2024-09-19T04:28:10.351 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-19T04:28:10.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T04:28:10.478 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911642 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/fs/test_o_trunc}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7911642' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule name: teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: max_mds: 1 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount dry_run: true install: ceph: flavor: default sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 kclient: client.0: mount_subvol_num: 1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 1747 sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 sleep_before_teardown: 0 subset: 176/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi002.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPbA3UXe69wYKaxAS/F/7Vkp2FvqJaals+iim898UuGOwcA+5kYFfGy4EvWFPNNND1p4aD8GWMgMJKpFEs/lIW8= smithi018.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA9Tx9aXtTRQF1YAJuSbAd+bwfQlGTOHEqrtsVXQSPvDA0kCash41W4JzdNNe2PardF7pgUg+9F4waNzzz7kcG8= smithi116.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGSx8dJRGVpdMQdQidIFkbqXFw6UZN8EofpWqGiX8nxqVkcTRHf4KAiPgqDbNsBWUyVKMLRbaEaA3jXKL9T8jw4= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - ceph-fuse: null - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph config set mgr mgr/snap_schedule/log_level debug - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - workunit: clients: all: - fs/test_o_trunc.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-18_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-19T04:28:10.478 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa; will attempt to use it 2024-09-19T04:28:10.479 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks 2024-09-19T04:28:10.479 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-19T04:28:10.482 INFO:teuthology.task.internal:Checking packages... 2024-09-19T04:28:10.502 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2f599a46ad10e37c929e5c43da2f6907ddcd1961' 2024-09-19T04:28:10.503 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T04:28:10.503 INFO:teuthology.packaging:ref: None 2024-09-19T04:28:10.503 INFO:teuthology.packaging:tag: None 2024-09-19T04:28:10.503 INFO:teuthology.packaging:branch: squid 2024-09-19T04:28:10.503 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T04:28:10.503 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-19T04:28:10.715 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-363.g6fad5dd7 2024-09-19T04:28:10.717 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-19T04:28:10.722 INFO:teuthology.task.internal:no buildpackages task found 2024-09-19T04:28:10.722 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-19T04:28:10.752 INFO:teuthology.task.internal:Saving configuration 2024-09-19T04:28:10.772 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-19T04:28:10.848 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-19T04:28:10.872 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi002.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911642', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 04:23:12.283594', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPbA3UXe69wYKaxAS/F/7Vkp2FvqJaals+iim898UuGOwcA+5kYFfGy4EvWFPNNND1p4aD8GWMgMJKpFEs/lIW8='} 2024-09-19T04:28:10.894 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi018.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911642', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 04:23:12.285938', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA9Tx9aXtTRQF1YAJuSbAd+bwfQlGTOHEqrtsVXQSPvDA0kCash41W4JzdNNe2PardF7pgUg+9F4waNzzz7kcG8='} 2024-09-19T04:28:10.914 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi116.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911642', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 04:23:12.284883', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGSx8dJRGVpdMQdQidIFkbqXFw6UZN8EofpWqGiX8nxqVkcTRHf4KAiPgqDbNsBWUyVKMLRbaEaA3jXKL9T8jw4='} 2024-09-19T04:28:10.915 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-19T04:28:10.920 INFO:teuthology.task.internal:roles: ubuntu@smithi002.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-19T04:28:10.920 INFO:teuthology.task.internal:roles: ubuntu@smithi018.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-19T04:28:10.920 INFO:teuthology.task.internal:roles: ubuntu@smithi116.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-19T04:28:10.920 INFO:teuthology.run_tasks:Running task console_log... 2024-09-19T04:28:11.067 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7faf79d17520>, signals=[15]) 2024-09-19T04:28:11.067 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-19T04:28:11.118 INFO:teuthology.task.internal:Opening connections... 2024-09-19T04:28:11.119 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi002.front.sepia.ceph.com 2024-09-19T04:28:11.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T04:28:11.196 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi018.front.sepia.ceph.com 2024-09-19T04:28:11.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T04:28:11.270 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi116.front.sepia.ceph.com 2024-09-19T04:28:11.271 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T04:28:11.344 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-19T04:28:11.349 DEBUG:teuthology.orchestra.run.smithi002:> uname -m 2024-09-19T04:28:11.367 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64 2024-09-19T04:28:11.367 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release 2024-09-19T04:28:11.425 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="CentOS Stream" 2024-09-19T04:28:11.425 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="9" 2024-09-19T04:28:11.425 INFO:teuthology.orchestra.run.smithi002.stdout:ID="centos" 2024-09-19T04:28:11.425 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="rhel fedora" 2024-09-19T04:28:11.425 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="9" 2024-09-19T04:28:11.425 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el9" 2024-09-19T04:28:11.425 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T04:28:11.425 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31" 2024-09-19T04:28:11.426 INFO:teuthology.orchestra.run.smithi002.stdout:LOGO="fedora-logo-icon" 2024-09-19T04:28:11.426 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T04:28:11.426 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://centos.org/" 2024-09-19T04:28:11.426 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T04:28:11.426 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T04:28:11.426 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T04:28:11.426 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2024-09-19T04:28:11.453 DEBUG:teuthology.orchestra.run.smithi018:> uname -m 2024-09-19T04:28:11.471 INFO:teuthology.orchestra.run.smithi018.stdout:x86_64 2024-09-19T04:28:11.472 DEBUG:teuthology.orchestra.run.smithi018:> cat /etc/os-release 2024-09-19T04:28:11.529 INFO:teuthology.orchestra.run.smithi018.stdout:NAME="CentOS Stream" 2024-09-19T04:28:11.529 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION="9" 2024-09-19T04:28:11.529 INFO:teuthology.orchestra.run.smithi018.stdout:ID="centos" 2024-09-19T04:28:11.529 INFO:teuthology.orchestra.run.smithi018.stdout:ID_LIKE="rhel fedora" 2024-09-19T04:28:11.530 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_ID="9" 2024-09-19T04:28:11.530 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM_ID="platform:el9" 2024-09-19T04:28:11.530 INFO:teuthology.orchestra.run.smithi018.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T04:28:11.530 INFO:teuthology.orchestra.run.smithi018.stdout:ANSI_COLOR="0;31" 2024-09-19T04:28:11.530 INFO:teuthology.orchestra.run.smithi018.stdout:LOGO="fedora-logo-icon" 2024-09-19T04:28:11.530 INFO:teuthology.orchestra.run.smithi018.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T04:28:11.530 INFO:teuthology.orchestra.run.smithi018.stdout:HOME_URL="https://centos.org/" 2024-09-19T04:28:11.530 INFO:teuthology.orchestra.run.smithi018.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T04:28:11.530 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T04:28:11.530 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T04:28:11.531 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server 2024-09-19T04:28:11.553 DEBUG:teuthology.orchestra.run.smithi116:> uname -m 2024-09-19T04:28:11.571 INFO:teuthology.orchestra.run.smithi116.stdout:x86_64 2024-09-19T04:28:11.572 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2024-09-19T04:28:11.630 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="CentOS Stream" 2024-09-19T04:28:11.630 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="9" 2024-09-19T04:28:11.630 INFO:teuthology.orchestra.run.smithi116.stdout:ID="centos" 2024-09-19T04:28:11.630 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="rhel fedora" 2024-09-19T04:28:11.630 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="9" 2024-09-19T04:28:11.630 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el9" 2024-09-19T04:28:11.631 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T04:28:11.631 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2024-09-19T04:28:11.631 INFO:teuthology.orchestra.run.smithi116.stdout:LOGO="fedora-logo-icon" 2024-09-19T04:28:11.631 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T04:28:11.631 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://centos.org/" 2024-09-19T04:28:11.631 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T04:28:11.631 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T04:28:11.631 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T04:28:11.631 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2024-09-19T04:28:11.669 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-19T04:28:11.679 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-19T04:28:11.760 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-19T04:28:11.761 DEBUG:teuthology.orchestra.run.smithi002:> test '!' -e /home/ubuntu/cephtest 2024-09-19T04:28:11.763 DEBUG:teuthology.orchestra.run.smithi018:> test '!' -e /home/ubuntu/cephtest 2024-09-19T04:28:11.768 DEBUG:teuthology.orchestra.run.smithi116:> test '!' -e /home/ubuntu/cephtest 2024-09-19T04:28:11.785 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-19T04:28:11.833 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-19T04:28:11.833 DEBUG:teuthology.orchestra.run.smithi002:> test -z $(ls -A /var/lib/ceph) 2024-09-19T04:28:11.836 DEBUG:teuthology.orchestra.run.smithi018:> test -z $(ls -A /var/lib/ceph) 2024-09-19T04:28:11.838 DEBUG:teuthology.orchestra.run.smithi116:> test -z $(ls -A /var/lib/ceph) 2024-09-19T04:28:11.867 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-19T04:28:11.938 INFO:teuthology.run_tasks:Running task kernel... 2024-09-19T04:28:11.951 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-19T04:28:11.951 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}, 'mon.c': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-19T04:28:11.952 DEBUG:teuthology.orchestra.run.smithi002:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T04:28:11.952 DEBUG:teuthology.orchestra.run.smithi018:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T04:28:11.953 DEBUG:teuthology.orchestra.run.smithi116:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T04:28:11.970 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T04:28:11.970 DEBUG:teuthology.orchestra.run.smithi018:> uname -r 2024-09-19T04:28:11.971 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T04:28:11.971 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T04:28:11.972 DEBUG:teuthology.orchestra.run.smithi116:> uname -r 2024-09-19T04:28:11.972 DEBUG:teuthology.orchestra.run.smithi002:> uname -r 2024-09-19T04:28:12.028 INFO:teuthology.orchestra.run.smithi018.stdout:5.14.0-503.el9.x86_64 2024-09-19T04:28:12.028 INFO:teuthology.task.kernel:Running kernel on smithi018: 5.14.0-503.el9.x86_64 2024-09-19T04:28:12.028 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum install -y kernel 2024-09-19T04:28:12.031 INFO:teuthology.orchestra.run.smithi116.stdout:5.14.0-503.el9.x86_64 2024-09-19T04:28:12.031 INFO:teuthology.orchestra.run.smithi002.stdout:5.14.0-503.el9.x86_64 2024-09-19T04:28:12.031 INFO:teuthology.task.kernel:Running kernel on smithi116: 5.14.0-503.el9.x86_64 2024-09-19T04:28:12.031 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum install -y kernel 2024-09-19T04:28:12.032 INFO:teuthology.task.kernel:Running kernel on smithi002: 5.14.0-503.el9.x86_64 2024-09-19T04:28:12.032 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum install -y kernel 2024-09-19T04:28:14.894 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - BaseOS 7.7 MB/s | 8.3 MB 00:01 2024-09-19T04:28:15.736 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - BaseOS 4.2 MB/s | 8.3 MB 00:01 2024-09-19T04:28:16.876 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - BaseOS 2.6 MB/s | 8.3 MB 00:03 2024-09-19T04:28:17.361 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - AppStream 35 MB/s | 20 MB 00:00 2024-09-19T04:28:19.502 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - AppStream 13 MB/s | 20 MB 00:01 2024-09-19T04:28:20.136 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - AppStream 4.9 MB/s | 20 MB 00:04 2024-09-19T04:28:22.787 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.5 MB 00:01 2024-09-19T04:28:23.852 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-19T04:28:24.412 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 19 kB 00:00 2024-09-19T04:28:24.894 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - CRB 7.8 MB/s | 6.5 MB 00:00 2024-09-19T04:28:25.208 INFO:teuthology.orchestra.run.smithi116.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-19T04:28:25.570 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 19 kB 00:00 2024-09-19T04:28:26.482 INFO:teuthology.orchestra.run.smithi018.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-19T04:28:26.587 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 19 kB 00:00 2024-09-19T04:28:27.490 INFO:teuthology.orchestra.run.smithi002.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-19T04:28:30.723 INFO:teuthology.orchestra.run.smithi116.stdout:lab-extras 16 kB/s | 1.7 kB 00:00 2024-09-19T04:28:32.079 INFO:teuthology.orchestra.run.smithi018.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-19T04:28:32.595 INFO:teuthology.orchestra.run.smithi116.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T04:28:32.595 INFO:teuthology.orchestra.run.smithi116.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T04:28:32.688 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-19T04:28:32.696 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-19T04:28:32.697 INFO:teuthology.orchestra.run.smithi116.stdout: Package Architecture Version Repository Size 2024-09-19T04:28:32.697 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-19T04:28:32.697 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-19T04:28:32.697 INFO:teuthology.orchestra.run.smithi116.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T04:28:32.697 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-09-19T04:28:32.697 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T04:28:32.697 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T04:28:32.697 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T04:28:32.697 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-19T04:28:32.697 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-19T04:28:32.697 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-19T04:28:32.698 INFO:teuthology.orchestra.run.smithi116.stdout:Install 4 Packages 2024-09-19T04:28:32.698 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-19T04:28:32.698 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 79 M 2024-09-19T04:28:32.698 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 126 M 2024-09-19T04:28:32.698 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-19T04:28:32.840 INFO:teuthology.orchestra.run.smithi116.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 296 kB/s | 36 kB 00:00 2024-09-19T04:28:33.138 INFO:teuthology.orchestra.run.smithi002.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-19T04:28:33.907 INFO:teuthology.orchestra.run.smithi116.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 13 MB/s | 16 MB 00:01 2024-09-19T04:28:34.069 INFO:teuthology.orchestra.run.smithi018.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T04:28:34.069 INFO:teuthology.orchestra.run.smithi018.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T04:28:34.164 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-09-19T04:28:34.168 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-19T04:28:34.168 INFO:teuthology.orchestra.run.smithi018.stdout: Package Architecture Version Repository Size 2024-09-19T04:28:34.168 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-19T04:28:34.168 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-09-19T04:28:34.168 INFO:teuthology.orchestra.run.smithi018.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T04:28:34.169 INFO:teuthology.orchestra.run.smithi018.stdout:Installing dependencies: 2024-09-19T04:28:34.169 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T04:28:34.169 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T04:28:34.169 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T04:28:34.169 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T04:28:34.169 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-09-19T04:28:34.169 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-19T04:28:34.169 INFO:teuthology.orchestra.run.smithi018.stdout:Install 4 Packages 2024-09-19T04:28:34.169 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T04:28:34.170 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 79 M 2024-09-19T04:28:34.170 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 126 M 2024-09-19T04:28:34.170 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-09-19T04:28:34.397 INFO:teuthology.orchestra.run.smithi018.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 288 kB/s | 36 kB 00:00 2024-09-19T04:28:34.416 INFO:teuthology.orchestra.run.smithi116.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 18 MB/s | 29 MB 00:01 2024-09-19T04:28:34.724 INFO:teuthology.orchestra.run.smithi116.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 17 MB/s | 35 MB 00:02 2024-09-19T04:28:34.725 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-19T04:28:34.725 INFO:teuthology.orchestra.run.smithi116.stdout:Total 39 MB/s | 79 MB 00:02 2024-09-19T04:28:35.153 INFO:teuthology.orchestra.run.smithi002.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T04:28:35.153 INFO:teuthology.orchestra.run.smithi002.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T04:28:35.245 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-19T04:28:35.251 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-19T04:28:35.252 INFO:teuthology.orchestra.run.smithi002.stdout: Package Architecture Version Repository Size 2024-09-19T04:28:35.252 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-19T04:28:35.252 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-19T04:28:35.252 INFO:teuthology.orchestra.run.smithi002.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T04:28:35.252 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-19T04:28:35.252 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T04:28:35.252 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T04:28:35.252 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T04:28:35.252 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:28:35.252 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-19T04:28:35.253 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-19T04:28:35.253 INFO:teuthology.orchestra.run.smithi002.stdout:Install 4 Packages 2024-09-19T04:28:35.253 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:28:35.253 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 79 M 2024-09-19T04:28:35.253 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 126 M 2024-09-19T04:28:35.253 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-19T04:28:35.403 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-19T04:28:35.456 INFO:teuthology.orchestra.run.smithi018.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 13 MB/s | 16 MB 00:01 2024-09-19T04:28:35.648 INFO:teuthology.orchestra.run.smithi002.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 325 kB/s | 36 kB 00:00 2024-09-19T04:28:35.751 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-19T04:28:35.751 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-19T04:28:36.056 INFO:teuthology.orchestra.run.smithi018.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 17 MB/s | 29 MB 00:01 2024-09-19T04:28:36.381 INFO:teuthology.orchestra.run.smithi018.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 16 MB/s | 35 MB 00:02 2024-09-19T04:28:36.381 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-09-19T04:28:36.382 INFO:teuthology.orchestra.run.smithi018.stdout:Total 36 MB/s | 79 MB 00:02 2024-09-19T04:28:36.710 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-19T04:28:36.710 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-19T04:28:37.086 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-09-19T04:28:37.414 INFO:teuthology.orchestra.run.smithi002.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 8.3 MB/s | 16 MB 00:01 2024-09-19T04:28:37.464 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-09-19T04:28:37.465 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-09-19T04:28:38.340 INFO:teuthology.orchestra.run.smithi002.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 11 MB/s | 29 MB 00:02 2024-09-19T04:28:38.496 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-09-19T04:28:38.497 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-09-19T04:28:39.107 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-19T04:28:39.506 INFO:teuthology.orchestra.run.smithi002.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 8.7 MB/s | 35 MB 00:03 2024-09-19T04:28:39.507 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-19T04:28:39.507 INFO:teuthology.orchestra.run.smithi002.stdout:Total 19 MB/s | 79 MB 00:04 2024-09-19T04:28:39.774 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T04:28:39.866 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T04:28:40.220 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-19T04:28:40.612 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-19T04:28:40.612 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-19T04:28:41.051 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-09-19T04:28:41.596 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-19T04:28:41.596 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-19T04:28:41.712 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T04:28:41.799 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T04:28:42.602 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T04:28:42.728 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T04:28:44.134 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-19T04:28:44.555 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T04:28:44.685 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T04:28:44.791 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T04:28:44.873 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T04:28:47.547 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T04:28:47.636 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T04:28:47.651 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T04:28:47.760 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T04:28:49.816 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T04:28:49.861 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T04:28:52.487 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T04:28:52.883 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T04:28:52.927 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T04:28:54.999 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T04:28:58.065 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T04:29:30.268 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T04:29:30.308 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T04:29:30.580 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T04:29:30.580 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T04:29:30.580 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T04:29:30.580 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T04:29:31.433 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T04:29:31.433 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-19T04:29:31.434 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-19T04:29:31.434 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T04:29:31.434 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T04:29:31.434 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T04:29:31.434 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T04:29:31.434 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-19T04:29:31.434 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-19T04:29:31.833 DEBUG:teuthology.orchestra.run.smithi116:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T04:29:31.919 INFO:teuthology.orchestra.run.smithi116.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T04:29:31.920 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T04:29:31.920 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T04:29:31.920 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T04:29:31.920 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T04:29:31.920 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2024-09-19T04:29:31.921 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi116.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T04:29:31.921 DEBUG:teuthology.orchestra.run.smithi116:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T04:29:31.980 INFO:teuthology.orchestra.run.smithi116.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T04:29:31.980 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T04:29:31.981 DEBUG:teuthology.orchestra.run.smithi116:> sudo rpm -qi grub2-tools 2024-09-19T04:29:32.015 INFO:teuthology.orchestra.run.smithi116.stdout:Name : grub2-tools 2024-09-19T04:29:32.015 INFO:teuthology.orchestra.run.smithi116.stdout:Epoch : 1 2024-09-19T04:29:32.015 INFO:teuthology.orchestra.run.smithi116.stdout:Version : 2.06 2024-09-19T04:29:32.015 INFO:teuthology.orchestra.run.smithi116.stdout:Release : 82.el9 2024-09-19T04:29:32.015 INFO:teuthology.orchestra.run.smithi116.stdout:Architecture: x86_64 2024-09-19T04:29:32.015 INFO:teuthology.orchestra.run.smithi116.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T04:29:32.015 INFO:teuthology.orchestra.run.smithi116.stdout:Group : Unspecified 2024-09-19T04:29:32.015 INFO:teuthology.orchestra.run.smithi116.stdout:Size : 8274670 2024-09-19T04:29:32.015 INFO:teuthology.orchestra.run.smithi116.stdout:License : GPLv3+ 2024-09-19T04:29:32.015 INFO:teuthology.orchestra.run.smithi116.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T04:29:32.015 INFO:teuthology.orchestra.run.smithi116.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T04:29:32.016 INFO:teuthology.orchestra.run.smithi116.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T04:29:32.016 INFO:teuthology.orchestra.run.smithi116.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T04:29:32.016 INFO:teuthology.orchestra.run.smithi116.stdout:Packager : builder@centos.org 2024-09-19T04:29:32.016 INFO:teuthology.orchestra.run.smithi116.stdout:Vendor : CentOS 2024-09-19T04:29:32.016 INFO:teuthology.orchestra.run.smithi116.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T04:29:32.016 INFO:teuthology.orchestra.run.smithi116.stdout:Summary : Support tools for GRUB. 2024-09-19T04:29:32.016 INFO:teuthology.orchestra.run.smithi116.stdout:Description : 2024-09-19T04:29:32.016 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-19T04:29:32.016 INFO:teuthology.orchestra.run.smithi116.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T04:29:32.016 INFO:teuthology.orchestra.run.smithi116.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T04:29:32.016 INFO:teuthology.orchestra.run.smithi116.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T04:29:32.016 INFO:teuthology.orchestra.run.smithi116.stdout:hardware devices. 2024-09-19T04:29:32.016 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-19T04:29:32.017 INFO:teuthology.orchestra.run.smithi116.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T04:29:32.017 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T04:29:32.018 INFO:teuthology.task.kernel:Updating grub on smithi116 to boot 5.14.0-508.el9.x86_64 2024-09-19T04:29:32.018 DEBUG:teuthology.orchestra.run.smithi116:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T04:29:32.642 INFO:teuthology.orchestra.run.smithi116.stderr:Generating grub configuration file ... 2024-09-19T04:29:33.972 INFO:teuthology.orchestra.run.smithi116.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T04:29:34.004 INFO:teuthology.orchestra.run.smithi116.stderr:done 2024-09-19T04:29:34.006 DEBUG:teuthology.orchestra.run.smithi116:> mktemp 2024-09-19T04:29:34.022 INFO:teuthology.orchestra.run.smithi116.stdout:/tmp/tmp.QoLKvDkV8Q 2024-09-19T04:29:34.022 DEBUG:teuthology.orchestra.run.smithi116:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.QoLKvDkV8Q 2024-09-19T04:29:34.094 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 0666 /tmp/tmp.QoLKvDkV8Q 2024-09-19T04:29:34.233 DEBUG:teuthology.orchestra.remote:smithi116:/tmp/tmp.QoLKvDkV8Q is 6KB 2024-09-19T04:29:34.281 DEBUG:teuthology.orchestra.run.smithi116:> rm -fr /tmp/tmp.QoLKvDkV8Q 2024-09-19T04:29:34.296 DEBUG:teuthology.orchestra.run.smithi116:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T04:29:34.319 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T04:29:34.358 INFO:teuthology.orchestra.run.smithi116.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T04:29:34.359 INFO:teuthology.orchestra.run.smithi116.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T04:29:34.359 INFO:teuthology.orchestra.run.smithi116.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T04:29:34.359 INFO:teuthology.orchestra.run.smithi116.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T04:29:34.360 DEBUG:teuthology.orchestra.run.smithi116:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T04:29:34.361 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T04:29:34.512 DEBUG:teuthology.orchestra.run.smithi116:> sudo shutdown -r now 2024-09-19T04:29:34.652 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T04:29:34.653 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T04:29:34.653 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T04:29:34.653 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T04:29:35.502 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T04:29:35.502 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T04:29:35.503 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-09-19T04:29:35.503 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T04:29:35.503 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T04:29:35.503 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T04:29:35.503 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T04:29:35.503 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T04:29:35.503 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-09-19T04:29:35.839 DEBUG:teuthology.orchestra.run.smithi018:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T04:29:35.930 INFO:teuthology.orchestra.run.smithi018.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T04:29:35.930 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T04:29:35.930 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T04:29:35.930 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T04:29:35.930 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T04:29:35.930 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-19T04:29:35.931 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi018.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T04:29:35.931 DEBUG:teuthology.orchestra.run.smithi018:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T04:29:35.989 INFO:teuthology.orchestra.run.smithi018.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T04:29:35.990 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T04:29:35.990 DEBUG:teuthology.orchestra.run.smithi018:> sudo rpm -qi grub2-tools 2024-09-19T04:29:36.024 INFO:teuthology.orchestra.run.smithi018.stdout:Name : grub2-tools 2024-09-19T04:29:36.024 INFO:teuthology.orchestra.run.smithi018.stdout:Epoch : 1 2024-09-19T04:29:36.025 INFO:teuthology.orchestra.run.smithi018.stdout:Version : 2.06 2024-09-19T04:29:36.025 INFO:teuthology.orchestra.run.smithi018.stdout:Release : 82.el9 2024-09-19T04:29:36.025 INFO:teuthology.orchestra.run.smithi018.stdout:Architecture: x86_64 2024-09-19T04:29:36.025 INFO:teuthology.orchestra.run.smithi018.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T04:29:36.025 INFO:teuthology.orchestra.run.smithi018.stdout:Group : Unspecified 2024-09-19T04:29:36.025 INFO:teuthology.orchestra.run.smithi018.stdout:Size : 8274670 2024-09-19T04:29:36.025 INFO:teuthology.orchestra.run.smithi018.stdout:License : GPLv3+ 2024-09-19T04:29:36.025 INFO:teuthology.orchestra.run.smithi018.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T04:29:36.025 INFO:teuthology.orchestra.run.smithi018.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T04:29:36.025 INFO:teuthology.orchestra.run.smithi018.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T04:29:36.026 INFO:teuthology.orchestra.run.smithi018.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T04:29:36.026 INFO:teuthology.orchestra.run.smithi018.stdout:Packager : builder@centos.org 2024-09-19T04:29:36.026 INFO:teuthology.orchestra.run.smithi018.stdout:Vendor : CentOS 2024-09-19T04:29:36.026 INFO:teuthology.orchestra.run.smithi018.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T04:29:36.026 INFO:teuthology.orchestra.run.smithi018.stdout:Summary : Support tools for GRUB. 2024-09-19T04:29:36.026 INFO:teuthology.orchestra.run.smithi018.stdout:Description : 2024-09-19T04:29:36.026 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T04:29:36.026 INFO:teuthology.orchestra.run.smithi018.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T04:29:36.026 INFO:teuthology.orchestra.run.smithi018.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T04:29:36.026 INFO:teuthology.orchestra.run.smithi018.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T04:29:36.026 INFO:teuthology.orchestra.run.smithi018.stdout:hardware devices. 2024-09-19T04:29:36.026 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T04:29:36.026 INFO:teuthology.orchestra.run.smithi018.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T04:29:36.027 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T04:29:36.027 INFO:teuthology.task.kernel:Updating grub on smithi018 to boot 5.14.0-508.el9.x86_64 2024-09-19T04:29:36.027 DEBUG:teuthology.orchestra.run.smithi018:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T04:29:36.665 INFO:teuthology.orchestra.run.smithi018.stderr:Generating grub configuration file ... 2024-09-19T04:29:37.288 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T04:29:37.329 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T04:29:37.703 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T04:29:37.704 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T04:29:37.704 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T04:29:37.704 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T04:29:37.927 INFO:teuthology.orchestra.run.smithi018.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T04:29:37.963 INFO:teuthology.orchestra.run.smithi018.stderr:done 2024-09-19T04:29:37.965 DEBUG:teuthology.orchestra.run.smithi018:> mktemp 2024-09-19T04:29:37.981 INFO:teuthology.orchestra.run.smithi018.stdout:/tmp/tmp.CzgXaZObD5 2024-09-19T04:29:37.981 DEBUG:teuthology.orchestra.run.smithi018:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.CzgXaZObD5 2024-09-19T04:29:38.048 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0666 /tmp/tmp.CzgXaZObD5 2024-09-19T04:29:38.193 DEBUG:teuthology.orchestra.remote:smithi018:/tmp/tmp.CzgXaZObD5 is 6KB 2024-09-19T04:29:38.243 DEBUG:teuthology.orchestra.run.smithi018:> rm -fr /tmp/tmp.CzgXaZObD5 2024-09-19T04:29:38.258 DEBUG:teuthology.orchestra.run.smithi018:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T04:29:38.320 INFO:teuthology.orchestra.run.smithi018.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T04:29:38.321 INFO:teuthology.orchestra.run.smithi018.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T04:29:38.321 INFO:teuthology.orchestra.run.smithi018.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T04:29:38.321 INFO:teuthology.orchestra.run.smithi018.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T04:29:38.322 DEBUG:teuthology.orchestra.run.smithi018:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T04:29:38.467 DEBUG:teuthology.orchestra.run.smithi018:> sudo shutdown -r now 2024-09-19T04:29:38.526 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T04:29:38.526 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:29:38.526 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-19T04:29:38.526 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T04:29:38.526 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T04:29:38.526 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T04:29:38.526 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T04:29:38.526 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:29:38.526 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-19T04:29:38.875 DEBUG:teuthology.orchestra.run.smithi002:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T04:29:38.969 INFO:teuthology.orchestra.run.smithi002.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T04:29:38.970 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T04:29:38.970 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T04:29:38.970 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T04:29:38.970 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T04:29:38.970 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-19T04:29:38.970 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi002.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T04:29:38.970 DEBUG:teuthology.orchestra.run.smithi002:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T04:29:39.029 INFO:teuthology.orchestra.run.smithi002.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T04:29:39.029 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T04:29:39.029 DEBUG:teuthology.orchestra.run.smithi002:> sudo rpm -qi grub2-tools 2024-09-19T04:29:39.061 INFO:teuthology.orchestra.run.smithi002.stdout:Name : grub2-tools 2024-09-19T04:29:39.061 INFO:teuthology.orchestra.run.smithi002.stdout:Epoch : 1 2024-09-19T04:29:39.061 INFO:teuthology.orchestra.run.smithi002.stdout:Version : 2.06 2024-09-19T04:29:39.061 INFO:teuthology.orchestra.run.smithi002.stdout:Release : 82.el9 2024-09-19T04:29:39.061 INFO:teuthology.orchestra.run.smithi002.stdout:Architecture: x86_64 2024-09-19T04:29:39.061 INFO:teuthology.orchestra.run.smithi002.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T04:29:39.062 INFO:teuthology.orchestra.run.smithi002.stdout:Group : Unspecified 2024-09-19T04:29:39.062 INFO:teuthology.orchestra.run.smithi002.stdout:Size : 8274670 2024-09-19T04:29:39.062 INFO:teuthology.orchestra.run.smithi002.stdout:License : GPLv3+ 2024-09-19T04:29:39.062 INFO:teuthology.orchestra.run.smithi002.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T04:29:39.062 INFO:teuthology.orchestra.run.smithi002.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T04:29:39.062 INFO:teuthology.orchestra.run.smithi002.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T04:29:39.062 INFO:teuthology.orchestra.run.smithi002.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T04:29:39.062 INFO:teuthology.orchestra.run.smithi002.stdout:Packager : builder@centos.org 2024-09-19T04:29:39.062 INFO:teuthology.orchestra.run.smithi002.stdout:Vendor : CentOS 2024-09-19T04:29:39.062 INFO:teuthology.orchestra.run.smithi002.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T04:29:39.062 INFO:teuthology.orchestra.run.smithi002.stdout:Summary : Support tools for GRUB. 2024-09-19T04:29:39.062 INFO:teuthology.orchestra.run.smithi002.stdout:Description : 2024-09-19T04:29:39.062 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:29:39.063 INFO:teuthology.orchestra.run.smithi002.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T04:29:39.063 INFO:teuthology.orchestra.run.smithi002.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T04:29:39.063 INFO:teuthology.orchestra.run.smithi002.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T04:29:39.063 INFO:teuthology.orchestra.run.smithi002.stdout:hardware devices. 2024-09-19T04:29:39.063 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:29:39.063 INFO:teuthology.orchestra.run.smithi002.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T04:29:39.064 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T04:29:39.064 INFO:teuthology.task.kernel:Updating grub on smithi002 to boot 5.14.0-508.el9.x86_64 2024-09-19T04:29:39.064 DEBUG:teuthology.orchestra.run.smithi002:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T04:29:39.717 INFO:teuthology.orchestra.run.smithi002.stderr:Generating grub configuration file ... 2024-09-19T04:29:40.959 INFO:teuthology.orchestra.run.smithi002.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T04:29:41.000 INFO:teuthology.orchestra.run.smithi002.stderr:done 2024-09-19T04:29:41.002 DEBUG:teuthology.orchestra.run.smithi002:> mktemp 2024-09-19T04:29:41.017 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.LTUC7jTUMq 2024-09-19T04:29:41.017 DEBUG:teuthology.orchestra.run.smithi002:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.LTUC7jTUMq 2024-09-19T04:29:41.089 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0666 /tmp/tmp.LTUC7jTUMq 2024-09-19T04:29:41.233 DEBUG:teuthology.orchestra.remote:smithi002:/tmp/tmp.LTUC7jTUMq is 6KB 2024-09-19T04:29:41.282 DEBUG:teuthology.orchestra.run.smithi002:> rm -fr /tmp/tmp.LTUC7jTUMq 2024-09-19T04:29:41.296 DEBUG:teuthology.orchestra.run.smithi002:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T04:29:41.358 INFO:teuthology.orchestra.run.smithi002.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T04:29:41.359 INFO:teuthology.orchestra.run.smithi002.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T04:29:41.359 INFO:teuthology.orchestra.run.smithi002.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T04:29:41.359 INFO:teuthology.orchestra.run.smithi002.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T04:29:41.360 DEBUG:teuthology.orchestra.run.smithi002:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T04:29:41.517 DEBUG:teuthology.orchestra.run.smithi002:> sudo shutdown -r now 2024-09-19T04:30:04.537 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2024-09-19T04:30:04.537 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-09-19T04:30:04.538 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T04:30:08.474 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-19T04:30:08.474 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-19T04:30:08.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T04:30:11.523 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-19T04:30:11.523 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-19T04:30:11.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T04:31:04.591 DEBUG:teuthology.orchestra.remote:timed out 2024-09-19T04:31:08.482 DEBUG:teuthology.orchestra.remote:timed out 2024-09-19T04:31:11.529 DEBUG:teuthology.orchestra.remote:timed out 2024-09-19T04:31:13.595 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-09-19T04:31:13.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T04:31:14.174 DEBUG:teuthology.orchestra.run.smithi116:> true 2024-09-19T04:31:14.632 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-09-19T04:31:14.632 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-508.el9.x86_64"... 2024-09-19T04:31:14.632 DEBUG:teuthology.orchestra.run.smithi116:> uname -r 2024-09-19T04:31:14.647 INFO:teuthology.orchestra.run.smithi116.stdout:5.14.0-508.el9.x86_64 2024-09-19T04:31:14.647 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T04:31:14.647 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T04:31:14.648 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T04:31:15.648 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-09-19T04:31:15.648 DEBUG:teuthology.orchestra.run.smithi116:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-19T04:31:15.726 INFO:teuthology.orchestra.run.smithi116.stdout:ttyS1 2024-09-19T04:31:15.751 DEBUG:teuthology.parallel:result is None 2024-09-19T04:31:17.483 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-19T04:31:17.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T04:31:17.973 DEBUG:teuthology.orchestra.run.smithi018:> true 2024-09-19T04:31:18.348 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-19T04:31:18.348 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-508.el9.x86_64"... 2024-09-19T04:31:18.348 DEBUG:teuthology.orchestra.run.smithi018:> uname -r 2024-09-19T04:31:18.363 INFO:teuthology.orchestra.run.smithi018.stdout:5.14.0-508.el9.x86_64 2024-09-19T04:31:18.364 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T04:31:18.364 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T04:31:18.364 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T04:31:19.365 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-19T04:31:19.365 DEBUG:teuthology.orchestra.run.smithi018:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-19T04:31:19.456 INFO:teuthology.orchestra.run.smithi018.stdout:ttyS1 2024-09-19T04:31:19.476 DEBUG:teuthology.parallel:result is None 2024-09-19T04:31:20.530 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-19T04:31:20.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T04:31:21.044 DEBUG:teuthology.orchestra.run.smithi002:> true 2024-09-19T04:31:21.614 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-19T04:31:21.614 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-508.el9.x86_64"... 2024-09-19T04:31:21.614 DEBUG:teuthology.orchestra.run.smithi002:> uname -r 2024-09-19T04:31:21.629 INFO:teuthology.orchestra.run.smithi002.stdout:5.14.0-508.el9.x86_64 2024-09-19T04:31:21.629 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T04:31:21.630 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T04:31:21.630 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T04:31:22.631 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-19T04:31:22.631 DEBUG:teuthology.orchestra.run.smithi002:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-19T04:31:22.700 INFO:teuthology.orchestra.run.smithi002.stdout:ttyS1 2024-09-19T04:31:22.725 DEBUG:teuthology.parallel:result is None 2024-09-19T04:31:22.725 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-19T04:31:22.734 INFO:teuthology.task.internal:Creating test directory... 2024-09-19T04:31:22.734 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T04:31:22.737 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T04:31:22.739 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T04:31:22.757 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-19T04:31:22.763 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-19T04:31:22.771 INFO:teuthology.task.internal:Creating archive directory... 2024-09-19T04:31:22.771 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T04:31:22.794 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T04:31:22.796 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T04:31:22.849 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-19T04:31:22.855 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-19T04:31:22.856 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T04:31:22.858 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T04:31:22.861 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T04:31:22.886 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T04:31:22.888 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T04:31:22.896 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T04:31:22.898 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T04:31:22.901 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T04:31:22.912 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T04:31:22.914 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-19T04:31:22.921 INFO:teuthology.task.internal:Configuring sudo... 2024-09-19T04:31:22.921 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T04:31:22.923 DEBUG:teuthology.orchestra.run.smithi018:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T04:31:22.937 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T04:31:22.966 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-19T04:31:22.974 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-19T04:31:22.974 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T04:31:22.990 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T04:31:23.001 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T04:31:23.021 DEBUG:teuthology.orchestra.run.smithi002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T04:31:23.083 DEBUG:teuthology.orchestra.run.smithi002:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T04:31:23.136 DEBUG:teuthology.orchestra.run.smithi002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T04:31:23.217 DEBUG:teuthology.orchestra.run.smithi002:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T04:31:23.260 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-19T04:31:23.260 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T04:31:23.326 DEBUG:teuthology.orchestra.run.smithi018:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T04:31:23.383 DEBUG:teuthology.orchestra.run.smithi018:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T04:31:23.496 DEBUG:teuthology.orchestra.run.smithi018:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T04:31:23.557 DEBUG:teuthology.orchestra.run.smithi018:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T04:31:23.617 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T04:31:23.617 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T04:31:23.719 DEBUG:teuthology.orchestra.run.smithi116:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T04:31:23.764 DEBUG:teuthology.orchestra.run.smithi116:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T04:31:23.824 DEBUG:teuthology.orchestra.run.smithi116:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T04:31:23.868 DEBUG:teuthology.orchestra.run.smithi116:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T04:31:23.909 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-19T04:31:23.909 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T04:31:23.975 DEBUG:teuthology.orchestra.run.smithi002:> sudo service rsyslog restart 2024-09-19T04:31:23.977 DEBUG:teuthology.orchestra.run.smithi018:> sudo service rsyslog restart 2024-09-19T04:31:23.982 DEBUG:teuthology.orchestra.run.smithi116:> sudo service rsyslog restart 2024-09-19T04:31:24.028 INFO:teuthology.orchestra.run.smithi002.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T04:31:24.070 INFO:teuthology.orchestra.run.smithi116.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T04:31:24.079 INFO:teuthology.orchestra.run.smithi018.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T04:31:24.380 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-19T04:31:24.387 INFO:teuthology.task.internal:Starting timer... 2024-09-19T04:31:24.387 INFO:teuthology.run_tasks:Running task pcp... 2024-09-19T04:31:24.466 INFO:teuthology.run_tasks:Running task selinux... 2024-09-19T04:31:24.509 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-19T04:31:24.510 DEBUG:teuthology.orchestra.run.smithi002:> sudo service auditd rotate 2024-09-19T04:31:24.554 INFO:teuthology.orchestra.run.smithi002.stdout:Rotating logs: 2024-09-19T04:31:24.555 DEBUG:teuthology.orchestra.run.smithi018:> sudo service auditd rotate 2024-09-19T04:31:24.853 INFO:teuthology.orchestra.run.smithi018.stdout:Rotating logs: 2024-09-19T04:31:24.855 DEBUG:teuthology.orchestra.run.smithi116:> sudo service auditd rotate 2024-09-19T04:31:24.926 INFO:teuthology.orchestra.run.smithi116.stdout:Rotating logs: 2024-09-19T04:31:24.928 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-19T04:31:24.928 DEBUG:teuthology.orchestra.run.smithi002:> /usr/sbin/getenforce 2024-09-19T04:31:24.960 INFO:teuthology.orchestra.run.smithi002.stdout:Permissive 2024-09-19T04:31:24.960 DEBUG:teuthology.orchestra.run.smithi018:> /usr/sbin/getenforce 2024-09-19T04:31:24.986 INFO:teuthology.orchestra.run.smithi018.stdout:Permissive 2024-09-19T04:31:24.987 DEBUG:teuthology.orchestra.run.smithi116:> /usr/sbin/getenforce 2024-09-19T04:31:25.020 INFO:teuthology.orchestra.run.smithi116.stdout:Permissive 2024-09-19T04:31:25.020 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi002.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi018.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi116.front.sepia.ceph.com': 'permissive'} 2024-09-19T04:31:25.021 DEBUG:teuthology.orchestra.run.smithi002:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T04:31:25.046 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T04:31:25.047 DEBUG:teuthology.orchestra.run.smithi018:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T04:31:25.075 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T04:31:25.076 DEBUG:teuthology.orchestra.run.smithi116:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T04:31:25.102 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T04:31:25.103 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-19T04:31:25.103 DEBUG:teuthology.orchestra.run.smithi002:> sudo /usr/sbin/setenforce permissive 2024-09-19T04:31:25.132 DEBUG:teuthology.orchestra.run.smithi018:> sudo /usr/sbin/setenforce permissive 2024-09-19T04:31:25.186 DEBUG:teuthology.orchestra.run.smithi116:> sudo /usr/sbin/setenforce permissive 2024-09-19T04:31:25.215 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-19T04:31:25.224 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-19T04:31:25.227 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-19T04:31:25.371 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-19T04:31:25.382 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-19T04:31:25.383 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi002.front.sepia.ceph.com,smithi018.front.sepia.ceph.com,smithi116.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-19T04:35:11.256 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi002.front.sepia.ceph.com'), Remote(name='ubuntu@smithi018.front.sepia.ceph.com'), Remote(name='ubuntu@smithi116.front.sepia.ceph.com')] 2024-09-19T04:35:11.258 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-19T04:35:11.259 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T04:35:11.337 DEBUG:teuthology.orchestra.run.smithi002:> true 2024-09-19T04:35:11.413 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-19T04:35:11.413 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-19T04:35:11.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T04:35:11.488 DEBUG:teuthology.orchestra.run.smithi018:> true 2024-09-19T04:35:11.573 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-19T04:35:11.574 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-09-19T04:35:11.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T04:35:11.650 DEBUG:teuthology.orchestra.run.smithi116:> true 2024-09-19T04:35:11.738 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-09-19T04:35:11.739 INFO:teuthology.run_tasks:Running task clock... 2024-09-19T04:35:11.750 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-19T04:35:11.750 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T04:35:11.751 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T04:35:11.753 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T04:35:11.753 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T04:35:11.755 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T04:35:11.756 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T04:35:11.784 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T04:35:11.787 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T04:35:11.800 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T04:35:11.804 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T04:35:11.808 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T04:35:11.823 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T04:35:11.827 INFO:teuthology.orchestra.run.smithi002.stderr:sudo: ntpd: command not found 2024-09-19T04:35:11.831 INFO:teuthology.orchestra.run.smithi018.stderr:sudo: ntpd: command not found 2024-09-19T04:35:11.839 INFO:teuthology.orchestra.run.smithi002.stdout:506 Cannot talk to daemon 2024-09-19T04:35:11.843 INFO:teuthology.orchestra.run.smithi018.stdout:506 Cannot talk to daemon 2024-09-19T04:35:11.848 INFO:teuthology.orchestra.run.smithi116.stderr:sudo: ntpd: command not found 2024-09-19T04:35:11.855 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T04:35:11.858 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T04:35:11.859 INFO:teuthology.orchestra.run.smithi116.stdout:506 Cannot talk to daemon 2024-09-19T04:35:11.870 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T04:35:11.873 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T04:35:11.873 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T04:35:11.887 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T04:35:11.933 INFO:teuthology.orchestra.run.smithi002.stderr:bash: line 1: ntpq: command not found 2024-09-19T04:35:11.934 INFO:teuthology.orchestra.run.smithi018.stderr:bash: line 1: ntpq: command not found 2024-09-19T04:35:11.937 INFO:teuthology.orchestra.run.smithi002.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T04:35:11.937 INFO:teuthology.orchestra.run.smithi002.stdout:=============================================================================== 2024-09-19T04:35:11.937 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T04:35:11.937 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T04:35:11.937 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T04:35:11.938 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T04:35:11.938 INFO:teuthology.orchestra.run.smithi018.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T04:35:11.938 INFO:teuthology.orchestra.run.smithi018.stdout:=============================================================================== 2024-09-19T04:35:11.939 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T04:35:11.939 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T04:35:11.939 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T04:35:11.939 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T04:35:11.942 INFO:teuthology.orchestra.run.smithi116.stderr:bash: line 1: ntpq: command not found 2024-09-19T04:35:11.945 INFO:teuthology.orchestra.run.smithi116.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T04:35:11.945 INFO:teuthology.orchestra.run.smithi116.stdout:=============================================================================== 2024-09-19T04:35:11.945 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T04:35:11.945 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T04:35:11.946 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T04:35:11.946 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T04:35:11.946 INFO:teuthology.run_tasks:Running task install... 2024-09-19T04:35:11.954 DEBUG:teuthology.task.install:project ceph 2024-09-19T04:35:11.955 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}} 2024-09-19T04:35:11.955 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'} 2024-09-19T04:35:11.955 INFO:teuthology.task.install:Using flavor: default 2024-09-19T04:35:11.960 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-19T04:35:11.960 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-19T04:35:11.960 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T04:35:11.961 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T04:35:11.963 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T04:35:11.964 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T04:35:11.965 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T04:35:11.965 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T04:35:12.111 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T04:35:12.111 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T04:35:12.120 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T04:35:12.121 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T04:35:12.124 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T04:35:12.124 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T04:35:12.325 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T04:35:12.325 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-19T04:35:12.326 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T04:35:12.342 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T04:35:12.343 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-19T04:35:12.343 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T04:35:12.345 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T04:35:12.345 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T04:35:12.345 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T04:35:12.351 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T04:35:12.352 DEBUG:teuthology.orchestra.run.smithi116:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T04:35:12.372 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T04:35:12.372 DEBUG:teuthology.orchestra.run.smithi002:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T04:35:12.373 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T04:35:12.374 DEBUG:teuthology.orchestra.run.smithi018:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T04:35:12.417 DEBUG:teuthology.orchestra.run.smithi116:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T04:35:12.440 DEBUG:teuthology.orchestra.run.smithi002:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T04:35:12.442 DEBUG:teuthology.orchestra.run.smithi018:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T04:35:12.493 DEBUG:teuthology.orchestra.run.smithi116:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T04:35:12.518 DEBUG:teuthology.orchestra.run.smithi002:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T04:35:12.520 DEBUG:teuthology.orchestra.run.smithi018:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T04:35:12.556 INFO:teuthology.orchestra.run.smithi116.stdout:check_obsoletes = 1 2024-09-19T04:35:12.558 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum clean all 2024-09-19T04:35:12.583 INFO:teuthology.orchestra.run.smithi002.stdout:check_obsoletes = 1 2024-09-19T04:35:12.585 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum clean all 2024-09-19T04:35:12.585 INFO:teuthology.orchestra.run.smithi018.stdout:check_obsoletes = 1 2024-09-19T04:35:12.587 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum clean all 2024-09-19T04:35:12.797 INFO:teuthology.orchestra.run.smithi116.stdout:45 files removed 2024-09-19T04:35:12.817 INFO:teuthology.orchestra.run.smithi002.stdout:45 files removed 2024-09-19T04:35:12.823 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T04:35:12.830 INFO:teuthology.orchestra.run.smithi018.stdout:45 files removed 2024-09-19T04:35:12.845 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T04:35:12.857 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T04:35:13.535 INFO:teuthology.orchestra.run.smithi116.stdout:ceph packages for x86_64 196 kB/s | 84 kB 00:00 2024-09-19T04:35:13.579 INFO:teuthology.orchestra.run.smithi018.stdout:ceph packages for x86_64 198 kB/s | 84 kB 00:00 2024-09-19T04:35:13.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph packages for x86_64 192 kB/s | 84 kB 00:00 2024-09-19T04:35:13.803 INFO:teuthology.orchestra.run.smithi116.stdout:ceph noarch packages 53 kB/s | 12 kB 00:00 2024-09-19T04:35:13.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph noarch packages 51 kB/s | 12 kB 00:00 2024-09-19T04:35:13.880 INFO:teuthology.orchestra.run.smithi018.stdout:ceph noarch packages 46 kB/s | 12 kB 00:00 2024-09-19T04:35:14.070 INFO:teuthology.orchestra.run.smithi116.stdout:ceph source packages 8.3 kB/s | 1.9 kB 00:00 2024-09-19T04:35:14.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph source packages 8.7 kB/s | 1.9 kB 00:00 2024-09-19T04:35:14.155 INFO:teuthology.orchestra.run.smithi018.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-19T04:35:14.583 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - BaseOS 19 MB/s | 8.3 MB 00:00 2024-09-19T04:35:14.772 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.3 MB 00:00 2024-09-19T04:35:15.786 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - BaseOS 4.9 MB/s | 8.3 MB 00:01 2024-09-19T04:35:20.559 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - AppStream 4.2 MB/s | 20 MB 00:04 2024-09-19T04:35:20.989 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - AppStream 4.0 MB/s | 20 MB 00:05 2024-09-19T04:35:21.446 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - AppStream 4.4 MB/s | 20 MB 00:04 2024-09-19T04:35:25.176 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - CRB 9.1 MB/s | 6.5 MB 00:00 2024-09-19T04:35:25.713 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-19T04:35:26.440 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - CRB 4.5 MB/s | 6.5 MB 00:01 2024-09-19T04:35:27.355 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - Extras packages 61 kB/s | 19 kB 00:00 2024-09-19T04:35:27.693 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - Extras packages 15 kB/s | 19 kB 00:01 2024-09-19T04:35:27.932 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - Extras packages 97 kB/s | 19 kB 00:00 2024-09-19T04:35:29.310 INFO:teuthology.orchestra.run.smithi116.stdout:Extra Packages for Enterprise Linux 12 MB/s | 23 MB 00:01 2024-09-19T04:35:29.415 INFO:teuthology.orchestra.run.smithi002.stdout:Extra Packages for Enterprise Linux 14 MB/s | 23 MB 00:01 2024-09-19T04:35:29.420 INFO:teuthology.orchestra.run.smithi018.stdout:Extra Packages for Enterprise Linux 17 MB/s | 23 MB 00:01 2024-09-19T04:35:34.707 INFO:teuthology.orchestra.run.smithi116.stdout:lab-extras 43 kB/s | 1.7 kB 00:00 2024-09-19T04:35:35.018 INFO:teuthology.orchestra.run.smithi018.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-19T04:35:35.045 INFO:teuthology.orchestra.run.smithi002.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-19T04:35:36.909 INFO:teuthology.orchestra.run.smithi116.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T04:35:36.910 INFO:teuthology.orchestra.run.smithi116.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T04:35:36.921 INFO:teuthology.orchestra.run.smithi116.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T04:35:36.922 INFO:teuthology.orchestra.run.smithi116.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T04:35:36.923 INFO:teuthology.orchestra.run.smithi116.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T04:35:36.924 INFO:teuthology.orchestra.run.smithi116.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T04:35:36.925 INFO:teuthology.orchestra.run.smithi116.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T04:35:36.928 INFO:teuthology.orchestra.run.smithi116.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T04:35:36.929 INFO:teuthology.orchestra.run.smithi116.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T04:35:36.992 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-19T04:35:37.010 INFO:teuthology.orchestra.run.smithi116.stdout:====================================================================================== 2024-09-19T04:35:37.010 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2024-09-19T04:35:37.010 INFO:teuthology.orchestra.run.smithi116.stdout:====================================================================================== 2024-09-19T04:35:37.011 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-19T04:35:37.011 INFO:teuthology.orchestra.run.smithi116.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T04:35:37.011 INFO:teuthology.orchestra.run.smithi116.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T04:35:37.011 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T04:35:37.011 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T04:35:37.011 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T04:35:37.011 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T04:35:37.011 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T04:35:37.011 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T04:35:37.011 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T04:35:37.011 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T04:35:37.011 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T04:35:37.011 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T04:35:37.012 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T04:35:37.012 INFO:teuthology.orchestra.run.smithi116.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T04:35:37.012 INFO:teuthology.orchestra.run.smithi116.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T04:35:37.012 INFO:teuthology.orchestra.run.smithi116.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T04:35:37.012 INFO:teuthology.orchestra.run.smithi116.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T04:35:37.012 INFO:teuthology.orchestra.run.smithi116.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T04:35:37.012 INFO:teuthology.orchestra.run.smithi116.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T04:35:37.012 INFO:teuthology.orchestra.run.smithi116.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T04:35:37.012 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T04:35:37.012 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T04:35:37.012 INFO:teuthology.orchestra.run.smithi116.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T04:35:37.012 INFO:teuthology.orchestra.run.smithi116.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T04:35:37.013 INFO:teuthology.orchestra.run.smithi116.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T04:35:37.013 INFO:teuthology.orchestra.run.smithi116.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T04:35:37.013 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T04:35:37.013 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T04:35:37.013 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T04:35:37.013 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T04:35:37.013 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T04:35:37.013 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T04:35:37.013 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T04:35:37.013 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T04:35:37.013 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T04:35:37.013 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T04:35:37.014 INFO:teuthology.orchestra.run.smithi116.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T04:35:37.014 INFO:teuthology.orchestra.run.smithi116.stdout:Upgrading: 2024-09-19T04:35:37.014 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T04:35:37.014 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T04:35:37.014 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T04:35:37.014 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T04:35:37.014 INFO:teuthology.orchestra.run.smithi116.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T04:35:37.014 INFO:teuthology.orchestra.run.smithi116.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T04:35:37.015 INFO:teuthology.orchestra.run.smithi116.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T04:35:37.015 INFO:teuthology.orchestra.run.smithi116.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T04:35:37.015 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-09-19T04:35:37.015 INFO:teuthology.orchestra.run.smithi116.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T04:35:37.015 INFO:teuthology.orchestra.run.smithi116.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T04:35:37.015 INFO:teuthology.orchestra.run.smithi116.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T04:35:37.015 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T04:35:37.015 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T04:35:37.015 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T04:35:37.015 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T04:35:37.015 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T04:35:37.016 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T04:35:37.016 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T04:35:37.016 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T04:35:37.016 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T04:35:37.016 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T04:35:37.016 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T04:35:37.016 INFO:teuthology.orchestra.run.smithi116.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T04:35:37.016 INFO:teuthology.orchestra.run.smithi116.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T04:35:37.016 INFO:teuthology.orchestra.run.smithi116.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T04:35:37.016 INFO:teuthology.orchestra.run.smithi116.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T04:35:37.016 INFO:teuthology.orchestra.run.smithi116.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T04:35:37.016 INFO:teuthology.orchestra.run.smithi116.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T04:35:37.017 INFO:teuthology.orchestra.run.smithi116.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T04:35:37.017 INFO:teuthology.orchestra.run.smithi116.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T04:35:37.017 INFO:teuthology.orchestra.run.smithi116.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T04:35:37.017 INFO:teuthology.orchestra.run.smithi116.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T04:35:37.017 INFO:teuthology.orchestra.run.smithi116.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T04:35:37.017 INFO:teuthology.orchestra.run.smithi116.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T04:35:37.017 INFO:teuthology.orchestra.run.smithi116.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T04:35:37.017 INFO:teuthology.orchestra.run.smithi116.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T04:35:37.017 INFO:teuthology.orchestra.run.smithi116.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T04:35:37.017 INFO:teuthology.orchestra.run.smithi116.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T04:35:37.017 INFO:teuthology.orchestra.run.smithi116.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T04:35:37.018 INFO:teuthology.orchestra.run.smithi116.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T04:35:37.018 INFO:teuthology.orchestra.run.smithi116.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T04:35:37.018 INFO:teuthology.orchestra.run.smithi116.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T04:35:37.018 INFO:teuthology.orchestra.run.smithi116.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T04:35:37.018 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T04:35:37.018 INFO:teuthology.orchestra.run.smithi116.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T04:35:37.018 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T04:35:37.018 INFO:teuthology.orchestra.run.smithi116.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T04:35:37.018 INFO:teuthology.orchestra.run.smithi116.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T04:35:37.018 INFO:teuthology.orchestra.run.smithi116.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T04:35:37.018 INFO:teuthology.orchestra.run.smithi116.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T04:35:37.018 INFO:teuthology.orchestra.run.smithi116.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T04:35:37.018 INFO:teuthology.orchestra.run.smithi116.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T04:35:37.019 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T04:35:37.019 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T04:35:37.019 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T04:35:37.019 INFO:teuthology.orchestra.run.smithi116.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T04:35:37.019 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T04:35:37.019 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T04:35:37.019 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T04:35:37.019 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T04:35:37.019 INFO:teuthology.orchestra.run.smithi116.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T04:35:37.019 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T04:35:37.019 INFO:teuthology.orchestra.run.smithi116.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T04:35:37.019 INFO:teuthology.orchestra.run.smithi116.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T04:35:37.019 INFO:teuthology.orchestra.run.smithi116.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T04:35:37.020 INFO:teuthology.orchestra.run.smithi116.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T04:35:37.020 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T04:35:37.020 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T04:35:37.020 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T04:35:37.020 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T04:35:37.020 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T04:35:37.020 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T04:35:37.020 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T04:35:37.020 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T04:35:37.020 INFO:teuthology.orchestra.run.smithi116.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T04:35:37.020 INFO:teuthology.orchestra.run.smithi116.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T04:35:37.020 INFO:teuthology.orchestra.run.smithi116.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T04:35:37.020 INFO:teuthology.orchestra.run.smithi116.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T04:35:37.021 INFO:teuthology.orchestra.run.smithi116.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T04:35:37.021 INFO:teuthology.orchestra.run.smithi116.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T04:35:37.021 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T04:35:37.021 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T04:35:37.021 INFO:teuthology.orchestra.run.smithi116.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T04:35:37.021 INFO:teuthology.orchestra.run.smithi116.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T04:35:37.021 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T04:35:37.021 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T04:35:37.021 INFO:teuthology.orchestra.run.smithi116.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T04:35:37.021 INFO:teuthology.orchestra.run.smithi116.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T04:35:37.021 INFO:teuthology.orchestra.run.smithi116.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T04:35:37.021 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T04:35:37.022 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T04:35:37.022 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T04:35:37.022 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T04:35:37.022 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T04:35:37.022 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T04:35:37.022 INFO:teuthology.orchestra.run.smithi116.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T04:35:37.022 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T04:35:37.022 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T04:35:37.022 INFO:teuthology.orchestra.run.smithi116.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T04:35:37.022 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T04:35:37.022 INFO:teuthology.orchestra.run.smithi116.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T04:35:37.022 INFO:teuthology.orchestra.run.smithi116.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T04:35:37.022 INFO:teuthology.orchestra.run.smithi116.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T04:35:37.023 INFO:teuthology.orchestra.run.smithi116.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T04:35:37.023 INFO:teuthology.orchestra.run.smithi116.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T04:35:37.023 INFO:teuthology.orchestra.run.smithi116.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T04:35:37.023 INFO:teuthology.orchestra.run.smithi116.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T04:35:37.023 INFO:teuthology.orchestra.run.smithi116.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T04:35:37.023 INFO:teuthology.orchestra.run.smithi116.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T04:35:37.023 INFO:teuthology.orchestra.run.smithi116.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T04:35:37.023 INFO:teuthology.orchestra.run.smithi116.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T04:35:37.023 INFO:teuthology.orchestra.run.smithi116.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T04:35:37.023 INFO:teuthology.orchestra.run.smithi116.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T04:35:37.023 INFO:teuthology.orchestra.run.smithi116.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T04:35:37.023 INFO:teuthology.orchestra.run.smithi116.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T04:35:37.023 INFO:teuthology.orchestra.run.smithi116.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T04:35:37.024 INFO:teuthology.orchestra.run.smithi116.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T04:35:37.024 INFO:teuthology.orchestra.run.smithi116.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T04:35:37.024 INFO:teuthology.orchestra.run.smithi116.stdout:Installing weak dependencies: 2024-09-19T04:35:37.024 INFO:teuthology.orchestra.run.smithi116.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T04:35:37.024 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-19T04:35:37.024 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-19T04:35:37.024 INFO:teuthology.orchestra.run.smithi116.stdout:====================================================================================== 2024-09-19T04:35:37.024 INFO:teuthology.orchestra.run.smithi116.stdout:Install 148 Packages 2024-09-19T04:35:37.024 INFO:teuthology.orchestra.run.smithi116.stdout:Upgrade 8 Packages 2024-09-19T04:35:37.024 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-19T04:35:37.025 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 226 M 2024-09-19T04:35:37.025 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-19T04:35:37.316 INFO:teuthology.orchestra.run.smithi002.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T04:35:37.317 INFO:teuthology.orchestra.run.smithi002.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T04:35:37.329 INFO:teuthology.orchestra.run.smithi018.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T04:35:37.330 INFO:teuthology.orchestra.run.smithi002.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T04:35:37.330 INFO:teuthology.orchestra.run.smithi018.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T04:35:37.331 INFO:teuthology.orchestra.run.smithi002.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T04:35:37.332 INFO:teuthology.orchestra.run.smithi002.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T04:35:37.333 INFO:teuthology.orchestra.run.smithi002.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T04:35:37.335 INFO:teuthology.orchestra.run.smithi002.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T04:35:37.338 INFO:teuthology.orchestra.run.smithi002.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T04:35:37.339 INFO:teuthology.orchestra.run.smithi002.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T04:35:37.344 INFO:teuthology.orchestra.run.smithi018.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T04:35:37.345 INFO:teuthology.orchestra.run.smithi018.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T04:35:37.346 INFO:teuthology.orchestra.run.smithi018.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T04:35:37.347 INFO:teuthology.orchestra.run.smithi018.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T04:35:37.349 INFO:teuthology.orchestra.run.smithi018.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T04:35:37.351 INFO:teuthology.orchestra.run.smithi018.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T04:35:37.352 INFO:teuthology.orchestra.run.smithi018.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T04:35:37.408 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-19T04:35:37.419 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-09-19T04:35:37.422 INFO:teuthology.orchestra.run.smithi002.stdout:====================================================================================== 2024-09-19T04:35:37.422 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-09-19T04:35:37.423 INFO:teuthology.orchestra.run.smithi002.stdout:====================================================================================== 2024-09-19T04:35:37.423 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-19T04:35:37.423 INFO:teuthology.orchestra.run.smithi002.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T04:35:37.423 INFO:teuthology.orchestra.run.smithi002.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T04:35:37.423 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T04:35:37.423 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T04:35:37.423 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T04:35:37.423 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T04:35:37.423 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T04:35:37.423 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T04:35:37.423 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T04:35:37.423 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T04:35:37.423 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T04:35:37.424 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T04:35:37.424 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T04:35:37.424 INFO:teuthology.orchestra.run.smithi002.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T04:35:37.424 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T04:35:37.424 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T04:35:37.424 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T04:35:37.424 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T04:35:37.424 INFO:teuthology.orchestra.run.smithi002.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T04:35:37.424 INFO:teuthology.orchestra.run.smithi002.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T04:35:37.424 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T04:35:37.424 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T04:35:37.424 INFO:teuthology.orchestra.run.smithi002.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T04:35:37.424 INFO:teuthology.orchestra.run.smithi002.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T04:35:37.425 INFO:teuthology.orchestra.run.smithi002.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T04:35:37.425 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T04:35:37.425 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T04:35:37.425 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T04:35:37.425 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T04:35:37.425 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T04:35:37.425 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T04:35:37.425 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T04:35:37.425 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T04:35:37.425 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T04:35:37.425 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T04:35:37.426 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T04:35:37.426 INFO:teuthology.orchestra.run.smithi002.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T04:35:37.426 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrading: 2024-09-19T04:35:37.426 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T04:35:37.426 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T04:35:37.426 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T04:35:37.426 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T04:35:37.426 INFO:teuthology.orchestra.run.smithi002.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T04:35:37.426 INFO:teuthology.orchestra.run.smithi002.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T04:35:37.426 INFO:teuthology.orchestra.run.smithi002.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T04:35:37.426 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T04:35:37.426 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-19T04:35:37.427 INFO:teuthology.orchestra.run.smithi002.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T04:35:37.427 INFO:teuthology.orchestra.run.smithi002.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T04:35:37.427 INFO:teuthology.orchestra.run.smithi002.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T04:35:37.427 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T04:35:37.427 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T04:35:37.427 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T04:35:37.427 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T04:35:37.427 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T04:35:37.427 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T04:35:37.427 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T04:35:37.427 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T04:35:37.427 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T04:35:37.427 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T04:35:37.428 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T04:35:37.428 INFO:teuthology.orchestra.run.smithi002.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T04:35:37.428 INFO:teuthology.orchestra.run.smithi002.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T04:35:37.428 INFO:teuthology.orchestra.run.smithi002.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T04:35:37.428 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T04:35:37.428 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T04:35:37.428 INFO:teuthology.orchestra.run.smithi002.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T04:35:37.428 INFO:teuthology.orchestra.run.smithi002.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T04:35:37.428 INFO:teuthology.orchestra.run.smithi002.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T04:35:37.428 INFO:teuthology.orchestra.run.smithi002.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T04:35:37.428 INFO:teuthology.orchestra.run.smithi002.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T04:35:37.428 INFO:teuthology.orchestra.run.smithi002.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T04:35:37.428 INFO:teuthology.orchestra.run.smithi002.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T04:35:37.429 INFO:teuthology.orchestra.run.smithi002.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T04:35:37.429 INFO:teuthology.orchestra.run.smithi002.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T04:35:37.429 INFO:teuthology.orchestra.run.smithi002.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T04:35:37.429 INFO:teuthology.orchestra.run.smithi002.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T04:35:37.429 INFO:teuthology.orchestra.run.smithi002.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T04:35:37.429 INFO:teuthology.orchestra.run.smithi002.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T04:35:37.429 INFO:teuthology.orchestra.run.smithi002.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T04:35:37.429 INFO:teuthology.orchestra.run.smithi002.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T04:35:37.429 INFO:teuthology.orchestra.run.smithi002.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T04:35:37.429 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T04:35:37.429 INFO:teuthology.orchestra.run.smithi002.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T04:35:37.429 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T04:35:37.429 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T04:35:37.430 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T04:35:37.430 INFO:teuthology.orchestra.run.smithi002.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T04:35:37.430 INFO:teuthology.orchestra.run.smithi002.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T04:35:37.430 INFO:teuthology.orchestra.run.smithi002.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T04:35:37.430 INFO:teuthology.orchestra.run.smithi002.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T04:35:37.430 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T04:35:37.430 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T04:35:37.430 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T04:35:37.430 INFO:teuthology.orchestra.run.smithi002.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T04:35:37.430 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T04:35:37.430 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T04:35:37.431 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T04:35:37.431 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T04:35:37.431 INFO:teuthology.orchestra.run.smithi002.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T04:35:37.431 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T04:35:37.431 INFO:teuthology.orchestra.run.smithi002.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T04:35:37.431 INFO:teuthology.orchestra.run.smithi002.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T04:35:37.431 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T04:35:37.431 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T04:35:37.431 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T04:35:37.431 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T04:35:37.431 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T04:35:37.431 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T04:35:37.432 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T04:35:37.432 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T04:35:37.432 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T04:35:37.432 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T04:35:37.432 INFO:teuthology.orchestra.run.smithi002.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T04:35:37.432 INFO:teuthology.orchestra.run.smithi002.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T04:35:37.432 INFO:teuthology.orchestra.run.smithi002.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T04:35:37.432 INFO:teuthology.orchestra.run.smithi002.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T04:35:37.432 INFO:teuthology.orchestra.run.smithi002.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T04:35:37.432 INFO:teuthology.orchestra.run.smithi002.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T04:35:37.432 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T04:35:37.432 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T04:35:37.432 INFO:teuthology.orchestra.run.smithi002.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T04:35:37.433 INFO:teuthology.orchestra.run.smithi002.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T04:35:37.433 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T04:35:37.433 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T04:35:37.433 INFO:teuthology.orchestra.run.smithi002.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T04:35:37.433 INFO:teuthology.orchestra.run.smithi002.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T04:35:37.433 INFO:teuthology.orchestra.run.smithi002.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T04:35:37.433 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T04:35:37.433 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T04:35:37.433 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T04:35:37.433 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T04:35:37.433 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T04:35:37.433 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T04:35:37.433 INFO:teuthology.orchestra.run.smithi002.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T04:35:37.434 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T04:35:37.434 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T04:35:37.434 INFO:teuthology.orchestra.run.smithi002.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T04:35:37.434 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T04:35:37.434 INFO:teuthology.orchestra.run.smithi002.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T04:35:37.434 INFO:teuthology.orchestra.run.smithi002.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T04:35:37.434 INFO:teuthology.orchestra.run.smithi002.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T04:35:37.434 INFO:teuthology.orchestra.run.smithi002.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T04:35:37.434 INFO:teuthology.orchestra.run.smithi002.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T04:35:37.434 INFO:teuthology.orchestra.run.smithi002.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T04:35:37.434 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T04:35:37.434 INFO:teuthology.orchestra.run.smithi002.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T04:35:37.434 INFO:teuthology.orchestra.run.smithi002.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T04:35:37.434 INFO:teuthology.orchestra.run.smithi002.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T04:35:37.434 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T04:35:37.435 INFO:teuthology.orchestra.run.smithi002.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T04:35:37.435 INFO:teuthology.orchestra.run.smithi002.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T04:35:37.435 INFO:teuthology.orchestra.run.smithi002.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T04:35:37.435 INFO:teuthology.orchestra.run.smithi002.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T04:35:37.435 INFO:teuthology.orchestra.run.smithi002.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T04:35:37.435 INFO:teuthology.orchestra.run.smithi002.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T04:35:37.435 INFO:teuthology.orchestra.run.smithi002.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T04:35:37.435 INFO:teuthology.orchestra.run.smithi002.stdout:Installing weak dependencies: 2024-09-19T04:35:37.435 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T04:35:37.435 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:35:37.435 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-19T04:35:37.435 INFO:teuthology.orchestra.run.smithi002.stdout:====================================================================================== 2024-09-19T04:35:37.435 INFO:teuthology.orchestra.run.smithi002.stdout:Install 148 Packages 2024-09-19T04:35:37.435 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrade 8 Packages 2024-09-19T04:35:37.435 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:35:37.436 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 226 M 2024-09-19T04:35:37.436 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-19T04:35:37.441 INFO:teuthology.orchestra.run.smithi018.stdout:====================================================================================== 2024-09-19T04:35:37.444 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repository Size 2024-09-19T04:35:37.445 INFO:teuthology.orchestra.run.smithi018.stdout:====================================================================================== 2024-09-19T04:35:37.445 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-09-19T04:35:37.445 INFO:teuthology.orchestra.run.smithi018.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T04:35:37.445 INFO:teuthology.orchestra.run.smithi018.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T04:35:37.445 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T04:35:37.445 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T04:35:37.445 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T04:35:37.445 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T04:35:37.445 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T04:35:37.445 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T04:35:37.445 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T04:35:37.445 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T04:35:37.446 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T04:35:37.446 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T04:35:37.446 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T04:35:37.446 INFO:teuthology.orchestra.run.smithi018.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T04:35:37.446 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T04:35:37.446 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T04:35:37.446 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T04:35:37.446 INFO:teuthology.orchestra.run.smithi018.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T04:35:37.446 INFO:teuthology.orchestra.run.smithi018.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T04:35:37.446 INFO:teuthology.orchestra.run.smithi018.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T04:35:37.446 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T04:35:37.447 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T04:35:37.447 INFO:teuthology.orchestra.run.smithi018.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T04:35:37.447 INFO:teuthology.orchestra.run.smithi018.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T04:35:37.447 INFO:teuthology.orchestra.run.smithi018.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T04:35:37.447 INFO:teuthology.orchestra.run.smithi018.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T04:35:37.447 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T04:35:37.447 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T04:35:37.447 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T04:35:37.447 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T04:35:37.447 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T04:35:37.447 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T04:35:37.448 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T04:35:37.448 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T04:35:37.448 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T04:35:37.448 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T04:35:37.448 INFO:teuthology.orchestra.run.smithi018.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T04:35:37.448 INFO:teuthology.orchestra.run.smithi018.stdout:Upgrading: 2024-09-19T04:35:37.448 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T04:35:37.448 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T04:35:37.448 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T04:35:37.448 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T04:35:37.448 INFO:teuthology.orchestra.run.smithi018.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T04:35:37.448 INFO:teuthology.orchestra.run.smithi018.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T04:35:37.448 INFO:teuthology.orchestra.run.smithi018.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T04:35:37.448 INFO:teuthology.orchestra.run.smithi018.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T04:35:37.449 INFO:teuthology.orchestra.run.smithi018.stdout:Installing dependencies: 2024-09-19T04:35:37.449 INFO:teuthology.orchestra.run.smithi018.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T04:35:37.449 INFO:teuthology.orchestra.run.smithi018.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T04:35:37.449 INFO:teuthology.orchestra.run.smithi018.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T04:35:37.449 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T04:35:37.449 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T04:35:37.449 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T04:35:37.449 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T04:35:37.449 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T04:35:37.449 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T04:35:37.449 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T04:35:37.450 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T04:35:37.450 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T04:35:37.450 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T04:35:37.450 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T04:35:37.450 INFO:teuthology.orchestra.run.smithi018.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T04:35:37.450 INFO:teuthology.orchestra.run.smithi018.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T04:35:37.450 INFO:teuthology.orchestra.run.smithi018.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T04:35:37.450 INFO:teuthology.orchestra.run.smithi018.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T04:35:37.450 INFO:teuthology.orchestra.run.smithi018.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T04:35:37.450 INFO:teuthology.orchestra.run.smithi018.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T04:35:37.450 INFO:teuthology.orchestra.run.smithi018.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T04:35:37.450 INFO:teuthology.orchestra.run.smithi018.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T04:35:37.450 INFO:teuthology.orchestra.run.smithi018.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T04:35:37.451 INFO:teuthology.orchestra.run.smithi018.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T04:35:37.451 INFO:teuthology.orchestra.run.smithi018.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T04:35:37.451 INFO:teuthology.orchestra.run.smithi018.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T04:35:37.451 INFO:teuthology.orchestra.run.smithi018.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T04:35:37.451 INFO:teuthology.orchestra.run.smithi018.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T04:35:37.451 INFO:teuthology.orchestra.run.smithi018.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T04:35:37.451 INFO:teuthology.orchestra.run.smithi018.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T04:35:37.451 INFO:teuthology.orchestra.run.smithi018.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T04:35:37.451 INFO:teuthology.orchestra.run.smithi018.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T04:35:37.451 INFO:teuthology.orchestra.run.smithi018.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T04:35:37.451 INFO:teuthology.orchestra.run.smithi018.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T04:35:37.451 INFO:teuthology.orchestra.run.smithi018.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T04:35:37.451 INFO:teuthology.orchestra.run.smithi018.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T04:35:37.452 INFO:teuthology.orchestra.run.smithi018.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T04:35:37.452 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T04:35:37.452 INFO:teuthology.orchestra.run.smithi018.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T04:35:37.452 INFO:teuthology.orchestra.run.smithi018.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T04:35:37.452 INFO:teuthology.orchestra.run.smithi018.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T04:35:37.452 INFO:teuthology.orchestra.run.smithi018.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T04:35:37.452 INFO:teuthology.orchestra.run.smithi018.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T04:35:37.452 INFO:teuthology.orchestra.run.smithi018.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T04:35:37.452 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T04:35:37.452 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T04:35:37.452 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T04:35:37.453 INFO:teuthology.orchestra.run.smithi018.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T04:35:37.453 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T04:35:37.453 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T04:35:37.453 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T04:35:37.453 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T04:35:37.453 INFO:teuthology.orchestra.run.smithi018.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T04:35:37.453 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T04:35:37.453 INFO:teuthology.orchestra.run.smithi018.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T04:35:37.453 INFO:teuthology.orchestra.run.smithi018.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T04:35:37.453 INFO:teuthology.orchestra.run.smithi018.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T04:35:37.453 INFO:teuthology.orchestra.run.smithi018.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T04:35:37.453 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T04:35:37.454 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T04:35:37.454 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T04:35:37.454 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T04:35:37.454 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T04:35:37.454 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T04:35:37.454 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T04:35:37.454 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T04:35:37.454 INFO:teuthology.orchestra.run.smithi018.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T04:35:37.454 INFO:teuthology.orchestra.run.smithi018.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T04:35:37.454 INFO:teuthology.orchestra.run.smithi018.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T04:35:37.454 INFO:teuthology.orchestra.run.smithi018.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T04:35:37.454 INFO:teuthology.orchestra.run.smithi018.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T04:35:37.454 INFO:teuthology.orchestra.run.smithi018.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T04:35:37.455 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T04:35:37.455 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T04:35:37.455 INFO:teuthology.orchestra.run.smithi018.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T04:35:37.455 INFO:teuthology.orchestra.run.smithi018.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T04:35:37.455 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T04:35:37.455 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T04:35:37.455 INFO:teuthology.orchestra.run.smithi018.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T04:35:37.455 INFO:teuthology.orchestra.run.smithi018.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T04:35:37.455 INFO:teuthology.orchestra.run.smithi018.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T04:35:37.455 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T04:35:37.455 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T04:35:37.455 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T04:35:37.456 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T04:35:37.456 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T04:35:37.456 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T04:35:37.456 INFO:teuthology.orchestra.run.smithi018.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T04:35:37.456 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T04:35:37.456 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T04:35:37.456 INFO:teuthology.orchestra.run.smithi018.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T04:35:37.456 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T04:35:37.456 INFO:teuthology.orchestra.run.smithi018.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T04:35:37.456 INFO:teuthology.orchestra.run.smithi018.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T04:35:37.456 INFO:teuthology.orchestra.run.smithi018.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T04:35:37.456 INFO:teuthology.orchestra.run.smithi018.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T04:35:37.457 INFO:teuthology.orchestra.run.smithi018.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T04:35:37.457 INFO:teuthology.orchestra.run.smithi018.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T04:35:37.457 INFO:teuthology.orchestra.run.smithi018.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T04:35:37.457 INFO:teuthology.orchestra.run.smithi018.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T04:35:37.457 INFO:teuthology.orchestra.run.smithi018.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T04:35:37.457 INFO:teuthology.orchestra.run.smithi018.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T04:35:37.457 INFO:teuthology.orchestra.run.smithi018.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T04:35:37.457 INFO:teuthology.orchestra.run.smithi018.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T04:35:37.457 INFO:teuthology.orchestra.run.smithi018.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T04:35:37.457 INFO:teuthology.orchestra.run.smithi018.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T04:35:37.457 INFO:teuthology.orchestra.run.smithi018.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T04:35:37.457 INFO:teuthology.orchestra.run.smithi018.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T04:35:37.457 INFO:teuthology.orchestra.run.smithi018.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T04:35:37.458 INFO:teuthology.orchestra.run.smithi018.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T04:35:37.458 INFO:teuthology.orchestra.run.smithi018.stdout:Installing weak dependencies: 2024-09-19T04:35:37.458 INFO:teuthology.orchestra.run.smithi018.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T04:35:37.458 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T04:35:37.458 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-09-19T04:35:37.458 INFO:teuthology.orchestra.run.smithi018.stdout:====================================================================================== 2024-09-19T04:35:37.458 INFO:teuthology.orchestra.run.smithi018.stdout:Install 148 Packages 2024-09-19T04:35:37.458 INFO:teuthology.orchestra.run.smithi018.stdout:Upgrade 8 Packages 2024-09-19T04:35:37.458 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T04:35:37.459 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 226 M 2024-09-19T04:35:37.459 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-09-19T04:35:37.683 INFO:teuthology.orchestra.run.smithi116.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 50 kB/s | 6.6 kB 00:00 2024-09-19T04:35:37.900 INFO:teuthology.orchestra.run.smithi116.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 4.0 MB/s | 896 kB 00:00 2024-09-19T04:35:37.994 INFO:teuthology.orchestra.run.smithi018.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 34 kB/s | 6.6 kB 00:00 2024-09-19T04:35:38.017 INFO:teuthology.orchestra.run.smithi116.stdout:(3/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 12 MB/s | 5.4 MB 00:00 2024-09-19T04:35:38.042 INFO:teuthology.orchestra.run.smithi116.stdout:(4/156): ceph-immutable-object-cache-19.1.1-361 1.0 MB/s | 145 kB 00:00 2024-09-19T04:35:38.121 INFO:teuthology.orchestra.run.smithi002.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 32 kB/s | 6.6 kB 00:00 2024-09-19T04:35:38.176 INFO:teuthology.orchestra.run.smithi116.stdout:(5/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 15 MB/s | 2.4 MB 00:00 2024-09-19T04:35:38.243 INFO:teuthology.orchestra.run.smithi116.stdout:(6/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 7.6 MB/s | 1.5 MB 00:00 2024-09-19T04:35:38.435 INFO:teuthology.orchestra.run.smithi116.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 18 MB/s | 4.7 MB 00:00 2024-09-19T04:35:38.980 INFO:teuthology.orchestra.run.smithi002.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 1.0 MB/s | 896 kB 00:00 2024-09-19T04:35:39.011 INFO:teuthology.orchestra.run.smithi018.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 881 kB/s | 896 kB 00:01 2024-09-19T04:35:39.047 INFO:teuthology.orchestra.run.smithi002.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 2.1 MB/s | 145 kB 00:00 2024-09-19T04:35:39.060 INFO:teuthology.orchestra.run.smithi116.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 14 MB/s | 21 MB 00:01 2024-09-19T04:35:39.118 INFO:teuthology.orchestra.run.smithi116.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 431 kB/s | 25 kB 00:00 2024-09-19T04:35:39.119 INFO:teuthology.orchestra.run.smithi018.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 1.3 MB/s | 145 kB 00:00 2024-09-19T04:35:39.252 INFO:teuthology.orchestra.run.smithi116.stdout:(10/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 13 MB/s | 11 MB 00:00 2024-09-19T04:35:39.311 INFO:teuthology.orchestra.run.smithi116.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 3.8 MB/s | 228 kB 00:00 2024-09-19T04:35:39.369 INFO:teuthology.orchestra.run.smithi116.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 463 kB/s | 27 kB 00:00 2024-09-19T04:35:39.428 INFO:teuthology.orchestra.run.smithi116.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 544 kB/s | 32 kB 00:00 2024-09-19T04:35:39.528 INFO:teuthology.orchestra.run.smithi116.stdout:(14/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 7.4 MB/s | 751 kB 00:00 2024-09-19T04:35:39.538 INFO:teuthology.orchestra.run.smithi002.stdout:(4/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 4.9 MB/s | 2.4 MB 00:00 2024-09-19T04:35:39.587 INFO:teuthology.orchestra.run.smithi116.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 2.7 MB/s | 163 kB 00:00 2024-09-19T04:35:39.654 INFO:teuthology.orchestra.run.smithi116.stdout:(16/156): librados-devel-19.1.1-361.g2f599a46.e 1.9 MB/s | 127 kB 00:00 2024-09-19T04:35:39.721 INFO:teuthology.orchestra.run.smithi116.stdout:(17/156): libradosstriper1-19.1.1-361.g2f599a46 7.4 MB/s | 506 kB 00:00 2024-09-19T04:35:39.945 INFO:teuthology.orchestra.run.smithi002.stdout:(5/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 3.7 MB/s | 1.5 MB 00:00 2024-09-19T04:35:40.078 INFO:teuthology.orchestra.run.smithi018.stdout:(4/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 2.4 MB/s | 5.4 MB 00:02 2024-09-19T04:35:40.087 INFO:teuthology.orchestra.run.smithi116.stdout:(18/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 15 MB/s | 5.3 MB 00:00 2024-09-19T04:35:40.121 INFO:teuthology.orchestra.run.smithi116.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 1.3 MB/s | 45 kB 00:00 2024-09-19T04:35:40.288 INFO:teuthology.orchestra.run.smithi116.stdout:(20/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 8.2 MB/s | 17 MB 00:02 2024-09-19T04:35:40.314 INFO:teuthology.orchestra.run.smithi116.stdout:(21/156): python3-ceph-common-19.1.1-361.g2f599 709 kB/s | 136 kB 00:00 2024-09-19T04:35:40.337 INFO:teuthology.orchestra.run.smithi018.stdout:(5/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 2.0 MB/s | 2.4 MB 00:01 2024-09-19T04:35:40.339 INFO:teuthology.orchestra.run.smithi116.stdout:(22/156): python3-cephfs-19.1.1-361.g2f599a46.e 3.2 MB/s | 161 kB 00:00 2024-09-19T04:35:40.356 INFO:teuthology.orchestra.run.smithi002.stdout:(6/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 11 MB/s | 4.7 MB 00:00 2024-09-19T04:35:40.364 INFO:teuthology.orchestra.run.smithi116.stdout:(23/156): python3-rados-19.1.1-361.g2f599a46.el 6.2 MB/s | 320 kB 00:00 2024-09-19T04:35:40.389 INFO:teuthology.orchestra.run.smithi116.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 5.8 MB/s | 300 kB 00:00 2024-09-19T04:35:40.414 INFO:teuthology.orchestra.run.smithi116.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.9 MB/s | 99 kB 00:00 2024-09-19T04:35:40.440 INFO:teuthology.orchestra.run.smithi116.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-19T04:35:40.478 INFO:teuthology.orchestra.run.smithi018.stdout:(6/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 3.8 MB/s | 1.5 MB 00:00 2024-09-19T04:35:40.524 INFO:teuthology.orchestra.run.smithi116.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 2.0 MB/s | 171 kB 00:00 2024-09-19T04:35:40.599 INFO:teuthology.orchestra.run.smithi116.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 425 kB/s | 32 kB 00:00 2024-09-19T04:35:40.682 INFO:teuthology.orchestra.run.smithi116.stdout:(29/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 12 MB/s | 3.1 MB 00:00 2024-09-19T04:35:40.708 INFO:teuthology.orchestra.run.smithi116.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 1.3 MB/s | 146 kB 00:00 2024-09-19T04:35:40.814 INFO:teuthology.orchestra.run.smithi002.stdout:(7/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 1.9 MB/s | 5.4 MB 00:02 2024-09-19T04:35:40.975 INFO:teuthology.orchestra.run.smithi116.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 12 MB/s | 3.6 MB 00:00 2024-09-19T04:35:41.058 INFO:teuthology.orchestra.run.smithi116.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 2.9 MB/s | 249 kB 00:00 2024-09-19T04:35:41.142 INFO:teuthology.orchestra.run.smithi116.stdout:(33/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 591 kB/s | 49 kB 00:00 2024-09-19T04:35:41.225 INFO:teuthology.orchestra.run.smithi116.stdout:(34/156): ceph-prometheus-alerts-19.1.1-361.g2f 198 kB/s | 16 kB 00:00 2024-09-19T04:35:41.309 INFO:teuthology.orchestra.run.smithi116.stdout:(35/156): ceph-volume-19.1.1-361.g2f599a46.el9. 3.3 MB/s | 285 kB 00:00 2024-09-19T04:35:41.384 INFO:teuthology.orchestra.run.smithi116.stdout:(36/156): cephadm-19.1.1-361.g2f599a46.el9.noar 10 MB/s | 765 kB 00:00 2024-09-19T04:35:41.439 INFO:teuthology.orchestra.run.smithi002.stdout:(8/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86_ 16 MB/s | 17 MB 00:01 2024-09-19T04:35:41.443 INFO:teuthology.orchestra.run.smithi116.stdout:(37/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 312 kB/s | 18 kB 00:00 2024-09-19T04:35:41.481 INFO:teuthology.orchestra.run.smithi002.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 605 kB/s | 25 kB 00:00 2024-09-19T04:35:41.660 INFO:teuthology.orchestra.run.smithi116.stdout:(38/156): ceph-mgr-diskprediction-local-19.1.1- 7.8 MB/s | 7.4 MB 00:00 2024-09-19T04:35:41.685 INFO:teuthology.orchestra.run.smithi116.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 329 kB/s | 80 kB 00:00 2024-09-19T04:35:41.844 INFO:teuthology.orchestra.run.smithi116.stdout:(40/156): libgfortran-11.5.0-2.el9.x86_64.rpm 4.3 MB/s | 801 kB 00:00 2024-09-19T04:35:41.877 INFO:teuthology.orchestra.run.smithi116.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 996 kB/s | 191 kB 00:00 2024-09-19T04:35:41.903 INFO:teuthology.orchestra.run.smithi116.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-09-19T04:35:42.328 INFO:teuthology.orchestra.run.smithi116.stdout:(43/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 15 MB/s | 49 MB 00:03 2024-09-19T04:35:42.353 INFO:teuthology.orchestra.run.smithi116.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 236 kB/s | 106 kB 00:00 2024-09-19T04:35:42.404 INFO:teuthology.orchestra.run.smithi116.stdout:(45/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-19T04:35:42.454 INFO:teuthology.orchestra.run.smithi116.stdout:(46/156): python3-cryptography-36.0.1-4.el9.x86 2.1 MB/s | 1.2 MB 00:00 2024-09-19T04:35:42.479 INFO:teuthology.orchestra.run.smithi116.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-09-19T04:35:42.529 INFO:teuthology.orchestra.run.smithi116.stdout:(48/156): python3-pycparser-2.20-6.el9.noarch.r 674 kB/s | 135 kB 00:00 2024-09-19T04:35:42.578 INFO:teuthology.orchestra.run.smithi018.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 2.1 MB/s | 4.7 MB 00:02 2024-09-19T04:35:42.638 INFO:teuthology.orchestra.run.smithi116.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 5.8 MB/s | 943 kB 00:00 2024-09-19T04:35:42.663 INFO:teuthology.orchestra.run.smithi116.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 800 kB/s | 107 kB 00:00 2024-09-19T04:35:42.697 INFO:teuthology.orchestra.run.smithi116.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 371 kB/s | 22 kB 00:00 2024-09-19T04:35:42.772 INFO:teuthology.orchestra.run.smithi116.stdout:(52/156): automake-1.16.2-8.el9.noarch.rpm 2.1 MB/s | 689 kB 00:00 2024-09-19T04:35:42.789 INFO:teuthology.orchestra.run.smithi116.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 355 kB/s | 33 kB 00:00 2024-09-19T04:35:42.814 INFO:teuthology.orchestra.run.smithi116.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.0 MB/s | 313 kB 00:00 2024-09-19T04:35:42.848 INFO:teuthology.orchestra.run.smithi116.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 311 kB/s | 18 kB 00:00 2024-09-19T04:35:42.923 INFO:teuthology.orchestra.run.smithi116.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 102 kB/s | 11 kB 00:00 2024-09-19T04:35:42.949 INFO:teuthology.orchestra.run.smithi116.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.6 MB/s | 160 kB 00:00 2024-09-19T04:35:42.982 INFO:teuthology.orchestra.run.smithi116.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 773 kB/s | 45 kB 00:00 2024-09-19T04:35:43.074 INFO:teuthology.orchestra.run.smithi116.stdout:(59/156): libtool-2.4.6-46.el9.x86_64.rpm 6.2 MB/s | 581 kB 00:00 2024-09-19T04:35:43.124 INFO:teuthology.orchestra.run.smithi116.stdout:(60/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 8.5 MB/s | 3.0 MB 00:00 2024-09-19T04:35:43.141 INFO:teuthology.orchestra.run.smithi116.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 366 kB/s | 24 kB 00:00 2024-09-19T04:35:43.166 INFO:teuthology.orchestra.run.smithi116.stdout:(62/156): librdkafka-1.6.1-102.el9.x86_64.rpm 3.0 MB/s | 662 kB 00:00 2024-09-19T04:35:43.200 INFO:teuthology.orchestra.run.smithi116.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 630 kB/s | 47 kB 00:00 2024-09-19T04:35:43.206 INFO:teuthology.orchestra.run.smithi002.stdout:(10/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 28 MB/s | 49 MB 00:01 2024-09-19T04:35:43.242 INFO:teuthology.orchestra.run.smithi116.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-09-19T04:35:43.267 INFO:teuthology.orchestra.run.smithi116.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-09-19T04:35:43.284 INFO:teuthology.orchestra.run.smithi116.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 458 kB/s | 38 kB 00:00 2024-09-19T04:35:43.409 INFO:teuthology.orchestra.run.smithi116.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 30 MB/s | 4.9 MB 00:00 2024-09-19T04:35:43.448 INFO:teuthology.orchestra.run.smithi002.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 945 kB/s | 228 kB 00:00 2024-09-19T04:35:43.476 INFO:teuthology.orchestra.run.smithi116.stdout:(68/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 21 MB/s | 4.4 MB 00:00 2024-09-19T04:35:43.507 INFO:teuthology.orchestra.run.smithi002.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 462 kB/s | 27 kB 00:00 2024-09-19T04:35:43.518 INFO:teuthology.orchestra.run.smithi116.stdout:(69/156): postgresql-13.16-1.el9.x86_64.rpm 6.8 MB/s | 1.6 MB 00:00 2024-09-19T04:35:43.552 INFO:teuthology.orchestra.run.smithi116.stdout:(70/156): postgresql-contrib-13.16-1.el9.x86_64 6.2 MB/s | 910 kB 00:00 2024-09-19T04:35:43.566 INFO:teuthology.orchestra.run.smithi002.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 544 kB/s | 32 kB 00:00 2024-09-19T04:35:43.577 INFO:teuthology.orchestra.run.smithi116.stdout:(71/156): postgresql-private-libs-13.16-1.el9.x 1.3 MB/s | 137 kB 00:00 2024-09-19T04:35:43.628 INFO:teuthology.orchestra.run.smithi116.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-09-19T04:35:43.652 INFO:teuthology.orchestra.run.smithi116.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.1 MB/s | 87 kB 00:00 2024-09-19T04:35:43.658 INFO:teuthology.orchestra.run.smithi002.stdout:(14/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 8.0 MB/s | 751 kB 00:00 2024-09-19T04:35:43.720 INFO:teuthology.orchestra.run.smithi116.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 918 kB/s | 61 kB 00:00 2024-09-19T04:35:43.733 INFO:teuthology.orchestra.run.smithi002.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 2.1 MB/s | 163 kB 00:00 2024-09-19T04:35:43.795 INFO:teuthology.orchestra.run.smithi116.stdout:(75/156): python3-babel-2.9.1-2.el9.noarch.rpm 36 MB/s | 6.0 MB 00:00 2024-09-19T04:35:43.800 INFO:teuthology.orchestra.run.smithi002.stdout:(16/156): librados-devel-19.1.1-361.g2f599a46.e 1.9 MB/s | 127 kB 00:00 2024-09-19T04:35:43.820 INFO:teuthology.orchestra.run.smithi116.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-19T04:35:43.862 INFO:teuthology.orchestra.run.smithi116.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 3.6 MB/s | 248 kB 00:00 2024-09-19T04:35:43.867 INFO:teuthology.orchestra.run.smithi002.stdout:(17/156): libradosstriper1-19.1.1-361.g2f599a46 7.4 MB/s | 506 kB 00:00 2024-09-19T04:35:43.896 INFO:teuthology.orchestra.run.smithi116.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 340 kB/s | 26 kB 00:00 2024-09-19T04:35:43.971 INFO:teuthology.orchestra.run.smithi116.stdout:(79/156): postgresql-server-13.16-1.el9.x86_64. 13 MB/s | 5.8 MB 00:00 2024-09-19T04:35:43.996 INFO:teuthology.orchestra.run.smithi116.stdout:(80/156): python3-jsonpointer-2.0-4.el9.noarch. 143 kB/s | 19 kB 00:00 2024-09-19T04:35:44.020 INFO:teuthology.orchestra.run.smithi018.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 3.4 MB/s | 21 MB 00:06 2024-09-19T04:35:44.022 INFO:teuthology.orchestra.run.smithi116.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-19T04:35:44.047 INFO:teuthology.orchestra.run.smithi116.stdout:(82/156): python3-markupsafe-1.1.1-12.el9.x86_6 461 kB/s | 35 kB 00:00 2024-09-19T04:35:44.121 INFO:teuthology.orchestra.run.smithi018.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 252 kB/s | 25 kB 00:00 2024-09-19T04:35:44.139 INFO:teuthology.orchestra.run.smithi116.stdout:(83/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 36 MB/s | 5.1 MB 00:00 2024-09-19T04:35:44.150 INFO:teuthology.orchestra.run.smithi002.stdout:(18/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 19 MB/s | 5.3 MB 00:00 2024-09-19T04:35:44.164 INFO:teuthology.orchestra.run.smithi116.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 1.9 MB/s | 222 kB 00:00 2024-09-19T04:35:44.189 INFO:teuthology.orchestra.run.smithi116.stdout:(85/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.5 MB/s | 250 kB 00:00 2024-09-19T04:35:44.192 INFO:teuthology.orchestra.run.smithi002.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 1.1 MB/s | 45 kB 00:00 2024-09-19T04:35:44.214 INFO:teuthology.orchestra.run.smithi116.stdout:(86/156): python3-packaging-20.9-5.el9.noarch.r 1.0 MB/s | 77 kB 00:00 2024-09-19T04:35:44.243 INFO:teuthology.orchestra.run.smithi002.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 2.7 MB/s | 136 kB 00:00 2024-09-19T04:35:44.248 INFO:teuthology.orchestra.run.smithi116.stdout:(87/156): python3-prettytable-0.7.2-27.el9.noar 504 kB/s | 42 kB 00:00 2024-09-19T04:35:44.273 INFO:teuthology.orchestra.run.smithi116.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 3.1 MB/s | 269 kB 00:00 2024-09-19T04:35:44.298 INFO:teuthology.orchestra.run.smithi116.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 159 kB 00:00 2024-09-19T04:35:44.301 INFO:teuthology.orchestra.run.smithi002.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 2.7 MB/s | 161 kB 00:00 2024-09-19T04:35:44.332 INFO:teuthology.orchestra.run.smithi116.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 873 kB/s | 51 kB 00:00 2024-09-19T04:35:44.357 INFO:teuthology.orchestra.run.smithi116.stdout:(91/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 279 kB 00:00 2024-09-19T04:35:44.383 INFO:teuthology.orchestra.run.smithi116.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 639 kB/s | 54 kB 00:00 2024-09-19T04:35:44.441 INFO:teuthology.orchestra.run.smithi116.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 498 kB/s | 42 kB 00:00 2024-09-19T04:35:44.443 INFO:teuthology.orchestra.run.smithi002.stdout:(22/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 2.9 MB/s | 11 MB 00:03 2024-09-19T04:35:44.466 INFO:teuthology.orchestra.run.smithi116.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 529 kB/s | 44 kB 00:00 2024-09-19T04:35:44.468 INFO:teuthology.orchestra.run.smithi002.stdout:(23/156): python3-rados-19.1.1-361.g2f599a46.el 1.9 MB/s | 320 kB 00:00 2024-09-19T04:35:44.508 INFO:teuthology.orchestra.run.smithi116.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-09-19T04:35:44.519 INFO:teuthology.orchestra.run.smithi002.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 3.9 MB/s | 300 kB 00:00 2024-09-19T04:35:44.534 INFO:teuthology.orchestra.run.smithi116.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 536 kB/s | 36 kB 00:00 2024-09-19T04:35:44.544 INFO:teuthology.orchestra.run.smithi002.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.3 MB/s | 99 kB 00:00 2024-09-19T04:35:44.576 INFO:teuthology.orchestra.run.smithi116.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 708 kB/s | 47 kB 00:00 2024-09-19T04:35:44.587 INFO:teuthology.orchestra.run.smithi018.stdout:(10/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 4.1 MB/s | 17 MB 00:04 2024-09-19T04:35:44.601 INFO:teuthology.orchestra.run.smithi116.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 4.4 MB/s | 304 kB 00:00 2024-09-19T04:35:44.660 INFO:teuthology.orchestra.run.smithi116.stdout:(99/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.6 MB/s | 96 kB 00:00 2024-09-19T04:35:44.685 INFO:teuthology.orchestra.run.smithi116.stdout:(100/156): uuid-1.6.2-55.el9.x86_64.rpm 530 kB/s | 58 kB 00:00 2024-09-19T04:35:44.694 INFO:teuthology.orchestra.run.smithi002.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 487 kB/s | 85 kB 00:00 2024-09-19T04:35:44.796 INFO:teuthology.orchestra.run.smithi018.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 1.1 MB/s | 228 kB 00:00 2024-09-19T04:35:44.811 INFO:teuthology.orchestra.run.smithi002.stdout:(27/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 12 MB/s | 3.1 MB 00:00 2024-09-19T04:35:44.836 INFO:teuthology.orchestra.run.smithi116.stdout:(101/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-09-19T04:35:44.846 INFO:teuthology.orchestra.run.smithi018.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 541 kB/s | 27 kB 00:00 2024-09-19T04:35:44.853 INFO:teuthology.orchestra.run.smithi002.stdout:(28/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 1.1 MB/s | 171 kB 00:00 2024-09-19T04:35:44.861 INFO:teuthology.orchestra.run.smithi116.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 255 kB/s | 45 kB 00:00 2024-09-19T04:35:44.870 INFO:teuthology.orchestra.run.smithi002.stdout:(29/156): ceph-grafana-dashboards-19.1.1-361.g2 546 kB/s | 32 kB 00:00 2024-09-19T04:35:44.886 INFO:teuthology.orchestra.run.smithi116.stdout:(103/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 282 kB/s | 64 kB 00:00 2024-09-19T04:35:44.888 INFO:teuthology.orchestra.run.smithi018.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 762 kB/s | 32 kB 00:00 2024-09-19T04:35:44.903 INFO:teuthology.orchestra.run.smithi002.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 2.9 MB/s | 146 kB 00:00 2024-09-19T04:35:44.945 INFO:teuthology.orchestra.run.smithi116.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-19T04:35:44.970 INFO:teuthology.orchestra.run.smithi116.stdout:(105/156): lua-devel-5.4.4-4.el9.x86_64.rpm 167 kB/s | 22 kB 00:00 2024-09-19T04:35:45.013 INFO:teuthology.orchestra.run.smithi116.stdout:(106/156): gperftools-libs-2.9.1-3.el9.x86_64.r 4.5 MB/s | 308 kB 00:00 2024-09-19T04:35:45.037 INFO:teuthology.orchestra.run.smithi116.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 292 kB/s | 19 kB 00:00 2024-09-19T04:35:45.063 INFO:teuthology.orchestra.run.smithi116.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-19T04:35:45.079 INFO:teuthology.orchestra.run.smithi002.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 17 MB/s | 3.6 MB 00:00 2024-09-19T04:35:45.096 INFO:teuthology.orchestra.run.smithi116.stdout:(109/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.6 MB/s | 863 kB 00:00 2024-09-19T04:35:45.121 INFO:teuthology.orchestra.run.smithi116.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 830 kB/s | 49 kB 00:00 2024-09-19T04:35:45.129 INFO:teuthology.orchestra.run.smithi002.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 4.9 MB/s | 249 kB 00:00 2024-09-19T04:35:45.171 INFO:teuthology.orchestra.run.smithi116.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 3.5 MB/s | 151 kB 00:00 2024-09-19T04:35:45.180 INFO:teuthology.orchestra.run.smithi018.stdout:(14/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 4.1 MB/s | 11 MB 00:02 2024-09-19T04:35:45.196 INFO:teuthology.orchestra.run.smithi002.stdout:(33/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 740 kB/s | 49 kB 00:00 2024-09-19T04:35:45.197 INFO:teuthology.orchestra.run.smithi116.stdout:(112/156): libunwind-1.6.2-1.el9.x86_64.rpm 672 kB/s | 67 kB 00:00 2024-09-19T04:35:45.206 INFO:teuthology.orchestra.run.smithi018.stdout:(15/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 2.3 MB/s | 751 kB 00:00 2024-09-19T04:35:45.231 INFO:teuthology.orchestra.run.smithi018.stdout:(16/156): libcephsqlite-19.1.1-361.g2f599a46.el 3.2 MB/s | 163 kB 00:00 2024-09-19T04:35:45.246 INFO:teuthology.orchestra.run.smithi002.stdout:(34/156): ceph-prometheus-alerts-19.1.1-361.g2f 329 kB/s | 16 kB 00:00 2024-09-19T04:35:45.255 INFO:teuthology.orchestra.run.smithi116.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 9.2 MB/s | 548 kB 00:00 2024-09-19T04:35:45.256 INFO:teuthology.orchestra.run.smithi018.stdout:(17/156): librados-devel-19.1.1-361.g2f599a46.e 2.5 MB/s | 127 kB 00:00 2024-09-19T04:35:45.296 INFO:teuthology.orchestra.run.smithi002.stdout:(35/156): ceph-volume-19.1.1-361.g2f599a46.el9. 5.6 MB/s | 285 kB 00:00 2024-09-19T04:35:45.330 INFO:teuthology.orchestra.run.smithi116.stdout:(114/156): libarrow-9.0.0-11.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-09-19T04:35:45.331 INFO:teuthology.orchestra.run.smithi018.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 4.9 MB/s | 506 kB 00:00 2024-09-19T04:35:45.347 INFO:teuthology.orchestra.run.smithi116.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 472 kB/s | 43 kB 00:00 2024-09-19T04:35:45.364 INFO:teuthology.orchestra.run.smithi116.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 960 kB/s | 32 kB 00:00 2024-09-19T04:35:45.372 INFO:teuthology.orchestra.run.smithi002.stdout:(36/156): cephadm-19.1.1-361.g2f599a46.el9.noar 10 MB/s | 765 kB 00:00 2024-09-19T04:35:45.390 INFO:teuthology.orchestra.run.smithi116.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 339 kB/s | 14 kB 00:00 2024-09-19T04:35:45.423 INFO:teuthology.orchestra.run.smithi116.stdout:(118/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.3 MB/s | 839 kB 00:00 2024-09-19T04:35:45.448 INFO:teuthology.orchestra.run.smithi116.stdout:(119/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-09-19T04:35:45.482 INFO:teuthology.orchestra.run.smithi116.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2024-09-19T04:35:45.507 INFO:teuthology.orchestra.run.smithi116.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-19T04:35:45.533 INFO:teuthology.orchestra.run.smithi116.stdout:(122/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.7 MB/s | 303 kB 00:00 2024-09-19T04:35:45.547 INFO:teuthology.orchestra.run.smithi002.stdout:(37/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 104 kB/s | 18 kB 00:00 2024-09-19T04:35:45.558 INFO:teuthology.orchestra.run.smithi116.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-09-19T04:35:45.583 INFO:teuthology.orchestra.run.smithi116.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 214 kB/s | 11 kB 00:00 2024-09-19T04:35:45.607 INFO:teuthology.orchestra.run.smithi018.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 164 kB/s | 45 kB 00:00 2024-09-19T04:35:45.647 INFO:teuthology.orchestra.run.smithi002.stdout:(38/156): fuse-2.9.9-16.el9.x86_64.rpm 799 kB/s | 80 kB 00:00 2024-09-19T04:35:45.667 INFO:teuthology.orchestra.run.smithi116.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 162 kB/s | 18 kB 00:00 2024-09-19T04:35:45.692 INFO:teuthology.orchestra.run.smithi116.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 222 kB/s | 23 kB 00:00 2024-09-19T04:35:45.715 INFO:teuthology.orchestra.run.smithi018.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 1.2 MB/s | 136 kB 00:00 2024-09-19T04:35:45.717 INFO:teuthology.orchestra.run.smithi116.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-09-19T04:35:45.743 INFO:teuthology.orchestra.run.smithi116.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-19T04:35:45.765 INFO:teuthology.orchestra.run.smithi018.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 3.2 MB/s | 161 kB 00:00 2024-09-19T04:35:45.776 INFO:teuthology.orchestra.run.smithi116.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-09-19T04:35:45.801 INFO:teuthology.orchestra.run.smithi116.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T04:35:45.835 INFO:teuthology.orchestra.run.smithi116.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 1.7 MB/s | 58 kB 00:00 2024-09-19T04:35:45.841 INFO:teuthology.orchestra.run.smithi018.stdout:(22/156): python3-rados-19.1.1-361.g2f599a46.el 4.2 MB/s | 320 kB 00:00 2024-09-19T04:35:45.869 INFO:teuthology.orchestra.run.smithi116.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2024-09-19T04:35:45.894 INFO:teuthology.orchestra.run.smithi116.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 4.6 MB/s | 272 kB 00:00 2024-09-19T04:35:45.908 INFO:teuthology.orchestra.run.smithi018.stdout:(23/156): python3-rbd-19.1.1-361.g2f599a46.el9. 4.4 MB/s | 300 kB 00:00 2024-09-19T04:35:45.914 INFO:teuthology.orchestra.run.smithi002.stdout:(39/156): ceph-common-19.1.1-361.g2f599a46.el9. 2.7 MB/s | 21 MB 00:07 2024-09-19T04:35:45.919 INFO:teuthology.orchestra.run.smithi116.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 327 kB/s | 16 kB 00:00 2024-09-19T04:35:45.945 INFO:teuthology.orchestra.run.smithi116.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-19T04:35:45.948 INFO:teuthology.orchestra.run.smithi002.stdout:(40/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.6 MB/s | 801 kB 00:00 2024-09-19T04:35:45.958 INFO:teuthology.orchestra.run.smithi018.stdout:(24/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.9 MB/s | 99 kB 00:00 2024-09-19T04:35:45.970 INFO:teuthology.orchestra.run.smithi116.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 563 kB/s | 28 kB 00:00 2024-09-19T04:35:45.996 INFO:teuthology.orchestra.run.smithi116.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-09-19T04:35:46.009 INFO:teuthology.orchestra.run.smithi018.stdout:(25/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-19T04:35:46.021 INFO:teuthology.orchestra.run.smithi116.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-19T04:35:46.046 INFO:teuthology.orchestra.run.smithi116.stdout:(139/156): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-19T04:35:46.048 INFO:teuthology.orchestra.run.smithi002.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.5 MB/s | 253 kB 00:00 2024-09-19T04:35:46.071 INFO:teuthology.orchestra.run.smithi116.stdout:(140/156): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-09-19T04:35:46.076 INFO:teuthology.orchestra.run.smithi002.stdout:(42/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-09-19T04:35:46.097 INFO:teuthology.orchestra.run.smithi116.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-19T04:35:46.109 INFO:teuthology.orchestra.run.smithi018.stdout:(26/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 6.3 MB/s | 5.3 MB 00:00 2024-09-19T04:35:46.118 INFO:teuthology.orchestra.run.smithi002.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-19T04:35:46.122 INFO:teuthology.orchestra.run.smithi116.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-19T04:35:46.160 INFO:teuthology.orchestra.run.smithi002.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 3.2 MB/s | 135 kB 00:00 2024-09-19T04:35:46.163 INFO:teuthology.orchestra.run.smithi116.stdout:(143/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.0 MB/s | 2.0 MB 00:00 2024-09-19T04:35:46.167 INFO:teuthology.orchestra.run.smithi018.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 2.9 MB/s | 171 kB 00:00 2024-09-19T04:35:46.189 INFO:teuthology.orchestra.run.smithi116.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-19T04:35:46.201 INFO:teuthology.orchestra.run.smithi002.stdout:(45/156): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-09-19T04:35:46.210 INFO:teuthology.orchestra.run.smithi018.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 765 kB/s | 32 kB 00:00 2024-09-19T04:35:46.214 INFO:teuthology.orchestra.run.smithi116.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-19T04:35:46.239 INFO:teuthology.orchestra.run.smithi116.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-19T04:35:46.243 INFO:teuthology.orchestra.run.smithi002.stdout:(46/156): python3-urllib3-1.26.5-6.el9.noarch.r 5.0 MB/s | 215 kB 00:00 2024-09-19T04:35:46.260 INFO:teuthology.orchestra.run.smithi018.stdout:(29/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 2.9 MB/s | 146 kB 00:00 2024-09-19T04:35:46.264 INFO:teuthology.orchestra.run.smithi116.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-09-19T04:35:46.315 INFO:teuthology.orchestra.run.smithi116.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-19T04:35:46.335 INFO:teuthology.orchestra.run.smithi002.stdout:(47/156): python3-cryptography-36.0.1-4.el9.x86 4.3 MB/s | 1.2 MB 00:00 2024-09-19T04:35:46.419 INFO:teuthology.orchestra.run.smithi002.stdout:(48/156): ceph-mgr-diskprediction-local-19.1.1- 4.9 MB/s | 7.4 MB 00:01 2024-09-19T04:35:46.507 INFO:teuthology.orchestra.run.smithi116.stdout:(149/156): librados2-19.1.1-361.g2f599a46.el9.x 13 MB/s | 3.4 MB 00:00 2024-09-19T04:35:46.535 INFO:teuthology.orchestra.run.smithi018.stdout:(30/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 5.9 MB/s | 3.1 MB 00:00 2024-09-19T04:35:46.719 INFO:teuthology.orchestra.run.smithi018.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 7.8 MB/s | 3.6 MB 00:00 2024-09-19T04:35:46.724 INFO:teuthology.orchestra.run.smithi116.stdout:(150/156): librbd1-19.1.1-361.g2f599a46.el9.x86 6.9 MB/s | 3.2 MB 00:00 2024-09-19T04:35:46.786 INFO:teuthology.orchestra.run.smithi018.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 3.7 MB/s | 249 kB 00:00 2024-09-19T04:35:46.844 INFO:teuthology.orchestra.run.smithi018.stdout:(33/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 849 kB/s | 49 kB 00:00 2024-09-19T04:35:46.865 INFO:teuthology.orchestra.run.smithi116.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 289 kB/s | 41 kB 00:00 2024-09-19T04:35:46.886 INFO:teuthology.orchestra.run.smithi018.stdout:(34/156): ceph-prometheus-alerts-19.1.1-361.g2f 395 kB/s | 16 kB 00:00 2024-09-19T04:35:46.962 INFO:teuthology.orchestra.run.smithi018.stdout:(35/156): ceph-volume-19.1.1-361.g2f599a46.el9. 3.7 MB/s | 285 kB 00:00 2024-09-19T04:35:46.974 INFO:teuthology.orchestra.run.smithi116.stdout:(152/156): NetworkManager-tui-1.51.0-1.el9.x86_ 2.2 MB/s | 249 kB 00:00 2024-09-19T04:35:47.016 INFO:teuthology.orchestra.run.smithi116.stdout:(153/156): NetworkManager-1.51.0-1.el9.x86_64.r 3.3 MB/s | 2.3 MB 00:00 2024-09-19T04:35:47.050 INFO:teuthology.orchestra.run.smithi116.stdout:(154/156): NetworkManager-libnm-1.51.0-1.el9.x8 3.3 MB/s | 1.8 MB 00:00 2024-09-19T04:35:47.094 INFO:teuthology.orchestra.run.smithi002.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 158 kB/s | 107 kB 00:00 2024-09-19T04:35:47.112 INFO:teuthology.orchestra.run.smithi018.stdout:(36/156): cephadm-19.1.1-361.g2f599a46.el9.noar 5.0 MB/s | 765 kB 00:00 2024-09-19T04:35:47.162 INFO:teuthology.orchestra.run.smithi018.stdout:(37/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 365 kB/s | 18 kB 00:00 2024-09-19T04:35:47.288 INFO:teuthology.orchestra.run.smithi018.stdout:(38/156): fuse-2.9.9-16.el9.x86_64.rpm 639 kB/s | 80 kB 00:00 2024-09-19T04:35:47.446 INFO:teuthology.orchestra.run.smithi018.stdout:(39/156): libgfortran-11.5.0-2.el9.x86_64.rpm 4.9 MB/s | 801 kB 00:00 2024-09-19T04:35:47.530 INFO:teuthology.orchestra.run.smithi018.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-19T04:35:47.628 INFO:teuthology.orchestra.run.smithi002.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 41 kB/s | 22 kB 00:00 2024-09-19T04:35:47.639 INFO:teuthology.orchestra.run.smithi018.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-09-19T04:35:47.661 INFO:teuthology.orchestra.run.smithi002.stdout:(51/156): automake-1.16.2-8.el9.noarch.rpm 486 kB/s | 689 kB 00:01 2024-09-19T04:35:47.675 INFO:teuthology.orchestra.run.smithi116.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.6 MB/s | 2.4 MB 00:00 2024-09-19T04:35:47.717 INFO:teuthology.orchestra.run.smithi116.stdout:(156/156): openssl-3.2.2-6.el9.x86_64.rpm 1.8 MB/s | 1.4 MB 00:00 2024-09-19T04:35:47.723 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-19T04:35:47.723 INFO:teuthology.orchestra.run.smithi116.stdout:Total 21 MB/s | 226 MB 00:10 2024-09-19T04:35:47.781 INFO:teuthology.orchestra.run.smithi018.stdout:(42/156): ceph-mgr-diskprediction-local-19.1.1- 5.9 MB/s | 7.4 MB 00:01 2024-09-19T04:35:47.822 INFO:teuthology.orchestra.run.smithi018.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 6.7 MB/s | 1.2 MB 00:00 2024-09-19T04:35:47.906 INFO:teuthology.orchestra.run.smithi018.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-09-19T04:35:47.948 INFO:teuthology.orchestra.run.smithi018.stdout:(45/156): python3-ply-3.11-14.el9.noarch.rpm 638 kB/s | 106 kB 00:00 2024-09-19T04:35:47.973 INFO:teuthology.orchestra.run.smithi018.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-09-19T04:35:48.011 INFO:teuthology.orchestra.run.smithi002.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 563 kB/s | 943 kB 00:01 2024-09-19T04:35:48.032 INFO:teuthology.orchestra.run.smithi018.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-19T04:35:48.157 INFO:teuthology.orchestra.run.smithi018.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 3.7 MB/s | 689 kB 00:00 2024-09-19T04:35:48.203 INFO:teuthology.orchestra.run.smithi002.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 60 kB/s | 33 kB 00:00 2024-09-19T04:35:48.216 INFO:teuthology.orchestra.run.smithi018.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 5.0 MB/s | 943 kB 00:00 2024-09-19T04:35:48.241 INFO:teuthology.orchestra.run.smithi018.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.2 MB/s | 107 kB 00:00 2024-09-19T04:35:48.267 INFO:teuthology.orchestra.run.smithi018.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 430 kB/s | 22 kB 00:00 2024-09-19T04:35:48.300 INFO:teuthology.orchestra.run.smithi018.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 313 kB 00:00 2024-09-19T04:35:48.325 INFO:teuthology.orchestra.run.smithi018.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 560 kB/s | 33 kB 00:00 2024-09-19T04:35:48.359 INFO:teuthology.orchestra.run.smithi018.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 547 kB/s | 18 kB 00:00 2024-09-19T04:35:48.393 INFO:teuthology.orchestra.run.smithi018.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 334 kB/s | 11 kB 00:00 2024-09-19T04:35:48.485 INFO:teuthology.orchestra.run.smithi018.stdout:(56/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2024-09-19T04:35:48.527 INFO:teuthology.orchestra.run.smithi018.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-19T04:35:48.595 INFO:teuthology.orchestra.run.smithi002.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 324 kB/s | 313 kB 00:00 2024-09-19T04:35:48.680 INFO:teuthology.orchestra.run.smithi002.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 38 kB/s | 18 kB 00:00 2024-09-19T04:35:48.735 INFO:teuthology.orchestra.run.smithi018.stdout:(58/156): librdkafka-1.6.1-102.el9.x86_64.rpm 3.1 MB/s | 662 kB 00:00 2024-09-19T04:35:48.905 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-19T04:35:48.919 INFO:teuthology.orchestra.run.smithi018.stdout:(59/156): libtool-2.4.6-46.el9.x86_64.rpm 3.1 MB/s | 581 kB 00:00 2024-09-19T04:35:48.952 INFO:teuthology.orchestra.run.smithi018.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 739 kB/s | 24 kB 00:00 2024-09-19T04:35:48.986 INFO:teuthology.orchestra.run.smithi018.stdout:(61/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-09-19T04:35:49.055 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-19T04:35:49.055 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-19T04:35:49.079 INFO:teuthology.orchestra.run.smithi002.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 23 kB/s | 11 kB 00:00 2024-09-19T04:35:49.088 INFO:teuthology.orchestra.run.smithi018.stdout:(62/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.9 MB/s | 292 kB 00:00 2024-09-19T04:35:49.162 INFO:teuthology.orchestra.run.smithi018.stdout:(63/156): lua-5.4.4-4.el9.x86_64.rpm 2.5 MB/s | 188 kB 00:00 2024-09-19T04:35:49.220 INFO:teuthology.orchestra.run.smithi018.stdout:(64/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.3 MB/s | 3.0 MB 00:00 2024-09-19T04:35:49.246 INFO:teuthology.orchestra.run.smithi018.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 460 kB/s | 38 kB 00:00 2024-09-19T04:35:49.455 INFO:teuthology.orchestra.run.smithi002.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 207 kB/s | 160 kB 00:00 2024-09-19T04:35:49.663 INFO:teuthology.orchestra.run.smithi002.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 78 kB/s | 45 kB 00:00 2024-09-19T04:35:50.046 INFO:teuthology.orchestra.run.smithi018.stdout:(66/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 8.2 MB/s | 49 MB 00:05 2024-09-19T04:35:50.363 INFO:teuthology.orchestra.run.smithi018.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 5.0 MB/s | 1.6 MB 00:00 2024-09-19T04:35:50.530 INFO:teuthology.orchestra.run.smithi018.stdout:(68/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.4 MB/s | 4.4 MB 00:01 2024-09-19T04:35:50.622 INFO:teuthology.orchestra.run.smithi018.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 1.5 MB/s | 137 kB 00:00 2024-09-19T04:35:50.648 INFO:teuthology.orchestra.run.smithi018.stdout:(70/156): postgresql-contrib-13.16-1.el9.x86_64 3.1 MB/s | 910 kB 00:00 2024-09-19T04:35:50.763 INFO:teuthology.orchestra.run.smithi002.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 506 kB/s | 662 kB 00:01 2024-09-19T04:35:50.781 INFO:teuthology.orchestra.run.smithi018.stdout:(71/156): openblas-openmp-0.3.26-2.el9.x86_64.r 3.2 MB/s | 4.9 MB 00:01 2024-09-19T04:35:50.830 INFO:teuthology.orchestra.run.smithi002.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 498 kB/s | 581 kB 00:01 2024-09-19T04:35:50.831 INFO:teuthology.orchestra.run.smithi018.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.7 MB/s | 87 kB 00:00 2024-09-19T04:35:50.940 INFO:teuthology.orchestra.run.smithi018.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 3.5 MB/s | 1.0 MB 00:00 2024-09-19T04:35:50.982 INFO:teuthology.orchestra.run.smithi018.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-19T04:35:51.072 INFO:teuthology.orchestra.run.smithi002.stdout:(61/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 1.0 MB/s | 3.0 MB 00:03 2024-09-19T04:35:51.115 INFO:teuthology.orchestra.run.smithi018.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 1.8 MB/s | 245 kB 00:00 2024-09-19T04:35:51.207 INFO:teuthology.orchestra.run.smithi018.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.6 MB/s | 248 kB 00:00 2024-09-19T04:35:51.250 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-19T04:35:51.250 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-19T04:35:51.258 INFO:teuthology.orchestra.run.smithi018.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 514 kB/s | 26 kB 00:00 2024-09-19T04:35:51.300 INFO:teuthology.orchestra.run.smithi018.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 461 kB/s | 19 kB 00:00 2024-09-19T04:35:51.322 INFO:teuthology.orchestra.run.smithi002.stdout:(62/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 44 kB/s | 24 kB 00:00 2024-09-19T04:35:51.375 INFO:teuthology.orchestra.run.smithi018.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-19T04:35:51.417 INFO:teuthology.orchestra.run.smithi018.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 835 kB/s | 35 kB 00:00 2024-09-19T04:35:51.447 INFO:teuthology.orchestra.run.smithi002.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 77 kB/s | 47 kB 00:00 2024-09-19T04:35:51.856 INFO:teuthology.orchestra.run.smithi002.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 378 kB/s | 292 kB 00:00 2024-09-19T04:35:52.006 INFO:teuthology.orchestra.run.smithi002.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 69 kB/s | 38 kB 00:00 2024-09-19T04:35:52.040 INFO:teuthology.orchestra.run.smithi002.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 263 kB/s | 188 kB 00:00 2024-09-19T04:35:52.492 INFO:teuthology.orchestra.run.smithi018.stdout:(81/156): postgresql-server-13.16-1.el9.x86_64. 3.1 MB/s | 5.8 MB 00:01 2024-09-19T04:35:52.584 INFO:teuthology.orchestra.run.smithi018.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.7 MB/s | 250 kB 00:00 2024-09-19T04:35:52.676 INFO:teuthology.orchestra.run.smithi018.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.4 MB/s | 222 kB 00:00 2024-09-19T04:35:52.751 INFO:teuthology.orchestra.run.smithi018.stdout:(84/156): python3-babel-2.9.1-2.el9.noarch.rpm 3.1 MB/s | 6.0 MB 00:01 2024-09-19T04:35:52.777 INFO:teuthology.orchestra.run.smithi018.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 769 kB/s | 77 kB 00:00 2024-09-19T04:35:52.802 INFO:teuthology.orchestra.run.smithi018.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 843 kB/s | 42 kB 00:00 2024-09-19T04:35:52.877 INFO:teuthology.orchestra.run.smithi018.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-19T04:35:52.902 INFO:teuthology.orchestra.run.smithi018.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 2.1 MB/s | 269 kB 00:00 2024-09-19T04:35:52.944 INFO:teuthology.orchestra.run.smithi018.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-19T04:35:52.982 INFO:teuthology.orchestra.run.smithi002.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 4.4 MB/s | 4.9 MB 00:01 2024-09-19T04:35:53.028 INFO:teuthology.orchestra.run.smithi018.stdout:(90/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.2 MB/s | 5.1 MB 00:01 2024-09-19T04:35:53.032 INFO:teuthology.orchestra.run.smithi002.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 1.6 MB/s | 1.6 MB 00:00 2024-09-19T04:35:53.053 INFO:teuthology.orchestra.run.smithi018.stdout:(91/156): python3-pyasn1-modules-0.4.8-6.el9.no 1.5 MB/s | 279 kB 00:00 2024-09-19T04:35:53.070 INFO:teuthology.orchestra.run.smithi018.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 428 kB/s | 54 kB 00:00 2024-09-19T04:35:53.104 INFO:teuthology.orchestra.run.smithi018.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 1.2 MB/s | 42 kB 00:00 2024-09-19T04:35:53.121 INFO:teuthology.orchestra.run.smithi018.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 878 kB/s | 44 kB 00:00 2024-09-19T04:35:53.124 INFO:teuthology.orchestra.run.smithi002.stdout:(69/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 4.0 MB/s | 4.4 MB 00:01 2024-09-19T04:35:53.154 INFO:teuthology.orchestra.run.smithi018.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 1.1 MB/s | 36 kB 00:00 2024-09-19T04:35:53.196 INFO:teuthology.orchestra.run.smithi018.stdout:(96/156): qatlib-24.02.0-1.el9.x86_64.rpm 2.3 MB/s | 221 kB 00:00 2024-09-19T04:35:53.221 INFO:teuthology.orchestra.run.smithi018.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 711 kB/s | 47 kB 00:00 2024-09-19T04:35:53.255 INFO:teuthology.orchestra.run.smithi018.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 1.7 MB/s | 58 kB 00:00 2024-09-19T04:35:53.314 INFO:teuthology.orchestra.run.smithi018.stdout:(99/156): socat-1.7.4.1-6.el9.x86_64.rpm 2.5 MB/s | 304 kB 00:00 2024-09-19T04:35:53.339 INFO:teuthology.orchestra.run.smithi018.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.1 MB/s | 96 kB 00:00 2024-09-19T04:35:53.381 INFO:teuthology.orchestra.run.smithi018.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 953 kB/s | 64 kB 00:00 2024-09-19T04:35:53.406 INFO:teuthology.orchestra.run.smithi018.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 671 kB/s | 45 kB 00:00 2024-09-19T04:35:53.523 INFO:teuthology.orchestra.run.smithi018.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 157 kB/s | 22 kB 00:00 2024-09-19T04:35:53.574 INFO:teuthology.orchestra.run.smithi018.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-19T04:35:53.607 INFO:teuthology.orchestra.run.smithi018.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-19T04:35:53.649 INFO:teuthology.orchestra.run.smithi018.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 468 kB/s | 19 kB 00:00 2024-09-19T04:35:53.741 INFO:teuthology.orchestra.run.smithi018.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.5 MB/s | 863 kB 00:00 2024-09-19T04:35:53.757 INFO:teuthology.orchestra.run.smithi002.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 189 kB/s | 137 kB 00:00 2024-09-19T04:35:53.825 INFO:teuthology.orchestra.run.smithi018.stdout:(108/156): libarrow-9.0.0-11.el9.x86_64.rpm 25 MB/s | 4.4 MB 00:00 2024-09-19T04:35:53.850 INFO:teuthology.orchestra.run.smithi018.stdout:(109/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 239 kB/s | 26 kB 00:00 2024-09-19T04:35:53.876 INFO:teuthology.orchestra.run.smithi018.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 968 kB/s | 49 kB 00:00 2024-09-19T04:35:53.882 INFO:teuthology.orchestra.run.smithi002.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 1.0 MB/s | 910 kB 00:00 2024-09-19T04:35:53.901 INFO:teuthology.orchestra.run.smithi018.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-19T04:35:53.926 INFO:teuthology.orchestra.run.smithi018.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-09-19T04:35:53.968 INFO:teuthology.orchestra.run.smithi018.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-19T04:35:53.993 INFO:teuthology.orchestra.run.smithi018.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T04:35:54.027 INFO:teuthology.orchestra.run.smithi018.stdout:(115/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.5 MB/s | 839 kB 00:00 2024-09-19T04:35:54.052 INFO:teuthology.orchestra.run.smithi018.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 548 kB/s | 32 kB 00:00 2024-09-19T04:35:54.077 INFO:teuthology.orchestra.run.smithi018.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-19T04:35:54.103 INFO:teuthology.orchestra.run.smithi018.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-19T04:35:54.137 INFO:teuthology.orchestra.run.smithi018.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 8.9 MB/s | 303 kB 00:00 2024-09-19T04:35:54.162 INFO:teuthology.orchestra.run.smithi018.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-09-19T04:35:54.187 INFO:teuthology.orchestra.run.smithi018.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-19T04:35:54.213 INFO:teuthology.orchestra.run.smithi018.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-19T04:35:54.238 INFO:teuthology.orchestra.run.smithi018.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-09-19T04:35:54.263 INFO:teuthology.orchestra.run.smithi018.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 706 kB/s | 18 kB 00:00 2024-09-19T04:35:54.283 INFO:teuthology.orchestra.run.smithi002.stdout:(72/156): postgresql-server-13.16-1.el9.x86_64. 5.0 MB/s | 5.8 MB 00:01 2024-09-19T04:35:54.289 INFO:teuthology.orchestra.run.smithi018.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 929 kB/s | 23 kB 00:00 2024-09-19T04:35:54.314 INFO:teuthology.orchestra.run.smithi018.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 784 kB/s | 19 kB 00:00 2024-09-19T04:35:54.339 INFO:teuthology.orchestra.run.smithi018.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 787 kB/s | 20 kB 00:00 2024-09-19T04:35:54.398 INFO:teuthology.orchestra.run.smithi018.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 8.7 MB/s | 2.0 MB 00:00 2024-09-19T04:35:54.423 INFO:teuthology.orchestra.run.smithi018.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T04:35:54.448 INFO:teuthology.orchestra.run.smithi018.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T04:35:54.465 INFO:teuthology.orchestra.run.smithi018.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-09-19T04:35:54.507 INFO:teuthology.orchestra.run.smithi018.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-09-19T04:35:54.524 INFO:teuthology.orchestra.run.smithi018.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 991 kB/s | 16 kB 00:00 2024-09-19T04:35:54.550 INFO:teuthology.orchestra.run.smithi018.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-19T04:35:54.566 INFO:teuthology.orchestra.run.smithi002.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 128 kB/s | 87 kB 00:00 2024-09-19T04:35:54.575 INFO:teuthology.orchestra.run.smithi018.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-19T04:35:54.600 INFO:teuthology.orchestra.run.smithi018.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-19T04:35:54.625 INFO:teuthology.orchestra.run.smithi018.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-19T04:35:54.651 INFO:teuthology.orchestra.run.smithi018.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-19T04:35:54.676 INFO:teuthology.orchestra.run.smithi018.stdout:(139/156): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-19T04:35:54.701 INFO:teuthology.orchestra.run.smithi018.stdout:(140/156): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-09-19T04:35:54.727 INFO:teuthology.orchestra.run.smithi018.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-19T04:35:54.742 INFO:teuthology.orchestra.run.smithi002.stdout:(74/156): protobuf-3.14.0-13.el9.x86_64.rpm 1.0 MB/s | 1.0 MB 00:00 2024-09-19T04:35:54.752 INFO:teuthology.orchestra.run.smithi018.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-19T04:35:54.779 INFO:teuthology.orchestra.run.smithi018.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.9 MB/s | 230 kB 00:00 2024-09-19T04:35:54.804 INFO:teuthology.orchestra.run.smithi018.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 804 kB/s | 20 kB 00:00 2024-09-19T04:35:54.830 INFO:teuthology.orchestra.run.smithi018.stdout:(145/156): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-19T04:35:54.864 INFO:teuthology.orchestra.run.smithi018.stdout:(146/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.7 MB/s | 427 kB 00:00 2024-09-19T04:35:54.931 INFO:teuthology.orchestra.run.smithi018.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-19T04:35:55.217 INFO:teuthology.orchestra.run.smithi002.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 94 kB/s | 61 kB 00:00 2024-09-19T04:35:55.331 INFO:teuthology.orchestra.run.smithi018.stdout:(148/156): librados2-19.1.1-361.g2f599a46.el9.x 7.3 MB/s | 3.4 MB 00:00 2024-09-19T04:35:55.381 INFO:teuthology.orchestra.run.smithi018.stdout:(149/156): librbd1-19.1.1-361.g2f599a46.el9.x86 7.0 MB/s | 3.2 MB 00:00 2024-09-19T04:35:55.426 INFO:teuthology.orchestra.run.smithi002.stdout:(76/156): python3-babel-2.9.1-2.el9.noarch.rpm 5.2 MB/s | 6.0 MB 00:01 2024-09-19T04:35:55.448 INFO:teuthology.orchestra.run.smithi018.stdout:(150/156): NetworkManager-1.51.0-1.el9.x86_64.r 20 MB/s | 2.3 MB 00:00 2024-09-19T04:35:55.517 INFO:teuthology.orchestra.run.smithi002.stdout:(77/156): python3-devel-3.9.19-8.el9.x86_64.rpm 316 kB/s | 245 kB 00:00 2024-09-19T04:35:55.523 INFO:teuthology.orchestra.run.smithi018.stdout:(151/156): NetworkManager-libnm-1.51.0-1.el9.x8 13 MB/s | 1.8 MB 00:00 2024-09-19T04:35:55.549 INFO:teuthology.orchestra.run.smithi018.stdout:(152/156): NetworkManager-team-1.51.0-1.el9.x86 408 kB/s | 41 kB 00:00 2024-09-19T04:35:55.599 INFO:teuthology.orchestra.run.smithi018.stdout:(153/156): NetworkManager-tui-1.51.0-1.el9.x86_ 3.2 MB/s | 249 kB 00:00 2024-09-19T04:35:55.750 INFO:teuthology.orchestra.run.smithi018.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 6.8 MB/s | 1.4 MB 00:00 2024-09-19T04:35:55.867 INFO:teuthology.orchestra.run.smithi018.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 9.0 MB/s | 2.4 MB 00:00 2024-09-19T04:35:55.993 INFO:teuthology.orchestra.run.smithi002.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 45 kB/s | 26 kB 00:00 2024-09-19T04:35:56.018 INFO:teuthology.orchestra.run.smithi002.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 39 kB/s | 19 kB 00:00 2024-09-19T04:35:56.068 INFO:teuthology.orchestra.run.smithi002.stdout:(80/156): python3-jinja2-2.11.3-6.el9.noarch.rp 292 kB/s | 248 kB 00:00 2024-09-19T04:35:56.577 INFO:teuthology.orchestra.run.smithi002.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 62 kB/s | 35 kB 00:00 2024-09-19T04:35:56.718 INFO:teuthology.orchestra.run.smithi002.stdout:(82/156): python3-mako-1.1.4-6.el9.noarch.rpm 237 kB/s | 172 kB 00:00 2024-09-19T04:35:57.202 INFO:teuthology.orchestra.run.smithi002.stdout:(83/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.5 MB/s | 5.1 MB 00:01 2024-09-19T04:35:57.336 INFO:teuthology.orchestra.run.smithi002.stdout:(84/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 330 kB/s | 250 kB 00:00 2024-09-19T04:35:57.494 INFO:teuthology.orchestra.run.smithi002.stdout:(85/156): python3-oauthlib-3.1.1-5.el9.noarch.r 287 kB/s | 222 kB 00:00 2024-09-19T04:35:57.534 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-19T04:35:57.646 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T04:35:57.789 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T04:35:57.836 INFO:teuthology.orchestra.run.smithi002.stdout:(86/156): python3-packaging-20.9-5.el9.noarch.r 122 kB/s | 77 kB 00:00 2024-09-19T04:35:57.928 INFO:teuthology.orchestra.run.smithi002.stdout:(87/156): python3-prettytable-0.7.2-27.el9.noar 71 kB/s | 42 kB 00:00 2024-09-19T04:35:57.964 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T04:35:58.005 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T04:35:58.030 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T04:35:58.090 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T04:35:58.270 INFO:teuthology.orchestra.run.smithi002.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 348 kB/s | 269 kB 00:00 2024-09-19T04:35:58.419 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T04:35:58.531 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T04:35:58.558 INFO:teuthology.orchestra.run.smithi018.stdout:(156/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 2.9 MB/s | 16 MB 00:05 2024-09-19T04:35:58.564 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-09-19T04:35:58.564 INFO:teuthology.orchestra.run.smithi018.stdout:Total 11 MB/s | 226 MB 00:21 2024-09-19T04:35:58.570 INFO:teuthology.orchestra.run.smithi002.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 216 kB/s | 159 kB 00:00 2024-09-19T04:35:58.652 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T04:35:58.690 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T04:35:58.781 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T04:35:58.788 INFO:teuthology.orchestra.run.smithi002.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 324 kB/s | 279 kB 00:00 2024-09-19T04:35:58.813 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T04:35:58.921 INFO:teuthology.orchestra.run.smithi002.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 78 kB/s | 51 kB 00:00 2024-09-19T04:35:58.988 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T04:35:59.042 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T04:35:59.069 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T04:35:59.172 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T04:35:59.204 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T04:35:59.250 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T04:35:59.288 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T04:35:59.311 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T04:35:59.312 INFO:teuthology.orchestra.run.smithi002.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 72 kB/s | 54 kB 00:00 2024-09-19T04:35:59.473 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T04:35:59.488 INFO:teuthology.orchestra.run.smithi002.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 75 kB/s | 42 kB 00:00 2024-09-19T04:35:59.638 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T04:35:59.761 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T04:35:59.775 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-09-19T04:35:59.876 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T04:35:59.880 INFO:teuthology.orchestra.run.smithi002.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 78 kB/s | 44 kB 00:00 2024-09-19T04:35:59.945 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-09-19T04:35:59.945 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-09-19T04:35:59.963 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T04:36:00.191 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T04:36:00.263 INFO:teuthology.orchestra.run.smithi002.stdout:(95/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-19T04:36:00.288 INFO:teuthology.orchestra.run.smithi002.stdout:(96/156): qatlib-24.02.0-1.el9.x86_64.rpm 276 kB/s | 221 kB 00:00 2024-09-19T04:36:00.306 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T04:36:00.395 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T04:36:00.430 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T04:36:00.469 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T04:36:00.530 INFO:teuthology.orchestra.run.smithi002.stdout:(97/156): qatlib-service-24.02.0-1.el9.x86_64.r 55 kB/s | 36 kB 00:00 2024-09-19T04:36:00.536 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T04:36:00.586 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T04:36:00.619 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T04:36:00.671 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T04:36:00.704 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T04:36:00.731 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T04:36:00.800 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T04:36:00.830 INFO:teuthology.orchestra.run.smithi002.stdout:(98/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 84 kB/s | 47 kB 00:00 2024-09-19T04:36:00.853 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T04:36:00.884 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T04:36:00.928 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T04:36:01.004 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T04:36:01.047 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T04:36:01.064 INFO:teuthology.orchestra.run.smithi002.stdout:(99/156): socat-1.7.4.1-6.el9.x86_64.rpm 392 kB/s | 304 kB 00:00 2024-09-19T04:36:01.090 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T04:36:01.119 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T04:36:01.156 INFO:teuthology.orchestra.run.smithi002.stdout:(100/156): uuid-1.6.2-55.el9.x86_64.rpm 92 kB/s | 58 kB 00:00 2024-09-19T04:36:01.187 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T04:36:01.233 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T04:36:01.306 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T04:36:01.438 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T04:36:01.493 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T04:36:01.523 INFO:teuthology.orchestra.run.smithi002.stdout:(101/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 139 kB/s | 96 kB 00:00 2024-09-19T04:36:01.590 INFO:teuthology.orchestra.run.smithi002.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 336 kB/s | 22 kB 00:00 2024-09-19T04:36:01.699 INFO:teuthology.orchestra.run.smithi002.stdout:(103/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 102 kB/s | 64 kB 00:00 2024-09-19T04:36:01.732 INFO:teuthology.orchestra.run.smithi002.stdout:(104/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 78 kB/s | 45 kB 00:00 2024-09-19T04:36:01.791 INFO:teuthology.orchestra.run.smithi002.stdout:(105/156): protobuf-compiler-3.14.0-13.el9.x86_ 4.2 MB/s | 863 kB 00:00 2024-09-19T04:36:01.833 INFO:teuthology.orchestra.run.smithi002.stdout:(106/156): abseil-cpp-20211102.0-3.el9.x86_64.r 4.0 MB/s | 548 kB 00:00 2024-09-19T04:36:01.858 INFO:teuthology.orchestra.run.smithi002.stdout:(107/156): gperftools-libs-2.9.1-3.el9.x86_64.r 2.4 MB/s | 308 kB 00:00 2024-09-19T04:36:01.883 INFO:teuthology.orchestra.run.smithi002.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.1 MB/s | 26 kB 00:00 2024-09-19T04:36:01.908 INFO:teuthology.orchestra.run.smithi002.stdout:(109/156): grpc-data-1.46.7-10.el9.noarch.rpm 169 kB/s | 19 kB 00:00 2024-09-19T04:36:01.934 INFO:teuthology.orchestra.run.smithi002.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 971 kB/s | 49 kB 00:00 2024-09-19T04:36:01.959 INFO:teuthology.orchestra.run.smithi002.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-19T04:36:01.984 INFO:teuthology.orchestra.run.smithi002.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-19T04:36:02.010 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T04:36:02.034 INFO:teuthology.orchestra.run.smithi002.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-19T04:36:02.060 INFO:teuthology.orchestra.run.smithi002.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T04:36:02.085 INFO:teuthology.orchestra.run.smithi002.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-19T04:36:02.088 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T04:36:02.110 INFO:teuthology.orchestra.run.smithi002.stdout:(116/156): python3-asyncssh-2.13.2-5.el9.noarch 4.3 MB/s | 548 kB 00:00 2024-09-19T04:36:02.119 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T04:36:02.135 INFO:teuthology.orchestra.run.smithi002.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-19T04:36:02.152 INFO:teuthology.orchestra.run.smithi002.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-09-19T04:36:02.162 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T04:36:02.186 INFO:teuthology.orchestra.run.smithi002.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-19T04:36:02.199 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T04:36:02.211 INFO:teuthology.orchestra.run.smithi002.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-19T04:36:02.237 INFO:teuthology.orchestra.run.smithi002.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-19T04:36:02.251 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T04:36:02.270 INFO:teuthology.orchestra.run.smithi002.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-19T04:36:02.277 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-09-19T04:36:02.278 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-09-19T04:36:02.295 INFO:teuthology.orchestra.run.smithi002.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-09-19T04:36:02.321 INFO:teuthology.orchestra.run.smithi002.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 710 kB/s | 18 kB 00:00 2024-09-19T04:36:02.346 INFO:teuthology.orchestra.run.smithi002.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 926 kB/s | 23 kB 00:00 2024-09-19T04:36:02.371 INFO:teuthology.orchestra.run.smithi002.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 779 kB/s | 19 kB 00:00 2024-09-19T04:36:02.397 INFO:teuthology.orchestra.run.smithi002.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 787 kB/s | 20 kB 00:00 2024-09-19T04:36:02.404 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T04:36:02.453 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T04:36:02.464 INFO:teuthology.orchestra.run.smithi002.stdout:(128/156): libarrow-9.0.0-11.el9.x86_64.rpm 7.3 MB/s | 4.4 MB 00:00 2024-09-19T04:36:02.489 INFO:teuthology.orchestra.run.smithi002.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T04:36:02.506 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T04:36:02.531 INFO:teuthology.orchestra.run.smithi002.stdout:(130/156): python3-grpcio-1.46.7-10.el9.x86_64. 6.4 MB/s | 2.0 MB 00:00 2024-09-19T04:36:02.548 INFO:teuthology.orchestra.run.smithi002.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-09-19T04:36:02.573 INFO:teuthology.orchestra.run.smithi002.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 1.3 MB/s | 58 kB 00:00 2024-09-19T04:36:02.579 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T04:36:02.598 INFO:teuthology.orchestra.run.smithi002.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 661 kB/s | 16 kB 00:00 2024-09-19T04:36:02.612 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T04:36:02.624 INFO:teuthology.orchestra.run.smithi002.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-19T04:36:02.648 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T04:36:02.649 INFO:teuthology.orchestra.run.smithi002.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-19T04:36:02.666 INFO:teuthology.orchestra.run.smithi002.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-09-19T04:36:02.694 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T04:36:02.700 INFO:teuthology.orchestra.run.smithi002.stdout:(137/156): python3-kubernetes-26.1.0-2.el9.noar 3.4 MB/s | 1.0 MB 00:00 2024-09-19T04:36:02.725 INFO:teuthology.orchestra.run.smithi002.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 407 kB/s | 31 kB 00:00 2024-09-19T04:36:02.730 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T04:36:02.750 INFO:teuthology.orchestra.run.smithi002.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-19T04:36:02.774 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T04:36:02.775 INFO:teuthology.orchestra.run.smithi002.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-19T04:36:02.801 INFO:teuthology.orchestra.run.smithi002.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-19T04:36:02.816 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T04:36:02.826 INFO:teuthology.orchestra.run.smithi002.stdout:(142/156): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-19T04:36:02.851 INFO:teuthology.orchestra.run.smithi002.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-19T04:36:02.877 INFO:teuthology.orchestra.run.smithi002.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-19T04:36:02.902 INFO:teuthology.orchestra.run.smithi002.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-19T04:36:02.927 INFO:teuthology.orchestra.run.smithi002.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-19T04:36:02.950 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T04:36:02.952 INFO:teuthology.orchestra.run.smithi002.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-19T04:36:02.993 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T04:36:03.003 INFO:teuthology.orchestra.run.smithi002.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-19T04:36:03.203 INFO:teuthology.orchestra.run.smithi002.stdout:(149/156): librados2-19.1.1-361.g2f599a46.el9.x 12 MB/s | 3.4 MB 00:00 2024-09-19T04:36:03.210 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T04:36:03.313 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T04:36:03.344 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T04:36:03.391 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T04:36:03.433 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T04:36:03.445 INFO:teuthology.orchestra.run.smithi002.stdout:(150/156): librbd1-19.1.1-361.g2f599a46.el9.x86 6.4 MB/s | 3.2 MB 00:00 2024-09-19T04:36:03.450 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T04:36:03.537 INFO:teuthology.orchestra.run.smithi002.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 447 kB/s | 41 kB 00:00 2024-09-19T04:36:03.545 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T04:36:03.612 INFO:teuthology.orchestra.run.smithi002.stdout:(152/156): NetworkManager-tui-1.51.0-1.el9.x86_ 3.3 MB/s | 249 kB 00:00 2024-09-19T04:36:03.654 INFO:teuthology.orchestra.run.smithi002.stdout:(153/156): NetworkManager-libnm-1.51.0-1.el9.x8 4.0 MB/s | 1.8 MB 00:00 2024-09-19T04:36:03.676 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T04:36:03.696 INFO:teuthology.orchestra.run.smithi002.stdout:(154/156): NetworkManager-1.51.0-1.el9.x86_64.r 3.3 MB/s | 2.3 MB 00:00 2024-09-19T04:36:03.715 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T04:36:03.749 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T04:36:03.786 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T04:36:03.825 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T04:36:03.856 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T04:36:03.886 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T04:36:03.904 INFO:teuthology.orchestra.run.smithi002.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 4.6 MB/s | 1.4 MB 00:00 2024-09-19T04:36:03.920 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T04:36:03.954 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T04:36:03.995 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T04:36:04.030 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T04:36:04.116 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T04:36:04.163 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T04:36:04.194 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T04:36:04.296 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T04:36:04.353 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T04:36:04.397 INFO:teuthology.orchestra.run.smithi002.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.2 MB/s | 2.4 MB 00:00 2024-09-19T04:36:04.403 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-19T04:36:04.403 INFO:teuthology.orchestra.run.smithi002.stdout:Total 8.4 MB/s | 226 MB 00:26 2024-09-19T04:36:05.061 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T04:36:05.101 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T04:36:05.143 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T04:36:05.242 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T04:36:05.289 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T04:36:05.334 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T04:36:05.422 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T04:36:05.462 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T04:36:05.641 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-19T04:36:05.646 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T04:36:05.677 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T04:36:05.754 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T04:36:05.810 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-19T04:36:05.810 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-19T04:36:06.385 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T04:36:06.499 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T04:36:07.761 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T04:36:07.855 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T04:36:07.883 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T04:36:07.916 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T04:36:08.153 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-19T04:36:08.154 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-19T04:36:08.226 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T04:36:08.279 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T04:36:08.372 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T04:36:08.403 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T04:36:08.439 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T04:36:08.812 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-09-19T04:36:08.917 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T04:36:08.920 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T04:36:08.951 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T04:36:09.022 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T04:36:09.051 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T04:36:09.052 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T04:36:09.224 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T04:36:09.263 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T04:36:09.296 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T04:36:09.375 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T04:36:09.730 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T04:36:09.847 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T04:36:09.972 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T04:36:10.006 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T04:36:10.099 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T04:36:10.128 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T04:36:10.295 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T04:36:10.350 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T04:36:10.386 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T04:36:10.509 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T04:36:10.554 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T04:36:10.625 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T04:36:10.655 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T04:36:10.680 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T04:36:10.855 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T04:36:11.028 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T04:36:11.153 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T04:36:11.272 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T04:36:11.355 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T04:36:11.595 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T04:36:11.705 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T04:36:11.720 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T04:36:11.740 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T04:36:11.828 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T04:36:11.860 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T04:36:11.903 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T04:36:11.971 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T04:36:12.030 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T04:36:12.087 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T04:36:12.131 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T04:36:12.163 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T04:36:12.190 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T04:36:12.262 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T04:36:12.293 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T04:36:12.314 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T04:36:12.327 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T04:36:12.353 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T04:36:12.396 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T04:36:12.417 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T04:36:12.417 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T04:36:12.417 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T04:36:12.417 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-19T04:36:12.453 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T04:36:12.473 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T04:36:12.506 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T04:36:12.550 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T04:36:12.578 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T04:36:12.651 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T04:36:12.693 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T04:36:12.771 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T04:36:12.922 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T04:36:12.980 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T04:36:13.531 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T04:36:13.618 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T04:36:13.662 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T04:36:13.714 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T04:36:13.751 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T04:36:13.794 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T04:36:13.972 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T04:36:14.029 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T04:36:14.086 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T04:36:14.160 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T04:36:14.197 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T04:36:14.233 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T04:36:14.289 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T04:36:14.333 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T04:36:14.376 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T04:36:14.419 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T04:36:14.562 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T04:36:14.612 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T04:36:14.654 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T04:36:14.759 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T04:36:14.796 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T04:36:14.839 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T04:36:14.872 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T04:36:14.896 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T04:36:14.974 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-19T04:36:14.994 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T04:36:15.128 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T04:36:15.135 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T04:36:15.171 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T04:36:15.199 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T04:36:15.240 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T04:36:15.276 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T04:36:15.280 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T04:36:15.321 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T04:36:15.335 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T04:36:15.350 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T04:36:15.376 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T04:36:15.385 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T04:36:15.401 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T04:36:15.418 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T04:36:15.460 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T04:36:15.469 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T04:36:15.497 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T04:36:15.584 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T04:36:15.642 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T04:36:15.681 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T04:36:15.790 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T04:36:15.817 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T04:36:15.841 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T04:36:15.935 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T04:36:16.061 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T04:36:16.087 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T04:36:16.188 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T04:36:16.217 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T04:36:16.411 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T04:36:16.470 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T04:36:16.499 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T04:36:16.596 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T04:36:16.606 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T04:36:16.640 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T04:36:16.642 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T04:36:16.682 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T04:36:16.705 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T04:36:16.735 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T04:36:16.758 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T04:36:16.785 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T04:36:16.847 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T04:36:16.891 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T04:36:16.938 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T04:36:16.982 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T04:36:17.017 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T04:36:17.097 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T04:36:17.210 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T04:36:17.233 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T04:36:17.248 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T04:36:17.329 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T04:36:17.344 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T04:36:17.426 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T04:36:17.643 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T04:36:17.752 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T04:36:17.848 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T04:36:17.881 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T04:36:17.916 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T04:36:17.983 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T04:36:18.015 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T04:36:18.034 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T04:36:18.074 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T04:36:18.117 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T04:36:18.140 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T04:36:18.152 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T04:36:18.178 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T04:36:18.250 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T04:36:18.301 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T04:36:18.331 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T04:36:18.375 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T04:36:18.452 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T04:36:18.485 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T04:36:18.529 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T04:36:18.556 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T04:36:18.639 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T04:36:18.689 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T04:36:18.766 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T04:36:18.911 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T04:36:18.967 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T04:36:19.458 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T04:36:19.520 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T04:36:19.530 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T04:36:19.557 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T04:36:19.593 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T04:36:19.613 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T04:36:19.657 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T04:36:19.700 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T04:36:19.737 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T04:36:19.781 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T04:36:19.917 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T04:36:19.955 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T04:36:19.970 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T04:36:20.015 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T04:36:20.062 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T04:36:20.071 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T04:36:20.100 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T04:36:20.137 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T04:36:20.154 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T04:36:20.192 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T04:36:20.244 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T04:36:20.292 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T04:36:20.327 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T04:36:20.370 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T04:36:20.413 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T04:36:20.556 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T04:36:20.606 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T04:36:20.646 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T04:36:20.647 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T04:36:20.673 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T04:36:20.745 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T04:36:20.753 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T04:36:20.774 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T04:36:20.789 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T04:36:20.829 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T04:36:20.862 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T04:36:20.887 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T04:36:20.991 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T04:36:21.118 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T04:36:21.160 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T04:36:21.194 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T04:36:21.240 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T04:36:21.279 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T04:36:21.319 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T04:36:21.348 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T04:36:21.383 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T04:36:21.417 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T04:36:21.458 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T04:36:21.492 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T04:36:21.582 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T04:36:21.640 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T04:36:21.674 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T04:36:21.783 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T04:36:21.842 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T04:36:22.603 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T04:36:22.647 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T04:36:22.680 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T04:36:22.784 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T04:36:22.845 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T04:36:22.890 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T04:36:22.979 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T04:36:23.016 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T04:36:23.207 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T04:36:23.209 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T04:36:23.238 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T04:36:23.246 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T04:36:23.319 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T04:36:23.822 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T04:36:23.867 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T04:36:23.960 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T04:36:23.960 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T04:36:23.960 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T04:36:23.960 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T04:36:24.001 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T04:36:24.013 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T04:36:24.132 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T04:36:24.329 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T04:36:24.329 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /sys 2024-09-19T04:36:24.329 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /proc 2024-09-19T04:36:24.329 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /mnt 2024-09-19T04:36:24.329 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /var/tmp 2024-09-19T04:36:24.329 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /home 2024-09-19T04:36:24.329 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /root 2024-09-19T04:36:24.329 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /tmp 2024-09-19T04:36:24.329 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-19T04:36:24.505 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T04:36:24.520 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T04:36:24.521 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:36:24.521 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T04:36:24.521 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-19T04:36:25.478 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T04:36:25.559 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T04:36:25.587 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T04:36:25.620 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T04:36:25.947 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T04:36:25.991 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T04:36:26.017 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T04:36:26.044 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T04:36:26.044 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:36:26.044 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T04:36:26.044 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T04:36:26.044 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T04:36:26.044 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-19T04:36:26.066 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T04:36:26.096 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T04:36:26.135 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T04:36:26.268 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T04:36:26.291 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T04:36:26.291 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:36:26.291 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T04:36:26.291 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T04:36:26.291 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T04:36:26.291 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-19T04:36:26.641 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T04:36:26.669 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T04:36:26.727 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T04:36:26.740 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T04:36:26.750 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T04:36:26.750 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:36:26.750 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T04:36:26.750 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T04:36:26.750 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T04:36:26.750 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-19T04:36:26.770 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T04:36:26.857 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T04:36:26.905 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T04:36:26.960 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T04:36:27.143 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T04:36:27.194 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T04:36:27.263 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T04:36:27.352 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T04:36:27.490 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T04:36:27.539 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T04:36:27.576 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T04:36:27.604 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T04:36:28.033 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T04:36:28.061 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T04:36:28.092 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T04:36:28.155 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T04:36:28.183 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T04:36:29.213 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T04:36:29.233 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T04:36:29.250 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T04:36:29.268 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T04:36:29.830 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T04:36:29.870 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T04:36:29.963 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T04:36:29.963 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T04:36:29.963 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T04:36:29.963 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:36:29.996 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T04:36:30.232 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T04:36:30.252 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T04:36:30.354 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T04:36:30.515 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T04:36:30.546 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T04:36:30.569 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T04:36:30.569 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:36:30.569 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T04:36:30.569 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T04:36:30.570 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T04:36:30.570 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-19T04:36:30.621 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T04:36:30.633 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T04:36:30.740 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T04:36:30.790 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T04:36:31.709 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T04:36:31.749 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T04:36:31.773 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T04:36:31.773 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:36:31.773 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T04:36:31.773 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T04:36:31.773 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T04:36:31.773 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-19T04:36:31.816 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T04:36:31.839 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T04:36:31.839 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:36:31.839 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T04:36:31.839 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-19T04:36:31.884 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T04:36:31.906 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T04:36:31.906 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:36:31.907 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T04:36:31.907 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T04:36:31.907 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T04:36:31.907 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-19T04:36:32.209 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T04:36:32.232 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T04:36:32.232 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:36:32.232 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T04:36:32.232 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T04:36:32.233 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T04:36:32.233 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-19T04:36:36.275 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T04:36:36.276 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /sys 2024-09-19T04:36:36.276 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /proc 2024-09-19T04:36:36.276 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /mnt 2024-09-19T04:36:36.276 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /var/tmp 2024-09-19T04:36:36.276 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /home 2024-09-19T04:36:36.276 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /root 2024-09-19T04:36:36.276 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /tmp 2024-09-19T04:36:36.276 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T04:36:36.579 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T04:36:36.596 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T04:36:36.596 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:36:36.596 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T04:36:36.597 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T04:36:36.797 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T04:36:36.838 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T04:36:36.878 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T04:36:36.910 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T04:36:36.938 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T04:36:37.132 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T04:36:37.176 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T04:36:37.214 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T04:36:37.244 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T04:36:37.291 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T04:36:37.904 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T04:36:37.946 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T04:36:37.966 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T04:36:38.124 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T04:36:38.152 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T04:36:38.152 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:36:38.152 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T04:36:38.152 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T04:36:38.152 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T04:36:38.152 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T04:36:38.392 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T04:36:38.416 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T04:36:38.416 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:36:38.416 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T04:36:38.416 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T04:36:38.416 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T04:36:38.416 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T04:36:38.803 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T04:36:38.884 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T04:36:38.892 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T04:36:38.908 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T04:36:38.909 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:36:38.909 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T04:36:38.909 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T04:36:38.909 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T04:36:38.909 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T04:36:38.937 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T04:36:39.015 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T04:36:39.025 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T04:36:39.053 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T04:36:39.073 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T04:36:39.080 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T04:36:39.113 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T04:36:39.113 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T04:36:39.137 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T04:36:39.197 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T04:36:39.197 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T04:36:39.281 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T04:36:39.306 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T04:36:39.311 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T04:36:39.311 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T04:36:39.329 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T04:36:39.385 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T04:36:39.466 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T04:36:39.491 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T04:36:39.491 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T04:36:39.563 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T04:36:39.575 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T04:36:39.650 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T04:36:39.706 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T04:36:39.758 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T04:36:39.801 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T04:36:39.837 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T04:36:40.326 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T04:36:40.353 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T04:36:40.385 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T04:36:40.449 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T04:36:40.475 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T04:36:41.583 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T04:36:41.627 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T04:36:42.036 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T04:36:42.036 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /sys 2024-09-19T04:36:42.036 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /proc 2024-09-19T04:36:42.036 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /mnt 2024-09-19T04:36:42.036 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /var/tmp 2024-09-19T04:36:42.036 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /home 2024-09-19T04:36:42.036 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /root 2024-09-19T04:36:42.036 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /tmp 2024-09-19T04:36:42.036 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:36:42.217 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T04:36:42.234 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T04:36:42.234 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:36:42.234 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T04:36:42.234 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:36:42.643 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T04:36:42.677 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T04:36:42.784 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T04:36:42.955 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T04:36:42.988 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T04:36:43.012 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T04:36:43.012 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:36:43.012 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T04:36:43.012 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T04:36:43.012 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T04:36:43.013 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T04:36:43.063 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T04:36:43.075 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T04:36:43.186 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T04:36:43.248 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T04:36:43.762 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T04:36:43.790 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T04:36:43.791 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:36:43.791 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T04:36:43.791 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T04:36:43.791 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T04:36:43.791 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:36:44.029 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T04:36:44.054 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T04:36:44.054 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:36:44.054 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T04:36:44.055 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T04:36:44.055 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T04:36:44.055 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:36:44.225 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T04:36:44.266 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T04:36:44.291 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T04:36:44.291 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:36:44.291 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T04:36:44.291 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T04:36:44.291 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T04:36:44.292 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T04:36:44.342 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T04:36:44.365 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T04:36:44.366 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:36:44.366 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T04:36:44.366 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T04:36:44.417 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T04:36:44.442 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T04:36:44.442 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:36:44.442 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T04:36:44.442 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T04:36:44.442 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T04:36:44.442 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T04:36:44.513 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T04:36:44.538 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T04:36:44.538 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:36:44.538 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T04:36:44.538 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T04:36:44.538 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T04:36:44.539 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:36:44.644 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T04:36:44.702 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T04:36:44.760 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T04:36:44.766 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T04:36:44.784 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T04:36:44.784 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:36:44.784 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T04:36:44.784 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T04:36:44.784 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T04:36:44.785 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T04:36:44.962 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T04:36:45.015 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T04:36:45.095 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T04:36:45.192 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T04:36:45.213 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T04:36:45.213 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T04:36:45.213 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T04:36:45.213 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T04:36:45.213 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T04:36:45.214 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T04:36:45.214 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T04:36:45.214 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T04:36:45.214 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T04:36:45.214 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T04:36:45.214 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T04:36:45.214 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T04:36:45.214 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T04:36:45.215 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T04:36:45.215 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T04:36:45.215 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T04:36:45.215 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T04:36:45.215 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T04:36:45.215 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T04:36:45.215 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T04:36:45.216 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T04:36:45.216 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T04:36:45.216 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T04:36:45.216 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T04:36:45.216 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T04:36:45.216 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T04:36:45.217 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T04:36:45.217 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T04:36:45.217 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T04:36:45.217 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T04:36:45.217 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T04:36:45.218 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T04:36:45.218 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T04:36:45.218 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T04:36:45.218 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T04:36:45.218 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T04:36:45.218 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T04:36:45.218 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T04:36:45.218 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T04:36:45.218 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T04:36:45.218 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T04:36:45.218 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T04:36:45.219 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T04:36:45.219 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T04:36:45.219 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T04:36:45.219 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T04:36:45.219 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T04:36:45.219 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T04:36:45.219 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T04:36:45.219 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T04:36:45.219 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T04:36:45.219 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T04:36:45.220 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T04:36:45.220 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T04:36:45.220 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T04:36:45.220 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T04:36:45.220 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T04:36:45.220 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T04:36:45.220 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T04:36:45.220 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T04:36:45.220 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T04:36:45.221 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T04:36:45.221 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T04:36:45.221 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T04:36:45.221 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T04:36:45.221 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T04:36:45.221 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T04:36:45.221 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T04:36:45.221 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T04:36:45.221 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T04:36:45.221 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T04:36:45.222 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T04:36:45.222 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T04:36:45.222 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T04:36:45.222 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T04:36:45.222 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T04:36:45.222 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T04:36:45.222 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T04:36:45.222 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T04:36:45.222 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T04:36:45.222 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T04:36:45.222 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T04:36:45.222 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T04:36:45.222 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T04:36:45.223 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T04:36:45.223 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T04:36:45.223 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T04:36:45.223 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T04:36:45.223 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T04:36:45.223 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T04:36:45.223 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T04:36:45.223 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T04:36:45.223 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T04:36:45.223 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T04:36:45.223 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T04:36:45.223 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T04:36:45.223 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T04:36:45.224 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T04:36:45.224 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T04:36:45.224 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T04:36:45.224 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T04:36:45.224 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T04:36:45.224 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T04:36:45.224 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T04:36:45.224 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T04:36:45.224 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T04:36:45.224 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T04:36:45.224 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T04:36:45.224 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T04:36:45.225 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T04:36:45.225 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T04:36:45.225 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T04:36:45.225 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T04:36:45.225 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T04:36:45.225 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T04:36:45.225 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T04:36:45.225 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T04:36:45.225 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T04:36:45.225 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T04:36:45.225 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T04:36:45.225 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T04:36:45.225 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T04:36:45.226 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T04:36:45.226 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T04:36:45.226 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T04:36:45.226 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T04:36:45.226 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T04:36:45.226 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T04:36:45.226 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T04:36:45.226 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T04:36:45.226 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T04:36:45.226 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T04:36:45.226 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T04:36:45.226 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T04:36:45.226 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T04:36:45.226 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T04:36:45.227 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T04:36:45.227 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T04:36:45.227 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T04:36:45.227 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T04:36:45.227 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T04:36:45.227 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T04:36:45.227 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T04:36:45.227 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T04:36:45.227 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T04:36:45.227 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T04:36:45.227 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T04:36:45.227 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T04:36:45.227 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T04:36:45.228 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T04:36:45.228 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T04:36:45.228 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T04:36:45.228 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T04:36:45.228 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T04:36:45.228 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T04:36:45.228 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T04:36:45.228 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T04:36:45.228 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T04:36:45.229 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T04:36:45.229 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T04:36:45.229 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T04:36:45.229 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T04:36:45.229 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T04:36:45.229 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T04:36:45.337 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T04:36:45.376 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T04:36:45.413 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T04:36:45.440 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T04:36:45.904 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T04:36:45.930 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T04:36:45.962 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T04:36:46.027 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T04:36:46.053 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T04:36:47.158 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T04:36:47.197 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T04:36:47.925 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T04:36:47.925 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-19T04:36:47.925 INFO:teuthology.orchestra.run.smithi116.stdout:Upgraded: 2024-09-19T04:36:47.925 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T04:36:47.925 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T04:36:47.925 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T04:36:47.925 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T04:36:47.925 INFO:teuthology.orchestra.run.smithi116.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:36:47.926 INFO:teuthology.orchestra.run.smithi116.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:36:47.926 INFO:teuthology.orchestra.run.smithi116.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T04:36:47.926 INFO:teuthology.orchestra.run.smithi116.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T04:36:47.926 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-19T04:36:47.926 INFO:teuthology.orchestra.run.smithi116.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T04:36:47.926 INFO:teuthology.orchestra.run.smithi116.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T04:36:47.926 INFO:teuthology.orchestra.run.smithi116.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T04:36:47.926 INFO:teuthology.orchestra.run.smithi116.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T04:36:47.926 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:36:47.926 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:36:47.926 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:36:47.926 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:36:47.926 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:36:47.926 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:36:47.927 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:36:47.927 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:36:47.927 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:36:47.927 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:36:47.927 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:36:47.927 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:36:47.927 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:36:47.927 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:36:47.927 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:36:47.927 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:36:47.927 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:36:47.927 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:36:47.927 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:36:47.928 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:36:47.928 INFO:teuthology.orchestra.run.smithi116.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:36:47.928 INFO:teuthology.orchestra.run.smithi116.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:36:47.928 INFO:teuthology.orchestra.run.smithi116.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:36:47.928 INFO:teuthology.orchestra.run.smithi116.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:36:47.928 INFO:teuthology.orchestra.run.smithi116.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T04:36:47.928 INFO:teuthology.orchestra.run.smithi116.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T04:36:47.928 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T04:36:47.928 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T04:36:47.928 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T04:36:47.928 INFO:teuthology.orchestra.run.smithi116.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T04:36:47.928 INFO:teuthology.orchestra.run.smithi116.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T04:36:47.928 INFO:teuthology.orchestra.run.smithi116.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T04:36:47.929 INFO:teuthology.orchestra.run.smithi116.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T04:36:47.929 INFO:teuthology.orchestra.run.smithi116.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T04:36:47.929 INFO:teuthology.orchestra.run.smithi116.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T04:36:47.929 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:36:47.929 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:36:47.929 INFO:teuthology.orchestra.run.smithi116.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:36:47.929 INFO:teuthology.orchestra.run.smithi116.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T04:36:47.929 INFO:teuthology.orchestra.run.smithi116.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T04:36:47.929 INFO:teuthology.orchestra.run.smithi116.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T04:36:47.929 INFO:teuthology.orchestra.run.smithi116.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T04:36:47.929 INFO:teuthology.orchestra.run.smithi116.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T04:36:47.929 INFO:teuthology.orchestra.run.smithi116.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:36:47.929 INFO:teuthology.orchestra.run.smithi116.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:36:47.930 INFO:teuthology.orchestra.run.smithi116.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T04:36:47.930 INFO:teuthology.orchestra.run.smithi116.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:36:47.930 INFO:teuthology.orchestra.run.smithi116.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T04:36:47.930 INFO:teuthology.orchestra.run.smithi116.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T04:36:47.930 INFO:teuthology.orchestra.run.smithi116.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T04:36:47.930 INFO:teuthology.orchestra.run.smithi116.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T04:36:47.930 INFO:teuthology.orchestra.run.smithi116.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T04:36:47.930 INFO:teuthology.orchestra.run.smithi116.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T04:36:47.930 INFO:teuthology.orchestra.run.smithi116.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T04:36:47.930 INFO:teuthology.orchestra.run.smithi116.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T04:36:47.930 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T04:36:47.930 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T04:36:47.930 INFO:teuthology.orchestra.run.smithi116.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T04:36:47.930 INFO:teuthology.orchestra.run.smithi116.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T04:36:47.931 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T04:36:47.931 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T04:36:47.931 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T04:36:47.931 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T04:36:47.931 INFO:teuthology.orchestra.run.smithi116.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T04:36:47.931 INFO:teuthology.orchestra.run.smithi116.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T04:36:47.931 INFO:teuthology.orchestra.run.smithi116.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T04:36:47.931 INFO:teuthology.orchestra.run.smithi116.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T04:36:47.931 INFO:teuthology.orchestra.run.smithi116.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T04:36:47.931 INFO:teuthology.orchestra.run.smithi116.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T04:36:47.931 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T04:36:47.931 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:36:47.931 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:36:47.932 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:36:47.932 INFO:teuthology.orchestra.run.smithi116.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T04:36:47.932 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T04:36:47.932 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T04:36:47.932 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T04:36:47.932 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T04:36:47.932 INFO:teuthology.orchestra.run.smithi116.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T04:36:47.932 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T04:36:47.932 INFO:teuthology.orchestra.run.smithi116.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T04:36:47.932 INFO:teuthology.orchestra.run.smithi116.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T04:36:47.932 INFO:teuthology.orchestra.run.smithi116.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T04:36:47.932 INFO:teuthology.orchestra.run.smithi116.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T04:36:47.932 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T04:36:47.933 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T04:36:47.933 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T04:36:47.933 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T04:36:47.933 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T04:36:47.933 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T04:36:47.933 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T04:36:47.933 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T04:36:47.933 INFO:teuthology.orchestra.run.smithi116.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T04:36:47.933 INFO:teuthology.orchestra.run.smithi116.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T04:36:47.933 INFO:teuthology.orchestra.run.smithi116.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T04:36:47.933 INFO:teuthology.orchestra.run.smithi116.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T04:36:47.933 INFO:teuthology.orchestra.run.smithi116.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T04:36:47.933 INFO:teuthology.orchestra.run.smithi116.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T04:36:47.934 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T04:36:47.934 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T04:36:47.934 INFO:teuthology.orchestra.run.smithi116.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T04:36:47.934 INFO:teuthology.orchestra.run.smithi116.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T04:36:47.934 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T04:36:47.934 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T04:36:47.934 INFO:teuthology.orchestra.run.smithi116.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T04:36:47.934 INFO:teuthology.orchestra.run.smithi116.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T04:36:47.934 INFO:teuthology.orchestra.run.smithi116.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T04:36:47.934 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T04:36:47.934 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T04:36:47.934 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T04:36:47.934 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T04:36:47.935 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T04:36:47.935 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T04:36:47.935 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:36:47.935 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:36:47.935 INFO:teuthology.orchestra.run.smithi116.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T04:36:47.935 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T04:36:47.935 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T04:36:47.935 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:36:47.935 INFO:teuthology.orchestra.run.smithi116.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T04:36:47.935 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T04:36:47.935 INFO:teuthology.orchestra.run.smithi116.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T04:36:47.935 INFO:teuthology.orchestra.run.smithi116.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T04:36:47.935 INFO:teuthology.orchestra.run.smithi116.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T04:36:47.935 INFO:teuthology.orchestra.run.smithi116.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T04:36:47.936 INFO:teuthology.orchestra.run.smithi116.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T04:36:47.936 INFO:teuthology.orchestra.run.smithi116.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T04:36:47.936 INFO:teuthology.orchestra.run.smithi116.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T04:36:47.936 INFO:teuthology.orchestra.run.smithi116.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T04:36:47.936 INFO:teuthology.orchestra.run.smithi116.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T04:36:47.936 INFO:teuthology.orchestra.run.smithi116.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T04:36:47.936 INFO:teuthology.orchestra.run.smithi116.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T04:36:47.936 INFO:teuthology.orchestra.run.smithi116.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T04:36:47.936 INFO:teuthology.orchestra.run.smithi116.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T04:36:47.936 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:36:47.936 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:36:47.936 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:36:47.936 INFO:teuthology.orchestra.run.smithi116.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T04:36:47.937 INFO:teuthology.orchestra.run.smithi116.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T04:36:47.937 INFO:teuthology.orchestra.run.smithi116.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T04:36:47.937 INFO:teuthology.orchestra.run.smithi116.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T04:36:47.937 INFO:teuthology.orchestra.run.smithi116.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T04:36:47.937 INFO:teuthology.orchestra.run.smithi116.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T04:36:47.937 INFO:teuthology.orchestra.run.smithi116.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T04:36:47.937 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-19T04:36:47.937 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-19T04:36:48.213 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T04:36:48.239 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T04:36:48.344 DEBUG:teuthology.parallel:result is None 2024-09-19T04:36:48.346 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T04:36:48.509 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T04:36:48.540 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T04:36:48.566 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T04:36:48.566 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:36:48.566 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T04:36:48.566 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T04:36:48.566 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T04:36:48.566 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:36:48.616 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T04:36:48.628 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T04:36:48.737 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T04:36:48.796 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T04:36:49.630 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T04:36:49.672 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T04:36:49.713 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T04:36:49.745 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T04:36:49.772 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T04:36:49.775 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T04:36:49.802 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T04:36:49.827 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T04:36:49.828 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:36:49.828 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T04:36:49.828 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T04:36:49.828 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T04:36:49.828 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:36:49.878 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T04:36:49.902 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T04:36:49.902 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:36:49.902 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T04:36:49.902 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:36:49.953 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T04:36:49.975 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T04:36:49.978 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T04:36:49.978 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:36:49.978 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T04:36:49.978 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T04:36:49.978 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T04:36:49.978 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:36:50.018 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T04:36:50.049 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T04:36:50.079 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T04:36:50.250 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T04:36:50.296 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T04:36:50.321 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T04:36:50.321 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:36:50.321 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T04:36:50.321 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T04:36:50.321 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T04:36:50.321 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:36:50.899 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T04:36:50.940 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T04:36:50.961 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T04:36:51.864 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T04:36:51.970 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T04:36:52.028 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T04:36:52.125 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T04:36:52.165 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T04:36:52.191 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T04:36:52.216 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T04:36:52.216 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T04:36:52.292 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T04:36:52.292 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T04:36:52.384 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T04:36:52.409 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T04:36:52.415 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T04:36:52.415 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T04:36:52.595 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T04:36:52.595 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T04:36:52.687 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T04:36:52.756 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T04:36:55.166 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T04:36:55.208 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T04:36:55.250 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T04:36:55.281 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T04:36:55.308 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T04:36:55.522 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T04:36:55.571 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T04:36:55.593 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T04:36:55.623 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T04:36:55.669 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T04:36:56.294 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T04:36:56.333 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T04:36:56.355 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T04:36:57.257 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T04:36:57.346 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T04:36:57.400 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T04:36:57.491 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T04:36:57.524 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T04:36:57.550 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T04:36:57.583 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T04:36:57.584 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T04:36:57.668 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T04:36:57.668 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T04:36:57.760 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T04:36:57.785 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T04:36:57.790 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T04:36:57.790 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T04:36:57.979 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T04:36:57.979 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T04:36:58.063 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T04:36:58.149 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T04:36:58.474 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T04:36:58.474 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T04:36:58.474 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T04:36:58.474 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T04:36:58.474 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T04:36:58.474 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T04:36:58.474 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T04:36:58.475 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T04:36:58.475 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T04:36:58.475 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T04:36:58.475 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T04:36:58.475 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T04:36:58.475 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T04:36:58.475 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T04:36:58.475 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T04:36:58.475 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T04:36:58.475 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T04:36:58.475 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T04:36:58.475 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T04:36:58.475 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T04:36:58.476 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T04:36:58.476 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T04:36:58.476 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T04:36:58.476 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T04:36:58.476 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T04:36:58.476 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T04:36:58.476 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T04:36:58.476 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T04:36:58.476 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T04:36:58.476 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T04:36:58.476 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T04:36:58.476 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T04:36:58.476 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T04:36:58.477 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T04:36:58.477 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T04:36:58.477 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T04:36:58.477 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T04:36:58.477 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T04:36:58.477 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T04:36:58.477 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T04:36:58.477 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T04:36:58.477 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T04:36:58.477 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T04:36:58.477 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T04:36:58.477 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T04:36:58.477 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T04:36:58.478 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T04:36:58.478 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T04:36:58.478 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T04:36:58.478 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T04:36:58.478 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T04:36:58.478 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T04:36:58.478 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T04:36:58.478 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T04:36:58.478 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T04:36:58.478 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T04:36:58.478 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T04:36:58.478 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T04:36:58.478 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T04:36:58.479 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T04:36:58.479 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T04:36:58.479 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T04:36:58.479 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T04:36:58.479 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T04:36:58.479 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T04:36:58.479 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T04:36:58.479 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T04:36:58.479 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T04:36:58.479 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T04:36:58.479 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T04:36:58.479 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T04:36:58.479 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T04:36:58.479 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T04:36:58.480 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T04:36:58.480 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T04:36:58.480 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T04:36:58.480 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T04:36:58.480 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T04:36:58.480 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T04:36:58.480 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T04:36:58.480 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T04:36:58.480 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T04:36:58.480 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T04:36:58.480 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T04:36:58.480 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T04:36:58.481 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T04:36:58.481 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T04:36:58.481 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T04:36:58.481 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T04:36:58.481 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T04:36:58.481 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T04:36:58.481 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T04:36:58.481 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T04:36:58.481 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T04:36:58.481 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T04:36:58.481 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T04:36:58.481 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T04:36:58.481 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T04:36:58.482 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T04:36:58.482 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T04:36:58.482 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T04:36:58.482 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T04:36:58.482 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T04:36:58.482 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T04:36:58.482 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T04:36:58.482 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T04:36:58.482 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T04:36:58.482 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T04:36:58.482 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T04:36:58.482 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T04:36:58.482 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T04:36:58.483 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T04:36:58.483 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T04:36:58.483 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T04:36:58.483 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T04:36:58.483 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T04:36:58.483 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T04:36:58.483 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T04:36:58.483 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T04:36:58.483 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T04:36:58.483 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T04:36:58.483 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T04:36:58.483 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T04:36:58.484 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T04:36:58.484 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T04:36:58.484 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T04:36:58.484 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T04:36:58.484 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T04:36:58.484 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T04:36:58.484 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T04:36:58.484 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T04:36:58.484 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T04:36:58.484 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T04:36:58.484 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T04:36:58.485 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T04:36:58.485 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T04:36:58.485 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T04:36:58.485 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T04:36:58.485 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T04:36:58.485 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T04:36:58.485 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T04:36:58.485 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T04:36:58.485 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T04:36:58.485 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T04:36:58.485 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T04:36:58.485 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T04:36:58.485 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T04:36:58.486 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T04:36:58.486 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T04:36:58.486 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T04:36:58.486 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T04:36:58.486 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T04:36:58.486 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T04:36:58.486 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T04:36:58.486 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T04:36:58.486 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T04:36:58.486 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T04:36:58.486 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T04:36:58.487 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T04:36:58.487 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T04:36:58.487 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T04:36:58.487 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T04:36:58.487 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T04:36:58.487 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T04:37:01.317 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T04:37:01.318 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T04:37:01.318 INFO:teuthology.orchestra.run.smithi018.stdout:Upgraded: 2024-09-19T04:37:01.318 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T04:37:01.318 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T04:37:01.318 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T04:37:01.318 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T04:37:01.318 INFO:teuthology.orchestra.run.smithi018.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:01.318 INFO:teuthology.orchestra.run.smithi018.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:01.318 INFO:teuthology.orchestra.run.smithi018.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T04:37:01.318 INFO:teuthology.orchestra.run.smithi018.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T04:37:01.318 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-09-19T04:37:01.319 INFO:teuthology.orchestra.run.smithi018.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T04:37:01.319 INFO:teuthology.orchestra.run.smithi018.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T04:37:01.319 INFO:teuthology.orchestra.run.smithi018.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T04:37:01.319 INFO:teuthology.orchestra.run.smithi018.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T04:37:01.319 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:01.319 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:01.319 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:01.319 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:01.319 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:37:01.319 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:01.319 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:01.319 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:01.320 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:37:01.320 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:37:01.320 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:37:01.320 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:37:01.320 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:37:01.320 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:01.320 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:01.320 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:37:01.320 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:01.320 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:01.320 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:01.320 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:37:01.321 INFO:teuthology.orchestra.run.smithi018.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:37:01.321 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:01.321 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:01.321 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:37:01.321 INFO:teuthology.orchestra.run.smithi018.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T04:37:01.321 INFO:teuthology.orchestra.run.smithi018.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T04:37:01.321 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T04:37:01.321 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T04:37:01.321 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T04:37:01.321 INFO:teuthology.orchestra.run.smithi018.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T04:37:01.321 INFO:teuthology.orchestra.run.smithi018.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T04:37:01.322 INFO:teuthology.orchestra.run.smithi018.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T04:37:01.322 INFO:teuthology.orchestra.run.smithi018.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T04:37:01.322 INFO:teuthology.orchestra.run.smithi018.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T04:37:01.322 INFO:teuthology.orchestra.run.smithi018.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T04:37:01.322 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:01.322 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:01.322 INFO:teuthology.orchestra.run.smithi018.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:01.322 INFO:teuthology.orchestra.run.smithi018.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T04:37:01.322 INFO:teuthology.orchestra.run.smithi018.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T04:37:01.322 INFO:teuthology.orchestra.run.smithi018.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T04:37:01.323 INFO:teuthology.orchestra.run.smithi018.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T04:37:01.323 INFO:teuthology.orchestra.run.smithi018.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T04:37:01.323 INFO:teuthology.orchestra.run.smithi018.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:01.323 INFO:teuthology.orchestra.run.smithi018.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:01.323 INFO:teuthology.orchestra.run.smithi018.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T04:37:01.323 INFO:teuthology.orchestra.run.smithi018.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:01.323 INFO:teuthology.orchestra.run.smithi018.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T04:37:01.323 INFO:teuthology.orchestra.run.smithi018.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T04:37:01.323 INFO:teuthology.orchestra.run.smithi018.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T04:37:01.323 INFO:teuthology.orchestra.run.smithi018.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T04:37:01.323 INFO:teuthology.orchestra.run.smithi018.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T04:37:01.323 INFO:teuthology.orchestra.run.smithi018.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T04:37:01.324 INFO:teuthology.orchestra.run.smithi018.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T04:37:01.324 INFO:teuthology.orchestra.run.smithi018.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T04:37:01.324 INFO:teuthology.orchestra.run.smithi018.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T04:37:01.324 INFO:teuthology.orchestra.run.smithi018.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T04:37:01.324 INFO:teuthology.orchestra.run.smithi018.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T04:37:01.324 INFO:teuthology.orchestra.run.smithi018.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T04:37:01.324 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T04:37:01.324 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T04:37:01.324 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T04:37:01.324 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T04:37:01.324 INFO:teuthology.orchestra.run.smithi018.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T04:37:01.324 INFO:teuthology.orchestra.run.smithi018.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T04:37:01.324 INFO:teuthology.orchestra.run.smithi018.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T04:37:01.325 INFO:teuthology.orchestra.run.smithi018.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T04:37:01.325 INFO:teuthology.orchestra.run.smithi018.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T04:37:01.325 INFO:teuthology.orchestra.run.smithi018.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T04:37:01.325 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T04:37:01.325 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:01.325 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:01.325 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:01.325 INFO:teuthology.orchestra.run.smithi018.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T04:37:01.325 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T04:37:01.325 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T04:37:01.325 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T04:37:01.325 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T04:37:01.325 INFO:teuthology.orchestra.run.smithi018.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T04:37:01.325 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T04:37:01.326 INFO:teuthology.orchestra.run.smithi018.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T04:37:01.326 INFO:teuthology.orchestra.run.smithi018.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T04:37:01.326 INFO:teuthology.orchestra.run.smithi018.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T04:37:01.326 INFO:teuthology.orchestra.run.smithi018.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T04:37:01.326 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T04:37:01.326 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T04:37:01.326 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T04:37:01.326 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T04:37:01.326 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T04:37:01.326 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T04:37:01.326 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T04:37:01.326 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T04:37:01.326 INFO:teuthology.orchestra.run.smithi018.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T04:37:01.327 INFO:teuthology.orchestra.run.smithi018.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T04:37:01.327 INFO:teuthology.orchestra.run.smithi018.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T04:37:01.327 INFO:teuthology.orchestra.run.smithi018.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T04:37:01.327 INFO:teuthology.orchestra.run.smithi018.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T04:37:01.327 INFO:teuthology.orchestra.run.smithi018.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T04:37:01.327 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T04:37:01.327 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T04:37:01.327 INFO:teuthology.orchestra.run.smithi018.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T04:37:01.327 INFO:teuthology.orchestra.run.smithi018.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T04:37:01.327 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T04:37:01.327 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T04:37:01.327 INFO:teuthology.orchestra.run.smithi018.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T04:37:01.327 INFO:teuthology.orchestra.run.smithi018.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T04:37:01.327 INFO:teuthology.orchestra.run.smithi018.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T04:37:01.328 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T04:37:01.328 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T04:37:01.328 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T04:37:01.328 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T04:37:01.328 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T04:37:01.328 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T04:37:01.328 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:01.328 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:01.328 INFO:teuthology.orchestra.run.smithi018.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T04:37:01.328 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T04:37:01.328 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T04:37:01.328 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:01.328 INFO:teuthology.orchestra.run.smithi018.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T04:37:01.329 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T04:37:01.329 INFO:teuthology.orchestra.run.smithi018.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T04:37:01.329 INFO:teuthology.orchestra.run.smithi018.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T04:37:01.329 INFO:teuthology.orchestra.run.smithi018.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T04:37:01.329 INFO:teuthology.orchestra.run.smithi018.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T04:37:01.329 INFO:teuthology.orchestra.run.smithi018.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T04:37:01.329 INFO:teuthology.orchestra.run.smithi018.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T04:37:01.329 INFO:teuthology.orchestra.run.smithi018.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T04:37:01.329 INFO:teuthology.orchestra.run.smithi018.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T04:37:01.329 INFO:teuthology.orchestra.run.smithi018.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T04:37:01.329 INFO:teuthology.orchestra.run.smithi018.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T04:37:01.329 INFO:teuthology.orchestra.run.smithi018.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T04:37:01.329 INFO:teuthology.orchestra.run.smithi018.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T04:37:01.330 INFO:teuthology.orchestra.run.smithi018.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T04:37:01.330 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:01.330 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:01.330 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:01.330 INFO:teuthology.orchestra.run.smithi018.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T04:37:01.330 INFO:teuthology.orchestra.run.smithi018.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T04:37:01.330 INFO:teuthology.orchestra.run.smithi018.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T04:37:01.330 INFO:teuthology.orchestra.run.smithi018.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T04:37:01.330 INFO:teuthology.orchestra.run.smithi018.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T04:37:01.330 INFO:teuthology.orchestra.run.smithi018.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T04:37:01.331 INFO:teuthology.orchestra.run.smithi018.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T04:37:01.331 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T04:37:01.331 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-09-19T04:37:01.852 DEBUG:teuthology.parallel:result is None 2024-09-19T04:37:03.652 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T04:37:03.652 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T04:37:03.652 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T04:37:03.652 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T04:37:03.652 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T04:37:03.652 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T04:37:03.652 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T04:37:03.652 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T04:37:03.652 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T04:37:03.652 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T04:37:03.653 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T04:37:03.653 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T04:37:03.653 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T04:37:03.653 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T04:37:03.653 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T04:37:03.653 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T04:37:03.653 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T04:37:03.653 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T04:37:03.653 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T04:37:03.653 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T04:37:03.653 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T04:37:03.653 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T04:37:03.653 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T04:37:03.654 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T04:37:03.654 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T04:37:03.654 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T04:37:03.654 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T04:37:03.654 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T04:37:03.666 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T04:37:03.666 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T04:37:03.666 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T04:37:03.666 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T04:37:03.666 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T04:37:03.667 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T04:37:03.667 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T04:37:03.667 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T04:37:03.667 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T04:37:03.667 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T04:37:03.667 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T04:37:03.667 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T04:37:03.667 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T04:37:03.667 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T04:37:03.667 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T04:37:03.667 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T04:37:03.667 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T04:37:03.667 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T04:37:03.668 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T04:37:03.668 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T04:37:03.668 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T04:37:03.668 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T04:37:03.668 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T04:37:03.668 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T04:37:03.668 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T04:37:03.668 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T04:37:03.668 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T04:37:03.668 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T04:37:03.668 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T04:37:03.668 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T04:37:03.669 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T04:37:03.669 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T04:37:03.669 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T04:37:03.669 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T04:37:03.669 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T04:37:03.669 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T04:37:03.669 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T04:37:03.669 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T04:37:03.669 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T04:37:03.669 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T04:37:03.669 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T04:37:03.669 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T04:37:03.669 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T04:37:03.670 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T04:37:03.670 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T04:37:03.670 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T04:37:03.670 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T04:37:03.670 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T04:37:03.670 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T04:37:03.670 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T04:37:03.670 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T04:37:03.670 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T04:37:03.670 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T04:37:03.670 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T04:37:03.670 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T04:37:03.670 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T04:37:03.671 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T04:37:03.671 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T04:37:03.671 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T04:37:03.671 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T04:37:03.671 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T04:37:03.671 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T04:37:03.671 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T04:37:03.671 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T04:37:03.671 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T04:37:03.671 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T04:37:03.671 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T04:37:03.671 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T04:37:03.671 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T04:37:03.672 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T04:37:03.672 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T04:37:03.672 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T04:37:03.672 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T04:37:03.672 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T04:37:03.672 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T04:37:03.672 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T04:37:03.672 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T04:37:03.672 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T04:37:03.672 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T04:37:03.672 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T04:37:03.672 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T04:37:03.672 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T04:37:03.673 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T04:37:03.673 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T04:37:03.673 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T04:37:03.673 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T04:37:03.673 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T04:37:03.673 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T04:37:03.673 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T04:37:03.673 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T04:37:03.673 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T04:37:03.673 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T04:37:03.673 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T04:37:03.673 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T04:37:03.674 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T04:37:03.674 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T04:37:03.674 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T04:37:03.674 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T04:37:03.674 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T04:37:03.674 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T04:37:03.674 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T04:37:03.674 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T04:37:03.674 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T04:37:03.674 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T04:37:03.674 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T04:37:03.674 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T04:37:03.674 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T04:37:03.675 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T04:37:03.675 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T04:37:03.675 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T04:37:03.675 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T04:37:03.675 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T04:37:03.675 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T04:37:03.675 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T04:37:03.675 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T04:37:03.675 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T04:37:03.675 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T04:37:03.675 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T04:37:03.675 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T04:37:03.675 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T04:37:03.676 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T04:37:03.676 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T04:37:03.676 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T04:37:03.676 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T04:37:03.676 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T04:37:03.676 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T04:37:03.676 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T04:37:03.676 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T04:37:03.676 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T04:37:03.676 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T04:37:03.676 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T04:37:03.676 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T04:37:03.676 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T04:37:03.677 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T04:37:03.677 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T04:37:03.677 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T04:37:06.516 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T04:37:06.516 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:37:06.516 INFO:teuthology.orchestra.run.smithi002.stdout:Upgraded: 2024-09-19T04:37:06.516 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T04:37:06.517 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T04:37:06.517 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T04:37:06.517 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T04:37:06.517 INFO:teuthology.orchestra.run.smithi002.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:06.517 INFO:teuthology.orchestra.run.smithi002.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:06.517 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T04:37:06.517 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T04:37:06.517 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-19T04:37:06.517 INFO:teuthology.orchestra.run.smithi002.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T04:37:06.517 INFO:teuthology.orchestra.run.smithi002.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T04:37:06.517 INFO:teuthology.orchestra.run.smithi002.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T04:37:06.517 INFO:teuthology.orchestra.run.smithi002.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T04:37:06.518 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:06.518 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:06.518 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:06.518 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:06.518 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:37:06.518 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:06.518 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:06.518 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:06.518 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:37:06.518 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:37:06.518 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:37:06.518 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:37:06.518 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:37:06.519 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:06.519 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:06.519 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:37:06.519 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:06.519 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:06.519 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:06.519 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:37:06.519 INFO:teuthology.orchestra.run.smithi002.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:37:06.519 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:06.519 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:06.519 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:37:06.519 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T04:37:06.520 INFO:teuthology.orchestra.run.smithi002.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T04:37:06.520 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T04:37:06.520 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T04:37:06.520 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T04:37:06.520 INFO:teuthology.orchestra.run.smithi002.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T04:37:06.520 INFO:teuthology.orchestra.run.smithi002.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T04:37:06.520 INFO:teuthology.orchestra.run.smithi002.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T04:37:06.520 INFO:teuthology.orchestra.run.smithi002.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T04:37:06.520 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T04:37:06.520 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T04:37:06.520 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:06.520 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:06.521 INFO:teuthology.orchestra.run.smithi002.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:06.521 INFO:teuthology.orchestra.run.smithi002.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T04:37:06.521 INFO:teuthology.orchestra.run.smithi002.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T04:37:06.521 INFO:teuthology.orchestra.run.smithi002.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T04:37:06.521 INFO:teuthology.orchestra.run.smithi002.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T04:37:06.521 INFO:teuthology.orchestra.run.smithi002.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T04:37:06.521 INFO:teuthology.orchestra.run.smithi002.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:06.521 INFO:teuthology.orchestra.run.smithi002.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:06.521 INFO:teuthology.orchestra.run.smithi002.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T04:37:06.521 INFO:teuthology.orchestra.run.smithi002.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:06.521 INFO:teuthology.orchestra.run.smithi002.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T04:37:06.521 INFO:teuthology.orchestra.run.smithi002.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T04:37:06.521 INFO:teuthology.orchestra.run.smithi002.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T04:37:06.522 INFO:teuthology.orchestra.run.smithi002.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T04:37:06.522 INFO:teuthology.orchestra.run.smithi002.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T04:37:06.522 INFO:teuthology.orchestra.run.smithi002.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T04:37:06.522 INFO:teuthology.orchestra.run.smithi002.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T04:37:06.522 INFO:teuthology.orchestra.run.smithi002.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T04:37:06.522 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T04:37:06.522 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T04:37:06.522 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T04:37:06.522 INFO:teuthology.orchestra.run.smithi002.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T04:37:06.522 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T04:37:06.522 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T04:37:06.522 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T04:37:06.522 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T04:37:06.523 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T04:37:06.523 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T04:37:06.523 INFO:teuthology.orchestra.run.smithi002.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T04:37:06.523 INFO:teuthology.orchestra.run.smithi002.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T04:37:06.523 INFO:teuthology.orchestra.run.smithi002.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T04:37:06.523 INFO:teuthology.orchestra.run.smithi002.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T04:37:06.523 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T04:37:06.523 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:06.523 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:06.523 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:06.523 INFO:teuthology.orchestra.run.smithi002.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T04:37:06.523 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T04:37:06.523 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T04:37:06.524 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T04:37:06.524 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T04:37:06.524 INFO:teuthology.orchestra.run.smithi002.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T04:37:06.524 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T04:37:06.524 INFO:teuthology.orchestra.run.smithi002.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T04:37:06.524 INFO:teuthology.orchestra.run.smithi002.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T04:37:06.524 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T04:37:06.524 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T04:37:06.524 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T04:37:06.524 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T04:37:06.524 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T04:37:06.524 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T04:37:06.524 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T04:37:06.525 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T04:37:06.525 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T04:37:06.525 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T04:37:06.525 INFO:teuthology.orchestra.run.smithi002.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T04:37:06.525 INFO:teuthology.orchestra.run.smithi002.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T04:37:06.525 INFO:teuthology.orchestra.run.smithi002.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T04:37:06.525 INFO:teuthology.orchestra.run.smithi002.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T04:37:06.525 INFO:teuthology.orchestra.run.smithi002.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T04:37:06.525 INFO:teuthology.orchestra.run.smithi002.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T04:37:06.525 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T04:37:06.525 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T04:37:06.525 INFO:teuthology.orchestra.run.smithi002.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T04:37:06.525 INFO:teuthology.orchestra.run.smithi002.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T04:37:06.526 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T04:37:06.526 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T04:37:06.526 INFO:teuthology.orchestra.run.smithi002.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T04:37:06.526 INFO:teuthology.orchestra.run.smithi002.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T04:37:06.526 INFO:teuthology.orchestra.run.smithi002.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T04:37:06.526 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T04:37:06.526 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T04:37:06.526 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T04:37:06.526 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T04:37:06.526 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T04:37:06.526 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T04:37:06.526 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:06.526 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:06.527 INFO:teuthology.orchestra.run.smithi002.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T04:37:06.527 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T04:37:06.527 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T04:37:06.527 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:06.527 INFO:teuthology.orchestra.run.smithi002.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T04:37:06.527 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T04:37:06.527 INFO:teuthology.orchestra.run.smithi002.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T04:37:06.527 INFO:teuthology.orchestra.run.smithi002.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T04:37:06.527 INFO:teuthology.orchestra.run.smithi002.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T04:37:06.527 INFO:teuthology.orchestra.run.smithi002.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T04:37:06.527 INFO:teuthology.orchestra.run.smithi002.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T04:37:06.527 INFO:teuthology.orchestra.run.smithi002.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T04:37:06.527 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T04:37:06.528 INFO:teuthology.orchestra.run.smithi002.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T04:37:06.528 INFO:teuthology.orchestra.run.smithi002.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T04:37:06.528 INFO:teuthology.orchestra.run.smithi002.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T04:37:06.528 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T04:37:06.528 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T04:37:06.528 INFO:teuthology.orchestra.run.smithi002.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T04:37:06.528 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:06.528 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:06.528 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:37:06.528 INFO:teuthology.orchestra.run.smithi002.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T04:37:06.528 INFO:teuthology.orchestra.run.smithi002.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T04:37:06.528 INFO:teuthology.orchestra.run.smithi002.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T04:37:06.528 INFO:teuthology.orchestra.run.smithi002.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T04:37:06.528 INFO:teuthology.orchestra.run.smithi002.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T04:37:06.529 INFO:teuthology.orchestra.run.smithi002.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T04:37:06.529 INFO:teuthology.orchestra.run.smithi002.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T04:37:06.529 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:37:06.529 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-19T04:37:06.943 DEBUG:teuthology.parallel:result is None 2024-09-19T04:37:06.944 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T04:37:07.093 DEBUG:teuthology.orchestra.run.smithi002:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T04:37:07.116 INFO:teuthology.orchestra.run.smithi002.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T04:37:07.117 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T04:37:07.117 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T04:37:07.119 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T04:37:07.261 DEBUG:teuthology.orchestra.run.smithi018:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T04:37:07.287 INFO:teuthology.orchestra.run.smithi018.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T04:37:07.288 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T04:37:07.288 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T04:37:07.290 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T04:37:07.429 DEBUG:teuthology.orchestra.run.smithi116:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T04:37:07.456 INFO:teuthology.orchestra.run.smithi116.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T04:37:07.456 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T04:37:07.456 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T04:37:07.458 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-19T04:37:07.458 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-19T04:37:07.459 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T04:37:07.489 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T04:37:07.489 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T04:37:07.524 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-19T04:37:07.524 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T04:37:07.555 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-19T04:37:07.556 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-19T04:37:07.556 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T04:37:07.584 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T04:37:07.651 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T04:37:07.651 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T04:37:07.682 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T04:37:07.752 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-19T04:37:07.752 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T04:37:07.782 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T04:37:07.851 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-19T04:37:07.852 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-19T04:37:07.852 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T04:37:07.879 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T04:37:07.946 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T04:37:07.946 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T04:37:07.975 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T04:37:08.044 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-19T04:37:08.044 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T04:37:08.069 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T04:37:08.135 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-19T04:37:08.136 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-19T04:37:08.136 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T04:37:08.164 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T04:37:08.232 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T04:37:08.232 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T04:37:08.262 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T04:37:08.332 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-19T04:37:08.332 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T04:37:08.356 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T04:37:08.421 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-19T04:37:08.521 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 1, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-09-19T04:37:08.522 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T04:37:08.522 INFO:tasks.cephadm:Cluster fsid is d46630c4-7640-11ef-bceb-c7b262605968 2024-09-19T04:37:08.522 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-19T04:37:08.523 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.2', 'mon.b': '172.21.15.18', 'mon.c': '172.21.15.116'} 2024-09-19T04:37:08.523 INFO:tasks.cephadm:First mon is mon.a on smithi002 2024-09-19T04:37:08.523 INFO:tasks.cephadm:First mgr is x 2024-09-19T04:37:08.523 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-19T04:37:08.523 DEBUG:teuthology.orchestra.run.smithi002:> sudo hostname $(hostname -s) 2024-09-19T04:37:08.553 DEBUG:teuthology.orchestra.run.smithi018:> sudo hostname $(hostname -s) 2024-09-19T04:37:08.584 DEBUG:teuthology.orchestra.run.smithi116:> sudo hostname $(hostname -s) 2024-09-19T04:37:08.609 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-19T04:37:08.610 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T04:37:08.751 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56106/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-361-g2f599a46', 'node_name': '172.21.2.7+braggi07', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-361.g2f599a46'}, 'url': 'https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-18 17:52:24.287651', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-19T04:37:08.889 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref squid, sha1 2f599a46ad10e37c929e5c43da2f6907ddcd1961 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T04:37:08.891 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T04:37:08.891 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T04:37:08.892 DEBUG:teuthology.orchestra.run.smithi002:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T04:37:09.425 INFO:teuthology.orchestra.run.smithi002.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 04:37 /home/ubuntu/cephtest/cephadm 2024-09-19T04:37:09.426 DEBUG:teuthology.orchestra.run.smithi018:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T04:37:10.177 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 04:37 /home/ubuntu/cephtest/cephadm 2024-09-19T04:37:10.177 DEBUG:teuthology.orchestra.run.smithi116:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T04:37:10.662 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 04:37 /home/ubuntu/cephtest/cephadm 2024-09-19T04:37:10.662 DEBUG:teuthology.orchestra.run.smithi002:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T04:37:10.683 DEBUG:teuthology.orchestra.run.smithi018:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T04:37:10.703 DEBUG:teuthology.orchestra.run.smithi116:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T04:37:10.739 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 on all hosts... 2024-09-19T04:37:10.739 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T04:37:10.742 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T04:37:10.745 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T04:37:12.377 INFO:teuthology.orchestra.run.smithi116.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T04:37:12.403 INFO:teuthology.orchestra.run.smithi018.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T04:37:12.685 INFO:teuthology.orchestra.run.smithi002.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T04:38:19.195 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-19T04:38:19.196 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T04:38:19.196 INFO:teuthology.orchestra.run.smithi116.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T04:38:19.196 INFO:teuthology.orchestra.run.smithi116.stdout: "repo_digests": [ 2024-09-19T04:38:19.196 INFO:teuthology.orchestra.run.smithi116.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T04:38:19.196 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-19T04:38:19.196 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-19T04:38:23.465 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T04:38:23.465 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T04:38:23.465 INFO:teuthology.orchestra.run.smithi018.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T04:38:23.465 INFO:teuthology.orchestra.run.smithi018.stdout: "repo_digests": [ 2024-09-19T04:38:23.465 INFO:teuthology.orchestra.run.smithi018.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T04:38:23.465 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T04:38:23.466 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T04:38:30.431 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:38:30.431 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T04:38:30.431 INFO:teuthology.orchestra.run.smithi002.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T04:38:30.432 INFO:teuthology.orchestra.run.smithi002.stdout: "repo_digests": [ 2024-09-19T04:38:30.432 INFO:teuthology.orchestra.run.smithi002.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T04:38:30.432 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-19T04:38:30.432 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:38:30.459 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /etc/ceph 2024-09-19T04:38:30.508 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /etc/ceph 2024-09-19T04:38:30.543 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /etc/ceph 2024-09-19T04:38:30.576 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 777 /etc/ceph 2024-09-19T04:38:30.603 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 777 /etc/ceph 2024-09-19T04:38:30.634 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 777 /etc/ceph 2024-09-19T04:38:30.662 INFO:tasks.cephadm:Writing seed config... 2024-09-19T04:38:30.663 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-19T04:38:30.664 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-19T04:38:30.664 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-19T04:38:30.664 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-19T04:38:30.664 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-19T04:38:30.664 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-19T04:38:30.664 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-19T04:38:30.664 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-19T04:38:30.664 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-19T04:38:30.664 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-19T04:38:30.664 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-19T04:38:30.664 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-19T04:38:30.665 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-19T04:38:30.665 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-19T04:38:30.665 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-19T04:38:30.665 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-19T04:38:30.665 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-19T04:38:30.665 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-19T04:38:30.665 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-19T04:38:30.665 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-19T04:38:30.665 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-09-19T04:38:30.665 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-19T04:38:30.666 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-19T04:38:30.666 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-19T04:38:30.666 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-19T04:38:30.666 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-19T04:38:30.666 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-19T04:38:30.666 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-19T04:38:30.666 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-19T04:38:30.666 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-19T04:38:30.666 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-19T04:38:30.666 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-19T04:38:30.666 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-19T04:38:30.666 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-19T04:38:30.666 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-19T04:38:30.667 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-19T04:38:30.667 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-19T04:38:30.667 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-19T04:38:30.667 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-19T04:38:30.667 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-19T04:38:30.667 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-19T04:38:30.667 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-19T04:38:30.667 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-19T04:38:30.667 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-19T04:38:30.667 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-19T04:38:30.667 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-19T04:38:30.667 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-19T04:38:30.667 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-19T04:38:30.669 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-19T04:38:30.669 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-19T04:38:30.685 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = d46630c4-7640-11ef-bceb-c7b262605968 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-19T04:38:30.685 DEBUG:teuthology.orchestra.run.smithi002:mon.a> sudo journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@mon.a.service 2024-09-19T04:38:30.727 DEBUG:teuthology.orchestra.run.smithi002:mgr.x> sudo journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@mgr.x.service 2024-09-19T04:38:30.771 INFO:tasks.cephadm:Bootstrapping... 2024-09-19T04:38:30.771 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 -v bootstrap --fsid d46630c4-7640-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.2 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-19T04:38:30.980 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-19T04:38:30.980 INFO:teuthology.orchestra.run.smithi002.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961', '-v', 'bootstrap', '--fsid', 'd46630c4-7640-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.2', '--skip-admin-label'] 2024-09-19T04:38:30.980 INFO:teuthology.orchestra.run.smithi002.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-19T04:38:30.981 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying podman|docker is present... 2024-09-19T04:38:31.005 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stdout 5.2.2 2024-09-19T04:38:31.005 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying lvm2 is present... 2024-09-19T04:38:31.005 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying time synchronization is in place... 2024-09-19T04:38:31.013 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T04:38:31.013 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T04:38:31.019 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T04:38:31.019 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-09-19T04:38:31.026 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout enabled 2024-09-19T04:38:31.033 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout active 2024-09-19T04:38:31.033 INFO:teuthology.orchestra.run.smithi002.stdout:Unit chronyd.service is enabled and running 2024-09-19T04:38:31.033 INFO:teuthology.orchestra.run.smithi002.stdout:Repeating the final host check... 2024-09-19T04:38:31.056 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stdout 5.2.2 2024-09-19T04:38:31.056 INFO:teuthology.orchestra.run.smithi002.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-19T04:38:31.056 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl is present 2024-09-19T04:38:31.056 INFO:teuthology.orchestra.run.smithi002.stdout:lvcreate is present 2024-09-19T04:38:31.063 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T04:38:31.063 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T04:38:31.072 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T04:38:31.072 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-09-19T04:38:31.076 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout enabled 2024-09-19T04:38:31.083 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout active 2024-09-19T04:38:31.083 INFO:teuthology.orchestra.run.smithi002.stdout:Unit chronyd.service is enabled and running 2024-09-19T04:38:31.083 INFO:teuthology.orchestra.run.smithi002.stdout:Host looks OK 2024-09-19T04:38:31.083 INFO:teuthology.orchestra.run.smithi002.stdout:Cluster fsid: d46630c4-7640-11ef-bceb-c7b262605968 2024-09-19T04:38:31.083 INFO:teuthology.orchestra.run.smithi002.stdout:Acquiring lock 140494857348096 on /run/cephadm/d46630c4-7640-11ef-bceb-c7b262605968.lock 2024-09-19T04:38:31.083 INFO:teuthology.orchestra.run.smithi002.stdout:Lock 140494857348096 acquired on /run/cephadm/d46630c4-7640-11ef-bceb-c7b262605968.lock 2024-09-19T04:38:31.084 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying IP 172.21.15.2 port 3300 ... 2024-09-19T04:38:31.084 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying IP 172.21.15.2 port 6789 ... 2024-09-19T04:38:31.084 INFO:teuthology.orchestra.run.smithi002.stdout:Base mon IP(s) is [172.21.15.2:3300, 172.21.15.2:6789], mon addrv is [v2:172.21.15.2:3300,v1:172.21.15.2:6789] 2024-09-19T04:38:31.087 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.2 metric 100 2024-09-19T04:38:31.087 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.2 metric 100 2024-09-19T04:38:31.090 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-19T04:38:31.090 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-19T04:38:31.090 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1782sec hoplimit 64 pref medium 2024-09-19T04:38:31.093 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-19T04:38:31.093 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-19T04:38:31.093 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T04:38:31.093 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-19T04:38:31.093 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1920/64 scope link 2024-09-19T04:38:31.093 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T04:38:31.094 INFO:teuthology.orchestra.run.smithi002.stdout:Mon IP `172.21.15.2` is in CIDR network `172.21.0.0/20` 2024-09-19T04:38:31.094 INFO:teuthology.orchestra.run.smithi002.stdout:Mon IP `172.21.15.2` is in CIDR network `172.21.0.0/20` 2024-09-19T04:38:31.094 INFO:teuthology.orchestra.run.smithi002.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-19T04:38:31.094 INFO:teuthology.orchestra.run.smithi002.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-19T04:38:31.095 INFO:teuthology.orchestra.run.smithi002.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T04:38:31.610 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stdout d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T04:38:31.610 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T04:38:31.610 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Getting image source signatures 2024-09-19T04:38:31.610 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Copying blob sha256:c4221751d16d26d2a4b7031ebd71ecffffff13c8cf7401cf95ce80dab3b6d67a 2024-09-19T04:38:31.610 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-19T04:38:31.610 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Copying config sha256:d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T04:38:31.610 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-19T04:38:32.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph: stdout ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T04:38:32.489 INFO:teuthology.orchestra.run.smithi002.stdout:Ceph version: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T04:38:32.489 INFO:teuthology.orchestra.run.smithi002.stdout:Extracting ceph user uid/gid from container image... 2024-09-19T04:38:33.345 INFO:teuthology.orchestra.run.smithi002.stdout:stat: stdout 167 167 2024-09-19T04:38:33.345 INFO:teuthology.orchestra.run.smithi002.stdout:Creating initial keys... 2024-09-19T04:38:34.534 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph-authtool: stdout AQDJqutmkc76JxAAXtt+ycqeJiuVdpDUlglrvg== 2024-09-19T04:38:35.481 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph-authtool: stdout AQDKqutmGTK2MBAAYCWlG0UfcmYZL+gGyxxUNA== 2024-09-19T04:38:36.345 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph-authtool: stdout AQDLqutmxZBdLxAAAaoQgtctgjC/KUFXjBGV8w== 2024-09-19T04:38:36.346 INFO:teuthology.orchestra.run.smithi002.stdout:Creating initial monmap... 2024-09-19T04:38:37.193 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T04:38:37.193 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-19T04:38:37.193 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to d46630c4-7640-11ef-bceb-c7b262605968 2024-09-19T04:38:37.193 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T04:38:37.193 INFO:teuthology.orchestra.run.smithi002.stdout:monmaptool for a [v2:172.21.15.2:3300,v1:172.21.15.2:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T04:38:37.193 INFO:teuthology.orchestra.run.smithi002.stdout:setting min_mon_release = quincy 2024-09-19T04:38:37.193 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: set fsid to d46630c4-7640-11ef-bceb-c7b262605968 2024-09-19T04:38:37.193 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T04:38:37.194 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:38:37.194 INFO:teuthology.orchestra.run.smithi002.stdout:Creating mon... 2024-09-19T04:38:38.132 INFO:teuthology.orchestra.run.smithi002.stdout:create mon.a on 2024-09-19T04:38:38.364 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-19T04:38:38.513 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-19T04:38:38.697 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-d46630c4-7640-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-d46630c4-7640-11ef-bceb-c7b262605968.target. 2024-09-19T04:38:38.697 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-d46630c4-7640-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-d46630c4-7640-11ef-bceb-c7b262605968.target. 2024-09-19T04:38:38.939 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-d46630c4-7640-11ef-bceb-c7b262605968@mon.a 2024-09-19T04:38:38.939 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Failed to reset failed state of unit ceph-d46630c4-7640-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-d46630c4-7640-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-19T04:38:39.194 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-d46630c4-7640-11ef-bceb-c7b262605968.target.wants/ceph-d46630c4-7640-11ef-bceb-c7b262605968@mon.a.service → /etc/systemd/system/ceph-d46630c4-7640-11ef-bceb-c7b262605968@.service. 2024-09-19T04:38:39.452 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:39 smithi002 podman[30586]: 2024-09-19 04:38:39.353846059 +0000 UTC m=+0.016223592 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T04:38:39.703 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:39 smithi002 podman[30586]: 2024-09-19 04:38:39.657841259 +0000 UTC m=+0.320218794 container init 1bafb8c8e61b48d8936235c4df036c1353d6b65895cc2b6213d0de9fbe22fd60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mon-a, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-19T04:38:39.703 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:39 smithi002 podman[30586]: 2024-09-19 04:38:39.661196541 +0000 UTC m=+0.323574065 container start 1bafb8c8e61b48d8936235c4df036c1353d6b65895cc2b6213d0de9fbe22fd60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mon-a, RELEASE=squid-2f599a4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T04:38:39.703 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:39 smithi002 ceph-mon[30606]: mkfs d46630c4-7640-11ef-bceb-c7b262605968 2024-09-19T04:38:39.703 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:39 smithi002 ceph-mon[30606]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T04:38:39.756 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T04:38:39.756 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout disabled 2024-09-19T04:38:39.763 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T04:38:39.763 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-09-19T04:38:39.763 INFO:teuthology.orchestra.run.smithi002.stdout:firewalld.service is not enabled 2024-09-19T04:38:39.763 INFO:teuthology.orchestra.run.smithi002.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T04:38:39.764 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mon to start... 2024-09-19T04:38:39.764 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mon... 2024-09-19T04:38:39.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:39 smithi002 bash[30586]: 1bafb8c8e61b48d8936235c4df036c1353d6b65895cc2b6213d0de9fbe22fd60 2024-09-19T04:38:39.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:39 smithi002 systemd[1]: Started Ceph mon.a for d46630c4-7640-11ef-bceb-c7b262605968. 2024-09-19T04:38:40.790 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:40 smithi002 ceph-mon[30606]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T04:38:40.791 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:40 smithi002 ceph-mon[30606]: monmap epoch 1 2024-09-19T04:38:40.791 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:40 smithi002 ceph-mon[30606]: fsid d46630c4-7640-11ef-bceb-c7b262605968 2024-09-19T04:38:40.791 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:40 smithi002 ceph-mon[30606]: last_changed 2024-09-19T04:38:36.676338+0000 2024-09-19T04:38:40.791 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:40 smithi002 ceph-mon[30606]: created 2024-09-19T04:38:36.676338+0000 2024-09-19T04:38:40.791 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:40 smithi002 ceph-mon[30606]: min_mon_release 19 (squid) 2024-09-19T04:38:40.791 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:40 smithi002 ceph-mon[30606]: election_strategy: 1 2024-09-19T04:38:40.791 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:40 smithi002 ceph-mon[30606]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-19T04:38:40.791 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:40 smithi002 ceph-mon[30606]: fsmap 2024-09-19T04:38:40.791 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:40 smithi002 ceph-mon[30606]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T04:38:40.791 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:40 smithi002 ceph-mon[30606]: mgrmap e1: no daemons active 2024-09-19T04:38:40.791 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:40 smithi002 ceph-mon[30606]: from='client.? 172.21.15.2:0/748376122' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-19T04:38:40.793 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout cluster: 2024-09-19T04:38:40.799 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout id: d46630c4-7640-11ef-bceb-c7b262605968 2024-09-19T04:38:40.799 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-19T04:38:40.799 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-19T04:38:40.799 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout services: 2024-09-19T04:38:40.799 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.546139s) 2024-09-19T04:38:40.799 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-19T04:38:40.799 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-19T04:38:40.799 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-19T04:38:40.799 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout data: 2024-09-19T04:38:40.799 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-19T04:38:40.799 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-19T04:38:40.800 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-19T04:38:40.800 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout pgs: 2024-09-19T04:38:40.800 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-19T04:38:40.800 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:40.172+0000 7fb63f572640 1 Processor -- start 2024-09-19T04:38:40.800 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:40.173+0000 7fb63f572640 1 -- start start 2024-09-19T04:38:40.800 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:40.173+0000 7fb63f572640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb63807deb0 0x7fb63807c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:40.800 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:40.173+0000 7fb63f572640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb63807c8e0 con 0x7fb63807deb0 2024-09-19T04:38:40.800 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:40.173+0000 7fb63d30e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb63807deb0 0x7fb63807c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:40.800 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:40.173+0000 7fb63d30e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb63807deb0 0x7fb63807c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44198/0 (socket says 172.21.15.2:44198) 2024-09-19T04:38:40.800 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:40.173+0000 7fb63d30e640 1 -- 172.21.15.2:0/1990021050 learned_addr learned my addr 172.21.15.2:0/1990021050 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:38:40.800 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:40.173+0000 7fb63d30e640 1 -- 172.21.15.2:0/1990021050 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb63807ca60 con 0x7fb63807deb0 2024-09-19T04:38:40.801 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:40.175+0000 7fb63d30e640 1 --2- 172.21.15.2:0/1990021050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb63807deb0 0x7fb63807c310 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb634009820 tx=0x7fb63402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27c32bcd5dd53c57 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:40.801 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:40.175+0000 7fb62ffff640 1 -- 172.21.15.2:0/1990021050 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb634037070 con 0x7fb63807deb0 2024-09-19T04:38:40.801 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:40.176+0000 7fb62ffff640 1 -- 172.21.15.2:0/1990021050 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb634032440 con 0x7fb63807deb0 2024-09-19T04:38:40.801 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:40.176+0000 7fb62ffff640 1 -- 172.21.15.2:0/1990021050 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb634032740 con 0x7fb63807deb0 2024-09-19T04:38:40.801 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:40.176+0000 7fb63f572640 1 -- 172.21.15.2:0/1990021050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb63807deb0 msgr2=0x7fb63807c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:40.801 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:40.176+0000 7fb63f572640 1 --2- 172.21.15.2:0/1990021050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb63807deb0 0x7fb63807c310 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb634009820 tx=0x7fb63402a270 comp rx=0 tx=0).stop 2024-09-19T04:38:40.801 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:40.176+0000 7fb63f572640 1 -- 172.21.15.2:0/1990021050 shutdown_connections 2024-09-19T04:38:40.801 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:40.176+0000 7fb63f572640 1 --2- 172.21.15.2:0/1990021050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb63807deb0 0x7fb63807c310 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:40.801 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:40.176+0000 7fb63f572640 1 -- 172.21.15.2:0/1990021050 >> 172.21.15.2:0/1990021050 conn(0x7fb638102d50 msgr2=0x7fb638105190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:40.801 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:40.176+0000 7fb63f572640 1 -- 172.21.15.2:0/1990021050 shutdown_connections 2024-09-19T04:38:40.801 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:40.176+0000 7fb63f572640 1 -- 172.21.15.2:0/1990021050 wait complete. 2024-09-19T04:38:40.801 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:40.177+0000 7fb63f572640 1 Processor -- start 2024-09-19T04:38:40.802 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:40.177+0000 7fb63f572640 1 -- start start 2024-09-19T04:38:40.802 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:40.177+0000 7fb63f572640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb63807deb0 0x7fb63819cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:40.802 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:40.177+0000 7fb63f572640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb63807d000 con 0x7fb63807deb0 2024-09-19T04:38:40.802 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:40.177+0000 7fb63d30e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb63807deb0 0x7fb63819cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:40.802 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:40.177+0000 7fb63d30e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb63807deb0 0x7fb63819cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44214/0 (socket says 172.21.15.2:44214) 2024-09-19T04:38:40.802 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:40.177+0000 7fb63d30e640 1 -- 172.21.15.2:0/748376122 learned_addr learned my addr 172.21.15.2:0/748376122 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:38:40.802 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:40.178+0000 7fb63d30e640 1 -- 172.21.15.2:0/748376122 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb63819d4c0 con 0x7fb63807deb0 2024-09-19T04:38:40.802 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:40.178+0000 7fb63d30e640 1 --2- 172.21.15.2:0/748376122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb63807deb0 0x7fb63819cf80 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fb6340090b0 tx=0x7fb6340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:40.802 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:40.178+0000 7fb62e7fc640 1 -- 172.21.15.2:0/748376122 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb634041070 con 0x7fb63807deb0 2024-09-19T04:38:40.802 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:40.178+0000 7fb62e7fc640 1 -- 172.21.15.2:0/748376122 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb63403c7a0 con 0x7fb63807deb0 2024-09-19T04:38:40.802 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:40.178+0000 7fb63f572640 1 -- 172.21.15.2:0/748376122 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb63819d750 con 0x7fb63807deb0 2024-09-19T04:38:40.802 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:40.178+0000 7fb62e7fc640 1 -- 172.21.15.2:0/748376122 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb634037040 con 0x7fb63807deb0 2024-09-19T04:38:40.802 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:40.178+0000 7fb63f572640 1 -- 172.21.15.2:0/748376122 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6381a0440 con 0x7fb63807deb0 2024-09-19T04:38:40.803 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:40.178+0000 7fb62e7fc640 1 -- 172.21.15.2:0/748376122 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb634044070 con 0x7fb63807deb0 2024-09-19T04:38:40.803 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:40.178+0000 7fb62e7fc640 1 -- 172.21.15.2:0/748376122 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb63403d3f0 con 0x7fb63807deb0 2024-09-19T04:38:40.803 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:40.179+0000 7fb63f572640 1 -- 172.21.15.2:0/748376122 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb63807c390 con 0x7fb63807deb0 2024-09-19T04:38:40.803 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:40.181+0000 7fb62e7fc640 1 -- 172.21.15.2:0/748376122 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fb634046450 con 0x7fb63807deb0 2024-09-19T04:38:40.803 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:40.242+0000 7fb63f572640 1 -- 172.21.15.2:0/748376122 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fb63802d910 con 0x7fb63807deb0 2024-09-19T04:38:40.803 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:40.243+0000 7fb62e7fc640 1 -- 172.21.15.2:0/748376122 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7fb634046630 con 0x7fb63807deb0 2024-09-19T04:38:40.803 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:40.243+0000 7fb63f572640 1 -- 172.21.15.2:0/748376122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb63807deb0 msgr2=0x7fb63819cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:40.803 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:40.243+0000 7fb63f572640 1 --2- 172.21.15.2:0/748376122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb63807deb0 0x7fb63819cf80 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fb6340090b0 tx=0x7fb6340046c0 comp rx=0 tx=0).stop 2024-09-19T04:38:40.803 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:40.243+0000 7fb63f572640 1 -- 172.21.15.2:0/748376122 shutdown_connections 2024-09-19T04:38:40.803 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:40.243+0000 7fb63f572640 1 --2- 172.21.15.2:0/748376122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb63807deb0 0x7fb63819cf80 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:40.803 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:40.243+0000 7fb63f572640 1 -- 172.21.15.2:0/748376122 >> 172.21.15.2:0/748376122 conn(0x7fb638102d50 msgr2=0x7fb638103d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:40.803 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:40.244+0000 7fb63f572640 1 -- 172.21.15.2:0/748376122 shutdown_connections 2024-09-19T04:38:40.803 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:40.244+0000 7fb63f572640 1 -- 172.21.15.2:0/748376122 wait complete. 2024-09-19T04:38:40.804 INFO:teuthology.orchestra.run.smithi002.stdout:mon is available 2024-09-19T04:38:40.804 INFO:teuthology.orchestra.run.smithi002.stdout:Assimilating anything we can from ceph.conf... 2024-09-19T04:38:41.789 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-19T04:38:41.789 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T04:38:41.789 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout fsid = d46630c4-7640-11ef-bceb-c7b262605968 2024-09-19T04:38:41.789 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.2:3300,v1:172.21.15.2:6789] 2024-09-19T04:38:41.789 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T04:38:41.789 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T04:38:41.789 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T04:38:41.789 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T04:38:41.789 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-19T04:38:41.789 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T04:38:41.789 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T04:38:41.790 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-19T04:38:41.790 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T04:38:41.790 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T04:38:41.790 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T04:38:41.790 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T04:38:41.790 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T04:38:41.790 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T04:38:41.790 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:41.170+0000 7f7a3e3bc640 1 Processor -- start 2024-09-19T04:38:41.790 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:41.170+0000 7f7a3e3bc640 1 -- start start 2024-09-19T04:38:41.790 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:41.170+0000 7f7a3e3bc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a381075c0 0x7f7a381079c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:41.790 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:41.170+0000 7f7a3e3bc640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7a38107f90 con 0x7f7a381075c0 2024-09-19T04:38:41.790 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:41.170+0000 7f7a37fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a381075c0 0x7f7a381079c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:41.790 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:41.170+0000 7f7a37fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a381075c0 0x7f7a381079c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44216/0 (socket says 172.21.15.2:44216) 2024-09-19T04:38:41.791 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:41.170+0000 7f7a37fff640 1 -- 172.21.15.2:0/3001653641 learned_addr learned my addr 172.21.15.2:0/3001653641 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:38:41.791 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:41.171+0000 7f7a37fff640 1 -- 172.21.15.2:0/3001653641 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a381087c0 con 0x7f7a381075c0 2024-09-19T04:38:41.791 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:41.171+0000 7f7a37fff640 1 --2- 172.21.15.2:0/3001653641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a381075c0 0x7f7a381079c0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f7a28009820 tx=0x7f7a2802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f8d4cff0d407961 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:41.791 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:41.171+0000 7f7a36ffd640 1 -- 172.21.15.2:0/3001653641 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a28037070 con 0x7f7a381075c0 2024-09-19T04:38:41.791 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:41.171+0000 7f7a36ffd640 1 -- 172.21.15.2:0/3001653641 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a28032440 con 0x7f7a381075c0 2024-09-19T04:38:41.791 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:41.172+0000 7f7a36ffd640 1 -- 172.21.15.2:0/3001653641 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a28032740 con 0x7f7a381075c0 2024-09-19T04:38:41.791 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:41.172+0000 7f7a3e3bc640 1 -- 172.21.15.2:0/3001653641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a381075c0 msgr2=0x7f7a381079c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:41.791 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:41.172+0000 7f7a3e3bc640 1 --2- 172.21.15.2:0/3001653641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a381075c0 0x7f7a381079c0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f7a28009820 tx=0x7f7a2802a270 comp rx=0 tx=0).stop 2024-09-19T04:38:41.791 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:41.172+0000 7f7a3e3bc640 1 -- 172.21.15.2:0/3001653641 shutdown_connections 2024-09-19T04:38:41.791 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:41.172+0000 7f7a3e3bc640 1 --2- 172.21.15.2:0/3001653641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a381075c0 0x7f7a381079c0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:41.791 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:41.172+0000 7f7a3e3bc640 1 -- 172.21.15.2:0/3001653641 >> 172.21.15.2:0/3001653641 conn(0x7f7a38102d50 msgr2=0x7f7a38105190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:41.791 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:41.172+0000 7f7a3e3bc640 1 -- 172.21.15.2:0/3001653641 shutdown_connections 2024-09-19T04:38:41.792 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:41.172+0000 7f7a3e3bc640 1 -- 172.21.15.2:0/3001653641 wait complete. 2024-09-19T04:38:41.792 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:41.173+0000 7f7a3e3bc640 1 Processor -- start 2024-09-19T04:38:41.792 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:41.173+0000 7f7a3e3bc640 1 -- start start 2024-09-19T04:38:41.792 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:41.173+0000 7f7a3e3bc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a381075c0 0x7f7a3819adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:41.792 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:41.173+0000 7f7a3e3bc640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7a38108d60 con 0x7f7a381075c0 2024-09-19T04:38:41.792 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:41.173+0000 7f7a37fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a381075c0 0x7f7a3819adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:41.792 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:41.173+0000 7f7a37fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a381075c0 0x7f7a3819adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44224/0 (socket says 172.21.15.2:44224) 2024-09-19T04:38:41.792 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:41.173+0000 7f7a37fff640 1 -- 172.21.15.2:0/2607133314 learned_addr learned my addr 172.21.15.2:0/2607133314 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:38:41.792 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:41.173+0000 7f7a37fff640 1 -- 172.21.15.2:0/2607133314 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a3819b2f0 con 0x7f7a381075c0 2024-09-19T04:38:41.792 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:41.174+0000 7f7a37fff640 1 --2- 172.21.15.2:0/2607133314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a381075c0 0x7f7a3819adb0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f7a280090b0 tx=0x7f7a280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:41.792 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:41.174+0000 7f7a357fa640 1 -- 172.21.15.2:0/2607133314 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a28041070 con 0x7f7a381075c0 2024-09-19T04:38:41.792 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:41.174+0000 7f7a357fa640 1 -- 172.21.15.2:0/2607133314 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a2803c7a0 con 0x7f7a381075c0 2024-09-19T04:38:41.792 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:41.174+0000 7f7a3e3bc640 1 -- 172.21.15.2:0/2607133314 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a3819b580 con 0x7f7a381075c0 2024-09-19T04:38:41.793 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:41.174+0000 7f7a357fa640 1 -- 172.21.15.2:0/2607133314 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a28037040 con 0x7f7a381075c0 2024-09-19T04:38:41.793 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:41.174+0000 7f7a3e3bc640 1 -- 172.21.15.2:0/2607133314 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a3819e230 con 0x7f7a381075c0 2024-09-19T04:38:41.793 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:41.174+0000 7f7a357fa640 1 -- 172.21.15.2:0/2607133314 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7a28044070 con 0x7f7a381075c0 2024-09-19T04:38:41.793 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:41.174+0000 7f7a357fa640 1 -- 172.21.15.2:0/2607133314 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7a2803d3f0 con 0x7f7a381075c0 2024-09-19T04:38:41.793 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:41.175+0000 7f7a3e3bc640 1 -- 172.21.15.2:0/2607133314 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a381093b0 con 0x7f7a381075c0 2024-09-19T04:38:41.793 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:41.177+0000 7f7a357fa640 1 -- 172.21.15.2:0/2607133314 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f7a28046450 con 0x7f7a381075c0 2024-09-19T04:38:41.793 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:41.236+0000 7f7a3e3bc640 1 -- 172.21.15.2:0/2607133314 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f7a3819f990 con 0x7f7a381075c0 2024-09-19T04:38:41.793 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:41.240+0000 7f7a357fa640 1 -- 172.21.15.2:0/2607133314 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+427 (secure 0 0 0) 0x7f7a28046630 con 0x7f7a381075c0 2024-09-19T04:38:41.793 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:41.240+0000 7f7a357fa640 1 -- 172.21.15.2:0/2607133314 <== mon.0 v2:172.21.15.2:3300/0 8 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f7a28056070 con 0x7f7a381075c0 2024-09-19T04:38:41.793 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:41.241+0000 7f7a3e3bc640 1 -- 172.21.15.2:0/2607133314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a381075c0 msgr2=0x7f7a3819adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:41.793 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:41.241+0000 7f7a3e3bc640 1 --2- 172.21.15.2:0/2607133314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a381075c0 0x7f7a3819adb0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f7a280090b0 tx=0x7f7a280046c0 comp rx=0 tx=0).stop 2024-09-19T04:38:41.793 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:41.241+0000 7f7a3e3bc640 1 -- 172.21.15.2:0/2607133314 shutdown_connections 2024-09-19T04:38:41.794 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:41.241+0000 7f7a3e3bc640 1 --2- 172.21.15.2:0/2607133314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a381075c0 0x7f7a3819adb0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:41.794 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:41.241+0000 7f7a3e3bc640 1 -- 172.21.15.2:0/2607133314 >> 172.21.15.2:0/2607133314 conn(0x7f7a38102d50 msgr2=0x7f7a3818f080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:41.794 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:41.241+0000 7f7a3e3bc640 1 -- 172.21.15.2:0/2607133314 shutdown_connections 2024-09-19T04:38:41.794 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:41.241+0000 7f7a3e3bc640 1 -- 172.21.15.2:0/2607133314 wait complete. 2024-09-19T04:38:41.794 INFO:teuthology.orchestra.run.smithi002.stdout:Generating new minimal ceph.conf... 2024-09-19T04:38:41.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:41 smithi002 ceph-mon[30606]: from='client.? 172.21.15.2:0/2607133314' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T04:38:41.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:41 smithi002 ceph-mon[30606]: from='client.? 172.21.15.2:0/2607133314' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-19T04:38:42.819 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:42 smithi002 ceph-mon[30606]: from='client.? 172.21.15.2:0/3165423441' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:38:42.829 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:42.185+0000 7f629011e640 1 Processor -- start 2024-09-19T04:38:42.830 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:42.186+0000 7f629011e640 1 -- start start 2024-09-19T04:38:42.830 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:42.186+0000 7f629011e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f628807de70 0x7f628807c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:42.830 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:42.186+0000 7f629011e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f628807c8a0 con 0x7f628807de70 2024-09-19T04:38:42.830 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:42.186+0000 7f628deba640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f628807de70 0x7f628807c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:42.830 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:42.186+0000 7f628deba640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f628807de70 0x7f628807c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56796/0 (socket says 172.21.15.2:56796) 2024-09-19T04:38:42.830 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:42.186+0000 7f628deba640 1 -- 172.21.15.2:0/2141156496 learned_addr learned my addr 172.21.15.2:0/2141156496 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:38:42.830 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:42.186+0000 7f628deba640 1 -- 172.21.15.2:0/2141156496 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f628807ca20 con 0x7f628807de70 2024-09-19T04:38:42.830 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:42.187+0000 7f628deba640 1 --2- 172.21.15.2:0/2141156496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f628807de70 0x7f628807c2d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f6284009820 tx=0x7f628402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d2105d5b18a4c85 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:42.830 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:42.187+0000 7f628ceb8640 1 -- 172.21.15.2:0/2141156496 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6284037070 con 0x7f628807de70 2024-09-19T04:38:42.830 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:42.187+0000 7f628ceb8640 1 -- 172.21.15.2:0/2141156496 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f62840328d0 con 0x7f628807de70 2024-09-19T04:38:42.830 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:42.187+0000 7f628ceb8640 1 -- 172.21.15.2:0/2141156496 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62840307d0 con 0x7f628807de70 2024-09-19T04:38:42.831 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:42.188+0000 7f629011e640 1 -- 172.21.15.2:0/2141156496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f628807de70 msgr2=0x7f628807c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:42.831 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:42.188+0000 7f629011e640 1 --2- 172.21.15.2:0/2141156496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f628807de70 0x7f628807c2d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f6284009820 tx=0x7f628402a270 comp rx=0 tx=0).stop 2024-09-19T04:38:42.831 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:42.188+0000 7f629011e640 1 -- 172.21.15.2:0/2141156496 shutdown_connections 2024-09-19T04:38:42.831 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:42.188+0000 7f629011e640 1 --2- 172.21.15.2:0/2141156496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f628807de70 0x7f628807c2d0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:42.831 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:42.188+0000 7f629011e640 1 -- 172.21.15.2:0/2141156496 >> 172.21.15.2:0/2141156496 conn(0x7f6288102d50 msgr2=0x7f6288105190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:42.831 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:42.188+0000 7f629011e640 1 -- 172.21.15.2:0/2141156496 shutdown_connections 2024-09-19T04:38:42.831 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:42.188+0000 7f629011e640 1 -- 172.21.15.2:0/2141156496 wait complete. 2024-09-19T04:38:42.831 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:42.188+0000 7f629011e640 1 Processor -- start 2024-09-19T04:38:42.831 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:42.189+0000 7f629011e640 1 -- start start 2024-09-19T04:38:42.831 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:42.189+0000 7f629011e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f628807de70 0x7f628819d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:42.831 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:42.189+0000 7f629011e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f628810db90 con 0x7f628807de70 2024-09-19T04:38:42.831 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:42.189+0000 7f628deba640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f628807de70 0x7f628819d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:42.832 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:42.189+0000 7f628deba640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f628807de70 0x7f628819d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56798/0 (socket says 172.21.15.2:56798) 2024-09-19T04:38:42.832 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:42.189+0000 7f628deba640 1 -- 172.21.15.2:0/3165423441 learned_addr learned my addr 172.21.15.2:0/3165423441 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:38:42.832 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:42.189+0000 7f628deba640 1 -- 172.21.15.2:0/3165423441 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f628819dd00 con 0x7f628807de70 2024-09-19T04:38:42.832 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:42.189+0000 7f628deba640 1 --2- 172.21.15.2:0/3165423441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f628807de70 0x7f628819d7c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f62840097f0 tx=0x7f6284030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:42.832 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:42.189+0000 7f627effd640 1 -- 172.21.15.2:0/3165423441 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6284037040 con 0x7f628807de70 2024-09-19T04:38:42.832 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:42.189+0000 7f627effd640 1 -- 172.21.15.2:0/3165423441 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f628403b3f0 con 0x7f628807de70 2024-09-19T04:38:42.832 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:42.189+0000 7f629011e640 1 -- 172.21.15.2:0/3165423441 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f628819df90 con 0x7f628807de70 2024-09-19T04:38:42.832 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:42.190+0000 7f627effd640 1 -- 172.21.15.2:0/3165423441 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f628403a520 con 0x7f628807de70 2024-09-19T04:38:42.832 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:42.190+0000 7f629011e640 1 -- 172.21.15.2:0/3165423441 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62881a0c80 con 0x7f628807de70 2024-09-19T04:38:42.832 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:42.190+0000 7f627effd640 1 -- 172.21.15.2:0/3165423441 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f628403a6c0 con 0x7f628807de70 2024-09-19T04:38:42.832 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:42.190+0000 7f627effd640 1 -- 172.21.15.2:0/3165423441 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6284044b00 con 0x7f628807de70 2024-09-19T04:38:42.833 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:42.191+0000 7f629011e640 1 -- 172.21.15.2:0/3165423441 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f628807c350 con 0x7f628807de70 2024-09-19T04:38:42.833 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:42.193+0000 7f627effd640 1 -- 172.21.15.2:0/3165423441 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f628403b980 con 0x7f628807de70 2024-09-19T04:38:42.833 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:42.252+0000 7f629011e640 1 -- 172.21.15.2:0/3165423441 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f62881a1200 con 0x7f628807de70 2024-09-19T04:38:42.833 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:42.252+0000 7f627effd640 1 -- 172.21.15.2:0/3165423441 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+173 (secure 0 0 0) 0x7f628403b5a0 con 0x7f628807de70 2024-09-19T04:38:42.833 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:42.253+0000 7f629011e640 1 -- 172.21.15.2:0/3165423441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f628807de70 msgr2=0x7f628819d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:42.833 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:42.253+0000 7f629011e640 1 --2- 172.21.15.2:0/3165423441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f628807de70 0x7f628819d7c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f62840097f0 tx=0x7f6284030d00 comp rx=0 tx=0).stop 2024-09-19T04:38:42.833 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:42.253+0000 7f629011e640 1 -- 172.21.15.2:0/3165423441 shutdown_connections 2024-09-19T04:38:42.833 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:42.253+0000 7f629011e640 1 --2- 172.21.15.2:0/3165423441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f628807de70 0x7f628819d7c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:42.833 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:42.253+0000 7f629011e640 1 -- 172.21.15.2:0/3165423441 >> 172.21.15.2:0/3165423441 conn(0x7f6288102d50 msgr2=0x7f6288103910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:42.833 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:42.253+0000 7f629011e640 1 -- 172.21.15.2:0/3165423441 shutdown_connections 2024-09-19T04:38:42.833 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:42.253+0000 7f629011e640 1 -- 172.21.15.2:0/3165423441 wait complete. 2024-09-19T04:38:42.833 INFO:teuthology.orchestra.run.smithi002.stdout:Restarting the monitor... 2024-09-19T04:38:43.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:42 smithi002 systemd[1]: Stopping Ceph mon.a for d46630c4-7640-11ef-bceb-c7b262605968... 2024-09-19T04:38:43.499 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:43 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mon-a[30602]: 2024-09-19T04:38:43.130+0000 7f54be3b7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:38:43.499 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:43 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mon-a[30602]: 2024-09-19T04:38:43.130+0000 7f54be3b7640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-19T04:38:43.499 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:43 smithi002 podman[30852]: 2024-09-19 04:38:43.222937165 +0000 UTC m=+0.229267278 container died 1bafb8c8e61b48d8936235c4df036c1353d6b65895cc2b6213d0de9fbe22fd60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mon-a, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T04:38:43.832 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:43 smithi002 podman[30852]: 2024-09-19 04:38:43.588791842 +0000 UTC m=+0.595121961 container cleanup 1bafb8c8e61b48d8936235c4df036c1353d6b65895cc2b6213d0de9fbe22fd60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mon-a, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-19T04:38:43.832 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:43 smithi002 bash[30852]: ceph-d46630c4-7640-11ef-bceb-c7b262605968-mon-a 2024-09-19T04:38:44.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:43 smithi002 podman[30865]: 2024-09-19 04:38:43.831253835 +0000 UTC m=+0.599322075 container remove 1bafb8c8e61b48d8936235c4df036c1353d6b65895cc2b6213d0de9fbe22fd60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mon-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4) 2024-09-19T04:38:44.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:43 smithi002 systemd[1]: ceph-d46630c4-7640-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-19T04:38:44.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:43 smithi002 systemd[1]: Stopped Ceph mon.a for d46630c4-7640-11ef-bceb-c7b262605968. 2024-09-19T04:38:44.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:43 smithi002 systemd[1]: Starting Ceph mon.a for d46630c4-7640-11ef-bceb-c7b262605968... 2024-09-19T04:38:44.511 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 podman[30956]: 2024-09-19 04:38:44.091098673 +0000 UTC m=+0.016262544 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T04:38:44.511 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 podman[30956]: 2024-09-19 04:38:44.407104299 +0000 UTC m=+0.332268152 container create 7720d0275239e8c2d1aa5e29f5ed99628f65acf75f8726a29944539afd7dc971 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mon-a, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T04:38:44.714 INFO:teuthology.orchestra.run.smithi002.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-19T04:38:44.820 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 podman[30956]: 2024-09-19 04:38:44.634640809 +0000 UTC m=+0.559804675 container init 7720d0275239e8c2d1aa5e29f5ed99628f65acf75f8726a29944539afd7dc971 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mon-a, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-19T04:38:44.820 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 podman[30956]: 2024-09-19 04:38:44.637975456 +0000 UTC m=+0.563139327 container start 7720d0275239e8c2d1aa5e29f5ed99628f65acf75f8726a29944539afd7dc971 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mon-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-19T04:38:44.820 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T04:38:44.820 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T04:38:44.820 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: pidfile_write: ignore empty --pid-file 2024-09-19T04:38:44.820 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: load: jerasure load: lrc 2024-09-19T04:38:44.820 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: RocksDB version: 7.9.2 2024-09-19T04:38:44.820 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Git sha 0 2024-09-19T04:38:44.820 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T04:38:44.820 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: DB SUMMARY 2024-09-19T04:38:44.821 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: DB Session ID: 11D11ORB4AA28PTY902T 2024-09-19T04:38:44.821 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: CURRENT file: CURRENT 2024-09-19T04:38:44.821 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T04:38:44.821 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-19T04:38:44.821 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-19T04:38:44.821 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 105478 ; 2024-09-19T04:38:44.821 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.error_if_exists: 0 2024-09-19T04:38:44.821 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.create_if_missing: 0 2024-09-19T04:38:44.821 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.paranoid_checks: 1 2024-09-19T04:38:44.821 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T04:38:44.821 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T04:38:44.821 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T04:38:44.821 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.env: 0x55d23b870940 2024-09-19T04:38:44.821 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T04:38:44.822 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.info_log: 0x55d23d2656e0 2024-09-19T04:38:44.822 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T04:38:44.822 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.statistics: (nil) 2024-09-19T04:38:44.822 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.use_fsync: 0 2024-09-19T04:38:44.823 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.max_log_file_size: 0 2024-09-19T04:38:44.823 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T04:38:44.823 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T04:38:44.823 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T04:38:44.823 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T04:38:44.823 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.allow_fallocate: 1 2024-09-19T04:38:44.823 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T04:38:44.823 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T04:38:44.823 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.use_direct_reads: 0 2024-09-19T04:38:44.823 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T04:38:44.823 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T04:38:44.823 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.db_log_dir: 2024-09-19T04:38:44.823 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.wal_dir: 2024-09-19T04:38:44.823 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T04:38:44.824 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T04:38:44.824 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T04:38:44.824 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T04:38:44.824 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T04:38:44.824 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T04:38:44.824 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T04:38:44.824 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T04:38:44.824 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.write_buffer_manager: 0x55d23d274dc0 2024-09-19T04:38:44.824 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T04:38:44.824 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T04:38:44.824 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T04:38:44.824 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T04:38:44.825 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T04:38:44.825 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T04:38:44.825 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T04:38:44.825 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T04:38:44.825 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.unordered_write: 0 2024-09-19T04:38:44.825 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T04:38:44.825 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T04:38:44.825 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T04:38:44.825 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T04:38:44.825 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.row_cache: None 2024-09-19T04:38:44.825 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.wal_filter: None 2024-09-19T04:38:44.825 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T04:38:44.825 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T04:38:44.826 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.two_write_queues: 0 2024-09-19T04:38:44.826 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T04:38:44.826 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.wal_compression: 0 2024-09-19T04:38:44.826 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.atomic_flush: 0 2024-09-19T04:38:44.826 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T04:38:44.826 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T04:38:44.826 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T04:38:44.826 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.log_readahead_size: 0 2024-09-19T04:38:44.826 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T04:38:44.826 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T04:38:44.826 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T04:38:44.826 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T04:38:44.826 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T04:38:44.827 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T04:38:44.827 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T04:38:44.827 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.max_background_jobs: 2 2024-09-19T04:38:44.827 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.max_background_compactions: -1 2024-09-19T04:38:44.827 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.max_subcompactions: 1 2024-09-19T04:38:44.827 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T04:38:44.827 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T04:38:44.827 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T04:38:44.827 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T04:38:44.827 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T04:38:44.827 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T04:38:44.827 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T04:38:44.827 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T04:38:44.827 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.max_open_files: -1 2024-09-19T04:38:44.828 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T04:38:44.828 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T04:38:44.828 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T04:38:44.828 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T04:38:44.828 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.max_background_flushes: -1 2024-09-19T04:38:44.828 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Compression algorithms supported: 2024-09-19T04:38:44.828 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: kZSTD supported: 0 2024-09-19T04:38:44.828 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: kXpressCompression supported: 0 2024-09-19T04:38:44.828 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: kBZip2Compression supported: 0 2024-09-19T04:38:44.828 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T04:38:44.828 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: kLZ4Compression supported: 1 2024-09-19T04:38:44.828 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: kZlibCompression supported: 1 2024-09-19T04:38:44.828 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T04:38:44.829 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: kSnappyCompression supported: 1 2024-09-19T04:38:44.829 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T04:38:44.829 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T04:38:44.829 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-19T04:38:44.829 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T04:38:44.829 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T04:38:44.829 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.merge_operator: 2024-09-19T04:38:44.829 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.compaction_filter: None 2024-09-19T04:38:44.829 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T04:38:44.829 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T04:38:44.829 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T04:38:44.829 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T04:38:44.829 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55d23d265320) 2024-09-19T04:38:44.830 INFO:journalctl@ceph.mon.a.smithi002.stdout: cache_index_and_filter_blocks: 1 2024-09-19T04:38:44.830 INFO:journalctl@ceph.mon.a.smithi002.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T04:38:44.830 INFO:journalctl@ceph.mon.a.smithi002.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T04:38:44.830 INFO:journalctl@ceph.mon.a.smithi002.stdout: pin_top_level_index_and_filter: 1 2024-09-19T04:38:44.830 INFO:journalctl@ceph.mon.a.smithi002.stdout: index_type: 0 2024-09-19T04:38:44.830 INFO:journalctl@ceph.mon.a.smithi002.stdout: data_block_index_type: 0 2024-09-19T04:38:44.830 INFO:journalctl@ceph.mon.a.smithi002.stdout: index_shortening: 1 2024-09-19T04:38:44.830 INFO:journalctl@ceph.mon.a.smithi002.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T04:38:44.830 INFO:journalctl@ceph.mon.a.smithi002.stdout: checksum: 4 2024-09-19T04:38:44.830 INFO:journalctl@ceph.mon.a.smithi002.stdout: no_block_cache: 0 2024-09-19T04:38:44.830 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_cache: 0x55d23d2591f0 2024-09-19T04:38:44.830 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_cache_name: BinnedLRUCache 2024-09-19T04:38:44.830 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_cache_options: 2024-09-19T04:38:44.831 INFO:journalctl@ceph.mon.a.smithi002.stdout: capacity : 536870912 2024-09-19T04:38:44.831 INFO:journalctl@ceph.mon.a.smithi002.stdout: num_shard_bits : 4 2024-09-19T04:38:44.831 INFO:journalctl@ceph.mon.a.smithi002.stdout: strict_capacity_limit : 0 2024-09-19T04:38:44.831 INFO:journalctl@ceph.mon.a.smithi002.stdout: high_pri_pool_ratio: 0.000 2024-09-19T04:38:44.831 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_cache_compressed: (nil) 2024-09-19T04:38:44.831 INFO:journalctl@ceph.mon.a.smithi002.stdout: persistent_cache: (nil) 2024-09-19T04:38:44.831 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_size: 4096 2024-09-19T04:38:44.831 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_size_deviation: 10 2024-09-19T04:38:44.831 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_restart_interval: 16 2024-09-19T04:38:44.831 INFO:journalctl@ceph.mon.a.smithi002.stdout: index_block_restart_interval: 1 2024-09-19T04:38:44.831 INFO:journalctl@ceph.mon.a.smithi002.stdout: metadata_block_size: 4096 2024-09-19T04:38:44.831 INFO:journalctl@ceph.mon.a.smithi002.stdout: partition_filters: 0 2024-09-19T04:38:44.831 INFO:journalctl@ceph.mon.a.smithi002.stdout: use_delta_encoding: 1 2024-09-19T04:38:44.832 INFO:journalctl@ceph.mon.a.smithi002.stdout: filter_policy: bloomfilter 2024-09-19T04:38:44.832 INFO:journalctl@ceph.mon.a.smithi002.stdout: whole_key_filtering: 1 2024-09-19T04:38:44.832 INFO:journalctl@ceph.mon.a.smithi002.stdout: verify_compression: 0 2024-09-19T04:38:44.832 INFO:journalctl@ceph.mon.a.smithi002.stdout: read_amp_bytes_per_bit: 0 2024-09-19T04:38:44.832 INFO:journalctl@ceph.mon.a.smithi002.stdout: format_version: 5 2024-09-19T04:38:44.832 INFO:journalctl@ceph.mon.a.smithi002.stdout: enable_index_compression: 1 2024-09-19T04:38:44.832 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_align: 0 2024-09-19T04:38:44.832 INFO:journalctl@ceph.mon.a.smithi002.stdout: max_auto_readahead_size: 262144 2024-09-19T04:38:44.832 INFO:journalctl@ceph.mon.a.smithi002.stdout: prepopulate_block_cache: 0 2024-09-19T04:38:44.832 INFO:journalctl@ceph.mon.a.smithi002.stdout: initial_auto_readahead_size: 8192 2024-09-19T04:38:44.832 INFO:journalctl@ceph.mon.a.smithi002.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T04:38:44.832 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T04:38:44.832 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T04:38:44.833 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.compression: NoCompression 2024-09-19T04:38:44.833 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T04:38:44.833 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T04:38:44.833 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T04:38:44.833 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.num_levels: 7 2024-09-19T04:38:44.833 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T04:38:44.833 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T04:38:44.833 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T04:38:44.833 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T04:38:44.833 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T04:38:44.833 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T04:38:44.833 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T04:38:44.833 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T04:38:44.834 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T04:38:44.834 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T04:38:44.834 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T04:38:44.834 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T04:38:44.834 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T04:38:44.834 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T04:38:44.834 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T04:38:44.834 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T04:38:44.834 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T04:38:44.834 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T04:38:44.834 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T04:38:44.834 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T04:38:44.834 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T04:38:44.834 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T04:38:44.834 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T04:38:44.835 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T04:38:44.835 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T04:38:44.835 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T04:38:44.835 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T04:38:44.835 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T04:38:44.835 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T04:38:44.835 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T04:38:44.835 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T04:38:44.835 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T04:38:44.836 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T04:38:44.836 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T04:38:44.836 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T04:38:44.836 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T04:38:44.836 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T04:38:44.836 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T04:38:44.836 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T04:38:44.836 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T04:38:44.837 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T04:38:44.837 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T04:38:44.837 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T04:38:44.837 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T04:38:44.837 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T04:38:44.837 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T04:38:44.837 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T04:38:44.837 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T04:38:44.837 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T04:38:44.837 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T04:38:44.837 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T04:38:44.837 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T04:38:44.837 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T04:38:44.838 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T04:38:44.838 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.inplace_update_support: 0 2024-09-19T04:38:44.838 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T04:38:44.838 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T04:38:44.838 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T04:38:44.838 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T04:38:44.838 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.bloom_locality: 0 2024-09-19T04:38:44.838 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.max_successive_merges: 0 2024-09-19T04:38:44.838 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T04:38:44.838 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T04:38:44.838 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T04:38:44.838 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T04:38:44.838 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.ttl: 2592000 2024-09-19T04:38:44.838 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T04:38:44.839 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T04:38:44.839 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T04:38:44.839 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.enable_blob_files: false 2024-09-19T04:38:44.839 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.min_blob_size: 0 2024-09-19T04:38:44.839 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T04:38:44.839 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T04:38:44.839 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T04:38:44.839 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T04:38:44.839 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T04:38:44.839 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T04:38:44.839 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T04:38:44.839 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T04:38:44.839 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-19T04:38:44.839 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-19T04:38:44.839 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: c82abe6c-0c3b-4029-8fb7-7c5ac4981f9d 2024-09-19T04:38:44.840 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726720724665805, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-19T04:38:44.840 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-19T04:38:44.840 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726720724666923, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 100472, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 330, "table_properties": {"data_size": 98366, "index_size": 298, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14373, "raw_average_key_size": 49, "raw_value_size": 90630, "raw_average_value_size": 313, "num_data_blocks": 12, "num_entries": 289, "num_filter_entries": 289, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726720724, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "c82abe6c-0c3b-4029-8fb7-7c5ac4981f9d", "db_session_id": "11D11ORB4AA28PTY902T", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-19T04:38:44.840 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726720724667044, "job": 1, "event": "recovery_finished"} 2024-09-19T04:38:44.840 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-19T04:38:44.840 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T04:38:44.840 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55d23d286e00 2024-09-19T04:38:44.840 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: DB pointer 0x55d23d382000 2024-09-19T04:38:44.840 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T04:38:44.840 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T04:38:44.840 INFO:journalctl@ceph.mon.a.smithi002.stdout: ** DB Stats ** 2024-09-19T04:38:44.840 INFO:journalctl@ceph.mon.a.smithi002.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T04:38:44.840 INFO:journalctl@ceph.mon.a.smithi002.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T04:38:44.840 INFO:journalctl@ceph.mon.a.smithi002.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T04:38:44.841 INFO:journalctl@ceph.mon.a.smithi002.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T04:38:44.841 INFO:journalctl@ceph.mon.a.smithi002.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T04:38:44.841 INFO:journalctl@ceph.mon.a.smithi002.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T04:38:44.841 INFO:journalctl@ceph.mon.a.smithi002.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T04:38:44.841 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-09-19T04:38:44.841 INFO:journalctl@ceph.mon.a.smithi002.stdout: ** Compaction Stats [default] ** 2024-09-19T04:38:44.841 INFO:journalctl@ceph.mon.a.smithi002.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T04:38:44.841 INFO:journalctl@ceph.mon.a.smithi002.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T04:38:44.841 INFO:journalctl@ceph.mon.a.smithi002.stdout: L0 2/0 99.98 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 134.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T04:38:44.841 INFO:journalctl@ceph.mon.a.smithi002.stdout: Sum 2/0 99.98 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 134.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T04:38:44.841 INFO:journalctl@ceph.mon.a.smithi002.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 134.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T04:38:44.841 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-09-19T04:38:44.841 INFO:journalctl@ceph.mon.a.smithi002.stdout: ** Compaction Stats [default] ** 2024-09-19T04:38:44.842 INFO:journalctl@ceph.mon.a.smithi002.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T04:38:44.842 INFO:journalctl@ceph.mon.a.smithi002.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T04:38:44.842 INFO:journalctl@ceph.mon.a.smithi002.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 134.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T04:38:44.842 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-09-19T04:38:44.842 INFO:journalctl@ceph.mon.a.smithi002.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T04:38:44.842 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-09-19T04:38:44.842 INFO:journalctl@ceph.mon.a.smithi002.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T04:38:44.842 INFO:journalctl@ceph.mon.a.smithi002.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T04:38:44.842 INFO:journalctl@ceph.mon.a.smithi002.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T04:38:44.842 INFO:journalctl@ceph.mon.a.smithi002.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T04:38:44.842 INFO:journalctl@ceph.mon.a.smithi002.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T04:38:44.842 INFO:journalctl@ceph.mon.a.smithi002.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T04:38:44.842 INFO:journalctl@ceph.mon.a.smithi002.stdout: Cumulative compaction: 0.00 GB write, 28.21 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T04:38:44.842 INFO:journalctl@ceph.mon.a.smithi002.stdout: Interval compaction: 0.00 GB write, 28.21 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T04:38:44.843 INFO:journalctl@ceph.mon.a.smithi002.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T04:38:44.843 INFO:journalctl@ceph.mon.a.smithi002.stdout: Block cache BinnedLRUCache@0x55d23d2591f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-19T04:38:44.843 INFO:journalctl@ceph.mon.a.smithi002.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-19T04:38:44.843 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-09-19T04:38:44.843 INFO:journalctl@ceph.mon.a.smithi002.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T04:38:44.843 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: starting mon.a rank 0 at public addrs [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] at bind addrs [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid d46630c4-7640-11ef-bceb-c7b262605968 2024-09-19T04:38:44.843 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: mon.a@-1(???) e1 preinit fsid d46630c4-7640-11ef-bceb-c7b262605968 2024-09-19T04:38:44.843 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: mon.a@-1(???).mds e1 new map 2024-09-19T04:38:44.843 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: mon.a@-1(???).mds e1 print_map 2024-09-19T04:38:44.843 INFO:journalctl@ceph.mon.a.smithi002.stdout: e1 2024-09-19T04:38:44.843 INFO:journalctl@ceph.mon.a.smithi002.stdout: btime 2024-09-19T04:38:39:698336+0000 2024-09-19T04:38:44.843 INFO:journalctl@ceph.mon.a.smithi002.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T04:38:44.843 INFO:journalctl@ceph.mon.a.smithi002.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T04:38:44.843 INFO:journalctl@ceph.mon.a.smithi002.stdout: legacy client fscid: -1 2024-09-19T04:38:44.844 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-09-19T04:38:44.844 INFO:journalctl@ceph.mon.a.smithi002.stdout: No filesystems configured 2024-09-19T04:38:44.844 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T04:38:44.844 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T04:38:44.844 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T04:38:44.844 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T04:38:44.844 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-19T04:38:44.844 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 bash[30956]: 7720d0275239e8c2d1aa5e29f5ed99628f65acf75f8726a29944539afd7dc971 2024-09-19T04:38:44.844 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 systemd[1]: Started Ceph mon.a for d46630c4-7640-11ef-bceb-c7b262605968. 2024-09-19T04:38:44.844 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T04:38:44.844 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: monmap epoch 1 2024-09-19T04:38:44.844 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: fsid d46630c4-7640-11ef-bceb-c7b262605968 2024-09-19T04:38:44.844 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: last_changed 2024-09-19T04:38:36.676338+0000 2024-09-19T04:38:44.844 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: created 2024-09-19T04:38:36.676338+0000 2024-09-19T04:38:44.844 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: min_mon_release 19 (squid) 2024-09-19T04:38:44.845 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: election_strategy: 1 2024-09-19T04:38:44.845 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-19T04:38:44.845 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: fsmap 2024-09-19T04:38:44.845 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T04:38:44.845 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:44 smithi002 ceph-mon[30975]: mgrmap e1: no daemons active 2024-09-19T04:38:45.733 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:45.155+0000 7f700029c640 1 Processor -- start 2024-09-19T04:38:45.733 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:45.155+0000 7f700029c640 1 -- start start 2024-09-19T04:38:45.733 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:45.155+0000 7f700029c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ff8108060 0x7f6ff810a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:45.733 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:45.155+0000 7f700029c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff8063490 con 0x7f6ff8108060 2024-09-19T04:38:45.733 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:45.156+0000 7f6ffe038640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ff8108060 0x7f6ff810a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:45.733 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:45.156+0000 7f6ffe038640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ff8108060 0x7f6ff810a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56802/0 (socket says 172.21.15.2:56802) 2024-09-19T04:38:45.733 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:45.156+0000 7f6ffe038640 1 -- 172.21.15.2:0/3215126367 learned_addr learned my addr 172.21.15.2:0/3215126367 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:38:45.734 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:45.156+0000 7f6ffe038640 1 -- 172.21.15.2:0/3215126367 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ff810a990 con 0x7f6ff8108060 2024-09-19T04:38:45.734 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:45.158+0000 7f6ffe038640 1 --2- 172.21.15.2:0/3215126367 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ff8108060 0x7f6ff810a450 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0009820 tx=0x7f6ff002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45f17716c7bdfcc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:45.734 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:45.158+0000 7f6ffd036640 1 -- 172.21.15.2:0/3215126367 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ff0037070 con 0x7f6ff8108060 2024-09-19T04:38:45.734 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:45.158+0000 7f6ffd036640 1 -- 172.21.15.2:0/3215126367 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f6ff00328d0 con 0x7f6ff8108060 2024-09-19T04:38:45.734 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:45.158+0000 7f6ffd036640 1 -- 172.21.15.2:0/3215126367 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ff00307d0 con 0x7f6ff8108060 2024-09-19T04:38:45.734 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:45.159+0000 7f700029c640 1 -- 172.21.15.2:0/3215126367 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ff8108060 msgr2=0x7f6ff810a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:45.734 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:45.159+0000 7f700029c640 1 --2- 172.21.15.2:0/3215126367 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ff8108060 0x7f6ff810a450 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0009820 tx=0x7f6ff002a270 comp rx=0 tx=0).stop 2024-09-19T04:38:45.734 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:45.159+0000 7f700029c640 1 -- 172.21.15.2:0/3215126367 shutdown_connections 2024-09-19T04:38:45.734 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:45.159+0000 7f700029c640 1 --2- 172.21.15.2:0/3215126367 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ff8108060 0x7f6ff810a450 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:45.734 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:45.159+0000 7f700029c640 1 -- 172.21.15.2:0/3215126367 >> 172.21.15.2:0/3215126367 conn(0x7f6ff8101c00 msgr2=0x7f6ff8104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:45.734 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:45.159+0000 7f700029c640 1 -- 172.21.15.2:0/3215126367 shutdown_connections 2024-09-19T04:38:45.734 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:45.159+0000 7f700029c640 1 -- 172.21.15.2:0/3215126367 wait complete. 2024-09-19T04:38:45.734 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:45.160+0000 7f700029c640 1 Processor -- start 2024-09-19T04:38:45.735 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:45.160+0000 7f700029c640 1 -- start start 2024-09-19T04:38:45.735 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:45.160+0000 7f700029c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ff8108060 0x7f6ff819b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:45.735 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:45.160+0000 7f700029c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff810b910 con 0x7f6ff8108060 2024-09-19T04:38:45.735 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:45.160+0000 7f6ffe038640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ff8108060 0x7f6ff819b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:45.735 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:45.160+0000 7f6ffe038640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ff8108060 0x7f6ff819b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56810/0 (socket says 172.21.15.2:56810) 2024-09-19T04:38:45.735 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:45.160+0000 7f6ffe038640 1 -- 172.21.15.2:0/1935204277 learned_addr learned my addr 172.21.15.2:0/1935204277 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:38:45.735 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:45.160+0000 7f6ffe038640 1 -- 172.21.15.2:0/1935204277 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ff819ba60 con 0x7f6ff8108060 2024-09-19T04:38:45.735 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:45.160+0000 7f6ffe038640 1 --2- 172.21.15.2:0/1935204277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ff8108060 0x7f6ff819b520 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0032e10 tx=0x7f6ff0032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:45.735 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:45.161+0000 7f6ff77fe640 1 -- 172.21.15.2:0/1935204277 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ff0042070 con 0x7f6ff8108060 2024-09-19T04:38:45.735 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:45.161+0000 7f6ff77fe640 1 -- 172.21.15.2:0/1935204277 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f6ff0030c80 con 0x7f6ff8108060 2024-09-19T04:38:45.735 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:45.161+0000 7f700029c640 1 -- 172.21.15.2:0/1935204277 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ff819bcf0 con 0x7f6ff8108060 2024-09-19T04:38:45.735 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:45.161+0000 7f6ff77fe640 1 -- 172.21.15.2:0/1935204277 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ff0037040 con 0x7f6ff8108060 2024-09-19T04:38:45.735 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:45.161+0000 7f700029c640 1 -- 172.21.15.2:0/1935204277 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ff819e9e0 con 0x7f6ff8108060 2024-09-19T04:38:45.735 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:45.161+0000 7f6ff77fe640 1 -- 172.21.15.2:0/1935204277 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6ff0045070 con 0x7f6ff8108060 2024-09-19T04:38:45.736 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:45.161+0000 7f6ff77fe640 1 -- 172.21.15.2:0/1935204277 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6ff0047a20 con 0x7f6ff8108060 2024-09-19T04:38:45.736 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:45.162+0000 7f700029c640 1 -- 172.21.15.2:0/1935204277 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ff81084c0 con 0x7f6ff8108060 2024-09-19T04:38:45.736 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:45.164+0000 7f6ff77fe640 1 -- 172.21.15.2:0/1935204277 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f6ff003c5f0 con 0x7f6ff8108060 2024-09-19T04:38:45.736 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:45.223+0000 7f700029c640 1 -- 172.21.15.2:0/1935204277 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f6ff819efc0 con 0x7f6ff8108060 2024-09-19T04:38:45.736 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:45.225+0000 7f6ff77fe640 1 -- 172.21.15.2:0/1935204277 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f6ff003c7d0 con 0x7f6ff8108060 2024-09-19T04:38:45.736 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:45.226+0000 7f700029c640 1 -- 172.21.15.2:0/1935204277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ff8108060 msgr2=0x7f6ff819b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:45.736 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:45.226+0000 7f700029c640 1 --2- 172.21.15.2:0/1935204277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ff8108060 0x7f6ff819b520 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0032e10 tx=0x7f6ff0032e40 comp rx=0 tx=0).stop 2024-09-19T04:38:45.736 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:45.226+0000 7f700029c640 1 -- 172.21.15.2:0/1935204277 shutdown_connections 2024-09-19T04:38:45.736 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:45.226+0000 7f700029c640 1 --2- 172.21.15.2:0/1935204277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ff8108060 0x7f6ff819b520 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:45.736 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:45.226+0000 7f700029c640 1 -- 172.21.15.2:0/1935204277 >> 172.21.15.2:0/1935204277 conn(0x7f6ff8101c00 msgr2=0x7f6ff81027b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:45.736 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:45.226+0000 7f700029c640 1 -- 172.21.15.2:0/1935204277 shutdown_connections 2024-09-19T04:38:45.736 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:45.226+0000 7f700029c640 1 -- 172.21.15.2:0/1935204277 wait complete. 2024-09-19T04:38:45.736 INFO:teuthology.orchestra.run.smithi002.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-19T04:38:45.759 INFO:teuthology.orchestra.run.smithi002.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-19T04:38:45.759 INFO:teuthology.orchestra.run.smithi002.stdout:Creating mgr... 2024-09-19T04:38:45.760 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-19T04:38:45.760 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-19T04:38:46.024 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-d46630c4-7640-11ef-bceb-c7b262605968@mgr.x 2024-09-19T04:38:46.025 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Failed to reset failed state of unit ceph-d46630c4-7640-11ef-bceb-c7b262605968@mgr.x.service: Unit ceph-d46630c4-7640-11ef-bceb-c7b262605968@mgr.x.service not loaded. 2024-09-19T04:38:46.181 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-d46630c4-7640-11ef-bceb-c7b262605968.target.wants/ceph-d46630c4-7640-11ef-bceb-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-d46630c4-7640-11ef-bceb-c7b262605968@.service. 2024-09-19T04:38:46.513 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:46 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/1935204277' entity='client.admin' 2024-09-19T04:38:46.704 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T04:38:46.704 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout disabled 2024-09-19T04:38:46.711 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T04:38:46.711 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-09-19T04:38:46.711 INFO:teuthology.orchestra.run.smithi002.stdout:firewalld.service is not enabled 2024-09-19T04:38:46.711 INFO:teuthology.orchestra.run.smithi002.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T04:38:46.720 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T04:38:46.720 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout disabled 2024-09-19T04:38:46.728 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T04:38:46.728 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-09-19T04:38:46.728 INFO:teuthology.orchestra.run.smithi002.stdout:firewalld.service is not enabled 2024-09-19T04:38:46.729 INFO:teuthology.orchestra.run.smithi002.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-19T04:38:46.729 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mgr to start... 2024-09-19T04:38:46.729 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mgr... 2024-09-19T04:38:47.595 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:47 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/3271756935' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T04:38:47.596 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:38:47 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:38:47.372+0000 7f088f537040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T04:38:47.860 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:38:47 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:38:47.707+0000 7f088f537040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T04:38:47.860 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:38:47 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:38:47.771+0000 7f088f537040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T04:38:47.927 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-19T04:38:47.927 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-19T04:38:47.928 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsid": "d46630c4-7640-11ef-bceb-c7b262605968", 2024-09-19T04:38:47.928 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T04:38:47.928 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T04:38:47.928 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T04:38:47.928 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T04:38:47.928 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:38:47.928 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T04:38:47.928 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T04:38:47.928 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 0 2024-09-19T04:38:47.928 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-19T04:38:47.929 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T04:38:47.929 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T04:38:47.929 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-19T04:38:47.929 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-19T04:38:47.929 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T04:38:47.929 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T04:38:47.929 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T04:38:47.929 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T04:38:47.929 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:38:47.929 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T04:38:47.930 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T04:38:47.930 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T04:38:47.930 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T04:38:47.930 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T04:38:47.930 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T04:38:47.930 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T04:38:47.930 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T04:38:47.930 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:38:47.931 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T04:38:47.931 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T04:38:47.931 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T04:38:47.931 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T04:38:47.931 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T04:38:47.931 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T04:38:47.931 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T04:38:47.931 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T04:38:47.932 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T04:38:47.932 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:38:47.932 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T04:38:47.932 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T04:38:47.932 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T04:38:39:698336+0000", 2024-09-19T04:38:47.932 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T04:38:47.932 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T04:38:47.933 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:38:47.933 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T04:38:47.933 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T04:38:47.933 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T04:38:47.933 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T04:38:47.933 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T04:38:47.933 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T04:38:47.933 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T04:38:47.933 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-19T04:38:47.933 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T04:38:47.933 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:38:47.933 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T04:38:47.934 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T04:38:47.934 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T04:38:39.698968+0000", 2024-09-19T04:38:47.934 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T04:38:47.934 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:38:47.934 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T04:38:47.934 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-19T04:38:47.934 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:47.164+0000 7f0999a7f640 1 Processor -- start 2024-09-19T04:38:47.934 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:47.164+0000 7f0999a7f640 1 -- start start 2024-09-19T04:38:47.934 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:47.164+0000 7f0999a7f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0994108020 0x7f099410a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:47.934 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:47.164+0000 7f0999a7f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f09940634d0 con 0x7f0994108020 2024-09-19T04:38:47.934 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:47.164+0000 7f09937fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0994108020 0x7f099410a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:47.934 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:47.164+0000 7f09937fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0994108020 0x7f099410a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56830/0 (socket says 172.21.15.2:56830) 2024-09-19T04:38:47.934 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:47.164+0000 7f09937fe640 1 -- 172.21.15.2:0/1513002653 learned_addr learned my addr 172.21.15.2:0/1513002653 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:38:47.935 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:47.165+0000 7f09937fe640 1 -- 172.21.15.2:0/1513002653 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f099410a950 con 0x7f0994108020 2024-09-19T04:38:47.935 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:47.165+0000 7f09937fe640 1 --2- 172.21.15.2:0/1513002653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0994108020 0x7f099410a410 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f0984009820 tx=0x7f098402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36094e94e1e7b0cc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:47.935 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:47.166+0000 7f0992ffd640 1 -- 172.21.15.2:0/1513002653 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0984037070 con 0x7f0994108020 2024-09-19T04:38:47.935 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:47.166+0000 7f0992ffd640 1 -- 172.21.15.2:0/1513002653 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f09840328d0 con 0x7f0994108020 2024-09-19T04:38:47.935 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:47.166+0000 7f0992ffd640 1 -- 172.21.15.2:0/1513002653 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09840307d0 con 0x7f0994108020 2024-09-19T04:38:47.935 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:47.166+0000 7f0999a7f640 1 -- 172.21.15.2:0/1513002653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0994108020 msgr2=0x7f099410a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:47.935 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:47.166+0000 7f0999a7f640 1 --2- 172.21.15.2:0/1513002653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0994108020 0x7f099410a410 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f0984009820 tx=0x7f098402a270 comp rx=0 tx=0).stop 2024-09-19T04:38:47.935 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:47.167+0000 7f0999a7f640 1 -- 172.21.15.2:0/1513002653 shutdown_connections 2024-09-19T04:38:47.935 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:47.167+0000 7f0999a7f640 1 --2- 172.21.15.2:0/1513002653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0994108020 0x7f099410a410 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:47.935 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:47.167+0000 7f0999a7f640 1 -- 172.21.15.2:0/1513002653 >> 172.21.15.2:0/1513002653 conn(0x7f0994101c00 msgr2=0x7f0994104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:47.935 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:47.167+0000 7f0999a7f640 1 -- 172.21.15.2:0/1513002653 shutdown_connections 2024-09-19T04:38:47.935 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:47.167+0000 7f0999a7f640 1 -- 172.21.15.2:0/1513002653 wait complete. 2024-09-19T04:38:47.935 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:47.167+0000 7f0999a7f640 1 Processor -- start 2024-09-19T04:38:47.936 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:47.167+0000 7f0999a7f640 1 -- start start 2024-09-19T04:38:47.936 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:47.168+0000 7f0999a7f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0994108020 0x7f099419d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:47.936 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:47.168+0000 7f0999a7f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f099410b930 con 0x7f0994108020 2024-09-19T04:38:47.936 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:47.168+0000 7f09937fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0994108020 0x7f099419d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:47.936 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:47.168+0000 7f09937fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0994108020 0x7f099419d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56834/0 (socket says 172.21.15.2:56834) 2024-09-19T04:38:47.936 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:47.168+0000 7f09937fe640 1 -- 172.21.15.2:0/3271756935 learned_addr learned my addr 172.21.15.2:0/3271756935 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:38:47.936 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:47.168+0000 7f09937fe640 1 -- 172.21.15.2:0/3271756935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f099419dcf0 con 0x7f0994108020 2024-09-19T04:38:47.936 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:47.168+0000 7f09937fe640 1 --2- 172.21.15.2:0/3271756935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0994108020 0x7f099419d7b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0984032e10 tx=0x7f0984032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:47.936 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:47.169+0000 7f09917fa640 1 -- 172.21.15.2:0/3271756935 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0984042070 con 0x7f0994108020 2024-09-19T04:38:47.936 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:47.169+0000 7f09917fa640 1 -- 172.21.15.2:0/3271756935 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f0984030c80 con 0x7f0994108020 2024-09-19T04:38:47.936 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:47.169+0000 7f0999a7f640 1 -- 172.21.15.2:0/3271756935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f099419df80 con 0x7f0994108020 2024-09-19T04:38:47.936 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:47.169+0000 7f09917fa640 1 -- 172.21.15.2:0/3271756935 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0984037040 con 0x7f0994108020 2024-09-19T04:38:47.937 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:47.169+0000 7f0999a7f640 1 -- 172.21.15.2:0/3271756935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09941a0c70 con 0x7f0994108020 2024-09-19T04:38:47.937 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:47.169+0000 7f09917fa640 1 -- 172.21.15.2:0/3271756935 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0984045070 con 0x7f0994108020 2024-09-19T04:38:47.937 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:47.169+0000 7f09917fa640 1 -- 172.21.15.2:0/3271756935 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f09840463b0 con 0x7f0994108020 2024-09-19T04:38:47.937 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:47.170+0000 7f0999a7f640 1 -- 172.21.15.2:0/3271756935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0994108480 con 0x7f0994108020 2024-09-19T04:38:47.937 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:47.172+0000 7f09917fa640 1 -- 172.21.15.2:0/3271756935 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f0984047440 con 0x7f0994108020 2024-09-19T04:38:47.937 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:47.234+0000 7f0999a7f640 1 -- 172.21.15.2:0/3271756935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f09941a0e40 con 0x7f0994108020 2024-09-19T04:38:47.937 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:47.235+0000 7f09917fa640 1 -- 172.21.15.2:0/3271756935 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f098403c7c0 con 0x7f0994108020 2024-09-19T04:38:47.937 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:47.236+0000 7f0999a7f640 1 -- 172.21.15.2:0/3271756935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0994108020 msgr2=0x7f099419d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:47.937 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:47.236+0000 7f0999a7f640 1 --2- 172.21.15.2:0/3271756935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0994108020 0x7f099419d7b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0984032e10 tx=0x7f0984032e40 comp rx=0 tx=0).stop 2024-09-19T04:38:47.937 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:47.236+0000 7f0999a7f640 1 -- 172.21.15.2:0/3271756935 shutdown_connections 2024-09-19T04:38:47.937 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:47.236+0000 7f0999a7f640 1 --2- 172.21.15.2:0/3271756935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0994108020 0x7f099419d7b0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:47.937 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:47.236+0000 7f0999a7f640 1 -- 172.21.15.2:0/3271756935 >> 172.21.15.2:0/3271756935 conn(0x7f0994101c00 msgr2=0x7f0994102760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:47.938 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:47.236+0000 7f0999a7f640 1 -- 172.21.15.2:0/3271756935 shutdown_connections 2024-09-19T04:38:47.938 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:47.236+0000 7f0999a7f640 1 -- 172.21.15.2:0/3271756935 wait complete. 2024-09-19T04:38:47.938 INFO:teuthology.orchestra.run.smithi002.stdout:mgr not available, waiting (1/15)... 2024-09-19T04:38:48.360 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:38:47 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:38:47.964+0000 7f088f537040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T04:38:49.360 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:38:48 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:38:48.885+0000 7f088f537040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T04:38:49.360 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:38:48 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:38:48.954+0000 7f088f537040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T04:38:49.985 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:38:49 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:38:49.707+0000 7f088f537040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T04:38:49.985 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:38:49 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:38:49.827+0000 7f088f537040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T04:38:50.284 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:38:49 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:38:49.982+0000 7f088f537040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T04:38:50.284 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:38:50 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:38:50.048+0000 7f088f537040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T04:38:50.284 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:38:50 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:38:50.208+0000 7f088f537040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T04:38:50.284 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:38:50 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:38:50.281+0000 7f088f537040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T04:38:50.598 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:50 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/2659746877' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T04:38:50.599 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:38:50 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:38:50.346+0000 7f088f537040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T04:38:50.599 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:38:50 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:38:50.526+0000 7f088f537040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T04:38:50.599 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:38:50 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:38:50.596+0000 7f088f537040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T04:38:50.860 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:38:50 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:38:50.665+0000 7f088f537040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T04:38:50.860 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:38:50 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:38:50.752+0000 7f088f537040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T04:38:50.860 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:38:50 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:38:50.814+0000 7f088f537040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T04:38:50.999 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-19T04:38:51.000 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-19T04:38:51.000 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsid": "d46630c4-7640-11ef-bceb-c7b262605968", 2024-09-19T04:38:51.000 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T04:38:51.000 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T04:38:51.000 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T04:38:51.000 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T04:38:51.000 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:38:51.000 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T04:38:51.000 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T04:38:51.000 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 0 2024-09-19T04:38:51.000 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-19T04:38:51.000 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T04:38:51.000 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T04:38:51.001 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-19T04:38:51.001 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-19T04:38:51.001 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T04:38:51.001 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T04:38:51.001 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T04:38:51.001 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T04:38:51.001 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:38:51.001 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T04:38:51.001 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T04:38:51.001 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T04:38:51.001 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T04:38:51.002 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T04:38:51.010 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T04:38:51.010 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T04:38:51.010 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T04:38:51.010 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:38:51.010 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T04:38:51.010 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T04:38:51.011 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T04:38:51.011 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T04:38:51.011 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T04:38:51.011 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T04:38:51.011 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T04:38:51.011 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T04:38:51.011 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T04:38:51.011 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:38:51.011 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T04:38:51.011 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T04:38:51.011 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T04:38:39:698336+0000", 2024-09-19T04:38:51.011 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T04:38:51.011 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T04:38:51.012 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:38:51.012 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T04:38:51.012 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T04:38:51.012 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T04:38:51.012 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T04:38:51.012 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T04:38:51.012 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T04:38:51.012 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T04:38:51.012 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-19T04:38:51.012 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T04:38:51.012 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:38:51.012 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T04:38:51.012 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T04:38:51.013 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T04:38:39.698968+0000", 2024-09-19T04:38:51.013 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T04:38:51.013 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:38:51.013 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T04:38:51.013 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-19T04:38:51.013 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:50.292+0000 7f77af3bd640 1 Processor -- start 2024-09-19T04:38:51.013 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:50.292+0000 7f77af3bd640 1 -- start start 2024-09-19T04:38:51.013 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:50.292+0000 7f77af3bd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77a8105e70 0x7f77a8106270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:51.013 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:50.292+0000 7f77af3bd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f77a8063470 con 0x7f77a8105e70 2024-09-19T04:38:51.013 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:50.293+0000 7f77ad159640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77a8105e70 0x7f77a8106270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:51.013 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:50.293+0000 7f77ad159640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77a8105e70 0x7f77a8106270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56842/0 (socket says 172.21.15.2:56842) 2024-09-19T04:38:51.014 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:50.293+0000 7f77ad159640 1 -- 172.21.15.2:0/355484792 learned_addr learned my addr 172.21.15.2:0/355484792 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:38:51.014 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:50.293+0000 7f77ad159640 1 -- 172.21.15.2:0/355484792 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77a81067b0 con 0x7f77a8105e70 2024-09-19T04:38:51.014 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:50.294+0000 7f77ad159640 1 --2- 172.21.15.2:0/355484792 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77a8105e70 0x7f77a8106270 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f779c009820 tx=0x7f779c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da828fbd794ef5e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:51.014 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:50.294+0000 7f779bfff640 1 -- 172.21.15.2:0/355484792 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f779c037070 con 0x7f77a8105e70 2024-09-19T04:38:51.014 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:50.294+0000 7f779bfff640 1 -- 172.21.15.2:0/355484792 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f779c0328d0 con 0x7f77a8105e70 2024-09-19T04:38:51.014 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:50.294+0000 7f779bfff640 1 -- 172.21.15.2:0/355484792 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f779c0307d0 con 0x7f77a8105e70 2024-09-19T04:38:51.014 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:50.294+0000 7f77af3bd640 1 -- 172.21.15.2:0/355484792 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77a8105e70 msgr2=0x7f77a8106270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:51.014 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:50.294+0000 7f77af3bd640 1 --2- 172.21.15.2:0/355484792 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77a8105e70 0x7f77a8106270 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f779c009820 tx=0x7f779c02a270 comp rx=0 tx=0).stop 2024-09-19T04:38:51.015 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:50.294+0000 7f77af3bd640 1 -- 172.21.15.2:0/355484792 shutdown_connections 2024-09-19T04:38:51.015 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:50.294+0000 7f77af3bd640 1 --2- 172.21.15.2:0/355484792 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77a8105e70 0x7f77a8106270 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:51.015 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:50.294+0000 7f77af3bd640 1 -- 172.21.15.2:0/355484792 >> 172.21.15.2:0/355484792 conn(0x7f77a8101c00 msgr2=0x7f77a8104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:51.015 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:50.295+0000 7f77af3bd640 1 -- 172.21.15.2:0/355484792 shutdown_connections 2024-09-19T04:38:51.015 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:50.295+0000 7f77af3bd640 1 -- 172.21.15.2:0/355484792 wait complete. 2024-09-19T04:38:51.015 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:50.295+0000 7f77af3bd640 1 Processor -- start 2024-09-19T04:38:51.015 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:50.295+0000 7f77af3bd640 1 -- start start 2024-09-19T04:38:51.015 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:50.295+0000 7f77af3bd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77a8105e70 0x7f77a810b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:51.015 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:50.295+0000 7f77af3bd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f77a8107850 con 0x7f77a8105e70 2024-09-19T04:38:51.015 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:50.295+0000 7f77ad159640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77a8105e70 0x7f77a810b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:51.015 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:50.296+0000 7f77ad159640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77a8105e70 0x7f77a810b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56848/0 (socket says 172.21.15.2:56848) 2024-09-19T04:38:51.015 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:50.296+0000 7f77ad159640 1 -- 172.21.15.2:0/2659746877 learned_addr learned my addr 172.21.15.2:0/2659746877 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:38:51.016 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:50.296+0000 7f77ad159640 1 -- 172.21.15.2:0/2659746877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77a810be50 con 0x7f77a8105e70 2024-09-19T04:38:51.016 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:50.296+0000 7f77ad159640 1 --2- 172.21.15.2:0/2659746877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77a8105e70 0x7f77a810b910 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f779c0097f0 tx=0x7f779c030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:51.016 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:50.296+0000 7f779a7fc640 1 -- 172.21.15.2:0/2659746877 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f779c037040 con 0x7f77a8105e70 2024-09-19T04:38:51.016 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:50.296+0000 7f779a7fc640 1 -- 172.21.15.2:0/2659746877 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f779c032bb0 con 0x7f77a8105e70 2024-09-19T04:38:51.016 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:50.296+0000 7f77af3bd640 1 -- 172.21.15.2:0/2659746877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77a810c0e0 con 0x7f77a8105e70 2024-09-19T04:38:51.016 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:50.296+0000 7f779a7fc640 1 -- 172.21.15.2:0/2659746877 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f779c03a390 con 0x7f77a8105e70 2024-09-19T04:38:51.016 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:50.296+0000 7f77af3bd640 1 -- 172.21.15.2:0/2659746877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77a81086a0 con 0x7f77a8105e70 2024-09-19T04:38:51.016 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:50.296+0000 7f779a7fc640 1 -- 172.21.15.2:0/2659746877 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f779c03a5d0 con 0x7f77a8105e70 2024-09-19T04:38:51.016 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:50.296+0000 7f779a7fc640 1 -- 172.21.15.2:0/2659746877 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f779c043360 con 0x7f77a8105e70 2024-09-19T04:38:51.016 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:50.298+0000 7f7793fff640 1 -- 172.21.15.2:0/2659746877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7788005290 con 0x7f77a8105e70 2024-09-19T04:38:51.016 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:50.300+0000 7f779a7fc640 1 -- 172.21.15.2:0/2659746877 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f779c032d60 con 0x7f77a8105e70 2024-09-19T04:38:51.017 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:50.363+0000 7f7793fff640 1 -- 172.21.15.2:0/2659746877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f7788005850 con 0x7f77a8105e70 2024-09-19T04:38:51.017 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:50.363+0000 7f779a7fc640 1 -- 172.21.15.2:0/2659746877 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f779c03aa50 con 0x7f77a8105e70 2024-09-19T04:38:51.017 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:50.364+0000 7f7793fff640 1 -- 172.21.15.2:0/2659746877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77a8105e70 msgr2=0x7f77a810b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:51.017 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:50.364+0000 7f7793fff640 1 --2- 172.21.15.2:0/2659746877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77a8105e70 0x7f77a810b910 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f779c0097f0 tx=0x7f779c030d00 comp rx=0 tx=0).stop 2024-09-19T04:38:51.017 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:50.364+0000 7f7793fff640 1 -- 172.21.15.2:0/2659746877 shutdown_connections 2024-09-19T04:38:51.017 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:50.364+0000 7f7793fff640 1 --2- 172.21.15.2:0/2659746877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77a8105e70 0x7f77a810b910 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:51.017 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:50.364+0000 7f7793fff640 1 -- 172.21.15.2:0/2659746877 >> 172.21.15.2:0/2659746877 conn(0x7f77a8101c00 msgr2=0x7f77a81943d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:51.017 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:50.365+0000 7f7793fff640 1 -- 172.21.15.2:0/2659746877 shutdown_connections 2024-09-19T04:38:51.018 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:50.365+0000 7f7793fff640 1 -- 172.21.15.2:0/2659746877 wait complete. 2024-09-19T04:38:51.018 INFO:teuthology.orchestra.run.smithi002.stdout:mgr not available, waiting (2/15)... 2024-09-19T04:38:51.360 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:38:50 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:38:50.876+0000 7f088f537040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T04:38:52.110 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:38:51 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:38:51.706+0000 7f088f537040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T04:38:52.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:51 smithi002 ceph-mon[30975]: Activating manager daemon x 2024-09-19T04:38:52.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:51 smithi002 ceph-mon[30975]: mgrmap e2: x(active, starting, since 0.00317243s) 2024-09-19T04:38:52.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:51 smithi002 ceph-mon[30975]: from='mgr.14100 172.21.15.2:0/2529027105' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T04:38:52.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:51 smithi002 ceph-mon[30975]: from='mgr.14100 172.21.15.2:0/2529027105' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T04:38:52.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:51 smithi002 ceph-mon[30975]: from='mgr.14100 172.21.15.2:0/2529027105' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T04:38:52.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:51 smithi002 ceph-mon[30975]: from='mgr.14100 172.21.15.2:0/2529027105' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:38:52.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:51 smithi002 ceph-mon[30975]: from='mgr.14100 172.21.15.2:0/2529027105' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T04:38:52.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:51 smithi002 ceph-mon[30975]: Manager daemon x is now available 2024-09-19T04:38:52.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:51 smithi002 ceph-mon[30975]: from='mgr.14100 172.21.15.2:0/2529027105' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T04:38:52.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:51 smithi002 ceph-mon[30975]: from='mgr.14100 172.21.15.2:0/2529027105' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T04:38:52.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:51 smithi002 ceph-mon[30975]: from='mgr.14100 172.21.15.2:0/2529027105' entity='mgr.x' 2024-09-19T04:38:52.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:51 smithi002 ceph-mon[30975]: from='mgr.14100 172.21.15.2:0/2529027105' entity='mgr.x' 2024-09-19T04:38:52.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:51 smithi002 ceph-mon[30975]: from='mgr.14100 172.21.15.2:0/2529027105' entity='mgr.x' 2024-09-19T04:38:54.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:53 smithi002 ceph-mon[30975]: mgrmap e3: x(active, since 1.00682s) 2024-09-19T04:38:54.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:53 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/1239336110' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T04:38:54.197 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-19T04:38:54.197 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-19T04:38:54.197 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsid": "d46630c4-7640-11ef-bceb-c7b262605968", 2024-09-19T04:38:54.197 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T04:38:54.197 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T04:38:54.197 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T04:38:54.197 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T04:38:54.197 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:38:54.197 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T04:38:54.197 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T04:38:54.197 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 0 2024-09-19T04:38:54.198 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-19T04:38:54.198 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T04:38:54.198 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T04:38:54.198 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-19T04:38:54.198 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-09-19T04:38:54.198 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T04:38:54.198 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T04:38:54.198 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T04:38:54.198 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T04:38:54.198 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:38:54.198 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T04:38:54.198 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T04:38:54.198 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T04:38:54.198 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T04:38:54.199 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T04:38:54.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T04:38:54.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T04:38:54.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T04:38:54.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:38:54.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T04:38:54.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T04:38:54.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T04:38:54.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T04:38:54.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T04:38:54.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T04:38:54.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T04:38:54.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T04:38:54.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T04:38:54.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:38:54.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T04:38:54.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T04:38:54.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T04:38:39:698336+0000", 2024-09-19T04:38:54.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T04:38:54.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T04:38:54.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:38:54.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T04:38:54.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T04:38:54.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T04:38:54.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T04:38:54.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T04:38:54.209 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T04:38:54.209 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T04:38:54.209 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-19T04:38:54.209 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T04:38:54.209 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:38:54.209 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T04:38:54.209 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T04:38:54.209 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T04:38:39.698968+0000", 2024-09-19T04:38:54.209 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T04:38:54.209 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:38:54.209 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T04:38:54.209 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-19T04:38:54.209 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.375+0000 7f452f912640 1 Processor -- start 2024-09-19T04:38:54.209 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.375+0000 7f452f912640 1 -- start start 2024-09-19T04:38:54.210 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.375+0000 7f452f912640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f452807de50 0x7f452807c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:54.210 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.375+0000 7f452f912640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f452807c7f0 con 0x7f452807de50 2024-09-19T04:38:54.210 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.376+0000 7f452d6ae640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f452807de50 0x7f452807c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:54.210 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.376+0000 7f452d6ae640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f452807de50 0x7f452807c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40442/0 (socket says 172.21.15.2:40442) 2024-09-19T04:38:54.210 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.376+0000 7f452d6ae640 1 -- 172.21.15.2:0/893866966 learned_addr learned my addr 172.21.15.2:0/893866966 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:38:54.210 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.376+0000 7f452d6ae640 1 -- 172.21.15.2:0/893866966 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f452807c970 con 0x7f452807de50 2024-09-19T04:38:54.210 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.377+0000 7f452d6ae640 1 --2- 172.21.15.2:0/893866966 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f452807de50 0x7f452807c2b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4524009820 tx=0x7f452402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e166bfd4bbfa90 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:54.210 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.377+0000 7f451ffff640 1 -- 172.21.15.2:0/893866966 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4524037070 con 0x7f452807de50 2024-09-19T04:38:54.210 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.377+0000 7f451ffff640 1 -- 172.21.15.2:0/893866966 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f45240328d0 con 0x7f452807de50 2024-09-19T04:38:54.210 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.377+0000 7f451ffff640 1 -- 172.21.15.2:0/893866966 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45240307d0 con 0x7f452807de50 2024-09-19T04:38:54.210 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.378+0000 7f452f912640 1 -- 172.21.15.2:0/893866966 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f452807de50 msgr2=0x7f452807c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:54.210 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.378+0000 7f452f912640 1 --2- 172.21.15.2:0/893866966 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f452807de50 0x7f452807c2b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4524009820 tx=0x7f452402a270 comp rx=0 tx=0).stop 2024-09-19T04:38:54.210 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.378+0000 7f452f912640 1 -- 172.21.15.2:0/893866966 shutdown_connections 2024-09-19T04:38:54.211 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.378+0000 7f452f912640 1 --2- 172.21.15.2:0/893866966 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f452807de50 0x7f452807c2b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:54.211 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.378+0000 7f452f912640 1 -- 172.21.15.2:0/893866966 >> 172.21.15.2:0/893866966 conn(0x7f4528102d50 msgr2=0x7f4528105190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:54.211 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.378+0000 7f452f912640 1 -- 172.21.15.2:0/893866966 shutdown_connections 2024-09-19T04:38:54.211 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.378+0000 7f452f912640 1 -- 172.21.15.2:0/893866966 wait complete. 2024-09-19T04:38:54.211 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.379+0000 7f452f912640 1 Processor -- start 2024-09-19T04:38:54.211 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.379+0000 7f452f912640 1 -- start start 2024-09-19T04:38:54.211 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.379+0000 7f452f912640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f452807de50 0x7f452819d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:54.211 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.379+0000 7f452f912640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f452810dbb0 con 0x7f452807de50 2024-09-19T04:38:54.211 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.379+0000 7f452d6ae640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f452807de50 0x7f452819d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:54.211 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.379+0000 7f452d6ae640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f452807de50 0x7f452819d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40448/0 (socket says 172.21.15.2:40448) 2024-09-19T04:38:54.211 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.379+0000 7f452d6ae640 1 -- 172.21.15.2:0/1239336110 learned_addr learned my addr 172.21.15.2:0/1239336110 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:38:54.211 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.379+0000 7f452d6ae640 1 -- 172.21.15.2:0/1239336110 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f452819dd10 con 0x7f452807de50 2024-09-19T04:38:54.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.380+0000 7f452d6ae640 1 --2- 172.21.15.2:0/1239336110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f452807de50 0x7f452819d7d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4524030520 tx=0x7f4524032dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:54.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.380+0000 7f451e7fc640 1 -- 172.21.15.2:0/1239336110 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4524042070 con 0x7f452807de50 2024-09-19T04:38:54.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.380+0000 7f451e7fc640 1 -- 172.21.15.2:0/1239336110 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f4524030cc0 con 0x7f452807de50 2024-09-19T04:38:54.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.380+0000 7f452f912640 1 -- 172.21.15.2:0/1239336110 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f452819dfa0 con 0x7f452807de50 2024-09-19T04:38:54.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.380+0000 7f451e7fc640 1 -- 172.21.15.2:0/1239336110 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4524037040 con 0x7f452807de50 2024-09-19T04:38:54.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.380+0000 7f452f912640 1 -- 172.21.15.2:0/1239336110 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45281a0c90 con 0x7f452807de50 2024-09-19T04:38:54.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.381+0000 7f451e7fc640 1 -- 172.21.15.2:0/1239336110 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 3) ==== 46344+0+0 (secure 0 0 0) 0x7f4524045070 con 0x7f452807de50 2024-09-19T04:38:54.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.381+0000 7f451e7fc640 1 --2- 172.21.15.2:0/1239336110 >> [v2:172.21.15.2:6800/1825825090,v1:172.21.15.2:6801/1825825090] conn(0x7f45140390a0 0x7f451403b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:54.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.381+0000 7f452f912640 1 -- 172.21.15.2:0/1239336110 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f452807c330 con 0x7f452807de50 2024-09-19T04:38:54.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.381+0000 7f451e7fc640 1 -- 172.21.15.2:0/1239336110 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f452406c100 con 0x7f452807de50 2024-09-19T04:38:54.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.381+0000 7f452cead640 1 --2- 172.21.15.2:0/1239336110 >> [v2:172.21.15.2:6800/1825825090,v1:172.21.15.2:6801/1825825090] conn(0x7f45140390a0 0x7f451403b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:54.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.382+0000 7f452cead640 1 --2- 172.21.15.2:0/1239336110 >> [v2:172.21.15.2:6800/1825825090,v1:172.21.15.2:6801/1825825090] conn(0x7f45140390a0 0x7f451403b560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f45180098c0 tx=0x7f4518006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:54.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.386+0000 7f451e7fc640 1 -- 172.21.15.2:0/1239336110 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4524045360 con 0x7f452807de50 2024-09-19T04:38:54.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.627+0000 7f452f912640 1 -- 172.21.15.2:0/1239336110 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f45281a0e60 con 0x7f452807de50 2024-09-19T04:38:54.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.628+0000 7f451e7fc640 1 -- 172.21.15.2:0/1239336110 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7f45281a0e60 con 0x7f452807de50 2024-09-19T04:38:54.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.630+0000 7f452f912640 1 -- 172.21.15.2:0/1239336110 >> [v2:172.21.15.2:6800/1825825090,v1:172.21.15.2:6801/1825825090] conn(0x7f45140390a0 msgr2=0x7f451403b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:54.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.630+0000 7f452f912640 1 --2- 172.21.15.2:0/1239336110 >> [v2:172.21.15.2:6800/1825825090,v1:172.21.15.2:6801/1825825090] conn(0x7f45140390a0 0x7f451403b560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f45180098c0 tx=0x7f4518006db0 comp rx=0 tx=0).stop 2024-09-19T04:38:54.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.630+0000 7f452f912640 1 -- 172.21.15.2:0/1239336110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f452807de50 msgr2=0x7f452819d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:54.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.630+0000 7f452f912640 1 --2- 172.21.15.2:0/1239336110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f452807de50 0x7f452819d7d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4524030520 tx=0x7f4524032dd0 comp rx=0 tx=0).stop 2024-09-19T04:38:54.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.631+0000 7f452f912640 1 -- 172.21.15.2:0/1239336110 shutdown_connections 2024-09-19T04:38:54.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.631+0000 7f452f912640 1 --2- 172.21.15.2:0/1239336110 >> [v2:172.21.15.2:6800/1825825090,v1:172.21.15.2:6801/1825825090] conn(0x7f45140390a0 0x7f451403b560 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:54.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.631+0000 7f452f912640 1 --2- 172.21.15.2:0/1239336110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f452807de50 0x7f452819d7d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:54.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.631+0000 7f452f912640 1 -- 172.21.15.2:0/1239336110 >> 172.21.15.2:0/1239336110 conn(0x7f4528102d50 msgr2=0x7f4528103920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:54.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.631+0000 7f452f912640 1 -- 172.21.15.2:0/1239336110 shutdown_connections 2024-09-19T04:38:54.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:53.631+0000 7f452f912640 1 -- 172.21.15.2:0/1239336110 wait complete. 2024-09-19T04:38:54.213 INFO:teuthology.orchestra.run.smithi002.stdout:mgr is available 2024-09-19T04:38:55.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:54 smithi002 ceph-mon[30975]: mgrmap e4: x(active, since 2s) 2024-09-19T04:38:56.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:38:56 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/1079620524' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T04:39:02.740 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-19T04:39:02.741 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T04:39:02.741 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout fsid = d46630c4-7640-11ef-bceb-c7b262605968 2024-09-19T04:39:02.741 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.2:3300,v1:172.21.15.2:6789] 2024-09-19T04:39:02.741 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T04:39:02.741 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T04:39:02.741 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T04:39:02.741 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T04:39:02.741 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-19T04:39:02.741 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T04:39:02.741 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T04:39:02.742 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-19T04:39:02.742 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T04:39:02.742 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T04:39:02.742 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T04:39:02.742 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T04:39:02.742 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T04:39:02.742 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T04:39:02.742 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.403+0000 7f72f3961640 1 Processor -- start 2024-09-19T04:39:02.742 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.403+0000 7f72f3961640 1 -- start start 2024-09-19T04:39:02.742 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.403+0000 7f72f3961640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72ec07de90 0x7f72ec07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:02.742 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.403+0000 7f72f3961640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f72ec07c8c0 con 0x7f72ec07de90 2024-09-19T04:39:02.742 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.403+0000 7f72f16fd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72ec07de90 0x7f72ec07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:02.743 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.403+0000 7f72f16fd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72ec07de90 0x7f72ec07c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40460/0 (socket says 172.21.15.2:40460) 2024-09-19T04:39:02.743 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.403+0000 7f72f16fd640 1 -- 172.21.15.2:0/1678063719 learned_addr learned my addr 172.21.15.2:0/1678063719 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:39:02.743 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.404+0000 7f72f16fd640 1 -- 172.21.15.2:0/1678063719 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72ec07ca40 con 0x7f72ec07de90 2024-09-19T04:39:02.743 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.404+0000 7f72f16fd640 1 --2- 172.21.15.2:0/1678063719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72ec07de90 0x7f72ec07c2f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f72e8009820 tx=0x7f72e802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1445821dedad4d1e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:02.743 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.405+0000 7f72e3fff640 1 -- 172.21.15.2:0/1678063719 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72e8037070 con 0x7f72ec07de90 2024-09-19T04:39:02.743 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.405+0000 7f72e3fff640 1 -- 172.21.15.2:0/1678063719 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f72e80328d0 con 0x7f72ec07de90 2024-09-19T04:39:02.743 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.405+0000 7f72e3fff640 1 -- 172.21.15.2:0/1678063719 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72e80307d0 con 0x7f72ec07de90 2024-09-19T04:39:02.743 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.405+0000 7f72f3961640 1 -- 172.21.15.2:0/1678063719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72ec07de90 msgr2=0x7f72ec07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:02.743 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.405+0000 7f72f3961640 1 --2- 172.21.15.2:0/1678063719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72ec07de90 0x7f72ec07c2f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f72e8009820 tx=0x7f72e802a270 comp rx=0 tx=0).stop 2024-09-19T04:39:02.743 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.405+0000 7f72f3961640 1 -- 172.21.15.2:0/1678063719 shutdown_connections 2024-09-19T04:39:02.743 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.405+0000 7f72f3961640 1 --2- 172.21.15.2:0/1678063719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72ec07de90 0x7f72ec07c2f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:02.743 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.405+0000 7f72f3961640 1 -- 172.21.15.2:0/1678063719 >> 172.21.15.2:0/1678063719 conn(0x7f72ec102d50 msgr2=0x7f72ec105190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:02.743 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.405+0000 7f72f3961640 1 -- 172.21.15.2:0/1678063719 shutdown_connections 2024-09-19T04:39:02.744 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.405+0000 7f72f3961640 1 -- 172.21.15.2:0/1678063719 wait complete. 2024-09-19T04:39:02.744 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.406+0000 7f72f3961640 1 Processor -- start 2024-09-19T04:39:02.744 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.406+0000 7f72f3961640 1 -- start start 2024-09-19T04:39:02.744 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.406+0000 7f72f3961640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72ec07de90 0x7f72ec19d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:02.744 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.406+0000 7f72f3961640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f72ec10dbd0 con 0x7f72ec07de90 2024-09-19T04:39:02.744 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.407+0000 7f72f16fd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72ec07de90 0x7f72ec19d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:02.744 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.407+0000 7f72f16fd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72ec07de90 0x7f72ec19d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40464/0 (socket says 172.21.15.2:40464) 2024-09-19T04:39:02.744 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.407+0000 7f72f16fd640 1 -- 172.21.15.2:0/1079620524 learned_addr learned my addr 172.21.15.2:0/1079620524 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:39:02.744 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.407+0000 7f72f16fd640 1 -- 172.21.15.2:0/1079620524 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72ec19dd00 con 0x7f72ec07de90 2024-09-19T04:39:02.744 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.407+0000 7f72f16fd640 1 --2- 172.21.15.2:0/1079620524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72ec07de90 0x7f72ec19d7c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f72e8030520 tx=0x7f72e8032dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:02.744 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.407+0000 7f72e27fc640 1 -- 172.21.15.2:0/1079620524 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72e8042070 con 0x7f72ec07de90 2024-09-19T04:39:02.744 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.407+0000 7f72e27fc640 1 -- 172.21.15.2:0/1079620524 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f72e8030cc0 con 0x7f72ec07de90 2024-09-19T04:39:02.744 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.407+0000 7f72f3961640 1 -- 172.21.15.2:0/1079620524 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72ec19df90 con 0x7f72ec07de90 2024-09-19T04:39:02.745 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.407+0000 7f72e27fc640 1 -- 172.21.15.2:0/1079620524 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72e8037040 con 0x7f72ec07de90 2024-09-19T04:39:02.745 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.407+0000 7f72f3961640 1 -- 172.21.15.2:0/1079620524 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72ec1a0c80 con 0x7f72ec07de90 2024-09-19T04:39:02.745 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.408+0000 7f72e27fc640 1 -- 172.21.15.2:0/1079620524 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f72e8045070 con 0x7f72ec07de90 2024-09-19T04:39:02.745 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.408+0000 7f72e27fc640 1 --2- 172.21.15.2:0/1079620524 >> [v2:172.21.15.2:6800/1825825090,v1:172.21.15.2:6801/1825825090] conn(0x7f72d80391b0 0x7f72d803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:02.745 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.408+0000 7f72e27fc640 1 -- 172.21.15.2:0/1079620524 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f72e806c0f0 con 0x7f72ec07de90 2024-09-19T04:39:02.745 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.408+0000 7f72f0efc640 1 --2- 172.21.15.2:0/1079620524 >> [v2:172.21.15.2:6800/1825825090,v1:172.21.15.2:6801/1825825090] conn(0x7f72d80391b0 0x7f72d803b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:02.745 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.408+0000 7f72f3961640 1 -- 172.21.15.2:0/1079620524 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72ec07c370 con 0x7f72ec07de90 2024-09-19T04:39:02.745 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.409+0000 7f72f0efc640 1 --2- 172.21.15.2:0/1079620524 >> [v2:172.21.15.2:6800/1825825090,v1:172.21.15.2:6801/1825825090] conn(0x7f72d80391b0 0x7f72d803b670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f72dc0098c0 tx=0x7f72dc006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:02.745 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.413+0000 7f72e27fc640 1 -- 172.21.15.2:0/1079620524 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f72e8045360 con 0x7f72ec07de90 2024-09-19T04:39:02.745 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.593+0000 7f72f3961640 1 -- 172.21.15.2:0/1079620524 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f72ec1a0e50 con 0x7f72ec07de90 2024-09-19T04:39:02.745 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.594+0000 7f72e27fc640 1 -- 172.21.15.2:0/1079620524 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+427 (secure 0 0 0) 0x7f72e802ed90 con 0x7f72ec07de90 2024-09-19T04:39:02.745 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.597+0000 7f72f3961640 1 -- 172.21.15.2:0/1079620524 >> [v2:172.21.15.2:6800/1825825090,v1:172.21.15.2:6801/1825825090] conn(0x7f72d80391b0 msgr2=0x7f72d803b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:02.745 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.597+0000 7f72f3961640 1 --2- 172.21.15.2:0/1079620524 >> [v2:172.21.15.2:6800/1825825090,v1:172.21.15.2:6801/1825825090] conn(0x7f72d80391b0 0x7f72d803b670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f72dc0098c0 tx=0x7f72dc006db0 comp rx=0 tx=0).stop 2024-09-19T04:39:02.746 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.597+0000 7f72f3961640 1 -- 172.21.15.2:0/1079620524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72ec07de90 msgr2=0x7f72ec19d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:02.746 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.597+0000 7f72f3961640 1 --2- 172.21.15.2:0/1079620524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72ec07de90 0x7f72ec19d7c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f72e8030520 tx=0x7f72e8032dd0 comp rx=0 tx=0).stop 2024-09-19T04:39:02.746 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.597+0000 7f72f3961640 1 -- 172.21.15.2:0/1079620524 shutdown_connections 2024-09-19T04:39:02.746 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.597+0000 7f72f3961640 1 --2- 172.21.15.2:0/1079620524 >> [v2:172.21.15.2:6800/1825825090,v1:172.21.15.2:6801/1825825090] conn(0x7f72d80391b0 0x7f72d803b670 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:02.746 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.597+0000 7f72f3961640 1 --2- 172.21.15.2:0/1079620524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72ec07de90 0x7f72ec19d7c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:02.746 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.597+0000 7f72f3961640 1 -- 172.21.15.2:0/1079620524 >> 172.21.15.2:0/1079620524 conn(0x7f72ec102d50 msgr2=0x7f72ec103910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:02.746 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.597+0000 7f72f3961640 1 -- 172.21.15.2:0/1079620524 shutdown_connections 2024-09-19T04:39:02.746 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:38:56.597+0000 7f72f3961640 1 -- 172.21.15.2:0/1079620524 wait complete. 2024-09-19T04:39:02.746 INFO:teuthology.orchestra.run.smithi002.stdout:Enabling cephadm module... 2024-09-19T04:39:06.250 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:06 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/4006000998' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-19T04:39:06.251 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:06 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: ignoring --setuser ceph since I am not root 2024-09-19T04:39:06.251 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:06 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: ignoring --setgroup ceph since I am not root 2024-09-19T04:39:06.251 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:06 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:06.189+0000 7f76b7dbe040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T04:39:06.251 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:06 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:06.249+0000 7f76b7dbe040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T04:39:06.588 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:06 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:06.403+0000 7f76b7dbe040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T04:39:06.588 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:06 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:06.472+0000 7f76b7dbe040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T04:39:06.860 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:06 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:06.626+0000 7f76b7dbe040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T04:39:06.860 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:06 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:06.773+0000 7f76b7dbe040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T04:39:06.904 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:05.751+0000 7f76ea1ee640 1 Processor -- start 2024-09-19T04:39:06.904 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:05.751+0000 7f76ea1ee640 1 -- start start 2024-09-19T04:39:06.905 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:05.751+0000 7f76ea1ee640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76e41075c0 0x7f76e41079c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:06.905 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:05.751+0000 7f76ea1ee640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f76e4107f90 con 0x7f76e41075c0 2024-09-19T04:39:06.905 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:05.751+0000 7f76e37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76e41075c0 0x7f76e41079c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:06.905 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:05.751+0000 7f76e37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76e41075c0 0x7f76e41079c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53390/0 (socket says 172.21.15.2:53390) 2024-09-19T04:39:06.905 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:05.751+0000 7f76e37fe640 1 -- 172.21.15.2:0/769532735 learned_addr learned my addr 172.21.15.2:0/769532735 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:39:06.905 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:05.752+0000 7f76e37fe640 1 -- 172.21.15.2:0/769532735 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76e41087c0 con 0x7f76e41075c0 2024-09-19T04:39:06.905 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:05.752+0000 7f76e37fe640 1 --2- 172.21.15.2:0/769532735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76e41075c0 0x7f76e41079c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f76d4009820 tx=0x7f76d402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b37f5dfc0ff72cb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:06.905 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:05.753+0000 7f76e27fc640 1 -- 172.21.15.2:0/769532735 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76d4037070 con 0x7f76e41075c0 2024-09-19T04:39:06.905 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:05.753+0000 7f76e27fc640 1 -- 172.21.15.2:0/769532735 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f76d40328d0 con 0x7f76e41075c0 2024-09-19T04:39:06.905 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:05.753+0000 7f76e27fc640 1 -- 172.21.15.2:0/769532735 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76d40307d0 con 0x7f76e41075c0 2024-09-19T04:39:06.905 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:05.753+0000 7f76ea1ee640 1 -- 172.21.15.2:0/769532735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76e41075c0 msgr2=0x7f76e41079c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:06.906 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:05.753+0000 7f76ea1ee640 1 --2- 172.21.15.2:0/769532735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76e41075c0 0x7f76e41079c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f76d4009820 tx=0x7f76d402a270 comp rx=0 tx=0).stop 2024-09-19T04:39:06.906 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:05.753+0000 7f76ea1ee640 1 -- 172.21.15.2:0/769532735 shutdown_connections 2024-09-19T04:39:06.906 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:05.753+0000 7f76ea1ee640 1 --2- 172.21.15.2:0/769532735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76e41075c0 0x7f76e41079c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:06.906 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:05.753+0000 7f76ea1ee640 1 -- 172.21.15.2:0/769532735 >> 172.21.15.2:0/769532735 conn(0x7f76e4102d50 msgr2=0x7f76e4105190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:06.906 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:05.753+0000 7f76ea1ee640 1 -- 172.21.15.2:0/769532735 shutdown_connections 2024-09-19T04:39:06.906 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:05.753+0000 7f76ea1ee640 1 -- 172.21.15.2:0/769532735 wait complete. 2024-09-19T04:39:06.906 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:05.754+0000 7f76ea1ee640 1 Processor -- start 2024-09-19T04:39:06.906 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:05.754+0000 7f76ea1ee640 1 -- start start 2024-09-19T04:39:06.906 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:05.754+0000 7f76ea1ee640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76e41075c0 0x7f76e419b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:06.906 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:05.754+0000 7f76ea1ee640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f76e410bb70 con 0x7f76e41075c0 2024-09-19T04:39:06.906 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:05.754+0000 7f76e37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76e41075c0 0x7f76e419b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:06.906 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:05.754+0000 7f76e37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76e41075c0 0x7f76e419b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53404/0 (socket says 172.21.15.2:53404) 2024-09-19T04:39:06.906 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:05.754+0000 7f76e37fe640 1 -- 172.21.15.2:0/4006000998 learned_addr learned my addr 172.21.15.2:0/4006000998 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:39:06.907 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:05.755+0000 7f76e37fe640 1 -- 172.21.15.2:0/4006000998 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76e419bb00 con 0x7f76e41075c0 2024-09-19T04:39:06.907 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:05.755+0000 7f76e37fe640 1 --2- 172.21.15.2:0/4006000998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76e41075c0 0x7f76e419b5c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f76d40097f0 tx=0x7f76d4030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:06.907 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:05.755+0000 7f76e0ff9640 1 -- 172.21.15.2:0/4006000998 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76d4037040 con 0x7f76e41075c0 2024-09-19T04:39:06.907 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:05.755+0000 7f76e0ff9640 1 -- 172.21.15.2:0/4006000998 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f76d4032bb0 con 0x7f76e41075c0 2024-09-19T04:39:06.907 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:05.755+0000 7f76e0ff9640 1 -- 172.21.15.2:0/4006000998 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76d403a390 con 0x7f76e41075c0 2024-09-19T04:39:06.907 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:05.755+0000 7f76ea1ee640 1 -- 172.21.15.2:0/4006000998 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76e419bd90 con 0x7f76e41075c0 2024-09-19T04:39:06.907 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:05.755+0000 7f76ea1ee640 1 -- 172.21.15.2:0/4006000998 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76e419ea80 con 0x7f76e41075c0 2024-09-19T04:39:06.907 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:05.756+0000 7f76e0ff9640 1 -- 172.21.15.2:0/4006000998 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f76d403a580 con 0x7f76e41075c0 2024-09-19T04:39:06.907 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:05.756+0000 7f76ea1ee640 1 -- 172.21.15.2:0/4006000998 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76e410bcf0 con 0x7f76e41075c0 2024-09-19T04:39:06.907 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:05.756+0000 7f76e0ff9640 1 --2- 172.21.15.2:0/4006000998 >> [v2:172.21.15.2:6800/1825825090,v1:172.21.15.2:6801/1825825090] conn(0x7f76cc0391b0 0x7f76cc03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:06.907 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:05.756+0000 7f76e0ff9640 1 -- 172.21.15.2:0/4006000998 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f76d406c4f0 con 0x7f76e41075c0 2024-09-19T04:39:06.907 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:05.756+0000 7f76e2ffd640 1 --2- 172.21.15.2:0/4006000998 >> [v2:172.21.15.2:6800/1825825090,v1:172.21.15.2:6801/1825825090] conn(0x7f76cc0391b0 0x7f76cc03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:06.907 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:05.757+0000 7f76e2ffd640 1 --2- 172.21.15.2:0/4006000998 >> [v2:172.21.15.2:6800/1825825090,v1:172.21.15.2:6801/1825825090] conn(0x7f76cc0391b0 0x7f76cc03b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f76d80098c0 tx=0x7f76d8006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:06.908 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:05.761+0000 7f76e0ff9640 1 -- 172.21.15.2:0/4006000998 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f76d4032dd0 con 0x7f76e41075c0 2024-09-19T04:39:06.908 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:05.989+0000 7f76ea1ee640 1 -- 172.21.15.2:0/4006000998 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f76e419f110 con 0x7f76e41075c0 2024-09-19T04:39:06.908 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:06.040+0000 7f76e0ff9640 1 -- 172.21.15.2:0/4006000998 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f76d406bf10 con 0x7f76e41075c0 2024-09-19T04:39:06.908 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:06.042+0000 7f76e0ff9640 1 -- 172.21.15.2:0/4006000998 <== mon.0 v2:172.21.15.2:3300/0 8 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f76d4044450 con 0x7f76e41075c0 2024-09-19T04:39:06.908 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:06.043+0000 7f76ea1ee640 1 -- 172.21.15.2:0/4006000998 >> [v2:172.21.15.2:6800/1825825090,v1:172.21.15.2:6801/1825825090] conn(0x7f76cc0391b0 msgr2=0x7f76cc03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:06.908 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:06.043+0000 7f76ea1ee640 1 --2- 172.21.15.2:0/4006000998 >> [v2:172.21.15.2:6800/1825825090,v1:172.21.15.2:6801/1825825090] conn(0x7f76cc0391b0 0x7f76cc03b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f76d80098c0 tx=0x7f76d8006db0 comp rx=0 tx=0).stop 2024-09-19T04:39:06.908 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:06.043+0000 7f76ea1ee640 1 -- 172.21.15.2:0/4006000998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76e41075c0 msgr2=0x7f76e419b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:06.908 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:06.043+0000 7f76ea1ee640 1 --2- 172.21.15.2:0/4006000998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76e41075c0 0x7f76e419b5c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f76d40097f0 tx=0x7f76d4030d00 comp rx=0 tx=0).stop 2024-09-19T04:39:06.908 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:06.043+0000 7f76ea1ee640 1 -- 172.21.15.2:0/4006000998 shutdown_connections 2024-09-19T04:39:06.908 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:06.043+0000 7f76ea1ee640 1 --2- 172.21.15.2:0/4006000998 >> [v2:172.21.15.2:6800/1825825090,v1:172.21.15.2:6801/1825825090] conn(0x7f76cc0391b0 0x7f76cc03b670 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:06.908 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:06.043+0000 7f76ea1ee640 1 --2- 172.21.15.2:0/4006000998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76e41075c0 0x7f76e419b5c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:06.909 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:06.043+0000 7f76ea1ee640 1 -- 172.21.15.2:0/4006000998 >> 172.21.15.2:0/4006000998 conn(0x7f76e4102d50 msgr2=0x7f76e41038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:06.909 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:06.043+0000 7f76ea1ee640 1 -- 172.21.15.2:0/4006000998 shutdown_connections 2024-09-19T04:39:06.909 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:06.043+0000 7f76ea1ee640 1 -- 172.21.15.2:0/4006000998 wait complete. 2024-09-19T04:39:07.173 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:07 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/4006000998' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-19T04:39:07.174 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:07 smithi002 ceph-mon[30975]: mgrmap e5: x(active, since 14s) 2024-09-19T04:39:07.174 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:07 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:07.107+0000 7f76b7dbe040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T04:39:07.528 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:07 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:07.171+0000 7f76b7dbe040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T04:39:07.529 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:07 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:07.369+0000 7f76b7dbe040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T04:39:08.109 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:08 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/10179075' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T04:39:08.120 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-19T04:39:08.120 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-19T04:39:08.120 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T04:39:08.120 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T04:39:08.121 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T04:39:08.121 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-19T04:39:08.121 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.320+0000 7f316ce0f640 1 Processor -- start 2024-09-19T04:39:08.121 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.320+0000 7f316ce0f640 1 -- start start 2024-09-19T04:39:08.121 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.321+0000 7f316ce0f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3168107fe0 0x7f316810a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:08.121 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.321+0000 7f316ce0f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3168063510 con 0x7f3168107fe0 2024-09-19T04:39:08.121 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.321+0000 7f316659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3168107fe0 0x7f316810a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:08.121 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.321+0000 7f316659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3168107fe0 0x7f316810a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53436/0 (socket says 172.21.15.2:53436) 2024-09-19T04:39:08.121 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.321+0000 7f316659c640 1 -- 172.21.15.2:0/3121776320 learned_addr learned my addr 172.21.15.2:0/3121776320 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:39:08.121 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.321+0000 7f316659c640 1 -- 172.21.15.2:0/3121776320 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f316810a910 con 0x7f3168107fe0 2024-09-19T04:39:08.121 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.322+0000 7f316659c640 1 --2- 172.21.15.2:0/3121776320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3168107fe0 0x7f316810a3d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3158009820 tx=0x7f315802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=123e156b0ae8464b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:08.121 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.322+0000 7f316559a640 1 -- 172.21.15.2:0/3121776320 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3158037070 con 0x7f3168107fe0 2024-09-19T04:39:08.122 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.322+0000 7f316559a640 1 -- 172.21.15.2:0/3121776320 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f31580328d0 con 0x7f3168107fe0 2024-09-19T04:39:08.122 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.322+0000 7f316559a640 1 -- 172.21.15.2:0/3121776320 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31580307d0 con 0x7f3168107fe0 2024-09-19T04:39:08.122 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.323+0000 7f316ce0f640 1 -- 172.21.15.2:0/3121776320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3168107fe0 msgr2=0x7f316810a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:08.122 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.323+0000 7f316ce0f640 1 --2- 172.21.15.2:0/3121776320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3168107fe0 0x7f316810a3d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3158009820 tx=0x7f315802a270 comp rx=0 tx=0).stop 2024-09-19T04:39:08.122 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.323+0000 7f316ce0f640 1 -- 172.21.15.2:0/3121776320 shutdown_connections 2024-09-19T04:39:08.122 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.323+0000 7f316ce0f640 1 --2- 172.21.15.2:0/3121776320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3168107fe0 0x7f316810a3d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:08.122 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.323+0000 7f316ce0f640 1 -- 172.21.15.2:0/3121776320 >> 172.21.15.2:0/3121776320 conn(0x7f3168101c00 msgr2=0x7f3168104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:08.122 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.323+0000 7f316ce0f640 1 -- 172.21.15.2:0/3121776320 shutdown_connections 2024-09-19T04:39:08.122 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.323+0000 7f316ce0f640 1 -- 172.21.15.2:0/3121776320 wait complete. 2024-09-19T04:39:08.122 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.324+0000 7f316ce0f640 1 Processor -- start 2024-09-19T04:39:08.122 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.324+0000 7f316ce0f640 1 -- start start 2024-09-19T04:39:08.122 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.324+0000 7f316ce0f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3168107fe0 0x7f316819b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:08.123 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.324+0000 7f316ce0f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f316810b950 con 0x7f3168107fe0 2024-09-19T04:39:08.123 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.324+0000 7f316659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3168107fe0 0x7f316819b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:08.123 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.324+0000 7f316659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3168107fe0 0x7f316819b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53438/0 (socket says 172.21.15.2:53438) 2024-09-19T04:39:08.123 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.324+0000 7f316659c640 1 -- 172.21.15.2:0/10179075 learned_addr learned my addr 172.21.15.2:0/10179075 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:39:08.123 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.325+0000 7f316659c640 1 -- 172.21.15.2:0/10179075 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f316819ba90 con 0x7f3168107fe0 2024-09-19T04:39:08.123 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.325+0000 7f316659c640 1 --2- 172.21.15.2:0/10179075 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3168107fe0 0x7f316819b550 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f31580097f0 tx=0x7f3158030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:08.123 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.325+0000 7f315f7fe640 1 -- 172.21.15.2:0/10179075 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3158037040 con 0x7f3168107fe0 2024-09-19T04:39:08.123 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.325+0000 7f315f7fe640 1 -- 172.21.15.2:0/10179075 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f3158032bb0 con 0x7f3168107fe0 2024-09-19T04:39:08.123 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.325+0000 7f316ce0f640 1 -- 172.21.15.2:0/10179075 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f316819bd20 con 0x7f3168107fe0 2024-09-19T04:39:08.123 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.325+0000 7f315f7fe640 1 -- 172.21.15.2:0/10179075 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f315803a390 con 0x7f3168107fe0 2024-09-19T04:39:08.123 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.325+0000 7f316ce0f640 1 -- 172.21.15.2:0/10179075 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f316819ea10 con 0x7f3168107fe0 2024-09-19T04:39:08.123 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.326+0000 7f315f7fe640 1 -- 172.21.15.2:0/10179075 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f315803a580 con 0x7f3168107fe0 2024-09-19T04:39:08.123 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.326+0000 7f315f7fe640 1 --2- 172.21.15.2:0/10179075 >> [v2:172.21.15.2:6800/1825825090,v1:172.21.15.2:6801/1825825090] conn(0x7f3154039200 0x7f315403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:08.124 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.326+0000 7f316ce0f640 1 -- 172.21.15.2:0/10179075 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3168108440 con 0x7f3168107fe0 2024-09-19T04:39:08.124 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.326+0000 7f3165d9b640 1 -- 172.21.15.2:0/10179075 >> [v2:172.21.15.2:6800/1825825090,v1:172.21.15.2:6801/1825825090] conn(0x7f3154039200 msgr2=0x7f315403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/1825825090 2024-09-19T04:39:08.124 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.326+0000 7f315f7fe640 1 -- 172.21.15.2:0/10179075 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f315806c4b0 con 0x7f3168107fe0 2024-09-19T04:39:08.124 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.326+0000 7f3165d9b640 1 --2- 172.21.15.2:0/10179075 >> [v2:172.21.15.2:6800/1825825090,v1:172.21.15.2:6801/1825825090] conn(0x7f3154039200 0x7f315403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T04:39:08.124 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.331+0000 7f315f7fe640 1 -- 172.21.15.2:0/10179075 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3158040210 con 0x7f3168107fe0 2024-09-19T04:39:08.124 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.527+0000 7f3165d9b640 1 -- 172.21.15.2:0/10179075 >> [v2:172.21.15.2:6800/1825825090,v1:172.21.15.2:6801/1825825090] conn(0x7f3154039200 msgr2=0x7f315403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/1825825090 2024-09-19T04:39:08.124 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.527+0000 7f3165d9b640 1 --2- 172.21.15.2:0/10179075 >> [v2:172.21.15.2:6800/1825825090,v1:172.21.15.2:6801/1825825090] conn(0x7f3154039200 0x7f315403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T04:39:08.124 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.556+0000 7f316ce0f640 1 -- 172.21.15.2:0/10179075 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f316819f060 con 0x7f3168107fe0 2024-09-19T04:39:08.124 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.556+0000 7f315f7fe640 1 -- 172.21.15.2:0/10179075 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f315806bf70 con 0x7f3168107fe0 2024-09-19T04:39:08.124 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.558+0000 7f316ce0f640 1 -- 172.21.15.2:0/10179075 >> [v2:172.21.15.2:6800/1825825090,v1:172.21.15.2:6801/1825825090] conn(0x7f3154039200 msgr2=0x7f315403b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T04:39:08.124 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.558+0000 7f316ce0f640 1 --2- 172.21.15.2:0/10179075 >> [v2:172.21.15.2:6800/1825825090,v1:172.21.15.2:6801/1825825090] conn(0x7f3154039200 0x7f315403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:08.124 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.558+0000 7f316ce0f640 1 -- 172.21.15.2:0/10179075 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3168107fe0 msgr2=0x7f316819b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:08.125 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.558+0000 7f316ce0f640 1 --2- 172.21.15.2:0/10179075 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3168107fe0 0x7f316819b550 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f31580097f0 tx=0x7f3158030d00 comp rx=0 tx=0).stop 2024-09-19T04:39:08.125 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.558+0000 7f316ce0f640 1 -- 172.21.15.2:0/10179075 shutdown_connections 2024-09-19T04:39:08.125 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.558+0000 7f316ce0f640 1 --2- 172.21.15.2:0/10179075 >> [v2:172.21.15.2:6800/1825825090,v1:172.21.15.2:6801/1825825090] conn(0x7f3154039200 0x7f315403b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:08.125 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.558+0000 7f316ce0f640 1 --2- 172.21.15.2:0/10179075 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3168107fe0 0x7f316819b550 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:08.125 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.558+0000 7f316ce0f640 1 -- 172.21.15.2:0/10179075 >> 172.21.15.2:0/10179075 conn(0x7f3168101c00 msgr2=0x7f3168102790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:08.125 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.559+0000 7f316ce0f640 1 -- 172.21.15.2:0/10179075 shutdown_connections 2024-09-19T04:39:08.125 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:07.559+0000 7f316ce0f640 1 -- 172.21.15.2:0/10179075 wait complete. 2024-09-19T04:39:08.125 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for the mgr to restart... 2024-09-19T04:39:08.125 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mgr epoch 5... 2024-09-19T04:39:08.383 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:08 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:08.307+0000 7f76b7dbe040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T04:39:08.383 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:08 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:08.381+0000 7f76b7dbe040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T04:39:09.398 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:09 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:09.127+0000 7f76b7dbe040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T04:39:09.398 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:09 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:09.247+0000 7f76b7dbe040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T04:39:09.687 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:09 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:09.396+0000 7f76b7dbe040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T04:39:09.687 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:09 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:09.460+0000 7f76b7dbe040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T04:39:09.687 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:09 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:09.615+0000 7f76b7dbe040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T04:39:09.688 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:09 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:09.685+0000 7f76b7dbe040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T04:39:09.981 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:09 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:09.748+0000 7f76b7dbe040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T04:39:09.982 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:09 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:09.912+0000 7f76b7dbe040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T04:39:09.982 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:09 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:09.980+0000 7f76b7dbe040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T04:39:10.259 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:10 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:10.049+0000 7f76b7dbe040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T04:39:10.259 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:10 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:10.134+0000 7f76b7dbe040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T04:39:10.259 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:10 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:10.196+0000 7f76b7dbe040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T04:39:10.259 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:10 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:10.258+0000 7f76b7dbe040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T04:39:11.360 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:11 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:11.084+0000 7f76b7dbe040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T04:39:11.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:11 smithi002 ceph-mon[30975]: Active manager daemon x restarted 2024-09-19T04:39:11.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:11 smithi002 ceph-mon[30975]: Activating manager daemon x 2024-09-19T04:39:11.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:11 smithi002 ceph-mon[30975]: osdmap e2: 0 total, 0 up, 0 in 2024-09-19T04:39:11.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:11 smithi002 ceph-mon[30975]: mgrmap e6: x(active, starting, since 0.00354073s) 2024-09-19T04:39:11.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:11 smithi002 ceph-mon[30975]: from='mgr.14118 172.21.15.2:0/1882287761' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:39:11.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:11 smithi002 ceph-mon[30975]: from='mgr.14118 172.21.15.2:0/1882287761' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T04:39:11.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:11 smithi002 ceph-mon[30975]: from='mgr.14118 172.21.15.2:0/1882287761' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T04:39:11.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:11 smithi002 ceph-mon[30975]: from='mgr.14118 172.21.15.2:0/1882287761' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T04:39:11.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:11 smithi002 ceph-mon[30975]: from='mgr.14118 172.21.15.2:0/1882287761' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T04:39:11.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:11 smithi002 ceph-mon[30975]: Manager daemon x is now available 2024-09-19T04:39:11.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:11 smithi002 ceph-mon[30975]: from='mgr.14118 172.21.15.2:0/1882287761' entity='mgr.x' 2024-09-19T04:39:11.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:11 smithi002 ceph-mon[30975]: from='mgr.14118 172.21.15.2:0/1882287761' entity='mgr.x' 2024-09-19T04:39:11.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:11 smithi002 ceph-mon[30975]: from='mgr.14118 172.21.15.2:0/1882287761' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:39:11.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:11 smithi002 ceph-mon[30975]: from='mgr.14118 172.21.15.2:0/1882287761' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:39:11.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:11 smithi002 ceph-mon[30975]: from='mgr.14118 172.21.15.2:0/1882287761' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T04:39:11.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:11 smithi002 ceph-mon[30975]: from='mgr.14118 172.21.15.2:0/1882287761' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T04:39:12.668 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-19T04:39:12.669 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-19T04:39:12.669 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T04:39:12.669 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-19T04:39:12.669 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:08.511+0000 7fb669e2d640 1 Processor -- start 2024-09-19T04:39:12.669 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:08.511+0000 7fb669e2d640 1 -- start start 2024-09-19T04:39:12.669 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:08.511+0000 7fb669e2d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb664106480 0x7fb664106880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:12.669 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:08.511+0000 7fb669e2d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb664106e50 con 0x7fb664106480 2024-09-19T04:39:12.669 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:08.511+0000 7fb6637fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb664106480 0x7fb664106880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:12.669 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:08.511+0000 7fb6637fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb664106480 0x7fb664106880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53454/0 (socket says 172.21.15.2:53454) 2024-09-19T04:39:12.669 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:08.511+0000 7fb6637fe640 1 -- 172.21.15.2:0/1476222056 learned_addr learned my addr 172.21.15.2:0/1476222056 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:39:12.669 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:08.512+0000 7fb6637fe640 1 -- 172.21.15.2:0/1476222056 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb664107680 con 0x7fb664106480 2024-09-19T04:39:12.670 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:08.512+0000 7fb6637fe640 1 --2- 172.21.15.2:0/1476222056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb664106480 0x7fb664106880 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb654009820 tx=0x7fb65402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edad393c586046ec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:12.670 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:08.513+0000 7fb662ffd640 1 -- 172.21.15.2:0/1476222056 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb654037070 con 0x7fb664106480 2024-09-19T04:39:12.670 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:08.513+0000 7fb662ffd640 1 -- 172.21.15.2:0/1476222056 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fb6540328d0 con 0x7fb664106480 2024-09-19T04:39:12.670 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:08.513+0000 7fb662ffd640 1 -- 172.21.15.2:0/1476222056 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6540307d0 con 0x7fb664106480 2024-09-19T04:39:12.670 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:08.513+0000 7fb669e2d640 1 -- 172.21.15.2:0/1476222056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb664106480 msgr2=0x7fb664106880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:12.670 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:08.513+0000 7fb669e2d640 1 --2- 172.21.15.2:0/1476222056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb664106480 0x7fb664106880 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb654009820 tx=0x7fb65402a270 comp rx=0 tx=0).stop 2024-09-19T04:39:12.670 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:08.513+0000 7fb669e2d640 1 -- 172.21.15.2:0/1476222056 shutdown_connections 2024-09-19T04:39:12.670 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:08.513+0000 7fb669e2d640 1 --2- 172.21.15.2:0/1476222056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb664106480 0x7fb664106880 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:12.670 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:08.513+0000 7fb669e2d640 1 -- 172.21.15.2:0/1476222056 >> 172.21.15.2:0/1476222056 conn(0x7fb664101bf0 msgr2=0x7fb664104050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:12.670 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:08.513+0000 7fb669e2d640 1 -- 172.21.15.2:0/1476222056 shutdown_connections 2024-09-19T04:39:12.670 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:08.513+0000 7fb669e2d640 1 -- 172.21.15.2:0/1476222056 wait complete. 2024-09-19T04:39:12.670 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:08.514+0000 7fb669e2d640 1 Processor -- start 2024-09-19T04:39:12.671 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:08.514+0000 7fb669e2d640 1 -- start start 2024-09-19T04:39:12.671 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:08.514+0000 7fb669e2d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb664106480 0x7fb6641916b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:12.671 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:08.514+0000 7fb669e2d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb66410aa30 con 0x7fb664106480 2024-09-19T04:39:12.671 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:08.514+0000 7fb6637fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb664106480 0x7fb6641916b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:12.671 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:08.514+0000 7fb6637fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb664106480 0x7fb6641916b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53462/0 (socket says 172.21.15.2:53462) 2024-09-19T04:39:12.671 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:08.514+0000 7fb6637fe640 1 -- 172.21.15.2:0/3697241961 learned_addr learned my addr 172.21.15.2:0/3697241961 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:39:12.671 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:08.515+0000 7fb6637fe640 1 -- 172.21.15.2:0/3697241961 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb664191bf0 con 0x7fb664106480 2024-09-19T04:39:12.671 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:08.515+0000 7fb6637fe640 1 --2- 172.21.15.2:0/3697241961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb664106480 0x7fb6641916b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb6540097f0 tx=0x7fb654030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:12.671 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:08.515+0000 7fb6617fa640 1 -- 172.21.15.2:0/3697241961 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb654037040 con 0x7fb664106480 2024-09-19T04:39:12.671 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:08.515+0000 7fb6617fa640 1 -- 172.21.15.2:0/3697241961 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fb654032bb0 con 0x7fb664106480 2024-09-19T04:39:12.671 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:08.515+0000 7fb669e2d640 1 -- 172.21.15.2:0/3697241961 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb66418fde0 con 0x7fb664106480 2024-09-19T04:39:12.671 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:08.515+0000 7fb6617fa640 1 -- 172.21.15.2:0/3697241961 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb65403a390 con 0x7fb664106480 2024-09-19T04:39:12.672 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:08.515+0000 7fb669e2d640 1 -- 172.21.15.2:0/3697241961 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb664190320 con 0x7fb664106480 2024-09-19T04:39:12.672 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:08.516+0000 7fb6617fa640 1 -- 172.21.15.2:0/3697241961 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7fb65403a580 con 0x7fb664106480 2024-09-19T04:39:12.672 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:08.516+0000 7fb6617fa640 1 --2- 172.21.15.2:0/3697241961 >> [v2:172.21.15.2:6800/1825825090,v1:172.21.15.2:6801/1825825090] conn(0x7fb650039200 0x7fb65003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:12.672 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:08.516+0000 7fb6617fa640 1 -- 172.21.15.2:0/3697241961 --> [v2:172.21.15.2:6800/1825825090,v1:172.21.15.2:6801/1825825090] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fb65003bdd0 con 0x7fb650039200 2024-09-19T04:39:12.672 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:08.517+0000 7fb6617fa640 1 -- 172.21.15.2:0/3697241961 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb65406c5b0 con 0x7fb664106480 2024-09-19T04:39:12.672 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:08.517+0000 7fb65bfff640 1 -- 172.21.15.2:0/3697241961 >> [v2:172.21.15.2:6800/1825825090,v1:172.21.15.2:6801/1825825090] conn(0x7fb650039200 msgr2=0x7fb65003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/1825825090 2024-09-19T04:39:12.672 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:08.517+0000 7fb65bfff640 1 --2- 172.21.15.2:0/3697241961 >> [v2:172.21.15.2:6800/1825825090,v1:172.21.15.2:6801/1825825090] conn(0x7fb650039200 0x7fb65003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T04:39:12.672 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:08.718+0000 7fb65bfff640 1 -- 172.21.15.2:0/3697241961 >> [v2:172.21.15.2:6800/1825825090,v1:172.21.15.2:6801/1825825090] conn(0x7fb650039200 msgr2=0x7fb65003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/1825825090 2024-09-19T04:39:12.672 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:08.718+0000 7fb65bfff640 1 --2- 172.21.15.2:0/3697241961 >> [v2:172.21.15.2:6800/1825825090,v1:172.21.15.2:6801/1825825090] conn(0x7fb650039200 0x7fb65003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T04:39:12.672 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:09.119+0000 7fb65bfff640 1 -- 172.21.15.2:0/3697241961 >> [v2:172.21.15.2:6800/1825825090,v1:172.21.15.2:6801/1825825090] conn(0x7fb650039200 msgr2=0x7fb65003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/1825825090 2024-09-19T04:39:12.672 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:09.119+0000 7fb65bfff640 1 --2- 172.21.15.2:0/3697241961 >> [v2:172.21.15.2:6800/1825825090,v1:172.21.15.2:6801/1825825090] conn(0x7fb650039200 0x7fb65003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T04:39:12.672 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:09.920+0000 7fb65bfff640 1 -- 172.21.15.2:0/3697241961 >> [v2:172.21.15.2:6800/1825825090,v1:172.21.15.2:6801/1825825090] conn(0x7fb650039200 msgr2=0x7fb65003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/1825825090 2024-09-19T04:39:12.673 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:09.920+0000 7fb65bfff640 1 --2- 172.21.15.2:0/3697241961 >> [v2:172.21.15.2:6800/1825825090,v1:172.21.15.2:6801/1825825090] conn(0x7fb650039200 0x7fb65003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T04:39:12.673 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:11.087+0000 7fb6617fa640 1 -- 172.21.15.2:0/3697241961 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mgrmap(e 6) ==== 46228+0+0 (secure 0 0 0) 0x7fb65406b070 con 0x7fb664106480 2024-09-19T04:39:12.673 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:11.087+0000 7fb6617fa640 1 -- 172.21.15.2:0/3697241961 >> [v2:172.21.15.2:6800/1825825090,v1:172.21.15.2:6801/1825825090] conn(0x7fb650039200 msgr2=0x7fb65003b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T04:39:12.673 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:11.087+0000 7fb6617fa640 1 --2- 172.21.15.2:0/3697241961 >> [v2:172.21.15.2:6800/1825825090,v1:172.21.15.2:6801/1825825090] conn(0x7fb650039200 0x7fb65003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:12.673 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:12.088+0000 7fb6617fa640 1 -- 172.21.15.2:0/3697241961 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7fb65403a870 con 0x7fb664106480 2024-09-19T04:39:12.673 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:12.089+0000 7fb6617fa640 1 --2- 172.21.15.2:0/3697241961 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7fb65003cb30 0x7fb65003ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:12.673 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:12.089+0000 7fb6617fa640 1 -- 172.21.15.2:0/3697241961 --> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fb654033e50 con 0x7fb65003cb30 2024-09-19T04:39:12.673 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:12.089+0000 7fb65bfff640 1 --2- 172.21.15.2:0/3697241961 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7fb65003cb30 0x7fb65003ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:12.673 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:12.090+0000 7fb65bfff640 1 --2- 172.21.15.2:0/3697241961 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7fb65003cb30 0x7fb65003ef20 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fb64c003980 tx=0x7fb64c0092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:12.673 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:12.091+0000 7fb6617fa640 1 -- 172.21.15.2:0/3697241961 <== mgr.14118 v2:172.21.15.2:6800/3782987318 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fb654033e50 con 0x7fb65003cb30 2024-09-19T04:39:12.673 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:12.098+0000 7fb669e2d640 1 -- 172.21.15.2:0/3697241961 --> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fb66410abb0 con 0x7fb65003cb30 2024-09-19T04:39:12.674 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:12.098+0000 7fb6617fa640 1 -- 172.21.15.2:0/3697241961 <== mgr.14118 v2:172.21.15.2:6800/3782987318 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7fb66410abb0 con 0x7fb65003cb30 2024-09-19T04:39:12.674 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:12.098+0000 7fb669e2d640 1 -- 172.21.15.2:0/3697241961 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7fb65003cb30 msgr2=0x7fb65003ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:12.674 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:12.098+0000 7fb669e2d640 1 --2- 172.21.15.2:0/3697241961 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7fb65003cb30 0x7fb65003ef20 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fb64c003980 tx=0x7fb64c0092b0 comp rx=0 tx=0).stop 2024-09-19T04:39:12.674 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:12.098+0000 7fb669e2d640 1 -- 172.21.15.2:0/3697241961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb664106480 msgr2=0x7fb6641916b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:12.674 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:12.098+0000 7fb669e2d640 1 --2- 172.21.15.2:0/3697241961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb664106480 0x7fb6641916b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb6540097f0 tx=0x7fb654030d00 comp rx=0 tx=0).stop 2024-09-19T04:39:12.674 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:12.098+0000 7fb669e2d640 1 -- 172.21.15.2:0/3697241961 shutdown_connections 2024-09-19T04:39:12.674 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:12.098+0000 7fb669e2d640 1 --2- 172.21.15.2:0/3697241961 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7fb65003cb30 0x7fb65003ef20 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:12.675 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:12.098+0000 7fb669e2d640 1 --2- 172.21.15.2:0/3697241961 >> [v2:172.21.15.2:6800/1825825090,v1:172.21.15.2:6801/1825825090] conn(0x7fb650039200 0x7fb65003b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:12.675 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:12.098+0000 7fb669e2d640 1 --2- 172.21.15.2:0/3697241961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb664106480 0x7fb6641916b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:12.675 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:12.098+0000 7fb669e2d640 1 -- 172.21.15.2:0/3697241961 >> 172.21.15.2:0/3697241961 conn(0x7fb664101bf0 msgr2=0x7fb664102b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:12.675 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:12.099+0000 7fb669e2d640 1 -- 172.21.15.2:0/3697241961 shutdown_connections 2024-09-19T04:39:12.675 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:12.099+0000 7fb669e2d640 1 -- 172.21.15.2:0/3697241961 wait complete. 2024-09-19T04:39:12.675 INFO:teuthology.orchestra.run.smithi002.stdout:mgr epoch 5 is available 2024-09-19T04:39:12.675 INFO:teuthology.orchestra.run.smithi002.stdout:Setting orchestrator backend to cephadm... 2024-09-19T04:39:13.185 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:13 smithi002 ceph-mon[30975]: Found migration_current of "None". Setting to last migration. 2024-09-19T04:39:13.185 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:13 smithi002 ceph-mon[30975]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T04:39:13.185 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:13 smithi002 ceph-mon[30975]: mgrmap e7: x(active, since 1.00526s) 2024-09-19T04:39:13.186 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:13 smithi002 ceph-mon[30975]: from='mgr.14118 172.21.15.2:0/1882287761' entity='mgr.x' 2024-09-19T04:39:13.186 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:13 smithi002 ceph-mon[30975]: from='mgr.14118 172.21.15.2:0/1882287761' entity='mgr.x' 2024-09-19T04:39:13.940 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.183+0000 7ff9b08e8640 1 Processor -- start 2024-09-19T04:39:13.940 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.183+0000 7ff9b08e8640 1 -- start start 2024-09-19T04:39:13.940 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.184+0000 7ff9b08e8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9ac1075b0 0x7ff9ac1079b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:13.940 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.184+0000 7ff9b08e8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ac107f80 con 0x7ff9ac1075b0 2024-09-19T04:39:13.940 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.184+0000 7ff9aa59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9ac1075b0 0x7ff9ac1079b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:13.940 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.184+0000 7ff9aa59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9ac1075b0 0x7ff9ac1079b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33266/0 (socket says 172.21.15.2:33266) 2024-09-19T04:39:13.940 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.184+0000 7ff9aa59c640 1 -- 172.21.15.2:0/3173673382 learned_addr learned my addr 172.21.15.2:0/3173673382 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:39:13.940 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.184+0000 7ff9aa59c640 1 -- 172.21.15.2:0/3173673382 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9ac1087b0 con 0x7ff9ac1075b0 2024-09-19T04:39:13.940 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.185+0000 7ff9aa59c640 1 --2- 172.21.15.2:0/3173673382 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9ac1075b0 0x7ff9ac1079b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff99c009820 tx=0x7ff99c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b3a58751a23cb2d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:13.940 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.185+0000 7ff9a959a640 1 -- 172.21.15.2:0/3173673382 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff99c037070 con 0x7ff9ac1075b0 2024-09-19T04:39:13.941 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.185+0000 7ff9a959a640 1 -- 172.21.15.2:0/3173673382 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7ff99c0328d0 con 0x7ff9ac1075b0 2024-09-19T04:39:13.941 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.185+0000 7ff9a959a640 1 -- 172.21.15.2:0/3173673382 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff99c0307d0 con 0x7ff9ac1075b0 2024-09-19T04:39:13.941 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.186+0000 7ff9b08e8640 1 -- 172.21.15.2:0/3173673382 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9ac1075b0 msgr2=0x7ff9ac1079b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:13.941 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.186+0000 7ff9b08e8640 1 --2- 172.21.15.2:0/3173673382 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9ac1075b0 0x7ff9ac1079b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff99c009820 tx=0x7ff99c02a270 comp rx=0 tx=0).stop 2024-09-19T04:39:13.941 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.186+0000 7ff9b08e8640 1 -- 172.21.15.2:0/3173673382 shutdown_connections 2024-09-19T04:39:13.941 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.186+0000 7ff9b08e8640 1 --2- 172.21.15.2:0/3173673382 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9ac1075b0 0x7ff9ac1079b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:13.941 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.186+0000 7ff9b08e8640 1 -- 172.21.15.2:0/3173673382 >> 172.21.15.2:0/3173673382 conn(0x7ff9ac102d60 msgr2=0x7ff9ac105180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:13.941 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.186+0000 7ff9b08e8640 1 -- 172.21.15.2:0/3173673382 shutdown_connections 2024-09-19T04:39:13.941 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.186+0000 7ff9b08e8640 1 -- 172.21.15.2:0/3173673382 wait complete. 2024-09-19T04:39:13.941 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.187+0000 7ff9b08e8640 1 Processor -- start 2024-09-19T04:39:13.941 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.187+0000 7ff9b08e8640 1 -- start start 2024-09-19T04:39:13.941 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.187+0000 7ff9b08e8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9ac1075b0 0x7ff9ac07db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:13.941 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.187+0000 7ff9b08e8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ac10bb60 con 0x7ff9ac1075b0 2024-09-19T04:39:13.942 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.187+0000 7ff9aa59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9ac1075b0 0x7ff9ac07db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:13.942 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.187+0000 7ff9aa59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9ac1075b0 0x7ff9ac07db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33276/0 (socket says 172.21.15.2:33276) 2024-09-19T04:39:13.942 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.187+0000 7ff9aa59c640 1 -- 172.21.15.2:0/2798317637 learned_addr learned my addr 172.21.15.2:0/2798317637 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:39:13.942 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.187+0000 7ff9aa59c640 1 -- 172.21.15.2:0/2798317637 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9ac07e0a0 con 0x7ff9ac1075b0 2024-09-19T04:39:13.942 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.188+0000 7ff9aa59c640 1 --2- 172.21.15.2:0/2798317637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9ac1075b0 0x7ff9ac07db60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff99c0097f0 tx=0x7ff99c030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:13.942 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.188+0000 7ff99b7fe640 1 -- 172.21.15.2:0/2798317637 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff99c037040 con 0x7ff9ac1075b0 2024-09-19T04:39:13.942 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.188+0000 7ff99b7fe640 1 -- 172.21.15.2:0/2798317637 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7ff99c032bb0 con 0x7ff9ac1075b0 2024-09-19T04:39:13.942 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.188+0000 7ff9b08e8640 1 -- 172.21.15.2:0/2798317637 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9ac07c290 con 0x7ff9ac1075b0 2024-09-19T04:39:13.942 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.188+0000 7ff99b7fe640 1 -- 172.21.15.2:0/2798317637 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff99c03a390 con 0x7ff9ac1075b0 2024-09-19T04:39:13.942 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.188+0000 7ff9b08e8640 1 -- 172.21.15.2:0/2798317637 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9ac07c7d0 con 0x7ff9ac1075b0 2024-09-19T04:39:13.942 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.189+0000 7ff99b7fe640 1 -- 172.21.15.2:0/2798317637 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7ff99c03a580 con 0x7ff9ac1075b0 2024-09-19T04:39:13.942 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.189+0000 7ff9b08e8640 1 -- 172.21.15.2:0/2798317637 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9ac107a30 con 0x7ff9ac1075b0 2024-09-19T04:39:13.942 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.189+0000 7ff99b7fe640 1 --2- 172.21.15.2:0/2798317637 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7ff9940390f0 0x7ff99403b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:13.943 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.189+0000 7ff99b7fe640 1 -- 172.21.15.2:0/2798317637 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff99c06c3a0 con 0x7ff9ac1075b0 2024-09-19T04:39:13.943 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.189+0000 7ff9a9d9b640 1 --2- 172.21.15.2:0/2798317637 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7ff9940390f0 0x7ff99403b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:13.943 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.190+0000 7ff9a9d9b640 1 --2- 172.21.15.2:0/2798317637 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7ff9940390f0 0x7ff99403b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff9a00098c0 tx=0x7ff9a0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:13.943 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.194+0000 7ff99b7fe640 1 -- 172.21.15.2:0/2798317637 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff99c032dd0 con 0x7ff9ac1075b0 2024-09-19T04:39:13.943 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.382+0000 7ff9b08e8640 1 -- 172.21.15.2:0/2798317637 --> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7ff9ac104000 con 0x7ff9940390f0 2024-09-19T04:39:13.943 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.387+0000 7ff99b7fe640 1 -- 172.21.15.2:0/2798317637 <== mgr.14118 v2:172.21.15.2:6800/3782987318 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff9ac104000 con 0x7ff9940390f0 2024-09-19T04:39:13.943 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.389+0000 7ff9b08e8640 1 -- 172.21.15.2:0/2798317637 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7ff9940390f0 msgr2=0x7ff99403b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:13.943 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.389+0000 7ff9b08e8640 1 --2- 172.21.15.2:0/2798317637 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7ff9940390f0 0x7ff99403b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff9a00098c0 tx=0x7ff9a0006db0 comp rx=0 tx=0).stop 2024-09-19T04:39:13.943 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.389+0000 7ff9b08e8640 1 -- 172.21.15.2:0/2798317637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9ac1075b0 msgr2=0x7ff9ac07db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:13.943 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.389+0000 7ff9b08e8640 1 --2- 172.21.15.2:0/2798317637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9ac1075b0 0x7ff9ac07db60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff99c0097f0 tx=0x7ff99c030d00 comp rx=0 tx=0).stop 2024-09-19T04:39:13.943 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.389+0000 7ff9b08e8640 1 -- 172.21.15.2:0/2798317637 shutdown_connections 2024-09-19T04:39:13.943 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.389+0000 7ff9b08e8640 1 --2- 172.21.15.2:0/2798317637 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7ff9940390f0 0x7ff99403b5b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:13.944 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.389+0000 7ff9b08e8640 1 --2- 172.21.15.2:0/2798317637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9ac1075b0 0x7ff9ac07db60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:13.944 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.389+0000 7ff9b08e8640 1 -- 172.21.15.2:0/2798317637 >> 172.21.15.2:0/2798317637 conn(0x7ff9ac102d60 msgr2=0x7ff9ac1038f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:13.944 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.389+0000 7ff9b08e8640 1 -- 172.21.15.2:0/2798317637 shutdown_connections 2024-09-19T04:39:13.944 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:13.389+0000 7ff9b08e8640 1 -- 172.21.15.2:0/2798317637 wait complete. 2024-09-19T04:39:14.243 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:14 smithi002 ceph-mon[30975]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T04:39:14.243 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:14 smithi002 ceph-mon[30975]: from='mgr.14118 172.21.15.2:0/1882287761' entity='mgr.x' 2024-09-19T04:39:14.243 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:14 smithi002 ceph-mon[30975]: from='mgr.14118 172.21.15.2:0/1882287761' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:39:14.243 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:14 smithi002 ceph-mon[30975]: mgrmap e8: x(active, since 2s) 2024-09-19T04:39:15.029 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-19T04:39:15.029 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.322+0000 7f9bd21d9640 1 Processor -- start 2024-09-19T04:39:15.029 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.322+0000 7f9bd21d9640 1 -- start start 2024-09-19T04:39:15.029 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.322+0000 7f9bd21d9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bcc108070 0x7f9bcc10a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:15.029 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.322+0000 7f9bd21d9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9bcc063490 con 0x7f9bcc108070 2024-09-19T04:39:15.029 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.322+0000 7f9bcb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bcc108070 0x7f9bcc10a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:15.030 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.322+0000 7f9bcb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bcc108070 0x7f9bcc10a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33284/0 (socket says 172.21.15.2:33284) 2024-09-19T04:39:15.030 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.322+0000 7f9bcb7fe640 1 -- 172.21.15.2:0/1753599201 learned_addr learned my addr 172.21.15.2:0/1753599201 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:39:15.030 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.322+0000 7f9bcb7fe640 1 -- 172.21.15.2:0/1753599201 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bcc10a9a0 con 0x7f9bcc108070 2024-09-19T04:39:15.030 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.323+0000 7f9bcb7fe640 1 --2- 172.21.15.2:0/1753599201 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bcc108070 0x7f9bcc10a460 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc009820 tx=0x7f9bbc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba342c8405df3658 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:15.030 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.323+0000 7f9bca7fc640 1 -- 172.21.15.2:0/1753599201 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bbc037070 con 0x7f9bcc108070 2024-09-19T04:39:15.030 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.323+0000 7f9bca7fc640 1 -- 172.21.15.2:0/1753599201 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f9bbc0328d0 con 0x7f9bcc108070 2024-09-19T04:39:15.031 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.323+0000 7f9bca7fc640 1 -- 172.21.15.2:0/1753599201 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bbc0307d0 con 0x7f9bcc108070 2024-09-19T04:39:15.031 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.324+0000 7f9bd21d9640 1 -- 172.21.15.2:0/1753599201 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bcc108070 msgr2=0x7f9bcc10a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:15.031 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.324+0000 7f9bd21d9640 1 --2- 172.21.15.2:0/1753599201 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bcc108070 0x7f9bcc10a460 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc009820 tx=0x7f9bbc02a270 comp rx=0 tx=0).stop 2024-09-19T04:39:15.031 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.324+0000 7f9bd21d9640 1 -- 172.21.15.2:0/1753599201 shutdown_connections 2024-09-19T04:39:15.031 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.324+0000 7f9bd21d9640 1 --2- 172.21.15.2:0/1753599201 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bcc108070 0x7f9bcc10a460 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:15.031 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.324+0000 7f9bd21d9640 1 -- 172.21.15.2:0/1753599201 >> 172.21.15.2:0/1753599201 conn(0x7f9bcc101bf0 msgr2=0x7f9bcc104050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:15.031 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.324+0000 7f9bd21d9640 1 -- 172.21.15.2:0/1753599201 shutdown_connections 2024-09-19T04:39:15.031 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.324+0000 7f9bd21d9640 1 -- 172.21.15.2:0/1753599201 wait complete. 2024-09-19T04:39:15.031 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.324+0000 7f9bd21d9640 1 Processor -- start 2024-09-19T04:39:15.031 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.325+0000 7f9bd21d9640 1 -- start start 2024-09-19T04:39:15.031 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.325+0000 7f9bd21d9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bcc108070 0x7f9bcc19b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:15.031 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.325+0000 7f9bd21d9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9bcc10b920 con 0x7f9bcc108070 2024-09-19T04:39:15.031 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.325+0000 7f9bcb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bcc108070 0x7f9bcc19b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:15.032 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.325+0000 7f9bcb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bcc108070 0x7f9bcc19b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33298/0 (socket says 172.21.15.2:33298) 2024-09-19T04:39:15.032 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.325+0000 7f9bcb7fe640 1 -- 172.21.15.2:0/1110860820 learned_addr learned my addr 172.21.15.2:0/1110860820 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:39:15.032 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.325+0000 7f9bcb7fe640 1 -- 172.21.15.2:0/1110860820 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bcc19ba80 con 0x7f9bcc108070 2024-09-19T04:39:15.032 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.325+0000 7f9bcb7fe640 1 --2- 172.21.15.2:0/1110860820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bcc108070 0x7f9bcc19b540 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc0097f0 tx=0x7f9bbc030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:15.032 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.326+0000 7f9bc8ff9640 1 -- 172.21.15.2:0/1110860820 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bbc037040 con 0x7f9bcc108070 2024-09-19T04:39:15.032 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.326+0000 7f9bc8ff9640 1 -- 172.21.15.2:0/1110860820 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f9bbc032bb0 con 0x7f9bcc108070 2024-09-19T04:39:15.032 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.326+0000 7f9bc8ff9640 1 -- 172.21.15.2:0/1110860820 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bbc03a390 con 0x7f9bcc108070 2024-09-19T04:39:15.032 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.326+0000 7f9bd21d9640 1 -- 172.21.15.2:0/1110860820 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bcc19bd10 con 0x7f9bcc108070 2024-09-19T04:39:15.032 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.326+0000 7f9bd21d9640 1 -- 172.21.15.2:0/1110860820 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bcc19ea00 con 0x7f9bcc108070 2024-09-19T04:39:15.032 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.327+0000 7f9bd21d9640 1 -- 172.21.15.2:0/1110860820 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bcc1084d0 con 0x7f9bcc108070 2024-09-19T04:39:15.032 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.327+0000 7f9bc8ff9640 1 -- 172.21.15.2:0/1110860820 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f9bbc03b3f0 con 0x7f9bcc108070 2024-09-19T04:39:15.032 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.327+0000 7f9bc8ff9640 1 --2- 172.21.15.2:0/1110860820 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7f9bb8039200 0x7f9bb803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:15.032 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.327+0000 7f9bc8ff9640 1 -- 172.21.15.2:0/1110860820 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f9bbc06c490 con 0x7f9bcc108070 2024-09-19T04:39:15.032 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.327+0000 7f9bcaffd640 1 --2- 172.21.15.2:0/1110860820 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7f9bb8039200 0x7f9bb803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:15.033 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.328+0000 7f9bcaffd640 1 --2- 172.21.15.2:0/1110860820 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7f9bb8039200 0x7f9bb803b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9bb40098c0 tx=0x7f9bb4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:15.033 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.332+0000 7f9bc8ff9640 1 -- 172.21.15.2:0/1110860820 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9bbc040210 con 0x7f9bcc108070 2024-09-19T04:39:15.033 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.511+0000 7f9bd21d9640 1 -- 172.21.15.2:0/1110860820 --> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f9bcc102f20 con 0x7f9bb8039200 2024-09-19T04:39:15.033 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.511+0000 7f9bc8ff9640 1 -- 172.21.15.2:0/1110860820 <== mgr.14118 v2:172.21.15.2:6800/3782987318 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f9bcc102f20 con 0x7f9bb8039200 2024-09-19T04:39:15.033 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.513+0000 7f9bd21d9640 1 -- 172.21.15.2:0/1110860820 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7f9bb8039200 msgr2=0x7f9bb803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:15.033 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.513+0000 7f9bd21d9640 1 --2- 172.21.15.2:0/1110860820 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7f9bb8039200 0x7f9bb803b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9bb40098c0 tx=0x7f9bb4006db0 comp rx=0 tx=0).stop 2024-09-19T04:39:15.033 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.513+0000 7f9bd21d9640 1 -- 172.21.15.2:0/1110860820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bcc108070 msgr2=0x7f9bcc19b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:15.033 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.513+0000 7f9bd21d9640 1 --2- 172.21.15.2:0/1110860820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bcc108070 0x7f9bcc19b540 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc0097f0 tx=0x7f9bbc030d00 comp rx=0 tx=0).stop 2024-09-19T04:39:15.033 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.513+0000 7f9bd21d9640 1 -- 172.21.15.2:0/1110860820 shutdown_connections 2024-09-19T04:39:15.033 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.513+0000 7f9bd21d9640 1 --2- 172.21.15.2:0/1110860820 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7f9bb8039200 0x7f9bb803b6c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:15.033 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.513+0000 7f9bd21d9640 1 --2- 172.21.15.2:0/1110860820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bcc108070 0x7f9bcc19b540 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:15.033 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.513+0000 7f9bd21d9640 1 -- 172.21.15.2:0/1110860820 >> 172.21.15.2:0/1110860820 conn(0x7f9bcc101bf0 msgr2=0x7f9bcc102810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:15.034 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.514+0000 7f9bd21d9640 1 -- 172.21.15.2:0/1110860820 shutdown_connections 2024-09-19T04:39:15.034 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:14.514+0000 7f9bd21d9640 1 -- 172.21.15.2:0/1110860820 wait complete. 2024-09-19T04:39:15.034 INFO:teuthology.orchestra.run.smithi002.stdout:Generating ssh key... 2024-09-19T04:39:15.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:15 smithi002 ceph-mon[30975]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:39:15.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:15 smithi002 ceph-mon[30975]: from='mgr.14118 172.21.15.2:0/1882287761' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:39:15.360 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:15 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:15.056+0000 7f761f0d8640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:04:39:15] ENGINE Error in HTTPServer.serve 2024-09-19T04:39:15.360 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:15 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: Traceback (most recent call last): 2024-09-19T04:39:15.360 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:15 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T04:39:15.360 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:15 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: self._connections.run(self.expiration_interval) 2024-09-19T04:39:15.361 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:15 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T04:39:15.361 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:15 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: self._run(expiration_interval) 2024-09-19T04:39:15.361 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:15 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T04:39:15.361 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:15 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T04:39:15.361 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:15 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T04:39:15.361 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:15 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T04:39:15.361 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:15 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T04:39:15.361 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:15 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: s = self.context.wrap_socket( 2024-09-19T04:39:15.361 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:15 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T04:39:15.361 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:15 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: return self.sslsocket_class._create( 2024-09-19T04:39:15.361 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:15 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T04:39:15.361 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:15 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: self.do_handshake() 2024-09-19T04:39:15.362 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:15 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T04:39:15.362 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:15 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: self._sslobj.do_handshake() 2024-09-19T04:39:15.362 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:15 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T04:39:15.362 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:15 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:16.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:16 smithi002 ceph-mon[30975]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:39:16.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:16 smithi002 ceph-mon[30975]: [19/Sep/2024:04:39:14] ENGINE Bus STARTING 2024-09-19T04:39:16.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:16 smithi002 ceph-mon[30975]: [19/Sep/2024:04:39:14] ENGINE Serving on http://172.21.15.2:8765 2024-09-19T04:39:16.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:16 smithi002 ceph-mon[30975]: [19/Sep/2024:04:39:15] ENGINE Serving on https://172.21.15.2:7150 2024-09-19T04:39:16.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:16 smithi002 ceph-mon[30975]: [19/Sep/2024:04:39:15] ENGINE Bus STARTED 2024-09-19T04:39:16.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:16 smithi002 ceph-mon[30975]: [19/Sep/2024:04:39:15] ENGINE Error in HTTPServer.serve 2024-09-19T04:39:16.361 INFO:journalctl@ceph.mon.a.smithi002.stdout: Traceback (most recent call last): 2024-09-19T04:39:16.361 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T04:39:16.361 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._connections.run(self.expiration_interval) 2024-09-19T04:39:16.361 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T04:39:16.361 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._run(expiration_interval) 2024-09-19T04:39:16.361 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T04:39:16.361 INFO:journalctl@ceph.mon.a.smithi002.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T04:39:16.361 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T04:39:16.361 INFO:journalctl@ceph.mon.a.smithi002.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T04:39:16.361 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T04:39:16.361 INFO:journalctl@ceph.mon.a.smithi002.stdout: s = self.context.wrap_socket( 2024-09-19T04:39:16.361 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T04:39:16.362 INFO:journalctl@ceph.mon.a.smithi002.stdout: return self.sslsocket_class._create( 2024-09-19T04:39:16.362 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T04:39:16.362 INFO:journalctl@ceph.mon.a.smithi002.stdout: self.do_handshake() 2024-09-19T04:39:16.362 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T04:39:16.362 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._sslobj.do_handshake() 2024-09-19T04:39:16.362 INFO:journalctl@ceph.mon.a.smithi002.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T04:39:16.362 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:16 smithi002 ceph-mon[30975]: from='mgr.14118 172.21.15.2:0/1882287761' entity='mgr.x' 2024-09-19T04:39:16.362 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:16 smithi002 ceph-mon[30975]: from='mgr.14118 172.21.15.2:0/1882287761' entity='mgr.x' 2024-09-19T04:39:16.362 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:16 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: Generating public/private rsa key pair. 2024-09-19T04:39:16.362 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:16 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: Your identification has been saved in /tmp/tmp5bpsi11v/key 2024-09-19T04:39:16.362 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:16 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: Your public key has been saved in /tmp/tmp5bpsi11v/key.pub 2024-09-19T04:39:16.362 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:16 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: The key fingerprint is: 2024-09-19T04:39:16.363 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:16 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: SHA256:/5CLAsltokWsHTHI8WmO5K16suIeX51jWesvOPu2YVg ceph-d46630c4-7640-11ef-bceb-c7b262605968 2024-09-19T04:39:16.363 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:16 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: The key's randomart image is: 2024-09-19T04:39:16.363 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:16 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: +---[RSA 3072]----+ 2024-09-19T04:39:16.363 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:16 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: | ..o | 2024-09-19T04:39:16.363 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:16 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: | o.o. | 2024-09-19T04:39:16.363 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:16 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: | ..+o | 2024-09-19T04:39:16.363 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:16 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: | o =+ | 2024-09-19T04:39:16.363 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:16 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: | o=o+ SE | 2024-09-19T04:39:16.363 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:16 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: | ..B + *... | 2024-09-19T04:39:16.363 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:16 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: | ..o = B.++ | 2024-09-19T04:39:16.363 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:16 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: |o.= . oo++.+ | 2024-09-19T04:39:16.363 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:16 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: |** . o*+=.. | 2024-09-19T04:39:16.363 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:16 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: +----[SHA256]-----+ 2024-09-19T04:39:16.620 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:15.376+0000 7fa92adc4640 1 Processor -- start 2024-09-19T04:39:16.620 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:15.376+0000 7fa92adc4640 1 -- start start 2024-09-19T04:39:16.620 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:15.377+0000 7fa92adc4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9241075c0 0x7fa9241079c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:16.620 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:15.377+0000 7fa92adc4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa924107f90 con 0x7fa9241075c0 2024-09-19T04:39:16.620 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:15.377+0000 7fa928b60640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9241075c0 0x7fa9241079c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:16.620 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:15.377+0000 7fa928b60640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9241075c0 0x7fa9241079c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33300/0 (socket says 172.21.15.2:33300) 2024-09-19T04:39:16.620 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:15.377+0000 7fa928b60640 1 -- 172.21.15.2:0/966048575 learned_addr learned my addr 172.21.15.2:0/966048575 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:39:16.620 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:15.377+0000 7fa928b60640 1 -- 172.21.15.2:0/966048575 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9241087c0 con 0x7fa9241075c0 2024-09-19T04:39:16.620 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:15.378+0000 7fa928b60640 1 --2- 172.21.15.2:0/966048575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9241075c0 0x7fa9241079c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa914009820 tx=0x7fa91402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a35a2321d80b00ee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:16.620 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:15.378+0000 7fa9237fe640 1 -- 172.21.15.2:0/966048575 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa914037070 con 0x7fa9241075c0 2024-09-19T04:39:16.620 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:15.378+0000 7fa9237fe640 1 -- 172.21.15.2:0/966048575 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fa9140328d0 con 0x7fa9241075c0 2024-09-19T04:39:16.621 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:15.378+0000 7fa9237fe640 1 -- 172.21.15.2:0/966048575 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9140307d0 con 0x7fa9241075c0 2024-09-19T04:39:16.621 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:15.378+0000 7fa92adc4640 1 -- 172.21.15.2:0/966048575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9241075c0 msgr2=0x7fa9241079c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:16.621 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:15.378+0000 7fa92adc4640 1 --2- 172.21.15.2:0/966048575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9241075c0 0x7fa9241079c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa914009820 tx=0x7fa91402a270 comp rx=0 tx=0).stop 2024-09-19T04:39:16.621 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:15.378+0000 7fa92adc4640 1 -- 172.21.15.2:0/966048575 shutdown_connections 2024-09-19T04:39:16.621 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:15.378+0000 7fa92adc4640 1 --2- 172.21.15.2:0/966048575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9241075c0 0x7fa9241079c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:16.621 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:15.378+0000 7fa92adc4640 1 -- 172.21.15.2:0/966048575 >> 172.21.15.2:0/966048575 conn(0x7fa924102d50 msgr2=0x7fa924105190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:16.621 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:15.379+0000 7fa92adc4640 1 -- 172.21.15.2:0/966048575 shutdown_connections 2024-09-19T04:39:16.621 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:15.379+0000 7fa92adc4640 1 -- 172.21.15.2:0/966048575 wait complete. 2024-09-19T04:39:16.621 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:15.379+0000 7fa92adc4640 1 Processor -- start 2024-09-19T04:39:16.621 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:15.379+0000 7fa92adc4640 1 -- start start 2024-09-19T04:39:16.621 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:15.379+0000 7fa92adc4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9241075c0 0x7fa92407db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:16.621 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:15.379+0000 7fa92adc4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa92410bb70 con 0x7fa9241075c0 2024-09-19T04:39:16.621 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:15.379+0000 7fa928b60640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9241075c0 0x7fa92407db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:16.622 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:15.380+0000 7fa928b60640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9241075c0 0x7fa92407db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33316/0 (socket says 172.21.15.2:33316) 2024-09-19T04:39:16.622 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:15.380+0000 7fa928b60640 1 -- 172.21.15.2:0/3225760440 learned_addr learned my addr 172.21.15.2:0/3225760440 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:39:16.622 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:15.380+0000 7fa928b60640 1 -- 172.21.15.2:0/3225760440 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa92407e0a0 con 0x7fa9241075c0 2024-09-19T04:39:16.622 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:15.380+0000 7fa928b60640 1 --2- 172.21.15.2:0/3225760440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9241075c0 0x7fa92407db60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa914030520 tx=0x7fa914032dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:16.622 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:15.380+0000 7fa921ffb640 1 -- 172.21.15.2:0/3225760440 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa914042070 con 0x7fa9241075c0 2024-09-19T04:39:16.622 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:15.380+0000 7fa921ffb640 1 -- 172.21.15.2:0/3225760440 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fa914030cc0 con 0x7fa9241075c0 2024-09-19T04:39:16.622 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:15.380+0000 7fa92adc4640 1 -- 172.21.15.2:0/3225760440 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa92407c290 con 0x7fa9241075c0 2024-09-19T04:39:16.622 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:15.380+0000 7fa921ffb640 1 -- 172.21.15.2:0/3225760440 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa914037040 con 0x7fa9241075c0 2024-09-19T04:39:16.622 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:15.380+0000 7fa92adc4640 1 -- 172.21.15.2:0/3225760440 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa92407c7d0 con 0x7fa9241075c0 2024-09-19T04:39:16.622 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:15.381+0000 7fa921ffb640 1 -- 172.21.15.2:0/3225760440 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fa914045070 con 0x7fa9241075c0 2024-09-19T04:39:16.622 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:15.381+0000 7fa921ffb640 1 --2- 172.21.15.2:0/3225760440 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7fa90c039200 0x7fa90c03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:16.622 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:15.381+0000 7fa92adc4640 1 -- 172.21.15.2:0/3225760440 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa924107a40 con 0x7fa9241075c0 2024-09-19T04:39:16.622 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:15.381+0000 7fa921ffb640 1 -- 172.21.15.2:0/3225760440 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa91406c2a0 con 0x7fa9241075c0 2024-09-19T04:39:16.623 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:15.381+0000 7fa923fff640 1 --2- 172.21.15.2:0/3225760440 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7fa90c039200 0x7fa90c03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:16.623 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:15.382+0000 7fa923fff640 1 --2- 172.21.15.2:0/3225760440 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7fa90c039200 0x7fa90c03b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa9180098c0 tx=0x7fa918006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:16.623 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:15.386+0000 7fa921ffb640 1 -- 172.21.15.2:0/3225760440 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa914045360 con 0x7fa9241075c0 2024-09-19T04:39:16.623 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:15.564+0000 7fa92adc4640 1 -- 172.21.15.2:0/3225760440 --> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7fa924103fe0 con 0x7fa90c039200 2024-09-19T04:39:16.623 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:16.068+0000 7fa921ffb640 1 -- 172.21.15.2:0/3225760440 <== mgr.14118 v2:172.21.15.2:6800/3782987318 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa924103fe0 con 0x7fa90c039200 2024-09-19T04:39:16.623 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:16.070+0000 7fa92adc4640 1 -- 172.21.15.2:0/3225760440 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7fa90c039200 msgr2=0x7fa90c03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:16.623 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:16.070+0000 7fa92adc4640 1 --2- 172.21.15.2:0/3225760440 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7fa90c039200 0x7fa90c03b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa9180098c0 tx=0x7fa918006db0 comp rx=0 tx=0).stop 2024-09-19T04:39:16.623 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:16.070+0000 7fa92adc4640 1 -- 172.21.15.2:0/3225760440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9241075c0 msgr2=0x7fa92407db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:16.623 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:16.070+0000 7fa92adc4640 1 --2- 172.21.15.2:0/3225760440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9241075c0 0x7fa92407db60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa914030520 tx=0x7fa914032dd0 comp rx=0 tx=0).stop 2024-09-19T04:39:16.623 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:16.070+0000 7fa92adc4640 1 -- 172.21.15.2:0/3225760440 shutdown_connections 2024-09-19T04:39:16.623 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:16.070+0000 7fa92adc4640 1 --2- 172.21.15.2:0/3225760440 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7fa90c039200 0x7fa90c03b6c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:16.623 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:16.070+0000 7fa92adc4640 1 --2- 172.21.15.2:0/3225760440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9241075c0 0x7fa92407db60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:16.623 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:16.070+0000 7fa92adc4640 1 -- 172.21.15.2:0/3225760440 >> 172.21.15.2:0/3225760440 conn(0x7fa924102d50 msgr2=0x7fa9241038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:16.624 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:16.070+0000 7fa92adc4640 1 -- 172.21.15.2:0/3225760440 shutdown_connections 2024-09-19T04:39:16.624 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:16.070+0000 7fa92adc4640 1 -- 172.21.15.2:0/3225760440 wait complete. 2024-09-19T04:39:17.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:17 smithi002 ceph-mon[30975]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:39:17.552 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:17 smithi002 ceph-mon[30975]: Generating ssh key... 2024-09-19T04:39:17.685 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBVTpzessfEhWnNlv/R69ZZfY6leSrxreLE+293+RK70utRPZNts0oRYPKtLihoK20MllGLFzeFGtWv/GXf4EfQ7lKASP0M1eo4q8nnYkgN5sd5MZJbizoBEOXn8e1XgmydAfw6KITVC03myKRXnbADXe4LsmUWiK6SJUFVDdWkgsYFTGYB7ZzP4QSRBx2F4bVckr+yrk4Gy+cJZ9+36NXCIG5MlvGODgTDVqiLYxQrVpczJDfkce8qUe1a6O+JTOvnMcbGqMHwFJ9cGrDKpVCDrYx/WqWJ6lYnQVQ6/3lyTAhNQqKf257VhXojp30XPwaOL42NH8OGXYaETDLKSFXsR9pWPzwS43VrYW52qAyza0aalyYnDElhdzk4HSfiEmeex5t1o8S7iMneREVNybOZEUXMzRERjLjMSyNpHxLIhWzFpxE6EVXYzokXfhrg5hh7AQaKG0sSkEWKEfWpf1uZZmcIA/R/5TwsH7qBkCMqnSs2vQm4C3n6m/9AbO+wGc= ceph-d46630c4-7640-11ef-bceb-c7b262605968 2024-09-19T04:39:17.685 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:16.998+0000 7f2d21438640 1 Processor -- start 2024-09-19T04:39:17.685 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:16.998+0000 7f2d21438640 1 -- start start 2024-09-19T04:39:17.685 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:16.998+0000 7f2d21438640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d1c1080a0 0x7f2d1c10a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:17.685 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:16.998+0000 7f2d21438640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1c063450 con 0x7f2d1c1080a0 2024-09-19T04:39:17.685 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:16.998+0000 7f2d1affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d1c1080a0 0x7f2d1c10a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:17.685 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:16.998+0000 7f2d1affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d1c1080a0 0x7f2d1c10a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33322/0 (socket says 172.21.15.2:33322) 2024-09-19T04:39:17.685 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:16.998+0000 7f2d1affd640 1 -- 172.21.15.2:0/97652673 learned_addr learned my addr 172.21.15.2:0/97652673 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:39:17.685 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:16.999+0000 7f2d1affd640 1 -- 172.21.15.2:0/97652673 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d1c10a9d0 con 0x7f2d1c1080a0 2024-09-19T04:39:17.685 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:16.999+0000 7f2d1affd640 1 --2- 172.21.15.2:0/97652673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d1c1080a0 0x7f2d1c10a490 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c009820 tx=0x7f2d0c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9d80228618eb8bd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:17.685 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:16.999+0000 7f2d1a7fc640 1 -- 172.21.15.2:0/97652673 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d0c037070 con 0x7f2d1c1080a0 2024-09-19T04:39:17.686 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:16.999+0000 7f2d1a7fc640 1 -- 172.21.15.2:0/97652673 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f2d0c0328d0 con 0x7f2d1c1080a0 2024-09-19T04:39:17.686 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:17.000+0000 7f2d1a7fc640 1 -- 172.21.15.2:0/97652673 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d0c0307d0 con 0x7f2d1c1080a0 2024-09-19T04:39:17.686 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:17.000+0000 7f2d21438640 1 -- 172.21.15.2:0/97652673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d1c1080a0 msgr2=0x7f2d1c10a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:17.686 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:17.000+0000 7f2d21438640 1 --2- 172.21.15.2:0/97652673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d1c1080a0 0x7f2d1c10a490 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c009820 tx=0x7f2d0c02a270 comp rx=0 tx=0).stop 2024-09-19T04:39:17.686 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:17.000+0000 7f2d21438640 1 -- 172.21.15.2:0/97652673 shutdown_connections 2024-09-19T04:39:17.686 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:17.000+0000 7f2d21438640 1 --2- 172.21.15.2:0/97652673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d1c1080a0 0x7f2d1c10a490 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:17.686 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:17.000+0000 7f2d21438640 1 -- 172.21.15.2:0/97652673 >> 172.21.15.2:0/97652673 conn(0x7f2d1c101c00 msgr2=0x7f2d1c104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:17.686 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:17.000+0000 7f2d21438640 1 -- 172.21.15.2:0/97652673 shutdown_connections 2024-09-19T04:39:17.686 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:17.000+0000 7f2d21438640 1 -- 172.21.15.2:0/97652673 wait complete. 2024-09-19T04:39:17.687 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:17.001+0000 7f2d21438640 1 Processor -- start 2024-09-19T04:39:17.687 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:17.001+0000 7f2d21438640 1 -- start start 2024-09-19T04:39:17.687 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:17.001+0000 7f2d21438640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d1c1080a0 0x7f2d1c19b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:17.687 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:17.001+0000 7f2d21438640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1c10b950 con 0x7f2d1c1080a0 2024-09-19T04:39:17.687 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:17.001+0000 7f2d1affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d1c1080a0 0x7f2d1c19b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:17.687 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:17.001+0000 7f2d1affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d1c1080a0 0x7f2d1c19b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33338/0 (socket says 172.21.15.2:33338) 2024-09-19T04:39:17.687 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:17.001+0000 7f2d1affd640 1 -- 172.21.15.2:0/617093793 learned_addr learned my addr 172.21.15.2:0/617093793 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:39:17.687 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:17.002+0000 7f2d1affd640 1 -- 172.21.15.2:0/617093793 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d1c19ba60 con 0x7f2d1c1080a0 2024-09-19T04:39:17.687 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:17.002+0000 7f2d1affd640 1 --2- 172.21.15.2:0/617093793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d1c1080a0 0x7f2d1c19b520 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c0097f0 tx=0x7f2d0c030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:17.687 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:17.002+0000 7f2d18ff9640 1 -- 172.21.15.2:0/617093793 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d0c037040 con 0x7f2d1c1080a0 2024-09-19T04:39:17.687 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:17.002+0000 7f2d18ff9640 1 -- 172.21.15.2:0/617093793 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f2d0c032bb0 con 0x7f2d1c1080a0 2024-09-19T04:39:17.687 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:17.002+0000 7f2d21438640 1 -- 172.21.15.2:0/617093793 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d1c19bcf0 con 0x7f2d1c1080a0 2024-09-19T04:39:17.687 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:17.002+0000 7f2d18ff9640 1 -- 172.21.15.2:0/617093793 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d0c03a390 con 0x7f2d1c1080a0 2024-09-19T04:39:17.688 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:17.002+0000 7f2d21438640 1 -- 172.21.15.2:0/617093793 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d1c19e9e0 con 0x7f2d1c1080a0 2024-09-19T04:39:17.688 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:17.003+0000 7f2d18ff9640 1 -- 172.21.15.2:0/617093793 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f2d0c03b3f0 con 0x7f2d1c1080a0 2024-09-19T04:39:17.688 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:17.003+0000 7f2d18ff9640 1 --2- 172.21.15.2:0/617093793 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7f2d08039200 0x7f2d0803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:17.688 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:17.003+0000 7f2d21438640 1 -- 172.21.15.2:0/617093793 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d1c108500 con 0x7f2d1c1080a0 2024-09-19T04:39:17.688 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:17.003+0000 7f2d18ff9640 1 -- 172.21.15.2:0/617093793 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f2d0c06c5c0 con 0x7f2d1c1080a0 2024-09-19T04:39:17.688 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:17.003+0000 7f2d127fc640 1 --2- 172.21.15.2:0/617093793 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7f2d08039200 0x7f2d0803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:17.688 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:17.004+0000 7f2d127fc640 1 --2- 172.21.15.2:0/617093793 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7f2d08039200 0x7f2d0803b6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2d040098c0 tx=0x7f2d04006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:17.688 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:17.008+0000 7f2d18ff9640 1 -- 172.21.15.2:0/617093793 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2d0c040210 con 0x7f2d1c1080a0 2024-09-19T04:39:17.688 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:17.187+0000 7f2d21438640 1 -- 172.21.15.2:0/617093793 --> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f2d1c102f10 con 0x7f2d08039200 2024-09-19T04:39:17.688 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:17.188+0000 7f2d18ff9640 1 -- 172.21.15.2:0/617093793 <== mgr.14118 v2:172.21.15.2:6800/3782987318 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f2d1c102f10 con 0x7f2d08039200 2024-09-19T04:39:17.688 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:17.190+0000 7f2d21438640 1 -- 172.21.15.2:0/617093793 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7f2d08039200 msgr2=0x7f2d0803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:17.688 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:17.190+0000 7f2d21438640 1 --2- 172.21.15.2:0/617093793 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7f2d08039200 0x7f2d0803b6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2d040098c0 tx=0x7f2d04006db0 comp rx=0 tx=0).stop 2024-09-19T04:39:17.689 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:17.190+0000 7f2d21438640 1 -- 172.21.15.2:0/617093793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d1c1080a0 msgr2=0x7f2d1c19b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:17.689 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:17.190+0000 7f2d21438640 1 --2- 172.21.15.2:0/617093793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d1c1080a0 0x7f2d1c19b520 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c0097f0 tx=0x7f2d0c030d00 comp rx=0 tx=0).stop 2024-09-19T04:39:17.689 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:17.190+0000 7f2d21438640 1 -- 172.21.15.2:0/617093793 shutdown_connections 2024-09-19T04:39:17.689 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:17.190+0000 7f2d21438640 1 --2- 172.21.15.2:0/617093793 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7f2d08039200 0x7f2d0803b6c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:17.689 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:17.190+0000 7f2d21438640 1 --2- 172.21.15.2:0/617093793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d1c1080a0 0x7f2d1c19b520 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:17.689 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:17.190+0000 7f2d21438640 1 -- 172.21.15.2:0/617093793 >> 172.21.15.2:0/617093793 conn(0x7f2d1c101c00 msgr2=0x7f2d1c102800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:17.689 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:17.190+0000 7f2d21438640 1 -- 172.21.15.2:0/617093793 shutdown_connections 2024-09-19T04:39:17.689 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:17.190+0000 7f2d21438640 1 -- 172.21.15.2:0/617093793 wait complete. 2024-09-19T04:39:17.689 INFO:teuthology.orchestra.run.smithi002.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-19T04:39:17.689 INFO:teuthology.orchestra.run.smithi002.stdout:Adding key to root@localhost authorized_keys... 2024-09-19T04:39:17.691 INFO:teuthology.orchestra.run.smithi002.stdout:Adding host smithi002... 2024-09-19T04:39:18.359 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:18 smithi002 ceph-mon[30975]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:39:19.268 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:19 smithi002 ceph-mon[30975]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi002", "addr": "172.21.15.2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:39:20.484 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:20 smithi002 ceph-mon[30975]: Deploying cephadm binary to smithi002 2024-09-19T04:39:22.663 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Added host 'smithi002' with addr '172.21.15.2' 2024-09-19T04:39:22.663 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:18.044+0000 7f9298abb640 1 Processor -- start 2024-09-19T04:39:22.663 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:18.044+0000 7f9298abb640 1 -- start start 2024-09-19T04:39:22.664 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:18.044+0000 7f9298abb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92941075c0 0x7f92941079c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:22.664 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:18.044+0000 7f9298abb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9294107f90 con 0x7f92941075c0 2024-09-19T04:39:22.664 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:18.045+0000 7f929259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92941075c0 0x7f92941079c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:22.664 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:18.045+0000 7f929259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92941075c0 0x7f92941079c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33346/0 (socket says 172.21.15.2:33346) 2024-09-19T04:39:22.664 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:18.045+0000 7f929259c640 1 -- 172.21.15.2:0/314929508 learned_addr learned my addr 172.21.15.2:0/314929508 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:39:22.664 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:18.045+0000 7f929259c640 1 -- 172.21.15.2:0/314929508 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92941087c0 con 0x7f92941075c0 2024-09-19T04:39:22.664 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:18.046+0000 7f929259c640 1 --2- 172.21.15.2:0/314929508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92941075c0 0x7f92941079c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9284009820 tx=0x7f928402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e51c19bf9b502d00 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:22.670 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:18.046+0000 7f9291d9b640 1 -- 172.21.15.2:0/314929508 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9284037070 con 0x7f92941075c0 2024-09-19T04:39:22.670 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:18.046+0000 7f9291d9b640 1 -- 172.21.15.2:0/314929508 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f92840328d0 con 0x7f92941075c0 2024-09-19T04:39:22.670 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:18.046+0000 7f9291d9b640 1 -- 172.21.15.2:0/314929508 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92840307d0 con 0x7f92941075c0 2024-09-19T04:39:22.670 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:18.046+0000 7f9298abb640 1 -- 172.21.15.2:0/314929508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92941075c0 msgr2=0x7f92941079c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:22.670 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:18.046+0000 7f9298abb640 1 --2- 172.21.15.2:0/314929508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92941075c0 0x7f92941079c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9284009820 tx=0x7f928402a270 comp rx=0 tx=0).stop 2024-09-19T04:39:22.670 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:18.047+0000 7f9298abb640 1 -- 172.21.15.2:0/314929508 shutdown_connections 2024-09-19T04:39:22.671 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:18.047+0000 7f9298abb640 1 --2- 172.21.15.2:0/314929508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92941075c0 0x7f92941079c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:22.671 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:18.047+0000 7f9298abb640 1 -- 172.21.15.2:0/314929508 >> 172.21.15.2:0/314929508 conn(0x7f9294102d50 msgr2=0x7f9294105190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:22.671 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:18.047+0000 7f9298abb640 1 -- 172.21.15.2:0/314929508 shutdown_connections 2024-09-19T04:39:22.671 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:18.047+0000 7f9298abb640 1 -- 172.21.15.2:0/314929508 wait complete. 2024-09-19T04:39:22.671 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:18.047+0000 7f9298abb640 1 Processor -- start 2024-09-19T04:39:22.671 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:18.048+0000 7f9298abb640 1 -- start start 2024-09-19T04:39:22.671 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:18.048+0000 7f9298abb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92941075c0 0x7f929419d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:22.671 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:18.048+0000 7f9298abb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f929410bb70 con 0x7f92941075c0 2024-09-19T04:39:22.671 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:18.048+0000 7f929259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92941075c0 0x7f929419d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:22.671 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:18.048+0000 7f929259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92941075c0 0x7f929419d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33350/0 (socket says 172.21.15.2:33350) 2024-09-19T04:39:22.672 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:18.048+0000 7f929259c640 1 -- 172.21.15.2:0/3399545400 learned_addr learned my addr 172.21.15.2:0/3399545400 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:39:22.672 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:18.048+0000 7f929259c640 1 -- 172.21.15.2:0/3399545400 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f929419dd20 con 0x7f92941075c0 2024-09-19T04:39:22.672 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:18.048+0000 7f929259c640 1 --2- 172.21.15.2:0/3399545400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92941075c0 0x7f929419d7e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9284030520 tx=0x7f9284032dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:22.672 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:18.048+0000 7f928bfff640 1 -- 172.21.15.2:0/3399545400 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9284042070 con 0x7f92941075c0 2024-09-19T04:39:22.672 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:18.048+0000 7f9298abb640 1 -- 172.21.15.2:0/3399545400 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f929419dfb0 con 0x7f92941075c0 2024-09-19T04:39:22.672 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:18.048+0000 7f928bfff640 1 -- 172.21.15.2:0/3399545400 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f9284030cc0 con 0x7f92941075c0 2024-09-19T04:39:22.672 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:18.048+0000 7f928bfff640 1 -- 172.21.15.2:0/3399545400 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9284037040 con 0x7f92941075c0 2024-09-19T04:39:22.672 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:18.049+0000 7f9298abb640 1 -- 172.21.15.2:0/3399545400 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92941a0ca0 con 0x7f92941075c0 2024-09-19T04:39:22.672 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:18.049+0000 7f928bfff640 1 -- 172.21.15.2:0/3399545400 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f9284045070 con 0x7f92941075c0 2024-09-19T04:39:22.672 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:18.050+0000 7f928bfff640 1 --2- 172.21.15.2:0/3399545400 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7f92800391b0 0x7f928003b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:22.673 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:18.049+0000 7f9298abb640 1 -- 172.21.15.2:0/3399545400 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f929410bcf0 con 0x7f92941075c0 2024-09-19T04:39:22.673 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:18.050+0000 7f928bfff640 1 -- 172.21.15.2:0/3399545400 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f928406c290 con 0x7f92941075c0 2024-09-19T04:39:22.673 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:18.050+0000 7f9289d9b640 1 --2- 172.21.15.2:0/3399545400 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7f92800391b0 0x7f928003b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:22.673 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:18.050+0000 7f9289d9b640 1 --2- 172.21.15.2:0/3399545400 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7f92800391b0 0x7f928003b670 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f927c0098c0 tx=0x7f927c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:22.673 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:18.054+0000 7f928bfff640 1 -- 172.21.15.2:0/3399545400 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9284046e00 con 0x7f92941075c0 2024-09-19T04:39:22.673 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:18.235+0000 7f9298abb640 1 -- 172.21.15.2:0/3399545400 --> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi002", "addr": "172.21.15.2", "target": ["mon-mgr", ""]}) -- 0x7f9294103f80 con 0x7f92800391b0 2024-09-19T04:39:22.673 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:22.121+0000 7f928bfff640 1 -- 172.21.15.2:0/3399545400 <== mgr.14118 v2:172.21.15.2:6800/3782987318 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7f9294103f80 con 0x7f92800391b0 2024-09-19T04:39:22.673 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:22.123+0000 7f9298abb640 1 -- 172.21.15.2:0/3399545400 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7f92800391b0 msgr2=0x7f928003b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:22.673 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:22.123+0000 7f9298abb640 1 --2- 172.21.15.2:0/3399545400 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7f92800391b0 0x7f928003b670 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f927c0098c0 tx=0x7f927c006db0 comp rx=0 tx=0).stop 2024-09-19T04:39:22.673 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:22.123+0000 7f9298abb640 1 -- 172.21.15.2:0/3399545400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92941075c0 msgr2=0x7f929419d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:22.674 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:22.123+0000 7f9298abb640 1 --2- 172.21.15.2:0/3399545400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92941075c0 0x7f929419d7e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9284030520 tx=0x7f9284032dd0 comp rx=0 tx=0).stop 2024-09-19T04:39:22.674 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:22.123+0000 7f9298abb640 1 -- 172.21.15.2:0/3399545400 shutdown_connections 2024-09-19T04:39:22.674 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:22.123+0000 7f9298abb640 1 --2- 172.21.15.2:0/3399545400 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7f92800391b0 0x7f928003b670 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:22.674 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:22.123+0000 7f9298abb640 1 --2- 172.21.15.2:0/3399545400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92941075c0 0x7f929419d7e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:22.674 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:22.123+0000 7f9298abb640 1 -- 172.21.15.2:0/3399545400 >> 172.21.15.2:0/3399545400 conn(0x7f9294102d50 msgr2=0x7f9294103870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:22.674 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:22.124+0000 7f9298abb640 1 -- 172.21.15.2:0/3399545400 shutdown_connections 2024-09-19T04:39:22.674 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:22.124+0000 7f9298abb640 1 -- 172.21.15.2:0/3399545400 wait complete. 2024-09-19T04:39:22.674 INFO:teuthology.orchestra.run.smithi002.stdout:Deploying unmanaged mon service... 2024-09-19T04:39:23.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:23 smithi002 ceph-mon[30975]: from='mgr.14118 172.21.15.2:0/1882287761' entity='mgr.x' 2024-09-19T04:39:23.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:23 smithi002 ceph-mon[30975]: Added host smithi002 2024-09-19T04:39:23.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:23 smithi002 ceph-mon[30975]: from='mgr.14118 172.21.15.2:0/1882287761' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:39:23.950 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-19T04:39:23.950 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.044+0000 7ff8208c0640 1 Processor -- start 2024-09-19T04:39:23.950 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.044+0000 7ff8208c0640 1 -- start start 2024-09-19T04:39:23.950 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.044+0000 7ff8208c0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff81c108060 0x7ff81c10a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:23.950 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.044+0000 7ff8208c0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff81c063490 con 0x7ff81c108060 2024-09-19T04:39:23.950 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.045+0000 7ff81a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff81c108060 0x7ff81c10a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:23.951 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.045+0000 7ff81a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff81c108060 0x7ff81c10a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42082/0 (socket says 172.21.15.2:42082) 2024-09-19T04:39:23.951 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.045+0000 7ff81a59c640 1 -- 172.21.15.2:0/3110350980 learned_addr learned my addr 172.21.15.2:0/3110350980 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:39:23.951 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.045+0000 7ff81a59c640 1 -- 172.21.15.2:0/3110350980 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff81c10a990 con 0x7ff81c108060 2024-09-19T04:39:23.951 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.046+0000 7ff81a59c640 1 --2- 172.21.15.2:0/3110350980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff81c108060 0x7ff81c10a450 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff80c009820 tx=0x7ff80c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf876c4ec9952133 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:23.951 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.046+0000 7ff81959a640 1 -- 172.21.15.2:0/3110350980 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff80c037070 con 0x7ff81c108060 2024-09-19T04:39:23.951 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.046+0000 7ff81959a640 1 -- 172.21.15.2:0/3110350980 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7ff80c0328d0 con 0x7ff81c108060 2024-09-19T04:39:23.951 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.046+0000 7ff81959a640 1 -- 172.21.15.2:0/3110350980 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff80c0307d0 con 0x7ff81c108060 2024-09-19T04:39:23.951 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.047+0000 7ff8208c0640 1 -- 172.21.15.2:0/3110350980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff81c108060 msgr2=0x7ff81c10a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:23.951 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.047+0000 7ff8208c0640 1 --2- 172.21.15.2:0/3110350980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff81c108060 0x7ff81c10a450 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff80c009820 tx=0x7ff80c02a270 comp rx=0 tx=0).stop 2024-09-19T04:39:23.951 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.047+0000 7ff8208c0640 1 -- 172.21.15.2:0/3110350980 shutdown_connections 2024-09-19T04:39:23.951 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.047+0000 7ff8208c0640 1 --2- 172.21.15.2:0/3110350980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff81c108060 0x7ff81c10a450 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:23.951 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.047+0000 7ff8208c0640 1 -- 172.21.15.2:0/3110350980 >> 172.21.15.2:0/3110350980 conn(0x7ff81c101c00 msgr2=0x7ff81c104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:23.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.047+0000 7ff8208c0640 1 -- 172.21.15.2:0/3110350980 shutdown_connections 2024-09-19T04:39:23.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.047+0000 7ff8208c0640 1 -- 172.21.15.2:0/3110350980 wait complete. 2024-09-19T04:39:23.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.048+0000 7ff8208c0640 1 Processor -- start 2024-09-19T04:39:23.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.048+0000 7ff8208c0640 1 -- start start 2024-09-19T04:39:23.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.048+0000 7ff8208c0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff81c108060 0x7ff81c19b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:23.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.048+0000 7ff8208c0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff81c10b910 con 0x7ff81c108060 2024-09-19T04:39:23.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.048+0000 7ff81a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff81c108060 0x7ff81c19b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:23.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.048+0000 7ff81a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff81c108060 0x7ff81c19b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42086/0 (socket says 172.21.15.2:42086) 2024-09-19T04:39:23.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.048+0000 7ff81a59c640 1 -- 172.21.15.2:0/2347844088 learned_addr learned my addr 172.21.15.2:0/2347844088 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:39:23.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.049+0000 7ff81a59c640 1 -- 172.21.15.2:0/2347844088 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff81c19bac0 con 0x7ff81c108060 2024-09-19T04:39:23.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.049+0000 7ff81a59c640 1 --2- 172.21.15.2:0/2347844088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff81c108060 0x7ff81c19b580 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff80c032e10 tx=0x7ff80c032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:23.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.049+0000 7ff80b7fe640 1 -- 172.21.15.2:0/2347844088 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff80c042070 con 0x7ff81c108060 2024-09-19T04:39:23.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.049+0000 7ff80b7fe640 1 -- 172.21.15.2:0/2347844088 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7ff80c030c80 con 0x7ff81c108060 2024-09-19T04:39:23.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.049+0000 7ff8208c0640 1 -- 172.21.15.2:0/2347844088 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff81c19bd50 con 0x7ff81c108060 2024-09-19T04:39:23.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.049+0000 7ff80b7fe640 1 -- 172.21.15.2:0/2347844088 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff80c037040 con 0x7ff81c108060 2024-09-19T04:39:23.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.049+0000 7ff8208c0640 1 -- 172.21.15.2:0/2347844088 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff81c19ea40 con 0x7ff81c108060 2024-09-19T04:39:23.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.050+0000 7ff80b7fe640 1 -- 172.21.15.2:0/2347844088 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7ff80c045070 con 0x7ff81c108060 2024-09-19T04:39:23.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.050+0000 7ff8208c0640 1 -- 172.21.15.2:0/2347844088 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff81c1084c0 con 0x7ff81c108060 2024-09-19T04:39:23.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.050+0000 7ff80b7fe640 1 --2- 172.21.15.2:0/2347844088 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7ff804039200 0x7ff80403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:23.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.051+0000 7ff80b7fe640 1 -- 172.21.15.2:0/2347844088 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff80c06c180 con 0x7ff81c108060 2024-09-19T04:39:23.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.051+0000 7ff819d9b640 1 --2- 172.21.15.2:0/2347844088 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7ff804039200 0x7ff80403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:23.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.051+0000 7ff819d9b640 1 --2- 172.21.15.2:0/2347844088 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7ff804039200 0x7ff80403b6c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff8100098c0 tx=0x7ff810006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:23.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.055+0000 7ff80b7fe640 1 -- 172.21.15.2:0/2347844088 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff80c045360 con 0x7ff81c108060 2024-09-19T04:39:23.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.249+0000 7ff8208c0640 1 -- 172.21.15.2:0/2347844088 --> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7ff81c102e90 con 0x7ff804039200 2024-09-19T04:39:23.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.253+0000 7ff80b7fe640 1 -- 172.21.15.2:0/2347844088 <== mgr.14118 v2:172.21.15.2:6800/3782987318 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7ff81c102e90 con 0x7ff804039200 2024-09-19T04:39:23.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.255+0000 7ff8208c0640 1 -- 172.21.15.2:0/2347844088 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7ff804039200 msgr2=0x7ff80403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:23.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.255+0000 7ff8208c0640 1 --2- 172.21.15.2:0/2347844088 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7ff804039200 0x7ff80403b6c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff8100098c0 tx=0x7ff810006db0 comp rx=0 tx=0).stop 2024-09-19T04:39:23.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.255+0000 7ff8208c0640 1 -- 172.21.15.2:0/2347844088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff81c108060 msgr2=0x7ff81c19b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:23.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.255+0000 7ff8208c0640 1 --2- 172.21.15.2:0/2347844088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff81c108060 0x7ff81c19b580 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff80c032e10 tx=0x7ff80c032e40 comp rx=0 tx=0).stop 2024-09-19T04:39:23.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.255+0000 7ff8208c0640 1 -- 172.21.15.2:0/2347844088 shutdown_connections 2024-09-19T04:39:23.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.255+0000 7ff8208c0640 1 --2- 172.21.15.2:0/2347844088 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7ff804039200 0x7ff80403b6c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:23.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.255+0000 7ff8208c0640 1 --2- 172.21.15.2:0/2347844088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff81c108060 0x7ff81c19b580 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:23.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.255+0000 7ff8208c0640 1 -- 172.21.15.2:0/2347844088 >> 172.21.15.2:0/2347844088 conn(0x7ff81c101c00 msgr2=0x7ff81c102780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:23.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.256+0000 7ff8208c0640 1 -- 172.21.15.2:0/2347844088 shutdown_connections 2024-09-19T04:39:23.955 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:23.256+0000 7ff8208c0640 1 -- 172.21.15.2:0/2347844088 wait complete. 2024-09-19T04:39:23.955 INFO:teuthology.orchestra.run.smithi002.stdout:Deploying unmanaged mgr service... 2024-09-19T04:39:24.512 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:24 smithi002 ceph-mon[30975]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:39:24.512 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:24 smithi002 ceph-mon[30975]: Saving service mon spec with placement count:5 2024-09-19T04:39:24.512 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:24 smithi002 ceph-mon[30975]: from='mgr.14118 172.21.15.2:0/1882287761' entity='mgr.x' 2024-09-19T04:39:25.552 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-19T04:39:25.552 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.309+0000 7fc5a0dbe640 1 Processor -- start 2024-09-19T04:39:25.552 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.309+0000 7fc5a0dbe640 1 -- start start 2024-09-19T04:39:25.552 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.309+0000 7fc5a0dbe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc59c106470 0x7fc59c106870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:25.552 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.310+0000 7fc5a0dbe640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc59c106e40 con 0x7fc59c106470 2024-09-19T04:39:25.552 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.310+0000 7fc59a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc59c106470 0x7fc59c106870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:25.552 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.310+0000 7fc59a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc59c106470 0x7fc59c106870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42094/0 (socket says 172.21.15.2:42094) 2024-09-19T04:39:25.552 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.310+0000 7fc59a59c640 1 -- 172.21.15.2:0/212108685 learned_addr learned my addr 172.21.15.2:0/212108685 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:39:25.553 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.310+0000 7fc59a59c640 1 -- 172.21.15.2:0/212108685 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc59c107670 con 0x7fc59c106470 2024-09-19T04:39:25.553 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.311+0000 7fc59a59c640 1 --2- 172.21.15.2:0/212108685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc59c106470 0x7fc59c106870 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc58c009e80 tx=0x7fc58c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ba58b75b438d52 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:25.553 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.311+0000 7fc59959a640 1 -- 172.21.15.2:0/212108685 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc58c036070 con 0x7fc59c106470 2024-09-19T04:39:25.553 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.311+0000 7fc59959a640 1 -- 172.21.15.2:0/212108685 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fc58c031890 con 0x7fc59c106470 2024-09-19T04:39:25.553 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.311+0000 7fc59959a640 1 -- 172.21.15.2:0/212108685 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc58c007980 con 0x7fc59c106470 2024-09-19T04:39:25.553 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.311+0000 7fc5a0dbe640 1 -- 172.21.15.2:0/212108685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc59c106470 msgr2=0x7fc59c106870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:25.553 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.311+0000 7fc5a0dbe640 1 --2- 172.21.15.2:0/212108685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc59c106470 0x7fc59c106870 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc58c009e80 tx=0x7fc58c02a7a0 comp rx=0 tx=0).stop 2024-09-19T04:39:25.553 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.312+0000 7fc5a0dbe640 1 -- 172.21.15.2:0/212108685 shutdown_connections 2024-09-19T04:39:25.553 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.312+0000 7fc5a0dbe640 1 --2- 172.21.15.2:0/212108685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc59c106470 0x7fc59c106870 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:25.553 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.312+0000 7fc5a0dbe640 1 -- 172.21.15.2:0/212108685 >> 172.21.15.2:0/212108685 conn(0x7fc59c101c00 msgr2=0x7fc59c104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:25.553 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.312+0000 7fc5a0dbe640 1 -- 172.21.15.2:0/212108685 shutdown_connections 2024-09-19T04:39:25.553 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.312+0000 7fc5a0dbe640 1 -- 172.21.15.2:0/212108685 wait complete. 2024-09-19T04:39:25.554 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.312+0000 7fc5a0dbe640 1 Processor -- start 2024-09-19T04:39:25.554 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.312+0000 7fc5a0dbe640 1 -- start start 2024-09-19T04:39:25.554 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.312+0000 7fc5a0dbe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc59c106470 0x7fc59c19b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:25.554 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.312+0000 7fc5a0dbe640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc59c10aa20 con 0x7fc59c106470 2024-09-19T04:39:25.554 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.313+0000 7fc59a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc59c106470 0x7fc59c19b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:25.554 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.313+0000 7fc59a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc59c106470 0x7fc59c19b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42108/0 (socket says 172.21.15.2:42108) 2024-09-19T04:39:25.554 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.313+0000 7fc59a59c640 1 -- 172.21.15.2:0/1580887012 learned_addr learned my addr 172.21.15.2:0/1580887012 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:39:25.554 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.313+0000 7fc59a59c640 1 -- 172.21.15.2:0/1580887012 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc59c19bb20 con 0x7fc59c106470 2024-09-19T04:39:25.554 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.313+0000 7fc59a59c640 1 --2- 172.21.15.2:0/1580887012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc59c106470 0x7fc59c19b5e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc58c031c70 tx=0x7fc58c031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:25.554 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.313+0000 7fc58b7fe640 1 -- 172.21.15.2:0/1580887012 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc58c041020 con 0x7fc59c106470 2024-09-19T04:39:25.554 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.313+0000 7fc5a0dbe640 1 -- 172.21.15.2:0/1580887012 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc59c19bdb0 con 0x7fc59c106470 2024-09-19T04:39:25.554 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.313+0000 7fc58b7fe640 1 -- 172.21.15.2:0/1580887012 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fc58c03c900 con 0x7fc59c106470 2024-09-19T04:39:25.554 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.313+0000 7fc58b7fe640 1 -- 172.21.15.2:0/1580887012 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc58c036040 con 0x7fc59c106470 2024-09-19T04:39:25.555 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.313+0000 7fc5a0dbe640 1 -- 172.21.15.2:0/1580887012 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc59c19eaa0 con 0x7fc59c106470 2024-09-19T04:39:25.555 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.314+0000 7fc58b7fe640 1 -- 172.21.15.2:0/1580887012 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fc58c044020 con 0x7fc59c106470 2024-09-19T04:39:25.555 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.314+0000 7fc58b7fe640 1 --2- 172.21.15.2:0/1580887012 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7fc5840391b0 0x7fc58403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:25.555 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.314+0000 7fc58b7fe640 1 -- 172.21.15.2:0/1580887012 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc58c06d850 con 0x7fc59c106470 2024-09-19T04:39:25.555 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.314+0000 7fc5a0dbe640 1 -- 172.21.15.2:0/1580887012 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc59c1068f0 con 0x7fc59c106470 2024-09-19T04:39:25.555 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.314+0000 7fc599d9b640 1 --2- 172.21.15.2:0/1580887012 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7fc5840391b0 0x7fc58403b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:25.555 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.315+0000 7fc599d9b640 1 --2- 172.21.15.2:0/1580887012 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7fc5840391b0 0x7fc58403b670 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc5900098c0 tx=0x7fc590006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:25.555 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.319+0000 7fc58b7fe640 1 -- 172.21.15.2:0/1580887012 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc58c04b020 con 0x7fc59c106470 2024-09-19T04:39:25.555 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.511+0000 7fc5a0dbe640 1 -- 172.21.15.2:0/1580887012 --> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fc59c02da80 con 0x7fc5840391b0 2024-09-19T04:39:25.555 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.515+0000 7fc58b7fe640 1 -- 172.21.15.2:0/1580887012 <== mgr.14118 v2:172.21.15.2:6800/3782987318 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fc59c02da80 con 0x7fc5840391b0 2024-09-19T04:39:25.555 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.517+0000 7fc5a0dbe640 1 -- 172.21.15.2:0/1580887012 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7fc5840391b0 msgr2=0x7fc58403b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:25.555 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.517+0000 7fc5a0dbe640 1 --2- 172.21.15.2:0/1580887012 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7fc5840391b0 0x7fc58403b670 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc5900098c0 tx=0x7fc590006db0 comp rx=0 tx=0).stop 2024-09-19T04:39:25.555 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.517+0000 7fc5a0dbe640 1 -- 172.21.15.2:0/1580887012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc59c106470 msgr2=0x7fc59c19b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:25.556 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.517+0000 7fc5a0dbe640 1 --2- 172.21.15.2:0/1580887012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc59c106470 0x7fc59c19b5e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc58c031c70 tx=0x7fc58c031ca0 comp rx=0 tx=0).stop 2024-09-19T04:39:25.556 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.517+0000 7fc5a0dbe640 1 -- 172.21.15.2:0/1580887012 shutdown_connections 2024-09-19T04:39:25.556 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.517+0000 7fc5a0dbe640 1 --2- 172.21.15.2:0/1580887012 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7fc5840391b0 0x7fc58403b670 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:25.556 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.517+0000 7fc5a0dbe640 1 --2- 172.21.15.2:0/1580887012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc59c106470 0x7fc59c19b5e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:25.556 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.517+0000 7fc5a0dbe640 1 -- 172.21.15.2:0/1580887012 >> 172.21.15.2:0/1580887012 conn(0x7fc59c101c00 msgr2=0x7fc59c102b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:25.556 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.517+0000 7fc5a0dbe640 1 -- 172.21.15.2:0/1580887012 shutdown_connections 2024-09-19T04:39:25.556 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:24.517+0000 7fc5a0dbe640 1 -- 172.21.15.2:0/1580887012 wait complete. 2024-09-19T04:39:25.655 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:25 smithi002 ceph-mon[30975]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:39:25.655 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:25 smithi002 ceph-mon[30975]: Saving service mgr spec with placement count:2 2024-09-19T04:39:25.655 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:25 smithi002 ceph-mon[30975]: from='mgr.14118 172.21.15.2:0/1882287761' entity='mgr.x' 2024-09-19T04:39:27.045 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:25.931+0000 7fef5817a640 1 Processor -- start 2024-09-19T04:39:27.046 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:25.931+0000 7fef5817a640 1 -- start start 2024-09-19T04:39:27.046 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:25.932+0000 7fef5817a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef5007de70 0x7fef5007c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:27.046 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:25.932+0000 7fef5817a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fef5007c8a0 con 0x7fef5007de70 2024-09-19T04:39:27.046 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:25.932+0000 7fef55f16640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef5007de70 0x7fef5007c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:27.046 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:25.932+0000 7fef55f16640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef5007de70 0x7fef5007c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42124/0 (socket says 172.21.15.2:42124) 2024-09-19T04:39:27.046 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:25.932+0000 7fef55f16640 1 -- 172.21.15.2:0/1328779864 learned_addr learned my addr 172.21.15.2:0/1328779864 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:39:27.046 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:25.932+0000 7fef55f16640 1 -- 172.21.15.2:0/1328779864 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef5007ca20 con 0x7fef5007de70 2024-09-19T04:39:27.046 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:25.933+0000 7fef55f16640 1 --2- 172.21.15.2:0/1328779864 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef5007de70 0x7fef5007c2d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fef4c009820 tx=0x7fef4c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d4dbe5d60e497e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:27.046 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:25.933+0000 7fef54f14640 1 -- 172.21.15.2:0/1328779864 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef4c037070 con 0x7fef5007de70 2024-09-19T04:39:27.046 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:25.933+0000 7fef54f14640 1 -- 172.21.15.2:0/1328779864 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fef4c0328d0 con 0x7fef5007de70 2024-09-19T04:39:27.046 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:25.933+0000 7fef54f14640 1 -- 172.21.15.2:0/1328779864 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef4c0307d0 con 0x7fef5007de70 2024-09-19T04:39:27.046 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:25.933+0000 7fef5817a640 1 -- 172.21.15.2:0/1328779864 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef5007de70 msgr2=0x7fef5007c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:27.047 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:25.933+0000 7fef5817a640 1 --2- 172.21.15.2:0/1328779864 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef5007de70 0x7fef5007c2d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fef4c009820 tx=0x7fef4c02a270 comp rx=0 tx=0).stop 2024-09-19T04:39:27.047 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:25.933+0000 7fef5817a640 1 -- 172.21.15.2:0/1328779864 shutdown_connections 2024-09-19T04:39:27.047 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:25.933+0000 7fef5817a640 1 --2- 172.21.15.2:0/1328779864 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef5007de70 0x7fef5007c2d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:27.047 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:25.934+0000 7fef5817a640 1 -- 172.21.15.2:0/1328779864 >> 172.21.15.2:0/1328779864 conn(0x7fef50102d50 msgr2=0x7fef50105190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:27.047 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:25.934+0000 7fef5817a640 1 -- 172.21.15.2:0/1328779864 shutdown_connections 2024-09-19T04:39:27.047 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:25.934+0000 7fef5817a640 1 -- 172.21.15.2:0/1328779864 wait complete. 2024-09-19T04:39:27.047 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:25.934+0000 7fef5817a640 1 Processor -- start 2024-09-19T04:39:27.047 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:25.934+0000 7fef5817a640 1 -- start start 2024-09-19T04:39:27.047 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:25.934+0000 7fef5817a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef5007de70 0x7fef5019d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:27.047 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:25.934+0000 7fef5817a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fef5010db90 con 0x7fef5007de70 2024-09-19T04:39:27.047 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:25.935+0000 7fef55f16640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef5007de70 0x7fef5019d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:27.047 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:25.935+0000 7fef55f16640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef5007de70 0x7fef5019d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42140/0 (socket says 172.21.15.2:42140) 2024-09-19T04:39:27.047 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:25.935+0000 7fef55f16640 1 -- 172.21.15.2:0/1568437240 learned_addr learned my addr 172.21.15.2:0/1568437240 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:39:27.048 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:25.935+0000 7fef55f16640 1 -- 172.21.15.2:0/1568437240 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef5019dd00 con 0x7fef5007de70 2024-09-19T04:39:27.048 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:25.935+0000 7fef55f16640 1 --2- 172.21.15.2:0/1568437240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef5007de70 0x7fef5019d7c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fef4c030520 tx=0x7fef4c032dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:27.048 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:25.935+0000 7fef46ffd640 1 -- 172.21.15.2:0/1568437240 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef4c042070 con 0x7fef5007de70 2024-09-19T04:39:27.048 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:25.935+0000 7fef46ffd640 1 -- 172.21.15.2:0/1568437240 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fef4c030cc0 con 0x7fef5007de70 2024-09-19T04:39:27.048 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:25.935+0000 7fef46ffd640 1 -- 172.21.15.2:0/1568437240 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef4c037040 con 0x7fef5007de70 2024-09-19T04:39:27.048 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:25.935+0000 7fef5817a640 1 -- 172.21.15.2:0/1568437240 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef5019df90 con 0x7fef5007de70 2024-09-19T04:39:27.048 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:25.935+0000 7fef5817a640 1 -- 172.21.15.2:0/1568437240 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef501a0c80 con 0x7fef5007de70 2024-09-19T04:39:27.048 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:25.936+0000 7fef46ffd640 1 -- 172.21.15.2:0/1568437240 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fef4c045070 con 0x7fef5007de70 2024-09-19T04:39:27.048 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:25.936+0000 7fef46ffd640 1 --2- 172.21.15.2:0/1568437240 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7fef3c0391b0 0x7fef3c03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:27.048 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:25.936+0000 7fef46ffd640 1 -- 172.21.15.2:0/1568437240 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fef4c06c2c0 con 0x7fef5007de70 2024-09-19T04:39:27.048 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:25.936+0000 7fef5817a640 1 -- 172.21.15.2:0/1568437240 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef5007c350 con 0x7fef5007de70 2024-09-19T04:39:27.049 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:25.936+0000 7fef55715640 1 --2- 172.21.15.2:0/1568437240 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7fef3c0391b0 0x7fef3c03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:27.049 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:25.937+0000 7fef55715640 1 --2- 172.21.15.2:0/1568437240 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7fef3c0391b0 0x7fef3c03b670 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fef400098c0 tx=0x7fef40006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:27.049 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:25.941+0000 7fef46ffd640 1 -- 172.21.15.2:0/1568437240 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fef4c04b170 con 0x7fef5007de70 2024-09-19T04:39:27.049 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:26.118+0000 7fef5817a640 1 -- 172.21.15.2:0/1568437240 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7fef501a12f0 con 0x7fef5007de70 2024-09-19T04:39:27.049 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:26.120+0000 7fef46ffd640 1 -- 172.21.15.2:0/1568437240 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v6)=0 v6) ==== 142+0+0 (secure 0 0 0) 0x7fef4c03d7b0 con 0x7fef5007de70 2024-09-19T04:39:27.049 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:26.122+0000 7fef5817a640 1 -- 172.21.15.2:0/1568437240 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7fef3c0391b0 msgr2=0x7fef3c03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:27.049 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:26.122+0000 7fef5817a640 1 --2- 172.21.15.2:0/1568437240 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7fef3c0391b0 0x7fef3c03b670 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fef400098c0 tx=0x7fef40006db0 comp rx=0 tx=0).stop 2024-09-19T04:39:27.049 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:26.122+0000 7fef5817a640 1 -- 172.21.15.2:0/1568437240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef5007de70 msgr2=0x7fef5019d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:27.049 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:26.122+0000 7fef5817a640 1 --2- 172.21.15.2:0/1568437240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef5007de70 0x7fef5019d7c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fef4c030520 tx=0x7fef4c032dd0 comp rx=0 tx=0).stop 2024-09-19T04:39:27.049 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:26.122+0000 7fef5817a640 1 -- 172.21.15.2:0/1568437240 shutdown_connections 2024-09-19T04:39:27.049 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:26.122+0000 7fef5817a640 1 --2- 172.21.15.2:0/1568437240 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7fef3c0391b0 0x7fef3c03b670 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:27.049 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:26.122+0000 7fef5817a640 1 --2- 172.21.15.2:0/1568437240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef5007de70 0x7fef5019d7c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:27.050 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:26.122+0000 7fef5817a640 1 -- 172.21.15.2:0/1568437240 >> 172.21.15.2:0/1568437240 conn(0x7fef50102d50 msgr2=0x7fef50103910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:27.050 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:26.122+0000 7fef5817a640 1 -- 172.21.15.2:0/1568437240 shutdown_connections 2024-09-19T04:39:27.050 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:26.122+0000 7fef5817a640 1 -- 172.21.15.2:0/1568437240 wait complete. 2024-09-19T04:39:27.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:27 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/1568437240' entity='client.admin' 2024-09-19T04:39:27.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:27 smithi002 ceph-mon[30975]: from='mgr.14118 172.21.15.2:0/1882287761' entity='mgr.x' 2024-09-19T04:39:27.383 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:27 smithi002 ceph-mon[30975]: from='mgr.14118 172.21.15.2:0/1882287761' entity='mgr.x' 2024-09-19T04:39:28.831 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:28 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/2222807551' entity='client.admin' 2024-09-19T04:39:28.832 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:28 smithi002 ceph-mon[30975]: from='mgr.14118 172.21.15.2:0/1882287761' entity='mgr.x' 2024-09-19T04:39:28.839 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.464+0000 7fe2197a4640 1 Processor -- start 2024-09-19T04:39:28.839 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.464+0000 7fe2197a4640 1 -- start start 2024-09-19T04:39:28.839 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.464+0000 7fe2197a4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe214107fe0 0x7fe21410a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:28.839 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.464+0000 7fe2197a4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe214063510 con 0x7fe214107fe0 2024-09-19T04:39:28.839 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.464+0000 7fe212ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe214107fe0 0x7fe21410a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:28.839 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.464+0000 7fe212ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe214107fe0 0x7fe21410a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42142/0 (socket says 172.21.15.2:42142) 2024-09-19T04:39:28.840 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.465+0000 7fe212ffd640 1 -- 172.21.15.2:0/2365321494 learned_addr learned my addr 172.21.15.2:0/2365321494 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:39:28.840 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.465+0000 7fe212ffd640 1 -- 172.21.15.2:0/2365321494 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe21410a910 con 0x7fe214107fe0 2024-09-19T04:39:28.840 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.465+0000 7fe212ffd640 1 --2- 172.21.15.2:0/2365321494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe214107fe0 0x7fe21410a3d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe20c009820 tx=0x7fe20c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=427d289a43f5d550 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:28.840 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.466+0000 7fe211ffb640 1 -- 172.21.15.2:0/2365321494 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe20c037070 con 0x7fe214107fe0 2024-09-19T04:39:28.840 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.466+0000 7fe211ffb640 1 -- 172.21.15.2:0/2365321494 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe20c0328f0 con 0x7fe214107fe0 2024-09-19T04:39:28.840 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.466+0000 7fe211ffb640 1 -- 172.21.15.2:0/2365321494 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe20c030740 con 0x7fe214107fe0 2024-09-19T04:39:28.840 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.466+0000 7fe2197a4640 1 -- 172.21.15.2:0/2365321494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe214107fe0 msgr2=0x7fe21410a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:28.840 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.466+0000 7fe2197a4640 1 --2- 172.21.15.2:0/2365321494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe214107fe0 0x7fe21410a3d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe20c009820 tx=0x7fe20c02a270 comp rx=0 tx=0).stop 2024-09-19T04:39:28.840 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.466+0000 7fe2197a4640 1 -- 172.21.15.2:0/2365321494 shutdown_connections 2024-09-19T04:39:28.840 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.466+0000 7fe2197a4640 1 --2- 172.21.15.2:0/2365321494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe214107fe0 0x7fe21410a3d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:28.840 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.466+0000 7fe2197a4640 1 -- 172.21.15.2:0/2365321494 >> 172.21.15.2:0/2365321494 conn(0x7fe214101c00 msgr2=0x7fe214104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:28.840 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.466+0000 7fe2197a4640 1 -- 172.21.15.2:0/2365321494 shutdown_connections 2024-09-19T04:39:28.841 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.466+0000 7fe2197a4640 1 -- 172.21.15.2:0/2365321494 wait complete. 2024-09-19T04:39:28.841 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.467+0000 7fe2197a4640 1 Processor -- start 2024-09-19T04:39:28.841 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.467+0000 7fe2197a4640 1 -- start start 2024-09-19T04:39:28.841 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.467+0000 7fe2197a4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe214107fe0 0x7fe21419b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:28.841 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.467+0000 7fe2197a4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe21410b990 con 0x7fe214107fe0 2024-09-19T04:39:28.841 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.467+0000 7fe212ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe214107fe0 0x7fe21419b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:28.841 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.467+0000 7fe212ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe214107fe0 0x7fe21419b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42152/0 (socket says 172.21.15.2:42152) 2024-09-19T04:39:28.841 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.467+0000 7fe212ffd640 1 -- 172.21.15.2:0/2222807551 learned_addr learned my addr 172.21.15.2:0/2222807551 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:39:28.841 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.468+0000 7fe212ffd640 1 -- 172.21.15.2:0/2222807551 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe21419bab0 con 0x7fe214107fe0 2024-09-19T04:39:28.841 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.468+0000 7fe212ffd640 1 --2- 172.21.15.2:0/2222807551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe214107fe0 0x7fe21419b570 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe20c0097f0 tx=0x7fe20c030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:28.841 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.468+0000 7fe20bfff640 1 -- 172.21.15.2:0/2222807551 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe20c042070 con 0x7fe214107fe0 2024-09-19T04:39:28.841 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.468+0000 7fe20bfff640 1 -- 172.21.15.2:0/2222807551 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe20c030d80 con 0x7fe214107fe0 2024-09-19T04:39:28.842 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.468+0000 7fe2197a4640 1 -- 172.21.15.2:0/2222807551 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe21419bd40 con 0x7fe214107fe0 2024-09-19T04:39:28.842 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.468+0000 7fe20bfff640 1 -- 172.21.15.2:0/2222807551 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe20c037040 con 0x7fe214107fe0 2024-09-19T04:39:28.842 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.468+0000 7fe2197a4640 1 -- 172.21.15.2:0/2222807551 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe21419ea30 con 0x7fe214107fe0 2024-09-19T04:39:28.842 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.469+0000 7fe20bfff640 1 -- 172.21.15.2:0/2222807551 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fe20c045070 con 0x7fe214107fe0 2024-09-19T04:39:28.842 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.469+0000 7fe2197a4640 1 -- 172.21.15.2:0/2222807551 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe214108440 con 0x7fe214107fe0 2024-09-19T04:39:28.842 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.469+0000 7fe20bfff640 1 --2- 172.21.15.2:0/2222807551 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7fe200039200 0x7fe20003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:28.842 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.469+0000 7fe20bfff640 1 -- 172.21.15.2:0/2222807551 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe20c06c2d0 con 0x7fe214107fe0 2024-09-19T04:39:28.842 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.469+0000 7fe2127fc640 1 --2- 172.21.15.2:0/2222807551 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7fe200039200 0x7fe20003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:28.842 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.470+0000 7fe2127fc640 1 --2- 172.21.15.2:0/2222807551 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7fe200039200 0x7fe20003b6c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc0098c0 tx=0x7fe1fc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:28.842 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.474+0000 7fe20bfff640 1 -- 172.21.15.2:0/2222807551 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe20c02ed90 con 0x7fe214107fe0 2024-09-19T04:39:28.842 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.665+0000 7fe2197a4640 1 -- 172.21.15.2:0/2222807551 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7fe21419ec00 con 0x7fe214107fe0 2024-09-19T04:39:28.842 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.667+0000 7fe20bfff640 1 -- 172.21.15.2:0/2222807551 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7fe20c0313a0 con 0x7fe214107fe0 2024-09-19T04:39:28.843 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.669+0000 7fe2197a4640 1 -- 172.21.15.2:0/2222807551 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7fe200039200 msgr2=0x7fe20003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:28.843 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.669+0000 7fe2197a4640 1 --2- 172.21.15.2:0/2222807551 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7fe200039200 0x7fe20003b6c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc0098c0 tx=0x7fe1fc006db0 comp rx=0 tx=0).stop 2024-09-19T04:39:28.843 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.669+0000 7fe2197a4640 1 -- 172.21.15.2:0/2222807551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe214107fe0 msgr2=0x7fe21419b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:28.843 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.669+0000 7fe2197a4640 1 --2- 172.21.15.2:0/2222807551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe214107fe0 0x7fe21419b570 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe20c0097f0 tx=0x7fe20c030c70 comp rx=0 tx=0).stop 2024-09-19T04:39:28.843 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.669+0000 7fe2197a4640 1 -- 172.21.15.2:0/2222807551 shutdown_connections 2024-09-19T04:39:28.843 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.669+0000 7fe2197a4640 1 --2- 172.21.15.2:0/2222807551 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7fe200039200 0x7fe20003b6c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:28.843 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.669+0000 7fe2197a4640 1 --2- 172.21.15.2:0/2222807551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe214107fe0 0x7fe21419b570 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:28.843 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.669+0000 7fe2197a4640 1 -- 172.21.15.2:0/2222807551 >> 172.21.15.2:0/2222807551 conn(0x7fe214101c00 msgr2=0x7fe214102790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:28.843 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.669+0000 7fe2197a4640 1 -- 172.21.15.2:0/2222807551 shutdown_connections 2024-09-19T04:39:28.843 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:27.670+0000 7fe2197a4640 1 -- 172.21.15.2:0/2222807551 wait complete. 2024-09-19T04:39:28.843 INFO:teuthology.orchestra.run.smithi002.stdout:Enabling the dashboard module... 2024-09-19T04:39:30.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:30 smithi002 ceph-mon[30975]: from='mgr.14118 172.21.15.2:0/1882287761' entity='mgr.x' 2024-09-19T04:39:30.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:30 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/116717334' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-19T04:39:30.610 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:30 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: ignoring --setuser ceph since I am not root 2024-09-19T04:39:30.610 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:30 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: ignoring --setgroup ceph since I am not root 2024-09-19T04:39:30.610 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:30 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:30.504+0000 7fb0229d6040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T04:39:30.610 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:30 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:30.563+0000 7fb0229d6040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T04:39:30.943 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:30 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:30.719+0000 7fb0229d6040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T04:39:30.944 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:30 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:30.788+0000 7fb0229d6040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T04:39:30.944 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:30 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:30.942+0000 7fb0229d6040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T04:39:31.311 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:31 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:31.089+0000 7fb0229d6040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T04:39:31.318 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:29.290+0000 7fd7065cf640 1 Processor -- start 2024-09-19T04:39:31.319 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:29.290+0000 7fd7065cf640 1 -- start start 2024-09-19T04:39:31.319 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:29.290+0000 7fd7065cf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7001075c0 0x7fd7001079c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:31.319 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:29.290+0000 7fd7065cf640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd700107f90 con 0x7fd7001075c0 2024-09-19T04:39:31.319 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:29.291+0000 7fd6fffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7001075c0 0x7fd7001079c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:31.319 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:29.291+0000 7fd6fffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7001075c0 0x7fd7001079c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42154/0 (socket says 172.21.15.2:42154) 2024-09-19T04:39:31.319 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:29.291+0000 7fd6fffff640 1 -- 172.21.15.2:0/1061698931 learned_addr learned my addr 172.21.15.2:0/1061698931 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:39:31.319 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:29.291+0000 7fd6fffff640 1 -- 172.21.15.2:0/1061698931 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7001087c0 con 0x7fd7001075c0 2024-09-19T04:39:31.319 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:29.292+0000 7fd6fffff640 1 --2- 172.21.15.2:0/1061698931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7001075c0 0x7fd7001079c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0009820 tx=0x7fd6f002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c06bcb2a48228e01 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:31.319 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:29.292+0000 7fd6feffd640 1 -- 172.21.15.2:0/1061698931 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6f0037070 con 0x7fd7001075c0 2024-09-19T04:39:31.319 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:29.292+0000 7fd6feffd640 1 -- 172.21.15.2:0/1061698931 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd6f00328f0 con 0x7fd7001075c0 2024-09-19T04:39:31.319 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:29.292+0000 7fd6feffd640 1 -- 172.21.15.2:0/1061698931 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6f0030740 con 0x7fd7001075c0 2024-09-19T04:39:31.319 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:29.293+0000 7fd7065cf640 1 -- 172.21.15.2:0/1061698931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7001075c0 msgr2=0x7fd7001079c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:31.320 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:29.293+0000 7fd7065cf640 1 --2- 172.21.15.2:0/1061698931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7001075c0 0x7fd7001079c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0009820 tx=0x7fd6f002a270 comp rx=0 tx=0).stop 2024-09-19T04:39:31.320 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:29.293+0000 7fd7065cf640 1 -- 172.21.15.2:0/1061698931 shutdown_connections 2024-09-19T04:39:31.320 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:29.293+0000 7fd7065cf640 1 --2- 172.21.15.2:0/1061698931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7001075c0 0x7fd7001079c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:31.320 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:29.293+0000 7fd7065cf640 1 -- 172.21.15.2:0/1061698931 >> 172.21.15.2:0/1061698931 conn(0x7fd700102d50 msgr2=0x7fd700105190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:31.320 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:29.293+0000 7fd7065cf640 1 -- 172.21.15.2:0/1061698931 shutdown_connections 2024-09-19T04:39:31.320 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:29.293+0000 7fd7065cf640 1 -- 172.21.15.2:0/1061698931 wait complete. 2024-09-19T04:39:31.320 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:29.293+0000 7fd7065cf640 1 Processor -- start 2024-09-19T04:39:31.320 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:29.293+0000 7fd7065cf640 1 -- start start 2024-09-19T04:39:31.320 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:29.294+0000 7fd7065cf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7001075c0 0x7fd70007db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:31.320 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:29.294+0000 7fd7065cf640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd70010bb70 con 0x7fd7001075c0 2024-09-19T04:39:31.320 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:29.294+0000 7fd6fffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7001075c0 0x7fd70007db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:31.320 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:29.294+0000 7fd6fffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7001075c0 0x7fd70007db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42170/0 (socket says 172.21.15.2:42170) 2024-09-19T04:39:31.321 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:29.294+0000 7fd6fffff640 1 -- 172.21.15.2:0/116717334 learned_addr learned my addr 172.21.15.2:0/116717334 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:39:31.321 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:29.294+0000 7fd6fffff640 1 -- 172.21.15.2:0/116717334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd70007e0a0 con 0x7fd7001075c0 2024-09-19T04:39:31.321 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:29.294+0000 7fd6fffff640 1 --2- 172.21.15.2:0/116717334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7001075c0 0x7fd70007db60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0009940 tx=0x7fd6f00327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:31.321 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:29.294+0000 7fd6fd7fa640 1 -- 172.21.15.2:0/116717334 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6f0042070 con 0x7fd7001075c0 2024-09-19T04:39:31.321 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:29.294+0000 7fd6fd7fa640 1 -- 172.21.15.2:0/116717334 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd6f0030d00 con 0x7fd7001075c0 2024-09-19T04:39:31.321 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:29.294+0000 7fd7065cf640 1 -- 172.21.15.2:0/116717334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd70007c290 con 0x7fd7001075c0 2024-09-19T04:39:31.321 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:29.295+0000 7fd6fd7fa640 1 -- 172.21.15.2:0/116717334 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6f0037040 con 0x7fd7001075c0 2024-09-19T04:39:31.321 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:29.295+0000 7fd7065cf640 1 -- 172.21.15.2:0/116717334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd70007c7d0 con 0x7fd7001075c0 2024-09-19T04:39:31.321 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:29.295+0000 7fd6fd7fa640 1 -- 172.21.15.2:0/116717334 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fd6f0045070 con 0x7fd7001075c0 2024-09-19T04:39:31.321 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:29.296+0000 7fd6fd7fa640 1 --2- 172.21.15.2:0/116717334 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7fd6e8039200 0x7fd6e803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:31.321 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:29.296+0000 7fd6fd7fa640 1 -- 172.21.15.2:0/116717334 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd6f006c2e0 con 0x7fd7001075c0 2024-09-19T04:39:31.321 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:29.296+0000 7fd7065cf640 1 -- 172.21.15.2:0/116717334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd70010bcf0 con 0x7fd7001075c0 2024-09-19T04:39:31.321 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:29.296+0000 7fd6ff7fe640 1 --2- 172.21.15.2:0/116717334 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7fd6e8039200 0x7fd6e803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:31.322 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:29.296+0000 7fd6ff7fe640 1 --2- 172.21.15.2:0/116717334 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7fd6e8039200 0x7fd6e803b6c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd6f40098c0 tx=0x7fd6f4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:31.322 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:29.300+0000 7fd6fd7fa640 1 -- 172.21.15.2:0/116717334 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd6f0046e00 con 0x7fd7001075c0 2024-09-19T04:39:31.322 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:29.529+0000 7fd7065cf640 1 -- 172.21.15.2:0/116717334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7fd70007ce90 con 0x7fd7001075c0 2024-09-19T04:39:31.322 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:30.345+0000 7fd6fd7fa640 1 -- 172.21.15.2:0/116717334 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7fd6f0045360 con 0x7fd7001075c0 2024-09-19T04:39:31.322 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:30.347+0000 7fd6fd7fa640 1 -- 172.21.15.2:0/116717334 <== mon.0 v2:172.21.15.2:3300/0 8 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7fd6f003ca50 con 0x7fd7001075c0 2024-09-19T04:39:31.322 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:30.349+0000 7fd7065cf640 1 -- 172.21.15.2:0/116717334 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7fd6e8039200 msgr2=0x7fd6e803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:31.322 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:30.349+0000 7fd7065cf640 1 --2- 172.21.15.2:0/116717334 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7fd6e8039200 0x7fd6e803b6c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd6f40098c0 tx=0x7fd6f4006db0 comp rx=0 tx=0).stop 2024-09-19T04:39:31.322 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:30.349+0000 7fd7065cf640 1 -- 172.21.15.2:0/116717334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7001075c0 msgr2=0x7fd70007db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:31.322 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:30.349+0000 7fd7065cf640 1 --2- 172.21.15.2:0/116717334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7001075c0 0x7fd70007db60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0009940 tx=0x7fd6f00327b0 comp rx=0 tx=0).stop 2024-09-19T04:39:31.322 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:30.349+0000 7fd7065cf640 1 -- 172.21.15.2:0/116717334 shutdown_connections 2024-09-19T04:39:31.322 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:30.349+0000 7fd7065cf640 1 --2- 172.21.15.2:0/116717334 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7fd6e8039200 0x7fd6e803b6c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:31.323 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:30.349+0000 7fd7065cf640 1 --2- 172.21.15.2:0/116717334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7001075c0 0x7fd70007db60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:31.323 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:30.349+0000 7fd7065cf640 1 -- 172.21.15.2:0/116717334 >> 172.21.15.2:0/116717334 conn(0x7fd700102d50 msgr2=0x7fd7001038f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:31.323 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:30.349+0000 7fd7065cf640 1 -- 172.21.15.2:0/116717334 shutdown_connections 2024-09-19T04:39:31.323 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:30.349+0000 7fd7065cf640 1 -- 172.21.15.2:0/116717334 wait complete. 2024-09-19T04:39:31.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:31 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/116717334' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-19T04:39:31.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:31 smithi002 ceph-mon[30975]: mgrmap e9: x(active, since 19s) 2024-09-19T04:39:31.610 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:31 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:31.422+0000 7fb0229d6040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T04:39:31.610 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:31 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:31.488+0000 7fb0229d6040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T04:39:31.893 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:31 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:31.691+0000 7fb0229d6040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T04:39:32.536 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:32 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/1607043100' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T04:39:32.552 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-19T04:39:32.552 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-19T04:39:32.552 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T04:39:32.553 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T04:39:32.553 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T04:39:32.553 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-19T04:39:32.553 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.713+0000 7f6cf5583640 1 Processor -- start 2024-09-19T04:39:32.553 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.713+0000 7f6cf5583640 1 -- start start 2024-09-19T04:39:32.554 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.713+0000 7f6cf5583640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cf0108040 0x7f6cf010a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:32.554 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.713+0000 7f6cf5583640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf00634b0 con 0x7f6cf0108040 2024-09-19T04:39:32.554 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.714+0000 7f6ceeffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cf0108040 0x7f6cf010a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:32.554 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.714+0000 7f6ceeffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cf0108040 0x7f6cf010a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45780/0 (socket says 172.21.15.2:45780) 2024-09-19T04:39:32.554 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.714+0000 7f6ceeffd640 1 -- 172.21.15.2:0/1748801000 learned_addr learned my addr 172.21.15.2:0/1748801000 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:39:32.555 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.714+0000 7f6ceeffd640 1 -- 172.21.15.2:0/1748801000 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cf010a970 con 0x7f6cf0108040 2024-09-19T04:39:32.555 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.715+0000 7f6ceeffd640 1 --2- 172.21.15.2:0/1748801000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cf0108040 0x7f6cf010a430 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6ce0009e80 tx=0x7f6ce002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad8be14ebebd0b65 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:32.555 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.715+0000 7f6cedffb640 1 -- 172.21.15.2:0/1748801000 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ce0036070 con 0x7f6cf0108040 2024-09-19T04:39:32.555 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.715+0000 7f6cedffb640 1 -- 172.21.15.2:0/1748801000 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6ce00318b0 con 0x7f6cf0108040 2024-09-19T04:39:32.556 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.715+0000 7f6cedffb640 1 -- 172.21.15.2:0/1748801000 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ce0007930 con 0x7f6cf0108040 2024-09-19T04:39:32.556 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.716+0000 7f6cf5583640 1 -- 172.21.15.2:0/1748801000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cf0108040 msgr2=0x7f6cf010a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:32.556 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.716+0000 7f6cf5583640 1 --2- 172.21.15.2:0/1748801000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cf0108040 0x7f6cf010a430 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6ce0009e80 tx=0x7f6ce002a7a0 comp rx=0 tx=0).stop 2024-09-19T04:39:32.556 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.716+0000 7f6cf5583640 1 -- 172.21.15.2:0/1748801000 shutdown_connections 2024-09-19T04:39:32.556 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.716+0000 7f6cf5583640 1 --2- 172.21.15.2:0/1748801000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cf0108040 0x7f6cf010a430 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:32.556 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.716+0000 7f6cf5583640 1 -- 172.21.15.2:0/1748801000 >> 172.21.15.2:0/1748801000 conn(0x7f6cf0101c00 msgr2=0x7f6cf0104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:32.557 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.716+0000 7f6cf5583640 1 -- 172.21.15.2:0/1748801000 shutdown_connections 2024-09-19T04:39:32.557 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.716+0000 7f6cf5583640 1 -- 172.21.15.2:0/1748801000 wait complete. 2024-09-19T04:39:32.557 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.716+0000 7f6cf5583640 1 Processor -- start 2024-09-19T04:39:32.557 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.717+0000 7f6cf5583640 1 -- start start 2024-09-19T04:39:32.557 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.717+0000 7f6cf5583640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cf0108040 0x7f6cf01078c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:32.558 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.717+0000 7f6cf5583640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf010b990 con 0x7f6cf0108040 2024-09-19T04:39:32.558 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.717+0000 7f6ceeffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cf0108040 0x7f6cf01078c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:32.558 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.717+0000 7f6ceeffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cf0108040 0x7f6cf01078c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45784/0 (socket says 172.21.15.2:45784) 2024-09-19T04:39:32.558 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.717+0000 7f6ceeffd640 1 -- 172.21.15.2:0/1607043100 learned_addr learned my addr 172.21.15.2:0/1607043100 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:39:32.558 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.717+0000 7f6ceeffd640 1 -- 172.21.15.2:0/1607043100 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cf0107e00 con 0x7f6cf0108040 2024-09-19T04:39:32.559 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.718+0000 7f6ceeffd640 1 --2- 172.21.15.2:0/1607043100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cf0108040 0x7f6cf01078c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6ce0031c90 tx=0x7f6ce0031cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:32.559 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.718+0000 7f6cd7fff640 1 -- 172.21.15.2:0/1607043100 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ce0036050 con 0x7f6cf0108040 2024-09-19T04:39:32.559 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.718+0000 7f6cf5583640 1 -- 172.21.15.2:0/1607043100 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cf0105ff0 con 0x7f6cf0108040 2024-09-19T04:39:32.559 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.718+0000 7f6cf5583640 1 -- 172.21.15.2:0/1607043100 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cf0106530 con 0x7f6cf0108040 2024-09-19T04:39:32.560 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.718+0000 7f6cd7fff640 1 -- 172.21.15.2:0/1607043100 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6ce0042070 con 0x7f6cf0108040 2024-09-19T04:39:32.560 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.718+0000 7f6cd7fff640 1 -- 172.21.15.2:0/1607043100 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ce003daa0 con 0x7f6cf0108040 2024-09-19T04:39:32.560 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.719+0000 7f6cd7fff640 1 -- 172.21.15.2:0/1607043100 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f6ce003dc40 con 0x7f6cf0108040 2024-09-19T04:39:32.560 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.719+0000 7f6cf5583640 1 -- 172.21.15.2:0/1607043100 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cdc0052c0 con 0x7f6cf0108040 2024-09-19T04:39:32.560 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.719+0000 7f6cd7fff640 1 --2- 172.21.15.2:0/1607043100 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7f6cd8039260 0x7f6cd803b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:32.561 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.719+0000 7f6cee7fc640 1 -- 172.21.15.2:0/1607043100 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7f6cd8039260 msgr2=0x7f6cd803b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/3782987318 2024-09-19T04:39:32.561 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.719+0000 7f6cd7fff640 1 -- 172.21.15.2:0/1607043100 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f6ce006d800 con 0x7f6cf0108040 2024-09-19T04:39:32.561 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.719+0000 7f6cee7fc640 1 --2- 172.21.15.2:0/1607043100 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7f6cd8039260 0x7f6cd803b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T04:39:32.561 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.725+0000 7f6cd7fff640 1 -- 172.21.15.2:0/1607043100 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6ce0044310 con 0x7f6cf0108040 2024-09-19T04:39:32.561 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.920+0000 7f6cee7fc640 1 -- 172.21.15.2:0/1607043100 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7f6cd8039260 msgr2=0x7f6cd803b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/3782987318 2024-09-19T04:39:32.561 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.920+0000 7f6cee7fc640 1 --2- 172.21.15.2:0/1607043100 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7f6cd8039260 0x7f6cd803b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T04:39:32.562 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.948+0000 7f6cf5583640 1 -- 172.21.15.2:0/1607043100 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f6cdc005dc0 con 0x7f6cf0108040 2024-09-19T04:39:32.562 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.949+0000 7f6cd7fff640 1 -- 172.21.15.2:0/1607043100 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f6ce003bdf0 con 0x7f6cf0108040 2024-09-19T04:39:32.562 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.951+0000 7f6cf5583640 1 -- 172.21.15.2:0/1607043100 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7f6cd8039260 msgr2=0x7f6cd803b720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T04:39:32.562 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.951+0000 7f6cf5583640 1 --2- 172.21.15.2:0/1607043100 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7f6cd8039260 0x7f6cd803b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:32.562 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.951+0000 7f6cf5583640 1 -- 172.21.15.2:0/1607043100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cf0108040 msgr2=0x7f6cf01078c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:32.563 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.951+0000 7f6cf5583640 1 --2- 172.21.15.2:0/1607043100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cf0108040 0x7f6cf01078c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6ce0031c90 tx=0x7f6ce0031cc0 comp rx=0 tx=0).stop 2024-09-19T04:39:32.563 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.951+0000 7f6cf5583640 1 -- 172.21.15.2:0/1607043100 shutdown_connections 2024-09-19T04:39:32.563 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.951+0000 7f6cf5583640 1 --2- 172.21.15.2:0/1607043100 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7f6cd8039260 0x7f6cd803b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:32.563 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.951+0000 7f6cf5583640 1 --2- 172.21.15.2:0/1607043100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cf0108040 0x7f6cf01078c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:32.563 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.951+0000 7f6cf5583640 1 -- 172.21.15.2:0/1607043100 >> 172.21.15.2:0/1607043100 conn(0x7f6cf0101c00 msgr2=0x7f6cf0102780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:32.564 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.952+0000 7f6cf5583640 1 -- 172.21.15.2:0/1607043100 shutdown_connections 2024-09-19T04:39:32.564 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:31.952+0000 7f6cf5583640 1 -- 172.21.15.2:0/1607043100 wait complete. 2024-09-19T04:39:32.564 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for the mgr to restart... 2024-09-19T04:39:32.564 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mgr epoch 9... 2024-09-19T04:39:32.795 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:32 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:32.662+0000 7fb0229d6040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T04:39:32.795 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:32 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:32.735+0000 7fb0229d6040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T04:39:33.762 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:33 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:33.490+0000 7fb0229d6040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T04:39:33.762 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:33 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:33.611+0000 7fb0229d6040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T04:39:34.054 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:33 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:33.761+0000 7fb0229d6040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T04:39:34.054 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:33 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:33.824+0000 7fb0229d6040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T04:39:34.054 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:33 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:33.980+0000 7fb0229d6040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T04:39:34.054 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:34 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:34.051+0000 7fb0229d6040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T04:39:34.351 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:34 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:34.114+0000 7fb0229d6040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T04:39:34.351 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:34 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:34.280+0000 7fb0229d6040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T04:39:34.351 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:34 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:34.348+0000 7fb0229d6040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T04:39:34.610 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:34 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:34.418+0000 7fb0229d6040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T04:39:34.610 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:34 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:34.504+0000 7fb0229d6040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T04:39:34.610 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:34 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:34.566+0000 7fb0229d6040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T04:39:35.110 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:34 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:34.628+0000 7fb0229d6040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T04:39:35.714 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:35 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:35.458+0000 7fb0229d6040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T04:39:35.715 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:35 smithi002 ceph-mon[30975]: Active manager daemon x restarted 2024-09-19T04:39:35.715 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:35 smithi002 ceph-mon[30975]: Activating manager daemon x 2024-09-19T04:39:35.715 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:35 smithi002 ceph-mon[30975]: osdmap e3: 0 total, 0 up, 0 in 2024-09-19T04:39:35.715 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:35 smithi002 ceph-mon[30975]: mgrmap e10: x(active, starting, since 0.0033872s) 2024-09-19T04:39:35.715 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:35 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:39:35.715 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:35 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T04:39:35.715 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:35 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T04:39:35.715 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:35 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T04:39:35.715 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:35 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T04:39:35.715 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:35 smithi002 ceph-mon[30975]: Manager daemon x is now available 2024-09-19T04:39:35.715 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:35 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:39:35.715 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:35 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T04:39:35.716 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:35 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T04:39:37.286 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-19T04:39:37.286 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-19T04:39:37.286 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T04:39:37.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-19T04:39:37.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:32.951+0000 7f496b6aa640 1 Processor -- start 2024-09-19T04:39:37.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:32.951+0000 7f496b6aa640 1 -- start start 2024-09-19T04:39:37.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:32.951+0000 7f496b6aa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4964108060 0x7f496410a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:37.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:32.951+0000 7f496b6aa640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f496407bea0 con 0x7f4964108060 2024-09-19T04:39:37.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:32.952+0000 7f4969446640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4964108060 0x7f496410a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:37.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:32.952+0000 7f4969446640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4964108060 0x7f496410a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45790/0 (socket says 172.21.15.2:45790) 2024-09-19T04:39:37.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:32.952+0000 7f4969446640 1 -- 172.21.15.2:0/694982310 learned_addr learned my addr 172.21.15.2:0/694982310 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:39:37.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:32.952+0000 7f4969446640 1 -- 172.21.15.2:0/694982310 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f496410a990 con 0x7f4964108060 2024-09-19T04:39:37.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:32.953+0000 7f4969446640 1 --2- 172.21.15.2:0/694982310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4964108060 0x7f496410a450 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4960009820 tx=0x7f496002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9b3a5007b60b580 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:37.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:32.953+0000 7f495bfff640 1 -- 172.21.15.2:0/694982310 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4960037070 con 0x7f4964108060 2024-09-19T04:39:37.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:32.953+0000 7f495bfff640 1 -- 172.21.15.2:0/694982310 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f49600328f0 con 0x7f4964108060 2024-09-19T04:39:37.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:32.953+0000 7f495bfff640 1 -- 172.21.15.2:0/694982310 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4960030740 con 0x7f4964108060 2024-09-19T04:39:37.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:32.954+0000 7f496b6aa640 1 -- 172.21.15.2:0/694982310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4964108060 msgr2=0x7f496410a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:37.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:32.954+0000 7f496b6aa640 1 --2- 172.21.15.2:0/694982310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4964108060 0x7f496410a450 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4960009820 tx=0x7f496002a270 comp rx=0 tx=0).stop 2024-09-19T04:39:37.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:32.954+0000 7f496b6aa640 1 -- 172.21.15.2:0/694982310 shutdown_connections 2024-09-19T04:39:37.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:32.954+0000 7f496b6aa640 1 --2- 172.21.15.2:0/694982310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4964108060 0x7f496410a450 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:37.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:32.954+0000 7f496b6aa640 1 -- 172.21.15.2:0/694982310 >> 172.21.15.2:0/694982310 conn(0x7f4964101ca0 msgr2=0x7f49641040c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:37.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:32.954+0000 7f496b6aa640 1 -- 172.21.15.2:0/694982310 shutdown_connections 2024-09-19T04:39:37.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:32.954+0000 7f496b6aa640 1 -- 172.21.15.2:0/694982310 wait complete. 2024-09-19T04:39:37.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:32.955+0000 7f496b6aa640 1 Processor -- start 2024-09-19T04:39:37.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:32.955+0000 7f496b6aa640 1 -- start start 2024-09-19T04:39:37.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:32.955+0000 7f496b6aa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4964108060 0x7f496419b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:37.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:32.955+0000 7f496b6aa640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f496410ba10 con 0x7f4964108060 2024-09-19T04:39:37.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:32.955+0000 7f4969446640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4964108060 0x7f496419b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:37.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:32.955+0000 7f4969446640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4964108060 0x7f496419b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45806/0 (socket says 172.21.15.2:45806) 2024-09-19T04:39:37.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:32.955+0000 7f4969446640 1 -- 172.21.15.2:0/3246551058 learned_addr learned my addr 172.21.15.2:0/3246551058 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:39:37.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:32.955+0000 7f4969446640 1 -- 172.21.15.2:0/3246551058 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f496419baf0 con 0x7f4964108060 2024-09-19T04:39:37.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:32.955+0000 7f4969446640 1 --2- 172.21.15.2:0/3246551058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4964108060 0x7f496419b5b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f49600097f0 tx=0x7f4960030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:37.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:32.956+0000 7f495a7fc640 1 -- 172.21.15.2:0/3246551058 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4960042070 con 0x7f4964108060 2024-09-19T04:39:37.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:32.956+0000 7f496b6aa640 1 -- 172.21.15.2:0/3246551058 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f496419bd80 con 0x7f4964108060 2024-09-19T04:39:37.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:32.956+0000 7f496b6aa640 1 -- 172.21.15.2:0/3246551058 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f496419ea70 con 0x7f4964108060 2024-09-19T04:39:37.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:32.956+0000 7f495a7fc640 1 -- 172.21.15.2:0/3246551058 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4960030e80 con 0x7f4964108060 2024-09-19T04:39:37.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:32.956+0000 7f495a7fc640 1 -- 172.21.15.2:0/3246551058 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4960037040 con 0x7f4964108060 2024-09-19T04:39:37.290 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:32.957+0000 7f495a7fc640 1 -- 172.21.15.2:0/3246551058 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f4960045070 con 0x7f4964108060 2024-09-19T04:39:37.290 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:32.957+0000 7f495a7fc640 1 --2- 172.21.15.2:0/3246551058 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7f4950039260 0x7f495003b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:37.290 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:32.957+0000 7f495a7fc640 1 -- 172.21.15.2:0/3246551058 --> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f495003be30 con 0x7f4950039260 2024-09-19T04:39:37.290 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:32.957+0000 7f495a7fc640 1 -- 172.21.15.2:0/3246551058 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f496006c5b0 con 0x7f4964108060 2024-09-19T04:39:37.290 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:32.957+0000 7f4968c45640 1 -- 172.21.15.2:0/3246551058 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7f4950039260 msgr2=0x7f495003b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/3782987318 2024-09-19T04:39:37.290 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:32.957+0000 7f4968c45640 1 --2- 172.21.15.2:0/3246551058 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7f4950039260 0x7f495003b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T04:39:37.290 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:33.158+0000 7f4968c45640 1 -- 172.21.15.2:0/3246551058 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7f4950039260 msgr2=0x7f495003b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/3782987318 2024-09-19T04:39:37.290 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:33.158+0000 7f4968c45640 1 --2- 172.21.15.2:0/3246551058 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7f4950039260 0x7f495003b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T04:39:37.290 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:33.559+0000 7f4968c45640 1 -- 172.21.15.2:0/3246551058 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7f4950039260 msgr2=0x7f495003b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/3782987318 2024-09-19T04:39:37.290 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:33.559+0000 7f4968c45640 1 --2- 172.21.15.2:0/3246551058 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7f4950039260 0x7f495003b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T04:39:37.290 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:34.359+0000 7f4968c45640 1 -- 172.21.15.2:0/3246551058 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7f4950039260 msgr2=0x7f495003b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/3782987318 2024-09-19T04:39:37.290 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:34.359+0000 7f4968c45640 1 --2- 172.21.15.2:0/3246551058 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7f4950039260 0x7f495003b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T04:39:37.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:35.461+0000 7f495a7fc640 1 -- 172.21.15.2:0/3246551058 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mgrmap(e 10) ==== 46241+0+0 (secure 0 0 0) 0x7f496003db70 con 0x7f4964108060 2024-09-19T04:39:37.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:35.461+0000 7f495a7fc640 1 -- 172.21.15.2:0/3246551058 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7f4950039260 msgr2=0x7f495003b720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T04:39:37.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:35.461+0000 7f495a7fc640 1 --2- 172.21.15.2:0/3246551058 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7f4950039260 0x7f495003b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:37.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:36.463+0000 7f495a7fc640 1 -- 172.21.15.2:0/3246551058 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7f496003c760 con 0x7f4964108060 2024-09-19T04:39:37.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:36.463+0000 7f495a7fc640 1 --2- 172.21.15.2:0/3246551058 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f495003cd20 0x7f495003f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:37.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:36.463+0000 7f495a7fc640 1 -- 172.21.15.2:0/3246551058 --> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f496003ee50 con 0x7f495003cd20 2024-09-19T04:39:37.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:36.464+0000 7f4968c45640 1 --2- 172.21.15.2:0/3246551058 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f495003cd20 0x7f495003f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:37.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:36.465+0000 7f4968c45640 1 --2- 172.21.15.2:0/3246551058 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f495003cd20 0x7f495003f110 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4954003980 tx=0x7f49540092b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:37.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:36.465+0000 7f495a7fc640 1 -- 172.21.15.2:0/3246551058 <== mgr.14150 v2:172.21.15.2:6800/3171525177 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f496003ee50 con 0x7f495003cd20 2024-09-19T04:39:37.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:36.478+0000 7f496b6aa640 1 -- 172.21.15.2:0/3246551058 --> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f49480025a0 con 0x7f495003cd20 2024-09-19T04:39:37.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:36.478+0000 7f495a7fc640 1 -- 172.21.15.2:0/3246551058 <== mgr.14150 v2:172.21.15.2:6800/3171525177 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f49480025a0 con 0x7f495003cd20 2024-09-19T04:39:37.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:36.479+0000 7f496b6aa640 1 -- 172.21.15.2:0/3246551058 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f495003cd20 msgr2=0x7f495003f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:37.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:36.479+0000 7f496b6aa640 1 --2- 172.21.15.2:0/3246551058 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f495003cd20 0x7f495003f110 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4954003980 tx=0x7f49540092b0 comp rx=0 tx=0).stop 2024-09-19T04:39:37.292 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:36.479+0000 7f496b6aa640 1 -- 172.21.15.2:0/3246551058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4964108060 msgr2=0x7f496419b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:37.292 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:36.479+0000 7f496b6aa640 1 --2- 172.21.15.2:0/3246551058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4964108060 0x7f496419b5b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f49600097f0 tx=0x7f4960030c70 comp rx=0 tx=0).stop 2024-09-19T04:39:37.292 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:36.479+0000 7f496b6aa640 1 -- 172.21.15.2:0/3246551058 shutdown_connections 2024-09-19T04:39:37.292 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:36.479+0000 7f496b6aa640 1 --2- 172.21.15.2:0/3246551058 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f495003cd20 0x7f495003f110 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:37.292 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:36.479+0000 7f496b6aa640 1 --2- 172.21.15.2:0/3246551058 >> [v2:172.21.15.2:6800/3782987318,v1:172.21.15.2:6801/3782987318] conn(0x7f4950039260 0x7f495003b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:37.292 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:36.479+0000 7f496b6aa640 1 --2- 172.21.15.2:0/3246551058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4964108060 0x7f496419b5b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:37.292 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:36.479+0000 7f496b6aa640 1 -- 172.21.15.2:0/3246551058 >> 172.21.15.2:0/3246551058 conn(0x7f4964101ca0 msgr2=0x7f4964102880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:37.292 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:36.479+0000 7f496b6aa640 1 -- 172.21.15.2:0/3246551058 shutdown_connections 2024-09-19T04:39:37.292 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:36.479+0000 7f496b6aa640 1 -- 172.21.15.2:0/3246551058 wait complete. 2024-09-19T04:39:37.292 INFO:teuthology.orchestra.run.smithi002.stdout:mgr epoch 9 is available 2024-09-19T04:39:37.292 INFO:teuthology.orchestra.run.smithi002.stdout:Generating a dashboard self-signed certificate... 2024-09-19T04:39:37.554 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:37 smithi002 ceph-mon[30975]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T04:39:37.554 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:37 smithi002 ceph-mon[30975]: mgrmap e11: x(active, since 1.00601s) 2024-09-19T04:39:37.554 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:37 smithi002 ceph-mon[30975]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T04:39:37.555 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:37 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:39:38.456 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:38 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:38.193+0000 7faf8db2a640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:04:39:38] ENGINE Error in HTTPServer.serve 2024-09-19T04:39:38.456 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:38 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: Traceback (most recent call last): 2024-09-19T04:39:38.456 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:38 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T04:39:38.457 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:38 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: self._connections.run(self.expiration_interval) 2024-09-19T04:39:38.457 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:38 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T04:39:38.457 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:38 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: self._run(expiration_interval) 2024-09-19T04:39:38.457 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:38 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T04:39:38.457 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:38 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T04:39:38.457 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:38 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T04:39:38.457 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:38 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T04:39:38.457 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:38 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T04:39:38.457 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:38 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: s = self.context.wrap_socket( 2024-09-19T04:39:38.457 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:38 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T04:39:38.457 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:38 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: return self.sslsocket_class._create( 2024-09-19T04:39:38.457 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:38 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T04:39:38.457 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:38 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: self.do_handshake() 2024-09-19T04:39:38.457 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:38 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T04:39:38.458 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:38 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: self._sslobj.do_handshake() 2024-09-19T04:39:38.458 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:38 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T04:39:38.458 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:39:38 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:39:38.675 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-19T04:39:38.675 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:37.743+0000 7f01b21e3640 1 Processor -- start 2024-09-19T04:39:38.675 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:37.743+0000 7f01b21e3640 1 -- start start 2024-09-19T04:39:38.675 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:37.743+0000 7f01b21e3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01ac106470 0x7f01ac106870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:38.675 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:37.743+0000 7f01b21e3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f01ac106e40 con 0x7f01ac106470 2024-09-19T04:39:38.675 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:37.743+0000 7f01ab7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01ac106470 0x7f01ac106870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:38.675 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:37.743+0000 7f01ab7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01ac106470 0x7f01ac106870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45874/0 (socket says 172.21.15.2:45874) 2024-09-19T04:39:38.675 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:37.743+0000 7f01ab7fe640 1 -- 172.21.15.2:0/1195222676 learned_addr learned my addr 172.21.15.2:0/1195222676 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:39:38.675 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:37.743+0000 7f01ab7fe640 1 -- 172.21.15.2:0/1195222676 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01ac107670 con 0x7f01ac106470 2024-09-19T04:39:38.675 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:37.744+0000 7f01ab7fe640 1 --2- 172.21.15.2:0/1195222676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01ac106470 0x7f01ac106870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f019c009820 tx=0x7f019c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ef493339a068a70 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:38.676 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:37.744+0000 7f01aa7fc640 1 -- 172.21.15.2:0/1195222676 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f019c037070 con 0x7f01ac106470 2024-09-19T04:39:38.676 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:37.745+0000 7f01aa7fc640 1 -- 172.21.15.2:0/1195222676 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f019c0328f0 con 0x7f01ac106470 2024-09-19T04:39:38.676 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:37.745+0000 7f01aa7fc640 1 -- 172.21.15.2:0/1195222676 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f019c030740 con 0x7f01ac106470 2024-09-19T04:39:38.676 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:37.745+0000 7f01b21e3640 1 -- 172.21.15.2:0/1195222676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01ac106470 msgr2=0x7f01ac106870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:38.676 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:37.745+0000 7f01b21e3640 1 --2- 172.21.15.2:0/1195222676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01ac106470 0x7f01ac106870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f019c009820 tx=0x7f019c02a270 comp rx=0 tx=0).stop 2024-09-19T04:39:38.676 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:37.745+0000 7f01b21e3640 1 -- 172.21.15.2:0/1195222676 shutdown_connections 2024-09-19T04:39:38.676 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:37.745+0000 7f01b21e3640 1 --2- 172.21.15.2:0/1195222676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01ac106470 0x7f01ac106870 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:38.676 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:37.745+0000 7f01b21e3640 1 -- 172.21.15.2:0/1195222676 >> 172.21.15.2:0/1195222676 conn(0x7f01ac101c00 msgr2=0x7f01ac104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:38.676 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:37.745+0000 7f01b21e3640 1 -- 172.21.15.2:0/1195222676 shutdown_connections 2024-09-19T04:39:38.676 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:37.745+0000 7f01b21e3640 1 -- 172.21.15.2:0/1195222676 wait complete. 2024-09-19T04:39:38.676 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:37.746+0000 7f01b21e3640 1 Processor -- start 2024-09-19T04:39:38.676 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:37.746+0000 7f01b21e3640 1 -- start start 2024-09-19T04:39:38.677 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:37.746+0000 7f01b21e3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01ac106470 0x7f01ac19b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:38.677 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:37.746+0000 7f01b21e3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f01ac10aa20 con 0x7f01ac106470 2024-09-19T04:39:38.677 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:37.746+0000 7f01ab7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01ac106470 0x7f01ac19b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:38.677 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:37.746+0000 7f01ab7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01ac106470 0x7f01ac19b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45882/0 (socket says 172.21.15.2:45882) 2024-09-19T04:39:38.677 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:37.747+0000 7f01ab7fe640 1 -- 172.21.15.2:0/1465827592 learned_addr learned my addr 172.21.15.2:0/1465827592 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:39:38.677 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:37.747+0000 7f01ab7fe640 1 -- 172.21.15.2:0/1465827592 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01ac19baf0 con 0x7f01ac106470 2024-09-19T04:39:38.677 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:37.747+0000 7f01ab7fe640 1 --2- 172.21.15.2:0/1465827592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01ac106470 0x7f01ac19b5b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f019c0097f0 tx=0x7f019c030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:38.677 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:37.747+0000 7f01a8ff9640 1 -- 172.21.15.2:0/1465827592 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f019c042070 con 0x7f01ac106470 2024-09-19T04:39:38.677 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:37.747+0000 7f01a8ff9640 1 -- 172.21.15.2:0/1465827592 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f019c030d80 con 0x7f01ac106470 2024-09-19T04:39:38.677 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:37.747+0000 7f01b21e3640 1 -- 172.21.15.2:0/1465827592 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01ac19bd80 con 0x7f01ac106470 2024-09-19T04:39:38.677 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:37.747+0000 7f01a8ff9640 1 -- 172.21.15.2:0/1465827592 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f019c037040 con 0x7f01ac106470 2024-09-19T04:39:38.677 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:37.747+0000 7f01b21e3640 1 -- 172.21.15.2:0/1465827592 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01ac19ea70 con 0x7f01ac106470 2024-09-19T04:39:38.677 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:37.748+0000 7f01a8ff9640 1 -- 172.21.15.2:0/1465827592 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7f019c045070 con 0x7f01ac106470 2024-09-19T04:39:38.677 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:37.749+0000 7f01a8ff9640 1 --2- 172.21.15.2:0/1465827592 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f01940390f0 0x7f019403b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:38.678 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:37.749+0000 7f01a8ff9640 1 -- 172.21.15.2:0/1465827592 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f019c06c250 con 0x7f01ac106470 2024-09-19T04:39:38.678 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:37.749+0000 7f01b21e3640 1 -- 172.21.15.2:0/1465827592 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01ac10aba0 con 0x7f01ac106470 2024-09-19T04:39:38.678 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:37.749+0000 7f01aaffd640 1 --2- 172.21.15.2:0/1465827592 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f01940390f0 0x7f019403b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:38.678 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:37.749+0000 7f01aaffd640 1 --2- 172.21.15.2:0/1465827592 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f01940390f0 0x7f019403b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f01a00098c0 tx=0x7f01a0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:38.678 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:37.754+0000 7f01a8ff9640 1 -- 172.21.15.2:0/1465827592 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f019c042d00 con 0x7f01ac106470 2024-09-19T04:39:38.678 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:37.942+0000 7f01b21e3640 1 -- 172.21.15.2:0/1465827592 --> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f01ac02d9c0 con 0x7f01940390f0 2024-09-19T04:39:38.678 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:38.021+0000 7f01a8ff9640 1 -- 172.21.15.2:0/1465827592 <== mgr.14150 v2:172.21.15.2:6800/3171525177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f01ac02d9c0 con 0x7f01940390f0 2024-09-19T04:39:38.678 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:38.024+0000 7f01b21e3640 1 -- 172.21.15.2:0/1465827592 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f01940390f0 msgr2=0x7f019403b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:38.678 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:38.024+0000 7f01b21e3640 1 --2- 172.21.15.2:0/1465827592 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f01940390f0 0x7f019403b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f01a00098c0 tx=0x7f01a0006db0 comp rx=0 tx=0).stop 2024-09-19T04:39:38.678 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:38.024+0000 7f01b21e3640 1 -- 172.21.15.2:0/1465827592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01ac106470 msgr2=0x7f01ac19b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:38.678 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:38.024+0000 7f01b21e3640 1 --2- 172.21.15.2:0/1465827592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01ac106470 0x7f01ac19b5b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f019c0097f0 tx=0x7f019c030c70 comp rx=0 tx=0).stop 2024-09-19T04:39:38.678 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:38.024+0000 7f01b21e3640 1 -- 172.21.15.2:0/1465827592 shutdown_connections 2024-09-19T04:39:38.678 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:38.024+0000 7f01b21e3640 1 --2- 172.21.15.2:0/1465827592 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f01940390f0 0x7f019403b5b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:38.679 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:38.024+0000 7f01b21e3640 1 --2- 172.21.15.2:0/1465827592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01ac106470 0x7f01ac19b5b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:38.679 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:38.024+0000 7f01b21e3640 1 -- 172.21.15.2:0/1465827592 >> 172.21.15.2:0/1465827592 conn(0x7f01ac101c00 msgr2=0x7f01ac102b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:38.679 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:38.024+0000 7f01b21e3640 1 -- 172.21.15.2:0/1465827592 shutdown_connections 2024-09-19T04:39:38.679 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:38.024+0000 7f01b21e3640 1 -- 172.21.15.2:0/1465827592 wait complete. 2024-09-19T04:39:38.679 INFO:teuthology.orchestra.run.smithi002.stdout:Creating initial admin user... 2024-09-19T04:39:39.043 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:39 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:39:39.044 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:39 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:39:39.044 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:39 smithi002 ceph-mon[30975]: [19/Sep/2024:04:39:38] ENGINE Bus STARTING 2024-09-19T04:39:39.044 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:39 smithi002 ceph-mon[30975]: [19/Sep/2024:04:39:38] ENGINE Serving on https://172.21.15.2:7150 2024-09-19T04:39:39.044 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:39 smithi002 ceph-mon[30975]: [19/Sep/2024:04:39:38] ENGINE Error in HTTPServer.serve 2024-09-19T04:39:39.044 INFO:journalctl@ceph.mon.a.smithi002.stdout: Traceback (most recent call last): 2024-09-19T04:39:39.044 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T04:39:39.044 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._connections.run(self.expiration_interval) 2024-09-19T04:39:39.044 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T04:39:39.044 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._run(expiration_interval) 2024-09-19T04:39:39.044 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T04:39:39.044 INFO:journalctl@ceph.mon.a.smithi002.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T04:39:39.045 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T04:39:39.045 INFO:journalctl@ceph.mon.a.smithi002.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T04:39:39.045 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T04:39:39.045 INFO:journalctl@ceph.mon.a.smithi002.stdout: s = self.context.wrap_socket( 2024-09-19T04:39:39.045 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T04:39:39.045 INFO:journalctl@ceph.mon.a.smithi002.stdout: return self.sslsocket_class._create( 2024-09-19T04:39:39.045 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T04:39:39.045 INFO:journalctl@ceph.mon.a.smithi002.stdout: self.do_handshake() 2024-09-19T04:39:39.045 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T04:39:39.045 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._sslobj.do_handshake() 2024-09-19T04:39:39.046 INFO:journalctl@ceph.mon.a.smithi002.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T04:39:39.046 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:39 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:39:39.046 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:39 smithi002 ceph-mon[30975]: [19/Sep/2024:04:39:38] ENGINE Serving on http://172.21.15.2:8765 2024-09-19T04:39:39.046 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:39 smithi002 ceph-mon[30975]: [19/Sep/2024:04:39:38] ENGINE Bus STARTED 2024-09-19T04:39:39.046 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:39 smithi002 ceph-mon[30975]: mgrmap e12: x(active, since 2s) 2024-09-19T04:39:40.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:40 smithi002 ceph-mon[30975]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:39:40.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:40 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:39:40.421 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$VpT6htdZslnEePNw7zkoYuMbkiS.z8jn3hVunkFzR9MqwHLqjeY.i", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726720779, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-19T04:39:40.421 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.036+0000 7ff68acc5640 1 Processor -- start 2024-09-19T04:39:40.421 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.036+0000 7ff68acc5640 1 -- start start 2024-09-19T04:39:40.422 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.036+0000 7ff68acc5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff684105ed0 0x7ff6841062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:40.422 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.036+0000 7ff68acc5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff68407be20 con 0x7ff684105ed0 2024-09-19T04:39:40.422 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.036+0000 7ff688a61640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff684105ed0 0x7ff6841062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:40.422 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.036+0000 7ff688a61640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff684105ed0 0x7ff6841062d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45884/0 (socket says 172.21.15.2:45884) 2024-09-19T04:39:40.422 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.036+0000 7ff688a61640 1 -- 172.21.15.2:0/162248655 learned_addr learned my addr 172.21.15.2:0/162248655 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:39:40.422 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.036+0000 7ff688a61640 1 -- 172.21.15.2:0/162248655 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff684106810 con 0x7ff684105ed0 2024-09-19T04:39:40.422 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.037+0000 7ff688a61640 1 --2- 172.21.15.2:0/162248655 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff684105ed0 0x7ff6841062d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff678009820 tx=0x7ff67802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e109d64a1583885c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:40.422 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.037+0000 7ff6837fe640 1 -- 172.21.15.2:0/162248655 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff678037070 con 0x7ff684105ed0 2024-09-19T04:39:40.422 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.037+0000 7ff6837fe640 1 -- 172.21.15.2:0/162248655 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff6780328f0 con 0x7ff684105ed0 2024-09-19T04:39:40.422 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.037+0000 7ff6837fe640 1 -- 172.21.15.2:0/162248655 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff678030740 con 0x7ff684105ed0 2024-09-19T04:39:40.422 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.038+0000 7ff68acc5640 1 -- 172.21.15.2:0/162248655 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff684105ed0 msgr2=0x7ff6841062d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:40.422 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.038+0000 7ff68acc5640 1 --2- 172.21.15.2:0/162248655 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff684105ed0 0x7ff6841062d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff678009820 tx=0x7ff67802a270 comp rx=0 tx=0).stop 2024-09-19T04:39:40.422 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.038+0000 7ff68acc5640 1 -- 172.21.15.2:0/162248655 shutdown_connections 2024-09-19T04:39:40.423 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.038+0000 7ff68acc5640 1 --2- 172.21.15.2:0/162248655 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff684105ed0 0x7ff6841062d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:40.423 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.038+0000 7ff68acc5640 1 -- 172.21.15.2:0/162248655 >> 172.21.15.2:0/162248655 conn(0x7ff684101ca0 msgr2=0x7ff6841040c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:40.423 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.038+0000 7ff68acc5640 1 -- 172.21.15.2:0/162248655 shutdown_connections 2024-09-19T04:39:40.423 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.038+0000 7ff68acc5640 1 -- 172.21.15.2:0/162248655 wait complete. 2024-09-19T04:39:40.423 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.039+0000 7ff68acc5640 1 Processor -- start 2024-09-19T04:39:40.423 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.039+0000 7ff68acc5640 1 -- start start 2024-09-19T04:39:40.423 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.039+0000 7ff68acc5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff684105ed0 0x7ff68419d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:40.423 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.039+0000 7ff68acc5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff6841078f0 con 0x7ff684105ed0 2024-09-19T04:39:40.423 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.039+0000 7ff688a61640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff684105ed0 0x7ff68419d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:40.423 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.039+0000 7ff688a61640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff684105ed0 0x7ff68419d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45896/0 (socket says 172.21.15.2:45896) 2024-09-19T04:39:40.423 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.039+0000 7ff688a61640 1 -- 172.21.15.2:0/3657924566 learned_addr learned my addr 172.21.15.2:0/3657924566 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:39:40.423 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.039+0000 7ff688a61640 1 -- 172.21.15.2:0/3657924566 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff68419dcf0 con 0x7ff684105ed0 2024-09-19T04:39:40.423 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.039+0000 7ff688a61640 1 --2- 172.21.15.2:0/3657924566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff684105ed0 0x7ff68419d7b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff6780327b0 tx=0x7ff6780327e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:40.424 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.040+0000 7ff681ffb640 1 -- 172.21.15.2:0/3657924566 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff678042070 con 0x7ff684105ed0 2024-09-19T04:39:40.424 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.040+0000 7ff681ffb640 1 -- 172.21.15.2:0/3657924566 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff678030d50 con 0x7ff684105ed0 2024-09-19T04:39:40.424 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.040+0000 7ff68acc5640 1 -- 172.21.15.2:0/3657924566 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff68419df80 con 0x7ff684105ed0 2024-09-19T04:39:40.424 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.040+0000 7ff681ffb640 1 -- 172.21.15.2:0/3657924566 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff678037040 con 0x7ff684105ed0 2024-09-19T04:39:40.424 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.040+0000 7ff68acc5640 1 -- 172.21.15.2:0/3657924566 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6841a0c70 con 0x7ff684105ed0 2024-09-19T04:39:40.424 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.041+0000 7ff681ffb640 1 -- 172.21.15.2:0/3657924566 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7ff678045070 con 0x7ff684105ed0 2024-09-19T04:39:40.424 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.041+0000 7ff681ffb640 1 --2- 172.21.15.2:0/3657924566 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7ff6740391b0 0x7ff67403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:40.424 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.041+0000 7ff681ffb640 1 -- 172.21.15.2:0/3657924566 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff67806c430 con 0x7ff684105ed0 2024-09-19T04:39:40.424 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.041+0000 7ff68acc5640 1 -- 172.21.15.2:0/3657924566 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6841062d0 con 0x7ff684105ed0 2024-09-19T04:39:40.424 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.041+0000 7ff683fff640 1 --2- 172.21.15.2:0/3657924566 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7ff6740391b0 0x7ff67403b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:40.424 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.042+0000 7ff683fff640 1 --2- 172.21.15.2:0/3657924566 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7ff6740391b0 0x7ff67403b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff6700098c0 tx=0x7ff670006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:40.424 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.047+0000 7ff681ffb640 1 -- 172.21.15.2:0/3657924566 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff678045360 con 0x7ff684105ed0 2024-09-19T04:39:40.424 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.241+0000 7ff68acc5640 1 -- 172.21.15.2:0/3657924566 --> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7ff68402d950 con 0x7ff6740391b0 2024-09-19T04:39:40.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.490+0000 7ff681ffb640 1 -- 172.21.15.2:0/3657924566 <== mgr.14150 v2:172.21.15.2:6800/3171525177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7ff68402d950 con 0x7ff6740391b0 2024-09-19T04:39:40.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.492+0000 7ff68acc5640 1 -- 172.21.15.2:0/3657924566 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7ff6740391b0 msgr2=0x7ff67403b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:40.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.492+0000 7ff68acc5640 1 --2- 172.21.15.2:0/3657924566 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7ff6740391b0 0x7ff67403b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff6700098c0 tx=0x7ff670006db0 comp rx=0 tx=0).stop 2024-09-19T04:39:40.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.492+0000 7ff68acc5640 1 -- 172.21.15.2:0/3657924566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff684105ed0 msgr2=0x7ff68419d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:40.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.492+0000 7ff68acc5640 1 --2- 172.21.15.2:0/3657924566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff684105ed0 0x7ff68419d7b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff6780327b0 tx=0x7ff6780327e0 comp rx=0 tx=0).stop 2024-09-19T04:39:40.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.492+0000 7ff68acc5640 1 -- 172.21.15.2:0/3657924566 shutdown_connections 2024-09-19T04:39:40.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.492+0000 7ff68acc5640 1 --2- 172.21.15.2:0/3657924566 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7ff6740391b0 0x7ff67403b670 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:40.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.492+0000 7ff68acc5640 1 --2- 172.21.15.2:0/3657924566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff684105ed0 0x7ff68419d7b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:40.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.492+0000 7ff68acc5640 1 -- 172.21.15.2:0/3657924566 >> 172.21.15.2:0/3657924566 conn(0x7ff684101ca0 msgr2=0x7ff684194430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:40.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.493+0000 7ff68acc5640 1 -- 172.21.15.2:0/3657924566 shutdown_connections 2024-09-19T04:39:40.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:39.493+0000 7ff68acc5640 1 -- 172.21.15.2:0/3657924566 wait complete. 2024-09-19T04:39:40.425 INFO:teuthology.orchestra.run.smithi002.stdout:Fetching dashboard port number... 2024-09-19T04:39:41.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:41 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/2059337253' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-19T04:39:41.586 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 8443 2024-09-19T04:39:41.586 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:40.838+0000 7fd78c77b640 1 Processor -- start 2024-09-19T04:39:41.586 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:40.838+0000 7fd78c77b640 1 -- start start 2024-09-19T04:39:41.586 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:40.839+0000 7fd78c77b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7841098b0 0x7fd784109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:41.586 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:40.839+0000 7fd78c77b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd78410a280 con 0x7fd7841098b0 2024-09-19T04:39:41.586 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:40.839+0000 7fd78a517640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7841098b0 0x7fd784109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:41.586 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:40.839+0000 7fd78a517640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7841098b0 0x7fd784109cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45904/0 (socket says 172.21.15.2:45904) 2024-09-19T04:39:41.586 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:40.839+0000 7fd78a517640 1 -- 172.21.15.2:0/1134808539 learned_addr learned my addr 172.21.15.2:0/1134808539 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:39:41.587 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:40.839+0000 7fd78a517640 1 -- 172.21.15.2:0/1134808539 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd78410a9f0 con 0x7fd7841098b0 2024-09-19T04:39:41.587 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:40.840+0000 7fd78a517640 1 --2- 172.21.15.2:0/1134808539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7841098b0 0x7fd784109cb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd774009e80 tx=0x7fd77402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a5bd5417cad7c4e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:41.587 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:40.840+0000 7fd789515640 1 -- 172.21.15.2:0/1134808539 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd774036070 con 0x7fd7841098b0 2024-09-19T04:39:41.587 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:40.840+0000 7fd789515640 1 -- 172.21.15.2:0/1134808539 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd7740318b0 con 0x7fd7841098b0 2024-09-19T04:39:41.587 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:40.840+0000 7fd789515640 1 -- 172.21.15.2:0/1134808539 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd774007930 con 0x7fd7841098b0 2024-09-19T04:39:41.587 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:40.841+0000 7fd78c77b640 1 -- 172.21.15.2:0/1134808539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7841098b0 msgr2=0x7fd784109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:41.587 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:40.841+0000 7fd78c77b640 1 --2- 172.21.15.2:0/1134808539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7841098b0 0x7fd784109cb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd774009e80 tx=0x7fd77402a7a0 comp rx=0 tx=0).stop 2024-09-19T04:39:41.587 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:40.841+0000 7fd78c77b640 1 -- 172.21.15.2:0/1134808539 shutdown_connections 2024-09-19T04:39:41.587 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:40.841+0000 7fd78c77b640 1 --2- 172.21.15.2:0/1134808539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7841098b0 0x7fd784109cb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:41.587 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:40.841+0000 7fd78c77b640 1 -- 172.21.15.2:0/1134808539 >> 172.21.15.2:0/1134808539 conn(0x7fd78407cdd0 msgr2=0x7fd78407d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:41.587 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:40.841+0000 7fd78c77b640 1 -- 172.21.15.2:0/1134808539 shutdown_connections 2024-09-19T04:39:41.587 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:40.841+0000 7fd78c77b640 1 -- 172.21.15.2:0/1134808539 wait complete. 2024-09-19T04:39:41.587 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:40.841+0000 7fd78c77b640 1 Processor -- start 2024-09-19T04:39:41.588 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:40.841+0000 7fd78c77b640 1 -- start start 2024-09-19T04:39:41.588 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:40.841+0000 7fd78c77b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7841098b0 0x7fd78419d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:41.588 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:40.841+0000 7fd78c77b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd78410dda0 con 0x7fd7841098b0 2024-09-19T04:39:41.588 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:40.842+0000 7fd78a517640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7841098b0 0x7fd78419d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:41.588 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:40.842+0000 7fd78a517640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7841098b0 0x7fd78419d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45910/0 (socket says 172.21.15.2:45910) 2024-09-19T04:39:41.588 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:40.842+0000 7fd78a517640 1 -- 172.21.15.2:0/2059337253 learned_addr learned my addr 172.21.15.2:0/2059337253 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:39:41.588 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:40.842+0000 7fd78a517640 1 -- 172.21.15.2:0/2059337253 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd78419dd30 con 0x7fd7841098b0 2024-09-19T04:39:41.588 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:40.842+0000 7fd78a517640 1 --2- 172.21.15.2:0/2059337253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7841098b0 0x7fd78419d7f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd774031c90 tx=0x7fd774031cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:41.588 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:40.842+0000 7fd7837fe640 1 -- 172.21.15.2:0/2059337253 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd774036050 con 0x7fd7841098b0 2024-09-19T04:39:41.588 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:40.842+0000 7fd78c77b640 1 -- 172.21.15.2:0/2059337253 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd78419dfc0 con 0x7fd7841098b0 2024-09-19T04:39:41.588 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:40.842+0000 7fd7837fe640 1 -- 172.21.15.2:0/2059337253 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd774042070 con 0x7fd7841098b0 2024-09-19T04:39:41.588 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:40.842+0000 7fd7837fe640 1 -- 172.21.15.2:0/2059337253 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd77403da30 con 0x7fd7841098b0 2024-09-19T04:39:41.588 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:40.842+0000 7fd78c77b640 1 -- 172.21.15.2:0/2059337253 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7841a0cb0 con 0x7fd7841098b0 2024-09-19T04:39:41.589 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:40.843+0000 7fd7837fe640 1 -- 172.21.15.2:0/2059337253 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7fd77403b740 con 0x7fd7841098b0 2024-09-19T04:39:41.589 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:40.843+0000 7fd78c77b640 1 -- 172.21.15.2:0/2059337253 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd78410df20 con 0x7fd7841098b0 2024-09-19T04:39:41.589 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:40.843+0000 7fd7837fe640 1 --2- 172.21.15.2:0/2059337253 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd76c039260 0x7fd76c03b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:41.589 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:40.843+0000 7fd7837fe640 1 -- 172.21.15.2:0/2059337253 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd77406d9f0 con 0x7fd7841098b0 2024-09-19T04:39:41.589 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:40.844+0000 7fd789d16640 1 --2- 172.21.15.2:0/2059337253 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd76c039260 0x7fd76c03b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:41.589 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:40.844+0000 7fd789d16640 1 --2- 172.21.15.2:0/2059337253 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd76c039260 0x7fd76c03b720 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd7780098c0 tx=0x7fd778006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:41.589 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:40.848+0000 7fd7837fe640 1 -- 172.21.15.2:0/2059337253 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd77404c200 con 0x7fd7841098b0 2024-09-19T04:39:41.589 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:41.023+0000 7fd78c77b640 1 -- 172.21.15.2:0/2059337253 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7fd7841a0e80 con 0x7fd7841098b0 2024-09-19T04:39:41.589 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:41.024+0000 7fd7837fe640 1 -- 172.21.15.2:0/2059337253 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7fd77403bd60 con 0x7fd7841098b0 2024-09-19T04:39:41.589 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:41.026+0000 7fd78c77b640 1 -- 172.21.15.2:0/2059337253 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd76c039260 msgr2=0x7fd76c03b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:41.589 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:41.026+0000 7fd78c77b640 1 --2- 172.21.15.2:0/2059337253 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd76c039260 0x7fd76c03b720 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd7780098c0 tx=0x7fd778006db0 comp rx=0 tx=0).stop 2024-09-19T04:39:41.589 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:41.026+0000 7fd78c77b640 1 -- 172.21.15.2:0/2059337253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7841098b0 msgr2=0x7fd78419d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:41.589 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:41.026+0000 7fd78c77b640 1 --2- 172.21.15.2:0/2059337253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7841098b0 0x7fd78419d7f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd774031c90 tx=0x7fd774031cc0 comp rx=0 tx=0).stop 2024-09-19T04:39:41.590 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:41.027+0000 7fd78c77b640 1 -- 172.21.15.2:0/2059337253 shutdown_connections 2024-09-19T04:39:41.590 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:41.027+0000 7fd78c77b640 1 --2- 172.21.15.2:0/2059337253 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd76c039260 0x7fd76c03b720 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:41.590 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:41.027+0000 7fd78c77b640 1 --2- 172.21.15.2:0/2059337253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7841098b0 0x7fd78419d7f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:41.590 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:41.027+0000 7fd78c77b640 1 -- 172.21.15.2:0/2059337253 >> 172.21.15.2:0/2059337253 conn(0x7fd78407cdd0 msgr2=0x7fd784107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:41.590 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:41.027+0000 7fd78c77b640 1 -- 172.21.15.2:0/2059337253 shutdown_connections 2024-09-19T04:39:41.590 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:41.027+0000 7fd78c77b640 1 -- 172.21.15.2:0/2059337253 wait complete. 2024-09-19T04:39:41.594 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T04:39:41.594 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout disabled 2024-09-19T04:39:41.602 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T04:39:41.602 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-09-19T04:39:41.602 INFO:teuthology.orchestra.run.smithi002.stdout:firewalld.service is not enabled 2024-09-19T04:39:41.602 INFO:teuthology.orchestra.run.smithi002.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-19T04:39:41.604 INFO:teuthology.orchestra.run.smithi002.stdout:Ceph Dashboard is now available at: 2024-09-19T04:39:41.604 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:39:41.604 INFO:teuthology.orchestra.run.smithi002.stdout: URL: https://smithi002.front.sepia.ceph.com:8443/ 2024-09-19T04:39:41.604 INFO:teuthology.orchestra.run.smithi002.stdout: User: admin 2024-09-19T04:39:41.605 INFO:teuthology.orchestra.run.smithi002.stdout: Password: i4k66apxyk 2024-09-19T04:39:41.605 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:39:41.605 INFO:teuthology.orchestra.run.smithi002.stdout:Saving cluster configuration to /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/config directory 2024-09-19T04:39:42.868 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.067+0000 7fa9828c8640 1 Processor -- start 2024-09-19T04:39:42.868 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.068+0000 7fa9828c8640 1 -- start start 2024-09-19T04:39:42.868 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.068+0000 7fa9828c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa97c106470 0x7fa97c106870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:42.868 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.068+0000 7fa9828c8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa97c106e40 con 0x7fa97c106470 2024-09-19T04:39:42.868 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.068+0000 7fa97bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa97c106470 0x7fa97c106870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:42.868 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.068+0000 7fa97bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa97c106470 0x7fa97c106870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58310/0 (socket says 172.21.15.2:58310) 2024-09-19T04:39:42.868 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.068+0000 7fa97bfff640 1 -- 172.21.15.2:0/1621848653 learned_addr learned my addr 172.21.15.2:0/1621848653 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:39:42.869 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.068+0000 7fa97bfff640 1 -- 172.21.15.2:0/1621848653 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa97c107670 con 0x7fa97c106470 2024-09-19T04:39:42.869 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.069+0000 7fa97bfff640 1 --2- 172.21.15.2:0/1621848653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa97c106470 0x7fa97c106870 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa96c009820 tx=0x7fa96c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=710d1c94e36c3e47 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:42.869 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.069+0000 7fa97affd640 1 -- 172.21.15.2:0/1621848653 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa96c037070 con 0x7fa97c106470 2024-09-19T04:39:42.869 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.069+0000 7fa97affd640 1 -- 172.21.15.2:0/1621848653 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa96c0328f0 con 0x7fa97c106470 2024-09-19T04:39:42.869 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.069+0000 7fa97affd640 1 -- 172.21.15.2:0/1621848653 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa96c030740 con 0x7fa97c106470 2024-09-19T04:39:42.869 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.070+0000 7fa9828c8640 1 -- 172.21.15.2:0/1621848653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa97c106470 msgr2=0x7fa97c106870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:42.869 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.070+0000 7fa9828c8640 1 --2- 172.21.15.2:0/1621848653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa97c106470 0x7fa97c106870 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa96c009820 tx=0x7fa96c02a270 comp rx=0 tx=0).stop 2024-09-19T04:39:42.869 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.070+0000 7fa9828c8640 1 -- 172.21.15.2:0/1621848653 shutdown_connections 2024-09-19T04:39:42.869 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.070+0000 7fa9828c8640 1 --2- 172.21.15.2:0/1621848653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa97c106470 0x7fa97c106870 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:42.869 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.070+0000 7fa9828c8640 1 -- 172.21.15.2:0/1621848653 >> 172.21.15.2:0/1621848653 conn(0x7fa97c101c00 msgr2=0x7fa97c104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:42.869 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.070+0000 7fa9828c8640 1 -- 172.21.15.2:0/1621848653 shutdown_connections 2024-09-19T04:39:42.869 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.070+0000 7fa9828c8640 1 -- 172.21.15.2:0/1621848653 wait complete. 2024-09-19T04:39:42.870 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.071+0000 7fa9828c8640 1 Processor -- start 2024-09-19T04:39:42.870 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.071+0000 7fa9828c8640 1 -- start start 2024-09-19T04:39:42.870 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.071+0000 7fa9828c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa97c106470 0x7fa97c19b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:42.870 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.071+0000 7fa9828c8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa97c10aa20 con 0x7fa97c106470 2024-09-19T04:39:42.870 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.071+0000 7fa97bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa97c106470 0x7fa97c19b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:42.870 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.071+0000 7fa97bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa97c106470 0x7fa97c19b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58314/0 (socket says 172.21.15.2:58314) 2024-09-19T04:39:42.870 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.071+0000 7fa97bfff640 1 -- 172.21.15.2:0/1529885368 learned_addr learned my addr 172.21.15.2:0/1529885368 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:39:42.870 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.072+0000 7fa97bfff640 1 -- 172.21.15.2:0/1529885368 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa97c19bad0 con 0x7fa97c106470 2024-09-19T04:39:42.870 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.072+0000 7fa97bfff640 1 --2- 172.21.15.2:0/1529885368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa97c106470 0x7fa97c19b590 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa96c0097f0 tx=0x7fa96c030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:42.870 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.072+0000 7fa9797fa640 1 -- 172.21.15.2:0/1529885368 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa96c042070 con 0x7fa97c106470 2024-09-19T04:39:42.870 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.072+0000 7fa9797fa640 1 -- 172.21.15.2:0/1529885368 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa96c030d80 con 0x7fa97c106470 2024-09-19T04:39:42.870 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.072+0000 7fa9828c8640 1 -- 172.21.15.2:0/1529885368 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa97c19bd60 con 0x7fa97c106470 2024-09-19T04:39:42.870 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.072+0000 7fa9797fa640 1 -- 172.21.15.2:0/1529885368 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa96c037040 con 0x7fa97c106470 2024-09-19T04:39:42.871 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.072+0000 7fa9828c8640 1 -- 172.21.15.2:0/1529885368 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa97c19ea50 con 0x7fa97c106470 2024-09-19T04:39:42.871 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.073+0000 7fa9797fa640 1 -- 172.21.15.2:0/1529885368 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7fa96c045070 con 0x7fa97c106470 2024-09-19T04:39:42.871 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.073+0000 7fa9828c8640 1 -- 172.21.15.2:0/1529885368 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa97c10aba0 con 0x7fa97c106470 2024-09-19T04:39:42.871 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.073+0000 7fa9797fa640 1 --2- 172.21.15.2:0/1529885368 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fa964039260 0x7fa96403b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:42.871 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.073+0000 7fa9797fa640 1 -- 172.21.15.2:0/1529885368 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa96c06c440 con 0x7fa97c106470 2024-09-19T04:39:42.871 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.073+0000 7fa97b7fe640 1 --2- 172.21.15.2:0/1529885368 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fa964039260 0x7fa96403b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:42.871 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.074+0000 7fa97b7fe640 1 --2- 172.21.15.2:0/1529885368 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fa964039260 0x7fa96403b720 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa9700098c0 tx=0x7fa970006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:42.871 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.078+0000 7fa9797fa640 1 -- 172.21.15.2:0/1529885368 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa96c045520 con 0x7fa97c106470 2024-09-19T04:39:42.871 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.081+0000 7fa9797fa640 1 -- 172.21.15.2:0/1529885368 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fa96c03cb30 con 0x7fa97c106470 2024-09-19T04:39:42.871 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.347+0000 7fa9828c8640 1 -- 172.21.15.2:0/1529885368 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7fa97c19ec20 con 0x7fa97c106470 2024-09-19T04:39:42.871 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.350+0000 7fa9797fa640 1 -- 172.21.15.2:0/1529885368 <== mon.0 v2:172.21.15.2:3300/0 8 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7fa96c0392e0 con 0x7fa97c106470 2024-09-19T04:39:42.871 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-19T04:39:42.871 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.352+0000 7fa9828c8640 1 -- 172.21.15.2:0/1529885368 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fa964039260 msgr2=0x7fa96403b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:42.872 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.352+0000 7fa9828c8640 1 --2- 172.21.15.2:0/1529885368 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fa964039260 0x7fa96403b720 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa9700098c0 tx=0x7fa970006db0 comp rx=0 tx=0).stop 2024-09-19T04:39:42.872 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.352+0000 7fa9828c8640 1 -- 172.21.15.2:0/1529885368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa97c106470 msgr2=0x7fa97c19b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:42.872 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.352+0000 7fa9828c8640 1 --2- 172.21.15.2:0/1529885368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa97c106470 0x7fa97c19b590 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa96c0097f0 tx=0x7fa96c030c70 comp rx=0 tx=0).stop 2024-09-19T04:39:42.872 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.352+0000 7fa9828c8640 1 -- 172.21.15.2:0/1529885368 shutdown_connections 2024-09-19T04:39:42.872 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.352+0000 7fa9828c8640 1 --2- 172.21.15.2:0/1529885368 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fa964039260 0x7fa96403b720 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:42.872 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.352+0000 7fa9828c8640 1 --2- 172.21.15.2:0/1529885368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa97c106470 0x7fa97c19b590 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:42.872 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.352+0000 7fa9828c8640 1 -- 172.21.15.2:0/1529885368 >> 172.21.15.2:0/1529885368 conn(0x7fa97c101c00 msgr2=0x7fa97c1027a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:42.872 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.352+0000 7fa9828c8640 1 -- 172.21.15.2:0/1529885368 shutdown_connections 2024-09-19T04:39:42.872 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T04:39:42.352+0000 7fa9828c8640 1 -- 172.21.15.2:0/1529885368 wait complete. 2024-09-19T04:39:42.872 INFO:teuthology.orchestra.run.smithi002.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-19T04:39:42.872 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:39:42.872 INFO:teuthology.orchestra.run.smithi002.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-19T04:39:42.872 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:39:42.872 INFO:teuthology.orchestra.run.smithi002.stdout:Or, if you are only running a single cluster on this host: 2024-09-19T04:39:42.873 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:39:42.873 INFO:teuthology.orchestra.run.smithi002.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-19T04:39:42.873 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:39:42.873 INFO:teuthology.orchestra.run.smithi002.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-19T04:39:42.873 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:39:42.873 INFO:teuthology.orchestra.run.smithi002.stdout: ceph telemetry on 2024-09-19T04:39:42.873 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:39:42.873 INFO:teuthology.orchestra.run.smithi002.stdout:For more information see: 2024-09-19T04:39:42.873 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:39:42.873 INFO:teuthology.orchestra.run.smithi002.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-19T04:39:42.873 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:39:42.873 INFO:teuthology.orchestra.run.smithi002.stdout:Bootstrap complete. 2024-09-19T04:39:42.909 INFO:tasks.cephadm:Fetching config... 2024-09-19T04:39:42.909 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-19T04:39:42.909 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-19T04:39:42.926 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-19T04:39:42.926 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-19T04:39:42.926 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-19T04:39:42.982 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-19T04:39:42.982 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-19T04:39:42.982 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-19T04:39:43.048 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-19T04:39:43.048 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-19T04:39:43.048 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-19T04:39:43.105 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-19T04:39:43.105 DEBUG:teuthology.orchestra.run.smithi002:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBVTpzessfEhWnNlv/R69ZZfY6leSrxreLE+293+RK70utRPZNts0oRYPKtLihoK20MllGLFzeFGtWv/GXf4EfQ7lKASP0M1eo4q8nnYkgN5sd5MZJbizoBEOXn8e1XgmydAfw6KITVC03myKRXnbADXe4LsmUWiK6SJUFVDdWkgsYFTGYB7ZzP4QSRBx2F4bVckr+yrk4Gy+cJZ9+36NXCIG5MlvGODgTDVqiLYxQrVpczJDfkce8qUe1a6O+JTOvnMcbGqMHwFJ9cGrDKpVCDrYx/WqWJ6lYnQVQ6/3lyTAhNQqKf257VhXojp30XPwaOL42NH8OGXYaETDLKSFXsR9pWPzwS43VrYW52qAyza0aalyYnDElhdzk4HSfiEmeex5t1o8S7iMneREVNybOZEUXMzRERjLjMSyNpHxLIhWzFpxE6EVXYzokXfhrg5hh7AQaKG0sSkEWKEfWpf1uZZmcIA/R/5TwsH7qBkCMqnSs2vQm4C3n6m/9AbO+wGc= ceph-d46630c4-7640-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T04:39:43.167 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:43 smithi002 ceph-mon[30975]: mgrmap e13: x(active, since 6s) 2024-09-19T04:39:43.167 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:43 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/1529885368' entity='client.admin' 2024-09-19T04:39:43.181 INFO:teuthology.orchestra.run.smithi002.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBVTpzessfEhWnNlv/R69ZZfY6leSrxreLE+293+RK70utRPZNts0oRYPKtLihoK20MllGLFzeFGtWv/GXf4EfQ7lKASP0M1eo4q8nnYkgN5sd5MZJbizoBEOXn8e1XgmydAfw6KITVC03myKRXnbADXe4LsmUWiK6SJUFVDdWkgsYFTGYB7ZzP4QSRBx2F4bVckr+yrk4Gy+cJZ9+36NXCIG5MlvGODgTDVqiLYxQrVpczJDfkce8qUe1a6O+JTOvnMcbGqMHwFJ9cGrDKpVCDrYx/WqWJ6lYnQVQ6/3lyTAhNQqKf257VhXojp30XPwaOL42NH8OGXYaETDLKSFXsR9pWPzwS43VrYW52qAyza0aalyYnDElhdzk4HSfiEmeex5t1o8S7iMneREVNybOZEUXMzRERjLjMSyNpHxLIhWzFpxE6EVXYzokXfhrg5hh7AQaKG0sSkEWKEfWpf1uZZmcIA/R/5TwsH7qBkCMqnSs2vQm4C3n6m/9AbO+wGc= ceph-d46630c4-7640-11ef-bceb-c7b262605968 2024-09-19T04:39:43.193 DEBUG:teuthology.orchestra.run.smithi018:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBVTpzessfEhWnNlv/R69ZZfY6leSrxreLE+293+RK70utRPZNts0oRYPKtLihoK20MllGLFzeFGtWv/GXf4EfQ7lKASP0M1eo4q8nnYkgN5sd5MZJbizoBEOXn8e1XgmydAfw6KITVC03myKRXnbADXe4LsmUWiK6SJUFVDdWkgsYFTGYB7ZzP4QSRBx2F4bVckr+yrk4Gy+cJZ9+36NXCIG5MlvGODgTDVqiLYxQrVpczJDfkce8qUe1a6O+JTOvnMcbGqMHwFJ9cGrDKpVCDrYx/WqWJ6lYnQVQ6/3lyTAhNQqKf257VhXojp30XPwaOL42NH8OGXYaETDLKSFXsR9pWPzwS43VrYW52qAyza0aalyYnDElhdzk4HSfiEmeex5t1o8S7iMneREVNybOZEUXMzRERjLjMSyNpHxLIhWzFpxE6EVXYzokXfhrg5hh7AQaKG0sSkEWKEfWpf1uZZmcIA/R/5TwsH7qBkCMqnSs2vQm4C3n6m/9AbO+wGc= ceph-d46630c4-7640-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T04:39:43.245 INFO:teuthology.orchestra.run.smithi018.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBVTpzessfEhWnNlv/R69ZZfY6leSrxreLE+293+RK70utRPZNts0oRYPKtLihoK20MllGLFzeFGtWv/GXf4EfQ7lKASP0M1eo4q8nnYkgN5sd5MZJbizoBEOXn8e1XgmydAfw6KITVC03myKRXnbADXe4LsmUWiK6SJUFVDdWkgsYFTGYB7ZzP4QSRBx2F4bVckr+yrk4Gy+cJZ9+36NXCIG5MlvGODgTDVqiLYxQrVpczJDfkce8qUe1a6O+JTOvnMcbGqMHwFJ9cGrDKpVCDrYx/WqWJ6lYnQVQ6/3lyTAhNQqKf257VhXojp30XPwaOL42NH8OGXYaETDLKSFXsR9pWPzwS43VrYW52qAyza0aalyYnDElhdzk4HSfiEmeex5t1o8S7iMneREVNybOZEUXMzRERjLjMSyNpHxLIhWzFpxE6EVXYzokXfhrg5hh7AQaKG0sSkEWKEfWpf1uZZmcIA/R/5TwsH7qBkCMqnSs2vQm4C3n6m/9AbO+wGc= ceph-d46630c4-7640-11ef-bceb-c7b262605968 2024-09-19T04:39:43.259 DEBUG:teuthology.orchestra.run.smithi116:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBVTpzessfEhWnNlv/R69ZZfY6leSrxreLE+293+RK70utRPZNts0oRYPKtLihoK20MllGLFzeFGtWv/GXf4EfQ7lKASP0M1eo4q8nnYkgN5sd5MZJbizoBEOXn8e1XgmydAfw6KITVC03myKRXnbADXe4LsmUWiK6SJUFVDdWkgsYFTGYB7ZzP4QSRBx2F4bVckr+yrk4Gy+cJZ9+36NXCIG5MlvGODgTDVqiLYxQrVpczJDfkce8qUe1a6O+JTOvnMcbGqMHwFJ9cGrDKpVCDrYx/WqWJ6lYnQVQ6/3lyTAhNQqKf257VhXojp30XPwaOL42NH8OGXYaETDLKSFXsR9pWPzwS43VrYW52qAyza0aalyYnDElhdzk4HSfiEmeex5t1o8S7iMneREVNybOZEUXMzRERjLjMSyNpHxLIhWzFpxE6EVXYzokXfhrg5hh7AQaKG0sSkEWKEfWpf1uZZmcIA/R/5TwsH7qBkCMqnSs2vQm4C3n6m/9AbO+wGc= ceph-d46630c4-7640-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T04:39:43.308 INFO:teuthology.orchestra.run.smithi116.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBVTpzessfEhWnNlv/R69ZZfY6leSrxreLE+293+RK70utRPZNts0oRYPKtLihoK20MllGLFzeFGtWv/GXf4EfQ7lKASP0M1eo4q8nnYkgN5sd5MZJbizoBEOXn8e1XgmydAfw6KITVC03myKRXnbADXe4LsmUWiK6SJUFVDdWkgsYFTGYB7ZzP4QSRBx2F4bVckr+yrk4Gy+cJZ9+36NXCIG5MlvGODgTDVqiLYxQrVpczJDfkce8qUe1a6O+JTOvnMcbGqMHwFJ9cGrDKpVCDrYx/WqWJ6lYnQVQ6/3lyTAhNQqKf257VhXojp30XPwaOL42NH8OGXYaETDLKSFXsR9pWPzwS43VrYW52qAyza0aalyYnDElhdzk4HSfiEmeex5t1o8S7iMneREVNybOZEUXMzRERjLjMSyNpHxLIhWzFpxE6EVXYzokXfhrg5hh7AQaKG0sSkEWKEfWpf1uZZmcIA/R/5TwsH7qBkCMqnSs2vQm4C3n6m/9AbO+wGc= ceph-d46630c4-7640-11ef-bceb-c7b262605968 2024-09-19T04:39:43.322 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-19T04:39:43.628 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:39:44.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:44.094+0000 7f2ccd69d640 1 -- 172.21.15.2:0/4223519898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cc80ffcc0 msgr2=0x7f2cc81000c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:44.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:44.094+0000 7f2ccd69d640 1 --2- 172.21.15.2:0/4223519898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cc80ffcc0 0x7f2cc81000c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8009880 tx=0x7f2cb802b6e0 comp rx=0 tx=0).stop 2024-09-19T04:39:44.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:44.094+0000 7f2ccd69d640 1 -- 172.21.15.2:0/4223519898 shutdown_connections 2024-09-19T04:39:44.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:44.094+0000 7f2ccd69d640 1 --2- 172.21.15.2:0/4223519898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cc80ffcc0 0x7f2cc81000c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:44.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:44.094+0000 7f2ccd69d640 1 -- 172.21.15.2:0/4223519898 >> 172.21.15.2:0/4223519898 conn(0x7f2cc80fb450 msgr2=0x7f2cc80fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:44.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:44.094+0000 7f2ccd69d640 1 -- 172.21.15.2:0/4223519898 shutdown_connections 2024-09-19T04:39:44.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:44.094+0000 7f2ccd69d640 1 -- 172.21.15.2:0/4223519898 wait complete. 2024-09-19T04:39:44.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:44.095+0000 7f2ccd69d640 1 Processor -- start 2024-09-19T04:39:44.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:44.095+0000 7f2ccd69d640 1 -- start start 2024-09-19T04:39:44.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:44.095+0000 7f2ccd69d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cc80ffcc0 0x7f2cc8194a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:44.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:44.095+0000 7f2ccd69d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc8105380 con 0x7f2cc80ffcc0 2024-09-19T04:39:44.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:44.095+0000 7f2cc6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cc80ffcc0 0x7f2cc8194a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:44.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:44.095+0000 7f2cc6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cc80ffcc0 0x7f2cc8194a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58334/0 (socket says 172.21.15.2:58334) 2024-09-19T04:39:44.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:44.095+0000 7f2cc6ffd640 1 -- 172.21.15.2:0/4188986470 learned_addr learned my addr 172.21.15.2:0/4188986470 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:39:44.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:44.096+0000 7f2cc6ffd640 1 -- 172.21.15.2:0/4188986470 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cc8194fd0 con 0x7f2cc80ffcc0 2024-09-19T04:39:44.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:44.096+0000 7f2cc6ffd640 1 --2- 172.21.15.2:0/4188986470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cc80ffcc0 0x7f2cc8194a90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8005ec0 tx=0x7f2cb80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:44.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:44.096+0000 7f2caffff640 1 -- 172.21.15.2:0/4188986470 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cb8040070 con 0x7f2cc80ffcc0 2024-09-19T04:39:44.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:44.096+0000 7f2ccd69d640 1 -- 172.21.15.2:0/4188986470 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cc8195260 con 0x7f2cc80ffcc0 2024-09-19T04:39:44.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:44.096+0000 7f2caffff640 1 -- 172.21.15.2:0/4188986470 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2cb8003aa0 con 0x7f2cc80ffcc0 2024-09-19T04:39:44.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:44.096+0000 7f2caffff640 1 -- 172.21.15.2:0/4188986470 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cb8036030 con 0x7f2cc80ffcc0 2024-09-19T04:39:44.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:44.096+0000 7f2ccd69d640 1 -- 172.21.15.2:0/4188986470 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cc8197f50 con 0x7f2cc80ffcc0 2024-09-19T04:39:44.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:44.097+0000 7f2caffff640 1 -- 172.21.15.2:0/4188986470 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f2cb8043070 con 0x7f2cc80ffcc0 2024-09-19T04:39:44.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:44.097+0000 7f2ccd69d640 1 -- 172.21.15.2:0/4188986470 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cc8105b00 con 0x7f2cc80ffcc0 2024-09-19T04:39:44.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:44.097+0000 7f2caffff640 1 --2- 172.21.15.2:0/4188986470 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f2cb00392a0 0x7f2cb003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:44.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:44.097+0000 7f2caffff640 1 -- 172.21.15.2:0/4188986470 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f2cb806efb0 con 0x7f2cc80ffcc0 2024-09-19T04:39:44.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:44.097+0000 7f2cc67fc640 1 --2- 172.21.15.2:0/4188986470 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f2cb00392a0 0x7f2cb003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:44.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:44.098+0000 7f2cc67fc640 1 --2- 172.21.15.2:0/4188986470 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f2cb00392a0 0x7f2cb003b760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc0098c0 tx=0x7f2cbc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:44.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:44.102+0000 7f2caffff640 1 -- 172.21.15.2:0/4188986470 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2cb80443b0 con 0x7f2cc80ffcc0 2024-09-19T04:39:44.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:44.284+0000 7f2ccd69d640 1 -- 172.21.15.2:0/4188986470 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f2cc802d880 con 0x7f2cc80ffcc0 2024-09-19T04:39:44.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:44.287+0000 7f2caffff640 1 -- 172.21.15.2:0/4188986470 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f2cb8030300 con 0x7f2cc80ffcc0 2024-09-19T04:39:44.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:44.289+0000 7f2ccd69d640 1 -- 172.21.15.2:0/4188986470 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f2cb00392a0 msgr2=0x7f2cb003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:44.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:44.289+0000 7f2ccd69d640 1 --2- 172.21.15.2:0/4188986470 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f2cb00392a0 0x7f2cb003b760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc0098c0 tx=0x7f2cbc006db0 comp rx=0 tx=0).stop 2024-09-19T04:39:44.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:44.289+0000 7f2ccd69d640 1 -- 172.21.15.2:0/4188986470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cc80ffcc0 msgr2=0x7f2cc8194a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:44.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:44.289+0000 7f2ccd69d640 1 --2- 172.21.15.2:0/4188986470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cc80ffcc0 0x7f2cc8194a90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8005ec0 tx=0x7f2cb80048f0 comp rx=0 tx=0).stop 2024-09-19T04:39:44.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:44.290+0000 7f2ccd69d640 1 -- 172.21.15.2:0/4188986470 shutdown_connections 2024-09-19T04:39:44.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:44.290+0000 7f2ccd69d640 1 --2- 172.21.15.2:0/4188986470 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f2cb00392a0 0x7f2cb003b760 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:44.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:44.290+0000 7f2ccd69d640 1 --2- 172.21.15.2:0/4188986470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cc80ffcc0 0x7f2cc8194a90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:44.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:44.290+0000 7f2ccd69d640 1 -- 172.21.15.2:0/4188986470 >> 172.21.15.2:0/4188986470 conn(0x7f2cc80fb450 msgr2=0x7f2cc80fbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:44.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:44.290+0000 7f2ccd69d640 1 -- 172.21.15.2:0/4188986470 shutdown_connections 2024-09-19T04:39:44.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:44.290+0000 7f2ccd69d640 1 -- 172.21.15.2:0/4188986470 wait complete. 2024-09-19T04:39:45.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:45 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/4188986470' entity='client.admin' 2024-09-19T04:39:45.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:45 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:39:45.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:45 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:39:45.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:45 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi002", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:39:45.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:45 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:39:45.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:45 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:39:45.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:45 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:39:45.514 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-19T04:39:45.514 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-19T04:39:45.773 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:39:46.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:46.255+0000 7fe6dd170640 1 -- 172.21.15.2:0/1340295922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6d81004e0 msgr2=0x7fe6d81008e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:46.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:46.255+0000 7fe6dd170640 1 --2- 172.21.15.2:0/1340295922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6d81004e0 0x7fe6d81008e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe6c8009880 tx=0x7fe6c802a5d0 comp rx=0 tx=0).stop 2024-09-19T04:39:46.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:46.255+0000 7fe6dd170640 1 -- 172.21.15.2:0/1340295922 shutdown_connections 2024-09-19T04:39:46.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:46.255+0000 7fe6dd170640 1 --2- 172.21.15.2:0/1340295922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6d81004e0 0x7fe6d81008e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:46.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:46.255+0000 7fe6dd170640 1 -- 172.21.15.2:0/1340295922 >> 172.21.15.2:0/1340295922 conn(0x7fe6d80fbc90 msgr2=0x7fe6d80fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:46.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:46.255+0000 7fe6dd170640 1 -- 172.21.15.2:0/1340295922 shutdown_connections 2024-09-19T04:39:46.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:46.255+0000 7fe6dd170640 1 -- 172.21.15.2:0/1340295922 wait complete. 2024-09-19T04:39:46.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:46.256+0000 7fe6dd170640 1 Processor -- start 2024-09-19T04:39:46.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:46.256+0000 7fe6dd170640 1 -- start start 2024-09-19T04:39:46.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:46.256+0000 7fe6dd170640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6d81004e0 0x7fe6d8198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:46.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:46.256+0000 7fe6dd170640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe6d81064a0 con 0x7fe6d81004e0 2024-09-19T04:39:46.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:46.257+0000 7fe6d6d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6d81004e0 0x7fe6d8198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:46.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:46.257+0000 7fe6d6d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6d81004e0 0x7fe6d8198ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58346/0 (socket says 172.21.15.2:58346) 2024-09-19T04:39:46.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:46.257+0000 7fe6d6d9d640 1 -- 172.21.15.2:0/957492508 learned_addr learned my addr 172.21.15.2:0/957492508 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:39:46.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:46.257+0000 7fe6d6d9d640 1 -- 172.21.15.2:0/957492508 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6d81993e0 con 0x7fe6d81004e0 2024-09-19T04:39:46.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:46.257+0000 7fe6d6d9d640 1 --2- 172.21.15.2:0/957492508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6d81004e0 0x7fe6d8198ea0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe6c8009230 tx=0x7fe6c80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:46.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:46.257+0000 7fe6cffff640 1 -- 172.21.15.2:0/957492508 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6c803f070 con 0x7fe6d81004e0 2024-09-19T04:39:46.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:46.257+0000 7fe6cffff640 1 -- 172.21.15.2:0/957492508 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe6c8003aa0 con 0x7fe6d81004e0 2024-09-19T04:39:46.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:46.257+0000 7fe6dd170640 1 -- 172.21.15.2:0/957492508 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6d8199670 con 0x7fe6d81004e0 2024-09-19T04:39:46.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:46.257+0000 7fe6cffff640 1 -- 172.21.15.2:0/957492508 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6c8035030 con 0x7fe6d81004e0 2024-09-19T04:39:46.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:46.257+0000 7fe6dd170640 1 -- 172.21.15.2:0/957492508 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6d819c360 con 0x7fe6d81004e0 2024-09-19T04:39:46.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:46.258+0000 7fe6cffff640 1 -- 172.21.15.2:0/957492508 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fe6c8042070 con 0x7fe6d81004e0 2024-09-19T04:39:46.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:46.258+0000 7fe6dd170640 1 -- 172.21.15.2:0/957492508 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6d8106c20 con 0x7fe6d81004e0 2024-09-19T04:39:46.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:46.258+0000 7fe6cffff640 1 --2- 172.21.15.2:0/957492508 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe6c40392a0 0x7fe6c403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:46.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:46.259+0000 7fe6cffff640 1 -- 172.21.15.2:0/957492508 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fe6c806d100 con 0x7fe6d81004e0 2024-09-19T04:39:46.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:46.259+0000 7fe6d659c640 1 --2- 172.21.15.2:0/957492508 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe6c40392a0 0x7fe6c403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:46.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:46.259+0000 7fe6d659c640 1 --2- 172.21.15.2:0/957492508 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe6c40392a0 0x7fe6c403b760 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe6c00098c0 tx=0x7fe6c0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:46.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:46.263+0000 7fe6cffff640 1 -- 172.21.15.2:0/957492508 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe6c802f300 con 0x7fe6d81004e0 2024-09-19T04:39:46.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:46.444+0000 7fe6dd170640 1 -- 172.21.15.2:0/957492508 --> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7fe6d80fd300 con 0x7fe6c40392a0 2024-09-19T04:39:46.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:46.447+0000 7fe6cffff640 1 -- 172.21.15.2:0/957492508 <== mgr.14150 v2:172.21.15.2:6800/3171525177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe6d80fd300 con 0x7fe6c40392a0 2024-09-19T04:39:46.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:46.450+0000 7fe6dd170640 1 -- 172.21.15.2:0/957492508 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe6c40392a0 msgr2=0x7fe6c403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:46.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:46.450+0000 7fe6dd170640 1 --2- 172.21.15.2:0/957492508 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe6c40392a0 0x7fe6c403b760 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe6c00098c0 tx=0x7fe6c0006db0 comp rx=0 tx=0).stop 2024-09-19T04:39:46.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:46.450+0000 7fe6dd170640 1 -- 172.21.15.2:0/957492508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6d81004e0 msgr2=0x7fe6d8198ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:46.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:46.450+0000 7fe6dd170640 1 --2- 172.21.15.2:0/957492508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6d81004e0 0x7fe6d8198ea0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe6c8009230 tx=0x7fe6c80048f0 comp rx=0 tx=0).stop 2024-09-19T04:39:46.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:46.450+0000 7fe6dd170640 1 -- 172.21.15.2:0/957492508 shutdown_connections 2024-09-19T04:39:46.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:46.450+0000 7fe6dd170640 1 --2- 172.21.15.2:0/957492508 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe6c40392a0 0x7fe6c403b760 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:46.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:46.450+0000 7fe6dd170640 1 --2- 172.21.15.2:0/957492508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6d81004e0 0x7fe6d8198ea0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:46.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:46.450+0000 7fe6dd170640 1 -- 172.21.15.2:0/957492508 >> 172.21.15.2:0/957492508 conn(0x7fe6d80fbc90 msgr2=0x7fe6d806a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:46.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:46.451+0000 7fe6dd170640 1 -- 172.21.15.2:0/957492508 shutdown_connections 2024-09-19T04:39:46.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:46.451+0000 7fe6dd170640 1 -- 172.21.15.2:0/957492508 wait complete. 2024-09-19T04:39:47.169 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi018 2024-09-19T04:39:47.169 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T04:39:47.170 DEBUG:teuthology.orchestra.run.smithi018:> dd of=/etc/ceph/ceph.conf 2024-09-19T04:39:47.189 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T04:39:47.189 DEBUG:teuthology.orchestra.run.smithi018:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T04:39:47.249 INFO:tasks.cephadm:Adding host smithi018 to orchestrator... 2024-09-19T04:39:47.249 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph orch host add smithi018 2024-09-19T04:39:47.685 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:39:47.806 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:47 smithi002 ceph-mon[30975]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:39:47.836 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:47 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:39:47.836 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:47 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:39:47.836 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:47 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:39:47.836 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:47 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:39:47.836 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:47 smithi002 ceph-mon[30975]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-19T04:39:47.836 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:47 smithi002 ceph-mon[30975]: Updating smithi002:/var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:39:47.837 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:47 smithi002 ceph-mon[30975]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2024-09-19T04:39:47.837 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:47 smithi002 ceph-mon[30975]: Updating smithi002:/var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T04:39:47.837 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:47 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:39:47.837 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:47 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:39:47.837 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:47 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:39:48.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:48.052+0000 7f6a8e17b640 1 -- 172.21.15.2:0/3462177804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a88102730 msgr2=0x7f6a88102b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:48.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:48.052+0000 7f6a8e17b640 1 --2- 172.21.15.2:0/3462177804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a88102730 0x7f6a88102b10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6a78009c10 tx=0x7f6a7802aa10 comp rx=0 tx=0).stop 2024-09-19T04:39:48.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:48.052+0000 7f6a8e17b640 1 -- 172.21.15.2:0/3462177804 shutdown_connections 2024-09-19T04:39:48.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:48.052+0000 7f6a8e17b640 1 --2- 172.21.15.2:0/3462177804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a88102730 0x7f6a88102b10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:48.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:48.052+0000 7f6a8e17b640 1 -- 172.21.15.2:0/3462177804 >> 172.21.15.2:0/3462177804 conn(0x7f6a88077310 msgr2=0x7f6a880fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:48.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:48.052+0000 7f6a8e17b640 1 -- 172.21.15.2:0/3462177804 shutdown_connections 2024-09-19T04:39:48.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:48.052+0000 7f6a8e17b640 1 -- 172.21.15.2:0/3462177804 wait complete. 2024-09-19T04:39:48.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:48.052+0000 7f6a8e17b640 1 Processor -- start 2024-09-19T04:39:48.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:48.053+0000 7f6a8e17b640 1 -- start start 2024-09-19T04:39:48.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:48.053+0000 7f6a8e17b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a88102730 0x7f6a88197110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:48.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:48.053+0000 7f6a8e17b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6a8810bb30 con 0x7f6a88102730 2024-09-19T04:39:48.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:48.053+0000 7f6a877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a88102730 0x7f6a88197110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:48.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:48.053+0000 7f6a877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a88102730 0x7f6a88197110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58376/0 (socket says 172.21.15.2:58376) 2024-09-19T04:39:48.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:48.053+0000 7f6a877fe640 1 -- 172.21.15.2:0/1190308667 learned_addr learned my addr 172.21.15.2:0/1190308667 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:39:48.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:48.053+0000 7f6a877fe640 1 -- 172.21.15.2:0/1190308667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a88197650 con 0x7f6a88102730 2024-09-19T04:39:48.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:48.054+0000 7f6a877fe640 1 --2- 172.21.15.2:0/1190308667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a88102730 0x7f6a88197110 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6a78005dd0 tx=0x7f6a7802f980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:48.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:48.054+0000 7f6a84ff9640 1 -- 172.21.15.2:0/1190308667 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a78034070 con 0x7f6a88102730 2024-09-19T04:39:48.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:48.054+0000 7f6a8e17b640 1 -- 172.21.15.2:0/1190308667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a881978e0 con 0x7f6a88102730 2024-09-19T04:39:48.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:48.054+0000 7f6a84ff9640 1 -- 172.21.15.2:0/1190308667 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6a7802feb0 con 0x7f6a88102730 2024-09-19T04:39:48.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:48.054+0000 7f6a84ff9640 1 -- 172.21.15.2:0/1190308667 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a78004360 con 0x7f6a88102730 2024-09-19T04:39:48.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:48.054+0000 7f6a8e17b640 1 -- 172.21.15.2:0/1190308667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a88197ce0 con 0x7f6a88102730 2024-09-19T04:39:48.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:48.055+0000 7f6a84ff9640 1 -- 172.21.15.2:0/1190308667 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f6a78037020 con 0x7f6a88102730 2024-09-19T04:39:48.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:48.055+0000 7f6a8e17b640 1 -- 172.21.15.2:0/1190308667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a88069f90 con 0x7f6a88102730 2024-09-19T04:39:48.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:48.055+0000 7f6a84ff9640 1 --2- 172.21.15.2:0/1190308667 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f6a740392a0 0x7f6a7403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:48.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:48.055+0000 7f6a84ff9640 1 -- 172.21.15.2:0/1190308667 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f6a7806d200 con 0x7f6a88102730 2024-09-19T04:39:48.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:48.055+0000 7f6a86ffd640 1 --2- 172.21.15.2:0/1190308667 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f6a740392a0 0x7f6a7403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:48.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:48.056+0000 7f6a86ffd640 1 --2- 172.21.15.2:0/1190308667 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f6a740392a0 0x7f6a7403b760 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6a700098c0 tx=0x7f6a70006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:48.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:48.060+0000 7f6a84ff9640 1 -- 172.21.15.2:0/1190308667 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6a7803f070 con 0x7f6a88102730 2024-09-19T04:39:48.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:48.238+0000 7f6a8e17b640 1 -- 172.21.15.2:0/1190308667 --> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi018", "target": ["mon-mgr", ""]}) -- 0x7f6a88198500 con 0x7f6a740392a0 2024-09-19T04:39:48.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:48 smithi002 ceph-mon[30975]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi018", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:39:50.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:50 smithi002 ceph-mon[30975]: Deploying cephadm binary to smithi018 2024-09-19T04:39:52.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:52.200+0000 7f6a84ff9640 1 -- 172.21.15.2:0/1190308667 <== mgr.14150 v2:172.21.15.2:6800/3171525177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f6a88198500 con 0x7f6a740392a0 2024-09-19T04:39:52.202 INFO:teuthology.orchestra.run.smithi002.stdout:Added host 'smithi018' with addr '172.21.15.18' 2024-09-19T04:39:52.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:52.203+0000 7f6a8e17b640 1 -- 172.21.15.2:0/1190308667 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f6a740392a0 msgr2=0x7f6a7403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:52.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:52.203+0000 7f6a8e17b640 1 --2- 172.21.15.2:0/1190308667 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f6a740392a0 0x7f6a7403b760 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6a700098c0 tx=0x7f6a70006db0 comp rx=0 tx=0).stop 2024-09-19T04:39:52.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:52.203+0000 7f6a8e17b640 1 -- 172.21.15.2:0/1190308667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a88102730 msgr2=0x7f6a88197110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:52.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:52.203+0000 7f6a8e17b640 1 --2- 172.21.15.2:0/1190308667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a88102730 0x7f6a88197110 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6a78005dd0 tx=0x7f6a7802f980 comp rx=0 tx=0).stop 2024-09-19T04:39:52.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:52.203+0000 7f6a8e17b640 1 -- 172.21.15.2:0/1190308667 shutdown_connections 2024-09-19T04:39:52.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:52.203+0000 7f6a8e17b640 1 --2- 172.21.15.2:0/1190308667 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f6a740392a0 0x7f6a7403b760 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:52.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:52.203+0000 7f6a8e17b640 1 --2- 172.21.15.2:0/1190308667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a88102730 0x7f6a88197110 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:52.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:52.203+0000 7f6a8e17b640 1 -- 172.21.15.2:0/1190308667 >> 172.21.15.2:0/1190308667 conn(0x7f6a88077310 msgr2=0x7f6a881054c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:52.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:52.203+0000 7f6a8e17b640 1 -- 172.21.15.2:0/1190308667 shutdown_connections 2024-09-19T04:39:52.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:52.203+0000 7f6a8e17b640 1 -- 172.21.15.2:0/1190308667 wait complete. 2024-09-19T04:39:52.904 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T04:39:53.155 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:39:53.476 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:53 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:39:53.476 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:53 smithi002 ceph-mon[30975]: Added host smithi018 2024-09-19T04:39:53.476 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:53 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:39:53.476 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:53 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:39:53.477 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:53 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:39:53.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:53.559+0000 7fb63f9a1640 1 -- 172.21.15.2:0/2992980161 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb638106560 msgr2=0x7fb638106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:53.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:53.559+0000 7fb63f9a1640 1 --2- 172.21.15.2:0/2992980161 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb638106560 0x7fb638106940 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb634009880 tx=0x7fb63402a5d0 comp rx=0 tx=0).stop 2024-09-19T04:39:53.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:53.559+0000 7fb63f9a1640 1 -- 172.21.15.2:0/2992980161 shutdown_connections 2024-09-19T04:39:53.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:53.559+0000 7fb63f9a1640 1 --2- 172.21.15.2:0/2992980161 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb638106560 0x7fb638106940 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:53.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:53.559+0000 7fb63f9a1640 1 -- 172.21.15.2:0/2992980161 >> 172.21.15.2:0/2992980161 conn(0x7fb6380fc1b0 msgr2=0x7fb6380fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:53.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:53.559+0000 7fb63f9a1640 1 -- 172.21.15.2:0/2992980161 shutdown_connections 2024-09-19T04:39:53.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:53.559+0000 7fb63f9a1640 1 -- 172.21.15.2:0/2992980161 wait complete. 2024-09-19T04:39:53.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:53.559+0000 7fb63f9a1640 1 Processor -- start 2024-09-19T04:39:53.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:53.559+0000 7fb63f9a1640 1 -- start start 2024-09-19T04:39:53.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:53.560+0000 7fb63f9a1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb638106560 0x7fb638197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:53.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:53.560+0000 7fb63f9a1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb63810aa40 con 0x7fb638106560 2024-09-19T04:39:53.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:53.560+0000 7fb63d73d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb638106560 0x7fb638197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:53.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:53.560+0000 7fb63d73d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb638106560 0x7fb638197e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54960/0 (socket says 172.21.15.2:54960) 2024-09-19T04:39:53.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:53.560+0000 7fb63d73d640 1 -- 172.21.15.2:0/3407004641 learned_addr learned my addr 172.21.15.2:0/3407004641 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:39:53.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:53.560+0000 7fb63d73d640 1 -- 172.21.15.2:0/3407004641 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6381983b0 con 0x7fb638106560 2024-09-19T04:39:53.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:53.560+0000 7fb63d73d640 1 --2- 172.21.15.2:0/3407004641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb638106560 0x7fb638197e70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb634009230 tx=0x7fb6340048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:53.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:53.560+0000 7fb62e7fc640 1 -- 172.21.15.2:0/3407004641 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb63403f070 con 0x7fb638106560 2024-09-19T04:39:53.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:53.560+0000 7fb62e7fc640 1 -- 172.21.15.2:0/3407004641 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb634004d10 con 0x7fb638106560 2024-09-19T04:39:53.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:53.560+0000 7fb63f9a1640 1 -- 172.21.15.2:0/3407004641 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb638198640 con 0x7fb638106560 2024-09-19T04:39:53.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:53.560+0000 7fb62e7fc640 1 -- 172.21.15.2:0/3407004641 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb634035030 con 0x7fb638106560 2024-09-19T04:39:53.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:53.560+0000 7fb63f9a1640 1 -- 172.21.15.2:0/3407004641 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb638198aa0 con 0x7fb638106560 2024-09-19T04:39:53.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:53.561+0000 7fb62e7fc640 1 -- 172.21.15.2:0/3407004641 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fb634042070 con 0x7fb638106560 2024-09-19T04:39:53.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:53.561+0000 7fb62e7fc640 1 --2- 172.21.15.2:0/3407004641 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fb6240392a0 0x7fb62403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:53.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:53.561+0000 7fb63f9a1640 1 -- 172.21.15.2:0/3407004641 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb638101bd0 con 0x7fb638106560 2024-09-19T04:39:53.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:53.561+0000 7fb62e7fc640 1 -- 172.21.15.2:0/3407004641 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fb63406cff0 con 0x7fb638106560 2024-09-19T04:39:53.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:53.562+0000 7fb63cf3c640 1 --2- 172.21.15.2:0/3407004641 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fb6240392a0 0x7fb62403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:53.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:53.562+0000 7fb63cf3c640 1 --2- 172.21.15.2:0/3407004641 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fb6240392a0 0x7fb62403b760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb6280098c0 tx=0x7fb628006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:53.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:53.567+0000 7fb62e7fc640 1 -- 172.21.15.2:0/3407004641 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb634039350 con 0x7fb638106560 2024-09-19T04:39:53.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:53.748+0000 7fb63f9a1640 1 -- 172.21.15.2:0/3407004641 --> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb6381069c0 con 0x7fb6240392a0 2024-09-19T04:39:53.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:53.750+0000 7fb62e7fc640 1 -- 172.21.15.2:0/3407004641 <== mgr.14150 v2:172.21.15.2:6800/3171525177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+158 (secure 0 0 0) 0x7fb6381069c0 con 0x7fb6240392a0 2024-09-19T04:39:53.751 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:39:53.751 INFO:teuthology.orchestra.run.smithi002.stdout:[{"addr": "172.21.15.2", "hostname": "smithi002", "labels": [], "status": ""}, {"addr": "172.21.15.18", "hostname": "smithi018", "labels": [], "status": ""}] 2024-09-19T04:39:53.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:53.752+0000 7fb63f9a1640 1 -- 172.21.15.2:0/3407004641 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fb6240392a0 msgr2=0x7fb62403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:53.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:53.752+0000 7fb63f9a1640 1 --2- 172.21.15.2:0/3407004641 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fb6240392a0 0x7fb62403b760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb6280098c0 tx=0x7fb628006db0 comp rx=0 tx=0).stop 2024-09-19T04:39:53.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:53.752+0000 7fb63f9a1640 1 -- 172.21.15.2:0/3407004641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb638106560 msgr2=0x7fb638197e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:53.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:53.752+0000 7fb63f9a1640 1 --2- 172.21.15.2:0/3407004641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb638106560 0x7fb638197e70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb634009230 tx=0x7fb6340048f0 comp rx=0 tx=0).stop 2024-09-19T04:39:53.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:53.753+0000 7fb63f9a1640 1 -- 172.21.15.2:0/3407004641 shutdown_connections 2024-09-19T04:39:53.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:53.753+0000 7fb63f9a1640 1 --2- 172.21.15.2:0/3407004641 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fb6240392a0 0x7fb62403b760 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:53.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:53.753+0000 7fb63f9a1640 1 --2- 172.21.15.2:0/3407004641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb638106560 0x7fb638197e70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:53.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:53.753+0000 7fb63f9a1640 1 -- 172.21.15.2:0/3407004641 >> 172.21.15.2:0/3407004641 conn(0x7fb6380fc1b0 msgr2=0x7fb6380fdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:53.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:53.753+0000 7fb63f9a1640 1 -- 172.21.15.2:0/3407004641 shutdown_connections 2024-09-19T04:39:53.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:53.753+0000 7fb63f9a1640 1 -- 172.21.15.2:0/3407004641 wait complete. 2024-09-19T04:39:54.321 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi116 2024-09-19T04:39:54.321 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-19T04:39:54.321 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/etc/ceph/ceph.conf 2024-09-19T04:39:54.340 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-19T04:39:54.340 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T04:39:54.398 INFO:tasks.cephadm:Adding host smithi116 to orchestrator... 2024-09-19T04:39:54.398 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph orch host add smithi116 2024-09-19T04:39:54.652 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:39:54.856 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:54 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:39:54.856 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:54 smithi002 ceph-mon[30975]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:39:55.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:55.066+0000 7f5bda125640 1 -- 172.21.15.2:0/4005431079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bd4106540 msgr2=0x7f5bd4106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:55.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:55.066+0000 7f5bda125640 1 --2- 172.21.15.2:0/4005431079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bd4106540 0x7f5bd4106920 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4009810 tx=0x7f5bc402a540 comp rx=0 tx=0).stop 2024-09-19T04:39:55.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:55.066+0000 7f5bda125640 1 -- 172.21.15.2:0/4005431079 shutdown_connections 2024-09-19T04:39:55.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:55.066+0000 7f5bda125640 1 --2- 172.21.15.2:0/4005431079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bd4106540 0x7f5bd4106920 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:55.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:55.066+0000 7f5bda125640 1 -- 172.21.15.2:0/4005431079 >> 172.21.15.2:0/4005431079 conn(0x7f5bd4077310 msgr2=0x7f5bd40fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:55.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:55.066+0000 7f5bda125640 1 -- 172.21.15.2:0/4005431079 shutdown_connections 2024-09-19T04:39:55.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:55.066+0000 7f5bda125640 1 -- 172.21.15.2:0/4005431079 wait complete. 2024-09-19T04:39:55.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:55.066+0000 7f5bda125640 1 Processor -- start 2024-09-19T04:39:55.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:55.067+0000 7f5bda125640 1 -- start start 2024-09-19T04:39:55.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:55.067+0000 7f5bda125640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bd4106540 0x7f5bd4196fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:55.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:55.067+0000 7f5bda125640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5bd410aa20 con 0x7f5bd4106540 2024-09-19T04:39:55.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:55.067+0000 7f5bd37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bd4106540 0x7f5bd4196fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:55.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:55.067+0000 7f5bd37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bd4106540 0x7f5bd4196fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54982/0 (socket says 172.21.15.2:54982) 2024-09-19T04:39:55.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:55.067+0000 7f5bd37fe640 1 -- 172.21.15.2:0/3626149260 learned_addr learned my addr 172.21.15.2:0/3626149260 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:39:55.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:55.067+0000 7f5bd37fe640 1 -- 172.21.15.2:0/3626149260 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bd4197500 con 0x7f5bd4106540 2024-09-19T04:39:55.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:55.067+0000 7f5bd37fe640 1 --2- 172.21.15.2:0/3626149260 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bd4106540 0x7f5bd4196fc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4030b00 tx=0x7f5bc4030b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:55.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:55.068+0000 7f5bd0ff9640 1 -- 172.21.15.2:0/3626149260 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bc4040070 con 0x7f5bd4106540 2024-09-19T04:39:55.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:55.068+0000 7f5bd0ff9640 1 -- 172.21.15.2:0/3626149260 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5bc40318b0 con 0x7f5bd4106540 2024-09-19T04:39:55.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:55.068+0000 7f5bda125640 1 -- 172.21.15.2:0/3626149260 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bd4197790 con 0x7f5bd4106540 2024-09-19T04:39:55.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:55.068+0000 7f5bd0ff9640 1 -- 172.21.15.2:0/3626149260 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bc4003de0 con 0x7f5bd4106540 2024-09-19T04:39:55.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:55.068+0000 7f5bda125640 1 -- 172.21.15.2:0/3626149260 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bd419b890 con 0x7f5bd4106540 2024-09-19T04:39:55.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:55.068+0000 7f5bd0ff9640 1 -- 172.21.15.2:0/3626149260 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f5bc4039040 con 0x7f5bd4106540 2024-09-19T04:39:55.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:55.069+0000 7f5bd0ff9640 1 --2- 172.21.15.2:0/3626149260 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f5bbc039300 0x7f5bbc03b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:55.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:55.069+0000 7f5bd0ff9640 1 -- 172.21.15.2:0/3626149260 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f5bc406d7b0 con 0x7f5bd4106540 2024-09-19T04:39:55.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:55.069+0000 7f5bda125640 1 -- 172.21.15.2:0/3626149260 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bd4101bb0 con 0x7f5bd4106540 2024-09-19T04:39:55.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:55.069+0000 7f5bd2ffd640 1 --2- 172.21.15.2:0/3626149260 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f5bbc039300 0x7f5bbc03b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:55.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:55.069+0000 7f5bd2ffd640 1 --2- 172.21.15.2:0/3626149260 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f5bbc039300 0x7f5bbc03b7c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5bc80098c0 tx=0x7f5bc8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:55.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:55.074+0000 7f5bd0ff9640 1 -- 172.21.15.2:0/3626149260 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5bc4043bd0 con 0x7f5bd4106540 2024-09-19T04:39:55.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:55.256+0000 7f5bda125640 1 -- 172.21.15.2:0/3626149260 --> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi116", "target": ["mon-mgr", ""]}) -- 0x7f5bd4106920 con 0x7f5bbc039300 2024-09-19T04:39:55.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:55 smithi002 ceph-mon[30975]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi116", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:39:57.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:57 smithi002 ceph-mon[30975]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:39:57.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:57 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:39:57.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:57 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:39:57.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:57 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:39:57.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:57 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:39:57.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:57 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi018", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:39:57.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:57 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:39:57.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:57 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:39:57.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:57 smithi002 ceph-mon[30975]: Updating smithi018:/etc/ceph/ceph.conf 2024-09-19T04:39:57.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:57 smithi002 ceph-mon[30975]: Deploying cephadm binary to smithi116 2024-09-19T04:39:57.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:57 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:39:57.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:57 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:39:57.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:57 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:39:58.609 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:58 smithi002 ceph-mon[30975]: Updating smithi018:/var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:39:58.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:58 smithi002 ceph-mon[30975]: Updating smithi018:/etc/ceph/ceph.client.admin.keyring 2024-09-19T04:39:58.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:58 smithi002 ceph-mon[30975]: Updating smithi018:/var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T04:39:59.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:59.087+0000 7f5bd0ff9640 1 -- 172.21.15.2:0/3626149260 <== mgr.14150 v2:172.21.15.2:6800/3171525177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f5bd4106920 con 0x7f5bbc039300 2024-09-19T04:39:59.089 INFO:teuthology.orchestra.run.smithi002.stdout:Added host 'smithi116' with addr '172.21.15.116' 2024-09-19T04:39:59.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:59.090+0000 7f5bda125640 1 -- 172.21.15.2:0/3626149260 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f5bbc039300 msgr2=0x7f5bbc03b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:59.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:59.090+0000 7f5bda125640 1 --2- 172.21.15.2:0/3626149260 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f5bbc039300 0x7f5bbc03b7c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5bc80098c0 tx=0x7f5bc8006db0 comp rx=0 tx=0).stop 2024-09-19T04:39:59.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:59.090+0000 7f5bda125640 1 -- 172.21.15.2:0/3626149260 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bd4106540 msgr2=0x7f5bd4196fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:59.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:59.090+0000 7f5bda125640 1 --2- 172.21.15.2:0/3626149260 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bd4106540 0x7f5bd4196fc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4030b00 tx=0x7f5bc4030b30 comp rx=0 tx=0).stop 2024-09-19T04:39:59.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:59.090+0000 7f5bda125640 1 -- 172.21.15.2:0/3626149260 shutdown_connections 2024-09-19T04:39:59.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:59.090+0000 7f5bda125640 1 --2- 172.21.15.2:0/3626149260 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f5bbc039300 0x7f5bbc03b7c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:59.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:59.090+0000 7f5bda125640 1 --2- 172.21.15.2:0/3626149260 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bd4106540 0x7f5bd4196fc0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:59.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:59.090+0000 7f5bda125640 1 -- 172.21.15.2:0/3626149260 >> 172.21.15.2:0/3626149260 conn(0x7f5bd4077310 msgr2=0x7f5bd40696b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:59.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:59.090+0000 7f5bda125640 1 -- 172.21.15.2:0/3626149260 shutdown_connections 2024-09-19T04:39:59.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:39:59.090+0000 7f5bda125640 1 -- 172.21.15.2:0/3626149260 wait complete. 2024-09-19T04:39:59.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:59 smithi002 ceph-mon[30975]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:39:59.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:59 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:39:59.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:39:59 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:39:59.651 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T04:39:59.905 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:40:00.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:00.338+0000 7f590d571640 1 -- 172.21.15.2:0/1346015480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5908102790 msgr2=0x7f5908102b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:00.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:00.338+0000 7f590d571640 1 --2- 172.21.15.2:0/1346015480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5908102790 0x7f5908102b70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f58f8009c10 tx=0x7f58f802aa10 comp rx=0 tx=0).stop 2024-09-19T04:40:00.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:00.338+0000 7f590d571640 1 -- 172.21.15.2:0/1346015480 shutdown_connections 2024-09-19T04:40:00.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:00.338+0000 7f590d571640 1 --2- 172.21.15.2:0/1346015480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5908102790 0x7f5908102b70 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:00.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:00.338+0000 7f590d571640 1 -- 172.21.15.2:0/1346015480 >> 172.21.15.2:0/1346015480 conn(0x7f5908077310 msgr2=0x7f59080fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:00.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:00.338+0000 7f590d571640 1 -- 172.21.15.2:0/1346015480 shutdown_connections 2024-09-19T04:40:00.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:00.338+0000 7f590d571640 1 -- 172.21.15.2:0/1346015480 wait complete. 2024-09-19T04:40:00.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:00.339+0000 7f590d571640 1 Processor -- start 2024-09-19T04:40:00.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:00.339+0000 7f590d571640 1 -- start start 2024-09-19T04:40:00.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:00.339+0000 7f590d571640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5908102790 0x7f5908197130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:00.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:00.339+0000 7f590d571640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f590810bb30 con 0x7f5908102790 2024-09-19T04:40:00.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:00.339+0000 7f5906ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5908102790 0x7f5908197130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:00.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:00.339+0000 7f5906ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5908102790 0x7f5908197130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54992/0 (socket says 172.21.15.2:54992) 2024-09-19T04:40:00.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:00.339+0000 7f5906ffd640 1 -- 172.21.15.2:0/2144712912 learned_addr learned my addr 172.21.15.2:0/2144712912 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:40:00.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:00.340+0000 7f5906ffd640 1 -- 172.21.15.2:0/2144712912 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5908197670 con 0x7f5908102790 2024-09-19T04:40:00.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:00.340+0000 7f5906ffd640 1 --2- 172.21.15.2:0/2144712912 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5908102790 0x7f5908197130 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f58f8005dd0 tx=0x7f58f802f980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:00.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:00.340+0000 7f58fffff640 1 -- 172.21.15.2:0/2144712912 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58f8034070 con 0x7f5908102790 2024-09-19T04:40:00.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:00.340+0000 7f590d571640 1 -- 172.21.15.2:0/2144712912 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5908197900 con 0x7f5908102790 2024-09-19T04:40:00.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:00.340+0000 7f58fffff640 1 -- 172.21.15.2:0/2144712912 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f58f802feb0 con 0x7f5908102790 2024-09-19T04:40:00.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:00.340+0000 7f58fffff640 1 -- 172.21.15.2:0/2144712912 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58f8004360 con 0x7f5908102790 2024-09-19T04:40:00.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:00.340+0000 7f590d571640 1 -- 172.21.15.2:0/2144712912 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5908197d00 con 0x7f5908102790 2024-09-19T04:40:00.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:00.341+0000 7f58fffff640 1 -- 172.21.15.2:0/2144712912 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f58f8037020 con 0x7f5908102790 2024-09-19T04:40:00.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:00.341+0000 7f58fffff640 1 --2- 172.21.15.2:0/2144712912 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f58f4039300 0x7f58f403b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:00.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:00.341+0000 7f58fffff640 1 -- 172.21.15.2:0/2144712912 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f58f806d1e0 con 0x7f5908102790 2024-09-19T04:40:00.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:00.341+0000 7f590d571640 1 -- 172.21.15.2:0/2144712912 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5908069f30 con 0x7f5908102790 2024-09-19T04:40:00.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:00.341+0000 7f59067fc640 1 --2- 172.21.15.2:0/2144712912 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f58f4039300 0x7f58f403b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:00.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:00.342+0000 7f59067fc640 1 --2- 172.21.15.2:0/2144712912 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f58f4039300 0x7f58f403b7c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f58f00098c0 tx=0x7f58f0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:00.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:00.346+0000 7f58fffff640 1 -- 172.21.15.2:0/2144712912 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f58f803f070 con 0x7f5908102790 2024-09-19T04:40:00.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:00.529+0000 7f590d571640 1 -- 172.21.15.2:0/2144712912 --> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5908198490 con 0x7f58f4039300 2024-09-19T04:40:00.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:00.530+0000 7f58fffff640 1 -- 172.21.15.2:0/2144712912 <== mgr.14150 v2:172.21.15.2:6800/3171525177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+238 (secure 0 0 0) 0x7f5908198490 con 0x7f58f4039300 2024-09-19T04:40:00.532 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:40:00.532 INFO:teuthology.orchestra.run.smithi002.stdout:[{"addr": "172.21.15.2", "hostname": "smithi002", "labels": [], "status": ""}, {"addr": "172.21.15.18", "hostname": "smithi018", "labels": [], "status": ""}, {"addr": "172.21.15.116", "hostname": "smithi116", "labels": [], "status": ""}] 2024-09-19T04:40:00.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:00.533+0000 7f590d571640 1 -- 172.21.15.2:0/2144712912 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f58f4039300 msgr2=0x7f58f403b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:00.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:00.533+0000 7f590d571640 1 --2- 172.21.15.2:0/2144712912 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f58f4039300 0x7f58f403b7c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f58f00098c0 tx=0x7f58f0006db0 comp rx=0 tx=0).stop 2024-09-19T04:40:00.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:00.533+0000 7f590d571640 1 -- 172.21.15.2:0/2144712912 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5908102790 msgr2=0x7f5908197130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:00.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:00.533+0000 7f590d571640 1 --2- 172.21.15.2:0/2144712912 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5908102790 0x7f5908197130 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f58f8005dd0 tx=0x7f58f802f980 comp rx=0 tx=0).stop 2024-09-19T04:40:00.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:00.533+0000 7f590d571640 1 -- 172.21.15.2:0/2144712912 shutdown_connections 2024-09-19T04:40:00.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:00.533+0000 7f590d571640 1 --2- 172.21.15.2:0/2144712912 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f58f4039300 0x7f58f403b7c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:00.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:00.533+0000 7f590d571640 1 --2- 172.21.15.2:0/2144712912 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5908102790 0x7f5908197130 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:00.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:00.533+0000 7f590d571640 1 -- 172.21.15.2:0/2144712912 >> 172.21.15.2:0/2144712912 conn(0x7f5908077310 msgr2=0x7f5908105520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:00.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:00.533+0000 7f590d571640 1 -- 172.21.15.2:0/2144712912 shutdown_connections 2024-09-19T04:40:00.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:00.533+0000 7f590d571640 1 -- 172.21.15.2:0/2144712912 wait complete. 2024-09-19T04:40:00.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:00 smithi002 ceph-mon[30975]: Added host smithi116 2024-09-19T04:40:00.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:00 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:00.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:00 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:01.098 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-19T04:40:01.098 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-19T04:40:01.356 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:40:01.633 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:01 smithi002 ceph-mon[30975]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:01.633 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:01 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:01.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:01.814+0000 7fd56a60e640 1 -- 172.21.15.2:0/2892687964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd564102730 msgr2=0x7fd564102b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:01.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:01.814+0000 7fd56a60e640 1 --2- 172.21.15.2:0/2892687964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd564102730 0x7fd564102b10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd554009810 tx=0x7fd55402a540 comp rx=0 tx=0).stop 2024-09-19T04:40:01.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:01.814+0000 7fd56a60e640 1 -- 172.21.15.2:0/2892687964 shutdown_connections 2024-09-19T04:40:01.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:01.814+0000 7fd56a60e640 1 --2- 172.21.15.2:0/2892687964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd564102730 0x7fd564102b10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:01.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:01.814+0000 7fd56a60e640 1 -- 172.21.15.2:0/2892687964 >> 172.21.15.2:0/2892687964 conn(0x7fd564077310 msgr2=0x7fd5640fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:01.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:01.814+0000 7fd56a60e640 1 -- 172.21.15.2:0/2892687964 shutdown_connections 2024-09-19T04:40:01.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:01.814+0000 7fd56a60e640 1 -- 172.21.15.2:0/2892687964 wait complete. 2024-09-19T04:40:01.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:01.815+0000 7fd56a60e640 1 Processor -- start 2024-09-19T04:40:01.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:01.815+0000 7fd56a60e640 1 -- start start 2024-09-19T04:40:01.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:01.815+0000 7fd56a60e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd564102730 0x7fd564197040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:01.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:01.815+0000 7fd56a60e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd56410bb30 con 0x7fd564102730 2024-09-19T04:40:01.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:01.815+0000 7fd563fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd564102730 0x7fd564197040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:01.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:01.815+0000 7fd563fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd564102730 0x7fd564197040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56690/0 (socket says 172.21.15.2:56690) 2024-09-19T04:40:01.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:01.815+0000 7fd563fff640 1 -- 172.21.15.2:0/3728581667 learned_addr learned my addr 172.21.15.2:0/3728581667 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:40:01.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:01.816+0000 7fd563fff640 1 -- 172.21.15.2:0/3728581667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd564197580 con 0x7fd564102730 2024-09-19T04:40:01.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:01.816+0000 7fd563fff640 1 --2- 172.21.15.2:0/3728581667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd564102730 0x7fd564197040 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd554030b00 tx=0x7fd554030b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:01.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:01.816+0000 7fd5617fa640 1 -- 172.21.15.2:0/3728581667 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd554040070 con 0x7fd564102730 2024-09-19T04:40:01.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:01.816+0000 7fd5617fa640 1 -- 172.21.15.2:0/3728581667 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd5540318b0 con 0x7fd564102730 2024-09-19T04:40:01.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:01.816+0000 7fd56a60e640 1 -- 172.21.15.2:0/3728581667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd564197810 con 0x7fd564102730 2024-09-19T04:40:01.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:01.816+0000 7fd5617fa640 1 -- 172.21.15.2:0/3728581667 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd554003de0 con 0x7fd564102730 2024-09-19T04:40:01.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:01.816+0000 7fd56a60e640 1 -- 172.21.15.2:0/3728581667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd564197c70 con 0x7fd564102730 2024-09-19T04:40:01.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:01.817+0000 7fd5617fa640 1 -- 172.21.15.2:0/3728581667 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fd554039040 con 0x7fd564102730 2024-09-19T04:40:01.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:01.817+0000 7fd5617fa640 1 --2- 172.21.15.2:0/3728581667 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd54c039300 0x7fd54c03b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:01.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:01.817+0000 7fd5617fa640 1 -- 172.21.15.2:0/3728581667 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd55406d7a0 con 0x7fd564102730 2024-09-19T04:40:01.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:01.818+0000 7fd5637fe640 1 --2- 172.21.15.2:0/3728581667 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd54c039300 0x7fd54c03b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:01.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:01.818+0000 7fd56a60e640 1 -- 172.21.15.2:0/3728581667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd564069f90 con 0x7fd564102730 2024-09-19T04:40:01.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:01.818+0000 7fd5637fe640 1 --2- 172.21.15.2:0/3728581667 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd54c039300 0x7fd54c03b7c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd5580098c0 tx=0x7fd558006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:01.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:01.822+0000 7fd5617fa640 1 -- 172.21.15.2:0/3728581667 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd554043bd0 con 0x7fd564102730 2024-09-19T04:40:02.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:02.019+0000 7fd56a60e640 1 -- 172.21.15.2:0/3728581667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fd564198500 con 0x7fd564102730 2024-09-19T04:40:02.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:02.375+0000 7fd5617fa640 1 -- 172.21.15.2:0/3728581667 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7fd55404d3a0 con 0x7fd564102730 2024-09-19T04:40:02.377 INFO:teuthology.orchestra.run.smithi002.stderr:adjusted tunables profile to default 2024-09-19T04:40:02.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:02.378+0000 7fd56a60e640 1 -- 172.21.15.2:0/3728581667 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd54c039300 msgr2=0x7fd54c03b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:02.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:02.378+0000 7fd56a60e640 1 --2- 172.21.15.2:0/3728581667 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd54c039300 0x7fd54c03b7c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd5580098c0 tx=0x7fd558006db0 comp rx=0 tx=0).stop 2024-09-19T04:40:02.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:02.378+0000 7fd56a60e640 1 -- 172.21.15.2:0/3728581667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd564102730 msgr2=0x7fd564197040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:02.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:02.378+0000 7fd56a60e640 1 --2- 172.21.15.2:0/3728581667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd564102730 0x7fd564197040 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd554030b00 tx=0x7fd554030b30 comp rx=0 tx=0).stop 2024-09-19T04:40:02.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:02.378+0000 7fd56a60e640 1 -- 172.21.15.2:0/3728581667 shutdown_connections 2024-09-19T04:40:02.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:02.378+0000 7fd56a60e640 1 --2- 172.21.15.2:0/3728581667 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd54c039300 0x7fd54c03b7c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:02.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:02.378+0000 7fd56a60e640 1 --2- 172.21.15.2:0/3728581667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd564102730 0x7fd564197040 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:02.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:02.378+0000 7fd56a60e640 1 -- 172.21.15.2:0/3728581667 >> 172.21.15.2:0/3728581667 conn(0x7fd564077310 msgr2=0x7fd5641034b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:02.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:02.378+0000 7fd56a60e640 1 -- 172.21.15.2:0/3728581667 shutdown_connections 2024-09-19T04:40:02.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:02.378+0000 7fd56a60e640 1 -- 172.21.15.2:0/3728581667 wait complete. 2024-09-19T04:40:02.657 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:02 smithi002 ceph-mon[30975]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:40:02.657 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:02 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/3728581667' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T04:40:02.920 INFO:tasks.cephadm:Adding mon.a on smithi002 2024-09-19T04:40:02.920 INFO:tasks.cephadm:Adding mon.b on smithi018 2024-09-19T04:40:02.920 INFO:tasks.cephadm:Adding mon.c on smithi116 2024-09-19T04:40:02.920 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi002:172.21.15.2=a;smithi018:172.21.15.18=b;smithi116:172.21.15.116=c' 2024-09-19T04:40:03.238 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T04:40:03.283 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T04:40:03.813 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:03.753+0000 7fd819cfa640 1 -- 172.21.15.116:0/1976705793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8140761a0 msgr2=0x7fd814074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:03.813 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:03.753+0000 7fd819cfa640 1 --2- 172.21.15.116:0/1976705793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8140761a0 0x7fd814074600 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd80c009c20 tx=0x7fd80c02aa90 comp rx=0 tx=0).stop 2024-09-19T04:40:03.813 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:03.753+0000 7fd819cfa640 1 -- 172.21.15.116:0/1976705793 shutdown_connections 2024-09-19T04:40:03.813 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:03.753+0000 7fd819cfa640 1 --2- 172.21.15.116:0/1976705793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8140761a0 0x7fd814074600 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:03.813 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:03.753+0000 7fd819cfa640 1 -- 172.21.15.116:0/1976705793 >> 172.21.15.116:0/1976705793 conn(0x7fd8140fcdb0 msgr2=0x7fd8140ff1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:03.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:03.753+0000 7fd819cfa640 1 -- 172.21.15.116:0/1976705793 shutdown_connections 2024-09-19T04:40:03.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:03.753+0000 7fd819cfa640 1 -- 172.21.15.116:0/1976705793 wait complete. 2024-09-19T04:40:03.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:03.753+0000 7fd819cfa640 1 Processor -- start 2024-09-19T04:40:03.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:03.754+0000 7fd819cfa640 1 -- start start 2024-09-19T04:40:03.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:03.754+0000 7fd819cfa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8140761a0 0x7fd814198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:03.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:03.754+0000 7fd819cfa640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd8141097d0 con 0x7fd8140761a0 2024-09-19T04:40:03.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:03.754+0000 7fd8137fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8140761a0 0x7fd814198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:03.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:03.754+0000 7fd8137fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8140761a0 0x7fd814198ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.116:59404/0 (socket says 172.21.15.116:59404) 2024-09-19T04:40:03.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:03.754+0000 7fd8137fe640 1 -- 172.21.15.116:0/2203488192 learned_addr learned my addr 172.21.15.116:0/2203488192 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-19T04:40:03.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:03.754+0000 7fd8137fe640 1 -- 172.21.15.116:0/2203488192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8141993e0 con 0x7fd8140761a0 2024-09-19T04:40:03.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:03.754+0000 7fd8137fe640 1 --2- 172.21.15.116:0/2203488192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8140761a0 0x7fd814198ea0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd80c006010 tx=0x7fd80c030f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:03.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:03.755+0000 7fd810ff9640 1 -- 172.21.15.116:0/2203488192 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd80c047070 con 0x7fd8140761a0 2024-09-19T04:40:03.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:03.755+0000 7fd810ff9640 1 -- 172.21.15.116:0/2203488192 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd80c003e20 con 0x7fd8140761a0 2024-09-19T04:40:03.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:03.755+0000 7fd819cfa640 1 -- 172.21.15.116:0/2203488192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd814199670 con 0x7fd8140761a0 2024-09-19T04:40:03.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:03.755+0000 7fd810ff9640 1 -- 172.21.15.116:0/2203488192 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd80c033050 con 0x7fd8140761a0 2024-09-19T04:40:03.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:03.755+0000 7fd819cfa640 1 -- 172.21.15.116:0/2203488192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd81419c360 con 0x7fd8140761a0 2024-09-19T04:40:03.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:03.756+0000 7fd810ff9640 1 -- 172.21.15.116:0/2203488192 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fd80c04a070 con 0x7fd8140761a0 2024-09-19T04:40:03.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:03.756+0000 7fd810ff9640 1 --2- 172.21.15.116:0/2203488192 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd8000392a0 0x7fd80003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:03.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:03.756+0000 7fd810ff9640 1 -- 172.21.15.116:0/2203488192 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd80c03e030 con 0x7fd8140761a0 2024-09-19T04:40:03.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:03.756+0000 7fd819cfa640 1 -- 172.21.15.116:0/2203488192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd814109f50 con 0x7fd8140761a0 2024-09-19T04:40:03.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:03.756+0000 7fd812ffd640 1 --2- 172.21.15.116:0/2203488192 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd8000392a0 0x7fd80003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:03.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:03.757+0000 7fd812ffd640 1 --2- 172.21.15.116:0/2203488192 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd8000392a0 0x7fd80003b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc0098c0 tx=0x7fd7fc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:03.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:03.761+0000 7fd810ff9640 1 -- 172.21.15.116:0/2203488192 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd80c051080 con 0x7fd8140761a0 2024-09-19T04:40:03.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:03 smithi002 ceph-mon[30975]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:03.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:03 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/3728581667' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T04:40:03.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:03 smithi002 ceph-mon[30975]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T04:40:03.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:03 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:03.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:03 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:03.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:03 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:03.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:03 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:03.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:03 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi116", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:40:03.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:03 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:03.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:03 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:40:03.951 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:03.949+0000 7fd819cfa640 1 -- 172.21.15.116:0/2203488192 --> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi002:172.21.15.2=a;smithi018:172.21.15.18=b;smithi116:172.21.15.116=c", "target": ["mon-mgr", ""]}) -- 0x7fd8140626e0 con 0x7fd8000392a0 2024-09-19T04:40:03.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:03.954+0000 7fd810ff9640 1 -- 172.21.15.116:0/2203488192 <== mgr.14150 v2:172.21.15.2:6800/3171525177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fd8140626e0 con 0x7fd8000392a0 2024-09-19T04:40:03.956 INFO:teuthology.orchestra.run.smithi116.stdout:Scheduled mon update... 2024-09-19T04:40:03.958 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:03.956+0000 7fd819cfa640 1 -- 172.21.15.116:0/2203488192 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd8000392a0 msgr2=0x7fd80003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:03.958 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:03.956+0000 7fd819cfa640 1 --2- 172.21.15.116:0/2203488192 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd8000392a0 0x7fd80003b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc0098c0 tx=0x7fd7fc006db0 comp rx=0 tx=0).stop 2024-09-19T04:40:03.958 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:03.956+0000 7fd819cfa640 1 -- 172.21.15.116:0/2203488192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8140761a0 msgr2=0x7fd814198ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:03.959 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:03.956+0000 7fd819cfa640 1 --2- 172.21.15.116:0/2203488192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8140761a0 0x7fd814198ea0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd80c006010 tx=0x7fd80c030f50 comp rx=0 tx=0).stop 2024-09-19T04:40:03.959 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:03.956+0000 7fd819cfa640 1 -- 172.21.15.116:0/2203488192 shutdown_connections 2024-09-19T04:40:03.959 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:03.956+0000 7fd819cfa640 1 --2- 172.21.15.116:0/2203488192 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd8000392a0 0x7fd80003b760 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:03.959 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:03.956+0000 7fd819cfa640 1 --2- 172.21.15.116:0/2203488192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8140761a0 0x7fd814198ea0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:03.959 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:03.956+0000 7fd819cfa640 1 -- 172.21.15.116:0/2203488192 >> 172.21.15.116:0/2203488192 conn(0x7fd8140fcdb0 msgr2=0x7fd8140fd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:03.959 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:03.957+0000 7fd819cfa640 1 -- 172.21.15.116:0/2203488192 shutdown_connections 2024-09-19T04:40:03.959 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:03.957+0000 7fd819cfa640 1 -- 172.21.15.116:0/2203488192 wait complete. 2024-09-19T04:40:04.610 DEBUG:teuthology.orchestra.run.smithi018:mon.b> sudo journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@mon.b.service 2024-09-19T04:40:04.613 DEBUG:teuthology.orchestra.run.smithi116:mon.c> sudo journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@mon.c.service 2024-09-19T04:40:04.615 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T04:40:04.615 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T04:40:04.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:04 smithi002 ceph-mon[30975]: Updating smithi116:/etc/ceph/ceph.conf 2024-09-19T04:40:04.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:04 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:04.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:04 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:04.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:04 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:04.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:04 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:04.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:04 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T04:40:04.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:04 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:05.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:05 smithi002 ceph-mon[30975]: Updating smithi116:/var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:40:05.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:05 smithi002 ceph-mon[30975]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:05.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:05 smithi002 ceph-mon[30975]: Updating smithi116:/etc/ceph/ceph.client.admin.keyring 2024-09-19T04:40:05.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:05 smithi002 ceph-mon[30975]: Updating smithi116:/var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T04:40:05.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:05 smithi002 ceph-mon[30975]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi002:172.21.15.2=a;smithi018:172.21.15.18=b;smithi116:172.21.15.116=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:40:05.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:05 smithi002 ceph-mon[30975]: Saving service mon spec with placement smithi002:172.21.15.2=a;smithi018:172.21.15.18=b;smithi116:172.21.15.116=c;count:3 2024-09-19T04:40:05.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:05 smithi002 ceph-mon[30975]: Deploying daemon mon.c on smithi116 2024-09-19T04:40:06.243 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:40:07.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:07.222+0000 7fcfe91bd640 1 -- 172.21.15.116:0/1012946470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfe4106550 msgr2=0x7fcfe4106930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:07.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:07.222+0000 7fcfe91bd640 1 --2- 172.21.15.116:0/1012946470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfe4106550 0x7fcfe4106930 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4009880 tx=0x7fcfd402a5d0 comp rx=0 tx=0).stop 2024-09-19T04:40:07.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:07.222+0000 7fcfe91bd640 1 -- 172.21.15.116:0/1012946470 shutdown_connections 2024-09-19T04:40:07.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:07.222+0000 7fcfe91bd640 1 --2- 172.21.15.116:0/1012946470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfe4106550 0x7fcfe4106930 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:07.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:07.222+0000 7fcfe91bd640 1 -- 172.21.15.116:0/1012946470 >> 172.21.15.116:0/1012946470 conn(0x7fcfe40fc120 msgr2=0x7fcfe40fe540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:07.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:07.223+0000 7fcfe91bd640 1 -- 172.21.15.116:0/1012946470 shutdown_connections 2024-09-19T04:40:07.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:07.223+0000 7fcfe91bd640 1 -- 172.21.15.116:0/1012946470 wait complete. 2024-09-19T04:40:07.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:07.223+0000 7fcfe91bd640 1 Processor -- start 2024-09-19T04:40:07.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:07.223+0000 7fcfe91bd640 1 -- start start 2024-09-19T04:40:07.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:07.224+0000 7fcfe91bd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfe4106550 0x7fcfe4197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:07.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:07.224+0000 7fcfe91bd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe410aa30 con 0x7fcfe4106550 2024-09-19T04:40:07.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:07.224+0000 7fcfe2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfe4106550 0x7fcfe4197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:07.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:07.224+0000 7fcfe2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfe4106550 0x7fcfe4197e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.116:59420/0 (socket says 172.21.15.116:59420) 2024-09-19T04:40:07.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:07.224+0000 7fcfe2d9d640 1 -- 172.21.15.116:0/541589052 learned_addr learned my addr 172.21.15.116:0/541589052 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-19T04:40:07.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:07.224+0000 7fcfe2d9d640 1 -- 172.21.15.116:0/541589052 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfe4198390 con 0x7fcfe4106550 2024-09-19T04:40:07.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:07.224+0000 7fcfe2d9d640 1 --2- 172.21.15.116:0/541589052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfe4106550 0x7fcfe4197e50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4009230 tx=0x7fcfd40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:07.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:07.225+0000 7fcfe0d99640 1 -- 172.21.15.116:0/541589052 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfd403f070 con 0x7fcfe4106550 2024-09-19T04:40:07.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:07.225+0000 7fcfe0d99640 1 -- 172.21.15.116:0/541589052 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcfd4004d10 con 0x7fcfe4106550 2024-09-19T04:40:07.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:07.225+0000 7fcfe0d99640 1 -- 172.21.15.116:0/541589052 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfd4035030 con 0x7fcfe4106550 2024-09-19T04:40:07.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:07.225+0000 7fcfe91bd640 1 -- 172.21.15.116:0/541589052 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfe4198620 con 0x7fcfe4106550 2024-09-19T04:40:07.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:07.225+0000 7fcfe91bd640 1 -- 172.21.15.116:0/541589052 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfe4198a80 con 0x7fcfe4106550 2024-09-19T04:40:07.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:07.226+0000 7fcfe0d99640 1 -- 172.21.15.116:0/541589052 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fcfd4042070 con 0x7fcfe4106550 2024-09-19T04:40:07.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:07.226+0000 7fcfe91bd640 1 -- 172.21.15.116:0/541589052 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfe4101bc0 con 0x7fcfe4106550 2024-09-19T04:40:07.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:07.226+0000 7fcfe0d99640 1 --2- 172.21.15.116:0/541589052 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fcfd00392a0 0x7fcfd003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:07.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:07.226+0000 7fcfe0d99640 1 -- 172.21.15.116:0/541589052 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fcfd406cfd0 con 0x7fcfe4106550 2024-09-19T04:40:07.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:07.226+0000 7fcfdbfff640 1 --2- 172.21.15.116:0/541589052 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fcfd00392a0 0x7fcfd003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:07.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:07.227+0000 7fcfdbfff640 1 --2- 172.21.15.116:0/541589052 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fcfd00392a0 0x7fcfd003b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc0098c0 tx=0x7fcfcc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:07.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:07.231+0000 7fcfe0d99640 1 -- 172.21.15.116:0/541589052 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcfd40372d0 con 0x7fcfe4106550 2024-09-19T04:40:07.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:07.490+0000 7fcfe91bd640 1 -- 172.21.15.116:0/541589052 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fcfe41069b0 con 0x7fcfe4106550 2024-09-19T04:40:07.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:07.490+0000 7fcfe0d99640 1 -- 172.21.15.116:0/541589052 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+741 (secure 0 0 0) 0x7fcfd4003920 con 0x7fcfe4106550 2024-09-19T04:40:07.492 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-19T04:40:07.493 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":1,"fsid":"d46630c4-7640-11ef-bceb-c7b262605968","modified":"2024-09-19T04:38:36.676338Z","created":"2024-09-19T04:38:36.676338Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T04:40:07.493 INFO:teuthology.orchestra.run.smithi116.stderr:dumped monmap epoch 1 2024-09-19T04:40:07.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:07.493+0000 7fcfe91bd640 1 -- 172.21.15.116:0/541589052 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fcfd00392a0 msgr2=0x7fcfd003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:07.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:07.493+0000 7fcfe91bd640 1 --2- 172.21.15.116:0/541589052 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fcfd00392a0 0x7fcfd003b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc0098c0 tx=0x7fcfcc006db0 comp rx=0 tx=0).stop 2024-09-19T04:40:07.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:07.493+0000 7fcfe91bd640 1 -- 172.21.15.116:0/541589052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfe4106550 msgr2=0x7fcfe4197e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:07.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:07.493+0000 7fcfe91bd640 1 --2- 172.21.15.116:0/541589052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfe4106550 0x7fcfe4197e50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4009230 tx=0x7fcfd40048f0 comp rx=0 tx=0).stop 2024-09-19T04:40:07.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:07.493+0000 7fcfe91bd640 1 -- 172.21.15.116:0/541589052 shutdown_connections 2024-09-19T04:40:07.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:07.493+0000 7fcfe91bd640 1 --2- 172.21.15.116:0/541589052 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fcfd00392a0 0x7fcfd003b760 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:07.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:07.493+0000 7fcfe91bd640 1 --2- 172.21.15.116:0/541589052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfe4106550 0x7fcfe4197e50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:07.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:07.493+0000 7fcfe91bd640 1 -- 172.21.15.116:0/541589052 >> 172.21.15.116:0/541589052 conn(0x7fcfe40fc120 msgr2=0x7fcfe40fc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:07.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:07.493+0000 7fcfe91bd640 1 -- 172.21.15.116:0/541589052 shutdown_connections 2024-09-19T04:40:07.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:07.493+0000 7fcfe91bd640 1 -- 172.21.15.116:0/541589052 wait complete. 2024-09-19T04:40:07.812 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:07 smithi116 systemd[1]: Starting Ceph mon.c for d46630c4-7640-11ef-bceb-c7b262605968... 2024-09-19T04:40:07.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:07 smithi002 ceph-mon[30975]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:08.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 podman[34457]: 2024-09-19 04:40:08.262537167 +0000 UTC m=+0.093449815 container create cbe5b534edd459d03f0a525bcfb708adc1de949a7bd789e92b0b38ca556526d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mon-c, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-19T04:40:08.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 podman[34457]: 2024-09-19 04:40:08.193480614 +0000 UTC m=+0.024393268 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:40:08.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:08 smithi002 ceph-mon[30975]: from='client.? 172.21.15.116:0/541589052' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T04:40:08.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 podman[34457]: 2024-09-19 04:40:08.507712029 +0000 UTC m=+0.338624682 container init cbe5b534edd459d03f0a525bcfb708adc1de949a7bd789e92b0b38ca556526d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mon-c, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-19T04:40:08.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 podman[34457]: 2024-09-19 04:40:08.510989202 +0000 UTC m=+0.341901842 container start cbe5b534edd459d03f0a525bcfb708adc1de949a7bd789e92b0b38ca556526d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mon-c, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-19T04:40:08.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T04:40:08.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T04:40:08.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: pidfile_write: ignore empty --pid-file 2024-09-19T04:40:08.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: load: jerasure load: lrc 2024-09-19T04:40:08.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: RocksDB version: 7.9.2 2024-09-19T04:40:08.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Git sha 0 2024-09-19T04:40:08.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T04:40:08.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: DB SUMMARY 2024-09-19T04:40:08.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: DB Session ID: 5GNCI2HJD43ZVZ8ALCN6 2024-09-19T04:40:08.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: CURRENT file: CURRENT 2024-09-19T04:40:08.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T04:40:08.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-19T04:40:08.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-19T04:40:08.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-19T04:40:08.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.error_if_exists: 0 2024-09-19T04:40:08.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.create_if_missing: 0 2024-09-19T04:40:08.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.paranoid_checks: 1 2024-09-19T04:40:08.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T04:40:08.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T04:40:08.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T04:40:08.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.env: 0x561281397940 2024-09-19T04:40:08.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T04:40:08.863 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.info_log: 0x5612824c36e0 2024-09-19T04:40:08.863 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T04:40:08.864 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.statistics: (nil) 2024-09-19T04:40:08.864 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.use_fsync: 0 2024-09-19T04:40:08.864 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.max_log_file_size: 0 2024-09-19T04:40:08.864 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T04:40:08.864 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T04:40:08.864 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T04:40:08.865 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T04:40:08.865 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.allow_fallocate: 1 2024-09-19T04:40:08.865 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T04:40:08.865 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T04:40:08.865 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.use_direct_reads: 0 2024-09-19T04:40:08.865 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T04:40:08.865 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T04:40:08.865 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.db_log_dir: 2024-09-19T04:40:08.865 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.wal_dir: 2024-09-19T04:40:08.865 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T04:40:08.865 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T04:40:08.865 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T04:40:08.865 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T04:40:08.866 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T04:40:08.866 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T04:40:08.866 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T04:40:08.866 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T04:40:08.866 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.write_buffer_manager: 0x5612824d2dc0 2024-09-19T04:40:08.866 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T04:40:08.866 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T04:40:08.866 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T04:40:08.866 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T04:40:08.866 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T04:40:08.866 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T04:40:08.866 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T04:40:08.866 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T04:40:08.867 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.unordered_write: 0 2024-09-19T04:40:08.867 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T04:40:08.867 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T04:40:08.867 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T04:40:08.867 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T04:40:08.867 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.row_cache: None 2024-09-19T04:40:08.867 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.wal_filter: None 2024-09-19T04:40:08.867 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T04:40:08.867 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T04:40:08.867 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.two_write_queues: 0 2024-09-19T04:40:08.867 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T04:40:08.867 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.wal_compression: 0 2024-09-19T04:40:08.867 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.atomic_flush: 0 2024-09-19T04:40:08.867 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T04:40:08.868 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T04:40:08.868 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T04:40:08.868 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.log_readahead_size: 0 2024-09-19T04:40:08.868 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T04:40:08.868 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T04:40:08.868 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T04:40:08.868 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T04:40:08.868 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T04:40:08.868 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T04:40:08.868 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T04:40:08.869 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.max_background_jobs: 2 2024-09-19T04:40:08.869 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.max_background_compactions: -1 2024-09-19T04:40:08.869 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.max_subcompactions: 1 2024-09-19T04:40:08.869 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T04:40:08.869 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T04:40:08.869 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T04:40:08.869 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T04:40:08.869 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T04:40:08.869 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T04:40:08.869 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T04:40:08.869 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T04:40:08.869 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.max_open_files: -1 2024-09-19T04:40:08.869 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T04:40:08.869 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T04:40:08.870 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T04:40:08.870 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T04:40:08.870 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.max_background_flushes: -1 2024-09-19T04:40:08.870 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Compression algorithms supported: 2024-09-19T04:40:08.870 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: kZSTD supported: 0 2024-09-19T04:40:08.870 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: kXpressCompression supported: 0 2024-09-19T04:40:08.870 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: kBZip2Compression supported: 0 2024-09-19T04:40:08.870 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T04:40:08.870 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: kLZ4Compression supported: 1 2024-09-19T04:40:08.870 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: kZlibCompression supported: 1 2024-09-19T04:40:08.870 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T04:40:08.870 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: kSnappyCompression supported: 1 2024-09-19T04:40:08.870 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T04:40:08.870 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T04:40:08.871 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-19T04:40:08.871 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T04:40:08.871 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T04:40:08.871 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.merge_operator: 2024-09-19T04:40:08.871 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.compaction_filter: None 2024-09-19T04:40:08.871 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T04:40:08.871 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T04:40:08.871 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T04:40:08.871 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T04:40:08.871 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5612824c3320) 2024-09-19T04:40:08.871 INFO:journalctl@ceph.mon.c.smithi116.stdout: cache_index_and_filter_blocks: 1 2024-09-19T04:40:08.872 INFO:journalctl@ceph.mon.c.smithi116.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T04:40:08.872 INFO:journalctl@ceph.mon.c.smithi116.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T04:40:08.872 INFO:journalctl@ceph.mon.c.smithi116.stdout: pin_top_level_index_and_filter: 1 2024-09-19T04:40:08.872 INFO:journalctl@ceph.mon.c.smithi116.stdout: index_type: 0 2024-09-19T04:40:08.872 INFO:journalctl@ceph.mon.c.smithi116.stdout: data_block_index_type: 0 2024-09-19T04:40:08.872 INFO:journalctl@ceph.mon.c.smithi116.stdout: index_shortening: 1 2024-09-19T04:40:08.872 INFO:journalctl@ceph.mon.c.smithi116.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T04:40:08.872 INFO:journalctl@ceph.mon.c.smithi116.stdout: checksum: 4 2024-09-19T04:40:08.872 INFO:journalctl@ceph.mon.c.smithi116.stdout: no_block_cache: 0 2024-09-19T04:40:08.872 INFO:journalctl@ceph.mon.c.smithi116.stdout: block_cache: 0x5612824b71f0 2024-09-19T04:40:08.872 INFO:journalctl@ceph.mon.c.smithi116.stdout: block_cache_name: BinnedLRUCache 2024-09-19T04:40:08.873 INFO:journalctl@ceph.mon.c.smithi116.stdout: block_cache_options: 2024-09-19T04:40:08.873 INFO:journalctl@ceph.mon.c.smithi116.stdout: capacity : 536870912 2024-09-19T04:40:08.873 INFO:journalctl@ceph.mon.c.smithi116.stdout: num_shard_bits : 4 2024-09-19T04:40:08.873 INFO:journalctl@ceph.mon.c.smithi116.stdout: strict_capacity_limit : 0 2024-09-19T04:40:08.873 INFO:journalctl@ceph.mon.c.smithi116.stdout: high_pri_pool_ratio: 0.000 2024-09-19T04:40:08.873 INFO:journalctl@ceph.mon.c.smithi116.stdout: block_cache_compressed: (nil) 2024-09-19T04:40:08.873 INFO:journalctl@ceph.mon.c.smithi116.stdout: persistent_cache: (nil) 2024-09-19T04:40:08.873 INFO:journalctl@ceph.mon.c.smithi116.stdout: block_size: 4096 2024-09-19T04:40:08.873 INFO:journalctl@ceph.mon.c.smithi116.stdout: block_size_deviation: 10 2024-09-19T04:40:08.873 INFO:journalctl@ceph.mon.c.smithi116.stdout: block_restart_interval: 16 2024-09-19T04:40:08.873 INFO:journalctl@ceph.mon.c.smithi116.stdout: index_block_restart_interval: 1 2024-09-19T04:40:08.873 INFO:journalctl@ceph.mon.c.smithi116.stdout: metadata_block_size: 4096 2024-09-19T04:40:08.873 INFO:journalctl@ceph.mon.c.smithi116.stdout: partition_filters: 0 2024-09-19T04:40:08.874 INFO:journalctl@ceph.mon.c.smithi116.stdout: use_delta_encoding: 1 2024-09-19T04:40:08.874 INFO:journalctl@ceph.mon.c.smithi116.stdout: filter_policy: bloomfilter 2024-09-19T04:40:08.874 INFO:journalctl@ceph.mon.c.smithi116.stdout: whole_key_filtering: 1 2024-09-19T04:40:08.874 INFO:journalctl@ceph.mon.c.smithi116.stdout: verify_compression: 0 2024-09-19T04:40:08.874 INFO:journalctl@ceph.mon.c.smithi116.stdout: read_amp_bytes_per_bit: 0 2024-09-19T04:40:08.874 INFO:journalctl@ceph.mon.c.smithi116.stdout: format_version: 5 2024-09-19T04:40:08.874 INFO:journalctl@ceph.mon.c.smithi116.stdout: enable_index_compression: 1 2024-09-19T04:40:08.874 INFO:journalctl@ceph.mon.c.smithi116.stdout: block_align: 0 2024-09-19T04:40:08.874 INFO:journalctl@ceph.mon.c.smithi116.stdout: max_auto_readahead_size: 262144 2024-09-19T04:40:08.874 INFO:journalctl@ceph.mon.c.smithi116.stdout: prepopulate_block_cache: 0 2024-09-19T04:40:08.874 INFO:journalctl@ceph.mon.c.smithi116.stdout: initial_auto_readahead_size: 8192 2024-09-19T04:40:08.874 INFO:journalctl@ceph.mon.c.smithi116.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T04:40:08.874 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T04:40:08.875 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T04:40:08.875 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.compression: NoCompression 2024-09-19T04:40:08.875 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T04:40:08.875 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T04:40:08.875 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T04:40:08.875 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.num_levels: 7 2024-09-19T04:40:08.875 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T04:40:08.875 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T04:40:08.875 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T04:40:08.875 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T04:40:08.875 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T04:40:08.875 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T04:40:08.875 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T04:40:08.876 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T04:40:08.876 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T04:40:08.876 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T04:40:08.876 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T04:40:08.876 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T04:40:08.876 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T04:40:08.876 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T04:40:08.876 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T04:40:08.876 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T04:40:08.876 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T04:40:08.876 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T04:40:08.877 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T04:40:08.877 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T04:40:08.877 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T04:40:08.877 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T04:40:08.877 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T04:40:08.877 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T04:40:08.877 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T04:40:08.877 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T04:40:08.877 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T04:40:08.877 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T04:40:08.877 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T04:40:08.877 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T04:40:08.877 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T04:40:08.878 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T04:40:08.878 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T04:40:08.878 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T04:40:08.878 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T04:40:08.878 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T04:40:08.878 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T04:40:08.878 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T04:40:08.878 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T04:40:08.878 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T04:40:08.878 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T04:40:08.878 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T04:40:08.879 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T04:40:08.879 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T04:40:08.879 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T04:40:08.879 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T04:40:08.879 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T04:40:08.879 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T04:40:08.879 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T04:40:08.879 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T04:40:08.879 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T04:40:08.879 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T04:40:08.879 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T04:40:08.880 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T04:40:08.880 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.inplace_update_support: 0 2024-09-19T04:40:08.880 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T04:40:08.880 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T04:40:08.880 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T04:40:08.880 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T04:40:08.880 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.bloom_locality: 0 2024-09-19T04:40:08.880 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.max_successive_merges: 0 2024-09-19T04:40:08.880 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T04:40:08.880 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T04:40:08.880 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T04:40:08.880 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T04:40:08.880 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.ttl: 2592000 2024-09-19T04:40:08.880 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T04:40:08.881 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T04:40:08.881 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T04:40:08.881 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.enable_blob_files: false 2024-09-19T04:40:08.881 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.min_blob_size: 0 2024-09-19T04:40:08.881 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T04:40:08.881 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T04:40:08.881 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T04:40:08.881 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T04:40:08.881 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T04:40:08.881 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T04:40:08.881 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T04:40:08.881 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T04:40:08.881 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-19T04:40:08.881 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-19T04:40:08.882 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 80d0d2e2-407d-4f55-98f1-3c9fd64b114b 2024-09-19T04:40:08.882 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726720808537869, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-19T04:40:08.882 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-19T04:40:08.882 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726720808538262, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726720808, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "80d0d2e2-407d-4f55-98f1-3c9fd64b114b", "db_session_id": "5GNCI2HJD43ZVZ8ALCN6", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-19T04:40:08.882 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726720808538353, "job": 1, "event": "recovery_finished"} 2024-09-19T04:40:08.882 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-19T04:40:08.882 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T04:40:08.882 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5612824e4e00 2024-09-19T04:40:08.882 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: DB pointer 0x5612825e0000 2024-09-19T04:40:08.882 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T04:40:08.882 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T04:40:08.882 INFO:journalctl@ceph.mon.c.smithi116.stdout: ** DB Stats ** 2024-09-19T04:40:08.882 INFO:journalctl@ceph.mon.c.smithi116.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T04:40:08.883 INFO:journalctl@ceph.mon.c.smithi116.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T04:40:08.883 INFO:journalctl@ceph.mon.c.smithi116.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T04:40:08.883 INFO:journalctl@ceph.mon.c.smithi116.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T04:40:08.883 INFO:journalctl@ceph.mon.c.smithi116.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T04:40:08.883 INFO:journalctl@ceph.mon.c.smithi116.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T04:40:08.883 INFO:journalctl@ceph.mon.c.smithi116.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T04:40:08.883 INFO:journalctl@ceph.mon.c.smithi116.stdout: 2024-09-19T04:40:08.883 INFO:journalctl@ceph.mon.c.smithi116.stdout: ** Compaction Stats [default] ** 2024-09-19T04:40:08.883 INFO:journalctl@ceph.mon.c.smithi116.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T04:40:08.883 INFO:journalctl@ceph.mon.c.smithi116.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T04:40:08.883 INFO:journalctl@ceph.mon.c.smithi116.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T04:40:08.883 INFO:journalctl@ceph.mon.c.smithi116.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T04:40:08.883 INFO:journalctl@ceph.mon.c.smithi116.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T04:40:08.884 INFO:journalctl@ceph.mon.c.smithi116.stdout: 2024-09-19T04:40:08.884 INFO:journalctl@ceph.mon.c.smithi116.stdout: ** Compaction Stats [default] ** 2024-09-19T04:40:08.884 INFO:journalctl@ceph.mon.c.smithi116.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T04:40:08.884 INFO:journalctl@ceph.mon.c.smithi116.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T04:40:08.884 INFO:journalctl@ceph.mon.c.smithi116.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T04:40:08.884 INFO:journalctl@ceph.mon.c.smithi116.stdout: 2024-09-19T04:40:08.884 INFO:journalctl@ceph.mon.c.smithi116.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T04:40:08.884 INFO:journalctl@ceph.mon.c.smithi116.stdout: 2024-09-19T04:40:08.884 INFO:journalctl@ceph.mon.c.smithi116.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T04:40:08.884 INFO:journalctl@ceph.mon.c.smithi116.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T04:40:08.884 INFO:journalctl@ceph.mon.c.smithi116.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T04:40:08.884 INFO:journalctl@ceph.mon.c.smithi116.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T04:40:08.885 INFO:journalctl@ceph.mon.c.smithi116.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T04:40:08.885 INFO:journalctl@ceph.mon.c.smithi116.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T04:40:08.885 INFO:journalctl@ceph.mon.c.smithi116.stdout: Cumulative compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T04:40:08.885 INFO:journalctl@ceph.mon.c.smithi116.stdout: Interval compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T04:40:08.885 INFO:journalctl@ceph.mon.c.smithi116.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T04:40:08.885 INFO:journalctl@ceph.mon.c.smithi116.stdout: Block cache BinnedLRUCache@0x5612824b71f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2024-09-19T04:40:08.885 INFO:journalctl@ceph.mon.c.smithi116.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-19T04:40:08.885 INFO:journalctl@ceph.mon.c.smithi116.stdout: 2024-09-19T04:40:08.885 INFO:journalctl@ceph.mon.c.smithi116.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T04:40:08.885 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-19T04:40:08.885 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: using public_addr v2:172.21.15.116:0/0 -> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-19T04:40:08.885 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: starting mon.c rank -1 at public addrs [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] at bind addrs [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid d46630c4-7640-11ef-bceb-c7b262605968 2024-09-19T04:40:08.885 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: mon.c@-1(???) e0 preinit fsid d46630c4-7640-11ef-bceb-c7b262605968 2024-09-19T04:40:08.886 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: mon.c@-1(synchronizing).mds e1 new map 2024-09-19T04:40:08.886 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-19T04:40:08.886 INFO:journalctl@ceph.mon.c.smithi116.stdout: e1 2024-09-19T04:40:08.886 INFO:journalctl@ceph.mon.c.smithi116.stdout: btime 2024-09-19T04:38:39:698336+0000 2024-09-19T04:40:08.886 INFO:journalctl@ceph.mon.c.smithi116.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T04:40:08.886 INFO:journalctl@ceph.mon.c.smithi116.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T04:40:08.886 INFO:journalctl@ceph.mon.c.smithi116.stdout: legacy client fscid: -1 2024-09-19T04:40:08.886 INFO:journalctl@ceph.mon.c.smithi116.stdout: 2024-09-19T04:40:08.886 INFO:journalctl@ceph.mon.c.smithi116.stdout: No filesystems configured 2024-09-19T04:40:08.886 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-19T04:40:08.886 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-19T04:40:08.886 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-19T04:40:08.886 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-19T04:40:08.886 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-19T04:40:08.887 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-19T04:40:08.887 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T04:40:08.887 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T04:40:08.887 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T04:40:08.887 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T04:40:08.887 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:40:08.887 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/3728581667' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T04:40:08.887 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:08.887 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/3728581667' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T04:40:08.887 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T04:40:08.888 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:08.888 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:08.888 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:08.888 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:08.888 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi116", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:40:08.888 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:08.888 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:40:08.888 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: Updating smithi116:/etc/ceph/ceph.conf 2024-09-19T04:40:08.888 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:08.888 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:08.888 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:08.888 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:08.888 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T04:40:08.888 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:08.889 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: Updating smithi116:/var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:40:08.889 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:08.889 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: Updating smithi116:/etc/ceph/ceph.client.admin.keyring 2024-09-19T04:40:08.889 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: Updating smithi116:/var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T04:40:08.889 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi002:172.21.15.2=a;smithi018:172.21.15.18=b;smithi116:172.21.15.116=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:40:08.889 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: Saving service mon spec with placement smithi002:172.21.15.2=a;smithi018:172.21.15.18=b;smithi116:172.21.15.116=c;count:3 2024-09-19T04:40:08.889 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: Deploying daemon mon.c on smithi116 2024-09-19T04:40:08.889 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:08.889 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: from='client.? 172.21.15.116:0/541589052' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T04:40:08.889 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 ceph-mon[34477]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-19T04:40:08.889 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 bash[34457]: cbe5b534edd459d03f0a525bcfb708adc1de949a7bd789e92b0b38ca556526d5 2024-09-19T04:40:08.889 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:08 smithi116 systemd[1]: Started Ceph mon.c for d46630c4-7640-11ef-bceb-c7b262605968. 2024-09-19T04:40:09.083 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T04:40:09.083 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T04:40:09.341 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T04:40:14.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:13 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:40:14.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:13 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:40:14.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:13 smithi002 ceph-mon[30975]: mon.a calling monitor election 2024-09-19T04:40:14.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:13 smithi002 ceph-mon[30975]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:14.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:13 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:40:14.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:13 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:40:14.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:13 smithi002 ceph-mon[30975]: mon.c calling monitor election 2024-09-19T04:40:14.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:13 smithi002 ceph-mon[30975]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:14.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:13 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:40:14.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:13 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:40:14.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:13 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:40:14.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:13 smithi002 ceph-mon[30975]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T04:40:14.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:13 smithi002 ceph-mon[30975]: monmap epoch 2 2024-09-19T04:40:14.112 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:13 smithi002 ceph-mon[30975]: fsid d46630c4-7640-11ef-bceb-c7b262605968 2024-09-19T04:40:14.112 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:13 smithi002 ceph-mon[30975]: last_changed 2024-09-19T04:40:08.563293+0000 2024-09-19T04:40:14.112 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:13 smithi002 ceph-mon[30975]: created 2024-09-19T04:38:36.676338+0000 2024-09-19T04:40:14.112 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:13 smithi002 ceph-mon[30975]: min_mon_release 19 (squid) 2024-09-19T04:40:14.112 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:13 smithi002 ceph-mon[30975]: election_strategy: 1 2024-09-19T04:40:14.112 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:13 smithi002 ceph-mon[30975]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-19T04:40:14.112 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:13 smithi002 ceph-mon[30975]: 1: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.c 2024-09-19T04:40:14.112 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:13 smithi002 ceph-mon[30975]: fsmap 2024-09-19T04:40:14.112 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:13 smithi002 ceph-mon[30975]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T04:40:14.112 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:13 smithi002 ceph-mon[30975]: mgrmap e13: x(active, since 38s) 2024-09-19T04:40:14.112 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:13 smithi002 ceph-mon[30975]: overall HEALTH_OK 2024-09-19T04:40:14.112 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:13 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:14.113 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:13 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:14.113 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:13 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:14.113 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:13 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T04:40:14.113 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:13 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:14.113 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:13 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:40:14.113 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:13 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:40:14.113 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:13 smithi116 ceph-mon[34477]: mon.a calling monitor election 2024-09-19T04:40:14.114 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:13 smithi116 ceph-mon[34477]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:14.114 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:13 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:40:14.114 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:13 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:40:14.114 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:13 smithi116 ceph-mon[34477]: mon.c calling monitor election 2024-09-19T04:40:14.114 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:13 smithi116 ceph-mon[34477]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:14.114 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:13 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:40:14.114 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:13 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:40:14.114 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:13 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:40:14.114 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:13 smithi116 ceph-mon[34477]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T04:40:14.114 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:13 smithi116 ceph-mon[34477]: monmap epoch 2 2024-09-19T04:40:14.114 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:13 smithi116 ceph-mon[34477]: fsid d46630c4-7640-11ef-bceb-c7b262605968 2024-09-19T04:40:14.114 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:13 smithi116 ceph-mon[34477]: last_changed 2024-09-19T04:40:08.563293+0000 2024-09-19T04:40:14.114 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:13 smithi116 ceph-mon[34477]: created 2024-09-19T04:38:36.676338+0000 2024-09-19T04:40:14.115 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:13 smithi116 ceph-mon[34477]: min_mon_release 19 (squid) 2024-09-19T04:40:14.115 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:13 smithi116 ceph-mon[34477]: election_strategy: 1 2024-09-19T04:40:14.115 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:13 smithi116 ceph-mon[34477]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-19T04:40:14.115 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:13 smithi116 ceph-mon[34477]: 1: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.c 2024-09-19T04:40:14.115 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:13 smithi116 ceph-mon[34477]: fsmap 2024-09-19T04:40:14.115 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:13 smithi116 ceph-mon[34477]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T04:40:14.115 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:13 smithi116 ceph-mon[34477]: mgrmap e13: x(active, since 38s) 2024-09-19T04:40:14.115 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:13 smithi116 ceph-mon[34477]: overall HEALTH_OK 2024-09-19T04:40:14.115 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:13 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:14.115 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:13 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:14.115 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:13 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:14.115 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:13 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T04:40:14.115 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:13 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:14.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.111+0000 7f94d8933640 1 -- 172.21.15.116:0/2657580653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94bc003530 msgr2=0x7f94bc0059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:14.118 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.111+0000 7f94d8933640 1 --2- 172.21.15.116:0/2657580653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94bc003530 0x7f94bc0059c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f94d4102af0 tx=0x7f94c402c490 comp rx=0 tx=0).stop 2024-09-19T04:40:14.118 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.111+0000 7f94d8933640 1 -- 172.21.15.116:0/2657580653 shutdown_connections 2024-09-19T04:40:14.118 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.111+0000 7f94d8933640 1 --2- 172.21.15.116:0/2657580653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94bc003530 0x7f94bc0059c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:14.118 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.111+0000 7f94d8933640 1 -- 172.21.15.116:0/2657580653 >> 172.21.15.116:0/2657580653 conn(0x7f94d40fd320 msgr2=0x7f94d40ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:14.118 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.111+0000 7f94d8933640 1 -- 172.21.15.116:0/2657580653 shutdown_connections 2024-09-19T04:40:14.118 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.111+0000 7f94d8933640 1 -- 172.21.15.116:0/2657580653 wait complete. 2024-09-19T04:40:14.118 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.112+0000 7f94d8933640 1 Processor -- start 2024-09-19T04:40:14.118 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.112+0000 7f94d8933640 1 -- start start 2024-09-19T04:40:14.118 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.113+0000 7f94d8933640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94bc003530 0x7f94d41971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:14.118 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.113+0000 7f94d8933640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94d4197720 0x7f94d419bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:14.118 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.113+0000 7f94d8933640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f94d4109630 con 0x7f94d4197720 2024-09-19T04:40:14.118 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.113+0000 7f94d8933640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f94d41094b0 con 0x7f94bc003530 2024-09-19T04:40:14.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.113+0000 7f94d259c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94bc003530 0x7f94d41971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:14.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.113+0000 7f94d259c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94bc003530 0x7f94d41971e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:44048/0 (socket says 172.21.15.116:44048) 2024-09-19T04:40:14.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.113+0000 7f94d259c640 1 -- 172.21.15.116:0/505242697 learned_addr learned my addr 172.21.15.116:0/505242697 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-19T04:40:14.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.113+0000 7f94d259c640 1 -- 172.21.15.116:0/505242697 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94bc003530 msgr2=0x7f94d41971e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T04:40:14.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.113+0000 7f94d259c640 1 -- 172.21.15.116:0/505242697 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94bc003530 msgr2=0x7f94d41971e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T04:40:14.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.113+0000 7f94d259c640 1 --2- 172.21.15.116:0/505242697 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94bc003530 0x7f94d41971e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T04:40:14.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.113+0000 7f94d1d9b640 1 --2- 172.21.15.116:0/505242697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94d4197720 0x7f94d419bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:14.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.113+0000 7f94d259c640 1 --2- 172.21.15.116:0/505242697 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94bc003530 0x7f94d41971e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T04:40:14.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.113+0000 7f94d1d9b640 1 -- 172.21.15.116:0/505242697 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94bc003530 msgr2=0x7f94d41971e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T04:40:14.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.113+0000 7f94d1d9b640 1 --2- 172.21.15.116:0/505242697 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94bc003530 0x7f94d41971e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:14.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.113+0000 7f94d1d9b640 1 -- 172.21.15.116:0/505242697 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94d4197d40 con 0x7f94d4197720 2024-09-19T04:40:14.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.114+0000 7f94d1d9b640 1 --2- 172.21.15.116:0/505242697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94d4197720 0x7f94d419bab0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f94c800b9b0 tx=0x7f94c800be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:14.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.114+0000 7f94c37fe640 1 -- 172.21.15.116:0/505242697 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f94c800c920 con 0x7f94d4197720 2024-09-19T04:40:14.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.114+0000 7f94c37fe640 1 -- 172.21.15.116:0/505242697 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f94c8014440 con 0x7f94d4197720 2024-09-19T04:40:14.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.114+0000 7f94c37fe640 1 -- 172.21.15.116:0/505242697 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f94c8012520 con 0x7f94d4197720 2024-09-19T04:40:14.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.114+0000 7f94d8933640 1 -- 172.21.15.116:0/505242697 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94d419bff0 con 0x7f94d4197720 2024-09-19T04:40:14.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.114+0000 7f94d8933640 1 -- 172.21.15.116:0/505242697 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94d419c530 con 0x7f94d4197720 2024-09-19T04:40:14.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.115+0000 7f94c37fe640 1 -- 172.21.15.116:0/505242697 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f94c801c070 con 0x7f94d4197720 2024-09-19T04:40:14.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.115+0000 7f94d8933640 1 -- 172.21.15.116:0/505242697 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94d4102da0 con 0x7f94d4197720 2024-09-19T04:40:14.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.115+0000 7f94c37fe640 1 --2- 172.21.15.116:0/505242697 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f94b4039090 0x7f94b403b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:14.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.115+0000 7f94c37fe640 1 -- 172.21.15.116:0/505242697 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f94c804bca0 con 0x7f94d4197720 2024-09-19T04:40:14.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.116+0000 7f94d259c640 1 --2- 172.21.15.116:0/505242697 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f94b4039090 0x7f94b403b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:14.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.116+0000 7f94d259c640 1 --2- 172.21.15.116:0/505242697 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f94b4039090 0x7f94b403b550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f94c4012c10 tx=0x7f94c40323a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:14.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.120+0000 7f94c37fe640 1 -- 172.21.15.116:0/505242697 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f94c8013560 con 0x7f94d4197720 2024-09-19T04:40:14.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.352+0000 7f94d8933640 1 -- 172.21.15.116:0/505242697 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f94d419c870 con 0x7f94d4197720 2024-09-19T04:40:14.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.353+0000 7f94c37fe640 1 -- 172.21.15.116:0/505242697 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1011 (secure 0 0 0) 0x7f94c800e0a0 con 0x7f94d4197720 2024-09-19T04:40:14.354 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-19T04:40:14.354 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":2,"fsid":"d46630c4-7640-11ef-bceb-c7b262605968","modified":"2024-09-19T04:40:08.563293Z","created":"2024-09-19T04:38:36.676338Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:3300","nonce":0},{"type":"v1","addr":"172.21.15.116:6789","nonce":0}]},"addr":"172.21.15.116:6789/0","public_addr":"172.21.15.116:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T04:40:14.354 INFO:teuthology.orchestra.run.smithi116.stderr:dumped monmap epoch 2 2024-09-19T04:40:14.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.355+0000 7f94d8933640 1 -- 172.21.15.116:0/505242697 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f94b4039090 msgr2=0x7f94b403b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:14.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.355+0000 7f94d8933640 1 --2- 172.21.15.116:0/505242697 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f94b4039090 0x7f94b403b550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f94c4012c10 tx=0x7f94c40323a0 comp rx=0 tx=0).stop 2024-09-19T04:40:14.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.355+0000 7f94d8933640 1 -- 172.21.15.116:0/505242697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94d4197720 msgr2=0x7f94d419bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:14.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.355+0000 7f94d8933640 1 --2- 172.21.15.116:0/505242697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94d4197720 0x7f94d419bab0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f94c800b9b0 tx=0x7f94c800be70 comp rx=0 tx=0).stop 2024-09-19T04:40:14.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.355+0000 7f94d8933640 1 -- 172.21.15.116:0/505242697 shutdown_connections 2024-09-19T04:40:14.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.355+0000 7f94d8933640 1 --2- 172.21.15.116:0/505242697 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f94b4039090 0x7f94b403b550 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:14.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.355+0000 7f94d8933640 1 --2- 172.21.15.116:0/505242697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94d4197720 0x7f94d419bab0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:14.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.355+0000 7f94d8933640 1 --2- 172.21.15.116:0/505242697 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94bc003530 0x7f94d41971e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:14.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.355+0000 7f94d8933640 1 -- 172.21.15.116:0/505242697 >> 172.21.15.116:0/505242697 conn(0x7f94d40fd320 msgr2=0x7f94d4105170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:14.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.355+0000 7f94d8933640 1 -- 172.21.15.116:0/505242697 shutdown_connections 2024-09-19T04:40:14.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:14.355+0000 7f94d8933640 1 -- 172.21.15.116:0/505242697 wait complete. 2024-09-19T04:40:14.973 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:14 smithi116 ceph-mon[34477]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:14.973 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:14 smithi116 ceph-mon[34477]: Deploying daemon mon.b on smithi018 2024-09-19T04:40:14.973 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:14 smithi116 ceph-mon[34477]: from='client.? 172.21.15.116:0/505242697' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T04:40:14.973 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:14 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:40:15.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:14 smithi002 ceph-mon[30975]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:15.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:14 smithi002 ceph-mon[30975]: Deploying daemon mon.b on smithi018 2024-09-19T04:40:15.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:14 smithi002 ceph-mon[30975]: from='client.? 172.21.15.116:0/505242697' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T04:40:15.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:14 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:40:16.002 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T04:40:16.003 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T04:40:16.253 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T04:40:16.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.681+0000 7f18a3971640 1 -- 172.21.15.116:0/2872409446 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f189c107660 msgr2=0x7f189c107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:16.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.681+0000 7f18a3971640 1 --2- 172.21.15.116:0/2872409446 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f189c107660 0x7f189c107a40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1898009880 tx=0x7f189802a5d0 comp rx=0 tx=0).stop 2024-09-19T04:40:16.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.682+0000 7f18a3971640 1 -- 172.21.15.116:0/2872409446 shutdown_connections 2024-09-19T04:40:16.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.682+0000 7f18a3971640 1 --2- 172.21.15.116:0/2872409446 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f189c107660 0x7f189c107a40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:16.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.682+0000 7f18a3971640 1 -- 172.21.15.116:0/2872409446 >> 172.21.15.116:0/2872409446 conn(0x7f189c0fd320 msgr2=0x7f189c0ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:16.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.682+0000 7f18a3971640 1 -- 172.21.15.116:0/2872409446 shutdown_connections 2024-09-19T04:40:16.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.682+0000 7f18a3971640 1 -- 172.21.15.116:0/2872409446 wait complete. 2024-09-19T04:40:16.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.682+0000 7f18a3971640 1 Processor -- start 2024-09-19T04:40:16.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.682+0000 7f18a3971640 1 -- start start 2024-09-19T04:40:16.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.682+0000 7f18a3971640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f189c107660 0x7f189c197240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:16.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.682+0000 7f18a3971640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f189c197780 0x7f189c19bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:16.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.682+0000 7f18a3971640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f189c10bbd0 con 0x7f189c197780 2024-09-19T04:40:16.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.682+0000 7f18a3971640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f189c10ba50 con 0x7f189c107660 2024-09-19T04:40:16.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.683+0000 7f18a170d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f189c107660 0x7f189c197240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:16.685 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.683+0000 7f18a170d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f189c107660 0x7f189c197240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:44062/0 (socket says 172.21.15.116:44062) 2024-09-19T04:40:16.685 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.683+0000 7f18a170d640 1 -- 172.21.15.116:0/1404606638 learned_addr learned my addr 172.21.15.116:0/1404606638 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-19T04:40:16.685 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.683+0000 7f18a170d640 1 -- 172.21.15.116:0/1404606638 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f189c107660 msgr2=0x7f189c197240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T04:40:16.685 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.683+0000 7f18a170d640 1 -- 172.21.15.116:0/1404606638 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f189c107660 msgr2=0x7f189c197240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T04:40:16.685 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.683+0000 7f18a170d640 1 --2- 172.21.15.116:0/1404606638 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f189c107660 0x7f189c197240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T04:40:16.685 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.683+0000 7f18a170d640 1 --2- 172.21.15.116:0/1404606638 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f189c107660 0x7f189c197240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T04:40:16.685 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.683+0000 7f18a0f0c640 1 --2- 172.21.15.116:0/1404606638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f189c197780 0x7f189c19bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:16.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.683+0000 7f18a0f0c640 1 -- 172.21.15.116:0/1404606638 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f189c107660 msgr2=0x7f189c197240 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T04:40:16.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.683+0000 7f18a0f0c640 1 --2- 172.21.15.116:0/1404606638 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f189c107660 0x7f189c197240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:16.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.683+0000 7f18a0f0c640 1 -- 172.21.15.116:0/1404606638 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f189c197da0 con 0x7f189c197780 2024-09-19T04:40:16.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.683+0000 7f18a0f0c640 1 --2- 172.21.15.116:0/1404606638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f189c197780 0x7f189c19bb10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f188c00b3d0 tx=0x7f188c00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:16.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.684+0000 7f18927fc640 1 -- 172.21.15.116:0/1404606638 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f188c011630 con 0x7f189c197780 2024-09-19T04:40:16.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.684+0000 7f18927fc640 1 -- 172.21.15.116:0/1404606638 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f188c011c80 con 0x7f189c197780 2024-09-19T04:40:16.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.684+0000 7f18a3971640 1 -- 172.21.15.116:0/1404606638 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f189c19c050 con 0x7f189c197780 2024-09-19T04:40:16.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.684+0000 7f18927fc640 1 -- 172.21.15.116:0/1404606638 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f188c010d80 con 0x7f189c197780 2024-09-19T04:40:16.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.684+0000 7f18a3971640 1 -- 172.21.15.116:0/1404606638 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f189c19c590 con 0x7f189c197780 2024-09-19T04:40:16.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.685+0000 7f18927fc640 1 -- 172.21.15.116:0/1404606638 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f188c018020 con 0x7f189c197780 2024-09-19T04:40:16.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.685+0000 7f18a3971640 1 -- 172.21.15.116:0/1404606638 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f189c102da0 con 0x7f189c197780 2024-09-19T04:40:16.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.685+0000 7f18927fc640 1 --2- 172.21.15.116:0/1404606638 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f1888039030 0x7f188803b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:16.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.685+0000 7f18927fc640 1 -- 172.21.15.116:0/1404606638 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f188c04bfd0 con 0x7f189c197780 2024-09-19T04:40:16.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.685+0000 7f18a170d640 1 --2- 172.21.15.116:0/1404606638 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f1888039030 0x7f188803b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:16.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.685+0000 7f18a170d640 1 --2- 172.21.15.116:0/1404606638 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f1888039030 0x7f188803b4f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f189802abc0 tx=0x7f189802aad0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:16.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.690+0000 7f18927fc640 1 -- 172.21.15.116:0/1404606638 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f188c01f020 con 0x7f189c197780 2024-09-19T04:40:16.919 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.918+0000 7f18a3971640 1 -- 172.21.15.116:0/1404606638 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f189c19c8a0 con 0x7f189c197780 2024-09-19T04:40:16.920 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:16 smithi116 ceph-mon[34477]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:16.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.919+0000 7f18927fc640 1 -- 172.21.15.116:0/1404606638 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1011 (secure 0 0 0) 0x7f188c0189a0 con 0x7f189c197780 2024-09-19T04:40:16.920 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-19T04:40:16.921 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":2,"fsid":"d46630c4-7640-11ef-bceb-c7b262605968","modified":"2024-09-19T04:40:08.563293Z","created":"2024-09-19T04:38:36.676338Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:3300","nonce":0},{"type":"v1","addr":"172.21.15.116:6789","nonce":0}]},"addr":"172.21.15.116:6789/0","public_addr":"172.21.15.116:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T04:40:16.921 INFO:teuthology.orchestra.run.smithi116.stderr:dumped monmap epoch 2 2024-09-19T04:40:16.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.921+0000 7f18a3971640 1 -- 172.21.15.116:0/1404606638 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f1888039030 msgr2=0x7f188803b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:16.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.921+0000 7f18a3971640 1 --2- 172.21.15.116:0/1404606638 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f1888039030 0x7f188803b4f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f189802abc0 tx=0x7f189802aad0 comp rx=0 tx=0).stop 2024-09-19T04:40:16.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.921+0000 7f18a3971640 1 -- 172.21.15.116:0/1404606638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f189c197780 msgr2=0x7f189c19bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:16.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.921+0000 7f18a3971640 1 --2- 172.21.15.116:0/1404606638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f189c197780 0x7f189c19bb10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f188c00b3d0 tx=0x7f188c00b890 comp rx=0 tx=0).stop 2024-09-19T04:40:16.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.921+0000 7f18a3971640 1 -- 172.21.15.116:0/1404606638 shutdown_connections 2024-09-19T04:40:16.923 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.921+0000 7f18a3971640 1 --2- 172.21.15.116:0/1404606638 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f1888039030 0x7f188803b4f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:16.923 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.921+0000 7f18a3971640 1 --2- 172.21.15.116:0/1404606638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f189c197780 0x7f189c19bb10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:16.923 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.921+0000 7f18a3971640 1 --2- 172.21.15.116:0/1404606638 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f189c107660 0x7f189c197240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:16.923 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.921+0000 7f18a3971640 1 -- 172.21.15.116:0/1404606638 >> 172.21.15.116:0/1404606638 conn(0x7f189c0fd320 msgr2=0x7f189c0fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:16.923 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.921+0000 7f18a3971640 1 -- 172.21.15.116:0/1404606638 shutdown_connections 2024-09-19T04:40:16.923 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:16.921+0000 7f18a3971640 1 -- 172.21.15.116:0/1404606638 wait complete. 2024-09-19T04:40:17.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:16 smithi002 ceph-mon[30975]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:17.669 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: mon.b@-1(???) e0 preinit fsid d46630c4-7640-11ef-bceb-c7b262605968 2024-09-19T04:40:17.669 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: mon.b@-1(synchronizing).mds e1 new map 2024-09-19T04:40:17.669 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-19T04:40:17.669 INFO:journalctl@ceph.mon.b.smithi018.stdout: e1 2024-09-19T04:40:17.669 INFO:journalctl@ceph.mon.b.smithi018.stdout: btime 2024-09-19T04:38:39:698336+0000 2024-09-19T04:40:17.669 INFO:journalctl@ceph.mon.b.smithi018.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T04:40:17.669 INFO:journalctl@ceph.mon.b.smithi018.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T04:40:17.669 INFO:journalctl@ceph.mon.b.smithi018.stdout: legacy client fscid: -1 2024-09-19T04:40:17.669 INFO:journalctl@ceph.mon.b.smithi018.stdout: 2024-09-19T04:40:17.669 INFO:journalctl@ceph.mon.b.smithi018.stdout: No filesystems configured 2024-09-19T04:40:17.670 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-19T04:40:17.670 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-19T04:40:18.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-19T04:40:18.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-19T04:40:18.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-19T04:40:18.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-19T04:40:18.058 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T04:40:18.058 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T04:40:18.058 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T04:40:18.058 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T04:40:18.058 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:40:18.058 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/3728581667' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T04:40:18.058 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:18.058 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/3728581667' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T04:40:18.058 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T04:40:18.058 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:18.058 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:18.058 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:18.059 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:18.059 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi116", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:40:18.059 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:18.059 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:40:18.059 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: Updating smithi116:/etc/ceph/ceph.conf 2024-09-19T04:40:18.059 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:18.059 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:18.059 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:18.059 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:18.059 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T04:40:18.059 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:18.059 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: Updating smithi116:/var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:40:18.059 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:18.059 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: Updating smithi116:/etc/ceph/ceph.client.admin.keyring 2024-09-19T04:40:18.060 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: Updating smithi116:/var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T04:40:18.060 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi002:172.21.15.2=a;smithi018:172.21.15.18=b;smithi116:172.21.15.116=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:40:18.060 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: Saving service mon spec with placement smithi002:172.21.15.2=a;smithi018:172.21.15.18=b;smithi116:172.21.15.116=c;count:3 2024-09-19T04:40:18.060 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: Deploying daemon mon.c on smithi116 2024-09-19T04:40:18.060 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:18.060 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: from='client.? 172.21.15.116:0/541589052' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T04:40:18.061 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:40:18.061 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:40:18.061 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: mon.a calling monitor election 2024-09-19T04:40:18.061 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:18.061 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:40:18.061 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:40:18.061 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: mon.c calling monitor election 2024-09-19T04:40:18.061 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:18.061 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:40:18.061 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:40:18.061 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:40:18.061 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T04:40:18.062 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: monmap epoch 2 2024-09-19T04:40:18.062 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: fsid d46630c4-7640-11ef-bceb-c7b262605968 2024-09-19T04:40:18.062 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: last_changed 2024-09-19T04:40:08.563293+0000 2024-09-19T04:40:18.062 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: created 2024-09-19T04:38:36.676338+0000 2024-09-19T04:40:18.062 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: min_mon_release 19 (squid) 2024-09-19T04:40:18.062 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: election_strategy: 1 2024-09-19T04:40:18.062 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-19T04:40:18.062 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: 1: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.c 2024-09-19T04:40:18.062 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: fsmap 2024-09-19T04:40:18.062 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T04:40:18.062 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: mgrmap e13: x(active, since 38s) 2024-09-19T04:40:18.062 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: overall HEALTH_OK 2024-09-19T04:40:18.062 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:18.063 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:18.063 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:18.063 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T04:40:18.063 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:18.063 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:18.063 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: Deploying daemon mon.b on smithi018 2024-09-19T04:40:18.063 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: from='client.? 172.21.15.116:0/505242697' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T04:40:18.063 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:40:18.063 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:18.063 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: from='client.? 172.21.15.116:0/1404606638' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T04:40:18.063 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 ceph-mon[34537]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-19T04:40:18.063 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 bash[34518]: 55d975b2834d9b34fc002617891f73a61cbe48c9aabb452e730539da73498132 2024-09-19T04:40:18.063 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:17 smithi018 systemd[1]: Started Ceph mon.b for d46630c4-7640-11ef-bceb-c7b262605968. 2024-09-19T04:40:18.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:17 smithi002 ceph-mon[30975]: from='client.? 172.21.15.116:0/1404606638' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T04:40:18.110 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:17 smithi116 ceph-mon[34477]: from='client.? 172.21.15.116:0/1404606638' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T04:40:18.517 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T04:40:18.704 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T04:40:18.953 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T04:40:22.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:22.962+0000 7fbf95b2c640 1 -- 172.21.15.116:0/2922780238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf78003530 msgr2=0x7fbf780059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:22.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:22.962+0000 7fbf95b2c640 1 --2- 172.21.15.116:0/2922780238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf78003530 0x7fbf780059c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbf901016a0 tx=0x7fbf8002bdd0 comp rx=0 tx=0).stop 2024-09-19T04:40:22.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:22.962+0000 7fbf95b2c640 1 -- 172.21.15.116:0/2922780238 shutdown_connections 2024-09-19T04:40:22.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:22.962+0000 7fbf95b2c640 1 --2- 172.21.15.116:0/2922780238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf78003530 0x7fbf780059c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:22.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:22.962+0000 7fbf95b2c640 1 -- 172.21.15.116:0/2922780238 >> 172.21.15.116:0/2922780238 conn(0x7fbf900fc220 msgr2=0x7fbf900fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:22.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:22.962+0000 7fbf95b2c640 1 -- 172.21.15.116:0/2922780238 shutdown_connections 2024-09-19T04:40:22.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:22.962+0000 7fbf95b2c640 1 -- 172.21.15.116:0/2922780238 wait complete. 2024-09-19T04:40:22.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:22.962+0000 7fbf95b2c640 1 Processor -- start 2024-09-19T04:40:22.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:22.963+0000 7fbf95b2c640 1 -- start start 2024-09-19T04:40:22.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:22.963+0000 7fbf95b2c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf78003530 0x7fbf90196190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:22.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:22.963+0000 7fbf95b2c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf901966d0 0x7fbf9019aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:22.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:22.963+0000 7fbf95b2c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbf9019afa0 0x7fbf9019b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:22.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:22.963+0000 7fbf95b2c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbf90108510 con 0x7fbf78003530 2024-09-19T04:40:22.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:22.963+0000 7fbf95b2c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbf90108390 con 0x7fbf901966d0 2024-09-19T04:40:22.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:22.963+0000 7fbf95b2c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fbf90108690 con 0x7fbf9019afa0 2024-09-19T04:40:22.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:22.963+0000 7fbf8ffff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbf9019afa0 0x7fbf9019b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:22.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:22.963+0000 7fbf8ffff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbf9019afa0 0x7fbf9019b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:47138/0 (socket says 172.21.15.116:47138) 2024-09-19T04:40:22.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:22.963+0000 7fbf8ffff640 1 -- 172.21.15.116:0/3228529355 learned_addr learned my addr 172.21.15.116:0/3228529355 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-19T04:40:22.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:22.963+0000 7fbf8effd640 1 --2- 172.21.15.116:0/3228529355 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf901966d0 0x7fbf9019aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:22.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:22.963+0000 7fbf8f7fe640 1 --2- 172.21.15.116:0/3228529355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf78003530 0x7fbf90196190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:22.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:22.963+0000 7fbf8ffff640 1 -- 172.21.15.116:0/3228529355 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbf9019afa0 msgr2=0x7fbf9019b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-19T04:40:22.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:22.963+0000 7fbf8ffff640 1 -- 172.21.15.116:0/3228529355 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbf9019afa0 msgr2=0x7fbf9019b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T04:40:22.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:22.963+0000 7fbf8ffff640 1 --2- 172.21.15.116:0/3228529355 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbf9019afa0 0x7fbf9019b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T04:40:22.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:22.963+0000 7fbf8ffff640 1 --2- 172.21.15.116:0/3228529355 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbf9019afa0 0x7fbf9019b450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T04:40:22.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:22.963+0000 7fbf8effd640 1 -- 172.21.15.116:0/3228529355 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf901966d0 msgr2=0x7fbf9019aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-19T04:40:22.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:22.963+0000 7fbf8effd640 1 -- 172.21.15.116:0/3228529355 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf901966d0 msgr2=0x7fbf9019aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T04:40:22.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:22.963+0000 7fbf8effd640 1 --2- 172.21.15.116:0/3228529355 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf901966d0 0x7fbf9019aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T04:40:22.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:22.963+0000 7fbf8effd640 1 --2- 172.21.15.116:0/3228529355 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf901966d0 0x7fbf9019aa60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T04:40:22.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:22.964+0000 7fbf8f7fe640 1 -- 172.21.15.116:0/3228529355 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbf9019afa0 msgr2=0x7fbf9019b450 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T04:40:22.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:22.964+0000 7fbf8f7fe640 1 --2- 172.21.15.116:0/3228529355 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbf9019afa0 0x7fbf9019b450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:22.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:22.964+0000 7fbf8f7fe640 1 -- 172.21.15.116:0/3228529355 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf901966d0 msgr2=0x7fbf9019aa60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T04:40:22.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:22.964+0000 7fbf8f7fe640 1 --2- 172.21.15.116:0/3228529355 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf901966d0 0x7fbf9019aa60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:22.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:22.964+0000 7fbf8f7fe640 1 -- 172.21.15.116:0/3228529355 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf9006a430 con 0x7fbf78003530 2024-09-19T04:40:22.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:22.964+0000 7fbf8f7fe640 1 --2- 172.21.15.116:0/3228529355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf78003530 0x7fbf90196190 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbf80009d60 tx=0x7fbf8002cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:22.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:22.964+0000 7fbf8cff9640 1 -- 172.21.15.116:0/3228529355 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf80039070 con 0x7fbf78003530 2024-09-19T04:40:22.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:22.964+0000 7fbf95b2c640 1 -- 172.21.15.116:0/3228529355 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf9006a6c0 con 0x7fbf78003530 2024-09-19T04:40:22.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:22.964+0000 7fbf8cff9640 1 -- 172.21.15.116:0/3228529355 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbf80003e20 con 0x7fbf78003530 2024-09-19T04:40:22.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:22.964+0000 7fbf8cff9640 1 -- 172.21.15.116:0/3228529355 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf8003c3d0 con 0x7fbf78003530 2024-09-19T04:40:22.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:22.964+0000 7fbf95b2c640 1 -- 172.21.15.116:0/3228529355 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf9006ac20 con 0x7fbf78003530 2024-09-19T04:40:22.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:22.965+0000 7fbf8cff9640 1 -- 172.21.15.116:0/3228529355 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fbf80044060 con 0x7fbf78003530 2024-09-19T04:40:22.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:22.965+0000 7fbf8cff9640 1 --2- 172.21.15.116:0/3228529355 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fbf7c039730 0x7fbf7c03bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:22.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:22.965+0000 7fbf95b2c640 1 -- 172.21.15.116:0/3228529355 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf90109600 con 0x7fbf78003530 2024-09-19T04:40:22.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:22.965+0000 7fbf8cff9640 1 -- 172.21.15.116:0/3228529355 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fbf8006d380 con 0x7fbf78003530 2024-09-19T04:40:22.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:22.965+0000 7fbf8effd640 1 --2- 172.21.15.116:0/3228529355 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fbf7c039730 0x7fbf7c03bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:22.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:22.966+0000 7fbf8effd640 1 --2- 172.21.15.116:0/3228529355 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fbf7c039730 0x7fbf7c03bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbf84006fd0 tx=0x7fbf84008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:22.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:22.970+0000 7fbf8cff9640 1 -- 172.21.15.116:0/3228529355 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbf80032340 con 0x7fbf78003530 2024-09-19T04:40:23.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:22 smithi018 ceph-mon[34537]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:23.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:22 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:40:23.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:22 smithi018 ceph-mon[34537]: mon.a calling monitor election 2024-09-19T04:40:23.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:22 smithi018 ceph-mon[34537]: mon.c calling monitor election 2024-09-19T04:40:23.058 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:22 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:40:23.058 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:22 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:40:23.058 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:22 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:40:23.058 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:22 smithi018 ceph-mon[34537]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:23.058 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:22 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:40:23.058 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:22 smithi018 ceph-mon[34537]: mon.b calling monitor election 2024-09-19T04:40:23.058 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:22 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:40:23.058 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:22 smithi018 ceph-mon[34537]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:23.058 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:22 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:40:23.058 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:22 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:40:23.059 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:22 smithi018 ceph-mon[34537]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T04:40:23.059 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:22 smithi018 ceph-mon[34537]: monmap epoch 3 2024-09-19T04:40:23.059 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:22 smithi018 ceph-mon[34537]: fsid d46630c4-7640-11ef-bceb-c7b262605968 2024-09-19T04:40:23.059 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:22 smithi018 ceph-mon[34537]: last_changed 2024-09-19T04:40:17.673092+0000 2024-09-19T04:40:23.059 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:22 smithi018 ceph-mon[34537]: created 2024-09-19T04:38:36.676338+0000 2024-09-19T04:40:23.059 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:22 smithi018 ceph-mon[34537]: min_mon_release 19 (squid) 2024-09-19T04:40:23.059 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:22 smithi018 ceph-mon[34537]: election_strategy: 1 2024-09-19T04:40:23.059 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:22 smithi018 ceph-mon[34537]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-19T04:40:23.059 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:22 smithi018 ceph-mon[34537]: 1: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.c 2024-09-19T04:40:23.059 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:22 smithi018 ceph-mon[34537]: 2: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.b 2024-09-19T04:40:23.059 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:22 smithi018 ceph-mon[34537]: fsmap 2024-09-19T04:40:23.060 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:22 smithi018 ceph-mon[34537]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T04:40:23.060 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:22 smithi018 ceph-mon[34537]: mgrmap e13: x(active, since 47s) 2024-09-19T04:40:23.060 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:22 smithi018 ceph-mon[34537]: overall HEALTH_OK 2024-09-19T04:40:23.060 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:22 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:23.060 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:22 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:23.060 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:22 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:23.060 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:22 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:23.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:22 smithi002 ceph-mon[30975]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:23.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:22 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:40:23.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:22 smithi002 ceph-mon[30975]: mon.a calling monitor election 2024-09-19T04:40:23.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:22 smithi002 ceph-mon[30975]: mon.c calling monitor election 2024-09-19T04:40:23.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:22 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:40:23.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:22 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:40:23.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:22 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:40:23.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:22 smithi002 ceph-mon[30975]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:23.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:22 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:40:23.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:22 smithi002 ceph-mon[30975]: mon.b calling monitor election 2024-09-19T04:40:23.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:22 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:40:23.112 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:22 smithi002 ceph-mon[30975]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:23.112 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:22 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:40:23.112 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:22 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:40:23.112 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:22 smithi002 ceph-mon[30975]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T04:40:23.112 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:22 smithi002 ceph-mon[30975]: monmap epoch 3 2024-09-19T04:40:23.112 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:22 smithi002 ceph-mon[30975]: fsid d46630c4-7640-11ef-bceb-c7b262605968 2024-09-19T04:40:23.112 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:22 smithi002 ceph-mon[30975]: last_changed 2024-09-19T04:40:17.673092+0000 2024-09-19T04:40:23.112 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:22 smithi002 ceph-mon[30975]: created 2024-09-19T04:38:36.676338+0000 2024-09-19T04:40:23.112 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:22 smithi002 ceph-mon[30975]: min_mon_release 19 (squid) 2024-09-19T04:40:23.112 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:22 smithi002 ceph-mon[30975]: election_strategy: 1 2024-09-19T04:40:23.112 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:22 smithi002 ceph-mon[30975]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-19T04:40:23.112 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:22 smithi002 ceph-mon[30975]: 1: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.c 2024-09-19T04:40:23.112 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:22 smithi002 ceph-mon[30975]: 2: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.b 2024-09-19T04:40:23.112 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:22 smithi002 ceph-mon[30975]: fsmap 2024-09-19T04:40:23.113 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:22 smithi002 ceph-mon[30975]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T04:40:23.113 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:22 smithi002 ceph-mon[30975]: mgrmap e13: x(active, since 47s) 2024-09-19T04:40:23.113 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:22 smithi002 ceph-mon[30975]: overall HEALTH_OK 2024-09-19T04:40:23.113 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:22 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:23.113 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:22 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:23.113 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:22 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:23.113 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:22 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:23.113 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:22 smithi116 ceph-mon[34477]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:23.113 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:22 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:40:23.114 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:22 smithi116 ceph-mon[34477]: mon.a calling monitor election 2024-09-19T04:40:23.114 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:22 smithi116 ceph-mon[34477]: mon.c calling monitor election 2024-09-19T04:40:23.114 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:22 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:40:23.114 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:22 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:40:23.114 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:22 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:40:23.114 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:22 smithi116 ceph-mon[34477]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:23.114 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:22 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:40:23.114 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:22 smithi116 ceph-mon[34477]: mon.b calling monitor election 2024-09-19T04:40:23.114 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:22 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:40:23.114 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:22 smithi116 ceph-mon[34477]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:23.114 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:22 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:40:23.114 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:22 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:40:23.115 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:22 smithi116 ceph-mon[34477]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T04:40:23.115 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:22 smithi116 ceph-mon[34477]: monmap epoch 3 2024-09-19T04:40:23.115 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:22 smithi116 ceph-mon[34477]: fsid d46630c4-7640-11ef-bceb-c7b262605968 2024-09-19T04:40:23.115 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:22 smithi116 ceph-mon[34477]: last_changed 2024-09-19T04:40:17.673092+0000 2024-09-19T04:40:23.115 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:22 smithi116 ceph-mon[34477]: created 2024-09-19T04:38:36.676338+0000 2024-09-19T04:40:23.115 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:22 smithi116 ceph-mon[34477]: min_mon_release 19 (squid) 2024-09-19T04:40:23.115 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:22 smithi116 ceph-mon[34477]: election_strategy: 1 2024-09-19T04:40:23.115 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:22 smithi116 ceph-mon[34477]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-19T04:40:23.115 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:22 smithi116 ceph-mon[34477]: 1: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.c 2024-09-19T04:40:23.115 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:22 smithi116 ceph-mon[34477]: 2: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.b 2024-09-19T04:40:23.115 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:22 smithi116 ceph-mon[34477]: fsmap 2024-09-19T04:40:23.115 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:22 smithi116 ceph-mon[34477]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T04:40:23.116 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:22 smithi116 ceph-mon[34477]: mgrmap e13: x(active, since 47s) 2024-09-19T04:40:23.116 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:22 smithi116 ceph-mon[34477]: overall HEALTH_OK 2024-09-19T04:40:23.116 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:22 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:23.116 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:22 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:23.116 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:22 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:23.116 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:22 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:23.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:23.225+0000 7fbf95b2c640 1 -- 172.21.15.116:0/3228529355 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fbf9018fc30 con 0x7fbf78003530 2024-09-19T04:40:23.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:23.226+0000 7fbf8cff9640 1 -- 172.21.15.116:0/3228529355 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1277 (secure 0 0 0) 0x7fbf80034bc0 con 0x7fbf78003530 2024-09-19T04:40:23.227 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-19T04:40:23.227 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":3,"fsid":"d46630c4-7640-11ef-bceb-c7b262605968","modified":"2024-09-19T04:40:17.673092Z","created":"2024-09-19T04:38:36.676338Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:3300","nonce":0},{"type":"v1","addr":"172.21.15.116:6789","nonce":0}]},"addr":"172.21.15.116:6789/0","public_addr":"172.21.15.116:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:3300","nonce":0},{"type":"v1","addr":"172.21.15.18:6789","nonce":0}]},"addr":"172.21.15.18:6789/0","public_addr":"172.21.15.18:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-19T04:40:23.227 INFO:teuthology.orchestra.run.smithi116.stderr:dumped monmap epoch 3 2024-09-19T04:40:23.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:23.228+0000 7fbf95b2c640 1 -- 172.21.15.116:0/3228529355 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fbf7c039730 msgr2=0x7fbf7c03bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:23.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:23.228+0000 7fbf95b2c640 1 --2- 172.21.15.116:0/3228529355 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fbf7c039730 0x7fbf7c03bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbf84006fd0 tx=0x7fbf84008040 comp rx=0 tx=0).stop 2024-09-19T04:40:23.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:23.228+0000 7fbf95b2c640 1 -- 172.21.15.116:0/3228529355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf78003530 msgr2=0x7fbf90196190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:23.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:23.228+0000 7fbf95b2c640 1 --2- 172.21.15.116:0/3228529355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf78003530 0x7fbf90196190 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbf80009d60 tx=0x7fbf8002cef0 comp rx=0 tx=0).stop 2024-09-19T04:40:23.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:23.228+0000 7fbf95b2c640 1 -- 172.21.15.116:0/3228529355 shutdown_connections 2024-09-19T04:40:23.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:23.228+0000 7fbf95b2c640 1 --2- 172.21.15.116:0/3228529355 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fbf7c039730 0x7fbf7c03bbf0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:23.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:23.228+0000 7fbf95b2c640 1 --2- 172.21.15.116:0/3228529355 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbf9019afa0 0x7fbf9019b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:23.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:23.228+0000 7fbf95b2c640 1 --2- 172.21.15.116:0/3228529355 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf901966d0 0x7fbf9019aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:23.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:23.228+0000 7fbf95b2c640 1 --2- 172.21.15.116:0/3228529355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf78003530 0x7fbf90196190 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:23.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:23.228+0000 7fbf95b2c640 1 -- 172.21.15.116:0/3228529355 >> 172.21.15.116:0/3228529355 conn(0x7fbf900fc220 msgr2=0x7fbf90105140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:23.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:23.229+0000 7fbf95b2c640 1 -- 172.21.15.116:0/3228529355 shutdown_connections 2024-09-19T04:40:23.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:23.229+0000 7fbf95b2c640 1 -- 172.21.15.116:0/3228529355 wait complete. 2024-09-19T04:40:23.793 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:23 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:40:23.794 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:23 smithi116 ceph-mon[34477]: from='client.? 172.21.15.116:0/3228529355' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T04:40:23.794 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:23 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:40:23.795 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-19T04:40:23.795 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-19T04:40:24.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:23 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:40:24.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:23 smithi018 ceph-mon[34537]: from='client.? 172.21.15.116:0/3228529355' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T04:40:24.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:23 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:40:24.065 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:40:24.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:23 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:40:24.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:23 smithi002 ceph-mon[30975]: from='client.? 172.21.15.116:0/3228529355' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T04:40:24.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:23 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:40:24.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.501+0000 7f5f8dcda640 1 -- 172.21.15.2:0/3366311655 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f881076c0 msgr2=0x7f5f88107aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:24.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.501+0000 7f5f8dcda640 1 --2- 172.21.15.2:0/3366311655 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f881076c0 0x7f5f88107aa0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5f78009880 tx=0x7f5f7802a5d0 comp rx=0 tx=0).stop 2024-09-19T04:40:24.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.501+0000 7f5f8dcda640 1 -- 172.21.15.2:0/3366311655 shutdown_connections 2024-09-19T04:40:24.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.501+0000 7f5f8dcda640 1 --2- 172.21.15.2:0/3366311655 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f881076c0 0x7f5f88107aa0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:24.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.501+0000 7f5f8dcda640 1 -- 172.21.15.2:0/3366311655 >> 172.21.15.2:0/3366311655 conn(0x7f5f880fb8c0 msgr2=0x7f5f880fdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:24.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.501+0000 7f5f8dcda640 1 -- 172.21.15.2:0/3366311655 shutdown_connections 2024-09-19T04:40:24.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.501+0000 7f5f8dcda640 1 -- 172.21.15.2:0/3366311655 wait complete. 2024-09-19T04:40:24.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.501+0000 7f5f8dcda640 1 Processor -- start 2024-09-19T04:40:24.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.502+0000 7f5f8dcda640 1 -- start start 2024-09-19T04:40:24.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.502+0000 7f5f8dcda640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f881076c0 0x7f5f88100b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:24.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.502+0000 7f5f8dcda640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5f881010d0 0x7f5f88101530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:24.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.502+0000 7f5f8dcda640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f881a3440 0x7f5f881a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:24.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.502+0000 7f5f8dcda640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5f8810bab0 con 0x7f5f881076c0 2024-09-19T04:40:24.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.502+0000 7f5f8dcda640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5f8810b930 con 0x7f5f881a3440 2024-09-19T04:40:24.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.502+0000 7f5f8dcda640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f5f8810bc30 con 0x7f5f881010d0 2024-09-19T04:40:24.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.502+0000 7f5f877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f881076c0 0x7f5f88100b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:24.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.502+0000 7f5f877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f881076c0 0x7f5f88100b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39316/0 (socket says 172.21.15.2:39316) 2024-09-19T04:40:24.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.502+0000 7f5f877fe640 1 -- 172.21.15.2:0/373576031 learned_addr learned my addr 172.21.15.2:0/373576031 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:40:24.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.502+0000 7f5f87fff640 1 --2- 172.21.15.2:0/373576031 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f881a3440 0x7f5f881a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:24.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.502+0000 7f5f86ffd640 1 --2- 172.21.15.2:0/373576031 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5f881010d0 0x7f5f88101530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:24.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.503+0000 7f5f877fe640 1 -- 172.21.15.2:0/373576031 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5f881010d0 msgr2=0x7f5f88101530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:24.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.503+0000 7f5f877fe640 1 --2- 172.21.15.2:0/373576031 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5f881010d0 0x7f5f88101530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:24.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.503+0000 7f5f877fe640 1 -- 172.21.15.2:0/373576031 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f881a3440 msgr2=0x7f5f881a5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:24.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.503+0000 7f5f877fe640 1 --2- 172.21.15.2:0/373576031 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f881a3440 0x7f5f881a5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:24.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.503+0000 7f5f877fe640 1 -- 172.21.15.2:0/373576031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f881a5f00 con 0x7f5f881076c0 2024-09-19T04:40:24.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.503+0000 7f5f877fe640 1 --2- 172.21.15.2:0/373576031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f881076c0 0x7f5f88100b90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5f78031440 tx=0x7f5f780042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:24.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.503+0000 7f5f84ff9640 1 -- 172.21.15.2:0/373576031 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f7803f030 con 0x7f5f881076c0 2024-09-19T04:40:24.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.503+0000 7f5f84ff9640 1 -- 172.21.15.2:0/373576031 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5f78003cb0 con 0x7f5f881076c0 2024-09-19T04:40:24.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.503+0000 7f5f8dcda640 1 -- 172.21.15.2:0/373576031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f881a6190 con 0x7f5f881076c0 2024-09-19T04:40:24.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.503+0000 7f5f84ff9640 1 -- 172.21.15.2:0/373576031 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f78035070 con 0x7f5f881076c0 2024-09-19T04:40:24.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.503+0000 7f5f8dcda640 1 -- 172.21.15.2:0/373576031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f881a66c0 con 0x7f5f881076c0 2024-09-19T04:40:24.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.504+0000 7f5f84ff9640 1 -- 172.21.15.2:0/373576031 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f5f78042030 con 0x7f5f881076c0 2024-09-19T04:40:24.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.504+0000 7f5f84ff9640 1 --2- 172.21.15.2:0/373576031 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f5f70039730 0x7f5f7003bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:24.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.505+0000 7f5f84ff9640 1 -- 172.21.15.2:0/373576031 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f5f7806cc10 con 0x7f5f881076c0 2024-09-19T04:40:24.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.505+0000 7f5f8dcda640 1 -- 172.21.15.2:0/373576031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f881020c0 con 0x7f5f881076c0 2024-09-19T04:40:24.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.505+0000 7f5f86ffd640 1 --2- 172.21.15.2:0/373576031 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f5f70039730 0x7f5f7003bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:24.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.505+0000 7f5f86ffd640 1 --2- 172.21.15.2:0/373576031 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f5f70039730 0x7f5f7003bbf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c009a10 tx=0x7f5f7c009190 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:24.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.511+0000 7f5f84ff9640 1 -- 172.21.15.2:0/373576031 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5f7803aa00 con 0x7f5f881076c0 2024-09-19T04:40:24.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.697+0000 7f5f8dcda640 1 -- 172.21.15.2:0/373576031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f5f881a6920 con 0x7f5f881076c0 2024-09-19T04:40:24.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.697+0000 7f5f84ff9640 1 -- 172.21.15.2:0/373576031 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+271 (secure 0 0 0) 0x7f5f78005540 con 0x7f5f881076c0 2024-09-19T04:40:24.700 INFO:teuthology.orchestra.run.smithi002.stdout:# minimal ceph.conf for d46630c4-7640-11ef-bceb-c7b262605968 2024-09-19T04:40:24.700 INFO:teuthology.orchestra.run.smithi002.stdout:[global] 2024-09-19T04:40:24.700 INFO:teuthology.orchestra.run.smithi002.stdout: fsid = d46630c4-7640-11ef-bceb-c7b262605968 2024-09-19T04:40:24.700 INFO:teuthology.orchestra.run.smithi002.stdout: mon_host = [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-19T04:40:24.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.699+0000 7f5f8dcda640 1 -- 172.21.15.2:0/373576031 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f5f70039730 msgr2=0x7f5f7003bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:24.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.699+0000 7f5f8dcda640 1 --2- 172.21.15.2:0/373576031 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f5f70039730 0x7f5f7003bbf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c009a10 tx=0x7f5f7c009190 comp rx=0 tx=0).stop 2024-09-19T04:40:24.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.699+0000 7f5f8dcda640 1 -- 172.21.15.2:0/373576031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f881076c0 msgr2=0x7f5f88100b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:24.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.699+0000 7f5f8dcda640 1 --2- 172.21.15.2:0/373576031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f881076c0 0x7f5f88100b90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5f78031440 tx=0x7f5f780042f0 comp rx=0 tx=0).stop 2024-09-19T04:40:24.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.699+0000 7f5f8dcda640 1 -- 172.21.15.2:0/373576031 shutdown_connections 2024-09-19T04:40:24.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.699+0000 7f5f8dcda640 1 --2- 172.21.15.2:0/373576031 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f5f70039730 0x7f5f7003bbf0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:24.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.699+0000 7f5f8dcda640 1 --2- 172.21.15.2:0/373576031 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f881a3440 0x7f5f881a5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:24.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.699+0000 7f5f8dcda640 1 --2- 172.21.15.2:0/373576031 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5f881010d0 0x7f5f88101530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:24.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.700+0000 7f5f8dcda640 1 --2- 172.21.15.2:0/373576031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f881076c0 0x7f5f88100b90 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:24.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.700+0000 7f5f8dcda640 1 -- 172.21.15.2:0/373576031 >> 172.21.15.2:0/373576031 conn(0x7f5f880fb8c0 msgr2=0x7f5f880fbca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:24.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.700+0000 7f5f8dcda640 1 -- 172.21.15.2:0/373576031 shutdown_connections 2024-09-19T04:40:24.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:24.700+0000 7f5f8dcda640 1 -- 172.21.15.2:0/373576031 wait complete. 2024-09-19T04:40:25.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:24 smithi002 ceph-mon[30975]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:25.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:24 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:25.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:24 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:25.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:24 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:25.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:24 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:25.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:24 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:25.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:24 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:40:25.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:24 smithi002 ceph-mon[30975]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-19T04:40:25.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:24 smithi002 ceph-mon[30975]: Updating smithi018:/etc/ceph/ceph.conf 2024-09-19T04:40:25.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:24 smithi002 ceph-mon[30975]: Updating smithi116:/etc/ceph/ceph.conf 2024-09-19T04:40:25.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:24 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/373576031' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:25.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:24 smithi116 ceph-mon[34477]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:25.112 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:24 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:25.112 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:24 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:25.112 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:24 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:25.112 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:24 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:25.112 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:24 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:25.112 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:24 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:40:25.112 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:24 smithi116 ceph-mon[34477]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-19T04:40:25.112 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:24 smithi116 ceph-mon[34477]: Updating smithi018:/etc/ceph/ceph.conf 2024-09-19T04:40:25.112 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:24 smithi116 ceph-mon[34477]: Updating smithi116:/etc/ceph/ceph.conf 2024-09-19T04:40:25.112 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:24 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/373576031' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:25.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:24 smithi018 ceph-mon[34537]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:25.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:24 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:25.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:24 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:25.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:24 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:25.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:24 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:25.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:24 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:25.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:24 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:40:25.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:24 smithi018 ceph-mon[34537]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-19T04:40:25.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:24 smithi018 ceph-mon[34537]: Updating smithi018:/etc/ceph/ceph.conf 2024-09-19T04:40:25.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:24 smithi018 ceph-mon[34537]: Updating smithi116:/etc/ceph/ceph.conf 2024-09-19T04:40:25.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:24 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/373576031' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:25.363 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-19T04:40:25.363 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-19T04:40:25.363 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T04:40:25.394 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-19T04:40:25.394 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T04:40:25.461 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T04:40:25.461 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T04:40:25.490 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T04:40:25.490 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T04:40:25.556 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-19T04:40:25.556 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T04:40:25.585 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-19T04:40:25.585 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T04:40:25.652 INFO:tasks.cephadm:Adding mgr.x on smithi002 2024-09-19T04:40:25.653 INFO:tasks.cephadm:Adding mgr.y on smithi018 2024-09-19T04:40:25.653 INFO:tasks.cephadm:Adding mgr.z on smithi116 2024-09-19T04:40:25.653 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph orch apply mgr '3;smithi002=x;smithi018=y;smithi116=z' 2024-09-19T04:40:25.928 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T04:40:26.179 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:25 smithi116 ceph-mon[34477]: Updating smithi116:/var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:40:26.179 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:25 smithi116 ceph-mon[34477]: Updating smithi002:/var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:40:26.179 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:25 smithi116 ceph-mon[34477]: Updating smithi018:/var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:40:26.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:25 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:26.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:25 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:26.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:25 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:26.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:25 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:26.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:25 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:26.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:25 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:26.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:25 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:26.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:25 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:26.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:25 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:26.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:25 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:26.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:25 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:26.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:25 smithi116 ceph-mon[34477]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T04:40:26.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:25 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T04:40:26.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:25 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T04:40:26.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:25 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:26.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:25 smithi116 ceph-mon[34477]: Reconfiguring daemon mon.a on smithi002 2024-09-19T04:40:26.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:25 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:26.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:25 smithi018 ceph-mon[34537]: Updating smithi116:/var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:40:26.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:25 smithi018 ceph-mon[34537]: Updating smithi002:/var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:40:26.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:25 smithi018 ceph-mon[34537]: Updating smithi018:/var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:40:26.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:25 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:26.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:25 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:26.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:25 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:26.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:25 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:26.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:25 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:26.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:25 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:26.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:25 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:26.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:25 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:26.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:25 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:26.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:25 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:26.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:25 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:26.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:25 smithi018 ceph-mon[34537]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T04:40:26.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:25 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T04:40:26.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:25 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T04:40:26.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:25 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:26.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:25 smithi018 ceph-mon[34537]: Reconfiguring daemon mon.a on smithi002 2024-09-19T04:40:26.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:25 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:26.340 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.339+0000 7ff9482d4640 1 -- 172.21.15.116:0/2380535925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9401005e0 msgr2=0x7ff9401009e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:26.340 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.339+0000 7ff9482d4640 1 --2- 172.21.15.116:0/2380535925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9401005e0 0x7ff9401009e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff930009c20 tx=0x7ff93002aa90 comp rx=0 tx=0).stop 2024-09-19T04:40:26.340 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.339+0000 7ff9482d4640 1 -- 172.21.15.116:0/2380535925 shutdown_connections 2024-09-19T04:40:26.340 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.339+0000 7ff9482d4640 1 --2- 172.21.15.116:0/2380535925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9401005e0 0x7ff9401009e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:26.340 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.339+0000 7ff9482d4640 1 -- 172.21.15.116:0/2380535925 >> 172.21.15.116:0/2380535925 conn(0x7ff9400fbdb0 msgr2=0x7ff9400fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:26.340 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.339+0000 7ff9482d4640 1 -- 172.21.15.116:0/2380535925 shutdown_connections 2024-09-19T04:40:26.341 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.339+0000 7ff9482d4640 1 -- 172.21.15.116:0/2380535925 wait complete. 2024-09-19T04:40:26.343 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.339+0000 7ff9482d4640 1 Processor -- start 2024-09-19T04:40:26.343 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.340+0000 7ff9482d4640 1 -- start start 2024-09-19T04:40:26.343 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.340+0000 7ff9482d4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9401005e0 0x7ff94006a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:26.343 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.340+0000 7ff9482d4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff940199c50 0x7ff94019c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:26.343 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.340+0000 7ff9482d4640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff94019c580 0x7ff94019ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:26.343 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.340+0000 7ff9482d4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff940106580 con 0x7ff940199c50 2024-09-19T04:40:26.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.340+0000 7ff9482d4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff940106400 con 0x7ff9401005e0 2024-09-19T04:40:26.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.340+0000 7ff9482d4640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7ff940106700 con 0x7ff94019c580 2024-09-19T04:40:26.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.340+0000 7ff946871640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff94019c580 0x7ff94019ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:26.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.340+0000 7ff946871640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff94019c580 0x7ff94019ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:47144/0 (socket says 172.21.15.116:47144) 2024-09-19T04:40:26.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.340+0000 7ff946871640 1 -- 172.21.15.116:0/681266005 learned_addr learned my addr 172.21.15.116:0/681266005 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-19T04:40:26.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.340+0000 7ff94586f640 1 --2- 172.21.15.116:0/681266005 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff940199c50 0x7ff94019c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:26.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.340+0000 7ff946070640 1 --2- 172.21.15.116:0/681266005 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9401005e0 0x7ff94006a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:26.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.340+0000 7ff946871640 1 -- 172.21.15.116:0/681266005 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9401005e0 msgr2=0x7ff94006a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:26.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.340+0000 7ff946871640 1 --2- 172.21.15.116:0/681266005 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9401005e0 0x7ff94006a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:26.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.340+0000 7ff946871640 1 -- 172.21.15.116:0/681266005 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff940199c50 msgr2=0x7ff94019c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:26.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.340+0000 7ff946871640 1 --2- 172.21.15.116:0/681266005 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff940199c50 0x7ff94019c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:26.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.340+0000 7ff946871640 1 -- 172.21.15.116:0/681266005 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff94019f350 con 0x7ff94019c580 2024-09-19T04:40:26.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.340+0000 7ff94586f640 1 --2- 172.21.15.116:0/681266005 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff940199c50 0x7ff94019c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:40:26.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.340+0000 7ff946871640 1 --2- 172.21.15.116:0/681266005 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff94019c580 0x7ff94019ea40 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff93800b450 tx=0x7ff93800b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:26.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.341+0000 7ff93f7fe640 1 -- 172.21.15.116:0/681266005 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff938015020 con 0x7ff94019c580 2024-09-19T04:40:26.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.341+0000 7ff93f7fe640 1 -- 172.21.15.116:0/681266005 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff938011d40 con 0x7ff94019c580 2024-09-19T04:40:26.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.341+0000 7ff9482d4640 1 -- 172.21.15.116:0/681266005 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff94019f5e0 con 0x7ff94019c580 2024-09-19T04:40:26.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.341+0000 7ff93f7fe640 1 -- 172.21.15.116:0/681266005 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff93800f340 con 0x7ff94019c580 2024-09-19T04:40:26.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.341+0000 7ff9482d4640 1 -- 172.21.15.116:0/681266005 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff94019fb50 con 0x7ff94019c580 2024-09-19T04:40:26.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.341+0000 7ff93f7fe640 1 -- 172.21.15.116:0/681266005 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7ff938018020 con 0x7ff94019c580 2024-09-19T04:40:26.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.342+0000 7ff9482d4640 1 -- 172.21.15.116:0/681266005 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff94018f340 con 0x7ff94019c580 2024-09-19T04:40:26.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.342+0000 7ff93f7fe640 1 --2- 172.21.15.116:0/681266005 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7ff928039730 0x7ff92803bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:26.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.342+0000 7ff93f7fe640 1 -- 172.21.15.116:0/681266005 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff93804c1f0 con 0x7ff94019c580 2024-09-19T04:40:26.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.342+0000 7ff946070640 1 --2- 172.21.15.116:0/681266005 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7ff928039730 0x7ff92803bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:26.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.342+0000 7ff946070640 1 --2- 172.21.15.116:0/681266005 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7ff928039730 0x7ff92803bbf0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff930000f80 tx=0x7ff93003a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:26.347 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.347+0000 7ff93f7fe640 1 -- 172.21.15.116:0/681266005 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff93801f020 con 0x7ff94019c580 2024-09-19T04:40:26.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:25 smithi002 ceph-mon[30975]: Updating smithi116:/var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:40:26.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:25 smithi002 ceph-mon[30975]: Updating smithi002:/var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:40:26.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:25 smithi002 ceph-mon[30975]: Updating smithi018:/var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:40:26.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:25 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:26.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:25 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:26.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:25 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:26.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:25 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:26.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:25 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:26.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:25 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:26.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:25 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:26.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:25 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:26.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:25 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:26.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:25 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:26.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:25 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:26.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:25 smithi002 ceph-mon[30975]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T04:40:26.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:25 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T04:40:26.362 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:25 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T04:40:26.362 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:25 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:26.362 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:25 smithi002 ceph-mon[30975]: Reconfiguring daemon mon.a on smithi002 2024-09-19T04:40:26.362 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:25 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:26.526 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.526+0000 7ff9482d4640 1 -- 172.21.15.116:0/681266005 --> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi002=x;smithi018=y;smithi116=z", "target": ["mon-mgr", ""]}) -- 0x7ff9400626c0 con 0x7ff928039730 2024-09-19T04:40:26.531 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.531+0000 7ff93f7fe640 1 -- 172.21.15.116:0/681266005 <== mgr.14150 v2:172.21.15.2:6800/3171525177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7ff9400626c0 con 0x7ff928039730 2024-09-19T04:40:26.531 INFO:teuthology.orchestra.run.smithi116.stdout:Scheduled mgr update... 2024-09-19T04:40:26.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.533+0000 7ff9482d4640 1 -- 172.21.15.116:0/681266005 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7ff928039730 msgr2=0x7ff92803bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:26.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.533+0000 7ff9482d4640 1 --2- 172.21.15.116:0/681266005 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7ff928039730 0x7ff92803bbf0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff930000f80 tx=0x7ff93003a040 comp rx=0 tx=0).stop 2024-09-19T04:40:26.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.533+0000 7ff9482d4640 1 -- 172.21.15.116:0/681266005 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff94019c580 msgr2=0x7ff94019ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:26.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.533+0000 7ff9482d4640 1 --2- 172.21.15.116:0/681266005 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff94019c580 0x7ff94019ea40 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff93800b450 tx=0x7ff93800b910 comp rx=0 tx=0).stop 2024-09-19T04:40:26.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.533+0000 7ff9482d4640 1 -- 172.21.15.116:0/681266005 shutdown_connections 2024-09-19T04:40:26.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.533+0000 7ff9482d4640 1 --2- 172.21.15.116:0/681266005 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7ff928039730 0x7ff92803bbf0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:26.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.533+0000 7ff9482d4640 1 --2- 172.21.15.116:0/681266005 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff94019c580 0x7ff94019ea40 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:26.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.533+0000 7ff9482d4640 1 --2- 172.21.15.116:0/681266005 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff940199c50 0x7ff94019c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:26.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.533+0000 7ff9482d4640 1 --2- 172.21.15.116:0/681266005 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9401005e0 0x7ff94006a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:26.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.533+0000 7ff9482d4640 1 -- 172.21.15.116:0/681266005 >> 172.21.15.116:0/681266005 conn(0x7ff9400fbdb0 msgr2=0x7ff9400fc960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:26.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.533+0000 7ff9482d4640 1 -- 172.21.15.116:0/681266005 shutdown_connections 2024-09-19T04:40:26.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:40:26.533+0000 7ff9482d4640 1 -- 172.21.15.116:0/681266005 wait complete. 2024-09-19T04:40:27.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:27 smithi116 ceph-mon[34477]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:27.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:27 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:27.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:27 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:27.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:27 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T04:40:27.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:27 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T04:40:27.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:27 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:27.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:27 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:27.140 DEBUG:teuthology.orchestra.run.smithi018:mgr.y> sudo journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@mgr.y.service 2024-09-19T04:40:27.143 DEBUG:teuthology.orchestra.run.smithi116:mgr.z> sudo journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@mgr.z.service 2024-09-19T04:40:27.145 INFO:tasks.cephadm:Deploying OSDs... 2024-09-19T04:40:27.145 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-19T04:40:27.145 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T04:40:27.156 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:27 smithi018 ceph-mon[34537]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:27.156 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:27 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:27.156 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:27 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:27.156 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:27 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T04:40:27.156 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:27 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T04:40:27.156 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:27 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:27.156 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:27 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:27.165 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T04:40:27.165 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_1 2024-09-19T04:40:27.224 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T04:40:27.224 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T04:40:27.224 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-19T04:40:27.224 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T04:40:27.225 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T04:40:27.225 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-19 04:39:46.029737788 +0000 2024-09-19T04:40:27.225 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-19 04:34:51.608712073 +0000 2024-09-19T04:40:27.225 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-19 04:34:51.608712073 +0000 2024-09-19T04:40:27.225 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-09-19 04:34:51.608712073 +0000 2024-09-19T04:40:27.225 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T04:40:27.293 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-09-19T04:40:27.293 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-09-19T04:40:27.293 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000126503 s, 4.0 MB/s 2024-09-19T04:40:27.295 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T04:40:27.354 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_2 2024-09-19T04:40:27.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:27 smithi002 ceph-mon[30975]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:27.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:27 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:27.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:27 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:27.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:27 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T04:40:27.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:27 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T04:40:27.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:27 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:27.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:27 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:27.377 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T04:40:27.377 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T04:40:27.377 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-19T04:40:27.377 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T04:40:27.377 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T04:40:27.377 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-19 04:39:46.058737163 +0000 2024-09-19T04:40:27.378 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-19 04:34:51.943704855 +0000 2024-09-19T04:40:27.378 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-19 04:34:51.943704855 +0000 2024-09-19T04:40:27.378 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-09-19 04:34:51.943704855 +0000 2024-09-19T04:40:27.378 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T04:40:27.443 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-09-19T04:40:27.443 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-09-19T04:40:27.443 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000121448 s, 4.2 MB/s 2024-09-19T04:40:27.445 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T04:40:27.503 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_3 2024-09-19T04:40:27.560 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T04:40:27.560 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T04:40:27.560 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-19T04:40:27.560 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T04:40:27.560 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T04:40:27.561 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-19 04:39:46.086736558 +0000 2024-09-19T04:40:27.561 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-19 04:34:52.270697810 +0000 2024-09-19T04:40:27.561 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-19 04:34:52.270697810 +0000 2024-09-19T04:40:27.561 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-09-19 04:34:52.270697810 +0000 2024-09-19T04:40:27.561 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T04:40:27.625 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-09-19T04:40:27.626 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-09-19T04:40:27.626 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000114279 s, 4.5 MB/s 2024-09-19T04:40:27.627 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T04:40:27.684 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_4 2024-09-19T04:40:27.740 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T04:40:27.741 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T04:40:27.741 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-19T04:40:27.741 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T04:40:27.741 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T04:40:27.741 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-19 04:39:46.113735976 +0000 2024-09-19T04:40:27.741 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-19 04:34:52.579691153 +0000 2024-09-19T04:40:27.741 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-19 04:34:52.579691153 +0000 2024-09-19T04:40:27.741 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-09-19 04:34:52.579691153 +0000 2024-09-19T04:40:27.741 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T04:40:27.806 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-09-19T04:40:27.806 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-09-19T04:40:27.807 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000114289 s, 4.5 MB/s 2024-09-19T04:40:27.808 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T04:40:27.866 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T04:40:27.866 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T04:40:27.885 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T04:40:27.885 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_1 2024-09-19T04:40:27.943 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T04:40:27.943 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T04:40:27.943 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-19T04:40:27.943 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T04:40:27.943 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T04:40:27.943 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-09-19 04:40:17.116253818 +0000 2024-09-19T04:40:27.943 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-09-19 04:34:52.654391591 +0000 2024-09-19T04:40:27.943 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-09-19 04:34:52.654391591 +0000 2024-09-19T04:40:27.943 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-09-19 04:34:52.654391591 +0000 2024-09-19T04:40:27.944 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T04:40:28.010 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-09-19T04:40:28.010 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-09-19T04:40:28.010 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000122801 s, 4.2 MB/s 2024-09-19T04:40:28.011 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T04:40:28.070 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_2 2024-09-19T04:40:28.129 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T04:40:28.129 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T04:40:28.129 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-19T04:40:28.129 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T04:40:28.129 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T04:40:28.129 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-09-19 04:40:17.117253807 +0000 2024-09-19T04:40:28.129 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-09-19 04:34:52.968388183 +0000 2024-09-19T04:40:28.129 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-09-19 04:34:52.968388183 +0000 2024-09-19T04:40:28.129 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-09-19 04:34:52.968388183 +0000 2024-09-19T04:40:28.130 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T04:40:28.195 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-09-19T04:40:28.195 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-09-19T04:40:28.195 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000118119 s, 4.3 MB/s 2024-09-19T04:40:28.196 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T04:40:28.256 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_3 2024-09-19T04:40:28.306 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:28 smithi018 ceph-mon[34537]: Reconfiguring mon.b (monmap changed)... 2024-09-19T04:40:28.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:28 smithi018 ceph-mon[34537]: Reconfiguring daemon mon.b on smithi018 2024-09-19T04:40:28.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:28 smithi018 ceph-mon[34537]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi002=x;smithi018=y;smithi116=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:40:28.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:28 smithi018 ceph-mon[34537]: Saving service mgr spec with placement smithi002=x;smithi018=y;smithi116=z;count:3 2024-09-19T04:40:28.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:28 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:28.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:28 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:28.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:28 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T04:40:28.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:28 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T04:40:28.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:28 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:28.313 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T04:40:28.314 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T04:40:28.314 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-19T04:40:28.314 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T04:40:28.314 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T04:40:28.314 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-09-19 04:40:17.117253807 +0000 2024-09-19T04:40:28.314 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-09-19 04:34:53.291384676 +0000 2024-09-19T04:40:28.314 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-09-19 04:34:53.291384676 +0000 2024-09-19T04:40:28.314 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-09-19 04:34:53.291384676 +0000 2024-09-19T04:40:28.314 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T04:40:28.335 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:28 smithi116 ceph-mon[34477]: Reconfiguring mon.b (monmap changed)... 2024-09-19T04:40:28.335 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:28 smithi116 ceph-mon[34477]: Reconfiguring daemon mon.b on smithi018 2024-09-19T04:40:28.335 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:28 smithi116 ceph-mon[34477]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi002=x;smithi018=y;smithi116=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:40:28.335 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:28 smithi116 ceph-mon[34477]: Saving service mgr spec with placement smithi002=x;smithi018=y;smithi116=z;count:3 2024-09-19T04:40:28.335 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:28 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:28.335 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:28 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:28.335 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:28 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T04:40:28.335 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:28 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T04:40:28.335 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:28 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:28.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:28 smithi002 ceph-mon[30975]: Reconfiguring mon.b (monmap changed)... 2024-09-19T04:40:28.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:28 smithi002 ceph-mon[30975]: Reconfiguring daemon mon.b on smithi018 2024-09-19T04:40:28.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:28 smithi002 ceph-mon[30975]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi002=x;smithi018=y;smithi116=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:40:28.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:28 smithi002 ceph-mon[30975]: Saving service mgr spec with placement smithi002=x;smithi018=y;smithi116=z;count:3 2024-09-19T04:40:28.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:28 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:28.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:28 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:28.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:28 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T04:40:28.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:28 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T04:40:28.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:28 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:28.382 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-09-19T04:40:28.382 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-09-19T04:40:28.382 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000103908 s, 4.9 MB/s 2024-09-19T04:40:28.383 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T04:40:28.443 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_4 2024-09-19T04:40:28.501 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T04:40:28.501 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T04:40:28.501 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-19T04:40:28.502 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T04:40:28.502 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T04:40:28.502 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-09-19 04:40:17.117253807 +0000 2024-09-19T04:40:28.502 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-09-19 04:34:53.616381148 +0000 2024-09-19T04:40:28.502 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-09-19 04:34:53.616381148 +0000 2024-09-19T04:40:28.502 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-09-19 04:34:53.616381148 +0000 2024-09-19T04:40:28.502 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T04:40:28.569 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-09-19T04:40:28.570 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-09-19T04:40:28.570 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000125638 s, 4.1 MB/s 2024-09-19T04:40:28.571 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T04:40:28.631 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-19T04:40:28.631 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T04:40:28.647 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T04:40:28.647 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_1 2024-09-19T04:40:28.703 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T04:40:28.703 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T04:40:28.703 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-19T04:40:28.703 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T04:40:28.703 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T04:40:28.703 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-09-19 04:40:07.652458372 +0000 2024-09-19T04:40:28.703 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-09-19 04:34:50.396271776 +0000 2024-09-19T04:40:28.703 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-09-19 04:34:50.396271776 +0000 2024-09-19T04:40:28.704 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2024-09-19 04:34:50.396271776 +0000 2024-09-19T04:40:28.704 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T04:40:28.770 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-09-19T04:40:28.770 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-09-19T04:40:28.770 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000231876 s, 2.2 MB/s 2024-09-19T04:40:28.771 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T04:40:28.828 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_2 2024-09-19T04:40:28.884 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T04:40:28.884 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T04:40:28.884 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-19T04:40:28.884 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T04:40:28.884 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T04:40:28.884 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-09-19 04:40:07.652458372 +0000 2024-09-19T04:40:28.884 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-09-19 04:34:50.744266205 +0000 2024-09-19T04:40:28.884 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-09-19 04:34:50.744266205 +0000 2024-09-19T04:40:28.885 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2024-09-19 04:34:50.744266205 +0000 2024-09-19T04:40:28.885 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T04:40:28.948 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-09-19T04:40:28.948 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-09-19T04:40:28.948 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000216722 s, 2.4 MB/s 2024-09-19T04:40:28.949 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T04:40:29.007 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_3 2024-09-19T04:40:29.062 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T04:40:29.063 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T04:40:29.063 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-19T04:40:29.063 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T04:40:29.063 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T04:40:29.063 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-09-19 04:40:07.653458356 +0000 2024-09-19T04:40:29.063 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-09-19 04:34:51.071260975 +0000 2024-09-19T04:40:29.063 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-09-19 04:34:51.071260975 +0000 2024-09-19T04:40:29.063 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2024-09-19 04:34:51.071260975 +0000 2024-09-19T04:40:29.064 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T04:40:29.126 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-09-19T04:40:29.126 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-09-19T04:40:29.126 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000202891 s, 2.5 MB/s 2024-09-19T04:40:29.127 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T04:40:29.185 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_4 2024-09-19T04:40:29.241 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T04:40:29.241 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T04:40:29.241 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-19T04:40:29.241 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T04:40:29.241 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T04:40:29.242 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-09-19 04:40:07.653458356 +0000 2024-09-19T04:40:29.242 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-09-19 04:34:51.392255840 +0000 2024-09-19T04:40:29.242 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-09-19 04:34:51.392255840 +0000 2024-09-19T04:40:29.242 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2024-09-19 04:34:51.392255840 +0000 2024-09-19T04:40:29.242 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T04:40:29.306 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-09-19T04:40:29.306 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-09-19T04:40:29.306 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000188508 s, 2.7 MB/s 2024-09-19T04:40:29.308 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T04:40:29.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:29 smithi002 ceph-mon[30975]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:29.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:29 smithi002 ceph-mon[30975]: Reconfiguring mon.c (monmap changed)... 2024-09-19T04:40:29.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:29 smithi002 ceph-mon[30975]: Reconfiguring daemon mon.c on smithi116 2024-09-19T04:40:29.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:29 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:29.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:29 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:29.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:29 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:40:29.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:29 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:29.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:29 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:40:29.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:29 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:29.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:29 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T04:40:29.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:29 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T04:40:29.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:29 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T04:40:29.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:29 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:29.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:29 smithi116 ceph-mon[34477]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:29.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:29 smithi116 ceph-mon[34477]: Reconfiguring mon.c (monmap changed)... 2024-09-19T04:40:29.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:29 smithi116 ceph-mon[34477]: Reconfiguring daemon mon.c on smithi116 2024-09-19T04:40:29.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:29 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:29.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:29 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:29.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:29 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:40:29.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:29 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:29.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:29 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:40:29.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:29 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:29.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:29 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T04:40:29.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:29 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T04:40:29.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:29 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T04:40:29.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:29 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:29.364 INFO:tasks.cephadm:Deploying osd.0 on smithi002 with /dev/vg_nvme/lv_4... 2024-09-19T04:40:29.364 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T04:40:29.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:29 smithi018 ceph-mon[34537]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:29.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:29 smithi018 ceph-mon[34537]: Reconfiguring mon.c (monmap changed)... 2024-09-19T04:40:29.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:29 smithi018 ceph-mon[34537]: Reconfiguring daemon mon.c on smithi116 2024-09-19T04:40:29.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:29 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:29.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:29 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:29.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:29 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:40:29.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:29 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:29.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:29 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:40:29.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:29 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:29.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:29 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T04:40:29.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:29 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T04:40:29.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:29 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T04:40:29.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:29 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:29.627 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:40:30.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:30 smithi002 ceph-mon[30975]: Deploying daemon mgr.z on smithi116 2024-09-19T04:40:30.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:30 smithi116 ceph-mon[34477]: Deploying daemon mgr.z on smithi116 2024-09-19T04:40:30.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:30 smithi018 ceph-mon[34537]: Deploying daemon mgr.z on smithi116 2024-09-19T04:40:31.206 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:31 smithi002 ceph-mon[30975]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:31.307 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:31 smithi116 ceph-mon[34477]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:31.307 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:40:31 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:40:31.242+0000 7f6d27c19040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T04:40:31.307 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:40:31 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:40:31.306+0000 7f6d27c19040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T04:40:31.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:31 smithi018 ceph-mon[34537]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:31.610 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:40:31 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:40:31.452+0000 7f6d27c19040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T04:40:31.610 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:40:31 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:40:31.517+0000 7f6d27c19040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T04:40:32.105 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:40:32.110 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:40:31 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:40:31.663+0000 7f6d27c19040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T04:40:32.110 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:40:31 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:40:31.800+0000 7f6d27c19040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T04:40:32.133 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi002:vg_nvme/lv_4 2024-09-19T04:40:32.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:32 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:32.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:32 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:32.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:32 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:32.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:32 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T04:40:32.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:32 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T04:40:32.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:32 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T04:40:32.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:32 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:32.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:32 smithi018 ceph-mon[34537]: Deploying daemon mgr.y on smithi018 2024-09-19T04:40:32.398 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:40:32.519 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:32 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:32.519 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:32 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:32.519 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:32 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:32.519 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:32 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T04:40:32.519 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:32 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T04:40:32.519 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:32 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T04:40:32.519 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:32 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:32.519 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:32 smithi002 ceph-mon[30975]: Deploying daemon mgr.y on smithi018 2024-09-19T04:40:32.610 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:40:32 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:40:32.111+0000 7f6d27c19040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T04:40:32.610 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:40:32 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:40:32.171+0000 7f6d27c19040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T04:40:32.611 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:40:32 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:40:32.357+0000 7f6d27c19040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T04:40:32.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:32 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:32.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:32 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:32.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:32 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:32.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:32 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T04:40:32.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:32 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T04:40:32.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:32 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T04:40:32.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:32 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:32.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:32 smithi116 ceph-mon[34477]: Deploying daemon mgr.y on smithi018 2024-09-19T04:40:32.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:32.806+0000 7fc42c399640 1 -- 172.21.15.2:0/2551216315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc424076220 msgr2=0x7fc424074680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:32.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:32.806+0000 7fc42c399640 1 --2- 172.21.15.2:0/2551216315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc424076220 0x7fc424074680 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc420009900 tx=0x7fc42002a410 comp rx=0 tx=0).stop 2024-09-19T04:40:32.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:32.806+0000 7fc42c399640 1 -- 172.21.15.2:0/2551216315 shutdown_connections 2024-09-19T04:40:32.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:32.806+0000 7fc42c399640 1 --2- 172.21.15.2:0/2551216315 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc42410e1e0 0x7fc4241105d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:32.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:32.806+0000 7fc42c399640 1 --2- 172.21.15.2:0/2551216315 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc424074c50 0x7fc4240750b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:32.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:32.806+0000 7fc42c399640 1 --2- 172.21.15.2:0/2551216315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc424076220 0x7fc424074680 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:32.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:32.806+0000 7fc42c399640 1 -- 172.21.15.2:0/2551216315 >> 172.21.15.2:0/2551216315 conn(0x7fc4240fd390 msgr2=0x7fc4240ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:32.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:32.806+0000 7fc42c399640 1 -- 172.21.15.2:0/2551216315 shutdown_connections 2024-09-19T04:40:32.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:32.806+0000 7fc42c399640 1 -- 172.21.15.2:0/2551216315 wait complete. 2024-09-19T04:40:32.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:32.807+0000 7fc42c399640 1 Processor -- start 2024-09-19T04:40:32.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:32.807+0000 7fc42c399640 1 -- start start 2024-09-19T04:40:32.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:32.807+0000 7fc42c399640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc424074c50 0x7fc42419e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:32.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:32.807+0000 7fc42c399640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc424076220 0x7fc42419e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:32.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:32.807+0000 7fc42c399640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc42410e1e0 0x7fc4241a5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:32.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:32.807+0000 7fc42c399640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc424113d20 con 0x7fc424074c50 2024-09-19T04:40:32.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:32.807+0000 7fc42c399640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc424113ba0 con 0x7fc424076220 2024-09-19T04:40:32.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:32.807+0000 7fc42c399640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fc424113ea0 con 0x7fc42410e1e0 2024-09-19T04:40:32.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:32.807+0000 7fc42a135640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc424074c50 0x7fc42419e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:32.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:32.807+0000 7fc42a135640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc424074c50 0x7fc42419e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43274/0 (socket says 172.21.15.2:43274) 2024-09-19T04:40:32.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:32.807+0000 7fc429934640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc424076220 0x7fc42419e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:32.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:32.807+0000 7fc42a135640 1 -- 172.21.15.2:0/2948799643 learned_addr learned my addr 172.21.15.2:0/2948799643 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:40:32.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:32.807+0000 7fc42a936640 1 --2- 172.21.15.2:0/2948799643 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc42410e1e0 0x7fc4241a5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:32.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:32.807+0000 7fc42a135640 1 -- 172.21.15.2:0/2948799643 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc42410e1e0 msgr2=0x7fc4241a5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:32.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:32.807+0000 7fc42a135640 1 --2- 172.21.15.2:0/2948799643 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc42410e1e0 0x7fc4241a5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:32.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:32.807+0000 7fc42a135640 1 -- 172.21.15.2:0/2948799643 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc424076220 msgr2=0x7fc42419e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:32.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:32.807+0000 7fc42a135640 1 --2- 172.21.15.2:0/2948799643 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc424076220 0x7fc42419e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:32.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:32.807+0000 7fc42a135640 1 -- 172.21.15.2:0/2948799643 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4241a6070 con 0x7fc424074c50 2024-09-19T04:40:32.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:32.807+0000 7fc429934640 1 --2- 172.21.15.2:0/2948799643 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc424076220 0x7fc42419e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:40:32.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:32.808+0000 7fc42a135640 1 --2- 172.21.15.2:0/2948799643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc424074c50 0x7fc42419e440 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc4200314e0 tx=0x7fc4200042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:32.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:32.808+0000 7fc4177fe640 1 -- 172.21.15.2:0/2948799643 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc42003f030 con 0x7fc424074c50 2024-09-19T04:40:32.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:32.808+0000 7fc4177fe640 1 -- 172.21.15.2:0/2948799643 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc420003cb0 con 0x7fc424074c50 2024-09-19T04:40:32.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:32.808+0000 7fc42c399640 1 -- 172.21.15.2:0/2948799643 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4241a6300 con 0x7fc424074c50 2024-09-19T04:40:32.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:32.808+0000 7fc4177fe640 1 -- 172.21.15.2:0/2948799643 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc420035070 con 0x7fc424074c50 2024-09-19T04:40:32.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:32.808+0000 7fc42c399640 1 -- 172.21.15.2:0/2948799643 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4241a6830 con 0x7fc424074c50 2024-09-19T04:40:32.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:32.809+0000 7fc4177fe640 1 -- 172.21.15.2:0/2948799643 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fc420042030 con 0x7fc424074c50 2024-09-19T04:40:32.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:32.809+0000 7fc42c399640 1 -- 172.21.15.2:0/2948799643 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc424103b80 con 0x7fc424074c50 2024-09-19T04:40:32.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:32.809+0000 7fc4177fe640 1 --2- 172.21.15.2:0/2948799643 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fc410039500 0x7fc41003b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:32.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:32.809+0000 7fc4177fe640 1 -- 172.21.15.2:0/2948799643 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc42006ce80 con 0x7fc424074c50 2024-09-19T04:40:32.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:32.810+0000 7fc429934640 1 --2- 172.21.15.2:0/2948799643 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fc410039500 0x7fc41003b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:32.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:32.810+0000 7fc429934640 1 --2- 172.21.15.2:0/2948799643 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fc410039500 0x7fc41003b9c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc42419f960 tx=0x7fc41800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:32.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:32.814+0000 7fc4177fe640 1 -- 172.21.15.2:0/2948799643 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc420030c00 con 0x7fc424074c50 2024-09-19T04:40:33.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:33.001+0000 7fc42c399640 1 -- 172.21.15.2:0/2948799643 --> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fc424062630 con 0x7fc410039500 2024-09-19T04:40:33.242 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:40:33 smithi018 systemd[1]: Starting Ceph mgr.y for d46630c4-7640-11ef-bceb-c7b262605968... 2024-09-19T04:40:33.497 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:33 smithi018 ceph-mon[34537]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:33.497 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:33 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:40:33.497 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:33 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:40:33.497 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:33 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:33.498 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:40:33 smithi018 podman[35887]: 2024-09-19 04:40:33.241232019 +0000 UTC m=+0.110149057 container create 993e387f95a99b0ed5717f617c77d7a09ff64ef560f3f05021938d5dff4f6555 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-19T04:40:33.498 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:40:33 smithi018 podman[35887]: 2024-09-19 04:40:33.147267578 +0000 UTC m=+0.016184600 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:40:33.498 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:40:33 smithi018 podman[35887]: 2024-09-19 04:40:33.468225779 +0000 UTC m=+0.337142794 container init 993e387f95a99b0ed5717f617c77d7a09ff64ef560f3f05021938d5dff4f6555 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-19T04:40:33.498 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:40:33 smithi018 podman[35887]: 2024-09-19 04:40:33.471596036 +0000 UTC m=+0.340513042 container start 993e387f95a99b0ed5717f617c77d7a09ff64ef560f3f05021938d5dff4f6555 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T04:40:33.498 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:40:33 smithi018 ceph-mgr[35907]: -- 172.21.15.18:0/2175774272 <== mon.2 v2:172.21.15.18:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5583526d90e0 con 0x5583526b7000 2024-09-19T04:40:33.533 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:33 smithi002 ceph-mon[30975]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:33.533 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:33 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:40:33.533 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:33 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:40:33.533 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:33 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:33.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:33 smithi116 ceph-mon[34477]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:33.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:33 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:40:33.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:33 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:40:33.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:33 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:33.611 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:40:33 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:40:33.226+0000 7f6d27c19040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T04:40:33.611 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:40:33 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:40:33.294+0000 7f6d27c19040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T04:40:33.807 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:40:33 smithi018 bash[35887]: 993e387f95a99b0ed5717f617c77d7a09ff64ef560f3f05021938d5dff4f6555 2024-09-19T04:40:33.807 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:40:33 smithi018 systemd[1]: Started Ceph mgr.y for d46630c4-7640-11ef-bceb-c7b262605968. 2024-09-19T04:40:33.807 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:40:33 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:40:33.596+0000 7f8d87522040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T04:40:33.807 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:40:33 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:40:33.658+0000 7f8d87522040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T04:40:34.205 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:40:33 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:40:33.817+0000 7f8d87522040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T04:40:34.205 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:40:33 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:40:33.888+0000 7f8d87522040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T04:40:34.205 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:40:34 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:40:34.050+0000 7f8d87522040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T04:40:34.205 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:40:34 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:40:34.203+0000 7f8d87522040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T04:40:34.319 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:40:34 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:40:34.042+0000 7f6d27c19040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T04:40:34.320 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:40:34 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:40:34.174+0000 7f6d27c19040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T04:40:34.320 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:34 smithi116 ceph-mon[34477]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:40:34.320 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:34 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:34.320 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:34 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:34.320 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:34 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:34.320 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:34 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:34.320 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:34 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:40:34.456 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:34 smithi018 ceph-mon[34537]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:40:34.456 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:34 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:34.456 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:34 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:34.457 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:34 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:34.457 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:34 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:34.457 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:34 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:40:34.606 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:34 smithi002 ceph-mon[30975]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:40:34.606 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:34 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:34.606 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:34 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:34.606 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:34 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:34.607 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:34 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:34.607 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:34 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:40:34.610 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:40:34 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:40:34.321+0000 7f6d27c19040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T04:40:34.610 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:40:34 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:40:34.385+0000 7f6d27c19040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T04:40:34.610 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:40:34 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:40:34.546+0000 7f6d27c19040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T04:40:34.803 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:40:34 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:40:34.541+0000 7f8d87522040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T04:40:34.804 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:40:34 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:40:34.606+0000 7f8d87522040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T04:40:34.804 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:40:34 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:40:34.802+0000 7f8d87522040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T04:40:34.916 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:40:34 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:40:34.616+0000 7f6d27c19040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T04:40:34.916 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:40:34 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:40:34.676+0000 7f6d27c19040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T04:40:34.916 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:40:34 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:40:34.850+0000 7f6d27c19040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T04:40:34.916 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:40:34 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:40:34.915+0000 7f6d27c19040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T04:40:35.188 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:40:34 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:40:34.984+0000 7f6d27c19040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T04:40:35.188 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:40:35 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:40:35.066+0000 7f6d27c19040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T04:40:35.189 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:40:35 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:40:35.125+0000 7f6d27c19040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T04:40:35.189 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:40:35 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:40:35.187+0000 7f6d27c19040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T04:40:35.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:35 smithi018 ceph-mon[34537]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:35.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:35 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:35.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:35 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:35.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:35 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:35.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:35 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:35.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:35 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:35.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:35 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:40:35.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:35 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:35.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:35 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T04:40:35.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:35 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T04:40:35.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:35 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:35.582 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:35 smithi002 ceph-mon[30975]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:35.582 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:35 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:35.582 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:35 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:35.582 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:35 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:35.582 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:35 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:35.582 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:35 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:35.582 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:35 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:40:35.582 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:35 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:35.583 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:35 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T04:40:35.583 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:35 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T04:40:35.583 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:35 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:35.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:35 smithi116 ceph-mon[34477]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:35.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:35 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:35.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:35 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:35.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:35 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:35.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:35 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:35.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:35 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:35.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:35 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:40:35.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:35 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:35.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:35 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T04:40:35.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:35 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T04:40:35.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:35 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:36.057 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:40:35 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:40:35.734+0000 7f8d87522040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T04:40:36.057 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:40:35 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:40:35.804+0000 7f8d87522040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T04:40:36.287 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:40:35 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:40:35.977+0000 7f6d27c19040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T04:40:36.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:36.511+0000 7fc4177fe640 1 -- 172.21.15.2:0/2948799643 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 14) ==== 92407+0+0 (secure 0 0 0) 0x7fc420071070 con 0x7fc424074c50 2024-09-19T04:40:36.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:36 smithi018 ceph-mon[34537]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T04:40:36.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:36 smithi018 ceph-mon[34537]: Reconfiguring daemon mgr.x on smithi002 2024-09-19T04:40:36.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:36 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/641181015' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a7dc9b9-8d5d-4dd3-93a3-0d5efced07d9"}]: dispatch 2024-09-19T04:40:36.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:36 smithi018 ceph-mon[34537]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a7dc9b9-8d5d-4dd3-93a3-0d5efced07d9"}]: dispatch 2024-09-19T04:40:36.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:36 smithi018 ceph-mon[34537]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7a7dc9b9-8d5d-4dd3-93a3-0d5efced07d9"}]': finished 2024-09-19T04:40:36.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:36 smithi018 ceph-mon[34537]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T04:40:36.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:36 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:40:36.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:36 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:36.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:36 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/3095104219' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:40:36.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:36 smithi018 ceph-mon[34537]: Standby manager daemon z started 2024-09-19T04:40:36.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:36 smithi018 ceph-mon[34537]: from='mgr.? 172.21.15.116:0/2016076648' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T04:40:36.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:36 smithi018 ceph-mon[34537]: from='mgr.? 172.21.15.116:0/2016076648' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T04:40:36.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:36 smithi018 ceph-mon[34537]: from='mgr.? 172.21.15.116:0/2016076648' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T04:40:36.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:36 smithi018 ceph-mon[34537]: from='mgr.? 172.21.15.116:0/2016076648' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T04:40:36.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:36 smithi002 ceph-mon[30975]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T04:40:36.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:36 smithi002 ceph-mon[30975]: Reconfiguring daemon mgr.x on smithi002 2024-09-19T04:40:36.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:36 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/641181015' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a7dc9b9-8d5d-4dd3-93a3-0d5efced07d9"}]: dispatch 2024-09-19T04:40:36.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:36 smithi002 ceph-mon[30975]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a7dc9b9-8d5d-4dd3-93a3-0d5efced07d9"}]: dispatch 2024-09-19T04:40:36.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:36 smithi002 ceph-mon[30975]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7a7dc9b9-8d5d-4dd3-93a3-0d5efced07d9"}]': finished 2024-09-19T04:40:36.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:36 smithi002 ceph-mon[30975]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T04:40:36.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:36 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:40:36.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:36 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:36.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:36 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/3095104219' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:40:36.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:36 smithi002 ceph-mon[30975]: Standby manager daemon z started 2024-09-19T04:40:36.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:36 smithi002 ceph-mon[30975]: from='mgr.? 172.21.15.116:0/2016076648' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T04:40:36.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:36 smithi002 ceph-mon[30975]: from='mgr.? 172.21.15.116:0/2016076648' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T04:40:36.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:36 smithi002 ceph-mon[30975]: from='mgr.? 172.21.15.116:0/2016076648' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T04:40:36.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:36 smithi002 ceph-mon[30975]: from='mgr.? 172.21.15.116:0/2016076648' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T04:40:36.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:36 smithi116 ceph-mon[34477]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T04:40:36.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:36 smithi116 ceph-mon[34477]: Reconfiguring daemon mgr.x on smithi002 2024-09-19T04:40:36.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:36 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/641181015' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a7dc9b9-8d5d-4dd3-93a3-0d5efced07d9"}]: dispatch 2024-09-19T04:40:36.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:36 smithi116 ceph-mon[34477]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a7dc9b9-8d5d-4dd3-93a3-0d5efced07d9"}]: dispatch 2024-09-19T04:40:36.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:36 smithi116 ceph-mon[34477]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7a7dc9b9-8d5d-4dd3-93a3-0d5efced07d9"}]': finished 2024-09-19T04:40:36.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:36 smithi116 ceph-mon[34477]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T04:40:36.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:36 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:40:36.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:36 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:36.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:36 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/3095104219' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:40:36.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:36 smithi116 ceph-mon[34477]: Standby manager daemon z started 2024-09-19T04:40:36.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:36 smithi116 ceph-mon[34477]: from='mgr.? 172.21.15.116:0/2016076648' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T04:40:36.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:36 smithi116 ceph-mon[34477]: from='mgr.? 172.21.15.116:0/2016076648' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T04:40:36.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:36 smithi116 ceph-mon[34477]: from='mgr.? 172.21.15.116:0/2016076648' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T04:40:36.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:36 smithi116 ceph-mon[34477]: from='mgr.? 172.21.15.116:0/2016076648' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T04:40:36.831 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:40:36 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:40:36.560+0000 7f8d87522040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T04:40:36.832 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:40:36 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:40:36.681+0000 7f8d87522040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T04:40:37.122 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:40:36 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:40:36.830+0000 7f8d87522040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T04:40:37.122 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:40:36 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:40:36.893+0000 7f8d87522040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T04:40:37.122 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:40:37 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:40:37.050+0000 7f8d87522040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T04:40:37.122 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:40:37 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:40:37.120+0000 7f8d87522040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T04:40:37.417 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:37 smithi018 ceph-mon[34537]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:37.418 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:37 smithi018 ceph-mon[34537]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-19T04:40:37.418 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:37 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T04:40:37.418 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:40:37 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:40:37.183+0000 7f8d87522040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T04:40:37.418 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:40:37 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:40:37.348+0000 7f8d87522040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T04:40:37.418 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:40:37 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:40:37.416+0000 7f8d87522040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T04:40:37.696 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:40:37 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:40:37.485+0000 7f8d87522040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T04:40:37.696 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:40:37 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:40:37.571+0000 7f8d87522040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T04:40:37.696 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:40:37 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:40:37.633+0000 7f8d87522040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T04:40:37.696 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:40:37 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:40:37.694+0000 7f8d87522040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T04:40:37.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:37 smithi002 ceph-mon[30975]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:37.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:37 smithi002 ceph-mon[30975]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-19T04:40:37.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:37 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T04:40:37.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:37 smithi116 ceph-mon[34477]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:37.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:37 smithi116 ceph-mon[34477]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-19T04:40:37.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:37 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T04:40:38.807 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:40:38 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:40:38.523+0000 7f8d87522040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T04:40:39.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:39.379+0000 7fc4177fe640 1 -- 172.21.15.2:0/2948799643 <== mon.0 v2:172.21.15.2:3300/0 8 ==== mgrmap(e 15) ==== 138298+0+0 (secure 0 0 0) 0x7fc42003a8e0 con 0x7fc424074c50 2024-09-19T04:40:39.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:39 smithi018 ceph-mon[34537]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:39.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:39 smithi018 ceph-mon[34537]: Standby manager daemon y started 2024-09-19T04:40:39.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:39 smithi018 ceph-mon[34537]: from='mgr.? 172.21.15.18:0/3235324390' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T04:40:39.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:39 smithi018 ceph-mon[34537]: from='mgr.? 172.21.15.18:0/3235324390' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T04:40:39.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:39 smithi018 ceph-mon[34537]: from='mgr.? 172.21.15.18:0/3235324390' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T04:40:39.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:39 smithi018 ceph-mon[34537]: from='mgr.? 172.21.15.18:0/3235324390' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T04:40:39.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:39 smithi002 ceph-mon[30975]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:39.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:39 smithi002 ceph-mon[30975]: Standby manager daemon y started 2024-09-19T04:40:39.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:39 smithi002 ceph-mon[30975]: from='mgr.? 172.21.15.18:0/3235324390' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T04:40:39.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:39 smithi002 ceph-mon[30975]: from='mgr.? 172.21.15.18:0/3235324390' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T04:40:39.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:39 smithi002 ceph-mon[30975]: from='mgr.? 172.21.15.18:0/3235324390' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T04:40:39.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:39 smithi002 ceph-mon[30975]: from='mgr.? 172.21.15.18:0/3235324390' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T04:40:39.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:39 smithi116 ceph-mon[34477]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:39.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:39 smithi116 ceph-mon[34477]: Standby manager daemon y started 2024-09-19T04:40:39.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:39 smithi116 ceph-mon[34477]: from='mgr.? 172.21.15.18:0/3235324390' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T04:40:39.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:39 smithi116 ceph-mon[34477]: from='mgr.? 172.21.15.18:0/3235324390' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T04:40:39.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:39 smithi116 ceph-mon[34477]: from='mgr.? 172.21.15.18:0/3235324390' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T04:40:39.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:39 smithi116 ceph-mon[34477]: from='mgr.? 172.21.15.18:0/3235324390' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T04:40:40.501 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:40 smithi002 ceph-mon[30975]: mgrmap e15: x(active, since 63s), standbys: z, y 2024-09-19T04:40:40.501 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:40 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T04:40:40.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:40 smithi018 ceph-mon[34537]: mgrmap e15: x(active, since 63s), standbys: z, y 2024-09-19T04:40:40.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:40 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T04:40:40.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:40 smithi116 ceph-mon[34477]: mgrmap e15: x(active, since 63s), standbys: z, y 2024-09-19T04:40:40.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:40 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T04:40:41.597 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:41 smithi002 ceph-mon[30975]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:41.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:41 smithi018 ceph-mon[34537]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:41.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:41 smithi116 ceph-mon[34477]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:43.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:43 smithi018 ceph-mon[34537]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:43.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:43 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:43.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:43 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:43.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:43 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:40:43.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:43 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:43.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:43 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:40:43.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:43 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:43.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:43 smithi002 ceph-mon[30975]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:43.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:43 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:43.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:43 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:43.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:43 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:40:43.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:43 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:43.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:43 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:40:43.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:43 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:43.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:43 smithi116 ceph-mon[34477]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:43.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:43 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:43.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:43 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:43.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:43 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:40:43.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:43 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:43.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:43 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:40:43.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:43 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:45.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:45 smithi018 ceph-mon[34537]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:45.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:45 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T04:40:45.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:45 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:45.569 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:45 smithi002 ceph-mon[30975]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:45.569 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:45 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T04:40:45.569 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:45 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:45.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:45 smithi116 ceph-mon[34477]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:45.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:45 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T04:40:45.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:45 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:46.427 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:46 smithi002 ceph-mon[30975]: Deploying daemon osd.0 on smithi002 2024-09-19T04:40:46.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:46 smithi018 ceph-mon[34537]: Deploying daemon osd.0 on smithi002 2024-09-19T04:40:46.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:46 smithi116 ceph-mon[34477]: Deploying daemon osd.0 on smithi002 2024-09-19T04:40:47.526 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:47 smithi002 ceph-mon[30975]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:47.556 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:47 smithi018 ceph-mon[34537]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:47.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:47 smithi116 ceph-mon[34477]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:49.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:49 smithi018 ceph-mon[34537]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:49.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:49 smithi002 ceph-mon[30975]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:49.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:49 smithi116 ceph-mon[34477]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:51.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:51 smithi018 ceph-mon[34537]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:51.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:51 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:40:51.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:51 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:51.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:51 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:51.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:51 smithi002 ceph-mon[30975]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:51.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:51 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:40:51.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:51 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:51.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:51 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:51.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:51 smithi116 ceph-mon[34477]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:51.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:51 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:40:51.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:51 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:51.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:51 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:53.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:53 smithi018 ceph-mon[34537]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:53.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:53 smithi002 ceph-mon[30975]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:53.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:53 smithi116 ceph-mon[34477]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:54.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:54 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:54.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:54 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:54.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:54 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:54.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:54 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:40:54.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:54 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:54.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:54 smithi116 ceph-mon[34477]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:54.654 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:54 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:54.654 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:54 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:54.654 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:54 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:54.654 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:54 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:40:54.654 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:54 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:54.654 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:54 smithi002 ceph-mon[30975]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:54.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:54.697+0000 7fc4177fe640 1 -- 172.21.15.2:0/2948799643 <== mgr.14150 v2:172.21.15.2:6800/3171525177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc424062630 con 0x7fc410039500 2024-09-19T04:40:54.699 INFO:teuthology.orchestra.run.smithi002.stdout:Created osd(s) 0 on host 'smithi002' 2024-09-19T04:40:54.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:54.700+0000 7fc42c399640 1 -- 172.21.15.2:0/2948799643 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fc410039500 msgr2=0x7fc41003b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:54.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:54.700+0000 7fc42c399640 1 --2- 172.21.15.2:0/2948799643 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fc410039500 0x7fc41003b9c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc42419f960 tx=0x7fc41800b410 comp rx=0 tx=0).stop 2024-09-19T04:40:54.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:54.700+0000 7fc42c399640 1 -- 172.21.15.2:0/2948799643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc424074c50 msgr2=0x7fc42419e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:54.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:54.700+0000 7fc42c399640 1 --2- 172.21.15.2:0/2948799643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc424074c50 0x7fc42419e440 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc4200314e0 tx=0x7fc4200042e0 comp rx=0 tx=0).stop 2024-09-19T04:40:54.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:54.700+0000 7fc42c399640 1 -- 172.21.15.2:0/2948799643 shutdown_connections 2024-09-19T04:40:54.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:54.700+0000 7fc42c399640 1 --2- 172.21.15.2:0/2948799643 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fc410039500 0x7fc41003b9c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:54.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:54.700+0000 7fc42c399640 1 --2- 172.21.15.2:0/2948799643 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc42410e1e0 0x7fc4241a5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:54.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:54.700+0000 7fc42c399640 1 --2- 172.21.15.2:0/2948799643 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc424076220 0x7fc42419e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:54.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:54.700+0000 7fc42c399640 1 --2- 172.21.15.2:0/2948799643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc424074c50 0x7fc42419e440 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:54.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:54.700+0000 7fc42c399640 1 -- 172.21.15.2:0/2948799643 >> 172.21.15.2:0/2948799643 conn(0x7fc4240fd390 msgr2=0x7fc4240ff780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:54.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:54.700+0000 7fc42c399640 1 -- 172.21.15.2:0/2948799643 shutdown_connections 2024-09-19T04:40:54.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:40:54.700+0000 7fc42c399640 1 -- 172.21.15.2:0/2948799643 wait complete. 2024-09-19T04:40:54.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:54 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:54.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:54 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:54.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:54 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:54.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:54 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:40:54.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:54 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:54.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:54 smithi018 ceph-mon[34537]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:55.311 DEBUG:teuthology.orchestra.run.smithi002:osd.0> sudo journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@osd.0.service 2024-09-19T04:40:55.313 INFO:tasks.cephadm:Deploying osd.1 on smithi018 with /dev/vg_nvme/lv_4... 2024-09-19T04:40:55.313 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T04:40:55.551 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:55 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:40:55.552 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:55 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:55.552 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:55 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:55.564 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T04:40:55.685 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:55 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:40:55.685 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:55 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:55.686 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:55 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:55.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:55 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:40:55.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:55 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:55.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:55 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:56.704 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:56 smithi018 ceph-mon[34537]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:56.780 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:56 smithi002 ceph-mon[30975]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:56.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:56 smithi116 ceph-mon[34477]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:57.332 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 04:40:57 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-0[44697]: 2024-09-19T04:40:57.249+0000 7ff33eeac640 -1 osd.0 0 log_to_monitors true 2024-09-19T04:40:57.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:57 smithi018 ceph-mon[34537]: from='osd.0 [v2:172.21.15.2:6802/611702745,v1:172.21.15.2:6803/611702745]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T04:40:57.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:57 smithi002 ceph-mon[30975]: from='osd.0 [v2:172.21.15.2:6802/611702745,v1:172.21.15.2:6803/611702745]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T04:40:57.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:57 smithi116 ceph-mon[34477]: from='osd.0 [v2:172.21.15.2:6802/611702745,v1:172.21.15.2:6803/611702745]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T04:40:57.878 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T04:40:57.910 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi018:vg_nvme/lv_4 2024-09-19T04:40:58.168 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T04:40:58.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:58 smithi018 ceph-mon[34537]: from='osd.0 [v2:172.21.15.2:6802/611702745,v1:172.21.15.2:6803/611702745]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T04:40:58.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:58 smithi018 ceph-mon[34537]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T04:40:58.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:58 smithi018 ceph-mon[34537]: from='osd.0 [v2:172.21.15.2:6802/611702745,v1:172.21.15.2:6803/611702745]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-19T04:40:58.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:58 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:40:58.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:58 smithi018 ceph-mon[34537]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:58.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:58 smithi018 ceph-mon[34537]: Detected new or changed devices on smithi002 2024-09-19T04:40:58.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:58 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:58.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:58 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:58.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:58 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:40:58.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:58 smithi018 ceph-mon[34537]: Adjusting osd_memory_target on smithi002 to 17092M 2024-09-19T04:40:58.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:58 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:58.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:58 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:58.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:58 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:40:58.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:58 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:58.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:40:58.667+0000 7f16c2ab7640 1 -- 172.21.15.18:0/1475208184 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f16bc101c00 msgr2=0x7f16bc102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:58.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:40:58.667+0000 7f16c2ab7640 1 --2- 172.21.15.18:0/1475208184 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f16bc101c00 0x7f16bc102000 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f16b0009900 tx=0x7f16b002a410 comp rx=0 tx=0).stop 2024-09-19T04:40:58.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:40:58.668+0000 7f16c2ab7640 1 -- 172.21.15.18:0/1475208184 shutdown_connections 2024-09-19T04:40:58.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:40:58.668+0000 7f16c2ab7640 1 --2- 172.21.15.18:0/1475208184 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f16bc1037c0 0x7f16bc10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:58.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:40:58.668+0000 7f16c2ab7640 1 --2- 172.21.15.18:0/1475208184 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16bc102e00 0x7f16bc103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:58.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:40:58.668+0000 7f16c2ab7640 1 --2- 172.21.15.18:0/1475208184 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f16bc101c00 0x7f16bc102000 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:58.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:40:58.668+0000 7f16c2ab7640 1 -- 172.21.15.18:0/1475208184 >> 172.21.15.18:0/1475208184 conn(0x7f16bc0fd390 msgr2=0x7f16bc0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:58.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:40:58.668+0000 7f16c2ab7640 1 -- 172.21.15.18:0/1475208184 shutdown_connections 2024-09-19T04:40:58.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:40:58.668+0000 7f16c2ab7640 1 -- 172.21.15.18:0/1475208184 wait complete. 2024-09-19T04:40:58.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:40:58.668+0000 7f16c2ab7640 1 Processor -- start 2024-09-19T04:40:58.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:40:58.668+0000 7f16c2ab7640 1 -- start start 2024-09-19T04:40:58.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:40:58.668+0000 7f16c2ab7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f16bc101c00 0x7f16bc197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:58.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:40:58.668+0000 7f16c2ab7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16bc102e00 0x7f16bc198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:58.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:40:58.668+0000 7f16c2ab7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f16bc1037c0 0x7f16bc19f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:58.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:40:58.668+0000 7f16c2ab7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f16bc10d740 con 0x7f16bc102e00 2024-09-19T04:40:58.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:40:58.668+0000 7f16c2ab7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f16bc10d5c0 con 0x7f16bc1037c0 2024-09-19T04:40:58.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:40:58.668+0000 7f16c2ab7640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f16bc10d8c0 con 0x7f16bc101c00 2024-09-19T04:40:58.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:40:58.669+0000 7f16bbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16bc102e00 0x7f16bc198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:58.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:40:58.669+0000 7f16bbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16bc102e00 0x7f16bc198330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.18:35822/0 (socket says 172.21.15.18:35822) 2024-09-19T04:40:58.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:40:58.669+0000 7f16c1054640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f16bc1037c0 0x7f16bc19f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:58.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:40:58.669+0000 7f16bbfff640 1 -- 172.21.15.18:0/4003792817 learned_addr learned my addr 172.21.15.18:0/4003792817 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T04:40:58.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:40:58.669+0000 7f16c0853640 1 --2- 172.21.15.18:0/4003792817 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f16bc101c00 0x7f16bc197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:58.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:40:58.669+0000 7f16bbfff640 1 -- 172.21.15.18:0/4003792817 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f16bc101c00 msgr2=0x7f16bc197df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:58.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:40:58.669+0000 7f16bbfff640 1 --2- 172.21.15.18:0/4003792817 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f16bc101c00 0x7f16bc197df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:58.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:40:58.669+0000 7f16bbfff640 1 -- 172.21.15.18:0/4003792817 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f16bc1037c0 msgr2=0x7f16bc19f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:58.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:40:58.669+0000 7f16bbfff640 1 --2- 172.21.15.18:0/4003792817 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f16bc1037c0 0x7f16bc19f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:58.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:40:58.669+0000 7f16bbfff640 1 -- 172.21.15.18:0/4003792817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16bc06bd40 con 0x7f16bc102e00 2024-09-19T04:40:58.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:40:58.669+0000 7f16c1054640 1 --2- 172.21.15.18:0/4003792817 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f16bc1037c0 0x7f16bc19f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:40:58.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:40:58.669+0000 7f16bbfff640 1 --2- 172.21.15.18:0/4003792817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16bc102e00 0x7f16bc198330 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f16a800e9f0 tx=0x7f16a800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:58.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:40:58.669+0000 7f16b9ffb640 1 -- 172.21.15.18:0/4003792817 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a800cd80 con 0x7f16bc102e00 2024-09-19T04:40:58.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:40:58.669+0000 7f16c2ab7640 1 -- 172.21.15.18:0/4003792817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16bc06c030 con 0x7f16bc102e00 2024-09-19T04:40:58.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:40:58.669+0000 7f16b9ffb640 1 -- 172.21.15.18:0/4003792817 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f16a80108e0 con 0x7f16bc102e00 2024-09-19T04:40:58.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:40:58.669+0000 7f16b9ffb640 1 -- 172.21.15.18:0/4003792817 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a8018920 con 0x7f16bc102e00 2024-09-19T04:40:58.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:40:58.670+0000 7f16c2ab7640 1 -- 172.21.15.18:0/4003792817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16bc06c5c0 con 0x7f16bc102e00 2024-09-19T04:40:58.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:40:58.670+0000 7f16c2ab7640 1 -- 172.21.15.18:0/4003792817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16bc1090a0 con 0x7f16bc102e00 2024-09-19T04:40:58.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:40:58.672+0000 7f16b9ffb640 1 -- 172.21.15.18:0/4003792817 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) ==== 138298+0+0 (secure 0 0 0) 0x7f16a8010a90 con 0x7f16bc102e00 2024-09-19T04:40:58.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:40:58.673+0000 7f16b9ffb640 1 --2- 172.21.15.18:0/4003792817 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f16ac0a31e0 0x7f16ac0a56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:58.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:40:58.673+0000 7f16b9ffb640 1 -- 172.21.15.18:0/4003792817 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7f16a80ce530 con 0x7f16bc102e00 2024-09-19T04:40:58.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:40:58.673+0000 7f16c0853640 1 --2- 172.21.15.18:0/4003792817 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f16ac0a31e0 0x7f16ac0a56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:58.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:40:58.673+0000 7f16c0853640 1 --2- 172.21.15.18:0/4003792817 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f16ac0a31e0 0x7f16ac0a56a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f16b0004770 tx=0x7f16b0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:58.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:40:58.680+0000 7f16b9ffb640 1 -- 172.21.15.18:0/4003792817 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f16a809c6f0 con 0x7f16bc102e00 2024-09-19T04:40:58.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:58 smithi002 ceph-mon[30975]: from='osd.0 [v2:172.21.15.2:6802/611702745,v1:172.21.15.2:6803/611702745]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T04:40:58.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:58 smithi002 ceph-mon[30975]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T04:40:58.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:58 smithi002 ceph-mon[30975]: from='osd.0 [v2:172.21.15.2:6802/611702745,v1:172.21.15.2:6803/611702745]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-19T04:40:58.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:58 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:40:58.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:58 smithi002 ceph-mon[30975]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:58.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:58 smithi002 ceph-mon[30975]: Detected new or changed devices on smithi002 2024-09-19T04:40:58.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:58 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:58.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:58 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:58.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:58 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:40:58.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:58 smithi002 ceph-mon[30975]: Adjusting osd_memory_target on smithi002 to 17092M 2024-09-19T04:40:58.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:58 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:58.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:58 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:58.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:58 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:40:58.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:58 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:58.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:58 smithi116 ceph-mon[34477]: from='osd.0 [v2:172.21.15.2:6802/611702745,v1:172.21.15.2:6803/611702745]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T04:40:58.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:58 smithi116 ceph-mon[34477]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T04:40:58.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:58 smithi116 ceph-mon[34477]: from='osd.0 [v2:172.21.15.2:6802/611702745,v1:172.21.15.2:6803/611702745]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-19T04:40:58.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:58 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:40:58.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:58 smithi116 ceph-mon[34477]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:40:58.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:58 smithi116 ceph-mon[34477]: Detected new or changed devices on smithi002 2024-09-19T04:40:58.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:58 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:58.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:58 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:58.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:58 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:40:58.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:58 smithi116 ceph-mon[34477]: Adjusting osd_memory_target on smithi002 to 17092M 2024-09-19T04:40:58.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:58 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:58.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:58 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:58.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:58 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:40:58.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:58 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:40:58.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:40:58.867+0000 7f16c2ab7640 1 -- 172.21.15.18:0/4003792817 --> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f16bc062630 con 0x7f16ac0a31e0 2024-09-19T04:40:59.497 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 04:40:59 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-0[44697]: 2024-09-19T04:40:59.219+0000 7ff33b643640 -1 osd.0 0 waiting for initial osdmap 2024-09-19T04:40:59.497 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 04:40:59 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-0[44697]: 2024-09-19T04:40:59.222+0000 7ff332c3e640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T04:40:59.548 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:59 smithi018 ceph-mon[34537]: from='osd.0 [v2:172.21.15.2:6802/611702745,v1:172.21.15.2:6803/611702745]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-19T04:40:59.548 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:59 smithi018 ceph-mon[34537]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T04:40:59.548 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:59 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:40:59.548 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:59 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:40:59.548 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:59 smithi018 ceph-mon[34537]: from='client.14250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:40:59.549 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:59 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:40:59.549 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:59 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:40:59.549 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:59 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:59.549 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:59 smithi018 ceph-mon[34537]: from='osd.0 [v2:172.21.15.2:6802/611702745,v1:172.21.15.2:6803/611702745]' entity='osd.0' 2024-09-19T04:40:59.549 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:40:59 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:40:59.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:59 smithi002 ceph-mon[30975]: from='osd.0 [v2:172.21.15.2:6802/611702745,v1:172.21.15.2:6803/611702745]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-19T04:40:59.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:59 smithi002 ceph-mon[30975]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T04:40:59.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:59 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:40:59.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:59 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:40:59.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:59 smithi002 ceph-mon[30975]: from='client.14250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:40:59.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:59 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:40:59.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:59 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:40:59.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:59 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:59.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:59 smithi002 ceph-mon[30975]: from='osd.0 [v2:172.21.15.2:6802/611702745,v1:172.21.15.2:6803/611702745]' entity='osd.0' 2024-09-19T04:40:59.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:40:59 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:40:59.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:59 smithi116 ceph-mon[34477]: from='osd.0 [v2:172.21.15.2:6802/611702745,v1:172.21.15.2:6803/611702745]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-19T04:40:59.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:59 smithi116 ceph-mon[34477]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T04:40:59.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:59 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:40:59.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:59 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:40:59.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:59 smithi116 ceph-mon[34477]: from='client.14250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:40:59.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:59 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:40:59.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:59 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:40:59.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:59 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:59.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:59 smithi116 ceph-mon[34477]: from='osd.0 [v2:172.21.15.2:6802/611702745,v1:172.21.15.2:6803/611702745]' entity='osd.0' 2024-09-19T04:40:59.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:40:59 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:41:01.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:01 smithi018 ceph-mon[34537]: purged_snaps scrub starts 2024-09-19T04:41:01.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:01 smithi018 ceph-mon[34537]: purged_snaps scrub ok 2024-09-19T04:41:01.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:01 smithi018 ceph-mon[34537]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:41:01.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:01 smithi018 ceph-mon[34537]: osd.0 [v2:172.21.15.2:6802/611702745,v1:172.21.15.2:6803/611702745] boot 2024-09-19T04:41:01.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:01 smithi018 ceph-mon[34537]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T04:41:01.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:01 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:41:01.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:01 smithi018 ceph-mon[34537]: from='client.? 172.21.15.18:0/1107789147' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bea40dec-7d9c-497f-bf16-4bf6d3b839f8"}]: dispatch 2024-09-19T04:41:01.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:01 smithi018 ceph-mon[34537]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bea40dec-7d9c-497f-bf16-4bf6d3b839f8"}]: dispatch 2024-09-19T04:41:01.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:01 smithi018 ceph-mon[34537]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bea40dec-7d9c-497f-bf16-4bf6d3b839f8"}]': finished 2024-09-19T04:41:01.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:01 smithi018 ceph-mon[34537]: osdmap e9: 2 total, 1 up, 2 in 2024-09-19T04:41:01.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:01 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:41:01.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:01 smithi002 ceph-mon[30975]: purged_snaps scrub starts 2024-09-19T04:41:01.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:01 smithi002 ceph-mon[30975]: purged_snaps scrub ok 2024-09-19T04:41:01.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:01 smithi002 ceph-mon[30975]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:41:01.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:01 smithi002 ceph-mon[30975]: osd.0 [v2:172.21.15.2:6802/611702745,v1:172.21.15.2:6803/611702745] boot 2024-09-19T04:41:01.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:01 smithi002 ceph-mon[30975]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T04:41:01.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:01 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:41:01.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:01 smithi002 ceph-mon[30975]: from='client.? 172.21.15.18:0/1107789147' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bea40dec-7d9c-497f-bf16-4bf6d3b839f8"}]: dispatch 2024-09-19T04:41:01.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:01 smithi002 ceph-mon[30975]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bea40dec-7d9c-497f-bf16-4bf6d3b839f8"}]: dispatch 2024-09-19T04:41:01.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:01 smithi002 ceph-mon[30975]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bea40dec-7d9c-497f-bf16-4bf6d3b839f8"}]': finished 2024-09-19T04:41:01.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:01 smithi002 ceph-mon[30975]: osdmap e9: 2 total, 1 up, 2 in 2024-09-19T04:41:01.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:01 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:41:01.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:01 smithi116 ceph-mon[34477]: purged_snaps scrub starts 2024-09-19T04:41:01.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:01 smithi116 ceph-mon[34477]: purged_snaps scrub ok 2024-09-19T04:41:01.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:01 smithi116 ceph-mon[34477]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:41:01.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:01 smithi116 ceph-mon[34477]: osd.0 [v2:172.21.15.2:6802/611702745,v1:172.21.15.2:6803/611702745] boot 2024-09-19T04:41:01.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:01 smithi116 ceph-mon[34477]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T04:41:01.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:01 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:41:01.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:01 smithi116 ceph-mon[34477]: from='client.? 172.21.15.18:0/1107789147' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bea40dec-7d9c-497f-bf16-4bf6d3b839f8"}]: dispatch 2024-09-19T04:41:01.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:01 smithi116 ceph-mon[34477]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bea40dec-7d9c-497f-bf16-4bf6d3b839f8"}]: dispatch 2024-09-19T04:41:01.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:01 smithi116 ceph-mon[34477]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bea40dec-7d9c-497f-bf16-4bf6d3b839f8"}]': finished 2024-09-19T04:41:01.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:01 smithi116 ceph-mon[34477]: osdmap e9: 2 total, 1 up, 2 in 2024-09-19T04:41:01.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:01 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:41:02.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:02 smithi018 ceph-mon[34537]: from='client.? 172.21.15.18:0/4094833707' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:41:02.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:02 smithi002 ceph-mon[30975]: from='client.? 172.21.15.18:0/4094833707' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:41:02.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:02 smithi116 ceph-mon[34477]: from='client.? 172.21.15.18:0/4094833707' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:41:03.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:03 smithi018 ceph-mon[34537]: pgmap v42: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:41:03.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:03 smithi002 ceph-mon[30975]: pgmap v42: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:41:03.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:03 smithi116 ceph-mon[34477]: pgmap v42: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:41:05.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:05 smithi018 ceph-mon[34537]: pgmap v43: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:41:05.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:05 smithi002 ceph-mon[30975]: pgmap v43: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:41:05.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:05 smithi116 ceph-mon[34477]: pgmap v43: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:41:07.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:07 smithi018 ceph-mon[34537]: pgmap v44: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:41:07.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:07 smithi002 ceph-mon[30975]: pgmap v44: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:41:07.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:07 smithi116 ceph-mon[34477]: pgmap v44: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:41:09.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:09 smithi018 ceph-mon[34537]: pgmap v45: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:41:09.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:09 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T04:41:09.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:09 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:41:09.609 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:09 smithi002 ceph-mon[30975]: pgmap v45: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:41:09.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:09 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T04:41:09.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:09 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:41:09.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:09 smithi116 ceph-mon[34477]: pgmap v45: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:41:09.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:09 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T04:41:09.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:09 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:41:10.551 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:10 smithi018 ceph-mon[34537]: Deploying daemon osd.1 on smithi018 2024-09-19T04:41:10.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:10 smithi002 ceph-mon[30975]: Deploying daemon osd.1 on smithi018 2024-09-19T04:41:10.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:10 smithi116 ceph-mon[34477]: Deploying daemon osd.1 on smithi018 2024-09-19T04:41:11.431 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:11 smithi018 ceph-mon[34537]: pgmap v46: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:41:11.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:11 smithi002 ceph-mon[30975]: pgmap v46: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:41:11.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:11 smithi116 ceph-mon[34477]: pgmap v46: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:41:13.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:13 smithi018 ceph-mon[34537]: pgmap v47: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:41:13.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:13 smithi002 ceph-mon[30975]: pgmap v47: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:41:13.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:13 smithi116 ceph-mon[34477]: pgmap v47: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:41:15.517 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:15 smithi018 ceph-mon[34537]: pgmap v48: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:41:15.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:15 smithi002 ceph-mon[30975]: pgmap v48: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:41:15.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:15 smithi116 ceph-mon[34477]: pgmap v48: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:41:16.279 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:16 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:41:16.279 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:16 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:16.279 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:16 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:16.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:16 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:41:16.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:16 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:16.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:16 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:16.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:16 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:41:16.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:16 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:16.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:16 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:17.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:17 smithi018 ceph-mon[34537]: pgmap v49: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:41:17.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:17 smithi002 ceph-mon[30975]: pgmap v49: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:41:17.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:17 smithi116 ceph-mon[34477]: pgmap v49: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:41:19.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:18 smithi018 ceph-mon[34537]: pgmap v50: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:41:19.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:18 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:19.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:18 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:19.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:18 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:41:19.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:18 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:41:19.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:18 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:19.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:18 smithi002 ceph-mon[30975]: pgmap v50: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:41:19.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:18 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:19.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:18 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:19.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:18 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:41:19.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:18 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:41:19.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:18 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:19.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:18 smithi116 ceph-mon[34477]: pgmap v50: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:41:19.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:18 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:19.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:18 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:19.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:18 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:41:19.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:18 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:41:19.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:18 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:19.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:41:19.840+0000 7f16b9ffb640 1 -- 172.21.15.18:0/4003792817 <== mgr.14150 v2:172.21.15.2:6800/3171525177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f16bc062630 con 0x7f16ac0a31e0 2024-09-19T04:41:19.841 INFO:teuthology.orchestra.run.smithi018.stdout:Created osd(s) 1 on host 'smithi018' 2024-09-19T04:41:19.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:41:19.842+0000 7f16c2ab7640 1 -- 172.21.15.18:0/4003792817 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f16ac0a31e0 msgr2=0x7f16ac0a56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:19.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:41:19.842+0000 7f16c2ab7640 1 --2- 172.21.15.18:0/4003792817 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f16ac0a31e0 0x7f16ac0a56a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f16b0004770 tx=0x7f16b0000bc0 comp rx=0 tx=0).stop 2024-09-19T04:41:19.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:41:19.842+0000 7f16c2ab7640 1 -- 172.21.15.18:0/4003792817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16bc102e00 msgr2=0x7f16bc198330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:19.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:41:19.842+0000 7f16c2ab7640 1 --2- 172.21.15.18:0/4003792817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16bc102e00 0x7f16bc198330 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f16a800e9f0 tx=0x7f16a800eeb0 comp rx=0 tx=0).stop 2024-09-19T04:41:19.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:41:19.843+0000 7f16c2ab7640 1 -- 172.21.15.18:0/4003792817 shutdown_connections 2024-09-19T04:41:19.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:41:19.843+0000 7f16c2ab7640 1 --2- 172.21.15.18:0/4003792817 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f16ac0a31e0 0x7f16ac0a56a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:19.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:41:19.843+0000 7f16c2ab7640 1 --2- 172.21.15.18:0/4003792817 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f16bc1037c0 0x7f16bc19f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:19.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:41:19.843+0000 7f16c2ab7640 1 --2- 172.21.15.18:0/4003792817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16bc102e00 0x7f16bc198330 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:19.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:41:19.843+0000 7f16c2ab7640 1 --2- 172.21.15.18:0/4003792817 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f16bc101c00 0x7f16bc197df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:19.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:41:19.843+0000 7f16c2ab7640 1 -- 172.21.15.18:0/4003792817 >> 172.21.15.18:0/4003792817 conn(0x7f16bc0fd390 msgr2=0x7f16bc106270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:19.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:41:19.843+0000 7f16c2ab7640 1 -- 172.21.15.18:0/4003792817 shutdown_connections 2024-09-19T04:41:19.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:41:19.843+0000 7f16c2ab7640 1 -- 172.21.15.18:0/4003792817 wait complete. 2024-09-19T04:41:20.496 DEBUG:teuthology.orchestra.run.smithi018:osd.1> sudo journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@osd.1.service 2024-09-19T04:41:20.498 INFO:tasks.cephadm:Deploying osd.2 on smithi116 with /dev/vg_nvme/lv_4... 2024-09-19T04:41:20.499 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T04:41:20.748 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T04:41:21.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:20 smithi018 ceph-mon[34537]: pgmap v51: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:41:21.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:20 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:41:21.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:20 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:21.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:20 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:21.108 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:20 smithi116 ceph-mon[34477]: pgmap v51: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:41:21.108 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:20 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:41:21.108 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:20 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:21.108 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:20 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:21.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:20 smithi002 ceph-mon[30975]: pgmap v51: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:41:21.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:20 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:41:21.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:20 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:21.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:20 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:21.938 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 19 04:41:21 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-1[39031]: 2024-09-19T04:41:21.891+0000 7ff081a8b640 -1 osd.1 0 log_to_monitors true 2024-09-19T04:41:22.888 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-19T04:41:22.912 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi116:vg_nvme/lv_4 2024-09-19T04:41:22.948 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:22 smithi018 ceph-mon[34537]: pgmap v52: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:41:22.948 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:22 smithi018 ceph-mon[34537]: from='osd.1 [v2:172.21.15.18:6800/58390709,v1:172.21.15.18:6801/58390709]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T04:41:22.948 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:22 smithi018 ceph-mon[34537]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T04:41:23.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:22 smithi002 ceph-mon[30975]: pgmap v52: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:41:23.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:22 smithi002 ceph-mon[30975]: from='osd.1 [v2:172.21.15.18:6800/58390709,v1:172.21.15.18:6801/58390709]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T04:41:23.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:22 smithi002 ceph-mon[30975]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T04:41:23.110 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:22 smithi116 ceph-mon[34477]: pgmap v52: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:41:23.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:22 smithi116 ceph-mon[34477]: from='osd.1 [v2:172.21.15.18:6800/58390709,v1:172.21.15.18:6801/58390709]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T04:41:23.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:22 smithi116 ceph-mon[34477]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T04:41:23.150 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T04:41:23.598 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:23.597+0000 7f4914d25640 1 -- 172.21.15.116:0/1913886289 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4910102730 msgr2=0x7f4910104b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:23.598 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:23.597+0000 7f4914d25640 1 --2- 172.21.15.116:0/1913886289 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4910102730 0x7f4910104b20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4904009900 tx=0x7f490402a410 comp rx=0 tx=0).stop 2024-09-19T04:41:23.598 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:23.597+0000 7f4914d25640 1 -- 172.21.15.116:0/1913886289 shutdown_connections 2024-09-19T04:41:23.598 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:23.597+0000 7f4914d25640 1 --2- 172.21.15.116:0/1913886289 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4910107990 0x7f4910109d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:23.599 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:23.597+0000 7f4914d25640 1 --2- 172.21.15.116:0/1913886289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4910105060 0x7f4910107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:23.599 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:23.597+0000 7f4914d25640 1 --2- 172.21.15.116:0/1913886289 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4910102730 0x7f4910104b20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:23.599 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:23.597+0000 7f4914d25640 1 -- 172.21.15.116:0/1913886289 >> 172.21.15.116:0/1913886289 conn(0x7f49100fc290 msgr2=0x7f49100fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:23.599 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:23.597+0000 7f4914d25640 1 -- 172.21.15.116:0/1913886289 shutdown_connections 2024-09-19T04:41:23.599 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:23.597+0000 7f4914d25640 1 -- 172.21.15.116:0/1913886289 wait complete. 2024-09-19T04:41:23.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:23.598+0000 7f4914d25640 1 Processor -- start 2024-09-19T04:41:23.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:23.598+0000 7f4914d25640 1 -- start start 2024-09-19T04:41:23.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:23.598+0000 7f4914d25640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4910102730 0x7f4910197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:23.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:23.598+0000 7f4914d25640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4910105060 0x7f4910198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:23.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:23.598+0000 7f4914d25640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4910107990 0x7f491019f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:23.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:23.598+0000 7f4914d25640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f491010d740 con 0x7f4910102730 2024-09-19T04:41:23.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:23.598+0000 7f4914d25640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f491010d5c0 con 0x7f4910107990 2024-09-19T04:41:23.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:23.598+0000 7f4914d25640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f491010d8c0 con 0x7f4910105060 2024-09-19T04:41:23.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:23.599+0000 7f490dd9b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4910105060 0x7f4910198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:23.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:23.599+0000 7f490dd9b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4910105060 0x7f4910198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:33170/0 (socket says 172.21.15.116:33170) 2024-09-19T04:41:23.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:23.599+0000 7f490dd9b640 1 -- 172.21.15.116:0/2760692135 learned_addr learned my addr 172.21.15.116:0/2760692135 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-19T04:41:23.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:23.599+0000 7f490e59c640 1 --2- 172.21.15.116:0/2760692135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4910102730 0x7f4910197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:23.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:23.599+0000 7f490ed9d640 1 --2- 172.21.15.116:0/2760692135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4910107990 0x7f491019f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:23.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:23.599+0000 7f490dd9b640 1 -- 172.21.15.116:0/2760692135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4910107990 msgr2=0x7f491019f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:23.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:23.599+0000 7f490dd9b640 1 --2- 172.21.15.116:0/2760692135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4910107990 0x7f491019f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:23.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:23.599+0000 7f490dd9b640 1 -- 172.21.15.116:0/2760692135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4910102730 msgr2=0x7f4910197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:23.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:23.599+0000 7f490dd9b640 1 --2- 172.21.15.116:0/2760692135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4910102730 0x7f4910197e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:23.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:23.599+0000 7f490dd9b640 1 -- 172.21.15.116:0/2760692135 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f491019fa50 con 0x7f4910105060 2024-09-19T04:41:23.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:23.599+0000 7f490ed9d640 1 --2- 172.21.15.116:0/2760692135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4910107990 0x7f491019f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:41:23.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:23.599+0000 7f490dd9b640 1 --2- 172.21.15.116:0/2760692135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4910105060 0x7f4910198360 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f490000d770 tx=0x7f490000dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:23.603 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:23.599+0000 7f48ff7fe640 1 -- 172.21.15.116:0/2760692135 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4900017070 con 0x7f4910105060 2024-09-19T04:41:23.603 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:23.599+0000 7f48ff7fe640 1 -- 172.21.15.116:0/2760692135 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4900009c30 con 0x7f4910105060 2024-09-19T04:41:23.603 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:23.599+0000 7f4914d25640 1 -- 172.21.15.116:0/2760692135 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f491019fd40 con 0x7f4910105060 2024-09-19T04:41:23.603 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:23.599+0000 7f48ff7fe640 1 -- 172.21.15.116:0/2760692135 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f490000f620 con 0x7f4910105060 2024-09-19T04:41:23.603 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:23.599+0000 7f4914d25640 1 -- 172.21.15.116:0/2760692135 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49101a0270 con 0x7f4910105060 2024-09-19T04:41:23.604 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:23.601+0000 7f4914d25640 1 -- 172.21.15.116:0/2760692135 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49100fdd80 con 0x7f4910105060 2024-09-19T04:41:23.604 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:23.602+0000 7f48ff7fe640 1 -- 172.21.15.116:0/2760692135 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 15) ==== 138298+0+0 (secure 0 0 0) 0x7f490001a070 con 0x7f4910105060 2024-09-19T04:41:23.604 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:23.603+0000 7f48ff7fe640 1 --2- 172.21.15.116:0/2760692135 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f48f80a3260 0x7f48f80a5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:23.604 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:23.603+0000 7f48ff7fe640 1 -- 172.21.15.116:0/2760692135 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1903+0+0 (secure 0 0 0) 0x7f49000cd910 con 0x7f4910105060 2024-09-19T04:41:23.604 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:23.603+0000 7f490e59c640 1 --2- 172.21.15.116:0/2760692135 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f48f80a3260 0x7f48f80a5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:23.604 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:23.604+0000 7f490e59c640 1 --2- 172.21.15.116:0/2760692135 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f48f80a3260 0x7f48f80a5720 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4904006010 tx=0x7f4904000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:23.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:23.608+0000 7f48ff7fe640 1 -- 172.21.15.116:0/2760692135 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f490009c020 con 0x7f4910105060 2024-09-19T04:41:23.789 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:23.788+0000 7f4914d25640 1 -- 172.21.15.116:0/2760692135 --> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f4910062630 con 0x7f48f80a3260 2024-09-19T04:41:23.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:23 smithi116 ceph-mon[34477]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T04:41:23.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:23 smithi116 ceph-mon[34477]: from='osd.1 [v2:172.21.15.18:6800/58390709,v1:172.21.15.18:6801/58390709]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-19T04:41:23.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:23 smithi116 ceph-mon[34477]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T04:41:23.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:23 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:41:23.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:23 smithi116 ceph-mon[34477]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-19T04:41:23.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:23 smithi116 ceph-mon[34477]: Detected new or changed devices on smithi018 2024-09-19T04:41:23.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:23 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:23.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:23 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:23.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:23 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:41:23.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:23 smithi116 ceph-mon[34477]: Adjusting osd_memory_target on smithi018 to 17092M 2024-09-19T04:41:23.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:23 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:23.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:23 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:41:23.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:23 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:41:23.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:23 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:23.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:23 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:41:24.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:23 smithi018 ceph-mon[34537]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T04:41:24.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:23 smithi018 ceph-mon[34537]: from='osd.1 [v2:172.21.15.18:6800/58390709,v1:172.21.15.18:6801/58390709]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-19T04:41:24.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:23 smithi018 ceph-mon[34537]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T04:41:24.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:23 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:41:24.058 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:23 smithi018 ceph-mon[34537]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-19T04:41:24.058 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:23 smithi018 ceph-mon[34537]: Detected new or changed devices on smithi018 2024-09-19T04:41:24.058 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:23 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:24.058 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:23 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:24.058 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:23 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:41:24.058 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:23 smithi018 ceph-mon[34537]: Adjusting osd_memory_target on smithi018 to 17092M 2024-09-19T04:41:24.058 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:23 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:24.058 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:23 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:41:24.058 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:23 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:41:24.058 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:23 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:24.058 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:23 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:41:24.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:23 smithi002 ceph-mon[30975]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T04:41:24.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:23 smithi002 ceph-mon[30975]: from='osd.1 [v2:172.21.15.18:6800/58390709,v1:172.21.15.18:6801/58390709]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-19T04:41:24.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:23 smithi002 ceph-mon[30975]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T04:41:24.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:23 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:41:24.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:23 smithi002 ceph-mon[30975]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-19T04:41:24.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:23 smithi002 ceph-mon[30975]: Detected new or changed devices on smithi018 2024-09-19T04:41:24.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:23 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:24.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:23 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:24.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:23 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:41:24.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:23 smithi002 ceph-mon[30975]: Adjusting osd_memory_target on smithi018 to 17092M 2024-09-19T04:41:24.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:23 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:24.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:23 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:41:24.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:23 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:41:24.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:23 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:24.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:23 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:41:24.802 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 19 04:41:24 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-1[39031]: 2024-09-19T04:41:24.488+0000 7ff07d1eb640 -1 osd.1 0 waiting for initial osdmap 2024-09-19T04:41:24.802 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 19 04:41:24 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-1[39031]: 2024-09-19T04:41:24.491+0000 7ff07581d640 -1 osd.1 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T04:41:25.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:24 smithi018 ceph-mon[34537]: pgmap v54: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:41:25.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:24 smithi018 ceph-mon[34537]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:41:25.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:24 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:41:25.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:24 smithi018 ceph-mon[34537]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-19T04:41:25.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:24 smithi018 ceph-mon[34537]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T04:41:25.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:24 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:41:25.058 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:24 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:41:25.058 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:24 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:41:25.058 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:24 smithi018 ceph-mon[34537]: from='osd.1 ' entity='osd.1' 2024-09-19T04:41:25.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:24 smithi002 ceph-mon[30975]: pgmap v54: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:41:25.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:24 smithi002 ceph-mon[30975]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:41:25.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:24 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:41:25.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:24 smithi002 ceph-mon[30975]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-19T04:41:25.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:24 smithi002 ceph-mon[30975]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T04:41:25.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:24 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:41:25.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:24 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:41:25.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:24 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:41:25.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:24 smithi002 ceph-mon[30975]: from='osd.1 ' entity='osd.1' 2024-09-19T04:41:25.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:24 smithi116 ceph-mon[34477]: pgmap v54: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:41:25.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:24 smithi116 ceph-mon[34477]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:41:25.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:24 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:41:25.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:24 smithi116 ceph-mon[34477]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-19T04:41:25.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:24 smithi116 ceph-mon[34477]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T04:41:25.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:24 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:41:25.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:24 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:41:25.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:24 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:41:25.112 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:24 smithi116 ceph-mon[34477]: from='osd.1 ' entity='osd.1' 2024-09-19T04:41:26.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:25 smithi002 ceph-mon[30975]: purged_snaps scrub starts 2024-09-19T04:41:26.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:25 smithi002 ceph-mon[30975]: purged_snaps scrub ok 2024-09-19T04:41:26.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:25 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:41:26.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:25 smithi002 ceph-mon[30975]: osd.1 [v2:172.21.15.18:6800/58390709,v1:172.21.15.18:6801/58390709] boot 2024-09-19T04:41:26.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:25 smithi002 ceph-mon[30975]: osdmap e12: 2 total, 2 up, 2 in 2024-09-19T04:41:26.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:25 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:41:26.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:25 smithi116 ceph-mon[34477]: purged_snaps scrub starts 2024-09-19T04:41:26.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:25 smithi116 ceph-mon[34477]: purged_snaps scrub ok 2024-09-19T04:41:26.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:25 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:41:26.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:25 smithi116 ceph-mon[34477]: osd.1 [v2:172.21.15.18:6800/58390709,v1:172.21.15.18:6801/58390709] boot 2024-09-19T04:41:26.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:25 smithi116 ceph-mon[34477]: osdmap e12: 2 total, 2 up, 2 in 2024-09-19T04:41:26.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:25 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:41:26.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:25 smithi018 ceph-mon[34537]: purged_snaps scrub starts 2024-09-19T04:41:26.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:25 smithi018 ceph-mon[34537]: purged_snaps scrub ok 2024-09-19T04:41:26.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:25 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:41:26.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:25 smithi018 ceph-mon[34537]: osd.1 [v2:172.21.15.18:6800/58390709,v1:172.21.15.18:6801/58390709] boot 2024-09-19T04:41:26.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:25 smithi018 ceph-mon[34537]: osdmap e12: 2 total, 2 up, 2 in 2024-09-19T04:41:26.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:25 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:41:27.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:26 smithi002 ceph-mon[30975]: pgmap v56: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:41:27.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:26 smithi002 ceph-mon[30975]: from='client.? 172.21.15.116:0/1706134472' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "97716304-a31e-48c9-83de-84eed10a7a4e"}]: dispatch 2024-09-19T04:41:27.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:26 smithi002 ceph-mon[30975]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "97716304-a31e-48c9-83de-84eed10a7a4e"}]: dispatch 2024-09-19T04:41:27.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:26 smithi002 ceph-mon[30975]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "97716304-a31e-48c9-83de-84eed10a7a4e"}]': finished 2024-09-19T04:41:27.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:26 smithi002 ceph-mon[30975]: osdmap e13: 3 total, 2 up, 3 in 2024-09-19T04:41:27.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:26 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:41:27.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:26 smithi002 ceph-mon[30975]: from='client.? 172.21.15.116:0/3816972519' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:41:27.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:26 smithi116 ceph-mon[34477]: pgmap v56: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:41:27.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:26 smithi116 ceph-mon[34477]: from='client.? 172.21.15.116:0/1706134472' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "97716304-a31e-48c9-83de-84eed10a7a4e"}]: dispatch 2024-09-19T04:41:27.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:26 smithi116 ceph-mon[34477]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "97716304-a31e-48c9-83de-84eed10a7a4e"}]: dispatch 2024-09-19T04:41:27.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:26 smithi116 ceph-mon[34477]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "97716304-a31e-48c9-83de-84eed10a7a4e"}]': finished 2024-09-19T04:41:27.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:26 smithi116 ceph-mon[34477]: osdmap e13: 3 total, 2 up, 3 in 2024-09-19T04:41:27.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:26 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:41:27.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:26 smithi116 ceph-mon[34477]: from='client.? 172.21.15.116:0/3816972519' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:41:27.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:26 smithi018 ceph-mon[34537]: pgmap v56: 0 pgs: ; 0 B data, 39 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:41:27.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:26 smithi018 ceph-mon[34537]: from='client.? 172.21.15.116:0/1706134472' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "97716304-a31e-48c9-83de-84eed10a7a4e"}]: dispatch 2024-09-19T04:41:27.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:26 smithi018 ceph-mon[34537]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "97716304-a31e-48c9-83de-84eed10a7a4e"}]: dispatch 2024-09-19T04:41:27.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:26 smithi018 ceph-mon[34537]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "97716304-a31e-48c9-83de-84eed10a7a4e"}]': finished 2024-09-19T04:41:27.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:26 smithi018 ceph-mon[34537]: osdmap e13: 3 total, 2 up, 3 in 2024-09-19T04:41:27.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:26 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:41:27.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:26 smithi018 ceph-mon[34537]: from='client.? 172.21.15.116:0/3816972519' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:41:29.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:28 smithi002 ceph-mon[30975]: pgmap v59: 0 pgs: ; 0 B data, 73 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:41:29.110 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:28 smithi116 ceph-mon[34477]: pgmap v59: 0 pgs: ; 0 B data, 73 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:41:29.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:28 smithi018 ceph-mon[34537]: pgmap v59: 0 pgs: ; 0 B data, 73 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:41:31.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:30 smithi002 ceph-mon[30975]: pgmap v60: 0 pgs: ; 0 B data, 73 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:41:31.110 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:30 smithi116 ceph-mon[34477]: pgmap v60: 0 pgs: ; 0 B data, 73 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:41:31.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:30 smithi018 ceph-mon[34537]: pgmap v60: 0 pgs: ; 0 B data, 73 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:41:33.042 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:32 smithi116 ceph-mon[34477]: pgmap v61: 0 pgs: ; 0 B data, 73 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:41:33.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:32 smithi002 ceph-mon[30975]: pgmap v61: 0 pgs: ; 0 B data, 73 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:41:33.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:32 smithi018 ceph-mon[34537]: pgmap v61: 0 pgs: ; 0 B data, 73 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:41:35.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:34 smithi002 ceph-mon[30975]: pgmap v62: 0 pgs: ; 0 B data, 73 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:41:35.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:34 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T04:41:35.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:34 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:41:35.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:34 smithi002 ceph-mon[30975]: Deploying daemon osd.2 on smithi116 2024-09-19T04:41:35.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:34 smithi116 ceph-mon[34477]: pgmap v62: 0 pgs: ; 0 B data, 73 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:41:35.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:34 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T04:41:35.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:34 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:41:35.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:34 smithi116 ceph-mon[34477]: Deploying daemon osd.2 on smithi116 2024-09-19T04:41:35.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:34 smithi018 ceph-mon[34537]: pgmap v62: 0 pgs: ; 0 B data, 73 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:41:35.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:34 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T04:41:35.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:34 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:41:35.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:34 smithi018 ceph-mon[34537]: Deploying daemon osd.2 on smithi116 2024-09-19T04:41:37.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:36 smithi002 ceph-mon[30975]: pgmap v63: 0 pgs: ; 0 B data, 73 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:41:37.110 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:36 smithi116 ceph-mon[34477]: pgmap v63: 0 pgs: ; 0 B data, 73 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:41:37.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:36 smithi018 ceph-mon[34537]: pgmap v63: 0 pgs: ; 0 B data, 73 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:41:39.072 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:38 smithi116 ceph-mon[34477]: pgmap v64: 0 pgs: ; 0 B data, 73 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:41:39.109 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:38 smithi002 ceph-mon[30975]: pgmap v64: 0 pgs: ; 0 B data, 73 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:41:39.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:38 smithi018 ceph-mon[34537]: pgmap v64: 0 pgs: ; 0 B data, 73 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:41:40.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:40 smithi116 ceph-mon[34477]: pgmap v65: 0 pgs: ; 0 B data, 73 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:41:40.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:40 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:41:40.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:40 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:40.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:40 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:41.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:40 smithi002 ceph-mon[30975]: pgmap v65: 0 pgs: ; 0 B data, 73 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:41:41.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:40 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:41:41.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:40 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:41.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:40 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:41.306 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:40 smithi018 ceph-mon[34537]: pgmap v65: 0 pgs: ; 0 B data, 73 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:41:41.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:40 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:41:41.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:40 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:41.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:40 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:43.110 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:42 smithi116 ceph-mon[34477]: pgmap v66: 0 pgs: ; 0 B data, 73 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:41:43.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:42 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:43.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:42 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:43.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:42 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:41:43.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:42 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:41:43.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:42 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:43.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:42 smithi018 ceph-mon[34537]: pgmap v66: 0 pgs: ; 0 B data, 73 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:41:43.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:42 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:43.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:42 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:43.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:42 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:41:43.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:42 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:41:43.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:42 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:43.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:42 smithi002 ceph-mon[30975]: pgmap v66: 0 pgs: ; 0 B data, 73 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:41:43.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:42 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:43.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:42 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:43.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:42 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:41:43.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:42 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:41:43.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:42 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:44.265 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:44.263+0000 7f48ff7fe640 1 -- 172.21.15.116:0/2760692135 <== mgr.14150 v2:172.21.15.2:6800/3171525177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4910062630 con 0x7f48f80a3260 2024-09-19T04:41:44.265 INFO:teuthology.orchestra.run.smithi116.stdout:Created osd(s) 2 on host 'smithi116' 2024-09-19T04:41:44.267 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:44.265+0000 7f4914d25640 1 -- 172.21.15.116:0/2760692135 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f48f80a3260 msgr2=0x7f48f80a5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:44.267 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:44.265+0000 7f4914d25640 1 --2- 172.21.15.116:0/2760692135 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f48f80a3260 0x7f48f80a5720 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4904006010 tx=0x7f4904000bc0 comp rx=0 tx=0).stop 2024-09-19T04:41:44.267 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:44.265+0000 7f4914d25640 1 -- 172.21.15.116:0/2760692135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4910105060 msgr2=0x7f4910198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:44.267 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:44.265+0000 7f4914d25640 1 --2- 172.21.15.116:0/2760692135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4910105060 0x7f4910198360 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f490000d770 tx=0x7f490000dc30 comp rx=0 tx=0).stop 2024-09-19T04:41:44.268 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:44.265+0000 7f4914d25640 1 -- 172.21.15.116:0/2760692135 shutdown_connections 2024-09-19T04:41:44.268 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:44.265+0000 7f4914d25640 1 --2- 172.21.15.116:0/2760692135 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f48f80a3260 0x7f48f80a5720 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:44.268 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:44.265+0000 7f4914d25640 1 --2- 172.21.15.116:0/2760692135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4910107990 0x7f491019f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:44.268 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:44.265+0000 7f4914d25640 1 --2- 172.21.15.116:0/2760692135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4910105060 0x7f4910198360 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:44.268 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:44.265+0000 7f4914d25640 1 --2- 172.21.15.116:0/2760692135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4910102730 0x7f4910197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:44.268 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:44.265+0000 7f4914d25640 1 -- 172.21.15.116:0/2760692135 >> 172.21.15.116:0/2760692135 conn(0x7f49100fc290 msgr2=0x7f49101031b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:44.268 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:44.266+0000 7f4914d25640 1 -- 172.21.15.116:0/2760692135 shutdown_connections 2024-09-19T04:41:44.268 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:41:44.266+0000 7f4914d25640 1 -- 172.21.15.116:0/2760692135 wait complete. 2024-09-19T04:41:44.878 DEBUG:teuthology.orchestra.run.smithi116:osd.2> sudo journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@osd.2.service 2024-09-19T04:41:44.880 INFO:tasks.cephadm:Deploying osd.3 on smithi002 with /dev/vg_nvme/lv_3... 2024-09-19T04:41:44.880 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T04:41:45.108 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:44 smithi116 ceph-mon[34477]: pgmap v67: 0 pgs: ; 0 B data, 73 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:41:45.108 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:44 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:41:45.108 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:44 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:45.109 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:44 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:45.133 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:41:45.254 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:44 smithi002 ceph-mon[30975]: pgmap v67: 0 pgs: ; 0 B data, 73 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:41:45.254 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:44 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:41:45.254 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:44 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:45.254 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:44 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:45.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:44 smithi018 ceph-mon[34537]: pgmap v67: 0 pgs: ; 0 B data, 73 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:41:45.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:44 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:41:45.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:44 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:45.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:44 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:46.611 INFO:journalctl@ceph.osd.2.smithi116.stdout:Sep 19 04:41:46 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-2[39479]: 2024-09-19T04:41:46.299+0000 7f7570d7c640 -1 osd.2 0 log_to_monitors true 2024-09-19T04:41:47.190 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:46 smithi116 ceph-mon[34477]: pgmap v68: 0 pgs: ; 0 B data, 73 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:41:47.191 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:46 smithi116 ceph-mon[34477]: from='osd.2 [v2:172.21.15.116:6800/627735759,v1:172.21.15.116:6801/627735759]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T04:41:47.191 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:46 smithi116 ceph-mon[34477]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T04:41:47.306 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:46 smithi018 ceph-mon[34537]: pgmap v68: 0 pgs: ; 0 B data, 73 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:41:47.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:46 smithi018 ceph-mon[34537]: from='osd.2 [v2:172.21.15.116:6800/627735759,v1:172.21.15.116:6801/627735759]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T04:41:47.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:46 smithi018 ceph-mon[34537]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T04:41:47.326 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:46 smithi002 ceph-mon[30975]: pgmap v68: 0 pgs: ; 0 B data, 73 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:41:47.326 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:46 smithi002 ceph-mon[30975]: from='osd.2 [v2:172.21.15.116:6800/627735759,v1:172.21.15.116:6801/627735759]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T04:41:47.326 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:46 smithi002 ceph-mon[30975]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T04:41:47.695 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:41:47.721 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi002:vg_nvme/lv_3 2024-09-19T04:41:47.983 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:41:48.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:47 smithi002 ceph-mon[30975]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T04:41:48.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:47 smithi002 ceph-mon[30975]: osdmap e14: 3 total, 2 up, 3 in 2024-09-19T04:41:48.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:47 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:41:48.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:47 smithi002 ceph-mon[30975]: from='osd.2 [v2:172.21.15.116:6800/627735759,v1:172.21.15.116:6801/627735759]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-19T04:41:48.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:47 smithi002 ceph-mon[30975]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-19T04:41:48.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:47 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:48.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:47 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:48.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:47 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:41:48.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:47 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:48.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:47 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:41:48.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:47 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:41:48.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:47 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:48.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:47 smithi018 ceph-mon[34537]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T04:41:48.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:47 smithi018 ceph-mon[34537]: osdmap e14: 3 total, 2 up, 3 in 2024-09-19T04:41:48.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:47 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:41:48.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:47 smithi018 ceph-mon[34537]: from='osd.2 [v2:172.21.15.116:6800/627735759,v1:172.21.15.116:6801/627735759]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-19T04:41:48.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:47 smithi018 ceph-mon[34537]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-19T04:41:48.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:47 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:48.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:47 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:48.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:47 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:41:48.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:47 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:48.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:47 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:41:48.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:47 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:41:48.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:47 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:48.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:47 smithi116 ceph-mon[34477]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T04:41:48.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:47 smithi116 ceph-mon[34477]: osdmap e14: 3 total, 2 up, 3 in 2024-09-19T04:41:48.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:47 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:41:48.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:47 smithi116 ceph-mon[34477]: from='osd.2 [v2:172.21.15.116:6800/627735759,v1:172.21.15.116:6801/627735759]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-19T04:41:48.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:47 smithi116 ceph-mon[34477]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-19T04:41:48.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:47 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:48.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:47 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:48.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:47 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:41:48.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:47 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:48.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:47 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:41:48.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:47 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:41:48.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:47 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:48.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:41:48.422+0000 7f09c2821640 1 -- 172.21.15.2:0/1128986038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09bc104fd0 msgr2=0x7f09bc1073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:48.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:41:48.422+0000 7f09c2821640 1 --2- 172.21.15.2:0/1128986038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09bc104fd0 0x7f09bc1073c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f09b0009900 tx=0x7f09b002a410 comp rx=0 tx=0).stop 2024-09-19T04:41:48.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:41:48.423+0000 7f09c2821640 1 -- 172.21.15.2:0/1128986038 shutdown_connections 2024-09-19T04:41:48.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:41:48.423+0000 7f09c2821640 1 --2- 172.21.15.2:0/1128986038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09bc107900 0x7f09bc109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:48.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:41:48.423+0000 7f09c2821640 1 --2- 172.21.15.2:0/1128986038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09bc104fd0 0x7f09bc1073c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:48.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:41:48.423+0000 7f09c2821640 1 --2- 172.21.15.2:0/1128986038 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f09bc1026a0 0x7f09bc104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:48.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:41:48.423+0000 7f09c2821640 1 -- 172.21.15.2:0/1128986038 >> 172.21.15.2:0/1128986038 conn(0x7f09bc0fc2a0 msgr2=0x7f09bc0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:48.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:41:48.423+0000 7f09c2821640 1 -- 172.21.15.2:0/1128986038 shutdown_connections 2024-09-19T04:41:48.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:41:48.423+0000 7f09c2821640 1 -- 172.21.15.2:0/1128986038 wait complete. 2024-09-19T04:41:48.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:41:48.423+0000 7f09c2821640 1 Processor -- start 2024-09-19T04:41:48.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:41:48.423+0000 7f09c2821640 1 -- start start 2024-09-19T04:41:48.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:41:48.424+0000 7f09c2821640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f09bc1026a0 0x7f09bc197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:48.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:41:48.424+0000 7f09c2821640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09bc104fd0 0x7f09bc1983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:48.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:41:48.424+0000 7f09c2821640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09bc107900 0x7f09bc19f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:48.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:41:48.424+0000 7f09c2821640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f09bc10d730 con 0x7f09bc107900 2024-09-19T04:41:48.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:41:48.424+0000 7f09c2821640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f09bc10d5b0 con 0x7f09bc104fd0 2024-09-19T04:41:48.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:41:48.424+0000 7f09c2821640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f09bc10d8b0 con 0x7f09bc1026a0 2024-09-19T04:41:48.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:41:48.424+0000 7f09c0dbe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09bc107900 0x7f09bc19f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:48.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:41:48.424+0000 7f09bbfff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f09bc1026a0 0x7f09bc197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:48.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:41:48.424+0000 7f09c0dbe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09bc107900 0x7f09bc19f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45752/0 (socket says 172.21.15.2:45752) 2024-09-19T04:41:48.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:41:48.424+0000 7f09c0dbe640 1 -- 172.21.15.2:0/373264536 learned_addr learned my addr 172.21.15.2:0/373264536 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:41:48.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:41:48.424+0000 7f09bb7fe640 1 --2- 172.21.15.2:0/373264536 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09bc104fd0 0x7f09bc1983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:48.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:41:48.424+0000 7f09c0dbe640 1 -- 172.21.15.2:0/373264536 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f09bc1026a0 msgr2=0x7f09bc197e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:48.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:41:48.424+0000 7f09c0dbe640 1 --2- 172.21.15.2:0/373264536 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f09bc1026a0 0x7f09bc197e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:48.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:41:48.424+0000 7f09c0dbe640 1 -- 172.21.15.2:0/373264536 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09bc104fd0 msgr2=0x7f09bc1983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:48.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:41:48.424+0000 7f09c0dbe640 1 --2- 172.21.15.2:0/373264536 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09bc104fd0 0x7f09bc1983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:48.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:41:48.424+0000 7f09c0dbe640 1 -- 172.21.15.2:0/373264536 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09bc19faa0 con 0x7f09bc107900 2024-09-19T04:41:48.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:41:48.424+0000 7f09c0dbe640 1 --2- 172.21.15.2:0/373264536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09bc107900 0x7f09bc19f430 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f09b400eaa0 tx=0x7f09b400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:48.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:41:48.424+0000 7f09b97fa640 1 -- 172.21.15.2:0/373264536 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b400cdb0 con 0x7f09bc107900 2024-09-19T04:41:48.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:41:48.425+0000 7f09c2821640 1 -- 172.21.15.2:0/373264536 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09bc19fd90 con 0x7f09bc107900 2024-09-19T04:41:48.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:41:48.425+0000 7f09b97fa640 1 -- 172.21.15.2:0/373264536 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f09b4005020 con 0x7f09bc107900 2024-09-19T04:41:48.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:41:48.425+0000 7f09b97fa640 1 -- 172.21.15.2:0/373264536 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b40116d0 con 0x7f09bc107900 2024-09-19T04:41:48.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:41:48.425+0000 7f09c2821640 1 -- 172.21.15.2:0/373264536 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09bc1a01f0 con 0x7f09bc107900 2024-09-19T04:41:48.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:41:48.426+0000 7f09c2821640 1 -- 172.21.15.2:0/373264536 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09bc0fdd90 con 0x7f09bc107900 2024-09-19T04:41:48.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:41:48.427+0000 7f09b97fa640 1 -- 172.21.15.2:0/373264536 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) ==== 138298+0+0 (secure 0 0 0) 0x7f09b40051d0 con 0x7f09bc107900 2024-09-19T04:41:48.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:41:48.427+0000 7f09b97fa640 1 --2- 172.21.15.2:0/373264536 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f09a40a3260 0x7f09a40a5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:48.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:41:48.428+0000 7f09bbfff640 1 --2- 172.21.15.2:0/373264536 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f09a40a3260 0x7f09a40a5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:48.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:41:48.428+0000 7f09b97fa640 1 -- 172.21.15.2:0/373264536 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2571+0+0 (secure 0 0 0) 0x7f09b40ce7b0 con 0x7f09bc107900 2024-09-19T04:41:48.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:41:48.428+0000 7f09bbfff640 1 --2- 172.21.15.2:0/373264536 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f09a40a3260 0x7f09a40a5720 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f09ac009bd0 tx=0x7f09ac005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:48.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:41:48.431+0000 7f09b97fa640 1 -- 172.21.15.2:0/373264536 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f09b4016030 con 0x7f09bc107900 2024-09-19T04:41:48.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:41:48.615+0000 7f09c2821640 1 -- 172.21.15.2:0/373264536 --> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f09bc062630 con 0x7f09a40a3260 2024-09-19T04:41:49.111 INFO:journalctl@ceph.osd.2.smithi116.stdout:Sep 19 04:41:48 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-2[39479]: 2024-09-19T04:41:48.680+0000 7f756c4dc640 -1 osd.2 0 waiting for initial osdmap 2024-09-19T04:41:49.111 INFO:journalctl@ceph.osd.2.smithi116.stdout:Sep 19 04:41:48 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-2[39479]: 2024-09-19T04:41:48.691+0000 7f7564b0e640 -1 osd.2 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T04:41:49.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:48 smithi116 ceph-mon[34477]: pgmap v70: 0 pgs: ; 0 B data, 73 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:41:49.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:48 smithi116 ceph-mon[34477]: Detected new or changed devices on smithi116 2024-09-19T04:41:49.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:48 smithi116 ceph-mon[34477]: Adjusting osd_memory_target on smithi116 to 17088M 2024-09-19T04:41:49.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:48 smithi116 ceph-mon[34477]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-09-19T04:41:49.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:48 smithi116 ceph-mon[34477]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T04:41:49.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:48 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:41:49.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:48 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:41:49.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:48 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:41:49.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:48 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:41:49.112 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:48 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:41:49.112 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:48 smithi116 ceph-mon[34477]: from='osd.2 ' entity='osd.2' 2024-09-19T04:41:49.231 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:48 smithi002 ceph-mon[30975]: pgmap v70: 0 pgs: ; 0 B data, 73 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:41:49.231 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:48 smithi002 ceph-mon[30975]: Detected new or changed devices on smithi116 2024-09-19T04:41:49.231 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:48 smithi002 ceph-mon[30975]: Adjusting osd_memory_target on smithi116 to 17088M 2024-09-19T04:41:49.232 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:48 smithi002 ceph-mon[30975]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-09-19T04:41:49.232 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:48 smithi002 ceph-mon[30975]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T04:41:49.232 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:48 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:41:49.232 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:48 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:41:49.232 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:48 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:41:49.232 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:48 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:41:49.232 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:48 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:41:49.232 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:48 smithi002 ceph-mon[30975]: from='osd.2 ' entity='osd.2' 2024-09-19T04:41:49.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:48 smithi018 ceph-mon[34537]: pgmap v70: 0 pgs: ; 0 B data, 73 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:41:49.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:48 smithi018 ceph-mon[34537]: Detected new or changed devices on smithi116 2024-09-19T04:41:49.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:48 smithi018 ceph-mon[34537]: Adjusting osd_memory_target on smithi116 to 17088M 2024-09-19T04:41:49.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:48 smithi018 ceph-mon[34537]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-09-19T04:41:49.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:48 smithi018 ceph-mon[34537]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T04:41:49.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:48 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:41:49.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:48 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:41:49.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:48 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:41:49.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:48 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:41:49.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:48 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:41:49.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:48 smithi018 ceph-mon[34537]: from='osd.2 ' entity='osd.2' 2024-09-19T04:41:50.068 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:49 smithi002 ceph-mon[30975]: purged_snaps scrub starts 2024-09-19T04:41:50.068 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:49 smithi002 ceph-mon[30975]: purged_snaps scrub ok 2024-09-19T04:41:50.068 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:49 smithi002 ceph-mon[30975]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:41:50.068 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:49 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:41:50.068 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:49 smithi002 ceph-mon[30975]: osd.2 [v2:172.21.15.116:6800/627735759,v1:172.21.15.116:6801/627735759] boot 2024-09-19T04:41:50.069 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:49 smithi002 ceph-mon[30975]: osdmap e16: 3 total, 3 up, 3 in 2024-09-19T04:41:50.069 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:49 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:41:50.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:49 smithi018 ceph-mon[34537]: purged_snaps scrub starts 2024-09-19T04:41:50.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:49 smithi018 ceph-mon[34537]: purged_snaps scrub ok 2024-09-19T04:41:50.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:49 smithi018 ceph-mon[34537]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:41:50.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:49 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:41:50.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:49 smithi018 ceph-mon[34537]: osd.2 [v2:172.21.15.116:6800/627735759,v1:172.21.15.116:6801/627735759] boot 2024-09-19T04:41:50.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:49 smithi018 ceph-mon[34537]: osdmap e16: 3 total, 3 up, 3 in 2024-09-19T04:41:50.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:49 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:41:50.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:49 smithi116 ceph-mon[34477]: purged_snaps scrub starts 2024-09-19T04:41:50.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:49 smithi116 ceph-mon[34477]: purged_snaps scrub ok 2024-09-19T04:41:50.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:49 smithi116 ceph-mon[34477]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:41:50.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:49 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:41:50.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:49 smithi116 ceph-mon[34477]: osd.2 [v2:172.21.15.116:6800/627735759,v1:172.21.15.116:6801/627735759] boot 2024-09-19T04:41:50.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:49 smithi116 ceph-mon[34477]: osdmap e16: 3 total, 3 up, 3 in 2024-09-19T04:41:50.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:49 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:41:51.228 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:50 smithi002 ceph-mon[30975]: pgmap v72: 0 pgs: ; 0 B data, 73 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:41:51.228 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:50 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/3058601841' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8d79514e-16cf-4bd0-a2eb-e9148b91183d"}]: dispatch 2024-09-19T04:41:51.228 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:50 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/3058601841' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8d79514e-16cf-4bd0-a2eb-e9148b91183d"}]': finished 2024-09-19T04:41:51.263 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:50 smithi116 ceph-mon[34477]: pgmap v72: 0 pgs: ; 0 B data, 73 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:41:51.263 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:50 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/3058601841' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8d79514e-16cf-4bd0-a2eb-e9148b91183d"}]: dispatch 2024-09-19T04:41:51.263 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:50 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/3058601841' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8d79514e-16cf-4bd0-a2eb-e9148b91183d"}]': finished 2024-09-19T04:41:51.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:50 smithi018 ceph-mon[34537]: pgmap v72: 0 pgs: ; 0 B data, 73 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:41:51.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:50 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/3058601841' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8d79514e-16cf-4bd0-a2eb-e9148b91183d"}]: dispatch 2024-09-19T04:41:51.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:50 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/3058601841' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8d79514e-16cf-4bd0-a2eb-e9148b91183d"}]': finished 2024-09-19T04:41:52.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:51 smithi018 ceph-mon[34537]: osdmap e17: 4 total, 3 up, 4 in 2024-09-19T04:41:52.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:51 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:41:52.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:51 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/2219420209' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:41:52.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:51 smithi002 ceph-mon[30975]: osdmap e17: 4 total, 3 up, 4 in 2024-09-19T04:41:52.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:51 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:41:52.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:51 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/2219420209' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:41:52.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:51 smithi116 ceph-mon[34477]: osdmap e17: 4 total, 3 up, 4 in 2024-09-19T04:41:52.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:51 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:41:52.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:51 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/2219420209' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:41:53.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:52 smithi018 ceph-mon[34537]: pgmap v75: 0 pgs: ; 0 B data, 104 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:41:53.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:52 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T04:41:53.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:52 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T04:41:53.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:52 smithi018 ceph-mon[34537]: osdmap e18: 4 total, 3 up, 4 in 2024-09-19T04:41:53.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:52 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:41:53.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:52 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T04:41:53.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:52 smithi002 ceph-mon[30975]: pgmap v75: 0 pgs: ; 0 B data, 104 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:41:53.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:52 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T04:41:53.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:52 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T04:41:53.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:52 smithi002 ceph-mon[30975]: osdmap e18: 4 total, 3 up, 4 in 2024-09-19T04:41:53.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:52 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:41:53.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:52 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T04:41:53.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:52 smithi116 ceph-mon[34477]: pgmap v75: 0 pgs: ; 0 B data, 104 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:41:53.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:52 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T04:41:53.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:52 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T04:41:53.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:52 smithi116 ceph-mon[34477]: osdmap e18: 4 total, 3 up, 4 in 2024-09-19T04:41:53.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:52 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:41:53.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:52 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T04:41:53.860 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 04:41:53 smithi002 sudo[50033]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T04:41:53.860 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 04:41:53 smithi002 sudo[50033]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T04:41:53.860 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 04:41:53 smithi002 sudo[50033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T04:41:53.860 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 04:41:53 smithi002 sudo[50033]: pam_unix(sudo:session): session closed for user root 2024-09-19T04:41:54.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:41:54.025+0000 7f09b97fa640 1 -- 172.21.15.2:0/373264536 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f09b4098af0 con 0x7f09bc107900 2024-09-19T04:41:54.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:54 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T04:41:54.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:54 smithi018 ceph-mon[34537]: osdmap e19: 4 total, 3 up, 4 in 2024-09-19T04:41:54.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:54 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:41:54.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:54 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T04:41:54.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:54 smithi002 ceph-mon[30975]: osdmap e19: 4 total, 3 up, 4 in 2024-09-19T04:41:54.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:54 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:41:54.360 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 04:41:54 smithi002 sudo[50227]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T04:41:54.360 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 04:41:54 smithi002 sudo[50227]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T04:41:54.360 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 04:41:54 smithi002 sudo[50227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T04:41:54.360 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 04:41:54 smithi002 sudo[50227]: pam_unix(sudo:session): session closed for user root 2024-09-19T04:41:54.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:54 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T04:41:54.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:54 smithi116 ceph-mon[34477]: osdmap e19: 4 total, 3 up, 4 in 2024-09-19T04:41:54.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:54 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:41:54.806 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 19 04:41:54 smithi018 sudo[42740]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T04:41:54.807 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 19 04:41:54 smithi018 sudo[42740]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T04:41:54.807 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 19 04:41:54 smithi018 sudo[42740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T04:41:54.807 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 19 04:41:54 smithi018 sudo[42740]: pam_unix(sudo:session): session closed for user root 2024-09-19T04:41:55.307 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 19 04:41:54 smithi018 sudo[42743]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T04:41:55.307 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 19 04:41:54 smithi018 sudo[42743]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T04:41:55.307 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 19 04:41:54 smithi018 sudo[42743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T04:41:55.307 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 19 04:41:54 smithi018 sudo[42743]: pam_unix(sudo:session): session closed for user root 2024-09-19T04:41:55.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:55 smithi018 ceph-mon[34537]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 104 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:41:55.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:55 smithi018 ceph-mon[34537]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T04:41:55.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:55 smithi018 ceph-mon[34537]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T04:41:55.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:55 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:41:55.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:55 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:55.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:55 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:55.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:55 smithi002 ceph-mon[30975]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 104 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:41:55.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:55 smithi002 ceph-mon[30975]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T04:41:55.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:55 smithi002 ceph-mon[30975]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T04:41:55.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:55 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:41:55.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:55 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:55.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:55 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:55.361 INFO:journalctl@ceph.osd.2.smithi116.stdout:Sep 19 04:41:55 smithi116 sudo[43110]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T04:41:55.361 INFO:journalctl@ceph.osd.2.smithi116.stdout:Sep 19 04:41:55 smithi116 sudo[43110]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T04:41:55.361 INFO:journalctl@ceph.osd.2.smithi116.stdout:Sep 19 04:41:55 smithi116 sudo[43110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T04:41:55.361 INFO:journalctl@ceph.osd.2.smithi116.stdout:Sep 19 04:41:55 smithi116 sudo[43110]: pam_unix(sudo:session): session closed for user root 2024-09-19T04:41:55.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:55 smithi116 ceph-mon[34477]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 104 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:41:55.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:55 smithi116 ceph-mon[34477]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T04:41:55.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:55 smithi116 ceph-mon[34477]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T04:41:55.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:55 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:41:55.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:55 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:55.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:55 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:55.860 INFO:journalctl@ceph.osd.2.smithi116.stdout:Sep 19 04:41:55 smithi116 sudo[43113]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T04:41:55.860 INFO:journalctl@ceph.osd.2.smithi116.stdout:Sep 19 04:41:55 smithi116 sudo[43113]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T04:41:55.861 INFO:journalctl@ceph.osd.2.smithi116.stdout:Sep 19 04:41:55 smithi116 sudo[43113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T04:41:55.861 INFO:journalctl@ceph.osd.2.smithi116.stdout:Sep 19 04:41:55 smithi116 sudo[43113]: pam_unix(sudo:session): session closed for user root 2024-09-19T04:41:55.957 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:55 smithi002 sudo[50883]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T04:41:55.957 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:55 smithi002 sudo[50883]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T04:41:55.957 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:55 smithi002 sudo[50883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T04:41:55.957 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:55 smithi002 sudo[50883]: pam_unix(sudo:session): session closed for user root 2024-09-19T04:41:56.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:56 smithi002 sudo[50906]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T04:41:56.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:56 smithi002 sudo[50906]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T04:41:56.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:56 smithi002 sudo[50906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T04:41:56.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:56 smithi002 sudo[50906]: pam_unix(sudo:session): session closed for user root 2024-09-19T04:41:56.899 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:56 smithi116 sudo[43116]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T04:41:56.899 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:56 smithi116 sudo[43116]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T04:41:56.899 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:56 smithi116 sudo[43116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T04:41:56.899 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:56 smithi116 sudo[43116]: pam_unix(sudo:session): session closed for user root 2024-09-19T04:41:57.184 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:56 smithi002 ceph-mon[30975]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 106 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:41:57.185 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:56 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:57.185 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:56 smithi002 ceph-mon[30975]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T04:41:57.185 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:56 smithi002 ceph-mon[30975]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T04:41:57.185 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:56 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:41:57.185 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:56 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:41:57.185 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:56 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:41:57.185 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:56 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:41:57.185 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:56 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:41:57.185 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:56 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:41:57.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:56 smithi018 ceph-mon[34537]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 106 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:41:57.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:56 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:57.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:56 smithi018 ceph-mon[34537]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T04:41:57.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:56 smithi018 ceph-mon[34537]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T04:41:57.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:56 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:41:57.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:56 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:41:57.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:56 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:41:57.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:56 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:41:57.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:56 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:41:57.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:56 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:41:57.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:56 smithi116 sudo[43119]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T04:41:57.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:56 smithi116 sudo[43119]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T04:41:57.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:56 smithi116 sudo[43119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T04:41:57.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:56 smithi116 sudo[43119]: pam_unix(sudo:session): session closed for user root 2024-09-19T04:41:57.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:56 smithi116 ceph-mon[34477]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 106 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:41:57.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:56 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:41:57.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:56 smithi116 ceph-mon[34477]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T04:41:57.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:56 smithi116 ceph-mon[34477]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T04:41:57.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:56 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:41:57.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:56 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:41:57.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:56 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:41:57.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:56 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:41:57.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:56 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:41:57.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:56 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:41:57.800 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:57 smithi018 sudo[42746]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T04:41:57.800 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:57 smithi018 sudo[42746]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T04:41:57.801 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:57 smithi018 sudo[42746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T04:41:57.801 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:57 smithi018 sudo[42746]: pam_unix(sudo:session): session closed for user root 2024-09-19T04:41:57.999 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:57 smithi002 ceph-mon[30975]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T04:41:57.999 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:57 smithi002 ceph-mon[30975]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T04:41:57.999 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:57 smithi002 ceph-mon[30975]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T04:41:57.999 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:57 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:41:57.999 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:57 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:41:58.000 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:57 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:41:58.000 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:57 smithi002 ceph-mon[30975]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T04:41:58.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:57 smithi018 sudo[42749]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T04:41:58.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:57 smithi018 sudo[42749]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T04:41:58.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:57 smithi018 sudo[42749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T04:41:58.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:57 smithi018 sudo[42749]: pam_unix(sudo:session): session closed for user root 2024-09-19T04:41:58.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:57 smithi018 ceph-mon[34537]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T04:41:58.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:57 smithi018 ceph-mon[34537]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T04:41:58.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:57 smithi018 ceph-mon[34537]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T04:41:58.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:57 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:41:58.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:57 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:41:58.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:57 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:41:58.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:57 smithi018 ceph-mon[34537]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T04:41:58.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:57 smithi116 ceph-mon[34477]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T04:41:58.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:57 smithi116 ceph-mon[34477]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T04:41:58.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:57 smithi116 ceph-mon[34477]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T04:41:58.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:57 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:41:58.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:57 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:41:58.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:57 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:41:58.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:57 smithi116 ceph-mon[34477]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T04:41:59.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:58 smithi002 ceph-mon[30975]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:41:59.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:58 smithi018 ceph-mon[34537]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:41:59.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:58 smithi116 ceph-mon[34477]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:42:00.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:59 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T04:42:00.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:59 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:42:00.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:41:59 smithi018 ceph-mon[34537]: Deploying daemon osd.3 on smithi002 2024-09-19T04:42:00.345 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:59 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T04:42:00.345 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:59 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:42:00.345 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:41:59 smithi002 ceph-mon[30975]: Deploying daemon osd.3 on smithi002 2024-09-19T04:42:00.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:59 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T04:42:00.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:59 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:42:00.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:41:59 smithi116 ceph-mon[34477]: Deploying daemon osd.3 on smithi002 2024-09-19T04:42:01.211 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:00 smithi002 ceph-mon[30975]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:42:01.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:00 smithi018 ceph-mon[34537]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:42:01.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:00 smithi116 ceph-mon[34477]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:42:03.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:02 smithi002 ceph-mon[30975]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2024-09-19T04:42:03.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:02 smithi018 ceph-mon[34537]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2024-09-19T04:42:03.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:02 smithi116 ceph-mon[34477]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2024-09-19T04:42:05.234 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:04 smithi002 ceph-mon[30975]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-19T04:42:05.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:04 smithi018 ceph-mon[34537]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-19T04:42:05.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:04 smithi116 ceph-mon[34477]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-19T04:42:06.266 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:05 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:42:06.267 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:05 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:06.267 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:05 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:06.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:05 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:42:06.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:05 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:06.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:05 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:06.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:05 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:42:06.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:05 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:06.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:05 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:07.240 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:06 smithi002 ceph-mon[30975]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-19T04:42:07.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:06 smithi018 ceph-mon[34537]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-19T04:42:07.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:06 smithi116 ceph-mon[34477]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-19T04:42:09.347 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:09 smithi002 ceph-mon[30975]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-19T04:42:09.347 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:09 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:09.347 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:09 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:09.347 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:09 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:42:09.347 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:09 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:42:09.347 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:09 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:09.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:09 smithi116 ceph-mon[34477]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-19T04:42:09.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:09 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:09.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:09 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:09.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:09 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:42:09.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:09 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:42:09.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:09 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:09.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:42:09.384+0000 7f09b97fa640 1 -- 172.21.15.2:0/373264536 <== mgr.14150 v2:172.21.15.2:6800/3171525177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f09bc062630 con 0x7f09a40a3260 2024-09-19T04:42:09.385 INFO:teuthology.orchestra.run.smithi002.stdout:Created osd(s) 3 on host 'smithi002' 2024-09-19T04:42:09.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:42:09.386+0000 7f09c2821640 1 -- 172.21.15.2:0/373264536 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f09a40a3260 msgr2=0x7f09a40a5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:42:09.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:42:09.386+0000 7f09c2821640 1 --2- 172.21.15.2:0/373264536 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f09a40a3260 0x7f09a40a5720 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f09ac009bd0 tx=0x7f09ac005f90 comp rx=0 tx=0).stop 2024-09-19T04:42:09.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:42:09.387+0000 7f09c2821640 1 -- 172.21.15.2:0/373264536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09bc107900 msgr2=0x7f09bc19f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:42:09.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:42:09.387+0000 7f09c2821640 1 --2- 172.21.15.2:0/373264536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09bc107900 0x7f09bc19f430 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f09b400eaa0 tx=0x7f09b400ef60 comp rx=0 tx=0).stop 2024-09-19T04:42:09.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:42:09.387+0000 7f09c2821640 1 -- 172.21.15.2:0/373264536 shutdown_connections 2024-09-19T04:42:09.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:42:09.387+0000 7f09c2821640 1 --2- 172.21.15.2:0/373264536 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f09a40a3260 0x7f09a40a5720 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:42:09.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:42:09.387+0000 7f09c2821640 1 --2- 172.21.15.2:0/373264536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09bc107900 0x7f09bc19f430 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:42:09.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:42:09.387+0000 7f09c2821640 1 --2- 172.21.15.2:0/373264536 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09bc104fd0 0x7f09bc1983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:42:09.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:42:09.387+0000 7f09c2821640 1 --2- 172.21.15.2:0/373264536 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f09bc1026a0 0x7f09bc197e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:42:09.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:42:09.387+0000 7f09c2821640 1 -- 172.21.15.2:0/373264536 >> 172.21.15.2:0/373264536 conn(0x7f09bc0fc2a0 msgr2=0x7f09bc102f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:42:09.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:42:09.387+0000 7f09c2821640 1 -- 172.21.15.2:0/373264536 shutdown_connections 2024-09-19T04:42:09.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:42:09.387+0000 7f09c2821640 1 -- 172.21.15.2:0/373264536 wait complete. 2024-09-19T04:42:09.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:09 smithi018 ceph-mon[34537]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-19T04:42:09.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:09 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:09.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:09 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:09.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:09 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:42:09.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:09 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:42:09.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:09 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:10.064 DEBUG:teuthology.orchestra.run.smithi002:osd.3> sudo journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@osd.3.service 2024-09-19T04:42:10.067 INFO:tasks.cephadm:Deploying osd.4 on smithi018 with /dev/vg_nvme/lv_3... 2024-09-19T04:42:10.067 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T04:42:10.318 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:10 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:42:10.319 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:10 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:10.319 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:10 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:10.333 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T04:42:10.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:10 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:42:10.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:10 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:10.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:10 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:10.454 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:10 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:42:10.455 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:10 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:10.455 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:10 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:11.519 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:11 smithi018 ceph-mon[34537]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T04:42:11.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:11 smithi002 ceph-mon[30975]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T04:42:11.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:11 smithi116 ceph-mon[34477]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T04:42:12.110 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 19 04:42:11 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-3[51640]: 2024-09-19T04:42:11.818+0000 7f6eb235a640 -1 osd.3 0 log_to_monitors true 2024-09-19T04:42:12.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:12 smithi002 ceph-mon[30975]: from='osd.3 [v2:172.21.15.2:6810/1936071687,v1:172.21.15.2:6811/1936071687]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T04:42:12.792 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:12 smithi018 ceph-mon[34537]: from='osd.3 [v2:172.21.15.2:6810/1936071687,v1:172.21.15.2:6811/1936071687]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T04:42:12.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:12 smithi116 ceph-mon[34477]: from='osd.3 [v2:172.21.15.2:6810/1936071687,v1:172.21.15.2:6811/1936071687]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T04:42:13.146 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T04:42:13.173 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi018:vg_nvme/lv_3 2024-09-19T04:42:13.430 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T04:42:13.653 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:13 smithi018 ceph-mon[34537]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T04:42:13.654 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:13 smithi018 ceph-mon[34537]: from='osd.3 [v2:172.21.15.2:6810/1936071687,v1:172.21.15.2:6811/1936071687]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T04:42:13.654 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:13 smithi018 ceph-mon[34537]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T04:42:13.654 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:13 smithi018 ceph-mon[34537]: from='osd.3 [v2:172.21.15.2:6810/1936071687,v1:172.21.15.2:6811/1936071687]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-19T04:42:13.654 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:13 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:42:13.654 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:13 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:13.654 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:13 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:13.654 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:13 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:42:13.654 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:13 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:42:13.654 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:13 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:13.654 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:13 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:42:13.654 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:13 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:42:13.655 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:13 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:13.762 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:13 smithi116 ceph-mon[34477]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T04:42:13.762 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:13 smithi116 ceph-mon[34477]: from='osd.3 [v2:172.21.15.2:6810/1936071687,v1:172.21.15.2:6811/1936071687]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T04:42:13.762 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:13 smithi116 ceph-mon[34477]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T04:42:13.762 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:13 smithi116 ceph-mon[34477]: from='osd.3 [v2:172.21.15.2:6810/1936071687,v1:172.21.15.2:6811/1936071687]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-19T04:42:13.762 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:13 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:42:13.762 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:13 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:13.763 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:13 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:13.763 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:13 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:42:13.763 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:13 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:42:13.763 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:13 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:13.763 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:13 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:42:13.763 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:13 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:42:13.763 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:13 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:13.860 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 19 04:42:13 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-3[51640]: 2024-09-19T04:42:13.397+0000 7f6eadaba640 -1 osd.3 0 waiting for initial osdmap 2024-09-19T04:42:13.860 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 19 04:42:13 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-3[51640]: 2024-09-19T04:42:13.403+0000 7f6eaa0f4640 -1 osd.3 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T04:42:13.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:13 smithi002 ceph-mon[30975]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T04:42:13.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:13 smithi002 ceph-mon[30975]: from='osd.3 [v2:172.21.15.2:6810/1936071687,v1:172.21.15.2:6811/1936071687]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T04:42:13.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:13 smithi002 ceph-mon[30975]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T04:42:13.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:13 smithi002 ceph-mon[30975]: from='osd.3 [v2:172.21.15.2:6810/1936071687,v1:172.21.15.2:6811/1936071687]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-19T04:42:13.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:13 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:42:13.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:13 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:13.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:13 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:13.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:13 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:42:13.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:13 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:42:13.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:13 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:13.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:13 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:42:13.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:13 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:42:13.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:13 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:13.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:13.864+0000 7f9e35188640 1 -- 172.21.15.18:0/2245043087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e30102690 msgr2=0x7f9e30108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:42:13.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:13.864+0000 7f9e35188640 1 --2- 172.21.15.18:0/2245043087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e30102690 0x7f9e30108f20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9e28009ca0 tx=0x7f9e2802a8c0 comp rx=0 tx=0).stop 2024-09-19T04:42:13.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:13.864+0000 7f9e35188640 1 -- 172.21.15.18:0/2245043087 shutdown_connections 2024-09-19T04:42:13.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:13.864+0000 7f9e35188640 1 --2- 172.21.15.18:0/2245043087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e30102690 0x7f9e30108f20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:42:13.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:13.864+0000 7f9e35188640 1 --2- 172.21.15.18:0/2245043087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e30101cd0 0x7f9e30102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:42:13.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:13.864+0000 7f9e35188640 1 --2- 172.21.15.18:0/2245043087 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e30100ad0 0x7f9e30100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:42:13.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:13.864+0000 7f9e35188640 1 -- 172.21.15.18:0/2245043087 >> 172.21.15.18:0/2245043087 conn(0x7f9e300fc280 msgr2=0x7f9e300fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:42:13.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:13.864+0000 7f9e35188640 1 -- 172.21.15.18:0/2245043087 shutdown_connections 2024-09-19T04:42:13.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:13.864+0000 7f9e35188640 1 -- 172.21.15.18:0/2245043087 wait complete. 2024-09-19T04:42:13.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:13.864+0000 7f9e35188640 1 Processor -- start 2024-09-19T04:42:13.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:13.865+0000 7f9e35188640 1 -- start start 2024-09-19T04:42:13.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:13.865+0000 7f9e35188640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e30100ad0 0x7f9e30196ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:42:13.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:13.865+0000 7f9e35188640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e30101cd0 0x7f9e30197220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:42:13.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:13.865+0000 7f9e35188640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e30102690 0x7f9e3019e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:42:13.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:13.865+0000 7f9e35188640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9e3010c600 con 0x7f9e30101cd0 2024-09-19T04:42:13.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:13.865+0000 7f9e35188640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9e3010c480 con 0x7f9e30102690 2024-09-19T04:42:13.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:13.865+0000 7f9e35188640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f9e3010c780 con 0x7f9e30100ad0 2024-09-19T04:42:13.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:13.865+0000 7f9e2f59e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e30102690 0x7f9e3019e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:42:13.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:13.865+0000 7f9e2f59e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e30102690 0x7f9e3019e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43164/0 (socket says 172.21.15.18:43164) 2024-09-19T04:42:13.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:13.865+0000 7f9e2f59e640 1 -- 172.21.15.18:0/1204169422 learned_addr learned my addr 172.21.15.18:0/1204169422 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T04:42:13.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:13.865+0000 7f9e2ed9d640 1 --2- 172.21.15.18:0/1204169422 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e30100ad0 0x7f9e30196ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:42:13.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:13.865+0000 7f9e2e59c640 1 --2- 172.21.15.18:0/1204169422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e30101cd0 0x7f9e30197220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:42:13.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:13.865+0000 7f9e2f59e640 1 -- 172.21.15.18:0/1204169422 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e30100ad0 msgr2=0x7f9e30196ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:42:13.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:13.865+0000 7f9e2f59e640 1 --2- 172.21.15.18:0/1204169422 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e30100ad0 0x7f9e30196ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:42:13.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:13.865+0000 7f9e2f59e640 1 -- 172.21.15.18:0/1204169422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e30101cd0 msgr2=0x7f9e30197220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:42:13.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:13.865+0000 7f9e2f59e640 1 --2- 172.21.15.18:0/1204169422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e30101cd0 0x7f9e30197220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:42:13.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:13.865+0000 7f9e2f59e640 1 -- 172.21.15.18:0/1204169422 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e3019e900 con 0x7f9e30102690 2024-09-19T04:42:13.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:13.866+0000 7f9e2f59e640 1 --2- 172.21.15.18:0/1204169422 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e30102690 0x7f9e3019e260 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9e28009dc0 tx=0x7f9e28003ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:42:13.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:13.866+0000 7f9e17fff640 1 -- 172.21.15.18:0/1204169422 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e28032ec0 con 0x7f9e30102690 2024-09-19T04:42:13.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:13.866+0000 7f9e17fff640 1 -- 172.21.15.18:0/1204169422 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9e280044f0 con 0x7f9e30102690 2024-09-19T04:42:13.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:13.866+0000 7f9e17fff640 1 -- 172.21.15.18:0/1204169422 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e28030d40 con 0x7f9e30102690 2024-09-19T04:42:13.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:13.866+0000 7f9e35188640 1 -- 172.21.15.18:0/1204169422 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e3019eb90 con 0x7f9e30102690 2024-09-19T04:42:13.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:13.866+0000 7f9e35188640 1 -- 172.21.15.18:0/1204169422 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e3019f080 con 0x7f9e30102690 2024-09-19T04:42:13.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:13.867+0000 7f9e35188640 1 -- 172.21.15.18:0/1204169422 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e30107f70 con 0x7f9e30102690 2024-09-19T04:42:13.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:13.868+0000 7f9e17fff640 1 -- 172.21.15.18:0/1204169422 <== mon.2 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f9e28004040 con 0x7f9e30102690 2024-09-19T04:42:13.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:13.869+0000 7f9e17fff640 1 --2- 172.21.15.18:0/1204169422 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f9e180a33e0 0x7f9e180a58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:42:13.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:13.869+0000 7f9e17fff640 1 -- 172.21.15.18:0/1204169422 <== mon.2 v2:172.21.15.18:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 3389+0+0 (secure 0 0 0) 0x7f9e280efbf0 con 0x7f9e30102690 2024-09-19T04:42:13.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:13.869+0000 7f9e2ed9d640 1 --2- 172.21.15.18:0/1204169422 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f9e180a33e0 0x7f9e180a58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:42:13.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:13.870+0000 7f9e2ed9d640 1 --2- 172.21.15.18:0/1204169422 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f9e180a33e0 0x7f9e180a58a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9e301981c0 tx=0x7f9e2000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:42:13.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:13.873+0000 7f9e17fff640 1 -- 172.21.15.18:0/1204169422 <== mon.2 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9e280bdc50 con 0x7f9e30102690 2024-09-19T04:42:14.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:14.060+0000 7f9e35188640 1 -- 172.21.15.18:0/1204169422 --> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f9e30062630 con 0x7f9e180a33e0 2024-09-19T04:42:14.683 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:14 smithi018 ceph-mon[34537]: Detected new or changed devices on smithi002 2024-09-19T04:42:14.683 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:14 smithi018 ceph-mon[34537]: Adjusting osd_memory_target on smithi002 to 8546M 2024-09-19T04:42:14.683 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:14 smithi018 ceph-mon[34537]: from='osd.3 [v2:172.21.15.2:6810/1936071687,v1:172.21.15.2:6811/1936071687]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-19T04:42:14.684 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:14 smithi018 ceph-mon[34537]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T04:42:14.684 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:14 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:42:14.684 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:14 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:42:14.684 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:14 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:42:14.684 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:14 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:42:14.684 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:14 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:42:14.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:14 smithi002 ceph-mon[30975]: Detected new or changed devices on smithi002 2024-09-19T04:42:14.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:14 smithi002 ceph-mon[30975]: Adjusting osd_memory_target on smithi002 to 8546M 2024-09-19T04:42:14.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:14 smithi002 ceph-mon[30975]: from='osd.3 [v2:172.21.15.2:6810/1936071687,v1:172.21.15.2:6811/1936071687]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-19T04:42:14.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:14 smithi002 ceph-mon[30975]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T04:42:14.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:14 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:42:14.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:14 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:42:14.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:14 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:42:14.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:14 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:42:14.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:14 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:42:14.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:14 smithi116 ceph-mon[34477]: Detected new or changed devices on smithi002 2024-09-19T04:42:14.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:14 smithi116 ceph-mon[34477]: Adjusting osd_memory_target on smithi002 to 8546M 2024-09-19T04:42:14.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:14 smithi116 ceph-mon[34477]: from='osd.3 [v2:172.21.15.2:6810/1936071687,v1:172.21.15.2:6811/1936071687]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-19T04:42:14.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:14 smithi116 ceph-mon[34477]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T04:42:14.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:14 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:42:14.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:14 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:42:14.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:14 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:42:14.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:14 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:42:14.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:14 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:42:15.655 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:15 smithi018 ceph-mon[34537]: purged_snaps scrub starts 2024-09-19T04:42:15.656 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:15 smithi018 ceph-mon[34537]: purged_snaps scrub ok 2024-09-19T04:42:15.656 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:15 smithi018 ceph-mon[34537]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:42:15.656 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:15 smithi018 ceph-mon[34537]: from='client.24212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:42:15.656 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:15 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:42:15.656 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:15 smithi018 ceph-mon[34537]: osd.3 [v2:172.21.15.2:6810/1936071687,v1:172.21.15.2:6811/1936071687] boot 2024-09-19T04:42:15.656 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:15 smithi018 ceph-mon[34537]: osdmap e23: 4 total, 4 up, 4 in 2024-09-19T04:42:15.656 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:15 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:42:15.656 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:15 smithi018 ceph-mon[34537]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T04:42:15.668 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:15 smithi002 ceph-mon[30975]: purged_snaps scrub starts 2024-09-19T04:42:15.668 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:15 smithi002 ceph-mon[30975]: purged_snaps scrub ok 2024-09-19T04:42:15.668 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:15 smithi002 ceph-mon[30975]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:42:15.668 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:15 smithi002 ceph-mon[30975]: from='client.24212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:42:15.668 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:15 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:42:15.668 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:15 smithi002 ceph-mon[30975]: osd.3 [v2:172.21.15.2:6810/1936071687,v1:172.21.15.2:6811/1936071687] boot 2024-09-19T04:42:15.669 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:15 smithi002 ceph-mon[30975]: osdmap e23: 4 total, 4 up, 4 in 2024-09-19T04:42:15.669 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:15 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:42:15.669 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:15 smithi002 ceph-mon[30975]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T04:42:15.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:15 smithi116 ceph-mon[34477]: purged_snaps scrub starts 2024-09-19T04:42:15.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:15 smithi116 ceph-mon[34477]: purged_snaps scrub ok 2024-09-19T04:42:15.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:15 smithi116 ceph-mon[34477]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:42:15.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:15 smithi116 ceph-mon[34477]: from='client.24212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:42:15.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:15 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:42:15.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:15 smithi116 ceph-mon[34477]: osd.3 [v2:172.21.15.2:6810/1936071687,v1:172.21.15.2:6811/1936071687] boot 2024-09-19T04:42:15.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:15 smithi116 ceph-mon[34477]: osdmap e23: 4 total, 4 up, 4 in 2024-09-19T04:42:15.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:15 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:42:15.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:15 smithi116 ceph-mon[34477]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T04:42:17.022 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:16 smithi018 ceph-mon[34537]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:42:17.022 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:16 smithi018 ceph-mon[34537]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T04:42:17.023 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:16 smithi018 ceph-mon[34537]: from='client.? 172.21.15.18:0/478728992' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5136f03c-94a3-42a0-9bfc-020397836037"}]: dispatch 2024-09-19T04:42:17.023 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:16 smithi018 ceph-mon[34537]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5136f03c-94a3-42a0-9bfc-020397836037"}]: dispatch 2024-09-19T04:42:17.023 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:16 smithi018 ceph-mon[34537]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5136f03c-94a3-42a0-9bfc-020397836037"}]': finished 2024-09-19T04:42:17.023 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:16 smithi018 ceph-mon[34537]: osdmap e26: 5 total, 4 up, 5 in 2024-09-19T04:42:17.023 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:16 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:42:17.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:16 smithi002 ceph-mon[30975]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:42:17.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:16 smithi002 ceph-mon[30975]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T04:42:17.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:16 smithi002 ceph-mon[30975]: from='client.? 172.21.15.18:0/478728992' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5136f03c-94a3-42a0-9bfc-020397836037"}]: dispatch 2024-09-19T04:42:17.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:16 smithi002 ceph-mon[30975]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5136f03c-94a3-42a0-9bfc-020397836037"}]: dispatch 2024-09-19T04:42:17.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:16 smithi002 ceph-mon[30975]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5136f03c-94a3-42a0-9bfc-020397836037"}]': finished 2024-09-19T04:42:17.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:16 smithi002 ceph-mon[30975]: osdmap e26: 5 total, 4 up, 5 in 2024-09-19T04:42:17.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:16 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:42:17.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:16 smithi116 ceph-mon[34477]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:42:17.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:16 smithi116 ceph-mon[34477]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T04:42:17.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:16 smithi116 ceph-mon[34477]: from='client.? 172.21.15.18:0/478728992' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5136f03c-94a3-42a0-9bfc-020397836037"}]: dispatch 2024-09-19T04:42:17.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:16 smithi116 ceph-mon[34477]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5136f03c-94a3-42a0-9bfc-020397836037"}]: dispatch 2024-09-19T04:42:17.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:16 smithi116 ceph-mon[34477]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5136f03c-94a3-42a0-9bfc-020397836037"}]': finished 2024-09-19T04:42:17.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:16 smithi116 ceph-mon[34477]: osdmap e26: 5 total, 4 up, 5 in 2024-09-19T04:42:17.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:16 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:42:18.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:17 smithi018 ceph-mon[34537]: from='client.? 172.21.15.18:0/2475177364' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:42:18.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:17 smithi018 ceph-mon[34537]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T04:42:18.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:17 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:42:18.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:17 smithi002 ceph-mon[30975]: from='client.? 172.21.15.18:0/2475177364' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:42:18.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:17 smithi002 ceph-mon[30975]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T04:42:18.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:17 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:42:18.110 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:17 smithi116 ceph-mon[34477]: from='client.? 172.21.15.18:0/2475177364' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:42:18.110 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:17 smithi116 ceph-mon[34477]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T04:42:18.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:17 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:42:19.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:19 smithi018 ceph-mon[34537]: pgmap v98: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail; 187 KiB/s, 0 objects/s recovering 2024-09-19T04:42:19.859 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:19 smithi002 ceph-mon[30975]: pgmap v98: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail; 187 KiB/s, 0 objects/s recovering 2024-09-19T04:42:19.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:19 smithi116 ceph-mon[34477]: pgmap v98: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail; 187 KiB/s, 0 objects/s recovering 2024-09-19T04:42:21.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:21 smithi018 ceph-mon[34537]: pgmap v99: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail; 120 KiB/s, 0 objects/s recovering 2024-09-19T04:42:21.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:21 smithi002 ceph-mon[30975]: pgmap v99: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail; 120 KiB/s, 0 objects/s recovering 2024-09-19T04:42:21.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:21 smithi116 ceph-mon[34477]: pgmap v99: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail; 120 KiB/s, 0 objects/s recovering 2024-09-19T04:42:23.718 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:23 smithi018 ceph-mon[34537]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T04:42:23.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:23 smithi002 ceph-mon[30975]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T04:42:23.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:23 smithi116 ceph-mon[34477]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T04:42:25.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:25 smithi018 ceph-mon[34537]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-19T04:42:25.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:25 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T04:42:25.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:25 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:42:25.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:25 smithi002 ceph-mon[30975]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-19T04:42:25.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:25 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T04:42:25.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:25 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:42:25.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:25 smithi116 ceph-mon[34477]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-19T04:42:25.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:25 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T04:42:25.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:25 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:42:26.519 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:26 smithi018 ceph-mon[34537]: Deploying daemon osd.4 on smithi018 2024-09-19T04:42:26.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:26 smithi002 ceph-mon[30975]: Deploying daemon osd.4 on smithi018 2024-09-19T04:42:26.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:26 smithi116 ceph-mon[34477]: Deploying daemon osd.4 on smithi018 2024-09-19T04:42:27.744 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:27 smithi018 ceph-mon[34537]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:42:27.859 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:27 smithi002 ceph-mon[30975]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:42:27.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:27 smithi116 ceph-mon[34477]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:42:29.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:29 smithi018 ceph-mon[34537]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:42:29.859 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:29 smithi002 ceph-mon[30975]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:42:29.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:29 smithi116 ceph-mon[34477]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:42:31.688 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:31 smithi018 ceph-mon[34537]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:42:31.688 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:31 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:42:31.688 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:31 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:31.689 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:31 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:31.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:31 smithi002 ceph-mon[30975]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:42:31.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:31 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:42:31.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:31 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:31.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:31 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:31.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:31 smithi116 ceph-mon[34477]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:42:31.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:31 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:42:31.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:31 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:31.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:31 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:33.744 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:33 smithi018 ceph-mon[34537]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:42:33.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:33 smithi002 ceph-mon[30975]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:42:33.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:33 smithi116 ceph-mon[34477]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:42:35.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:34 smithi018 ceph-mon[34537]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:42:35.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:34 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:35.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:34 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:35.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:34 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:42:35.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:34 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:42:35.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:34 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:35.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:35.164+0000 7f9e17fff640 1 -- 172.21.15.18:0/1204169422 <== mgr.14150 v2:172.21.15.2:6800/3171525177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9e30062630 con 0x7f9e180a33e0 2024-09-19T04:42:35.166 INFO:teuthology.orchestra.run.smithi018.stdout:Created osd(s) 4 on host 'smithi018' 2024-09-19T04:42:35.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:35.167+0000 7f9e35188640 1 -- 172.21.15.18:0/1204169422 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f9e180a33e0 msgr2=0x7f9e180a58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:42:35.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:35.167+0000 7f9e35188640 1 --2- 172.21.15.18:0/1204169422 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f9e180a33e0 0x7f9e180a58a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9e301981c0 tx=0x7f9e2000b390 comp rx=0 tx=0).stop 2024-09-19T04:42:35.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:35.167+0000 7f9e35188640 1 -- 172.21.15.18:0/1204169422 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e30102690 msgr2=0x7f9e3019e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:42:35.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:35.167+0000 7f9e35188640 1 --2- 172.21.15.18:0/1204169422 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e30102690 0x7f9e3019e260 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9e28009dc0 tx=0x7f9e28003ba0 comp rx=0 tx=0).stop 2024-09-19T04:42:35.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:35.167+0000 7f9e35188640 1 -- 172.21.15.18:0/1204169422 shutdown_connections 2024-09-19T04:42:35.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:35.167+0000 7f9e35188640 1 --2- 172.21.15.18:0/1204169422 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f9e180a33e0 0x7f9e180a58a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:42:35.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:35.167+0000 7f9e35188640 1 --2- 172.21.15.18:0/1204169422 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e30102690 0x7f9e3019e260 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:42:35.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:35.167+0000 7f9e35188640 1 --2- 172.21.15.18:0/1204169422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e30101cd0 0x7f9e30197220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:42:35.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:35.167+0000 7f9e35188640 1 --2- 172.21.15.18:0/1204169422 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e30100ad0 0x7f9e30196ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:42:35.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:35.167+0000 7f9e35188640 1 -- 172.21.15.18:0/1204169422 >> 172.21.15.18:0/1204169422 conn(0x7f9e300fc280 msgr2=0x7f9e30105140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:42:35.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:35.167+0000 7f9e35188640 1 -- 172.21.15.18:0/1204169422 shutdown_connections 2024-09-19T04:42:35.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:42:35.167+0000 7f9e35188640 1 -- 172.21.15.18:0/1204169422 wait complete. 2024-09-19T04:42:35.229 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:34 smithi002 ceph-mon[30975]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:42:35.229 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:34 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:35.229 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:34 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:35.229 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:34 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:42:35.230 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:34 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:42:35.230 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:34 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:35.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:34 smithi116 ceph-mon[34477]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:42:35.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:34 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:35.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:34 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:35.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:34 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:42:35.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:34 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:42:35.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:34 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:35.857 DEBUG:teuthology.orchestra.run.smithi018:osd.4> sudo journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@osd.4.service 2024-09-19T04:42:35.860 INFO:tasks.cephadm:Deploying osd.5 on smithi116 with /dev/vg_nvme/lv_3... 2024-09-19T04:42:35.860 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T04:42:36.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:35 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:42:36.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:35 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:36.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:35 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:36.113 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T04:42:36.233 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:35 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:42:36.233 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:35 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:36.234 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:35 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:36.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:35 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:42:36.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:35 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:36.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:35 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:37.341 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:37 smithi116 ceph-mon[34477]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:42:37.376 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:37 smithi018 ceph-mon[34537]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:42:37.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:37 smithi002 ceph-mon[30975]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:42:37.807 INFO:journalctl@ceph.osd.4.smithi018.stdout:Sep 19 04:42:37 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-4[45488]: 2024-09-19T04:42:37.447+0000 7f664fcf4640 -1 osd.4 0 log_to_monitors true 2024-09-19T04:42:38.378 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-19T04:42:38.404 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi116:vg_nvme/lv_3 2024-09-19T04:42:38.428 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:38 smithi116 ceph-mon[34477]: from='osd.4 [v2:172.21.15.18:6808/1333533784,v1:172.21.15.18:6809/1333533784]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T04:42:38.428 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:38 smithi116 ceph-mon[34477]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T04:42:38.431 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:38 smithi018 ceph-mon[34537]: from='osd.4 [v2:172.21.15.18:6808/1333533784,v1:172.21.15.18:6809/1333533784]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T04:42:38.431 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:38 smithi018 ceph-mon[34537]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T04:42:38.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:38 smithi002 ceph-mon[30975]: from='osd.4 [v2:172.21.15.18:6808/1333533784,v1:172.21.15.18:6809/1333533784]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T04:42:38.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:38 smithi002 ceph-mon[30975]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T04:42:38.654 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T04:42:39.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:39.096+0000 7fc9b09a3640 1 -- 172.21.15.116:0/1458022810 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9ac101790 msgr2=0x7fc9ac101c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:42:39.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:39.096+0000 7fc9b09a3640 1 --2- 172.21.15.116:0/1458022810 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9ac101790 0x7fc9ac101c40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4009ca0 tx=0x7fc9a402a8c0 comp rx=0 tx=0).stop 2024-09-19T04:42:39.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:39.096+0000 7fc9b09a3640 1 -- 172.21.15.116:0/1458022810 shutdown_connections 2024-09-19T04:42:39.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:39.096+0000 7fc9b09a3640 1 --2- 172.21.15.116:0/1458022810 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9ac101790 0x7fc9ac101c40 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:42:39.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:39.096+0000 7fc9b09a3640 1 --2- 172.21.15.116:0/1458022810 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9ac100df0 0x7fc9ac101250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:42:39.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:39.096+0000 7fc9b09a3640 1 --2- 172.21.15.116:0/1458022810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9ac1004b0 0x7fc9ac1008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:42:39.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:39.096+0000 7fc9b09a3640 1 -- 172.21.15.116:0/1458022810 >> 172.21.15.116:0/1458022810 conn(0x7fc9ac0fc280 msgr2=0x7fc9ac0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:42:39.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:39.096+0000 7fc9b09a3640 1 -- 172.21.15.116:0/1458022810 shutdown_connections 2024-09-19T04:42:39.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:39.096+0000 7fc9b09a3640 1 -- 172.21.15.116:0/1458022810 wait complete. 2024-09-19T04:42:39.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:39.097+0000 7fc9b09a3640 1 Processor -- start 2024-09-19T04:42:39.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:39.097+0000 7fc9b09a3640 1 -- start start 2024-09-19T04:42:39.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:39.097+0000 7fc9b09a3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9ac1004b0 0x7fc9ac199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:42:39.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:39.097+0000 7fc9b09a3640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9ac100df0 0x7fc9ac19a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:42:39.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:39.097+0000 7fc9b09a3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9ac101790 0x7fc9ac1a1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:42:39.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:39.097+0000 7fc9b09a3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ac10f8f0 con 0x7fc9ac1004b0 2024-09-19T04:42:39.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:39.097+0000 7fc9b09a3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ac10f770 con 0x7fc9ac101790 2024-09-19T04:42:39.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:39.097+0000 7fc9b09a3640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ac10fa70 con 0x7fc9ac100df0 2024-09-19T04:42:39.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:39.097+0000 7fc9a9d9b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9ac100df0 0x7fc9ac19a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:42:39.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:39.097+0000 7fc9a9d9b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9ac100df0 0x7fc9ac19a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34694/0 (socket says 172.21.15.116:34694) 2024-09-19T04:42:39.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:39.097+0000 7fc9a9d9b640 1 -- 172.21.15.116:0/2877050647 learned_addr learned my addr 172.21.15.116:0/2877050647 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-19T04:42:39.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:39.097+0000 7fc9aa59c640 1 --2- 172.21.15.116:0/2877050647 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9ac1004b0 0x7fc9ac199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:42:39.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:39.097+0000 7fc9aad9d640 1 --2- 172.21.15.116:0/2877050647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9ac101790 0x7fc9ac1a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:42:39.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:39.097+0000 7fc9a9d9b640 1 -- 172.21.15.116:0/2877050647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9ac101790 msgr2=0x7fc9ac1a1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:42:39.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:39.097+0000 7fc9a9d9b640 1 --2- 172.21.15.116:0/2877050647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9ac101790 0x7fc9ac1a1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:42:39.102 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:39.097+0000 7fc9a9d9b640 1 -- 172.21.15.116:0/2877050647 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9ac1004b0 msgr2=0x7fc9ac199fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:42:39.102 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:39.097+0000 7fc9a9d9b640 1 --2- 172.21.15.116:0/2877050647 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9ac1004b0 0x7fc9ac199fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:42:39.102 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:39.097+0000 7fc9a9d9b640 1 -- 172.21.15.116:0/2877050647 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9ac1a1be0 con 0x7fc9ac100df0 2024-09-19T04:42:39.102 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:39.098+0000 7fc9a9d9b640 1 --2- 172.21.15.116:0/2877050647 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9ac100df0 0x7fc9ac19a4f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc9a000d770 tx=0x7fc9a000dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:42:39.102 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:39.098+0000 7fc99b7fe640 1 -- 172.21.15.116:0/2877050647 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a0017070 con 0x7fc9ac100df0 2024-09-19T04:42:39.102 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:39.098+0000 7fc99b7fe640 1 -- 172.21.15.116:0/2877050647 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc9a00054d0 con 0x7fc9ac100df0 2024-09-19T04:42:39.102 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:39.098+0000 7fc9b09a3640 1 -- 172.21.15.116:0/2877050647 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9ac1a1ed0 con 0x7fc9ac100df0 2024-09-19T04:42:39.102 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:39.098+0000 7fc99b7fe640 1 -- 172.21.15.116:0/2877050647 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a0004cf0 con 0x7fc9ac100df0 2024-09-19T04:42:39.102 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:39.098+0000 7fc9b09a3640 1 -- 172.21.15.116:0/2877050647 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9ac1a2330 con 0x7fc9ac100df0 2024-09-19T04:42:39.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:39.099+0000 7fc9b09a3640 1 -- 172.21.15.116:0/2877050647 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9ac10b3f0 con 0x7fc9ac100df0 2024-09-19T04:42:39.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:39.100+0000 7fc99b7fe640 1 -- 172.21.15.116:0/2877050647 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fc9a0004e90 con 0x7fc9ac100df0 2024-09-19T04:42:39.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:39.101+0000 7fc99b7fe640 1 --2- 172.21.15.116:0/2877050647 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fc9940a3270 0x7fc9940a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:42:39.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:39.101+0000 7fc99b7fe640 1 -- 172.21.15.116:0/2877050647 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 3805+0+0 (secure 0 0 0) 0x7fc9a00ce0e0 con 0x7fc9ac100df0 2024-09-19T04:42:39.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:39.101+0000 7fc9aa59c640 1 --2- 172.21.15.116:0/2877050647 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fc9940a3270 0x7fc9940a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:42:39.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:39.102+0000 7fc9aa59c640 1 --2- 172.21.15.116:0/2877050647 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fc9940a3270 0x7fc9940a5730 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc99c00bbe0 tx=0x7fc99c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:42:39.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:39.106+0000 7fc99b7fe640 1 -- 172.21.15.116:0/2877050647 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc9a009b950 con 0x7fc9ac100df0 2024-09-19T04:42:39.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:39.285+0000 7fc9b09a3640 1 -- 172.21.15.116:0/2877050647 --> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fc9ac062630 con 0x7fc9940a3270 2024-09-19T04:42:39.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:39 smithi116 ceph-mon[34477]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:42:39.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:39 smithi116 ceph-mon[34477]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T04:42:39.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:39 smithi116 ceph-mon[34477]: from='osd.4 [v2:172.21.15.18:6808/1333533784,v1:172.21.15.18:6809/1333533784]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-19T04:42:39.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:39 smithi116 ceph-mon[34477]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T04:42:39.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:39 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:42:39.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:39 smithi116 ceph-mon[34477]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-19T04:42:39.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:39 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:39.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:39 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:39.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:39 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:42:39.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:39 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:42:39.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:39 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:39.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:39 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:42:39.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:39 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:42:39.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:39 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:39.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:39 smithi018 ceph-mon[34537]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:42:39.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:39 smithi018 ceph-mon[34537]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T04:42:39.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:39 smithi018 ceph-mon[34537]: from='osd.4 [v2:172.21.15.18:6808/1333533784,v1:172.21.15.18:6809/1333533784]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-19T04:42:39.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:39 smithi018 ceph-mon[34537]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T04:42:39.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:39 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:42:39.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:39 smithi018 ceph-mon[34537]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-19T04:42:39.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:39 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:39.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:39 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:39.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:39 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:42:39.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:39 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:42:39.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:39 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:39.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:39 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:42:39.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:39 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:42:39.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:39 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:39.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:39 smithi002 ceph-mon[30975]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:42:39.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:39 smithi002 ceph-mon[30975]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T04:42:39.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:39 smithi002 ceph-mon[30975]: from='osd.4 [v2:172.21.15.18:6808/1333533784,v1:172.21.15.18:6809/1333533784]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-19T04:42:39.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:39 smithi002 ceph-mon[30975]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T04:42:39.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:39 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:42:39.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:39 smithi002 ceph-mon[30975]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-19T04:42:39.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:39 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:39.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:39 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:39.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:39 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:42:39.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:39 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:42:39.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:39 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:39.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:39 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:42:39.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:39 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:42:39.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:39 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:40.180 INFO:journalctl@ceph.osd.4.smithi018.stdout:Sep 19 04:42:39 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-4[45488]: 2024-09-19T04:42:39.831+0000 7f664b454640 -1 osd.4 0 waiting for initial osdmap 2024-09-19T04:42:40.181 INFO:journalctl@ceph.osd.4.smithi018.stdout:Sep 19 04:42:39 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-4[45488]: 2024-09-19T04:42:39.837+0000 7f6643a86640 -1 osd.4 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T04:42:40.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:40 smithi116 ceph-mon[34477]: Detected new or changed devices on smithi018 2024-09-19T04:42:40.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:40 smithi116 ceph-mon[34477]: Adjusting osd_memory_target on smithi018 to 8546M 2024-09-19T04:42:40.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:40 smithi116 ceph-mon[34477]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-19T04:42:40.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:40 smithi116 ceph-mon[34477]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T04:42:40.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:40 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:42:40.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:40 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:42:40.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:40 smithi116 ceph-mon[34477]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:42:40.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:40 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:42:40.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:40 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:42:40.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:40 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:42:40.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:40 smithi116 ceph-mon[34477]: from='osd.4 ' entity='osd.4' 2024-09-19T04:42:40.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:40 smithi018 ceph-mon[34537]: Detected new or changed devices on smithi018 2024-09-19T04:42:40.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:40 smithi018 ceph-mon[34537]: Adjusting osd_memory_target on smithi018 to 8546M 2024-09-19T04:42:40.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:40 smithi018 ceph-mon[34537]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-19T04:42:40.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:40 smithi018 ceph-mon[34537]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T04:42:40.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:40 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:42:40.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:40 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:42:40.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:40 smithi018 ceph-mon[34537]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:42:40.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:40 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:42:40.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:40 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:42:40.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:40 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:42:40.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:40 smithi018 ceph-mon[34537]: from='osd.4 ' entity='osd.4' 2024-09-19T04:42:40.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:40 smithi002 ceph-mon[30975]: Detected new or changed devices on smithi018 2024-09-19T04:42:40.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:40 smithi002 ceph-mon[30975]: Adjusting osd_memory_target on smithi018 to 8546M 2024-09-19T04:42:40.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:40 smithi002 ceph-mon[30975]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-19T04:42:40.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:40 smithi002 ceph-mon[30975]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T04:42:40.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:40 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:42:40.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:40 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:42:40.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:40 smithi002 ceph-mon[30975]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:42:40.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:40 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:42:40.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:40 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:42:40.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:40 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:42:40.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:40 smithi002 ceph-mon[30975]: from='osd.4 ' entity='osd.4' 2024-09-19T04:42:41.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:41 smithi018 ceph-mon[34537]: purged_snaps scrub starts 2024-09-19T04:42:41.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:41 smithi018 ceph-mon[34537]: purged_snaps scrub ok 2024-09-19T04:42:41.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:41 smithi018 ceph-mon[34537]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:42:41.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:41 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:42:41.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:41 smithi018 ceph-mon[34537]: osd.4 [v2:172.21.15.18:6808/1333533784,v1:172.21.15.18:6809/1333533784] boot 2024-09-19T04:42:41.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:41 smithi018 ceph-mon[34537]: osdmap e30: 5 total, 5 up, 5 in 2024-09-19T04:42:41.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:41 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:42:41.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:41 smithi002 ceph-mon[30975]: purged_snaps scrub starts 2024-09-19T04:42:41.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:41 smithi002 ceph-mon[30975]: purged_snaps scrub ok 2024-09-19T04:42:41.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:41 smithi002 ceph-mon[30975]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:42:41.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:41 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:42:41.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:41 smithi002 ceph-mon[30975]: osd.4 [v2:172.21.15.18:6808/1333533784,v1:172.21.15.18:6809/1333533784] boot 2024-09-19T04:42:41.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:41 smithi002 ceph-mon[30975]: osdmap e30: 5 total, 5 up, 5 in 2024-09-19T04:42:41.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:41 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:42:41.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:41 smithi116 ceph-mon[34477]: purged_snaps scrub starts 2024-09-19T04:42:41.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:41 smithi116 ceph-mon[34477]: purged_snaps scrub ok 2024-09-19T04:42:41.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:41 smithi116 ceph-mon[34477]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:42:41.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:41 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:42:41.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:41 smithi116 ceph-mon[34477]: osd.4 [v2:172.21.15.18:6808/1333533784,v1:172.21.15.18:6809/1333533784] boot 2024-09-19T04:42:41.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:41 smithi116 ceph-mon[34477]: osdmap e30: 5 total, 5 up, 5 in 2024-09-19T04:42:41.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:41 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:42:42.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:42 smithi116 ceph-mon[34477]: from='client.? 172.21.15.116:0/1559657328' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d3384b0-f87d-4513-b151-4cca21c339b3"}]: dispatch 2024-09-19T04:42:42.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:42 smithi116 ceph-mon[34477]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d3384b0-f87d-4513-b151-4cca21c339b3"}]: dispatch 2024-09-19T04:42:42.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:42 smithi116 ceph-mon[34477]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9d3384b0-f87d-4513-b151-4cca21c339b3"}]': finished 2024-09-19T04:42:42.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:42 smithi116 ceph-mon[34477]: osdmap e31: 6 total, 5 up, 6 in 2024-09-19T04:42:42.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:42 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:42:42.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:42 smithi116 ceph-mon[34477]: from='client.? 172.21.15.116:0/1942965242' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:42:42.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:42 smithi018 ceph-mon[34537]: from='client.? 172.21.15.116:0/1559657328' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d3384b0-f87d-4513-b151-4cca21c339b3"}]: dispatch 2024-09-19T04:42:42.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:42 smithi018 ceph-mon[34537]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d3384b0-f87d-4513-b151-4cca21c339b3"}]: dispatch 2024-09-19T04:42:42.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:42 smithi018 ceph-mon[34537]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9d3384b0-f87d-4513-b151-4cca21c339b3"}]': finished 2024-09-19T04:42:42.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:42 smithi018 ceph-mon[34537]: osdmap e31: 6 total, 5 up, 6 in 2024-09-19T04:42:42.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:42 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:42:42.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:42 smithi018 ceph-mon[34537]: from='client.? 172.21.15.116:0/1942965242' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:42:42.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:42 smithi002 ceph-mon[30975]: from='client.? 172.21.15.116:0/1559657328' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d3384b0-f87d-4513-b151-4cca21c339b3"}]: dispatch 2024-09-19T04:42:42.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:42 smithi002 ceph-mon[30975]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d3384b0-f87d-4513-b151-4cca21c339b3"}]: dispatch 2024-09-19T04:42:42.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:42 smithi002 ceph-mon[30975]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9d3384b0-f87d-4513-b151-4cca21c339b3"}]': finished 2024-09-19T04:42:42.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:42 smithi002 ceph-mon[30975]: osdmap e31: 6 total, 5 up, 6 in 2024-09-19T04:42:42.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:42 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:42:42.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:42 smithi002 ceph-mon[30975]: from='client.? 172.21.15.116:0/1942965242' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:42:43.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:43 smithi018 ceph-mon[34537]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:42:43.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:43 smithi018 ceph-mon[34537]: osdmap e32: 6 total, 5 up, 6 in 2024-09-19T04:42:43.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:43 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:42:43.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:43 smithi002 ceph-mon[30975]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:42:43.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:43 smithi002 ceph-mon[30975]: osdmap e32: 6 total, 5 up, 6 in 2024-09-19T04:42:43.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:43 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:42:43.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:43 smithi116 ceph-mon[34477]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:42:43.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:43 smithi116 ceph-mon[34477]: osdmap e32: 6 total, 5 up, 6 in 2024-09-19T04:42:43.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:43 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:42:45.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:45 smithi018 ceph-mon[34537]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:42:45.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:45 smithi002 ceph-mon[30975]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:42:45.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:45 smithi116 ceph-mon[34477]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:42:47.217 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:47 smithi116 ceph-mon[34477]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:42:47.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:47 smithi018 ceph-mon[34537]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:42:47.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:47 smithi002 ceph-mon[30975]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:42:49.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:49 smithi018 ceph-mon[34537]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:42:49.609 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:49 smithi002 ceph-mon[30975]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:42:49.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:49 smithi116 ceph-mon[34477]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:42:50.416 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:50 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T04:42:50.416 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:50 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:42:50.556 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:50 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T04:42:50.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:50 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:42:50.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:50 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T04:42:50.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:50 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:42:51.268 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:51 smithi116 ceph-mon[34477]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:42:51.268 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:51 smithi116 ceph-mon[34477]: Deploying daemon osd.5 on smithi116 2024-09-19T04:42:51.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:51 smithi018 ceph-mon[34537]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:42:51.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:51 smithi018 ceph-mon[34537]: Deploying daemon osd.5 on smithi116 2024-09-19T04:42:51.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:51 smithi002 ceph-mon[30975]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:42:51.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:51 smithi002 ceph-mon[30975]: Deploying daemon osd.5 on smithi116 2024-09-19T04:42:53.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:53 smithi018 ceph-mon[34537]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:42:53.609 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:53 smithi002 ceph-mon[30975]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:42:53.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:53 smithi116 ceph-mon[34477]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:42:55.353 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:55 smithi116 ceph-mon[34477]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:42:55.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:55 smithi018 ceph-mon[34537]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:42:55.609 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:55 smithi002 ceph-mon[30975]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:42:56.298 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:56 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:42:56.298 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:56 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:56.298 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:56 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:56.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:56 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:42:56.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:56 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:56.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:56 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:56.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:56 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:42:56.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:56 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:56.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:56 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:57.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:57 smithi018 ceph-mon[34537]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:42:57.609 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:57 smithi002 ceph-mon[30975]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:42:57.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:57 smithi116 ceph-mon[34477]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:42:59.102 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:58 smithi116 ceph-mon[34477]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:42:59.103 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:58 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:59.103 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:58 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:59.103 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:58 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:42:59.103 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:58 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:42:59.103 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:58 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:59.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:58 smithi018 ceph-mon[34537]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:42:59.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:58 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:59.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:58 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:59.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:58 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:42:59.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:58 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:42:59.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:58 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:59.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:58 smithi002 ceph-mon[30975]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:42:59.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:58 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:59.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:58 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:59.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:58 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:42:59.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:58 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:42:59.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:58 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:42:59.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:59.457+0000 7fc99b7fe640 1 -- 172.21.15.116:0/2877050647 <== mgr.14150 v2:172.21.15.2:6800/3171525177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc9ac062630 con 0x7fc9940a3270 2024-09-19T04:42:59.459 INFO:teuthology.orchestra.run.smithi116.stdout:Created osd(s) 5 on host 'smithi116' 2024-09-19T04:42:59.461 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:59.459+0000 7fc9b09a3640 1 -- 172.21.15.116:0/2877050647 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fc9940a3270 msgr2=0x7fc9940a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:42:59.461 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:59.459+0000 7fc9b09a3640 1 --2- 172.21.15.116:0/2877050647 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fc9940a3270 0x7fc9940a5730 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc99c00bbe0 tx=0x7fc99c00b390 comp rx=0 tx=0).stop 2024-09-19T04:42:59.461 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:59.459+0000 7fc9b09a3640 1 -- 172.21.15.116:0/2877050647 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9ac100df0 msgr2=0x7fc9ac19a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:42:59.461 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:59.459+0000 7fc9b09a3640 1 --2- 172.21.15.116:0/2877050647 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9ac100df0 0x7fc9ac19a4f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc9a000d770 tx=0x7fc9a000dc30 comp rx=0 tx=0).stop 2024-09-19T04:42:59.462 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:59.459+0000 7fc9b09a3640 1 -- 172.21.15.116:0/2877050647 shutdown_connections 2024-09-19T04:42:59.462 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:59.459+0000 7fc9b09a3640 1 --2- 172.21.15.116:0/2877050647 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fc9940a3270 0x7fc9940a5730 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:42:59.462 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:59.459+0000 7fc9b09a3640 1 --2- 172.21.15.116:0/2877050647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9ac101790 0x7fc9ac1a1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:42:59.462 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:59.459+0000 7fc9b09a3640 1 --2- 172.21.15.116:0/2877050647 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9ac100df0 0x7fc9ac19a4f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:42:59.462 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:59.459+0000 7fc9b09a3640 1 --2- 172.21.15.116:0/2877050647 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9ac1004b0 0x7fc9ac199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:42:59.462 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:59.459+0000 7fc9b09a3640 1 -- 172.21.15.116:0/2877050647 >> 172.21.15.116:0/2877050647 conn(0x7fc9ac0fc280 msgr2=0x7fc9ac0fd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:42:59.462 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:59.459+0000 7fc9b09a3640 1 -- 172.21.15.116:0/2877050647 shutdown_connections 2024-09-19T04:42:59.462 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:42:59.459+0000 7fc9b09a3640 1 -- 172.21.15.116:0/2877050647 wait complete. 2024-09-19T04:43:00.015 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:59 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:43:00.015 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:59 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:00.016 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:42:59 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:00.043 DEBUG:teuthology.orchestra.run.smithi116:osd.5> sudo journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@osd.5.service 2024-09-19T04:43:00.086 INFO:tasks.cephadm:Deploying osd.6 on smithi002 with /dev/vg_nvme/lv_2... 2024-09-19T04:43:00.086 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T04:43:00.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:59 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:43:00.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:59 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:00.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:42:59 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:00.352 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:43:00.359 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:59 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:43:00.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:59 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:00.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:42:59 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:01.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:00 smithi002 ceph-mon[30975]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:43:01.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:00 smithi116 ceph-mon[34477]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:43:01.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:00 smithi018 ceph-mon[34537]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:43:02.361 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 19 04:43:01 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-5[45954]: 2024-09-19T04:43:01.905+0000 7f4f1d009640 -1 osd.5 0 log_to_monitors true 2024-09-19T04:43:03.000 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:02 smithi002 ceph-mon[30975]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:43:03.000 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:02 smithi002 ceph-mon[30975]: from='osd.5 [v2:172.21.15.116:6808/316360741,v1:172.21.15.116:6809/316360741]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T04:43:03.001 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:02 smithi002 ceph-mon[30975]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T04:43:03.001 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:02 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:03.001 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:02 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:03.001 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:02 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:43:03.001 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:02 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:43:03.001 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:02 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:03.001 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:02 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:43:03.001 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:02 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:43:03.001 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:02 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:03.004 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:43:03.039 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi002:vg_nvme/lv_2 2024-09-19T04:43:03.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:02 smithi116 ceph-mon[34477]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:43:03.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:02 smithi116 ceph-mon[34477]: from='osd.5 [v2:172.21.15.116:6808/316360741,v1:172.21.15.116:6809/316360741]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T04:43:03.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:02 smithi116 ceph-mon[34477]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T04:43:03.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:02 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:03.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:02 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:03.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:02 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:43:03.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:02 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:43:03.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:02 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:03.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:02 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:43:03.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:02 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:43:03.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:02 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:03.299 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:43:03.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:02 smithi018 ceph-mon[34537]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:43:03.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:02 smithi018 ceph-mon[34537]: from='osd.5 [v2:172.21.15.116:6808/316360741,v1:172.21.15.116:6809/316360741]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T04:43:03.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:02 smithi018 ceph-mon[34537]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T04:43:03.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:02 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:03.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:02 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:03.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:02 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:43:03.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:02 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:43:03.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:02 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:03.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:02 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:43:03.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:02 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:43:03.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:02 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:03.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:03.765+0000 7f31c4bd7640 1 -- 172.21.15.2:0/233416794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31c0100b00 msgr2=0x7f31c0100f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:43:03.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:03.765+0000 7f31c4bd7640 1 --2- 172.21.15.2:0/233416794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31c0100b00 0x7f31c0100f00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f31b0009900 tx=0x7f31b002a410 comp rx=0 tx=0).stop 2024-09-19T04:43:03.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:03.766+0000 7f31c4bd7640 1 -- 172.21.15.2:0/233416794 shutdown_connections 2024-09-19T04:43:03.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:03.766+0000 7f31c4bd7640 1 --2- 172.21.15.2:0/233416794 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31c01026c0 0x7f31c0108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:43:03.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:03.766+0000 7f31c4bd7640 1 --2- 172.21.15.2:0/233416794 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f31c0101d00 0x7f31c0102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:43:03.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:03.766+0000 7f31c4bd7640 1 --2- 172.21.15.2:0/233416794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31c0100b00 0x7f31c0100f00 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:43:03.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:03.766+0000 7f31c4bd7640 1 -- 172.21.15.2:0/233416794 >> 172.21.15.2:0/233416794 conn(0x7f31c00fc290 msgr2=0x7f31c00fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:43:03.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:03.766+0000 7f31c4bd7640 1 -- 172.21.15.2:0/233416794 shutdown_connections 2024-09-19T04:43:03.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:03.766+0000 7f31c4bd7640 1 -- 172.21.15.2:0/233416794 wait complete. 2024-09-19T04:43:03.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:03.766+0000 7f31c4bd7640 1 Processor -- start 2024-09-19T04:43:03.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:03.767+0000 7f31c4bd7640 1 -- start start 2024-09-19T04:43:03.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:03.767+0000 7f31c4bd7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31c0100b00 0x7f31c019a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:43:03.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:03.767+0000 7f31c4bd7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31c0101d00 0x7f31c019a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:43:03.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:03.767+0000 7f31c4bd7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f31c01026c0 0x7f31c01a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:43:03.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:03.767+0000 7f31c4bd7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f31c010c690 con 0x7f31c0101d00 2024-09-19T04:43:03.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:03.767+0000 7f31c4bd7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f31c010c510 con 0x7f31c0100b00 2024-09-19T04:43:03.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:03.767+0000 7f31c4bd7640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f31c010c810 con 0x7f31c01026c0 2024-09-19T04:43:03.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:03.767+0000 7f31bdd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31c0101d00 0x7f31c019a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:43:03.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:03.767+0000 7f31bdd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31c0101d00 0x7f31c019a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46758/0 (socket says 172.21.15.2:46758) 2024-09-19T04:43:03.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:03.767+0000 7f31bdd9b640 1 -- 172.21.15.2:0/2797032524 learned_addr learned my addr 172.21.15.2:0/2797032524 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:43:03.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:03.767+0000 7f31be59c640 1 --2- 172.21.15.2:0/2797032524 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31c0100b00 0x7f31c019a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:43:03.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:03.767+0000 7f31bed9d640 1 --2- 172.21.15.2:0/2797032524 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f31c01026c0 0x7f31c01a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:43:03.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:03.767+0000 7f31bdd9b640 1 -- 172.21.15.2:0/2797032524 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f31c01026c0 msgr2=0x7f31c01a1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:43:03.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:03.767+0000 7f31bdd9b640 1 --2- 172.21.15.2:0/2797032524 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f31c01026c0 0x7f31c01a1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:43:03.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:03.767+0000 7f31bdd9b640 1 -- 172.21.15.2:0/2797032524 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31c0100b00 msgr2=0x7f31c019a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:43:03.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:03.767+0000 7f31bdd9b640 1 --2- 172.21.15.2:0/2797032524 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31c0100b00 0x7f31c019a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:43:03.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:03.767+0000 7f31bdd9b640 1 -- 172.21.15.2:0/2797032524 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31c01a1c80 con 0x7f31c0101d00 2024-09-19T04:43:03.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:03.767+0000 7f31bdd9b640 1 --2- 172.21.15.2:0/2797032524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31c0101d00 0x7f31c019a590 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f31b400b4a0 tx=0x7f31b400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:43:03.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:03.768+0000 7f31af7fe640 1 -- 172.21.15.2:0/2797032524 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b4014070 con 0x7f31c0101d00 2024-09-19T04:43:03.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:03.768+0000 7f31c4bd7640 1 -- 172.21.15.2:0/2797032524 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31c01a1f70 con 0x7f31c0101d00 2024-09-19T04:43:03.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:03.768+0000 7f31af7fe640 1 -- 172.21.15.2:0/2797032524 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f31b4010ac0 con 0x7f31c0101d00 2024-09-19T04:43:03.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:03.768+0000 7f31af7fe640 1 -- 172.21.15.2:0/2797032524 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b4017c30 con 0x7f31c0101d00 2024-09-19T04:43:03.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:03.768+0000 7f31c4bd7640 1 -- 172.21.15.2:0/2797032524 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31c01a24a0 con 0x7f31c0101d00 2024-09-19T04:43:03.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:03.769+0000 7f31c4bd7640 1 -- 172.21.15.2:0/2797032524 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31c01a2730 con 0x7f31c0101d00 2024-09-19T04:43:03.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:03.770+0000 7f31af7fe640 1 -- 172.21.15.2:0/2797032524 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f31b4017070 con 0x7f31c0101d00 2024-09-19T04:43:03.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:03.770+0000 7f31af7fe640 1 --2- 172.21.15.2:0/2797032524 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f31a80a3270 0x7f31a80a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:43:03.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:03.771+0000 7f31af7fe640 1 -- 172.21.15.2:0/2797032524 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4237+0+0 (secure 0 0 0) 0x7f31b40cdc30 con 0x7f31c0101d00 2024-09-19T04:43:03.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:03.771+0000 7f31be59c640 1 --2- 172.21.15.2:0/2797032524 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f31a80a3270 0x7f31a80a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:43:03.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:03.771+0000 7f31be59c640 1 --2- 172.21.15.2:0/2797032524 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f31a80a3270 0x7f31a80a5730 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f31b0006010 tx=0x7f31b0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:43:03.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:03.775+0000 7f31af7fe640 1 -- 172.21.15.2:0/2797032524 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f31b409b940 con 0x7f31c0101d00 2024-09-19T04:43:03.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:03.962+0000 7f31c4bd7640 1 -- 172.21.15.2:0/2797032524 --> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f31c01a2900 con 0x7f31a80a3270 2024-09-19T04:43:03.964 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:03 smithi002 ceph-mon[30975]: Detected new or changed devices on smithi116 2024-09-19T04:43:03.964 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:03 smithi002 ceph-mon[30975]: Adjusting osd_memory_target on smithi116 to 8544M 2024-09-19T04:43:03.964 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:03 smithi002 ceph-mon[30975]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T04:43:03.964 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:03 smithi002 ceph-mon[30975]: osdmap e33: 6 total, 5 up, 6 in 2024-09-19T04:43:03.964 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:03 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:43:03.964 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:03 smithi002 ceph-mon[30975]: from='osd.5 [v2:172.21.15.116:6808/316360741,v1:172.21.15.116:6809/316360741]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-19T04:43:03.964 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:03 smithi002 ceph-mon[30975]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-19T04:43:04.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:03 smithi018 ceph-mon[34537]: Detected new or changed devices on smithi116 2024-09-19T04:43:04.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:03 smithi018 ceph-mon[34537]: Adjusting osd_memory_target on smithi116 to 8544M 2024-09-19T04:43:04.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:03 smithi018 ceph-mon[34537]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T04:43:04.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:03 smithi018 ceph-mon[34537]: osdmap e33: 6 total, 5 up, 6 in 2024-09-19T04:43:04.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:03 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:43:04.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:03 smithi018 ceph-mon[34537]: from='osd.5 [v2:172.21.15.116:6808/316360741,v1:172.21.15.116:6809/316360741]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-19T04:43:04.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:03 smithi018 ceph-mon[34537]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-19T04:43:04.360 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 19 04:43:03 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-5[45954]: 2024-09-19T04:43:03.888+0000 7f4f18769640 -1 osd.5 0 waiting for initial osdmap 2024-09-19T04:43:04.360 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 19 04:43:03 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-5[45954]: 2024-09-19T04:43:03.895+0000 7f4f14da3640 -1 osd.5 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T04:43:04.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:03 smithi116 ceph-mon[34477]: Detected new or changed devices on smithi116 2024-09-19T04:43:04.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:03 smithi116 ceph-mon[34477]: Adjusting osd_memory_target on smithi116 to 8544M 2024-09-19T04:43:04.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:03 smithi116 ceph-mon[34477]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T04:43:04.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:03 smithi116 ceph-mon[34477]: osdmap e33: 6 total, 5 up, 6 in 2024-09-19T04:43:04.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:03 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:43:04.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:03 smithi116 ceph-mon[34477]: from='osd.5 [v2:172.21.15.116:6808/316360741,v1:172.21.15.116:6809/316360741]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-19T04:43:04.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:03 smithi116 ceph-mon[34477]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-19T04:43:05.085 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:04 smithi002 ceph-mon[30975]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:43:05.085 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:04 smithi002 ceph-mon[30975]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-09-19T04:43:05.086 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:04 smithi002 ceph-mon[30975]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T04:43:05.086 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:04 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:43:05.086 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:04 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:43:05.086 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:04 smithi002 ceph-mon[30975]: from='client.14373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:43:05.086 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:04 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:43:05.086 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:04 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:43:05.086 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:04 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:43:05.086 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:04 smithi002 ceph-mon[30975]: osd.5 [v2:172.21.15.116:6808/316360741,v1:172.21.15.116:6809/316360741] boot 2024-09-19T04:43:05.086 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:04 smithi002 ceph-mon[30975]: osdmap e35: 6 total, 6 up, 6 in 2024-09-19T04:43:05.086 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:04 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:43:05.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:04 smithi018 ceph-mon[34537]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:43:05.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:04 smithi018 ceph-mon[34537]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-09-19T04:43:05.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:04 smithi018 ceph-mon[34537]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T04:43:05.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:04 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:43:05.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:04 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:43:05.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:04 smithi018 ceph-mon[34537]: from='client.14373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:43:05.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:04 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:43:05.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:04 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:43:05.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:04 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:43:05.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:04 smithi018 ceph-mon[34537]: osd.5 [v2:172.21.15.116:6808/316360741,v1:172.21.15.116:6809/316360741] boot 2024-09-19T04:43:05.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:04 smithi018 ceph-mon[34537]: osdmap e35: 6 total, 6 up, 6 in 2024-09-19T04:43:05.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:04 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:43:05.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:04 smithi116 ceph-mon[34477]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:43:05.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:04 smithi116 ceph-mon[34477]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-09-19T04:43:05.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:04 smithi116 ceph-mon[34477]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T04:43:05.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:04 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:43:05.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:04 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:43:05.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:04 smithi116 ceph-mon[34477]: from='client.14373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:43:05.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:04 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:43:05.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:04 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:43:05.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:04 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:43:05.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:04 smithi116 ceph-mon[34477]: osd.5 [v2:172.21.15.116:6808/316360741,v1:172.21.15.116:6809/316360741] boot 2024-09-19T04:43:05.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:04 smithi116 ceph-mon[34477]: osdmap e35: 6 total, 6 up, 6 in 2024-09-19T04:43:05.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:04 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:43:06.010 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:05 smithi002 ceph-mon[30975]: purged_snaps scrub starts 2024-09-19T04:43:06.010 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:05 smithi002 ceph-mon[30975]: purged_snaps scrub ok 2024-09-19T04:43:06.010 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:05 smithi002 ceph-mon[30975]: osdmap e36: 6 total, 6 up, 6 in 2024-09-19T04:43:06.306 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:05 smithi018 ceph-mon[34537]: purged_snaps scrub starts 2024-09-19T04:43:06.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:05 smithi018 ceph-mon[34537]: purged_snaps scrub ok 2024-09-19T04:43:06.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:05 smithi018 ceph-mon[34537]: osdmap e36: 6 total, 6 up, 6 in 2024-09-19T04:43:06.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:05 smithi116 ceph-mon[34477]: purged_snaps scrub starts 2024-09-19T04:43:06.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:05 smithi116 ceph-mon[34477]: purged_snaps scrub ok 2024-09-19T04:43:06.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:05 smithi116 ceph-mon[34477]: osdmap e36: 6 total, 6 up, 6 in 2024-09-19T04:43:07.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:06 smithi018 ceph-mon[34537]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:43:07.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:06 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/4101850686' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e54f44b5-a693-4b31-83b2-2bcf10ab9a75"}]: dispatch 2024-09-19T04:43:07.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:06 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/4101850686' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e54f44b5-a693-4b31-83b2-2bcf10ab9a75"}]': finished 2024-09-19T04:43:07.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:06 smithi018 ceph-mon[34537]: osdmap e37: 7 total, 6 up, 7 in 2024-09-19T04:43:07.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:06 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:43:07.359 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:06 smithi002 ceph-mon[30975]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:43:07.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:06 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/4101850686' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e54f44b5-a693-4b31-83b2-2bcf10ab9a75"}]: dispatch 2024-09-19T04:43:07.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:06 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/4101850686' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e54f44b5-a693-4b31-83b2-2bcf10ab9a75"}]': finished 2024-09-19T04:43:07.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:06 smithi002 ceph-mon[30975]: osdmap e37: 7 total, 6 up, 7 in 2024-09-19T04:43:07.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:06 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:43:07.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:06 smithi116 ceph-mon[34477]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:43:07.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:06 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/4101850686' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e54f44b5-a693-4b31-83b2-2bcf10ab9a75"}]: dispatch 2024-09-19T04:43:07.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:06 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/4101850686' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e54f44b5-a693-4b31-83b2-2bcf10ab9a75"}]': finished 2024-09-19T04:43:07.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:06 smithi116 ceph-mon[34477]: osdmap e37: 7 total, 6 up, 7 in 2024-09-19T04:43:07.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:06 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:43:08.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:07 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/3356442278' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:43:08.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:07 smithi018 ceph-mon[34537]: osdmap e38: 7 total, 6 up, 7 in 2024-09-19T04:43:08.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:07 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:43:08.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:07 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/3356442278' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:43:08.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:07 smithi002 ceph-mon[30975]: osdmap e38: 7 total, 6 up, 7 in 2024-09-19T04:43:08.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:07 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:43:08.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:07 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/3356442278' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:43:08.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:07 smithi116 ceph-mon[34477]: osdmap e38: 7 total, 6 up, 7 in 2024-09-19T04:43:08.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:07 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:43:09.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:09 smithi002 ceph-mon[30975]: pgmap v134: 1 pgs: 1 remapped+peering; 577 KiB data, 198 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:43:09.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:09 smithi002 ceph-mon[30975]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T04:43:09.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:09 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:43:09.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:09 smithi116 ceph-mon[34477]: pgmap v134: 1 pgs: 1 remapped+peering; 577 KiB data, 198 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:43:09.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:09 smithi116 ceph-mon[34477]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T04:43:09.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:09 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:43:09.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:09 smithi018 ceph-mon[34537]: pgmap v134: 1 pgs: 1 remapped+peering; 577 KiB data, 198 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:43:09.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:09 smithi018 ceph-mon[34537]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T04:43:09.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:09 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:43:11.550 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:11 smithi002 ceph-mon[30975]: pgmap v136: 1 pgs: 1 remapped+peering; 577 KiB data, 198 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:43:11.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:11 smithi116 ceph-mon[34477]: pgmap v136: 1 pgs: 1 remapped+peering; 577 KiB data, 198 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:43:11.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:11 smithi018 ceph-mon[34537]: pgmap v136: 1 pgs: 1 remapped+peering; 577 KiB data, 198 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:43:13.590 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:13 smithi002 ceph-mon[30975]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 100 KiB/s, 0 objects/s recovering 2024-09-19T04:43:13.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:13 smithi116 ceph-mon[34477]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 100 KiB/s, 0 objects/s recovering 2024-09-19T04:43:13.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:13 smithi018 ceph-mon[34537]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 100 KiB/s, 0 objects/s recovering 2024-09-19T04:43:15.609 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:15 smithi018 ceph-mon[34537]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-19T04:43:15.609 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:15 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T04:43:15.609 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:15 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:43:15.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:15 smithi002 ceph-mon[30975]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-19T04:43:15.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:15 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T04:43:15.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:15 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:43:15.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:15 smithi116 ceph-mon[34477]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-19T04:43:15.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:15 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T04:43:15.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:15 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:43:16.538 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:16 smithi002 ceph-mon[30975]: Deploying daemon osd.6 on smithi002 2024-09-19T04:43:16.806 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:16 smithi018 ceph-mon[34537]: Deploying daemon osd.6 on smithi002 2024-09-19T04:43:16.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:16 smithi116 ceph-mon[34477]: Deploying daemon osd.6 on smithi002 2024-09-19T04:43:17.435 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:17 smithi002 ceph-mon[30975]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-19T04:43:17.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:17 smithi018 ceph-mon[34537]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-19T04:43:17.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:17 smithi116 ceph-mon[34477]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-19T04:43:19.564 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:19 smithi002 ceph-mon[30975]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T04:43:19.806 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:19 smithi018 ceph-mon[34537]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T04:43:19.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:19 smithi116 ceph-mon[34477]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T04:43:21.499 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:21 smithi002 ceph-mon[30975]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-19T04:43:21.499 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:21 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:43:21.499 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:21 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:21.499 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:21 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:21.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:21 smithi018 ceph-mon[34537]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-19T04:43:21.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:21 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:43:21.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:21 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:21.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:21 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:21.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:21 smithi116 ceph-mon[34477]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-19T04:43:21.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:21 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:43:21.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:21 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:21.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:21 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:23.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:23 smithi002 ceph-mon[30975]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T04:43:23.806 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:23 smithi018 ceph-mon[34537]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T04:43:23.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:23 smithi116 ceph-mon[34477]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T04:43:23.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:23.925+0000 7f31af7fe640 1 -- 172.21.15.2:0/2797032524 <== mgr.14150 v2:172.21.15.2:6800/3171525177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f31c01a2900 con 0x7f31a80a3270 2024-09-19T04:43:23.927 INFO:teuthology.orchestra.run.smithi002.stdout:Created osd(s) 6 on host 'smithi002' 2024-09-19T04:43:23.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:23.927+0000 7f31c4bd7640 1 -- 172.21.15.2:0/2797032524 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f31a80a3270 msgr2=0x7f31a80a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:43:23.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:23.927+0000 7f31c4bd7640 1 --2- 172.21.15.2:0/2797032524 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f31a80a3270 0x7f31a80a5730 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f31b0006010 tx=0x7f31b0000bc0 comp rx=0 tx=0).stop 2024-09-19T04:43:23.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:23.927+0000 7f31c4bd7640 1 -- 172.21.15.2:0/2797032524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31c0101d00 msgr2=0x7f31c019a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:43:23.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:23.927+0000 7f31c4bd7640 1 --2- 172.21.15.2:0/2797032524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31c0101d00 0x7f31c019a590 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f31b400b4a0 tx=0x7f31b400b960 comp rx=0 tx=0).stop 2024-09-19T04:43:23.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:23.928+0000 7f31c4bd7640 1 -- 172.21.15.2:0/2797032524 shutdown_connections 2024-09-19T04:43:23.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:23.928+0000 7f31c4bd7640 1 --2- 172.21.15.2:0/2797032524 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f31a80a3270 0x7f31a80a5730 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:43:23.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:23.928+0000 7f31c4bd7640 1 --2- 172.21.15.2:0/2797032524 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f31c01026c0 0x7f31c01a1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:43:23.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:23.928+0000 7f31c4bd7640 1 --2- 172.21.15.2:0/2797032524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31c0101d00 0x7f31c019a590 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:43:23.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:23.928+0000 7f31c4bd7640 1 --2- 172.21.15.2:0/2797032524 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31c0100b00 0x7f31c019a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:43:23.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:23.928+0000 7f31c4bd7640 1 -- 172.21.15.2:0/2797032524 >> 172.21.15.2:0/2797032524 conn(0x7f31c00fc290 msgr2=0x7f31c00fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:43:23.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:23.928+0000 7f31c4bd7640 1 -- 172.21.15.2:0/2797032524 shutdown_connections 2024-09-19T04:43:23.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:43:23.928+0000 7f31c4bd7640 1 -- 172.21.15.2:0/2797032524 wait complete. 2024-09-19T04:43:24.563 DEBUG:teuthology.orchestra.run.smithi002:osd.6> sudo journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@osd.6.service 2024-09-19T04:43:24.566 INFO:tasks.cephadm:Deploying osd.7 on smithi018 with /dev/vg_nvme/lv_2... 2024-09-19T04:43:24.567 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T04:43:24.833 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T04:43:25.110 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:24 smithi116 ceph-mon[34477]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:43:25.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:24 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:25.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:24 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:25.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:24 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:25.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:24 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:25.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:24 smithi002 ceph-mon[30975]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:43:25.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:24 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:25.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:24 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:25.237 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:24 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:25.238 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:24 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:25.265 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:24 smithi018 ceph-mon[34537]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:43:25.265 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:24 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:25.265 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:24 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:25.265 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:24 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:25.265 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:24 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:27.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:26 smithi018 ceph-mon[34537]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:43:27.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:26 smithi002 ceph-mon[30975]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:43:27.360 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 04:43:27 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T04:43:27.077+0000 7fa372783640 -1 osd.6 0 log_to_monitors true 2024-09-19T04:43:27.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:26 smithi116 ceph-mon[34477]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:43:27.446 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T04:43:27.473 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi018:vg_nvme/lv_2 2024-09-19T04:43:27.737 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T04:43:28.039 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:27 smithi018 ceph-mon[34537]: from='osd.6 [v2:172.21.15.2:6818/1185564560,v1:172.21.15.2:6819/1185564560]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T04:43:28.039 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:27 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:28.039 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:27 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:28.039 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:27 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:43:28.039 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:27 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:43:28.039 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:27 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:43:28.039 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:27 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:28.039 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:27 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:43:28.039 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:27 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:43:28.039 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:27 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:28.040 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:27 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:43:28.040 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:27 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:43:28.040 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:27 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:43:28.040 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:27 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:28.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:27 smithi002 ceph-mon[30975]: from='osd.6 [v2:172.21.15.2:6818/1185564560,v1:172.21.15.2:6819/1185564560]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T04:43:28.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:27 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:28.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:27 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:28.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:27 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:43:28.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:27 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:43:28.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:27 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:43:28.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:27 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:28.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:27 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:43:28.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:27 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:43:28.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:27 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:28.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:27 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:43:28.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:27 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:43:28.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:27 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:43:28.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:27 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:28.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:28.241+0000 7fd2e6335640 1 -- 172.21.15.18:0/2889809059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2e0101cd0 msgr2=0x7fd2e0102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:43:28.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:28.241+0000 7fd2e6335640 1 --2- 172.21.15.18:0/2889809059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2e0101cd0 0x7fd2e0102150 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4009900 tx=0x7fd2d402a410 comp rx=0 tx=0).stop 2024-09-19T04:43:28.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:28.241+0000 7fd2e6335640 1 -- 172.21.15.18:0/2889809059 shutdown_connections 2024-09-19T04:43:28.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:28.241+0000 7fd2e6335640 1 --2- 172.21.15.18:0/2889809059 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd2e0102690 0x7fd2e0108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:43:28.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:28.241+0000 7fd2e6335640 1 --2- 172.21.15.18:0/2889809059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2e0101cd0 0x7fd2e0102150 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:43:28.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:28.241+0000 7fd2e6335640 1 --2- 172.21.15.18:0/2889809059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2e0100ad0 0x7fd2e0100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:43:28.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:28.241+0000 7fd2e6335640 1 -- 172.21.15.18:0/2889809059 >> 172.21.15.18:0/2889809059 conn(0x7fd2e00fc280 msgr2=0x7fd2e00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:43:28.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:28.241+0000 7fd2e6335640 1 -- 172.21.15.18:0/2889809059 shutdown_connections 2024-09-19T04:43:28.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:28.241+0000 7fd2e6335640 1 -- 172.21.15.18:0/2889809059 wait complete. 2024-09-19T04:43:28.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:28.242+0000 7fd2e6335640 1 Processor -- start 2024-09-19T04:43:28.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:28.242+0000 7fd2e6335640 1 -- start start 2024-09-19T04:43:28.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:28.242+0000 7fd2e6335640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2e0100ad0 0x7fd2e0104a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:43:28.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:28.242+0000 7fd2e6335640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2e0101cd0 0x7fd2e01030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:43:28.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:28.242+0000 7fd2e6335640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd2e0102690 0x7fd2e01035f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:43:28.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:28.242+0000 7fd2e6335640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e010c600 con 0x7fd2e0101cd0 2024-09-19T04:43:28.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:28.242+0000 7fd2e6335640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e010c480 con 0x7fd2e0100ad0 2024-09-19T04:43:28.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:28.242+0000 7fd2e6335640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e010c780 con 0x7fd2e0102690 2024-09-19T04:43:28.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:28.242+0000 7fd2dffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2e0100ad0 0x7fd2e0104a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:43:28.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:28.242+0000 7fd2dffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2e0100ad0 0x7fd2e0104a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60090/0 (socket says 172.21.15.18:60090) 2024-09-19T04:43:28.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:28.242+0000 7fd2dffff640 1 -- 172.21.15.18:0/1684675120 learned_addr learned my addr 172.21.15.18:0/1684675120 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T04:43:28.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:28.242+0000 7fd2e48d2640 1 --2- 172.21.15.18:0/1684675120 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd2e0102690 0x7fd2e01035f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:43:28.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:28.243+0000 7fd2df7fe640 1 --2- 172.21.15.18:0/1684675120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2e0101cd0 0x7fd2e01030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:43:28.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:28.243+0000 7fd2dffff640 1 -- 172.21.15.18:0/1684675120 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd2e0102690 msgr2=0x7fd2e01035f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:43:28.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:28.243+0000 7fd2dffff640 1 --2- 172.21.15.18:0/1684675120 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd2e0102690 0x7fd2e01035f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:43:28.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:28.243+0000 7fd2dffff640 1 -- 172.21.15.18:0/1684675120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2e0101cd0 msgr2=0x7fd2e01030b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:43:28.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:28.243+0000 7fd2dffff640 1 --2- 172.21.15.18:0/1684675120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2e0101cd0 0x7fd2e01030b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:43:28.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:28.243+0000 7fd2dffff640 1 -- 172.21.15.18:0/1684675120 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2e0103eb0 con 0x7fd2e0100ad0 2024-09-19T04:43:28.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:28.243+0000 7fd2dffff640 1 --2- 172.21.15.18:0/1684675120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2e0100ad0 0x7fd2e0104a60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd2d000d770 tx=0x7fd2d000dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:43:28.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:28.243+0000 7fd2dd7fa640 1 -- 172.21.15.18:0/1684675120 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d0017070 con 0x7fd2e0100ad0 2024-09-19T04:43:28.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:28.243+0000 7fd2e6335640 1 -- 172.21.15.18:0/1684675120 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2e01a1f60 con 0x7fd2e0100ad0 2024-09-19T04:43:28.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:28.243+0000 7fd2dd7fa640 1 -- 172.21.15.18:0/1684675120 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd2d0009c30 con 0x7fd2e0100ad0 2024-09-19T04:43:28.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:28.243+0000 7fd2dd7fa640 1 -- 172.21.15.18:0/1684675120 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d0003c90 con 0x7fd2e0100ad0 2024-09-19T04:43:28.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:28.243+0000 7fd2e6335640 1 -- 172.21.15.18:0/1684675120 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2e01a23b0 con 0x7fd2e0100ad0 2024-09-19T04:43:28.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:28.244+0000 7fd2e6335640 1 -- 172.21.15.18:0/1684675120 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2e01a26a0 con 0x7fd2e0100ad0 2024-09-19T04:43:28.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:28.245+0000 7fd2dd7fa640 1 -- 172.21.15.18:0/1684675120 <== mon.2 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fd2d0003e30 con 0x7fd2e0100ad0 2024-09-19T04:43:28.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:28.246+0000 7fd2dd7fa640 1 --2- 172.21.15.18:0/1684675120 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd2c80a32c0 0x7fd2c80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:43:28.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:28.246+0000 7fd2dd7fa640 1 -- 172.21.15.18:0/1684675120 <== mon.2 v2:172.21.15.18:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4669+0+0 (secure 0 0 0) 0x7fd2d00ce340 con 0x7fd2e0100ad0 2024-09-19T04:43:28.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:28.246+0000 7fd2df7fe640 1 --2- 172.21.15.18:0/1684675120 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd2c80a32c0 0x7fd2c80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:43:28.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:28.247+0000 7fd2df7fe640 1 --2- 172.21.15.18:0/1684675120 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd2c80a32c0 0x7fd2c80a5780 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4006010 tx=0x7fd2d4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:43:28.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:28.251+0000 7fd2dd7fa640 1 -- 172.21.15.18:0/1684675120 <== mon.2 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd2d0009de0 con 0x7fd2e0100ad0 2024-09-19T04:43:28.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:27 smithi116 ceph-mon[34477]: from='osd.6 [v2:172.21.15.2:6818/1185564560,v1:172.21.15.2:6819/1185564560]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T04:43:28.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:27 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:28.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:27 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:28.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:27 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:43:28.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:27 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:43:28.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:27 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:43:28.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:27 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:28.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:27 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:43:28.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:27 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:43:28.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:27 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:28.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:27 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:43:28.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:27 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:43:28.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:27 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:43:28.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:27 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:28.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:28.438+0000 7fd2e6335640 1 -- 172.21.15.18:0/1684675120 --> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fd2e006a6b0 con 0x7fd2c80a32c0 2024-09-19T04:43:29.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:28 smithi018 ceph-mon[34537]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:43:29.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:28 smithi018 ceph-mon[34537]: Detected new or changed devices on smithi002 2024-09-19T04:43:29.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:28 smithi018 ceph-mon[34537]: Adjusting osd_memory_target on smithi002 to 5697M 2024-09-19T04:43:29.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:28 smithi018 ceph-mon[34537]: from='osd.6 [v2:172.21.15.2:6818/1185564560,v1:172.21.15.2:6819/1185564560]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T04:43:29.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:28 smithi018 ceph-mon[34537]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T04:43:29.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:28 smithi018 ceph-mon[34537]: from='osd.6 [v2:172.21.15.2:6818/1185564560,v1:172.21.15.2:6819/1185564560]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-19T04:43:29.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:28 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:43:29.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:28 smithi018 ceph-mon[34537]: from='client.24269 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:43:29.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:28 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:43:29.058 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:28 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:43:29.058 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:28 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:43:29.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:28 smithi002 ceph-mon[30975]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:43:29.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:28 smithi002 ceph-mon[30975]: Detected new or changed devices on smithi002 2024-09-19T04:43:29.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:28 smithi002 ceph-mon[30975]: Adjusting osd_memory_target on smithi002 to 5697M 2024-09-19T04:43:29.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:28 smithi002 ceph-mon[30975]: from='osd.6 [v2:172.21.15.2:6818/1185564560,v1:172.21.15.2:6819/1185564560]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T04:43:29.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:28 smithi002 ceph-mon[30975]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T04:43:29.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:28 smithi002 ceph-mon[30975]: from='osd.6 [v2:172.21.15.2:6818/1185564560,v1:172.21.15.2:6819/1185564560]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-19T04:43:29.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:28 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:43:29.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:28 smithi002 ceph-mon[30975]: from='client.24269 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:43:29.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:28 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:43:29.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:28 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:43:29.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:28 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:43:29.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:28 smithi116 ceph-mon[34477]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:43:29.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:28 smithi116 ceph-mon[34477]: Detected new or changed devices on smithi002 2024-09-19T04:43:29.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:28 smithi116 ceph-mon[34477]: Adjusting osd_memory_target on smithi002 to 5697M 2024-09-19T04:43:29.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:28 smithi116 ceph-mon[34477]: from='osd.6 [v2:172.21.15.2:6818/1185564560,v1:172.21.15.2:6819/1185564560]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T04:43:29.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:28 smithi116 ceph-mon[34477]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T04:43:29.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:28 smithi116 ceph-mon[34477]: from='osd.6 [v2:172.21.15.2:6818/1185564560,v1:172.21.15.2:6819/1185564560]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-19T04:43:29.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:28 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:43:29.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:28 smithi116 ceph-mon[34477]: from='client.24269 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:43:29.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:28 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:43:29.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:28 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:43:29.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:28 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:43:29.944 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 04:43:29 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T04:43:29.647+0000 7fa36dee3640 -1 osd.6 0 waiting for initial osdmap 2024-09-19T04:43:29.944 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 04:43:29 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T04:43:29.659+0000 7fa366515640 -1 osd.6 41 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T04:43:30.056 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:29 smithi018 ceph-mon[34537]: from='osd.6 [v2:172.21.15.2:6818/1185564560,v1:172.21.15.2:6819/1185564560]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-19T04:43:30.056 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:29 smithi018 ceph-mon[34537]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T04:43:30.056 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:29 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:43:30.056 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:29 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:43:30.056 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:29 smithi018 ceph-mon[34537]: from='osd.6 [v2:172.21.15.2:6818/1185564560,v1:172.21.15.2:6819/1185564560]' entity='osd.6' 2024-09-19T04:43:30.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:29 smithi002 ceph-mon[30975]: from='osd.6 [v2:172.21.15.2:6818/1185564560,v1:172.21.15.2:6819/1185564560]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-19T04:43:30.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:29 smithi002 ceph-mon[30975]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T04:43:30.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:29 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:43:30.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:29 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:43:30.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:29 smithi002 ceph-mon[30975]: from='osd.6 [v2:172.21.15.2:6818/1185564560,v1:172.21.15.2:6819/1185564560]' entity='osd.6' 2024-09-19T04:43:30.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:29 smithi116 ceph-mon[34477]: from='osd.6 [v2:172.21.15.2:6818/1185564560,v1:172.21.15.2:6819/1185564560]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-19T04:43:30.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:29 smithi116 ceph-mon[34477]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T04:43:30.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:29 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:43:30.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:29 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:43:30.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:29 smithi116 ceph-mon[34477]: from='osd.6 [v2:172.21.15.2:6818/1185564560,v1:172.21.15.2:6819/1185564560]' entity='osd.6' 2024-09-19T04:43:31.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:30 smithi018 ceph-mon[34537]: purged_snaps scrub starts 2024-09-19T04:43:31.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:30 smithi018 ceph-mon[34537]: purged_snaps scrub ok 2024-09-19T04:43:31.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:30 smithi018 ceph-mon[34537]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:43:31.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:30 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:43:31.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:30 smithi018 ceph-mon[34537]: osd.6 [v2:172.21.15.2:6818/1185564560,v1:172.21.15.2:6819/1185564560] boot 2024-09-19T04:43:31.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:30 smithi018 ceph-mon[34537]: osdmap e42: 7 total, 7 up, 7 in 2024-09-19T04:43:31.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:30 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:43:31.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:30 smithi018 ceph-mon[34537]: from='client.? 172.21.15.18:0/3436742389' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "96a444c3-429a-48b6-9823-95c9e171341a"}]: dispatch 2024-09-19T04:43:31.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:30 smithi018 ceph-mon[34537]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "96a444c3-429a-48b6-9823-95c9e171341a"}]: dispatch 2024-09-19T04:43:31.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:30 smithi018 ceph-mon[34537]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "96a444c3-429a-48b6-9823-95c9e171341a"}]': finished 2024-09-19T04:43:31.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:30 smithi018 ceph-mon[34537]: osdmap e43: 8 total, 7 up, 8 in 2024-09-19T04:43:31.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:30 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:43:31.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:30 smithi002 ceph-mon[30975]: purged_snaps scrub starts 2024-09-19T04:43:31.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:30 smithi002 ceph-mon[30975]: purged_snaps scrub ok 2024-09-19T04:43:31.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:30 smithi002 ceph-mon[30975]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:43:31.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:30 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:43:31.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:30 smithi002 ceph-mon[30975]: osd.6 [v2:172.21.15.2:6818/1185564560,v1:172.21.15.2:6819/1185564560] boot 2024-09-19T04:43:31.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:30 smithi002 ceph-mon[30975]: osdmap e42: 7 total, 7 up, 7 in 2024-09-19T04:43:31.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:30 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:43:31.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:30 smithi002 ceph-mon[30975]: from='client.? 172.21.15.18:0/3436742389' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "96a444c3-429a-48b6-9823-95c9e171341a"}]: dispatch 2024-09-19T04:43:31.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:30 smithi002 ceph-mon[30975]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "96a444c3-429a-48b6-9823-95c9e171341a"}]: dispatch 2024-09-19T04:43:31.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:30 smithi002 ceph-mon[30975]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "96a444c3-429a-48b6-9823-95c9e171341a"}]': finished 2024-09-19T04:43:31.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:30 smithi002 ceph-mon[30975]: osdmap e43: 8 total, 7 up, 8 in 2024-09-19T04:43:31.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:30 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:43:31.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:30 smithi116 ceph-mon[34477]: purged_snaps scrub starts 2024-09-19T04:43:31.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:30 smithi116 ceph-mon[34477]: purged_snaps scrub ok 2024-09-19T04:43:31.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:30 smithi116 ceph-mon[34477]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:43:31.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:30 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:43:31.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:30 smithi116 ceph-mon[34477]: osd.6 [v2:172.21.15.2:6818/1185564560,v1:172.21.15.2:6819/1185564560] boot 2024-09-19T04:43:31.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:30 smithi116 ceph-mon[34477]: osdmap e42: 7 total, 7 up, 7 in 2024-09-19T04:43:31.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:30 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:43:31.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:30 smithi116 ceph-mon[34477]: from='client.? 172.21.15.18:0/3436742389' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "96a444c3-429a-48b6-9823-95c9e171341a"}]: dispatch 2024-09-19T04:43:31.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:30 smithi116 ceph-mon[34477]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "96a444c3-429a-48b6-9823-95c9e171341a"}]: dispatch 2024-09-19T04:43:31.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:30 smithi116 ceph-mon[34477]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "96a444c3-429a-48b6-9823-95c9e171341a"}]': finished 2024-09-19T04:43:31.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:30 smithi116 ceph-mon[34477]: osdmap e43: 8 total, 7 up, 8 in 2024-09-19T04:43:31.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:30 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:43:32.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:31 smithi018 ceph-mon[34537]: from='client.? 172.21.15.18:0/4198725059' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:43:32.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:31 smithi002 ceph-mon[30975]: from='client.? 172.21.15.18:0/4198725059' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:43:32.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:31 smithi116 ceph-mon[34477]: from='client.? 172.21.15.18:0/4198725059' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:43:33.261 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:32 smithi002 ceph-mon[30975]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:43:33.261 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:32 smithi002 ceph-mon[30975]: osdmap e44: 8 total, 7 up, 8 in 2024-09-19T04:43:33.261 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:32 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:43:33.306 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:32 smithi018 ceph-mon[34537]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:43:33.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:32 smithi018 ceph-mon[34537]: osdmap e44: 8 total, 7 up, 8 in 2024-09-19T04:43:33.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:32 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:43:33.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:32 smithi116 ceph-mon[34477]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:43:33.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:32 smithi116 ceph-mon[34477]: osdmap e44: 8 total, 7 up, 8 in 2024-09-19T04:43:33.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:32 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:43:35.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:34 smithi018 ceph-mon[34537]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:43:35.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:34 smithi002 ceph-mon[30975]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:43:35.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:34 smithi116 ceph-mon[34477]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:43:37.215 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:36 smithi018 ceph-mon[34537]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:43:37.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:36 smithi002 ceph-mon[30975]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:43:37.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:36 smithi116 ceph-mon[34477]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:43:39.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:38 smithi018 ceph-mon[34537]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:43:39.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:38 smithi002 ceph-mon[30975]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:43:39.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:38 smithi116 ceph-mon[34477]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:43:40.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:39 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T04:43:40.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:39 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:43:40.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:39 smithi018 ceph-mon[34537]: Deploying daemon osd.7 on smithi018 2024-09-19T04:43:40.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:39 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T04:43:40.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:39 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:43:40.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:39 smithi002 ceph-mon[30975]: Deploying daemon osd.7 on smithi018 2024-09-19T04:43:40.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:39 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T04:43:40.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:39 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:43:40.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:39 smithi116 ceph-mon[34477]: Deploying daemon osd.7 on smithi018 2024-09-19T04:43:41.266 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:40 smithi018 ceph-mon[34537]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:43:41.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:40 smithi002 ceph-mon[30975]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:43:41.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:40 smithi116 ceph-mon[34477]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:43:43.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:42 smithi018 ceph-mon[34537]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:43:43.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:42 smithi002 ceph-mon[30975]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:43:43.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:42 smithi116 ceph-mon[34477]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:43:45.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:44 smithi018 ceph-mon[34537]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:43:45.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:44 smithi002 ceph-mon[30975]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:43:45.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:44 smithi116 ceph-mon[34477]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:43:46.142 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:45 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:43:46.143 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:45 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:46.143 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:45 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:46.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:45 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:43:46.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:45 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:46.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:45 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:46.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:45 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:43:46.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:45 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:46.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:45 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:47.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:47 smithi018 ceph-mon[34537]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:43:47.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:47 smithi002 ceph-mon[30975]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:43:47.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:47 smithi116 ceph-mon[34477]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:43:49.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:49.130+0000 7fd2dd7fa640 1 -- 172.21.15.18:0/1684675120 <== mgr.14150 v2:172.21.15.2:6800/3171525177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd2e006a6b0 con 0x7fd2c80a32c0 2024-09-19T04:43:49.133 INFO:teuthology.orchestra.run.smithi018.stdout:Created osd(s) 7 on host 'smithi018' 2024-09-19T04:43:49.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:49.132+0000 7fd2e6335640 1 -- 172.21.15.18:0/1684675120 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd2c80a32c0 msgr2=0x7fd2c80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:43:49.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:49.132+0000 7fd2e6335640 1 --2- 172.21.15.18:0/1684675120 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd2c80a32c0 0x7fd2c80a5780 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4006010 tx=0x7fd2d4000bc0 comp rx=0 tx=0).stop 2024-09-19T04:43:49.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:49.132+0000 7fd2e6335640 1 -- 172.21.15.18:0/1684675120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2e0100ad0 msgr2=0x7fd2e0104a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:43:49.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:49.132+0000 7fd2e6335640 1 --2- 172.21.15.18:0/1684675120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2e0100ad0 0x7fd2e0104a60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd2d000d770 tx=0x7fd2d000dc30 comp rx=0 tx=0).stop 2024-09-19T04:43:49.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:49.132+0000 7fd2e6335640 1 -- 172.21.15.18:0/1684675120 shutdown_connections 2024-09-19T04:43:49.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:49.132+0000 7fd2e6335640 1 --2- 172.21.15.18:0/1684675120 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd2c80a32c0 0x7fd2c80a5780 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:43:49.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:49.132+0000 7fd2e6335640 1 --2- 172.21.15.18:0/1684675120 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd2e0102690 0x7fd2e01035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:43:49.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:49.132+0000 7fd2e6335640 1 --2- 172.21.15.18:0/1684675120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2e0101cd0 0x7fd2e01030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:43:49.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:49.132+0000 7fd2e6335640 1 --2- 172.21.15.18:0/1684675120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2e0100ad0 0x7fd2e0104a60 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:43:49.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:49.132+0000 7fd2e6335640 1 -- 172.21.15.18:0/1684675120 >> 172.21.15.18:0/1684675120 conn(0x7fd2e00fc280 msgr2=0x7fd2e0069fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:43:49.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:49.132+0000 7fd2e6335640 1 -- 172.21.15.18:0/1684675120 shutdown_connections 2024-09-19T04:43:49.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:43:49.132+0000 7fd2e6335640 1 -- 172.21.15.18:0/1684675120 wait complete. 2024-09-19T04:43:49.509 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:49 smithi018 ceph-mon[34537]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:43:49.510 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:49 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:49.510 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:49 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:49.510 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:49 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:43:49.510 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:49 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:43:49.510 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:49 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:49.510 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:49 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:43:49.510 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:49 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:49.510 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:49 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:49.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:49 smithi002 ceph-mon[30975]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:43:49.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:49 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:49.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:49 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:49.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:49 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:43:49.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:49 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:43:49.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:49 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:49.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:49 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:43:49.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:49 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:49.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:49 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:49.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:49 smithi116 ceph-mon[34477]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:43:49.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:49 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:49.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:49 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:49.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:49 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:43:49.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:49 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:43:49.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:49 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:49.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:49 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:43:49.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:49 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:49.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:49 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:49.874 DEBUG:teuthology.orchestra.run.smithi018:osd.7> sudo journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@osd.7.service 2024-09-19T04:43:49.877 INFO:tasks.cephadm:Deploying osd.8 on smithi116 with /dev/vg_nvme/lv_2... 2024-09-19T04:43:49.877 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T04:43:50.128 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T04:43:51.468 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:51 smithi116 ceph-mon[34477]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:43:51.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:51 smithi018 ceph-mon[34537]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:43:51.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:51 smithi002 ceph-mon[30975]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:43:52.057 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 04:43:51 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T04:43:51.689+0000 7f16ed009640 -1 osd.7 0 log_to_monitors true 2024-09-19T04:43:52.480 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:52 smithi116 ceph-mon[34477]: from='osd.7 [v2:172.21.15.18:6816/3691801363,v1:172.21.15.18:6817/3691801363]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T04:43:52.480 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:52 smithi116 ceph-mon[34477]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T04:43:52.483 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-19T04:43:52.498 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:52 smithi018 ceph-mon[34537]: from='osd.7 [v2:172.21.15.18:6816/3691801363,v1:172.21.15.18:6817/3691801363]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T04:43:52.498 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:52 smithi018 ceph-mon[34537]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T04:43:52.510 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi116:vg_nvme/lv_2 2024-09-19T04:43:52.609 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:52 smithi002 ceph-mon[30975]: from='osd.7 [v2:172.21.15.18:6816/3691801363,v1:172.21.15.18:6817/3691801363]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T04:43:52.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:52 smithi002 ceph-mon[30975]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T04:43:52.761 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T04:43:53.152 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:43:53.148+0000 7fd04ba35640 1 -- 172.21.15.116:0/69083656 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd044100ad0 msgr2=0x7fd044100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:43:53.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:43:53.148+0000 7fd04ba35640 1 --2- 172.21.15.116:0/69083656 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd044100ad0 0x7fd044100ed0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd040009900 tx=0x7fd04002a410 comp rx=0 tx=0).stop 2024-09-19T04:43:53.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:43:53.148+0000 7fd04ba35640 1 -- 172.21.15.116:0/69083656 shutdown_connections 2024-09-19T04:43:53.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:43:53.148+0000 7fd04ba35640 1 --2- 172.21.15.116:0/69083656 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd044102690 0x7fd044108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:43:53.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:43:53.148+0000 7fd04ba35640 1 --2- 172.21.15.116:0/69083656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd044101cd0 0x7fd044102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:43:53.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:43:53.148+0000 7fd04ba35640 1 --2- 172.21.15.116:0/69083656 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd044100ad0 0x7fd044100ed0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:43:53.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:43:53.148+0000 7fd04ba35640 1 -- 172.21.15.116:0/69083656 >> 172.21.15.116:0/69083656 conn(0x7fd0440fc280 msgr2=0x7fd0440fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:43:53.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:43:53.149+0000 7fd04ba35640 1 -- 172.21.15.116:0/69083656 shutdown_connections 2024-09-19T04:43:53.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:43:53.149+0000 7fd04ba35640 1 -- 172.21.15.116:0/69083656 wait complete. 2024-09-19T04:43:53.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:43:53.149+0000 7fd04ba35640 1 Processor -- start 2024-09-19T04:43:53.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:43:53.149+0000 7fd04ba35640 1 -- start start 2024-09-19T04:43:53.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:43:53.149+0000 7fd04ba35640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd044100ad0 0x7fd04406aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:43:53.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:43:53.149+0000 7fd04ba35640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd044101cd0 0x7fd04419cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:43:53.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:43:53.149+0000 7fd04ba35640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd044102690 0x7fd04419f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:43:53.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:43:53.150+0000 7fd04ba35640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd04410c610 con 0x7fd044102690 2024-09-19T04:43:53.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:43:53.150+0000 7fd04ba35640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd04410c490 con 0x7fd044101cd0 2024-09-19T04:43:53.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:43:53.150+0000 7fd04ba35640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fd04410c790 con 0x7fd044100ad0 2024-09-19T04:43:53.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:43:53.150+0000 7fd0497d1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd044100ad0 0x7fd04406aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:43:53.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:43:53.150+0000 7fd0497d1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd044100ad0 0x7fd04406aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:53976/0 (socket says 172.21.15.116:53976) 2024-09-19T04:43:53.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:43:53.150+0000 7fd0497d1640 1 -- 172.21.15.116:0/2922401422 learned_addr learned my addr 172.21.15.116:0/2922401422 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-19T04:43:53.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:43:53.150+0000 7fd048fd0640 1 --2- 172.21.15.116:0/2922401422 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd044101cd0 0x7fd04419cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:43:53.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:43:53.150+0000 7fd0497d1640 1 -- 172.21.15.116:0/2922401422 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd044101cd0 msgr2=0x7fd04419cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:43:53.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:43:53.150+0000 7fd0497d1640 1 --2- 172.21.15.116:0/2922401422 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd044101cd0 0x7fd04419cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:43:53.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:43:53.150+0000 7fd0497d1640 1 -- 172.21.15.116:0/2922401422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd044102690 msgr2=0x7fd04419f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:43:53.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:43:53.150+0000 7fd0497d1640 1 --2- 172.21.15.116:0/2922401422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd044102690 0x7fd04419f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:43:53.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:43:53.150+0000 7fd0497d1640 1 -- 172.21.15.116:0/2922401422 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd04419fa90 con 0x7fd044100ad0 2024-09-19T04:43:53.155 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:43:53.150+0000 7fd048fd0640 1 --2- 172.21.15.116:0/2922401422 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd044101cd0 0x7fd04419cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:43:53.155 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:43:53.150+0000 7fd0497d1640 1 --2- 172.21.15.116:0/2922401422 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd044100ad0 0x7fd04406aad0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd0400314e0 tx=0x7fd040031a30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:43:53.155 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:43:53.150+0000 7fd03a7fc640 1 -- 172.21.15.116:0/2922401422 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04003f030 con 0x7fd044100ad0 2024-09-19T04:43:53.155 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:43:53.150+0000 7fd04ba35640 1 -- 172.21.15.116:0/2922401422 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd04419fcc0 con 0x7fd044100ad0 2024-09-19T04:43:53.155 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:43:53.150+0000 7fd03a7fc640 1 -- 172.21.15.116:0/2922401422 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd0400044b0 con 0x7fd044100ad0 2024-09-19T04:43:53.155 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:43:53.150+0000 7fd03a7fc640 1 -- 172.21.15.116:0/2922401422 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd040035070 con 0x7fd044100ad0 2024-09-19T04:43:53.155 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:43:53.150+0000 7fd04ba35640 1 -- 172.21.15.116:0/2922401422 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0441a01a0 con 0x7fd044100ad0 2024-09-19T04:43:53.156 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:43:53.151+0000 7fd04ba35640 1 -- 172.21.15.116:0/2922401422 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd044107f20 con 0x7fd044100ad0 2024-09-19T04:43:53.156 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:43:53.153+0000 7fd03a7fc640 1 -- 172.21.15.116:0/2922401422 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fd040042030 con 0x7fd044100ad0 2024-09-19T04:43:53.156 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:43:53.154+0000 7fd03a7fc640 1 --2- 172.21.15.116:0/2922401422 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd0300a3240 0x7fd0300a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:43:53.156 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:43:53.154+0000 7fd03a7fc640 1 -- 172.21.15.116:0/2922401422 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5101+0+0 (secure 0 0 0) 0x7fd0400ef750 con 0x7fd044100ad0 2024-09-19T04:43:53.156 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:43:53.154+0000 7fd048fd0640 1 --2- 172.21.15.116:0/2922401422 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd0300a3240 0x7fd0300a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:43:53.156 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:43:53.154+0000 7fd048fd0640 1 --2- 172.21.15.116:0/2922401422 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd0300a3240 0x7fd0300a5700 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd04406b050 tx=0x7fd034005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:43:53.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:43:53.157+0000 7fd03a7fc640 1 -- 172.21.15.116:0/2922401422 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd0400bd180 con 0x7fd044100ad0 2024-09-19T04:43:53.340 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:43:53.339+0000 7fd04ba35640 1 -- 172.21.15.116:0/2922401422 --> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fd044062630 con 0x7fd0300a3240 2024-09-19T04:43:53.557 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 04:43:53 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T04:43:53.183+0000 7f16e8769640 -1 osd.7 0 waiting for initial osdmap 2024-09-19T04:43:53.557 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 04:43:53 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T04:43:53.195+0000 7f16e4da3640 -1 osd.7 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T04:43:53.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:53 smithi018 ceph-mon[34537]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:43:53.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:53 smithi018 ceph-mon[34537]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T04:43:53.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:53 smithi018 ceph-mon[34537]: from='osd.7 [v2:172.21.15.18:6816/3691801363,v1:172.21.15.18:6817/3691801363]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-19T04:43:53.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:53 smithi018 ceph-mon[34537]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T04:43:53.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:53 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:43:53.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:53 smithi018 ceph-mon[34537]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-19T04:43:53.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:53 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:53.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:53 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:53.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:53 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:43:53.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:53 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:43:53.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:53 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:43:53.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:53 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:53.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:53 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:43:53.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:53 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:43:53.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:53 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:53.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:53 smithi002 ceph-mon[30975]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:43:53.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:53 smithi002 ceph-mon[30975]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T04:43:53.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:53 smithi002 ceph-mon[30975]: from='osd.7 [v2:172.21.15.18:6816/3691801363,v1:172.21.15.18:6817/3691801363]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-19T04:43:53.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:53 smithi002 ceph-mon[30975]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T04:43:53.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:53 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:43:53.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:53 smithi002 ceph-mon[30975]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-19T04:43:53.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:53 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:53.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:53 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:53.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:53 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:43:53.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:53 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:43:53.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:53 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:43:53.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:53 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:53.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:53 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:43:53.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:53 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:43:53.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:53 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:53.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:53 smithi116 ceph-mon[34477]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:43:53.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:53 smithi116 ceph-mon[34477]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T04:43:53.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:53 smithi116 ceph-mon[34477]: from='osd.7 [v2:172.21.15.18:6816/3691801363,v1:172.21.15.18:6817/3691801363]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-19T04:43:53.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:53 smithi116 ceph-mon[34477]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T04:43:53.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:53 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:43:53.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:53 smithi116 ceph-mon[34477]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-19T04:43:53.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:53 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:53.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:53 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:53.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:53 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:43:53.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:53 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:43:53.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:53 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:43:53.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:53 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:53.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:53 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:43:53.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:53 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:43:53.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:53 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:43:54.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:54 smithi116 ceph-mon[34477]: Detected new or changed devices on smithi018 2024-09-19T04:43:54.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:54 smithi116 ceph-mon[34477]: Adjusting osd_memory_target on smithi018 to 5697M 2024-09-19T04:43:54.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:54 smithi116 ceph-mon[34477]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-19T04:43:54.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:54 smithi116 ceph-mon[34477]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T04:43:54.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:54 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:43:54.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:54 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:43:54.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:54 smithi116 ceph-mon[34477]: from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:43:54.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:54 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:43:54.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:54 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:43:54.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:54 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:43:54.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:54 smithi018 ceph-mon[34537]: Detected new or changed devices on smithi018 2024-09-19T04:43:54.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:54 smithi018 ceph-mon[34537]: Adjusting osd_memory_target on smithi018 to 5697M 2024-09-19T04:43:54.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:54 smithi018 ceph-mon[34537]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-19T04:43:54.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:54 smithi018 ceph-mon[34537]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T04:43:54.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:54 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:43:54.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:54 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:43:54.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:54 smithi018 ceph-mon[34537]: from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:43:54.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:54 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:43:54.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:54 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:43:54.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:54 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:43:54.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:54 smithi002 ceph-mon[30975]: Detected new or changed devices on smithi018 2024-09-19T04:43:54.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:54 smithi002 ceph-mon[30975]: Adjusting osd_memory_target on smithi018 to 5697M 2024-09-19T04:43:54.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:54 smithi002 ceph-mon[30975]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-19T04:43:54.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:54 smithi002 ceph-mon[30975]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T04:43:54.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:54 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:43:54.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:54 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:43:54.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:54 smithi002 ceph-mon[30975]: from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:43:54.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:54 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:43:54.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:54 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:43:54.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:54 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:43:55.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:55 smithi018 ceph-mon[34537]: purged_snaps scrub starts 2024-09-19T04:43:55.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:55 smithi018 ceph-mon[34537]: purged_snaps scrub ok 2024-09-19T04:43:55.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:55 smithi018 ceph-mon[34537]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:43:55.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:55 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:43:55.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:55 smithi018 ceph-mon[34537]: osd.7 [v2:172.21.15.18:6816/3691801363,v1:172.21.15.18:6817/3691801363] boot 2024-09-19T04:43:55.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:55 smithi018 ceph-mon[34537]: osdmap e47: 8 total, 8 up, 8 in 2024-09-19T04:43:55.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:55 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:43:55.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:55 smithi018 ceph-mon[34537]: osdmap e48: 8 total, 8 up, 8 in 2024-09-19T04:43:55.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:55 smithi002 ceph-mon[30975]: purged_snaps scrub starts 2024-09-19T04:43:55.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:55 smithi002 ceph-mon[30975]: purged_snaps scrub ok 2024-09-19T04:43:55.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:55 smithi002 ceph-mon[30975]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:43:55.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:55 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:43:55.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:55 smithi002 ceph-mon[30975]: osd.7 [v2:172.21.15.18:6816/3691801363,v1:172.21.15.18:6817/3691801363] boot 2024-09-19T04:43:55.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:55 smithi002 ceph-mon[30975]: osdmap e47: 8 total, 8 up, 8 in 2024-09-19T04:43:55.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:55 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:43:55.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:55 smithi002 ceph-mon[30975]: osdmap e48: 8 total, 8 up, 8 in 2024-09-19T04:43:55.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:55 smithi116 ceph-mon[34477]: purged_snaps scrub starts 2024-09-19T04:43:55.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:55 smithi116 ceph-mon[34477]: purged_snaps scrub ok 2024-09-19T04:43:55.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:55 smithi116 ceph-mon[34477]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:43:55.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:55 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:43:55.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:55 smithi116 ceph-mon[34477]: osd.7 [v2:172.21.15.18:6816/3691801363,v1:172.21.15.18:6817/3691801363] boot 2024-09-19T04:43:55.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:55 smithi116 ceph-mon[34477]: osdmap e47: 8 total, 8 up, 8 in 2024-09-19T04:43:55.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:55 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:43:55.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:55 smithi116 ceph-mon[34477]: osdmap e48: 8 total, 8 up, 8 in 2024-09-19T04:43:56.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:56 smithi018 ceph-mon[34537]: from='client.? 172.21.15.116:0/4273114740' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c3f696aa-be7d-4f67-9147-3751406e394d"}]: dispatch 2024-09-19T04:43:56.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:56 smithi018 ceph-mon[34537]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c3f696aa-be7d-4f67-9147-3751406e394d"}]: dispatch 2024-09-19T04:43:56.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:56 smithi018 ceph-mon[34537]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c3f696aa-be7d-4f67-9147-3751406e394d"}]': finished 2024-09-19T04:43:56.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:56 smithi018 ceph-mon[34537]: osdmap e49: 9 total, 8 up, 9 in 2024-09-19T04:43:56.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:56 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:43:56.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:56 smithi002 ceph-mon[30975]: from='client.? 172.21.15.116:0/4273114740' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c3f696aa-be7d-4f67-9147-3751406e394d"}]: dispatch 2024-09-19T04:43:56.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:56 smithi002 ceph-mon[30975]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c3f696aa-be7d-4f67-9147-3751406e394d"}]: dispatch 2024-09-19T04:43:56.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:56 smithi002 ceph-mon[30975]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c3f696aa-be7d-4f67-9147-3751406e394d"}]': finished 2024-09-19T04:43:56.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:56 smithi002 ceph-mon[30975]: osdmap e49: 9 total, 8 up, 9 in 2024-09-19T04:43:56.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:56 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:43:56.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:56 smithi116 ceph-mon[34477]: from='client.? 172.21.15.116:0/4273114740' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c3f696aa-be7d-4f67-9147-3751406e394d"}]: dispatch 2024-09-19T04:43:56.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:56 smithi116 ceph-mon[34477]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c3f696aa-be7d-4f67-9147-3751406e394d"}]: dispatch 2024-09-19T04:43:56.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:56 smithi116 ceph-mon[34477]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c3f696aa-be7d-4f67-9147-3751406e394d"}]': finished 2024-09-19T04:43:56.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:56 smithi116 ceph-mon[34477]: osdmap e49: 9 total, 8 up, 9 in 2024-09-19T04:43:56.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:56 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:43:57.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:57 smithi018 ceph-mon[34537]: pgmap v168: 1 pgs: 1 remapped+peering; 577 KiB data, 261 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:43:57.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:57 smithi018 ceph-mon[34537]: from='client.? 172.21.15.116:0/1631133620' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:43:57.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:57 smithi018 ceph-mon[34537]: osdmap e50: 9 total, 8 up, 9 in 2024-09-19T04:43:57.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:57 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:43:57.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:57 smithi002 ceph-mon[30975]: pgmap v168: 1 pgs: 1 remapped+peering; 577 KiB data, 261 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:43:57.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:57 smithi002 ceph-mon[30975]: from='client.? 172.21.15.116:0/1631133620' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:43:57.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:57 smithi002 ceph-mon[30975]: osdmap e50: 9 total, 8 up, 9 in 2024-09-19T04:43:57.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:57 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:43:57.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:57 smithi116 ceph-mon[34477]: pgmap v168: 1 pgs: 1 remapped+peering; 577 KiB data, 261 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:43:57.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:57 smithi116 ceph-mon[34477]: from='client.? 172.21.15.116:0/1631133620' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:43:57.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:57 smithi116 ceph-mon[34477]: osdmap e50: 9 total, 8 up, 9 in 2024-09-19T04:43:57.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:57 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:43:59.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:58 smithi018 ceph-mon[34537]: pgmap v171: 1 pgs: 1 remapped+peering; 577 KiB data, 261 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:43:59.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:58 smithi018 ceph-mon[34537]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T04:43:59.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:43:58 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:43:59.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:58 smithi002 ceph-mon[30975]: pgmap v171: 1 pgs: 1 remapped+peering; 577 KiB data, 261 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:43:59.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:58 smithi002 ceph-mon[30975]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T04:43:59.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:43:58 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:43:59.110 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:58 smithi116 ceph-mon[34477]: pgmap v171: 1 pgs: 1 remapped+peering; 577 KiB data, 261 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:43:59.110 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:58 smithi116 ceph-mon[34477]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T04:43:59.110 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:43:58 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:44:01.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:00 smithi018 ceph-mon[34537]: pgmap v173: 1 pgs: 1 remapped+peering; 577 KiB data, 261 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:44:01.096 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:00 smithi116 ceph-mon[34477]: pgmap v173: 1 pgs: 1 remapped+peering; 577 KiB data, 261 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:44:01.109 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:00 smithi002 ceph-mon[30975]: pgmap v173: 1 pgs: 1 remapped+peering; 577 KiB data, 261 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:44:03.047 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:02 smithi116 ceph-mon[34477]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:44:03.056 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:02 smithi018 ceph-mon[34537]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:44:03.109 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:02 smithi002 ceph-mon[30975]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:44:04.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:04 smithi116 ceph-mon[34477]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:44:04.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:04 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T04:44:04.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:04 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:44:04.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:04 smithi116 ceph-mon[34477]: Deploying daemon osd.8 on smithi116 2024-09-19T04:44:05.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:04 smithi018 ceph-mon[34537]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:44:05.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:04 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T04:44:05.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:04 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:44:05.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:04 smithi018 ceph-mon[34537]: Deploying daemon osd.8 on smithi116 2024-09-19T04:44:05.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:04 smithi002 ceph-mon[30975]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:44:05.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:04 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T04:44:05.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:04 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:44:05.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:04 smithi002 ceph-mon[30975]: Deploying daemon osd.8 on smithi116 2024-09-19T04:44:06.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:06 smithi116 ceph-mon[34477]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:44:07.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:06 smithi018 ceph-mon[34537]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:44:07.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:06 smithi002 ceph-mon[30975]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:44:08.948 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:08 smithi116 ceph-mon[34477]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:44:09.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:08 smithi018 ceph-mon[34537]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:44:09.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:08 smithi002 ceph-mon[30975]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:44:10.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:10 smithi116 ceph-mon[34477]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:44:10.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:10 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:44:10.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:10 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:10.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:10 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:11.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:10 smithi018 ceph-mon[34537]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:44:11.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:10 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:44:11.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:10 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:11.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:10 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:11.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:10 smithi002 ceph-mon[30975]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:44:11.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:10 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:44:11.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:10 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:11.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:10 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:12.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:12 smithi116 ceph-mon[34477]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:44:12.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:44:12.905+0000 7fd03a7fc640 1 -- 172.21.15.116:0/2922401422 <== mgr.14150 v2:172.21.15.2:6800/3171525177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd044062630 con 0x7fd0300a3240 2024-09-19T04:44:12.907 INFO:teuthology.orchestra.run.smithi116.stdout:Created osd(s) 8 on host 'smithi116' 2024-09-19T04:44:12.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:44:12.907+0000 7fd04ba35640 1 -- 172.21.15.116:0/2922401422 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd0300a3240 msgr2=0x7fd0300a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:44:12.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:44:12.907+0000 7fd04ba35640 1 --2- 172.21.15.116:0/2922401422 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd0300a3240 0x7fd0300a5700 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd04406b050 tx=0x7fd034005e50 comp rx=0 tx=0).stop 2024-09-19T04:44:12.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:44:12.907+0000 7fd04ba35640 1 -- 172.21.15.116:0/2922401422 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd044100ad0 msgr2=0x7fd04406aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:44:12.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:44:12.907+0000 7fd04ba35640 1 --2- 172.21.15.116:0/2922401422 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd044100ad0 0x7fd04406aad0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd0400314e0 tx=0x7fd040031a30 comp rx=0 tx=0).stop 2024-09-19T04:44:12.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:44:12.907+0000 7fd04ba35640 1 -- 172.21.15.116:0/2922401422 shutdown_connections 2024-09-19T04:44:12.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:44:12.907+0000 7fd04ba35640 1 --2- 172.21.15.116:0/2922401422 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd0300a3240 0x7fd0300a5700 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:44:12.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:44:12.907+0000 7fd04ba35640 1 --2- 172.21.15.116:0/2922401422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd044102690 0x7fd04419f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:44:12.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:44:12.907+0000 7fd04ba35640 1 --2- 172.21.15.116:0/2922401422 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd044101cd0 0x7fd04419cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:44:12.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:44:12.908+0000 7fd04ba35640 1 --2- 172.21.15.116:0/2922401422 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd044100ad0 0x7fd04406aad0 secure :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd0400314e0 tx=0x7fd040031a30 comp rx=0 tx=0).stop 2024-09-19T04:44:12.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:44:12.908+0000 7fd04ba35640 1 -- 172.21.15.116:0/2922401422 >> 172.21.15.116:0/2922401422 conn(0x7fd0440fc280 msgr2=0x7fd0441050f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:44:12.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:44:12.908+0000 7fd04ba35640 1 -- 172.21.15.116:0/2922401422 shutdown_connections 2024-09-19T04:44:12.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:44:12.908+0000 7fd04ba35640 1 -- 172.21.15.116:0/2922401422 wait complete. 2024-09-19T04:44:13.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:12 smithi018 ceph-mon[34537]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:44:13.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:12 smithi002 ceph-mon[30975]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:44:13.514 DEBUG:teuthology.orchestra.run.smithi116:osd.8> sudo journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@osd.8.service 2024-09-19T04:44:13.517 INFO:tasks.cephadm:Deploying osd.9 on smithi002 with /dev/vg_nvme/lv_1... 2024-09-19T04:44:13.517 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T04:44:13.786 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:44:14.158 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:13 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:14.158 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:13 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:14.158 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:13 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:14.158 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:13 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:14.163 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:13 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:14.163 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:13 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:14.163 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:13 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:14.163 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:13 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:14.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:13 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:14.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:13 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:14.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:13 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:14.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:13 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:15.169 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:14 smithi116 ceph-mon[34477]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:44:15.208 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:14 smithi018 ceph-mon[34537]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:44:15.232 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:14 smithi002 ceph-mon[30975]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:44:16.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:15 smithi002 ceph-mon[30975]: from='osd.8 [v2:172.21.15.116:6816/3709586119,v1:172.21.15.116:6817/3709586119]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T04:44:16.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:15 smithi002 ceph-mon[30975]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T04:44:16.110 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:15 smithi116 ceph-mon[34477]: from='osd.8 [v2:172.21.15.116:6816/3709586119,v1:172.21.15.116:6817/3709586119]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T04:44:16.110 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:15 smithi116 ceph-mon[34477]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T04:44:16.111 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 04:44:15 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T04:44:15.879+0000 7f460f97d640 -1 osd.8 0 log_to_monitors true 2024-09-19T04:44:16.224 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:15 smithi018 ceph-mon[34537]: from='osd.8 [v2:172.21.15.116:6816/3709586119,v1:172.21.15.116:6817/3709586119]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T04:44:16.224 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:15 smithi018 ceph-mon[34537]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T04:44:16.707 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:44:16.741 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi002:vg_nvme/lv_1 2024-09-19T04:44:17.003 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:44:17.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:16 smithi002 ceph-mon[30975]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:44:17.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:16 smithi002 ceph-mon[30975]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T04:44:17.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:16 smithi002 ceph-mon[30975]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T04:44:17.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:16 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:44:17.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:16 smithi002 ceph-mon[30975]: from='osd.8 [v2:172.21.15.116:6816/3709586119,v1:172.21.15.116:6817/3709586119]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-19T04:44:17.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:16 smithi002 ceph-mon[30975]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-19T04:44:17.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:16 smithi002 ceph-mon[30975]: Detected new or changed devices on smithi116 2024-09-19T04:44:17.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:16 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:17.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:16 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:17.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:16 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:44:17.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:16 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:44:17.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:16 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:44:17.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:16 smithi002 ceph-mon[30975]: Adjusting osd_memory_target on smithi116 to 5696M 2024-09-19T04:44:17.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:16 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:17.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:16 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:44:17.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:16 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:44:17.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:16 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:17.112 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:16 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:44:17.112 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:16 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:44:17.112 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:16 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:44:17.112 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:16 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:17.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:16 smithi018 ceph-mon[34537]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:44:17.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:16 smithi018 ceph-mon[34537]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T04:44:17.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:16 smithi018 ceph-mon[34537]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T04:44:17.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:16 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:44:17.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:16 smithi018 ceph-mon[34537]: from='osd.8 [v2:172.21.15.116:6816/3709586119,v1:172.21.15.116:6817/3709586119]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-19T04:44:17.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:16 smithi018 ceph-mon[34537]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-19T04:44:17.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:16 smithi018 ceph-mon[34537]: Detected new or changed devices on smithi116 2024-09-19T04:44:17.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:16 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:17.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:16 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:17.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:16 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:44:17.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:16 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:44:17.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:16 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:44:17.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:16 smithi018 ceph-mon[34537]: Adjusting osd_memory_target on smithi116 to 5696M 2024-09-19T04:44:17.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:16 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:17.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:16 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:44:17.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:16 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:44:17.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:16 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:17.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:16 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:44:17.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:16 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:44:17.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:16 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:44:17.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:16 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:17.360 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 04:44:16 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T04:44:16.921+0000 7f460b0dd640 -1 osd.8 0 waiting for initial osdmap 2024-09-19T04:44:17.361 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 04:44:16 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T04:44:16.932+0000 7f4607717640 -1 osd.8 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T04:44:17.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:16 smithi116 ceph-mon[34477]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:44:17.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:16 smithi116 ceph-mon[34477]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T04:44:17.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:16 smithi116 ceph-mon[34477]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T04:44:17.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:16 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:44:17.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:16 smithi116 ceph-mon[34477]: from='osd.8 [v2:172.21.15.116:6816/3709586119,v1:172.21.15.116:6817/3709586119]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-19T04:44:17.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:16 smithi116 ceph-mon[34477]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-19T04:44:17.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:16 smithi116 ceph-mon[34477]: Detected new or changed devices on smithi116 2024-09-19T04:44:17.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:16 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:17.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:16 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:17.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:16 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:44:17.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:16 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:44:17.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:16 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:44:17.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:16 smithi116 ceph-mon[34477]: Adjusting osd_memory_target on smithi116 to 5696M 2024-09-19T04:44:17.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:16 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:17.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:16 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:44:17.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:16 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:44:17.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:16 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:17.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:16 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:44:17.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:16 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:44:17.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:16 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:44:17.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:16 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:17.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:17.466+0000 7f1c0893a640 1 -- 172.21.15.2:0/423587073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c04100ad0 msgr2=0x7f1c04100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:44:17.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:17.466+0000 7f1c0893a640 1 --2- 172.21.15.2:0/423587073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c04100ad0 0x7f1c04100ed0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1bec009900 tx=0x7f1bec02a410 comp rx=0 tx=0).stop 2024-09-19T04:44:17.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:17.466+0000 7f1c0893a640 1 -- 172.21.15.2:0/423587073 shutdown_connections 2024-09-19T04:44:17.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:17.466+0000 7f1c0893a640 1 --2- 172.21.15.2:0/423587073 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c04102690 0x7f1c04108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:44:17.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:17.466+0000 7f1c0893a640 1 --2- 172.21.15.2:0/423587073 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c04101cd0 0x7f1c04102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:44:17.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:17.466+0000 7f1c0893a640 1 --2- 172.21.15.2:0/423587073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c04100ad0 0x7f1c04100ed0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:44:17.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:17.466+0000 7f1c0893a640 1 -- 172.21.15.2:0/423587073 >> 172.21.15.2:0/423587073 conn(0x7f1c040fc280 msgr2=0x7f1c040fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:44:17.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:17.466+0000 7f1c0893a640 1 -- 172.21.15.2:0/423587073 shutdown_connections 2024-09-19T04:44:17.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:17.466+0000 7f1c0893a640 1 -- 172.21.15.2:0/423587073 wait complete. 2024-09-19T04:44:17.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:17.467+0000 7f1c0893a640 1 Processor -- start 2024-09-19T04:44:17.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:17.467+0000 7f1c0893a640 1 -- start start 2024-09-19T04:44:17.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:17.467+0000 7f1c0893a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c04100ad0 0x7f1c04197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:44:17.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:17.467+0000 7f1c0893a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c04101cd0 0x7f1c041983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:44:17.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:17.467+0000 7f1c0893a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c04102690 0x7f1c0419f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:44:17.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:17.467+0000 7f1c0893a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1c0410c600 con 0x7f1c04102690 2024-09-19T04:44:17.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:17.467+0000 7f1c0893a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1c0410c480 con 0x7f1c04100ad0 2024-09-19T04:44:17.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:17.467+0000 7f1c0893a640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f1c0410c780 con 0x7f1c04101cd0 2024-09-19T04:44:17.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:17.467+0000 7f1c02d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c04102690 0x7f1c0419f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:44:17.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:17.467+0000 7f1c0259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c04100ad0 0x7f1c04197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:44:17.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:17.467+0000 7f1c02d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c04102690 0x7f1c0419f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49550/0 (socket says 172.21.15.2:49550) 2024-09-19T04:44:17.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:17.467+0000 7f1c0259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c04100ad0 0x7f1c04197e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.2:59588/0 (socket says 172.21.15.2:59588) 2024-09-19T04:44:17.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:17.467+0000 7f1c02d9d640 1 -- 172.21.15.2:0/415197821 learned_addr learned my addr 172.21.15.2:0/415197821 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:44:17.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:17.467+0000 7f1c01d9b640 1 --2- 172.21.15.2:0/415197821 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c04101cd0 0x7f1c041983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:44:17.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:17.468+0000 7f1c02d9d640 1 -- 172.21.15.2:0/415197821 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c04101cd0 msgr2=0x7f1c041983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:44:17.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:17.468+0000 7f1c02d9d640 1 --2- 172.21.15.2:0/415197821 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c04101cd0 0x7f1c041983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:44:17.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:17.468+0000 7f1c02d9d640 1 -- 172.21.15.2:0/415197821 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c04100ad0 msgr2=0x7f1c04197e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:44:17.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:17.468+0000 7f1c02d9d640 1 --2- 172.21.15.2:0/415197821 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c04100ad0 0x7f1c04197e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:44:17.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:17.468+0000 7f1c02d9d640 1 -- 172.21.15.2:0/415197821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c0419fac0 con 0x7f1c04102690 2024-09-19T04:44:17.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:17.468+0000 7f1c01d9b640 1 --2- 172.21.15.2:0/415197821 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c04101cd0 0x7f1c041983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:44:17.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:17.468+0000 7f1c0259c640 1 --2- 172.21.15.2:0/415197821 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c04100ad0 0x7f1c04197e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:44:17.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:17.468+0000 7f1c02d9d640 1 --2- 172.21.15.2:0/415197821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c04102690 0x7f1c0419f450 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc00eb10 tx=0x7f1bfc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:44:17.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:17.468+0000 7f1bfb7fe640 1 -- 172.21.15.2:0/415197821 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc004b20 con 0x7f1c04102690 2024-09-19T04:44:17.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:17.468+0000 7f1c0893a640 1 -- 172.21.15.2:0/415197821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c0419fdb0 con 0x7f1c04102690 2024-09-19T04:44:17.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:17.468+0000 7f1bfb7fe640 1 -- 172.21.15.2:0/415197821 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1bfc004cc0 con 0x7f1c04102690 2024-09-19T04:44:17.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:17.468+0000 7f1bfb7fe640 1 -- 172.21.15.2:0/415197821 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc010690 con 0x7f1c04102690 2024-09-19T04:44:17.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:17.468+0000 7f1c0893a640 1 -- 172.21.15.2:0/415197821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c041a0210 con 0x7f1c04102690 2024-09-19T04:44:17.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:17.469+0000 7f1c0893a640 1 -- 172.21.15.2:0/415197821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c041a04d0 con 0x7f1c04102690 2024-09-19T04:44:17.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:17.470+0000 7f1bfb7fe640 1 -- 172.21.15.2:0/415197821 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f1bfc004e70 con 0x7f1c04102690 2024-09-19T04:44:17.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:17.471+0000 7f1bfb7fe640 1 --2- 172.21.15.2:0/415197821 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f1bf00a3270 0x7f1bf00a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:44:17.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:17.471+0000 7f1c0259c640 1 --2- 172.21.15.2:0/415197821 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f1bf00a3270 0x7f1bf00a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:44:17.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:17.472+0000 7f1bfb7fe640 1 -- 172.21.15.2:0/415197821 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5549+0+0 (secure 0 0 0) 0x7f1bfc0cf520 con 0x7f1c04102690 2024-09-19T04:44:17.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:17.472+0000 7f1c0259c640 1 --2- 172.21.15.2:0/415197821 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f1bf00a3270 0x7f1bf00a5730 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1bec004770 tx=0x7f1bec000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:44:17.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:17.475+0000 7f1bfb7fe640 1 -- 172.21.15.2:0/415197821 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1bfc09cc70 con 0x7f1c04102690 2024-09-19T04:44:17.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:17.663+0000 7f1c0893a640 1 -- 172.21.15.2:0/415197821 --> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f1c0406a6f0 con 0x7f1bf00a3270 2024-09-19T04:44:18.232 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:17 smithi002 ceph-mon[30975]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-09-19T04:44:18.232 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:17 smithi002 ceph-mon[30975]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T04:44:18.233 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:17 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:44:18.233 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:17 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:44:18.233 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:17 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:44:18.233 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:17 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:44:18.233 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:17 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:44:18.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:17 smithi018 ceph-mon[34537]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-09-19T04:44:18.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:17 smithi018 ceph-mon[34537]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T04:44:18.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:17 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:44:18.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:17 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:44:18.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:17 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:44:18.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:17 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:44:18.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:17 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:44:18.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:17 smithi116 ceph-mon[34477]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-09-19T04:44:18.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:17 smithi116 ceph-mon[34477]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T04:44:18.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:17 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:44:18.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:17 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:44:18.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:17 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:44:18.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:17 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:44:18.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:17 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:44:19.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:18 smithi002 ceph-mon[30975]: purged_snaps scrub starts 2024-09-19T04:44:19.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:18 smithi002 ceph-mon[30975]: purged_snaps scrub ok 2024-09-19T04:44:19.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:18 smithi002 ceph-mon[30975]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:44:19.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:18 smithi002 ceph-mon[30975]: from='client.14439 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:44:19.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:18 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:44:19.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:18 smithi002 ceph-mon[30975]: osd.8 [v2:172.21.15.116:6816/3709586119,v1:172.21.15.116:6817/3709586119] boot 2024-09-19T04:44:19.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:18 smithi002 ceph-mon[30975]: osdmap e54: 9 total, 9 up, 9 in 2024-09-19T04:44:19.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:18 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:44:19.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:18 smithi018 ceph-mon[34537]: purged_snaps scrub starts 2024-09-19T04:44:19.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:18 smithi018 ceph-mon[34537]: purged_snaps scrub ok 2024-09-19T04:44:19.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:18 smithi018 ceph-mon[34537]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:44:19.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:18 smithi018 ceph-mon[34537]: from='client.14439 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:44:19.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:18 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:44:19.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:18 smithi018 ceph-mon[34537]: osd.8 [v2:172.21.15.116:6816/3709586119,v1:172.21.15.116:6817/3709586119] boot 2024-09-19T04:44:19.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:18 smithi018 ceph-mon[34537]: osdmap e54: 9 total, 9 up, 9 in 2024-09-19T04:44:19.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:18 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:44:19.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:18 smithi116 ceph-mon[34477]: purged_snaps scrub starts 2024-09-19T04:44:19.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:18 smithi116 ceph-mon[34477]: purged_snaps scrub ok 2024-09-19T04:44:19.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:18 smithi116 ceph-mon[34477]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:44:19.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:18 smithi116 ceph-mon[34477]: from='client.14439 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:44:19.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:18 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:44:19.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:18 smithi116 ceph-mon[34477]: osd.8 [v2:172.21.15.116:6816/3709586119,v1:172.21.15.116:6817/3709586119] boot 2024-09-19T04:44:19.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:18 smithi116 ceph-mon[34477]: osdmap e54: 9 total, 9 up, 9 in 2024-09-19T04:44:19.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:18 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:44:20.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:19 smithi018 ceph-mon[34537]: osdmap e55: 9 total, 9 up, 9 in 2024-09-19T04:44:20.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:19 smithi002 ceph-mon[30975]: osdmap e55: 9 total, 9 up, 9 in 2024-09-19T04:44:20.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:19 smithi116 ceph-mon[34477]: osdmap e55: 9 total, 9 up, 9 in 2024-09-19T04:44:21.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:20 smithi018 ceph-mon[34537]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:44:21.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:20 smithi018 ceph-mon[34537]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T04:44:21.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:20 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/2520860687' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4892549d-f050-48c5-b695-5924b612a581"}]: dispatch 2024-09-19T04:44:21.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:20 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/2520860687' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4892549d-f050-48c5-b695-5924b612a581"}]': finished 2024-09-19T04:44:21.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:20 smithi018 ceph-mon[34537]: osdmap e57: 10 total, 9 up, 10 in 2024-09-19T04:44:21.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:20 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:44:21.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:20 smithi002 ceph-mon[30975]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:44:21.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:20 smithi002 ceph-mon[30975]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T04:44:21.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:20 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/2520860687' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4892549d-f050-48c5-b695-5924b612a581"}]: dispatch 2024-09-19T04:44:21.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:20 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/2520860687' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4892549d-f050-48c5-b695-5924b612a581"}]': finished 2024-09-19T04:44:21.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:20 smithi002 ceph-mon[30975]: osdmap e57: 10 total, 9 up, 10 in 2024-09-19T04:44:21.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:20 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:44:21.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:20 smithi116 ceph-mon[34477]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:44:21.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:20 smithi116 ceph-mon[34477]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T04:44:21.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:20 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/2520860687' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4892549d-f050-48c5-b695-5924b612a581"}]: dispatch 2024-09-19T04:44:21.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:20 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/2520860687' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4892549d-f050-48c5-b695-5924b612a581"}]': finished 2024-09-19T04:44:21.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:20 smithi116 ceph-mon[34477]: osdmap e57: 10 total, 9 up, 10 in 2024-09-19T04:44:21.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:20 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:44:22.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:21 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/119839741' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:44:22.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:21 smithi018 ceph-mon[34537]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T04:44:22.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:21 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:44:22.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:21 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/119839741' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:44:22.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:21 smithi002 ceph-mon[30975]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T04:44:22.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:21 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:44:22.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:21 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/119839741' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:44:22.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:21 smithi116 ceph-mon[34477]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T04:44:22.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:21 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:44:23.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:23 smithi002 ceph-mon[30975]: pgmap v191: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail; 161 KiB/s, 0 objects/s recovering 2024-09-19T04:44:23.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:23 smithi116 ceph-mon[34477]: pgmap v191: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail; 161 KiB/s, 0 objects/s recovering 2024-09-19T04:44:23.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:23 smithi018 ceph-mon[34537]: pgmap v191: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail; 161 KiB/s, 0 objects/s recovering 2024-09-19T04:44:25.537 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:25 smithi002 ceph-mon[30975]: pgmap v192: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail; 126 KiB/s, 0 objects/s recovering 2024-09-19T04:44:25.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:25 smithi116 ceph-mon[34477]: pgmap v192: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail; 126 KiB/s, 0 objects/s recovering 2024-09-19T04:44:25.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:25 smithi018 ceph-mon[34537]: pgmap v192: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail; 126 KiB/s, 0 objects/s recovering 2024-09-19T04:44:27.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:27 smithi002 ceph-mon[30975]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T04:44:27.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:27 smithi116 ceph-mon[34477]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T04:44:27.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:27 smithi018 ceph-mon[34537]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T04:44:29.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:29 smithi002 ceph-mon[30975]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-19T04:44:29.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:29 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T04:44:29.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:29 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:44:29.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:29 smithi116 ceph-mon[34477]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-19T04:44:29.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:29 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T04:44:29.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:29 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:44:29.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:29 smithi018 ceph-mon[34537]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-19T04:44:29.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:29 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T04:44:29.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:29 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:44:30.609 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:30 smithi002 ceph-mon[30975]: Deploying daemon osd.9 on smithi002 2024-09-19T04:44:30.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:30 smithi018 ceph-mon[34537]: Deploying daemon osd.9 on smithi002 2024-09-19T04:44:30.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:30 smithi116 ceph-mon[34477]: Deploying daemon osd.9 on smithi002 2024-09-19T04:44:31.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:31 smithi002 ceph-mon[30975]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:44:31.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:31 smithi018 ceph-mon[34537]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:44:31.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:31 smithi116 ceph-mon[34477]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:44:33.504 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:33 smithi002 ceph-mon[30975]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:44:33.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:33 smithi018 ceph-mon[34537]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:44:33.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:33 smithi116 ceph-mon[34477]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:44:35.448 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:35 smithi002 ceph-mon[30975]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:44:35.448 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:35 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:44:35.449 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:35 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:35.449 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:35 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:35.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:35 smithi018 ceph-mon[34537]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:44:35.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:35 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:44:35.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:35 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:35.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:35 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:35.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:35 smithi116 ceph-mon[34477]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:44:35.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:35 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:44:35.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:35 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:35.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:35 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:37.779 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:37 smithi002 ceph-mon[30975]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:44:37.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:37 smithi018 ceph-mon[34537]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:44:37.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:37 smithi116 ceph-mon[34477]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:44:38.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:38.194+0000 7f1bfb7fe640 1 -- 172.21.15.2:0/415197821 <== mgr.14150 v2:172.21.15.2:6800/3171525177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1c0406a6f0 con 0x7f1bf00a3270 2024-09-19T04:44:38.196 INFO:teuthology.orchestra.run.smithi002.stdout:Created osd(s) 9 on host 'smithi002' 2024-09-19T04:44:38.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:38.196+0000 7f1c0893a640 1 -- 172.21.15.2:0/415197821 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f1bf00a3270 msgr2=0x7f1bf00a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:44:38.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:38.196+0000 7f1c0893a640 1 --2- 172.21.15.2:0/415197821 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f1bf00a3270 0x7f1bf00a5730 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1bec004770 tx=0x7f1bec000bc0 comp rx=0 tx=0).stop 2024-09-19T04:44:38.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:38.196+0000 7f1c0893a640 1 -- 172.21.15.2:0/415197821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c04102690 msgr2=0x7f1c0419f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:44:38.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:38.196+0000 7f1c0893a640 1 --2- 172.21.15.2:0/415197821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c04102690 0x7f1c0419f450 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc00eb10 tx=0x7f1bfc00c2d0 comp rx=0 tx=0).stop 2024-09-19T04:44:38.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:38.196+0000 7f1c0893a640 1 -- 172.21.15.2:0/415197821 shutdown_connections 2024-09-19T04:44:38.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:38.196+0000 7f1c0893a640 1 --2- 172.21.15.2:0/415197821 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f1bf00a3270 0x7f1bf00a5730 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:44:38.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:38.196+0000 7f1c0893a640 1 --2- 172.21.15.2:0/415197821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c04102690 0x7f1c0419f450 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:44:38.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:38.196+0000 7f1c0893a640 1 --2- 172.21.15.2:0/415197821 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c04101cd0 0x7f1c041983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:44:38.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:38.196+0000 7f1c0893a640 1 --2- 172.21.15.2:0/415197821 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c04100ad0 0x7f1c04197e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:44:38.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:38.196+0000 7f1c0893a640 1 -- 172.21.15.2:0/415197821 >> 172.21.15.2:0/415197821 conn(0x7f1c040fc280 msgr2=0x7f1c04069fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:44:38.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:38.197+0000 7f1c0893a640 1 -- 172.21.15.2:0/415197821 shutdown_connections 2024-09-19T04:44:38.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:44:38.197+0000 7f1c0893a640 1 -- 172.21.15.2:0/415197821 wait complete. 2024-09-19T04:44:38.483 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:38 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:38.483 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:38 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:38.483 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:38 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:44:38.483 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:38 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:44:38.483 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:38 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:38.483 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:38 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:44:38.483 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:38 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:38.483 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:38 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:38.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:38 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:38.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:38 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:38.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:38 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:44:38.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:38 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:44:38.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:38 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:38.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:38 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:44:38.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:38 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:38.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:38 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:38.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:38 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:38.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:38 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:38.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:38 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:44:38.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:38 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:44:38.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:38 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:38.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:38 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:44:38.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:38 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:38.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:38 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:38.883 DEBUG:teuthology.orchestra.run.smithi002:osd.9> sudo journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@osd.9.service 2024-09-19T04:44:38.885 INFO:tasks.cephadm:Deploying osd.10 on smithi018 with /dev/vg_nvme/lv_1... 2024-09-19T04:44:38.886 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T04:44:39.155 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T04:44:39.527 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:39 smithi018 ceph-mon[34537]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:44:39.708 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:39 smithi002 ceph-mon[30975]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:44:39.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:39 smithi116 ceph-mon[34477]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:44:41.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 04:44:41 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T04:44:41.065+0000 7f57fd6b2640 -1 osd.9 0 log_to_monitors true 2024-09-19T04:44:41.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:41 smithi018 ceph-mon[34537]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:44:41.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:41 smithi018 ceph-mon[34537]: from='osd.9 [v2:172.21.15.2:6826/1054791011,v1:172.21.15.2:6827/1054791011]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T04:44:41.613 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T04:44:41.640 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi018:vg_nvme/lv_1 2024-09-19T04:44:41.757 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:41 smithi002 ceph-mon[30975]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:44:41.757 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:41 smithi002 ceph-mon[30975]: from='osd.9 [v2:172.21.15.2:6826/1054791011,v1:172.21.15.2:6827/1054791011]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T04:44:41.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:41 smithi116 ceph-mon[34477]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:44:41.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:41 smithi116 ceph-mon[34477]: from='osd.9 [v2:172.21.15.2:6826/1054791011,v1:172.21.15.2:6827/1054791011]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T04:44:41.904 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T04:44:42.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:44:42.433+0000 7fb75efe5640 1 -- 172.21.15.18:0/668332462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb758102690 msgr2=0x7fb758108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:44:42.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:44:42.433+0000 7fb75efe5640 1 --2- 172.21.15.18:0/668332462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb758102690 0x7fb758108f20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb750009900 tx=0x7fb75002a410 comp rx=0 tx=0).stop 2024-09-19T04:44:42.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:44:42.433+0000 7fb75efe5640 1 -- 172.21.15.18:0/668332462 shutdown_connections 2024-09-19T04:44:42.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:44:42.433+0000 7fb75efe5640 1 --2- 172.21.15.18:0/668332462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb758102690 0x7fb758108f20 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:44:42.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:44:42.433+0000 7fb75efe5640 1 --2- 172.21.15.18:0/668332462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb758101cd0 0x7fb758102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:44:42.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:44:42.433+0000 7fb75efe5640 1 --2- 172.21.15.18:0/668332462 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb758100ad0 0x7fb758100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:44:42.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:44:42.433+0000 7fb75efe5640 1 -- 172.21.15.18:0/668332462 >> 172.21.15.18:0/668332462 conn(0x7fb7580fc280 msgr2=0x7fb7580fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:44:42.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:44:42.433+0000 7fb75efe5640 1 -- 172.21.15.18:0/668332462 shutdown_connections 2024-09-19T04:44:42.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:44:42.433+0000 7fb75efe5640 1 -- 172.21.15.18:0/668332462 wait complete. 2024-09-19T04:44:42.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:44:42.433+0000 7fb75efe5640 1 Processor -- start 2024-09-19T04:44:42.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:44:42.433+0000 7fb75efe5640 1 -- start start 2024-09-19T04:44:42.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:44:42.433+0000 7fb75efe5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb758100ad0 0x7fb758197d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:44:42.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:44:42.433+0000 7fb75efe5640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb758101cd0 0x7fb758198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:44:42.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:44:42.434+0000 7fb75efe5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb758102690 0x7fb75819f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:44:42.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:44:42.434+0000 7fb75efe5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb75810d730 con 0x7fb758100ad0 2024-09-19T04:44:42.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:44:42.434+0000 7fb75efe5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb75810d5b0 con 0x7fb758102690 2024-09-19T04:44:42.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:44:42.434+0000 7fb75efe5640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fb75810d8b0 con 0x7fb758101cd0 2024-09-19T04:44:42.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:44:42.434+0000 7fb75d582640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb758102690 0x7fb75819f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:44:42.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:44:42.434+0000 7fb75d582640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb758102690 0x7fb75819f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42616/0 (socket says 172.21.15.18:42616) 2024-09-19T04:44:42.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:44:42.434+0000 7fb75d582640 1 -- 172.21.15.18:0/987929706 learned_addr learned my addr 172.21.15.18:0/987929706 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T04:44:42.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:44:42.434+0000 7fb75cd81640 1 --2- 172.21.15.18:0/987929706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb758100ad0 0x7fb758197d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:44:42.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:44:42.434+0000 7fb757fff640 1 --2- 172.21.15.18:0/987929706 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb758101cd0 0x7fb758198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:44:42.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:44:42.434+0000 7fb75d582640 1 -- 172.21.15.18:0/987929706 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb758101cd0 msgr2=0x7fb758198270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:44:42.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:44:42.434+0000 7fb75d582640 1 --2- 172.21.15.18:0/987929706 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb758101cd0 0x7fb758198270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:44:42.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:44:42.434+0000 7fb75d582640 1 -- 172.21.15.18:0/987929706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb758100ad0 msgr2=0x7fb758197d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:44:42.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:44:42.434+0000 7fb75d582640 1 --2- 172.21.15.18:0/987929706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb758100ad0 0x7fb758197d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:44:42.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:44:42.434+0000 7fb75d582640 1 -- 172.21.15.18:0/987929706 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb75819f950 con 0x7fb758102690 2024-09-19T04:44:42.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:44:42.434+0000 7fb75d582640 1 --2- 172.21.15.18:0/987929706 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb758102690 0x7fb75819f2b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb750005940 tx=0x7fb750031a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:44:42.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:44:42.434+0000 7fb755ffb640 1 -- 172.21.15.18:0/987929706 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb75003f030 con 0x7fb758102690 2024-09-19T04:44:42.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:44:42.434+0000 7fb75efe5640 1 -- 172.21.15.18:0/987929706 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb75819fbe0 con 0x7fb758102690 2024-09-19T04:44:42.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:44:42.434+0000 7fb755ffb640 1 -- 172.21.15.18:0/987929706 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb750003aa0 con 0x7fb758102690 2024-09-19T04:44:42.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:44:42.434+0000 7fb755ffb640 1 -- 172.21.15.18:0/987929706 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb750035070 con 0x7fb758102690 2024-09-19T04:44:42.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:44:42.435+0000 7fb75efe5640 1 -- 172.21.15.18:0/987929706 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7581a00c0 con 0x7fb758102690 2024-09-19T04:44:42.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:44:42.436+0000 7fb75efe5640 1 -- 172.21.15.18:0/987929706 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb758107ed0 con 0x7fb758102690 2024-09-19T04:44:42.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:44:42.438+0000 7fb755ffb640 1 -- 172.21.15.18:0/987929706 <== mon.2 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fb750042030 con 0x7fb758102690 2024-09-19T04:44:42.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:44:42.438+0000 7fb755ffb640 1 --2- 172.21.15.18:0/987929706 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fb7400a3240 0x7fb7400a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:44:42.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:44:42.439+0000 7fb755ffb640 1 -- 172.21.15.18:0/987929706 <== mon.2 v2:172.21.15.18:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5981+0+0 (secure 0 0 0) 0x7fb7500efa20 con 0x7fb758102690 2024-09-19T04:44:42.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:44:42.439+0000 7fb75cd81640 1 --2- 172.21.15.18:0/987929706 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fb7400a3240 0x7fb7400a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:44:42.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:44:42.439+0000 7fb75cd81640 1 --2- 172.21.15.18:0/987929706 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fb7400a3240 0x7fb7400a5700 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb758199210 tx=0x7fb748005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:44:42.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:44:42.442+0000 7fb755ffb640 1 -- 172.21.15.18:0/987929706 <== mon.2 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb7500bd060 con 0x7fb758102690 2024-09-19T04:44:42.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:42 smithi018 ceph-mon[34537]: from='osd.9 [v2:172.21.15.2:6826/1054791011,v1:172.21.15.2:6827/1054791011]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T04:44:42.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:42 smithi018 ceph-mon[34537]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T04:44:42.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:42 smithi018 ceph-mon[34537]: from='osd.9 [v2:172.21.15.2:6826/1054791011,v1:172.21.15.2:6827/1054791011]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-19T04:44:42.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:42 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:44:42.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:42 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:42.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:42 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:42.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:42 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:44:42.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:42 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:44:42.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:42 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:44:42.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:42 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:44:42.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:42 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:42.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:42 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:44:42.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:42 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:44:42.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:42 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:42.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:42 smithi018 ceph-mon[34537]: from='osd.9 [v2:172.21.15.2:6826/1054791011,v1:172.21.15.2:6827/1054791011]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-19T04:44:42.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:44:42.626+0000 7fb75efe5640 1 -- 172.21.15.18:0/987929706 --> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fb758062630 con 0x7fb7400a3240 2024-09-19T04:44:42.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:42 smithi002 ceph-mon[30975]: from='osd.9 [v2:172.21.15.2:6826/1054791011,v1:172.21.15.2:6827/1054791011]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T04:44:42.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:42 smithi002 ceph-mon[30975]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T04:44:42.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:42 smithi002 ceph-mon[30975]: from='osd.9 [v2:172.21.15.2:6826/1054791011,v1:172.21.15.2:6827/1054791011]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-19T04:44:42.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:42 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:44:42.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:42 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:42.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:42 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:42.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:42 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:44:42.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:42 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:44:42.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:42 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:44:42.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:42 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:44:42.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:42 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:42.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:42 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:44:42.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:42 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:44:42.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:42 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:42.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:42 smithi002 ceph-mon[30975]: from='osd.9 [v2:172.21.15.2:6826/1054791011,v1:172.21.15.2:6827/1054791011]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-19T04:44:42.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:42 smithi116 ceph-mon[34477]: from='osd.9 [v2:172.21.15.2:6826/1054791011,v1:172.21.15.2:6827/1054791011]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T04:44:42.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:42 smithi116 ceph-mon[34477]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T04:44:42.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:42 smithi116 ceph-mon[34477]: from='osd.9 [v2:172.21.15.2:6826/1054791011,v1:172.21.15.2:6827/1054791011]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-19T04:44:42.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:42 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:44:42.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:42 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:42.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:42 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:42.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:42 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:44:42.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:42 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:44:42.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:42 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:44:42.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:42 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:44:42.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:42 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:42.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:42 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:44:42.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:42 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:44:42.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:42 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:42.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:42 smithi116 ceph-mon[34477]: from='osd.9 [v2:172.21.15.2:6826/1054791011,v1:172.21.15.2:6827/1054791011]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-19T04:44:43.413 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 04:44:43 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T04:44:43.152+0000 7f57f8e12640 -1 osd.9 0 waiting for initial osdmap 2024-09-19T04:44:43.413 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 04:44:43 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T04:44:43.163+0000 7f57f1444640 -1 osd.9 60 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T04:44:43.737 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:43 smithi018 ceph-mon[34537]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:44:43.737 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:43 smithi018 ceph-mon[34537]: Detected new or changed devices on smithi002 2024-09-19T04:44:43.737 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:43 smithi018 ceph-mon[34537]: Adjusting osd_memory_target on smithi002 to 4273M 2024-09-19T04:44:43.737 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:43 smithi018 ceph-mon[34537]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T04:44:43.737 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:43 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:44:43.737 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:43 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:44:43.737 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:43 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:44:43.737 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:43 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:44:43.738 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:43 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:44:43.738 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:43 smithi018 ceph-mon[34537]: from='osd.9 [v2:172.21.15.2:6826/1054791011,v1:172.21.15.2:6827/1054791011]' entity='osd.9' 2024-09-19T04:44:43.738 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:43 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:44:43.762 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:43 smithi116 ceph-mon[34477]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:44:43.762 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:43 smithi116 ceph-mon[34477]: Detected new or changed devices on smithi002 2024-09-19T04:44:43.762 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:43 smithi116 ceph-mon[34477]: Adjusting osd_memory_target on smithi002 to 4273M 2024-09-19T04:44:43.762 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:43 smithi116 ceph-mon[34477]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T04:44:43.762 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:43 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:44:43.762 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:43 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:44:43.762 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:43 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:44:43.762 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:43 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:44:43.762 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:43 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:44:43.762 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:43 smithi116 ceph-mon[34477]: from='osd.9 [v2:172.21.15.2:6826/1054791011,v1:172.21.15.2:6827/1054791011]' entity='osd.9' 2024-09-19T04:44:43.763 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:43 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:44:43.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:43 smithi002 ceph-mon[30975]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:44:43.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:43 smithi002 ceph-mon[30975]: Detected new or changed devices on smithi002 2024-09-19T04:44:43.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:43 smithi002 ceph-mon[30975]: Adjusting osd_memory_target on smithi002 to 4273M 2024-09-19T04:44:43.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:43 smithi002 ceph-mon[30975]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T04:44:43.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:43 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:44:43.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:43 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:44:43.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:43 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:44:43.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:43 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:44:43.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:43 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:44:43.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:43 smithi002 ceph-mon[30975]: from='osd.9 [v2:172.21.15.2:6826/1054791011,v1:172.21.15.2:6827/1054791011]' entity='osd.9' 2024-09-19T04:44:43.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:43 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:44:44.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:44 smithi018 ceph-mon[34537]: purged_snaps scrub starts 2024-09-19T04:44:44.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:44 smithi018 ceph-mon[34537]: purged_snaps scrub ok 2024-09-19T04:44:44.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:44 smithi018 ceph-mon[34537]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:44:44.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:44 smithi018 ceph-mon[34537]: osd.9 [v2:172.21.15.2:6826/1054791011,v1:172.21.15.2:6827/1054791011] boot 2024-09-19T04:44:44.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:44 smithi018 ceph-mon[34537]: osdmap e61: 10 total, 10 up, 10 in 2024-09-19T04:44:44.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:44 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:44:44.774 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:44 smithi116 ceph-mon[34477]: purged_snaps scrub starts 2024-09-19T04:44:44.774 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:44 smithi116 ceph-mon[34477]: purged_snaps scrub ok 2024-09-19T04:44:44.774 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:44 smithi116 ceph-mon[34477]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:44:44.774 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:44 smithi116 ceph-mon[34477]: osd.9 [v2:172.21.15.2:6826/1054791011,v1:172.21.15.2:6827/1054791011] boot 2024-09-19T04:44:44.774 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:44 smithi116 ceph-mon[34477]: osdmap e61: 10 total, 10 up, 10 in 2024-09-19T04:44:44.774 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:44 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:44:44.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:44 smithi002 ceph-mon[30975]: purged_snaps scrub starts 2024-09-19T04:44:44.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:44 smithi002 ceph-mon[30975]: purged_snaps scrub ok 2024-09-19T04:44:44.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:44 smithi002 ceph-mon[30975]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:44:44.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:44 smithi002 ceph-mon[30975]: osd.9 [v2:172.21.15.2:6826/1054791011,v1:172.21.15.2:6827/1054791011] boot 2024-09-19T04:44:44.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:44 smithi002 ceph-mon[30975]: osdmap e61: 10 total, 10 up, 10 in 2024-09-19T04:44:44.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:44 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:44:45.562 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:45 smithi018 ceph-mon[34537]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:44:45.562 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:45 smithi018 ceph-mon[34537]: from='client.? 172.21.15.18:0/3341595898' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12b60238-6a35-4d48-bacd-ee5ddd8fdb0c"}]: dispatch 2024-09-19T04:44:45.562 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:45 smithi018 ceph-mon[34537]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12b60238-6a35-4d48-bacd-ee5ddd8fdb0c"}]: dispatch 2024-09-19T04:44:45.562 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:45 smithi018 ceph-mon[34537]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "12b60238-6a35-4d48-bacd-ee5ddd8fdb0c"}]': finished 2024-09-19T04:44:45.562 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:45 smithi018 ceph-mon[34537]: osdmap e62: 11 total, 10 up, 11 in 2024-09-19T04:44:45.562 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:45 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:44:45.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:45 smithi002 ceph-mon[30975]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:44:45.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:45 smithi002 ceph-mon[30975]: from='client.? 172.21.15.18:0/3341595898' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12b60238-6a35-4d48-bacd-ee5ddd8fdb0c"}]: dispatch 2024-09-19T04:44:45.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:45 smithi002 ceph-mon[30975]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12b60238-6a35-4d48-bacd-ee5ddd8fdb0c"}]: dispatch 2024-09-19T04:44:45.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:45 smithi002 ceph-mon[30975]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "12b60238-6a35-4d48-bacd-ee5ddd8fdb0c"}]': finished 2024-09-19T04:44:45.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:45 smithi002 ceph-mon[30975]: osdmap e62: 11 total, 10 up, 11 in 2024-09-19T04:44:45.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:45 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:44:45.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:45 smithi116 ceph-mon[34477]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:44:45.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:45 smithi116 ceph-mon[34477]: from='client.? 172.21.15.18:0/3341595898' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12b60238-6a35-4d48-bacd-ee5ddd8fdb0c"}]: dispatch 2024-09-19T04:44:45.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:45 smithi116 ceph-mon[34477]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12b60238-6a35-4d48-bacd-ee5ddd8fdb0c"}]: dispatch 2024-09-19T04:44:45.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:45 smithi116 ceph-mon[34477]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "12b60238-6a35-4d48-bacd-ee5ddd8fdb0c"}]': finished 2024-09-19T04:44:45.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:45 smithi116 ceph-mon[34477]: osdmap e62: 11 total, 10 up, 11 in 2024-09-19T04:44:45.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:45 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:44:46.806 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:46 smithi018 ceph-mon[34537]: from='client.? 172.21.15.18:0/1048151770' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:44:46.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:46 smithi002 ceph-mon[30975]: from='client.? 172.21.15.18:0/1048151770' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:44:46.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:46 smithi116 ceph-mon[34477]: from='client.? 172.21.15.18:0/1048151770' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:44:47.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:47 smithi018 ceph-mon[34537]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:44:47.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:47 smithi002 ceph-mon[30975]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:44:47.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:47 smithi116 ceph-mon[34477]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:44:49.806 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:49 smithi018 ceph-mon[34537]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:44:49.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:49 smithi002 ceph-mon[30975]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:44:49.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:49 smithi116 ceph-mon[34477]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:44:51.523 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:51 smithi018 ceph-mon[34537]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:44:51.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:51 smithi002 ceph-mon[30975]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:44:51.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:51 smithi116 ceph-mon[34477]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:44:53.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:53 smithi018 ceph-mon[34537]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:44:53.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:53 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T04:44:53.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:53 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:44:53.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:53 smithi002 ceph-mon[30975]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:44:53.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:53 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T04:44:53.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:53 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:44:53.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:53 smithi116 ceph-mon[34477]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:44:53.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:53 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T04:44:53.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:53 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:44:54.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:54 smithi018 ceph-mon[34537]: Deploying daemon osd.10 on smithi018 2024-09-19T04:44:54.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:54 smithi002 ceph-mon[30975]: Deploying daemon osd.10 on smithi018 2024-09-19T04:44:54.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:54 smithi116 ceph-mon[34477]: Deploying daemon osd.10 on smithi018 2024-09-19T04:44:55.547 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:55 smithi018 ceph-mon[34537]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:44:55.859 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:55 smithi002 ceph-mon[30975]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:44:55.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:55 smithi116 ceph-mon[34477]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:44:57.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:57 smithi018 ceph-mon[34537]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:44:57.859 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:57 smithi002 ceph-mon[30975]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:44:57.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:57 smithi116 ceph-mon[34477]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:44:59.793 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:59 smithi018 ceph-mon[34537]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:44:59.793 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:59 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:44:59.793 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:59 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:59.793 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:44:59 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:59.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:59 smithi002 ceph-mon[30975]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:44:59.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:59 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:44:59.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:59 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:59.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:44:59 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:59.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:59 smithi116 ceph-mon[34477]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:44:59.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:59 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:44:59.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:59 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:44:59.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:44:59 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:01.709 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:01 smithi018 ceph-mon[34537]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:45:01.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:01 smithi002 ceph-mon[30975]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:45:01.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:01 smithi116 ceph-mon[34477]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:45:02.970 INFO:teuthology.orchestra.run.smithi018.stdout:Created osd(s) 10 on host 'smithi018' 2024-09-19T04:45:02.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:45:02.968+0000 7fb755ffb640 1 -- 172.21.15.18:0/987929706 <== mgr.14150 v2:172.21.15.2:6800/3171525177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fb758062630 con 0x7fb7400a3240 2024-09-19T04:45:02.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:45:02.971+0000 7fb75efe5640 1 -- 172.21.15.18:0/987929706 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fb7400a3240 msgr2=0x7fb7400a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:02.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:45:02.971+0000 7fb75efe5640 1 --2- 172.21.15.18:0/987929706 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fb7400a3240 0x7fb7400a5700 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb758199210 tx=0x7fb748005f90 comp rx=0 tx=0).stop 2024-09-19T04:45:02.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:45:02.971+0000 7fb75efe5640 1 -- 172.21.15.18:0/987929706 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb758102690 msgr2=0x7fb75819f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:02.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:45:02.971+0000 7fb75efe5640 1 --2- 172.21.15.18:0/987929706 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb758102690 0x7fb75819f2b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb750005940 tx=0x7fb750031a30 comp rx=0 tx=0).stop 2024-09-19T04:45:02.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:45:02.971+0000 7fb75efe5640 1 -- 172.21.15.18:0/987929706 shutdown_connections 2024-09-19T04:45:02.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:45:02.971+0000 7fb75efe5640 1 --2- 172.21.15.18:0/987929706 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fb7400a3240 0x7fb7400a5700 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:02.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:45:02.971+0000 7fb75efe5640 1 --2- 172.21.15.18:0/987929706 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb758102690 0x7fb75819f2b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:02.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:45:02.971+0000 7fb75efe5640 1 --2- 172.21.15.18:0/987929706 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb758101cd0 0x7fb758198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:02.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:45:02.971+0000 7fb75efe5640 1 --2- 172.21.15.18:0/987929706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb758100ad0 0x7fb758197d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:02.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:45:02.971+0000 7fb75efe5640 1 -- 172.21.15.18:0/987929706 >> 172.21.15.18:0/987929706 conn(0x7fb7580fc280 msgr2=0x7fb7581050a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:45:02.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:45:02.971+0000 7fb75efe5640 1 -- 172.21.15.18:0/987929706 shutdown_connections 2024-09-19T04:45:02.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T04:45:02.971+0000 7fb75efe5640 1 -- 172.21.15.18:0/987929706 wait complete. 2024-09-19T04:45:03.549 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:03 smithi018 ceph-mon[34537]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:45:03.549 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:03 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:03.549 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:03 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:03.549 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:03 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:45:03.549 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:03 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:45:03.549 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:03 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:03.549 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:03 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:45:03.549 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:03 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:03.549 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:03 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:03.576 DEBUG:teuthology.orchestra.run.smithi018:osd.10> sudo journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@osd.10.service 2024-09-19T04:45:03.578 INFO:tasks.cephadm:Deploying osd.11 on smithi116 with /dev/vg_nvme/lv_1... 2024-09-19T04:45:03.578 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T04:45:03.606 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:03 smithi116 ceph-mon[34477]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:45:03.606 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:03 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:03.606 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:03 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:03.606 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:03 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:45:03.606 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:03 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:45:03.606 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:03 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:03.606 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:03 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:45:03.606 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:03 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:03.606 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:03 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:03.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:03 smithi002 ceph-mon[30975]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:45:03.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:03 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:03.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:03 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:03.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:03 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:45:03.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:03 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:45:03.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:03 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:03.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:03 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:45:03.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:03 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:03.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:03 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:03.830 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T04:45:05.342 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:05 smithi116 ceph-mon[34477]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:45:05.399 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:05 smithi018 ceph-mon[34537]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:45:05.609 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:05 smithi002 ceph-mon[30975]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:45:05.804 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 04:45:05 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T04:45:05.396+0000 7fd45d400640 -1 osd.10 0 log_to_monitors true 2024-09-19T04:45:06.457 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:06 smithi116 ceph-mon[34477]: from='osd.10 [v2:172.21.15.18:6824/1958683776,v1:172.21.15.18:6825/1958683776]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T04:45:06.458 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:06 smithi116 ceph-mon[34477]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T04:45:06.460 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-19T04:45:06.471 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:06 smithi018 ceph-mon[34537]: from='osd.10 [v2:172.21.15.18:6824/1958683776,v1:172.21.15.18:6825/1958683776]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T04:45:06.471 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:06 smithi018 ceph-mon[34537]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T04:45:06.486 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi116:vg_nvme/lv_1 2024-09-19T04:45:06.609 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:06 smithi002 ceph-mon[30975]: from='osd.10 [v2:172.21.15.18:6824/1958683776,v1:172.21.15.18:6825/1958683776]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T04:45:06.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:06 smithi002 ceph-mon[30975]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T04:45:06.779 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T04:45:07.188 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:07.184+0000 7f334b3c1640 1 -- 172.21.15.116:0/2471294112 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3344102eb0 msgr2=0x7f3344103330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:07.188 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:07.184+0000 7f334b3c1640 1 --2- 172.21.15.116:0/2471294112 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3344102eb0 0x7f3344103330 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3334009930 tx=0x7f333402a420 comp rx=0 tx=0).stop 2024-09-19T04:45:07.188 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:07.184+0000 7f334b3c1640 1 -- 172.21.15.116:0/2471294112 shutdown_connections 2024-09-19T04:45:07.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:07.184+0000 7f334b3c1640 1 --2- 172.21.15.116:0/2471294112 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3344103870 0x7f334410a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:07.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:07.184+0000 7f334b3c1640 1 --2- 172.21.15.116:0/2471294112 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3344102eb0 0x7f3344103330 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:07.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:07.184+0000 7f334b3c1640 1 --2- 172.21.15.116:0/2471294112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33440ffed0 0x7f33441002d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:07.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:07.184+0000 7f334b3c1640 1 -- 172.21.15.116:0/2471294112 >> 172.21.15.116:0/2471294112 conn(0x7f33440fba40 msgr2=0x7f33440fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:45:07.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:07.184+0000 7f334b3c1640 1 -- 172.21.15.116:0/2471294112 shutdown_connections 2024-09-19T04:45:07.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:07.184+0000 7f334b3c1640 1 -- 172.21.15.116:0/2471294112 wait complete. 2024-09-19T04:45:07.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:07.185+0000 7f334b3c1640 1 Processor -- start 2024-09-19T04:45:07.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:07.185+0000 7f334b3c1640 1 -- start start 2024-09-19T04:45:07.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:07.185+0000 7f334b3c1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33440ffed0 0x7f3344197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:07.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:07.185+0000 7f334b3c1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3344102eb0 0x7f3344198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:07.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:07.185+0000 7f334b3c1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3344103870 0x7f334419f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:07.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:07.185+0000 7f334b3c1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f334410d7c0 con 0x7f33440ffed0 2024-09-19T04:45:07.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:07.185+0000 7f334b3c1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f334410d640 con 0x7f3344103870 2024-09-19T04:45:07.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:07.185+0000 7f334b3c1640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f334410d940 con 0x7f3344102eb0 2024-09-19T04:45:07.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:07.186+0000 7f334895c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3344102eb0 0x7f3344198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:07.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:07.186+0000 7f334895c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3344102eb0 0x7f3344198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:35858/0 (socket says 172.21.15.116:35858) 2024-09-19T04:45:07.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:07.186+0000 7f334895c640 1 -- 172.21.15.116:0/3156011899 learned_addr learned my addr 172.21.15.116:0/3156011899 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-19T04:45:07.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:07.186+0000 7f334915d640 1 --2- 172.21.15.116:0/3156011899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33440ffed0 0x7f3344197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:07.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:07.186+0000 7f334995e640 1 --2- 172.21.15.116:0/3156011899 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3344103870 0x7f334419f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:07.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:07.186+0000 7f334895c640 1 -- 172.21.15.116:0/3156011899 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3344103870 msgr2=0x7f334419f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:07.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:07.186+0000 7f334895c640 1 --2- 172.21.15.116:0/3156011899 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3344103870 0x7f334419f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:07.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:07.186+0000 7f334895c640 1 -- 172.21.15.116:0/3156011899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33440ffed0 msgr2=0x7f3344197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:07.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:07.186+0000 7f334895c640 1 --2- 172.21.15.116:0/3156011899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33440ffed0 0x7f3344197f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:07.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:07.186+0000 7f334895c640 1 -- 172.21.15.116:0/3156011899 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f334419fb70 con 0x7f3344102eb0 2024-09-19T04:45:07.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:07.186+0000 7f334895c640 1 --2- 172.21.15.116:0/3156011899 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3344102eb0 0x7f3344198480 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3334004770 tx=0x7f33340042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:45:07.191 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:07.186+0000 7f333a7fc640 1 -- 172.21.15.116:0/3156011899 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333403f070 con 0x7f3344102eb0 2024-09-19T04:45:07.191 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:07.186+0000 7f334b3c1640 1 -- 172.21.15.116:0/3156011899 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f334419fe00 con 0x7f3344102eb0 2024-09-19T04:45:07.191 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:07.186+0000 7f333a7fc640 1 -- 172.21.15.116:0/3156011899 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f333403b460 con 0x7f3344102eb0 2024-09-19T04:45:07.191 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:07.186+0000 7f333a7fc640 1 -- 172.21.15.116:0/3156011899 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3334035070 con 0x7f3344102eb0 2024-09-19T04:45:07.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:07.187+0000 7f334b3c1640 1 -- 172.21.15.116:0/3156011899 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33441a0260 con 0x7f3344102eb0 2024-09-19T04:45:07.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:07.188+0000 7f334b3c1640 1 -- 172.21.15.116:0/3156011899 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33441091f0 con 0x7f3344102eb0 2024-09-19T04:45:07.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:07.189+0000 7f333a7fc640 1 -- 172.21.15.116:0/3156011899 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f333403b610 con 0x7f3344102eb0 2024-09-19T04:45:07.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:07.190+0000 7f333a7fc640 1 --2- 172.21.15.116:0/3156011899 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f33300a32f0 0x7f33300a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:07.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:07.190+0000 7f333a7fc640 1 -- 172.21.15.116:0/3156011899 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6398+0+0 (secure 0 0 0) 0x7f33340ef500 con 0x7f3344102eb0 2024-09-19T04:45:07.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:07.190+0000 7f334915d640 1 --2- 172.21.15.116:0/3156011899 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f33300a32f0 0x7f33300a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:07.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:07.191+0000 7f334915d640 1 --2- 172.21.15.116:0/3156011899 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f33300a32f0 0x7f33300a57b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3340005fd0 tx=0x7f334000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:45:07.196 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:07.194+0000 7f333a7fc640 1 -- 172.21.15.116:0/3156011899 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f33340bc9a0 con 0x7f3344102eb0 2024-09-19T04:45:07.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:07 smithi116 ceph-mon[34477]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:45:07.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:07 smithi116 ceph-mon[34477]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T04:45:07.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:07 smithi116 ceph-mon[34477]: osdmap e63: 11 total, 10 up, 11 in 2024-09-19T04:45:07.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:07 smithi116 ceph-mon[34477]: from='osd.10 [v2:172.21.15.18:6824/1958683776,v1:172.21.15.18:6825/1958683776]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-19T04:45:07.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:07 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:45:07.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:07 smithi116 ceph-mon[34477]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-19T04:45:07.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:07 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:07.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:07 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:07.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:07 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:45:07.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:07 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:45:07.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:07 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:45:07.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:07 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:45:07.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:07 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:07.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:07 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:45:07.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:07 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:45:07.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:07 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:07.384 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:07.382+0000 7f334b3c1640 1 -- 172.21.15.116:0/3156011899 --> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f3344062630 con 0x7f33300a32f0 2024-09-19T04:45:07.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:07 smithi018 ceph-mon[34537]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:45:07.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:07 smithi018 ceph-mon[34537]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T04:45:07.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:07 smithi018 ceph-mon[34537]: osdmap e63: 11 total, 10 up, 11 in 2024-09-19T04:45:07.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:07 smithi018 ceph-mon[34537]: from='osd.10 [v2:172.21.15.18:6824/1958683776,v1:172.21.15.18:6825/1958683776]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-19T04:45:07.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:07 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:45:07.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:07 smithi018 ceph-mon[34537]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-19T04:45:07.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:07 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:07.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:07 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:07.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:07 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:45:07.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:07 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:45:07.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:07 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:45:07.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:07 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:45:07.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:07 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:07.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:07 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:45:07.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:07 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:45:07.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:07 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:07.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:07 smithi002 ceph-mon[30975]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:45:07.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:07 smithi002 ceph-mon[30975]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T04:45:07.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:07 smithi002 ceph-mon[30975]: osdmap e63: 11 total, 10 up, 11 in 2024-09-19T04:45:07.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:07 smithi002 ceph-mon[30975]: from='osd.10 [v2:172.21.15.18:6824/1958683776,v1:172.21.15.18:6825/1958683776]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-19T04:45:07.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:07 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:45:07.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:07 smithi002 ceph-mon[30975]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-09-19T04:45:07.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:07 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:07.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:07 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:07.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:07 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:45:07.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:07 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:45:07.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:07 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:45:07.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:07 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:45:07.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:07 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:07.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:07 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:45:07.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:07 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:45:07.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:07 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:08.240 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 04:45:07 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T04:45:07.896+0000 7fd458b60640 -1 osd.10 0 waiting for initial osdmap 2024-09-19T04:45:08.241 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 04:45:07 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T04:45:07.907+0000 7fd451192640 -1 osd.10 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T04:45:08.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:08 smithi116 ceph-mon[34477]: Detected new or changed devices on smithi018 2024-09-19T04:45:08.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:08 smithi116 ceph-mon[34477]: Adjusting osd_memory_target on smithi018 to 4273M 2024-09-19T04:45:08.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:08 smithi116 ceph-mon[34477]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-19T04:45:08.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:08 smithi116 ceph-mon[34477]: osdmap e64: 11 total, 10 up, 11 in 2024-09-19T04:45:08.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:08 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:45:08.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:08 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:45:08.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:08 smithi116 ceph-mon[34477]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:45:08.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:08 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:45:08.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:08 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:45:08.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:08 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:45:08.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:08 smithi116 ceph-mon[34477]: from='osd.10 ' entity='osd.10' 2024-09-19T04:45:08.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:08 smithi018 ceph-mon[34537]: Detected new or changed devices on smithi018 2024-09-19T04:45:08.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:08 smithi018 ceph-mon[34537]: Adjusting osd_memory_target on smithi018 to 4273M 2024-09-19T04:45:08.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:08 smithi018 ceph-mon[34537]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-19T04:45:08.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:08 smithi018 ceph-mon[34537]: osdmap e64: 11 total, 10 up, 11 in 2024-09-19T04:45:08.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:08 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:45:08.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:08 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:45:08.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:08 smithi018 ceph-mon[34537]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:45:08.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:08 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:45:08.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:08 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:45:08.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:08 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:45:08.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:08 smithi018 ceph-mon[34537]: from='osd.10 ' entity='osd.10' 2024-09-19T04:45:08.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:08 smithi002 ceph-mon[30975]: Detected new or changed devices on smithi018 2024-09-19T04:45:08.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:08 smithi002 ceph-mon[30975]: Adjusting osd_memory_target on smithi018 to 4273M 2024-09-19T04:45:08.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:08 smithi002 ceph-mon[30975]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-19T04:45:08.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:08 smithi002 ceph-mon[30975]: osdmap e64: 11 total, 10 up, 11 in 2024-09-19T04:45:08.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:08 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:45:08.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:08 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:45:08.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:08 smithi002 ceph-mon[30975]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:45:08.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:08 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:45:08.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:08 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:45:08.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:08 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:45:08.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:08 smithi002 ceph-mon[30975]: from='osd.10 ' entity='osd.10' 2024-09-19T04:45:09.489 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:09 smithi116 ceph-mon[34477]: purged_snaps scrub starts 2024-09-19T04:45:09.489 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:09 smithi116 ceph-mon[34477]: purged_snaps scrub ok 2024-09-19T04:45:09.489 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:09 smithi116 ceph-mon[34477]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:45:09.489 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:09 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:45:09.489 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:09 smithi116 ceph-mon[34477]: osd.10 [v2:172.21.15.18:6824/1958683776,v1:172.21.15.18:6825/1958683776] boot 2024-09-19T04:45:09.489 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:09 smithi116 ceph-mon[34477]: osdmap e65: 11 total, 11 up, 11 in 2024-09-19T04:45:09.489 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:09 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:45:09.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:09 smithi018 ceph-mon[34537]: purged_snaps scrub starts 2024-09-19T04:45:09.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:09 smithi018 ceph-mon[34537]: purged_snaps scrub ok 2024-09-19T04:45:09.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:09 smithi018 ceph-mon[34537]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:45:09.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:09 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:45:09.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:09 smithi018 ceph-mon[34537]: osd.10 [v2:172.21.15.18:6824/1958683776,v1:172.21.15.18:6825/1958683776] boot 2024-09-19T04:45:09.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:09 smithi018 ceph-mon[34537]: osdmap e65: 11 total, 11 up, 11 in 2024-09-19T04:45:09.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:09 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:45:09.609 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:09 smithi002 ceph-mon[30975]: purged_snaps scrub starts 2024-09-19T04:45:09.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:09 smithi002 ceph-mon[30975]: purged_snaps scrub ok 2024-09-19T04:45:09.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:09 smithi002 ceph-mon[30975]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:45:09.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:09 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:45:09.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:09 smithi002 ceph-mon[30975]: osd.10 [v2:172.21.15.18:6824/1958683776,v1:172.21.15.18:6825/1958683776] boot 2024-09-19T04:45:09.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:09 smithi002 ceph-mon[30975]: osdmap e65: 11 total, 11 up, 11 in 2024-09-19T04:45:09.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:09 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:45:10.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:10 smithi116 ceph-mon[34477]: osdmap e66: 11 total, 11 up, 11 in 2024-09-19T04:45:10.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:10 smithi116 ceph-mon[34477]: from='client.? 172.21.15.116:0/3633141766' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "99b3e553-b42c-4b2f-817f-3900ad8bd223"}]: dispatch 2024-09-19T04:45:10.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:10 smithi116 ceph-mon[34477]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "99b3e553-b42c-4b2f-817f-3900ad8bd223"}]: dispatch 2024-09-19T04:45:10.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:10 smithi116 ceph-mon[34477]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "99b3e553-b42c-4b2f-817f-3900ad8bd223"}]': finished 2024-09-19T04:45:10.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:10 smithi116 ceph-mon[34477]: osdmap e67: 12 total, 11 up, 12 in 2024-09-19T04:45:10.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:10 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:45:10.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:10 smithi018 ceph-mon[34537]: osdmap e66: 11 total, 11 up, 11 in 2024-09-19T04:45:10.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:10 smithi018 ceph-mon[34537]: from='client.? 172.21.15.116:0/3633141766' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "99b3e553-b42c-4b2f-817f-3900ad8bd223"}]: dispatch 2024-09-19T04:45:10.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:10 smithi018 ceph-mon[34537]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "99b3e553-b42c-4b2f-817f-3900ad8bd223"}]: dispatch 2024-09-19T04:45:10.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:10 smithi018 ceph-mon[34537]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "99b3e553-b42c-4b2f-817f-3900ad8bd223"}]': finished 2024-09-19T04:45:10.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:10 smithi018 ceph-mon[34537]: osdmap e67: 12 total, 11 up, 12 in 2024-09-19T04:45:10.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:10 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:45:10.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:10 smithi002 ceph-mon[30975]: osdmap e66: 11 total, 11 up, 11 in 2024-09-19T04:45:10.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:10 smithi002 ceph-mon[30975]: from='client.? 172.21.15.116:0/3633141766' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "99b3e553-b42c-4b2f-817f-3900ad8bd223"}]: dispatch 2024-09-19T04:45:10.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:10 smithi002 ceph-mon[30975]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "99b3e553-b42c-4b2f-817f-3900ad8bd223"}]: dispatch 2024-09-19T04:45:10.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:10 smithi002 ceph-mon[30975]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "99b3e553-b42c-4b2f-817f-3900ad8bd223"}]': finished 2024-09-19T04:45:10.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:10 smithi002 ceph-mon[30975]: osdmap e67: 12 total, 11 up, 12 in 2024-09-19T04:45:10.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:10 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:45:11.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:11 smithi018 ceph-mon[34537]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 983 GiB / 983 GiB avail 2024-09-19T04:45:11.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:11 smithi018 ceph-mon[34537]: from='client.? 172.21.15.116:0/1241300916' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:45:11.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:11 smithi002 ceph-mon[30975]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 983 GiB / 983 GiB avail 2024-09-19T04:45:11.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:11 smithi002 ceph-mon[30975]: from='client.? 172.21.15.116:0/1241300916' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:45:11.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:11 smithi116 ceph-mon[34477]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 983 GiB / 983 GiB avail 2024-09-19T04:45:11.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:11 smithi116 ceph-mon[34477]: from='client.? 172.21.15.116:0/1241300916' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:45:12.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:12 smithi018 ceph-mon[34537]: osdmap e68: 12 total, 11 up, 12 in 2024-09-19T04:45:12.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:12 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:45:12.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:12 smithi002 ceph-mon[30975]: osdmap e68: 12 total, 11 up, 12 in 2024-09-19T04:45:12.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:12 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:45:12.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:12 smithi116 ceph-mon[34477]: osdmap e68: 12 total, 11 up, 12 in 2024-09-19T04:45:12.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:12 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:45:13.521 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:13 smithi116 ceph-mon[34477]: pgmap v226: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 360 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-19T04:45:13.522 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:13 smithi116 ceph-mon[34477]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-19T04:45:13.522 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:13 smithi116 ceph-mon[34477]: osdmap e69: 12 total, 11 up, 12 in 2024-09-19T04:45:13.522 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:13 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:45:13.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:13 smithi018 ceph-mon[34537]: pgmap v226: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 360 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-19T04:45:13.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:13 smithi018 ceph-mon[34537]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-19T04:45:13.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:13 smithi018 ceph-mon[34537]: osdmap e69: 12 total, 11 up, 12 in 2024-09-19T04:45:13.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:13 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:45:13.609 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:13 smithi002 ceph-mon[30975]: pgmap v226: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 360 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-19T04:45:13.609 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:13 smithi002 ceph-mon[30975]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-19T04:45:13.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:13 smithi002 ceph-mon[30975]: osdmap e69: 12 total, 11 up, 12 in 2024-09-19T04:45:13.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:13 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:45:15.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:15 smithi018 ceph-mon[34537]: pgmap v228: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 360 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-19T04:45:15.576 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:15 smithi116 ceph-mon[34477]: pgmap v228: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 360 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-19T04:45:15.609 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:15 smithi002 ceph-mon[30975]: pgmap v228: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 360 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-19T04:45:16.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:16 smithi002 ceph-mon[30975]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-19T04:45:16.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:16 smithi002 ceph-mon[30975]: Cluster is now healthy 2024-09-19T04:45:16.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:16 smithi116 ceph-mon[34477]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-19T04:45:16.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:16 smithi116 ceph-mon[34477]: Cluster is now healthy 2024-09-19T04:45:16.665 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:16 smithi018 ceph-mon[34537]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-19T04:45:16.665 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:16 smithi018 ceph-mon[34537]: Cluster is now healthy 2024-09-19T04:45:17.592 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:17 smithi116 ceph-mon[34477]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T04:45:17.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:17 smithi002 ceph-mon[30975]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T04:45:17.806 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:17 smithi018 ceph-mon[34537]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T04:45:19.402 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:19 smithi116 ceph-mon[34477]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 983 GiB / 983 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-19T04:45:19.402 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:19 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T04:45:19.402 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:19 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:45:19.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:19 smithi002 ceph-mon[30975]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 983 GiB / 983 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-19T04:45:19.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:19 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T04:45:19.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:19 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:45:19.806 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:19 smithi018 ceph-mon[34537]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 983 GiB / 983 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-19T04:45:19.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:19 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T04:45:19.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:19 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:45:20.475 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:20 smithi116 ceph-mon[34477]: Deploying daemon osd.11 on smithi116 2024-09-19T04:45:20.609 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:20 smithi002 ceph-mon[30975]: Deploying daemon osd.11 on smithi116 2024-09-19T04:45:20.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:20 smithi018 ceph-mon[34537]: Deploying daemon osd.11 on smithi116 2024-09-19T04:45:21.459 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:21 smithi116 ceph-mon[34477]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 983 GiB / 983 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-19T04:45:21.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:21 smithi002 ceph-mon[30975]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 983 GiB / 983 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-19T04:45:21.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:21 smithi018 ceph-mon[34537]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 983 GiB / 983 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-19T04:45:23.553 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:23 smithi116 ceph-mon[34477]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T04:45:23.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:23 smithi002 ceph-mon[30975]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T04:45:23.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:23 smithi018 ceph-mon[34537]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T04:45:24.693 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:24 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:45:24.693 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:24 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:24.693 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:24 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:24.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:24 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:45:24.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:24 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:24.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:24 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:24.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:24 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:45:24.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:24 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:24.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:24 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:25.685 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:25 smithi116 ceph-mon[34477]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 983 GiB / 983 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-19T04:45:25.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:25 smithi018 ceph-mon[34537]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 983 GiB / 983 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-19T04:45:25.859 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:25 smithi002 ceph-mon[30975]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 983 GiB / 983 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-19T04:45:27.242 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:27.241+0000 7f333a7fc640 1 -- 172.21.15.116:0/3156011899 <== mgr.14150 v2:172.21.15.2:6800/3171525177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f3344062630 con 0x7f33300a32f0 2024-09-19T04:45:27.243 INFO:teuthology.orchestra.run.smithi116.stdout:Created osd(s) 11 on host 'smithi116' 2024-09-19T04:45:27.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:27.244+0000 7f334b3c1640 1 -- 172.21.15.116:0/3156011899 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f33300a32f0 msgr2=0x7f33300a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:27.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:27.244+0000 7f334b3c1640 1 --2- 172.21.15.116:0/3156011899 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f33300a32f0 0x7f33300a57b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3340005fd0 tx=0x7f334000b410 comp rx=0 tx=0).stop 2024-09-19T04:45:27.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:27.244+0000 7f334b3c1640 1 -- 172.21.15.116:0/3156011899 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3344102eb0 msgr2=0x7f3344198480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:27.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:27.244+0000 7f334b3c1640 1 --2- 172.21.15.116:0/3156011899 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3344102eb0 0x7f3344198480 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3334004770 tx=0x7f33340042f0 comp rx=0 tx=0).stop 2024-09-19T04:45:27.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:27.244+0000 7f334b3c1640 1 -- 172.21.15.116:0/3156011899 shutdown_connections 2024-09-19T04:45:27.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:27.244+0000 7f334b3c1640 1 --2- 172.21.15.116:0/3156011899 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f33300a32f0 0x7f33300a57b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:27.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:27.244+0000 7f334b3c1640 1 --2- 172.21.15.116:0/3156011899 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3344103870 0x7f334419f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:27.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:27.244+0000 7f334b3c1640 1 --2- 172.21.15.116:0/3156011899 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3344102eb0 0x7f3344198480 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:27.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:27.244+0000 7f334b3c1640 1 --2- 172.21.15.116:0/3156011899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33440ffed0 0x7f3344197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:27.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:27.244+0000 7f334b3c1640 1 -- 172.21.15.116:0/3156011899 >> 172.21.15.116:0/3156011899 conn(0x7f33440fba40 msgr2=0x7f33441063c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:45:27.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:27.244+0000 7f334b3c1640 1 -- 172.21.15.116:0/3156011899 shutdown_connections 2024-09-19T04:45:27.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:27.244+0000 7f334b3c1640 1 -- 172.21.15.116:0/3156011899 wait complete. 2024-09-19T04:45:27.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:27 smithi116 ceph-mon[34477]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T04:45:27.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:27 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:27.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:27 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:27.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:27 smithi018 ceph-mon[34537]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T04:45:27.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:27 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:27.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:27 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:27.824 DEBUG:teuthology.orchestra.run.smithi116:osd.11> sudo journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@osd.11.service 2024-09-19T04:45:27.826 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-19T04:45:27.826 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T04:45:27.855 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:27 smithi002 ceph-mon[30975]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T04:45:27.855 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:27 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:27.855 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:27 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:28.099 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:45:28.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.540+0000 7fc3857df640 1 -- 172.21.15.2:0/1330329293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc380101490 msgr2=0x7fc380101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:28.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.540+0000 7fc3857df640 1 --2- 172.21.15.2:0/1330329293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc380101490 0x7fc380101910 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc368009900 tx=0x7fc36802a410 comp rx=0 tx=0).stop 2024-09-19T04:45:28.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.540+0000 7fc3857df640 1 -- 172.21.15.2:0/1330329293 shutdown_connections 2024-09-19T04:45:28.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.540+0000 7fc3857df640 1 --2- 172.21.15.2:0/1330329293 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc380101e50 0x7fc3801086e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:28.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.540+0000 7fc3857df640 1 --2- 172.21.15.2:0/1330329293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc380101490 0x7fc380101910 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:28.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.540+0000 7fc3857df640 1 --2- 172.21.15.2:0/1330329293 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc380100290 0x7fc380100690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:28.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.540+0000 7fc3857df640 1 -- 172.21.15.2:0/1330329293 >> 172.21.15.2:0/1330329293 conn(0x7fc3800fba40 msgr2=0x7fc3800fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:45:28.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.540+0000 7fc3857df640 1 -- 172.21.15.2:0/1330329293 shutdown_connections 2024-09-19T04:45:28.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.540+0000 7fc3857df640 1 -- 172.21.15.2:0/1330329293 wait complete. 2024-09-19T04:45:28.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.541+0000 7fc3857df640 1 Processor -- start 2024-09-19T04:45:28.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.541+0000 7fc3857df640 1 -- start start 2024-09-19T04:45:28.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.542+0000 7fc3857df640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc380100290 0x7fc380197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:28.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.542+0000 7fc3857df640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc380101490 0x7fc380198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:28.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.542+0000 7fc3857df640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc380101e50 0x7fc38019f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:28.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.542+0000 7fc3857df640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc38010b5b0 con 0x7fc380101490 2024-09-19T04:45:28.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.542+0000 7fc3857df640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc38010b430 con 0x7fc380100290 2024-09-19T04:45:28.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.542+0000 7fc3857df640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fc38010b730 con 0x7fc380101e50 2024-09-19T04:45:28.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.542+0000 7fc3767fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc380101490 0x7fc380198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:28.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.542+0000 7fc3767fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc380101490 0x7fc380198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35754/0 (socket says 172.21.15.2:35754) 2024-09-19T04:45:28.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.542+0000 7fc3767fc640 1 -- 172.21.15.2:0/3283768418 learned_addr learned my addr 172.21.15.2:0/3283768418 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:45:28.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.542+0000 7fc37f7fe640 1 --2- 172.21.15.2:0/3283768418 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc380101e50 0x7fc38019f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:28.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.542+0000 7fc37effd640 1 --2- 172.21.15.2:0/3283768418 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc380100290 0x7fc380197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:28.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.542+0000 7fc3767fc640 1 -- 172.21.15.2:0/3283768418 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc380101e50 msgr2=0x7fc38019f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:28.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.542+0000 7fc3767fc640 1 --2- 172.21.15.2:0/3283768418 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc380101e50 0x7fc38019f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:28.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.542+0000 7fc3767fc640 1 -- 172.21.15.2:0/3283768418 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc380100290 msgr2=0x7fc380197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:28.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.542+0000 7fc3767fc640 1 --2- 172.21.15.2:0/3283768418 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc380100290 0x7fc380197ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:28.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.542+0000 7fc3767fc640 1 -- 172.21.15.2:0/3283768418 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc38019faf0 con 0x7fc380101490 2024-09-19T04:45:28.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.542+0000 7fc3767fc640 1 --2- 172.21.15.2:0/3283768418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc380101490 0x7fc380198400 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc368005ab0 tx=0x7fc368003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:45:28.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.542+0000 7fc37cff9640 1 -- 172.21.15.2:0/3283768418 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36803f070 con 0x7fc380101490 2024-09-19T04:45:28.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.543+0000 7fc37cff9640 1 -- 172.21.15.2:0/3283768418 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc368031e40 con 0x7fc380101490 2024-09-19T04:45:28.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.543+0000 7fc37cff9640 1 -- 172.21.15.2:0/3283768418 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc368035030 con 0x7fc380101490 2024-09-19T04:45:28.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.543+0000 7fc3857df640 1 -- 172.21.15.2:0/3283768418 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc38019fd80 con 0x7fc380101490 2024-09-19T04:45:28.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.543+0000 7fc3857df640 1 -- 172.21.15.2:0/3283768418 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3801a01b0 con 0x7fc380101490 2024-09-19T04:45:28.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.544+0000 7fc3857df640 1 -- 172.21.15.2:0/3283768418 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3801a03e0 con 0x7fc380101490 2024-09-19T04:45:28.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.545+0000 7fc37cff9640 1 -- 172.21.15.2:0/3283768418 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fc368042070 con 0x7fc380101490 2024-09-19T04:45:28.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.545+0000 7fc37cff9640 1 --2- 172.21.15.2:0/3283768418 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fc36c0a32f0 0x7fc36c0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:28.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.546+0000 7fc37effd640 1 --2- 172.21.15.2:0/3283768418 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fc36c0a32f0 0x7fc36c0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:28.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.546+0000 7fc37cff9640 1 -- 172.21.15.2:0/3283768418 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6809+0+0 (secure 0 0 0) 0x7fc3680efbf0 con 0x7fc380101490 2024-09-19T04:45:28.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.546+0000 7fc37effd640 1 --2- 172.21.15.2:0/3283768418 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fc36c0a32f0 0x7fc36c0a57b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc370005fd0 tx=0x7fc37000b490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:45:28.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.550+0000 7fc37cff9640 1 -- 172.21.15.2:0/3283768418 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc3680bc800 con 0x7fc380101490 2024-09-19T04:45:28.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.727+0000 7fc3857df640 1 -- 172.21.15.2:0/3283768418 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fc3801a0c60 con 0x7fc380101490 2024-09-19T04:45:28.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.727+0000 7fc37cff9640 1 -- 172.21.15.2:0/3283768418 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v69) ==== 74+0+133 (secure 0 0 0) 0x7fc3680c0b00 con 0x7fc380101490 2024-09-19T04:45:28.729 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:45:28.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.730+0000 7fc3857df640 1 -- 172.21.15.2:0/3283768418 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fc36c0a32f0 msgr2=0x7fc36c0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:28.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.730+0000 7fc3857df640 1 --2- 172.21.15.2:0/3283768418 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fc36c0a32f0 0x7fc36c0a57b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc370005fd0 tx=0x7fc37000b490 comp rx=0 tx=0).stop 2024-09-19T04:45:28.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.730+0000 7fc3857df640 1 -- 172.21.15.2:0/3283768418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc380101490 msgr2=0x7fc380198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:28.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.730+0000 7fc3857df640 1 --2- 172.21.15.2:0/3283768418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc380101490 0x7fc380198400 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc368005ab0 tx=0x7fc368003cd0 comp rx=0 tx=0).stop 2024-09-19T04:45:28.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.731+0000 7fc3857df640 1 -- 172.21.15.2:0/3283768418 shutdown_connections 2024-09-19T04:45:28.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.731+0000 7fc3857df640 1 --2- 172.21.15.2:0/3283768418 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fc36c0a32f0 0x7fc36c0a57b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:28.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.731+0000 7fc3857df640 1 --2- 172.21.15.2:0/3283768418 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc380101e50 0x7fc38019f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:28.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.731+0000 7fc3857df640 1 --2- 172.21.15.2:0/3283768418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc380101490 0x7fc380198400 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:28.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.731+0000 7fc3857df640 1 --2- 172.21.15.2:0/3283768418 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc380100290 0x7fc380197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:28.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.731+0000 7fc3857df640 1 -- 172.21.15.2:0/3283768418 >> 172.21.15.2:0/3283768418 conn(0x7fc3800fba40 msgr2=0x7fc380106ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:45:28.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.731+0000 7fc3857df640 1 -- 172.21.15.2:0/3283768418 shutdown_connections 2024-09-19T04:45:28.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:28.731+0000 7fc3857df640 1 -- 172.21.15.2:0/3283768418 wait complete. 2024-09-19T04:45:29.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:29 smithi018 ceph-mon[34537]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 983 GiB / 983 GiB avail 2024-09-19T04:45:29.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:29 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:29.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:29 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:29.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:29 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/3283768418' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T04:45:29.359 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:29 smithi002 ceph-mon[30975]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 983 GiB / 983 GiB avail 2024-09-19T04:45:29.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:29 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:29.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:29 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:29.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:29 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/3283768418' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T04:45:29.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:29 smithi116 ceph-mon[34477]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 983 GiB / 983 GiB avail 2024-09-19T04:45:29.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:29 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:29.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:29 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:29.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:29 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/3283768418' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T04:45:29.454 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":69,"num_osds":12,"num_up_osds":11,"osd_up_since":1726721108,"num_in_osds":12,"osd_in_since":1726721109,"num_remapped_pgs":0} 2024-09-19T04:45:30.455 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T04:45:30.584 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 04:45:30 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T04:45:30.548+0000 7f303cb51640 -1 osd.11 0 log_to_monitors true 2024-09-19T04:45:30.718 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:45:31.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:31 smithi002 ceph-mon[30975]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 983 GiB / 983 GiB avail 2024-09-19T04:45:31.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:31 smithi002 ceph-mon[30975]: from='osd.11 [v2:172.21.15.116:6824/3456789654,v1:172.21.15.116:6825/3456789654]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T04:45:31.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:31 smithi002 ceph-mon[30975]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T04:45:31.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:31 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:31.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:31 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:31.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:31 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:45:31.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:31 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:45:31.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:31 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:45:31.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:31 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:45:31.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:31 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:31.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:31 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:45:31.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:31 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:45:31.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:31 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:31.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:31 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:45:31.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:31 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:45:31.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:31 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:45:31.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.151+0000 7fdf635d2640 1 -- 172.21.15.2:0/4067730685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf5c101cd0 msgr2=0x7fdf5c102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:31.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.151+0000 7fdf635d2640 1 --2- 172.21.15.2:0/4067730685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf5c101cd0 0x7fdf5c102150 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdf50009900 tx=0x7fdf5002a410 comp rx=0 tx=0).stop 2024-09-19T04:45:31.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.151+0000 7fdf635d2640 1 -- 172.21.15.2:0/4067730685 shutdown_connections 2024-09-19T04:45:31.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.151+0000 7fdf635d2640 1 --2- 172.21.15.2:0/4067730685 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf5c102690 0x7fdf5c108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:31.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.151+0000 7fdf635d2640 1 --2- 172.21.15.2:0/4067730685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf5c101cd0 0x7fdf5c102150 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:31.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.151+0000 7fdf635d2640 1 --2- 172.21.15.2:0/4067730685 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf5c100ad0 0x7fdf5c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:31.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.151+0000 7fdf635d2640 1 -- 172.21.15.2:0/4067730685 >> 172.21.15.2:0/4067730685 conn(0x7fdf5c0fc280 msgr2=0x7fdf5c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:45:31.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.151+0000 7fdf635d2640 1 -- 172.21.15.2:0/4067730685 shutdown_connections 2024-09-19T04:45:31.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.151+0000 7fdf635d2640 1 -- 172.21.15.2:0/4067730685 wait complete. 2024-09-19T04:45:31.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.152+0000 7fdf635d2640 1 Processor -- start 2024-09-19T04:45:31.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.152+0000 7fdf635d2640 1 -- start start 2024-09-19T04:45:31.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.152+0000 7fdf635d2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf5c100ad0 0x7fdf5c197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:31.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.152+0000 7fdf635d2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf5c101cd0 0x7fdf5c198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:31.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.152+0000 7fdf635d2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf5c102690 0x7fdf5c19f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:31.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.152+0000 7fdf635d2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5c10c600 con 0x7fdf5c102690 2024-09-19T04:45:31.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.152+0000 7fdf635d2640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5c10c480 con 0x7fdf5c100ad0 2024-09-19T04:45:31.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.152+0000 7fdf635d2640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5c10c780 con 0x7fdf5c101cd0 2024-09-19T04:45:31.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.152+0000 7fdf61b6f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf5c102690 0x7fdf5c19f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:31.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.152+0000 7fdf61b6f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf5c102690 0x7fdf5c19f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35780/0 (socket says 172.21.15.2:35780) 2024-09-19T04:45:31.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.152+0000 7fdf61b6f640 1 -- 172.21.15.2:0/973007205 learned_addr learned my addr 172.21.15.2:0/973007205 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:45:31.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.152+0000 7fdf60b6d640 1 --2- 172.21.15.2:0/973007205 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf5c101cd0 0x7fdf5c198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:31.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.153+0000 7fdf6136e640 1 --2- 172.21.15.2:0/973007205 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf5c100ad0 0x7fdf5c197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:31.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.153+0000 7fdf61b6f640 1 -- 172.21.15.2:0/973007205 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf5c101cd0 msgr2=0x7fdf5c198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:31.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.153+0000 7fdf61b6f640 1 --2- 172.21.15.2:0/973007205 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf5c101cd0 0x7fdf5c198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:31.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.153+0000 7fdf61b6f640 1 -- 172.21.15.2:0/973007205 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf5c100ad0 msgr2=0x7fdf5c197dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:31.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.153+0000 7fdf61b6f640 1 --2- 172.21.15.2:0/973007205 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf5c100ad0 0x7fdf5c197dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:31.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.153+0000 7fdf61b6f640 1 -- 172.21.15.2:0/973007205 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf5c19fa00 con 0x7fdf5c102690 2024-09-19T04:45:31.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.153+0000 7fdf60b6d640 1 --2- 172.21.15.2:0/973007205 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf5c101cd0 0x7fdf5c198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:45:31.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.153+0000 7fdf61b6f640 1 --2- 172.21.15.2:0/973007205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf5c102690 0x7fdf5c19f390 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fdf5400eb10 tx=0x7fdf5400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:45:31.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.153+0000 7fdf4e7fc640 1 -- 172.21.15.2:0/973007205 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf54004b20 con 0x7fdf5c102690 2024-09-19T04:45:31.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.153+0000 7fdf4e7fc640 1 -- 172.21.15.2:0/973007205 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdf54004cc0 con 0x7fdf5c102690 2024-09-19T04:45:31.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.153+0000 7fdf4e7fc640 1 -- 172.21.15.2:0/973007205 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf54010690 con 0x7fdf5c102690 2024-09-19T04:45:31.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.153+0000 7fdf635d2640 1 -- 172.21.15.2:0/973007205 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf5c19fcf0 con 0x7fdf5c102690 2024-09-19T04:45:31.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.153+0000 7fdf635d2640 1 -- 172.21.15.2:0/973007205 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf5c1a01b0 con 0x7fdf5c102690 2024-09-19T04:45:31.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.154+0000 7fdf635d2640 1 -- 172.21.15.2:0/973007205 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf5c1a0440 con 0x7fdf5c102690 2024-09-19T04:45:31.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.155+0000 7fdf4e7fc640 1 -- 172.21.15.2:0/973007205 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fdf54005000 con 0x7fdf5c102690 2024-09-19T04:45:31.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.156+0000 7fdf4e7fc640 1 --2- 172.21.15.2:0/973007205 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fdf480a3270 0x7fdf480a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:31.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.156+0000 7fdf6136e640 1 --2- 172.21.15.2:0/973007205 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fdf480a3270 0x7fdf480a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:31.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.156+0000 7fdf4e7fc640 1 -- 172.21.15.2:0/973007205 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6831+0+0 (secure 0 0 0) 0x7fdf540cfab0 con 0x7fdf5c102690 2024-09-19T04:45:31.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.157+0000 7fdf6136e640 1 --2- 172.21.15.2:0/973007205 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fdf480a3270 0x7fdf480a5730 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c101b30 tx=0x7fdf58005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:45:31.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.159+0000 7fdf4e7fc640 1 -- 172.21.15.2:0/973007205 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdf54054210 con 0x7fdf5c102690 2024-09-19T04:45:31.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:31 smithi018 ceph-mon[34537]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 983 GiB / 983 GiB avail 2024-09-19T04:45:31.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:31 smithi018 ceph-mon[34537]: from='osd.11 [v2:172.21.15.116:6824/3456789654,v1:172.21.15.116:6825/3456789654]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T04:45:31.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:31 smithi018 ceph-mon[34537]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T04:45:31.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:31 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:31.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:31 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:31.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:31 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:45:31.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:31 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:45:31.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:31 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:45:31.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:31 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:45:31.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:31 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:31.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:31 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:45:31.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:31 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:45:31.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:31 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:31.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:31 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:45:31.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:31 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:45:31.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:31 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:45:31.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.334+0000 7fdf635d2640 1 -- 172.21.15.2:0/973007205 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fdf5c108a80 con 0x7fdf5c102690 2024-09-19T04:45:31.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.334+0000 7fdf4e7fc640 1 -- 172.21.15.2:0/973007205 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v70) ==== 74+0+133 (secure 0 0 0) 0x7fdf5409cd00 con 0x7fdf5c102690 2024-09-19T04:45:31.336 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:45:31.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.336+0000 7fdf635d2640 1 -- 172.21.15.2:0/973007205 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fdf480a3270 msgr2=0x7fdf480a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:31.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.336+0000 7fdf635d2640 1 --2- 172.21.15.2:0/973007205 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fdf480a3270 0x7fdf480a5730 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c101b30 tx=0x7fdf58005f90 comp rx=0 tx=0).stop 2024-09-19T04:45:31.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.336+0000 7fdf635d2640 1 -- 172.21.15.2:0/973007205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf5c102690 msgr2=0x7fdf5c19f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:31.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.336+0000 7fdf635d2640 1 --2- 172.21.15.2:0/973007205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf5c102690 0x7fdf5c19f390 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fdf5400eb10 tx=0x7fdf5400c2d0 comp rx=0 tx=0).stop 2024-09-19T04:45:31.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.336+0000 7fdf635d2640 1 -- 172.21.15.2:0/973007205 shutdown_connections 2024-09-19T04:45:31.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.336+0000 7fdf635d2640 1 --2- 172.21.15.2:0/973007205 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fdf480a3270 0x7fdf480a5730 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:31.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.336+0000 7fdf635d2640 1 --2- 172.21.15.2:0/973007205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf5c102690 0x7fdf5c19f390 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:31.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.336+0000 7fdf635d2640 1 --2- 172.21.15.2:0/973007205 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf5c101cd0 0x7fdf5c198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:31.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.336+0000 7fdf635d2640 1 --2- 172.21.15.2:0/973007205 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf5c100ad0 0x7fdf5c197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:31.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.336+0000 7fdf635d2640 1 -- 172.21.15.2:0/973007205 >> 172.21.15.2:0/973007205 conn(0x7fdf5c0fc280 msgr2=0x7fdf5c0fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:45:31.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.337+0000 7fdf635d2640 1 -- 172.21.15.2:0/973007205 shutdown_connections 2024-09-19T04:45:31.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:31.337+0000 7fdf635d2640 1 -- 172.21.15.2:0/973007205 wait complete. 2024-09-19T04:45:31.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:31 smithi116 ceph-mon[34477]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 983 GiB / 983 GiB avail 2024-09-19T04:45:31.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:31 smithi116 ceph-mon[34477]: from='osd.11 [v2:172.21.15.116:6824/3456789654,v1:172.21.15.116:6825/3456789654]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T04:45:31.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:31 smithi116 ceph-mon[34477]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T04:45:31.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:31 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:31.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:31 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:31.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:31 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:45:31.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:31 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:45:31.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:31 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:45:31.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:31 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:45:31.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:31 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:31.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:31 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:45:31.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:31 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:45:31.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:31 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:31.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:31 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:45:31.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:31 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:45:31.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:31 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:45:31.989 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":70,"num_osds":12,"num_up_osds":11,"osd_up_since":1726721108,"num_in_osds":12,"osd_in_since":1726721109,"num_remapped_pgs":0} 2024-09-19T04:45:32.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:32 smithi002 ceph-mon[30975]: Detected new or changed devices on smithi116 2024-09-19T04:45:32.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:32 smithi002 ceph-mon[30975]: Adjusting osd_memory_target on smithi116 to 4272M 2024-09-19T04:45:32.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:32 smithi002 ceph-mon[30975]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T04:45:32.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:32 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:32.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:32 smithi002 ceph-mon[30975]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T04:45:32.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:32 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:45:32.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:32 smithi002 ceph-mon[30975]: from='osd.11 [v2:172.21.15.116:6824/3456789654,v1:172.21.15.116:6825/3456789654]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-19T04:45:32.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:32 smithi002 ceph-mon[30975]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-19T04:45:32.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:32 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/973007205' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T04:45:32.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:32 smithi116 ceph-mon[34477]: Detected new or changed devices on smithi116 2024-09-19T04:45:32.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:32 smithi116 ceph-mon[34477]: Adjusting osd_memory_target on smithi116 to 4272M 2024-09-19T04:45:32.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:32 smithi116 ceph-mon[34477]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T04:45:32.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:32 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:32.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:32 smithi116 ceph-mon[34477]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T04:45:32.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:32 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:45:32.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:32 smithi116 ceph-mon[34477]: from='osd.11 [v2:172.21.15.116:6824/3456789654,v1:172.21.15.116:6825/3456789654]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-19T04:45:32.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:32 smithi116 ceph-mon[34477]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-19T04:45:32.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:32 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/973007205' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T04:45:32.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:32 smithi018 ceph-mon[34537]: Detected new or changed devices on smithi116 2024-09-19T04:45:32.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:32 smithi018 ceph-mon[34537]: Adjusting osd_memory_target on smithi116 to 4272M 2024-09-19T04:45:32.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:32 smithi018 ceph-mon[34537]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T04:45:32.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:32 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:32.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:32 smithi018 ceph-mon[34537]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T04:45:32.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:32 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:45:32.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:32 smithi018 ceph-mon[34537]: from='osd.11 [v2:172.21.15.116:6824/3456789654,v1:172.21.15.116:6825/3456789654]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-19T04:45:32.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:32 smithi018 ceph-mon[34537]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-19T04:45:32.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:32 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/973007205' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T04:45:32.990 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T04:45:33.110 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 04:45:32 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T04:45:32.837+0000 7f30382b1640 -1 osd.11 0 waiting for initial osdmap 2024-09-19T04:45:33.111 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 04:45:32 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T04:45:32.852+0000 7f30308e3640 -1 osd.11 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T04:45:33.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:33 smithi116 ceph-mon[34477]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 983 GiB / 983 GiB avail 2024-09-19T04:45:33.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:33 smithi116 ceph-mon[34477]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-09-19T04:45:33.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:33 smithi116 ceph-mon[34477]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T04:45:33.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:33 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:45:33.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:33 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:45:33.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:33 smithi116 ceph-mon[34477]: from='osd.11 ' entity='osd.11' 2024-09-19T04:45:33.259 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:45:33.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:33 smithi002 ceph-mon[30975]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 983 GiB / 983 GiB avail 2024-09-19T04:45:33.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:33 smithi002 ceph-mon[30975]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-09-19T04:45:33.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:33 smithi002 ceph-mon[30975]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T04:45:33.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:33 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:45:33.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:33 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:45:33.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:33 smithi002 ceph-mon[30975]: from='osd.11 ' entity='osd.11' 2024-09-19T04:45:33.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:33 smithi018 ceph-mon[34537]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 983 GiB / 983 GiB avail 2024-09-19T04:45:33.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:33 smithi018 ceph-mon[34537]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-09-19T04:45:33.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:33 smithi018 ceph-mon[34537]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T04:45:33.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:33 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:45:33.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:33 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:45:33.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:33 smithi018 ceph-mon[34537]: from='osd.11 ' entity='osd.11' 2024-09-19T04:45:33.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.654+0000 7f97df59e640 1 -- 172.21.15.2:0/1851457531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97e0102c40 msgr2=0x7f97e01030c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:33.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.654+0000 7f97df59e640 1 --2- 172.21.15.2:0/1851457531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97e0102c40 0x7f97e01030c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f97d4009900 tx=0x7f97d402a410 comp rx=0 tx=0).stop 2024-09-19T04:45:33.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.654+0000 7f97df59e640 1 -- 172.21.15.2:0/1851457531 shutdown_connections 2024-09-19T04:45:33.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.654+0000 7f97df59e640 1 --2- 172.21.15.2:0/1851457531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97e0103600 0x7f97e0109e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:33.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.654+0000 7f97df59e640 1 --2- 172.21.15.2:0/1851457531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97e0102c40 0x7f97e01030c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:33.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.654+0000 7f97df59e640 1 --2- 172.21.15.2:0/1851457531 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97e0101a40 0x7f97e0101e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:33.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.654+0000 7f97df59e640 1 -- 172.21.15.2:0/1851457531 >> 172.21.15.2:0/1851457531 conn(0x7f97e00fd1f0 msgr2=0x7f97e00ff610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:45:33.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.654+0000 7f97df59e640 1 -- 172.21.15.2:0/1851457531 shutdown_connections 2024-09-19T04:45:33.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.654+0000 7f97df59e640 1 -- 172.21.15.2:0/1851457531 wait complete. 2024-09-19T04:45:33.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.655+0000 7f97df59e640 1 Processor -- start 2024-09-19T04:45:33.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.655+0000 7f97df59e640 1 -- start start 2024-09-19T04:45:33.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.655+0000 7f97df59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97e0101a40 0x7f97e0197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:33.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.655+0000 7f97df59e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97e0102c40 0x7f97e01981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:33.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.655+0000 7f97df59e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97e0103600 0x7f97e019f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:33.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.655+0000 7f97df59e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f97e010d5f0 con 0x7f97e0101a40 2024-09-19T04:45:33.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.655+0000 7f97df59e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f97e010d470 con 0x7f97e0103600 2024-09-19T04:45:33.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.655+0000 7f97df59e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f97e010d770 con 0x7f97e0102c40 2024-09-19T04:45:33.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.655+0000 7f97de59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97e0101a40 0x7f97e0197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:33.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.655+0000 7f97de59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97e0101a40 0x7f97e0197ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52202/0 (socket says 172.21.15.2:52202) 2024-09-19T04:45:33.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.655+0000 7f97de59c640 1 -- 172.21.15.2:0/4096530975 learned_addr learned my addr 172.21.15.2:0/4096530975 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:45:33.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.655+0000 7f97ddd9b640 1 --2- 172.21.15.2:0/4096530975 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97e0102c40 0x7f97e01981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:33.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.656+0000 7f97de59c640 1 -- 172.21.15.2:0/4096530975 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97e0102c40 msgr2=0x7f97e01981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:33.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.656+0000 7f97de59c640 1 --2- 172.21.15.2:0/4096530975 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97e0102c40 0x7f97e01981e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:33.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.656+0000 7f97ded9d640 1 --2- 172.21.15.2:0/4096530975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97e0103600 0x7f97e019f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:33.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.656+0000 7f97de59c640 1 -- 172.21.15.2:0/4096530975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97e0103600 msgr2=0x7f97e019f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:33.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.656+0000 7f97de59c640 1 --2- 172.21.15.2:0/4096530975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97e0103600 0x7f97e019f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:33.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.656+0000 7f97de59c640 1 -- 172.21.15.2:0/4096530975 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97e019f8c0 con 0x7f97e0101a40 2024-09-19T04:45:33.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.656+0000 7f97ded9d640 1 --2- 172.21.15.2:0/4096530975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97e0103600 0x7f97e019f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:45:33.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.656+0000 7f97de59c640 1 --2- 172.21.15.2:0/4096530975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97e0101a40 0x7f97e0197ca0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f97d000ccb0 tx=0x7f97d000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:45:33.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.656+0000 7f97cf7fe640 1 -- 172.21.15.2:0/4096530975 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d0004b20 con 0x7f97e0101a40 2024-09-19T04:45:33.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.656+0000 7f97cf7fe640 1 -- 172.21.15.2:0/4096530975 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f97d0003e40 con 0x7f97e0101a40 2024-09-19T04:45:33.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.656+0000 7f97df59e640 1 -- 172.21.15.2:0/4096530975 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97e019fbb0 con 0x7f97e0101a40 2024-09-19T04:45:33.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.656+0000 7f97cf7fe640 1 -- 172.21.15.2:0/4096530975 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d00047e0 con 0x7f97e0101a40 2024-09-19T04:45:33.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.656+0000 7f97df59e640 1 -- 172.21.15.2:0/4096530975 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97e01a0070 con 0x7f97e0101a40 2024-09-19T04:45:33.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.657+0000 7f97df59e640 1 -- 172.21.15.2:0/4096530975 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97e0108e90 con 0x7f97e0101a40 2024-09-19T04:45:33.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.658+0000 7f97cf7fe640 1 -- 172.21.15.2:0/4096530975 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f97d0003990 con 0x7f97e0101a40 2024-09-19T04:45:33.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.659+0000 7f97cf7fe640 1 --2- 172.21.15.2:0/4096530975 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f97c80a3240 0x7f97c80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:33.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.659+0000 7f97ddd9b640 1 --2- 172.21.15.2:0/4096530975 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f97c80a3240 0x7f97c80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:33.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.659+0000 7f97cf7fe640 1 -- 172.21.15.2:0/4096530975 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6847+0+0 (secure 0 0 0) 0x7f97d00cf4f0 con 0x7f97e0101a40 2024-09-19T04:45:33.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.659+0000 7f97ddd9b640 1 --2- 172.21.15.2:0/4096530975 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f97c80a3240 0x7f97c80a5700 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f97d4000c00 tx=0x7f97d4005e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:45:33.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.663+0000 7f97cf7fe640 1 -- 172.21.15.2:0/4096530975 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f97d0014030 con 0x7f97e0101a40 2024-09-19T04:45:33.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.837+0000 7f97df59e640 1 -- 172.21.15.2:0/4096530975 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f97e0062ef0 con 0x7f97e0101a40 2024-09-19T04:45:33.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.837+0000 7f97cf7fe640 1 -- 172.21.15.2:0/4096530975 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v71) ==== 74+0+133 (secure 0 0 0) 0x7f97d009c730 con 0x7f97e0101a40 2024-09-19T04:45:33.839 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:45:33.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.839+0000 7f97df59e640 1 -- 172.21.15.2:0/4096530975 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f97c80a3240 msgr2=0x7f97c80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:33.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.839+0000 7f97df59e640 1 --2- 172.21.15.2:0/4096530975 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f97c80a3240 0x7f97c80a5700 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f97d4000c00 tx=0x7f97d4005e40 comp rx=0 tx=0).stop 2024-09-19T04:45:33.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.839+0000 7f97df59e640 1 -- 172.21.15.2:0/4096530975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97e0101a40 msgr2=0x7f97e0197ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:33.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.839+0000 7f97df59e640 1 --2- 172.21.15.2:0/4096530975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97e0101a40 0x7f97e0197ca0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f97d000ccb0 tx=0x7f97d000a620 comp rx=0 tx=0).stop 2024-09-19T04:45:33.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.840+0000 7f97df59e640 1 -- 172.21.15.2:0/4096530975 shutdown_connections 2024-09-19T04:45:33.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.840+0000 7f97df59e640 1 --2- 172.21.15.2:0/4096530975 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f97c80a3240 0x7f97c80a5700 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:33.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.840+0000 7f97df59e640 1 --2- 172.21.15.2:0/4096530975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97e0103600 0x7f97e019f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:33.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.840+0000 7f97df59e640 1 --2- 172.21.15.2:0/4096530975 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97e0102c40 0x7f97e01981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:33.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.840+0000 7f97df59e640 1 --2- 172.21.15.2:0/4096530975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97e0101a40 0x7f97e0197ca0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:33.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.840+0000 7f97df59e640 1 -- 172.21.15.2:0/4096530975 >> 172.21.15.2:0/4096530975 conn(0x7f97e00fd1f0 msgr2=0x7f97e0106060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:45:33.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.840+0000 7f97df59e640 1 -- 172.21.15.2:0/4096530975 shutdown_connections 2024-09-19T04:45:33.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:33.840+0000 7f97df59e640 1 -- 172.21.15.2:0/4096530975 wait complete. 2024-09-19T04:45:34.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:34 smithi002 ceph-mon[30975]: purged_snaps scrub starts 2024-09-19T04:45:34.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:34 smithi002 ceph-mon[30975]: purged_snaps scrub ok 2024-09-19T04:45:34.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:34 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:45:34.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:34 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/4096530975' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T04:45:34.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:34 smithi002 ceph-mon[30975]: osd.11 [v2:172.21.15.116:6824/3456789654,v1:172.21.15.116:6825/3456789654] boot 2024-09-19T04:45:34.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:34 smithi002 ceph-mon[30975]: osdmap e72: 12 total, 12 up, 12 in 2024-09-19T04:45:34.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:34 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:45:34.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:34 smithi116 ceph-mon[34477]: purged_snaps scrub starts 2024-09-19T04:45:34.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:34 smithi116 ceph-mon[34477]: purged_snaps scrub ok 2024-09-19T04:45:34.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:34 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:45:34.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:34 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/4096530975' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T04:45:34.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:34 smithi116 ceph-mon[34477]: osd.11 [v2:172.21.15.116:6824/3456789654,v1:172.21.15.116:6825/3456789654] boot 2024-09-19T04:45:34.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:34 smithi116 ceph-mon[34477]: osdmap e72: 12 total, 12 up, 12 in 2024-09-19T04:45:34.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:34 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:45:34.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:34 smithi018 ceph-mon[34537]: purged_snaps scrub starts 2024-09-19T04:45:34.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:34 smithi018 ceph-mon[34537]: purged_snaps scrub ok 2024-09-19T04:45:34.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:34 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:45:34.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:34 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/4096530975' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T04:45:34.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:34 smithi018 ceph-mon[34537]: osd.11 [v2:172.21.15.116:6824/3456789654,v1:172.21.15.116:6825/3456789654] boot 2024-09-19T04:45:34.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:34 smithi018 ceph-mon[34537]: osdmap e72: 12 total, 12 up, 12 in 2024-09-19T04:45:34.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:34 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:45:34.602 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":71,"num_osds":12,"num_up_osds":11,"osd_up_since":1726721108,"num_in_osds":12,"osd_in_since":1726721109,"num_remapped_pgs":0} 2024-09-19T04:45:35.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:35 smithi002 ceph-mon[30975]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 983 GiB / 983 GiB avail 2024-09-19T04:45:35.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:35 smithi116 ceph-mon[34477]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 983 GiB / 983 GiB avail 2024-09-19T04:45:35.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:35 smithi018 ceph-mon[34537]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 983 GiB / 983 GiB avail 2024-09-19T04:45:35.603 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T04:45:35.872 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:45:36.273 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:36 smithi002 ceph-mon[30975]: osdmap e73: 12 total, 12 up, 12 in 2024-09-19T04:45:36.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:36 smithi116 ceph-mon[34477]: osdmap e73: 12 total, 12 up, 12 in 2024-09-19T04:45:36.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.355+0000 7fed797b5640 1 -- 172.21.15.2:0/3274699135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed741026a0 msgr2=0x7fed74104a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:36.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.355+0000 7fed797b5640 1 --2- 172.21.15.2:0/3274699135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed741026a0 0x7fed74104a90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fed6c009ca0 tx=0x7fed6c02a8c0 comp rx=0 tx=0).stop 2024-09-19T04:45:36.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.355+0000 7fed797b5640 1 -- 172.21.15.2:0/3274699135 shutdown_connections 2024-09-19T04:45:36.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.355+0000 7fed797b5640 1 --2- 172.21.15.2:0/3274699135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed74107900 0x7fed74109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:36.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.355+0000 7fed797b5640 1 --2- 172.21.15.2:0/3274699135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed74104fd0 0x7fed741073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:36.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.355+0000 7fed797b5640 1 --2- 172.21.15.2:0/3274699135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed741026a0 0x7fed74104a90 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:36.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.355+0000 7fed797b5640 1 -- 172.21.15.2:0/3274699135 >> 172.21.15.2:0/3274699135 conn(0x7fed740fc2a0 msgr2=0x7fed740fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:45:36.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.355+0000 7fed797b5640 1 -- 172.21.15.2:0/3274699135 shutdown_connections 2024-09-19T04:45:36.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.355+0000 7fed797b5640 1 -- 172.21.15.2:0/3274699135 wait complete. 2024-09-19T04:45:36.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.356+0000 7fed797b5640 1 Processor -- start 2024-09-19T04:45:36.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.356+0000 7fed797b5640 1 -- start start 2024-09-19T04:45:36.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.356+0000 7fed797b5640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed741026a0 0x7fed74197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:36.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.356+0000 7fed797b5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed74104fd0 0x7fed74198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:36.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.356+0000 7fed797b5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed74107900 0x7fed7419f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:36.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.356+0000 7fed797b5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fed7410d7d0 con 0x7fed74107900 2024-09-19T04:45:36.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.356+0000 7fed797b5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fed7410d650 con 0x7fed74104fd0 2024-09-19T04:45:36.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.356+0000 7fed797b5640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fed7410d950 con 0x7fed741026a0 2024-09-19T04:45:36.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.356+0000 7fed737fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed74107900 0x7fed7419f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:36.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.356+0000 7fed737fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed74107900 0x7fed7419f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52216/0 (socket says 172.21.15.2:52216) 2024-09-19T04:45:36.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.356+0000 7fed737fe640 1 -- 172.21.15.2:0/3086832490 learned_addr learned my addr 172.21.15.2:0/3086832490 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:45:36.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.356+0000 7fed727fc640 1 --2- 172.21.15.2:0/3086832490 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed74104fd0 0x7fed74198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:36.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.356+0000 7fed72ffd640 1 --2- 172.21.15.2:0/3086832490 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed741026a0 0x7fed74197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:36.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.357+0000 7fed737fe640 1 -- 172.21.15.2:0/3086832490 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed741026a0 msgr2=0x7fed74197f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:36.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.357+0000 7fed737fe640 1 --2- 172.21.15.2:0/3086832490 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed741026a0 0x7fed74197f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:36.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.357+0000 7fed737fe640 1 -- 172.21.15.2:0/3086832490 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed74104fd0 msgr2=0x7fed74198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:36.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.357+0000 7fed737fe640 1 --2- 172.21.15.2:0/3086832490 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed74104fd0 0x7fed74198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:36.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.357+0000 7fed737fe640 1 -- 172.21.15.2:0/3086832490 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed7419fb40 con 0x7fed74107900 2024-09-19T04:45:36.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.357+0000 7fed727fc640 1 --2- 172.21.15.2:0/3086832490 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed74104fd0 0x7fed74198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:45:36.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.357+0000 7fed737fe640 1 --2- 172.21.15.2:0/3086832490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed74107900 0x7fed7419f4d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fed6400c970 tx=0x7fed6400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:45:36.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.357+0000 7fed6bfff640 1 -- 172.21.15.2:0/3086832490 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed64007bb0 con 0x7fed74107900 2024-09-19T04:45:36.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.357+0000 7fed6bfff640 1 -- 172.21.15.2:0/3086832490 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fed64007d50 con 0x7fed74107900 2024-09-19T04:45:36.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.357+0000 7fed797b5640 1 -- 172.21.15.2:0/3086832490 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed7419fe30 con 0x7fed74107900 2024-09-19T04:45:36.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.357+0000 7fed6bfff640 1 -- 172.21.15.2:0/3086832490 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed64004e10 con 0x7fed74107900 2024-09-19T04:45:36.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.357+0000 7fed797b5640 1 -- 172.21.15.2:0/3086832490 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed741a02e0 con 0x7fed74107900 2024-09-19T04:45:36.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.358+0000 7fed797b5640 1 -- 172.21.15.2:0/3086832490 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed740fdd90 con 0x7fed74107900 2024-09-19T04:45:36.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.360+0000 7fed6bfff640 1 -- 172.21.15.2:0/3086832490 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fed64005000 con 0x7fed74107900 2024-09-19T04:45:36.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.361+0000 7fed6bfff640 1 --2- 172.21.15.2:0/3086832490 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fed600a32f0 0x7fed600a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:36.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.361+0000 7fed72ffd640 1 --2- 172.21.15.2:0/3086832490 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fed600a32f0 0x7fed600a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:36.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.361+0000 7fed6bfff640 1 -- 172.21.15.2:0/3086832490 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fed640cf5a0 con 0x7fed74107900 2024-09-19T04:45:36.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.361+0000 7fed72ffd640 1 --2- 172.21.15.2:0/3086832490 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fed600a32f0 0x7fed600a57b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fed6c005fa0 tx=0x7fed6c031000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:45:36.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.364+0000 7fed6bfff640 1 -- 172.21.15.2:0/3086832490 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fed64014030 con 0x7fed74107900 2024-09-19T04:45:36.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.542+0000 7fed797b5640 1 -- 172.21.15.2:0/3086832490 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fed7402da10 con 0x7fed74107900 2024-09-19T04:45:36.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.542+0000 7fed6bfff640 1 -- 172.21.15.2:0/3086832490 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v73) ==== 74+0+133 (secure 0 0 0) 0x7fed6409c740 con 0x7fed74107900 2024-09-19T04:45:36.544 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:45:36.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.545+0000 7fed797b5640 1 -- 172.21.15.2:0/3086832490 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fed600a32f0 msgr2=0x7fed600a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:36.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.545+0000 7fed797b5640 1 --2- 172.21.15.2:0/3086832490 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fed600a32f0 0x7fed600a57b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fed6c005fa0 tx=0x7fed6c031000 comp rx=0 tx=0).stop 2024-09-19T04:45:36.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.545+0000 7fed797b5640 1 -- 172.21.15.2:0/3086832490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed74107900 msgr2=0x7fed7419f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:36.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.545+0000 7fed797b5640 1 --2- 172.21.15.2:0/3086832490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed74107900 0x7fed7419f4d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fed6400c970 tx=0x7fed6400ce30 comp rx=0 tx=0).stop 2024-09-19T04:45:36.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.545+0000 7fed797b5640 1 -- 172.21.15.2:0/3086832490 shutdown_connections 2024-09-19T04:45:36.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.545+0000 7fed797b5640 1 --2- 172.21.15.2:0/3086832490 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fed600a32f0 0x7fed600a57b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:36.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.545+0000 7fed797b5640 1 --2- 172.21.15.2:0/3086832490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed74107900 0x7fed7419f4d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:36.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.545+0000 7fed797b5640 1 --2- 172.21.15.2:0/3086832490 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed74104fd0 0x7fed74198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:36.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.545+0000 7fed797b5640 1 --2- 172.21.15.2:0/3086832490 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed741026a0 0x7fed74197f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:36.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.545+0000 7fed797b5640 1 -- 172.21.15.2:0/3086832490 >> 172.21.15.2:0/3086832490 conn(0x7fed740fc2a0 msgr2=0x7fed74103000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:45:36.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.545+0000 7fed797b5640 1 -- 172.21.15.2:0/3086832490 shutdown_connections 2024-09-19T04:45:36.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:36.545+0000 7fed797b5640 1 -- 172.21.15.2:0/3086832490 wait complete. 2024-09-19T04:45:36.556 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:36 smithi018 ceph-mon[34537]: osdmap e73: 12 total, 12 up, 12 in 2024-09-19T04:45:37.172 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":73,"num_osds":12,"num_up_osds":12,"osd_up_since":1726721133,"num_in_osds":12,"osd_in_since":1726721109,"num_remapped_pgs":0} 2024-09-19T04:45:37.172 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T04:45:37.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:37 smithi002 ceph-mon[30975]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:45:37.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:37 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/3086832490' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T04:45:37.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:37 smithi116 ceph-mon[34477]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:45:37.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:37 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/3086832490' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T04:45:37.427 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:45:37.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:37 smithi018 ceph-mon[34537]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:45:37.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:37 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/3086832490' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T04:45:37.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:37.884+0000 7f1775658640 1 -- 172.21.15.2:0/3150002000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1770106f30 msgr2=0x7f177010eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:37.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:37.884+0000 7f1775658640 1 --2- 172.21.15.2:0/3150002000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1770106f30 0x7f177010eab0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1768009ca0 tx=0x7f176802a8c0 comp rx=0 tx=0).stop 2024-09-19T04:45:37.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:37.884+0000 7f1775658640 1 -- 172.21.15.2:0/3150002000 shutdown_connections 2024-09-19T04:45:37.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:37.884+0000 7f1775658640 1 --2- 172.21.15.2:0/3150002000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1770106f30 0x7f177010eab0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:37.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:37.884+0000 7f1775658640 1 --2- 172.21.15.2:0/3150002000 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1770100cc0 0x7f1770106800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:37.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:37.884+0000 7f1775658640 1 --2- 172.21.15.2:0/3150002000 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1770100310 0x7f17701006f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:37.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:37.884+0000 7f1775658640 1 -- 172.21.15.2:0/3150002000 >> 172.21.15.2:0/3150002000 conn(0x7f1770077210 msgr2=0x7f17700fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:45:37.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:37.884+0000 7f1775658640 1 -- 172.21.15.2:0/3150002000 shutdown_connections 2024-09-19T04:45:37.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:37.884+0000 7f1775658640 1 -- 172.21.15.2:0/3150002000 wait complete. 2024-09-19T04:45:37.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:37.885+0000 7f1775658640 1 Processor -- start 2024-09-19T04:45:37.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:37.885+0000 7f1775658640 1 -- start start 2024-09-19T04:45:37.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:37.886+0000 7f1775658640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1770100310 0x7f17701983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:37.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:37.886+0000 7f1775658640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1770100cc0 0x7f17701988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:37.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:37.886+0000 7f1775658640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1770106f30 0x7f177019cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:37.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:37.886+0000 7f1775658640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1770111e40 con 0x7f1770100cc0 2024-09-19T04:45:37.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:37.886+0000 7f1775658640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1770111cc0 con 0x7f1770106f30 2024-09-19T04:45:37.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:37.886+0000 7f1775658640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f1770111fc0 con 0x7f1770100310 2024-09-19T04:45:37.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:37.886+0000 7f17667fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1770100cc0 0x7f17701988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:37.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:37.886+0000 7f17667fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1770100cc0 0x7f17701988e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52240/0 (socket says 172.21.15.2:52240) 2024-09-19T04:45:37.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:37.886+0000 7f17667fc640 1 -- 172.21.15.2:0/3845969748 learned_addr learned my addr 172.21.15.2:0/3845969748 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:45:37.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:37.886+0000 7f176f7fe640 1 --2- 172.21.15.2:0/3845969748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1770106f30 0x7f177019cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:37.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:37.886+0000 7f176effd640 1 --2- 172.21.15.2:0/3845969748 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1770100310 0x7f17701983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:37.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:37.886+0000 7f17667fc640 1 -- 172.21.15.2:0/3845969748 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1770100310 msgr2=0x7f17701983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:37.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:37.886+0000 7f17667fc640 1 --2- 172.21.15.2:0/3845969748 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1770100310 0x7f17701983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:37.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:37.886+0000 7f17667fc640 1 -- 172.21.15.2:0/3845969748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1770106f30 msgr2=0x7f177019cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:37.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:37.886+0000 7f17667fc640 1 --2- 172.21.15.2:0/3845969748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1770106f30 0x7f177019cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:37.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:37.886+0000 7f17667fc640 1 -- 172.21.15.2:0/3845969748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f177019d350 con 0x7f1770100cc0 2024-09-19T04:45:37.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:37.886+0000 7f17667fc640 1 --2- 172.21.15.2:0/3845969748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1770100cc0 0x7f17701988e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f175800d950 tx=0x7f175800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:45:37.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:37.886+0000 7f176cff9640 1 -- 172.21.15.2:0/3845969748 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1758017070 con 0x7f1770100cc0 2024-09-19T04:45:37.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:37.886+0000 7f176cff9640 1 -- 172.21.15.2:0/3845969748 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1758009c30 con 0x7f1770100cc0 2024-09-19T04:45:37.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:37.886+0000 7f1775658640 1 -- 172.21.15.2:0/3845969748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f177019d640 con 0x7f1770100cc0 2024-09-19T04:45:37.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:37.886+0000 7f176cff9640 1 -- 172.21.15.2:0/3845969748 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f175800f620 con 0x7f1770100cc0 2024-09-19T04:45:37.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:37.886+0000 7f1775658640 1 -- 172.21.15.2:0/3845969748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17701a4f20 con 0x7f1770100cc0 2024-09-19T04:45:37.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:37.888+0000 7f1775658640 1 -- 172.21.15.2:0/3845969748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17701006f0 con 0x7f1770100cc0 2024-09-19T04:45:37.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:37.889+0000 7f176cff9640 1 -- 172.21.15.2:0/3845969748 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f17580109a0 con 0x7f1770100cc0 2024-09-19T04:45:37.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:37.889+0000 7f176cff9640 1 --2- 172.21.15.2:0/3845969748 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f175c0a32c0 0x7f175c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:37.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:37.889+0000 7f176effd640 1 --2- 172.21.15.2:0/3845969748 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f175c0a32c0 0x7f175c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:37.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:37.889+0000 7f176cff9640 1 -- 172.21.15.2:0/3845969748 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f17580cef50 con 0x7f1770100cc0 2024-09-19T04:45:37.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:37.890+0000 7f176effd640 1 --2- 172.21.15.2:0/3845969748 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f175c0a32c0 0x7f175c0a5780 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f17600058c0 tx=0x7f176000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:45:37.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:37.893+0000 7f176cff9640 1 -- 172.21.15.2:0/3845969748 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1758009de0 con 0x7f1770100cc0 2024-09-19T04:45:38.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:38.081+0000 7f1775658640 1 -- 172.21.15.2:0/3845969748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f177010a110 con 0x7f1770100cc0 2024-09-19T04:45:38.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:38.082+0000 7f176cff9640 1 -- 172.21.15.2:0/3845969748 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+18350 (secure 0 0 0) 0x7f175809bac0 con 0x7f1770100cc0 2024-09-19T04:45:38.084 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:45:38.084 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":73,"fsid":"d46630c4-7640-11ef-bceb-c7b262605968","created":"2024-09-19T04:38:39.698488+0000","modified":"2024-09-19T04:45:35.064680+0000","last_up_change":"2024-09-19T04:45:33.839647+0000","last_in_change":"2024-09-19T04:45:09.816808+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T04:41:51.960734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7a7dc9b9-8d5d-4dd3-93a3-0d5efced07d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":611702745},{"type":"v1","addr":"172.21.15.2:6803","nonce":611702745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":611702745},{"type":"v1","addr":"172.21.15.2:6805","nonce":611702745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":611702745},{"type":"v1","addr":"172.21.15.2:6809","nonce":611702745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":611702745},{"type":"v1","addr":"172.21.15.2:6807","nonce":611702745}]},"public_addr":"172.21.15.2:6803/611702745","cluster_addr":"172.21.15.2:6805/611702745","heartbeat_back_addr":"172.21.15.2:6809/611702745","heartbeat_front_addr":"172.21.15.2:6807/611702745","state":["exists","up"]},{"osd":1,"uuid":"bea40dec-7d9c-497f-bf16-4bf6d3b839f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":58390709},{"type":"v1","addr":"172.21.15.18:6801","nonce":58390709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":58390709},{"type":"v1","addr":"172.21.15.18:6803","nonce":58390709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":58390709},{"type":"v1","addr":"172.21.15.18:6807","nonce":58390709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":58390709},{"type":"v1","addr":"172.21.15.18:6805","nonce":58390709}]},"public_addr":"172.21.15.18:6801/58390709","cluster_addr":"172.21.15.18:6803/58390709","heartbeat_back_addr":"172.21.15.18:6807/58390709","heartbeat_front_addr":"172.21.15.18:6805/58390709","state":["exists","up"]},{"osd":2,"uuid":"97716304-a31e-48c9-83de-84eed10a7a4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":627735759},{"type":"v1","addr":"172.21.15.116:6801","nonce":627735759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":627735759},{"type":"v1","addr":"172.21.15.116:6803","nonce":627735759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":627735759},{"type":"v1","addr":"172.21.15.116:6807","nonce":627735759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":627735759},{"type":"v1","addr":"172.21.15.116:6805","nonce":627735759}]},"public_addr":"172.21.15.116:6801/627735759","cluster_addr":"172.21.15.116:6803/627735759","heartbeat_back_addr":"172.21.15.116:6807/627735759","heartbeat_front_addr":"172.21.15.116:6805/627735759","state":["exists","up"]},{"osd":3,"uuid":"8d79514e-16cf-4bd0-a2eb-e9148b91183d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1936071687},{"type":"v1","addr":"172.21.15.2:6811","nonce":1936071687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1936071687},{"type":"v1","addr":"172.21.15.2:6813","nonce":1936071687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1936071687},{"type":"v1","addr":"172.21.15.2:6817","nonce":1936071687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1936071687},{"type":"v1","addr":"172.21.15.2:6815","nonce":1936071687}]},"public_addr":"172.21.15.2:6811/1936071687","cluster_addr":"172.21.15.2:6813/1936071687","heartbeat_back_addr":"172.21.15.2:6817/1936071687","heartbeat_front_addr":"172.21.15.2:6815/1936071687","state":["exists","up"]},{"osd":4,"uuid":"5136f03c-94a3-42a0-9bfc-020397836037","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1333533784},{"type":"v1","addr":"172.21.15.18:6809","nonce":1333533784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1333533784},{"type":"v1","addr":"172.21.15.18:6811","nonce":1333533784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1333533784},{"type":"v1","addr":"172.21.15.18:6815","nonce":1333533784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1333533784},{"type":"v1","addr":"172.21.15.18:6813","nonce":1333533784}]},"public_addr":"172.21.15.18:6809/1333533784","cluster_addr":"172.21.15.18:6811/1333533784","heartbeat_back_addr":"172.21.15.18:6815/1333533784","heartbeat_front_addr":"172.21.15.18:6813/1333533784","state":["exists","up"]},{"osd":5,"uuid":"9d3384b0-f87d-4513-b151-4cca21c339b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":316360741},{"type":"v1","addr":"172.21.15.116:6809","nonce":316360741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":316360741},{"type":"v1","addr":"172.21.15.116:6811","nonce":316360741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":316360741},{"type":"v1","addr":"172.21.15.116:6815","nonce":316360741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":316360741},{"type":"v1","addr":"172.21.15.116:6813","nonce":316360741}]},"public_addr":"172.21.15.116:6809/316360741","cluster_addr":"172.21.15.116:6811/316360741","heartbeat_back_addr":"172.21.15.116:6815/316360741","heartbeat_front_addr":"172.21.15.116:6813/316360741","state":["exists","up"]},{"osd":6,"uuid":"e54f44b5-a693-4b31-83b2-2bcf10ab9a75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1185564560},{"type":"v1","addr":"172.21.15.2:6819","nonce":1185564560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1185564560},{"type":"v1","addr":"172.21.15.2:6821","nonce":1185564560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1185564560},{"type":"v1","addr":"172.21.15.2:6825","nonce":1185564560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":1185564560},{"type":"v1","addr":"172.21.15.2:6823","nonce":1185564560}]},"public_addr":"172.21.15.2:6819/1185564560","cluster_addr":"172.21.15.2:6821/1185564560","heartbeat_back_addr":"172.21.15.2:6825/1185564560","heartbeat_front_addr":"172.21.15.2:6823/1185564560","state":["exists","up"]},{"osd":7,"uuid":"96a444c3-429a-48b6-9823-95c9e171341a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3691801363},{"type":"v1","addr":"172.21.15.18:6817","nonce":3691801363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3691801363},{"type":"v1","addr":"172.21.15.18:6819","nonce":3691801363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3691801363},{"type":"v1","addr":"172.21.15.18:6823","nonce":3691801363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3691801363},{"type":"v1","addr":"172.21.15.18:6821","nonce":3691801363}]},"public_addr":"172.21.15.18:6817/3691801363","cluster_addr":"172.21.15.18:6819/3691801363","heartbeat_back_addr":"172.21.15.18:6823/3691801363","heartbeat_front_addr":"172.21.15.18:6821/3691801363","state":["exists","up"]},{"osd":8,"uuid":"c3f696aa-be7d-4f67-9147-3751406e394d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":3709586119},{"type":"v1","addr":"172.21.15.116:6817","nonce":3709586119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":3709586119},{"type":"v1","addr":"172.21.15.116:6819","nonce":3709586119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":3709586119},{"type":"v1","addr":"172.21.15.116:6823","nonce":3709586119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":3709586119},{"type":"v1","addr":"172.21.15.116:6821","nonce":3709586119}]},"public_addr":"172.21.15.116:6817/3709586119","cluster_addr":"172.21.15.116:6819/3709586119","heartbeat_back_addr":"172.21.15.116:6823/3709586119","heartbeat_front_addr":"172.21.15.116:6821/3709586119","state":["exists","up"]},{"osd":9,"uuid":"4892549d-f050-48c5-b695-5924b612a581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1054791011},{"type":"v1","addr":"172.21.15.2:6827","nonce":1054791011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1054791011},{"type":"v1","addr":"172.21.15.2:6829","nonce":1054791011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1054791011},{"type":"v1","addr":"172.21.15.2:6833","nonce":1054791011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":1054791011},{"type":"v1","addr":"172.21.15.2:6831","nonce":1054791011}]},"public_addr":"172.21.15.2:6827/1054791011","cluster_addr":"172.21.15.2:6829/1054791011","heartbeat_back_addr":"172.21.15.2:6833/1054791011","heartbeat_front_addr":"172.21.15.2:6831/1054791011","state":["exists","up"]},{"osd":10,"uuid":"12b60238-6a35-4d48-bacd-ee5ddd8fdb0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1958683776},{"type":"v1","addr":"172.21.15.18:6825","nonce":1958683776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":1958683776},{"type":"v1","addr":"172.21.15.18:6827","nonce":1958683776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":1958683776},{"type":"v1","addr":"172.21.15.18:6831","nonce":1958683776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":1958683776},{"type":"v1","addr":"172.21.15.18:6829","nonce":1958683776}]},"public_addr":"172.21.15.18:6825/1958683776","cluster_addr":"172.21.15.18:6827/1958683776","heartbeat_back_addr":"172.21.15.18:6831/1958683776","heartbeat_front_addr":"172.21.15.18:6829/1958683776","state":["exists","up"]},{"osd":11,"uuid":"99b3e553-b42c-4b2f-817f-3900ad8bd223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3456789654},{"type":"v1","addr":"172.21.15.116:6825","nonce":3456789654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3456789654},{"type":"v1","addr":"172.21.15.116:6827","nonce":3456789654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3456789654},{"type":"v1","addr":"172.21.15.116:6831","nonce":3456789654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3456789654},{"type":"v1","addr":"172.21.15.116:6829","nonce":3456789654}]},"public_addr":"172.21.15.116:6825/3456789654","cluster_addr":"172.21.15.116:6827/3456789654","heartbeat_back_addr":"172.21.15.116:6831/3456789654","heartbeat_front_addr":"172.21.15.116:6829/3456789654","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:40:58.216702+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:41:22.852350+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:41:47.265084+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:42:12.785128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:42:38.475008+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:43:02.924009+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:43:28.050646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:43:52.715369+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:44:16.905066+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:44:42.071128+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:45:06.434525+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:45:31.569086+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/870383845":"2024-09-20T04:39:35.461329+0000","172.21.15.2:0/2801870985":"2024-09-20T04:39:35.461329+0000","172.21.15.2:0/256825166":"2024-09-20T04:39:35.461329+0000","172.21.15.2:6801/3782987318":"2024-09-20T04:39:35.461329+0000","172.21.15.2:0/3064319092":"2024-09-20T04:39:11.086431+0000","172.21.15.2:0/1528097642":"2024-09-20T04:39:11.086431+0000","172.21.15.2:6801/1825825090":"2024-09-20T04:39:11.086431+0000","172.21.15.2:6800/1825825090":"2024-09-20T04:39:11.086431+0000","172.21.15.2:6800/3782987318":"2024-09-20T04:39:35.461329+0000","172.21.15.2:0/2432243496":"2024-09-20T04:39:11.086431+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T04:45:38.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:38.085+0000 7f1775658640 1 -- 172.21.15.2:0/3845969748 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f175c0a32c0 msgr2=0x7f175c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:38.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:38.085+0000 7f1775658640 1 --2- 172.21.15.2:0/3845969748 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f175c0a32c0 0x7f175c0a5780 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f17600058c0 tx=0x7f176000a2d0 comp rx=0 tx=0).stop 2024-09-19T04:45:38.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:38.085+0000 7f1775658640 1 -- 172.21.15.2:0/3845969748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1770100cc0 msgr2=0x7f17701988e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:38.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:38.085+0000 7f1775658640 1 --2- 172.21.15.2:0/3845969748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1770100cc0 0x7f17701988e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f175800d950 tx=0x7f175800de10 comp rx=0 tx=0).stop 2024-09-19T04:45:38.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:38.085+0000 7f1775658640 1 -- 172.21.15.2:0/3845969748 shutdown_connections 2024-09-19T04:45:38.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:38.085+0000 7f1775658640 1 --2- 172.21.15.2:0/3845969748 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f175c0a32c0 0x7f175c0a5780 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:38.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:38.085+0000 7f1775658640 1 --2- 172.21.15.2:0/3845969748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1770106f30 0x7f177019cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:38.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:38.085+0000 7f1775658640 1 --2- 172.21.15.2:0/3845969748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1770100cc0 0x7f17701988e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:38.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:38.085+0000 7f1775658640 1 --2- 172.21.15.2:0/3845969748 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1770100310 0x7f17701983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:38.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:38.085+0000 7f1775658640 1 -- 172.21.15.2:0/3845969748 >> 172.21.15.2:0/3845969748 conn(0x7f1770077210 msgr2=0x7f1770105150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:45:38.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:38.085+0000 7f1775658640 1 -- 172.21.15.2:0/3845969748 shutdown_connections 2024-09-19T04:45:38.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:38.085+0000 7f1775658640 1 -- 172.21.15.2:0/3845969748 wait complete. 2024-09-19T04:45:38.767 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T04:41:51.960734+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T04:45:38.768 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-19T04:45:39.024 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:45:39.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:39 smithi002 ceph-mon[30975]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:45:39.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:39 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/3845969748' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:45:39.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:39 smithi116 ceph-mon[34477]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:45:39.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:39 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/3845969748' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:45:39.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.487+0000 7fdba9b4e640 1 -- 172.21.15.2:0/1314068434 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdba4101de0 msgr2=0x7fdba41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:39.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.487+0000 7fdba9b4e640 1 --2- 172.21.15.2:0/1314068434 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdba4101de0 0x7fdba41021c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdb94009900 tx=0x7fdb9402a410 comp rx=0 tx=0).stop 2024-09-19T04:45:39.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.487+0000 7fdba9b4e640 1 -- 172.21.15.2:0/1314068434 shutdown_connections 2024-09-19T04:45:39.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.487+0000 7fdba9b4e640 1 --2- 172.21.15.2:0/1314068434 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdba4106f10 0x7fdba410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:39.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.487+0000 7fdba9b4e640 1 --2- 172.21.15.2:0/1314068434 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdba4102790 0x7fdba41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:39.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.487+0000 7fdba9b4e640 1 --2- 172.21.15.2:0/1314068434 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdba4101de0 0x7fdba41021c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:39.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.487+0000 7fdba9b4e640 1 -- 172.21.15.2:0/1314068434 >> 172.21.15.2:0/1314068434 conn(0x7fdba40fd8c0 msgr2=0x7fdba40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:45:39.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.487+0000 7fdba9b4e640 1 -- 172.21.15.2:0/1314068434 shutdown_connections 2024-09-19T04:45:39.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.487+0000 7fdba9b4e640 1 -- 172.21.15.2:0/1314068434 wait complete. 2024-09-19T04:45:39.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.488+0000 7fdba9b4e640 1 Processor -- start 2024-09-19T04:45:39.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.488+0000 7fdba9b4e640 1 -- start start 2024-09-19T04:45:39.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.488+0000 7fdba9b4e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdba4101de0 0x7fdba4198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:39.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.488+0000 7fdba9b4e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdba4102790 0x7fdba41988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:39.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.488+0000 7fdba9b4e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdba4106f10 0x7fdba419cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:39.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.488+0000 7fdba9b4e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdba4111e70 con 0x7fdba4106f10 2024-09-19T04:45:39.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.488+0000 7fdba9b4e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdba4111cf0 con 0x7fdba4101de0 2024-09-19T04:45:39.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.488+0000 7fdba9b4e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fdba4111ff0 con 0x7fdba4102790 2024-09-19T04:45:39.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.488+0000 7fdba3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdba4106f10 0x7fdba419cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:39.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.488+0000 7fdba3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdba4106f10 0x7fdba419cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52258/0 (socket says 172.21.15.2:52258) 2024-09-19T04:45:39.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.488+0000 7fdba3fff640 1 -- 172.21.15.2:0/412481776 learned_addr learned my addr 172.21.15.2:0/412481776 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:45:39.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.489+0000 7fdba37fe640 1 --2- 172.21.15.2:0/412481776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdba4101de0 0x7fdba4198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:39.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.489+0000 7fdba2ffd640 1 --2- 172.21.15.2:0/412481776 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdba4102790 0x7fdba41988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:39.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.489+0000 7fdba3fff640 1 -- 172.21.15.2:0/412481776 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdba4102790 msgr2=0x7fdba41988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:39.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.489+0000 7fdba3fff640 1 --2- 172.21.15.2:0/412481776 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdba4102790 0x7fdba41988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:39.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.489+0000 7fdba3fff640 1 -- 172.21.15.2:0/412481776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdba4101de0 msgr2=0x7fdba4198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:39.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.489+0000 7fdba3fff640 1 --2- 172.21.15.2:0/412481776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdba4101de0 0x7fdba4198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:39.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.489+0000 7fdba3fff640 1 -- 172.21.15.2:0/412481776 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdba419d340 con 0x7fdba4106f10 2024-09-19T04:45:39.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.489+0000 7fdba3fff640 1 --2- 172.21.15.2:0/412481776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdba4106f10 0x7fdba419cc60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c00cce0 tx=0x7fdb9c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:45:39.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.489+0000 7fdba0ff9640 1 -- 172.21.15.2:0/412481776 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c00f450 con 0x7fdba4106f10 2024-09-19T04:45:39.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.489+0000 7fdba0ff9640 1 -- 172.21.15.2:0/412481776 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdb9c00faa0 con 0x7fdba4106f10 2024-09-19T04:45:39.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.489+0000 7fdba9b4e640 1 -- 172.21.15.2:0/412481776 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdba419d630 con 0x7fdba4106f10 2024-09-19T04:45:39.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.489+0000 7fdba0ff9640 1 -- 172.21.15.2:0/412481776 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c018b70 con 0x7fdba4106f10 2024-09-19T04:45:39.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.489+0000 7fdba9b4e640 1 -- 172.21.15.2:0/412481776 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdba41a4f10 con 0x7fdba4106f10 2024-09-19T04:45:39.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.490+0000 7fdba9b4e640 1 -- 172.21.15.2:0/412481776 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdba41021c0 con 0x7fdba4106f10 2024-09-19T04:45:39.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.492+0000 7fdba0ff9640 1 -- 172.21.15.2:0/412481776 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fdb9c018d10 con 0x7fdba4106f10 2024-09-19T04:45:39.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.492+0000 7fdba0ff9640 1 --2- 172.21.15.2:0/412481776 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fdb8c0a3240 0x7fdb8c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:39.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.493+0000 7fdba37fe640 1 --2- 172.21.15.2:0/412481776 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fdb8c0a3240 0x7fdb8c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:39.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.493+0000 7fdba0ff9640 1 -- 172.21.15.2:0/412481776 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fdb9c0cf840 con 0x7fdba4106f10 2024-09-19T04:45:39.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.493+0000 7fdba37fe640 1 --2- 172.21.15.2:0/412481776 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fdb8c0a3240 0x7fdb8c0a5700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdb94005ab0 tx=0x7fdb94005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:45:39.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.497+0000 7fdba0ff9640 1 -- 172.21.15.2:0/412481776 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdb9c014030 con 0x7fdba4106f10 2024-09-19T04:45:39.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:39 smithi018 ceph-mon[34537]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:45:39.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:39 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/3845969748' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:45:39.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.674+0000 7fdba9b4e640 1 -- 172.21.15.2:0/412481776 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdba410a150 con 0x7fdba4106f10 2024-09-19T04:45:39.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.674+0000 7fdba0ff9640 1 -- 172.21.15.2:0/412481776 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) ==== 93+0+10 (secure 0 0 0) 0x7fdb9c09ca00 con 0x7fdba4106f10 2024-09-19T04:45:39.676 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-09-19T04:45:39.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.676+0000 7fdba9b4e640 1 -- 172.21.15.2:0/412481776 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fdb8c0a3240 msgr2=0x7fdb8c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:39.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.676+0000 7fdba9b4e640 1 --2- 172.21.15.2:0/412481776 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fdb8c0a3240 0x7fdb8c0a5700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdb94005ab0 tx=0x7fdb94005a20 comp rx=0 tx=0).stop 2024-09-19T04:45:39.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.676+0000 7fdba9b4e640 1 -- 172.21.15.2:0/412481776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdba4106f10 msgr2=0x7fdba419cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:39.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.676+0000 7fdba9b4e640 1 --2- 172.21.15.2:0/412481776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdba4106f10 0x7fdba419cc60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c00cce0 tx=0x7fdb9c00a620 comp rx=0 tx=0).stop 2024-09-19T04:45:39.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.676+0000 7fdba9b4e640 1 -- 172.21.15.2:0/412481776 shutdown_connections 2024-09-19T04:45:39.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.676+0000 7fdba9b4e640 1 --2- 172.21.15.2:0/412481776 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fdb8c0a3240 0x7fdb8c0a5700 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:39.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.676+0000 7fdba9b4e640 1 --2- 172.21.15.2:0/412481776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdba4106f10 0x7fdba419cc60 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:39.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.676+0000 7fdba9b4e640 1 --2- 172.21.15.2:0/412481776 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdba4102790 0x7fdba41988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:39.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.676+0000 7fdba9b4e640 1 --2- 172.21.15.2:0/412481776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdba4101de0 0x7fdba4198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:39.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.676+0000 7fdba9b4e640 1 -- 172.21.15.2:0/412481776 >> 172.21.15.2:0/412481776 conn(0x7fdba40fd8c0 msgr2=0x7fdba40febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:45:39.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.677+0000 7fdba9b4e640 1 -- 172.21.15.2:0/412481776 shutdown_connections 2024-09-19T04:45:39.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:39.677+0000 7fdba9b4e640 1 -- 172.21.15.2:0/412481776 wait complete. 2024-09-19T04:45:40.291 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:40 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/412481776' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T04:45:40.321 INFO:tasks.cephadm:Adding mds.a on smithi002 2024-09-19T04:45:40.322 INFO:tasks.cephadm:Adding mds.d on smithi002 2024-09-19T04:45:40.322 INFO:tasks.cephadm:Adding mds.g on smithi002 2024-09-19T04:45:40.322 INFO:tasks.cephadm:Adding mds.j on smithi002 2024-09-19T04:45:40.322 INFO:tasks.cephadm:Adding mds.b on smithi018 2024-09-19T04:45:40.322 INFO:tasks.cephadm:Adding mds.e on smithi018 2024-09-19T04:45:40.322 INFO:tasks.cephadm:Adding mds.h on smithi018 2024-09-19T04:45:40.322 INFO:tasks.cephadm:Adding mds.k on smithi018 2024-09-19T04:45:40.322 INFO:tasks.cephadm:Adding mds.c on smithi116 2024-09-19T04:45:40.322 INFO:tasks.cephadm:Adding mds.f on smithi116 2024-09-19T04:45:40.322 INFO:tasks.cephadm:Adding mds.i on smithi116 2024-09-19T04:45:40.322 INFO:tasks.cephadm:Adding mds.l on smithi116 2024-09-19T04:45:40.323 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph orch apply mds all '12;smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi018=b;smithi018=e;smithi018=h;smithi018=k;smithi116=c;smithi116=f;smithi116=i;smithi116=l' 2024-09-19T04:45:40.351 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:40 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/412481776' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T04:45:40.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:40 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/412481776' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T04:45:40.578 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T04:45:41.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.029+0000 7fa068b08640 1 -- 172.21.15.116:0/89376350 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0641037c0 msgr2=0x7fa06410a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:41.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.029+0000 7fa068b08640 1 --2- 172.21.15.116:0/89376350 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0641037c0 0x7fa06410a050 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa05c009ca0 tx=0x7fa05c02a8c0 comp rx=0 tx=0).stop 2024-09-19T04:45:41.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.029+0000 7fa068b08640 1 -- 172.21.15.116:0/89376350 shutdown_connections 2024-09-19T04:45:41.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.029+0000 7fa068b08640 1 --2- 172.21.15.116:0/89376350 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0641037c0 0x7fa06410a050 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:41.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.029+0000 7fa068b08640 1 --2- 172.21.15.116:0/89376350 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa064102e00 0x7fa064103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:41.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.029+0000 7fa068b08640 1 --2- 172.21.15.116:0/89376350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa064101c00 0x7fa064102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:41.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.029+0000 7fa068b08640 1 -- 172.21.15.116:0/89376350 >> 172.21.15.116:0/89376350 conn(0x7fa0640fd390 msgr2=0x7fa0640ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:45:41.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.029+0000 7fa068b08640 1 -- 172.21.15.116:0/89376350 shutdown_connections 2024-09-19T04:45:41.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.029+0000 7fa068b08640 1 -- 172.21.15.116:0/89376350 wait complete. 2024-09-19T04:45:41.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.030+0000 7fa068b08640 1 Processor -- start 2024-09-19T04:45:41.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.030+0000 7fa068b08640 1 -- start start 2024-09-19T04:45:41.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.030+0000 7fa068b08640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa064101c00 0x7fa064197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:41.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.030+0000 7fa068b08640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa064102e00 0x7fa064198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:41.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.030+0000 7fa068b08640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0641037c0 0x7fa06419f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:41.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.030+0000 7fa068b08640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa06410d710 con 0x7fa0641037c0 2024-09-19T04:45:41.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.030+0000 7fa068b08640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa06410d590 con 0x7fa064101c00 2024-09-19T04:45:41.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.030+0000 7fa068b08640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa06410d890 con 0x7fa064102e00 2024-09-19T04:45:41.056 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.031+0000 7fa061d9b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa064102e00 0x7fa064198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:41.056 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.031+0000 7fa061d9b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa064102e00 0x7fa064198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34282/0 (socket says 172.21.15.116:34282) 2024-09-19T04:45:41.056 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.031+0000 7fa061d9b640 1 -- 172.21.15.116:0/1333032881 learned_addr learned my addr 172.21.15.116:0/1333032881 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-19T04:45:41.056 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.031+0000 7fa06259c640 1 --2- 172.21.15.116:0/1333032881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa064101c00 0x7fa064197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:41.056 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.031+0000 7fa062d9d640 1 --2- 172.21.15.116:0/1333032881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0641037c0 0x7fa06419f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:41.056 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.031+0000 7fa061d9b640 1 -- 172.21.15.116:0/1333032881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa064101c00 msgr2=0x7fa064197dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:41.056 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.031+0000 7fa061d9b640 1 --2- 172.21.15.116:0/1333032881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa064101c00 0x7fa064197dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:41.056 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.031+0000 7fa061d9b640 1 -- 172.21.15.116:0/1333032881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0641037c0 msgr2=0x7fa06419f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:41.056 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.031+0000 7fa061d9b640 1 --2- 172.21.15.116:0/1333032881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0641037c0 0x7fa06419f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:41.056 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.031+0000 7fa061d9b640 1 -- 172.21.15.116:0/1333032881 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa06419f9f0 con 0x7fa064102e00 2024-09-19T04:45:41.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.031+0000 7fa06259c640 1 --2- 172.21.15.116:0/1333032881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa064101c00 0x7fa064197dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:45:41.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.031+0000 7fa061d9b640 1 --2- 172.21.15.116:0/1333032881 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa064102e00 0x7fa064198300 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa05400d950 tx=0x7fa05400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:45:41.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.031+0000 7fa0537fe640 1 -- 172.21.15.116:0/1333032881 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa054017070 con 0x7fa064102e00 2024-09-19T04:45:41.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.031+0000 7fa068b08640 1 -- 172.21.15.116:0/1333032881 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa06419fce0 con 0x7fa064102e00 2024-09-19T04:45:41.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.031+0000 7fa0537fe640 1 -- 172.21.15.116:0/1333032881 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa054009c30 con 0x7fa064102e00 2024-09-19T04:45:41.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.031+0000 7fa0537fe640 1 -- 172.21.15.116:0/1333032881 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05400f620 con 0x7fa064102e00 2024-09-19T04:45:41.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.031+0000 7fa068b08640 1 -- 172.21.15.116:0/1333032881 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0641a01c0 con 0x7fa064102e00 2024-09-19T04:45:41.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.033+0000 7fa068b08640 1 -- 172.21.15.116:0/1333032881 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa064109050 con 0x7fa064102e00 2024-09-19T04:45:41.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.033+0000 7fa0537fe640 1 -- 172.21.15.116:0/1333032881 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fa0540109a0 con 0x7fa064102e00 2024-09-19T04:45:41.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.034+0000 7fa0537fe640 1 --2- 172.21.15.116:0/1333032881 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fa04c0a3270 0x7fa04c0a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:41.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.035+0000 7fa0537fe640 1 -- 172.21.15.116:0/1333032881 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fa0540cf1e0 con 0x7fa064102e00 2024-09-19T04:45:41.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.035+0000 7fa06259c640 1 --2- 172.21.15.116:0/1333032881 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fa04c0a3270 0x7fa04c0a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:41.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.035+0000 7fa06259c640 1 --2- 172.21.15.116:0/1333032881 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fa04c0a3270 0x7fa04c0a5730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa064102c60 tx=0x7fa05800a560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:45:41.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.038+0000 7fa0537fe640 1 -- 172.21.15.116:0/1333032881 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa05409c300 con 0x7fa064102e00 2024-09-19T04:45:41.249 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:41 smithi116 ceph-mon[34477]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:45:41.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.249+0000 7fa068b08640 1 -- 172.21.15.116:0/1333032881 --> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi018=b;smithi018=e;smithi018=h;smithi018=k;smithi116=c;smithi116=f;smithi116=i;smithi116=l", "target": ["mon-mgr", ""]}) -- 0x7fa0640628f0 con 0x7fa04c0a3270 2024-09-19T04:45:41.258 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.257+0000 7fa0537fe640 1 -- 172.21.15.116:0/1333032881 <== mgr.14150 v2:172.21.15.2:6800/3171525177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7fa0640628f0 con 0x7fa04c0a3270 2024-09-19T04:45:41.258 INFO:teuthology.orchestra.run.smithi116.stdout:Scheduled mds.all update... 2024-09-19T04:45:41.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.259+0000 7fa068b08640 1 -- 172.21.15.116:0/1333032881 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fa04c0a3270 msgr2=0x7fa04c0a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:41.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.259+0000 7fa068b08640 1 --2- 172.21.15.116:0/1333032881 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fa04c0a3270 0x7fa04c0a5730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa064102c60 tx=0x7fa05800a560 comp rx=0 tx=0).stop 2024-09-19T04:45:41.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.259+0000 7fa068b08640 1 -- 172.21.15.116:0/1333032881 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa064102e00 msgr2=0x7fa064198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:41.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.259+0000 7fa068b08640 1 --2- 172.21.15.116:0/1333032881 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa064102e00 0x7fa064198300 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa05400d950 tx=0x7fa05400de10 comp rx=0 tx=0).stop 2024-09-19T04:45:41.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.259+0000 7fa068b08640 1 -- 172.21.15.116:0/1333032881 shutdown_connections 2024-09-19T04:45:41.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.259+0000 7fa068b08640 1 --2- 172.21.15.116:0/1333032881 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fa04c0a3270 0x7fa04c0a5730 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:41.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.259+0000 7fa068b08640 1 --2- 172.21.15.116:0/1333032881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0641037c0 0x7fa06419f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:41.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.259+0000 7fa068b08640 1 --2- 172.21.15.116:0/1333032881 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa064102e00 0x7fa064198300 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:41.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.259+0000 7fa068b08640 1 --2- 172.21.15.116:0/1333032881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa064101c00 0x7fa064197dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:41.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.259+0000 7fa068b08640 1 -- 172.21.15.116:0/1333032881 >> 172.21.15.116:0/1333032881 conn(0x7fa0640fd390 msgr2=0x7fa064106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:45:41.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.259+0000 7fa068b08640 1 -- 172.21.15.116:0/1333032881 shutdown_connections 2024-09-19T04:45:41.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-19T04:45:41.260+0000 7fa068b08640 1 -- 172.21.15.116:0/1333032881 wait complete. 2024-09-19T04:45:41.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:41 smithi002 ceph-mon[30975]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:45:41.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:41 smithi018 ceph-mon[34537]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:45:41.881 DEBUG:teuthology.orchestra.run.smithi002:mds.a> sudo journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@mds.a.service 2024-09-19T04:45:41.953 DEBUG:teuthology.orchestra.run.smithi002:mds.d> sudo journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@mds.d.service 2024-09-19T04:45:41.996 DEBUG:teuthology.orchestra.run.smithi002:mds.g> sudo journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@mds.g.service 2024-09-19T04:45:42.040 DEBUG:teuthology.orchestra.run.smithi002:mds.j> sudo journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@mds.j.service 2024-09-19T04:45:42.084 DEBUG:teuthology.orchestra.run.smithi018:mds.b> sudo journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@mds.b.service 2024-09-19T04:45:42.087 DEBUG:teuthology.orchestra.run.smithi018:mds.e> sudo journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@mds.e.service 2024-09-19T04:45:42.130 DEBUG:teuthology.orchestra.run.smithi018:mds.h> sudo journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@mds.h.service 2024-09-19T04:45:42.173 DEBUG:teuthology.orchestra.run.smithi018:mds.k> sudo journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@mds.k.service 2024-09-19T04:45:42.216 DEBUG:teuthology.orchestra.run.smithi116:mds.c> sudo journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@mds.c.service 2024-09-19T04:45:42.218 DEBUG:teuthology.orchestra.run.smithi116:mds.f> sudo journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@mds.f.service 2024-09-19T04:45:42.261 DEBUG:teuthology.orchestra.run.smithi116:mds.i> sudo journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@mds.i.service 2024-09-19T04:45:42.304 DEBUG:teuthology.orchestra.run.smithi116:mds.l> sudo journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@mds.l.service 2024-09-19T04:45:42.348 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-19T04:45:42.349 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:45:42.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:42 smithi018 ceph-mon[34537]: from='client.24430 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi018=b;smithi018=e;smithi018=h;smithi018=k;smithi116=c;smithi116=f;smithi116=i;smithi116=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:45:42.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:42 smithi018 ceph-mon[34537]: Saving service mds.all spec with placement smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi018=b;smithi018=e;smithi018=h;smithi018=k;smithi116=c;smithi116=f;smithi116=i;smithi116=l;count:12 2024-09-19T04:45:42.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:42 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:42.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:42 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:45:42.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:42 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:45:42.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:42 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:45:42.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:42 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:42.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:42 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:45:42.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:42 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:45:42.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:42 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:45:42.605 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:45:42.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:42 smithi002 ceph-mon[30975]: from='client.24430 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi018=b;smithi018=e;smithi018=h;smithi018=k;smithi116=c;smithi116=f;smithi116=i;smithi116=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:45:42.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:42 smithi002 ceph-mon[30975]: Saving service mds.all spec with placement smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi018=b;smithi018=e;smithi018=h;smithi018=k;smithi116=c;smithi116=f;smithi116=i;smithi116=l;count:12 2024-09-19T04:45:42.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:42 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:42.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:42 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:45:42.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:42 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:45:42.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:42 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:45:42.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:42 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:42.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:42 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:45:42.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:42 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:45:42.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:42 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:45:42.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:42 smithi116 ceph-mon[34477]: from='client.24430 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi018=b;smithi018=e;smithi018=h;smithi018=k;smithi116=c;smithi116=f;smithi116=i;smithi116=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:45:42.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:42 smithi116 ceph-mon[34477]: Saving service mds.all spec with placement smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi018=b;smithi018=e;smithi018=h;smithi018=k;smithi116=c;smithi116=f;smithi116=i;smithi116=l;count:12 2024-09-19T04:45:42.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:42 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:42.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:42 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:45:42.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:42 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:45:42.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:42 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:45:42.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:42 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:42.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:42 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:45:42.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:42 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:45:42.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:42 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:45:43.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.025+0000 7f8d04970640 1 -- 172.21.15.2:0/4138995398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d00102d40 msgr2=0x7f8d00103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:43.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.025+0000 7f8d04970640 1 --2- 172.21.15.2:0/4138995398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d00102d40 0x7f8d00103120 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0009900 tx=0x7f8cf002a480 comp rx=0 tx=0).stop 2024-09-19T04:45:43.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.025+0000 7f8d04970640 1 -- 172.21.15.2:0/4138995398 shutdown_connections 2024-09-19T04:45:43.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.025+0000 7f8d04970640 1 --2- 172.21.15.2:0/4138995398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d0010c170 0x7f8d0010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:43.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.025+0000 7f8d04970640 1 --2- 172.21.15.2:0/4138995398 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8d00103660 0x7f8d0010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:43.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.025+0000 7f8d04970640 1 --2- 172.21.15.2:0/4138995398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d00102d40 0x7f8d00103120 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:43.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.025+0000 7f8d04970640 1 -- 172.21.15.2:0/4138995398 >> 172.21.15.2:0/4138995398 conn(0x7f8d000fc7a0 msgr2=0x7f8d000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:45:43.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.025+0000 7f8d04970640 1 -- 172.21.15.2:0/4138995398 shutdown_connections 2024-09-19T04:45:43.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.025+0000 7f8d04970640 1 -- 172.21.15.2:0/4138995398 wait complete. 2024-09-19T04:45:43.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.026+0000 7f8d04970640 1 Processor -- start 2024-09-19T04:45:43.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.026+0000 7f8d04970640 1 -- start start 2024-09-19T04:45:43.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.026+0000 7f8d04970640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d00102d40 0x7f8d001983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:43.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.026+0000 7f8d04970640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d00103660 0x7f8d00198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:43.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.026+0000 7f8d04970640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8d0010c170 0x7f8d0019ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:43.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.026+0000 7f8d04970640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8d00111e20 con 0x7f8d00102d40 2024-09-19T04:45:43.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.026+0000 7f8d04970640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8d00111ca0 con 0x7f8d00103660 2024-09-19T04:45:43.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.026+0000 7f8d04970640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f8d00111fa0 con 0x7f8d0010c170 2024-09-19T04:45:43.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.026+0000 7f8cfe59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d00102d40 0x7f8d001983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:43.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.026+0000 7f8cfe59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d00102d40 0x7f8d001983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50736/0 (socket says 172.21.15.2:50736) 2024-09-19T04:45:43.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.026+0000 7f8cfe59c640 1 -- 172.21.15.2:0/2057055787 learned_addr learned my addr 172.21.15.2:0/2057055787 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:45:43.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.026+0000 7f8cfed9d640 1 --2- 172.21.15.2:0/2057055787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8d0010c170 0x7f8d0019ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:43.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.026+0000 7f8cfdd9b640 1 --2- 172.21.15.2:0/2057055787 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d00103660 0x7f8d00198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:43.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.027+0000 7f8cfed9d640 1 -- 172.21.15.2:0/2057055787 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d00103660 msgr2=0x7f8d00198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:43.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.027+0000 7f8cfed9d640 1 --2- 172.21.15.2:0/2057055787 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d00103660 0x7f8d00198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:43.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.027+0000 7f8cfed9d640 1 -- 172.21.15.2:0/2057055787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d00102d40 msgr2=0x7f8d001983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:43.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.027+0000 7f8cfed9d640 1 --2- 172.21.15.2:0/2057055787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d00102d40 0x7f8d001983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:43.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.027+0000 7f8cfed9d640 1 -- 172.21.15.2:0/2057055787 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d0019d390 con 0x7f8d0010c170 2024-09-19T04:45:43.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.027+0000 7f8cfe59c640 1 --2- 172.21.15.2:0/2057055787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d00102d40 0x7f8d001983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:45:43.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.027+0000 7f8cfed9d640 1 --2- 172.21.15.2:0/2057055787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8d0010c170 0x7f8d0019ccb0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8cf800da10 tx=0x7f8cf800ded0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:45:43.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.027+0000 7f8cf77fe640 1 -- 172.21.15.2:0/2057055787 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf800bd70 con 0x7f8d0010c170 2024-09-19T04:45:43.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.027+0000 7f8cf77fe640 1 -- 172.21.15.2:0/2057055787 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8cf8003e20 con 0x7f8d0010c170 2024-09-19T04:45:43.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.027+0000 7f8d04970640 1 -- 172.21.15.2:0/2057055787 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d0019d680 con 0x7f8d0010c170 2024-09-19T04:45:43.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.027+0000 7f8cf77fe640 1 -- 172.21.15.2:0/2057055787 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf80106c0 con 0x7f8d0010c170 2024-09-19T04:45:43.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.027+0000 7f8d04970640 1 -- 172.21.15.2:0/2057055787 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d001a4f60 con 0x7f8d0010c170 2024-09-19T04:45:43.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.028+0000 7f8d04970640 1 -- 172.21.15.2:0/2057055787 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d00103120 con 0x7f8d0010c170 2024-09-19T04:45:43.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.029+0000 7f8cf77fe640 1 -- 172.21.15.2:0/2057055787 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f8cf8003970 con 0x7f8d0010c170 2024-09-19T04:45:43.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.030+0000 7f8cf77fe640 1 --2- 172.21.15.2:0/2057055787 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f8cec0a32c0 0x7f8cec0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:43.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.030+0000 7f8cfe59c640 1 --2- 172.21.15.2:0/2057055787 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f8cec0a32c0 0x7f8cec0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:43.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.030+0000 7f8cf77fe640 1 -- 172.21.15.2:0/2057055787 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f8cf80cf750 con 0x7f8d0010c170 2024-09-19T04:45:43.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.030+0000 7f8cfe59c640 1 --2- 172.21.15.2:0/2057055787 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f8cec0a32c0 0x7f8cec0a5780 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0031440 tx=0x7f8cf00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:45:43.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.033+0000 7f8cf77fe640 1 -- 172.21.15.2:0/2057055787 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8cf809c8f0 con 0x7f8d0010c170 2024-09-19T04:45:43.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.243+0000 7f8d04970640 1 -- 172.21.15.2:0/2057055787 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8d00199740 con 0x7f8d0010c170 2024-09-19T04:45:43.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.244+0000 7f8cf77fe640 1 -- 172.21.15.2:0/2057055787 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f8d00199740 con 0x7f8d0010c170 2024-09-19T04:45:43.245 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:45:43.246 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":1,"btime":"2024-09-19T04:38:39:698336+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-19T04:45:43.246 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 1 2024-09-19T04:45:43.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.246+0000 7f8d04970640 1 -- 172.21.15.2:0/2057055787 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f8cec0a32c0 msgr2=0x7f8cec0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:43.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.246+0000 7f8d04970640 1 --2- 172.21.15.2:0/2057055787 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f8cec0a32c0 0x7f8cec0a5780 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0031440 tx=0x7f8cf00058d0 comp rx=0 tx=0).stop 2024-09-19T04:45:43.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.246+0000 7f8d04970640 1 -- 172.21.15.2:0/2057055787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8d0010c170 msgr2=0x7f8d0019ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:43.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.246+0000 7f8d04970640 1 --2- 172.21.15.2:0/2057055787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8d0010c170 0x7f8d0019ccb0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8cf800da10 tx=0x7f8cf800ded0 comp rx=0 tx=0).stop 2024-09-19T04:45:43.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.246+0000 7f8d04970640 1 -- 172.21.15.2:0/2057055787 shutdown_connections 2024-09-19T04:45:43.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.246+0000 7f8d04970640 1 --2- 172.21.15.2:0/2057055787 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f8cec0a32c0 0x7f8cec0a5780 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:43.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.246+0000 7f8d04970640 1 --2- 172.21.15.2:0/2057055787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8d0010c170 0x7f8d0019ccb0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:43.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.246+0000 7f8d04970640 1 --2- 172.21.15.2:0/2057055787 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d00103660 0x7f8d00198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:43.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.246+0000 7f8d04970640 1 --2- 172.21.15.2:0/2057055787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d00102d40 0x7f8d001983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:43.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.246+0000 7f8d04970640 1 -- 172.21.15.2:0/2057055787 >> 172.21.15.2:0/2057055787 conn(0x7f8d000fc7a0 msgr2=0x7f8d000fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:45:43.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.246+0000 7f8d04970640 1 -- 172.21.15.2:0/2057055787 shutdown_connections 2024-09-19T04:45:43.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:43.246+0000 7f8d04970640 1 -- 172.21.15.2:0/2057055787 wait complete. 2024-09-19T04:45:43.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:43 smithi002 ceph-mon[30975]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:45:43.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:43 smithi002 ceph-mon[30975]: Deploying daemon mds.l on smithi116 2024-09-19T04:45:43.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:43 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/2057055787' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:45:43.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:43 smithi018 ceph-mon[34537]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:45:43.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:43 smithi018 ceph-mon[34537]: Deploying daemon mds.l on smithi116 2024-09-19T04:45:43.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:43 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/2057055787' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:45:43.575 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:43 smithi116 ceph-mon[34477]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:45:43.575 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:43 smithi116 ceph-mon[34477]: Deploying daemon mds.l on smithi116 2024-09-19T04:45:43.575 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:43 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/2057055787' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:45:43.576 INFO:journalctl@ceph.mds.l.smithi116.stdout:Sep 19 04:45:43 smithi116 systemd[1]: Starting Ceph mds.l for d46630c4-7640-11ef-bceb-c7b262605968... 2024-09-19T04:45:43.837 INFO:journalctl@ceph.mds.l.smithi116.stdout:Sep 19 04:45:43 smithi116 podman[63990]: 2024-09-19 04:45:43.574210196 +0000 UTC m=+0.087790275 container create f8bd7b31c4c702be2bbc60ac58470c00df99099de8be4cd2911dc8a59732ff09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-l, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS) 2024-09-19T04:45:43.837 INFO:journalctl@ceph.mds.l.smithi116.stdout:Sep 19 04:45:43 smithi116 podman[63990]: 2024-09-19 04:45:43.502111409 +0000 UTC m=+0.015691499 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:45:43.837 INFO:journalctl@ceph.mds.l.smithi116.stdout:Sep 19 04:45:43 smithi116 podman[63990]: 2024-09-19 04:45:43.810426719 +0000 UTC m=+0.324006808 container init f8bd7b31c4c702be2bbc60ac58470c00df99099de8be4cd2911dc8a59732ff09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-l, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-19T04:45:43.837 INFO:journalctl@ceph.mds.l.smithi116.stdout:Sep 19 04:45:43 smithi116 podman[63990]: 2024-09-19 04:45:43.813254232 +0000 UTC m=+0.326834314 container start f8bd7b31c4c702be2bbc60ac58470c00df99099de8be4cd2911dc8a59732ff09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-19T04:45:43.838 INFO:journalctl@ceph.mds.l.smithi116.stdout:Sep 19 04:45:43 smithi116 ceph-mds[64009]: -- 172.21.15.116:0/1025142139 <== mon.1 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560ecb383c20 con 0x560ecb360800 2024-09-19T04:45:44.110 INFO:journalctl@ceph.mds.l.smithi116.stdout:Sep 19 04:45:43 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-l[64005]: starting mds.l at 2024-09-19T04:45:44.110 INFO:journalctl@ceph.mds.l.smithi116.stdout:Sep 19 04:45:43 smithi116 bash[63990]: f8bd7b31c4c702be2bbc60ac58470c00df99099de8be4cd2911dc8a59732ff09 2024-09-19T04:45:44.111 INFO:journalctl@ceph.mds.l.smithi116.stdout:Sep 19 04:45:43 smithi116 systemd[1]: Started Ceph mds.l for d46630c4-7640-11ef-bceb-c7b262605968. 2024-09-19T04:45:45.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:44 smithi018 ceph-mon[34537]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:45:45.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:44 smithi018 ceph-mon[34537]: mds.? [v2:172.21.15.116:6832/1553897465,v1:172.21.15.116:6833/1553897465] up:boot 2024-09-19T04:45:45.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:44 smithi018 ceph-mon[34537]: fsmap 1 up:standby 2024-09-19T04:45:45.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:44 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T04:45:45.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:44 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:45.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:44 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:45.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:44 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:45.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:44 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:45:45.058 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:44 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:45:45.058 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:44 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:45:45.058 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:44 smithi018 ceph-mon[34537]: Deploying daemon mds.k on smithi018 2024-09-19T04:45:45.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:44 smithi002 ceph-mon[30975]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:45:45.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:44 smithi002 ceph-mon[30975]: mds.? [v2:172.21.15.116:6832/1553897465,v1:172.21.15.116:6833/1553897465] up:boot 2024-09-19T04:45:45.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:44 smithi002 ceph-mon[30975]: fsmap 1 up:standby 2024-09-19T04:45:45.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:44 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T04:45:45.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:44 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:45.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:44 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:45.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:44 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:45.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:44 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:45:45.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:44 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:45:45.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:44 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:45:45.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:44 smithi002 ceph-mon[30975]: Deploying daemon mds.k on smithi018 2024-09-19T04:45:45.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:44 smithi116 ceph-mon[34477]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:45:45.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:44 smithi116 ceph-mon[34477]: mds.? [v2:172.21.15.116:6832/1553897465,v1:172.21.15.116:6833/1553897465] up:boot 2024-09-19T04:45:45.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:44 smithi116 ceph-mon[34477]: fsmap 1 up:standby 2024-09-19T04:45:45.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:44 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T04:45:45.112 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:44 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:45.112 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:44 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:45.112 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:44 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:45.112 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:44 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:45:45.112 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:44 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:45:45.112 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:44 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:45:45.112 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:44 smithi116 ceph-mon[34477]: Deploying daemon mds.k on smithi018 2024-09-19T04:45:45.990 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:45:46.238 INFO:journalctl@ceph.mds.k.smithi018.stdout:Sep 19 04:45:46 smithi018 systemd[1]: Starting Ceph mds.k for d46630c4-7640-11ef-bceb-c7b262605968... 2024-09-19T04:45:46.259 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:45:46.510 INFO:journalctl@ceph.mds.k.smithi018.stdout:Sep 19 04:45:46 smithi018 podman[63607]: 2024-09-19 04:45:46.139878085 +0000 UTC m=+0.016769628 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:45:46.510 INFO:journalctl@ceph.mds.k.smithi018.stdout:Sep 19 04:45:46 smithi018 podman[63607]: 2024-09-19 04:45:46.261151666 +0000 UTC m=+0.138043204 container create 629dab1921dc80c1b913725850c652351e59b2aa226b4e30654d0da9b794ef39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-k, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4) 2024-09-19T04:45:46.510 INFO:journalctl@ceph.mds.k.smithi018.stdout:Sep 19 04:45:46 smithi018 podman[63607]: 2024-09-19 04:45:46.480078305 +0000 UTC m=+0.356969845 container init 629dab1921dc80c1b913725850c652351e59b2aa226b4e30654d0da9b794ef39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-k, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T04:45:46.510 INFO:journalctl@ceph.mds.k.smithi018.stdout:Sep 19 04:45:46 smithi018 podman[63607]: 2024-09-19 04:45:46.483281406 +0000 UTC m=+0.360172945 container start 629dab1921dc80c1b913725850c652351e59b2aa226b4e30654d0da9b794ef39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-k, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-19T04:45:46.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.681+0000 7f16f1d07640 1 -- 172.21.15.2:0/391205508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16ec106a80 msgr2=0x7f16ec106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:46.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.681+0000 7f16f1d07640 1 --2- 172.21.15.2:0/391205508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16ec106a80 0x7f16ec106e60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f16dc009930 tx=0x7f16dc02a420 comp rx=0 tx=0).stop 2024-09-19T04:45:46.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.681+0000 7f16f1d07640 1 -- 172.21.15.2:0/391205508 shutdown_connections 2024-09-19T04:45:46.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.681+0000 7f16f1d07640 1 --2- 172.21.15.2:0/391205508 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f16ec101420 0x7f16ec10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:46.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.681+0000 7f16f1d07640 1 --2- 172.21.15.2:0/391205508 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f16ec100a80 0x7f16ec100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:46.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.681+0000 7f16f1d07640 1 --2- 172.21.15.2:0/391205508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16ec106a80 0x7f16ec106e60 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:46.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.681+0000 7f16f1d07640 1 -- 172.21.15.2:0/391205508 >> 172.21.15.2:0/391205508 conn(0x7f16ec0fc7a0 msgr2=0x7f16ec0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:45:46.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.681+0000 7f16f1d07640 1 -- 172.21.15.2:0/391205508 shutdown_connections 2024-09-19T04:45:46.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.681+0000 7f16f1d07640 1 -- 172.21.15.2:0/391205508 wait complete. 2024-09-19T04:45:46.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.682+0000 7f16f1d07640 1 Processor -- start 2024-09-19T04:45:46.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.682+0000 7f16f1d07640 1 -- start start 2024-09-19T04:45:46.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.682+0000 7f16f1d07640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f16ec100a80 0x7f16ec1991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:46.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.682+0000 7f16f1d07640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f16ec101420 0x7f16ec199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:46.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.682+0000 7f16f1d07640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16ec106a80 0x7f16ec1a4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:46.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.682+0000 7f16f1d07640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f16ec110d80 con 0x7f16ec106a80 2024-09-19T04:45:46.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.682+0000 7f16f1d07640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f16ec110c00 con 0x7f16ec101420 2024-09-19T04:45:46.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.682+0000 7f16f1d07640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f16ec110f00 con 0x7f16ec100a80 2024-09-19T04:45:46.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.682+0000 7f16ebfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16ec106a80 0x7f16ec1a4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:46.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.682+0000 7f16ebfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16ec106a80 0x7f16ec1a4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50762/0 (socket says 172.21.15.2:50762) 2024-09-19T04:45:46.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.682+0000 7f16ebfff640 1 -- 172.21.15.2:0/2445522252 learned_addr learned my addr 172.21.15.2:0/2445522252 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:45:46.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.682+0000 7f16eaffd640 1 --2- 172.21.15.2:0/2445522252 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f16ec101420 0x7f16ec199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:46.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.682+0000 7f16eb7fe640 1 --2- 172.21.15.2:0/2445522252 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f16ec100a80 0x7f16ec1991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:46.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.683+0000 7f16ebfff640 1 -- 172.21.15.2:0/2445522252 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f16ec100a80 msgr2=0x7f16ec1991f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:46.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.683+0000 7f16ebfff640 1 --2- 172.21.15.2:0/2445522252 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f16ec100a80 0x7f16ec1991f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:46.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.683+0000 7f16ebfff640 1 -- 172.21.15.2:0/2445522252 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f16ec101420 msgr2=0x7f16ec199730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:46.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.683+0000 7f16ebfff640 1 --2- 172.21.15.2:0/2445522252 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f16ec101420 0x7f16ec199730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:46.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.683+0000 7f16ebfff640 1 -- 172.21.15.2:0/2445522252 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16ec1a47b0 con 0x7f16ec106a80 2024-09-19T04:45:46.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.683+0000 7f16ebfff640 1 --2- 172.21.15.2:0/2445522252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16ec106a80 0x7f16ec1a4270 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f16e400cad0 tx=0x7f16e400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:45:46.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.683+0000 7f16e8ff9640 1 -- 172.21.15.2:0/2445522252 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e400ae20 con 0x7f16ec106a80 2024-09-19T04:45:46.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.683+0000 7f16e8ff9640 1 -- 172.21.15.2:0/2445522252 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f16e4005020 con 0x7f16ec106a80 2024-09-19T04:45:46.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.683+0000 7f16f1d07640 1 -- 172.21.15.2:0/2445522252 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16ec1a4980 con 0x7f16ec106a80 2024-09-19T04:45:46.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.683+0000 7f16e8ff9640 1 -- 172.21.15.2:0/2445522252 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e400f6b0 con 0x7f16ec106a80 2024-09-19T04:45:46.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.683+0000 7f16f1d07640 1 -- 172.21.15.2:0/2445522252 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16ec1a4ec0 con 0x7f16ec106a80 2024-09-19T04:45:46.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.684+0000 7f16f1d07640 1 -- 172.21.15.2:0/2445522252 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16ec100ee0 con 0x7f16ec106a80 2024-09-19T04:45:46.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.685+0000 7f16e8ff9640 1 -- 172.21.15.2:0/2445522252 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f16e40051d0 con 0x7f16ec106a80 2024-09-19T04:45:46.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.686+0000 7f16e8ff9640 1 --2- 172.21.15.2:0/2445522252 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f16d40a3240 0x7f16d40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:46.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.686+0000 7f16eb7fe640 1 --2- 172.21.15.2:0/2445522252 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f16d40a3240 0x7f16d40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:46.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.686+0000 7f16e8ff9640 1 -- 172.21.15.2:0/2445522252 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f16e40cf380 con 0x7f16ec106a80 2024-09-19T04:45:46.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.686+0000 7f16eb7fe640 1 --2- 172.21.15.2:0/2445522252 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f16d40a3240 0x7f16d40a5700 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f16dc031440 tx=0x7f16dc005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:45:46.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.690+0000 7f16e8ff9640 1 -- 172.21.15.2:0/2445522252 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f16e4014030 con 0x7f16ec106a80 2024-09-19T04:45:46.807 INFO:journalctl@ceph.mds.k.smithi018.stdout:Sep 19 04:45:46 smithi018 ceph-mds[63627]: -- 172.21.15.18:0/1789755025 <== mon.2 v2:172.21.15.18:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e3b2647860 con 0x55e3b2625400 2024-09-19T04:45:46.807 INFO:journalctl@ceph.mds.k.smithi018.stdout:Sep 19 04:45:46 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-k[63622]: starting mds.k at 2024-09-19T04:45:46.807 INFO:journalctl@ceph.mds.k.smithi018.stdout:Sep 19 04:45:46 smithi018 bash[63607]: 629dab1921dc80c1b913725850c652351e59b2aa226b4e30654d0da9b794ef39 2024-09-19T04:45:46.807 INFO:journalctl@ceph.mds.k.smithi018.stdout:Sep 19 04:45:46 smithi018 systemd[1]: Started Ceph mds.k for d46630c4-7640-11ef-bceb-c7b262605968. 2024-09-19T04:45:46.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.904+0000 7f16f1d07640 1 -- 172.21.15.2:0/2445522252 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f16ec108ff0 con 0x7f16ec106a80 2024-09-19T04:45:46.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.905+0000 7f16e8ff9640 1 -- 172.21.15.2:0/2445522252 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2263 (secure 0 0 0) 0x7f16e409bef0 con 0x7f16ec106a80 2024-09-19T04:45:46.907 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:45:46.907 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":3,"btime":"2024-09-19T04:45:46:844996+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1630480244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1630480244},{"type":"v1","addr":"172.21.15.18:6833","nonce":1630480244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1553897465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1553897465},{"type":"v1","addr":"172.21.15.116:6833","nonce":1553897465}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T04:45:46.908 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 3 2024-09-19T04:45:46.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.907+0000 7f16f1d07640 1 -- 172.21.15.2:0/2445522252 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f16d40a3240 msgr2=0x7f16d40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:46.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.907+0000 7f16f1d07640 1 --2- 172.21.15.2:0/2445522252 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f16d40a3240 0x7f16d40a5700 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f16dc031440 tx=0x7f16dc005a20 comp rx=0 tx=0).stop 2024-09-19T04:45:46.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.907+0000 7f16f1d07640 1 -- 172.21.15.2:0/2445522252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16ec106a80 msgr2=0x7f16ec1a4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:46.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.907+0000 7f16f1d07640 1 --2- 172.21.15.2:0/2445522252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16ec106a80 0x7f16ec1a4270 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f16e400cad0 tx=0x7f16e400cf90 comp rx=0 tx=0).stop 2024-09-19T04:45:46.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.907+0000 7f16f1d07640 1 -- 172.21.15.2:0/2445522252 shutdown_connections 2024-09-19T04:45:46.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.907+0000 7f16f1d07640 1 --2- 172.21.15.2:0/2445522252 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f16d40a3240 0x7f16d40a5700 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:46.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.907+0000 7f16f1d07640 1 --2- 172.21.15.2:0/2445522252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16ec106a80 0x7f16ec1a4270 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:46.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.907+0000 7f16f1d07640 1 --2- 172.21.15.2:0/2445522252 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f16ec101420 0x7f16ec199730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:46.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.907+0000 7f16f1d07640 1 --2- 172.21.15.2:0/2445522252 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f16ec100a80 0x7f16ec1991f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:46.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.907+0000 7f16f1d07640 1 -- 172.21.15.2:0/2445522252 >> 172.21.15.2:0/2445522252 conn(0x7f16ec0fc7a0 msgr2=0x7f16ec0fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:45:46.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.907+0000 7f16f1d07640 1 -- 172.21.15.2:0/2445522252 shutdown_connections 2024-09-19T04:45:46.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:46.907+0000 7f16f1d07640 1 -- 172.21.15.2:0/2445522252 wait complete. 2024-09-19T04:45:47.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:46 smithi002 ceph-mon[30975]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:45:47.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:46 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:47.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:46 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:47.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:46 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:47.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:46 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:45:47.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:46 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:45:47.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:46 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:45:47.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:46 smithi116 ceph-mon[34477]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:45:47.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:46 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:47.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:46 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:47.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:46 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:47.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:46 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:45:47.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:46 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:45:47.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:46 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:45:47.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:46 smithi018 ceph-mon[34537]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:45:47.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:46 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:47.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:46 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:47.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:46 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:47.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:46 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:45:47.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:46 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:45:47.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:46 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:45:48.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:47 smithi018 ceph-mon[34537]: Deploying daemon mds.j on smithi002 2024-09-19T04:45:48.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:47 smithi018 ceph-mon[34537]: mds.? [v2:172.21.15.18:6832/1630480244,v1:172.21.15.18:6833/1630480244] up:boot 2024-09-19T04:45:48.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:47 smithi018 ceph-mon[34537]: fsmap 2 up:standby 2024-09-19T04:45:48.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:47 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T04:45:48.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:47 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/2445522252' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:45:48.068 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:47 smithi002 ceph-mon[30975]: Deploying daemon mds.j on smithi002 2024-09-19T04:45:48.068 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:47 smithi002 ceph-mon[30975]: mds.? [v2:172.21.15.18:6832/1630480244,v1:172.21.15.18:6833/1630480244] up:boot 2024-09-19T04:45:48.068 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:47 smithi002 ceph-mon[30975]: fsmap 2 up:standby 2024-09-19T04:45:48.068 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:47 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T04:45:48.068 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:47 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/2445522252' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:45:48.110 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:47 smithi116 ceph-mon[34477]: Deploying daemon mds.j on smithi002 2024-09-19T04:45:48.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:47 smithi116 ceph-mon[34477]: mds.? [v2:172.21.15.18:6832/1630480244,v1:172.21.15.18:6833/1630480244] up:boot 2024-09-19T04:45:48.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:47 smithi116 ceph-mon[34477]: fsmap 2 up:standby 2024-09-19T04:45:48.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:47 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T04:45:48.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:47 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/2445522252' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:45:49.088 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:48 smithi002 ceph-mon[30975]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:45:49.110 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:48 smithi116 ceph-mon[34477]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:45:49.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:48 smithi018 ceph-mon[34537]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:45:49.360 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 19 04:45:49 smithi002 systemd[1]: Starting Ceph mds.j for d46630c4-7640-11ef-bceb-c7b262605968... 2024-09-19T04:45:49.528 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:45:49.747 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 19 04:45:49 smithi002 podman[70420]: 2024-09-19 04:45:49.390067782 +0000 UTC m=+0.016678398 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:45:49.747 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 19 04:45:49 smithi002 podman[70420]: 2024-09-19 04:45:49.498596939 +0000 UTC m=+0.125207546 container create 56a3b4f35edd3d46cbe8dfb1b4ac6bcc0018fcc12471d605f163756e3e6d478b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-19T04:45:49.747 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 19 04:45:49 smithi002 podman[70420]: 2024-09-19 04:45:49.717713369 +0000 UTC m=+0.344323987 container init 56a3b4f35edd3d46cbe8dfb1b4ac6bcc0018fcc12471d605f163756e3e6d478b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-j, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T04:45:49.747 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 19 04:45:49 smithi002 podman[70420]: 2024-09-19 04:45:49.72179885 +0000 UTC m=+0.348409467 container start 56a3b4f35edd3d46cbe8dfb1b4ac6bcc0018fcc12471d605f163756e3e6d478b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-j, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T04:45:49.905 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:45:50.028 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 19 04:45:49 smithi002 ceph-mds[70468]: -- 172.21.15.2:0/335647601 <== mon.0 v2:172.21.15.2:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55afe868f860 con 0x55afe866d400 2024-09-19T04:45:50.028 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 19 04:45:49 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-j[70453]: starting mds.j at 2024-09-19T04:45:50.028 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 19 04:45:49 smithi002 bash[70420]: 56a3b4f35edd3d46cbe8dfb1b4ac6bcc0018fcc12471d605f163756e3e6d478b 2024-09-19T04:45:50.028 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 19 04:45:49 smithi002 systemd[1]: Started Ceph mds.j for d46630c4-7640-11ef-bceb-c7b262605968. 2024-09-19T04:45:50.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.363+0000 7f9e8a540640 1 -- 172.21.15.2:0/1744805895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e84102ef0 msgr2=0x7f9e8410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:50.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.363+0000 7f9e8a540640 1 --2- 172.21.15.2:0/1744805895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e84102ef0 0x7f9e8410da40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c009ca0 tx=0x7f9e7c02a950 comp rx=0 tx=0).stop 2024-09-19T04:45:50.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.363+0000 7f9e8a540640 1 -- 172.21.15.2:0/1744805895 shutdown_connections 2024-09-19T04:45:50.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.363+0000 7f9e8a540640 1 --2- 172.21.15.2:0/1744805895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e84102ef0 0x7f9e8410da40 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:50.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.363+0000 7f9e8a540640 1 --2- 172.21.15.2:0/1744805895 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e84102570 0x7f9e841029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:50.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.363+0000 7f9e8a540640 1 --2- 172.21.15.2:0/1744805895 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e84100e20 0x7f9e84101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:50.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.363+0000 7f9e8a540640 1 -- 172.21.15.2:0/1744805895 >> 172.21.15.2:0/1744805895 conn(0x7f9e840fc7d0 msgr2=0x7f9e840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:45:50.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.363+0000 7f9e8a540640 1 -- 172.21.15.2:0/1744805895 shutdown_connections 2024-09-19T04:45:50.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.363+0000 7f9e8a540640 1 -- 172.21.15.2:0/1744805895 wait complete. 2024-09-19T04:45:50.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.363+0000 7f9e8a540640 1 Processor -- start 2024-09-19T04:45:50.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.363+0000 7f9e8a540640 1 -- start start 2024-09-19T04:45:50.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.364+0000 7f9e8a540640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e84100e20 0x7f9e840fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:50.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.364+0000 7f9e8a540640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e84102570 0x7f9e840fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:50.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.364+0000 7f9e8a540640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e84102ef0 0x7f9e840fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:50.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.364+0000 7f9e8a540640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9e84110ed0 con 0x7f9e84102ef0 2024-09-19T04:45:50.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.364+0000 7f9e8a540640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9e84110d50 con 0x7f9e84100e20 2024-09-19T04:45:50.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.364+0000 7f9e8a540640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f9e84111050 con 0x7f9e84102570 2024-09-19T04:45:50.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.364+0000 7f9e88add640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e84102ef0 0x7f9e840fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:50.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.364+0000 7f9e88add640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e84102ef0 0x7f9e840fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50792/0 (socket says 172.21.15.2:50792) 2024-09-19T04:45:50.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.364+0000 7f9e88add640 1 -- 172.21.15.2:0/4038973953 learned_addr learned my addr 172.21.15.2:0/4038973953 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:45:50.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.364+0000 7f9e837fe640 1 --2- 172.21.15.2:0/4038973953 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e84102570 0x7f9e840fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:50.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.364+0000 7f9e83fff640 1 --2- 172.21.15.2:0/4038973953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e84100e20 0x7f9e840fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:50.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.364+0000 7f9e88add640 1 -- 172.21.15.2:0/4038973953 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e84102570 msgr2=0x7f9e840fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:50.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.364+0000 7f9e88add640 1 --2- 172.21.15.2:0/4038973953 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e84102570 0x7f9e840fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:50.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.364+0000 7f9e88add640 1 -- 172.21.15.2:0/4038973953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e84100e20 msgr2=0x7f9e840fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:50.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.364+0000 7f9e88add640 1 --2- 172.21.15.2:0/4038973953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e84100e20 0x7f9e840fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:50.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.364+0000 7f9e88add640 1 -- 172.21.15.2:0/4038973953 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e841a6a00 con 0x7f9e84102ef0 2024-09-19T04:45:50.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.364+0000 7f9e837fe640 1 --2- 172.21.15.2:0/4038973953 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e84102570 0x7f9e840fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:45:50.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.364+0000 7f9e83fff640 1 --2- 172.21.15.2:0/4038973953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e84100e20 0x7f9e840fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:45:50.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.365+0000 7f9e88add640 1 --2- 172.21.15.2:0/4038973953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e84102ef0 0x7f9e840fd700 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c006010 tx=0x7f9e7c02f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:45:50.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.365+0000 7f9e817fa640 1 -- 172.21.15.2:0/4038973953 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c034040 con 0x7f9e84102ef0 2024-09-19T04:45:50.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.365+0000 7f9e817fa640 1 -- 172.21.15.2:0/4038973953 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9e7c003e00 con 0x7f9e84102ef0 2024-09-19T04:45:50.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.365+0000 7f9e8a540640 1 -- 172.21.15.2:0/4038973953 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e841a6c90 con 0x7f9e84102ef0 2024-09-19T04:45:50.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.365+0000 7f9e817fa640 1 -- 172.21.15.2:0/4038973953 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c045480 con 0x7f9e84102ef0 2024-09-19T04:45:50.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.365+0000 7f9e8a540640 1 -- 172.21.15.2:0/4038973953 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e841a7170 con 0x7f9e84102ef0 2024-09-19T04:45:50.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.366+0000 7f9e8a540640 1 -- 172.21.15.2:0/4038973953 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e84101280 con 0x7f9e84102ef0 2024-09-19T04:45:50.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.367+0000 7f9e817fa640 1 -- 172.21.15.2:0/4038973953 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f9e7c037020 con 0x7f9e84102ef0 2024-09-19T04:45:50.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.368+0000 7f9e817fa640 1 --2- 172.21.15.2:0/4038973953 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f9e6c0a3240 0x7f9e6c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:50.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.368+0000 7f9e83fff640 1 --2- 172.21.15.2:0/4038973953 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f9e6c0a3240 0x7f9e6c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:50.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.368+0000 7f9e817fa640 1 -- 172.21.15.2:0/4038973953 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f9e7c0f0620 con 0x7f9e84102ef0 2024-09-19T04:45:50.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.368+0000 7f9e83fff640 1 --2- 172.21.15.2:0/4038973953 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f9e6c0a3240 0x7f9e6c0a5700 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9e74009930 tx=0x7f9e74008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:45:50.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.372+0000 7f9e817fa640 1 -- 172.21.15.2:0/4038973953 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9e7c0bd7e0 con 0x7f9e84102ef0 2024-09-19T04:45:50.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.593+0000 7f9e8a540640 1 -- 172.21.15.2:0/4038973953 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9e8410a0a0 con 0x7f9e84102ef0 2024-09-19T04:45:50.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.594+0000 7f9e817fa640 1 -- 172.21.15.2:0/4038973953 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3085 (secure 0 0 0) 0x7f9e7c0bd0e0 con 0x7f9e84102ef0 2024-09-19T04:45:50.596 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:45:50.596 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":4,"btime":"2024-09-19T04:45:49:858110+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2467365137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2467365137},{"type":"v1","addr":"172.21.15.2:6835","nonce":2467365137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1630480244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1630480244},{"type":"v1","addr":"172.21.15.18:6833","nonce":1630480244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1553897465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1553897465},{"type":"v1","addr":"172.21.15.116:6833","nonce":1553897465}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T04:45:50.596 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 4 2024-09-19T04:45:50.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.596+0000 7f9e8a540640 1 -- 172.21.15.2:0/4038973953 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f9e6c0a3240 msgr2=0x7f9e6c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:50.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.596+0000 7f9e8a540640 1 --2- 172.21.15.2:0/4038973953 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f9e6c0a3240 0x7f9e6c0a5700 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9e74009930 tx=0x7f9e74008040 comp rx=0 tx=0).stop 2024-09-19T04:45:50.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.596+0000 7f9e8a540640 1 -- 172.21.15.2:0/4038973953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e84102ef0 msgr2=0x7f9e840fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:50.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.596+0000 7f9e8a540640 1 --2- 172.21.15.2:0/4038973953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e84102ef0 0x7f9e840fd700 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c006010 tx=0x7f9e7c02f710 comp rx=0 tx=0).stop 2024-09-19T04:45:50.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.596+0000 7f9e8a540640 1 -- 172.21.15.2:0/4038973953 shutdown_connections 2024-09-19T04:45:50.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.596+0000 7f9e8a540640 1 --2- 172.21.15.2:0/4038973953 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f9e6c0a3240 0x7f9e6c0a5700 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:50.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.596+0000 7f9e8a540640 1 --2- 172.21.15.2:0/4038973953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e84102ef0 0x7f9e840fd700 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:50.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.596+0000 7f9e8a540640 1 --2- 172.21.15.2:0/4038973953 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e84102570 0x7f9e840fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:50.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.596+0000 7f9e8a540640 1 --2- 172.21.15.2:0/4038973953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e84100e20 0x7f9e840fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:50.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.596+0000 7f9e8a540640 1 -- 172.21.15.2:0/4038973953 >> 172.21.15.2:0/4038973953 conn(0x7f9e840fc7d0 msgr2=0x7f9e8406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:45:50.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.596+0000 7f9e8a540640 1 -- 172.21.15.2:0/4038973953 shutdown_connections 2024-09-19T04:45:50.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:50.596+0000 7f9e8a540640 1 -- 172.21.15.2:0/4038973953 wait complete. 2024-09-19T04:45:51.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:50 smithi018 ceph-mon[34537]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:45:51.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:50 smithi018 ceph-mon[34537]: mds.? [v2:172.21.15.2:6834/2467365137,v1:172.21.15.2:6835/2467365137] up:boot 2024-09-19T04:45:51.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:50 smithi018 ceph-mon[34537]: fsmap 3 up:standby 2024-09-19T04:45:51.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:50 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T04:45:51.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:50 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:51.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:50 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:51.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:50 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:51.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:50 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:45:51.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:50 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:45:51.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:50 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:45:51.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:50 smithi018 ceph-mon[34537]: Deploying daemon mds.d on smithi002 2024-09-19T04:45:51.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:50 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/4038973953' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:45:51.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:50 smithi002 ceph-mon[30975]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:45:51.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:50 smithi002 ceph-mon[30975]: mds.? [v2:172.21.15.2:6834/2467365137,v1:172.21.15.2:6835/2467365137] up:boot 2024-09-19T04:45:51.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:50 smithi002 ceph-mon[30975]: fsmap 3 up:standby 2024-09-19T04:45:51.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:50 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T04:45:51.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:50 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:51.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:50 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:51.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:50 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:51.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:50 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:45:51.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:50 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:45:51.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:50 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:45:51.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:50 smithi002 ceph-mon[30975]: Deploying daemon mds.d on smithi002 2024-09-19T04:45:51.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:50 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/4038973953' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:45:51.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:50 smithi116 ceph-mon[34477]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:45:51.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:50 smithi116 ceph-mon[34477]: mds.? [v2:172.21.15.2:6834/2467365137,v1:172.21.15.2:6835/2467365137] up:boot 2024-09-19T04:45:51.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:50 smithi116 ceph-mon[34477]: fsmap 3 up:standby 2024-09-19T04:45:51.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:50 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T04:45:51.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:50 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:51.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:50 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:51.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:50 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:51.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:50 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:45:51.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:50 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:45:51.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:50 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:45:51.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:50 smithi116 ceph-mon[34477]: Deploying daemon mds.d on smithi002 2024-09-19T04:45:51.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:50 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/4038973953' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:45:52.509 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 19 04:45:52 smithi002 systemd[1]: Starting Ceph mds.d for d46630c4-7640-11ef-bceb-c7b262605968... 2024-09-19T04:45:52.824 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 19 04:45:52 smithi002 podman[70832]: 2024-09-19 04:45:52.726045004 +0000 UTC m=+0.100958967 container create 51951dea2f187f04b7d431c46ec029654fa200da426389807dbb001f2297c8aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-d, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-19T04:45:52.824 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 19 04:45:52 smithi002 podman[70832]: 2024-09-19 04:45:52.641632539 +0000 UTC m=+0.016546514 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:45:53.306 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:52 smithi018 ceph-mon[34537]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:45:53.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:52 smithi002 ceph-mon[30975]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:45:53.360 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 19 04:45:52 smithi002 podman[70832]: 2024-09-19 04:45:52.920268113 +0000 UTC m=+0.295182091 container init 51951dea2f187f04b7d431c46ec029654fa200da426389807dbb001f2297c8aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-d, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-19T04:45:53.360 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 19 04:45:52 smithi002 podman[70832]: 2024-09-19 04:45:52.923325593 +0000 UTC m=+0.298239549 container start 51951dea2f187f04b7d431c46ec029654fa200da426389807dbb001f2297c8aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-d, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-19T04:45:53.360 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 19 04:45:52 smithi002 ceph-mds[70852]: -- 172.21.15.2:0/3807693664 <== mon.0 v2:172.21.15.2:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5598d7459860 con 0x5598d7437400 2024-09-19T04:45:53.360 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 19 04:45:52 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-d[70848]: starting mds.d at 2024-09-19T04:45:53.361 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 19 04:45:52 smithi002 bash[70832]: 51951dea2f187f04b7d431c46ec029654fa200da426389807dbb001f2297c8aa 2024-09-19T04:45:53.361 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 19 04:45:52 smithi002 systemd[1]: Started Ceph mds.d for d46630c4-7640-11ef-bceb-c7b262605968. 2024-09-19T04:45:53.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:52 smithi116 ceph-mon[34477]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:45:54.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:54 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:54.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:54 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:54.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:54 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:54.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:54 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:45:54.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:54 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:45:54.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:54 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:45:54.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:54 smithi018 ceph-mon[34537]: Deploying daemon mds.e on smithi018 2024-09-19T04:45:54.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:54 smithi018 ceph-mon[34537]: mds.? [v2:172.21.15.2:6836/3162441888,v1:172.21.15.2:6837/3162441888] up:boot 2024-09-19T04:45:54.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:54 smithi018 ceph-mon[34537]: fsmap 4 up:standby 2024-09-19T04:45:54.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:54 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T04:45:54.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:54 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:54.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:54 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:54.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:54 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:54.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:54 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:45:54.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:54 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:45:54.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:54 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:45:54.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:54 smithi002 ceph-mon[30975]: Deploying daemon mds.e on smithi018 2024-09-19T04:45:54.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:54 smithi002 ceph-mon[30975]: mds.? [v2:172.21.15.2:6836/3162441888,v1:172.21.15.2:6837/3162441888] up:boot 2024-09-19T04:45:54.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:54 smithi002 ceph-mon[30975]: fsmap 4 up:standby 2024-09-19T04:45:54.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:54 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T04:45:54.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:54 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:54.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:54 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:54.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:54 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:54.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:54 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:45:54.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:54 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:45:54.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:54 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:45:54.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:54 smithi116 ceph-mon[34477]: Deploying daemon mds.e on smithi018 2024-09-19T04:45:54.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:54 smithi116 ceph-mon[34477]: mds.? [v2:172.21.15.2:6836/3162441888,v1:172.21.15.2:6837/3162441888] up:boot 2024-09-19T04:45:54.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:54 smithi116 ceph-mon[34477]: fsmap 4 up:standby 2024-09-19T04:45:54.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:54 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T04:45:54.538 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:45:54.812 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:45:55.191 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:55 smithi002 ceph-mon[30975]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:45:55.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.274+0000 7f2bf559d640 1 -- 172.21.15.2:0/1861881861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bf0102380 msgr2=0x7f2bf010e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:55.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.274+0000 7f2bf559d640 1 --2- 172.21.15.2:0/1861881861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bf0102380 0x7f2bf010e9c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2be8009cd0 tx=0x7f2be802a8e0 comp rx=0 tx=0).stop 2024-09-19T04:45:55.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.274+0000 7f2bf559d640 1 -- 172.21.15.2:0/1861881861 shutdown_connections 2024-09-19T04:45:55.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.274+0000 7f2bf559d640 1 --2- 172.21.15.2:0/1861881861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bf0102380 0x7f2bf010e9c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:55.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.274+0000 7f2bf559d640 1 --2- 172.21.15.2:0/1861881861 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bf01019e0 0x7f2bf0101e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:55.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.274+0000 7f2bf559d640 1 --2- 172.21.15.2:0/1861881861 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2bf0107af0 0x7f2bf0107ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:55.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.274+0000 7f2bf559d640 1 -- 172.21.15.2:0/1861881861 >> 172.21.15.2:0/1861881861 conn(0x7f2bf00fd700 msgr2=0x7f2bf00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:45:55.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.274+0000 7f2bf559d640 1 -- 172.21.15.2:0/1861881861 shutdown_connections 2024-09-19T04:45:55.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.274+0000 7f2bf559d640 1 -- 172.21.15.2:0/1861881861 wait complete. 2024-09-19T04:45:55.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.274+0000 7f2bf559d640 1 Processor -- start 2024-09-19T04:45:55.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.274+0000 7f2bf559d640 1 -- start start 2024-09-19T04:45:55.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.275+0000 7f2bf559d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bf01019e0 0x7f2bf01982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:55.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.275+0000 7f2bf559d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2bf0102380 0x7f2bf01987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:55.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.275+0000 7f2bf559d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bf0107af0 0x7f2bf019cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:55.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.275+0000 7f2bf559d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf0111dc0 con 0x7f2bf0107af0 2024-09-19T04:45:55.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.275+0000 7f2bf559d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf0111c40 con 0x7f2bf01019e0 2024-09-19T04:45:55.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.275+0000 7f2bf559d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf0111f40 con 0x7f2bf0102380 2024-09-19T04:45:55.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.275+0000 7f2bf4d9c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bf0107af0 0x7f2bf019cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:55.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.275+0000 7f2bf4d9c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bf0107af0 0x7f2bf019cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52902/0 (socket says 172.21.15.2:52902) 2024-09-19T04:45:55.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.275+0000 7f2bf4d9c640 1 -- 172.21.15.2:0/1962670884 learned_addr learned my addr 172.21.15.2:0/1962670884 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:45:55.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.275+0000 7f2beffff640 1 --2- 172.21.15.2:0/1962670884 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bf01019e0 0x7f2bf01982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:55.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.275+0000 7f2bef7fe640 1 --2- 172.21.15.2:0/1962670884 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2bf0102380 0x7f2bf01987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:55.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.275+0000 7f2bf4d9c640 1 -- 172.21.15.2:0/1962670884 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2bf0102380 msgr2=0x7f2bf01987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:55.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.275+0000 7f2bf4d9c640 1 --2- 172.21.15.2:0/1962670884 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2bf0102380 0x7f2bf01987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:55.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.275+0000 7f2bf4d9c640 1 -- 172.21.15.2:0/1962670884 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bf01019e0 msgr2=0x7f2bf01982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:55.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.275+0000 7f2bf4d9c640 1 --2- 172.21.15.2:0/1962670884 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bf01019e0 0x7f2bf01982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:55.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.275+0000 7f2bf4d9c640 1 -- 172.21.15.2:0/1962670884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bf019d260 con 0x7f2bf0107af0 2024-09-19T04:45:55.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.275+0000 7f2bef7fe640 1 --2- 172.21.15.2:0/1962670884 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2bf0102380 0x7f2bf01987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:45:55.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.276+0000 7f2bf4d9c640 1 --2- 172.21.15.2:0/1962670884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bf0107af0 0x7f2bf019cb80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2be8033040 tx=0x7f2be8003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:45:55.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.276+0000 7f2bed7fa640 1 -- 172.21.15.2:0/1962670884 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be8004040 con 0x7f2bf0107af0 2024-09-19T04:45:55.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.276+0000 7f2bed7fa640 1 -- 172.21.15.2:0/1962670884 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2be8004690 con 0x7f2bf0107af0 2024-09-19T04:45:55.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.276+0000 7f2bf559d640 1 -- 172.21.15.2:0/1962670884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bf019d4f0 con 0x7f2bf0107af0 2024-09-19T04:45:55.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.276+0000 7f2bed7fa640 1 -- 172.21.15.2:0/1962670884 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be8030d80 con 0x7f2bf0107af0 2024-09-19T04:45:55.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.276+0000 7f2bf559d640 1 -- 172.21.15.2:0/1962670884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bf01a4e30 con 0x7f2bf0107af0 2024-09-19T04:45:55.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.277+0000 7f2bf559d640 1 -- 172.21.15.2:0/1962670884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bf0101e40 con 0x7f2bf0107af0 2024-09-19T04:45:55.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.278+0000 7f2bed7fa640 1 -- 172.21.15.2:0/1962670884 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f2be80041e0 con 0x7f2bf0107af0 2024-09-19T04:45:55.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.279+0000 7f2bed7fa640 1 --2- 172.21.15.2:0/1962670884 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f2bd80a3240 0x7f2bd80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:55.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.279+0000 7f2beffff640 1 --2- 172.21.15.2:0/1962670884 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f2bd80a3240 0x7f2bd80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:55.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.279+0000 7f2bed7fa640 1 -- 172.21.15.2:0/1962670884 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f2be802e030 con 0x7f2bf0107af0 2024-09-19T04:45:55.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.279+0000 7f2beffff640 1 --2- 172.21.15.2:0/1962670884 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f2bd80a3240 0x7f2bd80a5700 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2be0009990 tx=0x7f2be0009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:45:55.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.283+0000 7f2bed7fa640 1 -- 172.21.15.2:0/1962670884 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2be80bd710 con 0x7f2bf0107af0 2024-09-19T04:45:55.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:55 smithi018 ceph-mon[34537]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:45:55.307 INFO:journalctl@ceph.mds.e.smithi018.stdout:Sep 19 04:45:55 smithi018 systemd[1]: Starting Ceph mds.e for d46630c4-7640-11ef-bceb-c7b262605968... 2024-09-19T04:45:55.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:55 smithi116 ceph-mon[34477]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:45:55.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.494+0000 7f2bf559d640 1 -- 172.21.15.2:0/1962670884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2bf0103120 con 0x7f2bf0107af0 2024-09-19T04:45:55.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.494+0000 7f2bed7fa640 1 -- 172.21.15.2:0/1962670884 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3907 (secure 0 0 0) 0x7f2be80bd010 con 0x7f2bf0107af0 2024-09-19T04:45:55.496 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:45:55.496 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":5,"btime":"2024-09-19T04:45:53:868412+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2467365137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2467365137},{"type":"v1","addr":"172.21.15.2:6835","nonce":2467365137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3162441888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3162441888},{"type":"v1","addr":"172.21.15.2:6837","nonce":3162441888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1630480244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1630480244},{"type":"v1","addr":"172.21.15.18:6833","nonce":1630480244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1553897465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1553897465},{"type":"v1","addr":"172.21.15.116:6833","nonce":1553897465}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T04:45:55.496 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 5 2024-09-19T04:45:55.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.496+0000 7f2bf559d640 1 -- 172.21.15.2:0/1962670884 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f2bd80a3240 msgr2=0x7f2bd80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:55.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.496+0000 7f2bf559d640 1 --2- 172.21.15.2:0/1962670884 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f2bd80a3240 0x7f2bd80a5700 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2be0009990 tx=0x7f2be0009110 comp rx=0 tx=0).stop 2024-09-19T04:45:55.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.496+0000 7f2bf559d640 1 -- 172.21.15.2:0/1962670884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bf0107af0 msgr2=0x7f2bf019cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:55.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.496+0000 7f2bf559d640 1 --2- 172.21.15.2:0/1962670884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bf0107af0 0x7f2bf019cb80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2be8033040 tx=0x7f2be8003970 comp rx=0 tx=0).stop 2024-09-19T04:45:55.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.497+0000 7f2bf559d640 1 -- 172.21.15.2:0/1962670884 shutdown_connections 2024-09-19T04:45:55.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.497+0000 7f2bf559d640 1 --2- 172.21.15.2:0/1962670884 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f2bd80a3240 0x7f2bd80a5700 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:55.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.497+0000 7f2bf559d640 1 --2- 172.21.15.2:0/1962670884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bf0107af0 0x7f2bf019cb80 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:55.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.497+0000 7f2bf559d640 1 --2- 172.21.15.2:0/1962670884 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2bf0102380 0x7f2bf01987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:55.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.497+0000 7f2bf559d640 1 --2- 172.21.15.2:0/1962670884 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bf01019e0 0x7f2bf01982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:55.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.497+0000 7f2bf559d640 1 -- 172.21.15.2:0/1962670884 >> 172.21.15.2:0/1962670884 conn(0x7f2bf00fd700 msgr2=0x7f2bf00fef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:45:55.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.497+0000 7f2bf559d640 1 -- 172.21.15.2:0/1962670884 shutdown_connections 2024-09-19T04:45:55.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:55.497+0000 7f2bf559d640 1 -- 172.21.15.2:0/1962670884 wait complete. 2024-09-19T04:45:55.634 INFO:journalctl@ceph.mds.e.smithi018.stdout:Sep 19 04:45:55 smithi018 podman[63926]: 2024-09-19 04:45:55.277749499 +0000 UTC m=+0.016553233 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:45:55.634 INFO:journalctl@ceph.mds.e.smithi018.stdout:Sep 19 04:45:55 smithi018 podman[63926]: 2024-09-19 04:45:55.406096038 +0000 UTC m=+0.144899760 container create a3d5df36f065648eaee3bee35efdd4fd26ac47d5e9afacadafa6cef3a85dfc67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-e, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-19T04:45:55.634 INFO:journalctl@ceph.mds.e.smithi018.stdout:Sep 19 04:45:55 smithi018 podman[63926]: 2024-09-19 04:45:55.633355298 +0000 UTC m=+0.372159030 container init a3d5df36f065648eaee3bee35efdd4fd26ac47d5e9afacadafa6cef3a85dfc67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-e, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-19T04:45:56.045 INFO:journalctl@ceph.mds.e.smithi018.stdout:Sep 19 04:45:55 smithi018 podman[63926]: 2024-09-19 04:45:55.63626069 +0000 UTC m=+0.375064411 container start a3d5df36f065648eaee3bee35efdd4fd26ac47d5e9afacadafa6cef3a85dfc67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T04:45:56.045 INFO:journalctl@ceph.mds.e.smithi018.stdout:Sep 19 04:45:55 smithi018 ceph-mds[63945]: -- 172.21.15.18:0/2152560956 <== mon.2 v2:172.21.15.18:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b1f19e7860 con 0x55b1f19c4800 2024-09-19T04:45:56.045 INFO:journalctl@ceph.mds.e.smithi018.stdout:Sep 19 04:45:55 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-e[63941]: starting mds.e at 2024-09-19T04:45:56.046 INFO:journalctl@ceph.mds.e.smithi018.stdout:Sep 19 04:45:55 smithi018 bash[63926]: a3d5df36f065648eaee3bee35efdd4fd26ac47d5e9afacadafa6cef3a85dfc67 2024-09-19T04:45:56.046 INFO:journalctl@ceph.mds.e.smithi018.stdout:Sep 19 04:45:55 smithi018 systemd[1]: Started Ceph mds.e for d46630c4-7640-11ef-bceb-c7b262605968. 2024-09-19T04:45:56.296 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:56 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/1962670884' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:45:56.296 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:56 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:56.297 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:56 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:56.297 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:56 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:56.297 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:56 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:45:56.297 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:56 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:45:56.297 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:56 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:45:56.306 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:56 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/1962670884' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:45:56.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:56 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:56.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:56 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:56.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:56 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:56.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:56 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:45:56.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:56 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:45:56.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:56 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:45:56.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:56 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/1962670884' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:45:56.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:56 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:56.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:56 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:56.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:56 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:56.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:56 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:45:56.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:56 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:45:56.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:56 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:45:57.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:57 smithi018 ceph-mon[34537]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:45:57.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:57 smithi018 ceph-mon[34537]: Deploying daemon mds.f on smithi116 2024-09-19T04:45:57.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:57 smithi018 ceph-mon[34537]: mds.? [v2:172.21.15.18:6834/3035664608,v1:172.21.15.18:6835/3035664608] up:boot 2024-09-19T04:45:57.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:57 smithi018 ceph-mon[34537]: fsmap 5 up:standby 2024-09-19T04:45:57.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:57 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T04:45:57.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:57 smithi002 ceph-mon[30975]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:45:57.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:57 smithi002 ceph-mon[30975]: Deploying daemon mds.f on smithi116 2024-09-19T04:45:57.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:57 smithi002 ceph-mon[30975]: mds.? [v2:172.21.15.18:6834/3035664608,v1:172.21.15.18:6835/3035664608] up:boot 2024-09-19T04:45:57.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:57 smithi002 ceph-mon[30975]: fsmap 5 up:standby 2024-09-19T04:45:57.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:57 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T04:45:57.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:57 smithi116 ceph-mon[34477]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:45:57.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:57 smithi116 ceph-mon[34477]: Deploying daemon mds.f on smithi116 2024-09-19T04:45:57.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:57 smithi116 ceph-mon[34477]: mds.? [v2:172.21.15.18:6834/3035664608,v1:172.21.15.18:6835/3035664608] up:boot 2024-09-19T04:45:57.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:57 smithi116 ceph-mon[34477]: fsmap 5 up:standby 2024-09-19T04:45:57.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:57 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T04:45:57.820 INFO:journalctl@ceph.mds.f.smithi116.stdout:Sep 19 04:45:57 smithi116 systemd[1]: Starting Ceph mds.f for d46630c4-7640-11ef-bceb-c7b262605968... 2024-09-19T04:45:58.111 INFO:journalctl@ceph.mds.f.smithi116.stdout:Sep 19 04:45:57 smithi116 podman[64293]: 2024-09-19 04:45:57.819249696 +0000 UTC m=+0.112699164 container create 95553dfaf8def1c0fd5da5f7e1767022d3be9552873f6979bc5d28596e33fb64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-f, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T04:45:58.111 INFO:journalctl@ceph.mds.f.smithi116.stdout:Sep 19 04:45:57 smithi116 podman[64293]: 2024-09-19 04:45:57.722397084 +0000 UTC m=+0.015846516 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:45:58.111 INFO:journalctl@ceph.mds.f.smithi116.stdout:Sep 19 04:45:58 smithi116 podman[64293]: 2024-09-19 04:45:58.038444392 +0000 UTC m=+0.331893826 container init 95553dfaf8def1c0fd5da5f7e1767022d3be9552873f6979bc5d28596e33fb64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-f, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T04:45:58.111 INFO:journalctl@ceph.mds.f.smithi116.stdout:Sep 19 04:45:58 smithi116 podman[64293]: 2024-09-19 04:45:58.04139481 +0000 UTC m=+0.334844233 container start 95553dfaf8def1c0fd5da5f7e1767022d3be9552873f6979bc5d28596e33fb64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-f, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-19T04:45:58.111 INFO:journalctl@ceph.mds.f.smithi116.stdout:Sep 19 04:45:58 smithi116 ceph-mds[64313]: -- 172.21.15.116:0/3828858462 <== mon.1 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560c81627860 con 0x560c81605000 2024-09-19T04:45:58.111 INFO:journalctl@ceph.mds.f.smithi116.stdout:Sep 19 04:45:58 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-f[64309]: starting mds.f at 2024-09-19T04:45:58.326 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:45:58.595 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:45:58.606 INFO:journalctl@ceph.mds.f.smithi116.stdout:Sep 19 04:45:58 smithi116 bash[64293]: 95553dfaf8def1c0fd5da5f7e1767022d3be9552873f6979bc5d28596e33fb64 2024-09-19T04:45:58.606 INFO:journalctl@ceph.mds.f.smithi116.stdout:Sep 19 04:45:58 smithi116 systemd[1]: Started Ceph mds.f for d46630c4-7640-11ef-bceb-c7b262605968. 2024-09-19T04:45:59.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.080+0000 7fa1dec3e640 1 -- 172.21.15.2:0/3126085292 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1d8108300 msgr2=0x7fa1d810ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:59.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.080+0000 7fa1dec3e640 1 --2- 172.21.15.2:0/3126085292 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1d8108300 0x7fa1d810ec70 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0009cd0 tx=0x7fa1d002a8d0 comp rx=0 tx=0).stop 2024-09-19T04:45:59.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.080+0000 7fa1dec3e640 1 -- 172.21.15.2:0/3126085292 shutdown_connections 2024-09-19T04:45:59.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.080+0000 7fa1dec3e640 1 --2- 172.21.15.2:0/3126085292 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1d8108300 0x7fa1d810ec70 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:59.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.080+0000 7fa1dec3e640 1 --2- 172.21.15.2:0/3126085292 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1d8103780 0x7fa1d8107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:59.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.080+0000 7fa1dec3e640 1 --2- 172.21.15.2:0/3126085292 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1d8102dd0 0x7fa1d81031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:59.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.080+0000 7fa1dec3e640 1 -- 172.21.15.2:0/3126085292 >> 172.21.15.2:0/3126085292 conn(0x7fa1d80fc7d0 msgr2=0x7fa1d80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:45:59.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.080+0000 7fa1dec3e640 1 -- 172.21.15.2:0/3126085292 shutdown_connections 2024-09-19T04:45:59.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.080+0000 7fa1dec3e640 1 -- 172.21.15.2:0/3126085292 wait complete. 2024-09-19T04:45:59.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.081+0000 7fa1dec3e640 1 Processor -- start 2024-09-19T04:45:59.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.081+0000 7fa1dec3e640 1 -- start start 2024-09-19T04:45:59.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.081+0000 7fa1dec3e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1d8102dd0 0x7fa1d8100a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:59.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.081+0000 7fa1dec3e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1d8103780 0x7fa1d8100f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:59.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.081+0000 7fa1dec3e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1d8108300 0x7fa1d81014b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:59.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.081+0000 7fa1dec3e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d8111f80 con 0x7fa1d8103780 2024-09-19T04:45:59.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.081+0000 7fa1dec3e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d8111e00 con 0x7fa1d8108300 2024-09-19T04:45:59.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.081+0000 7fa1dec3e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d8112100 con 0x7fa1d8102dd0 2024-09-19T04:45:59.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.081+0000 7fa1d7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1d8103780 0x7fa1d8100f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:59.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.081+0000 7fa1d7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1d8103780 0x7fa1d8100f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52916/0 (socket says 172.21.15.2:52916) 2024-09-19T04:45:59.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.081+0000 7fa1d7fff640 1 -- 172.21.15.2:0/1486788874 learned_addr learned my addr 172.21.15.2:0/1486788874 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:45:59.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.081+0000 7fa1dc9da640 1 --2- 172.21.15.2:0/1486788874 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1d8102dd0 0x7fa1d8100a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:59.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.081+0000 7fa1dd1db640 1 --2- 172.21.15.2:0/1486788874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1d8108300 0x7fa1d81014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:59.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.081+0000 7fa1d7fff640 1 -- 172.21.15.2:0/1486788874 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1d8102dd0 msgr2=0x7fa1d8100a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:59.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.081+0000 7fa1d7fff640 1 --2- 172.21.15.2:0/1486788874 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1d8102dd0 0x7fa1d8100a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:59.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.081+0000 7fa1d7fff640 1 -- 172.21.15.2:0/1486788874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1d8108300 msgr2=0x7fa1d81014b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:59.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.081+0000 7fa1d7fff640 1 --2- 172.21.15.2:0/1486788874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1d8108300 0x7fa1d81014b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:59.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.081+0000 7fa1d7fff640 1 -- 172.21.15.2:0/1486788874 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1d81a6960 con 0x7fa1d8103780 2024-09-19T04:45:59.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.081+0000 7fa1dc9da640 1 --2- 172.21.15.2:0/1486788874 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1d8102dd0 0x7fa1d8100a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:45:59.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.082+0000 7fa1d7fff640 1 --2- 172.21.15.2:0/1486788874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1d8103780 0x7fa1d8100f70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc00d950 tx=0x7fa1cc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:45:59.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.082+0000 7fa1d5ffb640 1 -- 172.21.15.2:0/1486788874 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc017070 con 0x7fa1d8103780 2024-09-19T04:45:59.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.082+0000 7fa1d5ffb640 1 -- 172.21.15.2:0/1486788874 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa1cc009c30 con 0x7fa1d8103780 2024-09-19T04:45:59.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.082+0000 7fa1dec3e640 1 -- 172.21.15.2:0/1486788874 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1d81a6c50 con 0x7fa1d8103780 2024-09-19T04:45:59.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.082+0000 7fa1d5ffb640 1 -- 172.21.15.2:0/1486788874 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc0047a0 con 0x7fa1d8103780 2024-09-19T04:45:59.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.082+0000 7fa1dec3e640 1 -- 172.21.15.2:0/1486788874 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1d81a7190 con 0x7fa1d8103780 2024-09-19T04:45:59.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.083+0000 7fa1dec3e640 1 -- 172.21.15.2:0/1486788874 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1d81031b0 con 0x7fa1d8103780 2024-09-19T04:45:59.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.084+0000 7fa1d5ffb640 1 -- 172.21.15.2:0/1486788874 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fa1cc004020 con 0x7fa1d8103780 2024-09-19T04:45:59.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.085+0000 7fa1d5ffb640 1 --2- 172.21.15.2:0/1486788874 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fa1c00a32c0 0x7fa1c00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:45:59.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.085+0000 7fa1dc9da640 1 --2- 172.21.15.2:0/1486788874 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fa1c00a32c0 0x7fa1c00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:45:59.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.085+0000 7fa1d5ffb640 1 -- 172.21.15.2:0/1486788874 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fa1cc0cef50 con 0x7fa1d8103780 2024-09-19T04:45:59.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.085+0000 7fa1dc9da640 1 --2- 172.21.15.2:0/1486788874 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fa1c00a32c0 0x7fa1c00a5780 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8009fc0 tx=0x7fa1c8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:45:59.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.089+0000 7fa1d5ffb640 1 -- 172.21.15.2:0/1486788874 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa1cc020020 con 0x7fa1d8103780 2024-09-19T04:45:59.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.306+0000 7fa1dec3e640 1 -- 172.21.15.2:0/1486788874 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa1d810a290 con 0x7fa1d8103780 2024-09-19T04:45:59.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:59 smithi002 ceph-mon[30975]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:45:59.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:59 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:59.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:59 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:59.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:59 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:59.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:59 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:45:59.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:59 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:45:59.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:59 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:45:59.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:59 smithi002 ceph-mon[30975]: Deploying daemon mds.c on smithi116 2024-09-19T04:45:59.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:59 smithi002 ceph-mon[30975]: mds.? [v2:172.21.15.116:6834/3761157675,v1:172.21.15.116:6835/3761157675] up:boot 2024-09-19T04:45:59.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:59 smithi002 ceph-mon[30975]: fsmap 6 up:standby 2024-09-19T04:45:59.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:45:59 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T04:45:59.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.307+0000 7fa1d5ffb640 1 -- 172.21.15.2:0/1486788874 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5560 (secure 0 0 0) 0x7fa1cc09c110 con 0x7fa1d8103780 2024-09-19T04:45:59.309 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:45:59.309 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":7,"btime":"2024-09-19T04:45:59:047128+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2467365137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2467365137},{"type":"v1","addr":"172.21.15.2:6835","nonce":2467365137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3162441888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3162441888},{"type":"v1","addr":"172.21.15.2:6837","nonce":3162441888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1630480244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1630480244},{"type":"v1","addr":"172.21.15.18:6833","nonce":1630480244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1553897465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1553897465},{"type":"v1","addr":"172.21.15.116:6833","nonce":1553897465}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3035664608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3035664608},{"type":"v1","addr":"172.21.15.18:6835","nonce":3035664608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3761157675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3761157675},{"type":"v1","addr":"172.21.15.116:6835","nonce":3761157675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-09-19T04:45:59.310 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 7 2024-09-19T04:45:59.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.309+0000 7fa1dec3e640 1 -- 172.21.15.2:0/1486788874 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fa1c00a32c0 msgr2=0x7fa1c00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:59.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.309+0000 7fa1dec3e640 1 --2- 172.21.15.2:0/1486788874 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fa1c00a32c0 0x7fa1c00a5780 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8009fc0 tx=0x7fa1c8005f90 comp rx=0 tx=0).stop 2024-09-19T04:45:59.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.310+0000 7fa1dec3e640 1 -- 172.21.15.2:0/1486788874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1d8103780 msgr2=0x7fa1d8100f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:45:59.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.310+0000 7fa1dec3e640 1 --2- 172.21.15.2:0/1486788874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1d8103780 0x7fa1d8100f70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc00d950 tx=0x7fa1cc00de10 comp rx=0 tx=0).stop 2024-09-19T04:45:59.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.310+0000 7fa1dec3e640 1 -- 172.21.15.2:0/1486788874 shutdown_connections 2024-09-19T04:45:59.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.310+0000 7fa1dec3e640 1 --2- 172.21.15.2:0/1486788874 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fa1c00a32c0 0x7fa1c00a5780 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:59.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.310+0000 7fa1dec3e640 1 --2- 172.21.15.2:0/1486788874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1d8108300 0x7fa1d81014b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:59.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.310+0000 7fa1dec3e640 1 --2- 172.21.15.2:0/1486788874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1d8103780 0x7fa1d8100f70 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:59.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.310+0000 7fa1dec3e640 1 --2- 172.21.15.2:0/1486788874 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1d8102dd0 0x7fa1d8100a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:45:59.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.310+0000 7fa1dec3e640 1 -- 172.21.15.2:0/1486788874 >> 172.21.15.2:0/1486788874 conn(0x7fa1d80fc7d0 msgr2=0x7fa1d8105e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:45:59.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.310+0000 7fa1dec3e640 1 -- 172.21.15.2:0/1486788874 shutdown_connections 2024-09-19T04:45:59.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:45:59.310+0000 7fa1dec3e640 1 -- 172.21.15.2:0/1486788874 wait complete. 2024-09-19T04:45:59.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:59 smithi116 ceph-mon[34477]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:45:59.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:59 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:59.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:59 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:59.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:59 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:59.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:59 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:45:59.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:59 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:45:59.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:59 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:45:59.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:59 smithi116 ceph-mon[34477]: Deploying daemon mds.c on smithi116 2024-09-19T04:45:59.463 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:59 smithi116 ceph-mon[34477]: mds.? [v2:172.21.15.116:6834/3761157675,v1:172.21.15.116:6835/3761157675] up:boot 2024-09-19T04:45:59.463 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:59 smithi116 ceph-mon[34477]: fsmap 6 up:standby 2024-09-19T04:45:59.463 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:45:59 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T04:45:59.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:59 smithi018 ceph-mon[34537]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:45:59.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:59 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:59.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:59 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:59.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:59 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:45:59.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:59 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:45:59.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:59 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:45:59.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:59 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:45:59.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:59 smithi018 ceph-mon[34537]: Deploying daemon mds.c on smithi116 2024-09-19T04:45:59.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:59 smithi018 ceph-mon[34537]: mds.? [v2:172.21.15.116:6834/3761157675,v1:172.21.15.116:6835/3761157675] up:boot 2024-09-19T04:45:59.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:59 smithi018 ceph-mon[34537]: fsmap 6 up:standby 2024-09-19T04:45:59.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:45:59 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T04:46:00.110 INFO:journalctl@ceph.mds.c.smithi116.stdout:Sep 19 04:45:59 smithi116 systemd[1]: Starting Ceph mds.c for d46630c4-7640-11ef-bceb-c7b262605968... 2024-09-19T04:46:00.359 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:00 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/1486788874' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:46:00.393 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:00 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/1486788874' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:46:00.393 INFO:journalctl@ceph.mds.c.smithi116.stdout:Sep 19 04:46:00 smithi116 podman[64597]: 2024-09-19 04:46:00.121979473 +0000 UTC m=+0.101111937 container create be4217314e29ec4a5e1e764b60eefc5c853fc35f36068f9af4cdcb9501a6a274 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-c, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-19T04:46:00.393 INFO:journalctl@ceph.mds.c.smithi116.stdout:Sep 19 04:46:00 smithi116 podman[64597]: 2024-09-19 04:46:00.036422274 +0000 UTC m=+0.015554748 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:46:00.393 INFO:journalctl@ceph.mds.c.smithi116.stdout:Sep 19 04:46:00 smithi116 podman[64597]: 2024-09-19 04:46:00.366411201 +0000 UTC m=+0.345543674 container init be4217314e29ec4a5e1e764b60eefc5c853fc35f36068f9af4cdcb9501a6a274 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T04:46:00.393 INFO:journalctl@ceph.mds.c.smithi116.stdout:Sep 19 04:46:00 smithi116 podman[64597]: 2024-09-19 04:46:00.369313803 +0000 UTC m=+0.348446276 container start be4217314e29ec4a5e1e764b60eefc5c853fc35f36068f9af4cdcb9501a6a274 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-c, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-19T04:46:00.393 INFO:journalctl@ceph.mds.c.smithi116.stdout:Sep 19 04:46:00 smithi116 ceph-mds[64616]: -- 172.21.15.116:0/3099666131 <== mon.1 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5636c8773860 con 0x5636c8750800 2024-09-19T04:46:00.556 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:00 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/1486788874' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:46:00.860 INFO:journalctl@ceph.mds.c.smithi116.stdout:Sep 19 04:46:00 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-c[64612]: starting mds.c at 2024-09-19T04:46:00.860 INFO:journalctl@ceph.mds.c.smithi116.stdout:Sep 19 04:46:00 smithi116 bash[64597]: be4217314e29ec4a5e1e764b60eefc5c853fc35f36068f9af4cdcb9501a6a274 2024-09-19T04:46:00.861 INFO:journalctl@ceph.mds.c.smithi116.stdout:Sep 19 04:46:00 smithi116 systemd[1]: Started Ceph mds.c for d46630c4-7640-11ef-bceb-c7b262605968. 2024-09-19T04:46:01.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:01 smithi018 ceph-mon[34537]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:46:01.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:01 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:01.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:01 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:01.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:01 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:01.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:01 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:46:01.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:01 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:46:01.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:01 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:46:01.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:01 smithi002 ceph-mon[30975]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:46:01.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:01 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:01.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:01 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:01.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:01 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:01.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:01 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:46:01.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:01 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:46:01.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:01 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:46:01.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:01 smithi116 ceph-mon[34477]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:46:01.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:01 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:01.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:01 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:01.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:01 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:01.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:01 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:46:01.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:01 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:46:01.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:01 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:46:02.052 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:46:02.330 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:46:02.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:02 smithi002 ceph-mon[30975]: Deploying daemon mds.h on smithi018 2024-09-19T04:46:02.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:02 smithi002 ceph-mon[30975]: mds.? [v2:172.21.15.116:6836/1120131594,v1:172.21.15.116:6837/1120131594] up:boot 2024-09-19T04:46:02.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:02 smithi002 ceph-mon[30975]: fsmap 7 up:standby 2024-09-19T04:46:02.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:02 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T04:46:02.500 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:02 smithi018 ceph-mon[34537]: Deploying daemon mds.h on smithi018 2024-09-19T04:46:02.500 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:02 smithi018 ceph-mon[34537]: mds.? [v2:172.21.15.116:6836/1120131594,v1:172.21.15.116:6837/1120131594] up:boot 2024-09-19T04:46:02.501 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:02 smithi018 ceph-mon[34537]: fsmap 7 up:standby 2024-09-19T04:46:02.501 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:02 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T04:46:02.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:02 smithi116 ceph-mon[34477]: Deploying daemon mds.h on smithi018 2024-09-19T04:46:02.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:02 smithi116 ceph-mon[34477]: mds.? [v2:172.21.15.116:6836/1120131594,v1:172.21.15.116:6837/1120131594] up:boot 2024-09-19T04:46:02.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:02 smithi116 ceph-mon[34477]: fsmap 7 up:standby 2024-09-19T04:46:02.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:02 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T04:46:02.807 INFO:journalctl@ceph.mds.h.smithi018.stdout:Sep 19 04:46:02 smithi018 podman[64229]: 2024-09-19 04:46:02.734232168 +0000 UTC m=+0.132704082 container create 1573d33f076b52a8ff5b04d1b3227ed609abb4cc6a2e941e3193265af9bd4f38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-h, RELEASE=squid-2f599a4, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True) 2024-09-19T04:46:02.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:02.806+0000 7f5cc19f9640 1 -- 172.21.15.2:0/1437689288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5cbc102ef0 msgr2=0x7f5cbc10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:02.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:02.806+0000 7f5cc19f9640 1 --2- 172.21.15.2:0/1437689288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5cbc102ef0 0x7f5cbc10da40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5cb4009ca0 tx=0x7f5cb402a950 comp rx=0 tx=0).stop 2024-09-19T04:46:02.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:02.806+0000 7f5cc19f9640 1 -- 172.21.15.2:0/1437689288 shutdown_connections 2024-09-19T04:46:02.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:02.806+0000 7f5cc19f9640 1 --2- 172.21.15.2:0/1437689288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5cbc102ef0 0x7f5cbc10da40 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:02.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:02.806+0000 7f5cc19f9640 1 --2- 172.21.15.2:0/1437689288 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5cbc102570 0x7f5cbc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:02.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:02.806+0000 7f5cc19f9640 1 --2- 172.21.15.2:0/1437689288 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5cbc100e20 0x7f5cbc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:02.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:02.806+0000 7f5cc19f9640 1 -- 172.21.15.2:0/1437689288 >> 172.21.15.2:0/1437689288 conn(0x7f5cbc0fc7d0 msgr2=0x7f5cbc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:02.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:02.806+0000 7f5cc19f9640 1 -- 172.21.15.2:0/1437689288 shutdown_connections 2024-09-19T04:46:02.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:02.806+0000 7f5cc19f9640 1 -- 172.21.15.2:0/1437689288 wait complete. 2024-09-19T04:46:02.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:02.806+0000 7f5cc19f9640 1 Processor -- start 2024-09-19T04:46:02.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:02.807+0000 7f5cc19f9640 1 -- start start 2024-09-19T04:46:02.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:02.807+0000 7f5cc19f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5cbc100e20 0x7f5cbc1990c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:02.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:02.807+0000 7f5cc19f9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5cbc102570 0x7f5cbc199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:02.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:02.807+0000 7f5cc19f9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5cbc102ef0 0x7f5cbc1a4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:02.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:02.807+0000 7f5cc19f9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5cbc110e30 con 0x7f5cbc100e20 2024-09-19T04:46:02.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:02.807+0000 7f5cc19f9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5cbc110cb0 con 0x7f5cbc102ef0 2024-09-19T04:46:02.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:02.807+0000 7f5cc19f9640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f5cbc110fb0 con 0x7f5cbc102570 2024-09-19T04:46:02.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:02.807+0000 7f5cbaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5cbc100e20 0x7f5cbc1990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:02.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:02.807+0000 7f5cbaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5cbc100e20 0x7f5cbc1990c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35276/0 (socket says 172.21.15.2:35276) 2024-09-19T04:46:02.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:02.807+0000 7f5cbaffd640 1 -- 172.21.15.2:0/781532393 learned_addr learned my addr 172.21.15.2:0/781532393 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:46:02.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:02.807+0000 7f5cba7fc640 1 --2- 172.21.15.2:0/781532393 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5cbc102570 0x7f5cbc199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:02.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:02.807+0000 7f5cbaffd640 1 -- 172.21.15.2:0/781532393 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5cbc102570 msgr2=0x7f5cbc199600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:02.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:02.807+0000 7f5cbaffd640 1 --2- 172.21.15.2:0/781532393 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5cbc102570 0x7f5cbc199600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:02.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:02.807+0000 7f5cbaffd640 1 -- 172.21.15.2:0/781532393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5cbc102ef0 msgr2=0x7f5cbc1a4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:02.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:02.807+0000 7f5cbaffd640 1 --2- 172.21.15.2:0/781532393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5cbc102ef0 0x7f5cbc1a4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:02.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:02.807+0000 7f5cbaffd640 1 -- 172.21.15.2:0/781532393 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cbc1a4680 con 0x7f5cbc100e20 2024-09-19T04:46:02.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:02.807+0000 7f5cbaffd640 1 --2- 172.21.15.2:0/781532393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5cbc100e20 0x7f5cbc1990c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5cac00c920 tx=0x7f5cac00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:02.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:02.808+0000 7f5cc09f7640 1 -- 172.21.15.2:0/781532393 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cac007c70 con 0x7f5cbc100e20 2024-09-19T04:46:02.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:02.808+0000 7f5cc09f7640 1 -- 172.21.15.2:0/781532393 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5cac007e10 con 0x7f5cbc100e20 2024-09-19T04:46:02.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:02.808+0000 7f5cc19f9640 1 -- 172.21.15.2:0/781532393 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cbc1a4850 con 0x7f5cbc100e20 2024-09-19T04:46:02.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:02.808+0000 7f5cc09f7640 1 -- 172.21.15.2:0/781532393 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cac018820 con 0x7f5cbc100e20 2024-09-19T04:46:02.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:02.808+0000 7f5cc19f9640 1 -- 172.21.15.2:0/781532393 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cbc1a4d60 con 0x7f5cbc100e20 2024-09-19T04:46:02.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:02.809+0000 7f5cc19f9640 1 -- 172.21.15.2:0/781532393 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cbc101200 con 0x7f5cbc100e20 2024-09-19T04:46:02.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:02.810+0000 7f5cc09f7640 1 -- 172.21.15.2:0/781532393 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f5cac0189c0 con 0x7f5cbc100e20 2024-09-19T04:46:02.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:02.810+0000 7f5cc09f7640 1 --2- 172.21.15.2:0/781532393 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f5ca40a3240 0x7f5ca40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:02.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:02.811+0000 7f5cba7fc640 1 --2- 172.21.15.2:0/781532393 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f5ca40a3240 0x7f5ca40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:02.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:02.811+0000 7f5cc09f7640 1 -- 172.21.15.2:0/781532393 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f5cac0cf730 con 0x7f5cbc100e20 2024-09-19T04:46:02.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:02.811+0000 7f5cba7fc640 1 --2- 172.21.15.2:0/781532393 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f5ca40a3240 0x7f5ca40a5700 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc06aac0 tx=0x7f5cb000c4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:02.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:02.815+0000 7f5cc09f7640 1 -- 172.21.15.2:0/781532393 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5cac014030 con 0x7f5cbc100e20 2024-09-19T04:46:03.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:03.028+0000 7f5cc19f9640 1 -- 172.21.15.2:0/781532393 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5cbc06a560 con 0x7f5cbc100e20 2024-09-19T04:46:03.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:03.028+0000 7f5cc09f7640 1 -- 172.21.15.2:0/781532393 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6388 (secure 0 0 0) 0x7f5cac09c850 con 0x7f5cbc100e20 2024-09-19T04:46:03.030 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:46:03.030 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":8,"btime":"2024-09-19T04:46:01:193839+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2467365137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2467365137},{"type":"v1","addr":"172.21.15.2:6835","nonce":2467365137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3162441888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3162441888},{"type":"v1","addr":"172.21.15.2:6837","nonce":3162441888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1630480244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1630480244},{"type":"v1","addr":"172.21.15.18:6833","nonce":1630480244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1553897465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1553897465},{"type":"v1","addr":"172.21.15.116:6833","nonce":1553897465}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3035664608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3035664608},{"type":"v1","addr":"172.21.15.18:6835","nonce":3035664608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3761157675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3761157675},{"type":"v1","addr":"172.21.15.116:6835","nonce":3761157675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/1120131594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1120131594},{"type":"v1","addr":"172.21.15.116:6837","nonce":1120131594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-19T04:46:03.030 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 8 2024-09-19T04:46:03.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:03.030+0000 7f5cc19f9640 1 -- 172.21.15.2:0/781532393 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f5ca40a3240 msgr2=0x7f5ca40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:03.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:03.030+0000 7f5cc19f9640 1 --2- 172.21.15.2:0/781532393 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f5ca40a3240 0x7f5ca40a5700 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc06aac0 tx=0x7f5cb000c4a0 comp rx=0 tx=0).stop 2024-09-19T04:46:03.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:03.030+0000 7f5cc19f9640 1 -- 172.21.15.2:0/781532393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5cbc100e20 msgr2=0x7f5cbc1990c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:03.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:03.030+0000 7f5cc19f9640 1 --2- 172.21.15.2:0/781532393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5cbc100e20 0x7f5cbc1990c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5cac00c920 tx=0x7f5cac00cde0 comp rx=0 tx=0).stop 2024-09-19T04:46:03.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:03.030+0000 7f5cc19f9640 1 -- 172.21.15.2:0/781532393 shutdown_connections 2024-09-19T04:46:03.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:03.030+0000 7f5cc19f9640 1 --2- 172.21.15.2:0/781532393 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f5ca40a3240 0x7f5ca40a5700 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:03.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:03.030+0000 7f5cc19f9640 1 --2- 172.21.15.2:0/781532393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5cbc102ef0 0x7f5cbc1a4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:03.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:03.030+0000 7f5cc19f9640 1 --2- 172.21.15.2:0/781532393 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5cbc102570 0x7f5cbc199600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:03.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:03.030+0000 7f5cc19f9640 1 --2- 172.21.15.2:0/781532393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5cbc100e20 0x7f5cbc1990c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:03.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:03.030+0000 7f5cc19f9640 1 -- 172.21.15.2:0/781532393 >> 172.21.15.2:0/781532393 conn(0x7f5cbc0fc7d0 msgr2=0x7f5cbc1067c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:03.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:03.031+0000 7f5cc19f9640 1 -- 172.21.15.2:0/781532393 shutdown_connections 2024-09-19T04:46:03.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:03.031+0000 7f5cc19f9640 1 -- 172.21.15.2:0/781532393 wait complete. 2024-09-19T04:46:03.213 INFO:journalctl@ceph.mds.h.smithi018.stdout:Sep 19 04:46:02 smithi018 podman[64229]: 2024-09-19 04:46:02.978276859 +0000 UTC m=+0.376748781 container init 1573d33f076b52a8ff5b04d1b3227ed609abb4cc6a2e941e3193265af9bd4f38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-h, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-19T04:46:03.213 INFO:journalctl@ceph.mds.h.smithi018.stdout:Sep 19 04:46:02 smithi018 podman[64229]: 2024-09-19 04:46:02.981432725 +0000 UTC m=+0.379904644 container start 1573d33f076b52a8ff5b04d1b3227ed609abb4cc6a2e941e3193265af9bd4f38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-h, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T04:46:03.213 INFO:journalctl@ceph.mds.h.smithi018.stdout:Sep 19 04:46:03 smithi018 ceph-mds[64248]: -- 172.21.15.18:0/2708992333 <== mon.2 v2:172.21.15.18:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5593fa32d860 con 0x5593fa30b000 2024-09-19T04:46:03.213 INFO:journalctl@ceph.mds.h.smithi018.stdout:Sep 19 04:46:03 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-h[64244]: starting mds.h at 2024-09-19T04:46:03.213 INFO:journalctl@ceph.mds.h.smithi018.stdout:Sep 19 04:46:03 smithi018 bash[64229]: 1573d33f076b52a8ff5b04d1b3227ed609abb4cc6a2e941e3193265af9bd4f38 2024-09-19T04:46:03.213 INFO:journalctl@ceph.mds.h.smithi018.stdout:Sep 19 04:46:03 smithi018 systemd[1]: Started Ceph mds.h for d46630c4-7640-11ef-bceb-c7b262605968. 2024-09-19T04:46:03.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:03 smithi002 ceph-mon[30975]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:46:03.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:03 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/781532393' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:46:03.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:03 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:03.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:03 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:03.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:03 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:03.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:03 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:46:03.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:03 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:46:03.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:03 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:46:03.556 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:03 smithi116 ceph-mon[34477]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:46:03.556 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:03 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/781532393' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:46:03.556 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:03 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:03.556 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:03 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:03.556 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:03 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:03.556 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:03 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:46:03.556 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:03 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:46:03.556 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:03 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:46:03.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:03 smithi018 ceph-mon[34537]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:46:03.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:03 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/781532393' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:46:03.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:03 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:03.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:03 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:03.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:03 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:03.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:03 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:46:03.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:03 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:46:03.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:03 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:46:04.472 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:04 smithi116 ceph-mon[34477]: Deploying daemon mds.i on smithi116 2024-09-19T04:46:04.472 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:04 smithi116 ceph-mon[34477]: mds.? [v2:172.21.15.18:6836/1096622392,v1:172.21.15.18:6837/1096622392] up:boot 2024-09-19T04:46:04.473 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:04 smithi116 ceph-mon[34477]: fsmap 8 up:standby 2024-09-19T04:46:04.473 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:04 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T04:46:04.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:04 smithi018 ceph-mon[34537]: Deploying daemon mds.i on smithi116 2024-09-19T04:46:04.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:04 smithi018 ceph-mon[34537]: mds.? [v2:172.21.15.18:6836/1096622392,v1:172.21.15.18:6837/1096622392] up:boot 2024-09-19T04:46:04.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:04 smithi018 ceph-mon[34537]: fsmap 8 up:standby 2024-09-19T04:46:04.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:04 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T04:46:04.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:04 smithi002 ceph-mon[30975]: Deploying daemon mds.i on smithi116 2024-09-19T04:46:04.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:04 smithi002 ceph-mon[30975]: mds.? [v2:172.21.15.18:6836/1096622392,v1:172.21.15.18:6837/1096622392] up:boot 2024-09-19T04:46:04.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:04 smithi002 ceph-mon[30975]: fsmap 8 up:standby 2024-09-19T04:46:04.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:04 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T04:46:05.111 INFO:journalctl@ceph.mds.i.smithi116.stdout:Sep 19 04:46:05 smithi116 podman[64897]: 2024-09-19 04:46:05.058397077 +0000 UTC m=+0.115213213 container create 4d19e7a3094d77fd465a8f74a3498447e62fa1f5d80d098ce14a4ce0d73a42d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-19T04:46:05.511 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:05 smithi002 ceph-mon[30975]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:46:05.556 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:05 smithi018 ceph-mon[34537]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:46:05.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:05 smithi116 ceph-mon[34477]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:46:05.611 INFO:journalctl@ceph.mds.i.smithi116.stdout:Sep 19 04:46:05 smithi116 podman[64897]: 2024-09-19 04:46:05.31956892 +0000 UTC m=+0.376385057 container init 4d19e7a3094d77fd465a8f74a3498447e62fa1f5d80d098ce14a4ce0d73a42d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-i, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-19T04:46:05.611 INFO:journalctl@ceph.mds.i.smithi116.stdout:Sep 19 04:46:05 smithi116 podman[64897]: 2024-09-19 04:46:05.322640574 +0000 UTC m=+0.379456718 container start 4d19e7a3094d77fd465a8f74a3498447e62fa1f5d80d098ce14a4ce0d73a42d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-i, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-19T04:46:05.611 INFO:journalctl@ceph.mds.i.smithi116.stdout:Sep 19 04:46:05 smithi116 ceph-mds[64917]: -- 172.21.15.116:0/3153512870 <== mon.1 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5588a2ee5860 con 0x5588a2ec3400 2024-09-19T04:46:05.611 INFO:journalctl@ceph.mds.i.smithi116.stdout:Sep 19 04:46:05 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-i[64913]: starting mds.i at 2024-09-19T04:46:05.611 INFO:journalctl@ceph.mds.i.smithi116.stdout:Sep 19 04:46:05 smithi116 bash[64897]: 4d19e7a3094d77fd465a8f74a3498447e62fa1f5d80d098ce14a4ce0d73a42d5 2024-09-19T04:46:05.611 INFO:journalctl@ceph.mds.i.smithi116.stdout:Sep 19 04:46:05 smithi116 systemd[1]: Started Ceph mds.i for d46630c4-7640-11ef-bceb-c7b262605968. 2024-09-19T04:46:05.699 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:46:06.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:06 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:06.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:06 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:06.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:06 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:06.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:06 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:46:06.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:06 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:46:06.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:06 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:46:06.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:06 smithi002 ceph-mon[30975]: mds.? [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] up:boot 2024-09-19T04:46:06.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:06 smithi002 ceph-mon[30975]: fsmap 9 up:standby 2024-09-19T04:46:06.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:06 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T04:46:06.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:06 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:06.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:06 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:06.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:06 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:06.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:06 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:46:06.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:06 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:46:06.808 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:06 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:46:06.808 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:06 smithi018 ceph-mon[34537]: mds.? [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] up:boot 2024-09-19T04:46:06.808 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:06 smithi018 ceph-mon[34537]: fsmap 9 up:standby 2024-09-19T04:46:06.808 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:06 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T04:46:06.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:06 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:06.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:06 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:06.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:06 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:06.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:06 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:46:06.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:06 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:46:06.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:06 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:46:06.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:06 smithi116 ceph-mon[34477]: mds.? [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] up:boot 2024-09-19T04:46:06.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:06 smithi116 ceph-mon[34477]: fsmap 9 up:standby 2024-09-19T04:46:06.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:06 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T04:46:07.010 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:46:07.480 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:07 smithi002 ceph-mon[30975]: Deploying daemon mds.g on smithi002 2024-09-19T04:46:07.480 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:07 smithi002 ceph-mon[30975]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:46:07.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.448+0000 7f06356e1640 1 -- 172.21.15.2:0/348948725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0630106a80 msgr2=0x7f0630106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:07.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.448+0000 7f06356e1640 1 --2- 172.21.15.2:0/348948725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0630106a80 0x7f0630106e60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0620009930 tx=0x7f062002a420 comp rx=0 tx=0).stop 2024-09-19T04:46:07.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.448+0000 7f06356e1640 1 -- 172.21.15.2:0/348948725 shutdown_connections 2024-09-19T04:46:07.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.448+0000 7f06356e1640 1 --2- 172.21.15.2:0/348948725 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0630101420 0x7f063010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:07.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.448+0000 7f06356e1640 1 --2- 172.21.15.2:0/348948725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0630100a80 0x7f0630100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:07.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.448+0000 7f06356e1640 1 --2- 172.21.15.2:0/348948725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0630106a80 0x7f0630106e60 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:07.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.448+0000 7f06356e1640 1 -- 172.21.15.2:0/348948725 >> 172.21.15.2:0/348948725 conn(0x7f06300fc7a0 msgr2=0x7f06300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:07.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.448+0000 7f06356e1640 1 -- 172.21.15.2:0/348948725 shutdown_connections 2024-09-19T04:46:07.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.448+0000 7f06356e1640 1 -- 172.21.15.2:0/348948725 wait complete. 2024-09-19T04:46:07.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.448+0000 7f06356e1640 1 Processor -- start 2024-09-19T04:46:07.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.449+0000 7f06356e1640 1 -- start start 2024-09-19T04:46:07.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.449+0000 7f06356e1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0630100a80 0x7f063010e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:07.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.449+0000 7f06356e1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0630101420 0x7f063010e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:07.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.449+0000 7f06356e1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0630106a80 0x7f063010ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:07.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.449+0000 7f06356e1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0630111e40 con 0x7f0630106a80 2024-09-19T04:46:07.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.449+0000 7f06356e1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0630111cc0 con 0x7f0630100a80 2024-09-19T04:46:07.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.449+0000 7f06356e1640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f0630111fc0 con 0x7f0630101420 2024-09-19T04:46:07.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.449+0000 7f062f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0630106a80 0x7f063010ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:07.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.449+0000 7f062f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0630106a80 0x7f063010ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35284/0 (socket says 172.21.15.2:35284) 2024-09-19T04:46:07.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.449+0000 7f062e7fc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0630101420 0x7f063010e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:07.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.449+0000 7f062f7fe640 1 -- 172.21.15.2:0/1012565393 learned_addr learned my addr 172.21.15.2:0/1012565393 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:46:07.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.449+0000 7f062effd640 1 --2- 172.21.15.2:0/1012565393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0630100a80 0x7f063010e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:07.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.449+0000 7f062f7fe640 1 -- 172.21.15.2:0/1012565393 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0630101420 msgr2=0x7f063010e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:07.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.449+0000 7f062f7fe640 1 --2- 172.21.15.2:0/1012565393 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0630101420 0x7f063010e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:07.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.449+0000 7f062f7fe640 1 -- 172.21.15.2:0/1012565393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0630100a80 msgr2=0x7f063010e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:07.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.449+0000 7f062f7fe640 1 --2- 172.21.15.2:0/1012565393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0630100a80 0x7f063010e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:07.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.449+0000 7f062f7fe640 1 -- 172.21.15.2:0/1012565393 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06301a6830 con 0x7f0630106a80 2024-09-19T04:46:07.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.450+0000 7f062f7fe640 1 --2- 172.21.15.2:0/1012565393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0630106a80 0x7f063010ece0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f062800eb10 tx=0x7f062800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:07.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.450+0000 7f0617fff640 1 -- 172.21.15.2:0/1012565393 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0628004b20 con 0x7f0630106a80 2024-09-19T04:46:07.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.450+0000 7f06356e1640 1 -- 172.21.15.2:0/1012565393 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06301a6b20 con 0x7f0630106a80 2024-09-19T04:46:07.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.450+0000 7f0617fff640 1 -- 172.21.15.2:0/1012565393 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0628004cc0 con 0x7f0630106a80 2024-09-19T04:46:07.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.450+0000 7f0617fff640 1 -- 172.21.15.2:0/1012565393 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0628010690 con 0x7f0630106a80 2024-09-19T04:46:07.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.450+0000 7f06356e1640 1 -- 172.21.15.2:0/1012565393 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06301a70b0 con 0x7f0630106a80 2024-09-19T04:46:07.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.451+0000 7f06356e1640 1 -- 172.21.15.2:0/1012565393 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0630100ee0 con 0x7f0630106a80 2024-09-19T04:46:07.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.453+0000 7f0617fff640 1 -- 172.21.15.2:0/1012565393 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f0628005000 con 0x7f0630106a80 2024-09-19T04:46:07.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.454+0000 7f0617fff640 1 --2- 172.21.15.2:0/1012565393 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f06180a3240 0x7f06180a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:07.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.454+0000 7f062effd640 1 --2- 172.21.15.2:0/1012565393 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f06180a3240 0x7f06180a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:07.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.454+0000 7f0617fff640 1 -- 172.21.15.2:0/1012565393 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f06280cfea0 con 0x7f0630106a80 2024-09-19T04:46:07.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.455+0000 7f062effd640 1 --2- 172.21.15.2:0/1012565393 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f06180a3240 0x7f06180a5700 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0620009900 tx=0x7f0620000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:07.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.457+0000 7f0617fff640 1 -- 172.21.15.2:0/1012565393 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f062809cfc0 con 0x7f0630106a80 2024-09-19T04:46:07.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.680+0000 7f06356e1640 1 -- 172.21.15.2:0/1012565393 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0630108ff0 con 0x7f0630106a80 2024-09-19T04:46:07.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.680+0000 7f0617fff640 1 -- 172.21.15.2:0/1012565393 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8043 (secure 0 0 0) 0x7f062809c8c0 con 0x7f0630106a80 2024-09-19T04:46:07.682 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:46:07.682 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":10,"btime":"2024-09-19T04:46:06:218299+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2467365137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2467365137},{"type":"v1","addr":"172.21.15.2:6835","nonce":2467365137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3162441888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3162441888},{"type":"v1","addr":"172.21.15.2:6837","nonce":3162441888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1630480244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1630480244},{"type":"v1","addr":"172.21.15.18:6833","nonce":1630480244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1553897465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1553897465},{"type":"v1","addr":"172.21.15.116:6833","nonce":1553897465}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3035664608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3035664608},{"type":"v1","addr":"172.21.15.18:6835","nonce":3035664608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1096622392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1096622392},{"type":"v1","addr":"172.21.15.18:6837","nonce":1096622392}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3761157675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3761157675},{"type":"v1","addr":"172.21.15.116:6835","nonce":3761157675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/1120131594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1120131594},{"type":"v1","addr":"172.21.15.116:6837","nonce":1120131594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24496,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6839/2346874880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":2346874880},{"type":"v1","addr":"172.21.15.116:6839","nonce":2346874880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T04:46:07.682 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 10 2024-09-19T04:46:07.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.682+0000 7f06356e1640 1 -- 172.21.15.2:0/1012565393 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f06180a3240 msgr2=0x7f06180a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:07.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.682+0000 7f06356e1640 1 --2- 172.21.15.2:0/1012565393 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f06180a3240 0x7f06180a5700 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0620009900 tx=0x7f0620000bc0 comp rx=0 tx=0).stop 2024-09-19T04:46:07.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.682+0000 7f06356e1640 1 -- 172.21.15.2:0/1012565393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0630106a80 msgr2=0x7f063010ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:07.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.682+0000 7f06356e1640 1 --2- 172.21.15.2:0/1012565393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0630106a80 0x7f063010ece0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f062800eb10 tx=0x7f062800c2d0 comp rx=0 tx=0).stop 2024-09-19T04:46:07.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.682+0000 7f06356e1640 1 -- 172.21.15.2:0/1012565393 shutdown_connections 2024-09-19T04:46:07.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.682+0000 7f06356e1640 1 --2- 172.21.15.2:0/1012565393 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f06180a3240 0x7f06180a5700 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:07.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.682+0000 7f06356e1640 1 --2- 172.21.15.2:0/1012565393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0630106a80 0x7f063010ece0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:07.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.682+0000 7f06356e1640 1 --2- 172.21.15.2:0/1012565393 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0630101420 0x7f063010e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:07.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.682+0000 7f06356e1640 1 --2- 172.21.15.2:0/1012565393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0630100a80 0x7f063010e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:07.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.682+0000 7f06356e1640 1 -- 172.21.15.2:0/1012565393 >> 172.21.15.2:0/1012565393 conn(0x7f06300fc7a0 msgr2=0x7f06300fd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:07.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.683+0000 7f06356e1640 1 -- 172.21.15.2:0/1012565393 shutdown_connections 2024-09-19T04:46:07.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:07.683+0000 7f06356e1640 1 -- 172.21.15.2:0/1012565393 wait complete. 2024-09-19T04:46:07.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:07 smithi018 ceph-mon[34537]: Deploying daemon mds.g on smithi002 2024-09-19T04:46:07.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:07 smithi018 ceph-mon[34537]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:46:07.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:07 smithi116 ceph-mon[34477]: Deploying daemon mds.g on smithi002 2024-09-19T04:46:07.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:07 smithi116 ceph-mon[34477]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:46:08.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:08 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/1012565393' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:46:08.610 INFO:journalctl@ceph.mds.g.smithi002.stdout:Sep 19 04:46:08 smithi002 systemd[1]: Started Ceph mds.g for d46630c4-7640-11ef-bceb-c7b262605968. 2024-09-19T04:46:08.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:08 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/1012565393' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:46:08.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:08 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/1012565393' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:46:09.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:09 smithi002 ceph-mon[30975]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:46:09.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:09 smithi002 ceph-mon[30975]: mds.? [v2:172.21.15.2:6838/2740862966,v1:172.21.15.2:6839/2740862966] up:boot 2024-09-19T04:46:09.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:09 smithi002 ceph-mon[30975]: fsmap 10 up:standby 2024-09-19T04:46:09.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:09 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T04:46:09.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:09 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:09.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:09 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:09.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:09 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:09.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:09 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:46:09.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:09 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:46:09.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:09 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:46:09.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:09 smithi002 ceph-mon[30975]: Deploying daemon mds.a on smithi002 2024-09-19T04:46:09.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:09 smithi018 ceph-mon[34537]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:46:09.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:09 smithi018 ceph-mon[34537]: mds.? [v2:172.21.15.2:6838/2740862966,v1:172.21.15.2:6839/2740862966] up:boot 2024-09-19T04:46:09.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:09 smithi018 ceph-mon[34537]: fsmap 10 up:standby 2024-09-19T04:46:09.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:09 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T04:46:09.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:09 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:09.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:09 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:09.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:09 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:09.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:09 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:46:09.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:09 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:46:09.808 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:09 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:46:09.808 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:09 smithi018 ceph-mon[34537]: Deploying daemon mds.a on smithi002 2024-09-19T04:46:09.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:09 smithi116 ceph-mon[34477]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:46:09.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:09 smithi116 ceph-mon[34477]: mds.? [v2:172.21.15.2:6838/2740862966,v1:172.21.15.2:6839/2740862966] up:boot 2024-09-19T04:46:09.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:09 smithi116 ceph-mon[34477]: fsmap 10 up:standby 2024-09-19T04:46:09.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:09 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T04:46:09.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:09 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:09.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:09 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:09.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:09 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:09.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:09 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:46:09.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:09 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:46:09.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:09 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:46:09.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:09 smithi116 ceph-mon[34477]: Deploying daemon mds.a on smithi002 2024-09-19T04:46:10.342 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:46:10.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:10 smithi002 ceph-mon[30975]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:46:10.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:10 smithi018 ceph-mon[34537]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:46:10.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:10 smithi116 ceph-mon[34477]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:46:10.946 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 19 04:46:10 smithi002 podman[71917]: 2024-09-19 04:46:10.945729371 +0000 UTC m=+0.365252630 container start 04ce962f102fa1bde7d7f05eff0ab08baf218078b296c364227f5f56b1515195 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-a, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-19T04:46:11.121 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:46:11.243 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 19 04:46:10 smithi002 ceph-mds[71960]: -- 172.21.15.2:0/2749592891 <== mon.0 v2:172.21.15.2:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564ef014f860 con 0x564ef012d400 2024-09-19T04:46:11.244 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 19 04:46:10 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-a[71944]: starting mds.a at 2024-09-19T04:46:11.244 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 19 04:46:11 smithi002 bash[71917]: 04ce962f102fa1bde7d7f05eff0ab08baf218078b296c364227f5f56b1515195 2024-09-19T04:46:11.244 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 19 04:46:11 smithi002 systemd[1]: Started Ceph mds.a for d46630c4-7640-11ef-bceb-c7b262605968. 2024-09-19T04:46:11.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.571+0000 7fe3daa54640 1 -- 172.21.15.2:0/2570092496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3d4102ef0 msgr2=0x7fe3d410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:11.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.571+0000 7fe3daa54640 1 --2- 172.21.15.2:0/2570092496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3d4102ef0 0x7fe3d410da40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc009ca0 tx=0x7fe3cc02a950 comp rx=0 tx=0).stop 2024-09-19T04:46:11.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.571+0000 7fe3daa54640 1 -- 172.21.15.2:0/2570092496 shutdown_connections 2024-09-19T04:46:11.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.571+0000 7fe3daa54640 1 --2- 172.21.15.2:0/2570092496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3d4102ef0 0x7fe3d410da40 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:11.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.571+0000 7fe3daa54640 1 --2- 172.21.15.2:0/2570092496 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3d4102570 0x7fe3d41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:11.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.571+0000 7fe3daa54640 1 --2- 172.21.15.2:0/2570092496 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe3d4100e20 0x7fe3d4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:11.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.571+0000 7fe3daa54640 1 -- 172.21.15.2:0/2570092496 >> 172.21.15.2:0/2570092496 conn(0x7fe3d40fc7d0 msgr2=0x7fe3d40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:11.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.571+0000 7fe3daa54640 1 -- 172.21.15.2:0/2570092496 shutdown_connections 2024-09-19T04:46:11.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.571+0000 7fe3daa54640 1 -- 172.21.15.2:0/2570092496 wait complete. 2024-09-19T04:46:11.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.572+0000 7fe3daa54640 1 Processor -- start 2024-09-19T04:46:11.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.572+0000 7fe3daa54640 1 -- start start 2024-09-19T04:46:11.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.572+0000 7fe3daa54640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe3d4100e20 0x7fe3d40fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:11.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.572+0000 7fe3daa54640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3d4102570 0x7fe3d40fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:11.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.572+0000 7fe3daa54640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3d4102ef0 0x7fe3d40fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:11.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.572+0000 7fe3daa54640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d4110e50 con 0x7fe3d4102ef0 2024-09-19T04:46:11.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.572+0000 7fe3daa54640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d4110cd0 con 0x7fe3d4102570 2024-09-19T04:46:11.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.572+0000 7fe3daa54640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d4110fd0 con 0x7fe3d4100e20 2024-09-19T04:46:11.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.572+0000 7fe3d8ff1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3d4102ef0 0x7fe3d40fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:11.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.572+0000 7fe3d8ff1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3d4102ef0 0x7fe3d40fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56396/0 (socket says 172.21.15.2:56396) 2024-09-19T04:46:11.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.572+0000 7fe3d8ff1640 1 -- 172.21.15.2:0/3564810408 learned_addr learned my addr 172.21.15.2:0/3564810408 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:46:11.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.572+0000 7fe3cbfff640 1 --2- 172.21.15.2:0/3564810408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3d4102570 0x7fe3d40fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:11.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.572+0000 7fe3d3fff640 1 --2- 172.21.15.2:0/3564810408 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe3d4100e20 0x7fe3d40fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:11.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.572+0000 7fe3d8ff1640 1 -- 172.21.15.2:0/3564810408 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe3d4100e20 msgr2=0x7fe3d40fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:11.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.572+0000 7fe3d8ff1640 1 --2- 172.21.15.2:0/3564810408 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe3d4100e20 0x7fe3d40fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:11.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.572+0000 7fe3d8ff1640 1 -- 172.21.15.2:0/3564810408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3d4102570 msgr2=0x7fe3d40fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:11.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.572+0000 7fe3d8ff1640 1 --2- 172.21.15.2:0/3564810408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3d4102570 0x7fe3d40fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:11.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.573+0000 7fe3d8ff1640 1 -- 172.21.15.2:0/3564810408 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3d41a69f0 con 0x7fe3d4102ef0 2024-09-19T04:46:11.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.573+0000 7fe3d8ff1640 1 --2- 172.21.15.2:0/3564810408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3d4102ef0 0x7fe3d40fd700 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc02ae70 tx=0x7fe3cc02f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:11.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.573+0000 7fe3d1ffb640 1 -- 172.21.15.2:0/3564810408 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc034040 con 0x7fe3d4102ef0 2024-09-19T04:46:11.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.573+0000 7fe3d1ffb640 1 -- 172.21.15.2:0/3564810408 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe3cc0308f0 con 0x7fe3d4102ef0 2024-09-19T04:46:11.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.573+0000 7fe3daa54640 1 -- 172.21.15.2:0/3564810408 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3d41a6c80 con 0x7fe3d4102ef0 2024-09-19T04:46:11.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.573+0000 7fe3d1ffb640 1 -- 172.21.15.2:0/3564810408 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc004780 con 0x7fe3d4102ef0 2024-09-19T04:46:11.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.573+0000 7fe3daa54640 1 -- 172.21.15.2:0/3564810408 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3d41a7160 con 0x7fe3d4102ef0 2024-09-19T04:46:11.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.574+0000 7fe3daa54640 1 -- 172.21.15.2:0/3564810408 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3d4101200 con 0x7fe3d4102ef0 2024-09-19T04:46:11.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.575+0000 7fe3d1ffb640 1 -- 172.21.15.2:0/3564810408 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fe3cc037020 con 0x7fe3d4102ef0 2024-09-19T04:46:11.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.576+0000 7fe3d1ffb640 1 --2- 172.21.15.2:0/3564810408 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe3c00a3240 0x7fe3c00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:11.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.576+0000 7fe3d3fff640 1 --2- 172.21.15.2:0/3564810408 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe3c00a3240 0x7fe3c00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:11.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.576+0000 7fe3d1ffb640 1 -- 172.21.15.2:0/3564810408 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fe3cc0f0500 con 0x7fe3d4102ef0 2024-09-19T04:46:11.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.577+0000 7fe3d3fff640 1 --2- 172.21.15.2:0/3564810408 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe3c00a3240 0x7fe3c00a5700 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4009890 tx=0x7fe3c4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:11.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.581+0000 7fe3d1ffb640 1 -- 172.21.15.2:0/3564810408 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe3cc0bd6c0 con 0x7fe3d4102ef0 2024-09-19T04:46:11.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.792+0000 7fe3daa54640 1 -- 172.21.15.2:0/3564810408 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe3d41a7390 con 0x7fe3d4102ef0 2024-09-19T04:46:11.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.793+0000 7fe3d1ffb640 1 -- 172.21.15.2:0/3564810408 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9689 (secure 0 0 0) 0x7fe3cc0bcfc0 con 0x7fe3d4102ef0 2024-09-19T04:46:11.794 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:46:11.795 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":12,"btime":"2024-09-19T04:46:11:482684+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2467365137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2467365137},{"type":"v1","addr":"172.21.15.2:6835","nonce":2467365137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3162441888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3162441888},{"type":"v1","addr":"172.21.15.2:6837","nonce":3162441888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14631,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2740862966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2740862966},{"type":"v1","addr":"172.21.15.2:6839","nonce":2740862966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/2394435504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2394435504},{"type":"v1","addr":"172.21.15.2:6841","nonce":2394435504}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1630480244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1630480244},{"type":"v1","addr":"172.21.15.18:6833","nonce":1630480244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1553897465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1553897465},{"type":"v1","addr":"172.21.15.116:6833","nonce":1553897465}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3035664608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3035664608},{"type":"v1","addr":"172.21.15.18:6835","nonce":3035664608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1096622392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1096622392},{"type":"v1","addr":"172.21.15.18:6837","nonce":1096622392}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3761157675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3761157675},{"type":"v1","addr":"172.21.15.116:6835","nonce":3761157675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/1120131594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1120131594},{"type":"v1","addr":"172.21.15.116:6837","nonce":1120131594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24496,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6839/2346874880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":2346874880},{"type":"v1","addr":"172.21.15.116:6839","nonce":2346874880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T04:46:11.795 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 12 2024-09-19T04:46:11.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.795+0000 7fe3daa54640 1 -- 172.21.15.2:0/3564810408 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe3c00a3240 msgr2=0x7fe3c00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:11.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.795+0000 7fe3daa54640 1 --2- 172.21.15.2:0/3564810408 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe3c00a3240 0x7fe3c00a5700 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4009890 tx=0x7fe3c4008040 comp rx=0 tx=0).stop 2024-09-19T04:46:11.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.795+0000 7fe3daa54640 1 -- 172.21.15.2:0/3564810408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3d4102ef0 msgr2=0x7fe3d40fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:11.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.795+0000 7fe3daa54640 1 --2- 172.21.15.2:0/3564810408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3d4102ef0 0x7fe3d40fd700 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc02ae70 tx=0x7fe3cc02f5d0 comp rx=0 tx=0).stop 2024-09-19T04:46:11.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.795+0000 7fe3daa54640 1 -- 172.21.15.2:0/3564810408 shutdown_connections 2024-09-19T04:46:11.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.795+0000 7fe3daa54640 1 --2- 172.21.15.2:0/3564810408 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe3c00a3240 0x7fe3c00a5700 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:11.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.795+0000 7fe3daa54640 1 --2- 172.21.15.2:0/3564810408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3d4102ef0 0x7fe3d40fd700 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:11.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.795+0000 7fe3daa54640 1 --2- 172.21.15.2:0/3564810408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3d4102570 0x7fe3d40fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:11.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.795+0000 7fe3daa54640 1 --2- 172.21.15.2:0/3564810408 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe3d4100e20 0x7fe3d40fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:11.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.795+0000 7fe3daa54640 1 -- 172.21.15.2:0/3564810408 >> 172.21.15.2:0/3564810408 conn(0x7fe3d40fc7d0 msgr2=0x7fe3d4069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:11.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.795+0000 7fe3daa54640 1 -- 172.21.15.2:0/3564810408 shutdown_connections 2024-09-19T04:46:11.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:11.796+0000 7fe3daa54640 1 -- 172.21.15.2:0/3564810408 wait complete. 2024-09-19T04:46:12.151 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:12 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:12.151 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:12 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:12.151 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:12 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:12.152 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:12 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:46:12.152 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:12 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:46:12.152 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:12 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:46:12.152 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:12 smithi002 ceph-mon[30975]: Deploying daemon mds.b on smithi018 2024-09-19T04:46:12.152 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:12 smithi002 ceph-mon[30975]: mds.? [v2:172.21.15.2:6840/2394435504,v1:172.21.15.2:6841/2394435504] up:boot 2024-09-19T04:46:12.152 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:12 smithi002 ceph-mon[30975]: fsmap 11 up:standby 2024-09-19T04:46:12.152 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:12 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T04:46:12.152 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:12 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/3564810408' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:46:12.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:12 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:12.378 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:12 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:12.378 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:12 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:12.378 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:12 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:46:12.378 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:12 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:46:12.378 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:12 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:46:12.378 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:12 smithi116 ceph-mon[34477]: Deploying daemon mds.b on smithi018 2024-09-19T04:46:12.378 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:12 smithi116 ceph-mon[34477]: mds.? [v2:172.21.15.2:6840/2394435504,v1:172.21.15.2:6841/2394435504] up:boot 2024-09-19T04:46:12.378 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:12 smithi116 ceph-mon[34477]: fsmap 11 up:standby 2024-09-19T04:46:12.378 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:12 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T04:46:12.378 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:12 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/3564810408' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:46:12.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:12 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:12.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:12 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:12.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:12 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:12.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:12 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:46:12.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:12 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:46:12.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:12 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:46:12.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:12 smithi018 ceph-mon[34537]: Deploying daemon mds.b on smithi018 2024-09-19T04:46:12.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:12 smithi018 ceph-mon[34537]: mds.? [v2:172.21.15.2:6840/2394435504,v1:172.21.15.2:6841/2394435504] up:boot 2024-09-19T04:46:12.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:12 smithi018 ceph-mon[34537]: fsmap 11 up:standby 2024-09-19T04:46:12.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:12 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T04:46:12.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:12 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/3564810408' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:46:13.276 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:13 smithi018 ceph-mon[34537]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:46:13.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:13 smithi002 ceph-mon[30975]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:46:13.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:13 smithi116 ceph-mon[34477]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:46:13.806 INFO:journalctl@ceph.mds.b.smithi018.stdout:Sep 19 04:46:13 smithi018 systemd[1]: Started Ceph mds.b for d46630c4-7640-11ef-bceb-c7b262605968. 2024-09-19T04:46:14.465 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:46:14.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:14 smithi018 ceph-mon[34537]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:46:14.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:14 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:14.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:14 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:14.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:14 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:14.808 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:14 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:14.808 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:14 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:14.808 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:14 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:46:14.808 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:14 smithi018 ceph-mon[34537]: mds.? [v2:172.21.15.18:6838/4207677139,v1:172.21.15.18:6839/4207677139] up:boot 2024-09-19T04:46:14.808 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:14 smithi018 ceph-mon[34537]: fsmap 12 up:standby 2024-09-19T04:46:14.808 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:14 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T04:46:15.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:14 smithi002 ceph-mon[30975]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:46:15.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:14 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:15.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:14 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:15.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:14 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:15.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:14 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:15.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:14 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:15.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:14 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:46:15.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:14 smithi002 ceph-mon[30975]: mds.? [v2:172.21.15.18:6838/4207677139,v1:172.21.15.18:6839/4207677139] up:boot 2024-09-19T04:46:15.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:14 smithi002 ceph-mon[30975]: fsmap 12 up:standby 2024-09-19T04:46:15.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:14 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T04:46:15.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:14 smithi116 ceph-mon[34477]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:46:15.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:14 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:15.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:14 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:15.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:14 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:15.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:14 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:15.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:14 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:15.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:14 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:46:15.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:14 smithi116 ceph-mon[34477]: mds.? [v2:172.21.15.18:6838/4207677139,v1:172.21.15.18:6839/4207677139] up:boot 2024-09-19T04:46:15.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:14 smithi116 ceph-mon[34477]: fsmap 12 up:standby 2024-09-19T04:46:15.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:14 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T04:46:15.152 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:46:15.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.609+0000 7fe5adbad640 1 -- 172.21.15.2:0/3775708006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5a8102780 msgr2=0x7fe5a81067d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:15.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.610+0000 7fe5adbad640 1 --2- 172.21.15.2:0/3775708006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5a8102780 0x7fe5a81067d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe59c009900 tx=0x7fe59c02a410 comp rx=0 tx=0).stop 2024-09-19T04:46:15.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.610+0000 7fe5adbad640 1 -- 172.21.15.2:0/3775708006 shutdown_connections 2024-09-19T04:46:15.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.610+0000 7fe5adbad640 1 --2- 172.21.15.2:0/3775708006 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5a8106f00 0x7fe5a810ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:15.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.610+0000 7fe5adbad640 1 --2- 172.21.15.2:0/3775708006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5a8102780 0x7fe5a81067d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:15.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.610+0000 7fe5adbad640 1 --2- 172.21.15.2:0/3775708006 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5a8101dd0 0x7fe5a81021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:15.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.610+0000 7fe5adbad640 1 -- 172.21.15.2:0/3775708006 >> 172.21.15.2:0/3775708006 conn(0x7fe5a80fd8b0 msgr2=0x7fe5a80ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:15.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.610+0000 7fe5adbad640 1 -- 172.21.15.2:0/3775708006 shutdown_connections 2024-09-19T04:46:15.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.610+0000 7fe5adbad640 1 -- 172.21.15.2:0/3775708006 wait complete. 2024-09-19T04:46:15.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.610+0000 7fe5adbad640 1 Processor -- start 2024-09-19T04:46:15.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.610+0000 7fe5adbad640 1 -- start start 2024-09-19T04:46:15.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.611+0000 7fe5adbad640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5a8101dd0 0x7fe5a80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:15.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.611+0000 7fe5adbad640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5a8102780 0x7fe5a8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:15.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.611+0000 7fe5adbad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5a8106f00 0x7fe5a8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:15.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.611+0000 7fe5adbad640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a8111e10 con 0x7fe5a8106f00 2024-09-19T04:46:15.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.611+0000 7fe5adbad640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a8111c90 con 0x7fe5a8102780 2024-09-19T04:46:15.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.611+0000 7fe5adbad640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a8111f90 con 0x7fe5a8101dd0 2024-09-19T04:46:15.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.611+0000 7fe5a7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5a8106f00 0x7fe5a8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:15.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.611+0000 7fe5a7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5a8106f00 0x7fe5a8074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56422/0 (socket says 172.21.15.2:56422) 2024-09-19T04:46:15.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.611+0000 7fe5a7fff640 1 -- 172.21.15.2:0/1834733841 learned_addr learned my addr 172.21.15.2:0/1834733841 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:46:15.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.611+0000 7fe5a6ffd640 1 --2- 172.21.15.2:0/1834733841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5a8102780 0x7fe5a8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:15.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.611+0000 7fe5a77fe640 1 --2- 172.21.15.2:0/1834733841 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5a8101dd0 0x7fe5a80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:15.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.611+0000 7fe5a7fff640 1 -- 172.21.15.2:0/1834733841 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5a8101dd0 msgr2=0x7fe5a80744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:15.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.611+0000 7fe5a7fff640 1 --2- 172.21.15.2:0/1834733841 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5a8101dd0 0x7fe5a80744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:15.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.611+0000 7fe5a7fff640 1 -- 172.21.15.2:0/1834733841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5a8102780 msgr2=0x7fe5a8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:15.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.611+0000 7fe5a7fff640 1 --2- 172.21.15.2:0/1834733841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5a8102780 0x7fe5a8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:15.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.611+0000 7fe5a7fff640 1 -- 172.21.15.2:0/1834733841 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5a81a6890 con 0x7fe5a8106f00 2024-09-19T04:46:15.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.611+0000 7fe5a6ffd640 1 --2- 172.21.15.2:0/1834733841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5a8102780 0x7fe5a8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:46:15.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.612+0000 7fe5a7fff640 1 --2- 172.21.15.2:0/1834733841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5a8106f00 0x7fe5a8074f70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe5a000eaa0 tx=0x7fe5a000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:15.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.612+0000 7fe5a4ff9640 1 -- 172.21.15.2:0/1834733841 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a000cdb0 con 0x7fe5a8106f00 2024-09-19T04:46:15.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.612+0000 7fe5adbad640 1 -- 172.21.15.2:0/1834733841 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5a81a6b80 con 0x7fe5a8106f00 2024-09-19T04:46:15.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.612+0000 7fe5a4ff9640 1 -- 172.21.15.2:0/1834733841 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe5a0005020 con 0x7fe5a8106f00 2024-09-19T04:46:15.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.612+0000 7fe5adbad640 1 -- 172.21.15.2:0/1834733841 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5a81a70e0 con 0x7fe5a8106f00 2024-09-19T04:46:15.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.612+0000 7fe5a4ff9640 1 -- 172.21.15.2:0/1834733841 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a00116d0 con 0x7fe5a8106f00 2024-09-19T04:46:15.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.613+0000 7fe5adbad640 1 -- 172.21.15.2:0/1834733841 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5a81021b0 con 0x7fe5a8106f00 2024-09-19T04:46:15.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.615+0000 7fe5a4ff9640 1 -- 172.21.15.2:0/1834733841 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fe5a00051d0 con 0x7fe5a8106f00 2024-09-19T04:46:15.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.616+0000 7fe5a4ff9640 1 --2- 172.21.15.2:0/1834733841 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe5900a3240 0x7fe5900a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:15.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.616+0000 7fe5a77fe640 1 --2- 172.21.15.2:0/1834733841 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe5900a3240 0x7fe5900a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:15.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.616+0000 7fe5a4ff9640 1 -- 172.21.15.2:0/1834733841 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fe5a00cf8a0 con 0x7fe5a8106f00 2024-09-19T04:46:15.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.616+0000 7fe5a77fe640 1 --2- 172.21.15.2:0/1834733841 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe5900a3240 0x7fe5900a5700 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe598005d00 tx=0x7fe59800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:15.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.619+0000 7fe5a4ff9640 1 -- 172.21.15.2:0/1834733841 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe5a0016030 con 0x7fe5a8106f00 2024-09-19T04:46:15.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.874+0000 7fe5adbad640 1 -- 172.21.15.2:0/1834733841 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe5a810a0e0 con 0x7fe5a8106f00 2024-09-19T04:46:15.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.874+0000 7fe5a4ff9640 1 -- 172.21.15.2:0/1834733841 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10515 (secure 0 0 0) 0x7fe5a009c410 con 0x7fe5a8106f00 2024-09-19T04:46:15.876 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:46:15.876 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":13,"btime":"2024-09-19T04:46:14:098424+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2467365137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2467365137},{"type":"v1","addr":"172.21.15.2:6835","nonce":2467365137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3162441888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3162441888},{"type":"v1","addr":"172.21.15.2:6837","nonce":3162441888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14631,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2740862966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2740862966},{"type":"v1","addr":"172.21.15.2:6839","nonce":2740862966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/2394435504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2394435504},{"type":"v1","addr":"172.21.15.2:6841","nonce":2394435504}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1630480244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1630480244},{"type":"v1","addr":"172.21.15.18:6833","nonce":1630480244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1553897465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1553897465},{"type":"v1","addr":"172.21.15.116:6833","nonce":1553897465}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3035664608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3035664608},{"type":"v1","addr":"172.21.15.18:6835","nonce":3035664608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1096622392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1096622392},{"type":"v1","addr":"172.21.15.18:6837","nonce":1096622392}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3761157675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3761157675},{"type":"v1","addr":"172.21.15.116:6835","nonce":3761157675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/1120131594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1120131594},{"type":"v1","addr":"172.21.15.116:6837","nonce":1120131594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24491,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/4207677139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":4207677139},{"type":"v1","addr":"172.21.15.18:6839","nonce":4207677139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24496,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6839/2346874880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":2346874880},{"type":"v1","addr":"172.21.15.116:6839","nonce":2346874880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T04:46:15.876 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 13 2024-09-19T04:46:15.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.877+0000 7fe5adbad640 1 -- 172.21.15.2:0/1834733841 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe5900a3240 msgr2=0x7fe5900a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:15.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.877+0000 7fe5adbad640 1 --2- 172.21.15.2:0/1834733841 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe5900a3240 0x7fe5900a5700 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe598005d00 tx=0x7fe59800b410 comp rx=0 tx=0).stop 2024-09-19T04:46:15.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.877+0000 7fe5adbad640 1 -- 172.21.15.2:0/1834733841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5a8106f00 msgr2=0x7fe5a8074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:15.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.877+0000 7fe5adbad640 1 --2- 172.21.15.2:0/1834733841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5a8106f00 0x7fe5a8074f70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe5a000eaa0 tx=0x7fe5a000ef60 comp rx=0 tx=0).stop 2024-09-19T04:46:15.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.877+0000 7fe5adbad640 1 -- 172.21.15.2:0/1834733841 shutdown_connections 2024-09-19T04:46:15.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.877+0000 7fe5adbad640 1 --2- 172.21.15.2:0/1834733841 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe5900a3240 0x7fe5900a5700 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:15.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.877+0000 7fe5adbad640 1 --2- 172.21.15.2:0/1834733841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5a8106f00 0x7fe5a8074f70 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:15.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.877+0000 7fe5adbad640 1 --2- 172.21.15.2:0/1834733841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5a8102780 0x7fe5a8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:15.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.877+0000 7fe5adbad640 1 --2- 172.21.15.2:0/1834733841 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5a8101dd0 0x7fe5a80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:15.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.877+0000 7fe5adbad640 1 -- 172.21.15.2:0/1834733841 >> 172.21.15.2:0/1834733841 conn(0x7fe5a80fd8b0 msgr2=0x7fe5a80feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:15.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.877+0000 7fe5adbad640 1 -- 172.21.15.2:0/1834733841 shutdown_connections 2024-09-19T04:46:15.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:15.877+0000 7fe5adbad640 1 -- 172.21.15.2:0/1834733841 wait complete. 2024-09-19T04:46:16.448 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:16 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:16.448 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:16 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:16.448 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:16 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:16.448 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:16 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:16.448 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:16 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:16.448 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:16 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/1834733841' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:46:16.448 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:16 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:16.448 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:16 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:16.448 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:16 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:46:16.448 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:16 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:46:16.449 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:16 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:16.449 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:16 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:46:16.474 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-19T04:46:16.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:16 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:16.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:16 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:16.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:16 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:16.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:16 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:16.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:16 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:16.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:16 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/1834733841' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:46:16.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:16 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:16.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:16 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:16.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:16 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:46:16.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:16 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:46:16.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:16 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:16.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:16 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:46:16.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:16 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:16.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:16 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:16.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:16 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:16.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:16 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:16.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:16 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:16.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:16 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/1834733841' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:46:16.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:16 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:16.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:16 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:16.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:16 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:46:16.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:16 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:46:16.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:16 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:16.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:16 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:46:17.398 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:46:17.521 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:17 smithi002 ceph-mon[30975]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:46:17.555 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:17 smithi018 ceph-mon[34537]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:46:17.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:17 smithi116 ceph-mon[34477]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:46:17.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:17.841+0000 7fe8874d8640 1 -- 172.21.15.2:0/2918897978 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe880100ca0 msgr2=0x7fe880106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:17.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:17.841+0000 7fe8874d8640 1 --2- 172.21.15.2:0/2918897978 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe880100ca0 0x7fe880106840 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe870009930 tx=0x7fe87002a420 comp rx=0 tx=0).stop 2024-09-19T04:46:17.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:17.841+0000 7fe8874d8640 1 -- 172.21.15.2:0/2918897978 shutdown_connections 2024-09-19T04:46:17.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:17.841+0000 7fe8874d8640 1 --2- 172.21.15.2:0/2918897978 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe880106f50 0x7fe88010eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:17.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:17.841+0000 7fe8874d8640 1 --2- 172.21.15.2:0/2918897978 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe880100ca0 0x7fe880106840 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:17.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:17.841+0000 7fe8874d8640 1 --2- 172.21.15.2:0/2918897978 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8801002f0 0x7fe8801006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:17.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:17.841+0000 7fe8874d8640 1 -- 172.21.15.2:0/2918897978 >> 172.21.15.2:0/2918897978 conn(0x7fe880077210 msgr2=0x7fe8800fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:17.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:17.841+0000 7fe8874d8640 1 -- 172.21.15.2:0/2918897978 shutdown_connections 2024-09-19T04:46:17.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:17.841+0000 7fe8874d8640 1 -- 172.21.15.2:0/2918897978 wait complete. 2024-09-19T04:46:17.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:17.842+0000 7fe8874d8640 1 Processor -- start 2024-09-19T04:46:17.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:17.842+0000 7fe8874d8640 1 -- start start 2024-09-19T04:46:17.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:17.842+0000 7fe8874d8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8801002f0 0x7fe8801984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:17.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:17.842+0000 7fe8874d8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe880100ca0 0x7fe880198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:17.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:17.842+0000 7fe8874d8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe880106f50 0x7fe88019cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:17.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:17.842+0000 7fe8874d8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe880111e50 con 0x7fe880100ca0 2024-09-19T04:46:17.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:17.842+0000 7fe8874d8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe880111cd0 con 0x7fe8801002f0 2024-09-19T04:46:17.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:17.842+0000 7fe8874d8640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fe880111fd0 con 0x7fe880106f50 2024-09-19T04:46:17.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:17.843+0000 7fe884a73640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe880100ca0 0x7fe880198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:17.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:17.843+0000 7fe885274640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8801002f0 0x7fe8801984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:17.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:17.843+0000 7fe885274640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8801002f0 0x7fe8801984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.2:46420/0 (socket says 172.21.15.2:46420) 2024-09-19T04:46:17.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:17.843+0000 7fe885274640 1 -- 172.21.15.2:0/3312808129 learned_addr learned my addr 172.21.15.2:0/3312808129 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:46:17.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:17.843+0000 7fe884a73640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe880100ca0 0x7fe880198a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56440/0 (socket says 172.21.15.2:56440) 2024-09-19T04:46:17.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:17.843+0000 7fe885a75640 1 --2- 172.21.15.2:0/3312808129 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe880106f50 0x7fe88019cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:17.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:17.843+0000 7fe885274640 1 -- 172.21.15.2:0/3312808129 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe880106f50 msgr2=0x7fe88019cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:17.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:17.843+0000 7fe885274640 1 --2- 172.21.15.2:0/3312808129 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe880106f50 0x7fe88019cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:17.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:17.843+0000 7fe885274640 1 -- 172.21.15.2:0/3312808129 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe880100ca0 msgr2=0x7fe880198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:17.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:17.843+0000 7fe885274640 1 --2- 172.21.15.2:0/3312808129 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe880100ca0 0x7fe880198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:17.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:17.843+0000 7fe885274640 1 -- 172.21.15.2:0/3312808129 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe88019d4a0 con 0x7fe8801002f0 2024-09-19T04:46:17.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:17.843+0000 7fe884a73640 1 --2- 172.21.15.2:0/3312808129 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe880100ca0 0x7fe880198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:46:17.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:17.843+0000 7fe885274640 1 --2- 172.21.15.2:0/3312808129 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8801002f0 0x7fe8801984f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe87c00e9f0 tx=0x7fe87c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:17.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:17.843+0000 7fe8767fc640 1 -- 172.21.15.2:0/3312808129 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe87c00cd80 con 0x7fe8801002f0 2024-09-19T04:46:17.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:17.843+0000 7fe8874d8640 1 -- 172.21.15.2:0/3312808129 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe88019d790 con 0x7fe8801002f0 2024-09-19T04:46:17.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:17.843+0000 7fe8767fc640 1 -- 172.21.15.2:0/3312808129 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe87c0108e0 con 0x7fe8801002f0 2024-09-19T04:46:17.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:17.843+0000 7fe8767fc640 1 -- 172.21.15.2:0/3312808129 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe87c018920 con 0x7fe8801002f0 2024-09-19T04:46:17.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:17.844+0000 7fe8874d8640 1 -- 172.21.15.2:0/3312808129 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8801a5070 con 0x7fe8801002f0 2024-09-19T04:46:17.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:17.844+0000 7fe8874d8640 1 -- 172.21.15.2:0/3312808129 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8801006d0 con 0x7fe8801002f0 2024-09-19T04:46:17.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:17.846+0000 7fe8767fc640 1 -- 172.21.15.2:0/3312808129 <== mon.2 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fe87c010a90 con 0x7fe8801002f0 2024-09-19T04:46:17.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:17.846+0000 7fe8767fc640 1 --2- 172.21.15.2:0/3312808129 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe86c0a3240 0x7fe86c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:17.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:17.846+0000 7fe884a73640 1 --2- 172.21.15.2:0/3312808129 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe86c0a3240 0x7fe86c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:17.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:17.846+0000 7fe8767fc640 1 -- 172.21.15.2:0/3312808129 <== mon.2 v2:172.21.15.18:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fe87c0cfcc0 con 0x7fe8801002f0 2024-09-19T04:46:17.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:17.847+0000 7fe884a73640 1 --2- 172.21.15.2:0/3312808129 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe86c0a3240 0x7fe86c0a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe870004770 tx=0x7fe870000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:17.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:17.850+0000 7fe8767fc640 1 -- 172.21.15.2:0/3312808129 <== mon.2 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe87c09c790 con 0x7fe8801002f0 2024-09-19T04:46:18.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:18.039+0000 7fe8874d8640 1 -- 172.21.15.2:0/3312808129 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fe88010a150 con 0x7fe8801002f0 2024-09-19T04:46:18.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:18.041+0000 7fe8767fc640 1 -- 172.21.15.2:0/3312808129 <== mon.2 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v73) ==== 84+0+65 (secure 0 0 0) 0x7fe87c0a0a90 con 0x7fe8801002f0 2024-09-19T04:46:18.042 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:46:18.042 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2024-09-19T04:46:18.042 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:46:18.043 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 1, 2024-09-19T04:46:18.043 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": ".mgr" 2024-09-19T04:46:18.043 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:46:18.043 INFO:teuthology.orchestra.run.smithi002.stdout:] 2024-09-19T04:46:18.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:18.043+0000 7fe8874d8640 1 -- 172.21.15.2:0/3312808129 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe86c0a3240 msgr2=0x7fe86c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:18.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:18.043+0000 7fe8874d8640 1 --2- 172.21.15.2:0/3312808129 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe86c0a3240 0x7fe86c0a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe870004770 tx=0x7fe870000bc0 comp rx=0 tx=0).stop 2024-09-19T04:46:18.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:18.043+0000 7fe8874d8640 1 -- 172.21.15.2:0/3312808129 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8801002f0 msgr2=0x7fe8801984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:18.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:18.043+0000 7fe8874d8640 1 --2- 172.21.15.2:0/3312808129 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8801002f0 0x7fe8801984f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe87c00e9f0 tx=0x7fe87c00eeb0 comp rx=0 tx=0).stop 2024-09-19T04:46:18.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:18.043+0000 7fe8874d8640 1 -- 172.21.15.2:0/3312808129 shutdown_connections 2024-09-19T04:46:18.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:18.043+0000 7fe8874d8640 1 --2- 172.21.15.2:0/3312808129 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe86c0a3240 0x7fe86c0a5700 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:18.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:18.043+0000 7fe8874d8640 1 --2- 172.21.15.2:0/3312808129 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe880106f50 0x7fe88019cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:18.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:18.043+0000 7fe8874d8640 1 --2- 172.21.15.2:0/3312808129 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe880100ca0 0x7fe880198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:18.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:18.043+0000 7fe8874d8640 1 --2- 172.21.15.2:0/3312808129 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8801002f0 0x7fe8801984f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:18.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:18.043+0000 7fe8874d8640 1 -- 172.21.15.2:0/3312808129 >> 172.21.15.2:0/3312808129 conn(0x7fe880077210 msgr2=0x7fe880105400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:18.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:18.043+0000 7fe8874d8640 1 -- 172.21.15.2:0/3312808129 shutdown_connections 2024-09-19T04:46:18.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:18.044+0000 7fe8874d8640 1 -- 172.21.15.2:0/3312808129 wait complete. 2024-09-19T04:46:18.665 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:18 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:18.665 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:18 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:18.665 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:18 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:18.665 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:18 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:18.665 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:18 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:18.665 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:18 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/3312808129' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T04:46:18.665 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:18 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:18.665 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:18 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:46:18.665 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:18 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:46:18.665 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:18 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:18.693 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T04:46:18.693 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T04:46:18.805 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:18 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:18.806 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:18 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:18.806 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:18 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:18.806 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:18 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:18.806 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:18 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:18.806 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:18 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/3312808129' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T04:46:18.806 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:18 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:18.806 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:18 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:46:18.806 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:18 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:46:18.806 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:18 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:18.863 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:18 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:18.863 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:18 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:18.863 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:18 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:18.863 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:18 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:18.864 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:18 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:18.864 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:18 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/3312808129' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T04:46:18.864 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:18 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:18.864 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:18 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:46:18.864 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:18 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:46:18.864 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:18 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:46:18.948 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:46:19.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:19.411+0000 7fcffbfa2640 1 -- 172.21.15.2:0/1386771004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcff4102da0 msgr2=0x7fcff4103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:19.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:19.411+0000 7fcffbfa2640 1 --2- 172.21.15.2:0/1386771004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcff4102da0 0x7fcff4103180 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcff0009900 tx=0x7fcff002a480 comp rx=0 tx=0).stop 2024-09-19T04:46:19.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:19.411+0000 7fcffbfa2640 1 -- 172.21.15.2:0/1386771004 shutdown_connections 2024-09-19T04:46:19.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:19.411+0000 7fcffbfa2640 1 --2- 172.21.15.2:0/1386771004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcff410c180 0x7fcff410e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:19.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:19.411+0000 7fcffbfa2640 1 --2- 172.21.15.2:0/1386771004 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcff41036c0 0x7fcff410bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:19.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:19.411+0000 7fcffbfa2640 1 --2- 172.21.15.2:0/1386771004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcff4102da0 0x7fcff4103180 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:19.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:19.411+0000 7fcffbfa2640 1 -- 172.21.15.2:0/1386771004 >> 172.21.15.2:0/1386771004 conn(0x7fcff40fc7a0 msgr2=0x7fcff40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:19.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:19.411+0000 7fcffbfa2640 1 -- 172.21.15.2:0/1386771004 shutdown_connections 2024-09-19T04:46:19.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:19.411+0000 7fcffbfa2640 1 -- 172.21.15.2:0/1386771004 wait complete. 2024-09-19T04:46:19.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:19.412+0000 7fcffbfa2640 1 Processor -- start 2024-09-19T04:46:19.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:19.412+0000 7fcffbfa2640 1 -- start start 2024-09-19T04:46:19.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:19.412+0000 7fcffbfa2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcff4102da0 0x7fcff4198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:19.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:19.412+0000 7fcffbfa2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcff41036c0 0x7fcff41988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:19.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:19.412+0000 7fcffbfa2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcff410c180 0x7fcff419cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:19.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:19.412+0000 7fcffbfa2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcff4111e10 con 0x7fcff410c180 2024-09-19T04:46:19.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:19.412+0000 7fcffbfa2640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcff4111c90 con 0x7fcff4102da0 2024-09-19T04:46:19.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:19.412+0000 7fcffbfa2640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fcff4111f90 con 0x7fcff41036c0 2024-09-19T04:46:19.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:19.412+0000 7fcffa53f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcff410c180 0x7fcff419cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:19.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:19.412+0000 7fcffa53f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcff410c180 0x7fcff419cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56454/0 (socket says 172.21.15.2:56454) 2024-09-19T04:46:19.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:19.412+0000 7fcffa53f640 1 -- 172.21.15.2:0/3767798251 learned_addr learned my addr 172.21.15.2:0/3767798251 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:46:19.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:19.412+0000 7fcff953d640 1 --2- 172.21.15.2:0/3767798251 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcff41036c0 0x7fcff41988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:19.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:19.412+0000 7fcff9d3e640 1 --2- 172.21.15.2:0/3767798251 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcff4102da0 0x7fcff4198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:19.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:19.412+0000 7fcffa53f640 1 -- 172.21.15.2:0/3767798251 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcff41036c0 msgr2=0x7fcff41988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:19.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:19.412+0000 7fcffa53f640 1 --2- 172.21.15.2:0/3767798251 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcff41036c0 0x7fcff41988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:19.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:19.412+0000 7fcffa53f640 1 -- 172.21.15.2:0/3767798251 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcff4102da0 msgr2=0x7fcff4198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:19.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:19.412+0000 7fcffa53f640 1 --2- 172.21.15.2:0/3767798251 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcff4102da0 0x7fcff4198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:19.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:19.413+0000 7fcffa53f640 1 -- 172.21.15.2:0/3767798251 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcff419d320 con 0x7fcff410c180 2024-09-19T04:46:19.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:19.413+0000 7fcffa53f640 1 --2- 172.21.15.2:0/3767798251 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcff410c180 0x7fcff419cc40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcfec00eaa0 tx=0x7fcfec00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:19.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:19.413+0000 7fcfe6ffd640 1 -- 172.21.15.2:0/3767798251 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfec00cdb0 con 0x7fcff410c180 2024-09-19T04:46:19.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:19.413+0000 7fcfe6ffd640 1 -- 172.21.15.2:0/3767798251 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcfec005020 con 0x7fcff410c180 2024-09-19T04:46:19.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:19.413+0000 7fcffbfa2640 1 -- 172.21.15.2:0/3767798251 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcff419d610 con 0x7fcff410c180 2024-09-19T04:46:19.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:19.413+0000 7fcfe6ffd640 1 -- 172.21.15.2:0/3767798251 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfec0116d0 con 0x7fcff410c180 2024-09-19T04:46:19.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:19.413+0000 7fcffbfa2640 1 -- 172.21.15.2:0/3767798251 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcff41a4ef0 con 0x7fcff410c180 2024-09-19T04:46:19.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:19.414+0000 7fcffbfa2640 1 -- 172.21.15.2:0/3767798251 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcff4103180 con 0x7fcff410c180 2024-09-19T04:46:19.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:19.415+0000 7fcfe6ffd640 1 -- 172.21.15.2:0/3767798251 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fcfec0051d0 con 0x7fcff410c180 2024-09-19T04:46:19.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:19.416+0000 7fcfe6ffd640 1 --2- 172.21.15.2:0/3767798251 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fcfe00a3240 0x7fcfe00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:19.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:19.416+0000 7fcff9d3e640 1 --2- 172.21.15.2:0/3767798251 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fcfe00a3240 0x7fcfe00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:19.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:19.416+0000 7fcfe6ffd640 1 -- 172.21.15.2:0/3767798251 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fcfec0cf6e0 con 0x7fcff410c180 2024-09-19T04:46:19.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:19.416+0000 7fcff9d3e640 1 --2- 172.21.15.2:0/3767798251 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fcfe00a3240 0x7fcfe00a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcff0031440 tx=0x7fcff00095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:19.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:19.420+0000 7fcfe6ffd640 1 -- 172.21.15.2:0/3767798251 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcfec016030 con 0x7fcff410c180 2024-09-19T04:46:19.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:19.598+0000 7fcffbfa2640 1 -- 172.21.15.2:0/3767798251 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fcff402d7c0 con 0x7fcff410c180 2024-09-19T04:46:19.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:19 smithi002 ceph-mon[30975]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:46:19.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:19 smithi018 ceph-mon[34537]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:46:19.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:19 smithi116 ceph-mon[34477]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:46:20.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:20.474+0000 7fcfe6ffd640 1 -- 172.21.15.2:0/3767798251 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v74) ==== 138+0+0 (secure 0 0 0) 0x7fcfec09c800 con 0x7fcff410c180 2024-09-19T04:46:20.476 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' created 2024-09-19T04:46:20.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:20.477+0000 7fcffbfa2640 1 -- 172.21.15.2:0/3767798251 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fcfe00a3240 msgr2=0x7fcfe00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:20.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:20.477+0000 7fcffbfa2640 1 --2- 172.21.15.2:0/3767798251 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fcfe00a3240 0x7fcfe00a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcff0031440 tx=0x7fcff00095f0 comp rx=0 tx=0).stop 2024-09-19T04:46:20.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:20.477+0000 7fcffbfa2640 1 -- 172.21.15.2:0/3767798251 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcff410c180 msgr2=0x7fcff419cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:20.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:20.477+0000 7fcffbfa2640 1 --2- 172.21.15.2:0/3767798251 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcff410c180 0x7fcff419cc40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcfec00eaa0 tx=0x7fcfec00ef60 comp rx=0 tx=0).stop 2024-09-19T04:46:20.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:20.477+0000 7fcffbfa2640 1 -- 172.21.15.2:0/3767798251 shutdown_connections 2024-09-19T04:46:20.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:20.477+0000 7fcffbfa2640 1 --2- 172.21.15.2:0/3767798251 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fcfe00a3240 0x7fcfe00a5700 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:20.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:20.477+0000 7fcffbfa2640 1 --2- 172.21.15.2:0/3767798251 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcff410c180 0x7fcff419cc40 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:20.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:20.477+0000 7fcffbfa2640 1 --2- 172.21.15.2:0/3767798251 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcff41036c0 0x7fcff41988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:20.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:20.477+0000 7fcffbfa2640 1 --2- 172.21.15.2:0/3767798251 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcff4102da0 0x7fcff4198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:20.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:20.477+0000 7fcffbfa2640 1 -- 172.21.15.2:0/3767798251 >> 172.21.15.2:0/3767798251 conn(0x7fcff40fc7a0 msgr2=0x7fcff40fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:20.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:20.477+0000 7fcffbfa2640 1 -- 172.21.15.2:0/3767798251 shutdown_connections 2024-09-19T04:46:20.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:20.477+0000 7fcffbfa2640 1 -- 172.21.15.2:0/3767798251 wait complete. 2024-09-19T04:46:20.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:20 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/3767798251' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T04:46:20.821 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:20 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/3767798251' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T04:46:20.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:20 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/3767798251' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T04:46:21.150 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T04:46:21.414 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:46:21.776 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:21 smithi002 ceph-mon[30975]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:46:21.776 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:21 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/3767798251' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T04:46:21.776 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:21 smithi002 ceph-mon[30975]: osdmap e74: 12 total, 12 up, 12 in 2024-09-19T04:46:21.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:21 smithi018 ceph-mon[34537]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:46:21.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:21 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/3767798251' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T04:46:21.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:21 smithi018 ceph-mon[34537]: osdmap e74: 12 total, 12 up, 12 in 2024-09-19T04:46:21.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:21 smithi116 ceph-mon[34477]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:46:21.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:21 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/3767798251' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T04:46:21.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:21 smithi116 ceph-mon[34477]: osdmap e74: 12 total, 12 up, 12 in 2024-09-19T04:46:21.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:21.864+0000 7f20f3c23640 1 -- 172.21.15.2:0/1833519837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20ec106a80 msgr2=0x7f20ec106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:21.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:21.864+0000 7f20f3c23640 1 --2- 172.21.15.2:0/1833519837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20ec106a80 0x7f20ec106e60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f20e8009930 tx=0x7f20e802a420 comp rx=0 tx=0).stop 2024-09-19T04:46:21.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:21.864+0000 7f20f3c23640 1 -- 172.21.15.2:0/1833519837 shutdown_connections 2024-09-19T04:46:21.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:21.864+0000 7f20f3c23640 1 --2- 172.21.15.2:0/1833519837 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20ec101420 0x7f20ec10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:21.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:21.864+0000 7f20f3c23640 1 --2- 172.21.15.2:0/1833519837 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f20ec100a80 0x7f20ec100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:21.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:21.864+0000 7f20f3c23640 1 --2- 172.21.15.2:0/1833519837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20ec106a80 0x7f20ec106e60 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:21.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:21.864+0000 7f20f3c23640 1 -- 172.21.15.2:0/1833519837 >> 172.21.15.2:0/1833519837 conn(0x7f20ec0fc7a0 msgr2=0x7f20ec0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:21.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:21.864+0000 7f20f3c23640 1 -- 172.21.15.2:0/1833519837 shutdown_connections 2024-09-19T04:46:21.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:21.864+0000 7f20f3c23640 1 -- 172.21.15.2:0/1833519837 wait complete. 2024-09-19T04:46:21.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:21.865+0000 7f20f3c23640 1 Processor -- start 2024-09-19T04:46:21.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:21.865+0000 7f20f3c23640 1 -- start start 2024-09-19T04:46:21.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:21.865+0000 7f20f3c23640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20ec100a80 0x7f20ec1972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:21.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:21.865+0000 7f20f3c23640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20ec101420 0x7f20ec197830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:21.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:21.865+0000 7f20f3c23640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f20ec106a80 0x7f20ec19bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:21.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:21.865+0000 7f20f3c23640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f20ec110d50 con 0x7f20ec100a80 2024-09-19T04:46:21.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:21.865+0000 7f20f3c23640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f20ec110bd0 con 0x7f20ec101420 2024-09-19T04:46:21.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:21.865+0000 7f20f3c23640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f20ec110ed0 con 0x7f20ec106a80 2024-09-19T04:46:21.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:21.865+0000 7f20f19bf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20ec100a80 0x7f20ec1972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:21.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:21.865+0000 7f20f19bf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20ec100a80 0x7f20ec1972f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34612/0 (socket says 172.21.15.2:34612) 2024-09-19T04:46:21.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:21.865+0000 7f20f19bf640 1 -- 172.21.15.2:0/3551375051 learned_addr learned my addr 172.21.15.2:0/3551375051 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:46:21.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:21.865+0000 7f20f21c0640 1 --2- 172.21.15.2:0/3551375051 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f20ec106a80 0x7f20ec19bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:21.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:21.866+0000 7f20f11be640 1 --2- 172.21.15.2:0/3551375051 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20ec101420 0x7f20ec197830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:21.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:21.866+0000 7f20f19bf640 1 -- 172.21.15.2:0/3551375051 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f20ec106a80 msgr2=0x7f20ec19bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:21.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:21.866+0000 7f20f19bf640 1 --2- 172.21.15.2:0/3551375051 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f20ec106a80 0x7f20ec19bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:21.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:21.866+0000 7f20f19bf640 1 -- 172.21.15.2:0/3551375051 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20ec101420 msgr2=0x7f20ec197830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:21.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:21.866+0000 7f20f19bf640 1 --2- 172.21.15.2:0/3551375051 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20ec101420 0x7f20ec197830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:21.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:21.866+0000 7f20f19bf640 1 -- 172.21.15.2:0/3551375051 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20ec19c2a0 con 0x7f20ec100a80 2024-09-19T04:46:21.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:21.866+0000 7f20f11be640 1 --2- 172.21.15.2:0/3551375051 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20ec101420 0x7f20ec197830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:46:21.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:21.866+0000 7f20f19bf640 1 --2- 172.21.15.2:0/3551375051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20ec100a80 0x7f20ec1972f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f20e8004770 tx=0x7f20e80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:21.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:21.866+0000 7f20e2ffd640 1 -- 172.21.15.2:0/3551375051 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e803f070 con 0x7f20ec100a80 2024-09-19T04:46:21.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:21.866+0000 7f20f3c23640 1 -- 172.21.15.2:0/3551375051 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20ec19c530 con 0x7f20ec100a80 2024-09-19T04:46:21.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:21.866+0000 7f20e2ffd640 1 -- 172.21.15.2:0/3551375051 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f20e803b460 con 0x7f20ec100a80 2024-09-19T04:46:21.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:21.866+0000 7f20e2ffd640 1 -- 172.21.15.2:0/3551375051 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e8035070 con 0x7f20ec100a80 2024-09-19T04:46:21.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:21.866+0000 7f20f3c23640 1 -- 172.21.15.2:0/3551375051 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20ec06a790 con 0x7f20ec100a80 2024-09-19T04:46:21.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:21.867+0000 7f20f3c23640 1 -- 172.21.15.2:0/3551375051 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20ec1021c0 con 0x7f20ec100a80 2024-09-19T04:46:21.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:21.868+0000 7f20e2ffd640 1 -- 172.21.15.2:0/3551375051 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f20e803b610 con 0x7f20ec100a80 2024-09-19T04:46:21.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:21.869+0000 7f20e2ffd640 1 --2- 172.21.15.2:0/3551375051 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f20d80a3240 0x7f20d80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:21.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:21.869+0000 7f20f11be640 1 --2- 172.21.15.2:0/3551375051 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f20d80a3240 0x7f20d80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:21.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:21.870+0000 7f20e2ffd640 1 -- 172.21.15.2:0/3551375051 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7497+0+0 (secure 0 0 0) 0x7f20e80efd90 con 0x7f20ec100a80 2024-09-19T04:46:21.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:21.870+0000 7f20f11be640 1 --2- 172.21.15.2:0/3551375051 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f20d80a3240 0x7f20d80a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f20dc005d00 tx=0x7f20dc009550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:21.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:21.873+0000 7f20e2ffd640 1 -- 172.21.15.2:0/3551375051 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f20e80bcd40 con 0x7f20ec100a80 2024-09-19T04:46:22.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:22.052+0000 7f20f3c23640 1 -- 172.21.15.2:0/3551375051 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f20ec06b1b0 con 0x7f20ec100a80 2024-09-19T04:46:22.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:22.489+0000 7f20e2ffd640 1 -- 172.21.15.2:0/3551375051 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v76) ==== 170+0+0 (secure 0 0 0) 0x7f20e80b8030 con 0x7f20ec100a80 2024-09-19T04:46:22.490 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' created 2024-09-19T04:46:22.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:22.491+0000 7f20f3c23640 1 -- 172.21.15.2:0/3551375051 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f20d80a3240 msgr2=0x7f20d80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:22.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:22.491+0000 7f20f3c23640 1 --2- 172.21.15.2:0/3551375051 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f20d80a3240 0x7f20d80a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f20dc005d00 tx=0x7f20dc009550 comp rx=0 tx=0).stop 2024-09-19T04:46:22.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:22.491+0000 7f20f3c23640 1 -- 172.21.15.2:0/3551375051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20ec100a80 msgr2=0x7f20ec1972f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:22.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:22.491+0000 7f20f3c23640 1 --2- 172.21.15.2:0/3551375051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20ec100a80 0x7f20ec1972f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f20e8004770 tx=0x7f20e80042f0 comp rx=0 tx=0).stop 2024-09-19T04:46:22.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:22.491+0000 7f20f3c23640 1 -- 172.21.15.2:0/3551375051 shutdown_connections 2024-09-19T04:46:22.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:22.491+0000 7f20f3c23640 1 --2- 172.21.15.2:0/3551375051 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f20d80a3240 0x7f20d80a5700 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:22.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:22.491+0000 7f20f3c23640 1 --2- 172.21.15.2:0/3551375051 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f20ec106a80 0x7f20ec19bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:22.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:22.491+0000 7f20f3c23640 1 --2- 172.21.15.2:0/3551375051 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20ec101420 0x7f20ec197830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:22.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:22.491+0000 7f20f3c23640 1 --2- 172.21.15.2:0/3551375051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20ec100a80 0x7f20ec1972f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:22.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:22.491+0000 7f20f3c23640 1 -- 172.21.15.2:0/3551375051 >> 172.21.15.2:0/3551375051 conn(0x7f20ec0fc7a0 msgr2=0x7f20ec0fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:22.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:22.492+0000 7f20f3c23640 1 -- 172.21.15.2:0/3551375051 shutdown_connections 2024-09-19T04:46:22.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:22.492+0000 7f20f3c23640 1 -- 172.21.15.2:0/3551375051 wait complete. 2024-09-19T04:46:22.787 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:22 smithi002 ceph-mon[30975]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T04:46:22.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:22 smithi018 ceph-mon[34537]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T04:46:22.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:22 smithi116 ceph-mon[34477]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T04:46:23.093 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T04:46:23.352 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:46:23.742 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:23 smithi002 ceph-mon[30975]: pgmap v268: 33 pgs: 7 creating+peering, 25 unknown, 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:46:23.742 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:23 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/3551375051' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T04:46:23.742 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:23 smithi002 ceph-mon[30975]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T04:46:23.742 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:23 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/3551375051' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T04:46:23.742 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:23 smithi002 ceph-mon[30975]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T04:46:23.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:23 smithi018 ceph-mon[34537]: pgmap v268: 33 pgs: 7 creating+peering, 25 unknown, 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:46:23.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:23 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/3551375051' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T04:46:23.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:23 smithi018 ceph-mon[34537]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T04:46:23.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:23 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/3551375051' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T04:46:23.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:23 smithi018 ceph-mon[34537]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T04:46:23.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:23.825+0000 7f699e322640 1 -- 172.21.15.2:0/2631172996 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69981055b0 msgr2=0x7f699810d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:23.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:23.825+0000 7f699e322640 1 --2- 172.21.15.2:0/2631172996 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69981055b0 0x7f699810d130 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6990009ca0 tx=0x7f699002a8c0 comp rx=0 tx=0).stop 2024-09-19T04:46:23.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:23.825+0000 7f699e322640 1 -- 172.21.15.2:0/2631172996 shutdown_connections 2024-09-19T04:46:23.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:23.825+0000 7f699e322640 1 --2- 172.21.15.2:0/2631172996 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69981055b0 0x7f699810d130 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:23.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:23.825+0000 7f699e322640 1 --2- 172.21.15.2:0/2631172996 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6998100e30 0x7f6998104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:23.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:23.825+0000 7f699e322640 1 --2- 172.21.15.2:0/2631172996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6998100480 0x7f6998100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:23.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:23.825+0000 7f699e322640 1 -- 172.21.15.2:0/2631172996 >> 172.21.15.2:0/2631172996 conn(0x7f6998077210 msgr2=0x7f69980fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:23.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:23.826+0000 7f699e322640 1 -- 172.21.15.2:0/2631172996 shutdown_connections 2024-09-19T04:46:23.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:23.826+0000 7f699e322640 1 -- 172.21.15.2:0/2631172996 wait complete. 2024-09-19T04:46:23.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:23.826+0000 7f699e322640 1 Processor -- start 2024-09-19T04:46:23.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:23.826+0000 7f699e322640 1 -- start start 2024-09-19T04:46:23.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:23.827+0000 7f699e322640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6998100480 0x7f6998198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:23.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:23.827+0000 7f699e322640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6998100e30 0x7f6998198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:23.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:23.827+0000 7f699e322640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f69981055b0 0x7f699819cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:23.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:23.827+0000 7f699e322640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6998111e60 con 0x7f6998100480 2024-09-19T04:46:23.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:23.827+0000 7f699e322640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6998111ce0 con 0x7f6998100e30 2024-09-19T04:46:23.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:23.827+0000 7f699e322640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f6998111fe0 con 0x7f69981055b0 2024-09-19T04:46:23.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:23.827+0000 7f6997fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6998100480 0x7f6998198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:23.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:23.827+0000 7f6997fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6998100480 0x7f6998198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34620/0 (socket says 172.21.15.2:34620) 2024-09-19T04:46:23.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:23.827+0000 7f6997fff640 1 -- 172.21.15.2:0/4042080112 learned_addr learned my addr 172.21.15.2:0/4042080112 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:46:23.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:23.827+0000 7f69977fe640 1 --2- 172.21.15.2:0/4042080112 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6998100e30 0x7f6998198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:23.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:23.827+0000 7f699c8bf640 1 --2- 172.21.15.2:0/4042080112 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f69981055b0 0x7f699819cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:23.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:23.827+0000 7f6997fff640 1 -- 172.21.15.2:0/4042080112 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f69981055b0 msgr2=0x7f699819cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:23.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:23.827+0000 7f6997fff640 1 --2- 172.21.15.2:0/4042080112 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f69981055b0 0x7f699819cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:23.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:23.827+0000 7f6997fff640 1 -- 172.21.15.2:0/4042080112 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6998100e30 msgr2=0x7f6998198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:23.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:23.827+0000 7f6997fff640 1 --2- 172.21.15.2:0/4042080112 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6998100e30 0x7f6998198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:23.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:23.827+0000 7f6997fff640 1 -- 172.21.15.2:0/4042080112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f699819d2b0 con 0x7f6998100480 2024-09-19T04:46:23.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:23.827+0000 7f69977fe640 1 --2- 172.21.15.2:0/4042080112 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6998100e30 0x7f6998198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:46:23.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:23.827+0000 7f6997fff640 1 --2- 172.21.15.2:0/4042080112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6998100480 0x7f6998198300 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f698800c920 tx=0x7f698800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:23.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:23.827+0000 7f69957fa640 1 -- 172.21.15.2:0/4042080112 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6988007c70 con 0x7f6998100480 2024-09-19T04:46:23.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:23.828+0000 7f69957fa640 1 -- 172.21.15.2:0/4042080112 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6988007e10 con 0x7f6998100480 2024-09-19T04:46:23.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:23.828+0000 7f699e322640 1 -- 172.21.15.2:0/4042080112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f699819d5a0 con 0x7f6998100480 2024-09-19T04:46:23.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:23.828+0000 7f69957fa640 1 -- 172.21.15.2:0/4042080112 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6988018820 con 0x7f6998100480 2024-09-19T04:46:23.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:23.828+0000 7f699e322640 1 -- 172.21.15.2:0/4042080112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f699810e780 con 0x7f6998100480 2024-09-19T04:46:23.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:23.829+0000 7f699e322640 1 -- 172.21.15.2:0/4042080112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6998100860 con 0x7f6998100480 2024-09-19T04:46:23.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:23.830+0000 7f69957fa640 1 -- 172.21.15.2:0/4042080112 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f69880189c0 con 0x7f6998100480 2024-09-19T04:46:23.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:23.831+0000 7f69957fa640 1 --2- 172.21.15.2:0/4042080112 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f69800a32c0 0x7f69800a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:23.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:23.831+0000 7f69977fe640 1 --2- 172.21.15.2:0/4042080112 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f69800a32c0 0x7f69800a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:23.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:23.831+0000 7f69957fa640 1 -- 172.21.15.2:0/4042080112 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7879+0+0 (secure 0 0 0) 0x7f69880cfb60 con 0x7f6998100480 2024-09-19T04:46:23.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:23.831+0000 7f69977fe640 1 --2- 172.21.15.2:0/4042080112 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f69800a32c0 0x7f69800a5780 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6998102e20 tx=0x7f698c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:23.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:23.834+0000 7f69957fa640 1 -- 172.21.15.2:0/4042080112 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6988014030 con 0x7f6998100480 2024-09-19T04:46:23.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:23 smithi116 ceph-mon[34477]: pgmap v268: 33 pgs: 7 creating+peering, 25 unknown, 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:46:23.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:23 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/3551375051' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T04:46:23.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:23 smithi116 ceph-mon[34477]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T04:46:23.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:23 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/3551375051' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T04:46:23.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:23 smithi116 ceph-mon[34477]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T04:46:24.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:24.048+0000 7f699e322640 1 -- 172.21.15.2:0/4042080112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f6998199660 con 0x7f6998100480 2024-09-19T04:46:24.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:24.501+0000 7f69957fa640 1 -- 172.21.15.2:0/4042080112 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f698809cb40 con 0x7f6998100480 2024-09-19T04:46:24.503 INFO:teuthology.orchestra.run.smithi002.stderr:new fs with metadata pool 2 and data pool 3 2024-09-19T04:46:24.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:24.504+0000 7f699e322640 1 -- 172.21.15.2:0/4042080112 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f69800a32c0 msgr2=0x7f69800a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:24.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:24.504+0000 7f699e322640 1 --2- 172.21.15.2:0/4042080112 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f69800a32c0 0x7f69800a5780 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6998102e20 tx=0x7f698c008040 comp rx=0 tx=0).stop 2024-09-19T04:46:24.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:24.504+0000 7f699e322640 1 -- 172.21.15.2:0/4042080112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6998100480 msgr2=0x7f6998198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:24.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:24.504+0000 7f699e322640 1 --2- 172.21.15.2:0/4042080112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6998100480 0x7f6998198300 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f698800c920 tx=0x7f698800cde0 comp rx=0 tx=0).stop 2024-09-19T04:46:24.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:24.504+0000 7f699e322640 1 -- 172.21.15.2:0/4042080112 shutdown_connections 2024-09-19T04:46:24.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:24.504+0000 7f699e322640 1 --2- 172.21.15.2:0/4042080112 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f69800a32c0 0x7f69800a5780 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:24.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:24.504+0000 7f699e322640 1 --2- 172.21.15.2:0/4042080112 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f69981055b0 0x7f699819cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:24.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:24.504+0000 7f699e322640 1 --2- 172.21.15.2:0/4042080112 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6998100e30 0x7f6998198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:24.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:24.504+0000 7f699e322640 1 --2- 172.21.15.2:0/4042080112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6998100480 0x7f6998198300 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:24.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:24.504+0000 7f699e322640 1 -- 172.21.15.2:0/4042080112 >> 172.21.15.2:0/4042080112 conn(0x7f6998077210 msgr2=0x7f6998103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:24.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:24.504+0000 7f699e322640 1 -- 172.21.15.2:0/4042080112 shutdown_connections 2024-09-19T04:46:24.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:24.505+0000 7f699e322640 1 -- 172.21.15.2:0/4042080112 wait complete. 2024-09-19T04:46:24.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:24 smithi018 ceph-mon[34537]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T04:46:24.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:24 smithi018 ceph-mon[34537]: pgmap v271: 97 pgs: 7 creating+peering, 89 unknown, 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:46:24.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:24 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/4042080112' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T04:46:24.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:24 smithi018 ceph-mon[34537]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-19T04:46:24.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:24 smithi002 ceph-mon[30975]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T04:46:24.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:24 smithi002 ceph-mon[30975]: pgmap v271: 97 pgs: 7 creating+peering, 89 unknown, 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:46:24.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:24 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/4042080112' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T04:46:24.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:24 smithi002 ceph-mon[30975]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-19T04:46:24.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:24 smithi116 ceph-mon[34477]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T04:46:24.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:24 smithi116 ceph-mon[34477]: pgmap v271: 97 pgs: 7 creating+peering, 89 unknown, 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:46:24.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:24 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/4042080112' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T04:46:24.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:24 smithi116 ceph-mon[34477]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-19T04:46:25.173 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T04:46:25.438 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:46:25.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:25 smithi018 ceph-mon[34537]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T04:46:25.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:25 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/4042080112' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T04:46:25.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:25 smithi018 ceph-mon[34537]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-19T04:46:25.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:25 smithi018 ceph-mon[34537]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-19T04:46:25.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:25 smithi018 ceph-mon[34537]: mds.? [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] up:active 2024-09-19T04:46:25.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:25 smithi018 ceph-mon[34537]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T04:46:25.824 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:25 smithi002 ceph-mon[30975]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T04:46:25.824 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:25 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/4042080112' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T04:46:25.824 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:25 smithi002 ceph-mon[30975]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-19T04:46:25.824 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:25 smithi002 ceph-mon[30975]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-19T04:46:25.824 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:25 smithi002 ceph-mon[30975]: mds.? [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] up:active 2024-09-19T04:46:25.825 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:25 smithi002 ceph-mon[30975]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T04:46:25.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:25 smithi116 ceph-mon[34477]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T04:46:25.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:25 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/4042080112' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T04:46:25.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:25 smithi116 ceph-mon[34477]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-19T04:46:25.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:25 smithi116 ceph-mon[34477]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-19T04:46:25.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:25 smithi116 ceph-mon[34477]: mds.? [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] up:active 2024-09-19T04:46:25.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:25 smithi116 ceph-mon[34477]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T04:46:25.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:25.906+0000 7ff1b21c4640 1 -- 172.21.15.2:0/481301176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1ac1027a0 msgr2=0x7ff1ac1067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:25.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:25.906+0000 7ff1b21c4640 1 --2- 172.21.15.2:0/481301176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1ac1027a0 0x7ff1ac1067f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0009900 tx=0x7ff1a002a410 comp rx=0 tx=0).stop 2024-09-19T04:46:25.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:25.906+0000 7ff1b21c4640 1 -- 172.21.15.2:0/481301176 shutdown_connections 2024-09-19T04:46:25.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:25.906+0000 7ff1b21c4640 1 --2- 172.21.15.2:0/481301176 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff1ac106f20 0x7ff1ac10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:25.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:25.906+0000 7ff1b21c4640 1 --2- 172.21.15.2:0/481301176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1ac1027a0 0x7ff1ac1067f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:25.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:25.906+0000 7ff1b21c4640 1 --2- 172.21.15.2:0/481301176 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1ac101df0 0x7ff1ac1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:25.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:25.906+0000 7ff1b21c4640 1 -- 172.21.15.2:0/481301176 >> 172.21.15.2:0/481301176 conn(0x7ff1ac0fd8f0 msgr2=0x7ff1ac0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:25.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:25.906+0000 7ff1b21c4640 1 -- 172.21.15.2:0/481301176 shutdown_connections 2024-09-19T04:46:25.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:25.906+0000 7ff1b21c4640 1 -- 172.21.15.2:0/481301176 wait complete. 2024-09-19T04:46:25.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:25.907+0000 7ff1b21c4640 1 Processor -- start 2024-09-19T04:46:25.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:25.907+0000 7ff1b21c4640 1 -- start start 2024-09-19T04:46:25.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:25.907+0000 7ff1b21c4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1ac101df0 0x7ff1ac0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:25.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:25.907+0000 7ff1b21c4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1ac1027a0 0x7ff1ac074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:25.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:25.907+0000 7ff1b21c4640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff1ac106f20 0x7ff1ac074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:25.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:25.907+0000 7ff1b21c4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff1ac111ed0 con 0x7ff1ac101df0 2024-09-19T04:46:25.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:25.907+0000 7ff1b21c4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff1ac111d50 con 0x7ff1ac1027a0 2024-09-19T04:46:25.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:25.907+0000 7ff1b21c4640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7ff1ac112050 con 0x7ff1ac106f20 2024-09-19T04:46:25.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:25.907+0000 7ff1ab7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1ac101df0 0x7ff1ac0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:25.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:25.907+0000 7ff1ab7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1ac101df0 0x7ff1ac0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34630/0 (socket says 172.21.15.2:34630) 2024-09-19T04:46:25.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:25.907+0000 7ff1ab7fe640 1 -- 172.21.15.2:0/1258111635 learned_addr learned my addr 172.21.15.2:0/1258111635 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:46:25.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:25.908+0000 7ff1aaffd640 1 --2- 172.21.15.2:0/1258111635 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1ac1027a0 0x7ff1ac074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:25.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:25.908+0000 7ff1abfff640 1 --2- 172.21.15.2:0/1258111635 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff1ac106f20 0x7ff1ac074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:25.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:25.908+0000 7ff1ab7fe640 1 -- 172.21.15.2:0/1258111635 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff1ac106f20 msgr2=0x7ff1ac074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:25.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:25.908+0000 7ff1ab7fe640 1 --2- 172.21.15.2:0/1258111635 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff1ac106f20 0x7ff1ac074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:25.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:25.908+0000 7ff1ab7fe640 1 -- 172.21.15.2:0/1258111635 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1ac1027a0 msgr2=0x7ff1ac074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:25.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:25.908+0000 7ff1ab7fe640 1 --2- 172.21.15.2:0/1258111635 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1ac1027a0 0x7ff1ac074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:25.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:25.908+0000 7ff1ab7fe640 1 -- 172.21.15.2:0/1258111635 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1ac1a69e0 con 0x7ff1ac101df0 2024-09-19T04:46:25.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:25.908+0000 7ff1ab7fe640 1 --2- 172.21.15.2:0/1258111635 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1ac101df0 0x7ff1ac0744f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff19c00b4a0 tx=0x7ff19c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:25.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:25.908+0000 7ff1a8ff9640 1 -- 172.21.15.2:0/1258111635 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff19c014070 con 0x7ff1ac101df0 2024-09-19T04:46:25.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:25.908+0000 7ff1b21c4640 1 -- 172.21.15.2:0/1258111635 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1ac1a6cd0 con 0x7ff1ac101df0 2024-09-19T04:46:25.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:25.908+0000 7ff1a8ff9640 1 -- 172.21.15.2:0/1258111635 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff19c010ac0 con 0x7ff1ac101df0 2024-09-19T04:46:25.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:25.908+0000 7ff1a8ff9640 1 -- 172.21.15.2:0/1258111635 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff19c017c30 con 0x7ff1ac101df0 2024-09-19T04:46:25.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:25.908+0000 7ff1b21c4640 1 -- 172.21.15.2:0/1258111635 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1ac1a71d0 con 0x7ff1ac101df0 2024-09-19T04:46:25.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:25.909+0000 7ff1b21c4640 1 -- 172.21.15.2:0/1258111635 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1ac102250 con 0x7ff1ac101df0 2024-09-19T04:46:25.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:25.910+0000 7ff1a8ff9640 1 -- 172.21.15.2:0/1258111635 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7ff19c017070 con 0x7ff1ac101df0 2024-09-19T04:46:25.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:25.911+0000 7ff1a8ff9640 1 --2- 172.21.15.2:0/1258111635 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7ff1940a3240 0x7ff1940a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:25.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:25.911+0000 7ff1aaffd640 1 --2- 172.21.15.2:0/1258111635 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7ff1940a3240 0x7ff1940a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:25.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:25.911+0000 7ff1a8ff9640 1 -- 172.21.15.2:0/1258111635 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7ff19c0cef30 con 0x7ff1ac101df0 2024-09-19T04:46:25.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:25.912+0000 7ff1aaffd640 1 --2- 172.21.15.2:0/1258111635 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7ff1940a3240 0x7ff1940a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0031440 tx=0x7ff1a00095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:25.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:25.915+0000 7ff1a8ff9640 1 -- 172.21.15.2:0/1258111635 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff19c09bda0 con 0x7ff1ac101df0 2024-09-19T04:46:26.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:26.092+0000 7ff1b21c4640 1 -- 172.21.15.2:0/1258111635 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff1ac109b70 con 0x7ff1ac101df0 2024-09-19T04:46:26.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:26.094+0000 7ff1a8ff9640 1 -- 172.21.15.2:0/1258111635 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+22161 (secure 0 0 0) 0x7ff19c09b6a0 con 0x7ff1ac101df0 2024-09-19T04:46:26.096 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:46:26.096 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":78,"fsid":"d46630c4-7640-11ef-bceb-c7b262605968","created":"2024-09-19T04:38:39.698488+0000","modified":"2024-09-19T04:46:24.049836+0000","last_up_change":"2024-09-19T04:45:33.839647+0000","last_in_change":"2024-09-19T04:45:09.816808+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T04:41:51.960734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T04:46:20.031485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T04:46:22.484767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7a7dc9b9-8d5d-4dd3-93a3-0d5efced07d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":611702745},{"type":"v1","addr":"172.21.15.2:6803","nonce":611702745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":611702745},{"type":"v1","addr":"172.21.15.2:6805","nonce":611702745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":611702745},{"type":"v1","addr":"172.21.15.2:6809","nonce":611702745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":611702745},{"type":"v1","addr":"172.21.15.2:6807","nonce":611702745}]},"public_addr":"172.21.15.2:6803/611702745","cluster_addr":"172.21.15.2:6805/611702745","heartbeat_back_addr":"172.21.15.2:6809/611702745","heartbeat_front_addr":"172.21.15.2:6807/611702745","state":["exists","up"]},{"osd":1,"uuid":"bea40dec-7d9c-497f-bf16-4bf6d3b839f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":58390709},{"type":"v1","addr":"172.21.15.18:6801","nonce":58390709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":58390709},{"type":"v1","addr":"172.21.15.18:6803","nonce":58390709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":58390709},{"type":"v1","addr":"172.21.15.18:6807","nonce":58390709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":58390709},{"type":"v1","addr":"172.21.15.18:6805","nonce":58390709}]},"public_addr":"172.21.15.18:6801/58390709","cluster_addr":"172.21.15.18:6803/58390709","heartbeat_back_addr":"172.21.15.18:6807/58390709","heartbeat_front_addr":"172.21.15.18:6805/58390709","state":["exists","up"]},{"osd":2,"uuid":"97716304-a31e-48c9-83de-84eed10a7a4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":627735759},{"type":"v1","addr":"172.21.15.116:6801","nonce":627735759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":627735759},{"type":"v1","addr":"172.21.15.116:6803","nonce":627735759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":627735759},{"type":"v1","addr":"172.21.15.116:6807","nonce":627735759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":627735759},{"type":"v1","addr":"172.21.15.116:6805","nonce":627735759}]},"public_addr":"172.21.15.116:6801/627735759","cluster_addr":"172.21.15.116:6803/627735759","heartbeat_back_addr":"172.21.15.116:6807/627735759","heartbeat_front_addr":"172.21.15.116:6805/627735759","state":["exists","up"]},{"osd":3,"uuid":"8d79514e-16cf-4bd0-a2eb-e9148b91183d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1936071687},{"type":"v1","addr":"172.21.15.2:6811","nonce":1936071687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1936071687},{"type":"v1","addr":"172.21.15.2:6813","nonce":1936071687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1936071687},{"type":"v1","addr":"172.21.15.2:6817","nonce":1936071687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1936071687},{"type":"v1","addr":"172.21.15.2:6815","nonce":1936071687}]},"public_addr":"172.21.15.2:6811/1936071687","cluster_addr":"172.21.15.2:6813/1936071687","heartbeat_back_addr":"172.21.15.2:6817/1936071687","heartbeat_front_addr":"172.21.15.2:6815/1936071687","state":["exists","up"]},{"osd":4,"uuid":"5136f03c-94a3-42a0-9bfc-020397836037","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1333533784},{"type":"v1","addr":"172.21.15.18:6809","nonce":1333533784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1333533784},{"type":"v1","addr":"172.21.15.18:6811","nonce":1333533784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1333533784},{"type":"v1","addr":"172.21.15.18:6815","nonce":1333533784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1333533784},{"type":"v1","addr":"172.21.15.18:6813","nonce":1333533784}]},"public_addr":"172.21.15.18:6809/1333533784","cluster_addr":"172.21.15.18:6811/1333533784","heartbeat_back_addr":"172.21.15.18:6815/1333533784","heartbeat_front_addr":"172.21.15.18:6813/1333533784","state":["exists","up"]},{"osd":5,"uuid":"9d3384b0-f87d-4513-b151-4cca21c339b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":316360741},{"type":"v1","addr":"172.21.15.116:6809","nonce":316360741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":316360741},{"type":"v1","addr":"172.21.15.116:6811","nonce":316360741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":316360741},{"type":"v1","addr":"172.21.15.116:6815","nonce":316360741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":316360741},{"type":"v1","addr":"172.21.15.116:6813","nonce":316360741}]},"public_addr":"172.21.15.116:6809/316360741","cluster_addr":"172.21.15.116:6811/316360741","heartbeat_back_addr":"172.21.15.116:6815/316360741","heartbeat_front_addr":"172.21.15.116:6813/316360741","state":["exists","up"]},{"osd":6,"uuid":"e54f44b5-a693-4b31-83b2-2bcf10ab9a75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1185564560},{"type":"v1","addr":"172.21.15.2:6819","nonce":1185564560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1185564560},{"type":"v1","addr":"172.21.15.2:6821","nonce":1185564560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1185564560},{"type":"v1","addr":"172.21.15.2:6825","nonce":1185564560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":1185564560},{"type":"v1","addr":"172.21.15.2:6823","nonce":1185564560}]},"public_addr":"172.21.15.2:6819/1185564560","cluster_addr":"172.21.15.2:6821/1185564560","heartbeat_back_addr":"172.21.15.2:6825/1185564560","heartbeat_front_addr":"172.21.15.2:6823/1185564560","state":["exists","up"]},{"osd":7,"uuid":"96a444c3-429a-48b6-9823-95c9e171341a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3691801363},{"type":"v1","addr":"172.21.15.18:6817","nonce":3691801363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3691801363},{"type":"v1","addr":"172.21.15.18:6819","nonce":3691801363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3691801363},{"type":"v1","addr":"172.21.15.18:6823","nonce":3691801363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3691801363},{"type":"v1","addr":"172.21.15.18:6821","nonce":3691801363}]},"public_addr":"172.21.15.18:6817/3691801363","cluster_addr":"172.21.15.18:6819/3691801363","heartbeat_back_addr":"172.21.15.18:6823/3691801363","heartbeat_front_addr":"172.21.15.18:6821/3691801363","state":["exists","up"]},{"osd":8,"uuid":"c3f696aa-be7d-4f67-9147-3751406e394d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":3709586119},{"type":"v1","addr":"172.21.15.116:6817","nonce":3709586119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":3709586119},{"type":"v1","addr":"172.21.15.116:6819","nonce":3709586119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":3709586119},{"type":"v1","addr":"172.21.15.116:6823","nonce":3709586119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":3709586119},{"type":"v1","addr":"172.21.15.116:6821","nonce":3709586119}]},"public_addr":"172.21.15.116:6817/3709586119","cluster_addr":"172.21.15.116:6819/3709586119","heartbeat_back_addr":"172.21.15.116:6823/3709586119","heartbeat_front_addr":"172.21.15.116:6821/3709586119","state":["exists","up"]},{"osd":9,"uuid":"4892549d-f050-48c5-b695-5924b612a581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1054791011},{"type":"v1","addr":"172.21.15.2:6827","nonce":1054791011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1054791011},{"type":"v1","addr":"172.21.15.2:6829","nonce":1054791011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1054791011},{"type":"v1","addr":"172.21.15.2:6833","nonce":1054791011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":1054791011},{"type":"v1","addr":"172.21.15.2:6831","nonce":1054791011}]},"public_addr":"172.21.15.2:6827/1054791011","cluster_addr":"172.21.15.2:6829/1054791011","heartbeat_back_addr":"172.21.15.2:6833/1054791011","heartbeat_front_addr":"172.21.15.2:6831/1054791011","state":["exists","up"]},{"osd":10,"uuid":"12b60238-6a35-4d48-bacd-ee5ddd8fdb0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1958683776},{"type":"v1","addr":"172.21.15.18:6825","nonce":1958683776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":1958683776},{"type":"v1","addr":"172.21.15.18:6827","nonce":1958683776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":1958683776},{"type":"v1","addr":"172.21.15.18:6831","nonce":1958683776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":1958683776},{"type":"v1","addr":"172.21.15.18:6829","nonce":1958683776}]},"public_addr":"172.21.15.18:6825/1958683776","cluster_addr":"172.21.15.18:6827/1958683776","heartbeat_back_addr":"172.21.15.18:6831/1958683776","heartbeat_front_addr":"172.21.15.18:6829/1958683776","state":["exists","up"]},{"osd":11,"uuid":"99b3e553-b42c-4b2f-817f-3900ad8bd223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3456789654},{"type":"v1","addr":"172.21.15.116:6825","nonce":3456789654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3456789654},{"type":"v1","addr":"172.21.15.116:6827","nonce":3456789654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3456789654},{"type":"v1","addr":"172.21.15.116:6831","nonce":3456789654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3456789654},{"type":"v1","addr":"172.21.15.116:6829","nonce":3456789654}]},"public_addr":"172.21.15.116:6825/3456789654","cluster_addr":"172.21.15.116:6827/3456789654","heartbeat_back_addr":"172.21.15.116:6831/3456789654","heartbeat_front_addr":"172.21.15.116:6829/3456789654","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:40:58.216702+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:41:22.852350+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:41:47.265084+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:42:12.785128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:42:38.475008+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:43:02.924009+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:43:28.050646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:43:52.715369+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:44:16.905066+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:44:42.071128+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:45:06.434525+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:45:31.569086+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/870383845":"2024-09-20T04:39:35.461329+0000","172.21.15.2:0/2801870985":"2024-09-20T04:39:35.461329+0000","172.21.15.2:0/256825166":"2024-09-20T04:39:35.461329+0000","172.21.15.2:6801/3782987318":"2024-09-20T04:39:35.461329+0000","172.21.15.2:0/3064319092":"2024-09-20T04:39:11.086431+0000","172.21.15.2:0/1528097642":"2024-09-20T04:39:11.086431+0000","172.21.15.2:6801/1825825090":"2024-09-20T04:39:11.086431+0000","172.21.15.2:6800/1825825090":"2024-09-20T04:39:11.086431+0000","172.21.15.2:6800/3782987318":"2024-09-20T04:39:35.461329+0000","172.21.15.2:0/2432243496":"2024-09-20T04:39:11.086431+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T04:46:26.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:26.096+0000 7ff1b21c4640 1 -- 172.21.15.2:0/1258111635 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7ff1940a3240 msgr2=0x7ff1940a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:26.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:26.096+0000 7ff1b21c4640 1 --2- 172.21.15.2:0/1258111635 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7ff1940a3240 0x7ff1940a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0031440 tx=0x7ff1a00095f0 comp rx=0 tx=0).stop 2024-09-19T04:46:26.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:26.096+0000 7ff1b21c4640 1 -- 172.21.15.2:0/1258111635 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1ac101df0 msgr2=0x7ff1ac0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:26.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:26.096+0000 7ff1b21c4640 1 --2- 172.21.15.2:0/1258111635 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1ac101df0 0x7ff1ac0744f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff19c00b4a0 tx=0x7ff19c00b960 comp rx=0 tx=0).stop 2024-09-19T04:46:26.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:26.096+0000 7ff1b21c4640 1 -- 172.21.15.2:0/1258111635 shutdown_connections 2024-09-19T04:46:26.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:26.096+0000 7ff1b21c4640 1 --2- 172.21.15.2:0/1258111635 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7ff1940a3240 0x7ff1940a5700 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:26.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:26.096+0000 7ff1b21c4640 1 --2- 172.21.15.2:0/1258111635 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff1ac106f20 0x7ff1ac074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:26.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:26.096+0000 7ff1b21c4640 1 --2- 172.21.15.2:0/1258111635 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1ac1027a0 0x7ff1ac074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:26.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:26.096+0000 7ff1b21c4640 1 --2- 172.21.15.2:0/1258111635 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1ac101df0 0x7ff1ac0744f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:26.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:26.097+0000 7ff1b21c4640 1 -- 172.21.15.2:0/1258111635 >> 172.21.15.2:0/1258111635 conn(0x7ff1ac0fd8f0 msgr2=0x7ff1ac0fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:26.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:26.097+0000 7ff1b21c4640 1 -- 172.21.15.2:0/1258111635 shutdown_connections 2024-09-19T04:46:26.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:26.097+0000 7ff1b21c4640 1 -- 172.21.15.2:0/1258111635 wait complete. 2024-09-19T04:46:26.510 INFO:journalctl@ceph.mds.i.smithi116.stdout:Sep 19 04:46:26 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-i[64913]: 2024-09-19T04:46:26.227+0000 7fe48fb2b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T04:46:26.669 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:26 smithi002 ceph-mon[30975]: pgmap v273: 97 pgs: 7 creating+peering, 14 unknown, 76 active+clean; 577 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 1 op/s 2024-09-19T04:46:26.669 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:26 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/1258111635' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:46:26.699 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T04:46:26.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:26 smithi018 ceph-mon[34537]: pgmap v273: 97 pgs: 7 creating+peering, 14 unknown, 76 active+clean; 577 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 1 op/s 2024-09-19T04:46:26.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:26 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/1258111635' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:46:26.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:26 smithi116 ceph-mon[34477]: pgmap v273: 97 pgs: 7 creating+peering, 14 unknown, 76 active+clean; 577 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 1 op/s 2024-09-19T04:46:26.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:26 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/1258111635' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:46:26.955 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:46:27.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.428+0000 7f24bd325640 1 -- 172.21.15.2:0/3549940898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24b8102ef0 msgr2=0x7f24b810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:27.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.428+0000 7f24bd325640 1 --2- 172.21.15.2:0/3549940898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24b8102ef0 0x7f24b810da40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f24b0009ca0 tx=0x7f24b002a950 comp rx=0 tx=0).stop 2024-09-19T04:46:27.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.428+0000 7f24bd325640 1 -- 172.21.15.2:0/3549940898 shutdown_connections 2024-09-19T04:46:27.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.428+0000 7f24bd325640 1 --2- 172.21.15.2:0/3549940898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24b8102ef0 0x7f24b810da40 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:27.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.428+0000 7f24bd325640 1 --2- 172.21.15.2:0/3549940898 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24b8102570 0x7f24b81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:27.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.428+0000 7f24bd325640 1 --2- 172.21.15.2:0/3549940898 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24b8100e20 0x7f24b8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:27.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.428+0000 7f24bd325640 1 -- 172.21.15.2:0/3549940898 >> 172.21.15.2:0/3549940898 conn(0x7f24b80fc7d0 msgr2=0x7f24b80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:27.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.428+0000 7f24bd325640 1 -- 172.21.15.2:0/3549940898 shutdown_connections 2024-09-19T04:46:27.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.428+0000 7f24bd325640 1 -- 172.21.15.2:0/3549940898 wait complete. 2024-09-19T04:46:27.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.428+0000 7f24bd325640 1 Processor -- start 2024-09-19T04:46:27.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.429+0000 7f24bd325640 1 -- start start 2024-09-19T04:46:27.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.429+0000 7f24bd325640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24b8100e20 0x7f24b81983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:27.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.429+0000 7f24bd325640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24b8102570 0x7f24b8198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:27.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.429+0000 7f24bd325640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24b8102ef0 0x7f24b819ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:27.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.429+0000 7f24bd325640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f24b8110e50 con 0x7f24b8102ef0 2024-09-19T04:46:27.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.429+0000 7f24bd325640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f24b8110cd0 con 0x7f24b8102570 2024-09-19T04:46:27.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.429+0000 7f24bd325640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f24b8110fd0 con 0x7f24b8100e20 2024-09-19T04:46:27.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.429+0000 7f24b77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24b8102ef0 0x7f24b819ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:27.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.429+0000 7f24b77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24b8102ef0 0x7f24b819ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34650/0 (socket says 172.21.15.2:34650) 2024-09-19T04:46:27.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.429+0000 7f24b77fe640 1 -- 172.21.15.2:0/4164726111 learned_addr learned my addr 172.21.15.2:0/4164726111 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:46:27.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.429+0000 7f24b67fc640 1 --2- 172.21.15.2:0/4164726111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24b8102570 0x7f24b8198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:27.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.429+0000 7f24b77fe640 1 -- 172.21.15.2:0/4164726111 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24b8100e20 msgr2=0x7f24b81983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:27.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.429+0000 7f24b6ffd640 1 --2- 172.21.15.2:0/4164726111 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24b8100e20 0x7f24b81983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:27.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.429+0000 7f24b77fe640 1 --2- 172.21.15.2:0/4164726111 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24b8100e20 0x7f24b81983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:27.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.429+0000 7f24b77fe640 1 -- 172.21.15.2:0/4164726111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24b8102570 msgr2=0x7f24b8198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:27.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.429+0000 7f24b77fe640 1 --2- 172.21.15.2:0/4164726111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24b8102570 0x7f24b8198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:27.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.429+0000 7f24b77fe640 1 -- 172.21.15.2:0/4164726111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24b819d3a0 con 0x7f24b8102ef0 2024-09-19T04:46:27.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.429+0000 7f24b67fc640 1 --2- 172.21.15.2:0/4164726111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24b8102570 0x7f24b8198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:46:27.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.429+0000 7f24b77fe640 1 --2- 172.21.15.2:0/4164726111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24b8102ef0 0x7f24b819ccc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f24b002ae70 tx=0x7f24b002f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:27.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.430+0000 7f249ffff640 1 -- 172.21.15.2:0/4164726111 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b0034040 con 0x7f24b8102ef0 2024-09-19T04:46:27.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.430+0000 7f24bd325640 1 -- 172.21.15.2:0/4164726111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24b819d630 con 0x7f24b8102ef0 2024-09-19T04:46:27.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.430+0000 7f249ffff640 1 -- 172.21.15.2:0/4164726111 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f24b00308f0 con 0x7f24b8102ef0 2024-09-19T04:46:27.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.430+0000 7f249ffff640 1 -- 172.21.15.2:0/4164726111 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b0004780 con 0x7f24b8102ef0 2024-09-19T04:46:27.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.430+0000 7f24bd325640 1 -- 172.21.15.2:0/4164726111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24b81a4f70 con 0x7f24b8102ef0 2024-09-19T04:46:27.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.431+0000 7f24bd325640 1 -- 172.21.15.2:0/4164726111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24b8101200 con 0x7f24b8102ef0 2024-09-19T04:46:27.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.432+0000 7f249ffff640 1 -- 172.21.15.2:0/4164726111 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f24b0037020 con 0x7f24b8102ef0 2024-09-19T04:46:27.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.433+0000 7f249ffff640 1 --2- 172.21.15.2:0/4164726111 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f24a00a32c0 0x7f24a00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:27.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.433+0000 7f24b6ffd640 1 --2- 172.21.15.2:0/4164726111 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f24a00a32c0 0x7f24a00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:27.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.433+0000 7f249ffff640 1 -- 172.21.15.2:0/4164726111 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f24b00f0980 con 0x7f24b8102ef0 2024-09-19T04:46:27.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.433+0000 7f24b6ffd640 1 --2- 172.21.15.2:0/4164726111 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f24a00a32c0 0x7f24a00a5780 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f24a800a810 tx=0x7f24a8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:27.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.437+0000 7f249ffff640 1 -- 172.21.15.2:0/4164726111 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f24b00bd750 con 0x7f24b8102ef0 2024-09-19T04:46:27.613 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:27 smithi002 ceph-mon[30975]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T04:46:27.613 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:27 smithi002 ceph-mon[30975]: Cluster is now healthy 2024-09-19T04:46:27.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.617+0000 7f24bd325640 1 -- 172.21.15.2:0/4164726111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f24b810a0a0 con 0x7f24b8102ef0 2024-09-19T04:46:27.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.618+0000 7f249ffff640 1 -- 172.21.15.2:0/4164726111 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+22161 (secure 0 0 0) 0x7f24b00bd050 con 0x7f24b8102ef0 2024-09-19T04:46:27.620 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:46:27.620 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":78,"fsid":"d46630c4-7640-11ef-bceb-c7b262605968","created":"2024-09-19T04:38:39.698488+0000","modified":"2024-09-19T04:46:24.049836+0000","last_up_change":"2024-09-19T04:45:33.839647+0000","last_in_change":"2024-09-19T04:45:09.816808+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T04:41:51.960734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T04:46:20.031485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T04:46:22.484767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7a7dc9b9-8d5d-4dd3-93a3-0d5efced07d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":611702745},{"type":"v1","addr":"172.21.15.2:6803","nonce":611702745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":611702745},{"type":"v1","addr":"172.21.15.2:6805","nonce":611702745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":611702745},{"type":"v1","addr":"172.21.15.2:6809","nonce":611702745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":611702745},{"type":"v1","addr":"172.21.15.2:6807","nonce":611702745}]},"public_addr":"172.21.15.2:6803/611702745","cluster_addr":"172.21.15.2:6805/611702745","heartbeat_back_addr":"172.21.15.2:6809/611702745","heartbeat_front_addr":"172.21.15.2:6807/611702745","state":["exists","up"]},{"osd":1,"uuid":"bea40dec-7d9c-497f-bf16-4bf6d3b839f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":58390709},{"type":"v1","addr":"172.21.15.18:6801","nonce":58390709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":58390709},{"type":"v1","addr":"172.21.15.18:6803","nonce":58390709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":58390709},{"type":"v1","addr":"172.21.15.18:6807","nonce":58390709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":58390709},{"type":"v1","addr":"172.21.15.18:6805","nonce":58390709}]},"public_addr":"172.21.15.18:6801/58390709","cluster_addr":"172.21.15.18:6803/58390709","heartbeat_back_addr":"172.21.15.18:6807/58390709","heartbeat_front_addr":"172.21.15.18:6805/58390709","state":["exists","up"]},{"osd":2,"uuid":"97716304-a31e-48c9-83de-84eed10a7a4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":627735759},{"type":"v1","addr":"172.21.15.116:6801","nonce":627735759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":627735759},{"type":"v1","addr":"172.21.15.116:6803","nonce":627735759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":627735759},{"type":"v1","addr":"172.21.15.116:6807","nonce":627735759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":627735759},{"type":"v1","addr":"172.21.15.116:6805","nonce":627735759}]},"public_addr":"172.21.15.116:6801/627735759","cluster_addr":"172.21.15.116:6803/627735759","heartbeat_back_addr":"172.21.15.116:6807/627735759","heartbeat_front_addr":"172.21.15.116:6805/627735759","state":["exists","up"]},{"osd":3,"uuid":"8d79514e-16cf-4bd0-a2eb-e9148b91183d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1936071687},{"type":"v1","addr":"172.21.15.2:6811","nonce":1936071687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1936071687},{"type":"v1","addr":"172.21.15.2:6813","nonce":1936071687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1936071687},{"type":"v1","addr":"172.21.15.2:6817","nonce":1936071687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1936071687},{"type":"v1","addr":"172.21.15.2:6815","nonce":1936071687}]},"public_addr":"172.21.15.2:6811/1936071687","cluster_addr":"172.21.15.2:6813/1936071687","heartbeat_back_addr":"172.21.15.2:6817/1936071687","heartbeat_front_addr":"172.21.15.2:6815/1936071687","state":["exists","up"]},{"osd":4,"uuid":"5136f03c-94a3-42a0-9bfc-020397836037","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1333533784},{"type":"v1","addr":"172.21.15.18:6809","nonce":1333533784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1333533784},{"type":"v1","addr":"172.21.15.18:6811","nonce":1333533784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1333533784},{"type":"v1","addr":"172.21.15.18:6815","nonce":1333533784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1333533784},{"type":"v1","addr":"172.21.15.18:6813","nonce":1333533784}]},"public_addr":"172.21.15.18:6809/1333533784","cluster_addr":"172.21.15.18:6811/1333533784","heartbeat_back_addr":"172.21.15.18:6815/1333533784","heartbeat_front_addr":"172.21.15.18:6813/1333533784","state":["exists","up"]},{"osd":5,"uuid":"9d3384b0-f87d-4513-b151-4cca21c339b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":316360741},{"type":"v1","addr":"172.21.15.116:6809","nonce":316360741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":316360741},{"type":"v1","addr":"172.21.15.116:6811","nonce":316360741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":316360741},{"type":"v1","addr":"172.21.15.116:6815","nonce":316360741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":316360741},{"type":"v1","addr":"172.21.15.116:6813","nonce":316360741}]},"public_addr":"172.21.15.116:6809/316360741","cluster_addr":"172.21.15.116:6811/316360741","heartbeat_back_addr":"172.21.15.116:6815/316360741","heartbeat_front_addr":"172.21.15.116:6813/316360741","state":["exists","up"]},{"osd":6,"uuid":"e54f44b5-a693-4b31-83b2-2bcf10ab9a75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1185564560},{"type":"v1","addr":"172.21.15.2:6819","nonce":1185564560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1185564560},{"type":"v1","addr":"172.21.15.2:6821","nonce":1185564560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1185564560},{"type":"v1","addr":"172.21.15.2:6825","nonce":1185564560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":1185564560},{"type":"v1","addr":"172.21.15.2:6823","nonce":1185564560}]},"public_addr":"172.21.15.2:6819/1185564560","cluster_addr":"172.21.15.2:6821/1185564560","heartbeat_back_addr":"172.21.15.2:6825/1185564560","heartbeat_front_addr":"172.21.15.2:6823/1185564560","state":["exists","up"]},{"osd":7,"uuid":"96a444c3-429a-48b6-9823-95c9e171341a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3691801363},{"type":"v1","addr":"172.21.15.18:6817","nonce":3691801363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3691801363},{"type":"v1","addr":"172.21.15.18:6819","nonce":3691801363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3691801363},{"type":"v1","addr":"172.21.15.18:6823","nonce":3691801363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3691801363},{"type":"v1","addr":"172.21.15.18:6821","nonce":3691801363}]},"public_addr":"172.21.15.18:6817/3691801363","cluster_addr":"172.21.15.18:6819/3691801363","heartbeat_back_addr":"172.21.15.18:6823/3691801363","heartbeat_front_addr":"172.21.15.18:6821/3691801363","state":["exists","up"]},{"osd":8,"uuid":"c3f696aa-be7d-4f67-9147-3751406e394d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":3709586119},{"type":"v1","addr":"172.21.15.116:6817","nonce":3709586119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":3709586119},{"type":"v1","addr":"172.21.15.116:6819","nonce":3709586119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":3709586119},{"type":"v1","addr":"172.21.15.116:6823","nonce":3709586119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":3709586119},{"type":"v1","addr":"172.21.15.116:6821","nonce":3709586119}]},"public_addr":"172.21.15.116:6817/3709586119","cluster_addr":"172.21.15.116:6819/3709586119","heartbeat_back_addr":"172.21.15.116:6823/3709586119","heartbeat_front_addr":"172.21.15.116:6821/3709586119","state":["exists","up"]},{"osd":9,"uuid":"4892549d-f050-48c5-b695-5924b612a581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1054791011},{"type":"v1","addr":"172.21.15.2:6827","nonce":1054791011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1054791011},{"type":"v1","addr":"172.21.15.2:6829","nonce":1054791011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1054791011},{"type":"v1","addr":"172.21.15.2:6833","nonce":1054791011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":1054791011},{"type":"v1","addr":"172.21.15.2:6831","nonce":1054791011}]},"public_addr":"172.21.15.2:6827/1054791011","cluster_addr":"172.21.15.2:6829/1054791011","heartbeat_back_addr":"172.21.15.2:6833/1054791011","heartbeat_front_addr":"172.21.15.2:6831/1054791011","state":["exists","up"]},{"osd":10,"uuid":"12b60238-6a35-4d48-bacd-ee5ddd8fdb0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1958683776},{"type":"v1","addr":"172.21.15.18:6825","nonce":1958683776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":1958683776},{"type":"v1","addr":"172.21.15.18:6827","nonce":1958683776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":1958683776},{"type":"v1","addr":"172.21.15.18:6831","nonce":1958683776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":1958683776},{"type":"v1","addr":"172.21.15.18:6829","nonce":1958683776}]},"public_addr":"172.21.15.18:6825/1958683776","cluster_addr":"172.21.15.18:6827/1958683776","heartbeat_back_addr":"172.21.15.18:6831/1958683776","heartbeat_front_addr":"172.21.15.18:6829/1958683776","state":["exists","up"]},{"osd":11,"uuid":"99b3e553-b42c-4b2f-817f-3900ad8bd223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3456789654},{"type":"v1","addr":"172.21.15.116:6825","nonce":3456789654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3456789654},{"type":"v1","addr":"172.21.15.116:6827","nonce":3456789654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3456789654},{"type":"v1","addr":"172.21.15.116:6831","nonce":3456789654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3456789654},{"type":"v1","addr":"172.21.15.116:6829","nonce":3456789654}]},"public_addr":"172.21.15.116:6825/3456789654","cluster_addr":"172.21.15.116:6827/3456789654","heartbeat_back_addr":"172.21.15.116:6831/3456789654","heartbeat_front_addr":"172.21.15.116:6829/3456789654","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:40:58.216702+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:41:22.852350+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:41:47.265084+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:42:12.785128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:42:38.475008+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:43:02.924009+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:43:28.050646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:43:52.715369+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:44:16.905066+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:44:42.071128+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:45:06.434525+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:45:31.569086+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/870383845":"2024-09-20T04:39:35.461329+0000","172.21.15.2:0/2801870985":"2024-09-20T04:39:35.461329+0000","172.21.15.2:0/256825166":"2024-09-20T04:39:35.461329+0000","172.21.15.2:6801/3782987318":"2024-09-20T04:39:35.461329+0000","172.21.15.2:0/3064319092":"2024-09-20T04:39:11.086431+0000","172.21.15.2:0/1528097642":"2024-09-20T04:39:11.086431+0000","172.21.15.2:6801/1825825090":"2024-09-20T04:39:11.086431+0000","172.21.15.2:6800/1825825090":"2024-09-20T04:39:11.086431+0000","172.21.15.2:6800/3782987318":"2024-09-20T04:39:35.461329+0000","172.21.15.2:0/2432243496":"2024-09-20T04:39:11.086431+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T04:46:27.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.620+0000 7f24bd325640 1 -- 172.21.15.2:0/4164726111 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f24a00a32c0 msgr2=0x7f24a00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:27.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.620+0000 7f24bd325640 1 --2- 172.21.15.2:0/4164726111 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f24a00a32c0 0x7f24a00a5780 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f24a800a810 tx=0x7f24a8008040 comp rx=0 tx=0).stop 2024-09-19T04:46:27.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.620+0000 7f24bd325640 1 -- 172.21.15.2:0/4164726111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24b8102ef0 msgr2=0x7f24b819ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:27.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.620+0000 7f24bd325640 1 --2- 172.21.15.2:0/4164726111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24b8102ef0 0x7f24b819ccc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f24b002ae70 tx=0x7f24b002f5d0 comp rx=0 tx=0).stop 2024-09-19T04:46:27.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.620+0000 7f24bd325640 1 -- 172.21.15.2:0/4164726111 shutdown_connections 2024-09-19T04:46:27.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.620+0000 7f24bd325640 1 --2- 172.21.15.2:0/4164726111 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f24a00a32c0 0x7f24a00a5780 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:27.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.620+0000 7f24bd325640 1 --2- 172.21.15.2:0/4164726111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24b8102ef0 0x7f24b819ccc0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:27.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.620+0000 7f24bd325640 1 --2- 172.21.15.2:0/4164726111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24b8102570 0x7f24b8198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:27.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.620+0000 7f24bd325640 1 --2- 172.21.15.2:0/4164726111 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24b8100e20 0x7f24b81983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:27.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.620+0000 7f24bd325640 1 -- 172.21.15.2:0/4164726111 >> 172.21.15.2:0/4164726111 conn(0x7f24b80fc7d0 msgr2=0x7f24b806a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:27.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.621+0000 7f24bd325640 1 -- 172.21.15.2:0/4164726111 shutdown_connections 2024-09-19T04:46:27.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:27.621+0000 7f24bd325640 1 -- 172.21.15.2:0/4164726111 wait complete. 2024-09-19T04:46:27.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:27 smithi018 ceph-mon[34537]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T04:46:27.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:27 smithi018 ceph-mon[34537]: Cluster is now healthy 2024-09-19T04:46:27.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:27 smithi116 ceph-mon[34477]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T04:46:27.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:27 smithi116 ceph-mon[34477]: Cluster is now healthy 2024-09-19T04:46:28.238 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-19T04:46:28.495 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:46:28.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:28 smithi018 ceph-mon[34537]: pgmap v274: 97 pgs: 97 active+clean; 577 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 2 op/s 2024-09-19T04:46:28.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:28 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/4164726111' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:46:28.768 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:28 smithi002 ceph-mon[30975]: pgmap v274: 97 pgs: 97 active+clean; 577 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 2 op/s 2024-09-19T04:46:28.768 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:28 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/4164726111' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:46:28.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:28 smithi116 ceph-mon[34477]: pgmap v274: 97 pgs: 97 active+clean; 577 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 2 op/s 2024-09-19T04:46:28.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:28 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/4164726111' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:46:28.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:28.978+0000 7fa326b48640 1 -- 172.21.15.2:0/3660439611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa32010c170 msgr2=0x7fa32010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:28.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:28.979+0000 7fa326b48640 1 --2- 172.21.15.2:0/3660439611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa32010c170 0x7fa32010e610 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa318009ca0 tx=0x7fa31802a950 comp rx=0 tx=0).stop 2024-09-19T04:46:28.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:28.979+0000 7fa326b48640 1 -- 172.21.15.2:0/3660439611 shutdown_connections 2024-09-19T04:46:28.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:28.979+0000 7fa326b48640 1 --2- 172.21.15.2:0/3660439611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa32010c170 0x7fa32010e610 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:28.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:28.979+0000 7fa326b48640 1 --2- 172.21.15.2:0/3660439611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa320103660 0x7fa32010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:28.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:28.979+0000 7fa326b48640 1 --2- 172.21.15.2:0/3660439611 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa320102d40 0x7fa320103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:28.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:28.979+0000 7fa326b48640 1 -- 172.21.15.2:0/3660439611 >> 172.21.15.2:0/3660439611 conn(0x7fa3200fc7a0 msgr2=0x7fa3200febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:28.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:28.979+0000 7fa326b48640 1 -- 172.21.15.2:0/3660439611 shutdown_connections 2024-09-19T04:46:28.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:28.979+0000 7fa326b48640 1 -- 172.21.15.2:0/3660439611 wait complete. 2024-09-19T04:46:28.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:28.979+0000 7fa326b48640 1 Processor -- start 2024-09-19T04:46:28.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:28.979+0000 7fa326b48640 1 -- start start 2024-09-19T04:46:28.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:28.979+0000 7fa326b48640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa320102d40 0x7fa3201983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:28.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:28.979+0000 7fa326b48640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa320103660 0x7fa320198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:28.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:28.979+0000 7fa326b48640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa32010c170 0x7fa32019cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:28.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:28.979+0000 7fa326b48640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa320111de0 con 0x7fa320102d40 2024-09-19T04:46:28.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:28.980+0000 7fa326b48640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa320111c60 con 0x7fa320103660 2024-09-19T04:46:28.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:28.980+0000 7fa326b48640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa320111f60 con 0x7fa32010c170 2024-09-19T04:46:28.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:28.980+0000 7fa3248e4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa320102d40 0x7fa3201983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:28.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:28.980+0000 7fa3248e4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa320102d40 0x7fa3201983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34672/0 (socket says 172.21.15.2:34672) 2024-09-19T04:46:28.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:28.980+0000 7fa3248e4640 1 -- 172.21.15.2:0/1240930366 learned_addr learned my addr 172.21.15.2:0/1240930366 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:46:28.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:28.980+0000 7fa3250e5640 1 --2- 172.21.15.2:0/1240930366 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa32010c170 0x7fa32019cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:28.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:28.980+0000 7fa31ffff640 1 --2- 172.21.15.2:0/1240930366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa320103660 0x7fa320198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:28.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:28.980+0000 7fa3248e4640 1 -- 172.21.15.2:0/1240930366 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa32010c170 msgr2=0x7fa32019cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:28.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:28.980+0000 7fa3248e4640 1 --2- 172.21.15.2:0/1240930366 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa32010c170 0x7fa32019cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:28.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:28.980+0000 7fa3248e4640 1 -- 172.21.15.2:0/1240930366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa320103660 msgr2=0x7fa320198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:28.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:28.980+0000 7fa3248e4640 1 --2- 172.21.15.2:0/1240930366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa320103660 0x7fa320198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:28.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:28.980+0000 7fa3248e4640 1 -- 172.21.15.2:0/1240930366 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa32019d370 con 0x7fa320102d40 2024-09-19T04:46:28.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:28.980+0000 7fa3248e4640 1 --2- 172.21.15.2:0/1240930366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa320102d40 0x7fa3201983c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa31000d950 tx=0x7fa31000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:28.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:28.980+0000 7fa31dffb640 1 -- 172.21.15.2:0/1240930366 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa310017070 con 0x7fa320102d40 2024-09-19T04:46:28.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:28.980+0000 7fa326b48640 1 -- 172.21.15.2:0/1240930366 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa32019d660 con 0x7fa320102d40 2024-09-19T04:46:28.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:28.980+0000 7fa31dffb640 1 -- 172.21.15.2:0/1240930366 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa310009c30 con 0x7fa320102d40 2024-09-19T04:46:28.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:28.980+0000 7fa31dffb640 1 -- 172.21.15.2:0/1240930366 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa31000f620 con 0x7fa320102d40 2024-09-19T04:46:28.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:28.981+0000 7fa326b48640 1 -- 172.21.15.2:0/1240930366 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3201a4f40 con 0x7fa320102d40 2024-09-19T04:46:28.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:28.981+0000 7fa326b48640 1 -- 172.21.15.2:0/1240930366 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa320103120 con 0x7fa320102d40 2024-09-19T04:46:28.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:28.983+0000 7fa31dffb640 1 -- 172.21.15.2:0/1240930366 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fa3100109a0 con 0x7fa320102d40 2024-09-19T04:46:28.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:28.983+0000 7fa31dffb640 1 --2- 172.21.15.2:0/1240930366 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fa3080a3240 0x7fa3080a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:28.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:28.983+0000 7fa31ffff640 1 --2- 172.21.15.2:0/1240930366 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fa3080a3240 0x7fa3080a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:28.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:28.983+0000 7fa31dffb640 1 -- 172.21.15.2:0/1240930366 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7fa3100cf420 con 0x7fa320102d40 2024-09-19T04:46:28.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:28.984+0000 7fa31ffff640 1 --2- 172.21.15.2:0/1240930366 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fa3080a3240 0x7fa3080a5700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa3200fedc0 tx=0x7fa314005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:28.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:28.987+0000 7fa31dffb640 1 -- 172.21.15.2:0/1240930366 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa310009de0 con 0x7fa320102d40 2024-09-19T04:46:29.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:29.201+0000 7fa326b48640 1 -- 172.21.15.2:0/1240930366 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fa320107240 con 0x7fa320102d40 2024-09-19T04:46:29.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:29.520+0000 7fa31dffb640 1 -- 172.21.15.2:0/1240930366 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7fa31009c290 con 0x7fa320102d40 2024-09-19T04:46:29.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:29.523+0000 7fa326b48640 1 -- 172.21.15.2:0/1240930366 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fa3080a3240 msgr2=0x7fa3080a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:29.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:29.523+0000 7fa326b48640 1 --2- 172.21.15.2:0/1240930366 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fa3080a3240 0x7fa3080a5700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa3200fedc0 tx=0x7fa314005f90 comp rx=0 tx=0).stop 2024-09-19T04:46:29.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:29.523+0000 7fa326b48640 1 -- 172.21.15.2:0/1240930366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa320102d40 msgr2=0x7fa3201983c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:29.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:29.523+0000 7fa326b48640 1 --2- 172.21.15.2:0/1240930366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa320102d40 0x7fa3201983c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa31000d950 tx=0x7fa31000de10 comp rx=0 tx=0).stop 2024-09-19T04:46:29.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:29.523+0000 7fa326b48640 1 -- 172.21.15.2:0/1240930366 shutdown_connections 2024-09-19T04:46:29.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:29.523+0000 7fa326b48640 1 --2- 172.21.15.2:0/1240930366 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fa3080a3240 0x7fa3080a5700 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:29.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:29.523+0000 7fa326b48640 1 --2- 172.21.15.2:0/1240930366 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa32010c170 0x7fa32019cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:29.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:29.523+0000 7fa326b48640 1 --2- 172.21.15.2:0/1240930366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa320103660 0x7fa320198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:29.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:29.523+0000 7fa326b48640 1 --2- 172.21.15.2:0/1240930366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa320102d40 0x7fa3201983c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:29.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:29.523+0000 7fa326b48640 1 -- 172.21.15.2:0/1240930366 >> 172.21.15.2:0/1240930366 conn(0x7fa3200fc7a0 msgr2=0x7fa3200fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:29.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:29.523+0000 7fa326b48640 1 -- 172.21.15.2:0/1240930366 shutdown_connections 2024-09-19T04:46:29.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:29.523+0000 7fa326b48640 1 -- 172.21.15.2:0/1240930366 wait complete. 2024-09-19T04:46:29.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:29 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/1240930366' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T04:46:29.819 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:29 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/1240930366' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T04:46:29.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:29 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/1240930366' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T04:46:30.195 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 1, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-09-19T04:46:30.196 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-19T04:46:30.461 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:46:30.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:30 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/1240930366' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T04:46:30.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:30 smithi018 ceph-mon[34537]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T04:46:30.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:30 smithi018 ceph-mon[34537]: pgmap v275: 97 pgs: 97 active+clean; 579 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-09-19T04:46:30.835 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:30 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/1240930366' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T04:46:30.835 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:30 smithi002 ceph-mon[30975]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T04:46:30.835 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:30 smithi002 ceph-mon[30975]: pgmap v275: 97 pgs: 97 active+clean; 579 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-09-19T04:46:30.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:30 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/1240930366' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T04:46:30.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:30 smithi116 ceph-mon[34477]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T04:46:30.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:30 smithi116 ceph-mon[34477]: pgmap v275: 97 pgs: 97 active+clean; 579 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-09-19T04:46:30.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:30.962+0000 7fa189d98640 1 -- 172.21.15.2:0/1531147713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1841036e0 msgr2=0x7fa184107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:30.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:30.962+0000 7fa189d98640 1 --2- 172.21.15.2:0/1531147713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1841036e0 0x7fa184107b90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa178009930 tx=0x7fa17802a420 comp rx=0 tx=0).stop 2024-09-19T04:46:30.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:30.963+0000 7fa189d98640 1 -- 172.21.15.2:0/1531147713 shutdown_connections 2024-09-19T04:46:30.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:30.963+0000 7fa189d98640 1 --2- 172.21.15.2:0/1531147713 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1841082a0 0x7fa18410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:30.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:30.963+0000 7fa189d98640 1 --2- 172.21.15.2:0/1531147713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1841036e0 0x7fa184107b90 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:30.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:30.963+0000 7fa189d98640 1 --2- 172.21.15.2:0/1531147713 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa184102d30 0x7fa184103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:30.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:30.963+0000 7fa189d98640 1 -- 172.21.15.2:0/1531147713 >> 172.21.15.2:0/1531147713 conn(0x7fa1840fc7d0 msgr2=0x7fa1840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:30.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:30.963+0000 7fa189d98640 1 -- 172.21.15.2:0/1531147713 shutdown_connections 2024-09-19T04:46:30.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:30.963+0000 7fa189d98640 1 -- 172.21.15.2:0/1531147713 wait complete. 2024-09-19T04:46:30.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:30.963+0000 7fa189d98640 1 Processor -- start 2024-09-19T04:46:30.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:30.963+0000 7fa189d98640 1 -- start start 2024-09-19T04:46:30.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:30.964+0000 7fa189d98640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa184102d30 0x7fa184100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:30.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:30.964+0000 7fa189d98640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1841036e0 0x7fa184100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:30.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:30.964+0000 7fa189d98640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1841082a0 0x7fa184101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:30.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:30.964+0000 7fa189d98640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa184111f50 con 0x7fa1841036e0 2024-09-19T04:46:30.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:30.964+0000 7fa189d98640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa184111dd0 con 0x7fa184102d30 2024-09-19T04:46:30.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:30.964+0000 7fa189d98640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa1841120d0 con 0x7fa1841082a0 2024-09-19T04:46:30.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:30.964+0000 7fa182ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1841036e0 0x7fa184100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:30.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:30.964+0000 7fa182ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1841036e0 0x7fa184100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34694/0 (socket says 172.21.15.2:34694) 2024-09-19T04:46:30.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:30.964+0000 7fa182ffd640 1 -- 172.21.15.2:0/3137763004 learned_addr learned my addr 172.21.15.2:0/3137763004 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:46:30.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:30.964+0000 7fa1837fe640 1 --2- 172.21.15.2:0/3137763004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa184102d30 0x7fa184100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:30.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:30.964+0000 7fa183fff640 1 --2- 172.21.15.2:0/3137763004 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1841082a0 0x7fa184101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:30.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:30.964+0000 7fa182ffd640 1 -- 172.21.15.2:0/3137763004 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1841082a0 msgr2=0x7fa184101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:30.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:30.964+0000 7fa182ffd640 1 --2- 172.21.15.2:0/3137763004 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1841082a0 0x7fa184101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:30.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:30.964+0000 7fa182ffd640 1 -- 172.21.15.2:0/3137763004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa184102d30 msgr2=0x7fa184100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:30.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:30.964+0000 7fa182ffd640 1 --2- 172.21.15.2:0/3137763004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa184102d30 0x7fa184100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:30.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:30.964+0000 7fa182ffd640 1 -- 172.21.15.2:0/3137763004 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1841a6a40 con 0x7fa1841036e0 2024-09-19T04:46:30.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:30.964+0000 7fa182ffd640 1 --2- 172.21.15.2:0/3137763004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1841036e0 0x7fa184100ed0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa178009230 tx=0x7fa178004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:30.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:30.965+0000 7fa180ff9640 1 -- 172.21.15.2:0/3137763004 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17803f030 con 0x7fa1841036e0 2024-09-19T04:46:30.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:30.965+0000 7fa180ff9640 1 -- 172.21.15.2:0/3137763004 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa1780035f0 con 0x7fa1841036e0 2024-09-19T04:46:30.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:30.965+0000 7fa189d98640 1 -- 172.21.15.2:0/3137763004 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1841a6cd0 con 0x7fa1841036e0 2024-09-19T04:46:30.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:30.965+0000 7fa180ff9640 1 -- 172.21.15.2:0/3137763004 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa178035070 con 0x7fa1841036e0 2024-09-19T04:46:30.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:30.965+0000 7fa189d98640 1 -- 172.21.15.2:0/3137763004 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1841a71b0 con 0x7fa1841036e0 2024-09-19T04:46:30.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:30.966+0000 7fa189d98640 1 -- 172.21.15.2:0/3137763004 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa184103110 con 0x7fa1841036e0 2024-09-19T04:46:30.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:30.967+0000 7fa180ff9640 1 -- 172.21.15.2:0/3137763004 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fa178003aa0 con 0x7fa1841036e0 2024-09-19T04:46:30.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:30.968+0000 7fa180ff9640 1 --2- 172.21.15.2:0/3137763004 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fa16c0a3240 0x7fa16c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:30.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:30.968+0000 7fa1837fe640 1 --2- 172.21.15.2:0/3137763004 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fa16c0a3240 0x7fa16c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:30.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:30.968+0000 7fa180ff9640 1 -- 172.21.15.2:0/3137763004 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7fa1780f0340 con 0x7fa1841036e0 2024-09-19T04:46:30.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:30.968+0000 7fa1837fe640 1 --2- 172.21.15.2:0/3137763004 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fa16c0a3240 0x7fa16c0a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa1740058c0 tx=0x7fa17400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:30.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:30.972+0000 7fa180ff9640 1 -- 172.21.15.2:0/3137763004 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa1780bd1b0 con 0x7fa1841036e0 2024-09-19T04:46:31.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:31.187+0000 7fa189d98640 1 -- 172.21.15.2:0/3137763004 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fa18410a2b0 con 0x7fa1841036e0 2024-09-19T04:46:31.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:31.529+0000 7fa180ff9640 1 -- 172.21.15.2:0/3137763004 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v17) ==== 121+0+0 (secure 0 0 0) 0x7fa1780bcab0 con 0x7fa1841036e0 2024-09-19T04:46:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:31.531+0000 7fa189d98640 1 -- 172.21.15.2:0/3137763004 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fa16c0a3240 msgr2=0x7fa16c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:31.531+0000 7fa189d98640 1 --2- 172.21.15.2:0/3137763004 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fa16c0a3240 0x7fa16c0a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa1740058c0 tx=0x7fa17400a2d0 comp rx=0 tx=0).stop 2024-09-19T04:46:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:31.531+0000 7fa189d98640 1 -- 172.21.15.2:0/3137763004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1841036e0 msgr2=0x7fa184100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:31.531+0000 7fa189d98640 1 --2- 172.21.15.2:0/3137763004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1841036e0 0x7fa184100ed0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa178009230 tx=0x7fa178004270 comp rx=0 tx=0).stop 2024-09-19T04:46:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:31.531+0000 7fa189d98640 1 -- 172.21.15.2:0/3137763004 shutdown_connections 2024-09-19T04:46:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:31.531+0000 7fa189d98640 1 --2- 172.21.15.2:0/3137763004 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fa16c0a3240 0x7fa16c0a5700 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:31.531+0000 7fa189d98640 1 --2- 172.21.15.2:0/3137763004 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1841082a0 0x7fa184101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:31.531+0000 7fa189d98640 1 --2- 172.21.15.2:0/3137763004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1841036e0 0x7fa184100ed0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:31.531+0000 7fa189d98640 1 --2- 172.21.15.2:0/3137763004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa184102d30 0x7fa184100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:31.531+0000 7fa189d98640 1 -- 172.21.15.2:0/3137763004 >> 172.21.15.2:0/3137763004 conn(0x7fa1840fc7d0 msgr2=0x7fa184105ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:31.531+0000 7fa189d98640 1 -- 172.21.15.2:0/3137763004 shutdown_connections 2024-09-19T04:46:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:31.531+0000 7fa189d98640 1 -- 172.21.15.2:0/3137763004 wait complete. 2024-09-19T04:46:31.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:31 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/3137763004' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T04:46:31.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:31 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/3137763004' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T04:46:31.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:31 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/3137763004' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T04:46:32.197 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-19T04:46:32.457 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:46:32.803 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:32 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/3137763004' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T04:46:32.803 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:32 smithi002 ceph-mon[30975]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T04:46:32.803 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:32 smithi002 ceph-mon[30975]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T04:46:32.803 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:32 smithi002 ceph-mon[30975]: pgmap v276: 97 pgs: 97 active+clean; 579 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-19T04:46:32.806 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:32 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/3137763004' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T04:46:32.806 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:32 smithi018 ceph-mon[34537]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T04:46:32.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:32 smithi018 ceph-mon[34537]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T04:46:32.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:32 smithi018 ceph-mon[34537]: pgmap v276: 97 pgs: 97 active+clean; 579 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-19T04:46:32.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:32 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/3137763004' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T04:46:32.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:32 smithi116 ceph-mon[34477]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T04:46:32.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:32 smithi116 ceph-mon[34477]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T04:46:32.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:32 smithi116 ceph-mon[34477]: pgmap v276: 97 pgs: 97 active+clean; 579 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-19T04:46:32.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:32.887+0000 7f0f060ef640 1 -- 172.21.15.2:0/3130309412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f00102570 msgr2=0x7f0f001029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:32.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:32.887+0000 7f0f060ef640 1 --2- 172.21.15.2:0/3130309412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f00102570 0x7f0f001029b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4009900 tx=0x7f0ef402a480 comp rx=0 tx=0).stop 2024-09-19T04:46:32.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:32.887+0000 7f0f060ef640 1 -- 172.21.15.2:0/3130309412 shutdown_connections 2024-09-19T04:46:32.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:32.887+0000 7f0f060ef640 1 --2- 172.21.15.2:0/3130309412 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f00102ef0 0x7f0f0010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:32.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:32.887+0000 7f0f060ef640 1 --2- 172.21.15.2:0/3130309412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f00102570 0x7f0f001029b0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:32.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:32.887+0000 7f0f060ef640 1 --2- 172.21.15.2:0/3130309412 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0f00100e20 0x7f0f00101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:32.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:32.887+0000 7f0f060ef640 1 -- 172.21.15.2:0/3130309412 >> 172.21.15.2:0/3130309412 conn(0x7f0f000fc7d0 msgr2=0x7f0f000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:32.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:32.887+0000 7f0f060ef640 1 -- 172.21.15.2:0/3130309412 shutdown_connections 2024-09-19T04:46:32.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:32.887+0000 7f0f060ef640 1 -- 172.21.15.2:0/3130309412 wait complete. 2024-09-19T04:46:32.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:32.887+0000 7f0f060ef640 1 Processor -- start 2024-09-19T04:46:32.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:32.888+0000 7f0f060ef640 1 -- start start 2024-09-19T04:46:32.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:32.888+0000 7f0f060ef640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f00100e20 0x7f0f001991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:32.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:32.888+0000 7f0f060ef640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0f00102570 0x7f0f00199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:32.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:32.888+0000 7f0f060ef640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f00102ef0 0x7f0f001a4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:32.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:32.888+0000 7f0f060ef640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0f00110e80 con 0x7f0f00100e20 2024-09-19T04:46:32.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:32.888+0000 7f0f060ef640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0f00110d00 con 0x7f0f00102ef0 2024-09-19T04:46:32.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:32.888+0000 7f0f060ef640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f0f00111000 con 0x7f0f00102570 2024-09-19T04:46:32.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:32.888+0000 7f0eff7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f00100e20 0x7f0f001991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:32.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:32.888+0000 7f0eff7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f00100e20 0x7f0f001991f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51594/0 (socket says 172.21.15.2:51594) 2024-09-19T04:46:32.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:32.888+0000 7f0eff7fe640 1 -- 172.21.15.2:0/3037430799 learned_addr learned my addr 172.21.15.2:0/3037430799 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:46:32.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:32.888+0000 7f0efeffd640 1 --2- 172.21.15.2:0/3037430799 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0f00102570 0x7f0f00199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:32.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:32.888+0000 7f0eff7fe640 1 -- 172.21.15.2:0/3037430799 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0f00102570 msgr2=0x7f0f00199730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:32.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:32.888+0000 7f0eff7fe640 1 --2- 172.21.15.2:0/3037430799 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0f00102570 0x7f0f00199730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:32.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:32.888+0000 7f0efffff640 1 --2- 172.21.15.2:0/3037430799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f00102ef0 0x7f0f001a4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:32.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:32.888+0000 7f0eff7fe640 1 -- 172.21.15.2:0/3037430799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f00102ef0 msgr2=0x7f0f001a4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:32.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:32.888+0000 7f0eff7fe640 1 --2- 172.21.15.2:0/3037430799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f00102ef0 0x7f0f001a4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:32.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:32.888+0000 7f0eff7fe640 1 -- 172.21.15.2:0/3037430799 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f001a47b0 con 0x7f0f00100e20 2024-09-19T04:46:32.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:32.888+0000 7f0eff7fe640 1 --2- 172.21.15.2:0/3037430799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f00100e20 0x7f0f001991f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0ef000d770 tx=0x7f0ef000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:32.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:32.889+0000 7f0efcff9640 1 -- 172.21.15.2:0/3037430799 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef0017070 con 0x7f0f00100e20 2024-09-19T04:46:32.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:32.889+0000 7f0f060ef640 1 -- 172.21.15.2:0/3037430799 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f001a4980 con 0x7f0f00100e20 2024-09-19T04:46:32.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:32.889+0000 7f0efcff9640 1 -- 172.21.15.2:0/3037430799 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0ef00054d0 con 0x7f0f00100e20 2024-09-19T04:46:32.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:32.889+0000 7f0efcff9640 1 -- 172.21.15.2:0/3037430799 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef0004cf0 con 0x7f0f00100e20 2024-09-19T04:46:32.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:32.889+0000 7f0f060ef640 1 -- 172.21.15.2:0/3037430799 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f001a4e40 con 0x7f0f00100e20 2024-09-19T04:46:32.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:32.890+0000 7f0f060ef640 1 -- 172.21.15.2:0/3037430799 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f00101200 con 0x7f0f00100e20 2024-09-19T04:46:32.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:32.891+0000 7f0efcff9640 1 -- 172.21.15.2:0/3037430799 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f0ef0004e90 con 0x7f0f00100e20 2024-09-19T04:46:32.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:32.892+0000 7f0efcff9640 1 --2- 172.21.15.2:0/3037430799 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f0ee80a3240 0x7f0ee80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:32.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:32.892+0000 7f0efeffd640 1 --2- 172.21.15.2:0/3037430799 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f0ee80a3240 0x7f0ee80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:32.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:32.892+0000 7f0efcff9640 1 -- 172.21.15.2:0/3037430799 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f0ef00cf230 con 0x7f0f00100e20 2024-09-19T04:46:32.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:32.892+0000 7f0efeffd640 1 --2- 172.21.15.2:0/3037430799 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f0ee80a3240 0x7f0ee80a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4000c00 tx=0x7f0ef4005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:32.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:32.896+0000 7f0efcff9640 1 -- 172.21.15.2:0/3037430799 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0ef009c0a0 con 0x7f0f00100e20 2024-09-19T04:46:33.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:33.110+0000 7f0f060ef640 1 -- 172.21.15.2:0/3037430799 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f0f00109090 con 0x7f0f00100e20 2024-09-19T04:46:33.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:33.543+0000 7f0efcff9640 1 -- 172.21.15.2:0/3037430799 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v19) ==== 115+0+0 (secure 0 0 0) 0x7f0ef009b9a0 con 0x7f0f00100e20 2024-09-19T04:46:33.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:33.545+0000 7f0f060ef640 1 -- 172.21.15.2:0/3037430799 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f0ee80a3240 msgr2=0x7f0ee80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:33.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:33.545+0000 7f0f060ef640 1 --2- 172.21.15.2:0/3037430799 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f0ee80a3240 0x7f0ee80a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4000c00 tx=0x7f0ef4005e80 comp rx=0 tx=0).stop 2024-09-19T04:46:33.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:33.545+0000 7f0f060ef640 1 -- 172.21.15.2:0/3037430799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f00100e20 msgr2=0x7f0f001991f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:33.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:33.545+0000 7f0f060ef640 1 --2- 172.21.15.2:0/3037430799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f00100e20 0x7f0f001991f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0ef000d770 tx=0x7f0ef000dc30 comp rx=0 tx=0).stop 2024-09-19T04:46:33.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:33.545+0000 7f0f060ef640 1 -- 172.21.15.2:0/3037430799 shutdown_connections 2024-09-19T04:46:33.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:33.545+0000 7f0f060ef640 1 --2- 172.21.15.2:0/3037430799 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f0ee80a3240 0x7f0ee80a5700 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:33.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:33.545+0000 7f0f060ef640 1 --2- 172.21.15.2:0/3037430799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f00102ef0 0x7f0f001a4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:33.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:33.545+0000 7f0f060ef640 1 --2- 172.21.15.2:0/3037430799 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0f00102570 0x7f0f00199730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:33.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:33.545+0000 7f0f060ef640 1 --2- 172.21.15.2:0/3037430799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f00100e20 0x7f0f001991f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:33.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:33.545+0000 7f0f060ef640 1 -- 172.21.15.2:0/3037430799 >> 172.21.15.2:0/3037430799 conn(0x7f0f000fc7d0 msgr2=0x7f0f000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:33.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:33.545+0000 7f0f060ef640 1 -- 172.21.15.2:0/3037430799 shutdown_connections 2024-09-19T04:46:33.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:33.545+0000 7f0f060ef640 1 -- 172.21.15.2:0/3037430799 wait complete. 2024-09-19T04:46:33.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:33 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/3037430799' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T04:46:33.859 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:33 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/3037430799' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T04:46:33.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:33 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/3037430799' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T04:46:34.248 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2024-09-19T04:46:34.249 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-19T04:46:34.512 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:46:34.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:34 smithi018 ceph-mon[34537]: pgmap v277: 97 pgs: 97 active+clean; 579 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-09-19T04:46:34.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:34 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/3037430799' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T04:46:34.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:34 smithi018 ceph-mon[34537]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T04:46:34.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:34 smithi002 ceph-mon[30975]: pgmap v277: 97 pgs: 97 active+clean; 579 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-09-19T04:46:34.852 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:34 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/3037430799' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T04:46:34.853 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:34 smithi002 ceph-mon[30975]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T04:46:34.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:34 smithi116 ceph-mon[34477]: pgmap v277: 97 pgs: 97 active+clean; 579 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-09-19T04:46:34.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:34 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/3037430799' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T04:46:34.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:34 smithi116 ceph-mon[34477]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T04:46:34.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:34.936+0000 7f56952b8640 1 -- 172.21.15.2:0/3056607588 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5690106f10 msgr2=0x7f569010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:34.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:34.936+0000 7f56952b8640 1 --2- 172.21.15.2:0/3056607588 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5690106f10 0x7f569010ea90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5688009ca0 tx=0x7f568802a8c0 comp rx=0 tx=0).stop 2024-09-19T04:46:34.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:34.936+0000 7f56952b8640 1 -- 172.21.15.2:0/3056607588 shutdown_connections 2024-09-19T04:46:34.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:34.936+0000 7f56952b8640 1 --2- 172.21.15.2:0/3056607588 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5690106f10 0x7f569010ea90 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:34.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:34.936+0000 7f56952b8640 1 --2- 172.21.15.2:0/3056607588 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5690102790 0x7f56901067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:34.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:34.936+0000 7f56952b8640 1 --2- 172.21.15.2:0/3056607588 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5690101de0 0x7f56901021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:34.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:34.936+0000 7f56952b8640 1 -- 172.21.15.2:0/3056607588 >> 172.21.15.2:0/3056607588 conn(0x7f56900fd8c0 msgr2=0x7f56900ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:34.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:34.936+0000 7f56952b8640 1 -- 172.21.15.2:0/3056607588 shutdown_connections 2024-09-19T04:46:34.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:34.936+0000 7f56952b8640 1 -- 172.21.15.2:0/3056607588 wait complete. 2024-09-19T04:46:34.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:34.937+0000 7f56952b8640 1 Processor -- start 2024-09-19T04:46:34.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:34.937+0000 7f56952b8640 1 -- start start 2024-09-19T04:46:34.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:34.937+0000 7f56952b8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5690101de0 0x7f5690198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:34.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:34.937+0000 7f56952b8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5690102790 0x7f5690198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:34.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:34.937+0000 7f56952b8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5690106f10 0x7f569019cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:34.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:34.937+0000 7f56952b8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5690111e20 con 0x7f5690102790 2024-09-19T04:46:34.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:34.937+0000 7f56952b8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5690111ca0 con 0x7f5690101de0 2024-09-19T04:46:34.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:34.937+0000 7f56952b8640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f5690111fa0 con 0x7f5690106f10 2024-09-19T04:46:34.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:34.937+0000 7f568e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5690102790 0x7f5690198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:34.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:34.937+0000 7f568e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5690102790 0x7f5690198880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51610/0 (socket says 172.21.15.2:51610) 2024-09-19T04:46:34.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:34.937+0000 7f568e7fc640 1 -- 172.21.15.2:0/140200895 learned_addr learned my addr 172.21.15.2:0/140200895 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:46:34.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:34.938+0000 7f568f7fe640 1 --2- 172.21.15.2:0/140200895 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5690106f10 0x7f569019cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:34.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:34.938+0000 7f568e7fc640 1 -- 172.21.15.2:0/140200895 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5690106f10 msgr2=0x7f569019cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:34.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:34.938+0000 7f568e7fc640 1 --2- 172.21.15.2:0/140200895 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5690106f10 0x7f569019cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:34.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:34.938+0000 7f568e7fc640 1 -- 172.21.15.2:0/140200895 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5690101de0 msgr2=0x7f5690198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:34.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:34.938+0000 7f568effd640 1 --2- 172.21.15.2:0/140200895 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5690101de0 0x7f5690198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:34.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:34.938+0000 7f568e7fc640 1 --2- 172.21.15.2:0/140200895 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5690101de0 0x7f5690198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:34.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:34.938+0000 7f568e7fc640 1 -- 172.21.15.2:0/140200895 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f569019d2f0 con 0x7f5690102790 2024-09-19T04:46:34.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:34.938+0000 7f568e7fc640 1 --2- 172.21.15.2:0/140200895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5690102790 0x7f5690198880 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f568400d770 tx=0x7f568400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:34.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:34.938+0000 7f5677fff640 1 -- 172.21.15.2:0/140200895 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5684017070 con 0x7f5690102790 2024-09-19T04:46:34.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:34.938+0000 7f5677fff640 1 -- 172.21.15.2:0/140200895 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f56840054d0 con 0x7f5690102790 2024-09-19T04:46:34.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:34.938+0000 7f56952b8640 1 -- 172.21.15.2:0/140200895 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f569019d5e0 con 0x7f5690102790 2024-09-19T04:46:34.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:34.938+0000 7f5677fff640 1 -- 172.21.15.2:0/140200895 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5684004cf0 con 0x7f5690102790 2024-09-19T04:46:34.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:34.938+0000 7f56952b8640 1 -- 172.21.15.2:0/140200895 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56901a4ec0 con 0x7f5690102790 2024-09-19T04:46:34.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:34.939+0000 7f56952b8640 1 -- 172.21.15.2:0/140200895 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56901032c0 con 0x7f5690102790 2024-09-19T04:46:34.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:34.940+0000 7f5677fff640 1 -- 172.21.15.2:0/140200895 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f5684004e90 con 0x7f5690102790 2024-09-19T04:46:34.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:34.941+0000 7f5677fff640 1 --2- 172.21.15.2:0/140200895 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f56780a3240 0x7f56780a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:34.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:34.941+0000 7f568effd640 1 --2- 172.21.15.2:0/140200895 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f56780a3240 0x7f56780a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:34.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:34.941+0000 7f5677fff640 1 -- 172.21.15.2:0/140200895 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f56840cf2e0 con 0x7f5690102790 2024-09-19T04:46:34.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:34.941+0000 7f568effd640 1 --2- 172.21.15.2:0/140200895 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f56780a3240 0x7f56780a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5680005fd0 tx=0x7f5680005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:34.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:34.945+0000 7f5677fff640 1 -- 172.21.15.2:0/140200895 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f568409c0b0 con 0x7f5690102790 2024-09-19T04:46:35.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:35.149+0000 7f56952b8640 1 -- 172.21.15.2:0/140200895 --> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f5690062630 con 0x7f56780a3240 2024-09-19T04:46:35.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:35.168+0000 7f5677fff640 1 -- 172.21.15.2:0/140200895 <== mgr.14150 v2:172.21.15.2:6800/3171525177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5690062630 con 0x7f56780a3240 2024-09-19T04:46:35.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:35.170+0000 7f56952b8640 1 -- 172.21.15.2:0/140200895 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f56780a3240 msgr2=0x7f56780a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:35.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:35.170+0000 7f56952b8640 1 --2- 172.21.15.2:0/140200895 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f56780a3240 0x7f56780a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5680005fd0 tx=0x7f5680005850 comp rx=0 tx=0).stop 2024-09-19T04:46:35.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:35.170+0000 7f56952b8640 1 -- 172.21.15.2:0/140200895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5690102790 msgr2=0x7f5690198880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:35.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:35.170+0000 7f56952b8640 1 --2- 172.21.15.2:0/140200895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5690102790 0x7f5690198880 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f568400d770 tx=0x7f568400dc30 comp rx=0 tx=0).stop 2024-09-19T04:46:35.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:35.170+0000 7f56952b8640 1 -- 172.21.15.2:0/140200895 shutdown_connections 2024-09-19T04:46:35.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:35.170+0000 7f56952b8640 1 --2- 172.21.15.2:0/140200895 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f56780a3240 0x7f56780a5700 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:35.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:35.170+0000 7f56952b8640 1 --2- 172.21.15.2:0/140200895 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5690106f10 0x7f569019cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:35.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:35.170+0000 7f56952b8640 1 --2- 172.21.15.2:0/140200895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5690102790 0x7f5690198880 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:35.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:35.170+0000 7f56952b8640 1 --2- 172.21.15.2:0/140200895 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5690101de0 0x7f5690198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:35.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:35.170+0000 7f56952b8640 1 -- 172.21.15.2:0/140200895 >> 172.21.15.2:0/140200895 conn(0x7f56900fd8c0 msgr2=0x7f56900fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:35.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:35.170+0000 7f56952b8640 1 -- 172.21.15.2:0/140200895 shutdown_connections 2024-09-19T04:46:35.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:35.170+0000 7f56952b8640 1 -- 172.21.15.2:0/140200895 wait complete. 2024-09-19T04:46:35.472 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:46:35 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:46:35.154+0000 7faf8e56b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:46:35.472 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:46:35 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:46:35.154+0000 7faf8e56b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:46:35.472 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:46:35 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:46:35.154+0000 7faf8e56b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:46:35.472 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:46:35 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:46:35.154+0000 7faf8e56b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:46:35.473 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:46:35 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:46:35.154+0000 7faf8e56b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:46:35.790 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:35 smithi002 ceph-mon[30975]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:46:35.790 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:35 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 1]}]: dispatch 2024-09-19T04:46:35.790 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:35 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-19T04:46:35.790 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:35 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2024-09-19T04:46:35.790 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:35 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]: dispatch 2024-09-19T04:46:35.790 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:35 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-09-19T04:46:35.790 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:35 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2024-09-19T04:46:35.790 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:35 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]: dispatch 2024-09-19T04:46:35.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:35 smithi018 ceph-mon[34537]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:46:35.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:35 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 1]}]: dispatch 2024-09-19T04:46:35.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:35 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-19T04:46:35.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:35 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2024-09-19T04:46:35.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:35 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]: dispatch 2024-09-19T04:46:35.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:35 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-09-19T04:46:35.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:35 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2024-09-19T04:46:35.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:35 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]: dispatch 2024-09-19T04:46:35.819 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-19T04:46:35.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:35 smithi116 ceph-mon[34477]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:46:35.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:35 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 1]}]: dispatch 2024-09-19T04:46:35.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:35 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-19T04:46:35.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:35 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2024-09-19T04:46:35.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:35 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]: dispatch 2024-09-19T04:46:35.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:35 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-09-19T04:46:35.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:35 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2024-09-19T04:46:35.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:35 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]: dispatch 2024-09-19T04:46:36.078 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:46:36.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.571+0000 7f21b9c06640 1 -- 172.21.15.2:0/4121068304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21b410ea80 msgr2=0x7f21b41154f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:36.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.571+0000 7f21b9c06640 1 --2- 172.21.15.2:0/4121068304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21b410ea80 0x7f21b41154f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f21ac005fd0 tx=0x7f21ac02b3e0 comp rx=0 tx=0).stop 2024-09-19T04:46:36.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.571+0000 7f21b9c06640 1 -- 172.21.15.2:0/4121068304 shutdown_connections 2024-09-19T04:46:36.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.571+0000 7f21b9c06640 1 --2- 172.21.15.2:0/4121068304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21b410ea80 0x7f21b41154f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:36.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.571+0000 7f21b9c06640 1 --2- 172.21.15.2:0/4121068304 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f21b4109e00 0x7f21b410e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:36.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.571+0000 7f21b9c06640 1 --2- 172.21.15.2:0/4121068304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21b4109450 0x7f21b4109830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:36.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.571+0000 7f21b9c06640 1 -- 172.21.15.2:0/4121068304 >> 172.21.15.2:0/4121068304 conn(0x7f21b406e2d0 msgr2=0x7f21b406e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:36.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.571+0000 7f21b9c06640 1 -- 172.21.15.2:0/4121068304 shutdown_connections 2024-09-19T04:46:36.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.571+0000 7f21b9c06640 1 -- 172.21.15.2:0/4121068304 wait complete. 2024-09-19T04:46:36.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.571+0000 7f21b9c06640 1 Processor -- start 2024-09-19T04:46:36.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.572+0000 7f21b9c06640 1 -- start start 2024-09-19T04:46:36.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.572+0000 7f21b9c06640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21b4109450 0x7f21b410a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:36.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.572+0000 7f21b9c06640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21b4109e00 0x7f21b410a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:36.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.572+0000 7f21b9c06640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f21b410ea80 0x7f21b410ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:36.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.572+0000 7f21b9c06640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f21b41184c0 con 0x7f21b4109450 2024-09-19T04:46:36.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.572+0000 7f21b9c06640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f21b4118340 con 0x7f21b4109e00 2024-09-19T04:46:36.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.572+0000 7f21b9c06640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f21b4118640 con 0x7f21b410ea80 2024-09-19T04:46:36.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.572+0000 7f21b37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21b4109450 0x7f21b410a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:36.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.572+0000 7f21b37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21b4109450 0x7f21b410a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51642/0 (socket says 172.21.15.2:51642) 2024-09-19T04:46:36.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.572+0000 7f21b37fe640 1 -- 172.21.15.2:0/1319047578 learned_addr learned my addr 172.21.15.2:0/1319047578 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:46:36.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.572+0000 7f21b2ffd640 1 --2- 172.21.15.2:0/1319047578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21b4109e00 0x7f21b410a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:36.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.572+0000 7f21b3fff640 1 --2- 172.21.15.2:0/1319047578 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f21b410ea80 0x7f21b410ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:36.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.572+0000 7f21b37fe640 1 -- 172.21.15.2:0/1319047578 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f21b410ea80 msgr2=0x7f21b410ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:36.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.572+0000 7f21b37fe640 1 --2- 172.21.15.2:0/1319047578 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f21b410ea80 0x7f21b410ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:36.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.572+0000 7f21b37fe640 1 -- 172.21.15.2:0/1319047578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21b4109e00 msgr2=0x7f21b410a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:36.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.572+0000 7f21b37fe640 1 --2- 172.21.15.2:0/1319047578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21b4109e00 0x7f21b410a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:36.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.572+0000 7f21b37fe640 1 -- 172.21.15.2:0/1319047578 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21b41af0c0 con 0x7f21b4109450 2024-09-19T04:46:36.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.572+0000 7f21b3fff640 1 --2- 172.21.15.2:0/1319047578 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f21b410ea80 0x7f21b410ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:46:36.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.572+0000 7f21b37fe640 1 --2- 172.21.15.2:0/1319047578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21b4109450 0x7f21b410a3e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f21a400d950 tx=0x7f21a400dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:36.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.573+0000 7f21b0ff9640 1 -- 172.21.15.2:0/1319047578 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a4017070 con 0x7f21b4109450 2024-09-19T04:46:36.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.573+0000 7f21b0ff9640 1 -- 172.21.15.2:0/1319047578 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f21a400de80 con 0x7f21b4109450 2024-09-19T04:46:36.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.573+0000 7f21b9c06640 1 -- 172.21.15.2:0/1319047578 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21b41af3b0 con 0x7f21b4109450 2024-09-19T04:46:36.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.573+0000 7f21b0ff9640 1 -- 172.21.15.2:0/1319047578 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a400f620 con 0x7f21b4109450 2024-09-19T04:46:36.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.573+0000 7f21b9c06640 1 -- 172.21.15.2:0/1319047578 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21b41af8f0 con 0x7f21b4109450 2024-09-19T04:46:36.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.574+0000 7f21b9c06640 1 -- 172.21.15.2:0/1319047578 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21b4109830 con 0x7f21b4109450 2024-09-19T04:46:36.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.575+0000 7f21b0ff9640 1 -- 172.21.15.2:0/1319047578 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f21a4009c30 con 0x7f21b4109450 2024-09-19T04:46:36.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.576+0000 7f21b0ff9640 1 --2- 172.21.15.2:0/1319047578 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f219c0a32d0 0x7f219c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:36.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.576+0000 7f21b2ffd640 1 --2- 172.21.15.2:0/1319047578 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f219c0a32d0 0x7f219c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:36.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.576+0000 7f21b0ff9640 1 -- 172.21.15.2:0/1319047578 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f21a40cf6e0 con 0x7f21b4109450 2024-09-19T04:46:36.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.576+0000 7f21b2ffd640 1 --2- 172.21.15.2:0/1319047578 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f219c0a32d0 0x7f219c0a5790 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f21b410be70 tx=0x7f21a8009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:36.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.580+0000 7f21b0ff9640 1 -- 172.21.15.2:0/1319047578 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f21a409c2d0 con 0x7f21b4109450 2024-09-19T04:46:36.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.782+0000 7f21b9c06640 1 -- 172.21.15.2:0/1319047578 --> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f21b4112ba0 con 0x7f219c0a32d0 2024-09-19T04:46:36.784 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:36 smithi002 ceph-mon[30975]: pgmap v278: 97 pgs: 97 active+clean; 579 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1019 B/s rd, 1.3 KiB/s wr, 5 op/s 2024-09-19T04:46:36.784 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:36 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 1]}]': finished 2024-09-19T04:46:36.784 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:36 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-19T04:46:36.785 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:36 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-09-19T04:46:36.785 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:36 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-09-19T04:46:36.785 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:36 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-09-19T04:46:36.785 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:36 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-09-19T04:46:36.785 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:36 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]': finished 2024-09-19T04:46:36.785 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:36 smithi002 ceph-mon[30975]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T04:46:36.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:36 smithi018 ceph-mon[34537]: pgmap v278: 97 pgs: 97 active+clean; 579 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1019 B/s rd, 1.3 KiB/s wr, 5 op/s 2024-09-19T04:46:36.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:36 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 1]}]': finished 2024-09-19T04:46:36.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:36 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-19T04:46:36.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:36 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-09-19T04:46:36.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:36 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-09-19T04:46:36.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:36 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-09-19T04:46:36.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:36 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-09-19T04:46:36.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:36 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]': finished 2024-09-19T04:46:36.808 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:36 smithi018 ceph-mon[34537]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T04:46:36.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.807+0000 7f21b0ff9640 1 -- 172.21.15.2:0/1319047578 <== mgr.14150 v2:172.21.15.2:6800/3171525177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f21a80095e0 con 0x7f219c0a32d0 2024-09-19T04:46:36.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.809+0000 7f21b9c06640 1 -- 172.21.15.2:0/1319047578 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f219c0a32d0 msgr2=0x7f219c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:36.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.809+0000 7f21b9c06640 1 --2- 172.21.15.2:0/1319047578 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f219c0a32d0 0x7f219c0a5790 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f21b410be70 tx=0x7f21a8009110 comp rx=0 tx=0).stop 2024-09-19T04:46:36.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.809+0000 7f21b9c06640 1 -- 172.21.15.2:0/1319047578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21b4109450 msgr2=0x7f21b410a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:36.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.809+0000 7f21b9c06640 1 --2- 172.21.15.2:0/1319047578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21b4109450 0x7f21b410a3e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f21a400d950 tx=0x7f21a400dd50 comp rx=0 tx=0).stop 2024-09-19T04:46:36.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.809+0000 7f21b9c06640 1 -- 172.21.15.2:0/1319047578 shutdown_connections 2024-09-19T04:46:36.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.809+0000 7f21b9c06640 1 --2- 172.21.15.2:0/1319047578 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f219c0a32d0 0x7f219c0a5790 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:36.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.809+0000 7f21b9c06640 1 --2- 172.21.15.2:0/1319047578 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f21b410ea80 0x7f21b410ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:36.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.809+0000 7f21b9c06640 1 --2- 172.21.15.2:0/1319047578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21b4109e00 0x7f21b410a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:36.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.809+0000 7f21b9c06640 1 --2- 172.21.15.2:0/1319047578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21b4109450 0x7f21b410a3e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:36.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.809+0000 7f21b9c06640 1 -- 172.21.15.2:0/1319047578 >> 172.21.15.2:0/1319047578 conn(0x7f21b406e2d0 msgr2=0x7f21b410c920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:36.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.810+0000 7f21b9c06640 1 -- 172.21.15.2:0/1319047578 shutdown_connections 2024-09-19T04:46:36.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:36.810+0000 7f21b9c06640 1 -- 172.21.15.2:0/1319047578 wait complete. 2024-09-19T04:46:36.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:36 smithi116 ceph-mon[34477]: pgmap v278: 97 pgs: 97 active+clean; 579 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1019 B/s rd, 1.3 KiB/s wr, 5 op/s 2024-09-19T04:46:36.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:36 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 1]}]': finished 2024-09-19T04:46:36.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:36 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-19T04:46:36.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:36 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-09-19T04:46:36.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:36 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-09-19T04:46:36.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:36 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-09-19T04:46:36.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:36 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-09-19T04:46:36.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:36 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]': finished 2024-09-19T04:46:36.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:36 smithi116 ceph-mon[34477]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T04:46:37.471 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-19T04:46:37.734 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:46:37.856 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:37 smithi002 ceph-mon[30975]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T04:46:37.856 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:37 smithi002 ceph-mon[30975]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T04:46:37.856 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:37 smithi002 ceph-mon[30975]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:46:37.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:37 smithi116 ceph-mon[34477]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T04:46:37.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:37 smithi116 ceph-mon[34477]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T04:46:37.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:37 smithi116 ceph-mon[34477]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:46:38.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:37 smithi018 ceph-mon[34537]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T04:46:38.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:37 smithi018 ceph-mon[34537]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T04:46:38.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:37 smithi018 ceph-mon[34537]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:46:38.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.178+0000 7fc800789640 1 -- 172.21.15.2:0/3695078840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7f810c170 msgr2=0x7fc7f810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:38.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.178+0000 7fc800789640 1 --2- 172.21.15.2:0/3695078840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7f810c170 0x7fc7f810e610 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc7f0009ca0 tx=0x7fc7f002a950 comp rx=0 tx=0).stop 2024-09-19T04:46:38.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.178+0000 7fc800789640 1 -- 172.21.15.2:0/3695078840 shutdown_connections 2024-09-19T04:46:38.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.178+0000 7fc800789640 1 --2- 172.21.15.2:0/3695078840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7f810c170 0x7fc7f810e610 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:38.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.178+0000 7fc800789640 1 --2- 172.21.15.2:0/3695078840 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7f8103660 0x7fc7f810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:38.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.178+0000 7fc800789640 1 --2- 172.21.15.2:0/3695078840 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7f8102d40 0x7fc7f8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:38.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.178+0000 7fc800789640 1 -- 172.21.15.2:0/3695078840 >> 172.21.15.2:0/3695078840 conn(0x7fc7f80fc7a0 msgr2=0x7fc7f80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:38.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.178+0000 7fc800789640 1 -- 172.21.15.2:0/3695078840 shutdown_connections 2024-09-19T04:46:38.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.178+0000 7fc800789640 1 -- 172.21.15.2:0/3695078840 wait complete. 2024-09-19T04:46:38.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.178+0000 7fc800789640 1 Processor -- start 2024-09-19T04:46:38.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.178+0000 7fc800789640 1 -- start start 2024-09-19T04:46:38.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.178+0000 7fc800789640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7f8102d40 0x7fc7f819a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:38.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.178+0000 7fc800789640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7f8103660 0x7fc7f819a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:38.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.178+0000 7fc800789640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7f810c170 0x7fc7f819ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:38.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.179+0000 7fc800789640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f8111e00 con 0x7fc7f8102d40 2024-09-19T04:46:38.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.179+0000 7fc800789640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f8111c80 con 0x7fc7f810c170 2024-09-19T04:46:38.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.179+0000 7fc800789640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f8111f80 con 0x7fc7f8103660 2024-09-19T04:46:38.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.179+0000 7fc7fe525640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7f8102d40 0x7fc7f819a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:38.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.179+0000 7fc7fe525640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7f8102d40 0x7fc7f819a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51674/0 (socket says 172.21.15.2:51674) 2024-09-19T04:46:38.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.179+0000 7fc7fe525640 1 -- 172.21.15.2:0/226499522 learned_addr learned my addr 172.21.15.2:0/226499522 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:46:38.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.179+0000 7fc7fed26640 1 --2- 172.21.15.2:0/226499522 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7f810c170 0x7fc7f819ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:38.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.179+0000 7fc7fdd24640 1 --2- 172.21.15.2:0/226499522 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7f8103660 0x7fc7f819a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:38.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.179+0000 7fc7fe525640 1 -- 172.21.15.2:0/226499522 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7f8103660 msgr2=0x7fc7f819a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:38.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.179+0000 7fc7fe525640 1 --2- 172.21.15.2:0/226499522 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7f8103660 0x7fc7f819a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:38.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.179+0000 7fc7fe525640 1 -- 172.21.15.2:0/226499522 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7f810c170 msgr2=0x7fc7f819ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:38.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.179+0000 7fc7fe525640 1 --2- 172.21.15.2:0/226499522 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7f810c170 0x7fc7f819ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:38.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.179+0000 7fc7fe525640 1 -- 172.21.15.2:0/226499522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7f819f420 con 0x7fc7f8102d40 2024-09-19T04:46:38.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.179+0000 7fc7fe525640 1 --2- 172.21.15.2:0/226499522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7f8102d40 0x7fc7f819a470 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc7f400c920 tx=0x7fc7f400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:38.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.179+0000 7fc7ef7fe640 1 -- 172.21.15.2:0/226499522 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f4007c70 con 0x7fc7f8102d40 2024-09-19T04:46:38.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.179+0000 7fc7ef7fe640 1 -- 172.21.15.2:0/226499522 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc7f4007e10 con 0x7fc7f8102d40 2024-09-19T04:46:38.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.179+0000 7fc800789640 1 -- 172.21.15.2:0/226499522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7f819f710 con 0x7fc7f8102d40 2024-09-19T04:46:38.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.179+0000 7fc7ef7fe640 1 -- 172.21.15.2:0/226499522 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f4018820 con 0x7fc7f8102d40 2024-09-19T04:46:38.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.179+0000 7fc800789640 1 -- 172.21.15.2:0/226499522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7f81a6ff0 con 0x7fc7f8102d40 2024-09-19T04:46:38.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.180+0000 7fc800789640 1 -- 172.21.15.2:0/226499522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7f8103120 con 0x7fc7f8102d40 2024-09-19T04:46:38.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.181+0000 7fc7ef7fe640 1 -- 172.21.15.2:0/226499522 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fc7f40189c0 con 0x7fc7f8102d40 2024-09-19T04:46:38.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.182+0000 7fc7ef7fe640 1 --2- 172.21.15.2:0/226499522 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fc7e40a3350 0x7fc7e40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:38.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.182+0000 7fc7fdd24640 1 --2- 172.21.15.2:0/226499522 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fc7e40a3350 0x7fc7e40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:38.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.182+0000 7fc7ef7fe640 1 -- 172.21.15.2:0/226499522 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fc7f40cffe0 con 0x7fc7f8102d40 2024-09-19T04:46:38.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.183+0000 7fc7fdd24640 1 --2- 172.21.15.2:0/226499522 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fc7e40a3350 0x7fc7e40a5810 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc7f810dfe0 tx=0x7fc7e8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:38.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.185+0000 7fc7ef7fe640 1 -- 172.21.15.2:0/226499522 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc7f4014030 con 0x7fc7f8102d40 2024-09-19T04:46:38.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.390+0000 7fc800789640 1 -- 172.21.15.2:0/226499522 --> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fc7f80fe2a0 con 0x7fc7e40a3350 2024-09-19T04:46:38.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.395+0000 7fc7ef7fe640 1 -- 172.21.15.2:0/226499522 <== mgr.14150 v2:172.21.15.2:6800/3171525177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fc7f80fe2a0 con 0x7fc7e40a3350 2024-09-19T04:46:38.397 INFO:teuthology.orchestra.run.smithi002.stdout:/volumes/qa/sv_0/b818eb68-79b7-4204-bd66-083d29d75e70 2024-09-19T04:46:38.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.397+0000 7fc800789640 1 -- 172.21.15.2:0/226499522 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fc7e40a3350 msgr2=0x7fc7e40a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:38.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.397+0000 7fc800789640 1 --2- 172.21.15.2:0/226499522 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fc7e40a3350 0x7fc7e40a5810 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc7f810dfe0 tx=0x7fc7e8005f90 comp rx=0 tx=0).stop 2024-09-19T04:46:38.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.397+0000 7fc800789640 1 -- 172.21.15.2:0/226499522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7f8102d40 msgr2=0x7fc7f819a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:38.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.397+0000 7fc800789640 1 --2- 172.21.15.2:0/226499522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7f8102d40 0x7fc7f819a470 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc7f400c920 tx=0x7fc7f400cde0 comp rx=0 tx=0).stop 2024-09-19T04:46:38.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.397+0000 7fc800789640 1 -- 172.21.15.2:0/226499522 shutdown_connections 2024-09-19T04:46:38.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.397+0000 7fc800789640 1 --2- 172.21.15.2:0/226499522 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fc7e40a3350 0x7fc7e40a5810 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:38.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.397+0000 7fc800789640 1 --2- 172.21.15.2:0/226499522 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7f810c170 0x7fc7f819ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:38.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.397+0000 7fc800789640 1 --2- 172.21.15.2:0/226499522 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7f8103660 0x7fc7f819a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:38.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.397+0000 7fc800789640 1 --2- 172.21.15.2:0/226499522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7f8102d40 0x7fc7f819a470 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:38.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.397+0000 7fc800789640 1 -- 172.21.15.2:0/226499522 >> 172.21.15.2:0/226499522 conn(0x7fc7f80fc7a0 msgr2=0x7fc7f80fcb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:38.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.397+0000 7fc800789640 1 -- 172.21.15.2:0/226499522 shutdown_connections 2024-09-19T04:46:38.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:38.397+0000 7fc800789640 1 -- 172.21.15.2:0/226499522 wait complete. 2024-09-19T04:46:38.859 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:38 smithi002 ceph-mon[30975]: pgmap v281: 97 pgs: 97 active+clean; 579 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-19T04:46:38.859 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:38 smithi002 ceph-mon[30975]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:46:38.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:38 smithi116 ceph-mon[34477]: pgmap v281: 97 pgs: 97 active+clean; 579 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-19T04:46:38.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:38 smithi116 ceph-mon[34477]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:46:39.008 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-19T04:46:39.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:38 smithi018 ceph-mon[34537]: pgmap v281: 97 pgs: 97 active+clean; 579 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-19T04:46:39.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:38 smithi018 ceph-mon[34537]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:46:39.265 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:46:39.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.710+0000 7fe8c1a0b640 1 -- 172.21.15.2:0/2211494881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8bc10c170 msgr2=0x7fe8bc10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:39.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.710+0000 7fe8c1a0b640 1 --2- 172.21.15.2:0/2211494881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8bc10c170 0x7fe8bc10e610 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe8b4009ca0 tx=0x7fe8b402a950 comp rx=0 tx=0).stop 2024-09-19T04:46:39.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.710+0000 7fe8c1a0b640 1 -- 172.21.15.2:0/2211494881 shutdown_connections 2024-09-19T04:46:39.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.710+0000 7fe8c1a0b640 1 --2- 172.21.15.2:0/2211494881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8bc10c170 0x7fe8bc10e610 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:39.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.710+0000 7fe8c1a0b640 1 --2- 172.21.15.2:0/2211494881 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe8bc103660 0x7fe8bc10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:39.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.710+0000 7fe8c1a0b640 1 --2- 172.21.15.2:0/2211494881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8bc102d40 0x7fe8bc103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:39.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.710+0000 7fe8c1a0b640 1 -- 172.21.15.2:0/2211494881 >> 172.21.15.2:0/2211494881 conn(0x7fe8bc0fc7a0 msgr2=0x7fe8bc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:39.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.710+0000 7fe8c1a0b640 1 -- 172.21.15.2:0/2211494881 shutdown_connections 2024-09-19T04:46:39.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.710+0000 7fe8c1a0b640 1 -- 172.21.15.2:0/2211494881 wait complete. 2024-09-19T04:46:39.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.711+0000 7fe8c1a0b640 1 Processor -- start 2024-09-19T04:46:39.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.711+0000 7fe8c1a0b640 1 -- start start 2024-09-19T04:46:39.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.711+0000 7fe8c1a0b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8bc102d40 0x7fe8bc198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:39.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.711+0000 7fe8c1a0b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8bc103660 0x7fe8bc198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:39.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.711+0000 7fe8c1a0b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe8bc10c170 0x7fe8bc19cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:39.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.711+0000 7fe8c1a0b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe8bc111e20 con 0x7fe8bc102d40 2024-09-19T04:46:39.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.711+0000 7fe8c1a0b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe8bc111ca0 con 0x7fe8bc103660 2024-09-19T04:46:39.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.711+0000 7fe8c1a0b640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fe8bc111fa0 con 0x7fe8bc10c170 2024-09-19T04:46:39.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.711+0000 7fe8baffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8bc102d40 0x7fe8bc198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:39.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.711+0000 7fe8baffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8bc102d40 0x7fe8bc198320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51690/0 (socket says 172.21.15.2:51690) 2024-09-19T04:46:39.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.712+0000 7fe8baffd640 1 -- 172.21.15.2:0/3343717379 learned_addr learned my addr 172.21.15.2:0/3343717379 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:46:39.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.712+0000 7fe8bb7fe640 1 --2- 172.21.15.2:0/3343717379 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe8bc10c170 0x7fe8bc19cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:39.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.712+0000 7fe8b3fff640 1 --2- 172.21.15.2:0/3343717379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8bc103660 0x7fe8bc198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:39.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.712+0000 7fe8baffd640 1 -- 172.21.15.2:0/3343717379 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe8bc10c170 msgr2=0x7fe8bc19cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:39.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.712+0000 7fe8baffd640 1 --2- 172.21.15.2:0/3343717379 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe8bc10c170 0x7fe8bc19cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:39.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.712+0000 7fe8baffd640 1 -- 172.21.15.2:0/3343717379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8bc103660 msgr2=0x7fe8bc198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:39.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.712+0000 7fe8baffd640 1 --2- 172.21.15.2:0/3343717379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8bc103660 0x7fe8bc198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:39.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.712+0000 7fe8baffd640 1 -- 172.21.15.2:0/3343717379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8bc19d2d0 con 0x7fe8bc102d40 2024-09-19T04:46:39.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.712+0000 7fe8baffd640 1 --2- 172.21.15.2:0/3343717379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8bc102d40 0x7fe8bc198320 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac00c890 tx=0x7fe8ac00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:39.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.712+0000 7fe8c0a09640 1 -- 172.21.15.2:0/3343717379 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac004220 con 0x7fe8bc102d40 2024-09-19T04:46:39.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.712+0000 7fe8c1a0b640 1 -- 172.21.15.2:0/3343717379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8bc19d5c0 con 0x7fe8bc102d40 2024-09-19T04:46:39.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.712+0000 7fe8c0a09640 1 -- 172.21.15.2:0/3343717379 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe8ac0043c0 con 0x7fe8bc102d40 2024-09-19T04:46:39.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.712+0000 7fe8c0a09640 1 -- 172.21.15.2:0/3343717379 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac004a00 con 0x7fe8bc102d40 2024-09-19T04:46:39.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.712+0000 7fe8c1a0b640 1 -- 172.21.15.2:0/3343717379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8bc1a4ea0 con 0x7fe8bc102d40 2024-09-19T04:46:39.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.713+0000 7fe8c1a0b640 1 -- 172.21.15.2:0/3343717379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8bc103120 con 0x7fe8bc102d40 2024-09-19T04:46:39.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.714+0000 7fe8c0a09640 1 -- 172.21.15.2:0/3343717379 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fe8ac004ba0 con 0x7fe8bc102d40 2024-09-19T04:46:39.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.715+0000 7fe8c0a09640 1 --2- 172.21.15.2:0/3343717379 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe8a80a32d0 0x7fe8a80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:39.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.715+0000 7fe8b3fff640 1 --2- 172.21.15.2:0/3343717379 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe8a80a32d0 0x7fe8a80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:39.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.715+0000 7fe8c0a09640 1 -- 172.21.15.2:0/3343717379 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fe8ac0cf840 con 0x7fe8bc102d40 2024-09-19T04:46:39.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.716+0000 7fe8b3fff640 1 --2- 172.21.15.2:0/3343717379 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe8a80a32d0 0x7fe8a80a5790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe8a4005d70 tx=0x7fe8a4005d00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:39.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.719+0000 7fe8c0a09640 1 -- 172.21.15.2:0/3343717379 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe8ac014030 con 0x7fe8bc102d40 2024-09-19T04:46:39.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.922+0000 7fe8c1a0b640 1 -- 172.21.15.2:0/3343717379 --> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fe8bc062630 con 0x7fe8a80a32d0 2024-09-19T04:46:39.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.945+0000 7fe8c0a09640 1 -- 172.21.15.2:0/3343717379 <== mgr.14150 v2:172.21.15.2:6800/3171525177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe8bc062630 con 0x7fe8a80a32d0 2024-09-19T04:46:39.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.947+0000 7fe8c1a0b640 1 -- 172.21.15.2:0/3343717379 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe8a80a32d0 msgr2=0x7fe8a80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:39.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.947+0000 7fe8c1a0b640 1 --2- 172.21.15.2:0/3343717379 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe8a80a32d0 0x7fe8a80a5790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe8a4005d70 tx=0x7fe8a4005d00 comp rx=0 tx=0).stop 2024-09-19T04:46:39.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.947+0000 7fe8c1a0b640 1 -- 172.21.15.2:0/3343717379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8bc102d40 msgr2=0x7fe8bc198320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:39.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.947+0000 7fe8c1a0b640 1 --2- 172.21.15.2:0/3343717379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8bc102d40 0x7fe8bc198320 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac00c890 tx=0x7fe8ac00cd50 comp rx=0 tx=0).stop 2024-09-19T04:46:39.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.947+0000 7fe8c1a0b640 1 -- 172.21.15.2:0/3343717379 shutdown_connections 2024-09-19T04:46:39.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.947+0000 7fe8c1a0b640 1 --2- 172.21.15.2:0/3343717379 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe8a80a32d0 0x7fe8a80a5790 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:39.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.947+0000 7fe8c1a0b640 1 --2- 172.21.15.2:0/3343717379 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe8bc10c170 0x7fe8bc19cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:39.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.947+0000 7fe8c1a0b640 1 --2- 172.21.15.2:0/3343717379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8bc103660 0x7fe8bc198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:39.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.947+0000 7fe8c1a0b640 1 --2- 172.21.15.2:0/3343717379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8bc102d40 0x7fe8bc198320 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:39.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.947+0000 7fe8c1a0b640 1 -- 172.21.15.2:0/3343717379 >> 172.21.15.2:0/3343717379 conn(0x7fe8bc0fc7a0 msgr2=0x7fe8bc0fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:39.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.947+0000 7fe8c1a0b640 1 -- 172.21.15.2:0/3343717379 shutdown_connections 2024-09-19T04:46:39.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:39.947+0000 7fe8c1a0b640 1 -- 172.21.15.2:0/3343717379 wait complete. 2024-09-19T04:46:40.538 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-19T04:46:40.794 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:46:41.181 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:41 smithi002 ceph-mon[30975]: pgmap v282: 97 pgs: 97 active+clean; 599 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 3.1 KiB/s wr, 4 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T04:46:41.181 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:41 smithi002 ceph-mon[30975]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:46:41.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.266+0000 7faa38927640 1 -- 172.21.15.2:0/3310110131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa34101430 msgr2=0x7faa3410d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:41.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.266+0000 7faa38927640 1 --2- 172.21.15.2:0/3310110131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa34101430 0x7faa3410d960 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7faa2c009cd0 tx=0x7faa2c02a8e0 comp rx=0 tx=0).stop 2024-09-19T04:46:41.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.266+0000 7faa38927640 1 -- 172.21.15.2:0/3310110131 shutdown_connections 2024-09-19T04:46:41.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.266+0000 7faa38927640 1 --2- 172.21.15.2:0/3310110131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa34101430 0x7faa3410d960 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:41.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.266+0000 7faa38927640 1 --2- 172.21.15.2:0/3310110131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa34100a90 0x7faa34100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:41.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.266+0000 7faa38927640 1 --2- 172.21.15.2:0/3310110131 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa34106a90 0x7faa34106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:41.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.266+0000 7faa38927640 1 -- 172.21.15.2:0/3310110131 >> 172.21.15.2:0/3310110131 conn(0x7faa340fc7d0 msgr2=0x7faa340febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:41.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.266+0000 7faa38927640 1 -- 172.21.15.2:0/3310110131 shutdown_connections 2024-09-19T04:46:41.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.266+0000 7faa38927640 1 -- 172.21.15.2:0/3310110131 wait complete. 2024-09-19T04:46:41.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.267+0000 7faa38927640 1 Processor -- start 2024-09-19T04:46:41.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.267+0000 7faa38927640 1 -- start start 2024-09-19T04:46:41.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.267+0000 7faa38927640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa34100a90 0x7faa34102660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:41.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.267+0000 7faa38927640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa34101430 0x7faa34102ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:41.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.267+0000 7faa38927640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa34106a90 0x7faa341030e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:41.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.267+0000 7faa38927640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faa34110d60 con 0x7faa34101430 2024-09-19T04:46:41.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.267+0000 7faa38927640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7faa34110be0 con 0x7faa34100a90 2024-09-19T04:46:41.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.267+0000 7faa38927640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7faa34110ee0 con 0x7faa34106a90 2024-09-19T04:46:41.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.267+0000 7faa31d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa34101430 0x7faa34102ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:41.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.267+0000 7faa31d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa34101430 0x7faa34102ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51700/0 (socket says 172.21.15.2:51700) 2024-09-19T04:46:41.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.267+0000 7faa31d9b640 1 -- 172.21.15.2:0/348888686 learned_addr learned my addr 172.21.15.2:0/348888686 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:46:41.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.267+0000 7faa32d9d640 1 --2- 172.21.15.2:0/348888686 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa34106a90 0x7faa341030e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:41.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.267+0000 7faa3259c640 1 --2- 172.21.15.2:0/348888686 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa34100a90 0x7faa34102660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:41.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.267+0000 7faa31d9b640 1 -- 172.21.15.2:0/348888686 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa34106a90 msgr2=0x7faa341030e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:41.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.267+0000 7faa31d9b640 1 --2- 172.21.15.2:0/348888686 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa34106a90 0x7faa341030e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:41.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.267+0000 7faa31d9b640 1 -- 172.21.15.2:0/348888686 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa34100a90 msgr2=0x7faa34102660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:41.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.267+0000 7faa31d9b640 1 --2- 172.21.15.2:0/348888686 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa34100a90 0x7faa34102660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:41.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.267+0000 7faa31d9b640 1 -- 172.21.15.2:0/348888686 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa341a67b0 con 0x7faa34101430 2024-09-19T04:46:41.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.268+0000 7faa31d9b640 1 --2- 172.21.15.2:0/348888686 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa34101430 0x7faa34102ba0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7faa2800c920 tx=0x7faa2800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:41.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.268+0000 7faa237fe640 1 -- 172.21.15.2:0/348888686 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa28007c70 con 0x7faa34101430 2024-09-19T04:46:41.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.268+0000 7faa38927640 1 -- 172.21.15.2:0/348888686 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa341a6aa0 con 0x7faa34101430 2024-09-19T04:46:41.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.268+0000 7faa237fe640 1 -- 172.21.15.2:0/348888686 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7faa28007e10 con 0x7faa34101430 2024-09-19T04:46:41.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.268+0000 7faa237fe640 1 -- 172.21.15.2:0/348888686 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa28018820 con 0x7faa34101430 2024-09-19T04:46:41.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.268+0000 7faa38927640 1 -- 172.21.15.2:0/348888686 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa341a6fe0 con 0x7faa34101430 2024-09-19T04:46:41.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.269+0000 7faa38927640 1 -- 172.21.15.2:0/348888686 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa34100ef0 con 0x7faa34101430 2024-09-19T04:46:41.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.270+0000 7faa237fe640 1 -- 172.21.15.2:0/348888686 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7faa280189c0 con 0x7faa34101430 2024-09-19T04:46:41.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.271+0000 7faa237fe640 1 --2- 172.21.15.2:0/348888686 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7faa1c0a32d0 0x7faa1c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:41.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.271+0000 7faa3259c640 1 --2- 172.21.15.2:0/348888686 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7faa1c0a32d0 0x7faa1c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:41.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.271+0000 7faa237fe640 1 -- 172.21.15.2:0/348888686 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7faa280cfc70 con 0x7faa34101430 2024-09-19T04:46:41.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.271+0000 7faa3259c640 1 --2- 172.21.15.2:0/348888686 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7faa1c0a32d0 0x7faa1c0a5790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7faa24009890 tx=0x7faa24008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:41.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.275+0000 7faa237fe640 1 -- 172.21.15.2:0/348888686 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7faa28014030 con 0x7faa34101430 2024-09-19T04:46:41.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:41 smithi018 ceph-mon[34537]: pgmap v282: 97 pgs: 97 active+clean; 599 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 3.1 KiB/s wr, 4 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T04:46:41.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:41 smithi018 ceph-mon[34537]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:46:41.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:41 smithi116 ceph-mon[34477]: pgmap v282: 97 pgs: 97 active+clean; 599 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 3.1 KiB/s wr, 4 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T04:46:41.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:41 smithi116 ceph-mon[34477]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:46:41.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.480+0000 7faa38927640 1 -- 172.21.15.2:0/348888686 --> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7faa3406af20 con 0x7faa1c0a32d0 2024-09-19T04:46:41.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.484+0000 7faa237fe640 1 -- 172.21.15.2:0/348888686 <== mgr.14150 v2:172.21.15.2:6800/3171525177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7faa3406af20 con 0x7faa1c0a32d0 2024-09-19T04:46:41.486 INFO:teuthology.orchestra.run.smithi002.stdout:/volumes/qa/sv_1/0b5581a3-63f6-4a31-bfca-a1b0fae9f8c2 2024-09-19T04:46:41.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.486+0000 7faa38927640 1 -- 172.21.15.2:0/348888686 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7faa1c0a32d0 msgr2=0x7faa1c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:41.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.486+0000 7faa38927640 1 --2- 172.21.15.2:0/348888686 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7faa1c0a32d0 0x7faa1c0a5790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7faa24009890 tx=0x7faa24008040 comp rx=0 tx=0).stop 2024-09-19T04:46:41.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.486+0000 7faa38927640 1 -- 172.21.15.2:0/348888686 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa34101430 msgr2=0x7faa34102ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:41.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.486+0000 7faa38927640 1 --2- 172.21.15.2:0/348888686 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa34101430 0x7faa34102ba0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7faa2800c920 tx=0x7faa2800cde0 comp rx=0 tx=0).stop 2024-09-19T04:46:41.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.487+0000 7faa38927640 1 -- 172.21.15.2:0/348888686 shutdown_connections 2024-09-19T04:46:41.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.487+0000 7faa38927640 1 --2- 172.21.15.2:0/348888686 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7faa1c0a32d0 0x7faa1c0a5790 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:41.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.487+0000 7faa38927640 1 --2- 172.21.15.2:0/348888686 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa34106a90 0x7faa341030e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:41.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.487+0000 7faa38927640 1 --2- 172.21.15.2:0/348888686 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa34101430 0x7faa34102ba0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:41.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.487+0000 7faa38927640 1 --2- 172.21.15.2:0/348888686 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa34100a90 0x7faa34102660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:41.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.487+0000 7faa38927640 1 -- 172.21.15.2:0/348888686 >> 172.21.15.2:0/348888686 conn(0x7faa340fc7d0 msgr2=0x7faa3406a810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:41.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.487+0000 7faa38927640 1 -- 172.21.15.2:0/348888686 shutdown_connections 2024-09-19T04:46:41.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:41.487+0000 7faa38927640 1 -- 172.21.15.2:0/348888686 wait complete. 2024-09-19T04:46:42.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:42 smithi002 ceph-mon[30975]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:46:42.167 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:46:42.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:42 smithi018 ceph-mon[34537]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:46:42.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:42 smithi116 ceph-mon[34477]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:46:42.426 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:46:42.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:42.861+0000 7f375d113640 1 -- 172.21.15.2:0/2458297928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3758106f20 msgr2=0x7f375810eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:42.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:42.861+0000 7f375d113640 1 --2- 172.21.15.2:0/2458297928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3758106f20 0x7f375810eaa0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3748009900 tx=0x7f374802a410 comp rx=0 tx=0).stop 2024-09-19T04:46:42.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:42.861+0000 7f375d113640 1 -- 172.21.15.2:0/2458297928 shutdown_connections 2024-09-19T04:46:42.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:42.861+0000 7f375d113640 1 --2- 172.21.15.2:0/2458297928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3758106f20 0x7f375810eaa0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:42.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:42.861+0000 7f375d113640 1 --2- 172.21.15.2:0/2458297928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37581027a0 0x7f37581067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:42.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:42.861+0000 7f375d113640 1 --2- 172.21.15.2:0/2458297928 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3758101df0 0x7f37581021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:42.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:42.861+0000 7f375d113640 1 -- 172.21.15.2:0/2458297928 >> 172.21.15.2:0/2458297928 conn(0x7f37580fd8f0 msgr2=0x7f37580ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:42.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:42.861+0000 7f375d113640 1 -- 172.21.15.2:0/2458297928 shutdown_connections 2024-09-19T04:46:42.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:42.861+0000 7f375d113640 1 -- 172.21.15.2:0/2458297928 wait complete. 2024-09-19T04:46:42.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:42.862+0000 7f375d113640 1 Processor -- start 2024-09-19T04:46:42.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:42.862+0000 7f375d113640 1 -- start start 2024-09-19T04:46:42.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:42.862+0000 7f375d113640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3758101df0 0x7f37580744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:42.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:42.862+0000 7f375d113640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37581027a0 0x7f3758074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:42.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:42.862+0000 7f375d113640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3758106f20 0x7f3758074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:42.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:42.862+0000 7f375d113640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3758111e50 con 0x7f3758106f20 2024-09-19T04:46:42.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:42.862+0000 7f375d113640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3758111cd0 con 0x7f37581027a0 2024-09-19T04:46:42.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:42.862+0000 7f375d113640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f3758111fd0 con 0x7f3758101df0 2024-09-19T04:46:42.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:42.862+0000 7f375759e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3758106f20 0x7f3758074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:42.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:42.862+0000 7f375759e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3758106f20 0x7f3758074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40594/0 (socket says 172.21.15.2:40594) 2024-09-19T04:46:42.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:42.862+0000 7f375759e640 1 -- 172.21.15.2:0/771694139 learned_addr learned my addr 172.21.15.2:0/771694139 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:46:42.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:42.862+0000 7f375659c640 1 --2- 172.21.15.2:0/771694139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37581027a0 0x7f3758074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:42.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:42.863+0000 7f3756d9d640 1 --2- 172.21.15.2:0/771694139 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3758101df0 0x7f37580744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:42.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:42.863+0000 7f375759e640 1 -- 172.21.15.2:0/771694139 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3758101df0 msgr2=0x7f37580744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:42.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:42.863+0000 7f375759e640 1 --2- 172.21.15.2:0/771694139 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3758101df0 0x7f37580744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:42.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:42.863+0000 7f375759e640 1 -- 172.21.15.2:0/771694139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37581027a0 msgr2=0x7f3758074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:42.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:42.863+0000 7f375759e640 1 --2- 172.21.15.2:0/771694139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37581027a0 0x7f3758074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:42.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:42.863+0000 7f375759e640 1 -- 172.21.15.2:0/771694139 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37581a6850 con 0x7f3758106f20 2024-09-19T04:46:42.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:42.863+0000 7f375759e640 1 --2- 172.21.15.2:0/771694139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3758106f20 0x7f3758074f70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3748009230 tx=0x7f3748004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:42.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:42.863+0000 7f374ffff640 1 -- 172.21.15.2:0/771694139 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f374803f030 con 0x7f3758106f20 2024-09-19T04:46:42.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:42.863+0000 7f375d113640 1 -- 172.21.15.2:0/771694139 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37581a6ae0 con 0x7f3758106f20 2024-09-19T04:46:42.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:42.863+0000 7f374ffff640 1 -- 172.21.15.2:0/771694139 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3748003aa0 con 0x7f3758106f20 2024-09-19T04:46:42.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:42.863+0000 7f374ffff640 1 -- 172.21.15.2:0/771694139 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3748035070 con 0x7f3758106f20 2024-09-19T04:46:42.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:42.863+0000 7f375d113640 1 -- 172.21.15.2:0/771694139 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37581a7010 con 0x7f3758106f20 2024-09-19T04:46:42.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:42.864+0000 7f375d113640 1 -- 172.21.15.2:0/771694139 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37581021d0 con 0x7f3758106f20 2024-09-19T04:46:42.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:42.865+0000 7f374ffff640 1 -- 172.21.15.2:0/771694139 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f3748042030 con 0x7f3758106f20 2024-09-19T04:46:42.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:42.866+0000 7f374ffff640 1 --2- 172.21.15.2:0/771694139 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f37440a32d0 0x7f37440a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:42.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:42.867+0000 7f3756d9d640 1 --2- 172.21.15.2:0/771694139 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f37440a32d0 0x7f37440a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:42.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:42.867+0000 7f374ffff640 1 -- 172.21.15.2:0/771694139 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f37480effe0 con 0x7f3758106f20 2024-09-19T04:46:42.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:42.867+0000 7f3756d9d640 1 --2- 172.21.15.2:0/771694139 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f37440a32d0 0x7f37440a5790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3750009f20 tx=0x7f37500094f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:42.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:42.871+0000 7f374ffff640 1 -- 172.21.15.2:0/771694139 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f37480bcbd0 con 0x7f3758106f20 2024-09-19T04:46:43.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:43.086+0000 7f375d113640 1 -- 172.21.15.2:0/771694139 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f375810a100 con 0x7f3758106f20 2024-09-19T04:46:43.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:43.087+0000 7f374ffff640 1 -- 172.21.15.2:0/771694139 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11840 (secure 0 0 0) 0x7f37480bc4d0 con 0x7f3758106f20 2024-09-19T04:46:43.178 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:46:43.179 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":19,"btime":"2024-09-19T04:46:33:537239+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2467365137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2467365137},{"type":"v1","addr":"172.21.15.2:6835","nonce":2467365137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3162441888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3162441888},{"type":"v1","addr":"172.21.15.2:6837","nonce":3162441888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14631,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2740862966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2740862966},{"type":"v1","addr":"172.21.15.2:6839","nonce":2740862966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/2394435504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2394435504},{"type":"v1","addr":"172.21.15.2:6841","nonce":2394435504}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1630480244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1630480244},{"type":"v1","addr":"172.21.15.18:6833","nonce":1630480244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1553897465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1553897465},{"type":"v1","addr":"172.21.15.116:6833","nonce":1553897465}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3035664608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3035664608},{"type":"v1","addr":"172.21.15.18:6835","nonce":3035664608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1096622392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1096622392},{"type":"v1","addr":"172.21.15.18:6837","nonce":1096622392}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3761157675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3761157675},{"type":"v1","addr":"172.21.15.116:6835","nonce":3761157675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/1120131594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1120131594},{"type":"v1","addr":"172.21.15.116:6837","nonce":1120131594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:46:24.050115+0000","modified":"2024-09-19T04:46:33.112369+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/4207677139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":4207677139},{"type":"v1","addr":"172.21.15.18:6839","nonce":4207677139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/2346874880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":2346874880},{"type":"v1","addr":"172.21.15.116:6839","nonce":2346874880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496]},"id":1}]} 2024-09-19T04:46:43.179 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 19 2024-09-19T04:46:43.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:43.089+0000 7f375d113640 1 -- 172.21.15.2:0/771694139 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f37440a32d0 msgr2=0x7f37440a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:43.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:43.089+0000 7f375d113640 1 --2- 172.21.15.2:0/771694139 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f37440a32d0 0x7f37440a5790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3750009f20 tx=0x7f37500094f0 comp rx=0 tx=0).stop 2024-09-19T04:46:43.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:43.089+0000 7f375d113640 1 -- 172.21.15.2:0/771694139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3758106f20 msgr2=0x7f3758074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:43.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:43.089+0000 7f375d113640 1 --2- 172.21.15.2:0/771694139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3758106f20 0x7f3758074f70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3748009230 tx=0x7f3748004270 comp rx=0 tx=0).stop 2024-09-19T04:46:43.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:43.089+0000 7f375d113640 1 -- 172.21.15.2:0/771694139 shutdown_connections 2024-09-19T04:46:43.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:43.089+0000 7f375d113640 1 --2- 172.21.15.2:0/771694139 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f37440a32d0 0x7f37440a5790 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:43.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:43.089+0000 7f375d113640 1 --2- 172.21.15.2:0/771694139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3758106f20 0x7f3758074f70 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:43.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:43.089+0000 7f375d113640 1 --2- 172.21.15.2:0/771694139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37581027a0 0x7f3758074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:43.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:43.089+0000 7f375d113640 1 --2- 172.21.15.2:0/771694139 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3758101df0 0x7f37580744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:43.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:43.089+0000 7f375d113640 1 -- 172.21.15.2:0/771694139 >> 172.21.15.2:0/771694139 conn(0x7f37580fd8f0 msgr2=0x7f37580fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:43.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:43.089+0000 7f375d113640 1 -- 172.21.15.2:0/771694139 shutdown_connections 2024-09-19T04:46:43.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:43.089+0000 7f375d113640 1 -- 172.21.15.2:0/771694139 wait complete. 2024-09-19T04:46:43.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:43 smithi018 ceph-mon[34537]: pgmap v283: 97 pgs: 97 active+clean; 599 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 3.2 KiB/s wr, 4 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T04:46:43.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:43 smithi002 ceph-mon[30975]: pgmap v283: 97 pgs: 97 active+clean; 599 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 3.2 KiB/s wr, 4 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T04:46:43.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:43 smithi116 ceph-mon[34477]: pgmap v283: 97 pgs: 97 active+clean; 599 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 3.2 KiB/s wr, 4 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T04:46:43.655 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T04:46:43.911 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:46:44.306 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:44 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/771694139' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:46:44.352 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:44 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/771694139' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:46:44.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:44 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/771694139' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:46:44.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.350+0000 7fb98ef10640 1 -- 172.21.15.2:0/3797494239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb988102790 msgr2=0x7fb9881067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:44.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.350+0000 7fb98ef10640 1 --2- 172.21.15.2:0/3797494239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb988102790 0x7fb9881067e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb974009900 tx=0x7fb97402a410 comp rx=0 tx=0).stop 2024-09-19T04:46:44.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.350+0000 7fb98ef10640 1 -- 172.21.15.2:0/3797494239 shutdown_connections 2024-09-19T04:46:44.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.350+0000 7fb98ef10640 1 --2- 172.21.15.2:0/3797494239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb988106f10 0x7fb98810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:44.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.350+0000 7fb98ef10640 1 --2- 172.21.15.2:0/3797494239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb988102790 0x7fb9881067e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:44.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.350+0000 7fb98ef10640 1 --2- 172.21.15.2:0/3797494239 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb988101de0 0x7fb9881021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:44.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.350+0000 7fb98ef10640 1 -- 172.21.15.2:0/3797494239 >> 172.21.15.2:0/3797494239 conn(0x7fb9880fd8c0 msgr2=0x7fb9880ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:44.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.351+0000 7fb98ef10640 1 -- 172.21.15.2:0/3797494239 shutdown_connections 2024-09-19T04:46:44.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.351+0000 7fb98ef10640 1 -- 172.21.15.2:0/3797494239 wait complete. 2024-09-19T04:46:44.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.351+0000 7fb98ef10640 1 Processor -- start 2024-09-19T04:46:44.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.351+0000 7fb98ef10640 1 -- start start 2024-09-19T04:46:44.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.352+0000 7fb98ef10640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb988101de0 0x7fb9880744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:44.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.352+0000 7fb98ef10640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb988102790 0x7fb988074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:44.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.352+0000 7fb98ef10640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb988106f10 0x7fb988074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:44.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.352+0000 7fb98ef10640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb988111e20 con 0x7fb988102790 2024-09-19T04:46:44.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.352+0000 7fb98ef10640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb988111ca0 con 0x7fb988106f10 2024-09-19T04:46:44.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.352+0000 7fb98ef10640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fb988111fa0 con 0x7fb988101de0 2024-09-19T04:46:44.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.352+0000 7fb987fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb988102790 0x7fb988074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:44.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.352+0000 7fb98ccac640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb988101de0 0x7fb9880744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:44.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.352+0000 7fb987fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb988102790 0x7fb988074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40618/0 (socket says 172.21.15.2:40618) 2024-09-19T04:46:44.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.352+0000 7fb987fff640 1 -- 172.21.15.2:0/1940664570 learned_addr learned my addr 172.21.15.2:0/1940664570 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:46:44.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.352+0000 7fb98d4ad640 1 --2- 172.21.15.2:0/1940664570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb988106f10 0x7fb988074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:44.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.352+0000 7fb98ccac640 1 -- 172.21.15.2:0/1940664570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb988106f10 msgr2=0x7fb988074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:44.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.352+0000 7fb98ccac640 1 --2- 172.21.15.2:0/1940664570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb988106f10 0x7fb988074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:44.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.352+0000 7fb98ccac640 1 -- 172.21.15.2:0/1940664570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb988102790 msgr2=0x7fb988074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:44.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.352+0000 7fb98ccac640 1 --2- 172.21.15.2:0/1940664570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb988102790 0x7fb988074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:44.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.352+0000 7fb98ccac640 1 -- 172.21.15.2:0/1940664570 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9881a68b0 con 0x7fb988101de0 2024-09-19T04:46:44.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.352+0000 7fb987fff640 1 --2- 172.21.15.2:0/1940664570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb988102790 0x7fb988074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:46:44.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.353+0000 7fb98ccac640 1 --2- 172.21.15.2:0/1940664570 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb988101de0 0x7fb9880744f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb97c00e9f0 tx=0x7fb97c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:44.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.353+0000 7fb985ffb640 1 -- 172.21.15.2:0/1940664570 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb97c00ccc0 con 0x7fb988101de0 2024-09-19T04:46:44.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.353+0000 7fb98ef10640 1 -- 172.21.15.2:0/1940664570 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9881a6ba0 con 0x7fb988101de0 2024-09-19T04:46:44.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.353+0000 7fb985ffb640 1 -- 172.21.15.2:0/1940664570 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb97c005020 con 0x7fb988101de0 2024-09-19T04:46:44.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.353+0000 7fb985ffb640 1 -- 172.21.15.2:0/1940664570 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb97c004a00 con 0x7fb988101de0 2024-09-19T04:46:44.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.353+0000 7fb98ef10640 1 -- 172.21.15.2:0/1940664570 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9881a70b0 con 0x7fb988101de0 2024-09-19T04:46:44.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.354+0000 7fb98ef10640 1 -- 172.21.15.2:0/1940664570 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9881021c0 con 0x7fb988101de0 2024-09-19T04:46:44.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.355+0000 7fb985ffb640 1 -- 172.21.15.2:0/1940664570 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fb97c004ba0 con 0x7fb988101de0 2024-09-19T04:46:44.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.356+0000 7fb985ffb640 1 --2- 172.21.15.2:0/1940664570 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fb9780a32d0 0x7fb9780a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:44.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.356+0000 7fb987fff640 1 --2- 172.21.15.2:0/1940664570 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fb9780a32d0 0x7fb9780a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:44.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.356+0000 7fb985ffb640 1 -- 172.21.15.2:0/1940664570 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fb97c0cfa30 con 0x7fb988101de0 2024-09-19T04:46:44.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.356+0000 7fb987fff640 1 --2- 172.21.15.2:0/1940664570 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fb9780a32d0 0x7fb9780a5790 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb974031440 tx=0x7fb9740058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:44.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.361+0000 7fb985ffb640 1 -- 172.21.15.2:0/1940664570 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb97c09c5c0 con 0x7fb988101de0 2024-09-19T04:46:44.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.539+0000 7fb98ef10640 1 -- 172.21.15.2:0/1940664570 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb98810a180 con 0x7fb988101de0 2024-09-19T04:46:44.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.541+0000 7fb985ffb640 1 -- 172.21.15.2:0/1940664570 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22490 (secure 0 0 0) 0x7fb97c09bec0 con 0x7fb988101de0 2024-09-19T04:46:44.543 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:46:44.543 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":80,"fsid":"d46630c4-7640-11ef-bceb-c7b262605968","created":"2024-09-19T04:38:39.698488+0000","modified":"2024-09-19T04:46:36.551838+0000","last_up_change":"2024-09-19T04:45:33.839647+0000","last_in_change":"2024-09-19T04:45:09.816808+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T04:41:51.960734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T04:46:20.031485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T04:46:22.484767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7a7dc9b9-8d5d-4dd3-93a3-0d5efced07d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":611702745},{"type":"v1","addr":"172.21.15.2:6803","nonce":611702745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":611702745},{"type":"v1","addr":"172.21.15.2:6805","nonce":611702745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":611702745},{"type":"v1","addr":"172.21.15.2:6809","nonce":611702745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":611702745},{"type":"v1","addr":"172.21.15.2:6807","nonce":611702745}]},"public_addr":"172.21.15.2:6803/611702745","cluster_addr":"172.21.15.2:6805/611702745","heartbeat_back_addr":"172.21.15.2:6809/611702745","heartbeat_front_addr":"172.21.15.2:6807/611702745","state":["exists","up"]},{"osd":1,"uuid":"bea40dec-7d9c-497f-bf16-4bf6d3b839f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":58390709},{"type":"v1","addr":"172.21.15.18:6801","nonce":58390709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":58390709},{"type":"v1","addr":"172.21.15.18:6803","nonce":58390709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":58390709},{"type":"v1","addr":"172.21.15.18:6807","nonce":58390709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":58390709},{"type":"v1","addr":"172.21.15.18:6805","nonce":58390709}]},"public_addr":"172.21.15.18:6801/58390709","cluster_addr":"172.21.15.18:6803/58390709","heartbeat_back_addr":"172.21.15.18:6807/58390709","heartbeat_front_addr":"172.21.15.18:6805/58390709","state":["exists","up"]},{"osd":2,"uuid":"97716304-a31e-48c9-83de-84eed10a7a4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":627735759},{"type":"v1","addr":"172.21.15.116:6801","nonce":627735759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":627735759},{"type":"v1","addr":"172.21.15.116:6803","nonce":627735759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":627735759},{"type":"v1","addr":"172.21.15.116:6807","nonce":627735759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":627735759},{"type":"v1","addr":"172.21.15.116:6805","nonce":627735759}]},"public_addr":"172.21.15.116:6801/627735759","cluster_addr":"172.21.15.116:6803/627735759","heartbeat_back_addr":"172.21.15.116:6807/627735759","heartbeat_front_addr":"172.21.15.116:6805/627735759","state":["exists","up"]},{"osd":3,"uuid":"8d79514e-16cf-4bd0-a2eb-e9148b91183d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1936071687},{"type":"v1","addr":"172.21.15.2:6811","nonce":1936071687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1936071687},{"type":"v1","addr":"172.21.15.2:6813","nonce":1936071687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1936071687},{"type":"v1","addr":"172.21.15.2:6817","nonce":1936071687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1936071687},{"type":"v1","addr":"172.21.15.2:6815","nonce":1936071687}]},"public_addr":"172.21.15.2:6811/1936071687","cluster_addr":"172.21.15.2:6813/1936071687","heartbeat_back_addr":"172.21.15.2:6817/1936071687","heartbeat_front_addr":"172.21.15.2:6815/1936071687","state":["exists","up"]},{"osd":4,"uuid":"5136f03c-94a3-42a0-9bfc-020397836037","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1333533784},{"type":"v1","addr":"172.21.15.18:6809","nonce":1333533784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1333533784},{"type":"v1","addr":"172.21.15.18:6811","nonce":1333533784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1333533784},{"type":"v1","addr":"172.21.15.18:6815","nonce":1333533784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1333533784},{"type":"v1","addr":"172.21.15.18:6813","nonce":1333533784}]},"public_addr":"172.21.15.18:6809/1333533784","cluster_addr":"172.21.15.18:6811/1333533784","heartbeat_back_addr":"172.21.15.18:6815/1333533784","heartbeat_front_addr":"172.21.15.18:6813/1333533784","state":["exists","up"]},{"osd":5,"uuid":"9d3384b0-f87d-4513-b151-4cca21c339b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":316360741},{"type":"v1","addr":"172.21.15.116:6809","nonce":316360741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":316360741},{"type":"v1","addr":"172.21.15.116:6811","nonce":316360741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":316360741},{"type":"v1","addr":"172.21.15.116:6815","nonce":316360741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":316360741},{"type":"v1","addr":"172.21.15.116:6813","nonce":316360741}]},"public_addr":"172.21.15.116:6809/316360741","cluster_addr":"172.21.15.116:6811/316360741","heartbeat_back_addr":"172.21.15.116:6815/316360741","heartbeat_front_addr":"172.21.15.116:6813/316360741","state":["exists","up"]},{"osd":6,"uuid":"e54f44b5-a693-4b31-83b2-2bcf10ab9a75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1185564560},{"type":"v1","addr":"172.21.15.2:6819","nonce":1185564560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1185564560},{"type":"v1","addr":"172.21.15.2:6821","nonce":1185564560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1185564560},{"type":"v1","addr":"172.21.15.2:6825","nonce":1185564560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":1185564560},{"type":"v1","addr":"172.21.15.2:6823","nonce":1185564560}]},"public_addr":"172.21.15.2:6819/1185564560","cluster_addr":"172.21.15.2:6821/1185564560","heartbeat_back_addr":"172.21.15.2:6825/1185564560","heartbeat_front_addr":"172.21.15.2:6823/1185564560","state":["exists","up"]},{"osd":7,"uuid":"96a444c3-429a-48b6-9823-95c9e171341a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3691801363},{"type":"v1","addr":"172.21.15.18:6817","nonce":3691801363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3691801363},{"type":"v1","addr":"172.21.15.18:6819","nonce":3691801363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3691801363},{"type":"v1","addr":"172.21.15.18:6823","nonce":3691801363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3691801363},{"type":"v1","addr":"172.21.15.18:6821","nonce":3691801363}]},"public_addr":"172.21.15.18:6817/3691801363","cluster_addr":"172.21.15.18:6819/3691801363","heartbeat_back_addr":"172.21.15.18:6823/3691801363","heartbeat_front_addr":"172.21.15.18:6821/3691801363","state":["exists","up"]},{"osd":8,"uuid":"c3f696aa-be7d-4f67-9147-3751406e394d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":3709586119},{"type":"v1","addr":"172.21.15.116:6817","nonce":3709586119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":3709586119},{"type":"v1","addr":"172.21.15.116:6819","nonce":3709586119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":3709586119},{"type":"v1","addr":"172.21.15.116:6823","nonce":3709586119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":3709586119},{"type":"v1","addr":"172.21.15.116:6821","nonce":3709586119}]},"public_addr":"172.21.15.116:6817/3709586119","cluster_addr":"172.21.15.116:6819/3709586119","heartbeat_back_addr":"172.21.15.116:6823/3709586119","heartbeat_front_addr":"172.21.15.116:6821/3709586119","state":["exists","up"]},{"osd":9,"uuid":"4892549d-f050-48c5-b695-5924b612a581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1054791011},{"type":"v1","addr":"172.21.15.2:6827","nonce":1054791011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1054791011},{"type":"v1","addr":"172.21.15.2:6829","nonce":1054791011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1054791011},{"type":"v1","addr":"172.21.15.2:6833","nonce":1054791011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":1054791011},{"type":"v1","addr":"172.21.15.2:6831","nonce":1054791011}]},"public_addr":"172.21.15.2:6827/1054791011","cluster_addr":"172.21.15.2:6829/1054791011","heartbeat_back_addr":"172.21.15.2:6833/1054791011","heartbeat_front_addr":"172.21.15.2:6831/1054791011","state":["exists","up"]},{"osd":10,"uuid":"12b60238-6a35-4d48-bacd-ee5ddd8fdb0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1958683776},{"type":"v1","addr":"172.21.15.18:6825","nonce":1958683776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":1958683776},{"type":"v1","addr":"172.21.15.18:6827","nonce":1958683776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":1958683776},{"type":"v1","addr":"172.21.15.18:6831","nonce":1958683776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":1958683776},{"type":"v1","addr":"172.21.15.18:6829","nonce":1958683776}]},"public_addr":"172.21.15.18:6825/1958683776","cluster_addr":"172.21.15.18:6827/1958683776","heartbeat_back_addr":"172.21.15.18:6831/1958683776","heartbeat_front_addr":"172.21.15.18:6829/1958683776","state":["exists","up"]},{"osd":11,"uuid":"99b3e553-b42c-4b2f-817f-3900ad8bd223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3456789654},{"type":"v1","addr":"172.21.15.116:6825","nonce":3456789654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3456789654},{"type":"v1","addr":"172.21.15.116:6827","nonce":3456789654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3456789654},{"type":"v1","addr":"172.21.15.116:6831","nonce":3456789654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3456789654},{"type":"v1","addr":"172.21.15.116:6829","nonce":3456789654}]},"public_addr":"172.21.15.116:6825/3456789654","cluster_addr":"172.21.15.116:6827/3456789654","heartbeat_back_addr":"172.21.15.116:6831/3456789654","heartbeat_front_addr":"172.21.15.116:6829/3456789654","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:40:58.216702+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:41:22.852350+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:41:47.265084+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:42:12.785128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:42:38.475008+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:43:02.924009+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:43:28.050646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:43:52.715369+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:44:16.905066+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:44:42.071128+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:45:06.434525+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:45:31.569086+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":1}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/870383845":"2024-09-20T04:39:35.461329+0000","172.21.15.2:0/2801870985":"2024-09-20T04:39:35.461329+0000","172.21.15.2:0/256825166":"2024-09-20T04:39:35.461329+0000","172.21.15.2:6801/3782987318":"2024-09-20T04:39:35.461329+0000","172.21.15.2:0/3064319092":"2024-09-20T04:39:11.086431+0000","172.21.15.2:0/1528097642":"2024-09-20T04:39:11.086431+0000","172.21.15.2:6801/1825825090":"2024-09-20T04:39:11.086431+0000","172.21.15.2:6800/1825825090":"2024-09-20T04:39:11.086431+0000","172.21.15.2:6800/3782987318":"2024-09-20T04:39:35.461329+0000","172.21.15.2:0/2432243496":"2024-09-20T04:39:11.086431+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T04:46:44.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.543+0000 7fb98ef10640 1 -- 172.21.15.2:0/1940664570 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fb9780a32d0 msgr2=0x7fb9780a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:44.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.543+0000 7fb98ef10640 1 --2- 172.21.15.2:0/1940664570 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fb9780a32d0 0x7fb9780a5790 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb974031440 tx=0x7fb9740058d0 comp rx=0 tx=0).stop 2024-09-19T04:46:44.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.543+0000 7fb98ef10640 1 -- 172.21.15.2:0/1940664570 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb988101de0 msgr2=0x7fb9880744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:44.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.543+0000 7fb98ef10640 1 --2- 172.21.15.2:0/1940664570 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb988101de0 0x7fb9880744f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb97c00e9f0 tx=0x7fb97c00eeb0 comp rx=0 tx=0).stop 2024-09-19T04:46:44.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.543+0000 7fb98ef10640 1 -- 172.21.15.2:0/1940664570 shutdown_connections 2024-09-19T04:46:44.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.543+0000 7fb98ef10640 1 --2- 172.21.15.2:0/1940664570 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fb9780a32d0 0x7fb9780a5790 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:44.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.543+0000 7fb98ef10640 1 --2- 172.21.15.2:0/1940664570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb988106f10 0x7fb988074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:44.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.543+0000 7fb98ef10640 1 --2- 172.21.15.2:0/1940664570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb988102790 0x7fb988074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:44.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.543+0000 7fb98ef10640 1 --2- 172.21.15.2:0/1940664570 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb988101de0 0x7fb9880744f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:44.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.543+0000 7fb98ef10640 1 -- 172.21.15.2:0/1940664570 >> 172.21.15.2:0/1940664570 conn(0x7fb9880fd8c0 msgr2=0x7fb9880fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:44.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.544+0000 7fb98ef10640 1 -- 172.21.15.2:0/1940664570 shutdown_connections 2024-09-19T04:46:44.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:44.544+0000 7fb98ef10640 1 -- 172.21.15.2:0/1940664570 wait complete. 2024-09-19T04:46:45.122 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T04:46:45.122 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T04:46:45.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:45 smithi018 ceph-mon[34537]: pgmap v284: 97 pgs: 97 active+clean; 599 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 3.2 KiB/s wr, 2 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T04:46:45.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:45 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/1940664570' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:46:45.359 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:45 smithi002 ceph-mon[30975]: pgmap v284: 97 pgs: 97 active+clean; 599 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 3.2 KiB/s wr, 2 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T04:46:45.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:45 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/1940664570' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:46:45.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:45 smithi116 ceph-mon[34477]: pgmap v284: 97 pgs: 97 active+clean; 599 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 3.2 KiB/s wr, 2 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T04:46:45.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:45 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/1940664570' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:46:45.383 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:46:45.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:45.825+0000 7fb2d68fa640 1 -- 172.21.15.2:0/3298235754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2d0101de0 msgr2=0x7fb2d01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:45.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:45.825+0000 7fb2d68fa640 1 --2- 172.21.15.2:0/3298235754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2d0101de0 0x7fb2d01021c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb2c0009900 tx=0x7fb2c002a410 comp rx=0 tx=0).stop 2024-09-19T04:46:45.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:45.825+0000 7fb2d68fa640 1 -- 172.21.15.2:0/3298235754 shutdown_connections 2024-09-19T04:46:45.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:45.825+0000 7fb2d68fa640 1 --2- 172.21.15.2:0/3298235754 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2d0106f10 0x7fb2d010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:45.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:45.825+0000 7fb2d68fa640 1 --2- 172.21.15.2:0/3298235754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2d0102790 0x7fb2d01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:45.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:45.825+0000 7fb2d68fa640 1 --2- 172.21.15.2:0/3298235754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2d0101de0 0x7fb2d01021c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:45.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:45.825+0000 7fb2d68fa640 1 -- 172.21.15.2:0/3298235754 >> 172.21.15.2:0/3298235754 conn(0x7fb2d00fd8c0 msgr2=0x7fb2d00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:45.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:45.825+0000 7fb2d68fa640 1 -- 172.21.15.2:0/3298235754 shutdown_connections 2024-09-19T04:46:45.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:45.825+0000 7fb2d68fa640 1 -- 172.21.15.2:0/3298235754 wait complete. 2024-09-19T04:46:45.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:45.826+0000 7fb2d68fa640 1 Processor -- start 2024-09-19T04:46:45.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:45.826+0000 7fb2d68fa640 1 -- start start 2024-09-19T04:46:45.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:45.826+0000 7fb2d68fa640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2d0101de0 0x7fb2d0198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:45.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:45.826+0000 7fb2d68fa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2d0102790 0x7fb2d01988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:45.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:45.826+0000 7fb2d68fa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2d0106f10 0x7fb2d019cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:45.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:45.826+0000 7fb2d68fa640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d0111e20 con 0x7fb2d0102790 2024-09-19T04:46:45.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:45.826+0000 7fb2d68fa640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d0111ca0 con 0x7fb2d0106f10 2024-09-19T04:46:45.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:45.826+0000 7fb2d68fa640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d0111fa0 con 0x7fb2d0101de0 2024-09-19T04:46:45.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:45.826+0000 7fb2cf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2d0102790 0x7fb2d01988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:45.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:45.826+0000 7fb2cf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2d0102790 0x7fb2d01988a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40636/0 (socket says 172.21.15.2:40636) 2024-09-19T04:46:45.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:45.826+0000 7fb2cf7fe640 1 -- 172.21.15.2:0/2431345236 learned_addr learned my addr 172.21.15.2:0/2431345236 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:46:45.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:45.827+0000 7fb2cffff640 1 --2- 172.21.15.2:0/2431345236 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2d0101de0 0x7fb2d0198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:45.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:45.827+0000 7fb2d4e97640 1 --2- 172.21.15.2:0/2431345236 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2d0106f10 0x7fb2d019cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:45.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:45.827+0000 7fb2cf7fe640 1 -- 172.21.15.2:0/2431345236 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2d0101de0 msgr2=0x7fb2d0198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:45.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:45.827+0000 7fb2cf7fe640 1 --2- 172.21.15.2:0/2431345236 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2d0101de0 0x7fb2d0198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:45.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:45.827+0000 7fb2cf7fe640 1 -- 172.21.15.2:0/2431345236 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2d0106f10 msgr2=0x7fb2d019cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:45.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:45.827+0000 7fb2cf7fe640 1 --2- 172.21.15.2:0/2431345236 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2d0106f10 0x7fb2d019cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:45.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:45.827+0000 7fb2cf7fe640 1 -- 172.21.15.2:0/2431345236 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2d019d310 con 0x7fb2d0102790 2024-09-19T04:46:45.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:45.827+0000 7fb2d4e97640 1 --2- 172.21.15.2:0/2431345236 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2d0106f10 0x7fb2d019cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:46:45.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:45.827+0000 7fb2cf7fe640 1 --2- 172.21.15.2:0/2431345236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2d0102790 0x7fb2d01988a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb2c400d950 tx=0x7fb2c400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:45.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:45.827+0000 7fb2cd7fa640 1 -- 172.21.15.2:0/2431345236 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c4017070 con 0x7fb2d0102790 2024-09-19T04:46:45.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:45.827+0000 7fb2d68fa640 1 -- 172.21.15.2:0/2431345236 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2d019d600 con 0x7fb2d0102790 2024-09-19T04:46:45.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:45.827+0000 7fb2cd7fa640 1 -- 172.21.15.2:0/2431345236 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb2c4009c30 con 0x7fb2d0102790 2024-09-19T04:46:45.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:45.827+0000 7fb2cd7fa640 1 -- 172.21.15.2:0/2431345236 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c400f620 con 0x7fb2d0102790 2024-09-19T04:46:45.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:45.827+0000 7fb2d68fa640 1 -- 172.21.15.2:0/2431345236 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2d01a4ee0 con 0x7fb2d0102790 2024-09-19T04:46:45.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:45.828+0000 7fb2d68fa640 1 -- 172.21.15.2:0/2431345236 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2d01021c0 con 0x7fb2d0102790 2024-09-19T04:46:45.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:45.829+0000 7fb2cd7fa640 1 -- 172.21.15.2:0/2431345236 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fb2c40109a0 con 0x7fb2d0102790 2024-09-19T04:46:45.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:45.830+0000 7fb2cd7fa640 1 --2- 172.21.15.2:0/2431345236 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fb2b80a32d0 0x7fb2b80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:45.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:45.830+0000 7fb2cffff640 1 --2- 172.21.15.2:0/2431345236 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fb2b80a32d0 0x7fb2b80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:45.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:45.830+0000 7fb2cd7fa640 1 -- 172.21.15.2:0/2431345236 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fb2c40cf6c0 con 0x7fb2d0102790 2024-09-19T04:46:45.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:45.831+0000 7fb2cffff640 1 --2- 172.21.15.2:0/2431345236 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fb2b80a32d0 0x7fb2b80a5790 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb2c0031440 tx=0x7fb2c0005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:45.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:45.835+0000 7fb2cd7fa640 1 -- 172.21.15.2:0/2431345236 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb2c4009de0 con 0x7fb2d0102790 2024-09-19T04:46:46.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:46.006+0000 7fb2d68fa640 1 -- 172.21.15.2:0/2431345236 --> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb2d0062630 con 0x7fb2b80a32d0 2024-09-19T04:46:46.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:46.014+0000 7fb2cd7fa640 1 -- 172.21.15.2:0/2431345236 <== mgr.14150 v2:172.21.15.2:6800/3171525177 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258647 (secure 0 0 0) 0x7fb2d0062630 con 0x7fb2b80a32d0 2024-09-19T04:46:46.020 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:46:46.022 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-19T04:46:46.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:46.016+0000 7fb2d68fa640 1 -- 172.21.15.2:0/2431345236 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fb2b80a32d0 msgr2=0x7fb2b80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:46.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:46.016+0000 7fb2d68fa640 1 --2- 172.21.15.2:0/2431345236 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fb2b80a32d0 0x7fb2b80a5790 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb2c0031440 tx=0x7fb2c0005b50 comp rx=0 tx=0).stop 2024-09-19T04:46:46.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:46.016+0000 7fb2d68fa640 1 -- 172.21.15.2:0/2431345236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2d0102790 msgr2=0x7fb2d01988a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:46.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:46.016+0000 7fb2d68fa640 1 --2- 172.21.15.2:0/2431345236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2d0102790 0x7fb2d01988a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb2c400d950 tx=0x7fb2c400de10 comp rx=0 tx=0).stop 2024-09-19T04:46:46.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:46.016+0000 7fb2d68fa640 1 -- 172.21.15.2:0/2431345236 shutdown_connections 2024-09-19T04:46:46.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:46.016+0000 7fb2d68fa640 1 --2- 172.21.15.2:0/2431345236 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fb2b80a32d0 0x7fb2b80a5790 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:46.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:46.016+0000 7fb2d68fa640 1 --2- 172.21.15.2:0/2431345236 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2d0106f10 0x7fb2d019cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:46.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:46.016+0000 7fb2d68fa640 1 --2- 172.21.15.2:0/2431345236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2d0102790 0x7fb2d01988a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:46.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:46.016+0000 7fb2d68fa640 1 --2- 172.21.15.2:0/2431345236 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2d0101de0 0x7fb2d0198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:46.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:46.016+0000 7fb2d68fa640 1 -- 172.21.15.2:0/2431345236 >> 172.21.15.2:0/2431345236 conn(0x7fb2d00fd8c0 msgr2=0x7fb2d00fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:46.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:46.017+0000 7fb2d68fa640 1 -- 172.21.15.2:0/2431345236 shutdown_connections 2024-09-19T04:46:46.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:46.017+0000 7fb2d68fa640 1 -- 172.21.15.2:0/2431345236 wait complete. 2024-09-19T04:46:46.740 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":285,"stamp":"2024-09-19T04:46:45.545180+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":638202,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":172,"num_read_kb":184,"num_write":250,"num_write_kb":3006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1180770,"num_keys_recovered":10,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":407192,"kb_used_data":12160,"kb_used_omap":18,"kb_used_meta":394797,"kb_avail":1124534632,"statfs":{"total":1151940427776,"available":1151523463168,"internally_reserved":0,"allocated":12451840,"data_stored":7022393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":404272442},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":45424,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":54,"num_write":24,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.993534"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.563629+0000","last_change":"2024-09-19T04:46:23.520907+0000","last_active":"2024-09-19T04:46:36.563629+0000","last_peered":"2024-09-19T04:46:36.563629+0000","last_clean":"2024-09-19T04:46:36.563629+0000","last_became_active":"2024-09-19T04:46:23.519321+0000","last_became_peered":"2024-09-19T04:46:23.519321+0000","last_unstale":"2024-09-19T04:46:36.563629+0000","last_undegraded":"2024-09-19T04:46:36.563629+0000","last_fullsized":"2024-09-19T04:46:36.563629+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:31.529472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.988683+0000","last_change":"2024-09-19T04:46:23.515272+0000","last_active":"2024-09-19T04:46:36.988683+0000","last_peered":"2024-09-19T04:46:36.988683+0000","last_clean":"2024-09-19T04:46:36.988683+0000","last_became_active":"2024-09-19T04:46:23.514760+0000","last_became_peered":"2024-09-19T04:46:23.514760+0000","last_unstale":"2024-09-19T04:46:36.988683+0000","last_undegraded":"2024-09-19T04:46:36.988683+0000","last_fullsized":"2024-09-19T04:46:36.988683+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:32.215940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.988740+0000","last_change":"2024-09-19T04:46:23.516809+0000","last_active":"2024-09-19T04:46:36.988740+0000","last_peered":"2024-09-19T04:46:36.988740+0000","last_clean":"2024-09-19T04:46:36.988740+0000","last_became_active":"2024-09-19T04:46:23.516489+0000","last_became_peered":"2024-09-19T04:46:23.516489+0000","last_unstale":"2024-09-19T04:46:36.988740+0000","last_undegraded":"2024-09-19T04:46:36.988740+0000","last_fullsized":"2024-09-19T04:46:36.988740+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:17:51.183061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.813744+0000","last_change":"2024-09-19T04:46:23.506868+0000","last_active":"2024-09-19T04:46:36.813744+0000","last_peered":"2024-09-19T04:46:36.813744+0000","last_clean":"2024-09-19T04:46:36.813744+0000","last_became_active":"2024-09-19T04:46:23.506489+0000","last_became_peered":"2024-09-19T04:46:23.506489+0000","last_unstale":"2024-09-19T04:46:36.813744+0000","last_undegraded":"2024-09-19T04:46:36.813744+0000","last_fullsized":"2024-09-19T04:46:36.813744+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:22.749973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.989486+0000","last_change":"2024-09-19T04:46:23.506733+0000","last_active":"2024-09-19T04:46:36.989486+0000","last_peered":"2024-09-19T04:46:36.989486+0000","last_clean":"2024-09-19T04:46:36.989486+0000","last_became_active":"2024-09-19T04:46:23.506408+0000","last_became_peered":"2024-09-19T04:46:23.506408+0000","last_unstale":"2024-09-19T04:46:36.989486+0000","last_undegraded":"2024-09-19T04:46:36.989486+0000","last_fullsized":"2024-09-19T04:46:36.989486+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:45:31.821607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.561796+0000","last_change":"2024-09-19T04:46:23.523109+0000","last_active":"2024-09-19T04:46:36.561796+0000","last_peered":"2024-09-19T04:46:36.561796+0000","last_clean":"2024-09-19T04:46:36.561796+0000","last_became_active":"2024-09-19T04:46:23.522783+0000","last_became_peered":"2024-09-19T04:46:23.522783+0000","last_unstale":"2024-09-19T04:46:36.561796+0000","last_undegraded":"2024-09-19T04:46:36.561796+0000","last_fullsized":"2024-09-19T04:46:36.561796+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:34:47.622562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.566699+0000","last_change":"2024-09-19T04:46:23.518297+0000","last_active":"2024-09-19T04:46:36.566699+0000","last_peered":"2024-09-19T04:46:36.566699+0000","last_clean":"2024-09-19T04:46:36.566699+0000","last_became_active":"2024-09-19T04:46:23.517974+0000","last_became_peered":"2024-09-19T04:46:23.517974+0000","last_unstale":"2024-09-19T04:46:36.566699+0000","last_undegraded":"2024-09-19T04:46:36.566699+0000","last_fullsized":"2024-09-19T04:46:36.566699+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:23:26.474961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.559392+0000","last_change":"2024-09-19T04:46:23.516255+0000","last_active":"2024-09-19T04:46:36.559392+0000","last_peered":"2024-09-19T04:46:36.559392+0000","last_clean":"2024-09-19T04:46:36.559392+0000","last_became_active":"2024-09-19T04:46:23.515861+0000","last_became_peered":"2024-09-19T04:46:23.515861+0000","last_unstale":"2024-09-19T04:46:36.559392+0000","last_undegraded":"2024-09-19T04:46:36.559392+0000","last_fullsized":"2024-09-19T04:46:36.559392+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:08:19.747905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.793466+0000","last_change":"2024-09-19T04:46:23.520947+0000","last_active":"2024-09-19T04:46:36.793466+0000","last_peered":"2024-09-19T04:46:36.793466+0000","last_clean":"2024-09-19T04:46:36.793466+0000","last_became_active":"2024-09-19T04:46:23.518463+0000","last_became_peered":"2024-09-19T04:46:23.518463+0000","last_unstale":"2024-09-19T04:46:36.793466+0000","last_undegraded":"2024-09-19T04:46:36.793466+0000","last_fullsized":"2024-09-19T04:46:36.793466+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:00.420868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.561908+0000","last_change":"2024-09-19T04:46:23.524145+0000","last_active":"2024-09-19T04:46:36.561908+0000","last_peered":"2024-09-19T04:46:36.561908+0000","last_clean":"2024-09-19T04:46:36.561908+0000","last_became_active":"2024-09-19T04:46:23.523698+0000","last_became_peered":"2024-09-19T04:46:23.523698+0000","last_unstale":"2024-09-19T04:46:36.561908+0000","last_undegraded":"2024-09-19T04:46:36.561908+0000","last_fullsized":"2024-09-19T04:46:36.561908+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:41.370871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.565617+0000","last_change":"2024-09-19T04:46:23.521782+0000","last_active":"2024-09-19T04:46:36.565617+0000","last_peered":"2024-09-19T04:46:36.565617+0000","last_clean":"2024-09-19T04:46:36.565617+0000","last_became_active":"2024-09-19T04:46:23.521452+0000","last_became_peered":"2024-09-19T04:46:23.521452+0000","last_unstale":"2024-09-19T04:46:36.565617+0000","last_undegraded":"2024-09-19T04:46:36.565617+0000","last_fullsized":"2024-09-19T04:46:36.565617+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:11:35.047064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.813744+0000","last_change":"2024-09-19T04:46:23.518174+0000","last_active":"2024-09-19T04:46:36.813744+0000","last_peered":"2024-09-19T04:46:36.813744+0000","last_clean":"2024-09-19T04:46:36.813744+0000","last_became_active":"2024-09-19T04:46:23.516507+0000","last_became_peered":"2024-09-19T04:46:23.516507+0000","last_unstale":"2024-09-19T04:46:36.813744+0000","last_undegraded":"2024-09-19T04:46:36.813744+0000","last_fullsized":"2024-09-19T04:46:36.813744+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:37.878245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.805393+0000","last_change":"2024-09-19T04:46:23.510582+0000","last_active":"2024-09-19T04:46:36.805393+0000","last_peered":"2024-09-19T04:46:36.805393+0000","last_clean":"2024-09-19T04:46:36.805393+0000","last_became_active":"2024-09-19T04:46:23.510135+0000","last_became_peered":"2024-09-19T04:46:23.510135+0000","last_unstale":"2024-09-19T04:46:36.805393+0000","last_undegraded":"2024-09-19T04:46:36.805393+0000","last_fullsized":"2024-09-19T04:46:36.805393+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:09.721696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.988533+0000","last_change":"2024-09-19T04:46:23.517963+0000","last_active":"2024-09-19T04:46:36.988533+0000","last_peered":"2024-09-19T04:46:36.988533+0000","last_clean":"2024-09-19T04:46:36.988533+0000","last_became_active":"2024-09-19T04:46:23.517574+0000","last_became_peered":"2024-09-19T04:46:23.517574+0000","last_unstale":"2024-09-19T04:46:36.988533+0000","last_undegraded":"2024-09-19T04:46:36.988533+0000","last_fullsized":"2024-09-19T04:46:36.988533+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:48:44.494267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.988454+0000","last_change":"2024-09-19T04:46:23.517318+0000","last_active":"2024-09-19T04:46:36.988454+0000","last_peered":"2024-09-19T04:46:36.988454+0000","last_clean":"2024-09-19T04:46:36.988454+0000","last_became_active":"2024-09-19T04:46:23.516973+0000","last_became_peered":"2024-09-19T04:46:23.516973+0000","last_unstale":"2024-09-19T04:46:36.988454+0000","last_undegraded":"2024-09-19T04:46:36.988454+0000","last_fullsized":"2024-09-19T04:46:36.988454+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:46:28.907400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.792910+0000","last_change":"2024-09-19T04:46:23.517468+0000","last_active":"2024-09-19T04:46:36.792910+0000","last_peered":"2024-09-19T04:46:36.792910+0000","last_clean":"2024-09-19T04:46:36.792910+0000","last_became_active":"2024-09-19T04:46:23.517093+0000","last_became_peered":"2024-09-19T04:46:23.517093+0000","last_unstale":"2024-09-19T04:46:36.792910+0000","last_undegraded":"2024-09-19T04:46:36.792910+0000","last_fullsized":"2024-09-19T04:46:36.792910+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:43.435560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.563738+0000","last_change":"2024-09-19T04:46:23.521679+0000","last_active":"2024-09-19T04:46:36.563738+0000","last_peered":"2024-09-19T04:46:36.563738+0000","last_clean":"2024-09-19T04:46:36.563738+0000","last_became_active":"2024-09-19T04:46:23.519346+0000","last_became_peered":"2024-09-19T04:46:23.519346+0000","last_unstale":"2024-09-19T04:46:36.563738+0000","last_undegraded":"2024-09-19T04:46:36.563738+0000","last_fullsized":"2024-09-19T04:46:36.563738+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:31.740226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.561931+0000","last_change":"2024-09-19T04:46:23.517518+0000","last_active":"2024-09-19T04:46:36.561931+0000","last_peered":"2024-09-19T04:46:36.561931+0000","last_clean":"2024-09-19T04:46:36.561931+0000","last_became_active":"2024-09-19T04:46:23.517179+0000","last_became_peered":"2024-09-19T04:46:23.517179+0000","last_unstale":"2024-09-19T04:46:36.561931+0000","last_undegraded":"2024-09-19T04:46:36.561931+0000","last_fullsized":"2024-09-19T04:46:36.561931+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:38.352433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.566817+0000","last_change":"2024-09-19T04:46:23.506618+0000","last_active":"2024-09-19T04:46:36.566817+0000","last_peered":"2024-09-19T04:46:36.566817+0000","last_clean":"2024-09-19T04:46:36.566817+0000","last_became_active":"2024-09-19T04:46:23.506276+0000","last_became_peered":"2024-09-19T04:46:23.506276+0000","last_unstale":"2024-09-19T04:46:36.566817+0000","last_undegraded":"2024-09-19T04:46:36.566817+0000","last_fullsized":"2024-09-19T04:46:36.566817+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:02:42.216717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.563322+0000","last_change":"2024-09-19T04:46:23.518793+0000","last_active":"2024-09-19T04:46:36.563322+0000","last_peered":"2024-09-19T04:46:36.563322+0000","last_clean":"2024-09-19T04:46:36.563322+0000","last_became_active":"2024-09-19T04:46:23.518386+0000","last_became_peered":"2024-09-19T04:46:23.518386+0000","last_unstale":"2024-09-19T04:46:36.563322+0000","last_undegraded":"2024-09-19T04:46:36.563322+0000","last_fullsized":"2024-09-19T04:46:36.563322+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:08:12.007678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.805447+0000","last_change":"2024-09-19T04:46:23.513022+0000","last_active":"2024-09-19T04:46:36.805447+0000","last_peered":"2024-09-19T04:46:36.805447+0000","last_clean":"2024-09-19T04:46:36.805447+0000","last_became_active":"2024-09-19T04:46:23.512541+0000","last_became_peered":"2024-09-19T04:46:23.512541+0000","last_unstale":"2024-09-19T04:46:36.805447+0000","last_undegraded":"2024-09-19T04:46:36.805447+0000","last_fullsized":"2024-09-19T04:46:36.805447+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:19.873546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.792966+0000","last_change":"2024-09-19T04:46:23.519523+0000","last_active":"2024-09-19T04:46:36.792966+0000","last_peered":"2024-09-19T04:46:36.792966+0000","last_clean":"2024-09-19T04:46:36.792966+0000","last_became_active":"2024-09-19T04:46:23.517995+0000","last_became_peered":"2024-09-19T04:46:23.517995+0000","last_unstale":"2024-09-19T04:46:36.792966+0000","last_undegraded":"2024-09-19T04:46:36.792966+0000","last_fullsized":"2024-09-19T04:46:36.792966+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:23.243522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.559440+0000","last_change":"2024-09-19T04:46:23.517564+0000","last_active":"2024-09-19T04:46:36.559440+0000","last_peered":"2024-09-19T04:46:36.559440+0000","last_clean":"2024-09-19T04:46:36.559440+0000","last_became_active":"2024-09-19T04:46:23.517248+0000","last_became_peered":"2024-09-19T04:46:23.517248+0000","last_unstale":"2024-09-19T04:46:36.559440+0000","last_undegraded":"2024-09-19T04:46:36.559440+0000","last_fullsized":"2024-09-19T04:46:36.559440+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:19.369346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.571382+0000","last_change":"2024-09-19T04:46:23.514150+0000","last_active":"2024-09-19T04:46:36.571382+0000","last_peered":"2024-09-19T04:46:36.571382+0000","last_clean":"2024-09-19T04:46:36.571382+0000","last_became_active":"2024-09-19T04:46:23.512169+0000","last_became_peered":"2024-09-19T04:46:23.512169+0000","last_unstale":"2024-09-19T04:46:36.571382+0000","last_undegraded":"2024-09-19T04:46:36.571382+0000","last_fullsized":"2024-09-19T04:46:36.571382+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:17.475389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.815086+0000","last_change":"2024-09-19T04:46:36.814692+0000","last_active":"2024-09-19T04:46:36.815086+0000","last_peered":"2024-09-19T04:46:36.815086+0000","last_clean":"2024-09-19T04:46:36.815086+0000","last_became_active":"2024-09-19T04:46:36.814429+0000","last_became_peered":"2024-09-19T04:46:36.814429+0000","last_unstale":"2024-09-19T04:46:36.815086+0000","last_undegraded":"2024-09-19T04:46:36.815086+0000","last_fullsized":"2024-09-19T04:46:36.815086+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:10:42.391448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.566542+0000","last_change":"2024-09-19T04:46:23.519273+0000","last_active":"2024-09-19T04:46:36.566542+0000","last_peered":"2024-09-19T04:46:36.566542+0000","last_clean":"2024-09-19T04:46:36.566542+0000","last_became_active":"2024-09-19T04:46:23.519001+0000","last_became_peered":"2024-09-19T04:46:23.519001+0000","last_unstale":"2024-09-19T04:46:36.566542+0000","last_undegraded":"2024-09-19T04:46:36.566542+0000","last_fullsized":"2024-09-19T04:46:36.566542+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:15:30.949066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.563341+0000","last_change":"2024-09-19T04:46:23.520888+0000","last_active":"2024-09-19T04:46:36.563341+0000","last_peered":"2024-09-19T04:46:36.563341+0000","last_clean":"2024-09-19T04:46:36.563341+0000","last_became_active":"2024-09-19T04:46:23.519476+0000","last_became_peered":"2024-09-19T04:46:23.519476+0000","last_unstale":"2024-09-19T04:46:36.563341+0000","last_undegraded":"2024-09-19T04:46:36.563341+0000","last_fullsized":"2024-09-19T04:46:36.563341+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:56.459724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.805408+0000","last_change":"2024-09-19T04:46:23.512152+0000","last_active":"2024-09-19T04:46:36.805408+0000","last_peered":"2024-09-19T04:46:36.805408+0000","last_clean":"2024-09-19T04:46:36.805408+0000","last_became_active":"2024-09-19T04:46:23.511784+0000","last_became_peered":"2024-09-19T04:46:23.511784+0000","last_unstale":"2024-09-19T04:46:36.805408+0000","last_undegraded":"2024-09-19T04:46:36.805408+0000","last_fullsized":"2024-09-19T04:46:36.805408+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:01:23.406580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.988812+0000","last_change":"2024-09-19T04:46:23.522491+0000","last_active":"2024-09-19T04:46:36.988812+0000","last_peered":"2024-09-19T04:46:36.988812+0000","last_clean":"2024-09-19T04:46:36.988812+0000","last_became_active":"2024-09-19T04:46:23.522025+0000","last_became_peered":"2024-09-19T04:46:23.522025+0000","last_unstale":"2024-09-19T04:46:36.988812+0000","last_undegraded":"2024-09-19T04:46:36.988812+0000","last_fullsized":"2024-09-19T04:46:36.988812+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:33.063300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.566102+0000","last_change":"2024-09-19T04:46:23.510057+0000","last_active":"2024-09-19T04:46:36.566102+0000","last_peered":"2024-09-19T04:46:36.566102+0000","last_clean":"2024-09-19T04:46:36.566102+0000","last_became_active":"2024-09-19T04:46:23.509691+0000","last_became_peered":"2024-09-19T04:46:23.509691+0000","last_unstale":"2024-09-19T04:46:36.566102+0000","last_undegraded":"2024-09-19T04:46:36.566102+0000","last_fullsized":"2024-09-19T04:46:36.566102+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:12:16.579944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.565831+0000","last_change":"2024-09-19T04:46:23.516876+0000","last_active":"2024-09-19T04:46:36.565831+0000","last_peered":"2024-09-19T04:46:36.565831+0000","last_clean":"2024-09-19T04:46:36.565831+0000","last_became_active":"2024-09-19T04:46:23.516533+0000","last_became_peered":"2024-09-19T04:46:23.516533+0000","last_unstale":"2024-09-19T04:46:36.565831+0000","last_undegraded":"2024-09-19T04:46:36.565831+0000","last_fullsized":"2024-09-19T04:46:36.565831+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:44.868936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.563114+0000","last_change":"2024-09-19T04:46:23.517607+0000","last_active":"2024-09-19T04:46:36.563114+0000","last_peered":"2024-09-19T04:46:36.563114+0000","last_clean":"2024-09-19T04:46:36.563114+0000","last_became_active":"2024-09-19T04:46:23.517289+0000","last_became_peered":"2024-09-19T04:46:23.517289+0000","last_unstale":"2024-09-19T04:46:36.563114+0000","last_undegraded":"2024-09-19T04:46:36.563114+0000","last_fullsized":"2024-09-19T04:46:36.563114+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:08:22.882886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.989428+0000","last_change":"2024-09-19T04:46:23.507713+0000","last_active":"2024-09-19T04:46:36.989428+0000","last_peered":"2024-09-19T04:46:36.989428+0000","last_clean":"2024-09-19T04:46:36.989428+0000","last_became_active":"2024-09-19T04:46:23.507350+0000","last_became_peered":"2024-09-19T04:46:23.507350+0000","last_unstale":"2024-09-19T04:46:36.989428+0000","last_undegraded":"2024-09-19T04:46:36.989428+0000","last_fullsized":"2024-09-19T04:46:36.989428+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:07:27.119097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.570432+0000","last_change":"2024-09-19T04:46:21.495958+0000","last_active":"2024-09-19T04:46:36.570432+0000","last_peered":"2024-09-19T04:46:36.570432+0000","last_clean":"2024-09-19T04:46:36.570432+0000","last_became_active":"2024-09-19T04:46:21.495562+0000","last_became_peered":"2024-09-19T04:46:21.495562+0000","last_unstale":"2024-09-19T04:46:36.570432+0000","last_undegraded":"2024-09-19T04:46:36.570432+0000","last_fullsized":"2024-09-19T04:46:36.570432+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:19:02.935893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.570323+0000","last_change":"2024-09-19T04:46:23.524151+0000","last_active":"2024-09-19T04:46:36.570323+0000","last_peered":"2024-09-19T04:46:36.570323+0000","last_clean":"2024-09-19T04:46:36.570323+0000","last_became_active":"2024-09-19T04:46:23.523795+0000","last_became_peered":"2024-09-19T04:46:23.523795+0000","last_unstale":"2024-09-19T04:46:36.570323+0000","last_undegraded":"2024-09-19T04:46:36.570323+0000","last_fullsized":"2024-09-19T04:46:36.570323+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:27.234766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.561930+0000","last_change":"2024-09-19T04:46:21.485072+0000","last_active":"2024-09-19T04:46:36.561930+0000","last_peered":"2024-09-19T04:46:36.561930+0000","last_clean":"2024-09-19T04:46:36.561930+0000","last_became_active":"2024-09-19T04:46:21.482727+0000","last_became_peered":"2024-09-19T04:46:21.482727+0000","last_unstale":"2024-09-19T04:46:36.561930+0000","last_undegraded":"2024-09-19T04:46:36.561930+0000","last_fullsized":"2024-09-19T04:46:36.561930+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:23.231570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.805189+0000","last_change":"2024-09-19T04:46:21.488537+0000","last_active":"2024-09-19T04:46:36.805189+0000","last_peered":"2024-09-19T04:46:36.805189+0000","last_clean":"2024-09-19T04:46:36.805189+0000","last_became_active":"2024-09-19T04:46:21.488176+0000","last_became_peered":"2024-09-19T04:46:21.488176+0000","last_unstale":"2024-09-19T04:46:36.805189+0000","last_undegraded":"2024-09-19T04:46:36.805189+0000","last_fullsized":"2024-09-19T04:46:36.805189+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:14.355956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.559474+0000","last_change":"2024-09-19T04:46:23.518619+0000","last_active":"2024-09-19T04:46:36.559474+0000","last_peered":"2024-09-19T04:46:36.559474+0000","last_clean":"2024-09-19T04:46:36.559474+0000","last_became_active":"2024-09-19T04:46:23.518313+0000","last_became_peered":"2024-09-19T04:46:23.518313+0000","last_unstale":"2024-09-19T04:46:36.559474+0000","last_undegraded":"2024-09-19T04:46:36.559474+0000","last_fullsized":"2024-09-19T04:46:36.559474+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:08:25.958935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.571543+0000","last_change":"2024-09-19T04:46:21.493873+0000","last_active":"2024-09-19T04:46:36.571543+0000","last_peered":"2024-09-19T04:46:36.571543+0000","last_clean":"2024-09-19T04:46:36.571543+0000","last_became_active":"2024-09-19T04:46:21.493447+0000","last_became_peered":"2024-09-19T04:46:21.493447+0000","last_unstale":"2024-09-19T04:46:36.571543+0000","last_undegraded":"2024-09-19T04:46:36.571543+0000","last_fullsized":"2024-09-19T04:46:36.571543+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:29.504001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.561265+0000","last_change":"2024-09-19T04:46:23.508247+0000","last_active":"2024-09-19T04:46:36.561265+0000","last_peered":"2024-09-19T04:46:36.561265+0000","last_clean":"2024-09-19T04:46:36.561265+0000","last_became_active":"2024-09-19T04:46:23.507936+0000","last_became_peered":"2024-09-19T04:46:23.507936+0000","last_unstale":"2024-09-19T04:46:36.561265+0000","last_undegraded":"2024-09-19T04:46:36.561265+0000","last_fullsized":"2024-09-19T04:46:36.561265+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:25:09.864664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.561738+0000","last_change":"2024-09-19T04:46:21.487636+0000","last_active":"2024-09-19T04:46:36.561738+0000","last_peered":"2024-09-19T04:46:36.561738+0000","last_clean":"2024-09-19T04:46:36.561738+0000","last_became_active":"2024-09-19T04:46:21.487162+0000","last_became_peered":"2024-09-19T04:46:21.487162+0000","last_unstale":"2024-09-19T04:46:36.561738+0000","last_undegraded":"2024-09-19T04:46:36.561738+0000","last_fullsized":"2024-09-19T04:46:36.561738+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:03:04.833769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.793378+0000","last_change":"2024-09-19T04:46:23.515047+0000","last_active":"2024-09-19T04:46:36.793378+0000","last_peered":"2024-09-19T04:46:36.793378+0000","last_clean":"2024-09-19T04:46:36.793378+0000","last_became_active":"2024-09-19T04:46:23.514607+0000","last_became_peered":"2024-09-19T04:46:23.514607+0000","last_unstale":"2024-09-19T04:46:36.793378+0000","last_undegraded":"2024-09-19T04:46:36.793378+0000","last_fullsized":"2024-09-19T04:46:36.793378+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:05:03.076568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.565898+0000","last_change":"2024-09-19T04:46:21.493732+0000","last_active":"2024-09-19T04:46:36.565898+0000","last_peered":"2024-09-19T04:46:36.565898+0000","last_clean":"2024-09-19T04:46:36.565898+0000","last_became_active":"2024-09-19T04:46:21.493069+0000","last_became_peered":"2024-09-19T04:46:21.493069+0000","last_unstale":"2024-09-19T04:46:36.565898+0000","last_undegraded":"2024-09-19T04:46:36.565898+0000","last_fullsized":"2024-09-19T04:46:36.565898+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:17.709419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.988887+0000","last_change":"2024-09-19T04:46:23.516530+0000","last_active":"2024-09-19T04:46:36.988887+0000","last_peered":"2024-09-19T04:46:36.988887+0000","last_clean":"2024-09-19T04:46:36.988887+0000","last_became_active":"2024-09-19T04:46:23.515816+0000","last_became_peered":"2024-09-19T04:46:23.515816+0000","last_unstale":"2024-09-19T04:46:36.988887+0000","last_undegraded":"2024-09-19T04:46:36.988887+0000","last_fullsized":"2024-09-19T04:46:36.988887+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:56:19.162009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.570448+0000","last_change":"2024-09-19T04:46:21.573930+0000","last_active":"2024-09-19T04:46:36.570448+0000","last_peered":"2024-09-19T04:46:36.570448+0000","last_clean":"2024-09-19T04:46:36.570448+0000","last_became_active":"2024-09-19T04:46:21.573579+0000","last_became_peered":"2024-09-19T04:46:21.573579+0000","last_unstale":"2024-09-19T04:46:36.570448+0000","last_undegraded":"2024-09-19T04:46:36.570448+0000","last_fullsized":"2024-09-19T04:46:36.570448+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:29.472481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.792985+0000","last_change":"2024-09-19T04:46:23.520569+0000","last_active":"2024-09-19T04:46:36.792985+0000","last_peered":"2024-09-19T04:46:36.792985+0000","last_clean":"2024-09-19T04:46:36.792985+0000","last_became_active":"2024-09-19T04:46:23.519894+0000","last_became_peered":"2024-09-19T04:46:23.519894+0000","last_unstale":"2024-09-19T04:46:36.792985+0000","last_undegraded":"2024-09-19T04:46:36.792985+0000","last_fullsized":"2024-09-19T04:46:36.792985+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:20.823559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'20","reported_seq":73,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:43.561229+0000","last_change":"2024-09-19T04:46:21.491853+0000","last_active":"2024-09-19T04:46:43.561229+0000","last_peered":"2024-09-19T04:46:43.561229+0000","last_clean":"2024-09-19T04:46:43.561229+0000","last_became_active":"2024-09-19T04:46:21.491499+0000","last_became_peered":"2024-09-19T04:46:21.491499+0000","last_unstale":"2024-09-19T04:46:43.561229+0000","last_undegraded":"2024-09-19T04:46:43.561229+0000","last_fullsized":"2024-09-19T04:46:43.561229+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:15.372001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46802,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":31,"num_read_kb":60,"num_write":20,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.989834+0000","last_change":"2024-09-19T04:46:23.516781+0000","last_active":"2024-09-19T04:46:36.989834+0000","last_peered":"2024-09-19T04:46:36.989834+0000","last_clean":"2024-09-19T04:46:36.989834+0000","last_became_active":"2024-09-19T04:46:23.515928+0000","last_became_peered":"2024-09-19T04:46:23.515928+0000","last_unstale":"2024-09-19T04:46:36.989834+0000","last_undegraded":"2024-09-19T04:46:36.989834+0000","last_fullsized":"2024-09-19T04:46:36.989834+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:31.319072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'2","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.576789+0000","last_change":"2024-09-19T04:46:36.576395+0000","last_active":"2024-09-19T04:46:36.576789+0000","last_peered":"2024-09-19T04:46:36.576789+0000","last_clean":"2024-09-19T04:46:36.576789+0000","last_became_active":"2024-09-19T04:46:36.567213+0000","last_became_peered":"2024-09-19T04:46:36.567213+0000","last_unstale":"2024-09-19T04:46:36.576789+0000","last_undegraded":"2024-09-19T04:46:36.576789+0000","last_fullsized":"2024-09-19T04:46:36.576789+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:26.802224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.805263+0000","last_change":"2024-09-19T04:46:23.512736+0000","last_active":"2024-09-19T04:46:36.805263+0000","last_peered":"2024-09-19T04:46:36.805263+0000","last_clean":"2024-09-19T04:46:36.805263+0000","last_became_active":"2024-09-19T04:46:23.512399+0000","last_became_peered":"2024-09-19T04:46:23.512399+0000","last_unstale":"2024-09-19T04:46:36.805263+0000","last_undegraded":"2024-09-19T04:46:36.805263+0000","last_fullsized":"2024-09-19T04:46:36.805263+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:54:28.607512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.570209+0000","last_change":"2024-09-19T04:46:21.495421+0000","last_active":"2024-09-19T04:46:36.570209+0000","last_peered":"2024-09-19T04:46:36.570209+0000","last_clean":"2024-09-19T04:46:36.570209+0000","last_became_active":"2024-09-19T04:46:21.495004+0000","last_became_peered":"2024-09-19T04:46:21.495004+0000","last_unstale":"2024-09-19T04:46:36.570209+0000","last_undegraded":"2024-09-19T04:46:36.570209+0000","last_fullsized":"2024-09-19T04:46:36.570209+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:11.038118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.567045+0000","last_change":"2024-09-19T04:46:23.519462+0000","last_active":"2024-09-19T04:46:36.567045+0000","last_peered":"2024-09-19T04:46:36.567045+0000","last_clean":"2024-09-19T04:46:36.567045+0000","last_became_active":"2024-09-19T04:46:23.519121+0000","last_became_peered":"2024-09-19T04:46:23.519121+0000","last_unstale":"2024-09-19T04:46:36.567045+0000","last_undegraded":"2024-09-19T04:46:36.567045+0000","last_fullsized":"2024-09-19T04:46:36.567045+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:19.643433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.813771+0000","last_change":"2024-09-19T04:46:21.496243+0000","last_active":"2024-09-19T04:46:36.813771+0000","last_peered":"2024-09-19T04:46:36.813771+0000","last_clean":"2024-09-19T04:46:36.813771+0000","last_became_active":"2024-09-19T04:46:21.495821+0000","last_became_peered":"2024-09-19T04:46:21.495821+0000","last_unstale":"2024-09-19T04:46:36.813771+0000","last_undegraded":"2024-09-19T04:46:36.813771+0000","last_fullsized":"2024-09-19T04:46:36.813771+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:35:02.729538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.570404+0000","last_change":"2024-09-19T04:46:36.570404+0000","last_active":"2024-09-19T04:46:36.570404+0000","last_peered":"2024-09-19T04:46:36.570404+0000","last_clean":"2024-09-19T04:46:36.570404+0000","last_became_active":"2024-09-19T04:46:36.569898+0000","last_became_peered":"2024-09-19T04:46:36.569898+0000","last_unstale":"2024-09-19T04:46:36.570404+0000","last_undegraded":"2024-09-19T04:46:36.570404+0000","last_fullsized":"2024-09-19T04:46:36.570404+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:20:47.441702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'8","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.989610+0000","last_change":"2024-09-19T04:46:21.572642+0000","last_active":"2024-09-19T04:46:36.989610+0000","last_peered":"2024-09-19T04:46:36.989610+0000","last_clean":"2024-09-19T04:46:36.989610+0000","last_became_active":"2024-09-19T04:46:21.571823+0000","last_became_peered":"2024-09-19T04:46:21.571823+0000","last_unstale":"2024-09-19T04:46:36.989610+0000","last_undegraded":"2024-09-19T04:46:36.989610+0000","last_fullsized":"2024-09-19T04:46:36.989610+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:28.956744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.569490+0000","last_change":"2024-09-19T04:46:23.524169+0000","last_active":"2024-09-19T04:46:36.569490+0000","last_peered":"2024-09-19T04:46:36.569490+0000","last_clean":"2024-09-19T04:46:36.569490+0000","last_became_active":"2024-09-19T04:46:23.523869+0000","last_became_peered":"2024-09-19T04:46:23.523869+0000","last_unstale":"2024-09-19T04:46:36.569490+0000","last_undegraded":"2024-09-19T04:46:36.569490+0000","last_fullsized":"2024-09-19T04:46:36.569490+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:46.131143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.989981+0000","last_change":"2024-09-19T04:46:21.490154+0000","last_active":"2024-09-19T04:46:36.989981+0000","last_peered":"2024-09-19T04:46:36.989981+0000","last_clean":"2024-09-19T04:46:36.989981+0000","last_became_active":"2024-09-19T04:46:21.489820+0000","last_became_peered":"2024-09-19T04:46:21.489820+0000","last_unstale":"2024-09-19T04:46:36.989981+0000","last_undegraded":"2024-09-19T04:46:36.989981+0000","last_fullsized":"2024-09-19T04:46:36.989981+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:34:27.446664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.563380+0000","last_change":"2024-09-19T04:46:23.518712+0000","last_active":"2024-09-19T04:46:36.563380+0000","last_peered":"2024-09-19T04:46:36.563380+0000","last_clean":"2024-09-19T04:46:36.563380+0000","last_became_active":"2024-09-19T04:46:23.518408+0000","last_became_peered":"2024-09-19T04:46:23.518408+0000","last_unstale":"2024-09-19T04:46:36.563380+0000","last_undegraded":"2024-09-19T04:46:36.563380+0000","last_fullsized":"2024-09-19T04:46:36.563380+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:45:17.398334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.805508+0000","last_change":"2024-09-19T04:46:21.487789+0000","last_active":"2024-09-19T04:46:36.805508+0000","last_peered":"2024-09-19T04:46:36.805508+0000","last_clean":"2024-09-19T04:46:36.805508+0000","last_became_active":"2024-09-19T04:46:21.487411+0000","last_became_peered":"2024-09-19T04:46:21.487411+0000","last_unstale":"2024-09-19T04:46:36.805508+0000","last_undegraded":"2024-09-19T04:46:36.805508+0000","last_fullsized":"2024-09-19T04:46:36.805508+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:25.353345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.565977+0000","last_change":"2024-09-19T04:46:23.515432+0000","last_active":"2024-09-19T04:46:36.565977+0000","last_peered":"2024-09-19T04:46:36.565977+0000","last_clean":"2024-09-19T04:46:36.565977+0000","last_became_active":"2024-09-19T04:46:23.515071+0000","last_became_peered":"2024-09-19T04:46:23.515071+0000","last_unstale":"2024-09-19T04:46:36.565977+0000","last_undegraded":"2024-09-19T04:46:36.565977+0000","last_fullsized":"2024-09-19T04:46:36.565977+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:56:04.743652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.570557+0000","last_change":"2024-09-19T04:46:21.487856+0000","last_active":"2024-09-19T04:46:36.570557+0000","last_peered":"2024-09-19T04:46:36.570557+0000","last_clean":"2024-09-19T04:46:36.570557+0000","last_became_active":"2024-09-19T04:46:21.487342+0000","last_became_peered":"2024-09-19T04:46:21.487342+0000","last_unstale":"2024-09-19T04:46:36.570557+0000","last_undegraded":"2024-09-19T04:46:36.570557+0000","last_fullsized":"2024-09-19T04:46:36.570557+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:29.275296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.565152+0000","last_change":"2024-09-19T04:46:23.517250+0000","last_active":"2024-09-19T04:46:36.565152+0000","last_peered":"2024-09-19T04:46:36.565152+0000","last_clean":"2024-09-19T04:46:36.565152+0000","last_became_active":"2024-09-19T04:46:23.516895+0000","last_became_peered":"2024-09-19T04:46:23.516895+0000","last_unstale":"2024-09-19T04:46:36.565152+0000","last_undegraded":"2024-09-19T04:46:36.565152+0000","last_fullsized":"2024-09-19T04:46:36.565152+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:51.982348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.566597+0000","last_change":"2024-09-19T04:46:21.572452+0000","last_active":"2024-09-19T04:46:36.566597+0000","last_peered":"2024-09-19T04:46:36.566597+0000","last_clean":"2024-09-19T04:46:36.566597+0000","last_became_active":"2024-09-19T04:46:21.572026+0000","last_became_peered":"2024-09-19T04:46:21.572026+0000","last_unstale":"2024-09-19T04:46:36.566597+0000","last_undegraded":"2024-09-19T04:46:36.566597+0000","last_fullsized":"2024-09-19T04:46:36.566597+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:07.859604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.565707+0000","last_change":"2024-09-19T04:46:23.523549+0000","last_active":"2024-09-19T04:46:36.565707+0000","last_peered":"2024-09-19T04:46:36.565707+0000","last_clean":"2024-09-19T04:46:36.565707+0000","last_became_active":"2024-09-19T04:46:23.522581+0000","last_became_peered":"2024-09-19T04:46:23.522581+0000","last_unstale":"2024-09-19T04:46:36.565707+0000","last_undegraded":"2024-09-19T04:46:36.565707+0000","last_fullsized":"2024-09-19T04:46:36.565707+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:51:33.504024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":341,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.567404+0000","last_change":"2024-09-19T04:45:12.271676+0000","last_active":"2024-09-19T04:46:36.567404+0000","last_peered":"2024-09-19T04:46:36.567404+0000","last_clean":"2024-09-19T04:46:36.567404+0000","last_became_active":"2024-09-19T04:45:12.271093+0000","last_became_peered":"2024-09-19T04:45:12.271093+0000","last_unstale":"2024-09-19T04:46:36.567404+0000","last_undegraded":"2024-09-19T04:46:36.567404+0000","last_fullsized":"2024-09-19T04:46:36.567404+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:41:52.010883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:41:52.010883+0000","last_clean_scrub_stamp":"2024-09-19T04:41:52.010883+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:48.499621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.813898+0000","last_change":"2024-09-19T04:46:21.493847+0000","last_active":"2024-09-19T04:46:36.813898+0000","last_peered":"2024-09-19T04:46:36.813898+0000","last_clean":"2024-09-19T04:46:36.813898+0000","last_became_active":"2024-09-19T04:46:21.493432+0000","last_became_peered":"2024-09-19T04:46:21.493432+0000","last_unstale":"2024-09-19T04:46:36.813898+0000","last_undegraded":"2024-09-19T04:46:36.813898+0000","last_fullsized":"2024-09-19T04:46:36.813898+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:10:21.398602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.559747+0000","last_change":"2024-09-19T04:46:23.517517+0000","last_active":"2024-09-19T04:46:36.559747+0000","last_peered":"2024-09-19T04:46:36.559747+0000","last_clean":"2024-09-19T04:46:36.559747+0000","last_became_active":"2024-09-19T04:46:23.517191+0000","last_became_peered":"2024-09-19T04:46:23.517191+0000","last_unstale":"2024-09-19T04:46:36.559747+0000","last_undegraded":"2024-09-19T04:46:36.559747+0000","last_fullsized":"2024-09-19T04:46:36.559747+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:17.896149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.794380+0000","last_change":"2024-09-19T04:46:36.794380+0000","last_active":"2024-09-19T04:46:36.794380+0000","last_peered":"2024-09-19T04:46:36.794380+0000","last_clean":"2024-09-19T04:46:36.794380+0000","last_became_active":"2024-09-19T04:46:36.793911+0000","last_became_peered":"2024-09-19T04:46:36.793911+0000","last_unstale":"2024-09-19T04:46:36.794380+0000","last_undegraded":"2024-09-19T04:46:36.794380+0000","last_fullsized":"2024-09-19T04:46:36.794380+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:01:37.733641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1],"acting":[7,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.805188+0000","last_change":"2024-09-19T04:46:23.514102+0000","last_active":"2024-09-19T04:46:36.805188+0000","last_peered":"2024-09-19T04:46:36.805188+0000","last_clean":"2024-09-19T04:46:36.805188+0000","last_became_active":"2024-09-19T04:46:23.513732+0000","last_became_peered":"2024-09-19T04:46:23.513732+0000","last_unstale":"2024-09-19T04:46:36.805188+0000","last_undegraded":"2024-09-19T04:46:36.805188+0000","last_fullsized":"2024-09-19T04:46:36.805188+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:13.533065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.805277+0000","last_change":"2024-09-19T04:46:21.572628+0000","last_active":"2024-09-19T04:46:36.805277+0000","last_peered":"2024-09-19T04:46:36.805277+0000","last_clean":"2024-09-19T04:46:36.805277+0000","last_became_active":"2024-09-19T04:46:21.571736+0000","last_became_peered":"2024-09-19T04:46:21.571736+0000","last_unstale":"2024-09-19T04:46:36.805277+0000","last_undegraded":"2024-09-19T04:46:36.805277+0000","last_fullsized":"2024-09-19T04:46:36.805277+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:10:50.204481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.991388+0000","last_change":"2024-09-19T04:46:36.991388+0000","last_active":"2024-09-19T04:46:36.991388+0000","last_peered":"2024-09-19T04:46:36.991388+0000","last_clean":"2024-09-19T04:46:36.991388+0000","last_became_active":"2024-09-19T04:46:36.990923+0000","last_became_peered":"2024-09-19T04:46:36.990923+0000","last_unstale":"2024-09-19T04:46:36.991388+0000","last_undegraded":"2024-09-19T04:46:36.991388+0000","last_fullsized":"2024-09-19T04:46:36.991388+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:31.148732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.565443+0000","last_change":"2024-09-19T04:46:21.492696+0000","last_active":"2024-09-19T04:46:36.565443+0000","last_peered":"2024-09-19T04:46:36.565443+0000","last_clean":"2024-09-19T04:46:36.565443+0000","last_became_active":"2024-09-19T04:46:21.492306+0000","last_became_peered":"2024-09-19T04:46:21.492306+0000","last_unstale":"2024-09-19T04:46:36.565443+0000","last_undegraded":"2024-09-19T04:46:36.565443+0000","last_fullsized":"2024-09-19T04:46:36.565443+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:51:56.975170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.989535+0000","last_change":"2024-09-19T04:46:36.989535+0000","last_active":"2024-09-19T04:46:36.989535+0000","last_peered":"2024-09-19T04:46:36.989535+0000","last_clean":"2024-09-19T04:46:36.989535+0000","last_became_active":"2024-09-19T04:46:36.989252+0000","last_became_peered":"2024-09-19T04:46:36.989252+0000","last_unstale":"2024-09-19T04:46:36.989535+0000","last_undegraded":"2024-09-19T04:46:36.989535+0000","last_fullsized":"2024-09-19T04:46:36.989535+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:49:45.767547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.561754+0000","last_change":"2024-09-19T04:46:21.572275+0000","last_active":"2024-09-19T04:46:36.561754+0000","last_peered":"2024-09-19T04:46:36.561754+0000","last_clean":"2024-09-19T04:46:36.561754+0000","last_became_active":"2024-09-19T04:46:21.571940+0000","last_became_peered":"2024-09-19T04:46:21.571940+0000","last_unstale":"2024-09-19T04:46:36.561754+0000","last_undegraded":"2024-09-19T04:46:36.561754+0000","last_fullsized":"2024-09-19T04:46:36.561754+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:13.399887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.561705+0000","last_change":"2024-09-19T04:46:23.514355+0000","last_active":"2024-09-19T04:46:36.561705+0000","last_peered":"2024-09-19T04:46:36.561705+0000","last_clean":"2024-09-19T04:46:36.561705+0000","last_became_active":"2024-09-19T04:46:23.513963+0000","last_became_peered":"2024-09-19T04:46:23.513963+0000","last_unstale":"2024-09-19T04:46:36.561705+0000","last_undegraded":"2024-09-19T04:46:36.561705+0000","last_fullsized":"2024-09-19T04:46:36.561705+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:06.742732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.990038+0000","last_change":"2024-09-19T04:46:21.572466+0000","last_active":"2024-09-19T04:46:36.990038+0000","last_peered":"2024-09-19T04:46:36.990038+0000","last_clean":"2024-09-19T04:46:36.990038+0000","last_became_active":"2024-09-19T04:46:21.571868+0000","last_became_peered":"2024-09-19T04:46:21.571868+0000","last_unstale":"2024-09-19T04:46:36.990038+0000","last_undegraded":"2024-09-19T04:46:36.990038+0000","last_fullsized":"2024-09-19T04:46:36.990038+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:01.132858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.805440+0000","last_change":"2024-09-19T04:46:23.509517+0000","last_active":"2024-09-19T04:46:36.805440+0000","last_peered":"2024-09-19T04:46:36.805440+0000","last_clean":"2024-09-19T04:46:36.805440+0000","last_became_active":"2024-09-19T04:46:23.509216+0000","last_became_peered":"2024-09-19T04:46:23.509216+0000","last_unstale":"2024-09-19T04:46:36.805440+0000","last_undegraded":"2024-09-19T04:46:36.805440+0000","last_fullsized":"2024-09-19T04:46:36.805440+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:29:52.747643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'5","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:40.511277+0000","last_change":"2024-09-19T04:46:21.484462+0000","last_active":"2024-09-19T04:46:40.511277+0000","last_peered":"2024-09-19T04:46:40.511277+0000","last_clean":"2024-09-19T04:46:40.511277+0000","last_became_active":"2024-09-19T04:46:21.484148+0000","last_became_peered":"2024-09-19T04:46:21.484148+0000","last_unstale":"2024-09-19T04:46:40.511277+0000","last_undegraded":"2024-09-19T04:46:40.511277+0000","last_fullsized":"2024-09-19T04:46:40.511277+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:17:18.742857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.559667+0000","last_change":"2024-09-19T04:46:23.512768+0000","last_active":"2024-09-19T04:46:36.559667+0000","last_peered":"2024-09-19T04:46:36.559667+0000","last_clean":"2024-09-19T04:46:36.559667+0000","last_became_active":"2024-09-19T04:46:23.512416+0000","last_became_peered":"2024-09-19T04:46:23.512416+0000","last_unstale":"2024-09-19T04:46:36.559667+0000","last_undegraded":"2024-09-19T04:46:36.559667+0000","last_fullsized":"2024-09-19T04:46:36.559667+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:03:48.340126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.814035+0000","last_change":"2024-09-19T04:46:21.488634+0000","last_active":"2024-09-19T04:46:36.814035+0000","last_peered":"2024-09-19T04:46:36.814035+0000","last_clean":"2024-09-19T04:46:36.814035+0000","last_became_active":"2024-09-19T04:46:21.488078+0000","last_became_peered":"2024-09-19T04:46:21.488078+0000","last_unstale":"2024-09-19T04:46:36.814035+0000","last_undegraded":"2024-09-19T04:46:36.814035+0000","last_fullsized":"2024-09-19T04:46:36.814035+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:31:47.946873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.988687+0000","last_change":"2024-09-19T04:46:23.522419+0000","last_active":"2024-09-19T04:46:36.988687+0000","last_peered":"2024-09-19T04:46:36.988687+0000","last_clean":"2024-09-19T04:46:36.988687+0000","last_became_active":"2024-09-19T04:46:23.522054+0000","last_became_peered":"2024-09-19T04:46:23.522054+0000","last_unstale":"2024-09-19T04:46:36.988687+0000","last_undegraded":"2024-09-19T04:46:36.988687+0000","last_fullsized":"2024-09-19T04:46:36.988687+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:43.720439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.793099+0000","last_change":"2024-09-19T04:46:21.572283+0000","last_active":"2024-09-19T04:46:36.793099+0000","last_peered":"2024-09-19T04:46:36.793099+0000","last_clean":"2024-09-19T04:46:36.793099+0000","last_became_active":"2024-09-19T04:46:21.572023+0000","last_became_peered":"2024-09-19T04:46:21.572023+0000","last_unstale":"2024-09-19T04:46:36.793099+0000","last_undegraded":"2024-09-19T04:46:36.793099+0000","last_fullsized":"2024-09-19T04:46:36.793099+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:37:26.293900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.989428+0000","last_change":"2024-09-19T04:46:23.516278+0000","last_active":"2024-09-19T04:46:36.989428+0000","last_peered":"2024-09-19T04:46:36.989428+0000","last_clean":"2024-09-19T04:46:36.989428+0000","last_became_active":"2024-09-19T04:46:23.515922+0000","last_became_peered":"2024-09-19T04:46:23.515922+0000","last_unstale":"2024-09-19T04:46:36.989428+0000","last_undegraded":"2024-09-19T04:46:36.989428+0000","last_fullsized":"2024-09-19T04:46:36.989428+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:26:11.038230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.559541+0000","last_change":"2024-09-19T04:46:21.489250+0000","last_active":"2024-09-19T04:46:36.559541+0000","last_peered":"2024-09-19T04:46:36.559541+0000","last_clean":"2024-09-19T04:46:36.559541+0000","last_became_active":"2024-09-19T04:46:21.488910+0000","last_became_peered":"2024-09-19T04:46:21.488910+0000","last_unstale":"2024-09-19T04:46:36.559541+0000","last_undegraded":"2024-09-19T04:46:36.559541+0000","last_fullsized":"2024-09-19T04:46:36.559541+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:04:03.650494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.563213+0000","last_change":"2024-09-19T04:46:23.512663+0000","last_active":"2024-09-19T04:46:36.563213+0000","last_peered":"2024-09-19T04:46:36.563213+0000","last_clean":"2024-09-19T04:46:36.563213+0000","last_became_active":"2024-09-19T04:46:23.512265+0000","last_became_peered":"2024-09-19T04:46:23.512265+0000","last_unstale":"2024-09-19T04:46:36.563213+0000","last_undegraded":"2024-09-19T04:46:36.563213+0000","last_fullsized":"2024-09-19T04:46:36.563213+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:52.903900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.991462+0000","last_change":"2024-09-19T04:46:36.990653+0000","last_active":"2024-09-19T04:46:36.991462+0000","last_peered":"2024-09-19T04:46:36.991462+0000","last_clean":"2024-09-19T04:46:36.991462+0000","last_became_active":"2024-09-19T04:46:36.990202+0000","last_became_peered":"2024-09-19T04:46:36.990202+0000","last_unstale":"2024-09-19T04:46:36.991462+0000","last_undegraded":"2024-09-19T04:46:36.991462+0000","last_fullsized":"2024-09-19T04:46:36.991462+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:25:53.780614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.559689+0000","last_change":"2024-09-19T04:46:23.510196+0000","last_active":"2024-09-19T04:46:36.559689+0000","last_peered":"2024-09-19T04:46:36.559689+0000","last_clean":"2024-09-19T04:46:36.559689+0000","last_became_active":"2024-09-19T04:46:23.509871+0000","last_became_peered":"2024-09-19T04:46:23.509871+0000","last_unstale":"2024-09-19T04:46:36.559689+0000","last_undegraded":"2024-09-19T04:46:36.559689+0000","last_fullsized":"2024-09-19T04:46:36.559689+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:42:01.825770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.989648+0000","last_change":"2024-09-19T04:46:21.492279+0000","last_active":"2024-09-19T04:46:36.989648+0000","last_peered":"2024-09-19T04:46:36.989648+0000","last_clean":"2024-09-19T04:46:36.989648+0000","last_became_active":"2024-09-19T04:46:21.491669+0000","last_became_peered":"2024-09-19T04:46:21.491669+0000","last_unstale":"2024-09-19T04:46:36.989648+0000","last_undegraded":"2024-09-19T04:46:36.989648+0000","last_fullsized":"2024-09-19T04:46:36.989648+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:23:15.822887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.565280+0000","last_change":"2024-09-19T04:46:23.518114+0000","last_active":"2024-09-19T04:46:36.565280+0000","last_peered":"2024-09-19T04:46:36.565280+0000","last_clean":"2024-09-19T04:46:36.565280+0000","last_became_active":"2024-09-19T04:46:23.517707+0000","last_became_peered":"2024-09-19T04:46:23.517707+0000","last_unstale":"2024-09-19T04:46:36.565280+0000","last_undegraded":"2024-09-19T04:46:36.565280+0000","last_fullsized":"2024-09-19T04:46:36.565280+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:52.438748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.570333+0000","last_change":"2024-09-19T04:46:23.525164+0000","last_active":"2024-09-19T04:46:36.570333+0000","last_peered":"2024-09-19T04:46:36.570333+0000","last_clean":"2024-09-19T04:46:36.570333+0000","last_became_active":"2024-09-19T04:46:23.524735+0000","last_became_peered":"2024-09-19T04:46:23.524735+0000","last_unstale":"2024-09-19T04:46:36.570333+0000","last_undegraded":"2024-09-19T04:46:36.570333+0000","last_fullsized":"2024-09-19T04:46:36.570333+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:53.590834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.989803+0000","last_change":"2024-09-19T04:46:21.492940+0000","last_active":"2024-09-19T04:46:36.989803+0000","last_peered":"2024-09-19T04:46:36.989803+0000","last_clean":"2024-09-19T04:46:36.989803+0000","last_became_active":"2024-09-19T04:46:21.492602+0000","last_became_peered":"2024-09-19T04:46:21.492602+0000","last_unstale":"2024-09-19T04:46:36.989803+0000","last_undegraded":"2024-09-19T04:46:36.989803+0000","last_fullsized":"2024-09-19T04:46:36.989803+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:20.554832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.792910+0000","last_change":"2024-09-19T04:46:23.513432+0000","last_active":"2024-09-19T04:46:36.792910+0000","last_peered":"2024-09-19T04:46:36.792910+0000","last_clean":"2024-09-19T04:46:36.792910+0000","last_became_active":"2024-09-19T04:46:23.513084+0000","last_became_peered":"2024-09-19T04:46:23.513084+0000","last_unstale":"2024-09-19T04:46:36.792910+0000","last_undegraded":"2024-09-19T04:46:36.792910+0000","last_fullsized":"2024-09-19T04:46:36.792910+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:03:16.732545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.989947+0000","last_change":"2024-09-19T04:46:21.491823+0000","last_active":"2024-09-19T04:46:36.989947+0000","last_peered":"2024-09-19T04:46:36.989947+0000","last_clean":"2024-09-19T04:46:36.989947+0000","last_became_active":"2024-09-19T04:46:21.491401+0000","last_became_peered":"2024-09-19T04:46:21.491401+0000","last_unstale":"2024-09-19T04:46:36.989947+0000","last_undegraded":"2024-09-19T04:46:36.989947+0000","last_fullsized":"2024-09-19T04:46:36.989947+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:55.955868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.988852+0000","last_change":"2024-09-19T04:46:23.515884+0000","last_active":"2024-09-19T04:46:36.988852+0000","last_peered":"2024-09-19T04:46:36.988852+0000","last_clean":"2024-09-19T04:46:36.988852+0000","last_became_active":"2024-09-19T04:46:23.515243+0000","last_became_peered":"2024-09-19T04:46:23.515243+0000","last_unstale":"2024-09-19T04:46:36.988852+0000","last_undegraded":"2024-09-19T04:46:36.988852+0000","last_fullsized":"2024-09-19T04:46:36.988852+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:07:33.716942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.559784+0000","last_change":"2024-09-19T04:46:21.572122+0000","last_active":"2024-09-19T04:46:36.559784+0000","last_peered":"2024-09-19T04:46:36.559784+0000","last_clean":"2024-09-19T04:46:36.559784+0000","last_became_active":"2024-09-19T04:46:21.571747+0000","last_became_peered":"2024-09-19T04:46:21.571747+0000","last_unstale":"2024-09-19T04:46:36.559784+0000","last_undegraded":"2024-09-19T04:46:36.559784+0000","last_fullsized":"2024-09-19T04:46:36.559784+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:06:43.411409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.559639+0000","last_change":"2024-09-19T04:46:23.513876+0000","last_active":"2024-09-19T04:46:36.559639+0000","last_peered":"2024-09-19T04:46:36.559639+0000","last_clean":"2024-09-19T04:46:36.559639+0000","last_became_active":"2024-09-19T04:46:23.513562+0000","last_became_peered":"2024-09-19T04:46:23.513562+0000","last_unstale":"2024-09-19T04:46:36.559639+0000","last_undegraded":"2024-09-19T04:46:36.559639+0000","last_fullsized":"2024-09-19T04:46:36.559639+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:21.982001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.561722+0000","last_change":"2024-09-19T04:46:21.491550+0000","last_active":"2024-09-19T04:46:36.561722+0000","last_peered":"2024-09-19T04:46:36.561722+0000","last_clean":"2024-09-19T04:46:36.561722+0000","last_became_active":"2024-09-19T04:46:21.491259+0000","last_became_peered":"2024-09-19T04:46:21.491259+0000","last_unstale":"2024-09-19T04:46:36.561722+0000","last_undegraded":"2024-09-19T04:46:36.561722+0000","last_fullsized":"2024-09-19T04:46:36.561722+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:38.671211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":47600,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":36,"num_read_kb":65,"num_write":67,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":233472,"data_stored":142800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":57,"ondisk_log_size":57,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645329,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32040,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713112,"statfs":{"total":95995035648,"available":95962226688,"internally_reserved":0,"allocated":872448,"data_stored":426161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874262,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36844,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708308,"statfs":{"total":95995035648,"available":95957307392,"internally_reserved":0,"allocated":1536000,"data_stored":1063608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":36174273},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005083,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40356,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704796,"statfs":{"total":95995035648,"available":95953711104,"internally_reserved":0,"allocated":872448,"data_stored":426709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234016,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":876544,"data_stored":426731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462949,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28460,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716692,"statfs":{"total":95995035648,"available":95965892608,"internally_reserved":0,"allocated":1470464,"data_stored":1017194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626473,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36200,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708952,"statfs":{"total":95995035648,"available":95957966848,"internally_reserved":0,"allocated":872448,"data_stored":426244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855406,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28468,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716684,"statfs":{"total":95995035648,"available":95965884416,"internally_reserved":0,"allocated":1478656,"data_stored":1016794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018931,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36204,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708948,"statfs":{"total":95995035648,"available":95957962752,"internally_reserved":0,"allocated":872448,"data_stored":426149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247865,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":426465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476798,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":925696,"data_stored":472929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607618,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40400,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704752,"statfs":{"total":95995035648,"available":95953666048,"internally_reserved":0,"allocated":917504,"data_stored":467192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738439,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40364,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704788,"statfs":{"total":95995035648,"available":95953702912,"internally_reserved":0,"allocated":872448,"data_stored":426217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":46802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":46802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":46996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T04:46:46.744 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T04:46:47.003 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:46:47.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:47 smithi018 ceph-mon[34537]: pgmap v285: 97 pgs: 97 active+clean; 623 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 5.4 KiB/s wr, 4 op/s; 3 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T04:46:47.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:47 smithi018 ceph-mon[34537]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:46:47.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:47 smithi002 ceph-mon[30975]: pgmap v285: 97 pgs: 97 active+clean; 623 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 5.4 KiB/s wr, 4 op/s; 3 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T04:46:47.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:47 smithi002 ceph-mon[30975]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:46:47.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:47 smithi116 ceph-mon[34477]: pgmap v285: 97 pgs: 97 active+clean; 623 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 5.4 KiB/s wr, 4 op/s; 3 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T04:46:47.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:47 smithi116 ceph-mon[34477]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:46:47.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.476+0000 7f15d4eb8640 1 -- 172.21.15.2:0/170581924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15d01082a0 msgr2=0x7f15d010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:47.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.476+0000 7f15d4eb8640 1 --2- 172.21.15.2:0/170581924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15d01082a0 0x7f15d010ec40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f15c8009930 tx=0x7f15c802a440 comp rx=0 tx=0).stop 2024-09-19T04:46:47.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.476+0000 7f15d4eb8640 1 -- 172.21.15.2:0/170581924 shutdown_connections 2024-09-19T04:46:47.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.476+0000 7f15d4eb8640 1 --2- 172.21.15.2:0/170581924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15d01082a0 0x7f15d010ec40 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:47.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.476+0000 7f15d4eb8640 1 --2- 172.21.15.2:0/170581924 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f15d01036e0 0x7f15d0107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:47.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.476+0000 7f15d4eb8640 1 --2- 172.21.15.2:0/170581924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15d0102d30 0x7f15d0103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:47.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.476+0000 7f15d4eb8640 1 -- 172.21.15.2:0/170581924 >> 172.21.15.2:0/170581924 conn(0x7f15d00fc7d0 msgr2=0x7f15d00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:47.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.476+0000 7f15d4eb8640 1 -- 172.21.15.2:0/170581924 shutdown_connections 2024-09-19T04:46:47.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.476+0000 7f15d4eb8640 1 -- 172.21.15.2:0/170581924 wait complete. 2024-09-19T04:46:47.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.477+0000 7f15d4eb8640 1 Processor -- start 2024-09-19T04:46:47.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.477+0000 7f15d4eb8640 1 -- start start 2024-09-19T04:46:47.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.477+0000 7f15d4eb8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f15d0102d30 0x7f15d01a0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:47.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.477+0000 7f15d4eb8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15d01036e0 0x7f15d01a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:47.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.477+0000 7f15d4eb8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15d01082a0 0x7f15d019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:47.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.477+0000 7f15d4eb8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f15d0112010 con 0x7f15d01082a0 2024-09-19T04:46:47.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.477+0000 7f15d4eb8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f15d0111e90 con 0x7f15d01036e0 2024-09-19T04:46:47.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.477+0000 7f15d4eb8640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f15d0112190 con 0x7f15d0102d30 2024-09-19T04:46:47.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.477+0000 7f15ced9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15d01082a0 0x7f15d019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:47.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.477+0000 7f15ced9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15d01082a0 0x7f15d019a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40640/0 (socket says 172.21.15.2:40640) 2024-09-19T04:46:47.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.477+0000 7f15ced9d640 1 -- 172.21.15.2:0/1555437650 learned_addr learned my addr 172.21.15.2:0/1555437650 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:46:47.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.477+0000 7f15ce59c640 1 --2- 172.21.15.2:0/1555437650 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f15d0102d30 0x7f15d01a0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:47.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.477+0000 7f15cdd9b640 1 --2- 172.21.15.2:0/1555437650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15d01036e0 0x7f15d01a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:47.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.477+0000 7f15ced9d640 1 -- 172.21.15.2:0/1555437650 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f15d0102d30 msgr2=0x7f15d01a0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:47.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.477+0000 7f15ced9d640 1 --2- 172.21.15.2:0/1555437650 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f15d0102d30 0x7f15d01a0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:47.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.477+0000 7f15ced9d640 1 -- 172.21.15.2:0/1555437650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15d01036e0 msgr2=0x7f15d01a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:47.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.477+0000 7f15ced9d640 1 --2- 172.21.15.2:0/1555437650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15d01036e0 0x7f15d01a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:47.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.477+0000 7f15ced9d640 1 -- 172.21.15.2:0/1555437650 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d019ad50 con 0x7f15d01082a0 2024-09-19T04:46:47.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.478+0000 7f15ced9d640 1 --2- 172.21.15.2:0/1555437650 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15d01082a0 0x7f15d019a620 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f15c8009900 tx=0x7f15c8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:47.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.478+0000 7f15c77fe640 1 -- 172.21.15.2:0/1555437650 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c803f030 con 0x7f15d01082a0 2024-09-19T04:46:47.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.478+0000 7f15c77fe640 1 -- 172.21.15.2:0/1555437650 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f15c80035f0 con 0x7f15d01082a0 2024-09-19T04:46:47.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.478+0000 7f15c77fe640 1 -- 172.21.15.2:0/1555437650 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c8035070 con 0x7f15d01082a0 2024-09-19T04:46:47.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.478+0000 7f15d4eb8640 1 -- 172.21.15.2:0/1555437650 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15d019afe0 con 0x7f15d01082a0 2024-09-19T04:46:47.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.478+0000 7f15d4eb8640 1 -- 172.21.15.2:0/1555437650 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15d01a7330 con 0x7f15d01082a0 2024-09-19T04:46:47.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.479+0000 7f15d4eb8640 1 -- 172.21.15.2:0/1555437650 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15d0103190 con 0x7f15d01082a0 2024-09-19T04:46:47.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.480+0000 7f15c77fe640 1 -- 172.21.15.2:0/1555437650 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f15c8003b10 con 0x7f15d01082a0 2024-09-19T04:46:47.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.481+0000 7f15c77fe640 1 --2- 172.21.15.2:0/1555437650 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f15bc0a32d0 0x7f15bc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:47.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.481+0000 7f15ce59c640 1 --2- 172.21.15.2:0/1555437650 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f15bc0a32d0 0x7f15bc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:47.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.481+0000 7f15c77fe640 1 -- 172.21.15.2:0/1555437650 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f15c80f0700 con 0x7f15d01082a0 2024-09-19T04:46:47.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.482+0000 7f15ce59c640 1 --2- 172.21.15.2:0/1555437650 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f15bc0a32d0 0x7f15bc0a5790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f15c0009f20 tx=0x7f15c00094f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:47.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.485+0000 7f15c77fe640 1 -- 172.21.15.2:0/1555437650 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f15c80bd2f0 con 0x7f15d01082a0 2024-09-19T04:46:47.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.663+0000 7f15d4eb8640 1 -- 172.21.15.2:0/1555437650 --> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f15d0062630 con 0x7f15bc0a32d0 2024-09-19T04:46:47.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.670+0000 7f15c77fe640 1 -- 172.21.15.2:0/1555437650 <== mgr.14150 v2:172.21.15.2:6800/3171525177 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258648 (secure 0 0 0) 0x7f15d0062630 con 0x7f15bc0a32d0 2024-09-19T04:46:47.677 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:46:47.678 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-19T04:46:47.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.674+0000 7f15d4eb8640 1 -- 172.21.15.2:0/1555437650 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f15bc0a32d0 msgr2=0x7f15bc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:47.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.674+0000 7f15d4eb8640 1 --2- 172.21.15.2:0/1555437650 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f15bc0a32d0 0x7f15bc0a5790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f15c0009f20 tx=0x7f15c00094f0 comp rx=0 tx=0).stop 2024-09-19T04:46:47.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.674+0000 7f15d4eb8640 1 -- 172.21.15.2:0/1555437650 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15d01082a0 msgr2=0x7f15d019a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:47.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.674+0000 7f15d4eb8640 1 --2- 172.21.15.2:0/1555437650 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15d01082a0 0x7f15d019a620 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f15c8009900 tx=0x7f15c8004270 comp rx=0 tx=0).stop 2024-09-19T04:46:47.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.674+0000 7f15d4eb8640 1 -- 172.21.15.2:0/1555437650 shutdown_connections 2024-09-19T04:46:47.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.674+0000 7f15d4eb8640 1 --2- 172.21.15.2:0/1555437650 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f15bc0a32d0 0x7f15bc0a5790 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:47.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.674+0000 7f15d4eb8640 1 --2- 172.21.15.2:0/1555437650 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15d01082a0 0x7f15d019a620 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:47.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.674+0000 7f15d4eb8640 1 --2- 172.21.15.2:0/1555437650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15d01036e0 0x7f15d01a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:47.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.674+0000 7f15d4eb8640 1 --2- 172.21.15.2:0/1555437650 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f15d0102d30 0x7f15d01a0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:47.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.674+0000 7f15d4eb8640 1 -- 172.21.15.2:0/1555437650 >> 172.21.15.2:0/1555437650 conn(0x7f15d00fc7d0 msgr2=0x7f15d0100da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:47.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.674+0000 7f15d4eb8640 1 -- 172.21.15.2:0/1555437650 shutdown_connections 2024-09-19T04:46:47.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:47.674+0000 7f15d4eb8640 1 -- 172.21.15.2:0/1555437650 wait complete. 2024-09-19T04:46:48.406 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":286,"stamp":"2024-09-19T04:46:47.545676+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":638202,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":172,"num_read_kb":184,"num_write":250,"num_write_kb":3006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1180770,"num_keys_recovered":10,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":407200,"kb_used_data":12168,"kb_used_omap":18,"kb_used_meta":394797,"kb_avail":1124534624,"statfs":{"total":1151940427776,"available":1151523454976,"internally_reserved":0,"allocated":12460032,"data_stored":7028130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":404272442},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":45424,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":54,"num_write":24,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.987372"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.563629+0000","last_change":"2024-09-19T04:46:23.520907+0000","last_active":"2024-09-19T04:46:36.563629+0000","last_peered":"2024-09-19T04:46:36.563629+0000","last_clean":"2024-09-19T04:46:36.563629+0000","last_became_active":"2024-09-19T04:46:23.519321+0000","last_became_peered":"2024-09-19T04:46:23.519321+0000","last_unstale":"2024-09-19T04:46:36.563629+0000","last_undegraded":"2024-09-19T04:46:36.563629+0000","last_fullsized":"2024-09-19T04:46:36.563629+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:31.529472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.988683+0000","last_change":"2024-09-19T04:46:23.515272+0000","last_active":"2024-09-19T04:46:36.988683+0000","last_peered":"2024-09-19T04:46:36.988683+0000","last_clean":"2024-09-19T04:46:36.988683+0000","last_became_active":"2024-09-19T04:46:23.514760+0000","last_became_peered":"2024-09-19T04:46:23.514760+0000","last_unstale":"2024-09-19T04:46:36.988683+0000","last_undegraded":"2024-09-19T04:46:36.988683+0000","last_fullsized":"2024-09-19T04:46:36.988683+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:32.215940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.988740+0000","last_change":"2024-09-19T04:46:23.516809+0000","last_active":"2024-09-19T04:46:36.988740+0000","last_peered":"2024-09-19T04:46:36.988740+0000","last_clean":"2024-09-19T04:46:36.988740+0000","last_became_active":"2024-09-19T04:46:23.516489+0000","last_became_peered":"2024-09-19T04:46:23.516489+0000","last_unstale":"2024-09-19T04:46:36.988740+0000","last_undegraded":"2024-09-19T04:46:36.988740+0000","last_fullsized":"2024-09-19T04:46:36.988740+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:17:51.183061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.813744+0000","last_change":"2024-09-19T04:46:23.506868+0000","last_active":"2024-09-19T04:46:36.813744+0000","last_peered":"2024-09-19T04:46:36.813744+0000","last_clean":"2024-09-19T04:46:36.813744+0000","last_became_active":"2024-09-19T04:46:23.506489+0000","last_became_peered":"2024-09-19T04:46:23.506489+0000","last_unstale":"2024-09-19T04:46:36.813744+0000","last_undegraded":"2024-09-19T04:46:36.813744+0000","last_fullsized":"2024-09-19T04:46:36.813744+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:22.749973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.989486+0000","last_change":"2024-09-19T04:46:23.506733+0000","last_active":"2024-09-19T04:46:36.989486+0000","last_peered":"2024-09-19T04:46:36.989486+0000","last_clean":"2024-09-19T04:46:36.989486+0000","last_became_active":"2024-09-19T04:46:23.506408+0000","last_became_peered":"2024-09-19T04:46:23.506408+0000","last_unstale":"2024-09-19T04:46:36.989486+0000","last_undegraded":"2024-09-19T04:46:36.989486+0000","last_fullsized":"2024-09-19T04:46:36.989486+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:45:31.821607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.561796+0000","last_change":"2024-09-19T04:46:23.523109+0000","last_active":"2024-09-19T04:46:36.561796+0000","last_peered":"2024-09-19T04:46:36.561796+0000","last_clean":"2024-09-19T04:46:36.561796+0000","last_became_active":"2024-09-19T04:46:23.522783+0000","last_became_peered":"2024-09-19T04:46:23.522783+0000","last_unstale":"2024-09-19T04:46:36.561796+0000","last_undegraded":"2024-09-19T04:46:36.561796+0000","last_fullsized":"2024-09-19T04:46:36.561796+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:34:47.622562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.566699+0000","last_change":"2024-09-19T04:46:23.518297+0000","last_active":"2024-09-19T04:46:36.566699+0000","last_peered":"2024-09-19T04:46:36.566699+0000","last_clean":"2024-09-19T04:46:36.566699+0000","last_became_active":"2024-09-19T04:46:23.517974+0000","last_became_peered":"2024-09-19T04:46:23.517974+0000","last_unstale":"2024-09-19T04:46:36.566699+0000","last_undegraded":"2024-09-19T04:46:36.566699+0000","last_fullsized":"2024-09-19T04:46:36.566699+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:23:26.474961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.559392+0000","last_change":"2024-09-19T04:46:23.516255+0000","last_active":"2024-09-19T04:46:36.559392+0000","last_peered":"2024-09-19T04:46:36.559392+0000","last_clean":"2024-09-19T04:46:36.559392+0000","last_became_active":"2024-09-19T04:46:23.515861+0000","last_became_peered":"2024-09-19T04:46:23.515861+0000","last_unstale":"2024-09-19T04:46:36.559392+0000","last_undegraded":"2024-09-19T04:46:36.559392+0000","last_fullsized":"2024-09-19T04:46:36.559392+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:08:19.747905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.793466+0000","last_change":"2024-09-19T04:46:23.520947+0000","last_active":"2024-09-19T04:46:36.793466+0000","last_peered":"2024-09-19T04:46:36.793466+0000","last_clean":"2024-09-19T04:46:36.793466+0000","last_became_active":"2024-09-19T04:46:23.518463+0000","last_became_peered":"2024-09-19T04:46:23.518463+0000","last_unstale":"2024-09-19T04:46:36.793466+0000","last_undegraded":"2024-09-19T04:46:36.793466+0000","last_fullsized":"2024-09-19T04:46:36.793466+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:00.420868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.561908+0000","last_change":"2024-09-19T04:46:23.524145+0000","last_active":"2024-09-19T04:46:36.561908+0000","last_peered":"2024-09-19T04:46:36.561908+0000","last_clean":"2024-09-19T04:46:36.561908+0000","last_became_active":"2024-09-19T04:46:23.523698+0000","last_became_peered":"2024-09-19T04:46:23.523698+0000","last_unstale":"2024-09-19T04:46:36.561908+0000","last_undegraded":"2024-09-19T04:46:36.561908+0000","last_fullsized":"2024-09-19T04:46:36.561908+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:41.370871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.565617+0000","last_change":"2024-09-19T04:46:23.521782+0000","last_active":"2024-09-19T04:46:36.565617+0000","last_peered":"2024-09-19T04:46:36.565617+0000","last_clean":"2024-09-19T04:46:36.565617+0000","last_became_active":"2024-09-19T04:46:23.521452+0000","last_became_peered":"2024-09-19T04:46:23.521452+0000","last_unstale":"2024-09-19T04:46:36.565617+0000","last_undegraded":"2024-09-19T04:46:36.565617+0000","last_fullsized":"2024-09-19T04:46:36.565617+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:11:35.047064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.813744+0000","last_change":"2024-09-19T04:46:23.518174+0000","last_active":"2024-09-19T04:46:36.813744+0000","last_peered":"2024-09-19T04:46:36.813744+0000","last_clean":"2024-09-19T04:46:36.813744+0000","last_became_active":"2024-09-19T04:46:23.516507+0000","last_became_peered":"2024-09-19T04:46:23.516507+0000","last_unstale":"2024-09-19T04:46:36.813744+0000","last_undegraded":"2024-09-19T04:46:36.813744+0000","last_fullsized":"2024-09-19T04:46:36.813744+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:37.878245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.805393+0000","last_change":"2024-09-19T04:46:23.510582+0000","last_active":"2024-09-19T04:46:36.805393+0000","last_peered":"2024-09-19T04:46:36.805393+0000","last_clean":"2024-09-19T04:46:36.805393+0000","last_became_active":"2024-09-19T04:46:23.510135+0000","last_became_peered":"2024-09-19T04:46:23.510135+0000","last_unstale":"2024-09-19T04:46:36.805393+0000","last_undegraded":"2024-09-19T04:46:36.805393+0000","last_fullsized":"2024-09-19T04:46:36.805393+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:09.721696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.988533+0000","last_change":"2024-09-19T04:46:23.517963+0000","last_active":"2024-09-19T04:46:36.988533+0000","last_peered":"2024-09-19T04:46:36.988533+0000","last_clean":"2024-09-19T04:46:36.988533+0000","last_became_active":"2024-09-19T04:46:23.517574+0000","last_became_peered":"2024-09-19T04:46:23.517574+0000","last_unstale":"2024-09-19T04:46:36.988533+0000","last_undegraded":"2024-09-19T04:46:36.988533+0000","last_fullsized":"2024-09-19T04:46:36.988533+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:48:44.494267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.988454+0000","last_change":"2024-09-19T04:46:23.517318+0000","last_active":"2024-09-19T04:46:36.988454+0000","last_peered":"2024-09-19T04:46:36.988454+0000","last_clean":"2024-09-19T04:46:36.988454+0000","last_became_active":"2024-09-19T04:46:23.516973+0000","last_became_peered":"2024-09-19T04:46:23.516973+0000","last_unstale":"2024-09-19T04:46:36.988454+0000","last_undegraded":"2024-09-19T04:46:36.988454+0000","last_fullsized":"2024-09-19T04:46:36.988454+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:46:28.907400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.792910+0000","last_change":"2024-09-19T04:46:23.517468+0000","last_active":"2024-09-19T04:46:36.792910+0000","last_peered":"2024-09-19T04:46:36.792910+0000","last_clean":"2024-09-19T04:46:36.792910+0000","last_became_active":"2024-09-19T04:46:23.517093+0000","last_became_peered":"2024-09-19T04:46:23.517093+0000","last_unstale":"2024-09-19T04:46:36.792910+0000","last_undegraded":"2024-09-19T04:46:36.792910+0000","last_fullsized":"2024-09-19T04:46:36.792910+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:43.435560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.563738+0000","last_change":"2024-09-19T04:46:23.521679+0000","last_active":"2024-09-19T04:46:36.563738+0000","last_peered":"2024-09-19T04:46:36.563738+0000","last_clean":"2024-09-19T04:46:36.563738+0000","last_became_active":"2024-09-19T04:46:23.519346+0000","last_became_peered":"2024-09-19T04:46:23.519346+0000","last_unstale":"2024-09-19T04:46:36.563738+0000","last_undegraded":"2024-09-19T04:46:36.563738+0000","last_fullsized":"2024-09-19T04:46:36.563738+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:31.740226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.561931+0000","last_change":"2024-09-19T04:46:23.517518+0000","last_active":"2024-09-19T04:46:36.561931+0000","last_peered":"2024-09-19T04:46:36.561931+0000","last_clean":"2024-09-19T04:46:36.561931+0000","last_became_active":"2024-09-19T04:46:23.517179+0000","last_became_peered":"2024-09-19T04:46:23.517179+0000","last_unstale":"2024-09-19T04:46:36.561931+0000","last_undegraded":"2024-09-19T04:46:36.561931+0000","last_fullsized":"2024-09-19T04:46:36.561931+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:38.352433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.566817+0000","last_change":"2024-09-19T04:46:23.506618+0000","last_active":"2024-09-19T04:46:36.566817+0000","last_peered":"2024-09-19T04:46:36.566817+0000","last_clean":"2024-09-19T04:46:36.566817+0000","last_became_active":"2024-09-19T04:46:23.506276+0000","last_became_peered":"2024-09-19T04:46:23.506276+0000","last_unstale":"2024-09-19T04:46:36.566817+0000","last_undegraded":"2024-09-19T04:46:36.566817+0000","last_fullsized":"2024-09-19T04:46:36.566817+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:02:42.216717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.563322+0000","last_change":"2024-09-19T04:46:23.518793+0000","last_active":"2024-09-19T04:46:36.563322+0000","last_peered":"2024-09-19T04:46:36.563322+0000","last_clean":"2024-09-19T04:46:36.563322+0000","last_became_active":"2024-09-19T04:46:23.518386+0000","last_became_peered":"2024-09-19T04:46:23.518386+0000","last_unstale":"2024-09-19T04:46:36.563322+0000","last_undegraded":"2024-09-19T04:46:36.563322+0000","last_fullsized":"2024-09-19T04:46:36.563322+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:08:12.007678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.805447+0000","last_change":"2024-09-19T04:46:23.513022+0000","last_active":"2024-09-19T04:46:36.805447+0000","last_peered":"2024-09-19T04:46:36.805447+0000","last_clean":"2024-09-19T04:46:36.805447+0000","last_became_active":"2024-09-19T04:46:23.512541+0000","last_became_peered":"2024-09-19T04:46:23.512541+0000","last_unstale":"2024-09-19T04:46:36.805447+0000","last_undegraded":"2024-09-19T04:46:36.805447+0000","last_fullsized":"2024-09-19T04:46:36.805447+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:19.873546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.792966+0000","last_change":"2024-09-19T04:46:23.519523+0000","last_active":"2024-09-19T04:46:36.792966+0000","last_peered":"2024-09-19T04:46:36.792966+0000","last_clean":"2024-09-19T04:46:36.792966+0000","last_became_active":"2024-09-19T04:46:23.517995+0000","last_became_peered":"2024-09-19T04:46:23.517995+0000","last_unstale":"2024-09-19T04:46:36.792966+0000","last_undegraded":"2024-09-19T04:46:36.792966+0000","last_fullsized":"2024-09-19T04:46:36.792966+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:23.243522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.559440+0000","last_change":"2024-09-19T04:46:23.517564+0000","last_active":"2024-09-19T04:46:36.559440+0000","last_peered":"2024-09-19T04:46:36.559440+0000","last_clean":"2024-09-19T04:46:36.559440+0000","last_became_active":"2024-09-19T04:46:23.517248+0000","last_became_peered":"2024-09-19T04:46:23.517248+0000","last_unstale":"2024-09-19T04:46:36.559440+0000","last_undegraded":"2024-09-19T04:46:36.559440+0000","last_fullsized":"2024-09-19T04:46:36.559440+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:19.369346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.571382+0000","last_change":"2024-09-19T04:46:23.514150+0000","last_active":"2024-09-19T04:46:36.571382+0000","last_peered":"2024-09-19T04:46:36.571382+0000","last_clean":"2024-09-19T04:46:36.571382+0000","last_became_active":"2024-09-19T04:46:23.512169+0000","last_became_peered":"2024-09-19T04:46:23.512169+0000","last_unstale":"2024-09-19T04:46:36.571382+0000","last_undegraded":"2024-09-19T04:46:36.571382+0000","last_fullsized":"2024-09-19T04:46:36.571382+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:17.475389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.815086+0000","last_change":"2024-09-19T04:46:36.814692+0000","last_active":"2024-09-19T04:46:36.815086+0000","last_peered":"2024-09-19T04:46:36.815086+0000","last_clean":"2024-09-19T04:46:36.815086+0000","last_became_active":"2024-09-19T04:46:36.814429+0000","last_became_peered":"2024-09-19T04:46:36.814429+0000","last_unstale":"2024-09-19T04:46:36.815086+0000","last_undegraded":"2024-09-19T04:46:36.815086+0000","last_fullsized":"2024-09-19T04:46:36.815086+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:10:42.391448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.566542+0000","last_change":"2024-09-19T04:46:23.519273+0000","last_active":"2024-09-19T04:46:36.566542+0000","last_peered":"2024-09-19T04:46:36.566542+0000","last_clean":"2024-09-19T04:46:36.566542+0000","last_became_active":"2024-09-19T04:46:23.519001+0000","last_became_peered":"2024-09-19T04:46:23.519001+0000","last_unstale":"2024-09-19T04:46:36.566542+0000","last_undegraded":"2024-09-19T04:46:36.566542+0000","last_fullsized":"2024-09-19T04:46:36.566542+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:15:30.949066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.563341+0000","last_change":"2024-09-19T04:46:23.520888+0000","last_active":"2024-09-19T04:46:36.563341+0000","last_peered":"2024-09-19T04:46:36.563341+0000","last_clean":"2024-09-19T04:46:36.563341+0000","last_became_active":"2024-09-19T04:46:23.519476+0000","last_became_peered":"2024-09-19T04:46:23.519476+0000","last_unstale":"2024-09-19T04:46:36.563341+0000","last_undegraded":"2024-09-19T04:46:36.563341+0000","last_fullsized":"2024-09-19T04:46:36.563341+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:56.459724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.805408+0000","last_change":"2024-09-19T04:46:23.512152+0000","last_active":"2024-09-19T04:46:36.805408+0000","last_peered":"2024-09-19T04:46:36.805408+0000","last_clean":"2024-09-19T04:46:36.805408+0000","last_became_active":"2024-09-19T04:46:23.511784+0000","last_became_peered":"2024-09-19T04:46:23.511784+0000","last_unstale":"2024-09-19T04:46:36.805408+0000","last_undegraded":"2024-09-19T04:46:36.805408+0000","last_fullsized":"2024-09-19T04:46:36.805408+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:01:23.406580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.988812+0000","last_change":"2024-09-19T04:46:23.522491+0000","last_active":"2024-09-19T04:46:36.988812+0000","last_peered":"2024-09-19T04:46:36.988812+0000","last_clean":"2024-09-19T04:46:36.988812+0000","last_became_active":"2024-09-19T04:46:23.522025+0000","last_became_peered":"2024-09-19T04:46:23.522025+0000","last_unstale":"2024-09-19T04:46:36.988812+0000","last_undegraded":"2024-09-19T04:46:36.988812+0000","last_fullsized":"2024-09-19T04:46:36.988812+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:33.063300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.566102+0000","last_change":"2024-09-19T04:46:23.510057+0000","last_active":"2024-09-19T04:46:36.566102+0000","last_peered":"2024-09-19T04:46:36.566102+0000","last_clean":"2024-09-19T04:46:36.566102+0000","last_became_active":"2024-09-19T04:46:23.509691+0000","last_became_peered":"2024-09-19T04:46:23.509691+0000","last_unstale":"2024-09-19T04:46:36.566102+0000","last_undegraded":"2024-09-19T04:46:36.566102+0000","last_fullsized":"2024-09-19T04:46:36.566102+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:12:16.579944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.565831+0000","last_change":"2024-09-19T04:46:23.516876+0000","last_active":"2024-09-19T04:46:36.565831+0000","last_peered":"2024-09-19T04:46:36.565831+0000","last_clean":"2024-09-19T04:46:36.565831+0000","last_became_active":"2024-09-19T04:46:23.516533+0000","last_became_peered":"2024-09-19T04:46:23.516533+0000","last_unstale":"2024-09-19T04:46:36.565831+0000","last_undegraded":"2024-09-19T04:46:36.565831+0000","last_fullsized":"2024-09-19T04:46:36.565831+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:44.868936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.563114+0000","last_change":"2024-09-19T04:46:23.517607+0000","last_active":"2024-09-19T04:46:36.563114+0000","last_peered":"2024-09-19T04:46:36.563114+0000","last_clean":"2024-09-19T04:46:36.563114+0000","last_became_active":"2024-09-19T04:46:23.517289+0000","last_became_peered":"2024-09-19T04:46:23.517289+0000","last_unstale":"2024-09-19T04:46:36.563114+0000","last_undegraded":"2024-09-19T04:46:36.563114+0000","last_fullsized":"2024-09-19T04:46:36.563114+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:08:22.882886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.989428+0000","last_change":"2024-09-19T04:46:23.507713+0000","last_active":"2024-09-19T04:46:36.989428+0000","last_peered":"2024-09-19T04:46:36.989428+0000","last_clean":"2024-09-19T04:46:36.989428+0000","last_became_active":"2024-09-19T04:46:23.507350+0000","last_became_peered":"2024-09-19T04:46:23.507350+0000","last_unstale":"2024-09-19T04:46:36.989428+0000","last_undegraded":"2024-09-19T04:46:36.989428+0000","last_fullsized":"2024-09-19T04:46:36.989428+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:07:27.119097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.570432+0000","last_change":"2024-09-19T04:46:21.495958+0000","last_active":"2024-09-19T04:46:36.570432+0000","last_peered":"2024-09-19T04:46:36.570432+0000","last_clean":"2024-09-19T04:46:36.570432+0000","last_became_active":"2024-09-19T04:46:21.495562+0000","last_became_peered":"2024-09-19T04:46:21.495562+0000","last_unstale":"2024-09-19T04:46:36.570432+0000","last_undegraded":"2024-09-19T04:46:36.570432+0000","last_fullsized":"2024-09-19T04:46:36.570432+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:19:02.935893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.570323+0000","last_change":"2024-09-19T04:46:23.524151+0000","last_active":"2024-09-19T04:46:36.570323+0000","last_peered":"2024-09-19T04:46:36.570323+0000","last_clean":"2024-09-19T04:46:36.570323+0000","last_became_active":"2024-09-19T04:46:23.523795+0000","last_became_peered":"2024-09-19T04:46:23.523795+0000","last_unstale":"2024-09-19T04:46:36.570323+0000","last_undegraded":"2024-09-19T04:46:36.570323+0000","last_fullsized":"2024-09-19T04:46:36.570323+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:27.234766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.561930+0000","last_change":"2024-09-19T04:46:21.485072+0000","last_active":"2024-09-19T04:46:36.561930+0000","last_peered":"2024-09-19T04:46:36.561930+0000","last_clean":"2024-09-19T04:46:36.561930+0000","last_became_active":"2024-09-19T04:46:21.482727+0000","last_became_peered":"2024-09-19T04:46:21.482727+0000","last_unstale":"2024-09-19T04:46:36.561930+0000","last_undegraded":"2024-09-19T04:46:36.561930+0000","last_fullsized":"2024-09-19T04:46:36.561930+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:23.231570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.805189+0000","last_change":"2024-09-19T04:46:21.488537+0000","last_active":"2024-09-19T04:46:36.805189+0000","last_peered":"2024-09-19T04:46:36.805189+0000","last_clean":"2024-09-19T04:46:36.805189+0000","last_became_active":"2024-09-19T04:46:21.488176+0000","last_became_peered":"2024-09-19T04:46:21.488176+0000","last_unstale":"2024-09-19T04:46:36.805189+0000","last_undegraded":"2024-09-19T04:46:36.805189+0000","last_fullsized":"2024-09-19T04:46:36.805189+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:14.355956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.559474+0000","last_change":"2024-09-19T04:46:23.518619+0000","last_active":"2024-09-19T04:46:36.559474+0000","last_peered":"2024-09-19T04:46:36.559474+0000","last_clean":"2024-09-19T04:46:36.559474+0000","last_became_active":"2024-09-19T04:46:23.518313+0000","last_became_peered":"2024-09-19T04:46:23.518313+0000","last_unstale":"2024-09-19T04:46:36.559474+0000","last_undegraded":"2024-09-19T04:46:36.559474+0000","last_fullsized":"2024-09-19T04:46:36.559474+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:08:25.958935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.571543+0000","last_change":"2024-09-19T04:46:21.493873+0000","last_active":"2024-09-19T04:46:36.571543+0000","last_peered":"2024-09-19T04:46:36.571543+0000","last_clean":"2024-09-19T04:46:36.571543+0000","last_became_active":"2024-09-19T04:46:21.493447+0000","last_became_peered":"2024-09-19T04:46:21.493447+0000","last_unstale":"2024-09-19T04:46:36.571543+0000","last_undegraded":"2024-09-19T04:46:36.571543+0000","last_fullsized":"2024-09-19T04:46:36.571543+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:29.504001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.561265+0000","last_change":"2024-09-19T04:46:23.508247+0000","last_active":"2024-09-19T04:46:36.561265+0000","last_peered":"2024-09-19T04:46:36.561265+0000","last_clean":"2024-09-19T04:46:36.561265+0000","last_became_active":"2024-09-19T04:46:23.507936+0000","last_became_peered":"2024-09-19T04:46:23.507936+0000","last_unstale":"2024-09-19T04:46:36.561265+0000","last_undegraded":"2024-09-19T04:46:36.561265+0000","last_fullsized":"2024-09-19T04:46:36.561265+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:25:09.864664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.561738+0000","last_change":"2024-09-19T04:46:21.487636+0000","last_active":"2024-09-19T04:46:36.561738+0000","last_peered":"2024-09-19T04:46:36.561738+0000","last_clean":"2024-09-19T04:46:36.561738+0000","last_became_active":"2024-09-19T04:46:21.487162+0000","last_became_peered":"2024-09-19T04:46:21.487162+0000","last_unstale":"2024-09-19T04:46:36.561738+0000","last_undegraded":"2024-09-19T04:46:36.561738+0000","last_fullsized":"2024-09-19T04:46:36.561738+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:03:04.833769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.793378+0000","last_change":"2024-09-19T04:46:23.515047+0000","last_active":"2024-09-19T04:46:36.793378+0000","last_peered":"2024-09-19T04:46:36.793378+0000","last_clean":"2024-09-19T04:46:36.793378+0000","last_became_active":"2024-09-19T04:46:23.514607+0000","last_became_peered":"2024-09-19T04:46:23.514607+0000","last_unstale":"2024-09-19T04:46:36.793378+0000","last_undegraded":"2024-09-19T04:46:36.793378+0000","last_fullsized":"2024-09-19T04:46:36.793378+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:05:03.076568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.565898+0000","last_change":"2024-09-19T04:46:21.493732+0000","last_active":"2024-09-19T04:46:36.565898+0000","last_peered":"2024-09-19T04:46:36.565898+0000","last_clean":"2024-09-19T04:46:36.565898+0000","last_became_active":"2024-09-19T04:46:21.493069+0000","last_became_peered":"2024-09-19T04:46:21.493069+0000","last_unstale":"2024-09-19T04:46:36.565898+0000","last_undegraded":"2024-09-19T04:46:36.565898+0000","last_fullsized":"2024-09-19T04:46:36.565898+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:17.709419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.988887+0000","last_change":"2024-09-19T04:46:23.516530+0000","last_active":"2024-09-19T04:46:36.988887+0000","last_peered":"2024-09-19T04:46:36.988887+0000","last_clean":"2024-09-19T04:46:36.988887+0000","last_became_active":"2024-09-19T04:46:23.515816+0000","last_became_peered":"2024-09-19T04:46:23.515816+0000","last_unstale":"2024-09-19T04:46:36.988887+0000","last_undegraded":"2024-09-19T04:46:36.988887+0000","last_fullsized":"2024-09-19T04:46:36.988887+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:56:19.162009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.570448+0000","last_change":"2024-09-19T04:46:21.573930+0000","last_active":"2024-09-19T04:46:36.570448+0000","last_peered":"2024-09-19T04:46:36.570448+0000","last_clean":"2024-09-19T04:46:36.570448+0000","last_became_active":"2024-09-19T04:46:21.573579+0000","last_became_peered":"2024-09-19T04:46:21.573579+0000","last_unstale":"2024-09-19T04:46:36.570448+0000","last_undegraded":"2024-09-19T04:46:36.570448+0000","last_fullsized":"2024-09-19T04:46:36.570448+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:29.472481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.792985+0000","last_change":"2024-09-19T04:46:23.520569+0000","last_active":"2024-09-19T04:46:36.792985+0000","last_peered":"2024-09-19T04:46:36.792985+0000","last_clean":"2024-09-19T04:46:36.792985+0000","last_became_active":"2024-09-19T04:46:23.519894+0000","last_became_peered":"2024-09-19T04:46:23.519894+0000","last_unstale":"2024-09-19T04:46:36.792985+0000","last_undegraded":"2024-09-19T04:46:36.792985+0000","last_fullsized":"2024-09-19T04:46:36.792985+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:20.823559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'20","reported_seq":73,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:43.561229+0000","last_change":"2024-09-19T04:46:21.491853+0000","last_active":"2024-09-19T04:46:43.561229+0000","last_peered":"2024-09-19T04:46:43.561229+0000","last_clean":"2024-09-19T04:46:43.561229+0000","last_became_active":"2024-09-19T04:46:21.491499+0000","last_became_peered":"2024-09-19T04:46:21.491499+0000","last_unstale":"2024-09-19T04:46:43.561229+0000","last_undegraded":"2024-09-19T04:46:43.561229+0000","last_fullsized":"2024-09-19T04:46:43.561229+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:15.372001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46802,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":31,"num_read_kb":60,"num_write":20,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.989834+0000","last_change":"2024-09-19T04:46:23.516781+0000","last_active":"2024-09-19T04:46:36.989834+0000","last_peered":"2024-09-19T04:46:36.989834+0000","last_clean":"2024-09-19T04:46:36.989834+0000","last_became_active":"2024-09-19T04:46:23.515928+0000","last_became_peered":"2024-09-19T04:46:23.515928+0000","last_unstale":"2024-09-19T04:46:36.989834+0000","last_undegraded":"2024-09-19T04:46:36.989834+0000","last_fullsized":"2024-09-19T04:46:36.989834+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:31.319072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'2","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.576789+0000","last_change":"2024-09-19T04:46:36.576395+0000","last_active":"2024-09-19T04:46:36.576789+0000","last_peered":"2024-09-19T04:46:36.576789+0000","last_clean":"2024-09-19T04:46:36.576789+0000","last_became_active":"2024-09-19T04:46:36.567213+0000","last_became_peered":"2024-09-19T04:46:36.567213+0000","last_unstale":"2024-09-19T04:46:36.576789+0000","last_undegraded":"2024-09-19T04:46:36.576789+0000","last_fullsized":"2024-09-19T04:46:36.576789+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:26.802224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.805263+0000","last_change":"2024-09-19T04:46:23.512736+0000","last_active":"2024-09-19T04:46:36.805263+0000","last_peered":"2024-09-19T04:46:36.805263+0000","last_clean":"2024-09-19T04:46:36.805263+0000","last_became_active":"2024-09-19T04:46:23.512399+0000","last_became_peered":"2024-09-19T04:46:23.512399+0000","last_unstale":"2024-09-19T04:46:36.805263+0000","last_undegraded":"2024-09-19T04:46:36.805263+0000","last_fullsized":"2024-09-19T04:46:36.805263+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:54:28.607512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.570209+0000","last_change":"2024-09-19T04:46:21.495421+0000","last_active":"2024-09-19T04:46:36.570209+0000","last_peered":"2024-09-19T04:46:36.570209+0000","last_clean":"2024-09-19T04:46:36.570209+0000","last_became_active":"2024-09-19T04:46:21.495004+0000","last_became_peered":"2024-09-19T04:46:21.495004+0000","last_unstale":"2024-09-19T04:46:36.570209+0000","last_undegraded":"2024-09-19T04:46:36.570209+0000","last_fullsized":"2024-09-19T04:46:36.570209+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:11.038118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.567045+0000","last_change":"2024-09-19T04:46:23.519462+0000","last_active":"2024-09-19T04:46:36.567045+0000","last_peered":"2024-09-19T04:46:36.567045+0000","last_clean":"2024-09-19T04:46:36.567045+0000","last_became_active":"2024-09-19T04:46:23.519121+0000","last_became_peered":"2024-09-19T04:46:23.519121+0000","last_unstale":"2024-09-19T04:46:36.567045+0000","last_undegraded":"2024-09-19T04:46:36.567045+0000","last_fullsized":"2024-09-19T04:46:36.567045+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:19.643433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.813771+0000","last_change":"2024-09-19T04:46:21.496243+0000","last_active":"2024-09-19T04:46:36.813771+0000","last_peered":"2024-09-19T04:46:36.813771+0000","last_clean":"2024-09-19T04:46:36.813771+0000","last_became_active":"2024-09-19T04:46:21.495821+0000","last_became_peered":"2024-09-19T04:46:21.495821+0000","last_unstale":"2024-09-19T04:46:36.813771+0000","last_undegraded":"2024-09-19T04:46:36.813771+0000","last_fullsized":"2024-09-19T04:46:36.813771+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:35:02.729538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.570404+0000","last_change":"2024-09-19T04:46:36.570404+0000","last_active":"2024-09-19T04:46:36.570404+0000","last_peered":"2024-09-19T04:46:36.570404+0000","last_clean":"2024-09-19T04:46:36.570404+0000","last_became_active":"2024-09-19T04:46:36.569898+0000","last_became_peered":"2024-09-19T04:46:36.569898+0000","last_unstale":"2024-09-19T04:46:36.570404+0000","last_undegraded":"2024-09-19T04:46:36.570404+0000","last_fullsized":"2024-09-19T04:46:36.570404+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:20:47.441702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'8","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.989610+0000","last_change":"2024-09-19T04:46:21.572642+0000","last_active":"2024-09-19T04:46:36.989610+0000","last_peered":"2024-09-19T04:46:36.989610+0000","last_clean":"2024-09-19T04:46:36.989610+0000","last_became_active":"2024-09-19T04:46:21.571823+0000","last_became_peered":"2024-09-19T04:46:21.571823+0000","last_unstale":"2024-09-19T04:46:36.989610+0000","last_undegraded":"2024-09-19T04:46:36.989610+0000","last_fullsized":"2024-09-19T04:46:36.989610+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:28.956744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.569490+0000","last_change":"2024-09-19T04:46:23.524169+0000","last_active":"2024-09-19T04:46:36.569490+0000","last_peered":"2024-09-19T04:46:36.569490+0000","last_clean":"2024-09-19T04:46:36.569490+0000","last_became_active":"2024-09-19T04:46:23.523869+0000","last_became_peered":"2024-09-19T04:46:23.523869+0000","last_unstale":"2024-09-19T04:46:36.569490+0000","last_undegraded":"2024-09-19T04:46:36.569490+0000","last_fullsized":"2024-09-19T04:46:36.569490+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:46.131143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.989981+0000","last_change":"2024-09-19T04:46:21.490154+0000","last_active":"2024-09-19T04:46:36.989981+0000","last_peered":"2024-09-19T04:46:36.989981+0000","last_clean":"2024-09-19T04:46:36.989981+0000","last_became_active":"2024-09-19T04:46:21.489820+0000","last_became_peered":"2024-09-19T04:46:21.489820+0000","last_unstale":"2024-09-19T04:46:36.989981+0000","last_undegraded":"2024-09-19T04:46:36.989981+0000","last_fullsized":"2024-09-19T04:46:36.989981+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:34:27.446664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.563380+0000","last_change":"2024-09-19T04:46:23.518712+0000","last_active":"2024-09-19T04:46:36.563380+0000","last_peered":"2024-09-19T04:46:36.563380+0000","last_clean":"2024-09-19T04:46:36.563380+0000","last_became_active":"2024-09-19T04:46:23.518408+0000","last_became_peered":"2024-09-19T04:46:23.518408+0000","last_unstale":"2024-09-19T04:46:36.563380+0000","last_undegraded":"2024-09-19T04:46:36.563380+0000","last_fullsized":"2024-09-19T04:46:36.563380+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:45:17.398334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.805508+0000","last_change":"2024-09-19T04:46:21.487789+0000","last_active":"2024-09-19T04:46:36.805508+0000","last_peered":"2024-09-19T04:46:36.805508+0000","last_clean":"2024-09-19T04:46:36.805508+0000","last_became_active":"2024-09-19T04:46:21.487411+0000","last_became_peered":"2024-09-19T04:46:21.487411+0000","last_unstale":"2024-09-19T04:46:36.805508+0000","last_undegraded":"2024-09-19T04:46:36.805508+0000","last_fullsized":"2024-09-19T04:46:36.805508+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:25.353345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.565977+0000","last_change":"2024-09-19T04:46:23.515432+0000","last_active":"2024-09-19T04:46:36.565977+0000","last_peered":"2024-09-19T04:46:36.565977+0000","last_clean":"2024-09-19T04:46:36.565977+0000","last_became_active":"2024-09-19T04:46:23.515071+0000","last_became_peered":"2024-09-19T04:46:23.515071+0000","last_unstale":"2024-09-19T04:46:36.565977+0000","last_undegraded":"2024-09-19T04:46:36.565977+0000","last_fullsized":"2024-09-19T04:46:36.565977+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:56:04.743652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.570557+0000","last_change":"2024-09-19T04:46:21.487856+0000","last_active":"2024-09-19T04:46:36.570557+0000","last_peered":"2024-09-19T04:46:36.570557+0000","last_clean":"2024-09-19T04:46:36.570557+0000","last_became_active":"2024-09-19T04:46:21.487342+0000","last_became_peered":"2024-09-19T04:46:21.487342+0000","last_unstale":"2024-09-19T04:46:36.570557+0000","last_undegraded":"2024-09-19T04:46:36.570557+0000","last_fullsized":"2024-09-19T04:46:36.570557+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:29.275296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.565152+0000","last_change":"2024-09-19T04:46:23.517250+0000","last_active":"2024-09-19T04:46:36.565152+0000","last_peered":"2024-09-19T04:46:36.565152+0000","last_clean":"2024-09-19T04:46:36.565152+0000","last_became_active":"2024-09-19T04:46:23.516895+0000","last_became_peered":"2024-09-19T04:46:23.516895+0000","last_unstale":"2024-09-19T04:46:36.565152+0000","last_undegraded":"2024-09-19T04:46:36.565152+0000","last_fullsized":"2024-09-19T04:46:36.565152+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:51.982348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.566597+0000","last_change":"2024-09-19T04:46:21.572452+0000","last_active":"2024-09-19T04:46:36.566597+0000","last_peered":"2024-09-19T04:46:36.566597+0000","last_clean":"2024-09-19T04:46:36.566597+0000","last_became_active":"2024-09-19T04:46:21.572026+0000","last_became_peered":"2024-09-19T04:46:21.572026+0000","last_unstale":"2024-09-19T04:46:36.566597+0000","last_undegraded":"2024-09-19T04:46:36.566597+0000","last_fullsized":"2024-09-19T04:46:36.566597+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:07.859604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.565707+0000","last_change":"2024-09-19T04:46:23.523549+0000","last_active":"2024-09-19T04:46:36.565707+0000","last_peered":"2024-09-19T04:46:36.565707+0000","last_clean":"2024-09-19T04:46:36.565707+0000","last_became_active":"2024-09-19T04:46:23.522581+0000","last_became_peered":"2024-09-19T04:46:23.522581+0000","last_unstale":"2024-09-19T04:46:36.565707+0000","last_undegraded":"2024-09-19T04:46:36.565707+0000","last_fullsized":"2024-09-19T04:46:36.565707+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:51:33.504024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":341,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.567404+0000","last_change":"2024-09-19T04:45:12.271676+0000","last_active":"2024-09-19T04:46:36.567404+0000","last_peered":"2024-09-19T04:46:36.567404+0000","last_clean":"2024-09-19T04:46:36.567404+0000","last_became_active":"2024-09-19T04:45:12.271093+0000","last_became_peered":"2024-09-19T04:45:12.271093+0000","last_unstale":"2024-09-19T04:46:36.567404+0000","last_undegraded":"2024-09-19T04:46:36.567404+0000","last_fullsized":"2024-09-19T04:46:36.567404+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:41:52.010883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:41:52.010883+0000","last_clean_scrub_stamp":"2024-09-19T04:41:52.010883+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:48.499621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.813898+0000","last_change":"2024-09-19T04:46:21.493847+0000","last_active":"2024-09-19T04:46:36.813898+0000","last_peered":"2024-09-19T04:46:36.813898+0000","last_clean":"2024-09-19T04:46:36.813898+0000","last_became_active":"2024-09-19T04:46:21.493432+0000","last_became_peered":"2024-09-19T04:46:21.493432+0000","last_unstale":"2024-09-19T04:46:36.813898+0000","last_undegraded":"2024-09-19T04:46:36.813898+0000","last_fullsized":"2024-09-19T04:46:36.813898+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:10:21.398602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.559747+0000","last_change":"2024-09-19T04:46:23.517517+0000","last_active":"2024-09-19T04:46:36.559747+0000","last_peered":"2024-09-19T04:46:36.559747+0000","last_clean":"2024-09-19T04:46:36.559747+0000","last_became_active":"2024-09-19T04:46:23.517191+0000","last_became_peered":"2024-09-19T04:46:23.517191+0000","last_unstale":"2024-09-19T04:46:36.559747+0000","last_undegraded":"2024-09-19T04:46:36.559747+0000","last_fullsized":"2024-09-19T04:46:36.559747+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:17.896149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.794380+0000","last_change":"2024-09-19T04:46:36.794380+0000","last_active":"2024-09-19T04:46:36.794380+0000","last_peered":"2024-09-19T04:46:36.794380+0000","last_clean":"2024-09-19T04:46:36.794380+0000","last_became_active":"2024-09-19T04:46:36.793911+0000","last_became_peered":"2024-09-19T04:46:36.793911+0000","last_unstale":"2024-09-19T04:46:36.794380+0000","last_undegraded":"2024-09-19T04:46:36.794380+0000","last_fullsized":"2024-09-19T04:46:36.794380+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:01:37.733641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1],"acting":[7,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.805188+0000","last_change":"2024-09-19T04:46:23.514102+0000","last_active":"2024-09-19T04:46:36.805188+0000","last_peered":"2024-09-19T04:46:36.805188+0000","last_clean":"2024-09-19T04:46:36.805188+0000","last_became_active":"2024-09-19T04:46:23.513732+0000","last_became_peered":"2024-09-19T04:46:23.513732+0000","last_unstale":"2024-09-19T04:46:36.805188+0000","last_undegraded":"2024-09-19T04:46:36.805188+0000","last_fullsized":"2024-09-19T04:46:36.805188+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:13.533065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.805277+0000","last_change":"2024-09-19T04:46:21.572628+0000","last_active":"2024-09-19T04:46:36.805277+0000","last_peered":"2024-09-19T04:46:36.805277+0000","last_clean":"2024-09-19T04:46:36.805277+0000","last_became_active":"2024-09-19T04:46:21.571736+0000","last_became_peered":"2024-09-19T04:46:21.571736+0000","last_unstale":"2024-09-19T04:46:36.805277+0000","last_undegraded":"2024-09-19T04:46:36.805277+0000","last_fullsized":"2024-09-19T04:46:36.805277+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:10:50.204481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.991388+0000","last_change":"2024-09-19T04:46:36.991388+0000","last_active":"2024-09-19T04:46:36.991388+0000","last_peered":"2024-09-19T04:46:36.991388+0000","last_clean":"2024-09-19T04:46:36.991388+0000","last_became_active":"2024-09-19T04:46:36.990923+0000","last_became_peered":"2024-09-19T04:46:36.990923+0000","last_unstale":"2024-09-19T04:46:36.991388+0000","last_undegraded":"2024-09-19T04:46:36.991388+0000","last_fullsized":"2024-09-19T04:46:36.991388+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:31.148732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.565443+0000","last_change":"2024-09-19T04:46:21.492696+0000","last_active":"2024-09-19T04:46:36.565443+0000","last_peered":"2024-09-19T04:46:36.565443+0000","last_clean":"2024-09-19T04:46:36.565443+0000","last_became_active":"2024-09-19T04:46:21.492306+0000","last_became_peered":"2024-09-19T04:46:21.492306+0000","last_unstale":"2024-09-19T04:46:36.565443+0000","last_undegraded":"2024-09-19T04:46:36.565443+0000","last_fullsized":"2024-09-19T04:46:36.565443+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:51:56.975170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.989535+0000","last_change":"2024-09-19T04:46:36.989535+0000","last_active":"2024-09-19T04:46:36.989535+0000","last_peered":"2024-09-19T04:46:36.989535+0000","last_clean":"2024-09-19T04:46:36.989535+0000","last_became_active":"2024-09-19T04:46:36.989252+0000","last_became_peered":"2024-09-19T04:46:36.989252+0000","last_unstale":"2024-09-19T04:46:36.989535+0000","last_undegraded":"2024-09-19T04:46:36.989535+0000","last_fullsized":"2024-09-19T04:46:36.989535+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:49:45.767547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.561754+0000","last_change":"2024-09-19T04:46:21.572275+0000","last_active":"2024-09-19T04:46:36.561754+0000","last_peered":"2024-09-19T04:46:36.561754+0000","last_clean":"2024-09-19T04:46:36.561754+0000","last_became_active":"2024-09-19T04:46:21.571940+0000","last_became_peered":"2024-09-19T04:46:21.571940+0000","last_unstale":"2024-09-19T04:46:36.561754+0000","last_undegraded":"2024-09-19T04:46:36.561754+0000","last_fullsized":"2024-09-19T04:46:36.561754+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:13.399887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.561705+0000","last_change":"2024-09-19T04:46:23.514355+0000","last_active":"2024-09-19T04:46:36.561705+0000","last_peered":"2024-09-19T04:46:36.561705+0000","last_clean":"2024-09-19T04:46:36.561705+0000","last_became_active":"2024-09-19T04:46:23.513963+0000","last_became_peered":"2024-09-19T04:46:23.513963+0000","last_unstale":"2024-09-19T04:46:36.561705+0000","last_undegraded":"2024-09-19T04:46:36.561705+0000","last_fullsized":"2024-09-19T04:46:36.561705+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:06.742732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.990038+0000","last_change":"2024-09-19T04:46:21.572466+0000","last_active":"2024-09-19T04:46:36.990038+0000","last_peered":"2024-09-19T04:46:36.990038+0000","last_clean":"2024-09-19T04:46:36.990038+0000","last_became_active":"2024-09-19T04:46:21.571868+0000","last_became_peered":"2024-09-19T04:46:21.571868+0000","last_unstale":"2024-09-19T04:46:36.990038+0000","last_undegraded":"2024-09-19T04:46:36.990038+0000","last_fullsized":"2024-09-19T04:46:36.990038+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:01.132858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.805440+0000","last_change":"2024-09-19T04:46:23.509517+0000","last_active":"2024-09-19T04:46:36.805440+0000","last_peered":"2024-09-19T04:46:36.805440+0000","last_clean":"2024-09-19T04:46:36.805440+0000","last_became_active":"2024-09-19T04:46:23.509216+0000","last_became_peered":"2024-09-19T04:46:23.509216+0000","last_unstale":"2024-09-19T04:46:36.805440+0000","last_undegraded":"2024-09-19T04:46:36.805440+0000","last_fullsized":"2024-09-19T04:46:36.805440+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:29:52.747643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'5","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:40.511277+0000","last_change":"2024-09-19T04:46:21.484462+0000","last_active":"2024-09-19T04:46:40.511277+0000","last_peered":"2024-09-19T04:46:40.511277+0000","last_clean":"2024-09-19T04:46:40.511277+0000","last_became_active":"2024-09-19T04:46:21.484148+0000","last_became_peered":"2024-09-19T04:46:21.484148+0000","last_unstale":"2024-09-19T04:46:40.511277+0000","last_undegraded":"2024-09-19T04:46:40.511277+0000","last_fullsized":"2024-09-19T04:46:40.511277+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:17:18.742857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.559667+0000","last_change":"2024-09-19T04:46:23.512768+0000","last_active":"2024-09-19T04:46:36.559667+0000","last_peered":"2024-09-19T04:46:36.559667+0000","last_clean":"2024-09-19T04:46:36.559667+0000","last_became_active":"2024-09-19T04:46:23.512416+0000","last_became_peered":"2024-09-19T04:46:23.512416+0000","last_unstale":"2024-09-19T04:46:36.559667+0000","last_undegraded":"2024-09-19T04:46:36.559667+0000","last_fullsized":"2024-09-19T04:46:36.559667+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:03:48.340126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.814035+0000","last_change":"2024-09-19T04:46:21.488634+0000","last_active":"2024-09-19T04:46:36.814035+0000","last_peered":"2024-09-19T04:46:36.814035+0000","last_clean":"2024-09-19T04:46:36.814035+0000","last_became_active":"2024-09-19T04:46:21.488078+0000","last_became_peered":"2024-09-19T04:46:21.488078+0000","last_unstale":"2024-09-19T04:46:36.814035+0000","last_undegraded":"2024-09-19T04:46:36.814035+0000","last_fullsized":"2024-09-19T04:46:36.814035+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:31:47.946873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.988687+0000","last_change":"2024-09-19T04:46:23.522419+0000","last_active":"2024-09-19T04:46:36.988687+0000","last_peered":"2024-09-19T04:46:36.988687+0000","last_clean":"2024-09-19T04:46:36.988687+0000","last_became_active":"2024-09-19T04:46:23.522054+0000","last_became_peered":"2024-09-19T04:46:23.522054+0000","last_unstale":"2024-09-19T04:46:36.988687+0000","last_undegraded":"2024-09-19T04:46:36.988687+0000","last_fullsized":"2024-09-19T04:46:36.988687+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:43.720439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.793099+0000","last_change":"2024-09-19T04:46:21.572283+0000","last_active":"2024-09-19T04:46:36.793099+0000","last_peered":"2024-09-19T04:46:36.793099+0000","last_clean":"2024-09-19T04:46:36.793099+0000","last_became_active":"2024-09-19T04:46:21.572023+0000","last_became_peered":"2024-09-19T04:46:21.572023+0000","last_unstale":"2024-09-19T04:46:36.793099+0000","last_undegraded":"2024-09-19T04:46:36.793099+0000","last_fullsized":"2024-09-19T04:46:36.793099+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:37:26.293900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.989428+0000","last_change":"2024-09-19T04:46:23.516278+0000","last_active":"2024-09-19T04:46:36.989428+0000","last_peered":"2024-09-19T04:46:36.989428+0000","last_clean":"2024-09-19T04:46:36.989428+0000","last_became_active":"2024-09-19T04:46:23.515922+0000","last_became_peered":"2024-09-19T04:46:23.515922+0000","last_unstale":"2024-09-19T04:46:36.989428+0000","last_undegraded":"2024-09-19T04:46:36.989428+0000","last_fullsized":"2024-09-19T04:46:36.989428+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:26:11.038230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.559541+0000","last_change":"2024-09-19T04:46:21.489250+0000","last_active":"2024-09-19T04:46:36.559541+0000","last_peered":"2024-09-19T04:46:36.559541+0000","last_clean":"2024-09-19T04:46:36.559541+0000","last_became_active":"2024-09-19T04:46:21.488910+0000","last_became_peered":"2024-09-19T04:46:21.488910+0000","last_unstale":"2024-09-19T04:46:36.559541+0000","last_undegraded":"2024-09-19T04:46:36.559541+0000","last_fullsized":"2024-09-19T04:46:36.559541+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:04:03.650494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.563213+0000","last_change":"2024-09-19T04:46:23.512663+0000","last_active":"2024-09-19T04:46:36.563213+0000","last_peered":"2024-09-19T04:46:36.563213+0000","last_clean":"2024-09-19T04:46:36.563213+0000","last_became_active":"2024-09-19T04:46:23.512265+0000","last_became_peered":"2024-09-19T04:46:23.512265+0000","last_unstale":"2024-09-19T04:46:36.563213+0000","last_undegraded":"2024-09-19T04:46:36.563213+0000","last_fullsized":"2024-09-19T04:46:36.563213+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:52.903900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.991462+0000","last_change":"2024-09-19T04:46:36.990653+0000","last_active":"2024-09-19T04:46:36.991462+0000","last_peered":"2024-09-19T04:46:36.991462+0000","last_clean":"2024-09-19T04:46:36.991462+0000","last_became_active":"2024-09-19T04:46:36.990202+0000","last_became_peered":"2024-09-19T04:46:36.990202+0000","last_unstale":"2024-09-19T04:46:36.991462+0000","last_undegraded":"2024-09-19T04:46:36.991462+0000","last_fullsized":"2024-09-19T04:46:36.991462+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:25:53.780614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.559689+0000","last_change":"2024-09-19T04:46:23.510196+0000","last_active":"2024-09-19T04:46:36.559689+0000","last_peered":"2024-09-19T04:46:36.559689+0000","last_clean":"2024-09-19T04:46:36.559689+0000","last_became_active":"2024-09-19T04:46:23.509871+0000","last_became_peered":"2024-09-19T04:46:23.509871+0000","last_unstale":"2024-09-19T04:46:36.559689+0000","last_undegraded":"2024-09-19T04:46:36.559689+0000","last_fullsized":"2024-09-19T04:46:36.559689+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:42:01.825770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.989648+0000","last_change":"2024-09-19T04:46:21.492279+0000","last_active":"2024-09-19T04:46:36.989648+0000","last_peered":"2024-09-19T04:46:36.989648+0000","last_clean":"2024-09-19T04:46:36.989648+0000","last_became_active":"2024-09-19T04:46:21.491669+0000","last_became_peered":"2024-09-19T04:46:21.491669+0000","last_unstale":"2024-09-19T04:46:36.989648+0000","last_undegraded":"2024-09-19T04:46:36.989648+0000","last_fullsized":"2024-09-19T04:46:36.989648+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:23:15.822887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.565280+0000","last_change":"2024-09-19T04:46:23.518114+0000","last_active":"2024-09-19T04:46:36.565280+0000","last_peered":"2024-09-19T04:46:36.565280+0000","last_clean":"2024-09-19T04:46:36.565280+0000","last_became_active":"2024-09-19T04:46:23.517707+0000","last_became_peered":"2024-09-19T04:46:23.517707+0000","last_unstale":"2024-09-19T04:46:36.565280+0000","last_undegraded":"2024-09-19T04:46:36.565280+0000","last_fullsized":"2024-09-19T04:46:36.565280+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:52.438748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.570333+0000","last_change":"2024-09-19T04:46:23.525164+0000","last_active":"2024-09-19T04:46:36.570333+0000","last_peered":"2024-09-19T04:46:36.570333+0000","last_clean":"2024-09-19T04:46:36.570333+0000","last_became_active":"2024-09-19T04:46:23.524735+0000","last_became_peered":"2024-09-19T04:46:23.524735+0000","last_unstale":"2024-09-19T04:46:36.570333+0000","last_undegraded":"2024-09-19T04:46:36.570333+0000","last_fullsized":"2024-09-19T04:46:36.570333+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:53.590834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.989803+0000","last_change":"2024-09-19T04:46:21.492940+0000","last_active":"2024-09-19T04:46:36.989803+0000","last_peered":"2024-09-19T04:46:36.989803+0000","last_clean":"2024-09-19T04:46:36.989803+0000","last_became_active":"2024-09-19T04:46:21.492602+0000","last_became_peered":"2024-09-19T04:46:21.492602+0000","last_unstale":"2024-09-19T04:46:36.989803+0000","last_undegraded":"2024-09-19T04:46:36.989803+0000","last_fullsized":"2024-09-19T04:46:36.989803+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:20.554832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.792910+0000","last_change":"2024-09-19T04:46:23.513432+0000","last_active":"2024-09-19T04:46:36.792910+0000","last_peered":"2024-09-19T04:46:36.792910+0000","last_clean":"2024-09-19T04:46:36.792910+0000","last_became_active":"2024-09-19T04:46:23.513084+0000","last_became_peered":"2024-09-19T04:46:23.513084+0000","last_unstale":"2024-09-19T04:46:36.792910+0000","last_undegraded":"2024-09-19T04:46:36.792910+0000","last_fullsized":"2024-09-19T04:46:36.792910+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:03:16.732545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.989947+0000","last_change":"2024-09-19T04:46:21.491823+0000","last_active":"2024-09-19T04:46:36.989947+0000","last_peered":"2024-09-19T04:46:36.989947+0000","last_clean":"2024-09-19T04:46:36.989947+0000","last_became_active":"2024-09-19T04:46:21.491401+0000","last_became_peered":"2024-09-19T04:46:21.491401+0000","last_unstale":"2024-09-19T04:46:36.989947+0000","last_undegraded":"2024-09-19T04:46:36.989947+0000","last_fullsized":"2024-09-19T04:46:36.989947+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:55.955868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.988852+0000","last_change":"2024-09-19T04:46:23.515884+0000","last_active":"2024-09-19T04:46:36.988852+0000","last_peered":"2024-09-19T04:46:36.988852+0000","last_clean":"2024-09-19T04:46:36.988852+0000","last_became_active":"2024-09-19T04:46:23.515243+0000","last_became_peered":"2024-09-19T04:46:23.515243+0000","last_unstale":"2024-09-19T04:46:36.988852+0000","last_undegraded":"2024-09-19T04:46:36.988852+0000","last_fullsized":"2024-09-19T04:46:36.988852+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:07:33.716942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.559784+0000","last_change":"2024-09-19T04:46:21.572122+0000","last_active":"2024-09-19T04:46:36.559784+0000","last_peered":"2024-09-19T04:46:36.559784+0000","last_clean":"2024-09-19T04:46:36.559784+0000","last_became_active":"2024-09-19T04:46:21.571747+0000","last_became_peered":"2024-09-19T04:46:21.571747+0000","last_unstale":"2024-09-19T04:46:36.559784+0000","last_undegraded":"2024-09-19T04:46:36.559784+0000","last_fullsized":"2024-09-19T04:46:36.559784+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:06:43.411409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.559639+0000","last_change":"2024-09-19T04:46:23.513876+0000","last_active":"2024-09-19T04:46:36.559639+0000","last_peered":"2024-09-19T04:46:36.559639+0000","last_clean":"2024-09-19T04:46:36.559639+0000","last_became_active":"2024-09-19T04:46:23.513562+0000","last_became_peered":"2024-09-19T04:46:23.513562+0000","last_unstale":"2024-09-19T04:46:36.559639+0000","last_undegraded":"2024-09-19T04:46:36.559639+0000","last_fullsized":"2024-09-19T04:46:36.559639+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:21.982001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.561722+0000","last_change":"2024-09-19T04:46:21.491550+0000","last_active":"2024-09-19T04:46:36.561722+0000","last_peered":"2024-09-19T04:46:36.561722+0000","last_clean":"2024-09-19T04:46:36.561722+0000","last_became_active":"2024-09-19T04:46:21.491259+0000","last_became_peered":"2024-09-19T04:46:21.491259+0000","last_unstale":"2024-09-19T04:46:36.561722+0000","last_undegraded":"2024-09-19T04:46:36.561722+0000","last_fullsized":"2024-09-19T04:46:36.561722+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:38.671211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":47600,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":36,"num_read_kb":65,"num_write":67,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":241664,"data_stored":152940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":57,"ondisk_log_size":57,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645329,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32040,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713112,"statfs":{"total":95995035648,"available":95962226688,"internally_reserved":0,"allocated":872448,"data_stored":426161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874262,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36844,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708308,"statfs":{"total":95995035648,"available":95957307392,"internally_reserved":0,"allocated":1536000,"data_stored":1063608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":36174273},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005083,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40356,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704796,"statfs":{"total":95995035648,"available":95953711104,"internally_reserved":0,"allocated":872448,"data_stored":426709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234016,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":876544,"data_stored":426731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462949,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28460,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716692,"statfs":{"total":95995035648,"available":95965892608,"internally_reserved":0,"allocated":1470464,"data_stored":1017194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626474,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36200,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708952,"statfs":{"total":95995035648,"available":95957966848,"internally_reserved":0,"allocated":872448,"data_stored":426244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855406,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28468,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716684,"statfs":{"total":95995035648,"available":95965884416,"internally_reserved":0,"allocated":1478656,"data_stored":1016794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018932,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36204,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708948,"statfs":{"total":95995035648,"available":95957962752,"internally_reserved":0,"allocated":872448,"data_stored":426149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247865,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":426465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476798,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":925696,"data_stored":472929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607619,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40408,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704744,"statfs":{"total":95995035648,"available":95953657856,"internally_reserved":0,"allocated":925696,"data_stored":472929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738439,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40364,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704788,"statfs":{"total":95995035648,"available":95953702912,"internally_reserved":0,"allocated":872448,"data_stored":426217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":56942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":46802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":46996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T04:46:48.410 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T04:46:48.411 INFO:tasks.cephadm:Setting up client nodes... 2024-09-19T04:46:48.411 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-19T04:46:48.670 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:46:49.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.136+0000 7f04f00e3640 1 -- 172.21.15.2:0/3121954178 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04e8101cd0 msgr2=0x7f04e8102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:49.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.136+0000 7f04f00e3640 1 --2- 172.21.15.2:0/3121954178 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04e8101cd0 0x7f04e8102150 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f04dc009900 tx=0x7f04dc02a410 comp rx=0 tx=0).stop 2024-09-19T04:46:49.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.136+0000 7f04f00e3640 1 -- 172.21.15.2:0/3121954178 shutdown_connections 2024-09-19T04:46:49.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.136+0000 7f04f00e3640 1 --2- 172.21.15.2:0/3121954178 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04e8102690 0x7f04e8108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:49.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.136+0000 7f04f00e3640 1 --2- 172.21.15.2:0/3121954178 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04e8101cd0 0x7f04e8102150 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:49.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.137+0000 7f04f00e3640 1 --2- 172.21.15.2:0/3121954178 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f04e8100ad0 0x7f04e8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:49.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.137+0000 7f04f00e3640 1 -- 172.21.15.2:0/3121954178 >> 172.21.15.2:0/3121954178 conn(0x7f04e80fc280 msgr2=0x7f04e80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:49.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.137+0000 7f04f00e3640 1 -- 172.21.15.2:0/3121954178 shutdown_connections 2024-09-19T04:46:49.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.137+0000 7f04f00e3640 1 -- 172.21.15.2:0/3121954178 wait complete. 2024-09-19T04:46:49.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.137+0000 7f04f00e3640 1 Processor -- start 2024-09-19T04:46:49.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.137+0000 7f04f00e3640 1 -- start start 2024-09-19T04:46:49.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.137+0000 7f04f00e3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04e8100ad0 0x7f04e8199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:49.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.137+0000 7f04f00e3640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f04e8101cd0 0x7f04e819a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:49.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.137+0000 7f04f00e3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04e8102690 0x7f04e81a1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:49.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.137+0000 7f04f00e3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f04e810d730 con 0x7f04e8102690 2024-09-19T04:46:49.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.137+0000 7f04f00e3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f04e810d5b0 con 0x7f04e8100ad0 2024-09-19T04:46:49.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.137+0000 7f04f00e3640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f04e810d8b0 con 0x7f04e8101cd0 2024-09-19T04:46:49.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.138+0000 7f04ee680640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04e8102690 0x7f04e81a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:49.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.138+0000 7f04ee680640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04e8102690 0x7f04e81a1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40650/0 (socket says 172.21.15.2:40650) 2024-09-19T04:46:49.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.138+0000 7f04ee680640 1 -- 172.21.15.2:0/1889785613 learned_addr learned my addr 172.21.15.2:0/1889785613 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:46:49.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.138+0000 7f04ed67e640 1 --2- 172.21.15.2:0/1889785613 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f04e8101cd0 0x7f04e819a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:49.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.138+0000 7f04ede7f640 1 --2- 172.21.15.2:0/1889785613 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04e8100ad0 0x7f04e8199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:49.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.138+0000 7f04ee680640 1 -- 172.21.15.2:0/1889785613 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f04e8101cd0 msgr2=0x7f04e819a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:49.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.138+0000 7f04ee680640 1 --2- 172.21.15.2:0/1889785613 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f04e8101cd0 0x7f04e819a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:49.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.138+0000 7f04ee680640 1 -- 172.21.15.2:0/1889785613 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04e8100ad0 msgr2=0x7f04e8199fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:49.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.138+0000 7f04ee680640 1 --2- 172.21.15.2:0/1889785613 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04e8100ad0 0x7f04e8199fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:49.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.138+0000 7f04ee680640 1 -- 172.21.15.2:0/1889785613 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04e81a1bf0 con 0x7f04e8102690 2024-09-19T04:46:49.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.138+0000 7f04ed67e640 1 --2- 172.21.15.2:0/1889785613 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f04e8101cd0 0x7f04e819a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:46:49.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.138+0000 7f04ee680640 1 --2- 172.21.15.2:0/1889785613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04e8102690 0x7f04e81a1580 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f04e000c970 tx=0x7f04e000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:49.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.138+0000 7f04e6ffd640 1 -- 172.21.15.2:0/1889785613 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e0007bb0 con 0x7f04e8102690 2024-09-19T04:46:49.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.138+0000 7f04e6ffd640 1 -- 172.21.15.2:0/1889785613 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f04e0007d50 con 0x7f04e8102690 2024-09-19T04:46:49.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.138+0000 7f04f00e3640 1 -- 172.21.15.2:0/1889785613 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04e81a1ee0 con 0x7f04e8102690 2024-09-19T04:46:49.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.138+0000 7f04e6ffd640 1 -- 172.21.15.2:0/1889785613 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e0018700 con 0x7f04e8102690 2024-09-19T04:46:49.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.138+0000 7f04f00e3640 1 -- 172.21.15.2:0/1889785613 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04e81a2340 con 0x7f04e8102690 2024-09-19T04:46:49.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.139+0000 7f04f00e3640 1 -- 172.21.15.2:0/1889785613 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04e81a25d0 con 0x7f04e8102690 2024-09-19T04:46:49.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.141+0000 7f04e6ffd640 1 -- 172.21.15.2:0/1889785613 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f04e000fa20 con 0x7f04e8102690 2024-09-19T04:46:49.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.141+0000 7f04e6ffd640 1 --2- 172.21.15.2:0/1889785613 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f04d00a3300 0x7f04d00a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:49.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.141+0000 7f04ede7f640 1 --2- 172.21.15.2:0/1889785613 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f04d00a3300 0x7f04d00a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:49.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.141+0000 7f04e6ffd640 1 -- 172.21.15.2:0/1889785613 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f04e00cfbe0 con 0x7f04e8102690 2024-09-19T04:46:49.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.142+0000 7f04ede7f640 1 --2- 172.21.15.2:0/1889785613 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f04d00a3300 0x7f04d00a57c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f04d8005c40 tx=0x7f04d800a780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:49.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.146+0000 7f04e6ffd640 1 -- 172.21.15.2:0/1889785613 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f04e0014030 con 0x7f04e8102690 2024-09-19T04:46:49.359 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:49 smithi002 ceph-mon[30975]: pgmap v286: 97 pgs: 97 active+clean; 623 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 4.9 KiB/s wr, 4 op/s; 3 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T04:46:49.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:49 smithi002 ceph-mon[30975]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:46:49.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:49 smithi116 ceph-mon[34477]: pgmap v286: 97 pgs: 97 active+clean; 623 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 4.9 KiB/s wr, 4 op/s; 3 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T04:46:49.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:49 smithi116 ceph-mon[34477]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:46:49.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.388+0000 7f04f00e3640 1 -- 172.21.15.2:0/1889785613 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f04e81a28e0 con 0x7f04e8102690 2024-09-19T04:46:49.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.391+0000 7f04e6ffd640 1 -- 172.21.15.2:0/1889785613 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f04e009c770 con 0x7f04e8102690 2024-09-19T04:46:49.392 INFO:teuthology.orchestra.run.smithi002.stdout:[client.0] 2024-09-19T04:46:49.392 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQC5rOtmdmFDFxAAzmjgasy78wUlvLD0N9bV4w== 2024-09-19T04:46:49.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.393+0000 7f04f00e3640 1 -- 172.21.15.2:0/1889785613 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f04d00a3300 msgr2=0x7f04d00a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:49.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.393+0000 7f04f00e3640 1 --2- 172.21.15.2:0/1889785613 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f04d00a3300 0x7f04d00a57c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f04d8005c40 tx=0x7f04d800a780 comp rx=0 tx=0).stop 2024-09-19T04:46:49.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.393+0000 7f04f00e3640 1 -- 172.21.15.2:0/1889785613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04e8102690 msgr2=0x7f04e81a1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:49.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.393+0000 7f04f00e3640 1 --2- 172.21.15.2:0/1889785613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04e8102690 0x7f04e81a1580 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f04e000c970 tx=0x7f04e000ce30 comp rx=0 tx=0).stop 2024-09-19T04:46:49.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.393+0000 7f04f00e3640 1 -- 172.21.15.2:0/1889785613 shutdown_connections 2024-09-19T04:46:49.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.393+0000 7f04f00e3640 1 --2- 172.21.15.2:0/1889785613 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f04d00a3300 0x7f04d00a57c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:49.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.393+0000 7f04f00e3640 1 --2- 172.21.15.2:0/1889785613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04e8102690 0x7f04e81a1580 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:49.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.393+0000 7f04f00e3640 1 --2- 172.21.15.2:0/1889785613 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f04e8101cd0 0x7f04e819a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:49.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.393+0000 7f04f00e3640 1 --2- 172.21.15.2:0/1889785613 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04e8100ad0 0x7f04e8199fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:49.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.393+0000 7f04f00e3640 1 -- 172.21.15.2:0/1889785613 >> 172.21.15.2:0/1889785613 conn(0x7f04e80fc280 msgr2=0x7f04e81074a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:49.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.393+0000 7f04f00e3640 1 -- 172.21.15.2:0/1889785613 shutdown_connections 2024-09-19T04:46:49.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:49.393+0000 7f04f00e3640 1 -- 172.21.15.2:0/1889785613 wait complete. 2024-09-19T04:46:49.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:49 smithi018 ceph-mon[34537]: pgmap v286: 97 pgs: 97 active+clean; 623 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 4.9 KiB/s wr, 4 op/s; 3 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T04:46:49.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:49 smithi018 ceph-mon[34537]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:46:50.190 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-19T04:46:50.190 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-19T04:46:50.190 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-19T04:46:50.230 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-19T04:46:50.230 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-19T04:46:50.230 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-19T04:46:50.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:50 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/1889785613' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T04:46:50.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:50 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/1889785613' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T04:46:50.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:50 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/1889785613' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T04:46:50.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:50 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/1889785613' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T04:46:50.528 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:46:50.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:50 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/1889785613' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T04:46:50.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:50 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/1889785613' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T04:46:50.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:50.974+0000 7fc8fc436640 1 -- 172.21.15.2:0/2056100813 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8f4102d30 msgr2=0x7fc8f4103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:50.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:50.974+0000 7fc8fc436640 1 --2- 172.21.15.2:0/2056100813 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8f4102d30 0x7fc8f4103110 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc8e4009cd0 tx=0x7fc8e402a8e0 comp rx=0 tx=0).stop 2024-09-19T04:46:50.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:50.974+0000 7fc8fc436640 1 -- 172.21.15.2:0/2056100813 shutdown_connections 2024-09-19T04:46:50.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:50.974+0000 7fc8fc436640 1 --2- 172.21.15.2:0/2056100813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8f41082a0 0x7fc8f410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:50.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:50.974+0000 7fc8fc436640 1 --2- 172.21.15.2:0/2056100813 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8f41036e0 0x7fc8f4107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:50.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:50.974+0000 7fc8fc436640 1 --2- 172.21.15.2:0/2056100813 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8f4102d30 0x7fc8f4103110 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:50.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:50.974+0000 7fc8fc436640 1 -- 172.21.15.2:0/2056100813 >> 172.21.15.2:0/2056100813 conn(0x7fc8f40fc7d0 msgr2=0x7fc8f40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:50.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:50.974+0000 7fc8fc436640 1 -- 172.21.15.2:0/2056100813 shutdown_connections 2024-09-19T04:46:50.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:50.974+0000 7fc8fc436640 1 -- 172.21.15.2:0/2056100813 wait complete. 2024-09-19T04:46:50.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:50.975+0000 7fc8fc436640 1 Processor -- start 2024-09-19T04:46:50.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:50.975+0000 7fc8fc436640 1 -- start start 2024-09-19T04:46:50.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:50.975+0000 7fc8fc436640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8f4102d30 0x7fc8f419a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:50.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:50.975+0000 7fc8fc436640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8f41036e0 0x7fc8f419abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:50.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:50.975+0000 7fc8fc436640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8f41082a0 0x7fc8f419ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:50.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:50.975+0000 7fc8fc436640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f4111fb0 con 0x7fc8f41082a0 2024-09-19T04:46:50.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:50.975+0000 7fc8fc436640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f4111e30 con 0x7fc8f41036e0 2024-09-19T04:46:50.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:50.975+0000 7fc8fc436640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f4112130 con 0x7fc8f4102d30 2024-09-19T04:46:50.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:50.975+0000 7fc8fa9d3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8f41082a0 0x7fc8f419ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:50.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:50.975+0000 7fc8fa9d3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8f41082a0 0x7fc8f419ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40658/0 (socket says 172.21.15.2:40658) 2024-09-19T04:46:50.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:50.975+0000 7fc8fa9d3640 1 -- 172.21.15.2:0/3685686550 learned_addr learned my addr 172.21.15.2:0/3685686550 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:46:50.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:50.975+0000 7fc8fa1d2640 1 --2- 172.21.15.2:0/3685686550 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8f4102d30 0x7fc8f419a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:50.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:50.975+0000 7fc8f99d1640 1 --2- 172.21.15.2:0/3685686550 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8f41036e0 0x7fc8f419abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:50.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:50.976+0000 7fc8fa9d3640 1 -- 172.21.15.2:0/3685686550 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8f4102d30 msgr2=0x7fc8f419a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:50.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:50.976+0000 7fc8fa9d3640 1 --2- 172.21.15.2:0/3685686550 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8f4102d30 0x7fc8f419a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:50.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:50.976+0000 7fc8fa9d3640 1 -- 172.21.15.2:0/3685686550 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8f41036e0 msgr2=0x7fc8f419abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:50.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:50.976+0000 7fc8fa9d3640 1 --2- 172.21.15.2:0/3685686550 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8f41036e0 0x7fc8f419abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:50.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:50.976+0000 7fc8fa9d3640 1 -- 172.21.15.2:0/3685686550 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8f419f660 con 0x7fc8f41082a0 2024-09-19T04:46:50.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:50.976+0000 7fc8fa9d3640 1 --2- 172.21.15.2:0/3685686550 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8f41082a0 0x7fc8f419ef80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec009fd0 tx=0x7fc8ec00b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:50.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:50.976+0000 7fc8f37fe640 1 -- 172.21.15.2:0/3685686550 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec015020 con 0x7fc8f41082a0 2024-09-19T04:46:50.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:50.976+0000 7fc8f37fe640 1 -- 172.21.15.2:0/3685686550 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc8ec011ce0 con 0x7fc8f41082a0 2024-09-19T04:46:50.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:50.977+0000 7fc8f37fe640 1 -- 172.21.15.2:0/3685686550 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec010d70 con 0x7fc8f41082a0 2024-09-19T04:46:50.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:50.977+0000 7fc8fc436640 1 -- 172.21.15.2:0/3685686550 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8f419f950 con 0x7fc8f41082a0 2024-09-19T04:46:50.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:50.977+0000 7fc8fc436640 1 -- 172.21.15.2:0/3685686550 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8f41a7230 con 0x7fc8f41082a0 2024-09-19T04:46:50.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:50.978+0000 7fc8fc436640 1 -- 172.21.15.2:0/3685686550 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8f406a850 con 0x7fc8f41082a0 2024-09-19T04:46:50.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:50.979+0000 7fc8f37fe640 1 -- 172.21.15.2:0/3685686550 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fc8ec018020 con 0x7fc8f41082a0 2024-09-19T04:46:50.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:50.980+0000 7fc8f37fe640 1 --2- 172.21.15.2:0/3685686550 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fc8dc0a32d0 0x7fc8dc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:50.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:50.980+0000 7fc8fa1d2640 1 --2- 172.21.15.2:0/3685686550 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fc8dc0a32d0 0x7fc8dc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:50.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:50.980+0000 7fc8f37fe640 1 -- 172.21.15.2:0/3685686550 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fc8ec0cf1e0 con 0x7fc8f41082a0 2024-09-19T04:46:50.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:50.980+0000 7fc8fa1d2640 1 --2- 172.21.15.2:0/3685686550 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fc8dc0a32d0 0x7fc8dc0a5790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc8e4006010 tx=0x7fc8e4005f70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:50.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:50.984+0000 7fc8f37fe640 1 -- 172.21.15.2:0/3685686550 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc8ec01f020 con 0x7fc8f41082a0 2024-09-19T04:46:51.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:51.206+0000 7fc8fc436640 1 -- 172.21.15.2:0/3685686550 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fc8f410c2c0 con 0x7fc8f41082a0 2024-09-19T04:46:51.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:51.210+0000 7fc8f37fe640 1 -- 172.21.15.2:0/3685686550 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+264041 (secure 0 0 0) 0x7fc8ec09be80 con 0x7fc8f41082a0 2024-09-19T04:46:51.215 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:46:51.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:51.213+0000 7fc8fc436640 1 -- 172.21.15.2:0/3685686550 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fc8dc0a32d0 msgr2=0x7fc8dc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:51.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:51.213+0000 7fc8fc436640 1 --2- 172.21.15.2:0/3685686550 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fc8dc0a32d0 0x7fc8dc0a5790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc8e4006010 tx=0x7fc8e4005f70 comp rx=0 tx=0).stop 2024-09-19T04:46:51.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:51.213+0000 7fc8fc436640 1 -- 172.21.15.2:0/3685686550 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8f41082a0 msgr2=0x7fc8f419ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:51.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:51.213+0000 7fc8fc436640 1 --2- 172.21.15.2:0/3685686550 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8f41082a0 0x7fc8f419ef80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec009fd0 tx=0x7fc8ec00b820 comp rx=0 tx=0).stop 2024-09-19T04:46:51.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:51.214+0000 7fc8fc436640 1 -- 172.21.15.2:0/3685686550 shutdown_connections 2024-09-19T04:46:51.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:51.214+0000 7fc8fc436640 1 --2- 172.21.15.2:0/3685686550 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fc8dc0a32d0 0x7fc8dc0a5790 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:51.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:51.214+0000 7fc8fc436640 1 --2- 172.21.15.2:0/3685686550 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8f41082a0 0x7fc8f419ef80 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:51.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:51.214+0000 7fc8fc436640 1 --2- 172.21.15.2:0/3685686550 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8f41036e0 0x7fc8f419abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:51.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:51.214+0000 7fc8fc436640 1 --2- 172.21.15.2:0/3685686550 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8f4102d30 0x7fc8f419a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:51.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:51.214+0000 7fc8fc436640 1 -- 172.21.15.2:0/3685686550 >> 172.21.15.2:0/3685686550 conn(0x7fc8f40fc7d0 msgr2=0x7fc8f4100ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:51.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:51.214+0000 7fc8fc436640 1 -- 172.21.15.2:0/3685686550 shutdown_connections 2024-09-19T04:46:51.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:51.214+0000 7fc8fc436640 1 -- 172.21.15.2:0/3685686550 wait complete. 2024-09-19T04:46:51.661 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:51 smithi002 ceph-mon[30975]: pgmap v287: 97 pgs: 97 active+clean; 633 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.5 KiB/s wr, 5 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T04:46:51.661 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:51 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/3685686550' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T04:46:51.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:51 smithi018 ceph-mon[34537]: pgmap v287: 97 pgs: 97 active+clean; 633 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.5 KiB/s wr, 5 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T04:46:51.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:51 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/3685686550' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T04:46:51.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:51 smithi116 ceph-mon[34477]: pgmap v287: 97 pgs: 97 active+clean; 633 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.5 KiB/s wr, 5 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T04:46:51.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:51 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/3685686550' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T04:46:51.886 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3171525177},{"type":"v1","addr":"172.21.15.2:6801","nonce":3171525177}]},"active_addr":"172.21.15.2:6801/3171525177","active_change":"2024-09-19T04:39:35.461438+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24116,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.2:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":2044166064}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":4263572944}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":3466359926}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":1092443021}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":3848778984}]}]} 2024-09-19T04:46:51.897 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-19T04:46:51.897 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-19T04:46:51.897 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T04:46:52.155 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:46:52.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.598+0000 7f1b1c7b4640 1 -- 172.21.15.2:0/3432353363 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b14102780 msgr2=0x7f1b141067d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:52.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.598+0000 7f1b1c7b4640 1 --2- 172.21.15.2:0/3432353363 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b14102780 0x7f1b141067d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1b08009900 tx=0x7f1b0802a410 comp rx=0 tx=0).stop 2024-09-19T04:46:52.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.598+0000 7f1b1c7b4640 1 -- 172.21.15.2:0/3432353363 shutdown_connections 2024-09-19T04:46:52.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.598+0000 7f1b1c7b4640 1 --2- 172.21.15.2:0/3432353363 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1b14106f00 0x7f1b1410ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:52.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.598+0000 7f1b1c7b4640 1 --2- 172.21.15.2:0/3432353363 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b14102780 0x7f1b141067d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:52.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.598+0000 7f1b1c7b4640 1 --2- 172.21.15.2:0/3432353363 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b14101dd0 0x7f1b141021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:52.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.599+0000 7f1b1c7b4640 1 -- 172.21.15.2:0/3432353363 >> 172.21.15.2:0/3432353363 conn(0x7f1b140fd8b0 msgr2=0x7f1b140ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:52.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.599+0000 7f1b1c7b4640 1 -- 172.21.15.2:0/3432353363 shutdown_connections 2024-09-19T04:46:52.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.599+0000 7f1b1c7b4640 1 -- 172.21.15.2:0/3432353363 wait complete. 2024-09-19T04:46:52.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.599+0000 7f1b1c7b4640 1 Processor -- start 2024-09-19T04:46:52.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.599+0000 7f1b1c7b4640 1 -- start start 2024-09-19T04:46:52.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.599+0000 7f1b1c7b4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b14101dd0 0x7f1b1419a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:52.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.599+0000 7f1b1c7b4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b14102780 0x7f1b1419ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:52.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.599+0000 7f1b1c7b4640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1b14106f00 0x7f1b1419efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:52.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.599+0000 7f1b1c7b4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1b14111e30 con 0x7f1b14101dd0 2024-09-19T04:46:52.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.599+0000 7f1b1c7b4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1b14111cb0 con 0x7f1b14102780 2024-09-19T04:46:52.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.599+0000 7f1b1c7b4640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f1b14111fb0 con 0x7f1b14106f00 2024-09-19T04:46:52.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.600+0000 7f1b1a550640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b14101dd0 0x7f1b1419a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:52.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.600+0000 7f1b1a550640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b14101dd0 0x7f1b1419a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42090/0 (socket says 172.21.15.2:42090) 2024-09-19T04:46:52.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.600+0000 7f1b1a550640 1 -- 172.21.15.2:0/3537196957 learned_addr learned my addr 172.21.15.2:0/3537196957 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:46:52.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.600+0000 7f1b19d4f640 1 --2- 172.21.15.2:0/3537196957 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b14102780 0x7f1b1419ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:52.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.600+0000 7f1b1ad51640 1 --2- 172.21.15.2:0/3537196957 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1b14106f00 0x7f1b1419efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:52.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.600+0000 7f1b1a550640 1 -- 172.21.15.2:0/3537196957 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1b14106f00 msgr2=0x7f1b1419efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:52.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.600+0000 7f1b1a550640 1 --2- 172.21.15.2:0/3537196957 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1b14106f00 0x7f1b1419efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:52.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.600+0000 7f1b1a550640 1 -- 172.21.15.2:0/3537196957 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b14102780 msgr2=0x7f1b1419ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:52.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.600+0000 7f1b1a550640 1 --2- 172.21.15.2:0/3537196957 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b14102780 0x7f1b1419ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:52.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.600+0000 7f1b1a550640 1 -- 172.21.15.2:0/3537196957 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b1419f680 con 0x7f1b14101dd0 2024-09-19T04:46:52.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.600+0000 7f1b1a550640 1 --2- 172.21.15.2:0/3537196957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b14101dd0 0x7f1b1419a6d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1b0400ba50 tx=0x7f1b0400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:52.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.600+0000 7f1b137fe640 1 -- 172.21.15.2:0/3537196957 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b04019070 con 0x7f1b14101dd0 2024-09-19T04:46:52.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.600+0000 7f1b137fe640 1 -- 172.21.15.2:0/3537196957 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1b0400cbe0 con 0x7f1b14101dd0 2024-09-19T04:46:52.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.600+0000 7f1b1c7b4640 1 -- 172.21.15.2:0/3537196957 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b1419f970 con 0x7f1b14101dd0 2024-09-19T04:46:52.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.600+0000 7f1b137fe640 1 -- 172.21.15.2:0/3537196957 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b040075d0 con 0x7f1b14101dd0 2024-09-19T04:46:52.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.600+0000 7f1b1c7b4640 1 -- 172.21.15.2:0/3537196957 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b141a7250 con 0x7f1b14101dd0 2024-09-19T04:46:52.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.602+0000 7f1b1c7b4640 1 -- 172.21.15.2:0/3537196957 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b141021b0 con 0x7f1b14101dd0 2024-09-19T04:46:52.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.603+0000 7f1b137fe640 1 -- 172.21.15.2:0/3537196957 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f1b0401c070 con 0x7f1b14101dd0 2024-09-19T04:46:52.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.603+0000 7f1b137fe640 1 --2- 172.21.15.2:0/3537196957 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f1afc0a3350 0x7f1afc0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:52.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.603+0000 7f1b19d4f640 1 --2- 172.21.15.2:0/3537196957 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f1afc0a3350 0x7f1afc0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:52.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.604+0000 7f1b137fe640 1 -- 172.21.15.2:0/3537196957 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f1b040cef10 con 0x7f1b14101dd0 2024-09-19T04:46:52.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.604+0000 7f1b19d4f640 1 --2- 172.21.15.2:0/3537196957 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f1afc0a3350 0x7f1afc0a5810 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1b08031440 tx=0x7f1b08005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:52.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.608+0000 7f1b137fe640 1 -- 172.21.15.2:0/3537196957 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1b0409b5c0 con 0x7f1b14101dd0 2024-09-19T04:46:52.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.784+0000 7f1b1c7b4640 1 -- 172.21.15.2:0/3537196957 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1b141a7480 con 0x7f1b14101dd0 2024-09-19T04:46:52.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.785+0000 7f1b137fe640 1 -- 172.21.15.2:0/3537196957 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22490 (secure 0 0 0) 0x7f1b0409f8c0 con 0x7f1b14101dd0 2024-09-19T04:46:52.787 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:46:52.787 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":80,"fsid":"d46630c4-7640-11ef-bceb-c7b262605968","created":"2024-09-19T04:38:39.698488+0000","modified":"2024-09-19T04:46:36.551838+0000","last_up_change":"2024-09-19T04:45:33.839647+0000","last_in_change":"2024-09-19T04:45:09.816808+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T04:41:51.960734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T04:46:20.031485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T04:46:22.484767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7a7dc9b9-8d5d-4dd3-93a3-0d5efced07d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":611702745},{"type":"v1","addr":"172.21.15.2:6803","nonce":611702745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":611702745},{"type":"v1","addr":"172.21.15.2:6805","nonce":611702745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":611702745},{"type":"v1","addr":"172.21.15.2:6809","nonce":611702745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":611702745},{"type":"v1","addr":"172.21.15.2:6807","nonce":611702745}]},"public_addr":"172.21.15.2:6803/611702745","cluster_addr":"172.21.15.2:6805/611702745","heartbeat_back_addr":"172.21.15.2:6809/611702745","heartbeat_front_addr":"172.21.15.2:6807/611702745","state":["exists","up"]},{"osd":1,"uuid":"bea40dec-7d9c-497f-bf16-4bf6d3b839f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":58390709},{"type":"v1","addr":"172.21.15.18:6801","nonce":58390709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":58390709},{"type":"v1","addr":"172.21.15.18:6803","nonce":58390709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":58390709},{"type":"v1","addr":"172.21.15.18:6807","nonce":58390709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":58390709},{"type":"v1","addr":"172.21.15.18:6805","nonce":58390709}]},"public_addr":"172.21.15.18:6801/58390709","cluster_addr":"172.21.15.18:6803/58390709","heartbeat_back_addr":"172.21.15.18:6807/58390709","heartbeat_front_addr":"172.21.15.18:6805/58390709","state":["exists","up"]},{"osd":2,"uuid":"97716304-a31e-48c9-83de-84eed10a7a4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":627735759},{"type":"v1","addr":"172.21.15.116:6801","nonce":627735759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":627735759},{"type":"v1","addr":"172.21.15.116:6803","nonce":627735759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":627735759},{"type":"v1","addr":"172.21.15.116:6807","nonce":627735759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":627735759},{"type":"v1","addr":"172.21.15.116:6805","nonce":627735759}]},"public_addr":"172.21.15.116:6801/627735759","cluster_addr":"172.21.15.116:6803/627735759","heartbeat_back_addr":"172.21.15.116:6807/627735759","heartbeat_front_addr":"172.21.15.116:6805/627735759","state":["exists","up"]},{"osd":3,"uuid":"8d79514e-16cf-4bd0-a2eb-e9148b91183d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1936071687},{"type":"v1","addr":"172.21.15.2:6811","nonce":1936071687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1936071687},{"type":"v1","addr":"172.21.15.2:6813","nonce":1936071687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1936071687},{"type":"v1","addr":"172.21.15.2:6817","nonce":1936071687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1936071687},{"type":"v1","addr":"172.21.15.2:6815","nonce":1936071687}]},"public_addr":"172.21.15.2:6811/1936071687","cluster_addr":"172.21.15.2:6813/1936071687","heartbeat_back_addr":"172.21.15.2:6817/1936071687","heartbeat_front_addr":"172.21.15.2:6815/1936071687","state":["exists","up"]},{"osd":4,"uuid":"5136f03c-94a3-42a0-9bfc-020397836037","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1333533784},{"type":"v1","addr":"172.21.15.18:6809","nonce":1333533784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1333533784},{"type":"v1","addr":"172.21.15.18:6811","nonce":1333533784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1333533784},{"type":"v1","addr":"172.21.15.18:6815","nonce":1333533784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1333533784},{"type":"v1","addr":"172.21.15.18:6813","nonce":1333533784}]},"public_addr":"172.21.15.18:6809/1333533784","cluster_addr":"172.21.15.18:6811/1333533784","heartbeat_back_addr":"172.21.15.18:6815/1333533784","heartbeat_front_addr":"172.21.15.18:6813/1333533784","state":["exists","up"]},{"osd":5,"uuid":"9d3384b0-f87d-4513-b151-4cca21c339b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":316360741},{"type":"v1","addr":"172.21.15.116:6809","nonce":316360741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":316360741},{"type":"v1","addr":"172.21.15.116:6811","nonce":316360741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":316360741},{"type":"v1","addr":"172.21.15.116:6815","nonce":316360741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":316360741},{"type":"v1","addr":"172.21.15.116:6813","nonce":316360741}]},"public_addr":"172.21.15.116:6809/316360741","cluster_addr":"172.21.15.116:6811/316360741","heartbeat_back_addr":"172.21.15.116:6815/316360741","heartbeat_front_addr":"172.21.15.116:6813/316360741","state":["exists","up"]},{"osd":6,"uuid":"e54f44b5-a693-4b31-83b2-2bcf10ab9a75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1185564560},{"type":"v1","addr":"172.21.15.2:6819","nonce":1185564560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1185564560},{"type":"v1","addr":"172.21.15.2:6821","nonce":1185564560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1185564560},{"type":"v1","addr":"172.21.15.2:6825","nonce":1185564560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":1185564560},{"type":"v1","addr":"172.21.15.2:6823","nonce":1185564560}]},"public_addr":"172.21.15.2:6819/1185564560","cluster_addr":"172.21.15.2:6821/1185564560","heartbeat_back_addr":"172.21.15.2:6825/1185564560","heartbeat_front_addr":"172.21.15.2:6823/1185564560","state":["exists","up"]},{"osd":7,"uuid":"96a444c3-429a-48b6-9823-95c9e171341a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3691801363},{"type":"v1","addr":"172.21.15.18:6817","nonce":3691801363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3691801363},{"type":"v1","addr":"172.21.15.18:6819","nonce":3691801363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3691801363},{"type":"v1","addr":"172.21.15.18:6823","nonce":3691801363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3691801363},{"type":"v1","addr":"172.21.15.18:6821","nonce":3691801363}]},"public_addr":"172.21.15.18:6817/3691801363","cluster_addr":"172.21.15.18:6819/3691801363","heartbeat_back_addr":"172.21.15.18:6823/3691801363","heartbeat_front_addr":"172.21.15.18:6821/3691801363","state":["exists","up"]},{"osd":8,"uuid":"c3f696aa-be7d-4f67-9147-3751406e394d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":3709586119},{"type":"v1","addr":"172.21.15.116:6817","nonce":3709586119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":3709586119},{"type":"v1","addr":"172.21.15.116:6819","nonce":3709586119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":3709586119},{"type":"v1","addr":"172.21.15.116:6823","nonce":3709586119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":3709586119},{"type":"v1","addr":"172.21.15.116:6821","nonce":3709586119}]},"public_addr":"172.21.15.116:6817/3709586119","cluster_addr":"172.21.15.116:6819/3709586119","heartbeat_back_addr":"172.21.15.116:6823/3709586119","heartbeat_front_addr":"172.21.15.116:6821/3709586119","state":["exists","up"]},{"osd":9,"uuid":"4892549d-f050-48c5-b695-5924b612a581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1054791011},{"type":"v1","addr":"172.21.15.2:6827","nonce":1054791011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1054791011},{"type":"v1","addr":"172.21.15.2:6829","nonce":1054791011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1054791011},{"type":"v1","addr":"172.21.15.2:6833","nonce":1054791011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":1054791011},{"type":"v1","addr":"172.21.15.2:6831","nonce":1054791011}]},"public_addr":"172.21.15.2:6827/1054791011","cluster_addr":"172.21.15.2:6829/1054791011","heartbeat_back_addr":"172.21.15.2:6833/1054791011","heartbeat_front_addr":"172.21.15.2:6831/1054791011","state":["exists","up"]},{"osd":10,"uuid":"12b60238-6a35-4d48-bacd-ee5ddd8fdb0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1958683776},{"type":"v1","addr":"172.21.15.18:6825","nonce":1958683776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":1958683776},{"type":"v1","addr":"172.21.15.18:6827","nonce":1958683776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":1958683776},{"type":"v1","addr":"172.21.15.18:6831","nonce":1958683776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":1958683776},{"type":"v1","addr":"172.21.15.18:6829","nonce":1958683776}]},"public_addr":"172.21.15.18:6825/1958683776","cluster_addr":"172.21.15.18:6827/1958683776","heartbeat_back_addr":"172.21.15.18:6831/1958683776","heartbeat_front_addr":"172.21.15.18:6829/1958683776","state":["exists","up"]},{"osd":11,"uuid":"99b3e553-b42c-4b2f-817f-3900ad8bd223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3456789654},{"type":"v1","addr":"172.21.15.116:6825","nonce":3456789654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3456789654},{"type":"v1","addr":"172.21.15.116:6827","nonce":3456789654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3456789654},{"type":"v1","addr":"172.21.15.116:6831","nonce":3456789654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3456789654},{"type":"v1","addr":"172.21.15.116:6829","nonce":3456789654}]},"public_addr":"172.21.15.116:6825/3456789654","cluster_addr":"172.21.15.116:6827/3456789654","heartbeat_back_addr":"172.21.15.116:6831/3456789654","heartbeat_front_addr":"172.21.15.116:6829/3456789654","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:40:58.216702+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:41:22.852350+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:41:47.265084+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:42:12.785128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:42:38.475008+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:43:02.924009+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:43:28.050646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:43:52.715369+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:44:16.905066+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:44:42.071128+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:45:06.434525+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:45:31.569086+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":1}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/870383845":"2024-09-20T04:39:35.461329+0000","172.21.15.2:0/2801870985":"2024-09-20T04:39:35.461329+0000","172.21.15.2:0/256825166":"2024-09-20T04:39:35.461329+0000","172.21.15.2:6801/3782987318":"2024-09-20T04:39:35.461329+0000","172.21.15.2:0/3064319092":"2024-09-20T04:39:11.086431+0000","172.21.15.2:0/1528097642":"2024-09-20T04:39:11.086431+0000","172.21.15.2:6801/1825825090":"2024-09-20T04:39:11.086431+0000","172.21.15.2:6800/1825825090":"2024-09-20T04:39:11.086431+0000","172.21.15.2:6800/3782987318":"2024-09-20T04:39:35.461329+0000","172.21.15.2:0/2432243496":"2024-09-20T04:39:11.086431+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T04:46:52.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.787+0000 7f1b1c7b4640 1 -- 172.21.15.2:0/3537196957 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f1afc0a3350 msgr2=0x7f1afc0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:52.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.787+0000 7f1b1c7b4640 1 --2- 172.21.15.2:0/3537196957 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f1afc0a3350 0x7f1afc0a5810 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1b08031440 tx=0x7f1b08005e80 comp rx=0 tx=0).stop 2024-09-19T04:46:52.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.787+0000 7f1b1c7b4640 1 -- 172.21.15.2:0/3537196957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b14101dd0 msgr2=0x7f1b1419a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:52.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.787+0000 7f1b1c7b4640 1 --2- 172.21.15.2:0/3537196957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b14101dd0 0x7f1b1419a6d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1b0400ba50 tx=0x7f1b0400bf10 comp rx=0 tx=0).stop 2024-09-19T04:46:52.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.787+0000 7f1b1c7b4640 1 -- 172.21.15.2:0/3537196957 shutdown_connections 2024-09-19T04:46:52.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.787+0000 7f1b1c7b4640 1 --2- 172.21.15.2:0/3537196957 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f1afc0a3350 0x7f1afc0a5810 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:52.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.787+0000 7f1b1c7b4640 1 --2- 172.21.15.2:0/3537196957 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1b14106f00 0x7f1b1419efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:52.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.787+0000 7f1b1c7b4640 1 --2- 172.21.15.2:0/3537196957 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b14102780 0x7f1b1419ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:52.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.787+0000 7f1b1c7b4640 1 --2- 172.21.15.2:0/3537196957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b14101dd0 0x7f1b1419a6d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:52.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.787+0000 7f1b1c7b4640 1 -- 172.21.15.2:0/3537196957 >> 172.21.15.2:0/3537196957 conn(0x7f1b140fd8b0 msgr2=0x7f1b140fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:52.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.787+0000 7f1b1c7b4640 1 -- 172.21.15.2:0/3537196957 shutdown_connections 2024-09-19T04:46:52.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:52.787+0000 7f1b1c7b4640 1 -- 172.21.15.2:0/3537196957 wait complete. 2024-09-19T04:46:53.428 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-19T04:46:53.428 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T04:46:53.688 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:46:53.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:53 smithi018 ceph-mon[34537]: pgmap v288: 97 pgs: 97 active+clean; 633 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.4 KiB/s wr, 3 op/s 2024-09-19T04:46:53.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:53 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/3537196957' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:46:53.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:53 smithi002 ceph-mon[30975]: pgmap v288: 97 pgs: 97 active+clean; 633 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.4 KiB/s wr, 3 op/s 2024-09-19T04:46:53.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:53 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/3537196957' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:46:53.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:53 smithi116 ceph-mon[34477]: pgmap v288: 97 pgs: 97 active+clean; 633 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.4 KiB/s wr, 3 op/s 2024-09-19T04:46:53.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:53 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/3537196957' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:46:54.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.331+0000 7fa51b9d0640 1 -- 172.21.15.2:0/2746278643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa514101de0 msgr2=0x7fa5141021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:54.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.331+0000 7fa51b9d0640 1 --2- 172.21.15.2:0/2746278643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa514101de0 0x7fa5141021c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa510009900 tx=0x7fa51002a410 comp rx=0 tx=0).stop 2024-09-19T04:46:54.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.331+0000 7fa51b9d0640 1 -- 172.21.15.2:0/2746278643 shutdown_connections 2024-09-19T04:46:54.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.331+0000 7fa51b9d0640 1 --2- 172.21.15.2:0/2746278643 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa514106f10 0x7fa51410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:54.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.331+0000 7fa51b9d0640 1 --2- 172.21.15.2:0/2746278643 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa514102790 0x7fa5141067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:54.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.331+0000 7fa51b9d0640 1 --2- 172.21.15.2:0/2746278643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa514101de0 0x7fa5141021c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:54.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.331+0000 7fa51b9d0640 1 -- 172.21.15.2:0/2746278643 >> 172.21.15.2:0/2746278643 conn(0x7fa5140fd8c0 msgr2=0x7fa5140ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:54.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.331+0000 7fa51b9d0640 1 -- 172.21.15.2:0/2746278643 shutdown_connections 2024-09-19T04:46:54.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.331+0000 7fa51b9d0640 1 -- 172.21.15.2:0/2746278643 wait complete. 2024-09-19T04:46:54.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.332+0000 7fa51b9d0640 1 Processor -- start 2024-09-19T04:46:54.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.332+0000 7fa51b9d0640 1 -- start start 2024-09-19T04:46:54.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.332+0000 7fa51b9d0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa514101de0 0x7fa514198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:54.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.332+0000 7fa51b9d0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa514102790 0x7fa5141988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:54.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.332+0000 7fa51b9d0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa514106f10 0x7fa51419cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:54.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.332+0000 7fa51b9d0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa514111e20 con 0x7fa514101de0 2024-09-19T04:46:54.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.332+0000 7fa51b9d0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa514111ca0 con 0x7fa514102790 2024-09-19T04:46:54.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.332+0000 7fa51b9d0640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa514111fa0 con 0x7fa514106f10 2024-09-19T04:46:54.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.332+0000 7fa51976c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa514101de0 0x7fa514198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:54.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.332+0000 7fa51976c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa514101de0 0x7fa514198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42120/0 (socket says 172.21.15.2:42120) 2024-09-19T04:46:54.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.332+0000 7fa51976c640 1 -- 172.21.15.2:0/422730454 learned_addr learned my addr 172.21.15.2:0/422730454 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:46:54.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.332+0000 7fa518f6b640 1 --2- 172.21.15.2:0/422730454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa514102790 0x7fa5141988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:54.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.332+0000 7fa519f6d640 1 --2- 172.21.15.2:0/422730454 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa514106f10 0x7fa51419cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:54.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.333+0000 7fa51976c640 1 -- 172.21.15.2:0/422730454 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa514106f10 msgr2=0x7fa51419cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:54.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.333+0000 7fa51976c640 1 --2- 172.21.15.2:0/422730454 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa514106f10 0x7fa51419cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:54.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.333+0000 7fa51976c640 1 -- 172.21.15.2:0/422730454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa514102790 msgr2=0x7fa5141988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:54.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.333+0000 7fa51976c640 1 --2- 172.21.15.2:0/422730454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa514102790 0x7fa5141988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:54.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.333+0000 7fa51976c640 1 -- 172.21.15.2:0/422730454 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa51419d330 con 0x7fa514101de0 2024-09-19T04:46:54.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.333+0000 7fa51976c640 1 --2- 172.21.15.2:0/422730454 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa514101de0 0x7fa514198380 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa510005940 tx=0x7fa510004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:54.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.333+0000 7fa50a7fc640 1 -- 172.21.15.2:0/422730454 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa51003f030 con 0x7fa514101de0 2024-09-19T04:46:54.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.333+0000 7fa51b9d0640 1 -- 172.21.15.2:0/422730454 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa51419d5c0 con 0x7fa514101de0 2024-09-19T04:46:54.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.333+0000 7fa50a7fc640 1 -- 172.21.15.2:0/422730454 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa510003aa0 con 0x7fa514101de0 2024-09-19T04:46:54.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.333+0000 7fa50a7fc640 1 -- 172.21.15.2:0/422730454 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa510035070 con 0x7fa514101de0 2024-09-19T04:46:54.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.333+0000 7fa51b9d0640 1 -- 172.21.15.2:0/422730454 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5141a4f00 con 0x7fa514101de0 2024-09-19T04:46:54.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.334+0000 7fa51b9d0640 1 -- 172.21.15.2:0/422730454 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5141021c0 con 0x7fa514101de0 2024-09-19T04:46:54.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.335+0000 7fa50a7fc640 1 -- 172.21.15.2:0/422730454 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fa510042030 con 0x7fa514101de0 2024-09-19T04:46:54.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.336+0000 7fa50a7fc640 1 --2- 172.21.15.2:0/422730454 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fa5000a32d0 0x7fa5000a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:54.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.336+0000 7fa518f6b640 1 --2- 172.21.15.2:0/422730454 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fa5000a32d0 0x7fa5000a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:54.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.336+0000 7fa50a7fc640 1 -- 172.21.15.2:0/422730454 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fa5100f0460 con 0x7fa514101de0 2024-09-19T04:46:54.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.336+0000 7fa518f6b640 1 --2- 172.21.15.2:0/422730454 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fa5000a32d0 0x7fa5000a5790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa5140fdd50 tx=0x7fa50400a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:54.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.339+0000 7fa50a7fc640 1 -- 172.21.15.2:0/422730454 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa5100bcff0 con 0x7fa514101de0 2024-09-19T04:46:54.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.517+0000 7fa51b9d0640 1 -- 172.21.15.2:0/422730454 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa51410a0f0 con 0x7fa514101de0 2024-09-19T04:46:54.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.518+0000 7fa50a7fc640 1 -- 172.21.15.2:0/422730454 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22490 (secure 0 0 0) 0x7fa5100bc8f0 con 0x7fa514101de0 2024-09-19T04:46:54.520 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:46:54.521 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":80,"fsid":"d46630c4-7640-11ef-bceb-c7b262605968","created":"2024-09-19T04:38:39.698488+0000","modified":"2024-09-19T04:46:36.551838+0000","last_up_change":"2024-09-19T04:45:33.839647+0000","last_in_change":"2024-09-19T04:45:09.816808+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T04:41:51.960734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T04:46:20.031485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T04:46:22.484767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7a7dc9b9-8d5d-4dd3-93a3-0d5efced07d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":611702745},{"type":"v1","addr":"172.21.15.2:6803","nonce":611702745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":611702745},{"type":"v1","addr":"172.21.15.2:6805","nonce":611702745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":611702745},{"type":"v1","addr":"172.21.15.2:6809","nonce":611702745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":611702745},{"type":"v1","addr":"172.21.15.2:6807","nonce":611702745}]},"public_addr":"172.21.15.2:6803/611702745","cluster_addr":"172.21.15.2:6805/611702745","heartbeat_back_addr":"172.21.15.2:6809/611702745","heartbeat_front_addr":"172.21.15.2:6807/611702745","state":["exists","up"]},{"osd":1,"uuid":"bea40dec-7d9c-497f-bf16-4bf6d3b839f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":58390709},{"type":"v1","addr":"172.21.15.18:6801","nonce":58390709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":58390709},{"type":"v1","addr":"172.21.15.18:6803","nonce":58390709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":58390709},{"type":"v1","addr":"172.21.15.18:6807","nonce":58390709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":58390709},{"type":"v1","addr":"172.21.15.18:6805","nonce":58390709}]},"public_addr":"172.21.15.18:6801/58390709","cluster_addr":"172.21.15.18:6803/58390709","heartbeat_back_addr":"172.21.15.18:6807/58390709","heartbeat_front_addr":"172.21.15.18:6805/58390709","state":["exists","up"]},{"osd":2,"uuid":"97716304-a31e-48c9-83de-84eed10a7a4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":627735759},{"type":"v1","addr":"172.21.15.116:6801","nonce":627735759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":627735759},{"type":"v1","addr":"172.21.15.116:6803","nonce":627735759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":627735759},{"type":"v1","addr":"172.21.15.116:6807","nonce":627735759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":627735759},{"type":"v1","addr":"172.21.15.116:6805","nonce":627735759}]},"public_addr":"172.21.15.116:6801/627735759","cluster_addr":"172.21.15.116:6803/627735759","heartbeat_back_addr":"172.21.15.116:6807/627735759","heartbeat_front_addr":"172.21.15.116:6805/627735759","state":["exists","up"]},{"osd":3,"uuid":"8d79514e-16cf-4bd0-a2eb-e9148b91183d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1936071687},{"type":"v1","addr":"172.21.15.2:6811","nonce":1936071687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1936071687},{"type":"v1","addr":"172.21.15.2:6813","nonce":1936071687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1936071687},{"type":"v1","addr":"172.21.15.2:6817","nonce":1936071687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1936071687},{"type":"v1","addr":"172.21.15.2:6815","nonce":1936071687}]},"public_addr":"172.21.15.2:6811/1936071687","cluster_addr":"172.21.15.2:6813/1936071687","heartbeat_back_addr":"172.21.15.2:6817/1936071687","heartbeat_front_addr":"172.21.15.2:6815/1936071687","state":["exists","up"]},{"osd":4,"uuid":"5136f03c-94a3-42a0-9bfc-020397836037","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1333533784},{"type":"v1","addr":"172.21.15.18:6809","nonce":1333533784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1333533784},{"type":"v1","addr":"172.21.15.18:6811","nonce":1333533784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1333533784},{"type":"v1","addr":"172.21.15.18:6815","nonce":1333533784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1333533784},{"type":"v1","addr":"172.21.15.18:6813","nonce":1333533784}]},"public_addr":"172.21.15.18:6809/1333533784","cluster_addr":"172.21.15.18:6811/1333533784","heartbeat_back_addr":"172.21.15.18:6815/1333533784","heartbeat_front_addr":"172.21.15.18:6813/1333533784","state":["exists","up"]},{"osd":5,"uuid":"9d3384b0-f87d-4513-b151-4cca21c339b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":316360741},{"type":"v1","addr":"172.21.15.116:6809","nonce":316360741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":316360741},{"type":"v1","addr":"172.21.15.116:6811","nonce":316360741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":316360741},{"type":"v1","addr":"172.21.15.116:6815","nonce":316360741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":316360741},{"type":"v1","addr":"172.21.15.116:6813","nonce":316360741}]},"public_addr":"172.21.15.116:6809/316360741","cluster_addr":"172.21.15.116:6811/316360741","heartbeat_back_addr":"172.21.15.116:6815/316360741","heartbeat_front_addr":"172.21.15.116:6813/316360741","state":["exists","up"]},{"osd":6,"uuid":"e54f44b5-a693-4b31-83b2-2bcf10ab9a75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1185564560},{"type":"v1","addr":"172.21.15.2:6819","nonce":1185564560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1185564560},{"type":"v1","addr":"172.21.15.2:6821","nonce":1185564560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1185564560},{"type":"v1","addr":"172.21.15.2:6825","nonce":1185564560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":1185564560},{"type":"v1","addr":"172.21.15.2:6823","nonce":1185564560}]},"public_addr":"172.21.15.2:6819/1185564560","cluster_addr":"172.21.15.2:6821/1185564560","heartbeat_back_addr":"172.21.15.2:6825/1185564560","heartbeat_front_addr":"172.21.15.2:6823/1185564560","state":["exists","up"]},{"osd":7,"uuid":"96a444c3-429a-48b6-9823-95c9e171341a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3691801363},{"type":"v1","addr":"172.21.15.18:6817","nonce":3691801363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3691801363},{"type":"v1","addr":"172.21.15.18:6819","nonce":3691801363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3691801363},{"type":"v1","addr":"172.21.15.18:6823","nonce":3691801363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3691801363},{"type":"v1","addr":"172.21.15.18:6821","nonce":3691801363}]},"public_addr":"172.21.15.18:6817/3691801363","cluster_addr":"172.21.15.18:6819/3691801363","heartbeat_back_addr":"172.21.15.18:6823/3691801363","heartbeat_front_addr":"172.21.15.18:6821/3691801363","state":["exists","up"]},{"osd":8,"uuid":"c3f696aa-be7d-4f67-9147-3751406e394d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":3709586119},{"type":"v1","addr":"172.21.15.116:6817","nonce":3709586119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":3709586119},{"type":"v1","addr":"172.21.15.116:6819","nonce":3709586119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":3709586119},{"type":"v1","addr":"172.21.15.116:6823","nonce":3709586119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":3709586119},{"type":"v1","addr":"172.21.15.116:6821","nonce":3709586119}]},"public_addr":"172.21.15.116:6817/3709586119","cluster_addr":"172.21.15.116:6819/3709586119","heartbeat_back_addr":"172.21.15.116:6823/3709586119","heartbeat_front_addr":"172.21.15.116:6821/3709586119","state":["exists","up"]},{"osd":9,"uuid":"4892549d-f050-48c5-b695-5924b612a581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1054791011},{"type":"v1","addr":"172.21.15.2:6827","nonce":1054791011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1054791011},{"type":"v1","addr":"172.21.15.2:6829","nonce":1054791011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1054791011},{"type":"v1","addr":"172.21.15.2:6833","nonce":1054791011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":1054791011},{"type":"v1","addr":"172.21.15.2:6831","nonce":1054791011}]},"public_addr":"172.21.15.2:6827/1054791011","cluster_addr":"172.21.15.2:6829/1054791011","heartbeat_back_addr":"172.21.15.2:6833/1054791011","heartbeat_front_addr":"172.21.15.2:6831/1054791011","state":["exists","up"]},{"osd":10,"uuid":"12b60238-6a35-4d48-bacd-ee5ddd8fdb0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1958683776},{"type":"v1","addr":"172.21.15.18:6825","nonce":1958683776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":1958683776},{"type":"v1","addr":"172.21.15.18:6827","nonce":1958683776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":1958683776},{"type":"v1","addr":"172.21.15.18:6831","nonce":1958683776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":1958683776},{"type":"v1","addr":"172.21.15.18:6829","nonce":1958683776}]},"public_addr":"172.21.15.18:6825/1958683776","cluster_addr":"172.21.15.18:6827/1958683776","heartbeat_back_addr":"172.21.15.18:6831/1958683776","heartbeat_front_addr":"172.21.15.18:6829/1958683776","state":["exists","up"]},{"osd":11,"uuid":"99b3e553-b42c-4b2f-817f-3900ad8bd223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3456789654},{"type":"v1","addr":"172.21.15.116:6825","nonce":3456789654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3456789654},{"type":"v1","addr":"172.21.15.116:6827","nonce":3456789654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3456789654},{"type":"v1","addr":"172.21.15.116:6831","nonce":3456789654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3456789654},{"type":"v1","addr":"172.21.15.116:6829","nonce":3456789654}]},"public_addr":"172.21.15.116:6825/3456789654","cluster_addr":"172.21.15.116:6827/3456789654","heartbeat_back_addr":"172.21.15.116:6831/3456789654","heartbeat_front_addr":"172.21.15.116:6829/3456789654","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:40:58.216702+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:41:22.852350+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:41:47.265084+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:42:12.785128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:42:38.475008+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:43:02.924009+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:43:28.050646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:43:52.715369+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:44:16.905066+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:44:42.071128+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:45:06.434525+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:45:31.569086+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":1}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/870383845":"2024-09-20T04:39:35.461329+0000","172.21.15.2:0/2801870985":"2024-09-20T04:39:35.461329+0000","172.21.15.2:0/256825166":"2024-09-20T04:39:35.461329+0000","172.21.15.2:6801/3782987318":"2024-09-20T04:39:35.461329+0000","172.21.15.2:0/3064319092":"2024-09-20T04:39:11.086431+0000","172.21.15.2:0/1528097642":"2024-09-20T04:39:11.086431+0000","172.21.15.2:6801/1825825090":"2024-09-20T04:39:11.086431+0000","172.21.15.2:6800/1825825090":"2024-09-20T04:39:11.086431+0000","172.21.15.2:6800/3782987318":"2024-09-20T04:39:35.461329+0000","172.21.15.2:0/2432243496":"2024-09-20T04:39:11.086431+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T04:46:54.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.521+0000 7fa51b9d0640 1 -- 172.21.15.2:0/422730454 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fa5000a32d0 msgr2=0x7fa5000a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:54.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.521+0000 7fa51b9d0640 1 --2- 172.21.15.2:0/422730454 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fa5000a32d0 0x7fa5000a5790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa5140fdd50 tx=0x7fa50400a250 comp rx=0 tx=0).stop 2024-09-19T04:46:54.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.521+0000 7fa51b9d0640 1 -- 172.21.15.2:0/422730454 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa514101de0 msgr2=0x7fa514198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:54.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.521+0000 7fa51b9d0640 1 --2- 172.21.15.2:0/422730454 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa514101de0 0x7fa514198380 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa510005940 tx=0x7fa510004270 comp rx=0 tx=0).stop 2024-09-19T04:46:54.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.521+0000 7fa51b9d0640 1 -- 172.21.15.2:0/422730454 shutdown_connections 2024-09-19T04:46:54.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.521+0000 7fa51b9d0640 1 --2- 172.21.15.2:0/422730454 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fa5000a32d0 0x7fa5000a5790 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:54.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.521+0000 7fa51b9d0640 1 --2- 172.21.15.2:0/422730454 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa514106f10 0x7fa51419cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:54.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.521+0000 7fa51b9d0640 1 --2- 172.21.15.2:0/422730454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa514102790 0x7fa5141988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:54.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.521+0000 7fa51b9d0640 1 --2- 172.21.15.2:0/422730454 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa514101de0 0x7fa514198380 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:54.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.521+0000 7fa51b9d0640 1 -- 172.21.15.2:0/422730454 >> 172.21.15.2:0/422730454 conn(0x7fa5140fd8c0 msgr2=0x7fa5140fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:54.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.521+0000 7fa51b9d0640 1 -- 172.21.15.2:0/422730454 shutdown_connections 2024-09-19T04:46:54.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:54.521+0000 7fa51b9d0640 1 -- 172.21.15.2:0/422730454 wait complete. 2024-09-19T04:46:55.151 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-19T04:46:55.152 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-19T04:46:55.152 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-19T04:46:55.153 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-19T04:46:55.153 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-19T04:46:55.153 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-19T04:46:55.154 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-19T04:46:55.154 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-19T04:46:55.155 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-19T04:46:55.155 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-19T04:46:55.156 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-19T04:46:55.156 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-19T04:46:55.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:55 smithi018 ceph-mon[34537]: pgmap v289: 97 pgs: 97 active+clean; 633 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.3 KiB/s wr, 3 op/s 2024-09-19T04:46:55.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:55 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/422730454' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:46:55.839 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:46:55.859 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:46:55.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:55 smithi116 ceph-mon[34477]: pgmap v289: 97 pgs: 97 active+clean; 633 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.3 KiB/s wr, 3 op/s 2024-09-19T04:46:55.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:55 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/422730454' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:46:55.864 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:55 smithi002 ceph-mon[30975]: pgmap v289: 97 pgs: 97 active+clean; 633 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.3 KiB/s wr, 3 op/s 2024-09-19T04:46:55.864 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:55 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/422730454' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:46:56.433 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:46:56.433 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:46:56.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.453+0000 7fbf04a39640 1 -- 172.21.15.2:0/1621913791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf001037a0 msgr2=0x7fbf0010bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:56.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.453+0000 7fbf04a39640 1 --2- 172.21.15.2:0/1621913791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf001037a0 0x7fbf0010bc00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbef0009900 tx=0x7fbef002a420 comp rx=0 tx=0).stop 2024-09-19T04:46:56.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.454+0000 7fbf04a39640 1 -- 172.21.15.2:0/1621913791 shutdown_connections 2024-09-19T04:46:56.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.454+0000 7fbf04a39640 1 --2- 172.21.15.2:0/1621913791 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbf0010c2f0 0x7fbf0010e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:56.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.454+0000 7fbf04a39640 1 --2- 172.21.15.2:0/1621913791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf001037a0 0x7fbf0010bc00 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:56.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.454+0000 7fbf04a39640 1 --2- 172.21.15.2:0/1621913791 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf00102df0 0x7fbf001031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:56.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.454+0000 7fbf04a39640 1 -- 172.21.15.2:0/1621913791 >> 172.21.15.2:0/1621913791 conn(0x7fbf000fc7d0 msgr2=0x7fbf000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:56.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.454+0000 7fbf04a39640 1 -- 172.21.15.2:0/1621913791 shutdown_connections 2024-09-19T04:46:56.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.454+0000 7fbf04a39640 1 -- 172.21.15.2:0/1621913791 wait complete. 2024-09-19T04:46:56.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.455+0000 7fbf04a39640 1 Processor -- start 2024-09-19T04:46:56.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.455+0000 7fbf04a39640 1 -- start start 2024-09-19T04:46:56.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.455+0000 7fbf04a39640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf00102df0 0x7fbf00109d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:56.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.455+0000 7fbf04a39640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf001037a0 0x7fbf0010a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:56.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.456+0000 7fbf04a39640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbf0010c2f0 0x7fbf0010a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:56.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.456+0000 7fbf04a39640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0010fbd0 con 0x7fbf00102df0 2024-09-19T04:46:56.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.456+0000 7fbf04a39640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0010fa50 con 0x7fbf001037a0 2024-09-19T04:46:56.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.456+0000 7fbf04a39640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0010fd50 con 0x7fbf0010c2f0 2024-09-19T04:46:56.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.456+0000 7fbefe59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf00102df0 0x7fbf00109d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:56.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.456+0000 7fbefed9d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbf0010c2f0 0x7fbf0010a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:56.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.456+0000 7fbefed9d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbf0010c2f0 0x7fbf0010a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.2:52602/0 (socket says 172.21.15.2:52602) 2024-09-19T04:46:56.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.456+0000 7fbefed9d640 1 -- 172.21.15.2:0/2335368827 learned_addr learned my addr 172.21.15.2:0/2335368827 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:46:56.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.456+0000 7fbefdd9b640 1 --2- 172.21.15.2:0/2335368827 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf001037a0 0x7fbf0010a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:56.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.456+0000 7fbefed9d640 1 -- 172.21.15.2:0/2335368827 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf001037a0 msgr2=0x7fbf0010a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:56.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.456+0000 7fbefed9d640 1 --2- 172.21.15.2:0/2335368827 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf001037a0 0x7fbf0010a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:56.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.456+0000 7fbefed9d640 1 -- 172.21.15.2:0/2335368827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf00102df0 msgr2=0x7fbf00109d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:56.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.456+0000 7fbefed9d640 1 --2- 172.21.15.2:0/2335368827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf00102df0 0x7fbf00109d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:56.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.456+0000 7fbefed9d640 1 -- 172.21.15.2:0/2335368827 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf001aafb0 con 0x7fbf0010c2f0 2024-09-19T04:46:56.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.457+0000 7fbefed9d640 1 --2- 172.21.15.2:0/2335368827 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbf0010c2f0 0x7fbf0010a7f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbef800b990 tx=0x7fbef800bd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:56.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.457+0000 7fbefe59c640 1 --2- 172.21.15.2:0/2335368827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf00102df0 0x7fbf00109d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:46:56.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.457+0000 7fbeef7fe640 1 -- 172.21.15.2:0/2335368827 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef8019070 con 0x7fbf0010c2f0 2024-09-19T04:46:56.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.458+0000 7fbeef7fe640 1 -- 172.21.15.2:0/2335368827 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbef8014440 con 0x7fbf0010c2f0 2024-09-19T04:46:56.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.458+0000 7fbeef7fe640 1 -- 172.21.15.2:0/2335368827 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef80075d0 con 0x7fbf0010c2f0 2024-09-19T04:46:56.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.458+0000 7fbf04a39640 1 -- 172.21.15.2:0/2335368827 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf001ab2a0 con 0x7fbf0010c2f0 2024-09-19T04:46:56.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.458+0000 7fbf04a39640 1 -- 172.21.15.2:0/2335368827 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf001ab700 con 0x7fbf0010c2f0 2024-09-19T04:46:56.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.459+0000 7fbf04a39640 1 -- 172.21.15.2:0/2335368827 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbf00111d80 con 0x7fbf0010c2f0 2024-09-19T04:46:56.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.461+0000 7fbeef7fe640 1 -- 172.21.15.2:0/2335368827 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fbef801c070 con 0x7fbf0010c2f0 2024-09-19T04:46:56.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.462+0000 7fbeef7fe640 1 --2- 172.21.15.2:0/2335368827 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fbee80a3460 0x7fbee80a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:56.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.462+0000 7fbeef7fe640 1 -- 172.21.15.2:0/2335368827 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fbef80cee10 con 0x7fbf0010c2f0 2024-09-19T04:46:56.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.462+0000 7fbefe59c640 1 --2- 172.21.15.2:0/2335368827 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fbee80a3460 0x7fbee80a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:56.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.462+0000 7fbeef7fe640 1 --2- 172.21.15.2:0/2335368827 >> [v2:172.21.15.2:6810/1936071687,v1:172.21.15.2:6811/1936071687] conn(0x7fbee80acf90 0x7fbee80af430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:56.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.462+0000 7fbeef7fe640 1 -- 172.21.15.2:0/2335368827 --> [v2:172.21.15.2:6810/1936071687,v1:172.21.15.2:6811/1936071687] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbee80afb00 con 0x7fbee80acf90 2024-09-19T04:46:56.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.462+0000 7fbeef7fe640 1 -- 172.21.15.2:0/2335368827 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fbef80d13d0 con 0x7fbf0010c2f0 2024-09-19T04:46:56.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.462+0000 7fbefdd9b640 1 --2- 172.21.15.2:0/2335368827 >> [v2:172.21.15.2:6810/1936071687,v1:172.21.15.2:6811/1936071687] conn(0x7fbee80acf90 0x7fbee80af430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:56.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.463+0000 7fbefe59c640 1 --2- 172.21.15.2:0/2335368827 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fbee80a3460 0x7fbee80a5920 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbef4009d60 tx=0x7fbef4009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:56.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.463+0000 7fbefdd9b640 1 --2- 172.21.15.2:0/2335368827 >> [v2:172.21.15.2:6810/1936071687,v1:172.21.15.2:6811/1936071687] conn(0x7fbee80acf90 0x7fbee80af430 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:56.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.463+0000 7fbeef7fe640 1 -- 172.21.15.2:0/2335368827 <== osd.3 v2:172.21.15.2:6810/1936071687 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbee80afb00 con 0x7fbee80acf90 2024-09-19T04:46:56.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.483+0000 7fbf04a39640 1 -- 172.21.15.2:0/2335368827 --> [v2:172.21.15.2:6810/1936071687,v1:172.21.15.2:6811/1936071687] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbf0006a790 con 0x7fbee80acf90 2024-09-19T04:46:56.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.484+0000 7fbeef7fe640 1 -- 172.21.15.2:0/2335368827 <== osd.3 v2:172.21.15.2:6810/1936071687 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fbf0006a790 con 0x7fbee80acf90 2024-09-19T04:46:56.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.484+0000 7fbf04a39640 1 -- 172.21.15.2:0/2335368827 >> [v2:172.21.15.2:6810/1936071687,v1:172.21.15.2:6811/1936071687] conn(0x7fbee80acf90 msgr2=0x7fbee80af430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:56.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.484+0000 7fbf04a39640 1 --2- 172.21.15.2:0/2335368827 >> [v2:172.21.15.2:6810/1936071687,v1:172.21.15.2:6811/1936071687] conn(0x7fbee80acf90 0x7fbee80af430 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:56.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.484+0000 7fbf04a39640 1 -- 172.21.15.2:0/2335368827 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fbee80a3460 msgr2=0x7fbee80a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:56.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.484+0000 7fbf04a39640 1 --2- 172.21.15.2:0/2335368827 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fbee80a3460 0x7fbee80a5920 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbef4009d60 tx=0x7fbef4009110 comp rx=0 tx=0).stop 2024-09-19T04:46:56.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.484+0000 7fbf04a39640 1 -- 172.21.15.2:0/2335368827 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbf0010c2f0 msgr2=0x7fbf0010a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:56.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.484+0000 7fbf04a39640 1 --2- 172.21.15.2:0/2335368827 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbf0010c2f0 0x7fbf0010a7f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbef800b990 tx=0x7fbef800bd90 comp rx=0 tx=0).stop 2024-09-19T04:46:56.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.484+0000 7fbefed9d640 1 -- 172.21.15.2:0/2335368827 reap_dead start 2024-09-19T04:46:56.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.484+0000 7fbf04a39640 1 -- 172.21.15.2:0/2335368827 shutdown_connections 2024-09-19T04:46:56.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.485+0000 7fbf04a39640 1 -- 172.21.15.2:0/2335368827 >> 172.21.15.2:0/2335368827 conn(0x7fbf000fc7d0 msgr2=0x7fbf00110390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:56.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.485+0000 7fbf04a39640 1 -- 172.21.15.2:0/2335368827 shutdown_connections 2024-09-19T04:46:56.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:56.485+0000 7fbf04a39640 1 -- 172.21.15.2:0/2335368827 wait complete. 2024-09-19T04:46:57.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.282+0000 7f9d83789640 1 -- 172.21.15.2:0/2067519135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d7c106f10 msgr2=0x7f9d7c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:57.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.282+0000 7f9d83789640 1 --2- 172.21.15.2:0/2067519135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d7c106f10 0x7f9d7c10ea90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9d74009ca0 tx=0x7f9d7402a8c0 comp rx=0 tx=0).stop 2024-09-19T04:46:57.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.282+0000 7f9d83789640 1 -- 172.21.15.2:0/2067519135 shutdown_connections 2024-09-19T04:46:57.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.282+0000 7f9d83789640 1 --2- 172.21.15.2:0/2067519135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d7c106f10 0x7f9d7c10ea90 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:57.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.282+0000 7f9d83789640 1 --2- 172.21.15.2:0/2067519135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d7c102790 0x7f9d7c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:57.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.282+0000 7f9d83789640 1 --2- 172.21.15.2:0/2067519135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d7c101de0 0x7f9d7c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:57.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.282+0000 7f9d83789640 1 -- 172.21.15.2:0/2067519135 >> 172.21.15.2:0/2067519135 conn(0x7f9d7c0fd8c0 msgr2=0x7f9d7c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:57.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.282+0000 7f9d83789640 1 -- 172.21.15.2:0/2067519135 shutdown_connections 2024-09-19T04:46:57.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.282+0000 7f9d83789640 1 -- 172.21.15.2:0/2067519135 wait complete. 2024-09-19T04:46:57.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.283+0000 7f9d83789640 1 Processor -- start 2024-09-19T04:46:57.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.283+0000 7f9d83789640 1 -- start start 2024-09-19T04:46:57.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.283+0000 7f9d83789640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d7c101de0 0x7f9d7c1983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:57.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.283+0000 7f9d83789640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d7c102790 0x7f9d7c1988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:57.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.283+0000 7f9d83789640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d7c106f10 0x7f9d7c19cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:57.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.283+0000 7f9d83789640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9d7c111e20 con 0x7f9d7c106f10 2024-09-19T04:46:57.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.283+0000 7f9d83789640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9d7c111ca0 con 0x7f9d7c102790 2024-09-19T04:46:57.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.283+0000 7f9d83789640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f9d7c111fa0 con 0x7f9d7c101de0 2024-09-19T04:46:57.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.283+0000 7f9d81d26640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d7c106f10 0x7f9d7c19cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:57.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.283+0000 7f9d81d26640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d7c106f10 0x7f9d7c19cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42150/0 (socket says 172.21.15.2:42150) 2024-09-19T04:46:57.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.283+0000 7f9d81d26640 1 -- 172.21.15.2:0/1840037326 learned_addr learned my addr 172.21.15.2:0/1840037326 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:46:57.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.283+0000 7f9d80d24640 1 --2- 172.21.15.2:0/1840037326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d7c102790 0x7f9d7c1988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:57.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.283+0000 7f9d81525640 1 --2- 172.21.15.2:0/1840037326 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d7c101de0 0x7f9d7c1983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:57.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.283+0000 7f9d81d26640 1 -- 172.21.15.2:0/1840037326 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d7c101de0 msgr2=0x7f9d7c1983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:57.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.283+0000 7f9d81d26640 1 --2- 172.21.15.2:0/1840037326 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d7c101de0 0x7f9d7c1983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:57.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.283+0000 7f9d81d26640 1 -- 172.21.15.2:0/1840037326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d7c102790 msgr2=0x7f9d7c1988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:57.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.283+0000 7f9d81d26640 1 --2- 172.21.15.2:0/1840037326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d7c102790 0x7f9d7c1988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:57.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.283+0000 7f9d81d26640 1 -- 172.21.15.2:0/1840037326 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d7c19d350 con 0x7f9d7c106f10 2024-09-19T04:46:57.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.284+0000 7f9d81d26640 1 --2- 172.21.15.2:0/1840037326 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d7c106f10 0x7f9d7c19cc70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9d74009dc0 tx=0x7f9d74032ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:57.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.284+0000 7f9d727fc640 1 -- 172.21.15.2:0/1840037326 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d74003cf0 con 0x7f9d7c106f10 2024-09-19T04:46:57.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.284+0000 7f9d727fc640 1 -- 172.21.15.2:0/1840037326 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9d740044f0 con 0x7f9d7c106f10 2024-09-19T04:46:57.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.284+0000 7f9d83789640 1 -- 172.21.15.2:0/1840037326 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d7c19d5e0 con 0x7f9d7c106f10 2024-09-19T04:46:57.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.284+0000 7f9d727fc640 1 -- 172.21.15.2:0/1840037326 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d74030bf0 con 0x7f9d7c106f10 2024-09-19T04:46:57.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.284+0000 7f9d83789640 1 -- 172.21.15.2:0/1840037326 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d7c1a4f20 con 0x7f9d7c106f10 2024-09-19T04:46:57.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.285+0000 7f9d83789640 1 -- 172.21.15.2:0/1840037326 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9d7c062900 con 0x7f9d7c106f10 2024-09-19T04:46:57.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.286+0000 7f9d727fc640 1 -- 172.21.15.2:0/1840037326 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f9d74004040 con 0x7f9d7c106f10 2024-09-19T04:46:57.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.287+0000 7f9d727fc640 1 --2- 172.21.15.2:0/1840037326 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f9d680a3350 0x7f9d680a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:57.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.287+0000 7f9d81525640 1 --2- 172.21.15.2:0/1840037326 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f9d680a3350 0x7f9d680a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:57.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.287+0000 7f9d727fc640 1 -- 172.21.15.2:0/1840037326 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f9d740f1130 con 0x7f9d7c106f10 2024-09-19T04:46:57.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.287+0000 7f9d727fc640 1 --2- 172.21.15.2:0/1840037326 >> [v2:172.21.15.18:6800/58390709,v1:172.21.15.18:6801/58390709] conn(0x7f9d680ace80 0x7f9d680af320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:57.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.287+0000 7f9d727fc640 1 -- 172.21.15.2:0/1840037326 --> [v2:172.21.15.18:6800/58390709,v1:172.21.15.18:6801/58390709] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9d7400b150 con 0x7f9d680ace80 2024-09-19T04:46:57.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.287+0000 7f9d727fc640 1 -- 172.21.15.2:0/1840037326 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f9d740f1580 con 0x7f9d7c106f10 2024-09-19T04:46:57.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.287+0000 7f9d81525640 1 --2- 172.21.15.2:0/1840037326 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f9d680a3350 0x7f9d680a5810 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9d78005fd0 tx=0x7f9d7800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:57.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.287+0000 7f9d80d24640 1 --2- 172.21.15.2:0/1840037326 >> [v2:172.21.15.18:6800/58390709,v1:172.21.15.18:6801/58390709] conn(0x7f9d680ace80 0x7f9d680af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:57.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.288+0000 7f9d80d24640 1 --2- 172.21.15.2:0/1840037326 >> [v2:172.21.15.18:6800/58390709,v1:172.21.15.18:6801/58390709] conn(0x7f9d680ace80 0x7f9d680af320 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:57.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.289+0000 7f9d727fc640 1 -- 172.21.15.2:0/1840037326 <== osd.1 v2:172.21.15.18:6800/58390709 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9d7400b150 con 0x7f9d680ace80 2024-09-19T04:46:57.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.302+0000 7f9d83789640 1 -- 172.21.15.2:0/1840037326 --> [v2:172.21.15.18:6800/58390709,v1:172.21.15.18:6801/58390709] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9d7c062d00 con 0x7f9d680ace80 2024-09-19T04:46:57.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.303+0000 7f9d727fc640 1 -- 172.21.15.2:0/1840037326 <== osd.1 v2:172.21.15.18:6800/58390709 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9d7c062d00 con 0x7f9d680ace80 2024-09-19T04:46:57.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.303+0000 7f9d83789640 1 -- 172.21.15.2:0/1840037326 >> [v2:172.21.15.18:6800/58390709,v1:172.21.15.18:6801/58390709] conn(0x7f9d680ace80 msgr2=0x7f9d680af320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:57.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.303+0000 7f9d83789640 1 --2- 172.21.15.2:0/1840037326 >> [v2:172.21.15.18:6800/58390709,v1:172.21.15.18:6801/58390709] conn(0x7f9d680ace80 0x7f9d680af320 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:57.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.303+0000 7f9d83789640 1 -- 172.21.15.2:0/1840037326 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f9d680a3350 msgr2=0x7f9d680a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:57.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.303+0000 7f9d83789640 1 --2- 172.21.15.2:0/1840037326 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f9d680a3350 0x7f9d680a5810 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9d78005fd0 tx=0x7f9d7800b390 comp rx=0 tx=0).stop 2024-09-19T04:46:57.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.303+0000 7f9d83789640 1 -- 172.21.15.2:0/1840037326 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d7c106f10 msgr2=0x7f9d7c19cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:57.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.303+0000 7f9d83789640 1 --2- 172.21.15.2:0/1840037326 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d7c106f10 0x7f9d7c19cc70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9d74009dc0 tx=0x7f9d74032ff0 comp rx=0 tx=0).stop 2024-09-19T04:46:57.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.304+0000 7f9d81d26640 1 -- 172.21.15.2:0/1840037326 reap_dead start 2024-09-19T04:46:57.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.304+0000 7f9d83789640 1 -- 172.21.15.2:0/1840037326 shutdown_connections 2024-09-19T04:46:57.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.304+0000 7f9d83789640 1 -- 172.21.15.2:0/1840037326 >> 172.21.15.2:0/1840037326 conn(0x7f9d7c0fd8c0 msgr2=0x7f9d7c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:57.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.304+0000 7f9d83789640 1 -- 172.21.15.2:0/1840037326 shutdown_connections 2024-09-19T04:46:57.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.304+0000 7f9d83789640 1 -- 172.21.15.2:0/1840037326 wait complete. 2024-09-19T04:46:57.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.484+0000 7f82f74a7640 1 -- 172.21.15.2:0/301583578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82f0101de0 msgr2=0x7f82f01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:57.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.484+0000 7f82f74a7640 1 --2- 172.21.15.2:0/301583578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82f0101de0 0x7f82f01021c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f82ec009900 tx=0x7f82ec02a410 comp rx=0 tx=0).stop 2024-09-19T04:46:57.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.484+0000 7f82f74a7640 1 -- 172.21.15.2:0/301583578 shutdown_connections 2024-09-19T04:46:57.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.484+0000 7f82f74a7640 1 --2- 172.21.15.2:0/301583578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82f0106f10 0x7f82f010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:57.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.484+0000 7f82f74a7640 1 --2- 172.21.15.2:0/301583578 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82f0102790 0x7f82f01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:57.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.484+0000 7f82f74a7640 1 --2- 172.21.15.2:0/301583578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82f0101de0 0x7f82f01021c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:57.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.484+0000 7f82f74a7640 1 -- 172.21.15.2:0/301583578 >> 172.21.15.2:0/301583578 conn(0x7f82f00fd8c0 msgr2=0x7f82f00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:57.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.484+0000 7f82f74a7640 1 -- 172.21.15.2:0/301583578 shutdown_connections 2024-09-19T04:46:57.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.484+0000 7f82f74a7640 1 -- 172.21.15.2:0/301583578 wait complete. 2024-09-19T04:46:57.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.485+0000 7f82f74a7640 1 Processor -- start 2024-09-19T04:46:57.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.485+0000 7f82f74a7640 1 -- start start 2024-09-19T04:46:57.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.485+0000 7f82f74a7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82f0101de0 0x7f82f00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:57.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.485+0000 7f82f74a7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82f0102790 0x7f82f0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:57.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.485+0000 7f82f74a7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82f0106f10 0x7f82f0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:57.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.485+0000 7f82f74a7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f82f0111e40 con 0x7f82f0106f10 2024-09-19T04:46:57.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.485+0000 7f82f74a7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f82f0111cc0 con 0x7f82f0102790 2024-09-19T04:46:57.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.485+0000 7f82f74a7640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f82f0111fc0 con 0x7f82f0101de0 2024-09-19T04:46:57.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.485+0000 7f82f5a44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82f0106f10 0x7f82f0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:57.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.485+0000 7f82f5a44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82f0106f10 0x7f82f0074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42164/0 (socket says 172.21.15.2:42164) 2024-09-19T04:46:57.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.485+0000 7f82f5a44640 1 -- 172.21.15.2:0/192820425 learned_addr learned my addr 172.21.15.2:0/192820425 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:46:57.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.485+0000 7f82f5243640 1 --2- 172.21.15.2:0/192820425 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82f0101de0 0x7f82f00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:57.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.485+0000 7f82f4a42640 1 --2- 172.21.15.2:0/192820425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82f0102790 0x7f82f0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:57.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.485+0000 7f82f5a44640 1 -- 172.21.15.2:0/192820425 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82f0101de0 msgr2=0x7f82f00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:57.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.485+0000 7f82f5a44640 1 --2- 172.21.15.2:0/192820425 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82f0101de0 0x7f82f00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:57.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.485+0000 7f82f5a44640 1 -- 172.21.15.2:0/192820425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82f0102790 msgr2=0x7f82f0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:57.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.485+0000 7f82f5a44640 1 --2- 172.21.15.2:0/192820425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82f0102790 0x7f82f0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:57.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.485+0000 7f82f5a44640 1 -- 172.21.15.2:0/192820425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82f01a68a0 con 0x7f82f0106f10 2024-09-19T04:46:57.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.485+0000 7f82f4a42640 1 --2- 172.21.15.2:0/192820425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82f0102790 0x7f82f0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:46:57.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.486+0000 7f82f5a44640 1 --2- 172.21.15.2:0/192820425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82f0106f10 0x7f82f0074f70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f82e800cce0 tx=0x7f82e800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:57.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.486+0000 7f82e67fc640 1 -- 172.21.15.2:0/192820425 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e800f450 con 0x7f82f0106f10 2024-09-19T04:46:57.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.486+0000 7f82e67fc640 1 -- 172.21.15.2:0/192820425 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f82e800faa0 con 0x7f82f0106f10 2024-09-19T04:46:57.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.486+0000 7f82f74a7640 1 -- 172.21.15.2:0/192820425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82f01a6b90 con 0x7f82f0106f10 2024-09-19T04:46:57.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.486+0000 7f82e67fc640 1 -- 172.21.15.2:0/192820425 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e8018b70 con 0x7f82f0106f10 2024-09-19T04:46:57.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.486+0000 7f82f74a7640 1 -- 172.21.15.2:0/192820425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82f01a70d0 con 0x7f82f0106f10 2024-09-19T04:46:57.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.487+0000 7f82f74a7640 1 -- 172.21.15.2:0/192820425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f82f00628c0 con 0x7f82f0106f10 2024-09-19T04:46:57.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.488+0000 7f82e67fc640 1 -- 172.21.15.2:0/192820425 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f82e8018d10 con 0x7f82f0106f10 2024-09-19T04:46:57.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.489+0000 7f82e67fc640 1 --2- 172.21.15.2:0/192820425 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f82dc0a3350 0x7f82dc0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:57.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.489+0000 7f82f5243640 1 --2- 172.21.15.2:0/192820425 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f82dc0a3350 0x7f82dc0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:57.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.489+0000 7f82e67fc640 1 -- 172.21.15.2:0/192820425 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f82e80d0160 con 0x7f82f0106f10 2024-09-19T04:46:57.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.489+0000 7f82e67fc640 1 --2- 172.21.15.2:0/192820425 >> [v2:172.21.15.116:6816/3709586119,v1:172.21.15.116:6817/3709586119] conn(0x7f82dc0ace80 0x7f82dc0af320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:57.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.489+0000 7f82e67fc640 1 -- 172.21.15.2:0/192820425 --> [v2:172.21.15.116:6816/3709586119,v1:172.21.15.116:6817/3709586119] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f82e800c120 con 0x7f82dc0ace80 2024-09-19T04:46:57.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.489+0000 7f82e67fc640 1 -- 172.21.15.2:0/192820425 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f82e80d05b0 con 0x7f82f0106f10 2024-09-19T04:46:57.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.489+0000 7f82f5243640 1 --2- 172.21.15.2:0/192820425 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f82dc0a3350 0x7f82dc0a5810 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f82ec031440 tx=0x7f82ec005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:57.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.489+0000 7f82f4a42640 1 --2- 172.21.15.2:0/192820425 >> [v2:172.21.15.116:6816/3709586119,v1:172.21.15.116:6817/3709586119] conn(0x7f82dc0ace80 0x7f82dc0af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:57.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.490+0000 7f82f4a42640 1 --2- 172.21.15.2:0/192820425 >> [v2:172.21.15.116:6816/3709586119,v1:172.21.15.116:6817/3709586119] conn(0x7f82dc0ace80 0x7f82dc0af320 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:57.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.491+0000 7f82e67fc640 1 -- 172.21.15.2:0/192820425 <== osd.8 v2:172.21.15.116:6816/3709586119 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f82e800c120 con 0x7f82dc0ace80 2024-09-19T04:46:57.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.504+0000 7f82f74a7640 1 -- 172.21.15.2:0/192820425 --> [v2:172.21.15.116:6816/3709586119,v1:172.21.15.116:6817/3709586119] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f82f0062d40 con 0x7f82dc0ace80 2024-09-19T04:46:57.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.505+0000 7f82e67fc640 1 -- 172.21.15.2:0/192820425 <== osd.8 v2:172.21.15.116:6816/3709586119 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f82f0062d40 con 0x7f82dc0ace80 2024-09-19T04:46:57.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.505+0000 7f82f74a7640 1 -- 172.21.15.2:0/192820425 >> [v2:172.21.15.116:6816/3709586119,v1:172.21.15.116:6817/3709586119] conn(0x7f82dc0ace80 msgr2=0x7f82dc0af320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:57.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.505+0000 7f82f74a7640 1 --2- 172.21.15.2:0/192820425 >> [v2:172.21.15.116:6816/3709586119,v1:172.21.15.116:6817/3709586119] conn(0x7f82dc0ace80 0x7f82dc0af320 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:57.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.505+0000 7f82f74a7640 1 -- 172.21.15.2:0/192820425 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f82dc0a3350 msgr2=0x7f82dc0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:57.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.505+0000 7f82f74a7640 1 --2- 172.21.15.2:0/192820425 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f82dc0a3350 0x7f82dc0a5810 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f82ec031440 tx=0x7f82ec005e80 comp rx=0 tx=0).stop 2024-09-19T04:46:57.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.505+0000 7f82f74a7640 1 -- 172.21.15.2:0/192820425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82f0106f10 msgr2=0x7f82f0074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:57.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.505+0000 7f82f74a7640 1 --2- 172.21.15.2:0/192820425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82f0106f10 0x7f82f0074f70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f82e800cce0 tx=0x7f82e800a620 comp rx=0 tx=0).stop 2024-09-19T04:46:57.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.505+0000 7f82f5a44640 1 -- 172.21.15.2:0/192820425 reap_dead start 2024-09-19T04:46:57.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.505+0000 7f82f74a7640 1 -- 172.21.15.2:0/192820425 shutdown_connections 2024-09-19T04:46:57.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.505+0000 7f82f74a7640 1 -- 172.21.15.2:0/192820425 >> 172.21.15.2:0/192820425 conn(0x7f82f00fd8c0 msgr2=0x7f82f00fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:57.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.505+0000 7f82f74a7640 1 -- 172.21.15.2:0/192820425 shutdown_connections 2024-09-19T04:46:57.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:57.505+0000 7f82f74a7640 1 -- 172.21.15.2:0/192820425 wait complete. 2024-09-19T04:46:57.695 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:57 smithi002 ceph-mon[30975]: pgmap v290: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 3.7 KiB/s wr, 4 op/s 2024-09-19T04:46:57.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:57 smithi018 ceph-mon[34537]: pgmap v290: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 3.7 KiB/s wr, 4 op/s 2024-09-19T04:46:57.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:57 smithi116 ceph-mon[34477]: pgmap v290: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 3.7 KiB/s wr, 4 op/s 2024-09-19T04:46:58.110 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:46:58.111 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:46:58.111 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:46:58.111 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:46:58.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.521+0000 7f53e8a47640 1 -- 172.21.15.2:0/1733120040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53e4102ef0 msgr2=0x7f53e410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:58.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.521+0000 7f53e8a47640 1 --2- 172.21.15.2:0/1733120040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53e4102ef0 0x7f53e410da40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f53dc009ca0 tx=0x7f53dc02a950 comp rx=0 tx=0).stop 2024-09-19T04:46:58.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.521+0000 7f53e8a47640 1 -- 172.21.15.2:0/1733120040 shutdown_connections 2024-09-19T04:46:58.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.521+0000 7f53e8a47640 1 --2- 172.21.15.2:0/1733120040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53e4102ef0 0x7f53e410da40 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:58.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.521+0000 7f53e8a47640 1 --2- 172.21.15.2:0/1733120040 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f53e4102570 0x7f53e41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:58.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.521+0000 7f53e8a47640 1 --2- 172.21.15.2:0/1733120040 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f53e4100e20 0x7f53e4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:58.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.521+0000 7f53e8a47640 1 -- 172.21.15.2:0/1733120040 >> 172.21.15.2:0/1733120040 conn(0x7f53e40fc7d0 msgr2=0x7f53e40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:58.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.521+0000 7f53e8a47640 1 -- 172.21.15.2:0/1733120040 shutdown_connections 2024-09-19T04:46:58.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.521+0000 7f53e8a47640 1 -- 172.21.15.2:0/1733120040 wait complete. 2024-09-19T04:46:58.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.522+0000 7f53e8a47640 1 Processor -- start 2024-09-19T04:46:58.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.522+0000 7f53e8a47640 1 -- start start 2024-09-19T04:46:58.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.522+0000 7f53e8a47640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53e4100e20 0x7f53e40fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:58.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.522+0000 7f53e8a47640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f53e4102570 0x7f53e40fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:58.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.522+0000 7f53e8a47640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f53e4102ef0 0x7f53e40fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:58.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.522+0000 7f53e8a47640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f53e4110e30 con 0x7f53e4100e20 2024-09-19T04:46:58.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.522+0000 7f53e8a47640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f53e4110cb0 con 0x7f53e4102ef0 2024-09-19T04:46:58.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.522+0000 7f53e8a47640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f53e4110fb0 con 0x7f53e4102570 2024-09-19T04:46:58.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.523+0000 7f53e259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53e4100e20 0x7f53e40fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:58.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.523+0000 7f53e259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53e4100e20 0x7f53e40fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42172/0 (socket says 172.21.15.2:42172) 2024-09-19T04:46:58.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.523+0000 7f53e259c640 1 -- 172.21.15.2:0/915732085 learned_addr learned my addr 172.21.15.2:0/915732085 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:46:58.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.523+0000 7f53e2d9d640 1 --2- 172.21.15.2:0/915732085 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f53e4102ef0 0x7f53e40fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:58.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.523+0000 7f53e1d9b640 1 --2- 172.21.15.2:0/915732085 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f53e4102570 0x7f53e40fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:58.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.523+0000 7f53e259c640 1 -- 172.21.15.2:0/915732085 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f53e4102570 msgr2=0x7f53e40fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:58.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.523+0000 7f53e259c640 1 --2- 172.21.15.2:0/915732085 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f53e4102570 0x7f53e40fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:58.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.523+0000 7f53e259c640 1 -- 172.21.15.2:0/915732085 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f53e4102ef0 msgr2=0x7f53e40fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:58.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.523+0000 7f53e259c640 1 --2- 172.21.15.2:0/915732085 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f53e4102ef0 0x7f53e40fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:58.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.523+0000 7f53e259c640 1 -- 172.21.15.2:0/915732085 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53e41a68d0 con 0x7f53e4100e20 2024-09-19T04:46:58.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.523+0000 7f53e259c640 1 --2- 172.21.15.2:0/915732085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53e4100e20 0x7f53e40fcc80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f53d400d770 tx=0x7f53d400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:58.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.523+0000 7f53d37fe640 1 -- 172.21.15.2:0/915732085 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d4017070 con 0x7f53e4100e20 2024-09-19T04:46:58.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.523+0000 7f53d37fe640 1 -- 172.21.15.2:0/915732085 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f53d40054d0 con 0x7f53e4100e20 2024-09-19T04:46:58.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.523+0000 7f53e8a47640 1 -- 172.21.15.2:0/915732085 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53e41a6bc0 con 0x7f53e4100e20 2024-09-19T04:46:58.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.523+0000 7f53d37fe640 1 -- 172.21.15.2:0/915732085 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d4004cf0 con 0x7f53e4100e20 2024-09-19T04:46:58.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.524+0000 7f53e8a47640 1 -- 172.21.15.2:0/915732085 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53e41a70b0 con 0x7f53e4100e20 2024-09-19T04:46:58.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.525+0000 7f53e8a47640 1 -- 172.21.15.2:0/915732085 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f53e40628c0 con 0x7f53e4100e20 2024-09-19T04:46:58.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.526+0000 7f53d37fe640 1 -- 172.21.15.2:0/915732085 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f53d4004e90 con 0x7f53e4100e20 2024-09-19T04:46:58.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.526+0000 7f53d37fe640 1 --2- 172.21.15.2:0/915732085 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f53cc0a32d0 0x7f53cc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:58.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.527+0000 7f53e1d9b640 1 --2- 172.21.15.2:0/915732085 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f53cc0a32d0 0x7f53cc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:58.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.527+0000 7f53d37fe640 1 -- 172.21.15.2:0/915732085 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f53d40cf8a0 con 0x7f53e4100e20 2024-09-19T04:46:58.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.527+0000 7f53d37fe640 1 --2- 172.21.15.2:0/915732085 >> [v2:172.21.15.116:6808/316360741,v1:172.21.15.116:6809/316360741] conn(0x7f53cc0ace00 0x7f53cc0af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:58.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.527+0000 7f53d37fe640 1 -- 172.21.15.2:0/915732085 --> [v2:172.21.15.116:6808/316360741,v1:172.21.15.116:6809/316360741] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f53d4005320 con 0x7f53cc0ace00 2024-09-19T04:46:58.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.527+0000 7f53d37fe640 1 -- 172.21.15.2:0/915732085 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f53d40cfc50 con 0x7f53e4100e20 2024-09-19T04:46:58.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.527+0000 7f53e1d9b640 1 --2- 172.21.15.2:0/915732085 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f53cc0a32d0 0x7f53cc0a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f53e40fe710 tx=0x7f53d800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:58.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.527+0000 7f53e2d9d640 1 --2- 172.21.15.2:0/915732085 >> [v2:172.21.15.116:6808/316360741,v1:172.21.15.116:6809/316360741] conn(0x7f53cc0ace00 0x7f53cc0af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:58.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.528+0000 7f53e2d9d640 1 --2- 172.21.15.2:0/915732085 >> [v2:172.21.15.116:6808/316360741,v1:172.21.15.116:6809/316360741] conn(0x7f53cc0ace00 0x7f53cc0af2a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:58.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.529+0000 7f53d37fe640 1 -- 172.21.15.2:0/915732085 <== osd.5 v2:172.21.15.116:6808/316360741 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f53d4005320 con 0x7f53cc0ace00 2024-09-19T04:46:58.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.542+0000 7f53e8a47640 1 -- 172.21.15.2:0/915732085 --> [v2:172.21.15.116:6808/316360741,v1:172.21.15.116:6809/316360741] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f53e4062d40 con 0x7f53cc0ace00 2024-09-19T04:46:58.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.543+0000 7f53d37fe640 1 -- 172.21.15.2:0/915732085 <== osd.5 v2:172.21.15.116:6808/316360741 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f53e4062d40 con 0x7f53cc0ace00 2024-09-19T04:46:58.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.543+0000 7f53e8a47640 1 -- 172.21.15.2:0/915732085 >> [v2:172.21.15.116:6808/316360741,v1:172.21.15.116:6809/316360741] conn(0x7f53cc0ace00 msgr2=0x7f53cc0af2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:58.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.543+0000 7f53e8a47640 1 --2- 172.21.15.2:0/915732085 >> [v2:172.21.15.116:6808/316360741,v1:172.21.15.116:6809/316360741] conn(0x7f53cc0ace00 0x7f53cc0af2a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:58.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.543+0000 7f53e8a47640 1 -- 172.21.15.2:0/915732085 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f53cc0a32d0 msgr2=0x7f53cc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:58.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.543+0000 7f53e8a47640 1 --2- 172.21.15.2:0/915732085 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f53cc0a32d0 0x7f53cc0a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f53e40fe710 tx=0x7f53d800b410 comp rx=0 tx=0).stop 2024-09-19T04:46:58.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.543+0000 7f53e8a47640 1 -- 172.21.15.2:0/915732085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53e4100e20 msgr2=0x7f53e40fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:58.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.543+0000 7f53e8a47640 1 --2- 172.21.15.2:0/915732085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53e4100e20 0x7f53e40fcc80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f53d400d770 tx=0x7f53d400dc30 comp rx=0 tx=0).stop 2024-09-19T04:46:58.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.543+0000 7f53e2d9d640 1 -- 172.21.15.2:0/915732085 reap_dead start 2024-09-19T04:46:58.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.543+0000 7f53e8a47640 1 -- 172.21.15.2:0/915732085 shutdown_connections 2024-09-19T04:46:58.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.543+0000 7f53e8a47640 1 -- 172.21.15.2:0/915732085 >> 172.21.15.2:0/915732085 conn(0x7f53e40fc7d0 msgr2=0x7f53e406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:58.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.543+0000 7f53e8a47640 1 -- 172.21.15.2:0/915732085 shutdown_connections 2024-09-19T04:46:58.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.543+0000 7f53e8a47640 1 -- 172.21.15.2:0/915732085 wait complete. 2024-09-19T04:46:58.804 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:46:58.804 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:46:58.805 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:46:58.805 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:46:59.296 INFO:teuthology.orchestra.run.smithi002.stdout:231928234019 2024-09-19T04:46:59.297 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-19T04:46:59.585 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:46:59 smithi002 ceph-mon[30975]: pgmap v291: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 1.4 KiB/s wr, 2 op/s 2024-09-19T04:46:59.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:46:59 smithi018 ceph-mon[34537]: pgmap v291: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 1.4 KiB/s wr, 2 op/s 2024-09-19T04:46:59.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:46:59 smithi116 ceph-mon[34477]: pgmap v291: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 1.4 KiB/s wr, 2 op/s 2024-09-19T04:46:59.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.876+0000 7fd6cb026640 1 -- 172.21.15.2:0/1550739751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6c4102ef0 msgr2=0x7fd6c410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:59.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.876+0000 7fd6cb026640 1 --2- 172.21.15.2:0/1550739751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6c4102ef0 0x7fd6c410da40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc009ca0 tx=0x7fd6bc02a950 comp rx=0 tx=0).stop 2024-09-19T04:46:59.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.876+0000 7fd6cb026640 1 -- 172.21.15.2:0/1550739751 shutdown_connections 2024-09-19T04:46:59.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.876+0000 7fd6cb026640 1 --2- 172.21.15.2:0/1550739751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6c4102ef0 0x7fd6c410da40 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:59.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.876+0000 7fd6cb026640 1 --2- 172.21.15.2:0/1550739751 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6c4102570 0x7fd6c41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:59.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.876+0000 7fd6cb026640 1 --2- 172.21.15.2:0/1550739751 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd6c4100e20 0x7fd6c4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:59.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.876+0000 7fd6cb026640 1 -- 172.21.15.2:0/1550739751 >> 172.21.15.2:0/1550739751 conn(0x7fd6c40fc7d0 msgr2=0x7fd6c40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:59.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.876+0000 7fd6cb026640 1 -- 172.21.15.2:0/1550739751 shutdown_connections 2024-09-19T04:46:59.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.876+0000 7fd6cb026640 1 -- 172.21.15.2:0/1550739751 wait complete. 2024-09-19T04:46:59.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.877+0000 7fd6cb026640 1 Processor -- start 2024-09-19T04:46:59.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.877+0000 7fd6cb026640 1 -- start start 2024-09-19T04:46:59.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.877+0000 7fd6cb026640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6c4100e20 0x7fd6c40fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:59.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.877+0000 7fd6cb026640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6c4102570 0x7fd6c40fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:59.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.877+0000 7fd6cb026640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd6c4102ef0 0x7fd6c40fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:59.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.877+0000 7fd6cb026640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c4110e30 con 0x7fd6c4102570 2024-09-19T04:46:59.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.877+0000 7fd6cb026640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c4110cb0 con 0x7fd6c4100e20 2024-09-19T04:46:59.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.877+0000 7fd6cb026640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c4110fb0 con 0x7fd6c4102ef0 2024-09-19T04:46:59.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.877+0000 7fd6c3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6c4102570 0x7fd6c40fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:59.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.878+0000 7fd6c3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6c4102570 0x7fd6c40fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42220/0 (socket says 172.21.15.2:42220) 2024-09-19T04:46:59.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.878+0000 7fd6c3fff640 1 -- 172.21.15.2:0/4044446283 learned_addr learned my addr 172.21.15.2:0/4044446283 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:46:59.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.878+0000 7fd6c95c3640 1 --2- 172.21.15.2:0/4044446283 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd6c4102ef0 0x7fd6c40fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:59.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.878+0000 7fd6c8dc2640 1 --2- 172.21.15.2:0/4044446283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6c4100e20 0x7fd6c40fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:59.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.878+0000 7fd6c3fff640 1 -- 172.21.15.2:0/4044446283 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd6c4102ef0 msgr2=0x7fd6c40fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:59.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.878+0000 7fd6c3fff640 1 --2- 172.21.15.2:0/4044446283 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd6c4102ef0 0x7fd6c40fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:59.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.878+0000 7fd6c3fff640 1 -- 172.21.15.2:0/4044446283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6c4100e20 msgr2=0x7fd6c40fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:59.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.878+0000 7fd6c3fff640 1 --2- 172.21.15.2:0/4044446283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6c4100e20 0x7fd6c40fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:59.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.878+0000 7fd6c3fff640 1 -- 172.21.15.2:0/4044446283 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6c41a6840 con 0x7fd6c4102570 2024-09-19T04:46:59.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.878+0000 7fd6c8dc2640 1 --2- 172.21.15.2:0/4044446283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6c4100e20 0x7fd6c40fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:46:59.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.878+0000 7fd6c3fff640 1 --2- 172.21.15.2:0/4044446283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6c4102570 0x7fd6c40fd1c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd6b000d950 tx=0x7fd6b000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:59.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.878+0000 7fd6c1ffb640 1 -- 172.21.15.2:0/4044446283 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b0017030 con 0x7fd6c4102570 2024-09-19T04:46:59.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.878+0000 7fd6c1ffb640 1 -- 172.21.15.2:0/4044446283 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd6b0004020 con 0x7fd6c4102570 2024-09-19T04:46:59.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.878+0000 7fd6cb026640 1 -- 172.21.15.2:0/4044446283 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6c41a6b30 con 0x7fd6c4102570 2024-09-19T04:46:59.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.878+0000 7fd6c1ffb640 1 -- 172.21.15.2:0/4044446283 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b00047a0 con 0x7fd6c4102570 2024-09-19T04:46:59.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.878+0000 7fd6cb026640 1 -- 172.21.15.2:0/4044446283 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6c41a7070 con 0x7fd6c4102570 2024-09-19T04:46:59.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.879+0000 7fd6cb026640 1 -- 172.21.15.2:0/4044446283 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd6c4062980 con 0x7fd6c4102570 2024-09-19T04:46:59.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.880+0000 7fd6c1ffb640 1 -- 172.21.15.2:0/4044446283 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fd6b00041d0 con 0x7fd6c4102570 2024-09-19T04:46:59.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.881+0000 7fd6c1ffb640 1 --2- 172.21.15.2:0/4044446283 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd6b40a32d0 0x7fd6b40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:59.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.881+0000 7fd6c1ffb640 1 -- 172.21.15.2:0/4044446283 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fd6b00cf490 con 0x7fd6c4102570 2024-09-19T04:46:59.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.881+0000 7fd6c8dc2640 1 --2- 172.21.15.2:0/4044446283 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd6b40a32d0 0x7fd6b40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:59.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.881+0000 7fd6c1ffb640 1 --2- 172.21.15.2:0/4044446283 >> [v2:172.21.15.18:6808/1333533784,v1:172.21.15.18:6809/1333533784] conn(0x7fd6b40ace00 0x7fd6b40af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:46:59.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.881+0000 7fd6c1ffb640 1 -- 172.21.15.2:0/4044446283 --> [v2:172.21.15.18:6808/1333533784,v1:172.21.15.18:6809/1333533784] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd6b00056a0 con 0x7fd6b40ace00 2024-09-19T04:46:59.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.881+0000 7fd6c1ffb640 1 -- 172.21.15.2:0/4044446283 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fd6b00d6050 con 0x7fd6c4102570 2024-09-19T04:46:59.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.882+0000 7fd6c8dc2640 1 --2- 172.21.15.2:0/4044446283 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd6b40a32d0 0x7fd6b40a5790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8009b40 tx=0x7fd6b8005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:59.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.882+0000 7fd6c95c3640 1 --2- 172.21.15.2:0/4044446283 >> [v2:172.21.15.18:6808/1333533784,v1:172.21.15.18:6809/1333533784] conn(0x7fd6b40ace00 0x7fd6b40af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:46:59.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.882+0000 7fd6c95c3640 1 --2- 172.21.15.2:0/4044446283 >> [v2:172.21.15.18:6808/1333533784,v1:172.21.15.18:6809/1333533784] conn(0x7fd6b40ace00 0x7fd6b40af2a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:46:59.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.883+0000 7fd6c1ffb640 1 -- 172.21.15.2:0/4044446283 <== osd.4 v2:172.21.15.18:6808/1333533784 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd6b00056a0 con 0x7fd6b40ace00 2024-09-19T04:46:59.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.897+0000 7fd6cb026640 1 -- 172.21.15.2:0/4044446283 --> [v2:172.21.15.18:6808/1333533784,v1:172.21.15.18:6809/1333533784] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd6c4062e00 con 0x7fd6b40ace00 2024-09-19T04:46:59.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.898+0000 7fd6c1ffb640 1 -- 172.21.15.2:0/4044446283 <== osd.4 v2:172.21.15.18:6808/1333533784 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd6c4062e00 con 0x7fd6b40ace00 2024-09-19T04:46:59.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.898+0000 7fd6cb026640 1 -- 172.21.15.2:0/4044446283 >> [v2:172.21.15.18:6808/1333533784,v1:172.21.15.18:6809/1333533784] conn(0x7fd6b40ace00 msgr2=0x7fd6b40af2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:59.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.898+0000 7fd6cb026640 1 --2- 172.21.15.2:0/4044446283 >> [v2:172.21.15.18:6808/1333533784,v1:172.21.15.18:6809/1333533784] conn(0x7fd6b40ace00 0x7fd6b40af2a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:46:59.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.898+0000 7fd6cb026640 1 -- 172.21.15.2:0/4044446283 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd6b40a32d0 msgr2=0x7fd6b40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:59.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.898+0000 7fd6cb026640 1 --2- 172.21.15.2:0/4044446283 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd6b40a32d0 0x7fd6b40a5790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8009b40 tx=0x7fd6b8005e50 comp rx=0 tx=0).stop 2024-09-19T04:46:59.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.898+0000 7fd6cb026640 1 -- 172.21.15.2:0/4044446283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6c4102570 msgr2=0x7fd6c40fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:46:59.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.898+0000 7fd6cb026640 1 --2- 172.21.15.2:0/4044446283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6c4102570 0x7fd6c40fd1c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd6b000d950 tx=0x7fd6b000de10 comp rx=0 tx=0).stop 2024-09-19T04:46:59.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.898+0000 7fd6c95c3640 1 -- 172.21.15.2:0/4044446283 reap_dead start 2024-09-19T04:46:59.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.898+0000 7fd6cb026640 1 -- 172.21.15.2:0/4044446283 shutdown_connections 2024-09-19T04:46:59.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.898+0000 7fd6cb026640 1 -- 172.21.15.2:0/4044446283 >> 172.21.15.2:0/4044446283 conn(0x7fd6c40fc7d0 msgr2=0x7fd6c406a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:46:59.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.898+0000 7fd6cb026640 1 -- 172.21.15.2:0/4044446283 shutdown_connections 2024-09-19T04:46:59.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:59.898+0000 7fd6cb026640 1 -- 172.21.15.2:0/4044446283 wait complete. 2024-09-19T04:47:00.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.607+0000 7f361956a640 1 -- 172.21.15.2:0/3747579605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3614100e20 msgr2=0x7f3614101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:00.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.607+0000 7f361956a640 1 --2- 172.21.15.2:0/3747579605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3614100e20 0x7f3614101200 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3604009900 tx=0x7f360402a480 comp rx=0 tx=0).stop 2024-09-19T04:47:00.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.607+0000 7f361956a640 1 -- 172.21.15.2:0/3747579605 shutdown_connections 2024-09-19T04:47:00.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.607+0000 7f361956a640 1 --2- 172.21.15.2:0/3747579605 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3614102ef0 0x7f361410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:00.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.607+0000 7f361956a640 1 --2- 172.21.15.2:0/3747579605 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3614102570 0x7f36141029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:00.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.607+0000 7f361956a640 1 --2- 172.21.15.2:0/3747579605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3614100e20 0x7f3614101200 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:00.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.607+0000 7f361956a640 1 -- 172.21.15.2:0/3747579605 >> 172.21.15.2:0/3747579605 conn(0x7f36140fc7d0 msgr2=0x7f36140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:00.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.607+0000 7f361956a640 1 -- 172.21.15.2:0/3747579605 shutdown_connections 2024-09-19T04:47:00.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.607+0000 7f361956a640 1 -- 172.21.15.2:0/3747579605 wait complete. 2024-09-19T04:47:00.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.607+0000 7f361956a640 1 Processor -- start 2024-09-19T04:47:00.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.608+0000 7f361956a640 1 -- start start 2024-09-19T04:47:00.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.608+0000 7f361956a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3614100e20 0x7f361419a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:00.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.608+0000 7f361956a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3614102570 0x7f361419ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:00.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.608+0000 7f361956a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3614102ef0 0x7f361419eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:00.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.608+0000 7f361956a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3614111f50 con 0x7f3614102570 2024-09-19T04:47:00.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.608+0000 7f361956a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3614111dd0 con 0x7f3614102ef0 2024-09-19T04:47:00.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.608+0000 7f361956a640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f36141120d0 con 0x7f3614100e20 2024-09-19T04:47:00.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.608+0000 7f36127fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3614102570 0x7f361419ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:00.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.608+0000 7f36127fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3614102570 0x7f361419ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42198/0 (socket says 172.21.15.2:42198) 2024-09-19T04:47:00.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.608+0000 7f36127fc640 1 -- 172.21.15.2:0/1333038425 learned_addr learned my addr 172.21.15.2:0/1333038425 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:47:00.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.608+0000 7f3612ffd640 1 --2- 172.21.15.2:0/1333038425 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3614100e20 0x7f361419a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:00.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.608+0000 7f36137fe640 1 --2- 172.21.15.2:0/1333038425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3614102ef0 0x7f361419eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:00.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.608+0000 7f36127fc640 1 -- 172.21.15.2:0/1333038425 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3614100e20 msgr2=0x7f361419a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:00.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.608+0000 7f36127fc640 1 --2- 172.21.15.2:0/1333038425 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3614100e20 0x7f361419a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:00.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.608+0000 7f36127fc640 1 -- 172.21.15.2:0/1333038425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3614102ef0 msgr2=0x7f361419eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:00.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.608+0000 7f36127fc640 1 --2- 172.21.15.2:0/1333038425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3614102ef0 0x7f361419eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:00.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.608+0000 7f36127fc640 1 -- 172.21.15.2:0/1333038425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f361419f590 con 0x7f3614102570 2024-09-19T04:47:00.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.608+0000 7f36137fe640 1 --2- 172.21.15.2:0/1333038425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3614102ef0 0x7f361419eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:47:00.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.609+0000 7f36127fc640 1 --2- 172.21.15.2:0/1333038425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3614102570 0x7f361419ab20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f35fc00d950 tx=0x7f35fc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:00.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.609+0000 7f360bfff640 1 -- 172.21.15.2:0/1333038425 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35fc017070 con 0x7f3614102570 2024-09-19T04:47:00.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.609+0000 7f360bfff640 1 -- 172.21.15.2:0/1333038425 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f35fc009c30 con 0x7f3614102570 2024-09-19T04:47:00.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.609+0000 7f361956a640 1 -- 172.21.15.2:0/1333038425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f361419f880 con 0x7f3614102570 2024-09-19T04:47:00.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.609+0000 7f360bfff640 1 -- 172.21.15.2:0/1333038425 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35fc00f620 con 0x7f3614102570 2024-09-19T04:47:00.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.609+0000 7f361956a640 1 -- 172.21.15.2:0/1333038425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36141a7160 con 0x7f3614102570 2024-09-19T04:47:00.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.610+0000 7f361956a640 1 -- 172.21.15.2:0/1333038425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3614062980 con 0x7f3614102570 2024-09-19T04:47:00.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.611+0000 7f360bfff640 1 -- 172.21.15.2:0/1333038425 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f35fc0109a0 con 0x7f3614102570 2024-09-19T04:47:00.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.612+0000 7f360bfff640 1 --2- 172.21.15.2:0/1333038425 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f36000a32d0 0x7f36000a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:00.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.612+0000 7f3612ffd640 1 --2- 172.21.15.2:0/1333038425 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f36000a32d0 0x7f36000a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:00.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.612+0000 7f360bfff640 1 -- 172.21.15.2:0/1333038425 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f35fc0cfa40 con 0x7f3614102570 2024-09-19T04:47:00.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.612+0000 7f360bfff640 1 --2- 172.21.15.2:0/1333038425 >> [v2:172.21.15.116:6824/3456789654,v1:172.21.15.116:6825/3456789654] conn(0x7f36000ace00 0x7f36000af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:00.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.612+0000 7f360bfff640 1 -- 172.21.15.2:0/1333038425 --> [v2:172.21.15.116:6824/3456789654,v1:172.21.15.116:6825/3456789654] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f36000af970 con 0x7f36000ace00 2024-09-19T04:47:00.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.612+0000 7f360bfff640 1 -- 172.21.15.2:0/1333038425 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f35fc0cfe90 con 0x7f3614102570 2024-09-19T04:47:00.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.612+0000 7f3612ffd640 1 --2- 172.21.15.2:0/1333038425 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f36000a32d0 0x7f36000a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3604009230 tx=0x7f36040058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:00.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.612+0000 7f36137fe640 1 --2- 172.21.15.2:0/1333038425 >> [v2:172.21.15.116:6824/3456789654,v1:172.21.15.116:6825/3456789654] conn(0x7f36000ace00 0x7f36000af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:00.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.613+0000 7f36137fe640 1 --2- 172.21.15.2:0/1333038425 >> [v2:172.21.15.116:6824/3456789654,v1:172.21.15.116:6825/3456789654] conn(0x7f36000ace00 0x7f36000af2a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:00.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.614+0000 7f360bfff640 1 -- 172.21.15.2:0/1333038425 <== osd.11 v2:172.21.15.116:6824/3456789654 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f36000af970 con 0x7f36000ace00 2024-09-19T04:47:00.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.628+0000 7f361956a640 1 -- 172.21.15.2:0/1333038425 --> [v2:172.21.15.116:6824/3456789654,v1:172.21.15.116:6825/3456789654] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3614062e00 con 0x7f36000ace00 2024-09-19T04:47:00.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.629+0000 7f360bfff640 1 -- 172.21.15.2:0/1333038425 <== osd.11 v2:172.21.15.116:6824/3456789654 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3614062e00 con 0x7f36000ace00 2024-09-19T04:47:00.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.629+0000 7f361956a640 1 -- 172.21.15.2:0/1333038425 >> [v2:172.21.15.116:6824/3456789654,v1:172.21.15.116:6825/3456789654] conn(0x7f36000ace00 msgr2=0x7f36000af2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:00.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.629+0000 7f361956a640 1 --2- 172.21.15.2:0/1333038425 >> [v2:172.21.15.116:6824/3456789654,v1:172.21.15.116:6825/3456789654] conn(0x7f36000ace00 0x7f36000af2a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:00.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.629+0000 7f361956a640 1 -- 172.21.15.2:0/1333038425 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f36000a32d0 msgr2=0x7f36000a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:00.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.629+0000 7f361956a640 1 --2- 172.21.15.2:0/1333038425 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f36000a32d0 0x7f36000a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3604009230 tx=0x7f36040058d0 comp rx=0 tx=0).stop 2024-09-19T04:47:00.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.629+0000 7f361956a640 1 -- 172.21.15.2:0/1333038425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3614102570 msgr2=0x7f361419ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:00.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.629+0000 7f361956a640 1 --2- 172.21.15.2:0/1333038425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3614102570 0x7f361419ab20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f35fc00d950 tx=0x7f35fc00de10 comp rx=0 tx=0).stop 2024-09-19T04:47:00.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.629+0000 7f36137fe640 1 -- 172.21.15.2:0/1333038425 reap_dead start 2024-09-19T04:47:00.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.629+0000 7f361956a640 1 -- 172.21.15.2:0/1333038425 shutdown_connections 2024-09-19T04:47:00.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.629+0000 7f361956a640 1 -- 172.21.15.2:0/1333038425 >> 172.21.15.2:0/1333038425 conn(0x7f36140fc7d0 msgr2=0x7f361410c250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:00.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.629+0000 7f361956a640 1 -- 172.21.15.2:0/1333038425 shutdown_connections 2024-09-19T04:47:00.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:46:58.629+0000 7f361956a640 1 -- 172.21.15.2:0/1333038425 wait complete. 2024-09-19T04:47:00.987 INFO:teuthology.orchestra.run.smithi002.stdout:309237645332 2024-09-19T04:47:00.988 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-19T04:47:01.569 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:01 smithi002 ceph-mon[30975]: pgmap v292: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.4 KiB/s wr, 3 op/s 2024-09-19T04:47:01.628 INFO:teuthology.orchestra.run.smithi002.stdout:150323855409 2024-09-19T04:47:01.629 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-19T04:47:01.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:01 smithi018 ceph-mon[34537]: pgmap v292: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.4 KiB/s wr, 3 op/s 2024-09-19T04:47:01.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:01 smithi116 ceph-mon[34477]: pgmap v292: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.4 KiB/s wr, 3 op/s 2024-09-19T04:47:02.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.238+0000 7f2bd91c9640 1 -- 172.21.15.2:0/1464299276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bd4100e20 msgr2=0x7f2bd4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:02.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.238+0000 7f2bd91c9640 1 --2- 172.21.15.2:0/1464299276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bd4100e20 0x7f2bd4101200 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2bc4009900 tx=0x7f2bc402a480 comp rx=0 tx=0).stop 2024-09-19T04:47:02.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.238+0000 7f2bd91c9640 1 -- 172.21.15.2:0/1464299276 shutdown_connections 2024-09-19T04:47:02.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.238+0000 7f2bd91c9640 1 --2- 172.21.15.2:0/1464299276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bd4102ef0 0x7f2bd410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:02.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.238+0000 7f2bd91c9640 1 --2- 172.21.15.2:0/1464299276 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2bd4102570 0x7f2bd41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:02.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.238+0000 7f2bd91c9640 1 --2- 172.21.15.2:0/1464299276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bd4100e20 0x7f2bd4101200 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:02.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.238+0000 7f2bd91c9640 1 -- 172.21.15.2:0/1464299276 >> 172.21.15.2:0/1464299276 conn(0x7f2bd40fc7d0 msgr2=0x7f2bd40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:02.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.238+0000 7f2bd91c9640 1 -- 172.21.15.2:0/1464299276 shutdown_connections 2024-09-19T04:47:02.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.238+0000 7f2bd91c9640 1 -- 172.21.15.2:0/1464299276 wait complete. 2024-09-19T04:47:02.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.238+0000 7f2bd91c9640 1 Processor -- start 2024-09-19T04:47:02.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.239+0000 7f2bd91c9640 1 -- start start 2024-09-19T04:47:02.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.239+0000 7f2bd91c9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2bd4100e20 0x7f2bd419a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:02.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.239+0000 7f2bd91c9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bd4102570 0x7f2bd419abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:02.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.239+0000 7f2bd91c9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bd4102ef0 0x7f2bd419ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:02.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.239+0000 7f2bd91c9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd4110f20 con 0x7f2bd4102570 2024-09-19T04:47:02.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.239+0000 7f2bd91c9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd4110da0 con 0x7f2bd4102ef0 2024-09-19T04:47:02.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.239+0000 7f2bd91c9640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd41110a0 con 0x7f2bd4100e20 2024-09-19T04:47:02.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.239+0000 7f2bca59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bd4102570 0x7f2bd419abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:02.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.239+0000 7f2bca59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bd4102570 0x7f2bd419abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52946/0 (socket says 172.21.15.2:52946) 2024-09-19T04:47:02.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.239+0000 7f2bca59c640 1 -- 172.21.15.2:0/1547741380 learned_addr learned my addr 172.21.15.2:0/1547741380 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:47:02.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.239+0000 7f2bd2d9d640 1 --2- 172.21.15.2:0/1547741380 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2bd4100e20 0x7f2bd419a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:02.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.239+0000 7f2bd359e640 1 --2- 172.21.15.2:0/1547741380 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bd4102ef0 0x7f2bd419ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:02.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.239+0000 7f2bca59c640 1 -- 172.21.15.2:0/1547741380 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2bd4100e20 msgr2=0x7f2bd419a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:02.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.239+0000 7f2bca59c640 1 --2- 172.21.15.2:0/1547741380 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2bd4100e20 0x7f2bd419a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:02.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.239+0000 7f2bca59c640 1 -- 172.21.15.2:0/1547741380 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bd4102ef0 msgr2=0x7f2bd419ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:02.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.240+0000 7f2bca59c640 1 --2- 172.21.15.2:0/1547741380 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bd4102ef0 0x7f2bd419ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:02.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.240+0000 7f2bca59c640 1 -- 172.21.15.2:0/1547741380 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bd419f640 con 0x7f2bd4102570 2024-09-19T04:47:02.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.240+0000 7f2bd359e640 1 --2- 172.21.15.2:0/1547741380 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bd4102ef0 0x7f2bd419ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:47:02.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.240+0000 7f2bca59c640 1 --2- 172.21.15.2:0/1547741380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bd4102570 0x7f2bd419abd0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc00b4a0 tx=0x7f2bbc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:02.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.240+0000 7f2bd0d99640 1 -- 172.21.15.2:0/1547741380 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc014070 con 0x7f2bd4102570 2024-09-19T04:47:02.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.240+0000 7f2bd91c9640 1 -- 172.21.15.2:0/1547741380 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bd419f930 con 0x7f2bd4102570 2024-09-19T04:47:02.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.240+0000 7f2bd0d99640 1 -- 172.21.15.2:0/1547741380 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2bbc010ac0 con 0x7f2bd4102570 2024-09-19T04:47:02.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.240+0000 7f2bd0d99640 1 -- 172.21.15.2:0/1547741380 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc017c30 con 0x7f2bd4102570 2024-09-19T04:47:02.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.240+0000 7f2bd91c9640 1 -- 172.21.15.2:0/1547741380 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bd41a7210 con 0x7f2bd4102570 2024-09-19T04:47:02.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.241+0000 7f2bd91c9640 1 -- 172.21.15.2:0/1547741380 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2bd410d0f0 con 0x7f2bd4102570 2024-09-19T04:47:02.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.242+0000 7f2bd0d99640 1 -- 172.21.15.2:0/1547741380 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f2bbc017070 con 0x7f2bd4102570 2024-09-19T04:47:02.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.243+0000 7f2bd0d99640 1 --2- 172.21.15.2:0/1547741380 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f2bc00a32d0 0x7f2bc00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:02.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.243+0000 7f2bd0d99640 1 -- 172.21.15.2:0/1547741380 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f2bbc0cf150 con 0x7f2bd4102570 2024-09-19T04:47:02.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.243+0000 7f2bd2d9d640 1 --2- 172.21.15.2:0/1547741380 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f2bc00a32d0 0x7f2bc00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:02.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.243+0000 7f2bd0d99640 1 --2- 172.21.15.2:0/1547741380 >> [v2:172.21.15.18:6824/1958683776,v1:172.21.15.18:6825/1958683776] conn(0x7f2bc00ace00 0x7f2bc00af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:02.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.243+0000 7f2bd0d99640 1 -- 172.21.15.2:0/1547741380 --> [v2:172.21.15.18:6824/1958683776,v1:172.21.15.18:6825/1958683776] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2bbc01ae50 con 0x7f2bc00ace00 2024-09-19T04:47:02.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.243+0000 7f2bd0d99640 1 -- 172.21.15.2:0/1547741380 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f2bbc0cf5a0 con 0x7f2bd4102570 2024-09-19T04:47:02.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.243+0000 7f2bd2d9d640 1 --2- 172.21.15.2:0/1547741380 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f2bc00a32d0 0x7f2bc00a5790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2bc4000c00 tx=0x7f2bc4005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:02.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.244+0000 7f2bd359e640 1 --2- 172.21.15.2:0/1547741380 >> [v2:172.21.15.18:6824/1958683776,v1:172.21.15.18:6825/1958683776] conn(0x7f2bc00ace00 0x7f2bc00af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:02.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.244+0000 7f2bd359e640 1 --2- 172.21.15.2:0/1547741380 >> [v2:172.21.15.18:6824/1958683776,v1:172.21.15.18:6825/1958683776] conn(0x7f2bc00ace00 0x7f2bc00af2a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:02.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.245+0000 7f2bd0d99640 1 -- 172.21.15.2:0/1547741380 <== osd.10 v2:172.21.15.18:6824/1958683776 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2bbc01ae50 con 0x7f2bc00ace00 2024-09-19T04:47:02.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.258+0000 7f2bd91c9640 1 -- 172.21.15.2:0/1547741380 --> [v2:172.21.15.18:6824/1958683776,v1:172.21.15.18:6825/1958683776] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2bd41021b0 con 0x7f2bc00ace00 2024-09-19T04:47:02.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.259+0000 7f2bd0d99640 1 -- 172.21.15.2:0/1547741380 <== osd.10 v2:172.21.15.18:6824/1958683776 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2bd41021b0 con 0x7f2bc00ace00 2024-09-19T04:47:02.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.259+0000 7f2bd91c9640 1 -- 172.21.15.2:0/1547741380 >> [v2:172.21.15.18:6824/1958683776,v1:172.21.15.18:6825/1958683776] conn(0x7f2bc00ace00 msgr2=0x7f2bc00af2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:02.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.259+0000 7f2bd91c9640 1 --2- 172.21.15.2:0/1547741380 >> [v2:172.21.15.18:6824/1958683776,v1:172.21.15.18:6825/1958683776] conn(0x7f2bc00ace00 0x7f2bc00af2a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:02.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.259+0000 7f2bd91c9640 1 -- 172.21.15.2:0/1547741380 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f2bc00a32d0 msgr2=0x7f2bc00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:02.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.259+0000 7f2bd91c9640 1 --2- 172.21.15.2:0/1547741380 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f2bc00a32d0 0x7f2bc00a5790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2bc4000c00 tx=0x7f2bc4005e80 comp rx=0 tx=0).stop 2024-09-19T04:47:02.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.259+0000 7f2bd91c9640 1 -- 172.21.15.2:0/1547741380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bd4102570 msgr2=0x7f2bd419abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:02.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.259+0000 7f2bd91c9640 1 --2- 172.21.15.2:0/1547741380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bd4102570 0x7f2bd419abd0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc00b4a0 tx=0x7f2bbc00b960 comp rx=0 tx=0).stop 2024-09-19T04:47:02.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.259+0000 7f2bd359e640 1 -- 172.21.15.2:0/1547741380 reap_dead start 2024-09-19T04:47:02.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.259+0000 7f2bd91c9640 1 -- 172.21.15.2:0/1547741380 shutdown_connections 2024-09-19T04:47:02.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.259+0000 7f2bd91c9640 1 -- 172.21.15.2:0/1547741380 >> 172.21.15.2:0/1547741380 conn(0x7f2bd40fc7d0 msgr2=0x7f2bd406a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:02.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.259+0000 7f2bd91c9640 1 -- 172.21.15.2:0/1547741380 shutdown_connections 2024-09-19T04:47:02.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:02.260+0000 7f2bd91c9640 1 -- 172.21.15.2:0/1547741380 wait complete. 2024-09-19T04:47:02.911 INFO:teuthology.orchestra.run.smithi002.stdout:279172874266 2024-09-19T04:47:02.911 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-19T04:47:03.382 INFO:teuthology.orchestra.run.smithi002.stdout:51539607622 2024-09-19T04:47:03.383 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-19T04:47:03.609 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:03 smithi002 ceph-mon[30975]: pgmap v293: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 426 B/s wr, 1 op/s 2024-09-19T04:47:03.806 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:03 smithi018 ceph-mon[34537]: pgmap v293: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 426 B/s wr, 1 op/s 2024-09-19T04:47:03.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:03 smithi116 ceph-mon[34477]: pgmap v293: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 426 B/s wr, 1 op/s 2024-09-19T04:47:04.060 INFO:teuthology.orchestra.run.smithi002.stdout:98784247868 2024-09-19T04:47:04.061 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-19T04:47:04.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.223+0000 7f453a31e640 1 -- 172.21.15.2:0/47026886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4534103740 msgr2=0x7f4534107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:04.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.223+0000 7f453a31e640 1 --2- 172.21.15.2:0/47026886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4534103740 0x7f4534107b80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4528009930 tx=0x7f452802a420 comp rx=0 tx=0).stop 2024-09-19T04:47:04.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.223+0000 7f453a31e640 1 -- 172.21.15.2:0/47026886 shutdown_connections 2024-09-19T04:47:04.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.223+0000 7f453a31e640 1 --2- 172.21.15.2:0/47026886 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4534108290 0x7f453410ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:04.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.223+0000 7f453a31e640 1 --2- 172.21.15.2:0/47026886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4534103740 0x7f4534107b80 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:04.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.223+0000 7f453a31e640 1 --2- 172.21.15.2:0/47026886 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4534102d90 0x7f4534103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:04.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.223+0000 7f453a31e640 1 -- 172.21.15.2:0/47026886 >> 172.21.15.2:0/47026886 conn(0x7f45340fc7d0 msgr2=0x7f45340febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:04.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.223+0000 7f453a31e640 1 -- 172.21.15.2:0/47026886 shutdown_connections 2024-09-19T04:47:04.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.223+0000 7f453a31e640 1 -- 172.21.15.2:0/47026886 wait complete. 2024-09-19T04:47:04.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.224+0000 7f453a31e640 1 Processor -- start 2024-09-19T04:47:04.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.224+0000 7f453a31e640 1 -- start start 2024-09-19T04:47:04.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.224+0000 7f453a31e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4534102d90 0x7f45341009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:04.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.224+0000 7f453a31e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4534103740 0x7f4534100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:04.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.224+0000 7f453a31e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4534108290 0x7f4534101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:04.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.224+0000 7f453a31e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4534111fe0 con 0x7f4534103740 2024-09-19T04:47:04.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.224+0000 7f453a31e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4534111e60 con 0x7f4534108290 2024-09-19T04:47:04.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.224+0000 7f453a31e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f4534112160 con 0x7f4534102d90 2024-09-19T04:47:04.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.225+0000 7f45337fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4534103740 0x7f4534100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:04.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.225+0000 7f45337fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4534103740 0x7f4534100f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52974/0 (socket says 172.21.15.2:52974) 2024-09-19T04:47:04.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.225+0000 7f45337fe640 1 -- 172.21.15.2:0/1796688886 learned_addr learned my addr 172.21.15.2:0/1796688886 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:47:04.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.225+0000 7f45388bb640 1 --2- 172.21.15.2:0/1796688886 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4534108290 0x7f4534101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:04.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.225+0000 7f4533fff640 1 --2- 172.21.15.2:0/1796688886 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4534102d90 0x7f45341009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:04.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.225+0000 7f45337fe640 1 -- 172.21.15.2:0/1796688886 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4534102d90 msgr2=0x7f45341009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:04.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.225+0000 7f45337fe640 1 --2- 172.21.15.2:0/1796688886 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4534102d90 0x7f45341009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:04.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.225+0000 7f45337fe640 1 -- 172.21.15.2:0/1796688886 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4534108290 msgr2=0x7f4534101470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:04.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.225+0000 7f45337fe640 1 --2- 172.21.15.2:0/1796688886 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4534108290 0x7f4534101470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:04.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.225+0000 7f45337fe640 1 -- 172.21.15.2:0/1796688886 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45341a6b00 con 0x7f4534103740 2024-09-19T04:47:04.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.225+0000 7f45388bb640 1 --2- 172.21.15.2:0/1796688886 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4534108290 0x7f4534101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:47:04.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.225+0000 7f4533fff640 1 --2- 172.21.15.2:0/1796688886 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4534102d90 0x7f45341009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:47:04.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.225+0000 7f45337fe640 1 --2- 172.21.15.2:0/1796688886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4534103740 0x7f4534100f30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4528009230 tx=0x7f4528004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:04.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.225+0000 7f45317fa640 1 -- 172.21.15.2:0/1796688886 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f452803f030 con 0x7f4534103740 2024-09-19T04:47:04.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.225+0000 7f453a31e640 1 -- 172.21.15.2:0/1796688886 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45341a6d90 con 0x7f4534103740 2024-09-19T04:47:04.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.225+0000 7f45317fa640 1 -- 172.21.15.2:0/1796688886 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4528003aa0 con 0x7f4534103740 2024-09-19T04:47:04.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.225+0000 7f45317fa640 1 -- 172.21.15.2:0/1796688886 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4528035070 con 0x7f4534103740 2024-09-19T04:47:04.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.225+0000 7f453a31e640 1 -- 172.21.15.2:0/1796688886 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45341a7260 con 0x7f4534103740 2024-09-19T04:47:04.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.226+0000 7f453a31e640 1 -- 172.21.15.2:0/1796688886 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f45340628c0 con 0x7f4534103740 2024-09-19T04:47:04.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.228+0000 7f45317fa640 1 -- 172.21.15.2:0/1796688886 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f4528042030 con 0x7f4534103740 2024-09-19T04:47:04.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.229+0000 7f45317fa640 1 --2- 172.21.15.2:0/1796688886 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f451c0a32d0 0x7f451c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:04.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.229+0000 7f4533fff640 1 --2- 172.21.15.2:0/1796688886 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f451c0a32d0 0x7f451c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:04.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.229+0000 7f45317fa640 1 -- 172.21.15.2:0/1796688886 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f45280f0640 con 0x7f4534103740 2024-09-19T04:47:04.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.229+0000 7f45317fa640 1 --2- 172.21.15.2:0/1796688886 >> [v2:172.21.15.116:6800/627735759,v1:172.21.15.116:6801/627735759] conn(0x7f451c0ace00 0x7f451c0af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:04.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.229+0000 7f45317fa640 1 -- 172.21.15.2:0/1796688886 --> [v2:172.21.15.116:6800/627735759,v1:172.21.15.116:6801/627735759] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f451c0af970 con 0x7f451c0ace00 2024-09-19T04:47:04.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.229+0000 7f45317fa640 1 -- 172.21.15.2:0/1796688886 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f45280f7050 con 0x7f4534103740 2024-09-19T04:47:04.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.230+0000 7f4533fff640 1 --2- 172.21.15.2:0/1796688886 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f451c0a32d0 0x7f451c0a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4524006fd0 tx=0x7f4524008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:04.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.230+0000 7f45388bb640 1 --2- 172.21.15.2:0/1796688886 >> [v2:172.21.15.116:6800/627735759,v1:172.21.15.116:6801/627735759] conn(0x7f451c0ace00 0x7f451c0af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:04.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.230+0000 7f45388bb640 1 --2- 172.21.15.2:0/1796688886 >> [v2:172.21.15.116:6800/627735759,v1:172.21.15.116:6801/627735759] conn(0x7f451c0ace00 0x7f451c0af2a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:04.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.231+0000 7f45317fa640 1 -- 172.21.15.2:0/1796688886 <== osd.2 v2:172.21.15.116:6800/627735759 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f451c0af970 con 0x7f451c0ace00 2024-09-19T04:47:04.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.245+0000 7f453a31e640 1 -- 172.21.15.2:0/1796688886 --> [v2:172.21.15.116:6800/627735759,v1:172.21.15.116:6801/627735759] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4534062cf0 con 0x7f451c0ace00 2024-09-19T04:47:04.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.245+0000 7f45317fa640 1 -- 172.21.15.2:0/1796688886 <== osd.2 v2:172.21.15.116:6800/627735759 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4534062cf0 con 0x7f451c0ace00 2024-09-19T04:47:04.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.246+0000 7f453a31e640 1 -- 172.21.15.2:0/1796688886 >> [v2:172.21.15.116:6800/627735759,v1:172.21.15.116:6801/627735759] conn(0x7f451c0ace00 msgr2=0x7f451c0af2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:04.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.246+0000 7f453a31e640 1 --2- 172.21.15.2:0/1796688886 >> [v2:172.21.15.116:6800/627735759,v1:172.21.15.116:6801/627735759] conn(0x7f451c0ace00 0x7f451c0af2a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:04.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.246+0000 7f453a31e640 1 -- 172.21.15.2:0/1796688886 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f451c0a32d0 msgr2=0x7f451c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:04.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.246+0000 7f453a31e640 1 --2- 172.21.15.2:0/1796688886 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f451c0a32d0 0x7f451c0a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4524006fd0 tx=0x7f4524008040 comp rx=0 tx=0).stop 2024-09-19T04:47:04.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.246+0000 7f453a31e640 1 -- 172.21.15.2:0/1796688886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4534103740 msgr2=0x7f4534100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:04.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.246+0000 7f453a31e640 1 --2- 172.21.15.2:0/1796688886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4534103740 0x7f4534100f30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4528009230 tx=0x7f4528004270 comp rx=0 tx=0).stop 2024-09-19T04:47:04.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.246+0000 7f45388bb640 1 -- 172.21.15.2:0/1796688886 reap_dead start 2024-09-19T04:47:04.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.246+0000 7f453a31e640 1 -- 172.21.15.2:0/1796688886 shutdown_connections 2024-09-19T04:47:04.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.246+0000 7f453a31e640 1 -- 172.21.15.2:0/1796688886 >> 172.21.15.2:0/1796688886 conn(0x7f45340fc7d0 msgr2=0x7f4534105eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:04.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.246+0000 7f453a31e640 1 -- 172.21.15.2:0/1796688886 shutdown_connections 2024-09-19T04:47:04.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:04.246+0000 7f453a31e640 1 -- 172.21.15.2:0/1796688886 wait complete. 2024-09-19T04:47:05.009 INFO:teuthology.orchestra.run.smithi002.stdout:128849018935 2024-09-19T04:47:05.010 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-19T04:47:05.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.166+0000 7fd4145ae640 1 -- 172.21.15.2:0/1262332327 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd40c103760 msgr2=0x7fd40c107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:05.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.166+0000 7fd4145ae640 1 --2- 172.21.15.2:0/1262332327 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd40c103760 0x7fd40c107ba0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc009930 tx=0x7fd3fc02a420 comp rx=0 tx=0).stop 2024-09-19T04:47:05.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.166+0000 7fd4145ae640 1 -- 172.21.15.2:0/1262332327 shutdown_connections 2024-09-19T04:47:05.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.166+0000 7fd4145ae640 1 --2- 172.21.15.2:0/1262332327 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd40c1082e0 0x7fd40c10ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:05.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.166+0000 7fd4145ae640 1 --2- 172.21.15.2:0/1262332327 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd40c103760 0x7fd40c107ba0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:05.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.166+0000 7fd4145ae640 1 --2- 172.21.15.2:0/1262332327 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd40c102db0 0x7fd40c103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:05.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.166+0000 7fd4145ae640 1 -- 172.21.15.2:0/1262332327 >> 172.21.15.2:0/1262332327 conn(0x7fd40c0fc7d0 msgr2=0x7fd40c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:05.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.166+0000 7fd4145ae640 1 -- 172.21.15.2:0/1262332327 shutdown_connections 2024-09-19T04:47:05.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.166+0000 7fd4145ae640 1 -- 172.21.15.2:0/1262332327 wait complete. 2024-09-19T04:47:05.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.166+0000 7fd4145ae640 1 Processor -- start 2024-09-19T04:47:05.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.167+0000 7fd4145ae640 1 -- start start 2024-09-19T04:47:05.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.167+0000 7fd4145ae640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd40c102db0 0x7fd40c198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:05.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.167+0000 7fd4145ae640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd40c103760 0x7fd40c198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:05.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.167+0000 7fd4145ae640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd40c1082e0 0x7fd40c19cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:05.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.167+0000 7fd4145ae640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd40c111f20 con 0x7fd40c1082e0 2024-09-19T04:47:05.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.167+0000 7fd4145ae640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd40c111da0 con 0x7fd40c102db0 2024-09-19T04:47:05.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.167+0000 7fd4145ae640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fd40c1120a0 con 0x7fd40c103760 2024-09-19T04:47:05.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.167+0000 7fd411b49640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd40c103760 0x7fd40c198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:05.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.167+0000 7fd412b4b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd40c1082e0 0x7fd40c19cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:05.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.167+0000 7fd411b49640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd40c103760 0x7fd40c198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.2:57334/0 (socket says 172.21.15.2:57334) 2024-09-19T04:47:05.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.167+0000 7fd412b4b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd40c1082e0 0x7fd40c19cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52994/0 (socket says 172.21.15.2:52994) 2024-09-19T04:47:05.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.167+0000 7fd411b49640 1 -- 172.21.15.2:0/2370795791 learned_addr learned my addr 172.21.15.2:0/2370795791 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:47:05.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.167+0000 7fd41234a640 1 --2- 172.21.15.2:0/2370795791 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd40c102db0 0x7fd40c198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:05.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.167+0000 7fd412b4b640 1 -- 172.21.15.2:0/2370795791 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd40c103760 msgr2=0x7fd40c198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:05.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.167+0000 7fd412b4b640 1 --2- 172.21.15.2:0/2370795791 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd40c103760 0x7fd40c198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:05.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.167+0000 7fd412b4b640 1 -- 172.21.15.2:0/2370795791 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd40c102db0 msgr2=0x7fd40c198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:05.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.167+0000 7fd412b4b640 1 --2- 172.21.15.2:0/2370795791 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd40c102db0 0x7fd40c198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:05.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.168+0000 7fd412b4b640 1 -- 172.21.15.2:0/2370795791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd40c19d4d0 con 0x7fd40c1082e0 2024-09-19T04:47:05.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.168+0000 7fd411b49640 1 --2- 172.21.15.2:0/2370795791 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd40c103760 0x7fd40c198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:47:05.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.168+0000 7fd412b4b640 1 --2- 172.21.15.2:0/2370795791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd40c1082e0 0x7fd40c19cdf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd404009d10 tx=0x7fd404007590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:05.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.168+0000 7fd4037fe640 1 -- 172.21.15.2:0/2370795791 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd404009e60 con 0x7fd40c1082e0 2024-09-19T04:47:05.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.168+0000 7fd4145ae640 1 -- 172.21.15.2:0/2370795791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd40c19d760 con 0x7fd40c1082e0 2024-09-19T04:47:05.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.168+0000 7fd4037fe640 1 -- 172.21.15.2:0/2370795791 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd4040100d0 con 0x7fd40c1082e0 2024-09-19T04:47:05.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.168+0000 7fd4037fe640 1 -- 172.21.15.2:0/2370795791 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd40400ec60 con 0x7fd40c1082e0 2024-09-19T04:47:05.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.168+0000 7fd4145ae640 1 -- 172.21.15.2:0/2370795791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd40c100940 con 0x7fd40c1082e0 2024-09-19T04:47:05.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.169+0000 7fd4145ae640 1 -- 172.21.15.2:0/2370795791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd40c062980 con 0x7fd40c1082e0 2024-09-19T04:47:05.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.170+0000 7fd4037fe640 1 -- 172.21.15.2:0/2370795791 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fd404010280 con 0x7fd40c1082e0 2024-09-19T04:47:05.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.171+0000 7fd4037fe640 1 --2- 172.21.15.2:0/2370795791 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd3f80a32d0 0x7fd3f80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:05.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.171+0000 7fd4037fe640 1 -- 172.21.15.2:0/2370795791 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fd4040d3760 con 0x7fd40c1082e0 2024-09-19T04:47:05.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.171+0000 7fd41234a640 1 --2- 172.21.15.2:0/2370795791 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd3f80a32d0 0x7fd3f80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:05.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.171+0000 7fd4037fe640 1 --2- 172.21.15.2:0/2370795791 >> [v2:172.21.15.2:6826/1054791011,v1:172.21.15.2:6827/1054791011] conn(0x7fd3f80ace00 0x7fd3f80af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:05.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.171+0000 7fd4037fe640 1 -- 172.21.15.2:0/2370795791 --> [v2:172.21.15.2:6826/1054791011,v1:172.21.15.2:6827/1054791011] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd3f80af970 con 0x7fd3f80ace00 2024-09-19T04:47:05.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.171+0000 7fd4037fe640 1 -- 172.21.15.2:0/2370795791 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fd4040d3bb0 con 0x7fd40c1082e0 2024-09-19T04:47:05.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.172+0000 7fd411b49640 1 --2- 172.21.15.2:0/2370795791 >> [v2:172.21.15.2:6826/1054791011,v1:172.21.15.2:6827/1054791011] conn(0x7fd3f80ace00 0x7fd3f80af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:05.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.172+0000 7fd41234a640 1 --2- 172.21.15.2:0/2370795791 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd3f80a32d0 0x7fd3f80a5790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd40800bbe0 tx=0x7fd40800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:05.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.172+0000 7fd411b49640 1 --2- 172.21.15.2:0/2370795791 >> [v2:172.21.15.2:6826/1054791011,v1:172.21.15.2:6827/1054791011] conn(0x7fd3f80ace00 0x7fd3f80af2a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:05.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.173+0000 7fd4037fe640 1 -- 172.21.15.2:0/2370795791 <== osd.9 v2:172.21.15.2:6826/1054791011 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd3f80af970 con 0x7fd3f80ace00 2024-09-19T04:47:05.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.186+0000 7fd4145ae640 1 -- 172.21.15.2:0/2370795791 --> [v2:172.21.15.2:6826/1054791011,v1:172.21.15.2:6827/1054791011] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd40c062e00 con 0x7fd3f80ace00 2024-09-19T04:47:05.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.187+0000 7fd4037fe640 1 -- 172.21.15.2:0/2370795791 <== osd.9 v2:172.21.15.2:6826/1054791011 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd40c062e00 con 0x7fd3f80ace00 2024-09-19T04:47:05.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.187+0000 7fd4145ae640 1 -- 172.21.15.2:0/2370795791 >> [v2:172.21.15.2:6826/1054791011,v1:172.21.15.2:6827/1054791011] conn(0x7fd3f80ace00 msgr2=0x7fd3f80af2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:05.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.187+0000 7fd4145ae640 1 --2- 172.21.15.2:0/2370795791 >> [v2:172.21.15.2:6826/1054791011,v1:172.21.15.2:6827/1054791011] conn(0x7fd3f80ace00 0x7fd3f80af2a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:05.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.187+0000 7fd4145ae640 1 -- 172.21.15.2:0/2370795791 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd3f80a32d0 msgr2=0x7fd3f80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:05.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.187+0000 7fd4145ae640 1 --2- 172.21.15.2:0/2370795791 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd3f80a32d0 0x7fd3f80a5790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd40800bbe0 tx=0x7fd40800b390 comp rx=0 tx=0).stop 2024-09-19T04:47:05.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.187+0000 7fd4145ae640 1 -- 172.21.15.2:0/2370795791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd40c1082e0 msgr2=0x7fd40c19cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:05.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.187+0000 7fd4145ae640 1 --2- 172.21.15.2:0/2370795791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd40c1082e0 0x7fd40c19cdf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd404009d10 tx=0x7fd404007590 comp rx=0 tx=0).stop 2024-09-19T04:47:05.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.187+0000 7fd412b4b640 1 -- 172.21.15.2:0/2370795791 reap_dead start 2024-09-19T04:47:05.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.187+0000 7fd4145ae640 1 -- 172.21.15.2:0/2370795791 shutdown_connections 2024-09-19T04:47:05.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.187+0000 7fd4145ae640 1 -- 172.21.15.2:0/2370795791 >> 172.21.15.2:0/2370795791 conn(0x7fd40c0fc7d0 msgr2=0x7fd40c105e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:05.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.187+0000 7fd4145ae640 1 -- 172.21.15.2:0/2370795791 shutdown_connections 2024-09-19T04:47:05.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.187+0000 7fd4145ae640 1 -- 172.21.15.2:0/2370795791 wait complete. 2024-09-19T04:47:05.530 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:05 smithi002 ceph-mon[30975]: pgmap v294: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-19T04:47:05.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.611+0000 7fe0a73dd640 1 -- 172.21.15.2:0/2376415539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0a0102ef0 msgr2=0x7fe0a010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:05.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.611+0000 7fe0a73dd640 1 --2- 172.21.15.2:0/2376415539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0a0102ef0 0x7fe0a010da40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe098009900 tx=0x7fe09802a480 comp rx=0 tx=0).stop 2024-09-19T04:47:05.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.611+0000 7fe0a73dd640 1 -- 172.21.15.2:0/2376415539 shutdown_connections 2024-09-19T04:47:05.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.611+0000 7fe0a73dd640 1 --2- 172.21.15.2:0/2376415539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0a0102ef0 0x7fe0a010da40 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:05.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.611+0000 7fe0a73dd640 1 --2- 172.21.15.2:0/2376415539 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0a0102570 0x7fe0a01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:05.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.611+0000 7fe0a73dd640 1 --2- 172.21.15.2:0/2376415539 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe0a0100e20 0x7fe0a0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:05.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.611+0000 7fe0a73dd640 1 -- 172.21.15.2:0/2376415539 >> 172.21.15.2:0/2376415539 conn(0x7fe0a00fc7d0 msgr2=0x7fe0a00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:05.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.611+0000 7fe0a73dd640 1 -- 172.21.15.2:0/2376415539 shutdown_connections 2024-09-19T04:47:05.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.611+0000 7fe0a73dd640 1 -- 172.21.15.2:0/2376415539 wait complete. 2024-09-19T04:47:05.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.612+0000 7fe0a73dd640 1 Processor -- start 2024-09-19T04:47:05.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.612+0000 7fe0a73dd640 1 -- start start 2024-09-19T04:47:05.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.612+0000 7fe0a73dd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0a0100e20 0x7fe0a0198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:05.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.612+0000 7fe0a73dd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0a0102570 0x7fe0a0198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:05.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.612+0000 7fe0a73dd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe0a0102ef0 0x7fe0a019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:05.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.612+0000 7fe0a73dd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a0110e50 con 0x7fe0a0102570 2024-09-19T04:47:05.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.612+0000 7fe0a73dd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a0110cd0 con 0x7fe0a0100e20 2024-09-19T04:47:05.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.612+0000 7fe0a73dd640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a0110fd0 con 0x7fe0a0102ef0 2024-09-19T04:47:05.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.612+0000 7fe0a4978640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0a0102570 0x7fe0a0198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:05.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.612+0000 7fe0a4978640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0a0102570 0x7fe0a0198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53010/0 (socket says 172.21.15.2:53010) 2024-09-19T04:47:05.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.612+0000 7fe0a4978640 1 -- 172.21.15.2:0/1559376566 learned_addr learned my addr 172.21.15.2:0/1559376566 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:47:05.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.612+0000 7fe0a597a640 1 --2- 172.21.15.2:0/1559376566 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe0a0102ef0 0x7fe0a019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:05.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.612+0000 7fe0a5179640 1 --2- 172.21.15.2:0/1559376566 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0a0100e20 0x7fe0a0198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:05.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.612+0000 7fe0a4978640 1 -- 172.21.15.2:0/1559376566 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe0a0102ef0 msgr2=0x7fe0a019cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:05.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.613+0000 7fe0a4978640 1 --2- 172.21.15.2:0/1559376566 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe0a0102ef0 0x7fe0a019cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:05.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.613+0000 7fe0a4978640 1 -- 172.21.15.2:0/1559376566 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0a0100e20 msgr2=0x7fe0a0198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:05.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.613+0000 7fe0a4978640 1 --2- 172.21.15.2:0/1559376566 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0a0100e20 0x7fe0a0198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:05.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.613+0000 7fe0a4978640 1 -- 172.21.15.2:0/1559376566 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0a019d3e0 con 0x7fe0a0102570 2024-09-19T04:47:05.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.613+0000 7fe0a5179640 1 --2- 172.21.15.2:0/1559376566 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0a0100e20 0x7fe0a0198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:47:05.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.613+0000 7fe0a4978640 1 --2- 172.21.15.2:0/1559376566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0a0102570 0x7fe0a0198970 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe09400ba50 tx=0x7fe09400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:05.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.613+0000 7fe09e7fc640 1 -- 172.21.15.2:0/1559376566 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe094019070 con 0x7fe0a0102570 2024-09-19T04:47:05.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.613+0000 7fe0a73dd640 1 -- 172.21.15.2:0/1559376566 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0a019d6d0 con 0x7fe0a0102570 2024-09-19T04:47:05.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.613+0000 7fe09e7fc640 1 -- 172.21.15.2:0/1559376566 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe09400cbe0 con 0x7fe0a0102570 2024-09-19T04:47:05.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.613+0000 7fe09e7fc640 1 -- 172.21.15.2:0/1559376566 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0940075d0 con 0x7fe0a0102570 2024-09-19T04:47:05.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.613+0000 7fe0a73dd640 1 -- 172.21.15.2:0/1559376566 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0a01a4fb0 con 0x7fe0a0102570 2024-09-19T04:47:05.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.614+0000 7fe0a73dd640 1 -- 172.21.15.2:0/1559376566 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe0a0062900 con 0x7fe0a0102570 2024-09-19T04:47:05.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.615+0000 7fe09e7fc640 1 -- 172.21.15.2:0/1559376566 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fe09401c070 con 0x7fe0a0102570 2024-09-19T04:47:05.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.616+0000 7fe09e7fc640 1 --2- 172.21.15.2:0/1559376566 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe0880a32d0 0x7fe0880a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:05.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.616+0000 7fe0a5179640 1 --2- 172.21.15.2:0/1559376566 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe0880a32d0 0x7fe0880a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:05.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.616+0000 7fe09e7fc640 1 -- 172.21.15.2:0/1559376566 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fe0940cf8a0 con 0x7fe0a0102570 2024-09-19T04:47:05.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.616+0000 7fe09e7fc640 1 --2- 172.21.15.2:0/1559376566 >> [v2:172.21.15.18:6816/3691801363,v1:172.21.15.18:6817/3691801363] conn(0x7fe0880ace00 0x7fe0880af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:05.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.616+0000 7fe09e7fc640 1 -- 172.21.15.2:0/1559376566 --> [v2:172.21.15.18:6816/3691801363,v1:172.21.15.18:6817/3691801363] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe094016ec0 con 0x7fe0880ace00 2024-09-19T04:47:05.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.616+0000 7fe09e7fc640 1 -- 172.21.15.2:0/1559376566 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fe0940cfc50 con 0x7fe0a0102570 2024-09-19T04:47:05.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.616+0000 7fe0a5179640 1 --2- 172.21.15.2:0/1559376566 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe0880a32d0 0x7fe0880a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe09000baa0 tx=0x7fe090005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:05.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.616+0000 7fe0a597a640 1 --2- 172.21.15.2:0/1559376566 >> [v2:172.21.15.18:6816/3691801363,v1:172.21.15.18:6817/3691801363] conn(0x7fe0880ace00 0x7fe0880af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:05.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.617+0000 7fe0a597a640 1 --2- 172.21.15.2:0/1559376566 >> [v2:172.21.15.18:6816/3691801363,v1:172.21.15.18:6817/3691801363] conn(0x7fe0880ace00 0x7fe0880af2a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:05.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.618+0000 7fe09e7fc640 1 -- 172.21.15.2:0/1559376566 <== osd.7 v2:172.21.15.18:6816/3691801363 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe094016ec0 con 0x7fe0880ace00 2024-09-19T04:47:05.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.631+0000 7fe0a73dd640 1 -- 172.21.15.2:0/1559376566 --> [v2:172.21.15.18:6816/3691801363,v1:172.21.15.18:6817/3691801363] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe0a0062d00 con 0x7fe0880ace00 2024-09-19T04:47:05.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.632+0000 7fe09e7fc640 1 -- 172.21.15.2:0/1559376566 <== osd.7 v2:172.21.15.18:6816/3691801363 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe0a0062d00 con 0x7fe0880ace00 2024-09-19T04:47:05.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.633+0000 7fe0a73dd640 1 -- 172.21.15.2:0/1559376566 >> [v2:172.21.15.18:6816/3691801363,v1:172.21.15.18:6817/3691801363] conn(0x7fe0880ace00 msgr2=0x7fe0880af2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:05.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.633+0000 7fe0a73dd640 1 --2- 172.21.15.2:0/1559376566 >> [v2:172.21.15.18:6816/3691801363,v1:172.21.15.18:6817/3691801363] conn(0x7fe0880ace00 0x7fe0880af2a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:05.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.633+0000 7fe0a73dd640 1 -- 172.21.15.2:0/1559376566 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe0880a32d0 msgr2=0x7fe0880a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:05.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.633+0000 7fe0a73dd640 1 --2- 172.21.15.2:0/1559376566 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe0880a32d0 0x7fe0880a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe09000baa0 tx=0x7fe090005d90 comp rx=0 tx=0).stop 2024-09-19T04:47:05.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.633+0000 7fe0a73dd640 1 -- 172.21.15.2:0/1559376566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0a0102570 msgr2=0x7fe0a0198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:05.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.633+0000 7fe0a73dd640 1 --2- 172.21.15.2:0/1559376566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0a0102570 0x7fe0a0198970 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe09400ba50 tx=0x7fe09400bf10 comp rx=0 tx=0).stop 2024-09-19T04:47:05.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.633+0000 7fe0a597a640 1 -- 172.21.15.2:0/1559376566 reap_dead start 2024-09-19T04:47:05.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.633+0000 7fe0a73dd640 1 -- 172.21.15.2:0/1559376566 shutdown_connections 2024-09-19T04:47:05.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.633+0000 7fe0a73dd640 1 -- 172.21.15.2:0/1559376566 >> 172.21.15.2:0/1559376566 conn(0x7fe0a00fc7d0 msgr2=0x7fe0a006a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:05.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.633+0000 7fe0a73dd640 1 -- 172.21.15.2:0/1559376566 shutdown_connections 2024-09-19T04:47:05.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.633+0000 7fe0a73dd640 1 -- 172.21.15.2:0/1559376566 wait complete. 2024-09-19T04:47:05.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:05 smithi018 ceph-mon[34537]: pgmap v294: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-19T04:47:05.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:05 smithi116 ceph-mon[34477]: pgmap v294: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-19T04:47:06.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.038+0000 7f1e9d25b640 1 -- 172.21.15.2:0/162349735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e98102790 msgr2=0x7f1e981067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:06.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.038+0000 7f1e9d25b640 1 --2- 172.21.15.2:0/162349735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e98102790 0x7f1e981067e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c009900 tx=0x7f1e8c02a410 comp rx=0 tx=0).stop 2024-09-19T04:47:06.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.038+0000 7f1e9d25b640 1 -- 172.21.15.2:0/162349735 shutdown_connections 2024-09-19T04:47:06.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.038+0000 7f1e9d25b640 1 --2- 172.21.15.2:0/162349735 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e98106f10 0x7f1e9810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:06.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.038+0000 7f1e9d25b640 1 --2- 172.21.15.2:0/162349735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e98102790 0x7f1e981067e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:06.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.038+0000 7f1e9d25b640 1 --2- 172.21.15.2:0/162349735 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1e98101de0 0x7f1e981021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:06.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.038+0000 7f1e9d25b640 1 -- 172.21.15.2:0/162349735 >> 172.21.15.2:0/162349735 conn(0x7f1e980fd8c0 msgr2=0x7f1e980ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:06.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.038+0000 7f1e9d25b640 1 -- 172.21.15.2:0/162349735 shutdown_connections 2024-09-19T04:47:06.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.038+0000 7f1e9d25b640 1 -- 172.21.15.2:0/162349735 wait complete. 2024-09-19T04:47:06.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.039+0000 7f1e9d25b640 1 Processor -- start 2024-09-19T04:47:06.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.039+0000 7f1e9d25b640 1 -- start start 2024-09-19T04:47:06.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.039+0000 7f1e9d25b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e98101de0 0x7f1e98198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:06.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.039+0000 7f1e9d25b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e98102790 0x7f1e98198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:06.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.039+0000 7f1e9d25b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1e98106f10 0x7f1e9819cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:06.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.039+0000 7f1e9d25b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1e98111e90 con 0x7f1e98102790 2024-09-19T04:47:06.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.039+0000 7f1e9d25b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1e98111d10 con 0x7f1e98101de0 2024-09-19T04:47:06.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.039+0000 7f1e9d25b640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f1e98112010 con 0x7f1e98106f10 2024-09-19T04:47:06.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.039+0000 7f1e9659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e98102790 0x7f1e98198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:06.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.039+0000 7f1e9659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e98102790 0x7f1e98198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53046/0 (socket says 172.21.15.2:53046) 2024-09-19T04:47:06.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.039+0000 7f1e9659c640 1 -- 172.21.15.2:0/525014131 learned_addr learned my addr 172.21.15.2:0/525014131 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:47:06.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.039+0000 7f1e9759e640 1 --2- 172.21.15.2:0/525014131 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1e98106f10 0x7f1e9819cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:06.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.040+0000 7f1e9659c640 1 -- 172.21.15.2:0/525014131 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1e98106f10 msgr2=0x7f1e9819cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:06.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.040+0000 7f1e9659c640 1 --2- 172.21.15.2:0/525014131 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1e98106f10 0x7f1e9819cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:06.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.040+0000 7f1e9659c640 1 -- 172.21.15.2:0/525014131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e98101de0 msgr2=0x7f1e98198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:06.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.040+0000 7f1e96d9d640 1 --2- 172.21.15.2:0/525014131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e98101de0 0x7f1e98198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:06.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.040+0000 7f1e9659c640 1 --2- 172.21.15.2:0/525014131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e98101de0 0x7f1e98198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:06.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.040+0000 7f1e9659c640 1 -- 172.21.15.2:0/525014131 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e9819d3e0 con 0x7f1e98102790 2024-09-19T04:47:06.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.040+0000 7f1e9759e640 1 --2- 172.21.15.2:0/525014131 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1e98106f10 0x7f1e9819cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:47:06.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.040+0000 7f1e9659c640 1 --2- 172.21.15.2:0/525014131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e98102790 0x7f1e98198970 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c005ab0 tx=0x7f1e8c003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:06.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.040+0000 7f1e7ffff640 1 -- 172.21.15.2:0/525014131 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c03f070 con 0x7f1e98102790 2024-09-19T04:47:06.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.040+0000 7f1e7ffff640 1 -- 172.21.15.2:0/525014131 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1e8c031d60 con 0x7f1e98102790 2024-09-19T04:47:06.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.040+0000 7f1e9d25b640 1 -- 172.21.15.2:0/525014131 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e9819d670 con 0x7f1e98102790 2024-09-19T04:47:06.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.040+0000 7f1e7ffff640 1 -- 172.21.15.2:0/525014131 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c035030 con 0x7f1e98102790 2024-09-19T04:47:06.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.040+0000 7f1e9d25b640 1 -- 172.21.15.2:0/525014131 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e981a4fb0 con 0x7f1e98102790 2024-09-19T04:47:06.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.041+0000 7f1e9d25b640 1 -- 172.21.15.2:0/525014131 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1e98062980 con 0x7f1e98102790 2024-09-19T04:47:06.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.042+0000 7f1e7ffff640 1 -- 172.21.15.2:0/525014131 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f1e8c042070 con 0x7f1e98102790 2024-09-19T04:47:06.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.043+0000 7f1e7ffff640 1 --2- 172.21.15.2:0/525014131 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f1e800a32d0 0x7f1e800a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:06.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.043+0000 7f1e96d9d640 1 --2- 172.21.15.2:0/525014131 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f1e800a32d0 0x7f1e800a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:06.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.043+0000 7f1e7ffff640 1 -- 172.21.15.2:0/525014131 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f1e8c0f0ad0 con 0x7f1e98102790 2024-09-19T04:47:06.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.043+0000 7f1e7ffff640 1 --2- 172.21.15.2:0/525014131 >> [v2:172.21.15.2:6818/1185564560,v1:172.21.15.2:6819/1185564560] conn(0x7f1e800ace00 0x7f1e800af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:06.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.043+0000 7f1e7ffff640 1 -- 172.21.15.2:0/525014131 --> [v2:172.21.15.2:6818/1185564560,v1:172.21.15.2:6819/1185564560] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1e8c038e90 con 0x7f1e800ace00 2024-09-19T04:47:06.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.043+0000 7f1e7ffff640 1 -- 172.21.15.2:0/525014131 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f1e8c0f0f20 con 0x7f1e98102790 2024-09-19T04:47:06.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.043+0000 7f1e9759e640 1 --2- 172.21.15.2:0/525014131 >> [v2:172.21.15.2:6818/1185564560,v1:172.21.15.2:6819/1185564560] conn(0x7f1e800ace00 0x7f1e800af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:06.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.044+0000 7f1e96d9d640 1 --2- 172.21.15.2:0/525014131 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f1e800a32d0 0x7f1e800a5790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1e8800a810 tx=0x7f1e88008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:06.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.044+0000 7f1e9759e640 1 --2- 172.21.15.2:0/525014131 >> [v2:172.21.15.2:6818/1185564560,v1:172.21.15.2:6819/1185564560] conn(0x7f1e800ace00 0x7f1e800af2a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:06.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.044+0000 7f1e7ffff640 1 -- 172.21.15.2:0/525014131 <== osd.6 v2:172.21.15.2:6818/1185564560 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1e8c038e90 con 0x7f1e800ace00 2024-09-19T04:47:06.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.058+0000 7f1e9d25b640 1 -- 172.21.15.2:0/525014131 --> [v2:172.21.15.2:6818/1185564560,v1:172.21.15.2:6819/1185564560] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1e98062e00 con 0x7f1e800ace00 2024-09-19T04:47:06.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.058+0000 7f1e7ffff640 1 -- 172.21.15.2:0/525014131 <== osd.6 v2:172.21.15.2:6818/1185564560 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1e98062e00 con 0x7f1e800ace00 2024-09-19T04:47:06.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.059+0000 7f1e9d25b640 1 -- 172.21.15.2:0/525014131 >> [v2:172.21.15.2:6818/1185564560,v1:172.21.15.2:6819/1185564560] conn(0x7f1e800ace00 msgr2=0x7f1e800af2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:06.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.059+0000 7f1e9d25b640 1 --2- 172.21.15.2:0/525014131 >> [v2:172.21.15.2:6818/1185564560,v1:172.21.15.2:6819/1185564560] conn(0x7f1e800ace00 0x7f1e800af2a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:06.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.059+0000 7f1e9d25b640 1 -- 172.21.15.2:0/525014131 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f1e800a32d0 msgr2=0x7f1e800a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:06.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.059+0000 7f1e9d25b640 1 --2- 172.21.15.2:0/525014131 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f1e800a32d0 0x7f1e800a5790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1e8800a810 tx=0x7f1e88008040 comp rx=0 tx=0).stop 2024-09-19T04:47:06.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.059+0000 7f1e9d25b640 1 -- 172.21.15.2:0/525014131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e98102790 msgr2=0x7f1e98198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:06.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.059+0000 7f1e9d25b640 1 --2- 172.21.15.2:0/525014131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e98102790 0x7f1e98198970 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c005ab0 tx=0x7f1e8c003d50 comp rx=0 tx=0).stop 2024-09-19T04:47:06.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.059+0000 7f1e9759e640 1 -- 172.21.15.2:0/525014131 reap_dead start 2024-09-19T04:47:06.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.059+0000 7f1e9d25b640 1 -- 172.21.15.2:0/525014131 shutdown_connections 2024-09-19T04:47:06.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.059+0000 7f1e9d25b640 1 -- 172.21.15.2:0/525014131 >> 172.21.15.2:0/525014131 conn(0x7f1e980fd8c0 msgr2=0x7f1e980fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:06.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.059+0000 7f1e9d25b640 1 -- 172.21.15.2:0/525014131 shutdown_connections 2024-09-19T04:47:06.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:06.059+0000 7f1e9d25b640 1 -- 172.21.15.2:0/525014131 wait complete. 2024-09-19T04:47:06.815 INFO:teuthology.orchestra.run.smithi002.stdout:68719476802 2024-09-19T04:47:06.816 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-19T04:47:07.400 INFO:teuthology.orchestra.run.smithi002.stdout:261993005088 2024-09-19T04:47:07.400 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-19T04:47:07.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.820+0000 7fc7b401f640 1 -- 172.21.15.2:0/3166398492 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7ac102790 msgr2=0x7fc7ac1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:07.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.820+0000 7fc7b401f640 1 --2- 172.21.15.2:0/3166398492 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7ac102790 0x7fc7ac1067e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc79c009900 tx=0x7fc79c02a410 comp rx=0 tx=0).stop 2024-09-19T04:47:07.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.820+0000 7fc7b401f640 1 -- 172.21.15.2:0/3166398492 shutdown_connections 2024-09-19T04:47:07.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.820+0000 7fc7b401f640 1 --2- 172.21.15.2:0/3166398492 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7ac106f10 0x7fc7ac10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:07.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.820+0000 7fc7b401f640 1 --2- 172.21.15.2:0/3166398492 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7ac102790 0x7fc7ac1067e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:07.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.820+0000 7fc7b401f640 1 --2- 172.21.15.2:0/3166398492 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7ac101de0 0x7fc7ac1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:07.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.820+0000 7fc7b401f640 1 -- 172.21.15.2:0/3166398492 >> 172.21.15.2:0/3166398492 conn(0x7fc7ac0fd8c0 msgr2=0x7fc7ac0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:07.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.820+0000 7fc7b401f640 1 -- 172.21.15.2:0/3166398492 shutdown_connections 2024-09-19T04:47:07.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.820+0000 7fc7b401f640 1 -- 172.21.15.2:0/3166398492 wait complete. 2024-09-19T04:47:07.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.821+0000 7fc7b401f640 1 Processor -- start 2024-09-19T04:47:07.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.821+0000 7fc7b401f640 1 -- start start 2024-09-19T04:47:07.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.821+0000 7fc7b401f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7ac101de0 0x7fc7ac1983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:07.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.821+0000 7fc7b401f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7ac102790 0x7fc7ac198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:07.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.821+0000 7fc7b401f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7ac106f10 0x7fc7ac19cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:07.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.821+0000 7fc7b401f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc7ac111de0 con 0x7fc7ac101de0 2024-09-19T04:47:07.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.821+0000 7fc7b401f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc7ac111c60 con 0x7fc7ac102790 2024-09-19T04:47:07.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.821+0000 7fc7b401f640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fc7ac111f60 con 0x7fc7ac106f10 2024-09-19T04:47:07.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.821+0000 7fc7b1dbb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7ac101de0 0x7fc7ac1983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:07.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.821+0000 7fc7b1dbb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7ac101de0 0x7fc7ac1983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53020/0 (socket says 172.21.15.2:53020) 2024-09-19T04:47:07.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.821+0000 7fc7b1dbb640 1 -- 172.21.15.2:0/1408410371 learned_addr learned my addr 172.21.15.2:0/1408410371 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:47:07.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.821+0000 7fc7b25bc640 1 --2- 172.21.15.2:0/1408410371 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7ac106f10 0x7fc7ac19cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:07.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.821+0000 7fc7b15ba640 1 --2- 172.21.15.2:0/1408410371 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7ac102790 0x7fc7ac198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:07.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.822+0000 7fc7b1dbb640 1 -- 172.21.15.2:0/1408410371 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7ac106f10 msgr2=0x7fc7ac19cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:07.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.822+0000 7fc7b1dbb640 1 --2- 172.21.15.2:0/1408410371 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7ac106f10 0x7fc7ac19cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:07.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.822+0000 7fc7b1dbb640 1 -- 172.21.15.2:0/1408410371 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7ac102790 msgr2=0x7fc7ac198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:07.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.822+0000 7fc7b1dbb640 1 --2- 172.21.15.2:0/1408410371 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7ac102790 0x7fc7ac198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:07.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.822+0000 7fc7b1dbb640 1 -- 172.21.15.2:0/1408410371 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7ac19d370 con 0x7fc7ac101de0 2024-09-19T04:47:07.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.822+0000 7fc7b25bc640 1 --2- 172.21.15.2:0/1408410371 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7ac106f10 0x7fc7ac19cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:47:07.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.822+0000 7fc7b15ba640 1 --2- 172.21.15.2:0/1408410371 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7ac102790 0x7fc7ac198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:47:07.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.822+0000 7fc7b1dbb640 1 --2- 172.21.15.2:0/1408410371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7ac101de0 0x7fc7ac1983c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc7a800d950 tx=0x7fc7a800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:07.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.822+0000 7fc7a2ffd640 1 -- 172.21.15.2:0/1408410371 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a8017070 con 0x7fc7ac101de0 2024-09-19T04:47:07.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.822+0000 7fc7b401f640 1 -- 172.21.15.2:0/1408410371 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7ac19d660 con 0x7fc7ac101de0 2024-09-19T04:47:07.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.822+0000 7fc7a2ffd640 1 -- 172.21.15.2:0/1408410371 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc7a8009c30 con 0x7fc7ac101de0 2024-09-19T04:47:07.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.822+0000 7fc7a2ffd640 1 -- 172.21.15.2:0/1408410371 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a800f620 con 0x7fc7ac101de0 2024-09-19T04:47:07.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.822+0000 7fc7b401f640 1 -- 172.21.15.2:0/1408410371 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7ac1a4f40 con 0x7fc7ac101de0 2024-09-19T04:47:07.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.823+0000 7fc7b401f640 1 -- 172.21.15.2:0/1408410371 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc7ac062980 con 0x7fc7ac101de0 2024-09-19T04:47:07.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.825+0000 7fc7a2ffd640 1 -- 172.21.15.2:0/1408410371 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fc7a80109a0 con 0x7fc7ac101de0 2024-09-19T04:47:07.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.825+0000 7fc7a2ffd640 1 --2- 172.21.15.2:0/1408410371 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fc7980a32d0 0x7fc7980a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:07.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.825+0000 7fc7b15ba640 1 --2- 172.21.15.2:0/1408410371 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fc7980a32d0 0x7fc7980a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:07.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.825+0000 7fc7a2ffd640 1 -- 172.21.15.2:0/1408410371 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fc7a80cfaf0 con 0x7fc7ac101de0 2024-09-19T04:47:07.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.826+0000 7fc7a2ffd640 1 --2- 172.21.15.2:0/1408410371 >> [v2:172.21.15.2:6802/611702745,v1:172.21.15.2:6803/611702745] conn(0x7fc7980ace00 0x7fc7980af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:07.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.826+0000 7fc7a2ffd640 1 -- 172.21.15.2:0/1408410371 --> [v2:172.21.15.2:6802/611702745,v1:172.21.15.2:6803/611702745] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc7980af970 con 0x7fc7980ace00 2024-09-19T04:47:07.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.826+0000 7fc7a2ffd640 1 -- 172.21.15.2:0/1408410371 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fc7a80cff40 con 0x7fc7ac101de0 2024-09-19T04:47:07.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.826+0000 7fc7b25bc640 1 --2- 172.21.15.2:0/1408410371 >> [v2:172.21.15.2:6802/611702745,v1:172.21.15.2:6803/611702745] conn(0x7fc7980ace00 0x7fc7980af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:07.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.826+0000 7fc7b15ba640 1 --2- 172.21.15.2:0/1408410371 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fc7980a32d0 0x7fc7980a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc79c031440 tx=0x7fc79c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:07.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.826+0000 7fc7b25bc640 1 --2- 172.21.15.2:0/1408410371 >> [v2:172.21.15.2:6802/611702745,v1:172.21.15.2:6803/611702745] conn(0x7fc7980ace00 0x7fc7980af2a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:07.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.827+0000 7fc7a2ffd640 1 -- 172.21.15.2:0/1408410371 <== osd.0 v2:172.21.15.2:6802/611702745 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc7980af970 con 0x7fc7980ace00 2024-09-19T04:47:07.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.846+0000 7fc7b401f640 1 -- 172.21.15.2:0/1408410371 --> [v2:172.21.15.2:6802/611702745,v1:172.21.15.2:6803/611702745] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc7ac062e00 con 0x7fc7980ace00 2024-09-19T04:47:07.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.846+0000 7fc7a2ffd640 1 -- 172.21.15.2:0/1408410371 <== osd.0 v2:172.21.15.2:6802/611702745 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc7ac062e00 con 0x7fc7980ace00 2024-09-19T04:47:07.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.847+0000 7fc7b401f640 1 -- 172.21.15.2:0/1408410371 >> [v2:172.21.15.2:6802/611702745,v1:172.21.15.2:6803/611702745] conn(0x7fc7980ace00 msgr2=0x7fc7980af2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:07.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.847+0000 7fc7b401f640 1 --2- 172.21.15.2:0/1408410371 >> [v2:172.21.15.2:6802/611702745,v1:172.21.15.2:6803/611702745] conn(0x7fc7980ace00 0x7fc7980af2a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:07.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.847+0000 7fc7b401f640 1 -- 172.21.15.2:0/1408410371 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fc7980a32d0 msgr2=0x7fc7980a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:07.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.847+0000 7fc7b401f640 1 --2- 172.21.15.2:0/1408410371 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fc7980a32d0 0x7fc7980a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc79c031440 tx=0x7fc79c005a20 comp rx=0 tx=0).stop 2024-09-19T04:47:07.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.847+0000 7fc7b401f640 1 -- 172.21.15.2:0/1408410371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7ac101de0 msgr2=0x7fc7ac1983c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:07.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.847+0000 7fc7b401f640 1 --2- 172.21.15.2:0/1408410371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7ac101de0 0x7fc7ac1983c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc7a800d950 tx=0x7fc7a800de10 comp rx=0 tx=0).stop 2024-09-19T04:47:07.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.847+0000 7fc7b25bc640 1 -- 172.21.15.2:0/1408410371 reap_dead start 2024-09-19T04:47:07.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.847+0000 7fc7b401f640 1 -- 172.21.15.2:0/1408410371 shutdown_connections 2024-09-19T04:47:07.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.847+0000 7fc7b401f640 1 -- 172.21.15.2:0/1408410371 >> 172.21.15.2:0/1408410371 conn(0x7fc7ac0fd8c0 msgr2=0x7fc7ac0fed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:07.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.847+0000 7fc7b401f640 1 -- 172.21.15.2:0/1408410371 shutdown_connections 2024-09-19T04:47:07.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:05.847+0000 7fc7b401f640 1 -- 172.21.15.2:0/1408410371 wait complete. 2024-09-19T04:47:07.709 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:07 smithi002 ceph-mon[30975]: pgmap v295: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-19T04:47:07.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:07 smithi018 ceph-mon[34537]: pgmap v295: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-19T04:47:07.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:07 smithi116 ceph-mon[34477]: pgmap v295: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-19T04:47:07.997 INFO:teuthology.orchestra.run.smithi002.stdout:34359738444 2024-09-19T04:47:07.997 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-19T04:47:08.684 INFO:teuthology.orchestra.run.smithi002.stdout:201863462954 2024-09-19T04:47:08.684 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-19T04:47:09.040 INFO:teuthology.orchestra.run.smithi002.stdout:180388626479 2024-09-19T04:47:09.040 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-19T04:47:09.254 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:47:09.255 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:47:09.260 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:47:09.265 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:47:09.269 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:47:09.271 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:47:09.274 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:47:09.274 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:47:09.278 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:47:09.282 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:47:09.284 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:47:09.688 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:09 smithi002 ceph-mon[30975]: pgmap v296: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:47:09.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:09 smithi018 ceph-mon[34537]: pgmap v296: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:47:09.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:09 smithi116 ceph-mon[34477]: pgmap v296: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:47:10.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:09.991+0000 7f965114b640 1 -- 172.21.15.2:0/3906619387 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f964c101420 msgr2=0x7f964c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:10.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:09.991+0000 7f965114b640 1 --2- 172.21.15.2:0/3906619387 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f964c101420 0x7f964c10d950 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9644009cd0 tx=0x7f964402a8e0 comp rx=0 tx=0).stop 2024-09-19T04:47:10.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:09.991+0000 7f965114b640 1 -- 172.21.15.2:0/3906619387 shutdown_connections 2024-09-19T04:47:10.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:09.991+0000 7f965114b640 1 --2- 172.21.15.2:0/3906619387 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f964c101420 0x7f964c10d950 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:10.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:09.991+0000 7f965114b640 1 --2- 172.21.15.2:0/3906619387 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f964c100a80 0x7f964c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:10.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:09.991+0000 7f965114b640 1 --2- 172.21.15.2:0/3906619387 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f964c106a80 0x7f964c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:10.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:09.991+0000 7f965114b640 1 -- 172.21.15.2:0/3906619387 >> 172.21.15.2:0/3906619387 conn(0x7f964c0fc7a0 msgr2=0x7f964c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:10.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:09.991+0000 7f965114b640 1 -- 172.21.15.2:0/3906619387 shutdown_connections 2024-09-19T04:47:10.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:09.991+0000 7f965114b640 1 -- 172.21.15.2:0/3906619387 wait complete. 2024-09-19T04:47:10.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:09.992+0000 7f965114b640 1 Processor -- start 2024-09-19T04:47:10.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:09.992+0000 7f965114b640 1 -- start start 2024-09-19T04:47:10.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:09.992+0000 7f965114b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f964c100a80 0x7f964c1983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:10.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:09.992+0000 7f965114b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f964c101420 0x7f964c198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:10.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:09.992+0000 7f965114b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f964c106a80 0x7f964c19cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:10.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:09.992+0000 7f965114b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f964c110d50 con 0x7f964c106a80 2024-09-19T04:47:10.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:09.992+0000 7f965114b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f964c110bd0 con 0x7f964c101420 2024-09-19T04:47:10.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:09.992+0000 7f965114b640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f964c110ed0 con 0x7f964c100a80 2024-09-19T04:47:10.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:09.992+0000 7f964b59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f964c106a80 0x7f964c19cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:10.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:09.993+0000 7f964b59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f964c106a80 0x7f964c19cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53072/0 (socket says 172.21.15.2:53072) 2024-09-19T04:47:10.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:09.993+0000 7f964b59e640 1 -- 172.21.15.2:0/1222578743 learned_addr learned my addr 172.21.15.2:0/1222578743 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:47:10.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:09.993+0000 7f964a59c640 1 --2- 172.21.15.2:0/1222578743 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f964c101420 0x7f964c198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:10.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:09.993+0000 7f964ad9d640 1 --2- 172.21.15.2:0/1222578743 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f964c100a80 0x7f964c1983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:10.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:09.993+0000 7f964b59e640 1 -- 172.21.15.2:0/1222578743 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f964c100a80 msgr2=0x7f964c1983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:10.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:09.993+0000 7f964b59e640 1 --2- 172.21.15.2:0/1222578743 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f964c100a80 0x7f964c1983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:10.205 INFO:teuthology.orchestra.run.smithi002.stdout:279172874267 2024-09-19T04:47:10.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:09.993+0000 7f964b59e640 1 -- 172.21.15.2:0/1222578743 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f964c101420 msgr2=0x7f964c198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:10.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:09.993+0000 7f964b59e640 1 --2- 172.21.15.2:0/1222578743 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f964c101420 0x7f964c198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:10.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:09.993+0000 7f964b59e640 1 -- 172.21.15.2:0/1222578743 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f964c19d370 con 0x7f964c106a80 2024-09-19T04:47:10.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:09.993+0000 7f964b59e640 1 --2- 172.21.15.2:0/1222578743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f964c106a80 0x7f964c19cc90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9644005cc0 tx=0x7f9644003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:10.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:09.993+0000 7f9633fff640 1 -- 172.21.15.2:0/1222578743 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9644004240 con 0x7f964c106a80 2024-09-19T04:47:10.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:09.993+0000 7f965114b640 1 -- 172.21.15.2:0/1222578743 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f964c19d600 con 0x7f964c106a80 2024-09-19T04:47:10.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:09.993+0000 7f9633fff640 1 -- 172.21.15.2:0/1222578743 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f96440305a0 con 0x7f964c106a80 2024-09-19T04:47:10.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:09.993+0000 7f9633fff640 1 -- 172.21.15.2:0/1222578743 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96440466c0 con 0x7f964c106a80 2024-09-19T04:47:10.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:09.993+0000 7f965114b640 1 -- 172.21.15.2:0/1222578743 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f964c1a4f40 con 0x7f964c106a80 2024-09-19T04:47:10.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:09.994+0000 7f965114b640 1 -- 172.21.15.2:0/1222578743 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f964c100ee0 con 0x7f964c106a80 2024-09-19T04:47:10.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:09.995+0000 7f9633fff640 1 -- 172.21.15.2:0/1222578743 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f9644030ac0 con 0x7f964c106a80 2024-09-19T04:47:10.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:09.996+0000 7f9633fff640 1 --2- 172.21.15.2:0/1222578743 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f96340a32d0 0x7f96340a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:10.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:09.996+0000 7f964ad9d640 1 --2- 172.21.15.2:0/1222578743 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f96340a32d0 0x7f96340a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:10.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:09.996+0000 7f9633fff640 1 -- 172.21.15.2:0/1222578743 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f964402e030 con 0x7f964c106a80 2024-09-19T04:47:10.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:09.997+0000 7f964ad9d640 1 --2- 172.21.15.2:0/1222578743 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f96340a32d0 0x7f96340a5790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f963c009890 tx=0x7f963c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:10.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:10.001+0000 7f9633fff640 1 -- 172.21.15.2:0/1222578743 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f964404b060 con 0x7f964c106a80 2024-09-19T04:47:10.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:10.183+0000 7f965114b640 1 -- 172.21.15.2:0/1222578743 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f964c1a5110 con 0x7f964c106a80 2024-09-19T04:47:10.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:10.184+0000 7f9633fff640 1 -- 172.21.15.2:0/1222578743 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f96440bdd30 con 0x7f964c106a80 2024-09-19T04:47:10.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:10.186+0000 7f965114b640 1 -- 172.21.15.2:0/1222578743 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f96340a32d0 msgr2=0x7f96340a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:10.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:10.186+0000 7f965114b640 1 --2- 172.21.15.2:0/1222578743 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f96340a32d0 0x7f96340a5790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f963c009890 tx=0x7f963c008040 comp rx=0 tx=0).stop 2024-09-19T04:47:10.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:10.186+0000 7f965114b640 1 -- 172.21.15.2:0/1222578743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f964c106a80 msgr2=0x7f964c19cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:10.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:10.186+0000 7f965114b640 1 --2- 172.21.15.2:0/1222578743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f964c106a80 0x7f964c19cc90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9644005cc0 tx=0x7f9644003ba0 comp rx=0 tx=0).stop 2024-09-19T04:47:10.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:10.186+0000 7f965114b640 1 -- 172.21.15.2:0/1222578743 shutdown_connections 2024-09-19T04:47:10.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:10.186+0000 7f965114b640 1 --2- 172.21.15.2:0/1222578743 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f96340a32d0 0x7f96340a5790 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:10.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:10.186+0000 7f965114b640 1 --2- 172.21.15.2:0/1222578743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f964c106a80 0x7f964c19cc90 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:10.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:10.186+0000 7f965114b640 1 --2- 172.21.15.2:0/1222578743 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f964c101420 0x7f964c198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:10.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:10.186+0000 7f965114b640 1 --2- 172.21.15.2:0/1222578743 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f964c100a80 0x7f964c1983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:10.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:10.186+0000 7f965114b640 1 -- 172.21.15.2:0/1222578743 >> 172.21.15.2:0/1222578743 conn(0x7f964c0fc7a0 msgr2=0x7f964c1048d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:10.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:10.186+0000 7f965114b640 1 -- 172.21.15.2:0/1222578743 shutdown_connections 2024-09-19T04:47:10.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:10.186+0000 7f965114b640 1 -- 172.21.15.2:0/1222578743 wait complete. 2024-09-19T04:47:10.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:10 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/1222578743' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T04:47:10.810 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:10 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/1222578743' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T04:47:10.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:10 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/1222578743' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T04:47:10.993 INFO:tasks.cephadm.ceph_manager.ceph:need seq 279172874266 got 279172874267 for osd.10 2024-09-19T04:47:10.993 DEBUG:teuthology.parallel:result is None 2024-09-19T04:47:11.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.155+0000 7f5950124640 1 -- 172.21.15.2:0/2399265166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f594810e500 msgr2=0x7f5948110910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:11.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.155+0000 7f5950124640 1 --2- 172.21.15.2:0/2399265166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f594810e500 0x7f5948110910 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5940009900 tx=0x7f594002a410 comp rx=0 tx=0).stop 2024-09-19T04:47:11.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.155+0000 7f5950124640 1 -- 172.21.15.2:0/2399265166 shutdown_connections 2024-09-19T04:47:11.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.155+0000 7f5950124640 1 --2- 172.21.15.2:0/2399265166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f594810e500 0x7f5948110910 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:11.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.155+0000 7f5950124640 1 --2- 172.21.15.2:0/2399265166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5948101440 0x7f594810df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:11.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.155+0000 7f5950124640 1 --2- 172.21.15.2:0/2399265166 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5948100b20 0x7f5948100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:11.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.155+0000 7f5950124640 1 -- 172.21.15.2:0/2399265166 >> 172.21.15.2:0/2399265166 conn(0x7f59480fc7d0 msgr2=0x7f59480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:11.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.155+0000 7f5950124640 1 -- 172.21.15.2:0/2399265166 shutdown_connections 2024-09-19T04:47:11.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.155+0000 7f5950124640 1 -- 172.21.15.2:0/2399265166 wait complete. 2024-09-19T04:47:11.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.156+0000 7f5950124640 1 Processor -- start 2024-09-19T04:47:11.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.156+0000 7f5950124640 1 -- start start 2024-09-19T04:47:11.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.156+0000 7f5950124640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5948100b20 0x7f594819a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:11.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.156+0000 7f5950124640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5948101440 0x7f594819abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:11.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.156+0000 7f5950124640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f594810e500 0x7f594819ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:11.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.157+0000 7f594dec0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5948100b20 0x7f594819a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:11.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.157+0000 7f594dec0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5948100b20 0x7f594819a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.2:34566/0 (socket says 172.21.15.2:34566) 2024-09-19T04:47:11.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.157+0000 7f594e6c1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f594810e500 0x7f594819ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:11.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.157+0000 7f594d6bf640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5948101440 0x7f594819abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:11.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.157+0000 7f594d6bf640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5948101440 0x7f594819abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.2:57420/0 (socket says 172.21.15.2:57420) 2024-09-19T04:47:11.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.157+0000 7f594e6c1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f594810e500 0x7f594819ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53090/0 (socket says 172.21.15.2:53090) 2024-09-19T04:47:11.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.157+0000 7f5950124640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5948114100 con 0x7f594810e500 2024-09-19T04:47:11.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.157+0000 7f5950124640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5948113f80 con 0x7f5948100b20 2024-09-19T04:47:11.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.157+0000 7f5950124640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f5948114280 con 0x7f5948101440 2024-09-19T04:47:11.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.157+0000 7f594dec0640 1 -- 172.21.15.2:0/1244893993 learned_addr learned my addr 172.21.15.2:0/1244893993 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:47:11.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.157+0000 7f594d6bf640 1 -- 172.21.15.2:0/1244893993 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5948100b20 msgr2=0x7f594819a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:11.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.157+0000 7f594d6bf640 1 --2- 172.21.15.2:0/1244893993 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5948100b20 0x7f594819a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:11.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.157+0000 7f594d6bf640 1 -- 172.21.15.2:0/1244893993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f594810e500 msgr2=0x7f594819ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:11.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.157+0000 7f594d6bf640 1 --2- 172.21.15.2:0/1244893993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f594810e500 0x7f594819ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:11.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.157+0000 7f594d6bf640 1 -- 172.21.15.2:0/1244893993 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f594819f630 con 0x7f5948101440 2024-09-19T04:47:11.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.157+0000 7f594dec0640 1 --2- 172.21.15.2:0/1244893993 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5948100b20 0x7f594819a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:47:11.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.158+0000 7f594d6bf640 1 --2- 172.21.15.2:0/1244893993 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5948101440 0x7f594819abc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f593c00d6a0 tx=0x7f593c00db60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:11.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.158+0000 7f5946ffd640 1 -- 172.21.15.2:0/1244893993 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f593c017070 con 0x7f5948101440 2024-09-19T04:47:11.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.158+0000 7f5946ffd640 1 -- 172.21.15.2:0/1244893993 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f593c009cd0 con 0x7f5948101440 2024-09-19T04:47:11.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.158+0000 7f5950124640 1 -- 172.21.15.2:0/1244893993 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f594819f920 con 0x7f5948101440 2024-09-19T04:47:11.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.158+0000 7f5946ffd640 1 -- 172.21.15.2:0/1244893993 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f593c003bf0 con 0x7f5948101440 2024-09-19T04:47:11.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.158+0000 7f5950124640 1 -- 172.21.15.2:0/1244893993 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59481a7200 con 0x7f5948101440 2024-09-19T04:47:11.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.159+0000 7f5950124640 1 -- 172.21.15.2:0/1244893993 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f594806a850 con 0x7f5948101440 2024-09-19T04:47:11.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.161+0000 7f5946ffd640 1 -- 172.21.15.2:0/1244893993 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f593c009820 con 0x7f5948101440 2024-09-19T04:47:11.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.162+0000 7f5946ffd640 1 --2- 172.21.15.2:0/1244893993 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f59300a3350 0x7f59300a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:11.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.162+0000 7f594dec0640 1 --2- 172.21.15.2:0/1244893993 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f59300a3350 0x7f59300a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:11.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.162+0000 7f5946ffd640 1 -- 172.21.15.2:0/1244893993 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f593c0cf700 con 0x7f5948101440 2024-09-19T04:47:11.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.162+0000 7f594dec0640 1 --2- 172.21.15.2:0/1244893993 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f59300a3350 0x7f59300a5810 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5938009270 tx=0x7f59380095a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:11.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.164+0000 7f5946ffd640 1 -- 172.21.15.2:0/1244893993 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f593c09c310 con 0x7f5948101440 2024-09-19T04:47:11.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.342+0000 7f5950124640 1 -- 172.21.15.2:0/1244893993 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f5948109600 con 0x7f5948101440 2024-09-19T04:47:11.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.342+0000 7f5946ffd640 1 -- 172.21.15.2:0/1244893993 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f593c09bc10 con 0x7f5948101440 2024-09-19T04:47:11.344 INFO:teuthology.orchestra.run.smithi002.stdout:201863462954 2024-09-19T04:47:11.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.345+0000 7f5950124640 1 -- 172.21.15.2:0/1244893993 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f59300a3350 msgr2=0x7f59300a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:11.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.345+0000 7f5950124640 1 --2- 172.21.15.2:0/1244893993 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f59300a3350 0x7f59300a5810 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5938009270 tx=0x7f59380095a0 comp rx=0 tx=0).stop 2024-09-19T04:47:11.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.345+0000 7f5950124640 1 -- 172.21.15.2:0/1244893993 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5948101440 msgr2=0x7f594819abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:11.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.345+0000 7f5950124640 1 --2- 172.21.15.2:0/1244893993 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5948101440 0x7f594819abc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f593c00d6a0 tx=0x7f593c00db60 comp rx=0 tx=0).stop 2024-09-19T04:47:11.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.345+0000 7f5950124640 1 -- 172.21.15.2:0/1244893993 shutdown_connections 2024-09-19T04:47:11.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.345+0000 7f5950124640 1 --2- 172.21.15.2:0/1244893993 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f59300a3350 0x7f59300a5810 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:11.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.345+0000 7f5950124640 1 --2- 172.21.15.2:0/1244893993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f594810e500 0x7f594819ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:11.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.345+0000 7f5950124640 1 --2- 172.21.15.2:0/1244893993 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5948101440 0x7f594819abc0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:11.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.345+0000 7f5950124640 1 --2- 172.21.15.2:0/1244893993 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5948100b20 0x7f594819a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:11.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.345+0000 7f5950124640 1 -- 172.21.15.2:0/1244893993 >> 172.21.15.2:0/1244893993 conn(0x7f59480fc7d0 msgr2=0x7f59480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:11.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.345+0000 7f5950124640 1 -- 172.21.15.2:0/1244893993 shutdown_connections 2024-09-19T04:47:11.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.345+0000 7f5950124640 1 -- 172.21.15.2:0/1244893993 wait complete. 2024-09-19T04:47:11.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.359+0000 7f56f7cb3640 1 -- 172.21.15.2:0/2174968408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56f0102790 msgr2=0x7f56f01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:11.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.359+0000 7f56f7cb3640 1 --2- 172.21.15.2:0/2174968408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56f0102790 0x7f56f01067e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f56e0009900 tx=0x7f56e002a410 comp rx=0 tx=0).stop 2024-09-19T04:47:11.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.360+0000 7f56f7cb3640 1 -- 172.21.15.2:0/2174968408 shutdown_connections 2024-09-19T04:47:11.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.360+0000 7f56f7cb3640 1 --2- 172.21.15.2:0/2174968408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56f0106f10 0x7f56f010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:11.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.360+0000 7f56f7cb3640 1 --2- 172.21.15.2:0/2174968408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56f0102790 0x7f56f01067e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:11.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.360+0000 7f56f7cb3640 1 --2- 172.21.15.2:0/2174968408 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56f0101de0 0x7f56f01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:11.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.360+0000 7f56f7cb3640 1 -- 172.21.15.2:0/2174968408 >> 172.21.15.2:0/2174968408 conn(0x7f56f00fd8c0 msgr2=0x7f56f00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:11.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.360+0000 7f56f7cb3640 1 -- 172.21.15.2:0/2174968408 shutdown_connections 2024-09-19T04:47:11.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.360+0000 7f56f7cb3640 1 -- 172.21.15.2:0/2174968408 wait complete. 2024-09-19T04:47:11.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.360+0000 7f56f7cb3640 1 Processor -- start 2024-09-19T04:47:11.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.360+0000 7f56f7cb3640 1 -- start start 2024-09-19T04:47:11.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.360+0000 7f56f7cb3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56f0101de0 0x7f56f019a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:11.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.360+0000 7f56f7cb3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56f0102790 0x7f56f019ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:11.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.360+0000 7f56f7cb3640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56f0106f10 0x7f56f019ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:11.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.360+0000 7f56f7cb3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f56f0111e20 con 0x7f56f0101de0 2024-09-19T04:47:11.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.361+0000 7f56f7cb3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f56f0111ca0 con 0x7f56f0102790 2024-09-19T04:47:11.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.361+0000 7f56f7cb3640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f56f0111fa0 con 0x7f56f0106f10 2024-09-19T04:47:11.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.361+0000 7f56f5a4f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56f0101de0 0x7f56f019a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:11.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.361+0000 7f56f5a4f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56f0101de0 0x7f56f019a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53096/0 (socket says 172.21.15.2:53096) 2024-09-19T04:47:11.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.361+0000 7f56f5a4f640 1 -- 172.21.15.2:0/910624373 learned_addr learned my addr 172.21.15.2:0/910624373 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:47:11.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.361+0000 7f56f6250640 1 --2- 172.21.15.2:0/910624373 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56f0106f10 0x7f56f019ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:11.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.361+0000 7f56f524e640 1 --2- 172.21.15.2:0/910624373 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56f0102790 0x7f56f019ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:11.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.361+0000 7f56f5a4f640 1 -- 172.21.15.2:0/910624373 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56f0106f10 msgr2=0x7f56f019ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:11.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.361+0000 7f56f5a4f640 1 --2- 172.21.15.2:0/910624373 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56f0106f10 0x7f56f019ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:11.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.361+0000 7f56f5a4f640 1 -- 172.21.15.2:0/910624373 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56f0102790 msgr2=0x7f56f019ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:11.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.361+0000 7f56f5a4f640 1 --2- 172.21.15.2:0/910624373 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56f0102790 0x7f56f019ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:11.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.361+0000 7f56f5a4f640 1 -- 172.21.15.2:0/910624373 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56f019f570 con 0x7f56f0101de0 2024-09-19T04:47:11.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.361+0000 7f56f524e640 1 --2- 172.21.15.2:0/910624373 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56f0102790 0x7f56f019ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:47:11.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.361+0000 7f56f5a4f640 1 --2- 172.21.15.2:0/910624373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56f0101de0 0x7f56f019a5c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f56ec00e9f0 tx=0x7f56ec00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:11.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.361+0000 7f56e6ffd640 1 -- 172.21.15.2:0/910624373 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ec00cd80 con 0x7f56f0101de0 2024-09-19T04:47:11.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.362+0000 7f56f7cb3640 1 -- 172.21.15.2:0/910624373 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56f019f860 con 0x7f56f0101de0 2024-09-19T04:47:11.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.362+0000 7f56e6ffd640 1 -- 172.21.15.2:0/910624373 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f56ec0054d0 con 0x7f56f0101de0 2024-09-19T04:47:11.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.362+0000 7f56e6ffd640 1 -- 172.21.15.2:0/910624373 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ec010490 con 0x7f56f0101de0 2024-09-19T04:47:11.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.362+0000 7f56f7cb3640 1 -- 172.21.15.2:0/910624373 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56f01a7140 con 0x7f56f0101de0 2024-09-19T04:47:11.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.363+0000 7f56f7cb3640 1 -- 172.21.15.2:0/910624373 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56f01021c0 con 0x7f56f0101de0 2024-09-19T04:47:11.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.365+0000 7f56e6ffd640 1 -- 172.21.15.2:0/910624373 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f56ec005000 con 0x7f56f0101de0 2024-09-19T04:47:11.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.365+0000 7f56e6ffd640 1 --2- 172.21.15.2:0/910624373 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f56dc0a32d0 0x7f56dc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:11.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.366+0000 7f56f524e640 1 --2- 172.21.15.2:0/910624373 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f56dc0a32d0 0x7f56dc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:11.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.366+0000 7f56e6ffd640 1 -- 172.21.15.2:0/910624373 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f56ec0d00a0 con 0x7f56f0101de0 2024-09-19T04:47:11.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.366+0000 7f56f524e640 1 --2- 172.21.15.2:0/910624373 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f56dc0a32d0 0x7f56dc0a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f56e0031440 tx=0x7f56e0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:11.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.368+0000 7f56e6ffd640 1 -- 172.21.15.2:0/910624373 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f56ec054210 con 0x7f56f0101de0 2024-09-19T04:47:11.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.558+0000 7f56f7cb3640 1 -- 172.21.15.2:0/910624373 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f56f019b920 con 0x7f56f0101de0 2024-09-19T04:47:11.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.559+0000 7f56e6ffd640 1 -- 172.21.15.2:0/910624373 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f56f019b920 con 0x7f56f0101de0 2024-09-19T04:47:11.560 INFO:teuthology.orchestra.run.smithi002.stdout:51539607624 2024-09-19T04:47:11.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.561+0000 7f56f7cb3640 1 -- 172.21.15.2:0/910624373 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f56dc0a32d0 msgr2=0x7f56dc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:11.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.561+0000 7f56f7cb3640 1 --2- 172.21.15.2:0/910624373 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f56dc0a32d0 0x7f56dc0a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f56e0031440 tx=0x7f56e0005a20 comp rx=0 tx=0).stop 2024-09-19T04:47:11.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.561+0000 7f56f7cb3640 1 -- 172.21.15.2:0/910624373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56f0101de0 msgr2=0x7f56f019a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:11.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.561+0000 7f56f7cb3640 1 --2- 172.21.15.2:0/910624373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56f0101de0 0x7f56f019a5c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f56ec00e9f0 tx=0x7f56ec00edf0 comp rx=0 tx=0).stop 2024-09-19T04:47:11.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.561+0000 7f56f7cb3640 1 -- 172.21.15.2:0/910624373 shutdown_connections 2024-09-19T04:47:11.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.561+0000 7f56f7cb3640 1 --2- 172.21.15.2:0/910624373 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f56dc0a32d0 0x7f56dc0a5790 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:11.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.561+0000 7f56f7cb3640 1 --2- 172.21.15.2:0/910624373 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56f0106f10 0x7f56f019ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:11.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.561+0000 7f56f7cb3640 1 --2- 172.21.15.2:0/910624373 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56f0102790 0x7f56f019ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:11.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.561+0000 7f56f7cb3640 1 --2- 172.21.15.2:0/910624373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56f0101de0 0x7f56f019a5c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:11.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.561+0000 7f56f7cb3640 1 -- 172.21.15.2:0/910624373 >> 172.21.15.2:0/910624373 conn(0x7f56f00fd8c0 msgr2=0x7f56f00fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:11.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.561+0000 7f56f7cb3640 1 -- 172.21.15.2:0/910624373 shutdown_connections 2024-09-19T04:47:11.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:11.561+0000 7f56f7cb3640 1 -- 172.21.15.2:0/910624373 wait complete. 2024-09-19T04:47:11.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:11 smithi002 ceph-mon[30975]: pgmap v297: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T04:47:11.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:11 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/1244893993' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T04:47:11.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:11 smithi018 ceph-mon[34537]: pgmap v297: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T04:47:11.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:11 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/1244893993' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T04:47:11.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:11 smithi116 ceph-mon[34477]: pgmap v297: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T04:47:11.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:11 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/1244893993' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T04:47:12.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.142+0000 7fda53414640 1 -- 172.21.15.2:0/1179685636 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda4c102d30 msgr2=0x7fda4c103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:12.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.142+0000 7fda53414640 1 --2- 172.21.15.2:0/1179685636 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda4c102d30 0x7fda4c103110 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fda3c009cd0 tx=0x7fda3c02a910 comp rx=0 tx=0).stop 2024-09-19T04:47:12.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.142+0000 7fda53414640 1 -- 172.21.15.2:0/1179685636 shutdown_connections 2024-09-19T04:47:12.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.142+0000 7fda53414640 1 --2- 172.21.15.2:0/1179685636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda4c1082a0 0x7fda4c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:12.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.142+0000 7fda53414640 1 --2- 172.21.15.2:0/1179685636 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda4c1036e0 0x7fda4c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:12.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.142+0000 7fda53414640 1 --2- 172.21.15.2:0/1179685636 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda4c102d30 0x7fda4c103110 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:12.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.142+0000 7fda53414640 1 -- 172.21.15.2:0/1179685636 >> 172.21.15.2:0/1179685636 conn(0x7fda4c0fc7d0 msgr2=0x7fda4c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:12.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.142+0000 7fda53414640 1 -- 172.21.15.2:0/1179685636 shutdown_connections 2024-09-19T04:47:12.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.142+0000 7fda53414640 1 -- 172.21.15.2:0/1179685636 wait complete. 2024-09-19T04:47:12.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.142+0000 7fda53414640 1 Processor -- start 2024-09-19T04:47:12.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.142+0000 7fda53414640 1 -- start start 2024-09-19T04:47:12.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.143+0000 7fda53414640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda4c102d30 0x7fda4c198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:12.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.143+0000 7fda53414640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda4c1036e0 0x7fda4c198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:12.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.143+0000 7fda53414640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda4c1082a0 0x7fda4c19cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:12.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.143+0000 7fda53414640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fda4c111f90 con 0x7fda4c1036e0 2024-09-19T04:47:12.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.143+0000 7fda53414640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fda4c111e10 con 0x7fda4c1082a0 2024-09-19T04:47:12.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.143+0000 7fda53414640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fda4c112110 con 0x7fda4c102d30 2024-09-19T04:47:12.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.143+0000 7fda509af640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda4c1036e0 0x7fda4c198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:12.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.143+0000 7fda509af640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda4c1036e0 0x7fda4c198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59856/0 (socket says 172.21.15.2:59856) 2024-09-19T04:47:12.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.143+0000 7fda509af640 1 -- 172.21.15.2:0/3317863861 learned_addr learned my addr 172.21.15.2:0/3317863861 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:47:12.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.143+0000 7fda511b0640 1 --2- 172.21.15.2:0/3317863861 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda4c102d30 0x7fda4c198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:12.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.143+0000 7fda519b1640 1 --2- 172.21.15.2:0/3317863861 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda4c1082a0 0x7fda4c19cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:12.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.143+0000 7fda509af640 1 -- 172.21.15.2:0/3317863861 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda4c102d30 msgr2=0x7fda4c198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:12.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.143+0000 7fda509af640 1 --2- 172.21.15.2:0/3317863861 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda4c102d30 0x7fda4c198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:12.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.143+0000 7fda509af640 1 -- 172.21.15.2:0/3317863861 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda4c1082a0 msgr2=0x7fda4c19cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:12.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.143+0000 7fda509af640 1 --2- 172.21.15.2:0/3317863861 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda4c1082a0 0x7fda4c19cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:12.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.143+0000 7fda509af640 1 -- 172.21.15.2:0/3317863861 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda4c19d4c0 con 0x7fda4c1036e0 2024-09-19T04:47:12.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.143+0000 7fda509af640 1 --2- 172.21.15.2:0/3317863861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda4c1036e0 0x7fda4c198a50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fda40006fd0 tx=0x7fda4000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:12.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.143+0000 7fda4a7fc640 1 -- 172.21.15.2:0/3317863861 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda40011830 con 0x7fda4c1036e0 2024-09-19T04:47:12.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.143+0000 7fda4a7fc640 1 -- 172.21.15.2:0/3317863861 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fda40016070 con 0x7fda4c1036e0 2024-09-19T04:47:12.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.143+0000 7fda4a7fc640 1 -- 172.21.15.2:0/3317863861 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda40010df0 con 0x7fda4c1036e0 2024-09-19T04:47:12.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.143+0000 7fda53414640 1 -- 172.21.15.2:0/3317863861 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda4c19d7b0 con 0x7fda4c1036e0 2024-09-19T04:47:12.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.144+0000 7fda53414640 1 -- 172.21.15.2:0/3317863861 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda4c1a5090 con 0x7fda4c1036e0 2024-09-19T04:47:12.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.145+0000 7fda53414640 1 -- 172.21.15.2:0/3317863861 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda4c06a850 con 0x7fda4c1036e0 2024-09-19T04:47:12.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.147+0000 7fda4a7fc640 1 -- 172.21.15.2:0/3317863861 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fda400119d0 con 0x7fda4c1036e0 2024-09-19T04:47:12.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.147+0000 7fda4a7fc640 1 --2- 172.21.15.2:0/3317863861 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fda340a32d0 0x7fda340a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:12.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.147+0000 7fda511b0640 1 --2- 172.21.15.2:0/3317863861 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fda340a32d0 0x7fda340a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:12.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.147+0000 7fda4a7fc640 1 -- 172.21.15.2:0/3317863861 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fda400cf5b0 con 0x7fda4c1036e0 2024-09-19T04:47:12.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.148+0000 7fda511b0640 1 --2- 172.21.15.2:0/3317863861 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fda340a32d0 0x7fda340a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fda3c0098d0 tx=0x7fda3c009900 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:12.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.151+0000 7fda4a7fc640 1 -- 172.21.15.2:0/3317863861 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fda4009c2b0 con 0x7fda4c1036e0 2024-09-19T04:47:12.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.317+0000 7f76f9db7640 1 -- 172.21.15.2:0/2404489993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76f41027c0 msgr2=0x7f76f4106810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:12.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.317+0000 7f76f9db7640 1 --2- 172.21.15.2:0/2404489993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76f41027c0 0x7f76f4106810 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f76dc009900 tx=0x7f76dc02a410 comp rx=0 tx=0).stop 2024-09-19T04:47:12.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.317+0000 7f76f9db7640 1 -- 172.21.15.2:0/2404489993 shutdown_connections 2024-09-19T04:47:12.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.317+0000 7f76f9db7640 1 --2- 172.21.15.2:0/2404489993 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76f4106f40 0x7f76f410eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:12.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.317+0000 7f76f9db7640 1 --2- 172.21.15.2:0/2404489993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76f41027c0 0x7f76f4106810 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:12.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.317+0000 7f76f9db7640 1 --2- 172.21.15.2:0/2404489993 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76f4101e10 0x7f76f41021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:12.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.317+0000 7f76f9db7640 1 -- 172.21.15.2:0/2404489993 >> 172.21.15.2:0/2404489993 conn(0x7f76f40fd8d0 msgr2=0x7f76f40ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:12.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.317+0000 7f76f9db7640 1 -- 172.21.15.2:0/2404489993 shutdown_connections 2024-09-19T04:47:12.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.317+0000 7f76f9db7640 1 -- 172.21.15.2:0/2404489993 wait complete. 2024-09-19T04:47:12.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.318+0000 7f76f9db7640 1 Processor -- start 2024-09-19T04:47:12.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.318+0000 7f76f9db7640 1 -- start start 2024-09-19T04:47:12.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.318+0000 7f76f9db7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76f4101e10 0x7f76f40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:12.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.318+0000 7f76f9db7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76f41027c0 0x7f76f4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:12.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.318+0000 7f76f9db7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76f4106f40 0x7f76f4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:12.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.318+0000 7f76f9db7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f76f4111e10 con 0x7f76f4106f40 2024-09-19T04:47:12.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.318+0000 7f76f9db7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f76f4111c90 con 0x7f76f41027c0 2024-09-19T04:47:12.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.318+0000 7f76f9db7640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f76f4111f90 con 0x7f76f4101e10 2024-09-19T04:47:12.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.319+0000 7f76f3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76f4106f40 0x7f76f4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:12.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.319+0000 7f76f3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76f4106f40 0x7f76f4074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59872/0 (socket says 172.21.15.2:59872) 2024-09-19T04:47:12.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.319+0000 7f76f37fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76f4101e10 0x7f76f40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:12.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.319+0000 7f76f3fff640 1 -- 172.21.15.2:0/3454618773 learned_addr learned my addr 172.21.15.2:0/3454618773 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:47:12.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.319+0000 7f76eaffd640 1 --2- 172.21.15.2:0/3454618773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76f41027c0 0x7f76f4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:12.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.319+0000 7f76f3fff640 1 -- 172.21.15.2:0/3454618773 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76f4101e10 msgr2=0x7f76f40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:12.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.319+0000 7f76f3fff640 1 --2- 172.21.15.2:0/3454618773 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76f4101e10 0x7f76f40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:12.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.319+0000 7f76f3fff640 1 -- 172.21.15.2:0/3454618773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76f41027c0 msgr2=0x7f76f4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:12.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.319+0000 7f76f3fff640 1 --2- 172.21.15.2:0/3454618773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76f41027c0 0x7f76f4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:12.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.319+0000 7f76f3fff640 1 -- 172.21.15.2:0/3454618773 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76f41a68b0 con 0x7f76f4106f40 2024-09-19T04:47:12.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.319+0000 7f76eaffd640 1 --2- 172.21.15.2:0/3454618773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76f41027c0 0x7f76f4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:47:12.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.319+0000 7f76f3fff640 1 --2- 172.21.15.2:0/3454618773 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76f4106f40 0x7f76f4074f70 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f76ec00cad0 tx=0x7f76ec00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:12.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.319+0000 7f76f17fa640 1 -- 172.21.15.2:0/3454618773 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76ec00ae20 con 0x7f76f4106f40 2024-09-19T04:47:12.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.319+0000 7f76f9db7640 1 -- 172.21.15.2:0/3454618773 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76f41a6ba0 con 0x7f76f4106f40 2024-09-19T04:47:12.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.319+0000 7f76f17fa640 1 -- 172.21.15.2:0/3454618773 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f76ec005020 con 0x7f76f4106f40 2024-09-19T04:47:12.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.319+0000 7f76f17fa640 1 -- 172.21.15.2:0/3454618773 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76ec00f6b0 con 0x7f76f4106f40 2024-09-19T04:47:12.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.319+0000 7f76f9db7640 1 -- 172.21.15.2:0/3454618773 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76f41a70b0 con 0x7f76f4106f40 2024-09-19T04:47:12.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.321+0000 7f76f9db7640 1 -- 172.21.15.2:0/3454618773 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76f41021f0 con 0x7f76f4106f40 2024-09-19T04:47:12.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.323+0000 7f76f17fa640 1 -- 172.21.15.2:0/3454618773 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f76ec0051d0 con 0x7f76f4106f40 2024-09-19T04:47:12.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.323+0000 7f76f17fa640 1 --2- 172.21.15.2:0/3454618773 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f76e00a32d0 0x7f76e00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:12.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.324+0000 7f76f37fe640 1 --2- 172.21.15.2:0/3454618773 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f76e00a32d0 0x7f76e00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:12.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.324+0000 7f76f17fa640 1 -- 172.21.15.2:0/3454618773 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f76ec0cfa60 con 0x7f76f4106f40 2024-09-19T04:47:12.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.324+0000 7f76f37fe640 1 --2- 172.21.15.2:0/3454618773 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f76e00a32d0 0x7f76e00a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f76e400bbe0 tx=0x7f76e400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:12.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.328+0000 7f76f17fa640 1 -- 172.21.15.2:0/3454618773 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f76ec014030 con 0x7f76f4106f40 2024-09-19T04:47:12.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.331+0000 7fda53414640 1 -- 172.21.15.2:0/3317863861 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fda4c103110 con 0x7fda4c1036e0 2024-09-19T04:47:12.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.331+0000 7fda4a7fc640 1 -- 172.21.15.2:0/3317863861 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fda4c103110 con 0x7fda4c1036e0 2024-09-19T04:47:12.332 INFO:teuthology.orchestra.run.smithi002.stdout:261993005089 2024-09-19T04:47:12.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.333+0000 7fda53414640 1 -- 172.21.15.2:0/3317863861 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fda340a32d0 msgr2=0x7fda340a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:12.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.333+0000 7fda53414640 1 --2- 172.21.15.2:0/3317863861 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fda340a32d0 0x7fda340a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fda3c0098d0 tx=0x7fda3c009900 comp rx=0 tx=0).stop 2024-09-19T04:47:12.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.333+0000 7fda53414640 1 -- 172.21.15.2:0/3317863861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda4c1036e0 msgr2=0x7fda4c198a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:12.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.333+0000 7fda53414640 1 --2- 172.21.15.2:0/3317863861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda4c1036e0 0x7fda4c198a50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fda40006fd0 tx=0x7fda4000b8e0 comp rx=0 tx=0).stop 2024-09-19T04:47:12.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.333+0000 7fda53414640 1 -- 172.21.15.2:0/3317863861 shutdown_connections 2024-09-19T04:47:12.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.333+0000 7fda53414640 1 --2- 172.21.15.2:0/3317863861 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fda340a32d0 0x7fda340a5790 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:12.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.333+0000 7fda53414640 1 --2- 172.21.15.2:0/3317863861 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda4c1082a0 0x7fda4c19cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:12.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.333+0000 7fda53414640 1 --2- 172.21.15.2:0/3317863861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda4c1036e0 0x7fda4c198a50 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:12.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.333+0000 7fda53414640 1 --2- 172.21.15.2:0/3317863861 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda4c102d30 0x7fda4c198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:12.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.333+0000 7fda53414640 1 -- 172.21.15.2:0/3317863861 >> 172.21.15.2:0/3317863861 conn(0x7fda4c0fc7d0 msgr2=0x7fda4c105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:12.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.333+0000 7fda53414640 1 -- 172.21.15.2:0/3317863861 shutdown_connections 2024-09-19T04:47:12.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.334+0000 7fda53414640 1 -- 172.21.15.2:0/3317863861 wait complete. 2024-09-19T04:47:12.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.508+0000 7f76f9db7640 1 -- 172.21.15.2:0/3454618773 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f76f402d7c0 con 0x7f76f4106f40 2024-09-19T04:47:12.510 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:12 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/910624373' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T04:47:12.510 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:12 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/3317863861' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T04:47:12.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.508+0000 7f76f17fa640 1 -- 172.21.15.2:0/3454618773 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f76ec09c650 con 0x7f76f4106f40 2024-09-19T04:47:12.511 INFO:teuthology.orchestra.run.smithi002.stdout:150323855412 2024-09-19T04:47:12.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.510+0000 7f76f9db7640 1 -- 172.21.15.2:0/3454618773 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f76e00a32d0 msgr2=0x7f76e00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:12.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.510+0000 7f76f9db7640 1 --2- 172.21.15.2:0/3454618773 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f76e00a32d0 0x7f76e00a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f76e400bbe0 tx=0x7f76e400b390 comp rx=0 tx=0).stop 2024-09-19T04:47:12.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.510+0000 7f76f9db7640 1 -- 172.21.15.2:0/3454618773 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76f4106f40 msgr2=0x7f76f4074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:12.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.510+0000 7f76f9db7640 1 --2- 172.21.15.2:0/3454618773 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76f4106f40 0x7f76f4074f70 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f76ec00cad0 tx=0x7f76ec00cf90 comp rx=0 tx=0).stop 2024-09-19T04:47:12.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.511+0000 7f76f9db7640 1 -- 172.21.15.2:0/3454618773 shutdown_connections 2024-09-19T04:47:12.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.511+0000 7f76f9db7640 1 --2- 172.21.15.2:0/3454618773 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f76e00a32d0 0x7f76e00a5790 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:12.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.511+0000 7f76f9db7640 1 --2- 172.21.15.2:0/3454618773 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76f4106f40 0x7f76f4074f70 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:12.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.511+0000 7f76f9db7640 1 --2- 172.21.15.2:0/3454618773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76f41027c0 0x7f76f4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:12.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.511+0000 7f76f9db7640 1 --2- 172.21.15.2:0/3454618773 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76f4101e10 0x7f76f40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:12.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.511+0000 7f76f9db7640 1 -- 172.21.15.2:0/3454618773 >> 172.21.15.2:0/3454618773 conn(0x7f76f40fd8d0 msgr2=0x7f76f40fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:12.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.511+0000 7f76f9db7640 1 -- 172.21.15.2:0/3454618773 shutdown_connections 2024-09-19T04:47:12.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:12.511+0000 7f76f9db7640 1 -- 172.21.15.2:0/3454618773 wait complete. 2024-09-19T04:47:12.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:12 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/910624373' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T04:47:12.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:12 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/3317863861' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T04:47:12.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:12 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/910624373' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T04:47:12.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:12 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/3317863861' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T04:47:13.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:13 smithi002 ceph-mon[30975]: pgmap v298: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:47:13.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:13 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/3454618773' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T04:47:13.762 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:13 smithi116 ceph-mon[34477]: pgmap v298: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:47:13.837 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:13 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/3454618773' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T04:47:13.837 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:13 smithi018 ceph-mon[34537]: pgmap v298: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:47:13.838 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:13 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/3454618773' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T04:47:14.630 INFO:tasks.cephadm.ceph_manager.ceph:need seq 51539607622 got 51539607624 for osd.1 2024-09-19T04:47:14.631 DEBUG:teuthology.parallel:result is None 2024-09-19T04:47:14.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:14 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/708515276' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T04:47:14.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:14 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/3359355819' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T04:47:14.810 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:14 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/708515276' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T04:47:14.811 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:14 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/3359355819' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T04:47:14.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:14 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/708515276' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T04:47:14.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:14 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/3359355819' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T04:47:14.935 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855409 got 150323855412 for osd.5 2024-09-19T04:47:14.935 DEBUG:teuthology.parallel:result is None 2024-09-19T04:47:15.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.526+0000 7fd58bd07640 1 -- 172.21.15.2:0/2310287132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd58410e480 msgr2=0x7fd584110870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:15.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.526+0000 7fd58bd07640 1 --2- 172.21.15.2:0/2310287132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd58410e480 0x7fd584110870 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd57c009ca0 tx=0x7fd57c02a8c0 comp rx=0 tx=0).stop 2024-09-19T04:47:15.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.526+0000 7fd58bd07640 1 -- 172.21.15.2:0/2310287132 shutdown_connections 2024-09-19T04:47:15.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.526+0000 7fd58bd07640 1 --2- 172.21.15.2:0/2310287132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd58410e480 0x7fd584110870 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:15.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.526+0000 7fd58bd07640 1 --2- 172.21.15.2:0/2310287132 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd584101280 0x7fd58410df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:15.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.526+0000 7fd58bd07640 1 --2- 172.21.15.2:0/2310287132 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5841008d0 0x7fd584100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:15.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.526+0000 7fd58bd07640 1 -- 172.21.15.2:0/2310287132 >> 172.21.15.2:0/2310287132 conn(0x7fd5840fc7a0 msgr2=0x7fd5840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:15.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.527+0000 7fd58bd07640 1 -- 172.21.15.2:0/2310287132 shutdown_connections 2024-09-19T04:47:15.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.527+0000 7fd58bd07640 1 -- 172.21.15.2:0/2310287132 wait complete. 2024-09-19T04:47:15.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.527+0000 7fd58bd07640 1 Processor -- start 2024-09-19T04:47:15.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.527+0000 7fd58bd07640 1 -- start start 2024-09-19T04:47:15.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.527+0000 7fd58bd07640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5841008d0 0x7fd58419a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:15.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.527+0000 7fd58bd07640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd584101280 0x7fd58419ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:15.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.527+0000 7fd58bd07640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd58410e480 0x7fd58419ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:15.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.527+0000 7fd58bd07640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd584114060 con 0x7fd58410e480 2024-09-19T04:47:15.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.527+0000 7fd58bd07640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd584113ee0 con 0x7fd5841008d0 2024-09-19T04:47:15.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.527+0000 7fd58bd07640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fd5841141e0 con 0x7fd584101280 2024-09-19T04:47:15.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.527+0000 7fd58a2a4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd58410e480 0x7fd58419ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:15.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.527+0000 7fd58a2a4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd58410e480 0x7fd58419ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59934/0 (socket says 172.21.15.2:59934) 2024-09-19T04:47:15.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.527+0000 7fd58a2a4640 1 -- 172.21.15.2:0/2489845703 learned_addr learned my addr 172.21.15.2:0/2489845703 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:47:15.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.528+0000 7fd5892a2640 1 --2- 172.21.15.2:0/2489845703 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd584101280 0x7fd58419ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:15.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.528+0000 7fd589aa3640 1 --2- 172.21.15.2:0/2489845703 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5841008d0 0x7fd58419a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:15.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.528+0000 7fd58a2a4640 1 -- 172.21.15.2:0/2489845703 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd584101280 msgr2=0x7fd58419ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:15.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.528+0000 7fd58a2a4640 1 --2- 172.21.15.2:0/2489845703 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd584101280 0x7fd58419ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:15.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.528+0000 7fd58a2a4640 1 -- 172.21.15.2:0/2489845703 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5841008d0 msgr2=0x7fd58419a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:15.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.528+0000 7fd58a2a4640 1 --2- 172.21.15.2:0/2489845703 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5841008d0 0x7fd58419a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:15.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.528+0000 7fd58a2a4640 1 -- 172.21.15.2:0/2489845703 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd58419f570 con 0x7fd58410e480 2024-09-19T04:47:15.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.528+0000 7fd58a2a4640 1 --2- 172.21.15.2:0/2489845703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd58410e480 0x7fd58419ee90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd57c031040 tx=0x7fd57c003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:15.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.528+0000 7fd57affd640 1 -- 172.21.15.2:0/2489845703 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c003ce0 con 0x7fd58410e480 2024-09-19T04:47:15.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.528+0000 7fd57affd640 1 -- 172.21.15.2:0/2489845703 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd57c0044f0 con 0x7fd58410e480 2024-09-19T04:47:15.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.528+0000 7fd58bd07640 1 -- 172.21.15.2:0/2489845703 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd58419f800 con 0x7fd58410e480 2024-09-19T04:47:15.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.528+0000 7fd57affd640 1 -- 172.21.15.2:0/2489845703 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c030c50 con 0x7fd58410e480 2024-09-19T04:47:15.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.528+0000 7fd58bd07640 1 -- 172.21.15.2:0/2489845703 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5841a7140 con 0x7fd58410e480 2024-09-19T04:47:15.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.529+0000 7fd58bd07640 1 -- 172.21.15.2:0/2489845703 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd584100cb0 con 0x7fd58410e480 2024-09-19T04:47:15.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.530+0000 7fd57affd640 1 -- 172.21.15.2:0/2489845703 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fd57c0046a0 con 0x7fd58410e480 2024-09-19T04:47:15.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.531+0000 7fd57affd640 1 --2- 172.21.15.2:0/2489845703 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd5700a32d0 0x7fd5700a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:15.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.531+0000 7fd589aa3640 1 --2- 172.21.15.2:0/2489845703 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd5700a32d0 0x7fd5700a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:15.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.531+0000 7fd57affd640 1 -- 172.21.15.2:0/2489845703 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fd57c0f0d80 con 0x7fd58410e480 2024-09-19T04:47:15.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.531+0000 7fd589aa3640 1 --2- 172.21.15.2:0/2489845703 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd5700a32d0 0x7fd5700a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd580005fd0 tx=0x7fd580005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:15.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.535+0000 7fd57affd640 1 -- 172.21.15.2:0/2489845703 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd57c0bda80 con 0x7fd58410e480 2024-09-19T04:47:15.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.712+0000 7fd58bd07640 1 -- 172.21.15.2:0/2489845703 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fd584109670 con 0x7fd58410e480 2024-09-19T04:47:15.714 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:15 smithi002 ceph-mon[30975]: pgmap v299: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:47:15.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.713+0000 7fd57affd640 1 -- 172.21.15.2:0/2489845703 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd57c0098b0 con 0x7fd58410e480 2024-09-19T04:47:15.715 INFO:teuthology.orchestra.run.smithi002.stdout:231928234022 2024-09-19T04:47:15.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.715+0000 7fd58bd07640 1 -- 172.21.15.2:0/2489845703 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd5700a32d0 msgr2=0x7fd5700a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:15.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.715+0000 7fd58bd07640 1 --2- 172.21.15.2:0/2489845703 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd5700a32d0 0x7fd5700a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd580005fd0 tx=0x7fd580005850 comp rx=0 tx=0).stop 2024-09-19T04:47:15.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.715+0000 7fd58bd07640 1 -- 172.21.15.2:0/2489845703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd58410e480 msgr2=0x7fd58419ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:15.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.715+0000 7fd58bd07640 1 --2- 172.21.15.2:0/2489845703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd58410e480 0x7fd58419ee90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd57c031040 tx=0x7fd57c003970 comp rx=0 tx=0).stop 2024-09-19T04:47:15.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.715+0000 7fd58bd07640 1 -- 172.21.15.2:0/2489845703 shutdown_connections 2024-09-19T04:47:15.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.715+0000 7fd58bd07640 1 --2- 172.21.15.2:0/2489845703 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd5700a32d0 0x7fd5700a5790 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:15.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.715+0000 7fd58bd07640 1 --2- 172.21.15.2:0/2489845703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd58410e480 0x7fd58419ee90 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:15.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.715+0000 7fd58bd07640 1 --2- 172.21.15.2:0/2489845703 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd584101280 0x7fd58419ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:15.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.715+0000 7fd58bd07640 1 --2- 172.21.15.2:0/2489845703 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5841008d0 0x7fd58419a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:15.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.715+0000 7fd58bd07640 1 -- 172.21.15.2:0/2489845703 >> 172.21.15.2:0/2489845703 conn(0x7fd5840fc7a0 msgr2=0x7fd5840feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:15.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.715+0000 7fd58bd07640 1 -- 172.21.15.2:0/2489845703 shutdown_connections 2024-09-19T04:47:15.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:15.715+0000 7fd58bd07640 1 -- 172.21.15.2:0/2489845703 wait complete. 2024-09-19T04:47:15.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:15 smithi018 ceph-mon[34537]: pgmap v299: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:47:15.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:15 smithi116 ceph-mon[34477]: pgmap v299: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:47:16.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.121+0000 7faafdb46640 1 -- 172.21.15.2:0/2780790388 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faaf8106a80 msgr2=0x7faaf8106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:16.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.121+0000 7faafdb46640 1 --2- 172.21.15.2:0/2780790388 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faaf8106a80 0x7faaf8106e60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7faae8009930 tx=0x7faae802a420 comp rx=0 tx=0).stop 2024-09-19T04:47:16.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.121+0000 7faafdb46640 1 -- 172.21.15.2:0/2780790388 shutdown_connections 2024-09-19T04:47:16.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.121+0000 7faafdb46640 1 --2- 172.21.15.2:0/2780790388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faaf8101420 0x7faaf810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:16.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.121+0000 7faafdb46640 1 --2- 172.21.15.2:0/2780790388 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faaf8100a80 0x7faaf8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:16.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.121+0000 7faafdb46640 1 --2- 172.21.15.2:0/2780790388 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faaf8106a80 0x7faaf8106e60 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:16.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.121+0000 7faafdb46640 1 -- 172.21.15.2:0/2780790388 >> 172.21.15.2:0/2780790388 conn(0x7faaf80fc7a0 msgr2=0x7faaf80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:16.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.121+0000 7faafdb46640 1 -- 172.21.15.2:0/2780790388 shutdown_connections 2024-09-19T04:47:16.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.121+0000 7faafdb46640 1 -- 172.21.15.2:0/2780790388 wait complete. 2024-09-19T04:47:16.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.122+0000 7faafdb46640 1 Processor -- start 2024-09-19T04:47:16.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.122+0000 7faafdb46640 1 -- start start 2024-09-19T04:47:16.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.122+0000 7faafdb46640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faaf8100a80 0x7faaf81983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:16.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.122+0000 7faafdb46640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faaf8101420 0x7faaf8198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:16.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.123+0000 7faafdb46640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faaf8106a80 0x7faaf819ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:16.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.123+0000 7faafdb46640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faaf8111e50 con 0x7faaf8100a80 2024-09-19T04:47:16.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.123+0000 7faafdb46640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7faaf8111cd0 con 0x7faaf8101420 2024-09-19T04:47:16.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.123+0000 7faafdb46640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7faaf8111fd0 con 0x7faaf8106a80 2024-09-19T04:47:16.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.123+0000 7faaf77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faaf8100a80 0x7faaf81983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:16.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.123+0000 7faaf77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faaf8100a80 0x7faaf81983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59956/0 (socket says 172.21.15.2:59956) 2024-09-19T04:47:16.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.123+0000 7faaf77fe640 1 -- 172.21.15.2:0/2130102582 learned_addr learned my addr 172.21.15.2:0/2130102582 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:47:16.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.123+0000 7faaeeffd640 1 --2- 172.21.15.2:0/2130102582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faaf8101420 0x7faaf8198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:16.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.123+0000 7faaf7fff640 1 --2- 172.21.15.2:0/2130102582 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faaf8106a80 0x7faaf819ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:16.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.123+0000 7faaf77fe640 1 -- 172.21.15.2:0/2130102582 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faaf8106a80 msgr2=0x7faaf819ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:16.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.123+0000 7faaf77fe640 1 --2- 172.21.15.2:0/2130102582 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faaf8106a80 0x7faaf819ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:16.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.123+0000 7faaf77fe640 1 -- 172.21.15.2:0/2130102582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faaf8101420 msgr2=0x7faaf8198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:16.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.123+0000 7faaf77fe640 1 --2- 172.21.15.2:0/2130102582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faaf8101420 0x7faaf8198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:16.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.123+0000 7faaf77fe640 1 -- 172.21.15.2:0/2130102582 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaf819d3a0 con 0x7faaf8100a80 2024-09-19T04:47:16.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.123+0000 7faaf77fe640 1 --2- 172.21.15.2:0/2130102582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faaf8100a80 0x7faaf81983f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7faae8004770 tx=0x7faae80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:16.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.123+0000 7faaf57fa640 1 -- 172.21.15.2:0/2130102582 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae803f070 con 0x7faaf8100a80 2024-09-19T04:47:16.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.123+0000 7faafdb46640 1 -- 172.21.15.2:0/2130102582 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaf819d630 con 0x7faaf8100a80 2024-09-19T04:47:16.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.123+0000 7faaf57fa640 1 -- 172.21.15.2:0/2130102582 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7faae803b460 con 0x7faaf8100a80 2024-09-19T04:47:16.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.123+0000 7faaf57fa640 1 -- 172.21.15.2:0/2130102582 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae8035070 con 0x7faaf8100a80 2024-09-19T04:47:16.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.123+0000 7faafdb46640 1 -- 172.21.15.2:0/2130102582 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaf81a4f70 con 0x7faaf8100a80 2024-09-19T04:47:16.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.125+0000 7faafdb46640 1 -- 172.21.15.2:0/2130102582 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaf81021c0 con 0x7faaf8100a80 2024-09-19T04:47:16.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.126+0000 7faaf57fa640 1 -- 172.21.15.2:0/2130102582 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7faae803b610 con 0x7faaf8100a80 2024-09-19T04:47:16.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.127+0000 7faaf57fa640 1 --2- 172.21.15.2:0/2130102582 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7faae40a32d0 0x7faae40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:16.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.127+0000 7faaeeffd640 1 --2- 172.21.15.2:0/2130102582 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7faae40a32d0 0x7faae40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:16.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.127+0000 7faaf57fa640 1 -- 172.21.15.2:0/2130102582 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7faae80efee0 con 0x7faaf8100a80 2024-09-19T04:47:16.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.127+0000 7faaeeffd640 1 --2- 172.21.15.2:0/2130102582 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7faae40a32d0 0x7faae40a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7faae0005fd0 tx=0x7faae0005e20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:16.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.131+0000 7faaf57fa640 1 -- 172.21.15.2:0/2130102582 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7faae80bcad0 con 0x7faaf8100a80 2024-09-19T04:47:16.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.313+0000 7faafdb46640 1 -- 172.21.15.2:0/2130102582 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7faaf8108ff0 con 0x7faaf8100a80 2024-09-19T04:47:16.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.313+0000 7faaf57fa640 1 -- 172.21.15.2:0/2130102582 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7faae80bc3d0 con 0x7faaf8100a80 2024-09-19T04:47:16.316 INFO:teuthology.orchestra.run.smithi002.stdout:309237645335 2024-09-19T04:47:16.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.316+0000 7faafdb46640 1 -- 172.21.15.2:0/2130102582 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7faae40a32d0 msgr2=0x7faae40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:16.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.316+0000 7faafdb46640 1 --2- 172.21.15.2:0/2130102582 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7faae40a32d0 0x7faae40a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7faae0005fd0 tx=0x7faae0005e20 comp rx=0 tx=0).stop 2024-09-19T04:47:16.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.316+0000 7faafdb46640 1 -- 172.21.15.2:0/2130102582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faaf8100a80 msgr2=0x7faaf81983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:16.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.316+0000 7faafdb46640 1 --2- 172.21.15.2:0/2130102582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faaf8100a80 0x7faaf81983f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7faae8004770 tx=0x7faae80042f0 comp rx=0 tx=0).stop 2024-09-19T04:47:16.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.316+0000 7faafdb46640 1 -- 172.21.15.2:0/2130102582 shutdown_connections 2024-09-19T04:47:16.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.316+0000 7faafdb46640 1 --2- 172.21.15.2:0/2130102582 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7faae40a32d0 0x7faae40a5790 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:16.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.316+0000 7faafdb46640 1 --2- 172.21.15.2:0/2130102582 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faaf8106a80 0x7faaf819ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:16.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.316+0000 7faafdb46640 1 --2- 172.21.15.2:0/2130102582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faaf8101420 0x7faaf8198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:16.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.316+0000 7faafdb46640 1 --2- 172.21.15.2:0/2130102582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faaf8100a80 0x7faaf81983f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:16.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.316+0000 7faafdb46640 1 -- 172.21.15.2:0/2130102582 >> 172.21.15.2:0/2130102582 conn(0x7faaf80fc7a0 msgr2=0x7faaf80fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:16.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.316+0000 7faafdb46640 1 -- 172.21.15.2:0/2130102582 shutdown_connections 2024-09-19T04:47:16.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:16.316+0000 7faafdb46640 1 -- 172.21.15.2:0/2130102582 wait complete. 2024-09-19T04:47:16.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.128+0000 7f023b261640 1 -- 172.21.15.2:0/1882904985 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0234102790 msgr2=0x7f02341067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:16.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.128+0000 7f023b261640 1 --2- 172.21.15.2:0/1882904985 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0234102790 0x7f02341067e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0220009900 tx=0x7f022002a410 comp rx=0 tx=0).stop 2024-09-19T04:47:16.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.128+0000 7f023b261640 1 -- 172.21.15.2:0/1882904985 shutdown_connections 2024-09-19T04:47:16.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.128+0000 7f023b261640 1 --2- 172.21.15.2:0/1882904985 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0234106f10 0x7f023410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:16.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.128+0000 7f023b261640 1 --2- 172.21.15.2:0/1882904985 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0234102790 0x7f02341067e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:16.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.128+0000 7f023b261640 1 --2- 172.21.15.2:0/1882904985 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0234101de0 0x7f02341021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:16.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.128+0000 7f023b261640 1 -- 172.21.15.2:0/1882904985 >> 172.21.15.2:0/1882904985 conn(0x7f02340fd8c0 msgr2=0x7f02340ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:16.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.128+0000 7f023b261640 1 -- 172.21.15.2:0/1882904985 shutdown_connections 2024-09-19T04:47:16.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.128+0000 7f023b261640 1 -- 172.21.15.2:0/1882904985 wait complete. 2024-09-19T04:47:16.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.129+0000 7f023b261640 1 Processor -- start 2024-09-19T04:47:16.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.129+0000 7f023b261640 1 -- start start 2024-09-19T04:47:16.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.129+0000 7f023b261640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0234101de0 0x7f023419a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:16.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.129+0000 7f023b261640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0234102790 0x7f023419abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:16.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.129+0000 7f023b261640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0234106f10 0x7f023419ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:16.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.129+0000 7f023b261640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0234111e90 con 0x7f0234101de0 2024-09-19T04:47:16.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.129+0000 7f023b261640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0234111d10 con 0x7f0234106f10 2024-09-19T04:47:16.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.129+0000 7f023b261640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f0234112010 con 0x7f0234102790 2024-09-19T04:47:16.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.129+0000 7f0238ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0234101de0 0x7f023419a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:16.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.129+0000 7f0238ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0234101de0 0x7f023419a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59926/0 (socket says 172.21.15.2:59926) 2024-09-19T04:47:16.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.129+0000 7f0238ffd640 1 -- 172.21.15.2:0/3359355819 learned_addr learned my addr 172.21.15.2:0/3359355819 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:47:16.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.129+0000 7f0233fff640 1 --2- 172.21.15.2:0/3359355819 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0234102790 0x7f023419abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:16.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.129+0000 7f0238ffd640 1 -- 172.21.15.2:0/3359355819 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0234102790 msgr2=0x7f023419abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:16.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.129+0000 7f0238ffd640 1 --2- 172.21.15.2:0/3359355819 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0234102790 0x7f023419abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:16.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.129+0000 7f0238ffd640 1 -- 172.21.15.2:0/3359355819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0234106f10 msgr2=0x7f023419ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:16.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.129+0000 7f02397fe640 1 --2- 172.21.15.2:0/3359355819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0234106f10 0x7f023419ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:16.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.130+0000 7f0238ffd640 1 --2- 172.21.15.2:0/3359355819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0234106f10 0x7f023419ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:16.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.130+0000 7f0238ffd640 1 -- 172.21.15.2:0/3359355819 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f023419f640 con 0x7f0234101de0 2024-09-19T04:47:16.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.130+0000 7f02397fe640 1 --2- 172.21.15.2:0/3359355819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0234106f10 0x7f023419ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:47:16.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.130+0000 7f0238ffd640 1 --2- 172.21.15.2:0/3359355819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0234101de0 0x7f023419a690 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f022800d950 tx=0x7f022800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:16.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.130+0000 7f0231ffb640 1 -- 172.21.15.2:0/3359355819 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0228017030 con 0x7f0234101de0 2024-09-19T04:47:16.463 INFO:teuthology.orchestra.run.smithi002.stdout:128849018938 2024-09-19T04:47:16.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.130+0000 7f0231ffb640 1 -- 172.21.15.2:0/3359355819 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0228004020 con 0x7f0234101de0 2024-09-19T04:47:16.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.130+0000 7f023b261640 1 -- 172.21.15.2:0/3359355819 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f023419f930 con 0x7f0234101de0 2024-09-19T04:47:16.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.130+0000 7f0231ffb640 1 -- 172.21.15.2:0/3359355819 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02280047a0 con 0x7f0234101de0 2024-09-19T04:47:16.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.130+0000 7f023b261640 1 -- 172.21.15.2:0/3359355819 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02341a7210 con 0x7f0234101de0 2024-09-19T04:47:16.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.131+0000 7f023b261640 1 -- 172.21.15.2:0/3359355819 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02341021c0 con 0x7f0234101de0 2024-09-19T04:47:16.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.132+0000 7f0231ffb640 1 -- 172.21.15.2:0/3359355819 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f02280041d0 con 0x7f0234101de0 2024-09-19T04:47:16.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.133+0000 7f0231ffb640 1 --2- 172.21.15.2:0/3359355819 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f02240a32d0 0x7f02240a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:16.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.133+0000 7f0233fff640 1 --2- 172.21.15.2:0/3359355819 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f02240a32d0 0x7f02240a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:16.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.133+0000 7f0231ffb640 1 -- 172.21.15.2:0/3359355819 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f02280cf5b0 con 0x7f0234101de0 2024-09-19T04:47:16.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.133+0000 7f0233fff640 1 --2- 172.21.15.2:0/3359355819 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f02240a32d0 0x7f02240a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0220000c00 tx=0x7f0220031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:16.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.137+0000 7f0231ffb640 1 -- 172.21.15.2:0/3359355819 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f022809c1a0 con 0x7f0234101de0 2024-09-19T04:47:16.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.369+0000 7f023b261640 1 -- 172.21.15.2:0/3359355819 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f02341a73e0 con 0x7f0234101de0 2024-09-19T04:47:16.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.369+0000 7f0231ffb640 1 -- 172.21.15.2:0/3359355819 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f022809baa0 con 0x7f0234101de0 2024-09-19T04:47:16.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.371+0000 7f023b261640 1 -- 172.21.15.2:0/3359355819 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f02240a32d0 msgr2=0x7f02240a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:16.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.371+0000 7f023b261640 1 --2- 172.21.15.2:0/3359355819 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f02240a32d0 0x7f02240a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0220000c00 tx=0x7f0220031400 comp rx=0 tx=0).stop 2024-09-19T04:47:16.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.371+0000 7f023b261640 1 -- 172.21.15.2:0/3359355819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0234101de0 msgr2=0x7f023419a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:16.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.371+0000 7f023b261640 1 --2- 172.21.15.2:0/3359355819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0234101de0 0x7f023419a690 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f022800d950 tx=0x7f022800de10 comp rx=0 tx=0).stop 2024-09-19T04:47:16.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.371+0000 7f023b261640 1 -- 172.21.15.2:0/3359355819 shutdown_connections 2024-09-19T04:47:16.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.371+0000 7f023b261640 1 --2- 172.21.15.2:0/3359355819 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f02240a32d0 0x7f02240a5790 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:16.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.371+0000 7f023b261640 1 --2- 172.21.15.2:0/3359355819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0234106f10 0x7f023419ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:16.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.371+0000 7f023b261640 1 --2- 172.21.15.2:0/3359355819 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0234102790 0x7f023419abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:16.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.371+0000 7f023b261640 1 --2- 172.21.15.2:0/3359355819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0234101de0 0x7f023419a690 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:16.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.371+0000 7f023b261640 1 -- 172.21.15.2:0/3359355819 >> 172.21.15.2:0/3359355819 conn(0x7f02340fd8c0 msgr2=0x7f02340fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:16.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.371+0000 7f023b261640 1 -- 172.21.15.2:0/3359355819 shutdown_connections 2024-09-19T04:47:16.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.371+0000 7f023b261640 1 -- 172.21.15.2:0/3359355819 wait complete. 2024-09-19T04:47:16.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:16 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/2489845703' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T04:47:16.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:16 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/2130102582' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T04:47:16.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:16 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/2489845703' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T04:47:16.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:16 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/2130102582' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T04:47:16.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.041+0000 7f1e0144a640 1 -- 172.21.15.2:0/2316026663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1dfc100de0 msgr2=0x7f1dfc104e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:16.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.041+0000 7f1e0144a640 1 --2- 172.21.15.2:0/2316026663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1dfc100de0 0x7f1dfc104e30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1de400aa10 tx=0x7f1de402b720 comp rx=0 tx=0).stop 2024-09-19T04:47:16.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.041+0000 7f1e0144a640 1 -- 172.21.15.2:0/2316026663 shutdown_connections 2024-09-19T04:47:16.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.041+0000 7f1e0144a640 1 --2- 172.21.15.2:0/2316026663 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1dfc105560 0x7f1dfc10d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:16.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.041+0000 7f1e0144a640 1 --2- 172.21.15.2:0/2316026663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1dfc100de0 0x7f1dfc104e30 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:16.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.041+0000 7f1e0144a640 1 --2- 172.21.15.2:0/2316026663 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1dfc100430 0x7f1dfc100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:16.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.041+0000 7f1e0144a640 1 -- 172.21.15.2:0/2316026663 >> 172.21.15.2:0/2316026663 conn(0x7f1dfc077230 msgr2=0x7f1dfc0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:16.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.041+0000 7f1e0144a640 1 -- 172.21.15.2:0/2316026663 shutdown_connections 2024-09-19T04:47:16.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.041+0000 7f1e0144a640 1 -- 172.21.15.2:0/2316026663 wait complete. 2024-09-19T04:47:16.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.041+0000 7f1e0144a640 1 Processor -- start 2024-09-19T04:47:16.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.041+0000 7f1e0144a640 1 -- start start 2024-09-19T04:47:16.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.042+0000 7f1e0144a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1dfc100430 0x7f1dfc198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:16.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.042+0000 7f1e0144a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1dfc100de0 0x7f1dfc1988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:16.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.042+0000 7f1e0144a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1dfc105560 0x7f1dfc19cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:16.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.042+0000 7f1e0144a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1dfc10fc10 con 0x7f1dfc105560 2024-09-19T04:47:16.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.042+0000 7f1e0144a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1dfc10fa90 con 0x7f1dfc100de0 2024-09-19T04:47:16.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.042+0000 7f1e0144a640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f1dfc10fd90 con 0x7f1dfc100430 2024-09-19T04:47:16.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.042+0000 7f1dfb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1dfc105560 0x7f1dfc19cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:16.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.042+0000 7f1dfb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1dfc105560 0x7f1dfc19cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59898/0 (socket says 172.21.15.2:59898) 2024-09-19T04:47:16.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.042+0000 7f1dfb7fe640 1 -- 172.21.15.2:0/708515276 learned_addr learned my addr 172.21.15.2:0/708515276 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:47:16.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.042+0000 7f1df3fff640 1 --2- 172.21.15.2:0/708515276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1dfc100de0 0x7f1dfc1988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:16.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.042+0000 7f1dfaffd640 1 --2- 172.21.15.2:0/708515276 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1dfc100430 0x7f1dfc198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:16.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.042+0000 7f1dfb7fe640 1 -- 172.21.15.2:0/708515276 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1dfc100430 msgr2=0x7f1dfc198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:16.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.042+0000 7f1dfb7fe640 1 --2- 172.21.15.2:0/708515276 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1dfc100430 0x7f1dfc198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:16.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.042+0000 7f1dfb7fe640 1 -- 172.21.15.2:0/708515276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1dfc100de0 msgr2=0x7f1dfc1988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:16.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.042+0000 7f1dfb7fe640 1 --2- 172.21.15.2:0/708515276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1dfc100de0 0x7f1dfc1988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:16.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.042+0000 7f1dfb7fe640 1 -- 172.21.15.2:0/708515276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dfc19d320 con 0x7f1dfc105560 2024-09-19T04:47:16.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.042+0000 7f1dfb7fe640 1 --2- 172.21.15.2:0/708515276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1dfc105560 0x7f1dfc19cc40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1df400cce0 tx=0x7f1df400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:16.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.043+0000 7f1df8ff9640 1 -- 172.21.15.2:0/708515276 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df400f450 con 0x7f1dfc105560 2024-09-19T04:47:16.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.043+0000 7f1e0144a640 1 -- 172.21.15.2:0/708515276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dfc19d610 con 0x7f1dfc105560 2024-09-19T04:47:16.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.043+0000 7f1df8ff9640 1 -- 172.21.15.2:0/708515276 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1df400faa0 con 0x7f1dfc105560 2024-09-19T04:47:16.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.043+0000 7f1df8ff9640 1 -- 172.21.15.2:0/708515276 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df4018b70 con 0x7f1dfc105560 2024-09-19T04:47:16.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.043+0000 7f1e0144a640 1 -- 172.21.15.2:0/708515276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dfc1a4ef0 con 0x7f1dfc105560 2024-09-19T04:47:16.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.045+0000 7f1e0144a640 1 -- 172.21.15.2:0/708515276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dfc100810 con 0x7f1dfc105560 2024-09-19T04:47:16.824 INFO:teuthology.orchestra.run.smithi002.stdout:34359738445 2024-09-19T04:47:16.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.045+0000 7f1df8ff9640 1 -- 172.21.15.2:0/708515276 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f1df4018d10 con 0x7f1dfc105560 2024-09-19T04:47:16.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.046+0000 7f1df8ff9640 1 --2- 172.21.15.2:0/708515276 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f1de80a32d0 0x7f1de80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:16.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.046+0000 7f1dfaffd640 1 --2- 172.21.15.2:0/708515276 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f1de80a32d0 0x7f1de80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:16.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.046+0000 7f1df8ff9640 1 -- 172.21.15.2:0/708515276 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f1df40cff00 con 0x7f1dfc105560 2024-09-19T04:47:16.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.046+0000 7f1dfaffd640 1 --2- 172.21.15.2:0/708515276 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f1de80a32d0 0x7f1de80a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1dec009890 tx=0x7f1dec008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:16.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.050+0000 7f1df8ff9640 1 -- 172.21.15.2:0/708515276 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1df4014030 con 0x7f1dfc105560 2024-09-19T04:47:16.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.290+0000 7f1e0144a640 1 -- 172.21.15.2:0/708515276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f1dfc10a1c0 con 0x7f1dfc105560 2024-09-19T04:47:16.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.291+0000 7f1df8ff9640 1 -- 172.21.15.2:0/708515276 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1df409caf0 con 0x7f1dfc105560 2024-09-19T04:47:16.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.293+0000 7f1e0144a640 1 -- 172.21.15.2:0/708515276 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f1de80a32d0 msgr2=0x7f1de80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:16.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.293+0000 7f1e0144a640 1 --2- 172.21.15.2:0/708515276 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f1de80a32d0 0x7f1de80a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1dec009890 tx=0x7f1dec008040 comp rx=0 tx=0).stop 2024-09-19T04:47:16.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.293+0000 7f1e0144a640 1 -- 172.21.15.2:0/708515276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1dfc105560 msgr2=0x7f1dfc19cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:16.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.293+0000 7f1e0144a640 1 --2- 172.21.15.2:0/708515276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1dfc105560 0x7f1dfc19cc40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1df400cce0 tx=0x7f1df400a620 comp rx=0 tx=0).stop 2024-09-19T04:47:16.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.293+0000 7f1e0144a640 1 -- 172.21.15.2:0/708515276 shutdown_connections 2024-09-19T04:47:16.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.293+0000 7f1e0144a640 1 --2- 172.21.15.2:0/708515276 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f1de80a32d0 0x7f1de80a5790 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:16.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.293+0000 7f1e0144a640 1 --2- 172.21.15.2:0/708515276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1dfc105560 0x7f1dfc19cc40 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:16.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.293+0000 7f1e0144a640 1 --2- 172.21.15.2:0/708515276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1dfc100de0 0x7f1dfc1988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:16.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.293+0000 7f1e0144a640 1 --2- 172.21.15.2:0/708515276 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1dfc100430 0x7f1dfc198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:16.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.293+0000 7f1e0144a640 1 -- 172.21.15.2:0/708515276 >> 172.21.15.2:0/708515276 conn(0x7f1dfc077230 msgr2=0x7f1dfc103d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:16.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.293+0000 7f1e0144a640 1 -- 172.21.15.2:0/708515276 shutdown_connections 2024-09-19T04:47:16.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:14.293+0000 7f1e0144a640 1 -- 172.21.15.2:0/708515276 wait complete. 2024-09-19T04:47:16.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:16 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/2489845703' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T04:47:16.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:16 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/2130102582' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T04:47:17.376 INFO:tasks.cephadm.ceph_manager.ceph:need seq 261993005088 got 261993005089 for osd.9 2024-09-19T04:47:17.377 DEBUG:teuthology.parallel:result is None 2024-09-19T04:47:17.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.533+0000 7f760cb54640 1 -- 172.21.15.2:0/1883807381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7608106f10 msgr2=0x7f760810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:17.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.533+0000 7f760cb54640 1 --2- 172.21.15.2:0/1883807381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7608106f10 0x7f760810ea90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7600009ca0 tx=0x7f760002a8c0 comp rx=0 tx=0).stop 2024-09-19T04:47:17.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.533+0000 7f760cb54640 1 -- 172.21.15.2:0/1883807381 shutdown_connections 2024-09-19T04:47:17.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.533+0000 7f760cb54640 1 --2- 172.21.15.2:0/1883807381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7608106f10 0x7f760810ea90 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:17.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.533+0000 7f760cb54640 1 --2- 172.21.15.2:0/1883807381 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7608102790 0x7f76081067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:17.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.533+0000 7f760cb54640 1 --2- 172.21.15.2:0/1883807381 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7608101de0 0x7f76081021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:17.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.533+0000 7f760cb54640 1 -- 172.21.15.2:0/1883807381 >> 172.21.15.2:0/1883807381 conn(0x7f76080fd8c0 msgr2=0x7f76080ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:17.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.533+0000 7f760cb54640 1 -- 172.21.15.2:0/1883807381 shutdown_connections 2024-09-19T04:47:17.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.533+0000 7f760cb54640 1 -- 172.21.15.2:0/1883807381 wait complete. 2024-09-19T04:47:17.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.534+0000 7f760cb54640 1 Processor -- start 2024-09-19T04:47:17.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.534+0000 7f760cb54640 1 -- start start 2024-09-19T04:47:17.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.534+0000 7f760cb54640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7608101de0 0x7f7608198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:17.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.534+0000 7f760cb54640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7608102790 0x7f7608198780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:17.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.534+0000 7f760cb54640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7608106f10 0x7f760819cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:17.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.534+0000 7f760cb54640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7608111e20 con 0x7f7608106f10 2024-09-19T04:47:17.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.534+0000 7f760cb54640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7608111ca0 con 0x7f7608102790 2024-09-19T04:47:17.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.534+0000 7f760cb54640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f7608111fa0 con 0x7f7608101de0 2024-09-19T04:47:17.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.534+0000 7f7606d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7608106f10 0x7f760819cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:17.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.534+0000 7f7606d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7608106f10 0x7f760819cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59974/0 (socket says 172.21.15.2:59974) 2024-09-19T04:47:17.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.534+0000 7f7606d9d640 1 -- 172.21.15.2:0/1160188314 learned_addr learned my addr 172.21.15.2:0/1160188314 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:47:17.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.535+0000 7f760659c640 1 --2- 172.21.15.2:0/1160188314 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7608101de0 0x7f7608198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:17.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.535+0000 7f7605d9b640 1 --2- 172.21.15.2:0/1160188314 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7608102790 0x7f7608198780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:17.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.535+0000 7f7606d9d640 1 -- 172.21.15.2:0/1160188314 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7608101de0 msgr2=0x7f7608198240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:17.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.535+0000 7f7606d9d640 1 --2- 172.21.15.2:0/1160188314 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7608101de0 0x7f7608198240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:17.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.535+0000 7f7606d9d640 1 -- 172.21.15.2:0/1160188314 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7608102790 msgr2=0x7f7608198780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:17.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.535+0000 7f7606d9d640 1 --2- 172.21.15.2:0/1160188314 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7608102790 0x7f7608198780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:17.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.535+0000 7f7606d9d640 1 -- 172.21.15.2:0/1160188314 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f760819d1f0 con 0x7f7608106f10 2024-09-19T04:47:17.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.535+0000 7f760659c640 1 --2- 172.21.15.2:0/1160188314 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7608101de0 0x7f7608198240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:47:17.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.535+0000 7f7605d9b640 1 --2- 172.21.15.2:0/1160188314 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7608102790 0x7f7608198780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:47:17.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.535+0000 7f7606d9d640 1 --2- 172.21.15.2:0/1160188314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7608106f10 0x7f760819cb10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7600009dc0 tx=0x7f7600003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:17.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.535+0000 7f75f77fe640 1 -- 172.21.15.2:0/1160188314 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7600004040 con 0x7f7608106f10 2024-09-19T04:47:17.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.535+0000 7f75f77fe640 1 -- 172.21.15.2:0/1160188314 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7600004690 con 0x7f7608106f10 2024-09-19T04:47:17.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.535+0000 7f760cb54640 1 -- 172.21.15.2:0/1160188314 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f760819d480 con 0x7f7608106f10 2024-09-19T04:47:17.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.535+0000 7f75f77fe640 1 -- 172.21.15.2:0/1160188314 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7600030d90 con 0x7f7608106f10 2024-09-19T04:47:17.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.535+0000 7f760cb54640 1 -- 172.21.15.2:0/1160188314 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76081a4dc0 con 0x7f7608106f10 2024-09-19T04:47:17.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.536+0000 7f760cb54640 1 -- 172.21.15.2:0/1160188314 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76081021c0 con 0x7f7608106f10 2024-09-19T04:47:17.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.537+0000 7f75f77fe640 1 -- 172.21.15.2:0/1160188314 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f76000305c0 con 0x7f7608106f10 2024-09-19T04:47:17.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.538+0000 7f75f77fe640 1 --2- 172.21.15.2:0/1160188314 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f75f00a32d0 0x7f75f00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:17.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.538+0000 7f760659c640 1 --2- 172.21.15.2:0/1160188314 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f75f00a32d0 0x7f75f00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:17.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.538+0000 7f75f77fe640 1 -- 172.21.15.2:0/1160188314 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f76000f13d0 con 0x7f7608106f10 2024-09-19T04:47:17.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.539+0000 7f760659c640 1 --2- 172.21.15.2:0/1160188314 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f75f00a32d0 0x7f75f00a5790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f75f800baa0 tx=0x7f75f8005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:17.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.541+0000 7f75f77fe640 1 -- 172.21.15.2:0/1160188314 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f76000be0d0 con 0x7f7608106f10 2024-09-19T04:47:17.708 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:17 smithi018 ceph-mon[34537]: pgmap v300: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T04:47:17.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.720+0000 7f760cb54640 1 -- 172.21.15.2:0/1160188314 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f76081995a0 con 0x7f7608106f10 2024-09-19T04:47:17.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:17 smithi002 ceph-mon[30975]: pgmap v300: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T04:47:17.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.720+0000 7f75f77fe640 1 -- 172.21.15.2:0/1160188314 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f76081995a0 con 0x7f7608106f10 2024-09-19T04:47:17.723 INFO:teuthology.orchestra.run.smithi002.stdout:98784247872 2024-09-19T04:47:17.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.722+0000 7f760cb54640 1 -- 172.21.15.2:0/1160188314 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f75f00a32d0 msgr2=0x7f75f00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:17.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.722+0000 7f760cb54640 1 --2- 172.21.15.2:0/1160188314 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f75f00a32d0 0x7f75f00a5790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f75f800baa0 tx=0x7f75f8005d90 comp rx=0 tx=0).stop 2024-09-19T04:47:17.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.722+0000 7f760cb54640 1 -- 172.21.15.2:0/1160188314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7608106f10 msgr2=0x7f760819cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:17.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.722+0000 7f760cb54640 1 --2- 172.21.15.2:0/1160188314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7608106f10 0x7f760819cb10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7600009dc0 tx=0x7f7600003ba0 comp rx=0 tx=0).stop 2024-09-19T04:47:17.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.722+0000 7f760cb54640 1 -- 172.21.15.2:0/1160188314 shutdown_connections 2024-09-19T04:47:17.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.722+0000 7f760cb54640 1 --2- 172.21.15.2:0/1160188314 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f75f00a32d0 0x7f75f00a5790 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:17.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.722+0000 7f760cb54640 1 --2- 172.21.15.2:0/1160188314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7608106f10 0x7f760819cb10 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:17.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.722+0000 7f760cb54640 1 --2- 172.21.15.2:0/1160188314 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7608102790 0x7f7608198780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:17.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.722+0000 7f760cb54640 1 --2- 172.21.15.2:0/1160188314 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7608101de0 0x7f7608198240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:17.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.722+0000 7f760cb54640 1 -- 172.21.15.2:0/1160188314 >> 172.21.15.2:0/1160188314 conn(0x7f76080fd8c0 msgr2=0x7f76080fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:17.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.722+0000 7f760cb54640 1 -- 172.21.15.2:0/1160188314 shutdown_connections 2024-09-19T04:47:17.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:17.722+0000 7f760cb54640 1 -- 172.21.15.2:0/1160188314 wait complete. 2024-09-19T04:47:17.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:17 smithi116 ceph-mon[34477]: pgmap v300: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T04:47:18.185 INFO:tasks.cephadm.ceph_manager.ceph:need seq 309237645332 got 309237645335 for osd.11 2024-09-19T04:47:18.185 DEBUG:teuthology.parallel:result is None 2024-09-19T04:47:18.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.477+0000 7f1b89426640 1 -- 172.21.15.2:0/2602022726 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1b84103670 msgr2=0x7f1b8410bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:18.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.477+0000 7f1b89426640 1 --2- 172.21.15.2:0/2602022726 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1b84103670 0x7f1b8410bb60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1b78009860 tx=0x7f1b7802a3d0 comp rx=0 tx=0).stop 2024-09-19T04:47:18.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.477+0000 7f1b89426640 1 -- 172.21.15.2:0/2602022726 shutdown_connections 2024-09-19T04:47:18.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.477+0000 7f1b89426640 1 --2- 172.21.15.2:0/2602022726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b8410c180 0x7f1b8410e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:18.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.477+0000 7f1b89426640 1 --2- 172.21.15.2:0/2602022726 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1b84103670 0x7f1b8410bb60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:18.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.477+0000 7f1b89426640 1 --2- 172.21.15.2:0/2602022726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b84102d50 0x7f1b84103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:18.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.477+0000 7f1b89426640 1 -- 172.21.15.2:0/2602022726 >> 172.21.15.2:0/2602022726 conn(0x7f1b840fc7d0 msgr2=0x7f1b840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:18.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.477+0000 7f1b89426640 1 -- 172.21.15.2:0/2602022726 shutdown_connections 2024-09-19T04:47:18.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.477+0000 7f1b89426640 1 -- 172.21.15.2:0/2602022726 wait complete. 2024-09-19T04:47:18.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.477+0000 7f1b89426640 1 Processor -- start 2024-09-19T04:47:18.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.478+0000 7f1b89426640 1 -- start start 2024-09-19T04:47:18.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.478+0000 7f1b89426640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b84102d50 0x7f1b841009b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:18.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.478+0000 7f1b89426640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b84103670 0x7f1b84100ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:18.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.478+0000 7f1b89426640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1b8410c180 0x7f1b84101430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:18.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.478+0000 7f1b89426640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1b84111e30 con 0x7f1b84102d50 2024-09-19T04:47:18.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.478+0000 7f1b89426640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1b84111cb0 con 0x7f1b84103670 2024-09-19T04:47:18.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.478+0000 7f1b89426640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f1b84111fb0 con 0x7f1b8410c180 2024-09-19T04:47:18.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.478+0000 7f1b82ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b84102d50 0x7f1b841009b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:18.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.478+0000 7f1b82ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b84102d50 0x7f1b841009b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59978/0 (socket says 172.21.15.2:59978) 2024-09-19T04:47:18.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.478+0000 7f1b82ffd640 1 -- 172.21.15.2:0/468362581 learned_addr learned my addr 172.21.15.2:0/468362581 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:47:18.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.478+0000 7f1b837fe640 1 --2- 172.21.15.2:0/468362581 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1b8410c180 0x7f1b84101430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:18.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.478+0000 7f1b827fc640 1 --2- 172.21.15.2:0/468362581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b84103670 0x7f1b84100ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:18.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.479+0000 7f1b82ffd640 1 -- 172.21.15.2:0/468362581 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1b8410c180 msgr2=0x7f1b84101430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:18.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.479+0000 7f1b82ffd640 1 --2- 172.21.15.2:0/468362581 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1b8410c180 0x7f1b84101430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:18.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.479+0000 7f1b82ffd640 1 -- 172.21.15.2:0/468362581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b84103670 msgr2=0x7f1b84100ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:18.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.479+0000 7f1b82ffd640 1 --2- 172.21.15.2:0/468362581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b84103670 0x7f1b84100ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:18.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.479+0000 7f1b82ffd640 1 -- 172.21.15.2:0/468362581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b841a68d0 con 0x7f1b84102d50 2024-09-19T04:47:18.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.479+0000 7f1b837fe640 1 --2- 172.21.15.2:0/468362581 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1b8410c180 0x7f1b84101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:47:18.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.479+0000 7f1b82ffd640 1 --2- 172.21.15.2:0/468362581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b84102d50 0x7f1b841009b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1b7400e9f0 tx=0x7f1b7400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:18.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.479+0000 7f1b6bfff640 1 -- 172.21.15.2:0/468362581 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7400cd80 con 0x7f1b84102d50 2024-09-19T04:47:18.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.479+0000 7f1b6bfff640 1 -- 172.21.15.2:0/468362581 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1b740108e0 con 0x7f1b84102d50 2024-09-19T04:47:18.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.479+0000 7f1b89426640 1 -- 172.21.15.2:0/468362581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b841a6bc0 con 0x7f1b84102d50 2024-09-19T04:47:18.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.479+0000 7f1b6bfff640 1 -- 172.21.15.2:0/468362581 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b74018920 con 0x7f1b84102d50 2024-09-19T04:47:18.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.479+0000 7f1b89426640 1 -- 172.21.15.2:0/468362581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b841a70b0 con 0x7f1b84102d50 2024-09-19T04:47:18.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.481+0000 7f1b89426640 1 -- 172.21.15.2:0/468362581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b84103130 con 0x7f1b84102d50 2024-09-19T04:47:18.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.482+0000 7f1b6bfff640 1 -- 172.21.15.2:0/468362581 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f1b74010a90 con 0x7f1b84102d50 2024-09-19T04:47:18.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.482+0000 7f1b6bfff640 1 --2- 172.21.15.2:0/468362581 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f1b6c0a32d0 0x7f1b6c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:18.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.483+0000 7f1b827fc640 1 --2- 172.21.15.2:0/468362581 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f1b6c0a32d0 0x7f1b6c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:18.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.483+0000 7f1b6bfff640 1 -- 172.21.15.2:0/468362581 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f1b740cfd40 con 0x7f1b84102d50 2024-09-19T04:47:18.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.483+0000 7f1b827fc640 1 --2- 172.21.15.2:0/468362581 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f1b6c0a32d0 0x7f1b6c0a5790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1b84102440 tx=0x7f1b780094b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:18.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.490+0000 7f1b6bfff640 1 -- 172.21.15.2:0/468362581 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1b7409c2e0 con 0x7f1b84102d50 2024-09-19T04:47:18.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.666+0000 7f1b89426640 1 -- 172.21.15.2:0/468362581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f1b841071f0 con 0x7f1b84102d50 2024-09-19T04:47:18.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.666+0000 7f1b6bfff640 1 -- 172.21.15.2:0/468362581 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1b740a05e0 con 0x7f1b84102d50 2024-09-19T04:47:18.669 INFO:teuthology.orchestra.run.smithi002.stdout:68719476805 2024-09-19T04:47:18.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.668+0000 7f1b89426640 1 -- 172.21.15.2:0/468362581 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f1b6c0a32d0 msgr2=0x7f1b6c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:18.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.668+0000 7f1b89426640 1 --2- 172.21.15.2:0/468362581 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f1b6c0a32d0 0x7f1b6c0a5790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1b84102440 tx=0x7f1b780094b0 comp rx=0 tx=0).stop 2024-09-19T04:47:18.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.668+0000 7f1b89426640 1 -- 172.21.15.2:0/468362581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b84102d50 msgr2=0x7f1b841009b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:18.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.668+0000 7f1b89426640 1 --2- 172.21.15.2:0/468362581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b84102d50 0x7f1b841009b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1b7400e9f0 tx=0x7f1b7400eeb0 comp rx=0 tx=0).stop 2024-09-19T04:47:18.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.668+0000 7f1b89426640 1 -- 172.21.15.2:0/468362581 shutdown_connections 2024-09-19T04:47:18.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.668+0000 7f1b89426640 1 --2- 172.21.15.2:0/468362581 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f1b6c0a32d0 0x7f1b6c0a5790 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:18.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.668+0000 7f1b89426640 1 --2- 172.21.15.2:0/468362581 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1b8410c180 0x7f1b84101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:18.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.668+0000 7f1b89426640 1 --2- 172.21.15.2:0/468362581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1b84103670 0x7f1b84100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:18.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.668+0000 7f1b89426640 1 --2- 172.21.15.2:0/468362581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b84102d50 0x7f1b841009b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:18.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.668+0000 7f1b89426640 1 -- 172.21.15.2:0/468362581 >> 172.21.15.2:0/468362581 conn(0x7f1b840fc7d0 msgr2=0x7f1b840fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:18.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.668+0000 7f1b89426640 1 -- 172.21.15.2:0/468362581 shutdown_connections 2024-09-19T04:47:18.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:18.668+0000 7f1b89426640 1 -- 172.21.15.2:0/468362581 wait complete. 2024-09-19T04:47:18.786 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:18 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/1160188314' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T04:47:18.786 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:18 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:47:18.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:18 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/1160188314' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T04:47:18.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:18 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:47:18.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:18 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/1160188314' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T04:47:18.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:18 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:47:18.913 INFO:tasks.cephadm.ceph_manager.ceph:need seq 231928234019 got 231928234022 for osd.8 2024-09-19T04:47:18.913 DEBUG:teuthology.parallel:result is None 2024-09-19T04:47:19.516 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:19 smithi002 ceph-mon[30975]: pgmap v301: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:47:19.516 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:19 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/468362581' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T04:47:19.553 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738444 got 34359738445 for osd.0 2024-09-19T04:47:19.553 DEBUG:teuthology.parallel:result is None 2024-09-19T04:47:19.556 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:19 smithi018 ceph-mon[34537]: pgmap v301: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:47:19.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:19 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/468362581' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T04:47:19.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:19 smithi116 ceph-mon[34477]: pgmap v301: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:47:19.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:19 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/468362581' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T04:47:19.898 INFO:tasks.cephadm.ceph_manager.ceph:need seq 68719476802 got 68719476805 for osd.2 2024-09-19T04:47:19.898 DEBUG:teuthology.parallel:result is None 2024-09-19T04:47:20.310 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018935 got 128849018938 for osd.4 2024-09-19T04:47:20.310 DEBUG:teuthology.parallel:result is None 2024-09-19T04:47:20.647 INFO:tasks.cephadm.ceph_manager.ceph:need seq 98784247868 got 98784247872 for osd.3 2024-09-19T04:47:20.647 DEBUG:teuthology.parallel:result is None 2024-09-19T04:47:21.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:20 smithi018 ceph-mon[34537]: pgmap v302: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T04:47:21.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:20 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:47:21.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:20 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:47:21.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:20 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:47:21.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:20 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:47:21.085 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:20 smithi002 ceph-mon[30975]: pgmap v302: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T04:47:21.085 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:20 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:47:21.085 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:20 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:47:21.085 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:20 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:47:21.085 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:20 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:47:21.110 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:20 smithi116 ceph-mon[34477]: pgmap v302: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T04:47:21.110 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:20 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:47:21.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:20 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:47:21.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:20 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:47:21.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:20 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:47:21.118 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462954 got 201863462954 for osd.7 2024-09-19T04:47:21.118 DEBUG:teuthology.parallel:result is None 2024-09-19T04:47:21.191 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:47:21.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.629+0000 7f7351934640 1 -- 172.21.15.2:0/1835490413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f734c101de0 msgr2=0x7f734c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:21.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.629+0000 7f7351934640 1 --2- 172.21.15.2:0/1835490413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f734c101de0 0x7f734c1021c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f733c009900 tx=0x7f733c02a410 comp rx=0 tx=0).stop 2024-09-19T04:47:21.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.629+0000 7f7351934640 1 -- 172.21.15.2:0/1835490413 shutdown_connections 2024-09-19T04:47:21.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.629+0000 7f7351934640 1 --2- 172.21.15.2:0/1835490413 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f734c106f10 0x7f734c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:21.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.629+0000 7f7351934640 1 --2- 172.21.15.2:0/1835490413 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f734c102790 0x7f734c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:21.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.629+0000 7f7351934640 1 --2- 172.21.15.2:0/1835490413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f734c101de0 0x7f734c1021c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:21.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.629+0000 7f7351934640 1 -- 172.21.15.2:0/1835490413 >> 172.21.15.2:0/1835490413 conn(0x7f734c0fd8c0 msgr2=0x7f734c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:21.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.629+0000 7f7351934640 1 -- 172.21.15.2:0/1835490413 shutdown_connections 2024-09-19T04:47:21.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.629+0000 7f7351934640 1 -- 172.21.15.2:0/1835490413 wait complete. 2024-09-19T04:47:21.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.629+0000 7f7351934640 1 Processor -- start 2024-09-19T04:47:21.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.630+0000 7f7351934640 1 -- start start 2024-09-19T04:47:21.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.630+0000 7f7351934640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f734c101de0 0x7f734c198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:21.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.630+0000 7f7351934640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f734c102790 0x7f734c198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:21.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.630+0000 7f7351934640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f734c106f10 0x7f734c19ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:21.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.630+0000 7f7351934640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f734c111ec0 con 0x7f734c102790 2024-09-19T04:47:21.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.630+0000 7f7351934640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f734c111d40 con 0x7f734c106f10 2024-09-19T04:47:21.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.630+0000 7f7351934640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f734c112040 con 0x7f734c101de0 2024-09-19T04:47:21.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.630+0000 7f7343fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f734c102790 0x7f734c198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:21.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.630+0000 7f7343fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f734c102790 0x7f734c198ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51850/0 (socket says 172.21.15.2:51850) 2024-09-19T04:47:21.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.630+0000 7f7343fff640 1 -- 172.21.15.2:0/931853529 learned_addr learned my addr 172.21.15.2:0/931853529 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:47:21.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.630+0000 7f734b7fe640 1 --2- 172.21.15.2:0/931853529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f734c106f10 0x7f734c19ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:21.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.630+0000 7f734affd640 1 --2- 172.21.15.2:0/931853529 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f734c101de0 0x7f734c198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:21.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.630+0000 7f7343fff640 1 -- 172.21.15.2:0/931853529 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f734c101de0 msgr2=0x7f734c198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:21.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.630+0000 7f7343fff640 1 --2- 172.21.15.2:0/931853529 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f734c101de0 0x7f734c198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:21.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.630+0000 7f7343fff640 1 -- 172.21.15.2:0/931853529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f734c106f10 msgr2=0x7f734c19ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:21.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.630+0000 7f7343fff640 1 --2- 172.21.15.2:0/931853529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f734c106f10 0x7f734c19ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:21.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.630+0000 7f7343fff640 1 -- 172.21.15.2:0/931853529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f734c19d540 con 0x7f734c102790 2024-09-19T04:47:21.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.630+0000 7f734b7fe640 1 --2- 172.21.15.2:0/931853529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f734c106f10 0x7f734c19ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:47:21.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.630+0000 7f734affd640 1 --2- 172.21.15.2:0/931853529 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f734c101de0 0x7f734c198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:47:21.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.630+0000 7f7343fff640 1 --2- 172.21.15.2:0/931853529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f734c102790 0x7f734c198ad0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f733400b4a0 tx=0x7f733400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:21.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.631+0000 7f7350932640 1 -- 172.21.15.2:0/931853529 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7334014070 con 0x7f734c102790 2024-09-19T04:47:21.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.631+0000 7f7350932640 1 -- 172.21.15.2:0/931853529 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7334010ac0 con 0x7f734c102790 2024-09-19T04:47:21.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.631+0000 7f7351934640 1 -- 172.21.15.2:0/931853529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f734c19d830 con 0x7f734c102790 2024-09-19T04:47:21.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.631+0000 7f7350932640 1 -- 172.21.15.2:0/931853529 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7334017c30 con 0x7f734c102790 2024-09-19T04:47:21.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.631+0000 7f7351934640 1 -- 172.21.15.2:0/931853529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f734c1a5110 con 0x7f734c102790 2024-09-19T04:47:21.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.632+0000 7f7351934640 1 -- 172.21.15.2:0/931853529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f734c102240 con 0x7f734c102790 2024-09-19T04:47:21.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.633+0000 7f7350932640 1 -- 172.21.15.2:0/931853529 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f7334017070 con 0x7f734c102790 2024-09-19T04:47:21.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.634+0000 7f7350932640 1 --2- 172.21.15.2:0/931853529 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f73380a3350 0x7f73380a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:21.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.634+0000 7f734affd640 1 --2- 172.21.15.2:0/931853529 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f73380a3350 0x7f73380a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:21.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.634+0000 7f7350932640 1 -- 172.21.15.2:0/931853529 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f73340ced60 con 0x7f734c102790 2024-09-19T04:47:21.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.634+0000 7f734affd640 1 --2- 172.21.15.2:0/931853529 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f73380a3350 0x7f73380a5810 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f733c000c00 tx=0x7f733c031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:21.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.638+0000 7f7350932640 1 -- 172.21.15.2:0/931853529 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f733409ba60 con 0x7f734c102790 2024-09-19T04:47:21.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.818+0000 7f7351934640 1 -- 172.21.15.2:0/931853529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f734c109b60 con 0x7f734c102790 2024-09-19T04:47:21.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.818+0000 7f7350932640 1 -- 172.21.15.2:0/931853529 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f733409b360 con 0x7f734c102790 2024-09-19T04:47:21.820 INFO:teuthology.orchestra.run.smithi002.stdout:180388626482 2024-09-19T04:47:21.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.820+0000 7f7351934640 1 -- 172.21.15.2:0/931853529 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f73380a3350 msgr2=0x7f73380a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:21.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.820+0000 7f7351934640 1 --2- 172.21.15.2:0/931853529 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f73380a3350 0x7f73380a5810 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f733c000c00 tx=0x7f733c031400 comp rx=0 tx=0).stop 2024-09-19T04:47:21.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.820+0000 7f7351934640 1 -- 172.21.15.2:0/931853529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f734c102790 msgr2=0x7f734c198ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:21.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.820+0000 7f7351934640 1 --2- 172.21.15.2:0/931853529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f734c102790 0x7f734c198ad0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f733400b4a0 tx=0x7f733400b960 comp rx=0 tx=0).stop 2024-09-19T04:47:21.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.820+0000 7f7351934640 1 -- 172.21.15.2:0/931853529 shutdown_connections 2024-09-19T04:47:21.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.820+0000 7f7351934640 1 --2- 172.21.15.2:0/931853529 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f73380a3350 0x7f73380a5810 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:21.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.820+0000 7f7351934640 1 --2- 172.21.15.2:0/931853529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f734c106f10 0x7f734c19ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:21.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.820+0000 7f7351934640 1 --2- 172.21.15.2:0/931853529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f734c102790 0x7f734c198ad0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:21.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.820+0000 7f7351934640 1 --2- 172.21.15.2:0/931853529 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f734c101de0 0x7f734c198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:21.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.820+0000 7f7351934640 1 -- 172.21.15.2:0/931853529 >> 172.21.15.2:0/931853529 conn(0x7f734c0fd8c0 msgr2=0x7f734c0fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:21.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.821+0000 7f7351934640 1 -- 172.21.15.2:0/931853529 shutdown_connections 2024-09-19T04:47:21.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:21.821+0000 7f7351934640 1 -- 172.21.15.2:0/931853529 wait complete. 2024-09-19T04:47:23.037 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:22 smithi002 ceph-mon[30975]: pgmap v303: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:47:23.038 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:22 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/931853529' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T04:47:23.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:22 smithi018 ceph-mon[34537]: pgmap v303: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:47:23.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:22 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/931853529' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T04:47:23.071 INFO:tasks.cephadm.ceph_manager.ceph:need seq 180388626479 got 180388626482 for osd.6 2024-09-19T04:47:23.071 DEBUG:teuthology.parallel:result is None 2024-09-19T04:47:23.071 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T04:47:23.071 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T04:47:23.110 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:22 smithi116 ceph-mon[34477]: pgmap v303: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:47:23.110 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:22 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/931853529' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T04:47:23.355 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:47:23.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:23.813+0000 7f5550a62640 1 -- 172.21.15.2:0/2289307151 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f554c100480 msgr2=0x7f554c100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:23.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:23.813+0000 7f5550a62640 1 --2- 172.21.15.2:0/2289307151 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f554c100480 0x7f554c100860 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f553c009900 tx=0x7f553c02a410 comp rx=0 tx=0).stop 2024-09-19T04:47:23.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:23.813+0000 7f5550a62640 1 -- 172.21.15.2:0/2289307151 shutdown_connections 2024-09-19T04:47:23.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:23.813+0000 7f5550a62640 1 --2- 172.21.15.2:0/2289307151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f554c1055b0 0x7f554c10d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:23.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:23.813+0000 7f5550a62640 1 --2- 172.21.15.2:0/2289307151 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f554c100e30 0x7f554c104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:23.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:23.813+0000 7f5550a62640 1 --2- 172.21.15.2:0/2289307151 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f554c100480 0x7f554c100860 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:23.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:23.813+0000 7f5550a62640 1 -- 172.21.15.2:0/2289307151 >> 172.21.15.2:0/2289307151 conn(0x7f554c077210 msgr2=0x7f554c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:23.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:23.813+0000 7f5550a62640 1 -- 172.21.15.2:0/2289307151 shutdown_connections 2024-09-19T04:47:23.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:23.813+0000 7f5550a62640 1 -- 172.21.15.2:0/2289307151 wait complete. 2024-09-19T04:47:23.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:23.814+0000 7f5550a62640 1 Processor -- start 2024-09-19T04:47:23.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:23.814+0000 7f5550a62640 1 -- start start 2024-09-19T04:47:23.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:23.814+0000 7f5550a62640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f554c100480 0x7f554c0fc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:23.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:23.814+0000 7f5550a62640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f554c100e30 0x7f554c0fcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:23.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:23.814+0000 7f5550a62640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f554c1055b0 0x7f554c0fd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:23.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:23.814+0000 7f5550a62640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f554c10fc90 con 0x7f554c1055b0 2024-09-19T04:47:23.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:23.814+0000 7f5550a62640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f554c10fb10 con 0x7f554c100e30 2024-09-19T04:47:23.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:23.814+0000 7f5550a62640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f554c10fe10 con 0x7f554c100480 2024-09-19T04:47:23.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:23.815+0000 7f554ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f554c1055b0 0x7f554c0fd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:23.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:23.815+0000 7f5549d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f554c100e30 0x7f554c0fcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:23.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:23.815+0000 7f554ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f554c1055b0 0x7f554c0fd110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51878/0 (socket says 172.21.15.2:51878) 2024-09-19T04:47:23.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:23.815+0000 7f554ad9d640 1 -- 172.21.15.2:0/216184497 learned_addr learned my addr 172.21.15.2:0/216184497 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:47:23.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:23.815+0000 7f554a59c640 1 --2- 172.21.15.2:0/216184497 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f554c100480 0x7f554c0fc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:23.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:23.815+0000 7f554ad9d640 1 -- 172.21.15.2:0/216184497 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f554c100480 msgr2=0x7f554c0fc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:23.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:23.815+0000 7f554ad9d640 1 --2- 172.21.15.2:0/216184497 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f554c100480 0x7f554c0fc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:23.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:23.815+0000 7f554ad9d640 1 -- 172.21.15.2:0/216184497 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f554c100e30 msgr2=0x7f554c0fcbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:23.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:23.815+0000 7f554ad9d640 1 --2- 172.21.15.2:0/216184497 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f554c100e30 0x7f554c0fcbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:23.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:23.815+0000 7f554ad9d640 1 -- 172.21.15.2:0/216184497 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f554c1a6890 con 0x7f554c1055b0 2024-09-19T04:47:23.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:23.815+0000 7f554a59c640 1 --2- 172.21.15.2:0/216184497 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f554c100480 0x7f554c0fc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:47:23.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:23.815+0000 7f554ad9d640 1 --2- 172.21.15.2:0/216184497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f554c1055b0 0x7f554c0fd110 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f554400de10 tx=0x7f554400b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:23.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:23.815+0000 7f553b7fe640 1 -- 172.21.15.2:0/216184497 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5544003b70 con 0x7f554c1055b0 2024-09-19T04:47:23.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:23.815+0000 7f553b7fe640 1 -- 172.21.15.2:0/216184497 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5544003d10 con 0x7f554c1055b0 2024-09-19T04:47:23.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:23.815+0000 7f5550a62640 1 -- 172.21.15.2:0/216184497 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f554c1a6b80 con 0x7f554c1055b0 2024-09-19T04:47:23.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:23.815+0000 7f553b7fe640 1 -- 172.21.15.2:0/216184497 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f554400ea60 con 0x7f554c1055b0 2024-09-19T04:47:23.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:23.815+0000 7f5550a62640 1 -- 172.21.15.2:0/216184497 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f554c1a70c0 con 0x7f554c1055b0 2024-09-19T04:47:23.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:23.816+0000 7f5550a62640 1 -- 172.21.15.2:0/216184497 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f554c100860 con 0x7f554c1055b0 2024-09-19T04:47:23.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:23.818+0000 7f553b7fe640 1 -- 172.21.15.2:0/216184497 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f554400ec00 con 0x7f554c1055b0 2024-09-19T04:47:23.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:23.818+0000 7f553b7fe640 1 --2- 172.21.15.2:0/216184497 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f55340a3350 0x7f55340a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:23.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:23.818+0000 7f554a59c640 1 --2- 172.21.15.2:0/216184497 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f55340a3350 0x7f55340a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:23.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:23.818+0000 7f553b7fe640 1 -- 172.21.15.2:0/216184497 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f55440cfbf0 con 0x7f554c1055b0 2024-09-19T04:47:23.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:23.819+0000 7f554a59c640 1 --2- 172.21.15.2:0/216184497 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f55340a3350 0x7f55340a5810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f553c005ab0 tx=0x7f553c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:23.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:23.822+0000 7f553b7fe640 1 -- 172.21.15.2:0/216184497 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f554409c8f0 con 0x7f554c1055b0 2024-09-19T04:47:24.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:23.998+0000 7f5550a62640 1 -- 172.21.15.2:0/216184497 --> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f554c062630 con 0x7f55340a3350 2024-09-19T04:47:24.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:24.004+0000 7f553b7fe640 1 -- 172.21.15.2:0/216184497 <== mgr.14150 v2:172.21.15.2:6800/3171525177 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258646 (secure 0 0 0) 0x7f554c062630 con 0x7f55340a3350 2024-09-19T04:47:24.007 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:47:24.013 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-19T04:47:24.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:24.007+0000 7f5550a62640 1 -- 172.21.15.2:0/216184497 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f55340a3350 msgr2=0x7f55340a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:24.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:24.007+0000 7f5550a62640 1 --2- 172.21.15.2:0/216184497 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f55340a3350 0x7f55340a5810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f553c005ab0 tx=0x7f553c000bc0 comp rx=0 tx=0).stop 2024-09-19T04:47:24.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:24.007+0000 7f5550a62640 1 -- 172.21.15.2:0/216184497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f554c1055b0 msgr2=0x7f554c0fd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:24.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:24.007+0000 7f5550a62640 1 --2- 172.21.15.2:0/216184497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f554c1055b0 0x7f554c0fd110 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f554400de10 tx=0x7f554400b730 comp rx=0 tx=0).stop 2024-09-19T04:47:24.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:24.007+0000 7f5550a62640 1 -- 172.21.15.2:0/216184497 shutdown_connections 2024-09-19T04:47:24.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:24.007+0000 7f5550a62640 1 --2- 172.21.15.2:0/216184497 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f55340a3350 0x7f55340a5810 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:24.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:24.007+0000 7f5550a62640 1 --2- 172.21.15.2:0/216184497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f554c1055b0 0x7f554c0fd110 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:24.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:24.007+0000 7f5550a62640 1 --2- 172.21.15.2:0/216184497 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f554c100e30 0x7f554c0fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:24.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:24.007+0000 7f5550a62640 1 --2- 172.21.15.2:0/216184497 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f554c100480 0x7f554c0fc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:24.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:24.007+0000 7f5550a62640 1 -- 172.21.15.2:0/216184497 >> 172.21.15.2:0/216184497 conn(0x7f554c077210 msgr2=0x7f554c103d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:24.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:24.008+0000 7f5550a62640 1 -- 172.21.15.2:0/216184497 shutdown_connections 2024-09-19T04:47:24.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:24.008+0000 7f5550a62640 1 -- 172.21.15.2:0/216184497 wait complete. 2024-09-19T04:47:24.675 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":304,"stamp":"2024-09-19T04:47:23.554699+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":652599,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":244,"num_read_kb":234,"num_write":261,"num_write_kb":3023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1180770,"num_keys_recovered":10,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":204,"ondisk_log_size":204,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":407236,"kb_used_data":12204,"kb_used_omap":18,"kb_used_meta":394797,"kb_avail":1124534588,"statfs":{"total":1151940427776,"available":1151523418112,"internally_reserved":0,"allocated":12496896,"data_stored":7071321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":404272442},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002877"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.563629+0000","last_change":"2024-09-19T04:46:23.520907+0000","last_active":"2024-09-19T04:46:36.563629+0000","last_peered":"2024-09-19T04:46:36.563629+0000","last_clean":"2024-09-19T04:46:36.563629+0000","last_became_active":"2024-09-19T04:46:23.519321+0000","last_became_peered":"2024-09-19T04:46:23.519321+0000","last_unstale":"2024-09-19T04:46:36.563629+0000","last_undegraded":"2024-09-19T04:46:36.563629+0000","last_fullsized":"2024-09-19T04:46:36.563629+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:31.529472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.988683+0000","last_change":"2024-09-19T04:46:23.515272+0000","last_active":"2024-09-19T04:46:36.988683+0000","last_peered":"2024-09-19T04:46:36.988683+0000","last_clean":"2024-09-19T04:46:36.988683+0000","last_became_active":"2024-09-19T04:46:23.514760+0000","last_became_peered":"2024-09-19T04:46:23.514760+0000","last_unstale":"2024-09-19T04:46:36.988683+0000","last_undegraded":"2024-09-19T04:46:36.988683+0000","last_fullsized":"2024-09-19T04:46:36.988683+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:32.215940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.988740+0000","last_change":"2024-09-19T04:46:23.516809+0000","last_active":"2024-09-19T04:46:36.988740+0000","last_peered":"2024-09-19T04:46:36.988740+0000","last_clean":"2024-09-19T04:46:36.988740+0000","last_became_active":"2024-09-19T04:46:23.516489+0000","last_became_peered":"2024-09-19T04:46:23.516489+0000","last_unstale":"2024-09-19T04:46:36.988740+0000","last_undegraded":"2024-09-19T04:46:36.988740+0000","last_fullsized":"2024-09-19T04:46:36.988740+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:17:51.183061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.813744+0000","last_change":"2024-09-19T04:46:23.506868+0000","last_active":"2024-09-19T04:46:36.813744+0000","last_peered":"2024-09-19T04:46:36.813744+0000","last_clean":"2024-09-19T04:46:36.813744+0000","last_became_active":"2024-09-19T04:46:23.506489+0000","last_became_peered":"2024-09-19T04:46:23.506489+0000","last_unstale":"2024-09-19T04:46:36.813744+0000","last_undegraded":"2024-09-19T04:46:36.813744+0000","last_fullsized":"2024-09-19T04:46:36.813744+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:22.749973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.989486+0000","last_change":"2024-09-19T04:46:23.506733+0000","last_active":"2024-09-19T04:46:36.989486+0000","last_peered":"2024-09-19T04:46:36.989486+0000","last_clean":"2024-09-19T04:46:36.989486+0000","last_became_active":"2024-09-19T04:46:23.506408+0000","last_became_peered":"2024-09-19T04:46:23.506408+0000","last_unstale":"2024-09-19T04:46:36.989486+0000","last_undegraded":"2024-09-19T04:46:36.989486+0000","last_fullsized":"2024-09-19T04:46:36.989486+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:45:31.821607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.561796+0000","last_change":"2024-09-19T04:46:23.523109+0000","last_active":"2024-09-19T04:46:36.561796+0000","last_peered":"2024-09-19T04:46:36.561796+0000","last_clean":"2024-09-19T04:46:36.561796+0000","last_became_active":"2024-09-19T04:46:23.522783+0000","last_became_peered":"2024-09-19T04:46:23.522783+0000","last_unstale":"2024-09-19T04:46:36.561796+0000","last_undegraded":"2024-09-19T04:46:36.561796+0000","last_fullsized":"2024-09-19T04:46:36.561796+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:34:47.622562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.566699+0000","last_change":"2024-09-19T04:46:23.518297+0000","last_active":"2024-09-19T04:46:36.566699+0000","last_peered":"2024-09-19T04:46:36.566699+0000","last_clean":"2024-09-19T04:46:36.566699+0000","last_became_active":"2024-09-19T04:46:23.517974+0000","last_became_peered":"2024-09-19T04:46:23.517974+0000","last_unstale":"2024-09-19T04:46:36.566699+0000","last_undegraded":"2024-09-19T04:46:36.566699+0000","last_fullsized":"2024-09-19T04:46:36.566699+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:23:26.474961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.559392+0000","last_change":"2024-09-19T04:46:23.516255+0000","last_active":"2024-09-19T04:46:36.559392+0000","last_peered":"2024-09-19T04:46:36.559392+0000","last_clean":"2024-09-19T04:46:36.559392+0000","last_became_active":"2024-09-19T04:46:23.515861+0000","last_became_peered":"2024-09-19T04:46:23.515861+0000","last_unstale":"2024-09-19T04:46:36.559392+0000","last_undegraded":"2024-09-19T04:46:36.559392+0000","last_fullsized":"2024-09-19T04:46:36.559392+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:08:19.747905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.793466+0000","last_change":"2024-09-19T04:46:23.520947+0000","last_active":"2024-09-19T04:46:36.793466+0000","last_peered":"2024-09-19T04:46:36.793466+0000","last_clean":"2024-09-19T04:46:36.793466+0000","last_became_active":"2024-09-19T04:46:23.518463+0000","last_became_peered":"2024-09-19T04:46:23.518463+0000","last_unstale":"2024-09-19T04:46:36.793466+0000","last_undegraded":"2024-09-19T04:46:36.793466+0000","last_fullsized":"2024-09-19T04:46:36.793466+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:00.420868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.561908+0000","last_change":"2024-09-19T04:46:23.524145+0000","last_active":"2024-09-19T04:46:36.561908+0000","last_peered":"2024-09-19T04:46:36.561908+0000","last_clean":"2024-09-19T04:46:36.561908+0000","last_became_active":"2024-09-19T04:46:23.523698+0000","last_became_peered":"2024-09-19T04:46:23.523698+0000","last_unstale":"2024-09-19T04:46:36.561908+0000","last_undegraded":"2024-09-19T04:46:36.561908+0000","last_fullsized":"2024-09-19T04:46:36.561908+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:41.370871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.565617+0000","last_change":"2024-09-19T04:46:23.521782+0000","last_active":"2024-09-19T04:46:36.565617+0000","last_peered":"2024-09-19T04:46:36.565617+0000","last_clean":"2024-09-19T04:46:36.565617+0000","last_became_active":"2024-09-19T04:46:23.521452+0000","last_became_peered":"2024-09-19T04:46:23.521452+0000","last_unstale":"2024-09-19T04:46:36.565617+0000","last_undegraded":"2024-09-19T04:46:36.565617+0000","last_fullsized":"2024-09-19T04:46:36.565617+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:11:35.047064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.813744+0000","last_change":"2024-09-19T04:46:23.518174+0000","last_active":"2024-09-19T04:46:36.813744+0000","last_peered":"2024-09-19T04:46:36.813744+0000","last_clean":"2024-09-19T04:46:36.813744+0000","last_became_active":"2024-09-19T04:46:23.516507+0000","last_became_peered":"2024-09-19T04:46:23.516507+0000","last_unstale":"2024-09-19T04:46:36.813744+0000","last_undegraded":"2024-09-19T04:46:36.813744+0000","last_fullsized":"2024-09-19T04:46:36.813744+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:37.878245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.805393+0000","last_change":"2024-09-19T04:46:23.510582+0000","last_active":"2024-09-19T04:46:36.805393+0000","last_peered":"2024-09-19T04:46:36.805393+0000","last_clean":"2024-09-19T04:46:36.805393+0000","last_became_active":"2024-09-19T04:46:23.510135+0000","last_became_peered":"2024-09-19T04:46:23.510135+0000","last_unstale":"2024-09-19T04:46:36.805393+0000","last_undegraded":"2024-09-19T04:46:36.805393+0000","last_fullsized":"2024-09-19T04:46:36.805393+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:09.721696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.988533+0000","last_change":"2024-09-19T04:46:23.517963+0000","last_active":"2024-09-19T04:46:36.988533+0000","last_peered":"2024-09-19T04:46:36.988533+0000","last_clean":"2024-09-19T04:46:36.988533+0000","last_became_active":"2024-09-19T04:46:23.517574+0000","last_became_peered":"2024-09-19T04:46:23.517574+0000","last_unstale":"2024-09-19T04:46:36.988533+0000","last_undegraded":"2024-09-19T04:46:36.988533+0000","last_fullsized":"2024-09-19T04:46:36.988533+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:48:44.494267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.988454+0000","last_change":"2024-09-19T04:46:23.517318+0000","last_active":"2024-09-19T04:46:36.988454+0000","last_peered":"2024-09-19T04:46:36.988454+0000","last_clean":"2024-09-19T04:46:36.988454+0000","last_became_active":"2024-09-19T04:46:23.516973+0000","last_became_peered":"2024-09-19T04:46:23.516973+0000","last_unstale":"2024-09-19T04:46:36.988454+0000","last_undegraded":"2024-09-19T04:46:36.988454+0000","last_fullsized":"2024-09-19T04:46:36.988454+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:46:28.907400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.792910+0000","last_change":"2024-09-19T04:46:23.517468+0000","last_active":"2024-09-19T04:46:36.792910+0000","last_peered":"2024-09-19T04:46:36.792910+0000","last_clean":"2024-09-19T04:46:36.792910+0000","last_became_active":"2024-09-19T04:46:23.517093+0000","last_became_peered":"2024-09-19T04:46:23.517093+0000","last_unstale":"2024-09-19T04:46:36.792910+0000","last_undegraded":"2024-09-19T04:46:36.792910+0000","last_fullsized":"2024-09-19T04:46:36.792910+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:43.435560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.563738+0000","last_change":"2024-09-19T04:46:23.521679+0000","last_active":"2024-09-19T04:46:36.563738+0000","last_peered":"2024-09-19T04:46:36.563738+0000","last_clean":"2024-09-19T04:46:36.563738+0000","last_became_active":"2024-09-19T04:46:23.519346+0000","last_became_peered":"2024-09-19T04:46:23.519346+0000","last_unstale":"2024-09-19T04:46:36.563738+0000","last_undegraded":"2024-09-19T04:46:36.563738+0000","last_fullsized":"2024-09-19T04:46:36.563738+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:31.740226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.561931+0000","last_change":"2024-09-19T04:46:23.517518+0000","last_active":"2024-09-19T04:46:36.561931+0000","last_peered":"2024-09-19T04:46:36.561931+0000","last_clean":"2024-09-19T04:46:36.561931+0000","last_became_active":"2024-09-19T04:46:23.517179+0000","last_became_peered":"2024-09-19T04:46:23.517179+0000","last_unstale":"2024-09-19T04:46:36.561931+0000","last_undegraded":"2024-09-19T04:46:36.561931+0000","last_fullsized":"2024-09-19T04:46:36.561931+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:38.352433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.566817+0000","last_change":"2024-09-19T04:46:23.506618+0000","last_active":"2024-09-19T04:46:36.566817+0000","last_peered":"2024-09-19T04:46:36.566817+0000","last_clean":"2024-09-19T04:46:36.566817+0000","last_became_active":"2024-09-19T04:46:23.506276+0000","last_became_peered":"2024-09-19T04:46:23.506276+0000","last_unstale":"2024-09-19T04:46:36.566817+0000","last_undegraded":"2024-09-19T04:46:36.566817+0000","last_fullsized":"2024-09-19T04:46:36.566817+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:02:42.216717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.563322+0000","last_change":"2024-09-19T04:46:23.518793+0000","last_active":"2024-09-19T04:46:36.563322+0000","last_peered":"2024-09-19T04:46:36.563322+0000","last_clean":"2024-09-19T04:46:36.563322+0000","last_became_active":"2024-09-19T04:46:23.518386+0000","last_became_peered":"2024-09-19T04:46:23.518386+0000","last_unstale":"2024-09-19T04:46:36.563322+0000","last_undegraded":"2024-09-19T04:46:36.563322+0000","last_fullsized":"2024-09-19T04:46:36.563322+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:08:12.007678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.805447+0000","last_change":"2024-09-19T04:46:23.513022+0000","last_active":"2024-09-19T04:46:36.805447+0000","last_peered":"2024-09-19T04:46:36.805447+0000","last_clean":"2024-09-19T04:46:36.805447+0000","last_became_active":"2024-09-19T04:46:23.512541+0000","last_became_peered":"2024-09-19T04:46:23.512541+0000","last_unstale":"2024-09-19T04:46:36.805447+0000","last_undegraded":"2024-09-19T04:46:36.805447+0000","last_fullsized":"2024-09-19T04:46:36.805447+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:19.873546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.792966+0000","last_change":"2024-09-19T04:46:23.519523+0000","last_active":"2024-09-19T04:46:36.792966+0000","last_peered":"2024-09-19T04:46:36.792966+0000","last_clean":"2024-09-19T04:46:36.792966+0000","last_became_active":"2024-09-19T04:46:23.517995+0000","last_became_peered":"2024-09-19T04:46:23.517995+0000","last_unstale":"2024-09-19T04:46:36.792966+0000","last_undegraded":"2024-09-19T04:46:36.792966+0000","last_fullsized":"2024-09-19T04:46:36.792966+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:23.243522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.559440+0000","last_change":"2024-09-19T04:46:23.517564+0000","last_active":"2024-09-19T04:46:36.559440+0000","last_peered":"2024-09-19T04:46:36.559440+0000","last_clean":"2024-09-19T04:46:36.559440+0000","last_became_active":"2024-09-19T04:46:23.517248+0000","last_became_peered":"2024-09-19T04:46:23.517248+0000","last_unstale":"2024-09-19T04:46:36.559440+0000","last_undegraded":"2024-09-19T04:46:36.559440+0000","last_fullsized":"2024-09-19T04:46:36.559440+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:19.369346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.571382+0000","last_change":"2024-09-19T04:46:23.514150+0000","last_active":"2024-09-19T04:46:36.571382+0000","last_peered":"2024-09-19T04:46:36.571382+0000","last_clean":"2024-09-19T04:46:36.571382+0000","last_became_active":"2024-09-19T04:46:23.512169+0000","last_became_peered":"2024-09-19T04:46:23.512169+0000","last_unstale":"2024-09-19T04:46:36.571382+0000","last_undegraded":"2024-09-19T04:46:36.571382+0000","last_fullsized":"2024-09-19T04:46:36.571382+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:17.475389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.815086+0000","last_change":"2024-09-19T04:46:36.814692+0000","last_active":"2024-09-19T04:46:36.815086+0000","last_peered":"2024-09-19T04:46:36.815086+0000","last_clean":"2024-09-19T04:46:36.815086+0000","last_became_active":"2024-09-19T04:46:36.814429+0000","last_became_peered":"2024-09-19T04:46:36.814429+0000","last_unstale":"2024-09-19T04:46:36.815086+0000","last_undegraded":"2024-09-19T04:46:36.815086+0000","last_fullsized":"2024-09-19T04:46:36.815086+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:10:42.391448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.566542+0000","last_change":"2024-09-19T04:46:23.519273+0000","last_active":"2024-09-19T04:46:36.566542+0000","last_peered":"2024-09-19T04:46:36.566542+0000","last_clean":"2024-09-19T04:46:36.566542+0000","last_became_active":"2024-09-19T04:46:23.519001+0000","last_became_peered":"2024-09-19T04:46:23.519001+0000","last_unstale":"2024-09-19T04:46:36.566542+0000","last_undegraded":"2024-09-19T04:46:36.566542+0000","last_fullsized":"2024-09-19T04:46:36.566542+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:15:30.949066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.563341+0000","last_change":"2024-09-19T04:46:23.520888+0000","last_active":"2024-09-19T04:46:36.563341+0000","last_peered":"2024-09-19T04:46:36.563341+0000","last_clean":"2024-09-19T04:46:36.563341+0000","last_became_active":"2024-09-19T04:46:23.519476+0000","last_became_peered":"2024-09-19T04:46:23.519476+0000","last_unstale":"2024-09-19T04:46:36.563341+0000","last_undegraded":"2024-09-19T04:46:36.563341+0000","last_fullsized":"2024-09-19T04:46:36.563341+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:56.459724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.805408+0000","last_change":"2024-09-19T04:46:23.512152+0000","last_active":"2024-09-19T04:46:36.805408+0000","last_peered":"2024-09-19T04:46:36.805408+0000","last_clean":"2024-09-19T04:46:36.805408+0000","last_became_active":"2024-09-19T04:46:23.511784+0000","last_became_peered":"2024-09-19T04:46:23.511784+0000","last_unstale":"2024-09-19T04:46:36.805408+0000","last_undegraded":"2024-09-19T04:46:36.805408+0000","last_fullsized":"2024-09-19T04:46:36.805408+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:01:23.406580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.988812+0000","last_change":"2024-09-19T04:46:23.522491+0000","last_active":"2024-09-19T04:46:36.988812+0000","last_peered":"2024-09-19T04:46:36.988812+0000","last_clean":"2024-09-19T04:46:36.988812+0000","last_became_active":"2024-09-19T04:46:23.522025+0000","last_became_peered":"2024-09-19T04:46:23.522025+0000","last_unstale":"2024-09-19T04:46:36.988812+0000","last_undegraded":"2024-09-19T04:46:36.988812+0000","last_fullsized":"2024-09-19T04:46:36.988812+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:33.063300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.566102+0000","last_change":"2024-09-19T04:46:23.510057+0000","last_active":"2024-09-19T04:46:36.566102+0000","last_peered":"2024-09-19T04:46:36.566102+0000","last_clean":"2024-09-19T04:46:36.566102+0000","last_became_active":"2024-09-19T04:46:23.509691+0000","last_became_peered":"2024-09-19T04:46:23.509691+0000","last_unstale":"2024-09-19T04:46:36.566102+0000","last_undegraded":"2024-09-19T04:46:36.566102+0000","last_fullsized":"2024-09-19T04:46:36.566102+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:12:16.579944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.565831+0000","last_change":"2024-09-19T04:46:23.516876+0000","last_active":"2024-09-19T04:46:36.565831+0000","last_peered":"2024-09-19T04:46:36.565831+0000","last_clean":"2024-09-19T04:46:36.565831+0000","last_became_active":"2024-09-19T04:46:23.516533+0000","last_became_peered":"2024-09-19T04:46:23.516533+0000","last_unstale":"2024-09-19T04:46:36.565831+0000","last_undegraded":"2024-09-19T04:46:36.565831+0000","last_fullsized":"2024-09-19T04:46:36.565831+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:44.868936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.563114+0000","last_change":"2024-09-19T04:46:23.517607+0000","last_active":"2024-09-19T04:46:36.563114+0000","last_peered":"2024-09-19T04:46:36.563114+0000","last_clean":"2024-09-19T04:46:36.563114+0000","last_became_active":"2024-09-19T04:46:23.517289+0000","last_became_peered":"2024-09-19T04:46:23.517289+0000","last_unstale":"2024-09-19T04:46:36.563114+0000","last_undegraded":"2024-09-19T04:46:36.563114+0000","last_fullsized":"2024-09-19T04:46:36.563114+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:08:22.882886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.989428+0000","last_change":"2024-09-19T04:46:23.507713+0000","last_active":"2024-09-19T04:46:36.989428+0000","last_peered":"2024-09-19T04:46:36.989428+0000","last_clean":"2024-09-19T04:46:36.989428+0000","last_became_active":"2024-09-19T04:46:23.507350+0000","last_became_peered":"2024-09-19T04:46:23.507350+0000","last_unstale":"2024-09-19T04:46:36.989428+0000","last_undegraded":"2024-09-19T04:46:36.989428+0000","last_fullsized":"2024-09-19T04:46:36.989428+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:07:27.119097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.570432+0000","last_change":"2024-09-19T04:46:21.495958+0000","last_active":"2024-09-19T04:46:36.570432+0000","last_peered":"2024-09-19T04:46:36.570432+0000","last_clean":"2024-09-19T04:46:36.570432+0000","last_became_active":"2024-09-19T04:46:21.495562+0000","last_became_peered":"2024-09-19T04:46:21.495562+0000","last_unstale":"2024-09-19T04:46:36.570432+0000","last_undegraded":"2024-09-19T04:46:36.570432+0000","last_fullsized":"2024-09-19T04:46:36.570432+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:19:02.935893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.570323+0000","last_change":"2024-09-19T04:46:23.524151+0000","last_active":"2024-09-19T04:46:36.570323+0000","last_peered":"2024-09-19T04:46:36.570323+0000","last_clean":"2024-09-19T04:46:36.570323+0000","last_became_active":"2024-09-19T04:46:23.523795+0000","last_became_peered":"2024-09-19T04:46:23.523795+0000","last_unstale":"2024-09-19T04:46:36.570323+0000","last_undegraded":"2024-09-19T04:46:36.570323+0000","last_fullsized":"2024-09-19T04:46:36.570323+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:27.234766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.561930+0000","last_change":"2024-09-19T04:46:21.485072+0000","last_active":"2024-09-19T04:46:36.561930+0000","last_peered":"2024-09-19T04:46:36.561930+0000","last_clean":"2024-09-19T04:46:36.561930+0000","last_became_active":"2024-09-19T04:46:21.482727+0000","last_became_peered":"2024-09-19T04:46:21.482727+0000","last_unstale":"2024-09-19T04:46:36.561930+0000","last_undegraded":"2024-09-19T04:46:36.561930+0000","last_fullsized":"2024-09-19T04:46:36.561930+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:23.231570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.805189+0000","last_change":"2024-09-19T04:46:21.488537+0000","last_active":"2024-09-19T04:46:36.805189+0000","last_peered":"2024-09-19T04:46:36.805189+0000","last_clean":"2024-09-19T04:46:36.805189+0000","last_became_active":"2024-09-19T04:46:21.488176+0000","last_became_peered":"2024-09-19T04:46:21.488176+0000","last_unstale":"2024-09-19T04:46:36.805189+0000","last_undegraded":"2024-09-19T04:46:36.805189+0000","last_fullsized":"2024-09-19T04:46:36.805189+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:14.355956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.559474+0000","last_change":"2024-09-19T04:46:23.518619+0000","last_active":"2024-09-19T04:46:36.559474+0000","last_peered":"2024-09-19T04:46:36.559474+0000","last_clean":"2024-09-19T04:46:36.559474+0000","last_became_active":"2024-09-19T04:46:23.518313+0000","last_became_peered":"2024-09-19T04:46:23.518313+0000","last_unstale":"2024-09-19T04:46:36.559474+0000","last_undegraded":"2024-09-19T04:46:36.559474+0000","last_fullsized":"2024-09-19T04:46:36.559474+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:08:25.958935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.571543+0000","last_change":"2024-09-19T04:46:21.493873+0000","last_active":"2024-09-19T04:46:36.571543+0000","last_peered":"2024-09-19T04:46:36.571543+0000","last_clean":"2024-09-19T04:46:36.571543+0000","last_became_active":"2024-09-19T04:46:21.493447+0000","last_became_peered":"2024-09-19T04:46:21.493447+0000","last_unstale":"2024-09-19T04:46:36.571543+0000","last_undegraded":"2024-09-19T04:46:36.571543+0000","last_fullsized":"2024-09-19T04:46:36.571543+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:29.504001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.561265+0000","last_change":"2024-09-19T04:46:23.508247+0000","last_active":"2024-09-19T04:46:36.561265+0000","last_peered":"2024-09-19T04:46:36.561265+0000","last_clean":"2024-09-19T04:46:36.561265+0000","last_became_active":"2024-09-19T04:46:23.507936+0000","last_became_peered":"2024-09-19T04:46:23.507936+0000","last_unstale":"2024-09-19T04:46:36.561265+0000","last_undegraded":"2024-09-19T04:46:36.561265+0000","last_fullsized":"2024-09-19T04:46:36.561265+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:25:09.864664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.561738+0000","last_change":"2024-09-19T04:46:21.487636+0000","last_active":"2024-09-19T04:46:36.561738+0000","last_peered":"2024-09-19T04:46:36.561738+0000","last_clean":"2024-09-19T04:46:36.561738+0000","last_became_active":"2024-09-19T04:46:21.487162+0000","last_became_peered":"2024-09-19T04:46:21.487162+0000","last_unstale":"2024-09-19T04:46:36.561738+0000","last_undegraded":"2024-09-19T04:46:36.561738+0000","last_fullsized":"2024-09-19T04:46:36.561738+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:03:04.833769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.793378+0000","last_change":"2024-09-19T04:46:23.515047+0000","last_active":"2024-09-19T04:46:36.793378+0000","last_peered":"2024-09-19T04:46:36.793378+0000","last_clean":"2024-09-19T04:46:36.793378+0000","last_became_active":"2024-09-19T04:46:23.514607+0000","last_became_peered":"2024-09-19T04:46:23.514607+0000","last_unstale":"2024-09-19T04:46:36.793378+0000","last_undegraded":"2024-09-19T04:46:36.793378+0000","last_fullsized":"2024-09-19T04:46:36.793378+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:05:03.076568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.565898+0000","last_change":"2024-09-19T04:46:21.493732+0000","last_active":"2024-09-19T04:46:36.565898+0000","last_peered":"2024-09-19T04:46:36.565898+0000","last_clean":"2024-09-19T04:46:36.565898+0000","last_became_active":"2024-09-19T04:46:21.493069+0000","last_became_peered":"2024-09-19T04:46:21.493069+0000","last_unstale":"2024-09-19T04:46:36.565898+0000","last_undegraded":"2024-09-19T04:46:36.565898+0000","last_fullsized":"2024-09-19T04:46:36.565898+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:17.709419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.988887+0000","last_change":"2024-09-19T04:46:23.516530+0000","last_active":"2024-09-19T04:46:36.988887+0000","last_peered":"2024-09-19T04:46:36.988887+0000","last_clean":"2024-09-19T04:46:36.988887+0000","last_became_active":"2024-09-19T04:46:23.515816+0000","last_became_peered":"2024-09-19T04:46:23.515816+0000","last_unstale":"2024-09-19T04:46:36.988887+0000","last_undegraded":"2024-09-19T04:46:36.988887+0000","last_fullsized":"2024-09-19T04:46:36.988887+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:56:19.162009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.570448+0000","last_change":"2024-09-19T04:46:21.573930+0000","last_active":"2024-09-19T04:46:36.570448+0000","last_peered":"2024-09-19T04:46:36.570448+0000","last_clean":"2024-09-19T04:46:36.570448+0000","last_became_active":"2024-09-19T04:46:21.573579+0000","last_became_peered":"2024-09-19T04:46:21.573579+0000","last_unstale":"2024-09-19T04:46:36.570448+0000","last_undegraded":"2024-09-19T04:46:36.570448+0000","last_fullsized":"2024-09-19T04:46:36.570448+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:29.472481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.792985+0000","last_change":"2024-09-19T04:46:23.520569+0000","last_active":"2024-09-19T04:46:36.792985+0000","last_peered":"2024-09-19T04:46:36.792985+0000","last_clean":"2024-09-19T04:46:36.792985+0000","last_became_active":"2024-09-19T04:46:23.519894+0000","last_became_peered":"2024-09-19T04:46:23.519894+0000","last_unstale":"2024-09-19T04:46:36.792985+0000","last_undegraded":"2024-09-19T04:46:36.792985+0000","last_fullsized":"2024-09-19T04:46:36.792985+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:20.823559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'25","reported_seq":150,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:47:18.614094+0000","last_change":"2024-09-19T04:46:21.491853+0000","last_active":"2024-09-19T04:47:18.614094+0000","last_peered":"2024-09-19T04:47:18.614094+0000","last_clean":"2024-09-19T04:47:18.614094+0000","last_became_active":"2024-09-19T04:46:21.491499+0000","last_became_peered":"2024-09-19T04:46:21.491499+0000","last_unstale":"2024-09-19T04:47:18.614094+0000","last_undegraded":"2024-09-19T04:47:18.614094+0000","last_fullsized":"2024-09-19T04:47:18.614094+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:15.372001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61199,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":103,"num_read_kb":110,"num_write":25,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.989834+0000","last_change":"2024-09-19T04:46:23.516781+0000","last_active":"2024-09-19T04:46:36.989834+0000","last_peered":"2024-09-19T04:46:36.989834+0000","last_clean":"2024-09-19T04:46:36.989834+0000","last_became_active":"2024-09-19T04:46:23.515928+0000","last_became_peered":"2024-09-19T04:46:23.515928+0000","last_unstale":"2024-09-19T04:46:36.989834+0000","last_undegraded":"2024-09-19T04:46:36.989834+0000","last_fullsized":"2024-09-19T04:46:36.989834+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:31.319072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'2","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.576789+0000","last_change":"2024-09-19T04:46:36.576395+0000","last_active":"2024-09-19T04:46:36.576789+0000","last_peered":"2024-09-19T04:46:36.576789+0000","last_clean":"2024-09-19T04:46:36.576789+0000","last_became_active":"2024-09-19T04:46:36.567213+0000","last_became_peered":"2024-09-19T04:46:36.567213+0000","last_unstale":"2024-09-19T04:46:36.576789+0000","last_undegraded":"2024-09-19T04:46:36.576789+0000","last_fullsized":"2024-09-19T04:46:36.576789+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:26.802224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.805263+0000","last_change":"2024-09-19T04:46:23.512736+0000","last_active":"2024-09-19T04:46:36.805263+0000","last_peered":"2024-09-19T04:46:36.805263+0000","last_clean":"2024-09-19T04:46:36.805263+0000","last_became_active":"2024-09-19T04:46:23.512399+0000","last_became_peered":"2024-09-19T04:46:23.512399+0000","last_unstale":"2024-09-19T04:46:36.805263+0000","last_undegraded":"2024-09-19T04:46:36.805263+0000","last_fullsized":"2024-09-19T04:46:36.805263+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:54:28.607512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.570209+0000","last_change":"2024-09-19T04:46:21.495421+0000","last_active":"2024-09-19T04:46:36.570209+0000","last_peered":"2024-09-19T04:46:36.570209+0000","last_clean":"2024-09-19T04:46:36.570209+0000","last_became_active":"2024-09-19T04:46:21.495004+0000","last_became_peered":"2024-09-19T04:46:21.495004+0000","last_unstale":"2024-09-19T04:46:36.570209+0000","last_undegraded":"2024-09-19T04:46:36.570209+0000","last_fullsized":"2024-09-19T04:46:36.570209+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:11.038118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.567045+0000","last_change":"2024-09-19T04:46:23.519462+0000","last_active":"2024-09-19T04:46:36.567045+0000","last_peered":"2024-09-19T04:46:36.567045+0000","last_clean":"2024-09-19T04:46:36.567045+0000","last_became_active":"2024-09-19T04:46:23.519121+0000","last_became_peered":"2024-09-19T04:46:23.519121+0000","last_unstale":"2024-09-19T04:46:36.567045+0000","last_undegraded":"2024-09-19T04:46:36.567045+0000","last_fullsized":"2024-09-19T04:46:36.567045+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:19.643433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.813771+0000","last_change":"2024-09-19T04:46:21.496243+0000","last_active":"2024-09-19T04:46:36.813771+0000","last_peered":"2024-09-19T04:46:36.813771+0000","last_clean":"2024-09-19T04:46:36.813771+0000","last_became_active":"2024-09-19T04:46:21.495821+0000","last_became_peered":"2024-09-19T04:46:21.495821+0000","last_unstale":"2024-09-19T04:46:36.813771+0000","last_undegraded":"2024-09-19T04:46:36.813771+0000","last_fullsized":"2024-09-19T04:46:36.813771+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:35:02.729538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.570404+0000","last_change":"2024-09-19T04:46:36.570404+0000","last_active":"2024-09-19T04:46:36.570404+0000","last_peered":"2024-09-19T04:46:36.570404+0000","last_clean":"2024-09-19T04:46:36.570404+0000","last_became_active":"2024-09-19T04:46:36.569898+0000","last_became_peered":"2024-09-19T04:46:36.569898+0000","last_unstale":"2024-09-19T04:46:36.570404+0000","last_undegraded":"2024-09-19T04:46:36.570404+0000","last_fullsized":"2024-09-19T04:46:36.570404+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:20:47.441702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'8","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.989610+0000","last_change":"2024-09-19T04:46:21.572642+0000","last_active":"2024-09-19T04:46:36.989610+0000","last_peered":"2024-09-19T04:46:36.989610+0000","last_clean":"2024-09-19T04:46:36.989610+0000","last_became_active":"2024-09-19T04:46:21.571823+0000","last_became_peered":"2024-09-19T04:46:21.571823+0000","last_unstale":"2024-09-19T04:46:36.989610+0000","last_undegraded":"2024-09-19T04:46:36.989610+0000","last_fullsized":"2024-09-19T04:46:36.989610+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:28.956744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.569490+0000","last_change":"2024-09-19T04:46:23.524169+0000","last_active":"2024-09-19T04:46:36.569490+0000","last_peered":"2024-09-19T04:46:36.569490+0000","last_clean":"2024-09-19T04:46:36.569490+0000","last_became_active":"2024-09-19T04:46:23.523869+0000","last_became_peered":"2024-09-19T04:46:23.523869+0000","last_unstale":"2024-09-19T04:46:36.569490+0000","last_undegraded":"2024-09-19T04:46:36.569490+0000","last_fullsized":"2024-09-19T04:46:36.569490+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:46.131143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.989981+0000","last_change":"2024-09-19T04:46:21.490154+0000","last_active":"2024-09-19T04:46:36.989981+0000","last_peered":"2024-09-19T04:46:36.989981+0000","last_clean":"2024-09-19T04:46:36.989981+0000","last_became_active":"2024-09-19T04:46:21.489820+0000","last_became_peered":"2024-09-19T04:46:21.489820+0000","last_unstale":"2024-09-19T04:46:36.989981+0000","last_undegraded":"2024-09-19T04:46:36.989981+0000","last_fullsized":"2024-09-19T04:46:36.989981+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:34:27.446664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.563380+0000","last_change":"2024-09-19T04:46:23.518712+0000","last_active":"2024-09-19T04:46:36.563380+0000","last_peered":"2024-09-19T04:46:36.563380+0000","last_clean":"2024-09-19T04:46:36.563380+0000","last_became_active":"2024-09-19T04:46:23.518408+0000","last_became_peered":"2024-09-19T04:46:23.518408+0000","last_unstale":"2024-09-19T04:46:36.563380+0000","last_undegraded":"2024-09-19T04:46:36.563380+0000","last_fullsized":"2024-09-19T04:46:36.563380+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:45:17.398334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.805508+0000","last_change":"2024-09-19T04:46:21.487789+0000","last_active":"2024-09-19T04:46:36.805508+0000","last_peered":"2024-09-19T04:46:36.805508+0000","last_clean":"2024-09-19T04:46:36.805508+0000","last_became_active":"2024-09-19T04:46:21.487411+0000","last_became_peered":"2024-09-19T04:46:21.487411+0000","last_unstale":"2024-09-19T04:46:36.805508+0000","last_undegraded":"2024-09-19T04:46:36.805508+0000","last_fullsized":"2024-09-19T04:46:36.805508+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:25.353345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.565977+0000","last_change":"2024-09-19T04:46:23.515432+0000","last_active":"2024-09-19T04:46:36.565977+0000","last_peered":"2024-09-19T04:46:36.565977+0000","last_clean":"2024-09-19T04:46:36.565977+0000","last_became_active":"2024-09-19T04:46:23.515071+0000","last_became_peered":"2024-09-19T04:46:23.515071+0000","last_unstale":"2024-09-19T04:46:36.565977+0000","last_undegraded":"2024-09-19T04:46:36.565977+0000","last_fullsized":"2024-09-19T04:46:36.565977+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:56:04.743652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.570557+0000","last_change":"2024-09-19T04:46:21.487856+0000","last_active":"2024-09-19T04:46:36.570557+0000","last_peered":"2024-09-19T04:46:36.570557+0000","last_clean":"2024-09-19T04:46:36.570557+0000","last_became_active":"2024-09-19T04:46:21.487342+0000","last_became_peered":"2024-09-19T04:46:21.487342+0000","last_unstale":"2024-09-19T04:46:36.570557+0000","last_undegraded":"2024-09-19T04:46:36.570557+0000","last_fullsized":"2024-09-19T04:46:36.570557+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:29.275296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.565152+0000","last_change":"2024-09-19T04:46:23.517250+0000","last_active":"2024-09-19T04:46:36.565152+0000","last_peered":"2024-09-19T04:46:36.565152+0000","last_clean":"2024-09-19T04:46:36.565152+0000","last_became_active":"2024-09-19T04:46:23.516895+0000","last_became_peered":"2024-09-19T04:46:23.516895+0000","last_unstale":"2024-09-19T04:46:36.565152+0000","last_undegraded":"2024-09-19T04:46:36.565152+0000","last_fullsized":"2024-09-19T04:46:36.565152+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:51.982348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.566597+0000","last_change":"2024-09-19T04:46:21.572452+0000","last_active":"2024-09-19T04:46:36.566597+0000","last_peered":"2024-09-19T04:46:36.566597+0000","last_clean":"2024-09-19T04:46:36.566597+0000","last_became_active":"2024-09-19T04:46:21.572026+0000","last_became_peered":"2024-09-19T04:46:21.572026+0000","last_unstale":"2024-09-19T04:46:36.566597+0000","last_undegraded":"2024-09-19T04:46:36.566597+0000","last_fullsized":"2024-09-19T04:46:36.566597+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:07.859604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.565707+0000","last_change":"2024-09-19T04:46:23.523549+0000","last_active":"2024-09-19T04:46:36.565707+0000","last_peered":"2024-09-19T04:46:36.565707+0000","last_clean":"2024-09-19T04:46:36.565707+0000","last_became_active":"2024-09-19T04:46:23.522581+0000","last_became_peered":"2024-09-19T04:46:23.522581+0000","last_unstale":"2024-09-19T04:46:36.565707+0000","last_undegraded":"2024-09-19T04:46:36.565707+0000","last_fullsized":"2024-09-19T04:46:36.565707+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:51:33.504024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":341,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.567404+0000","last_change":"2024-09-19T04:45:12.271676+0000","last_active":"2024-09-19T04:46:36.567404+0000","last_peered":"2024-09-19T04:46:36.567404+0000","last_clean":"2024-09-19T04:46:36.567404+0000","last_became_active":"2024-09-19T04:45:12.271093+0000","last_became_peered":"2024-09-19T04:45:12.271093+0000","last_unstale":"2024-09-19T04:46:36.567404+0000","last_undegraded":"2024-09-19T04:46:36.567404+0000","last_fullsized":"2024-09-19T04:46:36.567404+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:41:52.010883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:41:52.010883+0000","last_clean_scrub_stamp":"2024-09-19T04:41:52.010883+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:48.499621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.813898+0000","last_change":"2024-09-19T04:46:21.493847+0000","last_active":"2024-09-19T04:46:36.813898+0000","last_peered":"2024-09-19T04:46:36.813898+0000","last_clean":"2024-09-19T04:46:36.813898+0000","last_became_active":"2024-09-19T04:46:21.493432+0000","last_became_peered":"2024-09-19T04:46:21.493432+0000","last_unstale":"2024-09-19T04:46:36.813898+0000","last_undegraded":"2024-09-19T04:46:36.813898+0000","last_fullsized":"2024-09-19T04:46:36.813898+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:10:21.398602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.559747+0000","last_change":"2024-09-19T04:46:23.517517+0000","last_active":"2024-09-19T04:46:36.559747+0000","last_peered":"2024-09-19T04:46:36.559747+0000","last_clean":"2024-09-19T04:46:36.559747+0000","last_became_active":"2024-09-19T04:46:23.517191+0000","last_became_peered":"2024-09-19T04:46:23.517191+0000","last_unstale":"2024-09-19T04:46:36.559747+0000","last_undegraded":"2024-09-19T04:46:36.559747+0000","last_fullsized":"2024-09-19T04:46:36.559747+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:17.896149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.794380+0000","last_change":"2024-09-19T04:46:36.794380+0000","last_active":"2024-09-19T04:46:36.794380+0000","last_peered":"2024-09-19T04:46:36.794380+0000","last_clean":"2024-09-19T04:46:36.794380+0000","last_became_active":"2024-09-19T04:46:36.793911+0000","last_became_peered":"2024-09-19T04:46:36.793911+0000","last_unstale":"2024-09-19T04:46:36.794380+0000","last_undegraded":"2024-09-19T04:46:36.794380+0000","last_fullsized":"2024-09-19T04:46:36.794380+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:01:37.733641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1],"acting":[7,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.805188+0000","last_change":"2024-09-19T04:46:23.514102+0000","last_active":"2024-09-19T04:46:36.805188+0000","last_peered":"2024-09-19T04:46:36.805188+0000","last_clean":"2024-09-19T04:46:36.805188+0000","last_became_active":"2024-09-19T04:46:23.513732+0000","last_became_peered":"2024-09-19T04:46:23.513732+0000","last_unstale":"2024-09-19T04:46:36.805188+0000","last_undegraded":"2024-09-19T04:46:36.805188+0000","last_fullsized":"2024-09-19T04:46:36.805188+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:13.533065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.805277+0000","last_change":"2024-09-19T04:46:21.572628+0000","last_active":"2024-09-19T04:46:36.805277+0000","last_peered":"2024-09-19T04:46:36.805277+0000","last_clean":"2024-09-19T04:46:36.805277+0000","last_became_active":"2024-09-19T04:46:21.571736+0000","last_became_peered":"2024-09-19T04:46:21.571736+0000","last_unstale":"2024-09-19T04:46:36.805277+0000","last_undegraded":"2024-09-19T04:46:36.805277+0000","last_fullsized":"2024-09-19T04:46:36.805277+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:10:50.204481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.991388+0000","last_change":"2024-09-19T04:46:36.991388+0000","last_active":"2024-09-19T04:46:36.991388+0000","last_peered":"2024-09-19T04:46:36.991388+0000","last_clean":"2024-09-19T04:46:36.991388+0000","last_became_active":"2024-09-19T04:46:36.990923+0000","last_became_peered":"2024-09-19T04:46:36.990923+0000","last_unstale":"2024-09-19T04:46:36.991388+0000","last_undegraded":"2024-09-19T04:46:36.991388+0000","last_fullsized":"2024-09-19T04:46:36.991388+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:31.148732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.565443+0000","last_change":"2024-09-19T04:46:21.492696+0000","last_active":"2024-09-19T04:46:36.565443+0000","last_peered":"2024-09-19T04:46:36.565443+0000","last_clean":"2024-09-19T04:46:36.565443+0000","last_became_active":"2024-09-19T04:46:21.492306+0000","last_became_peered":"2024-09-19T04:46:21.492306+0000","last_unstale":"2024-09-19T04:46:36.565443+0000","last_undegraded":"2024-09-19T04:46:36.565443+0000","last_fullsized":"2024-09-19T04:46:36.565443+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:51:56.975170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.989535+0000","last_change":"2024-09-19T04:46:36.989535+0000","last_active":"2024-09-19T04:46:36.989535+0000","last_peered":"2024-09-19T04:46:36.989535+0000","last_clean":"2024-09-19T04:46:36.989535+0000","last_became_active":"2024-09-19T04:46:36.989252+0000","last_became_peered":"2024-09-19T04:46:36.989252+0000","last_unstale":"2024-09-19T04:46:36.989535+0000","last_undegraded":"2024-09-19T04:46:36.989535+0000","last_fullsized":"2024-09-19T04:46:36.989535+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:49:45.767547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.561754+0000","last_change":"2024-09-19T04:46:21.572275+0000","last_active":"2024-09-19T04:46:36.561754+0000","last_peered":"2024-09-19T04:46:36.561754+0000","last_clean":"2024-09-19T04:46:36.561754+0000","last_became_active":"2024-09-19T04:46:21.571940+0000","last_became_peered":"2024-09-19T04:46:21.571940+0000","last_unstale":"2024-09-19T04:46:36.561754+0000","last_undegraded":"2024-09-19T04:46:36.561754+0000","last_fullsized":"2024-09-19T04:46:36.561754+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:13.399887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.561705+0000","last_change":"2024-09-19T04:46:23.514355+0000","last_active":"2024-09-19T04:46:36.561705+0000","last_peered":"2024-09-19T04:46:36.561705+0000","last_clean":"2024-09-19T04:46:36.561705+0000","last_became_active":"2024-09-19T04:46:23.513963+0000","last_became_peered":"2024-09-19T04:46:23.513963+0000","last_unstale":"2024-09-19T04:46:36.561705+0000","last_undegraded":"2024-09-19T04:46:36.561705+0000","last_fullsized":"2024-09-19T04:46:36.561705+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:06.742732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.990038+0000","last_change":"2024-09-19T04:46:21.572466+0000","last_active":"2024-09-19T04:46:36.990038+0000","last_peered":"2024-09-19T04:46:36.990038+0000","last_clean":"2024-09-19T04:46:36.990038+0000","last_became_active":"2024-09-19T04:46:21.571868+0000","last_became_peered":"2024-09-19T04:46:21.571868+0000","last_unstale":"2024-09-19T04:46:36.990038+0000","last_undegraded":"2024-09-19T04:46:36.990038+0000","last_fullsized":"2024-09-19T04:46:36.990038+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:01.132858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.805440+0000","last_change":"2024-09-19T04:46:23.509517+0000","last_active":"2024-09-19T04:46:36.805440+0000","last_peered":"2024-09-19T04:46:36.805440+0000","last_clean":"2024-09-19T04:46:36.805440+0000","last_became_active":"2024-09-19T04:46:23.509216+0000","last_became_peered":"2024-09-19T04:46:23.509216+0000","last_unstale":"2024-09-19T04:46:36.805440+0000","last_undegraded":"2024-09-19T04:46:36.805440+0000","last_fullsized":"2024-09-19T04:46:36.805440+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:29:52.747643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'8","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:45.511671+0000","last_change":"2024-09-19T04:46:21.484462+0000","last_active":"2024-09-19T04:46:45.511671+0000","last_peered":"2024-09-19T04:46:45.511671+0000","last_clean":"2024-09-19T04:46:45.511671+0000","last_became_active":"2024-09-19T04:46:21.484148+0000","last_became_peered":"2024-09-19T04:46:21.484148+0000","last_unstale":"2024-09-19T04:46:45.511671+0000","last_undegraded":"2024-09-19T04:46:45.511671+0000","last_fullsized":"2024-09-19T04:46:45.511671+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:17:18.742857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.559667+0000","last_change":"2024-09-19T04:46:23.512768+0000","last_active":"2024-09-19T04:46:36.559667+0000","last_peered":"2024-09-19T04:46:36.559667+0000","last_clean":"2024-09-19T04:46:36.559667+0000","last_became_active":"2024-09-19T04:46:23.512416+0000","last_became_peered":"2024-09-19T04:46:23.512416+0000","last_unstale":"2024-09-19T04:46:36.559667+0000","last_undegraded":"2024-09-19T04:46:36.559667+0000","last_fullsized":"2024-09-19T04:46:36.559667+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:03:48.340126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.814035+0000","last_change":"2024-09-19T04:46:21.488634+0000","last_active":"2024-09-19T04:46:36.814035+0000","last_peered":"2024-09-19T04:46:36.814035+0000","last_clean":"2024-09-19T04:46:36.814035+0000","last_became_active":"2024-09-19T04:46:21.488078+0000","last_became_peered":"2024-09-19T04:46:21.488078+0000","last_unstale":"2024-09-19T04:46:36.814035+0000","last_undegraded":"2024-09-19T04:46:36.814035+0000","last_fullsized":"2024-09-19T04:46:36.814035+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:31:47.946873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.988687+0000","last_change":"2024-09-19T04:46:23.522419+0000","last_active":"2024-09-19T04:46:36.988687+0000","last_peered":"2024-09-19T04:46:36.988687+0000","last_clean":"2024-09-19T04:46:36.988687+0000","last_became_active":"2024-09-19T04:46:23.522054+0000","last_became_peered":"2024-09-19T04:46:23.522054+0000","last_unstale":"2024-09-19T04:46:36.988687+0000","last_undegraded":"2024-09-19T04:46:36.988687+0000","last_fullsized":"2024-09-19T04:46:36.988687+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:43.720439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.793099+0000","last_change":"2024-09-19T04:46:21.572283+0000","last_active":"2024-09-19T04:46:36.793099+0000","last_peered":"2024-09-19T04:46:36.793099+0000","last_clean":"2024-09-19T04:46:36.793099+0000","last_became_active":"2024-09-19T04:46:21.572023+0000","last_became_peered":"2024-09-19T04:46:21.572023+0000","last_unstale":"2024-09-19T04:46:36.793099+0000","last_undegraded":"2024-09-19T04:46:36.793099+0000","last_fullsized":"2024-09-19T04:46:36.793099+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:37:26.293900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.989428+0000","last_change":"2024-09-19T04:46:23.516278+0000","last_active":"2024-09-19T04:46:36.989428+0000","last_peered":"2024-09-19T04:46:36.989428+0000","last_clean":"2024-09-19T04:46:36.989428+0000","last_became_active":"2024-09-19T04:46:23.515922+0000","last_became_peered":"2024-09-19T04:46:23.515922+0000","last_unstale":"2024-09-19T04:46:36.989428+0000","last_undegraded":"2024-09-19T04:46:36.989428+0000","last_fullsized":"2024-09-19T04:46:36.989428+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:26:11.038230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.559541+0000","last_change":"2024-09-19T04:46:21.489250+0000","last_active":"2024-09-19T04:46:36.559541+0000","last_peered":"2024-09-19T04:46:36.559541+0000","last_clean":"2024-09-19T04:46:36.559541+0000","last_became_active":"2024-09-19T04:46:21.488910+0000","last_became_peered":"2024-09-19T04:46:21.488910+0000","last_unstale":"2024-09-19T04:46:36.559541+0000","last_undegraded":"2024-09-19T04:46:36.559541+0000","last_fullsized":"2024-09-19T04:46:36.559541+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:04:03.650494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.563213+0000","last_change":"2024-09-19T04:46:23.512663+0000","last_active":"2024-09-19T04:46:36.563213+0000","last_peered":"2024-09-19T04:46:36.563213+0000","last_clean":"2024-09-19T04:46:36.563213+0000","last_became_active":"2024-09-19T04:46:23.512265+0000","last_became_peered":"2024-09-19T04:46:23.512265+0000","last_unstale":"2024-09-19T04:46:36.563213+0000","last_undegraded":"2024-09-19T04:46:36.563213+0000","last_fullsized":"2024-09-19T04:46:36.563213+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:52.903900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.991462+0000","last_change":"2024-09-19T04:46:36.990653+0000","last_active":"2024-09-19T04:46:36.991462+0000","last_peered":"2024-09-19T04:46:36.991462+0000","last_clean":"2024-09-19T04:46:36.991462+0000","last_became_active":"2024-09-19T04:46:36.990202+0000","last_became_peered":"2024-09-19T04:46:36.990202+0000","last_unstale":"2024-09-19T04:46:36.991462+0000","last_undegraded":"2024-09-19T04:46:36.991462+0000","last_fullsized":"2024-09-19T04:46:36.991462+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:25:53.780614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.559689+0000","last_change":"2024-09-19T04:46:23.510196+0000","last_active":"2024-09-19T04:46:36.559689+0000","last_peered":"2024-09-19T04:46:36.559689+0000","last_clean":"2024-09-19T04:46:36.559689+0000","last_became_active":"2024-09-19T04:46:23.509871+0000","last_became_peered":"2024-09-19T04:46:23.509871+0000","last_unstale":"2024-09-19T04:46:36.559689+0000","last_undegraded":"2024-09-19T04:46:36.559689+0000","last_fullsized":"2024-09-19T04:46:36.559689+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:42:01.825770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.989648+0000","last_change":"2024-09-19T04:46:21.492279+0000","last_active":"2024-09-19T04:46:36.989648+0000","last_peered":"2024-09-19T04:46:36.989648+0000","last_clean":"2024-09-19T04:46:36.989648+0000","last_became_active":"2024-09-19T04:46:21.491669+0000","last_became_peered":"2024-09-19T04:46:21.491669+0000","last_unstale":"2024-09-19T04:46:36.989648+0000","last_undegraded":"2024-09-19T04:46:36.989648+0000","last_fullsized":"2024-09-19T04:46:36.989648+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:23:15.822887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.565280+0000","last_change":"2024-09-19T04:46:23.518114+0000","last_active":"2024-09-19T04:46:36.565280+0000","last_peered":"2024-09-19T04:46:36.565280+0000","last_clean":"2024-09-19T04:46:36.565280+0000","last_became_active":"2024-09-19T04:46:23.517707+0000","last_became_peered":"2024-09-19T04:46:23.517707+0000","last_unstale":"2024-09-19T04:46:36.565280+0000","last_undegraded":"2024-09-19T04:46:36.565280+0000","last_fullsized":"2024-09-19T04:46:36.565280+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:52.438748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.570333+0000","last_change":"2024-09-19T04:46:23.525164+0000","last_active":"2024-09-19T04:46:36.570333+0000","last_peered":"2024-09-19T04:46:36.570333+0000","last_clean":"2024-09-19T04:46:36.570333+0000","last_became_active":"2024-09-19T04:46:23.524735+0000","last_became_peered":"2024-09-19T04:46:23.524735+0000","last_unstale":"2024-09-19T04:46:36.570333+0000","last_undegraded":"2024-09-19T04:46:36.570333+0000","last_fullsized":"2024-09-19T04:46:36.570333+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:53.590834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.989803+0000","last_change":"2024-09-19T04:46:21.492940+0000","last_active":"2024-09-19T04:46:36.989803+0000","last_peered":"2024-09-19T04:46:36.989803+0000","last_clean":"2024-09-19T04:46:36.989803+0000","last_became_active":"2024-09-19T04:46:21.492602+0000","last_became_peered":"2024-09-19T04:46:21.492602+0000","last_unstale":"2024-09-19T04:46:36.989803+0000","last_undegraded":"2024-09-19T04:46:36.989803+0000","last_fullsized":"2024-09-19T04:46:36.989803+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:20.554832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.792910+0000","last_change":"2024-09-19T04:46:23.513432+0000","last_active":"2024-09-19T04:46:36.792910+0000","last_peered":"2024-09-19T04:46:36.792910+0000","last_clean":"2024-09-19T04:46:36.792910+0000","last_became_active":"2024-09-19T04:46:23.513084+0000","last_became_peered":"2024-09-19T04:46:23.513084+0000","last_unstale":"2024-09-19T04:46:36.792910+0000","last_undegraded":"2024-09-19T04:46:36.792910+0000","last_fullsized":"2024-09-19T04:46:36.792910+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:03:16.732545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.989947+0000","last_change":"2024-09-19T04:46:21.491823+0000","last_active":"2024-09-19T04:46:36.989947+0000","last_peered":"2024-09-19T04:46:36.989947+0000","last_clean":"2024-09-19T04:46:36.989947+0000","last_became_active":"2024-09-19T04:46:21.491401+0000","last_became_peered":"2024-09-19T04:46:21.491401+0000","last_unstale":"2024-09-19T04:46:36.989947+0000","last_undegraded":"2024-09-19T04:46:36.989947+0000","last_fullsized":"2024-09-19T04:46:36.989947+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:55.955868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.988852+0000","last_change":"2024-09-19T04:46:23.515884+0000","last_active":"2024-09-19T04:46:36.988852+0000","last_peered":"2024-09-19T04:46:36.988852+0000","last_clean":"2024-09-19T04:46:36.988852+0000","last_became_active":"2024-09-19T04:46:23.515243+0000","last_became_peered":"2024-09-19T04:46:23.515243+0000","last_unstale":"2024-09-19T04:46:36.988852+0000","last_undegraded":"2024-09-19T04:46:36.988852+0000","last_fullsized":"2024-09-19T04:46:36.988852+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:07:33.716942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.559784+0000","last_change":"2024-09-19T04:46:21.572122+0000","last_active":"2024-09-19T04:46:36.559784+0000","last_peered":"2024-09-19T04:46:36.559784+0000","last_clean":"2024-09-19T04:46:36.559784+0000","last_became_active":"2024-09-19T04:46:21.571747+0000","last_became_peered":"2024-09-19T04:46:21.571747+0000","last_unstale":"2024-09-19T04:46:36.559784+0000","last_undegraded":"2024-09-19T04:46:36.559784+0000","last_fullsized":"2024-09-19T04:46:36.559784+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:06:43.411409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.559639+0000","last_change":"2024-09-19T04:46:23.513876+0000","last_active":"2024-09-19T04:46:36.559639+0000","last_peered":"2024-09-19T04:46:36.559639+0000","last_clean":"2024-09-19T04:46:36.559639+0000","last_became_active":"2024-09-19T04:46:23.513562+0000","last_became_peered":"2024-09-19T04:46:23.513562+0000","last_unstale":"2024-09-19T04:46:36.559639+0000","last_undegraded":"2024-09-19T04:46:36.559639+0000","last_fullsized":"2024-09-19T04:46:36.559639+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:21.982001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.561722+0000","last_change":"2024-09-19T04:46:21.491550+0000","last_active":"2024-09-19T04:46:36.561722+0000","last_peered":"2024-09-19T04:46:36.561722+0000","last_clean":"2024-09-19T04:46:36.561722+0000","last_became_active":"2024-09-19T04:46:21.491259+0000","last_became_peered":"2024-09-19T04:46:21.491259+0000","last_unstale":"2024-09-19T04:46:36.561722+0000","last_undegraded":"2024-09-19T04:46:36.561722+0000","last_fullsized":"2024-09-19T04:46:36.561722+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:38.671211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":61997,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":108,"num_read_kb":115,"num_write":78,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":185991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":65,"ondisk_log_size":65,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645337,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32040,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713112,"statfs":{"total":95995035648,"available":95962226688,"internally_reserved":0,"allocated":872448,"data_stored":426161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874270,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36856,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708296,"statfs":{"total":95995035648,"available":95957295104,"internally_reserved":0,"allocated":1548288,"data_stored":1078005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":36174273},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005091,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40356,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704796,"statfs":{"total":95995035648,"available":95953711104,"internally_reserved":0,"allocated":872448,"data_stored":426709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234024,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":876544,"data_stored":426731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462957,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28460,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716692,"statfs":{"total":95995035648,"available":95965892608,"internally_reserved":0,"allocated":1470464,"data_stored":1017194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626482,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36200,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708952,"statfs":{"total":95995035648,"available":95957966848,"internally_reserved":0,"allocated":872448,"data_stored":426244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855414,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28468,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716684,"statfs":{"total":95995035648,"available":95965884416,"internally_reserved":0,"allocated":1478656,"data_stored":1016794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018940,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36204,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708948,"statfs":{"total":95995035648,"available":95957962752,"internally_reserved":0,"allocated":872448,"data_stored":426149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247873,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":426465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476806,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":937984,"data_stored":487326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607627,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40420,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704732,"statfs":{"total":95995035648,"available":95953645568,"internally_reserved":0,"allocated":937984,"data_stored":487326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40364,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704788,"statfs":{"total":95995035648,"available":95953702912,"internally_reserved":0,"allocated":872448,"data_stored":426217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":61199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":61199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":61393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T04:47:24.679 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T04:47:24.938 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:47:25.167 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:24 smithi002 ceph-mon[30975]: pgmap v304: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:47:25.167 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:24 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:47:25.167 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:24 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:47:25.167 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:24 smithi002 ceph-mon[30975]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:47:25.167 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:24 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:47:25.167 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:24 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:47:25.167 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:24 smithi002 ceph-mon[30975]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:47:25.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:24 smithi018 ceph-mon[34537]: pgmap v304: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:47:25.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:24 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:47:25.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:24 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:47:25.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:24 smithi018 ceph-mon[34537]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:47:25.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:24 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:47:25.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:24 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:47:25.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:24 smithi018 ceph-mon[34537]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:47:25.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:24 smithi116 ceph-mon[34477]: pgmap v304: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:47:25.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:24 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:47:25.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:24 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:47:25.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:24 smithi116 ceph-mon[34477]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:47:25.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:24 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:47:25.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:24 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:47:25.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:24 smithi116 ceph-mon[34477]: from='mgr.14150 172.21.15.2:0/2330747825' entity='mgr.x' 2024-09-19T04:47:25.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.390+0000 7fdba2264640 1 -- 172.21.15.2:0/1497737936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb9c106f50 msgr2=0x7fdb9c10eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:25.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.390+0000 7fdba2264640 1 --2- 172.21.15.2:0/1497737936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb9c106f50 0x7fdb9c10eaf0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fdb94009cd0 tx=0x7fdb9402a8e0 comp rx=0 tx=0).stop 2024-09-19T04:47:25.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.390+0000 7fdba2264640 1 -- 172.21.15.2:0/1497737936 shutdown_connections 2024-09-19T04:47:25.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.390+0000 7fdba2264640 1 --2- 172.21.15.2:0/1497737936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb9c106f50 0x7fdb9c10eaf0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:25.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.390+0000 7fdba2264640 1 --2- 172.21.15.2:0/1497737936 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb9c100ca0 0x7fdb9c106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:25.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.390+0000 7fdba2264640 1 --2- 172.21.15.2:0/1497737936 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb9c1002f0 0x7fdb9c1006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:25.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.390+0000 7fdba2264640 1 -- 172.21.15.2:0/1497737936 >> 172.21.15.2:0/1497737936 conn(0x7fdb9c077210 msgr2=0x7fdb9c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:25.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.390+0000 7fdba2264640 1 -- 172.21.15.2:0/1497737936 shutdown_connections 2024-09-19T04:47:25.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.390+0000 7fdba2264640 1 -- 172.21.15.2:0/1497737936 wait complete. 2024-09-19T04:47:25.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.391+0000 7fdba2264640 1 Processor -- start 2024-09-19T04:47:25.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.391+0000 7fdba2264640 1 -- start start 2024-09-19T04:47:25.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.391+0000 7fdba2264640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb9c1002f0 0x7fdb9c1983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:25.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.391+0000 7fdba2264640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb9c100ca0 0x7fdb9c198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:25.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.391+0000 7fdba2264640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb9c106f50 0x7fdb9c19ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:25.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.391+0000 7fdba2264640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdb9c111e50 con 0x7fdb9c1002f0 2024-09-19T04:47:25.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.391+0000 7fdba2264640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdb9c111cd0 con 0x7fdb9c106f50 2024-09-19T04:47:25.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.391+0000 7fdba2264640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fdb9c111fd0 con 0x7fdb9c100ca0 2024-09-19T04:47:25.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.391+0000 7fdb9bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb9c1002f0 0x7fdb9c1983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:25.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.391+0000 7fdb9bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb9c1002f0 0x7fdb9c1983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51900/0 (socket says 172.21.15.2:51900) 2024-09-19T04:47:25.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.391+0000 7fdb9bfff640 1 -- 172.21.15.2:0/2494027654 learned_addr learned my addr 172.21.15.2:0/2494027654 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:47:25.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.392+0000 7fdba0801640 1 --2- 172.21.15.2:0/2494027654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb9c106f50 0x7fdb9c19ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:25.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.392+0000 7fdb9b7fe640 1 --2- 172.21.15.2:0/2494027654 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb9c100ca0 0x7fdb9c198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:25.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.392+0000 7fdb9bfff640 1 -- 172.21.15.2:0/2494027654 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb9c100ca0 msgr2=0x7fdb9c198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:25.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.392+0000 7fdb9bfff640 1 --2- 172.21.15.2:0/2494027654 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb9c100ca0 0x7fdb9c198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:25.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.392+0000 7fdb9bfff640 1 -- 172.21.15.2:0/2494027654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb9c106f50 msgr2=0x7fdb9c19ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:25.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.392+0000 7fdb9bfff640 1 --2- 172.21.15.2:0/2494027654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb9c106f50 0x7fdb9c19ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:25.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.392+0000 7fdb9bfff640 1 -- 172.21.15.2:0/2494027654 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb9c19d390 con 0x7fdb9c1002f0 2024-09-19T04:47:25.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.392+0000 7fdb9b7fe640 1 --2- 172.21.15.2:0/2494027654 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb9c100ca0 0x7fdb9c198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:47:25.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.392+0000 7fdb9bfff640 1 --2- 172.21.15.2:0/2494027654 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb9c1002f0 0x7fdb9c1983e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c00d950 tx=0x7fdb8c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:25.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.392+0000 7fdb997fa640 1 -- 172.21.15.2:0/2494027654 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c017070 con 0x7fdb9c1002f0 2024-09-19T04:47:25.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.392+0000 7fdba2264640 1 -- 172.21.15.2:0/2494027654 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb9c19d680 con 0x7fdb9c1002f0 2024-09-19T04:47:25.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.392+0000 7fdb997fa640 1 -- 172.21.15.2:0/2494027654 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdb8c009c30 con 0x7fdb9c1002f0 2024-09-19T04:47:25.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.392+0000 7fdb997fa640 1 -- 172.21.15.2:0/2494027654 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c00f620 con 0x7fdb9c1002f0 2024-09-19T04:47:25.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.392+0000 7fdba2264640 1 -- 172.21.15.2:0/2494027654 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb9c1a4f60 con 0x7fdb9c1002f0 2024-09-19T04:47:25.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.393+0000 7fdba2264640 1 -- 172.21.15.2:0/2494027654 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb9c1006d0 con 0x7fdb9c1002f0 2024-09-19T04:47:25.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.395+0000 7fdb997fa640 1 -- 172.21.15.2:0/2494027654 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fdb8c0109a0 con 0x7fdb9c1002f0 2024-09-19T04:47:25.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.395+0000 7fdb997fa640 1 --2- 172.21.15.2:0/2494027654 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fdb840a32d0 0x7fdb840a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:25.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.395+0000 7fdb9b7fe640 1 --2- 172.21.15.2:0/2494027654 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fdb840a32d0 0x7fdb840a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:25.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.395+0000 7fdb997fa640 1 -- 172.21.15.2:0/2494027654 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fdb8c0cf720 con 0x7fdb9c1002f0 2024-09-19T04:47:25.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.396+0000 7fdb9b7fe640 1 --2- 172.21.15.2:0/2494027654 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fdb840a32d0 0x7fdb840a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdb90005fd0 tx=0x7fdb900094d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:25.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.400+0000 7fdb997fa640 1 -- 172.21.15.2:0/2494027654 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdb8c009de0 con 0x7fdb9c1002f0 2024-09-19T04:47:25.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.575+0000 7fdba2264640 1 -- 172.21.15.2:0/2494027654 --> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdb9c10a1b0 con 0x7fdb840a32d0 2024-09-19T04:47:25.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.582+0000 7fdb997fa640 1 -- 172.21.15.2:0/2494027654 <== mgr.14150 v2:172.21.15.2:6800/3171525177 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258646 (secure 0 0 0) 0x7fdb9000e9e0 con 0x7fdb840a32d0 2024-09-19T04:47:25.585 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:47:25.586 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-19T04:47:25.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.584+0000 7fdba2264640 1 -- 172.21.15.2:0/2494027654 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fdb840a32d0 msgr2=0x7fdb840a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:25.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.584+0000 7fdba2264640 1 --2- 172.21.15.2:0/2494027654 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fdb840a32d0 0x7fdb840a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdb90005fd0 tx=0x7fdb900094d0 comp rx=0 tx=0).stop 2024-09-19T04:47:25.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.585+0000 7fdba2264640 1 -- 172.21.15.2:0/2494027654 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb9c1002f0 msgr2=0x7fdb9c1983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:25.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.585+0000 7fdba2264640 1 --2- 172.21.15.2:0/2494027654 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb9c1002f0 0x7fdb9c1983e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c00d950 tx=0x7fdb8c00de10 comp rx=0 tx=0).stop 2024-09-19T04:47:25.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.585+0000 7fdba2264640 1 -- 172.21.15.2:0/2494027654 shutdown_connections 2024-09-19T04:47:25.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.585+0000 7fdba2264640 1 --2- 172.21.15.2:0/2494027654 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fdb840a32d0 0x7fdb840a5790 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:25.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.585+0000 7fdba2264640 1 --2- 172.21.15.2:0/2494027654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb9c106f50 0x7fdb9c19ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:25.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.585+0000 7fdba2264640 1 --2- 172.21.15.2:0/2494027654 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb9c100ca0 0x7fdb9c198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:25.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.585+0000 7fdba2264640 1 --2- 172.21.15.2:0/2494027654 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb9c1002f0 0x7fdb9c1983e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:25.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.585+0000 7fdba2264640 1 -- 172.21.15.2:0/2494027654 >> 172.21.15.2:0/2494027654 conn(0x7fdb9c077210 msgr2=0x7fdb9c1052c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:25.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.585+0000 7fdba2264640 1 -- 172.21.15.2:0/2494027654 shutdown_connections 2024-09-19T04:47:25.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:25.585+0000 7fdba2264640 1 -- 172.21.15.2:0/2494027654 wait complete. 2024-09-19T04:47:26.242 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":305,"stamp":"2024-09-19T04:47:25.555096+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":652599,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":254,"num_read_kb":239,"num_write":261,"num_write_kb":3023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1180770,"num_keys_recovered":10,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":204,"ondisk_log_size":204,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":407236,"kb_used_data":12204,"kb_used_omap":18,"kb_used_meta":394797,"kb_avail":1124534588,"statfs":{"total":1151940427776,"available":1151523418112,"internally_reserved":0,"allocated":12496896,"data_stored":7071321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":404272442},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":15,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002770"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.563629+0000","last_change":"2024-09-19T04:46:23.520907+0000","last_active":"2024-09-19T04:46:36.563629+0000","last_peered":"2024-09-19T04:46:36.563629+0000","last_clean":"2024-09-19T04:46:36.563629+0000","last_became_active":"2024-09-19T04:46:23.519321+0000","last_became_peered":"2024-09-19T04:46:23.519321+0000","last_unstale":"2024-09-19T04:46:36.563629+0000","last_undegraded":"2024-09-19T04:46:36.563629+0000","last_fullsized":"2024-09-19T04:46:36.563629+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:31.529472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.988683+0000","last_change":"2024-09-19T04:46:23.515272+0000","last_active":"2024-09-19T04:46:36.988683+0000","last_peered":"2024-09-19T04:46:36.988683+0000","last_clean":"2024-09-19T04:46:36.988683+0000","last_became_active":"2024-09-19T04:46:23.514760+0000","last_became_peered":"2024-09-19T04:46:23.514760+0000","last_unstale":"2024-09-19T04:46:36.988683+0000","last_undegraded":"2024-09-19T04:46:36.988683+0000","last_fullsized":"2024-09-19T04:46:36.988683+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:32.215940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.988740+0000","last_change":"2024-09-19T04:46:23.516809+0000","last_active":"2024-09-19T04:46:36.988740+0000","last_peered":"2024-09-19T04:46:36.988740+0000","last_clean":"2024-09-19T04:46:36.988740+0000","last_became_active":"2024-09-19T04:46:23.516489+0000","last_became_peered":"2024-09-19T04:46:23.516489+0000","last_unstale":"2024-09-19T04:46:36.988740+0000","last_undegraded":"2024-09-19T04:46:36.988740+0000","last_fullsized":"2024-09-19T04:46:36.988740+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:17:51.183061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.813744+0000","last_change":"2024-09-19T04:46:23.506868+0000","last_active":"2024-09-19T04:46:36.813744+0000","last_peered":"2024-09-19T04:46:36.813744+0000","last_clean":"2024-09-19T04:46:36.813744+0000","last_became_active":"2024-09-19T04:46:23.506489+0000","last_became_peered":"2024-09-19T04:46:23.506489+0000","last_unstale":"2024-09-19T04:46:36.813744+0000","last_undegraded":"2024-09-19T04:46:36.813744+0000","last_fullsized":"2024-09-19T04:46:36.813744+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:22.749973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.989486+0000","last_change":"2024-09-19T04:46:23.506733+0000","last_active":"2024-09-19T04:46:36.989486+0000","last_peered":"2024-09-19T04:46:36.989486+0000","last_clean":"2024-09-19T04:46:36.989486+0000","last_became_active":"2024-09-19T04:46:23.506408+0000","last_became_peered":"2024-09-19T04:46:23.506408+0000","last_unstale":"2024-09-19T04:46:36.989486+0000","last_undegraded":"2024-09-19T04:46:36.989486+0000","last_fullsized":"2024-09-19T04:46:36.989486+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:45:31.821607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.561796+0000","last_change":"2024-09-19T04:46:23.523109+0000","last_active":"2024-09-19T04:46:36.561796+0000","last_peered":"2024-09-19T04:46:36.561796+0000","last_clean":"2024-09-19T04:46:36.561796+0000","last_became_active":"2024-09-19T04:46:23.522783+0000","last_became_peered":"2024-09-19T04:46:23.522783+0000","last_unstale":"2024-09-19T04:46:36.561796+0000","last_undegraded":"2024-09-19T04:46:36.561796+0000","last_fullsized":"2024-09-19T04:46:36.561796+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:34:47.622562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.566699+0000","last_change":"2024-09-19T04:46:23.518297+0000","last_active":"2024-09-19T04:46:36.566699+0000","last_peered":"2024-09-19T04:46:36.566699+0000","last_clean":"2024-09-19T04:46:36.566699+0000","last_became_active":"2024-09-19T04:46:23.517974+0000","last_became_peered":"2024-09-19T04:46:23.517974+0000","last_unstale":"2024-09-19T04:46:36.566699+0000","last_undegraded":"2024-09-19T04:46:36.566699+0000","last_fullsized":"2024-09-19T04:46:36.566699+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:23:26.474961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.559392+0000","last_change":"2024-09-19T04:46:23.516255+0000","last_active":"2024-09-19T04:46:36.559392+0000","last_peered":"2024-09-19T04:46:36.559392+0000","last_clean":"2024-09-19T04:46:36.559392+0000","last_became_active":"2024-09-19T04:46:23.515861+0000","last_became_peered":"2024-09-19T04:46:23.515861+0000","last_unstale":"2024-09-19T04:46:36.559392+0000","last_undegraded":"2024-09-19T04:46:36.559392+0000","last_fullsized":"2024-09-19T04:46:36.559392+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:08:19.747905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.793466+0000","last_change":"2024-09-19T04:46:23.520947+0000","last_active":"2024-09-19T04:46:36.793466+0000","last_peered":"2024-09-19T04:46:36.793466+0000","last_clean":"2024-09-19T04:46:36.793466+0000","last_became_active":"2024-09-19T04:46:23.518463+0000","last_became_peered":"2024-09-19T04:46:23.518463+0000","last_unstale":"2024-09-19T04:46:36.793466+0000","last_undegraded":"2024-09-19T04:46:36.793466+0000","last_fullsized":"2024-09-19T04:46:36.793466+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:00.420868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.561908+0000","last_change":"2024-09-19T04:46:23.524145+0000","last_active":"2024-09-19T04:46:36.561908+0000","last_peered":"2024-09-19T04:46:36.561908+0000","last_clean":"2024-09-19T04:46:36.561908+0000","last_became_active":"2024-09-19T04:46:23.523698+0000","last_became_peered":"2024-09-19T04:46:23.523698+0000","last_unstale":"2024-09-19T04:46:36.561908+0000","last_undegraded":"2024-09-19T04:46:36.561908+0000","last_fullsized":"2024-09-19T04:46:36.561908+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:41.370871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.565617+0000","last_change":"2024-09-19T04:46:23.521782+0000","last_active":"2024-09-19T04:46:36.565617+0000","last_peered":"2024-09-19T04:46:36.565617+0000","last_clean":"2024-09-19T04:46:36.565617+0000","last_became_active":"2024-09-19T04:46:23.521452+0000","last_became_peered":"2024-09-19T04:46:23.521452+0000","last_unstale":"2024-09-19T04:46:36.565617+0000","last_undegraded":"2024-09-19T04:46:36.565617+0000","last_fullsized":"2024-09-19T04:46:36.565617+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:11:35.047064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.813744+0000","last_change":"2024-09-19T04:46:23.518174+0000","last_active":"2024-09-19T04:46:36.813744+0000","last_peered":"2024-09-19T04:46:36.813744+0000","last_clean":"2024-09-19T04:46:36.813744+0000","last_became_active":"2024-09-19T04:46:23.516507+0000","last_became_peered":"2024-09-19T04:46:23.516507+0000","last_unstale":"2024-09-19T04:46:36.813744+0000","last_undegraded":"2024-09-19T04:46:36.813744+0000","last_fullsized":"2024-09-19T04:46:36.813744+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:37.878245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.805393+0000","last_change":"2024-09-19T04:46:23.510582+0000","last_active":"2024-09-19T04:46:36.805393+0000","last_peered":"2024-09-19T04:46:36.805393+0000","last_clean":"2024-09-19T04:46:36.805393+0000","last_became_active":"2024-09-19T04:46:23.510135+0000","last_became_peered":"2024-09-19T04:46:23.510135+0000","last_unstale":"2024-09-19T04:46:36.805393+0000","last_undegraded":"2024-09-19T04:46:36.805393+0000","last_fullsized":"2024-09-19T04:46:36.805393+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:09.721696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.988533+0000","last_change":"2024-09-19T04:46:23.517963+0000","last_active":"2024-09-19T04:46:36.988533+0000","last_peered":"2024-09-19T04:46:36.988533+0000","last_clean":"2024-09-19T04:46:36.988533+0000","last_became_active":"2024-09-19T04:46:23.517574+0000","last_became_peered":"2024-09-19T04:46:23.517574+0000","last_unstale":"2024-09-19T04:46:36.988533+0000","last_undegraded":"2024-09-19T04:46:36.988533+0000","last_fullsized":"2024-09-19T04:46:36.988533+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:48:44.494267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.988454+0000","last_change":"2024-09-19T04:46:23.517318+0000","last_active":"2024-09-19T04:46:36.988454+0000","last_peered":"2024-09-19T04:46:36.988454+0000","last_clean":"2024-09-19T04:46:36.988454+0000","last_became_active":"2024-09-19T04:46:23.516973+0000","last_became_peered":"2024-09-19T04:46:23.516973+0000","last_unstale":"2024-09-19T04:46:36.988454+0000","last_undegraded":"2024-09-19T04:46:36.988454+0000","last_fullsized":"2024-09-19T04:46:36.988454+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:46:28.907400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.792910+0000","last_change":"2024-09-19T04:46:23.517468+0000","last_active":"2024-09-19T04:46:36.792910+0000","last_peered":"2024-09-19T04:46:36.792910+0000","last_clean":"2024-09-19T04:46:36.792910+0000","last_became_active":"2024-09-19T04:46:23.517093+0000","last_became_peered":"2024-09-19T04:46:23.517093+0000","last_unstale":"2024-09-19T04:46:36.792910+0000","last_undegraded":"2024-09-19T04:46:36.792910+0000","last_fullsized":"2024-09-19T04:46:36.792910+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:43.435560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.563738+0000","last_change":"2024-09-19T04:46:23.521679+0000","last_active":"2024-09-19T04:46:36.563738+0000","last_peered":"2024-09-19T04:46:36.563738+0000","last_clean":"2024-09-19T04:46:36.563738+0000","last_became_active":"2024-09-19T04:46:23.519346+0000","last_became_peered":"2024-09-19T04:46:23.519346+0000","last_unstale":"2024-09-19T04:46:36.563738+0000","last_undegraded":"2024-09-19T04:46:36.563738+0000","last_fullsized":"2024-09-19T04:46:36.563738+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:31.740226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.561931+0000","last_change":"2024-09-19T04:46:23.517518+0000","last_active":"2024-09-19T04:46:36.561931+0000","last_peered":"2024-09-19T04:46:36.561931+0000","last_clean":"2024-09-19T04:46:36.561931+0000","last_became_active":"2024-09-19T04:46:23.517179+0000","last_became_peered":"2024-09-19T04:46:23.517179+0000","last_unstale":"2024-09-19T04:46:36.561931+0000","last_undegraded":"2024-09-19T04:46:36.561931+0000","last_fullsized":"2024-09-19T04:46:36.561931+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:38.352433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.566817+0000","last_change":"2024-09-19T04:46:23.506618+0000","last_active":"2024-09-19T04:46:36.566817+0000","last_peered":"2024-09-19T04:46:36.566817+0000","last_clean":"2024-09-19T04:46:36.566817+0000","last_became_active":"2024-09-19T04:46:23.506276+0000","last_became_peered":"2024-09-19T04:46:23.506276+0000","last_unstale":"2024-09-19T04:46:36.566817+0000","last_undegraded":"2024-09-19T04:46:36.566817+0000","last_fullsized":"2024-09-19T04:46:36.566817+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:02:42.216717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.563322+0000","last_change":"2024-09-19T04:46:23.518793+0000","last_active":"2024-09-19T04:46:36.563322+0000","last_peered":"2024-09-19T04:46:36.563322+0000","last_clean":"2024-09-19T04:46:36.563322+0000","last_became_active":"2024-09-19T04:46:23.518386+0000","last_became_peered":"2024-09-19T04:46:23.518386+0000","last_unstale":"2024-09-19T04:46:36.563322+0000","last_undegraded":"2024-09-19T04:46:36.563322+0000","last_fullsized":"2024-09-19T04:46:36.563322+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:08:12.007678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.805447+0000","last_change":"2024-09-19T04:46:23.513022+0000","last_active":"2024-09-19T04:46:36.805447+0000","last_peered":"2024-09-19T04:46:36.805447+0000","last_clean":"2024-09-19T04:46:36.805447+0000","last_became_active":"2024-09-19T04:46:23.512541+0000","last_became_peered":"2024-09-19T04:46:23.512541+0000","last_unstale":"2024-09-19T04:46:36.805447+0000","last_undegraded":"2024-09-19T04:46:36.805447+0000","last_fullsized":"2024-09-19T04:46:36.805447+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:19.873546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.792966+0000","last_change":"2024-09-19T04:46:23.519523+0000","last_active":"2024-09-19T04:46:36.792966+0000","last_peered":"2024-09-19T04:46:36.792966+0000","last_clean":"2024-09-19T04:46:36.792966+0000","last_became_active":"2024-09-19T04:46:23.517995+0000","last_became_peered":"2024-09-19T04:46:23.517995+0000","last_unstale":"2024-09-19T04:46:36.792966+0000","last_undegraded":"2024-09-19T04:46:36.792966+0000","last_fullsized":"2024-09-19T04:46:36.792966+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:23.243522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.559440+0000","last_change":"2024-09-19T04:46:23.517564+0000","last_active":"2024-09-19T04:46:36.559440+0000","last_peered":"2024-09-19T04:46:36.559440+0000","last_clean":"2024-09-19T04:46:36.559440+0000","last_became_active":"2024-09-19T04:46:23.517248+0000","last_became_peered":"2024-09-19T04:46:23.517248+0000","last_unstale":"2024-09-19T04:46:36.559440+0000","last_undegraded":"2024-09-19T04:46:36.559440+0000","last_fullsized":"2024-09-19T04:46:36.559440+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:19.369346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.571382+0000","last_change":"2024-09-19T04:46:23.514150+0000","last_active":"2024-09-19T04:46:36.571382+0000","last_peered":"2024-09-19T04:46:36.571382+0000","last_clean":"2024-09-19T04:46:36.571382+0000","last_became_active":"2024-09-19T04:46:23.512169+0000","last_became_peered":"2024-09-19T04:46:23.512169+0000","last_unstale":"2024-09-19T04:46:36.571382+0000","last_undegraded":"2024-09-19T04:46:36.571382+0000","last_fullsized":"2024-09-19T04:46:36.571382+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:17.475389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.815086+0000","last_change":"2024-09-19T04:46:36.814692+0000","last_active":"2024-09-19T04:46:36.815086+0000","last_peered":"2024-09-19T04:46:36.815086+0000","last_clean":"2024-09-19T04:46:36.815086+0000","last_became_active":"2024-09-19T04:46:36.814429+0000","last_became_peered":"2024-09-19T04:46:36.814429+0000","last_unstale":"2024-09-19T04:46:36.815086+0000","last_undegraded":"2024-09-19T04:46:36.815086+0000","last_fullsized":"2024-09-19T04:46:36.815086+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:10:42.391448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.566542+0000","last_change":"2024-09-19T04:46:23.519273+0000","last_active":"2024-09-19T04:46:36.566542+0000","last_peered":"2024-09-19T04:46:36.566542+0000","last_clean":"2024-09-19T04:46:36.566542+0000","last_became_active":"2024-09-19T04:46:23.519001+0000","last_became_peered":"2024-09-19T04:46:23.519001+0000","last_unstale":"2024-09-19T04:46:36.566542+0000","last_undegraded":"2024-09-19T04:46:36.566542+0000","last_fullsized":"2024-09-19T04:46:36.566542+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:15:30.949066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.563341+0000","last_change":"2024-09-19T04:46:23.520888+0000","last_active":"2024-09-19T04:46:36.563341+0000","last_peered":"2024-09-19T04:46:36.563341+0000","last_clean":"2024-09-19T04:46:36.563341+0000","last_became_active":"2024-09-19T04:46:23.519476+0000","last_became_peered":"2024-09-19T04:46:23.519476+0000","last_unstale":"2024-09-19T04:46:36.563341+0000","last_undegraded":"2024-09-19T04:46:36.563341+0000","last_fullsized":"2024-09-19T04:46:36.563341+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:56.459724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.805408+0000","last_change":"2024-09-19T04:46:23.512152+0000","last_active":"2024-09-19T04:46:36.805408+0000","last_peered":"2024-09-19T04:46:36.805408+0000","last_clean":"2024-09-19T04:46:36.805408+0000","last_became_active":"2024-09-19T04:46:23.511784+0000","last_became_peered":"2024-09-19T04:46:23.511784+0000","last_unstale":"2024-09-19T04:46:36.805408+0000","last_undegraded":"2024-09-19T04:46:36.805408+0000","last_fullsized":"2024-09-19T04:46:36.805408+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:01:23.406580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.988812+0000","last_change":"2024-09-19T04:46:23.522491+0000","last_active":"2024-09-19T04:46:36.988812+0000","last_peered":"2024-09-19T04:46:36.988812+0000","last_clean":"2024-09-19T04:46:36.988812+0000","last_became_active":"2024-09-19T04:46:23.522025+0000","last_became_peered":"2024-09-19T04:46:23.522025+0000","last_unstale":"2024-09-19T04:46:36.988812+0000","last_undegraded":"2024-09-19T04:46:36.988812+0000","last_fullsized":"2024-09-19T04:46:36.988812+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:33.063300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.566102+0000","last_change":"2024-09-19T04:46:23.510057+0000","last_active":"2024-09-19T04:46:36.566102+0000","last_peered":"2024-09-19T04:46:36.566102+0000","last_clean":"2024-09-19T04:46:36.566102+0000","last_became_active":"2024-09-19T04:46:23.509691+0000","last_became_peered":"2024-09-19T04:46:23.509691+0000","last_unstale":"2024-09-19T04:46:36.566102+0000","last_undegraded":"2024-09-19T04:46:36.566102+0000","last_fullsized":"2024-09-19T04:46:36.566102+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:12:16.579944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.565831+0000","last_change":"2024-09-19T04:46:23.516876+0000","last_active":"2024-09-19T04:46:36.565831+0000","last_peered":"2024-09-19T04:46:36.565831+0000","last_clean":"2024-09-19T04:46:36.565831+0000","last_became_active":"2024-09-19T04:46:23.516533+0000","last_became_peered":"2024-09-19T04:46:23.516533+0000","last_unstale":"2024-09-19T04:46:36.565831+0000","last_undegraded":"2024-09-19T04:46:36.565831+0000","last_fullsized":"2024-09-19T04:46:36.565831+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:44.868936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.563114+0000","last_change":"2024-09-19T04:46:23.517607+0000","last_active":"2024-09-19T04:46:36.563114+0000","last_peered":"2024-09-19T04:46:36.563114+0000","last_clean":"2024-09-19T04:46:36.563114+0000","last_became_active":"2024-09-19T04:46:23.517289+0000","last_became_peered":"2024-09-19T04:46:23.517289+0000","last_unstale":"2024-09-19T04:46:36.563114+0000","last_undegraded":"2024-09-19T04:46:36.563114+0000","last_fullsized":"2024-09-19T04:46:36.563114+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:08:22.882886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.989428+0000","last_change":"2024-09-19T04:46:23.507713+0000","last_active":"2024-09-19T04:46:36.989428+0000","last_peered":"2024-09-19T04:46:36.989428+0000","last_clean":"2024-09-19T04:46:36.989428+0000","last_became_active":"2024-09-19T04:46:23.507350+0000","last_became_peered":"2024-09-19T04:46:23.507350+0000","last_unstale":"2024-09-19T04:46:36.989428+0000","last_undegraded":"2024-09-19T04:46:36.989428+0000","last_fullsized":"2024-09-19T04:46:36.989428+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:07:27.119097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.570432+0000","last_change":"2024-09-19T04:46:21.495958+0000","last_active":"2024-09-19T04:46:36.570432+0000","last_peered":"2024-09-19T04:46:36.570432+0000","last_clean":"2024-09-19T04:46:36.570432+0000","last_became_active":"2024-09-19T04:46:21.495562+0000","last_became_peered":"2024-09-19T04:46:21.495562+0000","last_unstale":"2024-09-19T04:46:36.570432+0000","last_undegraded":"2024-09-19T04:46:36.570432+0000","last_fullsized":"2024-09-19T04:46:36.570432+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:19:02.935893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.570323+0000","last_change":"2024-09-19T04:46:23.524151+0000","last_active":"2024-09-19T04:46:36.570323+0000","last_peered":"2024-09-19T04:46:36.570323+0000","last_clean":"2024-09-19T04:46:36.570323+0000","last_became_active":"2024-09-19T04:46:23.523795+0000","last_became_peered":"2024-09-19T04:46:23.523795+0000","last_unstale":"2024-09-19T04:46:36.570323+0000","last_undegraded":"2024-09-19T04:46:36.570323+0000","last_fullsized":"2024-09-19T04:46:36.570323+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:27.234766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.561930+0000","last_change":"2024-09-19T04:46:21.485072+0000","last_active":"2024-09-19T04:46:36.561930+0000","last_peered":"2024-09-19T04:46:36.561930+0000","last_clean":"2024-09-19T04:46:36.561930+0000","last_became_active":"2024-09-19T04:46:21.482727+0000","last_became_peered":"2024-09-19T04:46:21.482727+0000","last_unstale":"2024-09-19T04:46:36.561930+0000","last_undegraded":"2024-09-19T04:46:36.561930+0000","last_fullsized":"2024-09-19T04:46:36.561930+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:23.231570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.805189+0000","last_change":"2024-09-19T04:46:21.488537+0000","last_active":"2024-09-19T04:46:36.805189+0000","last_peered":"2024-09-19T04:46:36.805189+0000","last_clean":"2024-09-19T04:46:36.805189+0000","last_became_active":"2024-09-19T04:46:21.488176+0000","last_became_peered":"2024-09-19T04:46:21.488176+0000","last_unstale":"2024-09-19T04:46:36.805189+0000","last_undegraded":"2024-09-19T04:46:36.805189+0000","last_fullsized":"2024-09-19T04:46:36.805189+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:14.355956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.559474+0000","last_change":"2024-09-19T04:46:23.518619+0000","last_active":"2024-09-19T04:46:36.559474+0000","last_peered":"2024-09-19T04:46:36.559474+0000","last_clean":"2024-09-19T04:46:36.559474+0000","last_became_active":"2024-09-19T04:46:23.518313+0000","last_became_peered":"2024-09-19T04:46:23.518313+0000","last_unstale":"2024-09-19T04:46:36.559474+0000","last_undegraded":"2024-09-19T04:46:36.559474+0000","last_fullsized":"2024-09-19T04:46:36.559474+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:08:25.958935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.571543+0000","last_change":"2024-09-19T04:46:21.493873+0000","last_active":"2024-09-19T04:46:36.571543+0000","last_peered":"2024-09-19T04:46:36.571543+0000","last_clean":"2024-09-19T04:46:36.571543+0000","last_became_active":"2024-09-19T04:46:21.493447+0000","last_became_peered":"2024-09-19T04:46:21.493447+0000","last_unstale":"2024-09-19T04:46:36.571543+0000","last_undegraded":"2024-09-19T04:46:36.571543+0000","last_fullsized":"2024-09-19T04:46:36.571543+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:29.504001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.561265+0000","last_change":"2024-09-19T04:46:23.508247+0000","last_active":"2024-09-19T04:46:36.561265+0000","last_peered":"2024-09-19T04:46:36.561265+0000","last_clean":"2024-09-19T04:46:36.561265+0000","last_became_active":"2024-09-19T04:46:23.507936+0000","last_became_peered":"2024-09-19T04:46:23.507936+0000","last_unstale":"2024-09-19T04:46:36.561265+0000","last_undegraded":"2024-09-19T04:46:36.561265+0000","last_fullsized":"2024-09-19T04:46:36.561265+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:25:09.864664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.561738+0000","last_change":"2024-09-19T04:46:21.487636+0000","last_active":"2024-09-19T04:46:36.561738+0000","last_peered":"2024-09-19T04:46:36.561738+0000","last_clean":"2024-09-19T04:46:36.561738+0000","last_became_active":"2024-09-19T04:46:21.487162+0000","last_became_peered":"2024-09-19T04:46:21.487162+0000","last_unstale":"2024-09-19T04:46:36.561738+0000","last_undegraded":"2024-09-19T04:46:36.561738+0000","last_fullsized":"2024-09-19T04:46:36.561738+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:03:04.833769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.793378+0000","last_change":"2024-09-19T04:46:23.515047+0000","last_active":"2024-09-19T04:46:36.793378+0000","last_peered":"2024-09-19T04:46:36.793378+0000","last_clean":"2024-09-19T04:46:36.793378+0000","last_became_active":"2024-09-19T04:46:23.514607+0000","last_became_peered":"2024-09-19T04:46:23.514607+0000","last_unstale":"2024-09-19T04:46:36.793378+0000","last_undegraded":"2024-09-19T04:46:36.793378+0000","last_fullsized":"2024-09-19T04:46:36.793378+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:05:03.076568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.565898+0000","last_change":"2024-09-19T04:46:21.493732+0000","last_active":"2024-09-19T04:46:36.565898+0000","last_peered":"2024-09-19T04:46:36.565898+0000","last_clean":"2024-09-19T04:46:36.565898+0000","last_became_active":"2024-09-19T04:46:21.493069+0000","last_became_peered":"2024-09-19T04:46:21.493069+0000","last_unstale":"2024-09-19T04:46:36.565898+0000","last_undegraded":"2024-09-19T04:46:36.565898+0000","last_fullsized":"2024-09-19T04:46:36.565898+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:17.709419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.988887+0000","last_change":"2024-09-19T04:46:23.516530+0000","last_active":"2024-09-19T04:46:36.988887+0000","last_peered":"2024-09-19T04:46:36.988887+0000","last_clean":"2024-09-19T04:46:36.988887+0000","last_became_active":"2024-09-19T04:46:23.515816+0000","last_became_peered":"2024-09-19T04:46:23.515816+0000","last_unstale":"2024-09-19T04:46:36.988887+0000","last_undegraded":"2024-09-19T04:46:36.988887+0000","last_fullsized":"2024-09-19T04:46:36.988887+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:56:19.162009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.570448+0000","last_change":"2024-09-19T04:46:21.573930+0000","last_active":"2024-09-19T04:46:36.570448+0000","last_peered":"2024-09-19T04:46:36.570448+0000","last_clean":"2024-09-19T04:46:36.570448+0000","last_became_active":"2024-09-19T04:46:21.573579+0000","last_became_peered":"2024-09-19T04:46:21.573579+0000","last_unstale":"2024-09-19T04:46:36.570448+0000","last_undegraded":"2024-09-19T04:46:36.570448+0000","last_fullsized":"2024-09-19T04:46:36.570448+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:29.472481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.792985+0000","last_change":"2024-09-19T04:46:23.520569+0000","last_active":"2024-09-19T04:46:36.792985+0000","last_peered":"2024-09-19T04:46:36.792985+0000","last_clean":"2024-09-19T04:46:36.792985+0000","last_became_active":"2024-09-19T04:46:23.519894+0000","last_became_peered":"2024-09-19T04:46:23.519894+0000","last_unstale":"2024-09-19T04:46:36.792985+0000","last_undegraded":"2024-09-19T04:46:36.792985+0000","last_fullsized":"2024-09-19T04:46:36.792985+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:20.823559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'25","reported_seq":160,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:47:23.621083+0000","last_change":"2024-09-19T04:46:21.491853+0000","last_active":"2024-09-19T04:47:23.621083+0000","last_peered":"2024-09-19T04:47:23.621083+0000","last_clean":"2024-09-19T04:47:23.621083+0000","last_became_active":"2024-09-19T04:46:21.491499+0000","last_became_peered":"2024-09-19T04:46:21.491499+0000","last_unstale":"2024-09-19T04:47:23.621083+0000","last_undegraded":"2024-09-19T04:47:23.621083+0000","last_fullsized":"2024-09-19T04:47:23.621083+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:15.372001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61199,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":113,"num_read_kb":115,"num_write":25,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.989834+0000","last_change":"2024-09-19T04:46:23.516781+0000","last_active":"2024-09-19T04:46:36.989834+0000","last_peered":"2024-09-19T04:46:36.989834+0000","last_clean":"2024-09-19T04:46:36.989834+0000","last_became_active":"2024-09-19T04:46:23.515928+0000","last_became_peered":"2024-09-19T04:46:23.515928+0000","last_unstale":"2024-09-19T04:46:36.989834+0000","last_undegraded":"2024-09-19T04:46:36.989834+0000","last_fullsized":"2024-09-19T04:46:36.989834+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:31.319072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'2","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.576789+0000","last_change":"2024-09-19T04:46:36.576395+0000","last_active":"2024-09-19T04:46:36.576789+0000","last_peered":"2024-09-19T04:46:36.576789+0000","last_clean":"2024-09-19T04:46:36.576789+0000","last_became_active":"2024-09-19T04:46:36.567213+0000","last_became_peered":"2024-09-19T04:46:36.567213+0000","last_unstale":"2024-09-19T04:46:36.576789+0000","last_undegraded":"2024-09-19T04:46:36.576789+0000","last_fullsized":"2024-09-19T04:46:36.576789+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:26.802224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.805263+0000","last_change":"2024-09-19T04:46:23.512736+0000","last_active":"2024-09-19T04:46:36.805263+0000","last_peered":"2024-09-19T04:46:36.805263+0000","last_clean":"2024-09-19T04:46:36.805263+0000","last_became_active":"2024-09-19T04:46:23.512399+0000","last_became_peered":"2024-09-19T04:46:23.512399+0000","last_unstale":"2024-09-19T04:46:36.805263+0000","last_undegraded":"2024-09-19T04:46:36.805263+0000","last_fullsized":"2024-09-19T04:46:36.805263+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:54:28.607512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.570209+0000","last_change":"2024-09-19T04:46:21.495421+0000","last_active":"2024-09-19T04:46:36.570209+0000","last_peered":"2024-09-19T04:46:36.570209+0000","last_clean":"2024-09-19T04:46:36.570209+0000","last_became_active":"2024-09-19T04:46:21.495004+0000","last_became_peered":"2024-09-19T04:46:21.495004+0000","last_unstale":"2024-09-19T04:46:36.570209+0000","last_undegraded":"2024-09-19T04:46:36.570209+0000","last_fullsized":"2024-09-19T04:46:36.570209+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:11.038118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.567045+0000","last_change":"2024-09-19T04:46:23.519462+0000","last_active":"2024-09-19T04:46:36.567045+0000","last_peered":"2024-09-19T04:46:36.567045+0000","last_clean":"2024-09-19T04:46:36.567045+0000","last_became_active":"2024-09-19T04:46:23.519121+0000","last_became_peered":"2024-09-19T04:46:23.519121+0000","last_unstale":"2024-09-19T04:46:36.567045+0000","last_undegraded":"2024-09-19T04:46:36.567045+0000","last_fullsized":"2024-09-19T04:46:36.567045+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:19.643433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.813771+0000","last_change":"2024-09-19T04:46:21.496243+0000","last_active":"2024-09-19T04:46:36.813771+0000","last_peered":"2024-09-19T04:46:36.813771+0000","last_clean":"2024-09-19T04:46:36.813771+0000","last_became_active":"2024-09-19T04:46:21.495821+0000","last_became_peered":"2024-09-19T04:46:21.495821+0000","last_unstale":"2024-09-19T04:46:36.813771+0000","last_undegraded":"2024-09-19T04:46:36.813771+0000","last_fullsized":"2024-09-19T04:46:36.813771+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:35:02.729538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.570404+0000","last_change":"2024-09-19T04:46:36.570404+0000","last_active":"2024-09-19T04:46:36.570404+0000","last_peered":"2024-09-19T04:46:36.570404+0000","last_clean":"2024-09-19T04:46:36.570404+0000","last_became_active":"2024-09-19T04:46:36.569898+0000","last_became_peered":"2024-09-19T04:46:36.569898+0000","last_unstale":"2024-09-19T04:46:36.570404+0000","last_undegraded":"2024-09-19T04:46:36.570404+0000","last_fullsized":"2024-09-19T04:46:36.570404+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:20:47.441702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'8","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.989610+0000","last_change":"2024-09-19T04:46:21.572642+0000","last_active":"2024-09-19T04:46:36.989610+0000","last_peered":"2024-09-19T04:46:36.989610+0000","last_clean":"2024-09-19T04:46:36.989610+0000","last_became_active":"2024-09-19T04:46:21.571823+0000","last_became_peered":"2024-09-19T04:46:21.571823+0000","last_unstale":"2024-09-19T04:46:36.989610+0000","last_undegraded":"2024-09-19T04:46:36.989610+0000","last_fullsized":"2024-09-19T04:46:36.989610+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:28.956744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.569490+0000","last_change":"2024-09-19T04:46:23.524169+0000","last_active":"2024-09-19T04:46:36.569490+0000","last_peered":"2024-09-19T04:46:36.569490+0000","last_clean":"2024-09-19T04:46:36.569490+0000","last_became_active":"2024-09-19T04:46:23.523869+0000","last_became_peered":"2024-09-19T04:46:23.523869+0000","last_unstale":"2024-09-19T04:46:36.569490+0000","last_undegraded":"2024-09-19T04:46:36.569490+0000","last_fullsized":"2024-09-19T04:46:36.569490+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:46.131143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.989981+0000","last_change":"2024-09-19T04:46:21.490154+0000","last_active":"2024-09-19T04:46:36.989981+0000","last_peered":"2024-09-19T04:46:36.989981+0000","last_clean":"2024-09-19T04:46:36.989981+0000","last_became_active":"2024-09-19T04:46:21.489820+0000","last_became_peered":"2024-09-19T04:46:21.489820+0000","last_unstale":"2024-09-19T04:46:36.989981+0000","last_undegraded":"2024-09-19T04:46:36.989981+0000","last_fullsized":"2024-09-19T04:46:36.989981+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:34:27.446664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.563380+0000","last_change":"2024-09-19T04:46:23.518712+0000","last_active":"2024-09-19T04:46:36.563380+0000","last_peered":"2024-09-19T04:46:36.563380+0000","last_clean":"2024-09-19T04:46:36.563380+0000","last_became_active":"2024-09-19T04:46:23.518408+0000","last_became_peered":"2024-09-19T04:46:23.518408+0000","last_unstale":"2024-09-19T04:46:36.563380+0000","last_undegraded":"2024-09-19T04:46:36.563380+0000","last_fullsized":"2024-09-19T04:46:36.563380+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:45:17.398334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.805508+0000","last_change":"2024-09-19T04:46:21.487789+0000","last_active":"2024-09-19T04:46:36.805508+0000","last_peered":"2024-09-19T04:46:36.805508+0000","last_clean":"2024-09-19T04:46:36.805508+0000","last_became_active":"2024-09-19T04:46:21.487411+0000","last_became_peered":"2024-09-19T04:46:21.487411+0000","last_unstale":"2024-09-19T04:46:36.805508+0000","last_undegraded":"2024-09-19T04:46:36.805508+0000","last_fullsized":"2024-09-19T04:46:36.805508+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:25.353345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.565977+0000","last_change":"2024-09-19T04:46:23.515432+0000","last_active":"2024-09-19T04:46:36.565977+0000","last_peered":"2024-09-19T04:46:36.565977+0000","last_clean":"2024-09-19T04:46:36.565977+0000","last_became_active":"2024-09-19T04:46:23.515071+0000","last_became_peered":"2024-09-19T04:46:23.515071+0000","last_unstale":"2024-09-19T04:46:36.565977+0000","last_undegraded":"2024-09-19T04:46:36.565977+0000","last_fullsized":"2024-09-19T04:46:36.565977+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:56:04.743652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.570557+0000","last_change":"2024-09-19T04:46:21.487856+0000","last_active":"2024-09-19T04:46:36.570557+0000","last_peered":"2024-09-19T04:46:36.570557+0000","last_clean":"2024-09-19T04:46:36.570557+0000","last_became_active":"2024-09-19T04:46:21.487342+0000","last_became_peered":"2024-09-19T04:46:21.487342+0000","last_unstale":"2024-09-19T04:46:36.570557+0000","last_undegraded":"2024-09-19T04:46:36.570557+0000","last_fullsized":"2024-09-19T04:46:36.570557+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:29.275296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.565152+0000","last_change":"2024-09-19T04:46:23.517250+0000","last_active":"2024-09-19T04:46:36.565152+0000","last_peered":"2024-09-19T04:46:36.565152+0000","last_clean":"2024-09-19T04:46:36.565152+0000","last_became_active":"2024-09-19T04:46:23.516895+0000","last_became_peered":"2024-09-19T04:46:23.516895+0000","last_unstale":"2024-09-19T04:46:36.565152+0000","last_undegraded":"2024-09-19T04:46:36.565152+0000","last_fullsized":"2024-09-19T04:46:36.565152+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:51.982348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.566597+0000","last_change":"2024-09-19T04:46:21.572452+0000","last_active":"2024-09-19T04:46:36.566597+0000","last_peered":"2024-09-19T04:46:36.566597+0000","last_clean":"2024-09-19T04:46:36.566597+0000","last_became_active":"2024-09-19T04:46:21.572026+0000","last_became_peered":"2024-09-19T04:46:21.572026+0000","last_unstale":"2024-09-19T04:46:36.566597+0000","last_undegraded":"2024-09-19T04:46:36.566597+0000","last_fullsized":"2024-09-19T04:46:36.566597+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:07.859604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.565707+0000","last_change":"2024-09-19T04:46:23.523549+0000","last_active":"2024-09-19T04:46:36.565707+0000","last_peered":"2024-09-19T04:46:36.565707+0000","last_clean":"2024-09-19T04:46:36.565707+0000","last_became_active":"2024-09-19T04:46:23.522581+0000","last_became_peered":"2024-09-19T04:46:23.522581+0000","last_unstale":"2024-09-19T04:46:36.565707+0000","last_undegraded":"2024-09-19T04:46:36.565707+0000","last_fullsized":"2024-09-19T04:46:36.565707+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:51:33.504024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":341,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.567404+0000","last_change":"2024-09-19T04:45:12.271676+0000","last_active":"2024-09-19T04:46:36.567404+0000","last_peered":"2024-09-19T04:46:36.567404+0000","last_clean":"2024-09-19T04:46:36.567404+0000","last_became_active":"2024-09-19T04:45:12.271093+0000","last_became_peered":"2024-09-19T04:45:12.271093+0000","last_unstale":"2024-09-19T04:46:36.567404+0000","last_undegraded":"2024-09-19T04:46:36.567404+0000","last_fullsized":"2024-09-19T04:46:36.567404+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:41:52.010883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:41:52.010883+0000","last_clean_scrub_stamp":"2024-09-19T04:41:52.010883+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:48.499621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.813898+0000","last_change":"2024-09-19T04:46:21.493847+0000","last_active":"2024-09-19T04:46:36.813898+0000","last_peered":"2024-09-19T04:46:36.813898+0000","last_clean":"2024-09-19T04:46:36.813898+0000","last_became_active":"2024-09-19T04:46:21.493432+0000","last_became_peered":"2024-09-19T04:46:21.493432+0000","last_unstale":"2024-09-19T04:46:36.813898+0000","last_undegraded":"2024-09-19T04:46:36.813898+0000","last_fullsized":"2024-09-19T04:46:36.813898+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:10:21.398602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.559747+0000","last_change":"2024-09-19T04:46:23.517517+0000","last_active":"2024-09-19T04:46:36.559747+0000","last_peered":"2024-09-19T04:46:36.559747+0000","last_clean":"2024-09-19T04:46:36.559747+0000","last_became_active":"2024-09-19T04:46:23.517191+0000","last_became_peered":"2024-09-19T04:46:23.517191+0000","last_unstale":"2024-09-19T04:46:36.559747+0000","last_undegraded":"2024-09-19T04:46:36.559747+0000","last_fullsized":"2024-09-19T04:46:36.559747+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:17.896149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.794380+0000","last_change":"2024-09-19T04:46:36.794380+0000","last_active":"2024-09-19T04:46:36.794380+0000","last_peered":"2024-09-19T04:46:36.794380+0000","last_clean":"2024-09-19T04:46:36.794380+0000","last_became_active":"2024-09-19T04:46:36.793911+0000","last_became_peered":"2024-09-19T04:46:36.793911+0000","last_unstale":"2024-09-19T04:46:36.794380+0000","last_undegraded":"2024-09-19T04:46:36.794380+0000","last_fullsized":"2024-09-19T04:46:36.794380+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:01:37.733641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1],"acting":[7,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.805188+0000","last_change":"2024-09-19T04:46:23.514102+0000","last_active":"2024-09-19T04:46:36.805188+0000","last_peered":"2024-09-19T04:46:36.805188+0000","last_clean":"2024-09-19T04:46:36.805188+0000","last_became_active":"2024-09-19T04:46:23.513732+0000","last_became_peered":"2024-09-19T04:46:23.513732+0000","last_unstale":"2024-09-19T04:46:36.805188+0000","last_undegraded":"2024-09-19T04:46:36.805188+0000","last_fullsized":"2024-09-19T04:46:36.805188+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:13.533065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.805277+0000","last_change":"2024-09-19T04:46:21.572628+0000","last_active":"2024-09-19T04:46:36.805277+0000","last_peered":"2024-09-19T04:46:36.805277+0000","last_clean":"2024-09-19T04:46:36.805277+0000","last_became_active":"2024-09-19T04:46:21.571736+0000","last_became_peered":"2024-09-19T04:46:21.571736+0000","last_unstale":"2024-09-19T04:46:36.805277+0000","last_undegraded":"2024-09-19T04:46:36.805277+0000","last_fullsized":"2024-09-19T04:46:36.805277+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:10:50.204481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.991388+0000","last_change":"2024-09-19T04:46:36.991388+0000","last_active":"2024-09-19T04:46:36.991388+0000","last_peered":"2024-09-19T04:46:36.991388+0000","last_clean":"2024-09-19T04:46:36.991388+0000","last_became_active":"2024-09-19T04:46:36.990923+0000","last_became_peered":"2024-09-19T04:46:36.990923+0000","last_unstale":"2024-09-19T04:46:36.991388+0000","last_undegraded":"2024-09-19T04:46:36.991388+0000","last_fullsized":"2024-09-19T04:46:36.991388+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:31.148732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.565443+0000","last_change":"2024-09-19T04:46:21.492696+0000","last_active":"2024-09-19T04:46:36.565443+0000","last_peered":"2024-09-19T04:46:36.565443+0000","last_clean":"2024-09-19T04:46:36.565443+0000","last_became_active":"2024-09-19T04:46:21.492306+0000","last_became_peered":"2024-09-19T04:46:21.492306+0000","last_unstale":"2024-09-19T04:46:36.565443+0000","last_undegraded":"2024-09-19T04:46:36.565443+0000","last_fullsized":"2024-09-19T04:46:36.565443+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:51:56.975170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.989535+0000","last_change":"2024-09-19T04:46:36.989535+0000","last_active":"2024-09-19T04:46:36.989535+0000","last_peered":"2024-09-19T04:46:36.989535+0000","last_clean":"2024-09-19T04:46:36.989535+0000","last_became_active":"2024-09-19T04:46:36.989252+0000","last_became_peered":"2024-09-19T04:46:36.989252+0000","last_unstale":"2024-09-19T04:46:36.989535+0000","last_undegraded":"2024-09-19T04:46:36.989535+0000","last_fullsized":"2024-09-19T04:46:36.989535+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:49:45.767547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.561754+0000","last_change":"2024-09-19T04:46:21.572275+0000","last_active":"2024-09-19T04:46:36.561754+0000","last_peered":"2024-09-19T04:46:36.561754+0000","last_clean":"2024-09-19T04:46:36.561754+0000","last_became_active":"2024-09-19T04:46:21.571940+0000","last_became_peered":"2024-09-19T04:46:21.571940+0000","last_unstale":"2024-09-19T04:46:36.561754+0000","last_undegraded":"2024-09-19T04:46:36.561754+0000","last_fullsized":"2024-09-19T04:46:36.561754+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:13.399887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.561705+0000","last_change":"2024-09-19T04:46:23.514355+0000","last_active":"2024-09-19T04:46:36.561705+0000","last_peered":"2024-09-19T04:46:36.561705+0000","last_clean":"2024-09-19T04:46:36.561705+0000","last_became_active":"2024-09-19T04:46:23.513963+0000","last_became_peered":"2024-09-19T04:46:23.513963+0000","last_unstale":"2024-09-19T04:46:36.561705+0000","last_undegraded":"2024-09-19T04:46:36.561705+0000","last_fullsized":"2024-09-19T04:46:36.561705+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:06.742732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.990038+0000","last_change":"2024-09-19T04:46:21.572466+0000","last_active":"2024-09-19T04:46:36.990038+0000","last_peered":"2024-09-19T04:46:36.990038+0000","last_clean":"2024-09-19T04:46:36.990038+0000","last_became_active":"2024-09-19T04:46:21.571868+0000","last_became_peered":"2024-09-19T04:46:21.571868+0000","last_unstale":"2024-09-19T04:46:36.990038+0000","last_undegraded":"2024-09-19T04:46:36.990038+0000","last_fullsized":"2024-09-19T04:46:36.990038+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:01.132858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.805440+0000","last_change":"2024-09-19T04:46:23.509517+0000","last_active":"2024-09-19T04:46:36.805440+0000","last_peered":"2024-09-19T04:46:36.805440+0000","last_clean":"2024-09-19T04:46:36.805440+0000","last_became_active":"2024-09-19T04:46:23.509216+0000","last_became_peered":"2024-09-19T04:46:23.509216+0000","last_unstale":"2024-09-19T04:46:36.805440+0000","last_undegraded":"2024-09-19T04:46:36.805440+0000","last_fullsized":"2024-09-19T04:46:36.805440+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:29:52.747643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'8","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:45.511671+0000","last_change":"2024-09-19T04:46:21.484462+0000","last_active":"2024-09-19T04:46:45.511671+0000","last_peered":"2024-09-19T04:46:45.511671+0000","last_clean":"2024-09-19T04:46:45.511671+0000","last_became_active":"2024-09-19T04:46:21.484148+0000","last_became_peered":"2024-09-19T04:46:21.484148+0000","last_unstale":"2024-09-19T04:46:45.511671+0000","last_undegraded":"2024-09-19T04:46:45.511671+0000","last_fullsized":"2024-09-19T04:46:45.511671+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:17:18.742857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.559667+0000","last_change":"2024-09-19T04:46:23.512768+0000","last_active":"2024-09-19T04:46:36.559667+0000","last_peered":"2024-09-19T04:46:36.559667+0000","last_clean":"2024-09-19T04:46:36.559667+0000","last_became_active":"2024-09-19T04:46:23.512416+0000","last_became_peered":"2024-09-19T04:46:23.512416+0000","last_unstale":"2024-09-19T04:46:36.559667+0000","last_undegraded":"2024-09-19T04:46:36.559667+0000","last_fullsized":"2024-09-19T04:46:36.559667+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:03:48.340126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.814035+0000","last_change":"2024-09-19T04:46:21.488634+0000","last_active":"2024-09-19T04:46:36.814035+0000","last_peered":"2024-09-19T04:46:36.814035+0000","last_clean":"2024-09-19T04:46:36.814035+0000","last_became_active":"2024-09-19T04:46:21.488078+0000","last_became_peered":"2024-09-19T04:46:21.488078+0000","last_unstale":"2024-09-19T04:46:36.814035+0000","last_undegraded":"2024-09-19T04:46:36.814035+0000","last_fullsized":"2024-09-19T04:46:36.814035+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:31:47.946873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.988687+0000","last_change":"2024-09-19T04:46:23.522419+0000","last_active":"2024-09-19T04:46:36.988687+0000","last_peered":"2024-09-19T04:46:36.988687+0000","last_clean":"2024-09-19T04:46:36.988687+0000","last_became_active":"2024-09-19T04:46:23.522054+0000","last_became_peered":"2024-09-19T04:46:23.522054+0000","last_unstale":"2024-09-19T04:46:36.988687+0000","last_undegraded":"2024-09-19T04:46:36.988687+0000","last_fullsized":"2024-09-19T04:46:36.988687+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:43.720439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.793099+0000","last_change":"2024-09-19T04:46:21.572283+0000","last_active":"2024-09-19T04:46:36.793099+0000","last_peered":"2024-09-19T04:46:36.793099+0000","last_clean":"2024-09-19T04:46:36.793099+0000","last_became_active":"2024-09-19T04:46:21.572023+0000","last_became_peered":"2024-09-19T04:46:21.572023+0000","last_unstale":"2024-09-19T04:46:36.793099+0000","last_undegraded":"2024-09-19T04:46:36.793099+0000","last_fullsized":"2024-09-19T04:46:36.793099+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:37:26.293900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.989428+0000","last_change":"2024-09-19T04:46:23.516278+0000","last_active":"2024-09-19T04:46:36.989428+0000","last_peered":"2024-09-19T04:46:36.989428+0000","last_clean":"2024-09-19T04:46:36.989428+0000","last_became_active":"2024-09-19T04:46:23.515922+0000","last_became_peered":"2024-09-19T04:46:23.515922+0000","last_unstale":"2024-09-19T04:46:36.989428+0000","last_undegraded":"2024-09-19T04:46:36.989428+0000","last_fullsized":"2024-09-19T04:46:36.989428+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:26:11.038230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.559541+0000","last_change":"2024-09-19T04:46:21.489250+0000","last_active":"2024-09-19T04:46:36.559541+0000","last_peered":"2024-09-19T04:46:36.559541+0000","last_clean":"2024-09-19T04:46:36.559541+0000","last_became_active":"2024-09-19T04:46:21.488910+0000","last_became_peered":"2024-09-19T04:46:21.488910+0000","last_unstale":"2024-09-19T04:46:36.559541+0000","last_undegraded":"2024-09-19T04:46:36.559541+0000","last_fullsized":"2024-09-19T04:46:36.559541+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:04:03.650494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.563213+0000","last_change":"2024-09-19T04:46:23.512663+0000","last_active":"2024-09-19T04:46:36.563213+0000","last_peered":"2024-09-19T04:46:36.563213+0000","last_clean":"2024-09-19T04:46:36.563213+0000","last_became_active":"2024-09-19T04:46:23.512265+0000","last_became_peered":"2024-09-19T04:46:23.512265+0000","last_unstale":"2024-09-19T04:46:36.563213+0000","last_undegraded":"2024-09-19T04:46:36.563213+0000","last_fullsized":"2024-09-19T04:46:36.563213+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:52.903900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.991462+0000","last_change":"2024-09-19T04:46:36.990653+0000","last_active":"2024-09-19T04:46:36.991462+0000","last_peered":"2024-09-19T04:46:36.991462+0000","last_clean":"2024-09-19T04:46:36.991462+0000","last_became_active":"2024-09-19T04:46:36.990202+0000","last_became_peered":"2024-09-19T04:46:36.990202+0000","last_unstale":"2024-09-19T04:46:36.991462+0000","last_undegraded":"2024-09-19T04:46:36.991462+0000","last_fullsized":"2024-09-19T04:46:36.991462+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:25:53.780614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.559689+0000","last_change":"2024-09-19T04:46:23.510196+0000","last_active":"2024-09-19T04:46:36.559689+0000","last_peered":"2024-09-19T04:46:36.559689+0000","last_clean":"2024-09-19T04:46:36.559689+0000","last_became_active":"2024-09-19T04:46:23.509871+0000","last_became_peered":"2024-09-19T04:46:23.509871+0000","last_unstale":"2024-09-19T04:46:36.559689+0000","last_undegraded":"2024-09-19T04:46:36.559689+0000","last_fullsized":"2024-09-19T04:46:36.559689+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:42:01.825770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.989648+0000","last_change":"2024-09-19T04:46:21.492279+0000","last_active":"2024-09-19T04:46:36.989648+0000","last_peered":"2024-09-19T04:46:36.989648+0000","last_clean":"2024-09-19T04:46:36.989648+0000","last_became_active":"2024-09-19T04:46:21.491669+0000","last_became_peered":"2024-09-19T04:46:21.491669+0000","last_unstale":"2024-09-19T04:46:36.989648+0000","last_undegraded":"2024-09-19T04:46:36.989648+0000","last_fullsized":"2024-09-19T04:46:36.989648+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:23:15.822887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.565280+0000","last_change":"2024-09-19T04:46:23.518114+0000","last_active":"2024-09-19T04:46:36.565280+0000","last_peered":"2024-09-19T04:46:36.565280+0000","last_clean":"2024-09-19T04:46:36.565280+0000","last_became_active":"2024-09-19T04:46:23.517707+0000","last_became_peered":"2024-09-19T04:46:23.517707+0000","last_unstale":"2024-09-19T04:46:36.565280+0000","last_undegraded":"2024-09-19T04:46:36.565280+0000","last_fullsized":"2024-09-19T04:46:36.565280+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:52.438748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.570333+0000","last_change":"2024-09-19T04:46:23.525164+0000","last_active":"2024-09-19T04:46:36.570333+0000","last_peered":"2024-09-19T04:46:36.570333+0000","last_clean":"2024-09-19T04:46:36.570333+0000","last_became_active":"2024-09-19T04:46:23.524735+0000","last_became_peered":"2024-09-19T04:46:23.524735+0000","last_unstale":"2024-09-19T04:46:36.570333+0000","last_undegraded":"2024-09-19T04:46:36.570333+0000","last_fullsized":"2024-09-19T04:46:36.570333+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:53.590834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.989803+0000","last_change":"2024-09-19T04:46:21.492940+0000","last_active":"2024-09-19T04:46:36.989803+0000","last_peered":"2024-09-19T04:46:36.989803+0000","last_clean":"2024-09-19T04:46:36.989803+0000","last_became_active":"2024-09-19T04:46:21.492602+0000","last_became_peered":"2024-09-19T04:46:21.492602+0000","last_unstale":"2024-09-19T04:46:36.989803+0000","last_undegraded":"2024-09-19T04:46:36.989803+0000","last_fullsized":"2024-09-19T04:46:36.989803+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:20.554832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.792910+0000","last_change":"2024-09-19T04:46:23.513432+0000","last_active":"2024-09-19T04:46:36.792910+0000","last_peered":"2024-09-19T04:46:36.792910+0000","last_clean":"2024-09-19T04:46:36.792910+0000","last_became_active":"2024-09-19T04:46:23.513084+0000","last_became_peered":"2024-09-19T04:46:23.513084+0000","last_unstale":"2024-09-19T04:46:36.792910+0000","last_undegraded":"2024-09-19T04:46:36.792910+0000","last_fullsized":"2024-09-19T04:46:36.792910+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:03:16.732545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.989947+0000","last_change":"2024-09-19T04:46:21.491823+0000","last_active":"2024-09-19T04:46:36.989947+0000","last_peered":"2024-09-19T04:46:36.989947+0000","last_clean":"2024-09-19T04:46:36.989947+0000","last_became_active":"2024-09-19T04:46:21.491401+0000","last_became_peered":"2024-09-19T04:46:21.491401+0000","last_unstale":"2024-09-19T04:46:36.989947+0000","last_undegraded":"2024-09-19T04:46:36.989947+0000","last_fullsized":"2024-09-19T04:46:36.989947+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:55.955868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.988852+0000","last_change":"2024-09-19T04:46:23.515884+0000","last_active":"2024-09-19T04:46:36.988852+0000","last_peered":"2024-09-19T04:46:36.988852+0000","last_clean":"2024-09-19T04:46:36.988852+0000","last_became_active":"2024-09-19T04:46:23.515243+0000","last_became_peered":"2024-09-19T04:46:23.515243+0000","last_unstale":"2024-09-19T04:46:36.988852+0000","last_undegraded":"2024-09-19T04:46:36.988852+0000","last_fullsized":"2024-09-19T04:46:36.988852+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:07:33.716942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.559784+0000","last_change":"2024-09-19T04:46:21.572122+0000","last_active":"2024-09-19T04:46:36.559784+0000","last_peered":"2024-09-19T04:46:36.559784+0000","last_clean":"2024-09-19T04:46:36.559784+0000","last_became_active":"2024-09-19T04:46:21.571747+0000","last_became_peered":"2024-09-19T04:46:21.571747+0000","last_unstale":"2024-09-19T04:46:36.559784+0000","last_undegraded":"2024-09-19T04:46:36.559784+0000","last_fullsized":"2024-09-19T04:46:36.559784+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:06:43.411409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.559639+0000","last_change":"2024-09-19T04:46:23.513876+0000","last_active":"2024-09-19T04:46:36.559639+0000","last_peered":"2024-09-19T04:46:36.559639+0000","last_clean":"2024-09-19T04:46:36.559639+0000","last_became_active":"2024-09-19T04:46:23.513562+0000","last_became_peered":"2024-09-19T04:46:23.513562+0000","last_unstale":"2024-09-19T04:46:36.559639+0000","last_undegraded":"2024-09-19T04:46:36.559639+0000","last_fullsized":"2024-09-19T04:46:36.559639+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:21.982001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T04:46:36.561722+0000","last_change":"2024-09-19T04:46:21.491550+0000","last_active":"2024-09-19T04:46:36.561722+0000","last_peered":"2024-09-19T04:46:36.561722+0000","last_clean":"2024-09-19T04:46:36.561722+0000","last_became_active":"2024-09-19T04:46:21.491259+0000","last_became_peered":"2024-09-19T04:46:21.491259+0000","last_unstale":"2024-09-19T04:46:36.561722+0000","last_undegraded":"2024-09-19T04:46:36.561722+0000","last_fullsized":"2024-09-19T04:46:36.561722+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:38.671211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":61997,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":118,"num_read_kb":120,"num_write":78,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":185991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":65,"ondisk_log_size":65,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645338,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32040,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713112,"statfs":{"total":95995035648,"available":95962226688,"internally_reserved":0,"allocated":872448,"data_stored":426161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874271,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36856,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708296,"statfs":{"total":95995035648,"available":95957295104,"internally_reserved":0,"allocated":1548288,"data_stored":1078005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":36174273},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005092,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40356,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704796,"statfs":{"total":95995035648,"available":95953711104,"internally_reserved":0,"allocated":872448,"data_stored":426709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234025,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":876544,"data_stored":426731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462958,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28460,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716692,"statfs":{"total":95995035648,"available":95965892608,"internally_reserved":0,"allocated":1470464,"data_stored":1017194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626482,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36200,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708952,"statfs":{"total":95995035648,"available":95957966848,"internally_reserved":0,"allocated":872448,"data_stored":426244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855415,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28468,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716684,"statfs":{"total":95995035648,"available":95965884416,"internally_reserved":0,"allocated":1478656,"data_stored":1016794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018940,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36204,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708948,"statfs":{"total":95995035648,"available":95957962752,"internally_reserved":0,"allocated":872448,"data_stored":426149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247874,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":426465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476807,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":937984,"data_stored":487326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607627,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40420,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704732,"statfs":{"total":95995035648,"available":95953645568,"internally_reserved":0,"allocated":937984,"data_stored":487326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40364,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704788,"statfs":{"total":95995035648,"available":95953702912,"internally_reserved":0,"allocated":872448,"data_stored":426217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":61199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":61199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":61393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T04:47:26.247 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T04:47:26.247 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-19T04:47:26.247 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-19T04:47:26.247 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-19T04:47:26.506 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:47:26.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:26.923+0000 7fbb32a41640 1 -- 172.21.15.2:0/1476215054 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb2c1082e0 msgr2=0x7fbb2c10ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:26.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:26.923+0000 7fbb32a41640 1 --2- 172.21.15.2:0/1476215054 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb2c1082e0 0x7fbb2c10ec50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbb24009cd0 tx=0x7fbb2402a8e0 comp rx=0 tx=0).stop 2024-09-19T04:47:26.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:26.923+0000 7fbb32a41640 1 -- 172.21.15.2:0/1476215054 shutdown_connections 2024-09-19T04:47:26.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:26.923+0000 7fbb32a41640 1 --2- 172.21.15.2:0/1476215054 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb2c1082e0 0x7fbb2c10ec50 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:26.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:26.923+0000 7fbb32a41640 1 --2- 172.21.15.2:0/1476215054 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb2c103760 0x7fbb2c107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:26.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:26.923+0000 7fbb32a41640 1 --2- 172.21.15.2:0/1476215054 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb2c102db0 0x7fbb2c103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:26.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:26.923+0000 7fbb32a41640 1 -- 172.21.15.2:0/1476215054 >> 172.21.15.2:0/1476215054 conn(0x7fbb2c0fc7d0 msgr2=0x7fbb2c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:26.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:26.923+0000 7fbb32a41640 1 -- 172.21.15.2:0/1476215054 shutdown_connections 2024-09-19T04:47:26.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:26.923+0000 7fbb32a41640 1 -- 172.21.15.2:0/1476215054 wait complete. 2024-09-19T04:47:26.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:26.923+0000 7fbb32a41640 1 Processor -- start 2024-09-19T04:47:26.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:26.923+0000 7fbb32a41640 1 -- start start 2024-09-19T04:47:26.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:26.924+0000 7fbb32a41640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb2c102db0 0x7fbb2c100a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:26.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:26.924+0000 7fbb32a41640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb2c103760 0x7fbb2c100f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:26.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:26.924+0000 7fbb32a41640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb2c1082e0 0x7fbb2c101490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:26.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:26.924+0000 7fbb32a41640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbb2c111f60 con 0x7fbb2c1082e0 2024-09-19T04:47:26.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:26.924+0000 7fbb32a41640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbb2c111de0 con 0x7fbb2c103760 2024-09-19T04:47:26.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:26.924+0000 7fbb32a41640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fbb2c1120e0 con 0x7fbb2c102db0 2024-09-19T04:47:26.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:26.924+0000 7fbb30fde640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb2c1082e0 0x7fbb2c101490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:26.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:26.924+0000 7fbb30fde640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb2c1082e0 0x7fbb2c101490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51924/0 (socket says 172.21.15.2:51924) 2024-09-19T04:47:26.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:26.924+0000 7fbb30fde640 1 -- 172.21.15.2:0/2614757023 learned_addr learned my addr 172.21.15.2:0/2614757023 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:47:26.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:26.924+0000 7fbb23fff640 1 --2- 172.21.15.2:0/2614757023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb2c103760 0x7fbb2c100f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:26.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:26.924+0000 7fbb2bfff640 1 --2- 172.21.15.2:0/2614757023 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb2c102db0 0x7fbb2c100a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:26.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:26.924+0000 7fbb30fde640 1 -- 172.21.15.2:0/2614757023 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb2c102db0 msgr2=0x7fbb2c100a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:26.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:26.924+0000 7fbb30fde640 1 --2- 172.21.15.2:0/2614757023 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb2c102db0 0x7fbb2c100a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:26.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:26.924+0000 7fbb30fde640 1 -- 172.21.15.2:0/2614757023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb2c103760 msgr2=0x7fbb2c100f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:26.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:26.924+0000 7fbb30fde640 1 --2- 172.21.15.2:0/2614757023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb2c103760 0x7fbb2c100f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:26.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:26.924+0000 7fbb30fde640 1 -- 172.21.15.2:0/2614757023 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb2c1aae50 con 0x7fbb2c1082e0 2024-09-19T04:47:26.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:26.924+0000 7fbb23fff640 1 --2- 172.21.15.2:0/2614757023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb2c103760 0x7fbb2c100f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:47:26.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:26.924+0000 7fbb30fde640 1 --2- 172.21.15.2:0/2614757023 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb2c1082e0 0x7fbb2c101490 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbb240097b0 tx=0x7fbb24003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:26.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:26.925+0000 7fbb29ffb640 1 -- 172.21.15.2:0/2614757023 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb24004240 con 0x7fbb2c1082e0 2024-09-19T04:47:26.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:26.925+0000 7fbb29ffb640 1 -- 172.21.15.2:0/2614757023 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbb240305a0 con 0x7fbb2c1082e0 2024-09-19T04:47:26.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:26.925+0000 7fbb32a41640 1 -- 172.21.15.2:0/2614757023 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb2c1ab080 con 0x7fbb2c1082e0 2024-09-19T04:47:26.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:26.925+0000 7fbb29ffb640 1 -- 172.21.15.2:0/2614757023 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb24045650 con 0x7fbb2c1082e0 2024-09-19T04:47:26.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:26.925+0000 7fbb32a41640 1 -- 172.21.15.2:0/2614757023 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb2c1ab5c0 con 0x7fbb2c1082e0 2024-09-19T04:47:26.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:26.926+0000 7fbb32a41640 1 -- 172.21.15.2:0/2614757023 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb2c06a7d0 con 0x7fbb2c1082e0 2024-09-19T04:47:26.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:26.927+0000 7fbb29ffb640 1 -- 172.21.15.2:0/2614757023 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fbb24043020 con 0x7fbb2c1082e0 2024-09-19T04:47:26.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:26.928+0000 7fbb29ffb640 1 --2- 172.21.15.2:0/2614757023 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fbb180a32d0 0x7fbb180a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:26.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:26.928+0000 7fbb2bfff640 1 --2- 172.21.15.2:0/2614757023 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fbb180a32d0 0x7fbb180a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:26.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:26.928+0000 7fbb29ffb640 1 -- 172.21.15.2:0/2614757023 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fbb2402e030 con 0x7fbb2c1082e0 2024-09-19T04:47:26.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:26.928+0000 7fbb2bfff640 1 --2- 172.21.15.2:0/2614757023 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fbb180a32d0 0x7fbb180a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c005e10 tx=0x7fbb1c005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:26.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:26.931+0000 7fbb29ffb640 1 -- 172.21.15.2:0/2614757023 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbb2404a060 con 0x7fbb2c1082e0 2024-09-19T04:47:27.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:27.143+0000 7fbb32a41640 1 -- 172.21.15.2:0/2614757023 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbb2c10a2c0 con 0x7fbb2c1082e0 2024-09-19T04:47:27.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:27.144+0000 7fbb29ffb640 1 -- 172.21.15.2:0/2614757023 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fbb240bd870 con 0x7fbb2c1082e0 2024-09-19T04:47:27.146 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:47:27.146 INFO:teuthology.orchestra.run.smithi002.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-19T04:47:27.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:27.146+0000 7fbb32a41640 1 -- 172.21.15.2:0/2614757023 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fbb180a32d0 msgr2=0x7fbb180a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:27.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:27.146+0000 7fbb32a41640 1 --2- 172.21.15.2:0/2614757023 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fbb180a32d0 0x7fbb180a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c005e10 tx=0x7fbb1c005da0 comp rx=0 tx=0).stop 2024-09-19T04:47:27.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:27.146+0000 7fbb32a41640 1 -- 172.21.15.2:0/2614757023 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb2c1082e0 msgr2=0x7fbb2c101490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:27.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:27.146+0000 7fbb32a41640 1 --2- 172.21.15.2:0/2614757023 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb2c1082e0 0x7fbb2c101490 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbb240097b0 tx=0x7fbb24003ba0 comp rx=0 tx=0).stop 2024-09-19T04:47:27.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:27.146+0000 7fbb32a41640 1 -- 172.21.15.2:0/2614757023 shutdown_connections 2024-09-19T04:47:27.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:27.146+0000 7fbb32a41640 1 --2- 172.21.15.2:0/2614757023 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fbb180a32d0 0x7fbb180a5790 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:27.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:27.146+0000 7fbb32a41640 1 --2- 172.21.15.2:0/2614757023 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb2c1082e0 0x7fbb2c101490 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:27.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:27.146+0000 7fbb32a41640 1 --2- 172.21.15.2:0/2614757023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb2c103760 0x7fbb2c100f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:27.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:27.146+0000 7fbb32a41640 1 --2- 172.21.15.2:0/2614757023 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb2c102db0 0x7fbb2c100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:27.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:27.146+0000 7fbb32a41640 1 -- 172.21.15.2:0/2614757023 >> 172.21.15.2:0/2614757023 conn(0x7fbb2c0fc7d0 msgr2=0x7fbb2c105d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:27.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:27.146+0000 7fbb32a41640 1 -- 172.21.15.2:0/2614757023 shutdown_connections 2024-09-19T04:47:27.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:27.146+0000 7fbb32a41640 1 -- 172.21.15.2:0/2614757023 wait complete. 2024-09-19T04:47:27.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:26 smithi018 ceph-mon[34537]: pgmap v305: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T04:47:27.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:26 smithi018 ceph-mon[34537]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:47:27.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:26 smithi002 ceph-mon[30975]: pgmap v305: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T04:47:27.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:26 smithi002 ceph-mon[30975]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:47:27.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:26 smithi116 ceph-mon[34477]: pgmap v305: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T04:47:27.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:26 smithi116 ceph-mon[34477]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:47:27.781 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-19T04:47:27.782 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:47:28.037 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:47:28.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:27 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/2614757023' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T04:47:28.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:27 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/2614757023' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T04:47:28.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:27 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/2614757023' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T04:47:28.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.554+0000 7fc5b8333640 1 -- 172.21.15.2:0/575639094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5b0100e20 msgr2=0x7fc5b0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:28.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.554+0000 7fc5b8333640 1 --2- 172.21.15.2:0/575639094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5b0100e20 0x7fc5b0101200 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc5a0009ca0 tx=0x7fc5a002a950 comp rx=0 tx=0).stop 2024-09-19T04:47:28.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.554+0000 7fc5b8333640 1 -- 172.21.15.2:0/575639094 shutdown_connections 2024-09-19T04:47:28.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.554+0000 7fc5b8333640 1 --2- 172.21.15.2:0/575639094 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc5b0102ef0 0x7fc5b010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:28.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.554+0000 7fc5b8333640 1 --2- 172.21.15.2:0/575639094 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc5b0102570 0x7fc5b01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:28.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.554+0000 7fc5b8333640 1 --2- 172.21.15.2:0/575639094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5b0100e20 0x7fc5b0101200 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:28.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.554+0000 7fc5b8333640 1 -- 172.21.15.2:0/575639094 >> 172.21.15.2:0/575639094 conn(0x7fc5b00fc7d0 msgr2=0x7fc5b00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:28.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.554+0000 7fc5b8333640 1 -- 172.21.15.2:0/575639094 shutdown_connections 2024-09-19T04:47:28.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.554+0000 7fc5b8333640 1 -- 172.21.15.2:0/575639094 wait complete. 2024-09-19T04:47:28.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.554+0000 7fc5b8333640 1 Processor -- start 2024-09-19T04:47:28.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.554+0000 7fc5b8333640 1 -- start start 2024-09-19T04:47:28.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.555+0000 7fc5b8333640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5b0100e20 0x7fc5b0198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:28.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.555+0000 7fc5b8333640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc5b0102570 0x7fc5b0198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:28.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.555+0000 7fc5b8333640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc5b0102ef0 0x7fc5b019cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:28.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.555+0000 7fc5b8333640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b0110e50 con 0x7fc5b0100e20 2024-09-19T04:47:28.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.555+0000 7fc5b8333640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b0110cd0 con 0x7fc5b0102ef0 2024-09-19T04:47:28.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.555+0000 7fc5b8333640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b0110fd0 con 0x7fc5b0102570 2024-09-19T04:47:28.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.555+0000 7fc5b60cf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5b0100e20 0x7fc5b0198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:28.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.555+0000 7fc5b60cf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5b0100e20 0x7fc5b0198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51942/0 (socket says 172.21.15.2:51942) 2024-09-19T04:47:28.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.555+0000 7fc5b60cf640 1 -- 172.21.15.2:0/3818802471 learned_addr learned my addr 172.21.15.2:0/3818802471 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:47:28.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.555+0000 7fc5b68d0640 1 --2- 172.21.15.2:0/3818802471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc5b0102ef0 0x7fc5b019cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:28.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.555+0000 7fc5b60cf640 1 -- 172.21.15.2:0/3818802471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc5b0102570 msgr2=0x7fc5b0198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:28.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.555+0000 7fc5b60cf640 1 --2- 172.21.15.2:0/3818802471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc5b0102570 0x7fc5b0198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:28.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.555+0000 7fc5b60cf640 1 -- 172.21.15.2:0/3818802471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc5b0102ef0 msgr2=0x7fc5b019cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:28.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.555+0000 7fc5b60cf640 1 --2- 172.21.15.2:0/3818802471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc5b0102ef0 0x7fc5b019cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:28.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.555+0000 7fc5b60cf640 1 -- 172.21.15.2:0/3818802471 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5b019d3f0 con 0x7fc5b0100e20 2024-09-19T04:47:28.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.555+0000 7fc5b60cf640 1 --2- 172.21.15.2:0/3818802471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5b0100e20 0x7fc5b0198440 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc5a0009430 tx=0x7fc5a002f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:28.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.555+0000 7fc5af7fe640 1 -- 172.21.15.2:0/3818802471 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a0034040 con 0x7fc5b0100e20 2024-09-19T04:47:28.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.556+0000 7fc5af7fe640 1 -- 172.21.15.2:0/3818802471 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc5a00308f0 con 0x7fc5b0100e20 2024-09-19T04:47:28.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.556+0000 7fc5b8333640 1 -- 172.21.15.2:0/3818802471 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5b019d680 con 0x7fc5b0100e20 2024-09-19T04:47:28.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.556+0000 7fc5af7fe640 1 -- 172.21.15.2:0/3818802471 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a0045480 con 0x7fc5b0100e20 2024-09-19T04:47:28.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.556+0000 7fc5b8333640 1 -- 172.21.15.2:0/3818802471 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5b01a4fc0 con 0x7fc5b0100e20 2024-09-19T04:47:28.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.557+0000 7fc5b8333640 1 -- 172.21.15.2:0/3818802471 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5b0101200 con 0x7fc5b0100e20 2024-09-19T04:47:28.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.559+0000 7fc5af7fe640 1 -- 172.21.15.2:0/3818802471 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fc5a0037020 con 0x7fc5b0100e20 2024-09-19T04:47:28.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.559+0000 7fc5af7fe640 1 --2- 172.21.15.2:0/3818802471 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fc5980a32d0 0x7fc5980a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:28.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.559+0000 7fc5af7fe640 1 -- 172.21.15.2:0/3818802471 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fc5a00f0d50 con 0x7fc5b0100e20 2024-09-19T04:47:28.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.559+0000 7fc5b58ce640 1 --2- 172.21.15.2:0/3818802471 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fc5980a32d0 0x7fc5980a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:28.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.560+0000 7fc5b58ce640 1 --2- 172.21.15.2:0/3818802471 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fc5980a32d0 0x7fc5980a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc5b00feee0 tx=0x7fc5a4005bf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:28.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.562+0000 7fc5af7fe640 1 -- 172.21.15.2:0/3818802471 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc5a0081210 con 0x7fc5b0100e20 2024-09-19T04:47:28.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.774+0000 7fc5b8333640 1 -- 172.21.15.2:0/3818802471 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc5b01a5190 con 0x7fc5b0100e20 2024-09-19T04:47:28.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.775+0000 7fc5af7fe640 1 -- 172.21.15.2:0/3818802471 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11840 (secure 0 0 0) 0x7fc5a00bda50 con 0x7fc5b0100e20 2024-09-19T04:47:28.777 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:47:28.777 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":19,"btime":"2024-09-19T04:46:33:537239+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2467365137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2467365137},{"type":"v1","addr":"172.21.15.2:6835","nonce":2467365137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3162441888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3162441888},{"type":"v1","addr":"172.21.15.2:6837","nonce":3162441888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14631,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2740862966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2740862966},{"type":"v1","addr":"172.21.15.2:6839","nonce":2740862966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/2394435504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2394435504},{"type":"v1","addr":"172.21.15.2:6841","nonce":2394435504}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1630480244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1630480244},{"type":"v1","addr":"172.21.15.18:6833","nonce":1630480244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1553897465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1553897465},{"type":"v1","addr":"172.21.15.116:6833","nonce":1553897465}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3035664608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3035664608},{"type":"v1","addr":"172.21.15.18:6835","nonce":3035664608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1096622392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1096622392},{"type":"v1","addr":"172.21.15.18:6837","nonce":1096622392}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3761157675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3761157675},{"type":"v1","addr":"172.21.15.116:6835","nonce":3761157675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/1120131594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1120131594},{"type":"v1","addr":"172.21.15.116:6837","nonce":1120131594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:46:24.050115+0000","modified":"2024-09-19T04:46:33.112369+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/4207677139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":4207677139},{"type":"v1","addr":"172.21.15.18:6839","nonce":4207677139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/2346874880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":2346874880},{"type":"v1","addr":"172.21.15.116:6839","nonce":2346874880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496]},"id":1}]} 2024-09-19T04:47:28.777 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 19 2024-09-19T04:47:28.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.777+0000 7fc5b8333640 1 -- 172.21.15.2:0/3818802471 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fc5980a32d0 msgr2=0x7fc5980a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:28.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.777+0000 7fc5b8333640 1 --2- 172.21.15.2:0/3818802471 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fc5980a32d0 0x7fc5980a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc5b00feee0 tx=0x7fc5a4005bf0 comp rx=0 tx=0).stop 2024-09-19T04:47:28.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.778+0000 7fc5b8333640 1 -- 172.21.15.2:0/3818802471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5b0100e20 msgr2=0x7fc5b0198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:28.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.778+0000 7fc5b8333640 1 --2- 172.21.15.2:0/3818802471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5b0100e20 0x7fc5b0198440 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc5a0009430 tx=0x7fc5a002f6c0 comp rx=0 tx=0).stop 2024-09-19T04:47:28.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.778+0000 7fc5b8333640 1 -- 172.21.15.2:0/3818802471 shutdown_connections 2024-09-19T04:47:28.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.778+0000 7fc5b8333640 1 --2- 172.21.15.2:0/3818802471 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fc5980a32d0 0x7fc5980a5790 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:28.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.778+0000 7fc5b8333640 1 --2- 172.21.15.2:0/3818802471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc5b0102ef0 0x7fc5b019cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:28.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.778+0000 7fc5b8333640 1 --2- 172.21.15.2:0/3818802471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc5b0102570 0x7fc5b0198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:28.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.778+0000 7fc5b8333640 1 --2- 172.21.15.2:0/3818802471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5b0100e20 0x7fc5b0198440 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:28.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.778+0000 7fc5b8333640 1 -- 172.21.15.2:0/3818802471 >> 172.21.15.2:0/3818802471 conn(0x7fc5b00fc7d0 msgr2=0x7fc5b0069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:28.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.778+0000 7fc5b8333640 1 -- 172.21.15.2:0/3818802471 shutdown_connections 2024-09-19T04:47:28.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:28.778+0000 7fc5b8333640 1 -- 172.21.15.2:0/3818802471 wait complete. 2024-09-19T04:47:29.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:28 smithi002 ceph-mon[30975]: pgmap v306: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:47:29.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:28 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/3818802471' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:47:29.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:28 smithi018 ceph-mon[34537]: pgmap v306: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:47:29.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:28 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/3818802471' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:47:29.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:28 smithi116 ceph-mon[34477]: pgmap v306: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:47:29.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:28 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/3818802471' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:47:29.461 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:47:29.724 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:47:30.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.254+0000 7f8319d57640 1 -- 172.21.15.2:0/2670004294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83141082a0 msgr2=0x7f831410ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:30.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.254+0000 7f8319d57640 1 --2- 172.21.15.2:0/2670004294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83141082a0 0x7f831410ec40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f830c009cd0 tx=0x7f830c02a910 comp rx=0 tx=0).stop 2024-09-19T04:47:30.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.254+0000 7f8319d57640 1 -- 172.21.15.2:0/2670004294 shutdown_connections 2024-09-19T04:47:30.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.254+0000 7f8319d57640 1 --2- 172.21.15.2:0/2670004294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83141082a0 0x7f831410ec40 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:30.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.254+0000 7f8319d57640 1 --2- 172.21.15.2:0/2670004294 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f83141036e0 0x7f8314107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:30.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.254+0000 7f8319d57640 1 --2- 172.21.15.2:0/2670004294 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8314102d30 0x7f8314103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:30.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.254+0000 7f8319d57640 1 -- 172.21.15.2:0/2670004294 >> 172.21.15.2:0/2670004294 conn(0x7f83140fc7d0 msgr2=0x7f83140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:30.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.254+0000 7f8319d57640 1 -- 172.21.15.2:0/2670004294 shutdown_connections 2024-09-19T04:47:30.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.254+0000 7f8319d57640 1 -- 172.21.15.2:0/2670004294 wait complete. 2024-09-19T04:47:30.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.254+0000 7f8319d57640 1 Processor -- start 2024-09-19T04:47:30.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.255+0000 7f8319d57640 1 -- start start 2024-09-19T04:47:30.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.255+0000 7f8319d57640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8314102d30 0x7f83141985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:30.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.255+0000 7f8319d57640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f83141036e0 0x7f8314198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:30.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.255+0000 7f8319d57640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83141082a0 0x7f831419cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:30.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.255+0000 7f8319d57640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8314112010 con 0x7f83141082a0 2024-09-19T04:47:30.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.255+0000 7f8319d57640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8314111e90 con 0x7f8314102d30 2024-09-19T04:47:30.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.255+0000 7f8319d57640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f8314112190 con 0x7f83141036e0 2024-09-19T04:47:30.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.255+0000 7f8313fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83141082a0 0x7f831419cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:30.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.255+0000 7f83137fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8314102d30 0x7f83141985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:30.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.255+0000 7f8313fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83141082a0 0x7f831419cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51958/0 (socket says 172.21.15.2:51958) 2024-09-19T04:47:30.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.255+0000 7f8313fff640 1 -- 172.21.15.2:0/1161262462 learned_addr learned my addr 172.21.15.2:0/1161262462 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:47:30.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.255+0000 7f83137fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8314102d30 0x7f83141985d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.2:47000/0 (socket says 172.21.15.2:47000) 2024-09-19T04:47:30.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.255+0000 7f8312ffd640 1 --2- 172.21.15.2:0/1161262462 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f83141036e0 0x7f8314198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:30.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.255+0000 7f8313fff640 1 -- 172.21.15.2:0/1161262462 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f83141036e0 msgr2=0x7f8314198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:30.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.255+0000 7f8313fff640 1 --2- 172.21.15.2:0/1161262462 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f83141036e0 0x7f8314198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:30.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.255+0000 7f8313fff640 1 -- 172.21.15.2:0/1161262462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8314102d30 msgr2=0x7f83141985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:30.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.255+0000 7f8313fff640 1 --2- 172.21.15.2:0/1161262462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8314102d30 0x7f83141985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:30.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.255+0000 7f8313fff640 1 -- 172.21.15.2:0/1161262462 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f831419d580 con 0x7f83141082a0 2024-09-19T04:47:30.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.256+0000 7f83137fe640 1 --2- 172.21.15.2:0/1161262462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8314102d30 0x7f83141985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:47:30.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.256+0000 7f8313fff640 1 --2- 172.21.15.2:0/1161262462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83141082a0 0x7f831419cea0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f830c009df0 tx=0x7f830c003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:30.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.256+0000 7f8310ff9640 1 -- 172.21.15.2:0/1161262462 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f830c004040 con 0x7f83141082a0 2024-09-19T04:47:30.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.256+0000 7f8310ff9640 1 -- 172.21.15.2:0/1161262462 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f830c004690 con 0x7f83141082a0 2024-09-19T04:47:30.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.256+0000 7f8319d57640 1 -- 172.21.15.2:0/1161262462 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f831419d810 con 0x7f83141082a0 2024-09-19T04:47:30.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.256+0000 7f8310ff9640 1 -- 172.21.15.2:0/1161262462 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f830c030e30 con 0x7f83141082a0 2024-09-19T04:47:30.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.256+0000 7f8319d57640 1 -- 172.21.15.2:0/1161262462 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83141a5150 con 0x7f83141082a0 2024-09-19T04:47:30.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.257+0000 7f8319d57640 1 -- 172.21.15.2:0/1161262462 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8314103190 con 0x7f83141082a0 2024-09-19T04:47:30.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.258+0000 7f8310ff9640 1 -- 172.21.15.2:0/1161262462 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f830c0305d0 con 0x7f83141082a0 2024-09-19T04:47:30.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.259+0000 7f8310ff9640 1 --2- 172.21.15.2:0/1161262462 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f82fc0a3350 0x7f82fc0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:30.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.259+0000 7f83137fe640 1 --2- 172.21.15.2:0/1161262462 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f82fc0a3350 0x7f82fc0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:30.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.260+0000 7f8310ff9640 1 -- 172.21.15.2:0/1161262462 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f830c0f0e20 con 0x7f83141082a0 2024-09-19T04:47:30.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.260+0000 7f83137fe640 1 --2- 172.21.15.2:0/1161262462 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f82fc0a3350 0x7f82fc0a5810 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8304009d60 tx=0x7f8304009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:30.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.263+0000 7f8310ff9640 1 -- 172.21.15.2:0/1161262462 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f830c0bdb00 con 0x7f83141082a0 2024-09-19T04:47:30.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.503+0000 7f8319d57640 1 -- 172.21.15.2:0/1161262462 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f831410a2b0 con 0x7f83141082a0 2024-09-19T04:47:30.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.503+0000 7f8310ff9640 1 -- 172.21.15.2:0/1161262462 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11840 (secure 0 0 0) 0x7f830c0bd400 con 0x7f83141082a0 2024-09-19T04:47:30.505 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:47:30.505 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":19,"btime":"2024-09-19T04:46:33:537239+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2467365137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2467365137},{"type":"v1","addr":"172.21.15.2:6835","nonce":2467365137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3162441888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3162441888},{"type":"v1","addr":"172.21.15.2:6837","nonce":3162441888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14631,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2740862966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2740862966},{"type":"v1","addr":"172.21.15.2:6839","nonce":2740862966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/2394435504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2394435504},{"type":"v1","addr":"172.21.15.2:6841","nonce":2394435504}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1630480244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1630480244},{"type":"v1","addr":"172.21.15.18:6833","nonce":1630480244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1553897465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1553897465},{"type":"v1","addr":"172.21.15.116:6833","nonce":1553897465}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3035664608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3035664608},{"type":"v1","addr":"172.21.15.18:6835","nonce":3035664608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1096622392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1096622392},{"type":"v1","addr":"172.21.15.18:6837","nonce":1096622392}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3761157675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3761157675},{"type":"v1","addr":"172.21.15.116:6835","nonce":3761157675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/1120131594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1120131594},{"type":"v1","addr":"172.21.15.116:6837","nonce":1120131594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:46:24.050115+0000","modified":"2024-09-19T04:46:33.112369+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/4207677139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":4207677139},{"type":"v1","addr":"172.21.15.18:6839","nonce":4207677139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/2346874880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":2346874880},{"type":"v1","addr":"172.21.15.116:6839","nonce":2346874880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496]},"id":1}]} 2024-09-19T04:47:30.505 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 19 2024-09-19T04:47:30.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.505+0000 7f8319d57640 1 -- 172.21.15.2:0/1161262462 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f82fc0a3350 msgr2=0x7f82fc0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:30.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.505+0000 7f8319d57640 1 --2- 172.21.15.2:0/1161262462 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f82fc0a3350 0x7f82fc0a5810 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8304009d60 tx=0x7f8304009110 comp rx=0 tx=0).stop 2024-09-19T04:47:30.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.505+0000 7f8319d57640 1 -- 172.21.15.2:0/1161262462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83141082a0 msgr2=0x7f831419cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:30.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.505+0000 7f8319d57640 1 --2- 172.21.15.2:0/1161262462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83141082a0 0x7f831419cea0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f830c009df0 tx=0x7f830c003ba0 comp rx=0 tx=0).stop 2024-09-19T04:47:30.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.505+0000 7f8319d57640 1 -- 172.21.15.2:0/1161262462 shutdown_connections 2024-09-19T04:47:30.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.505+0000 7f8319d57640 1 --2- 172.21.15.2:0/1161262462 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f82fc0a3350 0x7f82fc0a5810 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:30.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.505+0000 7f8319d57640 1 --2- 172.21.15.2:0/1161262462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83141082a0 0x7f831419cea0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:30.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.505+0000 7f8319d57640 1 --2- 172.21.15.2:0/1161262462 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f83141036e0 0x7f8314198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:30.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.505+0000 7f8319d57640 1 --2- 172.21.15.2:0/1161262462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8314102d30 0x7f83141985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:30.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.505+0000 7f8319d57640 1 -- 172.21.15.2:0/1161262462 >> 172.21.15.2:0/1161262462 conn(0x7f83140fc7d0 msgr2=0x7f8314105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:30.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.506+0000 7f8319d57640 1 -- 172.21.15.2:0/1161262462 shutdown_connections 2024-09-19T04:47:30.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:30.506+0000 7f8319d57640 1 -- 172.21.15.2:0/1161262462 wait complete. 2024-09-19T04:47:31.119 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:30 smithi002 ceph-mon[30975]: pgmap v307: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T04:47:31.119 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:30 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/1161262462' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:47:31.121 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T04:47:31.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:30 smithi018 ceph-mon[34537]: pgmap v307: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T04:47:31.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:30 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/1161262462' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:47:31.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:30 smithi116 ceph-mon[34477]: pgmap v307: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T04:47:31.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:30 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/1161262462' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:47:31.385 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:47:31.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:31.811+0000 7efc4a29a640 1 -- 172.21.15.2:0/2849636400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc4410c170 msgr2=0x7efc4410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:31.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:31.811+0000 7efc4a29a640 1 --2- 172.21.15.2:0/2849636400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc4410c170 0x7efc4410e610 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7efc3c009ca0 tx=0x7efc3c02a950 comp rx=0 tx=0).stop 2024-09-19T04:47:31.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:31.811+0000 7efc4a29a640 1 -- 172.21.15.2:0/2849636400 shutdown_connections 2024-09-19T04:47:31.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:31.811+0000 7efc4a29a640 1 --2- 172.21.15.2:0/2849636400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc4410c170 0x7efc4410e610 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:31.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:31.811+0000 7efc4a29a640 1 --2- 172.21.15.2:0/2849636400 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc44103660 0x7efc4410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:31.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:31.811+0000 7efc4a29a640 1 --2- 172.21.15.2:0/2849636400 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc44102d40 0x7efc44103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:31.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:31.811+0000 7efc4a29a640 1 -- 172.21.15.2:0/2849636400 >> 172.21.15.2:0/2849636400 conn(0x7efc440fc7a0 msgr2=0x7efc440febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:31.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:31.811+0000 7efc4a29a640 1 -- 172.21.15.2:0/2849636400 shutdown_connections 2024-09-19T04:47:31.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:31.811+0000 7efc4a29a640 1 -- 172.21.15.2:0/2849636400 wait complete. 2024-09-19T04:47:31.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:31.812+0000 7efc4a29a640 1 Processor -- start 2024-09-19T04:47:31.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:31.812+0000 7efc4a29a640 1 -- start start 2024-09-19T04:47:31.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:31.812+0000 7efc4a29a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc44102d40 0x7efc441982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:31.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:31.812+0000 7efc4a29a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc44103660 0x7efc44198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:31.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:31.812+0000 7efc4a29a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc4410c170 0x7efc4419cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:31.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:31.812+0000 7efc4a29a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efc44111e60 con 0x7efc4410c170 2024-09-19T04:47:31.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:31.812+0000 7efc4a29a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efc44111ce0 con 0x7efc44103660 2024-09-19T04:47:31.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:31.812+0000 7efc4a29a640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7efc44111fe0 con 0x7efc44102d40 2024-09-19T04:47:31.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:31.812+0000 7efc48837640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc4410c170 0x7efc4419cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:31.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:31.812+0000 7efc48837640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc4410c170 0x7efc4419cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54900/0 (socket says 172.21.15.2:54900) 2024-09-19T04:47:31.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:31.812+0000 7efc48837640 1 -- 172.21.15.2:0/3922625321 learned_addr learned my addr 172.21.15.2:0/3922625321 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:47:31.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:31.812+0000 7efc43fff640 1 --2- 172.21.15.2:0/3922625321 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc44102d40 0x7efc441982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:31.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:31.812+0000 7efc48837640 1 -- 172.21.15.2:0/3922625321 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc44102d40 msgr2=0x7efc441982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:31.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:31.812+0000 7efc3bfff640 1 --2- 172.21.15.2:0/3922625321 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc44103660 0x7efc44198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:31.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:31.812+0000 7efc48837640 1 --2- 172.21.15.2:0/3922625321 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc44102d40 0x7efc441982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:31.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:31.812+0000 7efc48837640 1 -- 172.21.15.2:0/3922625321 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc44103660 msgr2=0x7efc44198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:31.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:31.812+0000 7efc48837640 1 --2- 172.21.15.2:0/3922625321 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc44103660 0x7efc44198820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:31.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:31.812+0000 7efc48837640 1 -- 172.21.15.2:0/3922625321 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc4419d290 con 0x7efc4410c170 2024-09-19T04:47:31.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:31.813+0000 7efc48837640 1 --2- 172.21.15.2:0/3922625321 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc4410c170 0x7efc4419cbb0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7efc3c006010 tx=0x7efc3c02f640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:31.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:31.813+0000 7efc41ffb640 1 -- 172.21.15.2:0/3922625321 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc3c034040 con 0x7efc4410c170 2024-09-19T04:47:31.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:31.813+0000 7efc41ffb640 1 -- 172.21.15.2:0/3922625321 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efc3c003e00 con 0x7efc4410c170 2024-09-19T04:47:31.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:31.813+0000 7efc4a29a640 1 -- 172.21.15.2:0/3922625321 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc4419d520 con 0x7efc4410c170 2024-09-19T04:47:31.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:31.813+0000 7efc41ffb640 1 -- 172.21.15.2:0/3922625321 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc3c045480 con 0x7efc4410c170 2024-09-19T04:47:31.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:31.813+0000 7efc4a29a640 1 -- 172.21.15.2:0/3922625321 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc441a4e60 con 0x7efc4410c170 2024-09-19T04:47:31.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:31.814+0000 7efc4a29a640 1 -- 172.21.15.2:0/3922625321 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc44103120 con 0x7efc4410c170 2024-09-19T04:47:31.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:31.815+0000 7efc41ffb640 1 -- 172.21.15.2:0/3922625321 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7efc3c037020 con 0x7efc4410c170 2024-09-19T04:47:31.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:31.816+0000 7efc41ffb640 1 --2- 172.21.15.2:0/3922625321 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7efc300a3350 0x7efc300a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:31.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:31.816+0000 7efc43fff640 1 --2- 172.21.15.2:0/3922625321 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7efc300a3350 0x7efc300a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:31.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:31.816+0000 7efc41ffb640 1 -- 172.21.15.2:0/3922625321 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7efc3c0f0ab0 con 0x7efc4410c170 2024-09-19T04:47:31.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:31.817+0000 7efc43fff640 1 --2- 172.21.15.2:0/3922625321 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7efc300a3350 0x7efc300a5810 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efc3400abe0 tx=0x7efc3400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:31.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:31.820+0000 7efc41ffb640 1 -- 172.21.15.2:0/3922625321 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7efc3c0bd7e0 con 0x7efc4410c170 2024-09-19T04:47:31.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:31.996+0000 7efc4a29a640 1 -- 172.21.15.2:0/3922625321 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efc441a5060 con 0x7efc4410c170 2024-09-19T04:47:31.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:31.998+0000 7efc41ffb640 1 -- 172.21.15.2:0/3922625321 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22490 (secure 0 0 0) 0x7efc3c0bd0e0 con 0x7efc4410c170 2024-09-19T04:47:32.000 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:47:32.000 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":80,"fsid":"d46630c4-7640-11ef-bceb-c7b262605968","created":"2024-09-19T04:38:39.698488+0000","modified":"2024-09-19T04:46:36.551838+0000","last_up_change":"2024-09-19T04:45:33.839647+0000","last_in_change":"2024-09-19T04:45:09.816808+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T04:41:51.960734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T04:46:20.031485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T04:46:22.484767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7a7dc9b9-8d5d-4dd3-93a3-0d5efced07d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":611702745},{"type":"v1","addr":"172.21.15.2:6803","nonce":611702745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":611702745},{"type":"v1","addr":"172.21.15.2:6805","nonce":611702745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":611702745},{"type":"v1","addr":"172.21.15.2:6809","nonce":611702745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":611702745},{"type":"v1","addr":"172.21.15.2:6807","nonce":611702745}]},"public_addr":"172.21.15.2:6803/611702745","cluster_addr":"172.21.15.2:6805/611702745","heartbeat_back_addr":"172.21.15.2:6809/611702745","heartbeat_front_addr":"172.21.15.2:6807/611702745","state":["exists","up"]},{"osd":1,"uuid":"bea40dec-7d9c-497f-bf16-4bf6d3b839f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":58390709},{"type":"v1","addr":"172.21.15.18:6801","nonce":58390709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":58390709},{"type":"v1","addr":"172.21.15.18:6803","nonce":58390709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":58390709},{"type":"v1","addr":"172.21.15.18:6807","nonce":58390709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":58390709},{"type":"v1","addr":"172.21.15.18:6805","nonce":58390709}]},"public_addr":"172.21.15.18:6801/58390709","cluster_addr":"172.21.15.18:6803/58390709","heartbeat_back_addr":"172.21.15.18:6807/58390709","heartbeat_front_addr":"172.21.15.18:6805/58390709","state":["exists","up"]},{"osd":2,"uuid":"97716304-a31e-48c9-83de-84eed10a7a4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":627735759},{"type":"v1","addr":"172.21.15.116:6801","nonce":627735759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":627735759},{"type":"v1","addr":"172.21.15.116:6803","nonce":627735759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":627735759},{"type":"v1","addr":"172.21.15.116:6807","nonce":627735759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":627735759},{"type":"v1","addr":"172.21.15.116:6805","nonce":627735759}]},"public_addr":"172.21.15.116:6801/627735759","cluster_addr":"172.21.15.116:6803/627735759","heartbeat_back_addr":"172.21.15.116:6807/627735759","heartbeat_front_addr":"172.21.15.116:6805/627735759","state":["exists","up"]},{"osd":3,"uuid":"8d79514e-16cf-4bd0-a2eb-e9148b91183d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1936071687},{"type":"v1","addr":"172.21.15.2:6811","nonce":1936071687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1936071687},{"type":"v1","addr":"172.21.15.2:6813","nonce":1936071687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1936071687},{"type":"v1","addr":"172.21.15.2:6817","nonce":1936071687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1936071687},{"type":"v1","addr":"172.21.15.2:6815","nonce":1936071687}]},"public_addr":"172.21.15.2:6811/1936071687","cluster_addr":"172.21.15.2:6813/1936071687","heartbeat_back_addr":"172.21.15.2:6817/1936071687","heartbeat_front_addr":"172.21.15.2:6815/1936071687","state":["exists","up"]},{"osd":4,"uuid":"5136f03c-94a3-42a0-9bfc-020397836037","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1333533784},{"type":"v1","addr":"172.21.15.18:6809","nonce":1333533784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1333533784},{"type":"v1","addr":"172.21.15.18:6811","nonce":1333533784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1333533784},{"type":"v1","addr":"172.21.15.18:6815","nonce":1333533784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1333533784},{"type":"v1","addr":"172.21.15.18:6813","nonce":1333533784}]},"public_addr":"172.21.15.18:6809/1333533784","cluster_addr":"172.21.15.18:6811/1333533784","heartbeat_back_addr":"172.21.15.18:6815/1333533784","heartbeat_front_addr":"172.21.15.18:6813/1333533784","state":["exists","up"]},{"osd":5,"uuid":"9d3384b0-f87d-4513-b151-4cca21c339b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":316360741},{"type":"v1","addr":"172.21.15.116:6809","nonce":316360741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":316360741},{"type":"v1","addr":"172.21.15.116:6811","nonce":316360741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":316360741},{"type":"v1","addr":"172.21.15.116:6815","nonce":316360741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":316360741},{"type":"v1","addr":"172.21.15.116:6813","nonce":316360741}]},"public_addr":"172.21.15.116:6809/316360741","cluster_addr":"172.21.15.116:6811/316360741","heartbeat_back_addr":"172.21.15.116:6815/316360741","heartbeat_front_addr":"172.21.15.116:6813/316360741","state":["exists","up"]},{"osd":6,"uuid":"e54f44b5-a693-4b31-83b2-2bcf10ab9a75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1185564560},{"type":"v1","addr":"172.21.15.2:6819","nonce":1185564560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1185564560},{"type":"v1","addr":"172.21.15.2:6821","nonce":1185564560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1185564560},{"type":"v1","addr":"172.21.15.2:6825","nonce":1185564560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":1185564560},{"type":"v1","addr":"172.21.15.2:6823","nonce":1185564560}]},"public_addr":"172.21.15.2:6819/1185564560","cluster_addr":"172.21.15.2:6821/1185564560","heartbeat_back_addr":"172.21.15.2:6825/1185564560","heartbeat_front_addr":"172.21.15.2:6823/1185564560","state":["exists","up"]},{"osd":7,"uuid":"96a444c3-429a-48b6-9823-95c9e171341a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3691801363},{"type":"v1","addr":"172.21.15.18:6817","nonce":3691801363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3691801363},{"type":"v1","addr":"172.21.15.18:6819","nonce":3691801363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3691801363},{"type":"v1","addr":"172.21.15.18:6823","nonce":3691801363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3691801363},{"type":"v1","addr":"172.21.15.18:6821","nonce":3691801363}]},"public_addr":"172.21.15.18:6817/3691801363","cluster_addr":"172.21.15.18:6819/3691801363","heartbeat_back_addr":"172.21.15.18:6823/3691801363","heartbeat_front_addr":"172.21.15.18:6821/3691801363","state":["exists","up"]},{"osd":8,"uuid":"c3f696aa-be7d-4f67-9147-3751406e394d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":3709586119},{"type":"v1","addr":"172.21.15.116:6817","nonce":3709586119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":3709586119},{"type":"v1","addr":"172.21.15.116:6819","nonce":3709586119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":3709586119},{"type":"v1","addr":"172.21.15.116:6823","nonce":3709586119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":3709586119},{"type":"v1","addr":"172.21.15.116:6821","nonce":3709586119}]},"public_addr":"172.21.15.116:6817/3709586119","cluster_addr":"172.21.15.116:6819/3709586119","heartbeat_back_addr":"172.21.15.116:6823/3709586119","heartbeat_front_addr":"172.21.15.116:6821/3709586119","state":["exists","up"]},{"osd":9,"uuid":"4892549d-f050-48c5-b695-5924b612a581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1054791011},{"type":"v1","addr":"172.21.15.2:6827","nonce":1054791011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1054791011},{"type":"v1","addr":"172.21.15.2:6829","nonce":1054791011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1054791011},{"type":"v1","addr":"172.21.15.2:6833","nonce":1054791011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":1054791011},{"type":"v1","addr":"172.21.15.2:6831","nonce":1054791011}]},"public_addr":"172.21.15.2:6827/1054791011","cluster_addr":"172.21.15.2:6829/1054791011","heartbeat_back_addr":"172.21.15.2:6833/1054791011","heartbeat_front_addr":"172.21.15.2:6831/1054791011","state":["exists","up"]},{"osd":10,"uuid":"12b60238-6a35-4d48-bacd-ee5ddd8fdb0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1958683776},{"type":"v1","addr":"172.21.15.18:6825","nonce":1958683776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":1958683776},{"type":"v1","addr":"172.21.15.18:6827","nonce":1958683776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":1958683776},{"type":"v1","addr":"172.21.15.18:6831","nonce":1958683776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":1958683776},{"type":"v1","addr":"172.21.15.18:6829","nonce":1958683776}]},"public_addr":"172.21.15.18:6825/1958683776","cluster_addr":"172.21.15.18:6827/1958683776","heartbeat_back_addr":"172.21.15.18:6831/1958683776","heartbeat_front_addr":"172.21.15.18:6829/1958683776","state":["exists","up"]},{"osd":11,"uuid":"99b3e553-b42c-4b2f-817f-3900ad8bd223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3456789654},{"type":"v1","addr":"172.21.15.116:6825","nonce":3456789654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3456789654},{"type":"v1","addr":"172.21.15.116:6827","nonce":3456789654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3456789654},{"type":"v1","addr":"172.21.15.116:6831","nonce":3456789654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3456789654},{"type":"v1","addr":"172.21.15.116:6829","nonce":3456789654}]},"public_addr":"172.21.15.116:6825/3456789654","cluster_addr":"172.21.15.116:6827/3456789654","heartbeat_back_addr":"172.21.15.116:6831/3456789654","heartbeat_front_addr":"172.21.15.116:6829/3456789654","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:40:58.216702+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:41:22.852350+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:41:47.265084+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:42:12.785128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:42:38.475008+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:43:02.924009+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:43:28.050646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:43:52.715369+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:44:16.905066+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:44:42.071128+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:45:06.434525+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:45:31.569086+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":1}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/870383845":"2024-09-20T04:39:35.461329+0000","172.21.15.2:0/2801870985":"2024-09-20T04:39:35.461329+0000","172.21.15.2:0/256825166":"2024-09-20T04:39:35.461329+0000","172.21.15.2:6801/3782987318":"2024-09-20T04:39:35.461329+0000","172.21.15.2:0/3064319092":"2024-09-20T04:39:11.086431+0000","172.21.15.2:0/1528097642":"2024-09-20T04:39:11.086431+0000","172.21.15.2:6801/1825825090":"2024-09-20T04:39:11.086431+0000","172.21.15.2:6800/1825825090":"2024-09-20T04:39:11.086431+0000","172.21.15.2:6800/3782987318":"2024-09-20T04:39:35.461329+0000","172.21.15.2:0/2432243496":"2024-09-20T04:39:11.086431+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T04:47:32.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:32.000+0000 7efc4a29a640 1 -- 172.21.15.2:0/3922625321 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7efc300a3350 msgr2=0x7efc300a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:32.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:32.000+0000 7efc4a29a640 1 --2- 172.21.15.2:0/3922625321 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7efc300a3350 0x7efc300a5810 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efc3400abe0 tx=0x7efc3400a2d0 comp rx=0 tx=0).stop 2024-09-19T04:47:32.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:32.000+0000 7efc4a29a640 1 -- 172.21.15.2:0/3922625321 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc4410c170 msgr2=0x7efc4419cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:32.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:32.000+0000 7efc4a29a640 1 --2- 172.21.15.2:0/3922625321 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc4410c170 0x7efc4419cbb0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7efc3c006010 tx=0x7efc3c02f640 comp rx=0 tx=0).stop 2024-09-19T04:47:32.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:32.000+0000 7efc4a29a640 1 -- 172.21.15.2:0/3922625321 shutdown_connections 2024-09-19T04:47:32.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:32.000+0000 7efc4a29a640 1 --2- 172.21.15.2:0/3922625321 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7efc300a3350 0x7efc300a5810 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:32.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:32.000+0000 7efc4a29a640 1 --2- 172.21.15.2:0/3922625321 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc4410c170 0x7efc4419cbb0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:32.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:32.000+0000 7efc4a29a640 1 --2- 172.21.15.2:0/3922625321 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc44103660 0x7efc44198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:32.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:32.000+0000 7efc4a29a640 1 --2- 172.21.15.2:0/3922625321 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc44102d40 0x7efc441982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:32.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:32.000+0000 7efc4a29a640 1 -- 172.21.15.2:0/3922625321 >> 172.21.15.2:0/3922625321 conn(0x7efc440fc7a0 msgr2=0x7efc440fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:32.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:32.000+0000 7efc4a29a640 1 -- 172.21.15.2:0/3922625321 shutdown_connections 2024-09-19T04:47:32.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:32.000+0000 7efc4a29a640 1 -- 172.21.15.2:0/3922625321 wait complete. 2024-09-19T04:47:32.640 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:47:32.900 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:47:33.177 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:32 smithi002 ceph-mon[30975]: pgmap v308: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:47:33.177 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:32 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/3922625321' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:47:33.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:32 smithi018 ceph-mon[34537]: pgmap v308: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:47:33.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:32 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/3922625321' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:47:33.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:32 smithi116 ceph-mon[34477]: pgmap v308: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:47:33.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:32 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/3922625321' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:47:33.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.385+0000 7fe9197d0640 1 -- 172.21.15.2:0/1125381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe914106f10 msgr2=0x7fe91410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:33.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.385+0000 7fe9197d0640 1 --2- 172.21.15.2:0/1125381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe914106f10 0x7fe91410ea90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe90c009900 tx=0x7fe90c02a410 comp rx=0 tx=0).stop 2024-09-19T04:47:33.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.385+0000 7fe9197d0640 1 -- 172.21.15.2:0/1125381 shutdown_connections 2024-09-19T04:47:33.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.385+0000 7fe9197d0640 1 --2- 172.21.15.2:0/1125381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe914106f10 0x7fe91410ea90 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:33.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.385+0000 7fe9197d0640 1 --2- 172.21.15.2:0/1125381 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe914102790 0x7fe9141067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:33.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.385+0000 7fe9197d0640 1 --2- 172.21.15.2:0/1125381 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe914101de0 0x7fe9141021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:33.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.385+0000 7fe9197d0640 1 -- 172.21.15.2:0/1125381 >> 172.21.15.2:0/1125381 conn(0x7fe9140fd8c0 msgr2=0x7fe9140ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:33.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.385+0000 7fe9197d0640 1 -- 172.21.15.2:0/1125381 shutdown_connections 2024-09-19T04:47:33.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.385+0000 7fe9197d0640 1 -- 172.21.15.2:0/1125381 wait complete. 2024-09-19T04:47:33.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.386+0000 7fe9197d0640 1 Processor -- start 2024-09-19T04:47:33.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.386+0000 7fe9197d0640 1 -- start start 2024-09-19T04:47:33.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.386+0000 7fe9197d0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe914101de0 0x7fe9140744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:33.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.386+0000 7fe9197d0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe914102790 0x7fe914074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:33.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.386+0000 7fe9197d0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe914106f10 0x7fe914074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:33.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.386+0000 7fe9197d0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe914111ec0 con 0x7fe914102790 2024-09-19T04:47:33.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.386+0000 7fe9197d0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe914111d40 con 0x7fe914106f10 2024-09-19T04:47:33.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.386+0000 7fe9197d0640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fe914112040 con 0x7fe914101de0 2024-09-19T04:47:33.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.386+0000 7fe9127fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe914102790 0x7fe914074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:33.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.386+0000 7fe9127fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe914102790 0x7fe914074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54912/0 (socket says 172.21.15.2:54912) 2024-09-19T04:47:33.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.386+0000 7fe9127fc640 1 -- 172.21.15.2:0/2876479697 learned_addr learned my addr 172.21.15.2:0/2876479697 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:47:33.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.387+0000 7fe912ffd640 1 --2- 172.21.15.2:0/2876479697 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe914101de0 0x7fe9140744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:33.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.387+0000 7fe9137fe640 1 --2- 172.21.15.2:0/2876479697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe914106f10 0x7fe914074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:33.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.387+0000 7fe9127fc640 1 -- 172.21.15.2:0/2876479697 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe914101de0 msgr2=0x7fe9140744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:33.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.387+0000 7fe9127fc640 1 --2- 172.21.15.2:0/2876479697 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe914101de0 0x7fe9140744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:33.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.387+0000 7fe9127fc640 1 -- 172.21.15.2:0/2876479697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe914106f10 msgr2=0x7fe914074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:33.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.387+0000 7fe9127fc640 1 --2- 172.21.15.2:0/2876479697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe914106f10 0x7fe914074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:33.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.387+0000 7fe9127fc640 1 -- 172.21.15.2:0/2876479697 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9141a6960 con 0x7fe914102790 2024-09-19T04:47:33.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.387+0000 7fe9137fe640 1 --2- 172.21.15.2:0/2876479697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe914106f10 0x7fe914074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:47:33.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.387+0000 7fe9127fc640 1 --2- 172.21.15.2:0/2876479697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe914102790 0x7fe914074a30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc00b4a0 tx=0x7fe8fc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:33.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.387+0000 7fe90bfff640 1 -- 172.21.15.2:0/2876479697 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc014070 con 0x7fe914102790 2024-09-19T04:47:33.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.387+0000 7fe9197d0640 1 -- 172.21.15.2:0/2876479697 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9141a6c50 con 0x7fe914102790 2024-09-19T04:47:33.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.387+0000 7fe90bfff640 1 -- 172.21.15.2:0/2876479697 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe8fc010ac0 con 0x7fe914102790 2024-09-19T04:47:33.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.387+0000 7fe90bfff640 1 -- 172.21.15.2:0/2876479697 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc017c30 con 0x7fe914102790 2024-09-19T04:47:33.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.387+0000 7fe9197d0640 1 -- 172.21.15.2:0/2876479697 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9141a7190 con 0x7fe914102790 2024-09-19T04:47:33.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.388+0000 7fe9197d0640 1 -- 172.21.15.2:0/2876479697 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe914102240 con 0x7fe914102790 2024-09-19T04:47:33.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.390+0000 7fe90bfff640 1 -- 172.21.15.2:0/2876479697 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fe8fc017070 con 0x7fe914102790 2024-09-19T04:47:33.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.390+0000 7fe90bfff640 1 --2- 172.21.15.2:0/2876479697 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe9000a32d0 0x7fe9000a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:33.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.390+0000 7fe912ffd640 1 --2- 172.21.15.2:0/2876479697 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe9000a32d0 0x7fe9000a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:33.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.390+0000 7fe90bfff640 1 -- 172.21.15.2:0/2876479697 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fe8fc0cf140 con 0x7fe914102790 2024-09-19T04:47:33.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.391+0000 7fe912ffd640 1 --2- 172.21.15.2:0/2876479697 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe9000a32d0 0x7fe9000a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe904009f20 tx=0x7fe9040094f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:33.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.393+0000 7fe90bfff640 1 -- 172.21.15.2:0/2876479697 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe8fc09bde0 con 0x7fe914102790 2024-09-19T04:47:33.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.609+0000 7fe9197d0640 1 -- 172.21.15.2:0/2876479697 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe91410a0f0 con 0x7fe914102790 2024-09-19T04:47:33.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.609+0000 7fe90bfff640 1 -- 172.21.15.2:0/2876479697 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11840 (secure 0 0 0) 0x7fe8fc09b6e0 con 0x7fe914102790 2024-09-19T04:47:33.611 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:47:33.611 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":19,"btime":"2024-09-19T04:46:33:537239+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2467365137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2467365137},{"type":"v1","addr":"172.21.15.2:6835","nonce":2467365137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3162441888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3162441888},{"type":"v1","addr":"172.21.15.2:6837","nonce":3162441888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14631,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2740862966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2740862966},{"type":"v1","addr":"172.21.15.2:6839","nonce":2740862966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/2394435504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2394435504},{"type":"v1","addr":"172.21.15.2:6841","nonce":2394435504}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1630480244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1630480244},{"type":"v1","addr":"172.21.15.18:6833","nonce":1630480244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1553897465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1553897465},{"type":"v1","addr":"172.21.15.116:6833","nonce":1553897465}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3035664608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3035664608},{"type":"v1","addr":"172.21.15.18:6835","nonce":3035664608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1096622392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1096622392},{"type":"v1","addr":"172.21.15.18:6837","nonce":1096622392}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3761157675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3761157675},{"type":"v1","addr":"172.21.15.116:6835","nonce":3761157675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/1120131594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1120131594},{"type":"v1","addr":"172.21.15.116:6837","nonce":1120131594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:46:24.050115+0000","modified":"2024-09-19T04:46:33.112369+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/4207677139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":4207677139},{"type":"v1","addr":"172.21.15.18:6839","nonce":4207677139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/2346874880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":2346874880},{"type":"v1","addr":"172.21.15.116:6839","nonce":2346874880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496]},"id":1}]} 2024-09-19T04:47:33.611 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 19 2024-09-19T04:47:33.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.611+0000 7fe9197d0640 1 -- 172.21.15.2:0/2876479697 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe9000a32d0 msgr2=0x7fe9000a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:33.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.611+0000 7fe9197d0640 1 --2- 172.21.15.2:0/2876479697 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe9000a32d0 0x7fe9000a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe904009f20 tx=0x7fe9040094f0 comp rx=0 tx=0).stop 2024-09-19T04:47:33.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.611+0000 7fe9197d0640 1 -- 172.21.15.2:0/2876479697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe914102790 msgr2=0x7fe914074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:33.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.611+0000 7fe9197d0640 1 --2- 172.21.15.2:0/2876479697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe914102790 0x7fe914074a30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc00b4a0 tx=0x7fe8fc00b960 comp rx=0 tx=0).stop 2024-09-19T04:47:33.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.611+0000 7fe9197d0640 1 -- 172.21.15.2:0/2876479697 shutdown_connections 2024-09-19T04:47:33.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.611+0000 7fe9197d0640 1 --2- 172.21.15.2:0/2876479697 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe9000a32d0 0x7fe9000a5790 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:33.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.611+0000 7fe9197d0640 1 --2- 172.21.15.2:0/2876479697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe914106f10 0x7fe914074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:33.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.611+0000 7fe9197d0640 1 --2- 172.21.15.2:0/2876479697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe914102790 0x7fe914074a30 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:33.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.611+0000 7fe9197d0640 1 --2- 172.21.15.2:0/2876479697 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe914101de0 0x7fe9140744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:33.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.611+0000 7fe9197d0640 1 -- 172.21.15.2:0/2876479697 >> 172.21.15.2:0/2876479697 conn(0x7fe9140fd8c0 msgr2=0x7fe9140fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:33.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.612+0000 7fe9197d0640 1 -- 172.21.15.2:0/2876479697 shutdown_connections 2024-09-19T04:47:33.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:33.612+0000 7fe9197d0640 1 -- 172.21.15.2:0/2876479697 wait complete. 2024-09-19T04:47:34.224 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:33 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/2876479697' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:47:34.255 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 19, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T04:46:24.050115+0000', 'modified': '2024-09-19T04:46:33.112369+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24496}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24491': {'gid': 24491, 'name': 'b', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.18:6839/4207677139', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6838', 'nonce': 4207677139}, {'type': 'v1', 'addr': '172.21.15.18:6839', 'nonce': 4207677139}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24496': {'gid': 24496, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.116:6839/2346874880', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6838', 'nonce': 2346874880}, {'type': 'v1', 'addr': '172.21.15.116:6839', 'nonce': 2346874880}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24496, 'qdb_cluster': [24496]} 2024-09-19T04:47:34.255 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T04:47:34.256 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T04:47:34.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:33 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/2876479697' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:47:34.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:33 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/2876479697' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:47:34.524 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:47:35.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.985+0000 7f82da3a4640 1 -- 172.21.15.2:0/2276208427 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82d4101de0 msgr2=0x7f82d41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:35.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.985+0000 7f82da3a4640 1 --2- 172.21.15.2:0/2276208427 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82d4101de0 0x7f82d41021c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f82c4009900 tx=0x7f82c402a410 comp rx=0 tx=0).stop 2024-09-19T04:47:35.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.985+0000 7f82da3a4640 1 -- 172.21.15.2:0/2276208427 shutdown_connections 2024-09-19T04:47:35.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.985+0000 7f82da3a4640 1 --2- 172.21.15.2:0/2276208427 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82d4106f10 0x7f82d410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:35.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.985+0000 7f82da3a4640 1 --2- 172.21.15.2:0/2276208427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82d4102790 0x7f82d41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:35.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.985+0000 7f82da3a4640 1 --2- 172.21.15.2:0/2276208427 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82d4101de0 0x7f82d41021c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:35.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.985+0000 7f82da3a4640 1 -- 172.21.15.2:0/2276208427 >> 172.21.15.2:0/2276208427 conn(0x7f82d40fd8c0 msgr2=0x7f82d40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:35.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.985+0000 7f82da3a4640 1 -- 172.21.15.2:0/2276208427 shutdown_connections 2024-09-19T04:47:35.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.985+0000 7f82da3a4640 1 -- 172.21.15.2:0/2276208427 wait complete. 2024-09-19T04:47:35.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.986+0000 7f82da3a4640 1 Processor -- start 2024-09-19T04:47:35.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.986+0000 7f82da3a4640 1 -- start start 2024-09-19T04:47:35.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.986+0000 7f82da3a4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82d4101de0 0x7f82d4198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:35.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.986+0000 7f82da3a4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82d4102790 0x7f82d41988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:35.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.986+0000 7f82da3a4640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82d4106f10 0x7f82d419cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:35.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.986+0000 7f82da3a4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f82d4111e40 con 0x7f82d4102790 2024-09-19T04:47:35.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.986+0000 7f82da3a4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f82d4111cc0 con 0x7f82d4101de0 2024-09-19T04:47:35.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.986+0000 7f82da3a4640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f82d4111fc0 con 0x7f82d4106f10 2024-09-19T04:47:35.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.986+0000 7f82d37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82d4102790 0x7f82d41988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:35.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.986+0000 7f82d37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82d4102790 0x7f82d41988a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54932/0 (socket says 172.21.15.2:54932) 2024-09-19T04:47:35.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.986+0000 7f82d37fe640 1 -- 172.21.15.2:0/1287564202 learned_addr learned my addr 172.21.15.2:0/1287564202 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:47:35.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.986+0000 7f82d8941640 1 --2- 172.21.15.2:0/1287564202 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82d4106f10 0x7f82d419cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:35.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.986+0000 7f82d3fff640 1 --2- 172.21.15.2:0/1287564202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82d4101de0 0x7f82d4198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:35.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.986+0000 7f82d37fe640 1 -- 172.21.15.2:0/1287564202 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82d4106f10 msgr2=0x7f82d419cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:35.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.986+0000 7f82d37fe640 1 --2- 172.21.15.2:0/1287564202 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82d4106f10 0x7f82d419cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:35.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.986+0000 7f82d37fe640 1 -- 172.21.15.2:0/1287564202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82d4101de0 msgr2=0x7f82d4198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:35.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.986+0000 7f82d37fe640 1 --2- 172.21.15.2:0/1287564202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82d4101de0 0x7f82d4198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:35.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.986+0000 7f82d37fe640 1 -- 172.21.15.2:0/1287564202 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82d419d310 con 0x7f82d4102790 2024-09-19T04:47:35.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.987+0000 7f82d37fe640 1 --2- 172.21.15.2:0/1287564202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82d4102790 0x7f82d41988a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f82c800c920 tx=0x7f82c800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:35.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.987+0000 7f82d17fa640 1 -- 172.21.15.2:0/1287564202 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c8007c70 con 0x7f82d4102790 2024-09-19T04:47:35.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.987+0000 7f82d17fa640 1 -- 172.21.15.2:0/1287564202 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f82c8007e10 con 0x7f82d4102790 2024-09-19T04:47:35.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.987+0000 7f82da3a4640 1 -- 172.21.15.2:0/1287564202 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82d419d600 con 0x7f82d4102790 2024-09-19T04:47:35.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.987+0000 7f82d17fa640 1 -- 172.21.15.2:0/1287564202 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c8018820 con 0x7f82d4102790 2024-09-19T04:47:35.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.987+0000 7f82da3a4640 1 -- 172.21.15.2:0/1287564202 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82d41a4ee0 con 0x7f82d4102790 2024-09-19T04:47:35.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.989+0000 7f82d17fa640 1 -- 172.21.15.2:0/1287564202 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f82c80189c0 con 0x7f82d4102790 2024-09-19T04:47:35.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.989+0000 7f82dc77d740 1 Processor -- start 2024-09-19T04:47:35.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.989+0000 7f82dc77d740 1 -- start start 2024-09-19T04:47:35.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.990+0000 7f82dc77d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626a20f19d0 0x5626a20f1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:35.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.990+0000 7f82dc77d740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5626a20f22f0 0x5626a20fc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:35.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.990+0000 7f82dc77d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626a20fcbb0 0x5626a20fefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:35.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.990+0000 7f82dc77d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5626a2058090 con 0x5626a20fcbb0 2024-09-19T04:47:35.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.990+0000 7f82dc77d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5626a1fffa70 con 0x5626a20f19d0 2024-09-19T04:47:35.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.990+0000 7f82dc77d740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5626a2054050 con 0x5626a20f22f0 2024-09-19T04:47:35.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.990+0000 7f82d17fa640 1 --2- 172.21.15.2:0/1287564202 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f82bc0a32d0 0x7f82bc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:35.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.990+0000 7f82d37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626a20fcbb0 0x5626a20fefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:35.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.990+0000 7f82d8941640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626a20f19d0 0x5626a20f1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:35.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.990+0000 7f82d8941640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626a20f19d0 0x5626a20f1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.2:59414/0 (socket says 172.21.15.2:59414) 2024-09-19T04:47:35.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.990+0000 7f82d8941640 1 -- 172.21.15.2:0/1049651840 learned_addr learned my addr 172.21.15.2:0/1049651840 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:47:35.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.990+0000 7f82d3fff640 1 --2- 172.21.15.2:0/1049651840 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5626a20f22f0 0x5626a20fc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:35.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.990+0000 7f82d8941640 1 --2- 172.21.15.2:0/1287564202 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f82bc0a32d0 0x7f82bc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:35.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.990+0000 7f82d8941640 1 -- 172.21.15.2:0/1049651840 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5626a20f22f0 msgr2=0x5626a20fc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:47:35.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.990+0000 7f82d8941640 1 --2- 172.21.15.2:0/1049651840 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5626a20f22f0 0x5626a20fc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:35.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.990+0000 7f82d8941640 1 -- 172.21.15.2:0/1049651840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626a20fcbb0 msgr2=0x5626a20fefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:47:35.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.990+0000 7f82d8941640 1 --2- 172.21.15.2:0/1049651840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626a20fcbb0 0x5626a20fefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:35.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.990+0000 7f82d8941640 1 -- 172.21.15.2:0/1049651840 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626a200c130 con 0x5626a20f19d0 2024-09-19T04:47:35.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.990+0000 7f82d17fa640 1 -- 172.21.15.2:0/1287564202 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f82c80cfcf0 con 0x7f82d4102790 2024-09-19T04:47:35.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.991+0000 7f82d8941640 1 --2- 172.21.15.2:0/1049651840 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626a20f19d0 0x5626a20f1db0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f82cc00cb20 tx=0x7f82cc0072b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=697599c7a9b13e96 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:35.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.991+0000 7f82d8941640 1 --2- 172.21.15.2:0/1287564202 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f82bc0a32d0 0x7f82bc0a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f82cc00c000 tx=0x7f82cc01b000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:35.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.991+0000 7f82ba7fc640 1 -- 172.21.15.2:0/1049651840 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82cc015070 con 0x5626a20f19d0 2024-09-19T04:47:35.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.991+0000 7f82ba7fc640 1 -- 172.21.15.2:0/1049651840 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f82cc01e030 con 0x5626a20f19d0 2024-09-19T04:47:35.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.991+0000 7f82ba7fc640 1 -- 172.21.15.2:0/1049651840 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82cc00a640 con 0x5626a20f19d0 2024-09-19T04:47:35.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.991+0000 7f82dc77d740 1 -- 172.21.15.2:0/1049651840 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626a20f19d0 msgr2=0x5626a20f1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:35.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.991+0000 7f82dc77d740 1 --2- 172.21.15.2:0/1049651840 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626a20f19d0 0x5626a20f1db0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f82cc00cb20 tx=0x7f82cc0072b0 comp rx=0 tx=0).stop 2024-09-19T04:47:35.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.991+0000 7f82dc77d740 1 -- 172.21.15.2:0/1049651840 shutdown_connections 2024-09-19T04:47:35.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.991+0000 7f82dc77d740 1 --2- 172.21.15.2:0/1049651840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626a20fcbb0 0x5626a20fefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:35.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.991+0000 7f82dc77d740 1 --2- 172.21.15.2:0/1049651840 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5626a20f22f0 0x5626a20fc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:35.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.991+0000 7f82dc77d740 1 --2- 172.21.15.2:0/1049651840 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626a20f19d0 0x5626a20f1db0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:35.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.991+0000 7f82dc77d740 1 -- 172.21.15.2:0/1049651840 >> 172.21.15.2:0/1049651840 conn(0x5626a20edf60 msgr2=0x5626a20ee340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:35.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.991+0000 7f82dc77d740 1 -- 172.21.15.2:0/1049651840 shutdown_connections 2024-09-19T04:47:35.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.992+0000 7f82dc77d740 1 -- 172.21.15.2:0/1049651840 wait complete. 2024-09-19T04:47:35.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.992+0000 7f82dc77d740 1 -- start start 2024-09-19T04:47:35.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.992+0000 7f82dc77d740 1 Processor -- start 2024-09-19T04:47:35.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.992+0000 7f82dc77d740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5626a20f19d0 0x5626a20fc520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:35.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.992+0000 7f82dc77d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626a20f22f0 0x5626a20f9870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:35.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.992+0000 7f82dc77d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626a20fcbb0 0x5626a20f9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:35.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.992+0000 7f82dc77d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5626a20ff780 con 0x5626a20fcbb0 2024-09-19T04:47:35.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.992+0000 7f82dc77d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5626a2012f20 con 0x5626a20f22f0 2024-09-19T04:47:35.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.992+0000 7f82dc77d740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5626a20ff900 con 0x5626a20f19d0 2024-09-19T04:47:35.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.992+0000 7f82dc77d740 10 client.0 _ll_register_callbacks cb 0x5626a1fdc030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:47:35.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.992+0000 7f82d8941640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626a20fcbb0 0x5626a20f9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:35.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.992+0000 7f82d8941640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626a20fcbb0 0x5626a20f9dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54948/0 (socket says 172.21.15.2:54948) 2024-09-19T04:47:35.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.992+0000 7f82d8941640 1 -- 172.21.15.2:0/2672755626 learned_addr learned my addr 172.21.15.2:0/2672755626 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:47:35.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.993+0000 7f82d37fe640 1 --2- 172.21.15.2:0/2672755626 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626a20f22f0 0x5626a20f9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:35.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.993+0000 7f82d3fff640 1 --2- 172.21.15.2:0/2672755626 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5626a20f19d0 0x5626a20fc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:35.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.993+0000 7f82d8941640 1 -- 172.21.15.2:0/2672755626 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5626a20f19d0 msgr2=0x5626a20fc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:47:35.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.993+0000 7f82d8941640 1 --2- 172.21.15.2:0/2672755626 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5626a20f19d0 0x5626a20fc520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:35.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.993+0000 7f82d8941640 1 -- 172.21.15.2:0/2672755626 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626a20f22f0 msgr2=0x5626a20f9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:47:35.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.993+0000 7f82d8941640 1 --2- 172.21.15.2:0/2672755626 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626a20f22f0 0x5626a20f9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:35.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.993+0000 7f82d8941640 1 -- 172.21.15.2:0/2672755626 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626a1dc92b0 con 0x5626a20fcbb0 2024-09-19T04:47:35.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.993+0000 7f82d8941640 1 --2- 172.21.15.2:0/2672755626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626a20fcbb0 0x5626a20f9dd0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f82cc009720 tx=0x7f82cc004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2a989322639a707 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:35.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.993+0000 7f82b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:47:35.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.993+0000 7f82b37fe640 1 -- 172.21.15.2:0/2672755626 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82cc030060 con 0x5626a20fcbb0 2024-09-19T04:47:35.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.993+0000 7f82b37fe640 1 -- 172.21.15.2:0/2672755626 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f82cc023830 con 0x5626a20fcbb0 2024-09-19T04:47:35.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.993+0000 7f82dc77d740 1 -- 172.21.15.2:0/2672755626 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82cc01e030 con 0x5626a20fcbb0 2024-09-19T04:47:35.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.993+0000 7f82b37fe640 1 -- 172.21.15.2:0/2672755626 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f82cc015040 con 0x5626a20fcbb0 2024-09-19T04:47:35.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.993+0000 7f82dc77d740 10 client.14988 fetch_fsmap learned FSMap version 19 2024-09-19T04:47:35.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.993+0000 7f82dc77d740 1 -- 172.21.15.2:0/2672755626 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5626a210b150 con 0x5626a20fcbb0 2024-09-19T04:47:35.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.993+0000 7f82b37fe640 1 -- 172.21.15.2:0/2672755626 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f82cc01e030 con 0x5626a20fcbb0 2024-09-19T04:47:35.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.994+0000 7f82b37fe640 1 -- 172.21.15.2:0/2672755626 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f82cc00a400 con 0x5626a20fcbb0 2024-09-19T04:47:35.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.994+0000 7f82dc77d740 10 client.14988 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:47:35.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.994+0000 7f82dc77d740 10 client.14988 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T04:47:35.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.994+0000 7f82dc77d740 20 client.14988 populate_metadata read hostname 'smithi002' 2024-09-19T04:47:35.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.994+0000 7f82dc77d740 1 --2- 172.21.15.2:0/2672755626 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5626a210d380 0x5626a210e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:35.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.994+0000 7f82dc77d740 4 client.14988 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:47:35.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.994+0000 7f82dc77d740 1 -- 172.21.15.2:0/2672755626 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5626a2065600 con 0x5626a210d380 2024-09-19T04:47:35.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.994+0000 7f82d3fff640 1 --2- 172.21.15.2:0/2672755626 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5626a210d380 0x5626a210e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:35.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.994+0000 7f82b37fe640 10 client.14988 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:47:35.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.994+0000 7f82d3fff640 1 --2- 172.21.15.2:0/2672755626 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5626a210d380 0x5626a210e7f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87197175126c00f1 server_cookie=ee417c41618735f6 in_seq=0 out_seq=0 2024-09-19T04:47:35.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.995+0000 7f82b37fe640 1 -- 172.21.15.2:0/2672755626 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5626a2065600 con 0x5626a210d380 2024-09-19T04:47:35.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.995+0000 7f82b37fe640 10 client.14988 handle_command_reply: tid=0 2024-09-19T04:47:35.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.995+0000 7f82dc77d740 1 client.14988 shutdown 2024-09-19T04:47:35.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.996+0000 7f82dc77d740 1 -- 172.21.15.2:0/2672755626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626a20fcbb0 msgr2=0x5626a20f9dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:35.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.996+0000 7f82dc77d740 1 --2- 172.21.15.2:0/2672755626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626a20fcbb0 0x5626a20f9dd0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f82cc009720 tx=0x7f82cc004b50 comp rx=0 tx=0).stop 2024-09-19T04:47:35.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.996+0000 7f82dc77d740 1 -- 172.21.15.2:0/2672755626 shutdown_connections 2024-09-19T04:47:35.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.996+0000 7f82dc77d740 1 --2- 172.21.15.2:0/2672755626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626a20fcbb0 0x5626a20f9dd0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:35.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.996+0000 7f82dc77d740 1 --2- 172.21.15.2:0/2672755626 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626a20f22f0 0x5626a20f9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:35.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.996+0000 7f82dc77d740 1 --2- 172.21.15.2:0/2672755626 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5626a210d380 0x5626a210e7f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:35.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.996+0000 7f82b37fe640 0 client.14988 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:47:35.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.996+0000 7f82dc77d740 1 --2- 172.21.15.2:0/2672755626 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5626a20f19d0 0x5626a20fc520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:35.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.996+0000 7f82dc77d740 1 -- 172.21.15.2:0/2672755626 >> 172.21.15.2:0/2672755626 conn(0x5626a20edf60 msgr2=0x5626a20f3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:35.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.996+0000 7f82dc77d740 1 -- 172.21.15.2:0/2672755626 shutdown_connections 2024-09-19T04:47:35.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.996+0000 7f82dc77d740 1 -- 172.21.15.2:0/2672755626 wait complete. 2024-09-19T04:47:35.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:34.996+0000 7f82dc77d740 20 client.14988 trim_cache size 0 max 16384 2024-09-19T04:47:35.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.014+0000 7f82dc77d740 1 Processor -- start 2024-09-19T04:47:35.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.014+0000 7f82dc77d740 1 -- start start 2024-09-19T04:47:35.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.014+0000 7f82dc77d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626a20f19d0 0x5626a20f9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:35.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.014+0000 7f82dc77d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626a20f22f0 0x5626a210e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:35.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.014+0000 7f82dc77d740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5626a20fcbb0 0x5626a20fb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:35.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.014+0000 7f82dc77d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5626a210cb30 con 0x5626a20f22f0 2024-09-19T04:47:35.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.014+0000 7f82dc77d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5626a210d200 con 0x5626a20f19d0 2024-09-19T04:47:35.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.014+0000 7f82dc77d740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5626a210d8d0 con 0x5626a20fcbb0 2024-09-19T04:47:35.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.014+0000 7f82d37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626a20f22f0 0x5626a210e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:35.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.014+0000 7f82d37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626a20f22f0 0x5626a210e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54950/0 (socket says 172.21.15.2:54950) 2024-09-19T04:47:35.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.014+0000 7f82d37fe640 1 -- 172.21.15.2:0/808021878 learned_addr learned my addr 172.21.15.2:0/808021878 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:47:35.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.014+0000 7f82d8941640 1 --2- 172.21.15.2:0/808021878 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5626a20fcbb0 0x5626a20fb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:35.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.014+0000 7f82d3fff640 1 --2- 172.21.15.2:0/808021878 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626a20f19d0 0x5626a20f9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:35.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.014+0000 7f82d37fe640 1 -- 172.21.15.2:0/808021878 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5626a20fcbb0 msgr2=0x5626a20fb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:47:35.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.014+0000 7f82d37fe640 1 --2- 172.21.15.2:0/808021878 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5626a20fcbb0 0x5626a20fb6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:35.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.014+0000 7f82d37fe640 1 -- 172.21.15.2:0/808021878 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626a20f19d0 msgr2=0x5626a20f9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:47:35.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.014+0000 7f82d37fe640 1 --2- 172.21.15.2:0/808021878 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626a20f19d0 0x5626a20f9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:35.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.014+0000 7f82d37fe640 1 -- 172.21.15.2:0/808021878 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626a20fc140 con 0x5626a20f22f0 2024-09-19T04:47:35.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.014+0000 7f82d3fff640 1 --2- 172.21.15.2:0/808021878 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626a20f19d0 0x5626a20f9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:47:35.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.015+0000 7f82d37fe640 1 --2- 172.21.15.2:0/808021878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626a20f22f0 0x5626a210e7f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f82c80985e0 tx=0x7f82c809c080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f14b0f77a8a068af server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:35.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.015+0000 7f82b9ffb640 1 -- 172.21.15.2:0/808021878 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c809c180 con 0x5626a20f22f0 2024-09-19T04:47:35.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.015+0000 7f82b9ffb640 1 -- 172.21.15.2:0/808021878 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f82c809c880 con 0x5626a20f22f0 2024-09-19T04:47:35.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.015+0000 7f82b9ffb640 1 -- 172.21.15.2:0/808021878 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c80cd8c0 con 0x5626a20f22f0 2024-09-19T04:47:35.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.015+0000 7f82dc77d740 1 -- 172.21.15.2:0/808021878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626a20f22f0 msgr2=0x5626a210e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:35.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.015+0000 7f82dc77d740 1 --2- 172.21.15.2:0/808021878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626a20f22f0 0x5626a210e7f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f82c80985e0 tx=0x7f82c809c080 comp rx=0 tx=0).stop 2024-09-19T04:47:35.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.015+0000 7f82dc77d740 1 -- 172.21.15.2:0/808021878 shutdown_connections 2024-09-19T04:47:35.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.015+0000 7f82dc77d740 1 --2- 172.21.15.2:0/808021878 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5626a20fcbb0 0x5626a20fb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:35.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.015+0000 7f82dc77d740 1 --2- 172.21.15.2:0/808021878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626a20f22f0 0x5626a210e7f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:35.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.015+0000 7f82dc77d740 1 --2- 172.21.15.2:0/808021878 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626a20f19d0 0x5626a20f9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:35.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.015+0000 7f82dc77d740 1 -- 172.21.15.2:0/808021878 >> 172.21.15.2:0/808021878 conn(0x5626a20edf60 msgr2=0x5626a20fafc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:35.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.016+0000 7f82dc77d740 1 -- 172.21.15.2:0/808021878 shutdown_connections 2024-09-19T04:47:35.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.016+0000 7f82dc77d740 1 -- 172.21.15.2:0/808021878 wait complete. 2024-09-19T04:47:35.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.016+0000 7f82dc77d740 1 -- start start 2024-09-19T04:47:35.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.016+0000 7f82dc77d740 1 Processor -- start 2024-09-19T04:47:35.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.016+0000 7f82dc77d740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5626a20f19d0 0x5626a2114bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:35.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.016+0000 7f82dc77d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626a20f22f0 0x5626a2115100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:35.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.016+0000 7f82dc77d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626a20fcbb0 0x5626a2115660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:35.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.016+0000 7f82dc77d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5626a210e670 con 0x5626a20fcbb0 2024-09-19T04:47:35.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.016+0000 7f82dc77d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5626a210dfa0 con 0x5626a20f22f0 2024-09-19T04:47:35.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.016+0000 7f82dc77d740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5626a210ed40 con 0x5626a20f19d0 2024-09-19T04:47:35.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.016+0000 7f82dc77d740 10 client.0 _ll_register_callbacks cb 0x7f82c809bf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:47:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.017+0000 7f82d8941640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626a20fcbb0 0x5626a2115660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.017+0000 7f82d8941640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626a20fcbb0 0x5626a2115660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54966/0 (socket says 172.21.15.2:54966) 2024-09-19T04:47:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.017+0000 7f82d8941640 1 -- 172.21.15.2:0/4151502293 learned_addr learned my addr 172.21.15.2:0/4151502293 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:47:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.017+0000 7f82d3fff640 1 --2- 172.21.15.2:0/4151502293 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5626a20f19d0 0x5626a2114bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.017+0000 7f82d37fe640 1 --2- 172.21.15.2:0/4151502293 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626a20f22f0 0x5626a2115100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.017+0000 7f82d8941640 1 -- 172.21.15.2:0/4151502293 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5626a20f19d0 msgr2=0x5626a2114bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:47:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.017+0000 7f82d8941640 1 --2- 172.21.15.2:0/4151502293 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5626a20f19d0 0x5626a2114bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.017+0000 7f82d8941640 1 -- 172.21.15.2:0/4151502293 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626a20f22f0 msgr2=0x5626a2115100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:47:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.017+0000 7f82d8941640 1 --2- 172.21.15.2:0/4151502293 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626a20f22f0 0x5626a2115100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.017+0000 7f82d8941640 1 -- 172.21.15.2:0/4151502293 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626a217ad90 con 0x5626a20fcbb0 2024-09-19T04:47:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.017+0000 7f82d8941640 1 --2- 172.21.15.2:0/4151502293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626a20fcbb0 0x5626a2115660 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f82cc002230 tx=0x7f82cc007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13eef8510c28e60 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.017+0000 7f82b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:47:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.017+0000 7f82b37fe640 1 -- 172.21.15.2:0/4151502293 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82cc03b070 con 0x5626a20fcbb0 2024-09-19T04:47:35.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.017+0000 7f82b37fe640 1 -- 172.21.15.2:0/4151502293 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f82cc00a9a0 con 0x5626a20fcbb0 2024-09-19T04:47:35.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.017+0000 7f82dc77d740 1 -- 172.21.15.2:0/4151502293 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82c809c880 con 0x5626a20fcbb0 2024-09-19T04:47:35.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.018+0000 7f82b37fe640 1 -- 172.21.15.2:0/4151502293 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f82cc030070 con 0x5626a20fcbb0 2024-09-19T04:47:35.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.018+0000 7f82dc77d740 10 client.14994 fetch_fsmap learned FSMap version 19 2024-09-19T04:47:35.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.018+0000 7f82dc77d740 1 -- 172.21.15.2:0/4151502293 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5626a217c000 con 0x5626a20fcbb0 2024-09-19T04:47:35.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.018+0000 7f82b37fe640 1 -- 172.21.15.2:0/4151502293 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f82c809c880 con 0x5626a20fcbb0 2024-09-19T04:47:35.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.018+0000 7f82b37fe640 1 -- 172.21.15.2:0/4151502293 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f82cc023630 con 0x5626a20fcbb0 2024-09-19T04:47:35.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.018+0000 7f82dc77d740 10 client.14994 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:47:35.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.018+0000 7f82dc77d740 10 client.14994 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T04:47:35.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.018+0000 7f82dc77d740 20 client.14994 populate_metadata read hostname 'smithi002' 2024-09-19T04:47:35.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.018+0000 7f82dc77d740 1 --2- 172.21.15.2:0/4151502293 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5626a210d380 0x5626a217f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:35.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.018+0000 7f82dc77d740 4 client.14994 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T04:47:35.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.018+0000 7f82dc77d740 1 -- 172.21.15.2:0/4151502293 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "status"}) -- 0x5626a205fb10 con 0x5626a210d380 2024-09-19T04:47:35.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.018+0000 7f82d3fff640 1 --2- 172.21.15.2:0/4151502293 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5626a210d380 0x5626a217f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:35.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.019+0000 7f82d3fff640 1 --2- 172.21.15.2:0/4151502293 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5626a210d380 0x5626a217f7e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ae9100f2a98073e server_cookie=5fca0cbe14ee936c in_seq=0 out_seq=0 2024-09-19T04:47:35.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.019+0000 7f82b37fe640 10 client.14994 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:47:35.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.019+0000 7f82b37fe640 1 -- 172.21.15.2:0/4151502293 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x5626a205fb10 con 0x5626a210d380 2024-09-19T04:47:35.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.019+0000 7f82b37fe640 10 client.14994 handle_command_reply: tid=0 2024-09-19T04:47:35.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.019+0000 7f82dc77d740 1 client.14994 shutdown 2024-09-19T04:47:35.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.019+0000 7f82dc77d740 1 -- 172.21.15.2:0/4151502293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626a20fcbb0 msgr2=0x5626a2115660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:35.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.019+0000 7f82dc77d740 1 --2- 172.21.15.2:0/4151502293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626a20fcbb0 0x5626a2115660 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f82cc002230 tx=0x7f82cc007830 comp rx=0 tx=0).stop 2024-09-19T04:47:35.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.019+0000 7f82dc77d740 1 -- 172.21.15.2:0/4151502293 shutdown_connections 2024-09-19T04:47:35.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.019+0000 7f82dc77d740 1 --2- 172.21.15.2:0/4151502293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626a20fcbb0 0x5626a2115660 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:35.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.019+0000 7f82dc77d740 1 --2- 172.21.15.2:0/4151502293 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626a20f22f0 0x5626a2115100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:35.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.019+0000 7f82dc77d740 1 --2- 172.21.15.2:0/4151502293 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5626a210d380 0x5626a217f7e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:35.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.019+0000 7f82dc77d740 1 --2- 172.21.15.2:0/4151502293 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5626a20f19d0 0x5626a2114bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:35.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.019+0000 7f82b37fe640 0 client.14994 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:47:35.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.019+0000 7f82dc77d740 1 -- 172.21.15.2:0/4151502293 >> 172.21.15.2:0/4151502293 conn(0x5626a20edf60 msgr2=0x5626a20ed000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:35.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.019+0000 7f82dc77d740 1 -- 172.21.15.2:0/4151502293 shutdown_connections 2024-09-19T04:47:35.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.019+0000 7f82dc77d740 1 -- 172.21.15.2:0/4151502293 wait complete. 2024-09-19T04:47:35.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.019+0000 7f82dc77d740 20 client.14994 trim_cache size 0 max 16384 2024-09-19T04:47:35.026 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:47:35.026 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "d46630c4-7640-11ef-bceb-c7b262605968", 2024-09-19T04:47:35.026 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 0, 2024-09-19T04:47:35.026 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24496, 2024-09-19T04:47:35.026 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-09-19T04:47:35.026 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-09-19T04:47:35.027 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-09-19T04:47:35.027 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 70.515889603000005, 2024-09-19T04:47:35.027 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 19, 2024-09-19T04:47:35.027 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 80, 2024-09-19T04:47:35.027 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 78, 2024-09-19T04:47:35.027 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 89.671789425 2024-09-19T04:47:35.027 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:47:35.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.020+0000 7f82da3a4640 1 -- 172.21.15.2:0/1287564202 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f82bc0a32d0 msgr2=0x7f82bc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.020+0000 7f82da3a4640 1 --2- 172.21.15.2:0/1287564202 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f82bc0a32d0 0x7f82bc0a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f82cc00c000 tx=0x7f82cc01b000 comp rx=0 tx=0).stop 2024-09-19T04:47:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.020+0000 7f82da3a4640 1 -- 172.21.15.2:0/1287564202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82d4102790 msgr2=0x7f82d41988a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.020+0000 7f82da3a4640 1 --2- 172.21.15.2:0/1287564202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82d4102790 0x7f82d41988a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f82c800c920 tx=0x7f82c800cde0 comp rx=0 tx=0).stop 2024-09-19T04:47:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.020+0000 7f82da3a4640 1 -- 172.21.15.2:0/1287564202 shutdown_connections 2024-09-19T04:47:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.020+0000 7f82da3a4640 1 --2- 172.21.15.2:0/1287564202 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f82bc0a32d0 0x7f82bc0a5790 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.020+0000 7f82da3a4640 1 --2- 172.21.15.2:0/1287564202 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82d4106f10 0x7f82d419cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.020+0000 7f82da3a4640 1 --2- 172.21.15.2:0/1287564202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82d4102790 0x7f82d41988a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.020+0000 7f82da3a4640 1 --2- 172.21.15.2:0/1287564202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82d4101de0 0x7f82d4198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.020+0000 7f82da3a4640 1 -- 172.21.15.2:0/1287564202 >> 172.21.15.2:0/1287564202 conn(0x7f82d40fd8c0 msgr2=0x7f82d40fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.020+0000 7f82da3a4640 1 -- 172.21.15.2:0/1287564202 shutdown_connections 2024-09-19T04:47:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:35.020+0000 7f82da3a4640 1 -- 172.21.15.2:0/1287564202 wait complete. 2024-09-19T04:47:35.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:34 smithi018 ceph-mon[34537]: pgmap v309: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:47:35.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:34 smithi002 ceph-mon[30975]: pgmap v309: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:47:35.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:34 smithi116 ceph-mon[34477]: pgmap v309: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:47:35.737 INFO:tasks.cephadm:Setup complete, yielding 2024-09-19T04:47:35.737 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T04:47:35.748 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-19T04:47:35.748 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-19T04:47:36.007 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:47:36.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.492+0000 7f0d67aa7640 1 -- 172.21.15.2:0/395569168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d601037d0 msgr2=0x7f0d6010a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:36.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.492+0000 7f0d67aa7640 1 --2- 172.21.15.2:0/395569168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d601037d0 0x7f0d6010a060 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0d58009ca0 tx=0x7f0d5802a8c0 comp rx=0 tx=0).stop 2024-09-19T04:47:36.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.492+0000 7f0d67aa7640 1 -- 172.21.15.2:0/395569168 shutdown_connections 2024-09-19T04:47:36.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.492+0000 7f0d67aa7640 1 --2- 172.21.15.2:0/395569168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d601037d0 0x7f0d6010a060 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:36.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.492+0000 7f0d67aa7640 1 --2- 172.21.15.2:0/395569168 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d60102e10 0x7f0d60103290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:36.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.492+0000 7f0d67aa7640 1 --2- 172.21.15.2:0/395569168 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d60101c10 0x7f0d60102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:36.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.492+0000 7f0d67aa7640 1 -- 172.21.15.2:0/395569168 >> 172.21.15.2:0/395569168 conn(0x7f0d600fd3c0 msgr2=0x7f0d600ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:36.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.492+0000 7f0d67aa7640 1 -- 172.21.15.2:0/395569168 shutdown_connections 2024-09-19T04:47:36.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.492+0000 7f0d67aa7640 1 -- 172.21.15.2:0/395569168 wait complete. 2024-09-19T04:47:36.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.493+0000 7f0d67aa7640 1 Processor -- start 2024-09-19T04:47:36.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.493+0000 7f0d67aa7640 1 -- start start 2024-09-19T04:47:36.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.493+0000 7f0d67aa7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d60101c10 0x7f0d60075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:36.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.493+0000 7f0d67aa7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d60102e10 0x7f0d600745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:36.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.493+0000 7f0d67aa7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d601037d0 0x7f0d60074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:36.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.493+0000 7f0d67aa7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0d6010d7c0 con 0x7f0d60101c10 2024-09-19T04:47:36.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.493+0000 7f0d67aa7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0d6010d640 con 0x7f0d60102e10 2024-09-19T04:47:36.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.493+0000 7f0d67aa7640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f0d6010d940 con 0x7f0d601037d0 2024-09-19T04:47:36.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.493+0000 7f0d65843640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d60101c10 0x7f0d60075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:36.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.493+0000 7f0d65843640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d60101c10 0x7f0d60075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54978/0 (socket says 172.21.15.2:54978) 2024-09-19T04:47:36.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.493+0000 7f0d65843640 1 -- 172.21.15.2:0/2967927476 learned_addr learned my addr 172.21.15.2:0/2967927476 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:47:36.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.493+0000 7f0d65042640 1 --2- 172.21.15.2:0/2967927476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d60102e10 0x7f0d600745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:36.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.493+0000 7f0d65843640 1 -- 172.21.15.2:0/2967927476 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d601037d0 msgr2=0x7f0d60074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:36.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.493+0000 7f0d66044640 1 --2- 172.21.15.2:0/2967927476 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d601037d0 0x7f0d60074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:36.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.493+0000 7f0d65843640 1 --2- 172.21.15.2:0/2967927476 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d601037d0 0x7f0d60074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:36.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.493+0000 7f0d65843640 1 -- 172.21.15.2:0/2967927476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d60102e10 msgr2=0x7f0d600745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:36.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.493+0000 7f0d65843640 1 --2- 172.21.15.2:0/2967927476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d60102e10 0x7f0d600745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:36.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.493+0000 7f0d65843640 1 -- 172.21.15.2:0/2967927476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d600753e0 con 0x7f0d60101c10 2024-09-19T04:47:36.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.493+0000 7f0d65042640 1 --2- 172.21.15.2:0/2967927476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d60102e10 0x7f0d600745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:47:36.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.493+0000 7f0d66044640 1 --2- 172.21.15.2:0/2967927476 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d601037d0 0x7f0d60074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:47:36.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.494+0000 7f0d65843640 1 --2- 172.21.15.2:0/2967927476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d60101c10 0x7f0d60075f90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c00b450 tx=0x7f0d5c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:36.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.494+0000 7f0d52ffd640 1 -- 172.21.15.2:0/2967927476 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c015020 con 0x7f0d60101c10 2024-09-19T04:47:36.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.494+0000 7f0d67aa7640 1 -- 172.21.15.2:0/2967927476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d601a1fe0 con 0x7f0d60101c10 2024-09-19T04:47:36.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.494+0000 7f0d52ffd640 1 -- 172.21.15.2:0/2967927476 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0d5c011d40 con 0x7f0d60101c10 2024-09-19T04:47:36.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.494+0000 7f0d52ffd640 1 -- 172.21.15.2:0/2967927476 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c00f340 con 0x7f0d60101c10 2024-09-19T04:47:36.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.494+0000 7f0d67aa7640 1 -- 172.21.15.2:0/2967927476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d601a2430 con 0x7f0d60101c10 2024-09-19T04:47:36.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.495+0000 7f0d67aa7640 1 -- 172.21.15.2:0/2967927476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d60109000 con 0x7f0d60101c10 2024-09-19T04:47:36.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.496+0000 7f0d52ffd640 1 -- 172.21.15.2:0/2967927476 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f0d5c018020 con 0x7f0d60101c10 2024-09-19T04:47:36.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.497+0000 7f0d52ffd640 1 --2- 172.21.15.2:0/2967927476 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f0d4c0a32d0 0x7f0d4c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:36.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.497+0000 7f0d65042640 1 --2- 172.21.15.2:0/2967927476 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f0d4c0a32d0 0x7f0d4c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:36.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.497+0000 7f0d52ffd640 1 -- 172.21.15.2:0/2967927476 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f0d5c0cf4b0 con 0x7f0d60101c10 2024-09-19T04:47:36.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.497+0000 7f0d65042640 1 --2- 172.21.15.2:0/2967927476 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f0d4c0a32d0 0x7f0d4c0a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0d60075d10 tx=0x7f0d54005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:36.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.501+0000 7f0d52ffd640 1 -- 172.21.15.2:0/2967927476 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0d5c01f020 con 0x7f0d60101c10 2024-09-19T04:47:36.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.698+0000 7f0d67aa7640 1 -- 172.21.15.2:0/2967927476 --> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f0d60062630 con 0x7f0d4c0a32d0 2024-09-19T04:47:36.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.699+0000 7f0d52ffd640 1 -- 172.21.15.2:0/2967927476 <== mgr.14150 v2:172.21.15.2:6800/3171525177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f0d60062630 con 0x7f0d4c0a32d0 2024-09-19T04:47:36.700 INFO:teuthology.orchestra.run.smithi002.stdout:Backend: cephadm 2024-09-19T04:47:36.701 INFO:teuthology.orchestra.run.smithi002.stdout:Available: Yes 2024-09-19T04:47:36.701 INFO:teuthology.orchestra.run.smithi002.stdout:Paused: No 2024-09-19T04:47:36.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.701+0000 7f0d67aa7640 1 -- 172.21.15.2:0/2967927476 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f0d4c0a32d0 msgr2=0x7f0d4c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:36.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.701+0000 7f0d67aa7640 1 --2- 172.21.15.2:0/2967927476 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f0d4c0a32d0 0x7f0d4c0a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0d60075d10 tx=0x7f0d54005d30 comp rx=0 tx=0).stop 2024-09-19T04:47:36.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.701+0000 7f0d67aa7640 1 -- 172.21.15.2:0/2967927476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d60101c10 msgr2=0x7f0d60075f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:36.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.701+0000 7f0d67aa7640 1 --2- 172.21.15.2:0/2967927476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d60101c10 0x7f0d60075f90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c00b450 tx=0x7f0d5c00b910 comp rx=0 tx=0).stop 2024-09-19T04:47:36.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.701+0000 7f0d67aa7640 1 -- 172.21.15.2:0/2967927476 shutdown_connections 2024-09-19T04:47:36.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.701+0000 7f0d67aa7640 1 --2- 172.21.15.2:0/2967927476 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f0d4c0a32d0 0x7f0d4c0a5790 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:36.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.701+0000 7f0d67aa7640 1 --2- 172.21.15.2:0/2967927476 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d601037d0 0x7f0d60074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:36.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.701+0000 7f0d67aa7640 1 --2- 172.21.15.2:0/2967927476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d60102e10 0x7f0d600745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:36.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.701+0000 7f0d67aa7640 1 --2- 172.21.15.2:0/2967927476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d60101c10 0x7f0d60075f90 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:36.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.701+0000 7f0d67aa7640 1 -- 172.21.15.2:0/2967927476 >> 172.21.15.2:0/2967927476 conn(0x7f0d600fd3c0 msgr2=0x7f0d601061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:36.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.701+0000 7f0d67aa7640 1 -- 172.21.15.2:0/2967927476 shutdown_connections 2024-09-19T04:47:36.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:36.701+0000 7f0d67aa7640 1 -- 172.21.15.2:0/2967927476 wait complete. 2024-09-19T04:47:37.021 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:36 smithi002 ceph-mon[30975]: pgmap v310: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T04:47:37.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:36 smithi018 ceph-mon[34537]: pgmap v310: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T04:47:37.326 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-19T04:47:37.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:36 smithi116 ceph-mon[34477]: pgmap v310: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T04:47:37.582 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:47:38.002 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:37 smithi002 ceph-mon[30975]: from='client.15000 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:47:38.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.000+0000 7f57d03bd640 1 -- 172.21.15.2:0/2110826513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57c81037c0 msgr2=0x7f57c810a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:38.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.000+0000 7f57d03bd640 1 --2- 172.21.15.2:0/2110826513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57c81037c0 0x7f57c810a050 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f57c0009ca0 tx=0x7f57c002a8c0 comp rx=0 tx=0).stop 2024-09-19T04:47:38.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.000+0000 7f57d03bd640 1 -- 172.21.15.2:0/2110826513 shutdown_connections 2024-09-19T04:47:38.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.000+0000 7f57d03bd640 1 --2- 172.21.15.2:0/2110826513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57c81037c0 0x7f57c810a050 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:38.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.000+0000 7f57d03bd640 1 --2- 172.21.15.2:0/2110826513 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57c8102e00 0x7f57c8103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:38.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.000+0000 7f57d03bd640 1 --2- 172.21.15.2:0/2110826513 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f57c8101c00 0x7f57c8102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:38.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.000+0000 7f57d03bd640 1 -- 172.21.15.2:0/2110826513 >> 172.21.15.2:0/2110826513 conn(0x7f57c80fd390 msgr2=0x7f57c80ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:38.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.000+0000 7f57d03bd640 1 -- 172.21.15.2:0/2110826513 shutdown_connections 2024-09-19T04:47:38.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.000+0000 7f57d03bd640 1 -- 172.21.15.2:0/2110826513 wait complete. 2024-09-19T04:47:38.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.001+0000 7f57d03bd640 1 Processor -- start 2024-09-19T04:47:38.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.001+0000 7f57d03bd640 1 -- start start 2024-09-19T04:47:38.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.001+0000 7f57d03bd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57c8101c00 0x7f57c8075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:38.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.001+0000 7f57d03bd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f57c8102e00 0x7f57c80745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:38.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.001+0000 7f57d03bd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57c81037c0 0x7f57c8074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:38.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.001+0000 7f57d03bd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f57c810d710 con 0x7f57c81037c0 2024-09-19T04:47:38.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.001+0000 7f57d03bd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f57c810d590 con 0x7f57c8101c00 2024-09-19T04:47:38.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.001+0000 7f57d03bd640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f57c810d890 con 0x7f57c8102e00 2024-09-19T04:47:38.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.001+0000 7f57ce95a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57c81037c0 0x7f57c8074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:38.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.001+0000 7f57ce95a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57c81037c0 0x7f57c8074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55000/0 (socket says 172.21.15.2:55000) 2024-09-19T04:47:38.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.001+0000 7f57ce95a640 1 -- 172.21.15.2:0/4170354951 learned_addr learned my addr 172.21.15.2:0/4170354951 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:47:38.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.002+0000 7f57ce159640 1 --2- 172.21.15.2:0/4170354951 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57c8101c00 0x7f57c8075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:38.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.002+0000 7f57cd958640 1 --2- 172.21.15.2:0/4170354951 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f57c8102e00 0x7f57c80745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:38.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.002+0000 7f57ce95a640 1 -- 172.21.15.2:0/4170354951 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f57c8102e00 msgr2=0x7f57c80745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:38.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.002+0000 7f57ce95a640 1 --2- 172.21.15.2:0/4170354951 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f57c8102e00 0x7f57c80745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:38.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.002+0000 7f57ce95a640 1 -- 172.21.15.2:0/4170354951 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57c8101c00 msgr2=0x7f57c8075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:38.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.002+0000 7f57ce95a640 1 --2- 172.21.15.2:0/4170354951 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57c8101c00 0x7f57c8075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:38.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.002+0000 7f57ce95a640 1 -- 172.21.15.2:0/4170354951 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57c80753e0 con 0x7f57c81037c0 2024-09-19T04:47:38.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.002+0000 7f57ce159640 1 --2- 172.21.15.2:0/4170354951 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57c8101c00 0x7f57c8075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:47:38.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.002+0000 7f57ce95a640 1 --2- 172.21.15.2:0/4170354951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57c81037c0 0x7f57c8074b20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f57c0009dc0 tx=0x7f57c0003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:38.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.002+0000 7f57bf7fe640 1 -- 172.21.15.2:0/4170354951 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c0004040 con 0x7f57c81037c0 2024-09-19T04:47:38.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.002+0000 7f57bf7fe640 1 -- 172.21.15.2:0/4170354951 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f57c0004690 con 0x7f57c81037c0 2024-09-19T04:47:38.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.002+0000 7f57d03bd640 1 -- 172.21.15.2:0/4170354951 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57c81a1e60 con 0x7f57c81037c0 2024-09-19T04:47:38.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.002+0000 7f57bf7fe640 1 -- 172.21.15.2:0/4170354951 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c002f4c0 con 0x7f57c81037c0 2024-09-19T04:47:38.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.002+0000 7f57d03bd640 1 -- 172.21.15.2:0/4170354951 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57c81a2310 con 0x7f57c81037c0 2024-09-19T04:47:38.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.003+0000 7f57d03bd640 1 -- 172.21.15.2:0/4170354951 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57c8109000 con 0x7f57c81037c0 2024-09-19T04:47:38.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.004+0000 7f57bf7fe640 1 -- 172.21.15.2:0/4170354951 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f57c0030650 con 0x7f57c81037c0 2024-09-19T04:47:38.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.005+0000 7f57bf7fe640 1 --2- 172.21.15.2:0/4170354951 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f57b40a32d0 0x7f57b40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:38.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.005+0000 7f57ce159640 1 --2- 172.21.15.2:0/4170354951 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f57b40a32d0 0x7f57b40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:38.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.005+0000 7f57bf7fe640 1 -- 172.21.15.2:0/4170354951 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f57c00f11f0 con 0x7f57c81037c0 2024-09-19T04:47:38.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.006+0000 7f57ce159640 1 --2- 172.21.15.2:0/4170354951 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f57b40a32d0 0x7f57b40a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f57c8102c60 tx=0x7f57c400a5e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:38.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.009+0000 7f57bf7fe640 1 -- 172.21.15.2:0/4170354951 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f57c004d3a0 con 0x7f57c81037c0 2024-09-19T04:47:38.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.192+0000 7f57d03bd640 1 -- 172.21.15.2:0/4170354951 --> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f57c8062630 con 0x7f57b40a32d0 2024-09-19T04:47:38.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.205+0000 7f57bf7fe640 1 -- 172.21.15.2:0/4170354951 <== mgr.14150 v2:172.21.15.2:6800/3171525177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7f57c8062630 con 0x7f57b40a32d0 2024-09-19T04:47:38.206 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T04:47:38.206 INFO:teuthology.orchestra.run.smithi002.stdout:mds.a smithi002 running (87s) 14s ago 87s 14.2M - 19.1.1-361-g2f599a46 d2baa855c067 04ce962f102f 2024-09-19T04:47:38.207 INFO:teuthology.orchestra.run.smithi002.stdout:mds.b smithi018 running (85s) 18s ago 84s 20.3M - 19.1.1-361-g2f599a46 d2baa855c067 06e4de8bb5a9 2024-09-19T04:47:38.207 INFO:teuthology.orchestra.run.smithi002.stdout:mds.c smithi116 running (98s) 18s ago 97s 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 be4217314e29 2024-09-19T04:47:38.207 INFO:teuthology.orchestra.run.smithi002.stdout:mds.d smithi002 running (105s) 14s ago 105s 14.1M - 19.1.1-361-g2f599a46 d2baa855c067 51951dea2f18 2024-09-19T04:47:38.207 INFO:teuthology.orchestra.run.smithi002.stdout:mds.e smithi018 running (102s) 18s ago 102s 16.6M - 19.1.1-361-g2f599a46 d2baa855c067 a3d5df36f065 2024-09-19T04:47:38.207 INFO:teuthology.orchestra.run.smithi002.stdout:mds.f smithi116 running (100s) 18s ago 100s 14.6M - 19.1.1-361-g2f599a46 d2baa855c067 95553dfaf8de 2024-09-19T04:47:38.207 INFO:teuthology.orchestra.run.smithi002.stdout:mds.g smithi002 running (90s) 14s ago 89s 13.4M - 19.1.1-361-g2f599a46 d2baa855c067 c4282b95ee0d 2024-09-19T04:47:38.208 INFO:teuthology.orchestra.run.smithi002.stdout:mds.h smithi018 running (95s) 18s ago 95s 15.6M - 19.1.1-361-g2f599a46 d2baa855c067 1573d33f076b 2024-09-19T04:47:38.208 INFO:teuthology.orchestra.run.smithi002.stdout:mds.i smithi116 running (93s) 18s ago 92s 25.4M - 19.1.1-361-g2f599a46 d2baa855c067 4d19e7a3094d 2024-09-19T04:47:38.208 INFO:teuthology.orchestra.run.smithi002.stdout:mds.j smithi002 running (108s) 14s ago 108s 15.8M - 19.1.1-361-g2f599a46 d2baa855c067 56a3b4f35edd 2024-09-19T04:47:38.208 INFO:teuthology.orchestra.run.smithi002.stdout:mds.k smithi018 running (112s) 18s ago 111s 14.2M - 19.1.1-361-g2f599a46 d2baa855c067 629dab1921dc 2024-09-19T04:47:38.209 INFO:teuthology.orchestra.run.smithi002.stdout:mds.l smithi116 running (114s) 18s ago 114s 14.5M - 19.1.1-361-g2f599a46 d2baa855c067 f8bd7b31c4c7 2024-09-19T04:47:38.209 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.x smithi002 *:9283,8765 running (8m) 14s ago 8m 507M - 19.1.1-361-g2f599a46 d2baa855c067 61e24d87eda4 2024-09-19T04:47:38.209 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.y smithi018 *:8443,8765 running (7m) 18s ago 7m 441M - 19.1.1-361-g2f599a46 d2baa855c067 993e387f95a9 2024-09-19T04:47:38.209 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.z smithi116 *:8443,8765 running (7m) 18s ago 7m 444M - 19.1.1-361-g2f599a46 d2baa855c067 65b2ae446ca7 2024-09-19T04:47:38.209 INFO:teuthology.orchestra.run.smithi002.stdout:mon.a smithi002 running (8m) 14s ago 8m 49.8M 2048M 19.1.1-361-g2f599a46 d2baa855c067 7720d0275239 2024-09-19T04:47:38.209 INFO:teuthology.orchestra.run.smithi002.stdout:mon.b smithi018 running (7m) 18s ago 7m 43.2M 2048M 19.1.1-361-g2f599a46 d2baa855c067 55d975b2834d 2024-09-19T04:47:38.210 INFO:teuthology.orchestra.run.smithi002.stdout:mon.c smithi116 running (7m) 18s ago 7m 39.6M 2048M 19.1.1-361-g2f599a46 d2baa855c067 cbe5b534edd4 2024-09-19T04:47:38.210 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (6m) 14s ago 6m 57.2M 4273M 19.1.1-361-g2f599a46 d2baa855c067 4ef3f458db9e 2024-09-19T04:47:38.210 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi018 running (6m) 18s ago 6m 55.8M 4273M 19.1.1-361-g2f599a46 d2baa855c067 c01fd417e77e 2024-09-19T04:47:38.210 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi116 running (5m) 18s ago 5m 60.3M 4272M 19.1.1-361-g2f599a46 d2baa855c067 1cafa9c8cd93 2024-09-19T04:47:38.210 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi002 running (5m) 14s ago 5m 47.4M 4273M 19.1.1-361-g2f599a46 d2baa855c067 1a12b72f66cf 2024-09-19T04:47:38.211 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi018 running (5m) 18s ago 5m 51.8M 4273M 19.1.1-361-g2f599a46 d2baa855c067 6d8bb99338c0 2024-09-19T04:47:38.211 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi116 running (4m) 18s ago 4m 47.8M 4272M 19.1.1-361-g2f599a46 d2baa855c067 dde79e36a871 2024-09-19T04:47:38.211 INFO:teuthology.orchestra.run.smithi002.stdout:osd.6 smithi002 running (4m) 14s ago 4m 52.2M 4273M 19.1.1-361-g2f599a46 d2baa855c067 2845620210ac 2024-09-19T04:47:38.211 INFO:teuthology.orchestra.run.smithi002.stdout:osd.7 smithi018 running (3m) 18s ago 3m 47.4M 4273M 19.1.1-361-g2f599a46 d2baa855c067 2a48e878b037 2024-09-19T04:47:38.211 INFO:teuthology.orchestra.run.smithi002.stdout:osd.8 smithi116 running (3m) 18s ago 3m 48.3M 4272M 19.1.1-361-g2f599a46 d2baa855c067 b14e24c2fe1a 2024-09-19T04:47:38.211 INFO:teuthology.orchestra.run.smithi002.stdout:osd.9 smithi002 running (3m) 14s ago 3m 52.1M 4273M 19.1.1-361-g2f599a46 d2baa855c067 748e1fc259f6 2024-09-19T04:47:38.212 INFO:teuthology.orchestra.run.smithi002.stdout:osd.10 smithi018 running (2m) 18s ago 2m 56.1M 4273M 19.1.1-361-g2f599a46 d2baa855c067 55aa501e5af6 2024-09-19T04:47:38.212 INFO:teuthology.orchestra.run.smithi002.stdout:osd.11 smithi116 running (2m) 18s ago 2m 50.8M 4272M 19.1.1-361-g2f599a46 d2baa855c067 225f52ce53b7 2024-09-19T04:47:38.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.207+0000 7f57d03bd640 1 -- 172.21.15.2:0/4170354951 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f57b40a32d0 msgr2=0x7f57b40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:38.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.207+0000 7f57d03bd640 1 --2- 172.21.15.2:0/4170354951 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f57b40a32d0 0x7f57b40a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f57c8102c60 tx=0x7f57c400a5e0 comp rx=0 tx=0).stop 2024-09-19T04:47:38.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.207+0000 7f57d03bd640 1 -- 172.21.15.2:0/4170354951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57c81037c0 msgr2=0x7f57c8074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:38.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.207+0000 7f57d03bd640 1 --2- 172.21.15.2:0/4170354951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57c81037c0 0x7f57c8074b20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f57c0009dc0 tx=0x7f57c0003ba0 comp rx=0 tx=0).stop 2024-09-19T04:47:38.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.207+0000 7f57d03bd640 1 -- 172.21.15.2:0/4170354951 shutdown_connections 2024-09-19T04:47:38.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.207+0000 7f57d03bd640 1 --2- 172.21.15.2:0/4170354951 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f57b40a32d0 0x7f57b40a5790 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:38.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.207+0000 7f57d03bd640 1 --2- 172.21.15.2:0/4170354951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57c81037c0 0x7f57c8074b20 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:38.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.207+0000 7f57d03bd640 1 --2- 172.21.15.2:0/4170354951 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f57c8102e00 0x7f57c80745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:38.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.207+0000 7f57d03bd640 1 --2- 172.21.15.2:0/4170354951 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57c8101c00 0x7f57c8075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:38.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.207+0000 7f57d03bd640 1 -- 172.21.15.2:0/4170354951 >> 172.21.15.2:0/4170354951 conn(0x7f57c80fd390 msgr2=0x7f57c81061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:38.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.207+0000 7f57d03bd640 1 -- 172.21.15.2:0/4170354951 shutdown_connections 2024-09-19T04:47:38.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:38.207+0000 7f57d03bd640 1 -- 172.21.15.2:0/4170354951 wait complete. 2024-09-19T04:47:38.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:37 smithi018 ceph-mon[34537]: from='client.15000 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:47:38.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:37 smithi116 ceph-mon[34477]: from='client.15000 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:47:38.910 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-19T04:47:39.169 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:47:39.290 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:38 smithi002 ceph-mon[30975]: pgmap v311: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:47:39.290 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:38 smithi002 ceph-mon[30975]: from='client.15006 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:47:39.306 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:38 smithi018 ceph-mon[34537]: pgmap v311: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:47:39.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:38 smithi018 ceph-mon[34537]: from='client.15006 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:47:39.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:38 smithi116 ceph-mon[34477]: pgmap v311: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:47:39.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:38 smithi116 ceph-mon[34477]: from='client.15006 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:47:39.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.614+0000 7f9c1d740640 1 -- 172.21.15.2:0/628762471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c18101730 msgr2=0x7f9c18101be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:39.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.614+0000 7f9c1d740640 1 --2- 172.21.15.2:0/628762471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c18101730 0x7f9c18101be0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9c10009ca0 tx=0x7f9c1002a8c0 comp rx=0 tx=0).stop 2024-09-19T04:47:39.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.614+0000 7f9c1d740640 1 -- 172.21.15.2:0/628762471 shutdown_connections 2024-09-19T04:47:39.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.614+0000 7f9c1d740640 1 --2- 172.21.15.2:0/628762471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c18101730 0x7f9c18101be0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:39.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.614+0000 7f9c1d740640 1 --2- 172.21.15.2:0/628762471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9c18100d90 0x7f9c181011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:39.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.614+0000 7f9c1d740640 1 --2- 172.21.15.2:0/628762471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c18100450 0x7f9c18100850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:39.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.614+0000 7f9c1d740640 1 -- 172.21.15.2:0/628762471 >> 172.21.15.2:0/628762471 conn(0x7f9c180fc280 msgr2=0x7f9c180fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:39.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.614+0000 7f9c1d740640 1 -- 172.21.15.2:0/628762471 shutdown_connections 2024-09-19T04:47:39.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.614+0000 7f9c1d740640 1 -- 172.21.15.2:0/628762471 wait complete. 2024-09-19T04:47:39.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.615+0000 7f9c1d740640 1 Processor -- start 2024-09-19T04:47:39.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.615+0000 7f9c1d740640 1 -- start start 2024-09-19T04:47:39.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.615+0000 7f9c1d740640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c18100450 0x7f9c18199fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:39.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.615+0000 7f9c1d740640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9c18100d90 0x7f9c1819a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:39.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.615+0000 7f9c1d740640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c18101730 0x7f9c181a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:39.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.615+0000 7f9c1d740640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9c1810f8f0 con 0x7f9c18100450 2024-09-19T04:47:39.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.615+0000 7f9c1d740640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9c1810f770 con 0x7f9c18101730 2024-09-19T04:47:39.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.615+0000 7f9c1d740640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f9c1810fa70 con 0x7f9c18100d90 2024-09-19T04:47:39.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.615+0000 7f9c16ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c18100450 0x7f9c18199fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:39.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.615+0000 7f9c16ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c18100450 0x7f9c18199fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55008/0 (socket says 172.21.15.2:55008) 2024-09-19T04:47:39.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.615+0000 7f9c16ffd640 1 -- 172.21.15.2:0/1723741224 learned_addr learned my addr 172.21.15.2:0/1723741224 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:47:39.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.616+0000 7f9c177fe640 1 --2- 172.21.15.2:0/1723741224 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c18101730 0x7f9c181a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:39.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.616+0000 7f9c167fc640 1 --2- 172.21.15.2:0/1723741224 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9c18100d90 0x7f9c1819a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:39.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.616+0000 7f9c16ffd640 1 -- 172.21.15.2:0/1723741224 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9c18100d90 msgr2=0x7f9c1819a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:39.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.616+0000 7f9c16ffd640 1 --2- 172.21.15.2:0/1723741224 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9c18100d90 0x7f9c1819a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:39.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.616+0000 7f9c16ffd640 1 -- 172.21.15.2:0/1723741224 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c18101730 msgr2=0x7f9c181a1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:39.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.616+0000 7f9c16ffd640 1 --2- 172.21.15.2:0/1723741224 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c18101730 0x7f9c181a1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:39.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.616+0000 7f9c16ffd640 1 -- 172.21.15.2:0/1723741224 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c181a1bd0 con 0x7f9c18100450 2024-09-19T04:47:39.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.616+0000 7f9c167fc640 1 --2- 172.21.15.2:0/1723741224 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9c18100d90 0x7f9c1819a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:47:39.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.616+0000 7f9c16ffd640 1 --2- 172.21.15.2:0/1723741224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c18100450 0x7f9c18199fa0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9c0800d950 tx=0x7f9c0800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:39.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.616+0000 7f9bfffff640 1 -- 172.21.15.2:0/1723741224 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c08017070 con 0x7f9c18100450 2024-09-19T04:47:39.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.616+0000 7f9bfffff640 1 -- 172.21.15.2:0/1723741224 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9c08009c30 con 0x7f9c18100450 2024-09-19T04:47:39.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.616+0000 7f9c1d740640 1 -- 172.21.15.2:0/1723741224 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c181a1ec0 con 0x7f9c18100450 2024-09-19T04:47:39.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.616+0000 7f9bfffff640 1 -- 172.21.15.2:0/1723741224 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c0800f620 con 0x7f9c18100450 2024-09-19T04:47:39.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.616+0000 7f9c1d740640 1 -- 172.21.15.2:0/1723741224 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c181a2320 con 0x7f9c18100450 2024-09-19T04:47:39.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.617+0000 7f9c1d740640 1 -- 172.21.15.2:0/1723741224 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c1810b1a0 con 0x7f9c18100450 2024-09-19T04:47:39.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.618+0000 7f9bfffff640 1 -- 172.21.15.2:0/1723741224 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f9c080109a0 con 0x7f9c18100450 2024-09-19T04:47:39.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.619+0000 7f9bfffff640 1 --2- 172.21.15.2:0/1723741224 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f9c000a3380 0x7f9c000a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:39.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.619+0000 7f9c167fc640 1 --2- 172.21.15.2:0/1723741224 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f9c000a3380 0x7f9c000a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:39.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.619+0000 7f9bfffff640 1 -- 172.21.15.2:0/1723741224 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f9c080cf620 con 0x7f9c18100450 2024-09-19T04:47:39.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.620+0000 7f9c167fc640 1 --2- 172.21.15.2:0/1723741224 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f9c000a3380 0x7f9c000a5840 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c0058c0 tx=0x7f9c0c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:39.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.623+0000 7f9bfffff640 1 -- 172.21.15.2:0/1723741224 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9c0809c1b0 con 0x7f9c18100450 2024-09-19T04:47:39.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.806+0000 7f9c1d740640 1 -- 172.21.15.2:0/1723741224 --> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f9c18062630 con 0x7f9c000a3380 2024-09-19T04:47:39.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.812+0000 7f9bfffff640 1 -- 172.21.15.2:0/1723741224 <== mgr.14150 v2:172.21.15.2:6800/3171525177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+985 (secure 0 0 0) 0x7f9c18062630 con 0x7f9c000a3380 2024-09-19T04:47:39.813 INFO:teuthology.orchestra.run.smithi002.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-19T04:47:39.814 INFO:teuthology.orchestra.run.smithi002.stdout:mds.all 12/12 20s ago 118s smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi018=b;smithi018=e;smithi018=h;smithi018=k;smithi116=c;smithi116=f;smithi116=i;smithi116=l;count:12 2024-09-19T04:47:39.814 INFO:teuthology.orchestra.run.smithi002.stdout:mgr 3/3 20s ago 7m smithi002=x;smithi018=y;smithi116=z;count:3 2024-09-19T04:47:39.814 INFO:teuthology.orchestra.run.smithi002.stdout:mon 3/3 20s ago 7m smithi002:172.21.15.2=a;smithi018:172.21.15.18=b;smithi116:172.21.15.116=c;count:3 2024-09-19T04:47:39.814 INFO:teuthology.orchestra.run.smithi002.stdout:osd 12 20s ago - 2024-09-19T04:47:39.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.814+0000 7f9c1d740640 1 -- 172.21.15.2:0/1723741224 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f9c000a3380 msgr2=0x7f9c000a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:39.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.814+0000 7f9c1d740640 1 --2- 172.21.15.2:0/1723741224 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f9c000a3380 0x7f9c000a5840 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c0058c0 tx=0x7f9c0c005850 comp rx=0 tx=0).stop 2024-09-19T04:47:39.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.814+0000 7f9c1d740640 1 -- 172.21.15.2:0/1723741224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c18100450 msgr2=0x7f9c18199fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:39.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.814+0000 7f9c1d740640 1 --2- 172.21.15.2:0/1723741224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c18100450 0x7f9c18199fa0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9c0800d950 tx=0x7f9c0800de10 comp rx=0 tx=0).stop 2024-09-19T04:47:39.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.814+0000 7f9c1d740640 1 -- 172.21.15.2:0/1723741224 shutdown_connections 2024-09-19T04:47:39.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.814+0000 7f9c1d740640 1 --2- 172.21.15.2:0/1723741224 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f9c000a3380 0x7f9c000a5840 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:39.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.814+0000 7f9c1d740640 1 --2- 172.21.15.2:0/1723741224 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c18101730 0x7f9c181a1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:39.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.814+0000 7f9c1d740640 1 --2- 172.21.15.2:0/1723741224 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9c18100d90 0x7f9c1819a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:39.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.814+0000 7f9c1d740640 1 --2- 172.21.15.2:0/1723741224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c18100450 0x7f9c18199fa0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:39.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.814+0000 7f9c1d740640 1 -- 172.21.15.2:0/1723741224 >> 172.21.15.2:0/1723741224 conn(0x7f9c180fc280 msgr2=0x7f9c180fdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:39.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.814+0000 7f9c1d740640 1 -- 172.21.15.2:0/1723741224 shutdown_connections 2024-09-19T04:47:39.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:39.814+0000 7f9c1d740640 1 -- 172.21.15.2:0/1723741224 wait complete. 2024-09-19T04:47:40.423 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-19T04:47:40.679 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:47:41.065 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:40 smithi002 ceph-mon[30975]: pgmap v312: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T04:47:41.065 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:40 smithi002 ceph-mon[30975]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:47:41.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.146+0000 7fe5c58f9640 1 -- 172.21.15.2:0/2670777392 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5c0105030 msgr2=0x7fe5c0107420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:41.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.146+0000 7fe5c58f9640 1 --2- 172.21.15.2:0/2670777392 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5c0105030 0x7fe5c0107420 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4009900 tx=0x7fe5b402a410 comp rx=0 tx=0).stop 2024-09-19T04:47:41.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.146+0000 7fe5c58f9640 1 -- 172.21.15.2:0/2670777392 shutdown_connections 2024-09-19T04:47:41.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.146+0000 7fe5c58f9640 1 --2- 172.21.15.2:0/2670777392 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5c0107960 0x7fe5c0109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:41.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.146+0000 7fe5c58f9640 1 --2- 172.21.15.2:0/2670777392 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5c0105030 0x7fe5c0107420 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:41.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.146+0000 7fe5c58f9640 1 --2- 172.21.15.2:0/2670777392 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5c0102700 0x7fe5c0104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:41.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.146+0000 7fe5c58f9640 1 -- 172.21.15.2:0/2670777392 >> 172.21.15.2:0/2670777392 conn(0x7fe5c00fc2a0 msgr2=0x7fe5c00fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:41.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.146+0000 7fe5c58f9640 1 -- 172.21.15.2:0/2670777392 shutdown_connections 2024-09-19T04:47:41.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.146+0000 7fe5c58f9640 1 -- 172.21.15.2:0/2670777392 wait complete. 2024-09-19T04:47:41.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.146+0000 7fe5c58f9640 1 Processor -- start 2024-09-19T04:47:41.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.147+0000 7fe5c58f9640 1 -- start start 2024-09-19T04:47:41.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.147+0000 7fe5c58f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5c0102700 0x7fe5c0197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:41.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.147+0000 7fe5c58f9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5c0105030 0x7fe5c0198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:41.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.147+0000 7fe5c58f9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5c0107960 0x7fe5c019f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:41.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.147+0000 7fe5c58f9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c010d720 con 0x7fe5c0102700 2024-09-19T04:47:41.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.147+0000 7fe5c58f9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c010d5a0 con 0x7fe5c0107960 2024-09-19T04:47:41.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.147+0000 7fe5c58f9640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c010d8a0 con 0x7fe5c0105030 2024-09-19T04:47:41.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.147+0000 7fe5beffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5c0102700 0x7fe5c0197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:41.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.147+0000 7fe5beffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5c0102700 0x7fe5c0197e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55026/0 (socket says 172.21.15.2:55026) 2024-09-19T04:47:41.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.147+0000 7fe5beffd640 1 -- 172.21.15.2:0/3230101677 learned_addr learned my addr 172.21.15.2:0/3230101677 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:47:41.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.147+0000 7fe5be7fc640 1 --2- 172.21.15.2:0/3230101677 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5c0105030 0x7fe5c0198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:41.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.147+0000 7fe5bf7fe640 1 --2- 172.21.15.2:0/3230101677 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5c0107960 0x7fe5c019f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:41.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.147+0000 7fe5beffd640 1 -- 172.21.15.2:0/3230101677 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5c0105030 msgr2=0x7fe5c0198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:41.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.147+0000 7fe5beffd640 1 --2- 172.21.15.2:0/3230101677 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5c0105030 0x7fe5c0198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:41.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.147+0000 7fe5beffd640 1 -- 172.21.15.2:0/3230101677 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5c0107960 msgr2=0x7fe5c019f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:41.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.147+0000 7fe5beffd640 1 --2- 172.21.15.2:0/3230101677 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5c0107960 0x7fe5c019f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:41.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.147+0000 7fe5beffd640 1 -- 172.21.15.2:0/3230101677 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5c019fa60 con 0x7fe5c0102700 2024-09-19T04:47:41.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.147+0000 7fe5bf7fe640 1 --2- 172.21.15.2:0/3230101677 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5c0107960 0x7fe5c019f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:47:41.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.148+0000 7fe5beffd640 1 --2- 172.21.15.2:0/3230101677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5c0102700 0x7fe5c0197e30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe5b000d950 tx=0x7fe5b000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:41.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.148+0000 7fe5c48f7640 1 -- 172.21.15.2:0/3230101677 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b0017070 con 0x7fe5c0102700 2024-09-19T04:47:41.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.148+0000 7fe5c48f7640 1 -- 172.21.15.2:0/3230101677 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe5b0009c30 con 0x7fe5c0102700 2024-09-19T04:47:41.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.148+0000 7fe5c58f9640 1 -- 172.21.15.2:0/3230101677 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5c019fd50 con 0x7fe5c0102700 2024-09-19T04:47:41.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.148+0000 7fe5c48f7640 1 -- 172.21.15.2:0/3230101677 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b000f620 con 0x7fe5c0102700 2024-09-19T04:47:41.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.148+0000 7fe5c58f9640 1 -- 172.21.15.2:0/3230101677 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5c01a01f0 con 0x7fe5c0102700 2024-09-19T04:47:41.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.149+0000 7fe5c58f9640 1 -- 172.21.15.2:0/3230101677 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5c00fdd90 con 0x7fe5c0102700 2024-09-19T04:47:41.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.150+0000 7fe5c48f7640 1 -- 172.21.15.2:0/3230101677 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fe5b00109a0 con 0x7fe5c0102700 2024-09-19T04:47:41.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.151+0000 7fe5c48f7640 1 --2- 172.21.15.2:0/3230101677 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe5a80a3380 0x7fe5a80a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:41.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.151+0000 7fe5be7fc640 1 --2- 172.21.15.2:0/3230101677 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe5a80a3380 0x7fe5a80a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:41.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.151+0000 7fe5c48f7640 1 -- 172.21.15.2:0/3230101677 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fe5b00cf670 con 0x7fe5c0102700 2024-09-19T04:47:41.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.151+0000 7fe5be7fc640 1 --2- 172.21.15.2:0/3230101677 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe5a80a3380 0x7fe5a80a5840 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4000c00 tx=0x7fe5b40314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:41.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.155+0000 7fe5c48f7640 1 -- 172.21.15.2:0/3230101677 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe5b009c260 con 0x7fe5c0102700 2024-09-19T04:47:41.306 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:40 smithi018 ceph-mon[34537]: pgmap v312: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T04:47:41.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:40 smithi018 ceph-mon[34537]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:47:41.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.337+0000 7fe5c58f9640 1 -- 172.21.15.2:0/3230101677 --> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fe5c0062630 con 0x7fe5a80a3380 2024-09-19T04:47:41.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.339+0000 7fe5c48f7640 1 -- 172.21.15.2:0/3230101677 <== mgr.14150 v2:172.21.15.2:6800/3171525177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7fe5c0062630 con 0x7fe5a80a3380 2024-09-19T04:47:41.340 INFO:teuthology.orchestra.run.smithi002.stdout:HOST ADDR LABELS STATUS 2024-09-19T04:47:41.340 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002 172.21.15.2 2024-09-19T04:47:41.341 INFO:teuthology.orchestra.run.smithi002.stdout:smithi018 172.21.15.18 2024-09-19T04:47:41.341 INFO:teuthology.orchestra.run.smithi002.stdout:smithi116 172.21.15.116 2024-09-19T04:47:41.341 INFO:teuthology.orchestra.run.smithi002.stdout:3 hosts in cluster 2024-09-19T04:47:41.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.341+0000 7fe5c58f9640 1 -- 172.21.15.2:0/3230101677 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe5a80a3380 msgr2=0x7fe5a80a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:41.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.341+0000 7fe5c58f9640 1 --2- 172.21.15.2:0/3230101677 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe5a80a3380 0x7fe5a80a5840 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4000c00 tx=0x7fe5b40314a0 comp rx=0 tx=0).stop 2024-09-19T04:47:41.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.341+0000 7fe5c58f9640 1 -- 172.21.15.2:0/3230101677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5c0102700 msgr2=0x7fe5c0197e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:41.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.341+0000 7fe5c58f9640 1 --2- 172.21.15.2:0/3230101677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5c0102700 0x7fe5c0197e30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe5b000d950 tx=0x7fe5b000de10 comp rx=0 tx=0).stop 2024-09-19T04:47:41.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.341+0000 7fe5c58f9640 1 -- 172.21.15.2:0/3230101677 shutdown_connections 2024-09-19T04:47:41.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.341+0000 7fe5c58f9640 1 --2- 172.21.15.2:0/3230101677 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe5a80a3380 0x7fe5a80a5840 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:41.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.341+0000 7fe5c58f9640 1 --2- 172.21.15.2:0/3230101677 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5c0107960 0x7fe5c019f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:41.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.341+0000 7fe5c58f9640 1 --2- 172.21.15.2:0/3230101677 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5c0105030 0x7fe5c0198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:41.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.341+0000 7fe5c58f9640 1 --2- 172.21.15.2:0/3230101677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5c0102700 0x7fe5c0197e30 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:41.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.341+0000 7fe5c58f9640 1 -- 172.21.15.2:0/3230101677 >> 172.21.15.2:0/3230101677 conn(0x7fe5c00fc2a0 msgr2=0x7fe5c01030c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:41.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.341+0000 7fe5c58f9640 1 -- 172.21.15.2:0/3230101677 shutdown_connections 2024-09-19T04:47:41.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:41.341+0000 7fe5c58f9640 1 -- 172.21.15.2:0/3230101677 wait complete. 2024-09-19T04:47:41.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:40 smithi116 ceph-mon[34477]: pgmap v312: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T04:47:41.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:40 smithi116 ceph-mon[34477]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:47:41.996 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:41 smithi002 ceph-mon[30975]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:47:41.997 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-19T04:47:42.254 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:47:42.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:41 smithi018 ceph-mon[34537]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:47:42.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:41 smithi116 ceph-mon[34477]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:47:42.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.671+0000 7f6cfe548640 1 -- 172.21.15.2:0/1358078902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cf8102e00 msgr2=0x7f6cf8103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:42.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.671+0000 7f6cfe548640 1 --2- 172.21.15.2:0/1358078902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cf8102e00 0x7f6cf8103280 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6cec009900 tx=0x7f6cec02a410 comp rx=0 tx=0).stop 2024-09-19T04:47:42.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.671+0000 7f6cfe548640 1 -- 172.21.15.2:0/1358078902 shutdown_connections 2024-09-19T04:47:42.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.671+0000 7f6cfe548640 1 --2- 172.21.15.2:0/1358078902 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6cf81037c0 0x7f6cf810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:42.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.671+0000 7f6cfe548640 1 --2- 172.21.15.2:0/1358078902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cf8102e00 0x7f6cf8103280 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:42.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.671+0000 7f6cfe548640 1 --2- 172.21.15.2:0/1358078902 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6cf8101c00 0x7f6cf8102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:42.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.671+0000 7f6cfe548640 1 -- 172.21.15.2:0/1358078902 >> 172.21.15.2:0/1358078902 conn(0x7f6cf80fd390 msgr2=0x7f6cf80ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:42.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.671+0000 7f6cfe548640 1 -- 172.21.15.2:0/1358078902 shutdown_connections 2024-09-19T04:47:42.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.671+0000 7f6cfe548640 1 -- 172.21.15.2:0/1358078902 wait complete. 2024-09-19T04:47:42.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.672+0000 7f6cfe548640 1 Processor -- start 2024-09-19T04:47:42.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.672+0000 7f6cfe548640 1 -- start start 2024-09-19T04:47:42.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.672+0000 7f6cfe548640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6cf8101c00 0x7f6cf8075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:42.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.672+0000 7f6cfe548640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cf8102e00 0x7f6cf80745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:42.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.672+0000 7f6cfe548640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6cf81037c0 0x7f6cf8074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:42.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.672+0000 7f6cfe548640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf810d760 con 0x7f6cf8102e00 2024-09-19T04:47:42.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.672+0000 7f6cfe548640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf810d5e0 con 0x7f6cf81037c0 2024-09-19T04:47:42.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.672+0000 7f6cfe548640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf810d8e0 con 0x7f6cf8101c00 2024-09-19T04:47:42.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.672+0000 7f6cf77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cf8102e00 0x7f6cf80745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:42.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.672+0000 7f6cf77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cf8102e00 0x7f6cf80745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38544/0 (socket says 172.21.15.2:38544) 2024-09-19T04:47:42.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.672+0000 7f6cf77fe640 1 -- 172.21.15.2:0/1309296464 learned_addr learned my addr 172.21.15.2:0/1309296464 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:47:42.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.672+0000 7f6cfcae5640 1 --2- 172.21.15.2:0/1309296464 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6cf81037c0 0x7f6cf8074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:42.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.672+0000 7f6cf7fff640 1 --2- 172.21.15.2:0/1309296464 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6cf8101c00 0x7f6cf8075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:42.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.673+0000 7f6cf77fe640 1 -- 172.21.15.2:0/1309296464 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6cf8101c00 msgr2=0x7f6cf8075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:42.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.673+0000 7f6cf77fe640 1 --2- 172.21.15.2:0/1309296464 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6cf8101c00 0x7f6cf8075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:42.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.673+0000 7f6cf77fe640 1 -- 172.21.15.2:0/1309296464 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6cf81037c0 msgr2=0x7f6cf8074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:42.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.673+0000 7f6cf77fe640 1 --2- 172.21.15.2:0/1309296464 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6cf81037c0 0x7f6cf8074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:42.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.673+0000 7f6cf77fe640 1 -- 172.21.15.2:0/1309296464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cf80753e0 con 0x7f6cf8102e00 2024-09-19T04:47:42.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.673+0000 7f6cf7fff640 1 --2- 172.21.15.2:0/1309296464 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6cf8101c00 0x7f6cf8075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:47:42.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.673+0000 7f6cf77fe640 1 --2- 172.21.15.2:0/1309296464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cf8102e00 0x7f6cf80745e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6cec0314e0 tx=0x7f6cec003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:42.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.673+0000 7f6cf57fa640 1 -- 172.21.15.2:0/1309296464 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cec03f070 con 0x7f6cf8102e00 2024-09-19T04:47:42.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.673+0000 7f6cfe548640 1 -- 172.21.15.2:0/1309296464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cf81a1ee0 con 0x7f6cf8102e00 2024-09-19T04:47:42.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.673+0000 7f6cf57fa640 1 -- 172.21.15.2:0/1309296464 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6cec031e40 con 0x7f6cf8102e00 2024-09-19T04:47:42.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.673+0000 7f6cf57fa640 1 -- 172.21.15.2:0/1309296464 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cec035030 con 0x7f6cf8102e00 2024-09-19T04:47:42.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.673+0000 7f6cfe548640 1 -- 172.21.15.2:0/1309296464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cf81a2330 con 0x7f6cf8102e00 2024-09-19T04:47:42.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.674+0000 7f6cfe548640 1 -- 172.21.15.2:0/1309296464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cf8109000 con 0x7f6cf8102e00 2024-09-19T04:47:42.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.675+0000 7f6cf57fa640 1 -- 172.21.15.2:0/1309296464 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f6cec042070 con 0x7f6cf8102e00 2024-09-19T04:47:42.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.676+0000 7f6cf57fa640 1 --2- 172.21.15.2:0/1309296464 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f6ce00a32d0 0x7f6ce00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:42.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.676+0000 7f6cf7fff640 1 --2- 172.21.15.2:0/1309296464 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f6ce00a32d0 0x7f6ce00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:42.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.676+0000 7f6cf57fa640 1 -- 172.21.15.2:0/1309296464 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f6cec0f0490 con 0x7f6cf8102e00 2024-09-19T04:47:42.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.676+0000 7f6cf7fff640 1 --2- 172.21.15.2:0/1309296464 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f6ce00a32d0 0x7f6ce00a5790 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8102c60 tx=0x7f6ce800a5e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:42.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.680+0000 7f6cf57fa640 1 -- 172.21.15.2:0/1309296464 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6cec0bd080 con 0x7f6cf8102e00 2024-09-19T04:47:42.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.861+0000 7f6cfe548640 1 -- 172.21.15.2:0/1309296464 --> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f6cf8062630 con 0x7f6ce00a32d0 2024-09-19T04:47:42.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.862+0000 7f6cf57fa640 1 -- 172.21.15.2:0/1309296464 <== mgr.14150 v2:172.21.15.2:6800/3171525177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f6cf8062630 con 0x7f6ce00a32d0 2024-09-19T04:47:42.864 INFO:teuthology.orchestra.run.smithi002.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-19T04:47:42.864 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB751300EV480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-19T04:47:42.864 INFO:teuthology.orchestra.run.smithi002.stdout:smithi018 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB75120091480DGN 447G No 2m ago Has a FileSystem, LVM detected 2024-09-19T04:47:42.864 INFO:teuthology.orchestra.run.smithi002.stdout:smithi116 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400VJ400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-19T04:47:42.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.864+0000 7f6cfe548640 1 -- 172.21.15.2:0/1309296464 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f6ce00a32d0 msgr2=0x7f6ce00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:42.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.864+0000 7f6cfe548640 1 --2- 172.21.15.2:0/1309296464 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f6ce00a32d0 0x7f6ce00a5790 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8102c60 tx=0x7f6ce800a5e0 comp rx=0 tx=0).stop 2024-09-19T04:47:42.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.864+0000 7f6cfe548640 1 -- 172.21.15.2:0/1309296464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cf8102e00 msgr2=0x7f6cf80745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:42.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.864+0000 7f6cfe548640 1 --2- 172.21.15.2:0/1309296464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cf8102e00 0x7f6cf80745e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6cec0314e0 tx=0x7f6cec003d50 comp rx=0 tx=0).stop 2024-09-19T04:47:42.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.865+0000 7f6cfe548640 1 -- 172.21.15.2:0/1309296464 shutdown_connections 2024-09-19T04:47:42.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.865+0000 7f6cfe548640 1 --2- 172.21.15.2:0/1309296464 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f6ce00a32d0 0x7f6ce00a5790 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:42.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.865+0000 7f6cfe548640 1 --2- 172.21.15.2:0/1309296464 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6cf81037c0 0x7f6cf8074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:42.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.865+0000 7f6cfe548640 1 --2- 172.21.15.2:0/1309296464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cf8102e00 0x7f6cf80745e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:42.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.865+0000 7f6cfe548640 1 --2- 172.21.15.2:0/1309296464 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6cf8101c00 0x7f6cf8075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:42.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.865+0000 7f6cfe548640 1 -- 172.21.15.2:0/1309296464 >> 172.21.15.2:0/1309296464 conn(0x7f6cf80fd390 msgr2=0x7f6cf81061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:42.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.865+0000 7f6cfe548640 1 -- 172.21.15.2:0/1309296464 shutdown_connections 2024-09-19T04:47:42.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:42.865+0000 7f6cfe548640 1 -- 172.21.15.2:0/1309296464 wait complete. 2024-09-19T04:47:43.217 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:42 smithi002 ceph-mon[30975]: pgmap v313: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:47:43.262 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:42 smithi116 ceph-mon[34477]: pgmap v313: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:47:43.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:42 smithi018 ceph-mon[34537]: pgmap v313: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:47:43.522 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T04:47:43.532 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-19T04:47:43.532 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-19T04:47:43.787 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:47:44.170 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:43 smithi002 ceph-mon[30975]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:47:44.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.253+0000 7f8158cc4640 1 -- 172.21.15.2:0/3944063156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81541026d0 msgr2=0x7f8154108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:44.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.253+0000 7f8158cc4640 1 --2- 172.21.15.2:0/3944063156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81541026d0 0x7f8154108f60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f814c009ca0 tx=0x7f814c02a8c0 comp rx=0 tx=0).stop 2024-09-19T04:47:44.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.253+0000 7f8158cc4640 1 -- 172.21.15.2:0/3944063156 shutdown_connections 2024-09-19T04:47:44.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.253+0000 7f8158cc4640 1 --2- 172.21.15.2:0/3944063156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81541026d0 0x7f8154108f60 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:44.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.253+0000 7f8158cc4640 1 --2- 172.21.15.2:0/3944063156 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8154101d10 0x7f8154102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:44.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.253+0000 7f8158cc4640 1 --2- 172.21.15.2:0/3944063156 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8154100b10 0x7f8154100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:44.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.253+0000 7f8158cc4640 1 -- 172.21.15.2:0/3944063156 >> 172.21.15.2:0/3944063156 conn(0x7f81540fc2a0 msgr2=0x7f81540fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:44.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.253+0000 7f8158cc4640 1 -- 172.21.15.2:0/3944063156 shutdown_connections 2024-09-19T04:47:44.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.253+0000 7f8158cc4640 1 -- 172.21.15.2:0/3944063156 wait complete. 2024-09-19T04:47:44.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.254+0000 7f8158cc4640 1 Processor -- start 2024-09-19T04:47:44.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.254+0000 7f8158cc4640 1 -- start start 2024-09-19T04:47:44.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.254+0000 7f8158cc4640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8154100b10 0x7f815406b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:44.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.254+0000 7f8158cc4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8154101d10 0x7f815419eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:44.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.254+0000 7f8158cc4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81541026d0 0x7f81541a1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:44.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.254+0000 7f8158cc4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f815410c710 con 0x7f81541026d0 2024-09-19T04:47:44.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.254+0000 7f8158cc4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f815410c590 con 0x7f8154101d10 2024-09-19T04:47:44.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.254+0000 7f8158cc4640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f815410c890 con 0x7f8154100b10 2024-09-19T04:47:44.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.254+0000 7f8152d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81541026d0 0x7f81541a1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:44.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.254+0000 7f8152d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81541026d0 0x7f81541a1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38558/0 (socket says 172.21.15.2:38558) 2024-09-19T04:47:44.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.254+0000 7f8152d9d640 1 -- 172.21.15.2:0/4167840137 learned_addr learned my addr 172.21.15.2:0/4167840137 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:47:44.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.254+0000 7f815259c640 1 --2- 172.21.15.2:0/4167840137 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8154100b10 0x7f815406b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:44.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.254+0000 7f814bfff640 1 --2- 172.21.15.2:0/4167840137 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8154101d10 0x7f815419eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:44.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.254+0000 7f8152d9d640 1 -- 172.21.15.2:0/4167840137 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8154100b10 msgr2=0x7f815406b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:44.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.254+0000 7f8152d9d640 1 --2- 172.21.15.2:0/4167840137 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8154100b10 0x7f815406b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:44.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.254+0000 7f8152d9d640 1 -- 172.21.15.2:0/4167840137 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8154101d10 msgr2=0x7f815419eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:44.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.254+0000 7f8152d9d640 1 --2- 172.21.15.2:0/4167840137 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8154101d10 0x7f815419eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:44.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.254+0000 7f8152d9d640 1 -- 172.21.15.2:0/4167840137 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81541a1d30 con 0x7f81541026d0 2024-09-19T04:47:44.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.254+0000 7f815259c640 1 --2- 172.21.15.2:0/4167840137 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8154100b10 0x7f815406b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:47:44.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.255+0000 7f8152d9d640 1 --2- 172.21.15.2:0/4167840137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81541026d0 0x7f81541a1540 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f814c031040 tx=0x7f814c003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:44.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.255+0000 7f814b7fe640 1 -- 172.21.15.2:0/4167840137 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f814c032ec0 con 0x7f81541026d0 2024-09-19T04:47:44.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.255+0000 7f814b7fe640 1 -- 172.21.15.2:0/4167840137 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f814c0044f0 con 0x7f81541026d0 2024-09-19T04:47:44.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.255+0000 7f8158cc4640 1 -- 172.21.15.2:0/4167840137 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81541a1f60 con 0x7f81541026d0 2024-09-19T04:47:44.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.255+0000 7f814b7fe640 1 -- 172.21.15.2:0/4167840137 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f814c030d10 con 0x7f81541026d0 2024-09-19T04:47:44.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.255+0000 7f8158cc4640 1 -- 172.21.15.2:0/4167840137 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81541a2470 con 0x7f81541026d0 2024-09-19T04:47:44.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.256+0000 7f8158cc4640 1 -- 172.21.15.2:0/4167840137 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8154107f60 con 0x7f81541026d0 2024-09-19T04:47:44.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.257+0000 7f814b7fe640 1 -- 172.21.15.2:0/4167840137 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f814c004040 con 0x7f81541026d0 2024-09-19T04:47:44.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.258+0000 7f814b7fe640 1 --2- 172.21.15.2:0/4167840137 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f81400a34a0 0x7f81400a5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:44.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.258+0000 7f815259c640 1 --2- 172.21.15.2:0/4167840137 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f81400a34a0 0x7f81400a5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:44.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.258+0000 7f814b7fe640 1 -- 172.21.15.2:0/4167840137 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f814c0f1070 con 0x7f81541026d0 2024-09-19T04:47:44.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.259+0000 7f815259c640 1 --2- 172.21.15.2:0/4167840137 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f81400a34a0 0x7f81400a5960 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8154101b70 tx=0x7f8144008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:44.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.262+0000 7f814b7fe640 1 -- 172.21.15.2:0/4167840137 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f814c0bdd70 con 0x7f81541026d0 2024-09-19T04:47:44.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:43 smithi018 ceph-mon[34537]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:47:44.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:43 smithi116 ceph-mon[34477]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:47:44.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.475+0000 7f8158cc4640 1 -- 172.21.15.2:0/4167840137 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f815402d7c0 con 0x7f81541026d0 2024-09-19T04:47:44.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.475+0000 7f814b7fe640 1 -- 172.21.15.2:0/4167840137 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) ==== 76+0+3040 (secure 0 0 0) 0x7f814c039e10 con 0x7f81541026d0 2024-09-19T04:47:44.699 INFO:teuthology.orchestra.run.smithi002.stdout:e19 2024-09-19T04:47:44.699 INFO:teuthology.orchestra.run.smithi002.stdout:btime 2024-09-19T04:46:33:537239+0000 2024-09-19T04:47:44.699 INFO:teuthology.orchestra.run.smithi002.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T04:47:44.699 INFO:teuthology.orchestra.run.smithi002.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T04:47:44.699 INFO:teuthology.orchestra.run.smithi002.stdout:legacy client fscid: 1 2024-09-19T04:47:44.699 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:47:44.699 INFO:teuthology.orchestra.run.smithi002.stdout:Filesystem 'cephfs' (1) 2024-09-19T04:47:44.699 INFO:teuthology.orchestra.run.smithi002.stdout:fs_name cephfs 2024-09-19T04:47:44.699 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 19 2024-09-19T04:47:44.699 INFO:teuthology.orchestra.run.smithi002.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T04:47:44.700 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-09-19T04:46:24.050115+0000 2024-09-19T04:47:44.700 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2024-09-19T04:46:33.112369+0000 2024-09-19T04:47:44.700 INFO:teuthology.orchestra.run.smithi002.stdout:tableserver 0 2024-09-19T04:47:44.700 INFO:teuthology.orchestra.run.smithi002.stdout:root 0 2024-09-19T04:47:44.700 INFO:teuthology.orchestra.run.smithi002.stdout:session_timeout 300 2024-09-19T04:47:44.700 INFO:teuthology.orchestra.run.smithi002.stdout:session_autoclose 300 2024-09-19T04:47:44.700 INFO:teuthology.orchestra.run.smithi002.stdout:max_file_size 1099511627776 2024-09-19T04:47:44.700 INFO:teuthology.orchestra.run.smithi002.stdout:max_xattr_size 65536 2024-09-19T04:47:44.700 INFO:teuthology.orchestra.run.smithi002.stdout:required_client_features {} 2024-09-19T04:47:44.700 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure 0 2024-09-19T04:47:44.700 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure_osd_epoch 0 2024-09-19T04:47:44.700 INFO:teuthology.orchestra.run.smithi002.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T04:47:44.700 INFO:teuthology.orchestra.run.smithi002.stdout:max_mds 1 2024-09-19T04:47:44.701 INFO:teuthology.orchestra.run.smithi002.stdout:in 0 2024-09-19T04:47:44.701 INFO:teuthology.orchestra.run.smithi002.stdout:up {0=24496} 2024-09-19T04:47:44.701 INFO:teuthology.orchestra.run.smithi002.stdout:failed 2024-09-19T04:47:44.701 INFO:teuthology.orchestra.run.smithi002.stdout:damaged 2024-09-19T04:47:44.701 INFO:teuthology.orchestra.run.smithi002.stdout:stopped 2024-09-19T04:47:44.701 INFO:teuthology.orchestra.run.smithi002.stdout:data_pools [3] 2024-09-19T04:47:44.701 INFO:teuthology.orchestra.run.smithi002.stdout:metadata_pool 2 2024-09-19T04:47:44.701 INFO:teuthology.orchestra.run.smithi002.stdout:inline_data disabled 2024-09-19T04:47:44.701 INFO:teuthology.orchestra.run.smithi002.stdout:balancer 2024-09-19T04:47:44.701 INFO:teuthology.orchestra.run.smithi002.stdout:bal_rank_mask -1 2024-09-19T04:47:44.701 INFO:teuthology.orchestra.run.smithi002.stdout:standby_count_wanted 0 2024-09-19T04:47:44.701 INFO:teuthology.orchestra.run.smithi002.stdout:qdb_cluster leader: 24496 members: 24496 2024-09-19T04:47:44.701 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.i{0:24496} state up:active seq 6 addr [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T04:47:44.702 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.b{0:24491} state up:standby-replay seq 1 addr [v2:172.21.15.18:6838/4207677139,v1:172.21.15.18:6839/4207677139] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T04:47:44.702 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:47:44.702 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:47:44.702 INFO:teuthology.orchestra.run.smithi002.stdout:Standby daemons: 2024-09-19T04:47:44.702 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:47:44.702 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.j{-1:14565} state up:standby seq 1 addr [v2:172.21.15.2:6834/2467365137,v1:172.21.15.2:6835/2467365137] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T04:47:44.702 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.d{-1:14577} state up:standby seq 1 addr [v2:172.21.15.2:6836/3162441888,v1:172.21.15.2:6837/3162441888] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T04:47:44.702 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.g{-1:14631} state up:standby seq 1 addr [v2:172.21.15.2:6838/2740862966,v1:172.21.15.2:6839/2740862966] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T04:47:44.702 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.a{-1:14637} state up:standby seq 1 addr [v2:172.21.15.2:6840/2394435504,v1:172.21.15.2:6841/2394435504] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T04:47:44.702 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.k{-1:24413} state up:standby seq 1 addr [v2:172.21.15.18:6832/1630480244,v1:172.21.15.18:6833/1630480244] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T04:47:44.702 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.l{-1:24442} state up:standby seq 1 addr [v2:172.21.15.116:6832/1553897465,v1:172.21.15.116:6833/1553897465] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T04:47:44.702 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.e{-1:24443} state up:standby seq 1 addr [v2:172.21.15.18:6834/3035664608,v1:172.21.15.18:6835/3035664608] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T04:47:44.702 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.h{-1:24461} state up:standby seq 1 addr [v2:172.21.15.18:6836/1096622392,v1:172.21.15.18:6837/1096622392] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T04:47:44.702 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.f{-1:24469} state up:standby seq 1 addr [v2:172.21.15.116:6834/3761157675,v1:172.21.15.116:6835/3761157675] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T04:47:44.703 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.c{-1:24481} state up:standby seq 1 addr [v2:172.21.15.116:6836/1120131594,v1:172.21.15.116:6837/1120131594] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T04:47:44.703 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 19 2024-09-19T04:47:44.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.479+0000 7f8158cc4640 1 -- 172.21.15.2:0/4167840137 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f81400a34a0 msgr2=0x7f81400a5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:44.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.479+0000 7f8158cc4640 1 --2- 172.21.15.2:0/4167840137 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f81400a34a0 0x7f81400a5960 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8154101b70 tx=0x7f8144008040 comp rx=0 tx=0).stop 2024-09-19T04:47:44.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.479+0000 7f8158cc4640 1 -- 172.21.15.2:0/4167840137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81541026d0 msgr2=0x7f81541a1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:44.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.479+0000 7f8158cc4640 1 --2- 172.21.15.2:0/4167840137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81541026d0 0x7f81541a1540 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f814c031040 tx=0x7f814c003ba0 comp rx=0 tx=0).stop 2024-09-19T04:47:44.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.479+0000 7f8158cc4640 1 -- 172.21.15.2:0/4167840137 shutdown_connections 2024-09-19T04:47:44.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.479+0000 7f8158cc4640 1 --2- 172.21.15.2:0/4167840137 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f81400a34a0 0x7f81400a5960 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:44.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.479+0000 7f8158cc4640 1 --2- 172.21.15.2:0/4167840137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81541026d0 0x7f81541a1540 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:44.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.479+0000 7f8158cc4640 1 --2- 172.21.15.2:0/4167840137 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8154101d10 0x7f815419eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:44.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.479+0000 7f8158cc4640 1 --2- 172.21.15.2:0/4167840137 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8154100b10 0x7f815406b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:44.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.479+0000 7f8158cc4640 1 -- 172.21.15.2:0/4167840137 >> 172.21.15.2:0/4167840137 conn(0x7f81540fc2a0 msgr2=0x7f8154105130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:44.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.479+0000 7f8158cc4640 1 -- 172.21.15.2:0/4167840137 shutdown_connections 2024-09-19T04:47:44.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:44.479+0000 7f8158cc4640 1 -- 172.21.15.2:0/4167840137 wait complete. 2024-09-19T04:47:45.078 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-19T04:47:45.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:44 smithi018 ceph-mon[34537]: pgmap v314: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:47:45.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:44 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/4167840137' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T04:47:45.335 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:47:45.359 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:44 smithi002 ceph-mon[30975]: pgmap v314: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:47:45.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:44 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/4167840137' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T04:47:45.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:44 smithi116 ceph-mon[34477]: pgmap v314: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:47:45.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:44 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/4167840137' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T04:47:45.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.785+0000 7fd63e651640 1 -- 172.21.15.2:0/1471576005 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd638100b10 msgr2=0x7fd638100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:45.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.785+0000 7fd63e651640 1 --2- 172.21.15.2:0/1471576005 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd638100b10 0x7fd638100f10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd628009900 tx=0x7fd62802a410 comp rx=0 tx=0).stop 2024-09-19T04:47:45.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.786+0000 7fd63e651640 1 -- 172.21.15.2:0/1471576005 shutdown_connections 2024-09-19T04:47:45.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.786+0000 7fd63e651640 1 --2- 172.21.15.2:0/1471576005 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6381026d0 0x7fd638108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:45.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.786+0000 7fd63e651640 1 --2- 172.21.15.2:0/1471576005 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd638101d10 0x7fd638102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:45.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.786+0000 7fd63e651640 1 --2- 172.21.15.2:0/1471576005 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd638100b10 0x7fd638100f10 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:45.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.786+0000 7fd63e651640 1 -- 172.21.15.2:0/1471576005 >> 172.21.15.2:0/1471576005 conn(0x7fd6380fc2a0 msgr2=0x7fd6380fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:45.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.786+0000 7fd63e651640 1 -- 172.21.15.2:0/1471576005 shutdown_connections 2024-09-19T04:47:45.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.786+0000 7fd63e651640 1 -- 172.21.15.2:0/1471576005 wait complete. 2024-09-19T04:47:45.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.786+0000 7fd63e651640 1 Processor -- start 2024-09-19T04:47:45.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.786+0000 7fd63e651640 1 -- start start 2024-09-19T04:47:45.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.786+0000 7fd63e651640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd638100b10 0x7fd638196eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:45.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.786+0000 7fd63e651640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd638101d10 0x7fd6381973f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:45.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.786+0000 7fd63e651640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6381026d0 0x7fd63819e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:45.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.787+0000 7fd63e651640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd63810c720 con 0x7fd638101d10 2024-09-19T04:47:45.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.787+0000 7fd63e651640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd63810c5a0 con 0x7fd6381026d0 2024-09-19T04:47:45.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.787+0000 7fd63e651640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fd63810c8a0 con 0x7fd638100b10 2024-09-19T04:47:45.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.787+0000 7fd6377fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd638101d10 0x7fd6381973f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:45.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.787+0000 7fd6377fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd638101d10 0x7fd6381973f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38576/0 (socket says 172.21.15.2:38576) 2024-09-19T04:47:45.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.787+0000 7fd6377fe640 1 -- 172.21.15.2:0/1748116799 learned_addr learned my addr 172.21.15.2:0/1748116799 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:47:45.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.787+0000 7fd63cbee640 1 --2- 172.21.15.2:0/1748116799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6381026d0 0x7fd63819e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:45.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.787+0000 7fd637fff640 1 --2- 172.21.15.2:0/1748116799 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd638100b10 0x7fd638196eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:45.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.787+0000 7fd6377fe640 1 -- 172.21.15.2:0/1748116799 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd638100b10 msgr2=0x7fd638196eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:45.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.787+0000 7fd6377fe640 1 --2- 172.21.15.2:0/1748116799 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd638100b10 0x7fd638196eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:45.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.787+0000 7fd6377fe640 1 -- 172.21.15.2:0/1748116799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6381026d0 msgr2=0x7fd63819e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:45.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.787+0000 7fd6377fe640 1 --2- 172.21.15.2:0/1748116799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6381026d0 0x7fd63819e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:45.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.787+0000 7fd6377fe640 1 -- 172.21.15.2:0/1748116799 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd63819eae0 con 0x7fd638101d10 2024-09-19T04:47:45.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.787+0000 7fd63cbee640 1 --2- 172.21.15.2:0/1748116799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6381026d0 0x7fd63819e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:47:45.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.787+0000 7fd6377fe640 1 --2- 172.21.15.2:0/1748116799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd638101d10 0x7fd6381973f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd62c00b4a0 tx=0x7fd62c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:45.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.787+0000 7fd6357fa640 1 -- 172.21.15.2:0/1748116799 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62c014070 con 0x7fd638101d10 2024-09-19T04:47:45.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.787+0000 7fd63e651640 1 -- 172.21.15.2:0/1748116799 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd63819edd0 con 0x7fd638101d10 2024-09-19T04:47:45.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.787+0000 7fd6357fa640 1 -- 172.21.15.2:0/1748116799 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd62c010ac0 con 0x7fd638101d10 2024-09-19T04:47:45.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.787+0000 7fd6357fa640 1 -- 172.21.15.2:0/1748116799 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62c017c30 con 0x7fd638101d10 2024-09-19T04:47:45.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.787+0000 7fd63e651640 1 -- 172.21.15.2:0/1748116799 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd63819f300 con 0x7fd638101d10 2024-09-19T04:47:45.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.788+0000 7fd63e651640 1 -- 172.21.15.2:0/1748116799 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd638108040 con 0x7fd638101d10 2024-09-19T04:47:45.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.790+0000 7fd6357fa640 1 -- 172.21.15.2:0/1748116799 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fd62c017070 con 0x7fd638101d10 2024-09-19T04:47:45.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.790+0000 7fd6357fa640 1 --2- 172.21.15.2:0/1748116799 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd6200a3380 0x7fd6200a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:45.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.791+0000 7fd637fff640 1 --2- 172.21.15.2:0/1748116799 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd6200a3380 0x7fd6200a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:45.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.791+0000 7fd6357fa640 1 -- 172.21.15.2:0/1748116799 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fd62c0cf0e0 con 0x7fd638101d10 2024-09-19T04:47:45.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.791+0000 7fd637fff640 1 --2- 172.21.15.2:0/1748116799 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd6200a3380 0x7fd6200a5840 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd628000c00 tx=0x7fd6280314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:45.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.794+0000 7fd6357fa640 1 -- 172.21.15.2:0/1748116799 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd62c09bd80 con 0x7fd638101d10 2024-09-19T04:47:45.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.969+0000 7fd63e651640 1 -- 172.21.15.2:0/1748116799 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fd63802d9c0 con 0x7fd638101d10 2024-09-19T04:47:45.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.970+0000 7fd6357fa640 1 -- 172.21.15.2:0/1748116799 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v80) ==== 56+0+5206 (secure 0 0 0) 0x7fd62c09b680 con 0x7fd638101d10 2024-09-19T04:47:45.971 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 80 2024-09-19T04:47:45.972 INFO:teuthology.orchestra.run.smithi002.stdout:fsid d46630c4-7640-11ef-bceb-c7b262605968 2024-09-19T04:47:45.972 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-09-19T04:38:39.698488+0000 2024-09-19T04:47:45.972 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2024-09-19T04:46:36.551838+0000 2024-09-19T04:47:45.972 INFO:teuthology.orchestra.run.smithi002.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-19T04:47:45.972 INFO:teuthology.orchestra.run.smithi002.stdout:crush_version 26 2024-09-19T04:47:45.972 INFO:teuthology.orchestra.run.smithi002.stdout:full_ratio 0.95 2024-09-19T04:47:45.972 INFO:teuthology.orchestra.run.smithi002.stdout:backfillfull_ratio 0.9 2024-09-19T04:47:45.972 INFO:teuthology.orchestra.run.smithi002.stdout:nearfull_ratio 0.85 2024-09-19T04:47:45.972 INFO:teuthology.orchestra.run.smithi002.stdout:require_min_compat_client luminous 2024-09-19T04:47:45.973 INFO:teuthology.orchestra.run.smithi002.stdout:min_compat_client luminous 2024-09-19T04:47:45.973 INFO:teuthology.orchestra.run.smithi002.stdout:require_osd_release squid 2024-09-19T04:47:45.973 INFO:teuthology.orchestra.run.smithi002.stdout:stretch_mode_enabled false 2024-09-19T04:47:45.973 INFO:teuthology.orchestra.run.smithi002.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 20 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-19T04:47:45.973 INFO:teuthology.orchestra.run.smithi002.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 78 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-09-19T04:47:45.973 INFO:teuthology.orchestra.run.smithi002.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 78 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-19T04:47:45.973 INFO:teuthology.orchestra.run.smithi002.stdout:max_osd 12 2024-09-19T04:47:45.974 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 up in weight 1 up_from 8 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.2:6802/611702745,v1:172.21.15.2:6803/611702745] [v2:172.21.15.2:6804/611702745,v1:172.21.15.2:6805/611702745] exists,up 7a7dc9b9-8d5d-4dd3-93a3-0d5efced07d9 2024-09-19T04:47:45.974 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 up in weight 1 up_from 12 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.18:6800/58390709,v1:172.21.15.18:6801/58390709] [v2:172.21.15.18:6802/58390709,v1:172.21.15.18:6803/58390709] exists,up bea40dec-7d9c-497f-bf16-4bf6d3b839f8 2024-09-19T04:47:45.974 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 up in weight 1 up_from 16 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.116:6800/627735759,v1:172.21.15.116:6801/627735759] [v2:172.21.15.116:6802/627735759,v1:172.21.15.116:6803/627735759] exists,up 97716304-a31e-48c9-83de-84eed10a7a4e 2024-09-19T04:47:45.974 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 up in weight 1 up_from 23 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.2:6810/1936071687,v1:172.21.15.2:6811/1936071687] [v2:172.21.15.2:6812/1936071687,v1:172.21.15.2:6813/1936071687] exists,up 8d79514e-16cf-4bd0-a2eb-e9148b91183d 2024-09-19T04:47:45.974 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 up in weight 1 up_from 30 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.18:6808/1333533784,v1:172.21.15.18:6809/1333533784] [v2:172.21.15.18:6810/1333533784,v1:172.21.15.18:6811/1333533784] exists,up 5136f03c-94a3-42a0-9bfc-020397836037 2024-09-19T04:47:45.974 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 up in weight 1 up_from 35 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.116:6808/316360741,v1:172.21.15.116:6809/316360741] [v2:172.21.15.116:6810/316360741,v1:172.21.15.116:6811/316360741] exists,up 9d3384b0-f87d-4513-b151-4cca21c339b3 2024-09-19T04:47:45.974 INFO:teuthology.orchestra.run.smithi002.stdout:osd.6 up in weight 1 up_from 42 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.2:6818/1185564560,v1:172.21.15.2:6819/1185564560] [v2:172.21.15.2:6820/1185564560,v1:172.21.15.2:6821/1185564560] exists,up e54f44b5-a693-4b31-83b2-2bcf10ab9a75 2024-09-19T04:47:45.974 INFO:teuthology.orchestra.run.smithi002.stdout:osd.7 up in weight 1 up_from 47 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.18:6816/3691801363,v1:172.21.15.18:6817/3691801363] [v2:172.21.15.18:6818/3691801363,v1:172.21.15.18:6819/3691801363] exists,up 96a444c3-429a-48b6-9823-95c9e171341a 2024-09-19T04:47:45.974 INFO:teuthology.orchestra.run.smithi002.stdout:osd.8 up in weight 1 up_from 54 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.116:6816/3709586119,v1:172.21.15.116:6817/3709586119] [v2:172.21.15.116:6818/3709586119,v1:172.21.15.116:6819/3709586119] exists,up c3f696aa-be7d-4f67-9147-3751406e394d 2024-09-19T04:47:45.974 INFO:teuthology.orchestra.run.smithi002.stdout:osd.9 up in weight 1 up_from 61 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.2:6826/1054791011,v1:172.21.15.2:6827/1054791011] [v2:172.21.15.2:6828/1054791011,v1:172.21.15.2:6829/1054791011] exists,up 4892549d-f050-48c5-b695-5924b612a581 2024-09-19T04:47:45.974 INFO:teuthology.orchestra.run.smithi002.stdout:osd.10 up in weight 1 up_from 65 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.18:6824/1958683776,v1:172.21.15.18:6825/1958683776] [v2:172.21.15.18:6826/1958683776,v1:172.21.15.18:6827/1958683776] exists,up 12b60238-6a35-4d48-bacd-ee5ddd8fdb0c 2024-09-19T04:47:45.975 INFO:teuthology.orchestra.run.smithi002.stdout:osd.11 up in weight 1 up_from 72 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.116:6824/3456789654,v1:172.21.15.116:6825/3456789654] [v2:172.21.15.116:6826/3456789654,v1:172.21.15.116:6827/3456789654] exists,up 99b3e553-b42c-4b2f-817f-3900ad8bd223 2024-09-19T04:47:45.975 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 2.0 [8,1] 2024-09-19T04:47:45.975 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 2.a [2,11] 2024-09-19T04:47:45.975 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 2.13 [2,11] 2024-09-19T04:47:45.975 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 3.0 [4,8] 2024-09-19T04:47:45.975 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 3.3 [4,9] 2024-09-19T04:47:45.975 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 3.10 [5,9] 2024-09-19T04:47:45.975 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 3.27 [3,9] 2024-09-19T04:47:45.975 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/870383845 expires 2024-09-20T04:39:35.461329+0000 2024-09-19T04:47:45.975 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/2801870985 expires 2024-09-20T04:39:35.461329+0000 2024-09-19T04:47:45.975 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/256825166 expires 2024-09-20T04:39:35.461329+0000 2024-09-19T04:47:45.975 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:6801/3782987318 expires 2024-09-20T04:39:35.461329+0000 2024-09-19T04:47:45.975 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/3064319092 expires 2024-09-20T04:39:11.086431+0000 2024-09-19T04:47:45.976 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/1528097642 expires 2024-09-20T04:39:11.086431+0000 2024-09-19T04:47:45.976 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:6801/1825825090 expires 2024-09-20T04:39:11.086431+0000 2024-09-19T04:47:45.976 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:6800/1825825090 expires 2024-09-20T04:39:11.086431+0000 2024-09-19T04:47:45.976 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:6800/3782987318 expires 2024-09-20T04:39:35.461329+0000 2024-09-19T04:47:45.976 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/2432243496 expires 2024-09-20T04:39:11.086431+0000 2024-09-19T04:47:45.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.972+0000 7fd63e651640 1 -- 172.21.15.2:0/1748116799 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd6200a3380 msgr2=0x7fd6200a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:45.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.972+0000 7fd63e651640 1 --2- 172.21.15.2:0/1748116799 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd6200a3380 0x7fd6200a5840 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd628000c00 tx=0x7fd6280314a0 comp rx=0 tx=0).stop 2024-09-19T04:47:45.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.972+0000 7fd63e651640 1 -- 172.21.15.2:0/1748116799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd638101d10 msgr2=0x7fd6381973f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:45.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.972+0000 7fd63e651640 1 --2- 172.21.15.2:0/1748116799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd638101d10 0x7fd6381973f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd62c00b4a0 tx=0x7fd62c00b960 comp rx=0 tx=0).stop 2024-09-19T04:47:45.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.972+0000 7fd63e651640 1 -- 172.21.15.2:0/1748116799 shutdown_connections 2024-09-19T04:47:45.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.972+0000 7fd63e651640 1 --2- 172.21.15.2:0/1748116799 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fd6200a3380 0x7fd6200a5840 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:45.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.972+0000 7fd63e651640 1 --2- 172.21.15.2:0/1748116799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6381026d0 0x7fd63819e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:45.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.972+0000 7fd63e651640 1 --2- 172.21.15.2:0/1748116799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd638101d10 0x7fd6381973f0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:45.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.972+0000 7fd63e651640 1 --2- 172.21.15.2:0/1748116799 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd638100b10 0x7fd638196eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:45.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.972+0000 7fd63e651640 1 -- 172.21.15.2:0/1748116799 >> 172.21.15.2:0/1748116799 conn(0x7fd6380fc2a0 msgr2=0x7fd638105210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:45.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.972+0000 7fd63e651640 1 -- 172.21.15.2:0/1748116799 shutdown_connections 2024-09-19T04:47:45.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:45.972+0000 7fd63e651640 1 -- 172.21.15.2:0/1748116799 wait complete. 2024-09-19T04:47:46.577 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-19T04:47:46.588 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:47:46.850 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:47:47.207 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:46 smithi002 ceph-mon[30975]: pgmap v315: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T04:47:47.207 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:46 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/1748116799' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T04:47:47.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:46 smithi018 ceph-mon[34537]: pgmap v315: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T04:47:47.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:46 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/1748116799' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T04:47:47.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.284+0000 7f6a21e07640 1 -- 172.21.15.2:0/2092861486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a1c1036e0 msgr2=0x7f6a1c107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:47.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.284+0000 7f6a21e07640 1 --2- 172.21.15.2:0/2092861486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a1c1036e0 0x7f6a1c107b90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6a04009930 tx=0x7f6a0402a420 comp rx=0 tx=0).stop 2024-09-19T04:47:47.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.284+0000 7f6a21e07640 1 -- 172.21.15.2:0/2092861486 shutdown_connections 2024-09-19T04:47:47.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.284+0000 7f6a21e07640 1 --2- 172.21.15.2:0/2092861486 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6a1c1082a0 0x7f6a1c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:47.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.284+0000 7f6a21e07640 1 --2- 172.21.15.2:0/2092861486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a1c1036e0 0x7f6a1c107b90 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:47.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.284+0000 7f6a21e07640 1 --2- 172.21.15.2:0/2092861486 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a1c102d30 0x7f6a1c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:47.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.284+0000 7f6a21e07640 1 -- 172.21.15.2:0/2092861486 >> 172.21.15.2:0/2092861486 conn(0x7f6a1c0fc7d0 msgr2=0x7f6a1c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:47.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.284+0000 7f6a21e07640 1 -- 172.21.15.2:0/2092861486 shutdown_connections 2024-09-19T04:47:47.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.284+0000 7f6a21e07640 1 -- 172.21.15.2:0/2092861486 wait complete. 2024-09-19T04:47:47.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.284+0000 7f6a21e07640 1 Processor -- start 2024-09-19T04:47:47.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.285+0000 7f6a21e07640 1 -- start start 2024-09-19T04:47:47.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.285+0000 7f6a21e07640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6a1c102d30 0x7f6a1c198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:47.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.285+0000 7f6a21e07640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a1c1036e0 0x7f6a1c198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:47.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.285+0000 7f6a21e07640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a1c1082a0 0x7f6a1c19cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:47.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.285+0000 7f6a21e07640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1c111f50 con 0x7f6a1c1036e0 2024-09-19T04:47:47.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.285+0000 7f6a21e07640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1c111dd0 con 0x7f6a1c1082a0 2024-09-19T04:47:47.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.285+0000 7f6a21e07640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1c1120d0 con 0x7f6a1c102d30 2024-09-19T04:47:47.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.285+0000 7f6a1affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a1c1036e0 0x7f6a1c198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:47.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.285+0000 7f6a1affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a1c1036e0 0x7f6a1c198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38592/0 (socket says 172.21.15.2:38592) 2024-09-19T04:47:47.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.285+0000 7f6a1affd640 1 -- 172.21.15.2:0/224468287 learned_addr learned my addr 172.21.15.2:0/224468287 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:47:47.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.285+0000 7f6a1bfff640 1 --2- 172.21.15.2:0/224468287 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a1c1082a0 0x7f6a1c19cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:47.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.285+0000 7f6a1b7fe640 1 --2- 172.21.15.2:0/224468287 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6a1c102d30 0x7f6a1c198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:47.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.285+0000 7f6a1affd640 1 -- 172.21.15.2:0/224468287 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6a1c102d30 msgr2=0x7f6a1c198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:47.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.285+0000 7f6a1affd640 1 --2- 172.21.15.2:0/224468287 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6a1c102d30 0x7f6a1c198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:47.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.285+0000 7f6a1affd640 1 -- 172.21.15.2:0/224468287 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a1c1082a0 msgr2=0x7f6a1c19cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:47.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.285+0000 7f6a1affd640 1 --2- 172.21.15.2:0/224468287 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a1c1082a0 0x7f6a1c19cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:47.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.285+0000 7f6a1affd640 1 -- 172.21.15.2:0/224468287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a1c19d4c0 con 0x7f6a1c1036e0 2024-09-19T04:47:47.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.285+0000 7f6a1bfff640 1 --2- 172.21.15.2:0/224468287 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a1c1082a0 0x7f6a1c19cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:47:47.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.285+0000 7f6a1affd640 1 --2- 172.21.15.2:0/224468287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a1c1036e0 0x7f6a1c198a50 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6a04031440 tx=0x7f6a04004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:47.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.286+0000 7f6a18ff9640 1 -- 172.21.15.2:0/224468287 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a0403f030 con 0x7f6a1c1036e0 2024-09-19T04:47:47.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.286+0000 7f6a21e07640 1 -- 172.21.15.2:0/224468287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a1c19d750 con 0x7f6a1c1036e0 2024-09-19T04:47:47.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.286+0000 7f6a18ff9640 1 -- 172.21.15.2:0/224468287 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6a04003aa0 con 0x7f6a1c1036e0 2024-09-19T04:47:47.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.286+0000 7f6a18ff9640 1 -- 172.21.15.2:0/224468287 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a04035070 con 0x7f6a1c1036e0 2024-09-19T04:47:47.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.286+0000 7f6a21e07640 1 -- 172.21.15.2:0/224468287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a1c1a5090 con 0x7f6a1c1036e0 2024-09-19T04:47:47.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.287+0000 7f6a21e07640 1 -- 172.21.15.2:0/224468287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a1c103110 con 0x7f6a1c1036e0 2024-09-19T04:47:47.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.288+0000 7f6a18ff9640 1 -- 172.21.15.2:0/224468287 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f6a04042030 con 0x7f6a1c1036e0 2024-09-19T04:47:47.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.289+0000 7f6a18ff9640 1 --2- 172.21.15.2:0/224468287 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f6a080a32d0 0x7f6a080a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:47.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.289+0000 7f6a18ff9640 1 -- 172.21.15.2:0/224468287 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f6a040f0600 con 0x7f6a1c1036e0 2024-09-19T04:47:47.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.289+0000 7f6a1b7fe640 1 --2- 172.21.15.2:0/224468287 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f6a080a32d0 0x7f6a080a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:47.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.289+0000 7f6a1b7fe640 1 --2- 172.21.15.2:0/224468287 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f6a080a32d0 0x7f6a080a5790 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c005fd0 tx=0x7f6a0c0098b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:47.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.292+0000 7f6a18ff9640 1 -- 172.21.15.2:0/224468287 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6a040bd1f0 con 0x7f6a1c1036e0 2024-09-19T04:47:47.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:46 smithi116 ceph-mon[34477]: pgmap v315: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T04:47:47.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:46 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/1748116799' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T04:47:47.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.528+0000 7f6a21e07640 1 -- 172.21.15.2:0/224468287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6a1c199870 con 0x7f6a1c1036e0 2024-09-19T04:47:47.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.528+0000 7f6a18ff9640 1 -- 172.21.15.2:0/224468287 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11840 (secure 0 0 0) 0x7f6a1c199870 con 0x7f6a1c1036e0 2024-09-19T04:47:47.530 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:47:47.530 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":19,"btime":"2024-09-19T04:46:33:537239+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2467365137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2467365137},{"type":"v1","addr":"172.21.15.2:6835","nonce":2467365137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3162441888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3162441888},{"type":"v1","addr":"172.21.15.2:6837","nonce":3162441888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14631,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2740862966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2740862966},{"type":"v1","addr":"172.21.15.2:6839","nonce":2740862966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/2394435504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2394435504},{"type":"v1","addr":"172.21.15.2:6841","nonce":2394435504}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1630480244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1630480244},{"type":"v1","addr":"172.21.15.18:6833","nonce":1630480244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1553897465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1553897465},{"type":"v1","addr":"172.21.15.116:6833","nonce":1553897465}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3035664608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3035664608},{"type":"v1","addr":"172.21.15.18:6835","nonce":3035664608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1096622392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1096622392},{"type":"v1","addr":"172.21.15.18:6837","nonce":1096622392}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3761157675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3761157675},{"type":"v1","addr":"172.21.15.116:6835","nonce":3761157675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/1120131594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1120131594},{"type":"v1","addr":"172.21.15.116:6837","nonce":1120131594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:46:24.050115+0000","modified":"2024-09-19T04:46:33.112369+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/4207677139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":4207677139},{"type":"v1","addr":"172.21.15.18:6839","nonce":4207677139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/2346874880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":2346874880},{"type":"v1","addr":"172.21.15.116:6839","nonce":2346874880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496]},"id":1}]} 2024-09-19T04:47:47.531 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 19 2024-09-19T04:47:47.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.531+0000 7f6a21e07640 1 -- 172.21.15.2:0/224468287 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f6a080a32d0 msgr2=0x7f6a080a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:47.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.531+0000 7f6a21e07640 1 --2- 172.21.15.2:0/224468287 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f6a080a32d0 0x7f6a080a5790 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c005fd0 tx=0x7f6a0c0098b0 comp rx=0 tx=0).stop 2024-09-19T04:47:47.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.531+0000 7f6a21e07640 1 -- 172.21.15.2:0/224468287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a1c1036e0 msgr2=0x7f6a1c198a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:47.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.531+0000 7f6a21e07640 1 --2- 172.21.15.2:0/224468287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a1c1036e0 0x7f6a1c198a50 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6a04031440 tx=0x7f6a04004270 comp rx=0 tx=0).stop 2024-09-19T04:47:47.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.531+0000 7f6a21e07640 1 -- 172.21.15.2:0/224468287 shutdown_connections 2024-09-19T04:47:47.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.531+0000 7f6a21e07640 1 --2- 172.21.15.2:0/224468287 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f6a080a32d0 0x7f6a080a5790 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:47.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.531+0000 7f6a21e07640 1 --2- 172.21.15.2:0/224468287 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a1c1082a0 0x7f6a1c19cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:47.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.531+0000 7f6a21e07640 1 --2- 172.21.15.2:0/224468287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a1c1036e0 0x7f6a1c198a50 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:47.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.531+0000 7f6a21e07640 1 --2- 172.21.15.2:0/224468287 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6a1c102d30 0x7f6a1c198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:47.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.531+0000 7f6a21e07640 1 -- 172.21.15.2:0/224468287 >> 172.21.15.2:0/224468287 conn(0x7f6a1c0fc7d0 msgr2=0x7f6a1c105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:47.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.531+0000 7f6a21e07640 1 -- 172.21.15.2:0/224468287 shutdown_connections 2024-09-19T04:47:47.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:47.531+0000 7f6a21e07640 1 -- 172.21.15.2:0/224468287 wait complete. 2024-09-19T04:47:48.141 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:47 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/224468287' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:47:48.170 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:47:48.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:47 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/224468287' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:47:48.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:47 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/224468287' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:47:48.428 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:47:48.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:48.891+0000 7fa7ad058640 1 -- 172.21.15.2:0/2218609010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7a8102d40 msgr2=0x7fa7a8103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:48.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:48.891+0000 7fa7ad058640 1 --2- 172.21.15.2:0/2218609010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7a8102d40 0x7fa7a8103120 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa798009900 tx=0x7fa79802a480 comp rx=0 tx=0).stop 2024-09-19T04:47:48.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:48.891+0000 7fa7ad058640 1 -- 172.21.15.2:0/2218609010 shutdown_connections 2024-09-19T04:47:48.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:48.891+0000 7fa7ad058640 1 --2- 172.21.15.2:0/2218609010 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7a810c170 0x7fa7a810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:48.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:48.891+0000 7fa7ad058640 1 --2- 172.21.15.2:0/2218609010 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7a8103660 0x7fa7a810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:48.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:48.891+0000 7fa7ad058640 1 --2- 172.21.15.2:0/2218609010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7a8102d40 0x7fa7a8103120 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:48.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:48.891+0000 7fa7ad058640 1 -- 172.21.15.2:0/2218609010 >> 172.21.15.2:0/2218609010 conn(0x7fa7a80fc7a0 msgr2=0x7fa7a80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:48.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:48.892+0000 7fa7ad058640 1 -- 172.21.15.2:0/2218609010 shutdown_connections 2024-09-19T04:47:48.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:48.892+0000 7fa7ad058640 1 -- 172.21.15.2:0/2218609010 wait complete. 2024-09-19T04:47:48.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:48.892+0000 7fa7ad058640 1 Processor -- start 2024-09-19T04:47:48.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:48.892+0000 7fa7ad058640 1 -- start start 2024-09-19T04:47:48.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:48.893+0000 7fa7ad058640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7a8102d40 0x7fa7a8198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:48.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:48.893+0000 7fa7ad058640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7a8103660 0x7fa7a8198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:48.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:48.893+0000 7fa7ad058640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7a810c170 0x7fa7a819ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:48.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:48.893+0000 7fa7ad058640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a8111e60 con 0x7fa7a8103660 2024-09-19T04:47:48.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:48.893+0000 7fa7ad058640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a8111ce0 con 0x7fa7a8102d40 2024-09-19T04:47:48.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:48.893+0000 7fa7ad058640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a8111fe0 con 0x7fa7a810c170 2024-09-19T04:47:48.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:48.893+0000 7fa7a659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7a8103660 0x7fa7a8198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:48.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:48.893+0000 7fa7a659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7a8103660 0x7fa7a8198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38624/0 (socket says 172.21.15.2:38624) 2024-09-19T04:47:48.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:48.893+0000 7fa7a659c640 1 -- 172.21.15.2:0/2726875762 learned_addr learned my addr 172.21.15.2:0/2726875762 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:47:48.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:48.893+0000 7fa7a6d9d640 1 --2- 172.21.15.2:0/2726875762 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7a8102d40 0x7fa7a8198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:48.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:48.893+0000 7fa7a759e640 1 --2- 172.21.15.2:0/2726875762 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7a810c170 0x7fa7a819ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:48.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:48.893+0000 7fa7a659c640 1 -- 172.21.15.2:0/2726875762 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7a810c170 msgr2=0x7fa7a819ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:48.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:48.893+0000 7fa7a659c640 1 --2- 172.21.15.2:0/2726875762 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7a810c170 0x7fa7a819ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:48.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:48.893+0000 7fa7a659c640 1 -- 172.21.15.2:0/2726875762 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7a8102d40 msgr2=0x7fa7a8198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:48.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:48.893+0000 7fa7a659c640 1 --2- 172.21.15.2:0/2726875762 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7a8102d40 0x7fa7a8198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:48.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:48.893+0000 7fa7a659c640 1 -- 172.21.15.2:0/2726875762 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7a819d3d0 con 0x7fa7a8103660 2024-09-19T04:47:48.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:48.893+0000 7fa7a6d9d640 1 --2- 172.21.15.2:0/2726875762 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7a8102d40 0x7fa7a8198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:47:48.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:48.893+0000 7fa7a659c640 1 --2- 172.21.15.2:0/2726875762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7a8103660 0x7fa7a8198960 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa79c00b3f0 tx=0x7fa79c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:48.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:48.893+0000 7fa78ffff640 1 -- 172.21.15.2:0/2726875762 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79c015020 con 0x7fa7a8103660 2024-09-19T04:47:48.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:48.894+0000 7fa7ad058640 1 -- 172.21.15.2:0/2726875762 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7a819d6c0 con 0x7fa7a8103660 2024-09-19T04:47:48.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:48.894+0000 7fa78ffff640 1 -- 172.21.15.2:0/2726875762 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa79c011ce0 con 0x7fa7a8103660 2024-09-19T04:47:48.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:48.894+0000 7fa78ffff640 1 -- 172.21.15.2:0/2726875762 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79c010d80 con 0x7fa7a8103660 2024-09-19T04:47:48.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:48.894+0000 7fa7ad058640 1 -- 172.21.15.2:0/2726875762 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7a81a4fa0 con 0x7fa7a8103660 2024-09-19T04:47:48.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:48.895+0000 7fa7ad058640 1 -- 172.21.15.2:0/2726875762 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7a8103120 con 0x7fa7a8103660 2024-09-19T04:47:48.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:48.896+0000 7fa78ffff640 1 -- 172.21.15.2:0/2726875762 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fa79c018020 con 0x7fa7a8103660 2024-09-19T04:47:48.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:48.896+0000 7fa78ffff640 1 --2- 172.21.15.2:0/2726875762 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fa7900a32d0 0x7fa7900a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:48.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:48.896+0000 7fa7a6d9d640 1 --2- 172.21.15.2:0/2726875762 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fa7900a32d0 0x7fa7900a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:48.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:48.897+0000 7fa78ffff640 1 -- 172.21.15.2:0/2726875762 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fa79c0cf280 con 0x7fa7a8103660 2024-09-19T04:47:48.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:48.897+0000 7fa7a6d9d640 1 --2- 172.21.15.2:0/2726875762 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fa7900a32d0 0x7fa7900a5790 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa798031440 tx=0x7fa7980095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:48.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:48.900+0000 7fa78ffff640 1 -- 172.21.15.2:0/2726875762 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa79c01f020 con 0x7fa7a8103660 2024-09-19T04:47:49.109 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:48 smithi002 ceph-mon[30975]: pgmap v316: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:47:49.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:49.113+0000 7fa7ad058640 1 -- 172.21.15.2:0/2726875762 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa7a8107240 con 0x7fa7a8103660 2024-09-19T04:47:49.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:49.114+0000 7fa78ffff640 1 -- 172.21.15.2:0/2726875762 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11840 (secure 0 0 0) 0x7fa79c09bf80 con 0x7fa7a8103660 2024-09-19T04:47:49.116 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:47:49.116 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":19,"btime":"2024-09-19T04:46:33:537239+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2467365137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2467365137},{"type":"v1","addr":"172.21.15.2:6835","nonce":2467365137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3162441888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3162441888},{"type":"v1","addr":"172.21.15.2:6837","nonce":3162441888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14631,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2740862966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2740862966},{"type":"v1","addr":"172.21.15.2:6839","nonce":2740862966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/2394435504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2394435504},{"type":"v1","addr":"172.21.15.2:6841","nonce":2394435504}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1630480244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1630480244},{"type":"v1","addr":"172.21.15.18:6833","nonce":1630480244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1553897465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1553897465},{"type":"v1","addr":"172.21.15.116:6833","nonce":1553897465}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3035664608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3035664608},{"type":"v1","addr":"172.21.15.18:6835","nonce":3035664608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1096622392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1096622392},{"type":"v1","addr":"172.21.15.18:6837","nonce":1096622392}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3761157675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3761157675},{"type":"v1","addr":"172.21.15.116:6835","nonce":3761157675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/1120131594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1120131594},{"type":"v1","addr":"172.21.15.116:6837","nonce":1120131594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:46:24.050115+0000","modified":"2024-09-19T04:46:33.112369+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/4207677139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":4207677139},{"type":"v1","addr":"172.21.15.18:6839","nonce":4207677139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/2346874880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":2346874880},{"type":"v1","addr":"172.21.15.116:6839","nonce":2346874880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496]},"id":1}]} 2024-09-19T04:47:49.116 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 19 2024-09-19T04:47:49.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:49.116+0000 7fa7ad058640 1 -- 172.21.15.2:0/2726875762 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fa7900a32d0 msgr2=0x7fa7900a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:49.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:49.116+0000 7fa7ad058640 1 --2- 172.21.15.2:0/2726875762 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fa7900a32d0 0x7fa7900a5790 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa798031440 tx=0x7fa7980095f0 comp rx=0 tx=0).stop 2024-09-19T04:47:49.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:49.116+0000 7fa7ad058640 1 -- 172.21.15.2:0/2726875762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7a8103660 msgr2=0x7fa7a8198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:49.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:49.116+0000 7fa7ad058640 1 --2- 172.21.15.2:0/2726875762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7a8103660 0x7fa7a8198960 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa79c00b3f0 tx=0x7fa79c00b8b0 comp rx=0 tx=0).stop 2024-09-19T04:47:49.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:49.116+0000 7fa7ad058640 1 -- 172.21.15.2:0/2726875762 shutdown_connections 2024-09-19T04:47:49.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:49.116+0000 7fa7ad058640 1 --2- 172.21.15.2:0/2726875762 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fa7900a32d0 0x7fa7900a5790 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:49.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:49.116+0000 7fa7ad058640 1 --2- 172.21.15.2:0/2726875762 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7a810c170 0x7fa7a819ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:49.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:49.116+0000 7fa7ad058640 1 --2- 172.21.15.2:0/2726875762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7a8103660 0x7fa7a8198960 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:49.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:49.116+0000 7fa7ad058640 1 --2- 172.21.15.2:0/2726875762 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7a8102d40 0x7fa7a8198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:49.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:49.116+0000 7fa7ad058640 1 -- 172.21.15.2:0/2726875762 >> 172.21.15.2:0/2726875762 conn(0x7fa7a80fc7a0 msgr2=0x7fa7a80fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:49.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:49.116+0000 7fa7ad058640 1 -- 172.21.15.2:0/2726875762 shutdown_connections 2024-09-19T04:47:49.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:49.116+0000 7fa7ad058640 1 -- 172.21.15.2:0/2726875762 wait complete. 2024-09-19T04:47:49.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:48 smithi018 ceph-mon[34537]: pgmap v316: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:47:49.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:48 smithi116 ceph-mon[34477]: pgmap v316: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:47:49.803 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T04:47:50.068 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:47:50.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:49 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/2726875762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:47:50.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:49 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/2726875762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:47:50.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:49 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/2726875762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:47:50.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.517+0000 7f858fb3d640 1 -- 172.21.15.2:0/427803743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8588106f20 msgr2=0x7f858810eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:50.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.517+0000 7f858fb3d640 1 --2- 172.21.15.2:0/427803743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8588106f20 0x7f858810eaa0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8580009900 tx=0x7f858002a410 comp rx=0 tx=0).stop 2024-09-19T04:47:50.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.517+0000 7f858fb3d640 1 -- 172.21.15.2:0/427803743 shutdown_connections 2024-09-19T04:47:50.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.517+0000 7f858fb3d640 1 --2- 172.21.15.2:0/427803743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8588106f20 0x7f858810eaa0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:50.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.517+0000 7f858fb3d640 1 --2- 172.21.15.2:0/427803743 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f85881027a0 0x7f85881067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:50.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.517+0000 7f858fb3d640 1 --2- 172.21.15.2:0/427803743 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8588101df0 0x7f85881021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:50.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.517+0000 7f858fb3d640 1 -- 172.21.15.2:0/427803743 >> 172.21.15.2:0/427803743 conn(0x7f85880fd8f0 msgr2=0x7f85880ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:50.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.518+0000 7f858fb3d640 1 -- 172.21.15.2:0/427803743 shutdown_connections 2024-09-19T04:47:50.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.518+0000 7f858fb3d640 1 -- 172.21.15.2:0/427803743 wait complete. 2024-09-19T04:47:50.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.518+0000 7f858fb3d640 1 Processor -- start 2024-09-19T04:47:50.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.518+0000 7f858fb3d640 1 -- start start 2024-09-19T04:47:50.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.519+0000 7f858fb3d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8588101df0 0x7f85880744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:50.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.519+0000 7f858fb3d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f85881027a0 0x7f8588074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:50.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.519+0000 7f858fb3d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8588106f20 0x7f8588074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:50.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.519+0000 7f858fb3d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8588111ed0 con 0x7f8588106f20 2024-09-19T04:47:50.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.519+0000 7f858fb3d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8588111d50 con 0x7f85881027a0 2024-09-19T04:47:50.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.519+0000 7f858fb3d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f8588112050 con 0x7f8588101df0 2024-09-19T04:47:50.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.519+0000 7f858e0da640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8588106f20 0x7f8588074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:50.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.519+0000 7f858e0da640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8588106f20 0x7f8588074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38642/0 (socket says 172.21.15.2:38642) 2024-09-19T04:47:50.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.519+0000 7f858e0da640 1 -- 172.21.15.2:0/1111946623 learned_addr learned my addr 172.21.15.2:0/1111946623 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:47:50.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.519+0000 7f858d0d8640 1 --2- 172.21.15.2:0/1111946623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f85881027a0 0x7f8588074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:50.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.519+0000 7f858d8d9640 1 --2- 172.21.15.2:0/1111946623 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8588101df0 0x7f85880744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:50.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.519+0000 7f858e0da640 1 -- 172.21.15.2:0/1111946623 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8588101df0 msgr2=0x7f85880744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:50.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.519+0000 7f858e0da640 1 --2- 172.21.15.2:0/1111946623 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8588101df0 0x7f85880744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:50.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.519+0000 7f858e0da640 1 -- 172.21.15.2:0/1111946623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f85881027a0 msgr2=0x7f8588074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:50.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.519+0000 7f858e0da640 1 --2- 172.21.15.2:0/1111946623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f85881027a0 0x7f8588074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:50.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.519+0000 7f858e0da640 1 -- 172.21.15.2:0/1111946623 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85881a69e0 con 0x7f8588106f20 2024-09-19T04:47:50.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.519+0000 7f858e0da640 1 --2- 172.21.15.2:0/1111946623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8588106f20 0x7f8588074f70 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8580009a20 tx=0x7f85800042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:50.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.520+0000 7f8586ffd640 1 -- 172.21.15.2:0/1111946623 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f858003f030 con 0x7f8588106f20 2024-09-19T04:47:50.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.520+0000 7f8586ffd640 1 -- 172.21.15.2:0/1111946623 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f85800044d0 con 0x7f8588106f20 2024-09-19T04:47:50.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.520+0000 7f858fb3d640 1 -- 172.21.15.2:0/1111946623 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85881a6c70 con 0x7f8588106f20 2024-09-19T04:47:50.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.520+0000 7f8586ffd640 1 -- 172.21.15.2:0/1111946623 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8580035070 con 0x7f8588106f20 2024-09-19T04:47:50.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.520+0000 7f858fb3d640 1 -- 172.21.15.2:0/1111946623 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85881a71a0 con 0x7f8588106f20 2024-09-19T04:47:50.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.521+0000 7f858fb3d640 1 -- 172.21.15.2:0/1111946623 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8588102250 con 0x7f8588106f20 2024-09-19T04:47:50.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.522+0000 7f8586ffd640 1 -- 172.21.15.2:0/1111946623 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f8580042030 con 0x7f8588106f20 2024-09-19T04:47:50.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.523+0000 7f8586ffd640 1 --2- 172.21.15.2:0/1111946623 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f85700a3350 0x7f85700a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:50.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.523+0000 7f858d8d9640 1 --2- 172.21.15.2:0/1111946623 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f85700a3350 0x7f85700a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:50.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.523+0000 7f8586ffd640 1 -- 172.21.15.2:0/1111946623 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f85800f0210 con 0x7f8588106f20 2024-09-19T04:47:50.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.523+0000 7f858d8d9640 1 --2- 172.21.15.2:0/1111946623 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f85700a3350 0x7f85700a5810 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8578009f20 tx=0x7f85780094f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:50.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.526+0000 7f8586ffd640 1 -- 172.21.15.2:0/1111946623 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f85800bcda0 con 0x7f8588106f20 2024-09-19T04:47:50.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.703+0000 7f858fb3d640 1 -- 172.21.15.2:0/1111946623 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f858810a100 con 0x7f8588106f20 2024-09-19T04:47:50.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.705+0000 7f8586ffd640 1 -- 172.21.15.2:0/1111946623 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22490 (secure 0 0 0) 0x7f85800bc6a0 con 0x7f8588106f20 2024-09-19T04:47:50.706 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:47:50.706 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":80,"fsid":"d46630c4-7640-11ef-bceb-c7b262605968","created":"2024-09-19T04:38:39.698488+0000","modified":"2024-09-19T04:46:36.551838+0000","last_up_change":"2024-09-19T04:45:33.839647+0000","last_in_change":"2024-09-19T04:45:09.816808+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T04:41:51.960734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T04:46:20.031485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T04:46:22.484767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7a7dc9b9-8d5d-4dd3-93a3-0d5efced07d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":611702745},{"type":"v1","addr":"172.21.15.2:6803","nonce":611702745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":611702745},{"type":"v1","addr":"172.21.15.2:6805","nonce":611702745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":611702745},{"type":"v1","addr":"172.21.15.2:6809","nonce":611702745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":611702745},{"type":"v1","addr":"172.21.15.2:6807","nonce":611702745}]},"public_addr":"172.21.15.2:6803/611702745","cluster_addr":"172.21.15.2:6805/611702745","heartbeat_back_addr":"172.21.15.2:6809/611702745","heartbeat_front_addr":"172.21.15.2:6807/611702745","state":["exists","up"]},{"osd":1,"uuid":"bea40dec-7d9c-497f-bf16-4bf6d3b839f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":58390709},{"type":"v1","addr":"172.21.15.18:6801","nonce":58390709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":58390709},{"type":"v1","addr":"172.21.15.18:6803","nonce":58390709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":58390709},{"type":"v1","addr":"172.21.15.18:6807","nonce":58390709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":58390709},{"type":"v1","addr":"172.21.15.18:6805","nonce":58390709}]},"public_addr":"172.21.15.18:6801/58390709","cluster_addr":"172.21.15.18:6803/58390709","heartbeat_back_addr":"172.21.15.18:6807/58390709","heartbeat_front_addr":"172.21.15.18:6805/58390709","state":["exists","up"]},{"osd":2,"uuid":"97716304-a31e-48c9-83de-84eed10a7a4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":627735759},{"type":"v1","addr":"172.21.15.116:6801","nonce":627735759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":627735759},{"type":"v1","addr":"172.21.15.116:6803","nonce":627735759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":627735759},{"type":"v1","addr":"172.21.15.116:6807","nonce":627735759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":627735759},{"type":"v1","addr":"172.21.15.116:6805","nonce":627735759}]},"public_addr":"172.21.15.116:6801/627735759","cluster_addr":"172.21.15.116:6803/627735759","heartbeat_back_addr":"172.21.15.116:6807/627735759","heartbeat_front_addr":"172.21.15.116:6805/627735759","state":["exists","up"]},{"osd":3,"uuid":"8d79514e-16cf-4bd0-a2eb-e9148b91183d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1936071687},{"type":"v1","addr":"172.21.15.2:6811","nonce":1936071687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1936071687},{"type":"v1","addr":"172.21.15.2:6813","nonce":1936071687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1936071687},{"type":"v1","addr":"172.21.15.2:6817","nonce":1936071687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1936071687},{"type":"v1","addr":"172.21.15.2:6815","nonce":1936071687}]},"public_addr":"172.21.15.2:6811/1936071687","cluster_addr":"172.21.15.2:6813/1936071687","heartbeat_back_addr":"172.21.15.2:6817/1936071687","heartbeat_front_addr":"172.21.15.2:6815/1936071687","state":["exists","up"]},{"osd":4,"uuid":"5136f03c-94a3-42a0-9bfc-020397836037","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1333533784},{"type":"v1","addr":"172.21.15.18:6809","nonce":1333533784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1333533784},{"type":"v1","addr":"172.21.15.18:6811","nonce":1333533784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1333533784},{"type":"v1","addr":"172.21.15.18:6815","nonce":1333533784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1333533784},{"type":"v1","addr":"172.21.15.18:6813","nonce":1333533784}]},"public_addr":"172.21.15.18:6809/1333533784","cluster_addr":"172.21.15.18:6811/1333533784","heartbeat_back_addr":"172.21.15.18:6815/1333533784","heartbeat_front_addr":"172.21.15.18:6813/1333533784","state":["exists","up"]},{"osd":5,"uuid":"9d3384b0-f87d-4513-b151-4cca21c339b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":316360741},{"type":"v1","addr":"172.21.15.116:6809","nonce":316360741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":316360741},{"type":"v1","addr":"172.21.15.116:6811","nonce":316360741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":316360741},{"type":"v1","addr":"172.21.15.116:6815","nonce":316360741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":316360741},{"type":"v1","addr":"172.21.15.116:6813","nonce":316360741}]},"public_addr":"172.21.15.116:6809/316360741","cluster_addr":"172.21.15.116:6811/316360741","heartbeat_back_addr":"172.21.15.116:6815/316360741","heartbeat_front_addr":"172.21.15.116:6813/316360741","state":["exists","up"]},{"osd":6,"uuid":"e54f44b5-a693-4b31-83b2-2bcf10ab9a75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1185564560},{"type":"v1","addr":"172.21.15.2:6819","nonce":1185564560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1185564560},{"type":"v1","addr":"172.21.15.2:6821","nonce":1185564560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1185564560},{"type":"v1","addr":"172.21.15.2:6825","nonce":1185564560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":1185564560},{"type":"v1","addr":"172.21.15.2:6823","nonce":1185564560}]},"public_addr":"172.21.15.2:6819/1185564560","cluster_addr":"172.21.15.2:6821/1185564560","heartbeat_back_addr":"172.21.15.2:6825/1185564560","heartbeat_front_addr":"172.21.15.2:6823/1185564560","state":["exists","up"]},{"osd":7,"uuid":"96a444c3-429a-48b6-9823-95c9e171341a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3691801363},{"type":"v1","addr":"172.21.15.18:6817","nonce":3691801363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3691801363},{"type":"v1","addr":"172.21.15.18:6819","nonce":3691801363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3691801363},{"type":"v1","addr":"172.21.15.18:6823","nonce":3691801363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3691801363},{"type":"v1","addr":"172.21.15.18:6821","nonce":3691801363}]},"public_addr":"172.21.15.18:6817/3691801363","cluster_addr":"172.21.15.18:6819/3691801363","heartbeat_back_addr":"172.21.15.18:6823/3691801363","heartbeat_front_addr":"172.21.15.18:6821/3691801363","state":["exists","up"]},{"osd":8,"uuid":"c3f696aa-be7d-4f67-9147-3751406e394d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":3709586119},{"type":"v1","addr":"172.21.15.116:6817","nonce":3709586119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":3709586119},{"type":"v1","addr":"172.21.15.116:6819","nonce":3709586119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":3709586119},{"type":"v1","addr":"172.21.15.116:6823","nonce":3709586119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":3709586119},{"type":"v1","addr":"172.21.15.116:6821","nonce":3709586119}]},"public_addr":"172.21.15.116:6817/3709586119","cluster_addr":"172.21.15.116:6819/3709586119","heartbeat_back_addr":"172.21.15.116:6823/3709586119","heartbeat_front_addr":"172.21.15.116:6821/3709586119","state":["exists","up"]},{"osd":9,"uuid":"4892549d-f050-48c5-b695-5924b612a581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1054791011},{"type":"v1","addr":"172.21.15.2:6827","nonce":1054791011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1054791011},{"type":"v1","addr":"172.21.15.2:6829","nonce":1054791011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1054791011},{"type":"v1","addr":"172.21.15.2:6833","nonce":1054791011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":1054791011},{"type":"v1","addr":"172.21.15.2:6831","nonce":1054791011}]},"public_addr":"172.21.15.2:6827/1054791011","cluster_addr":"172.21.15.2:6829/1054791011","heartbeat_back_addr":"172.21.15.2:6833/1054791011","heartbeat_front_addr":"172.21.15.2:6831/1054791011","state":["exists","up"]},{"osd":10,"uuid":"12b60238-6a35-4d48-bacd-ee5ddd8fdb0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1958683776},{"type":"v1","addr":"172.21.15.18:6825","nonce":1958683776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":1958683776},{"type":"v1","addr":"172.21.15.18:6827","nonce":1958683776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":1958683776},{"type":"v1","addr":"172.21.15.18:6831","nonce":1958683776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":1958683776},{"type":"v1","addr":"172.21.15.18:6829","nonce":1958683776}]},"public_addr":"172.21.15.18:6825/1958683776","cluster_addr":"172.21.15.18:6827/1958683776","heartbeat_back_addr":"172.21.15.18:6831/1958683776","heartbeat_front_addr":"172.21.15.18:6829/1958683776","state":["exists","up"]},{"osd":11,"uuid":"99b3e553-b42c-4b2f-817f-3900ad8bd223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3456789654},{"type":"v1","addr":"172.21.15.116:6825","nonce":3456789654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3456789654},{"type":"v1","addr":"172.21.15.116:6827","nonce":3456789654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3456789654},{"type":"v1","addr":"172.21.15.116:6831","nonce":3456789654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3456789654},{"type":"v1","addr":"172.21.15.116:6829","nonce":3456789654}]},"public_addr":"172.21.15.116:6825/3456789654","cluster_addr":"172.21.15.116:6827/3456789654","heartbeat_back_addr":"172.21.15.116:6831/3456789654","heartbeat_front_addr":"172.21.15.116:6829/3456789654","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:40:58.216702+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:41:22.852350+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:41:47.265084+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:42:12.785128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:42:38.475008+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:43:02.924009+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:43:28.050646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:43:52.715369+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:44:16.905066+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:44:42.071128+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:45:06.434525+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:45:31.569086+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":1}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/870383845":"2024-09-20T04:39:35.461329+0000","172.21.15.2:0/2801870985":"2024-09-20T04:39:35.461329+0000","172.21.15.2:0/256825166":"2024-09-20T04:39:35.461329+0000","172.21.15.2:6801/3782987318":"2024-09-20T04:39:35.461329+0000","172.21.15.2:0/3064319092":"2024-09-20T04:39:11.086431+0000","172.21.15.2:0/1528097642":"2024-09-20T04:39:11.086431+0000","172.21.15.2:6801/1825825090":"2024-09-20T04:39:11.086431+0000","172.21.15.2:6800/1825825090":"2024-09-20T04:39:11.086431+0000","172.21.15.2:6800/3782987318":"2024-09-20T04:39:35.461329+0000","172.21.15.2:0/2432243496":"2024-09-20T04:39:11.086431+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T04:47:50.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.707+0000 7f858fb3d640 1 -- 172.21.15.2:0/1111946623 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f85700a3350 msgr2=0x7f85700a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:50.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.707+0000 7f858fb3d640 1 --2- 172.21.15.2:0/1111946623 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f85700a3350 0x7f85700a5810 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8578009f20 tx=0x7f85780094f0 comp rx=0 tx=0).stop 2024-09-19T04:47:50.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.707+0000 7f858fb3d640 1 -- 172.21.15.2:0/1111946623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8588106f20 msgr2=0x7f8588074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:50.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.707+0000 7f858fb3d640 1 --2- 172.21.15.2:0/1111946623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8588106f20 0x7f8588074f70 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8580009a20 tx=0x7f85800042e0 comp rx=0 tx=0).stop 2024-09-19T04:47:50.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.707+0000 7f858fb3d640 1 -- 172.21.15.2:0/1111946623 shutdown_connections 2024-09-19T04:47:50.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.707+0000 7f858fb3d640 1 --2- 172.21.15.2:0/1111946623 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f85700a3350 0x7f85700a5810 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:50.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.707+0000 7f858fb3d640 1 --2- 172.21.15.2:0/1111946623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8588106f20 0x7f8588074f70 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:50.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.707+0000 7f858fb3d640 1 --2- 172.21.15.2:0/1111946623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f85881027a0 0x7f8588074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:50.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.707+0000 7f858fb3d640 1 --2- 172.21.15.2:0/1111946623 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8588101df0 0x7f85880744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:50.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.707+0000 7f858fb3d640 1 -- 172.21.15.2:0/1111946623 >> 172.21.15.2:0/1111946623 conn(0x7f85880fd8f0 msgr2=0x7f85880fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:50.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.707+0000 7f858fb3d640 1 -- 172.21.15.2:0/1111946623 shutdown_connections 2024-09-19T04:47:50.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:50.707+0000 7f858fb3d640 1 -- 172.21.15.2:0/1111946623 wait complete. 2024-09-19T04:47:51.211 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:50 smithi002 ceph-mon[30975]: pgmap v317: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T04:47:51.211 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:50 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/1111946623' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:47:51.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:50 smithi018 ceph-mon[34537]: pgmap v317: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T04:47:51.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:50 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/1111946623' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:47:51.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:50 smithi116 ceph-mon[34477]: pgmap v317: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T04:47:51.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:50 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/1111946623' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:47:51.398 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 19, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T04:46:24.050115+0000', 'modified': '2024-09-19T04:46:33.112369+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24496}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24491': {'gid': 24491, 'name': 'b', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.18:6839/4207677139', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6838', 'nonce': 4207677139}, {'type': 'v1', 'addr': '172.21.15.18:6839', 'nonce': 4207677139}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24496': {'gid': 24496, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.116:6839/2346874880', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6838', 'nonce': 2346874880}, {'type': 'v1', 'addr': '172.21.15.116:6839', 'nonce': 2346874880}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24496, 'qdb_cluster': [24496]} 2024-09-19T04:47:51.398 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T04:47:51.398 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T04:47:51.663 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:47:52.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.075+0000 7fe79fd40640 1 -- 172.21.15.2:0/3599826677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7981008d0 msgr2=0x7fe798100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:52.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.075+0000 7fe79fd40640 1 --2- 172.21.15.2:0/3599826677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7981008d0 0x7fe798100cb0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe794009900 tx=0x7fe79402a410 comp rx=0 tx=0).stop 2024-09-19T04:47:52.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.075+0000 7fe79fd40640 1 -- 172.21.15.2:0/3599826677 shutdown_connections 2024-09-19T04:47:52.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.075+0000 7fe79fd40640 1 --2- 172.21.15.2:0/3599826677 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe79810e480 0x7fe798110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:52.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.075+0000 7fe79fd40640 1 --2- 172.21.15.2:0/3599826677 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe798101280 0x7fe79810df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:52.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.075+0000 7fe79fd40640 1 --2- 172.21.15.2:0/3599826677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7981008d0 0x7fe798100cb0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:52.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.075+0000 7fe79fd40640 1 -- 172.21.15.2:0/3599826677 >> 172.21.15.2:0/3599826677 conn(0x7fe7980fc7a0 msgr2=0x7fe7980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:52.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.075+0000 7fe79fd40640 1 -- 172.21.15.2:0/3599826677 shutdown_connections 2024-09-19T04:47:52.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.075+0000 7fe79fd40640 1 -- 172.21.15.2:0/3599826677 wait complete. 2024-09-19T04:47:52.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.075+0000 7fe79fd40640 1 Processor -- start 2024-09-19T04:47:52.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.076+0000 7fe79fd40640 1 -- start start 2024-09-19T04:47:52.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.076+0000 7fe79fd40640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7981008d0 0x7fe79819a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:52.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.076+0000 7fe79fd40640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe798101280 0x7fe79819aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:52.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.076+0000 7fe79fd40640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe79810e480 0x7fe79819ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:52.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.076+0000 7fe79fd40640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe798114060 con 0x7fe79810e480 2024-09-19T04:47:52.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.076+0000 7fe79fd40640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe798113ee0 con 0x7fe798101280 2024-09-19T04:47:52.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.076+0000 7fe79fd40640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fe7981141e0 con 0x7fe7981008d0 2024-09-19T04:47:52.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.076+0000 7fe79e2dd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe79810e480 0x7fe79819ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:52.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.076+0000 7fe79e2dd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe79810e480 0x7fe79819ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45706/0 (socket says 172.21.15.2:45706) 2024-09-19T04:47:52.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.076+0000 7fe79e2dd640 1 -- 172.21.15.2:0/1737748636 learned_addr learned my addr 172.21.15.2:0/1737748636 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:47:52.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.076+0000 7fe79dadc640 1 --2- 172.21.15.2:0/1737748636 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7981008d0 0x7fe79819a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:52.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.076+0000 7fe79e2dd640 1 -- 172.21.15.2:0/1737748636 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7981008d0 msgr2=0x7fe79819a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:52.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.076+0000 7fe79e2dd640 1 --2- 172.21.15.2:0/1737748636 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7981008d0 0x7fe79819a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:52.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.076+0000 7fe79e2dd640 1 -- 172.21.15.2:0/1737748636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe798101280 msgr2=0x7fe79819aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:52.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.076+0000 7fe79d2db640 1 --2- 172.21.15.2:0/1737748636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe798101280 0x7fe79819aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:52.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.076+0000 7fe79e2dd640 1 --2- 172.21.15.2:0/1737748636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe798101280 0x7fe79819aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:52.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.076+0000 7fe79e2dd640 1 -- 172.21.15.2:0/1737748636 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe79819f550 con 0x7fe79810e480 2024-09-19T04:47:52.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.076+0000 7fe79e2dd640 1 --2- 172.21.15.2:0/1737748636 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe79810e480 0x7fe79819ee70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe790009fd0 tx=0x7fe79000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:52.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.077+0000 7fe78effd640 1 -- 172.21.15.2:0/1737748636 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe790004d20 con 0x7fe79810e480 2024-09-19T04:47:52.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.077+0000 7fe78effd640 1 -- 172.21.15.2:0/1737748636 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe790005020 con 0x7fe79810e480 2024-09-19T04:47:52.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.077+0000 7fe78effd640 1 -- 172.21.15.2:0/1737748636 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7900116b0 con 0x7fe79810e480 2024-09-19T04:47:52.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.077+0000 7fe79fd40640 1 -- 172.21.15.2:0/1737748636 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe79819f840 con 0x7fe79810e480 2024-09-19T04:47:52.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.077+0000 7fe79fd40640 1 -- 172.21.15.2:0/1737748636 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7981a7120 con 0x7fe79810e480 2024-09-19T04:47:52.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.079+0000 7fe78effd640 1 -- 172.21.15.2:0/1737748636 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fe7900051d0 con 0x7fe79810e480 2024-09-19T04:47:52.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.079+0000 7fe7a2119740 1 Processor -- start 2024-09-19T04:47:52.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.079+0000 7fe7a2119740 1 -- start start 2024-09-19T04:47:52.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.080+0000 7fe7a2119740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632093fb9d0 0x5632093fbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:52.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.080+0000 7fe7a2119740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632093fc2f0 0x563209406670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:52.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.080+0000 7fe7a2119740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563209406bb0 0x563209408fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:52.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.080+0000 7fe7a2119740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563209362090 con 0x563209406bb0 2024-09-19T04:47:52.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.080+0000 7fe7a2119740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563209309a70 con 0x5632093fc2f0 2024-09-19T04:47:52.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.080+0000 7fe7a2119740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x56320935e050 con 0x5632093fb9d0 2024-09-19T04:47:52.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.080+0000 7fe79d2db640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563209406bb0 0x563209408fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:52.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.080+0000 7fe79d2db640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563209406bb0 0x563209408fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45714/0 (socket says 172.21.15.2:45714) 2024-09-19T04:47:52.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.080+0000 7fe78effd640 1 --2- 172.21.15.2:0/1737748636 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe7840a32d0 0x7fe7840a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:52.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.080+0000 7fe79d2db640 1 -- 172.21.15.2:0/1202785133 learned_addr learned my addr 172.21.15.2:0/1202785133 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:47:52.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.080+0000 7fe79dadc640 1 --2- 172.21.15.2:0/1202785133 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632093fc2f0 0x563209406670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:52.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.080+0000 7fe79d2db640 1 --2- 172.21.15.2:0/1202785133 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632093fb9d0 0x5632093fbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:52.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.080+0000 7fe79e2dd640 1 --2- 172.21.15.2:0/1737748636 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe7840a32d0 0x7fe7840a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:52.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.080+0000 7fe79d2db640 1 -- 172.21.15.2:0/1202785133 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632093fb9d0 msgr2=0x5632093fbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:47:52.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.080+0000 7fe79d2db640 1 --2- 172.21.15.2:0/1202785133 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632093fb9d0 0x5632093fbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:52.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.080+0000 7fe79d2db640 1 -- 172.21.15.2:0/1202785133 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632093fc2f0 msgr2=0x563209406670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:47:52.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.080+0000 7fe79d2db640 1 --2- 172.21.15.2:0/1202785133 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632093fc2f0 0x563209406670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:52.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.080+0000 7fe78effd640 1 -- 172.21.15.2:0/1737748636 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fe7900cffc0 con 0x7fe79810e480 2024-09-19T04:47:52.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.080+0000 7fe79d2db640 1 -- 172.21.15.2:0/1202785133 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563209316130 con 0x563209406bb0 2024-09-19T04:47:52.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.081+0000 7fe79d2db640 1 --2- 172.21.15.2:0/1202785133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563209406bb0 0x563209408fa0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe788005fd0 tx=0x7fe78800e3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b33ba397d3f6d6fa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:52.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.081+0000 7fe79e2dd640 1 --2- 172.21.15.2:0/1737748636 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe7840a32d0 0x7fe7840a5790 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe790098e20 tx=0x7fe7900a0040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:52.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.081+0000 7fe783fff640 1 -- 172.21.15.2:0/1202785133 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe78800b680 con 0x563209406bb0 2024-09-19T04:47:52.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.081+0000 7fe783fff640 1 -- 172.21.15.2:0/1202785133 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe78800bcd0 con 0x563209406bb0 2024-09-19T04:47:52.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.081+0000 7fe783fff640 1 -- 172.21.15.2:0/1202785133 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe788011c40 con 0x563209406bb0 2024-09-19T04:47:52.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.081+0000 7fe7a2119740 1 -- 172.21.15.2:0/1202785133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563209406bb0 msgr2=0x563209408fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:52.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.081+0000 7fe7a2119740 1 --2- 172.21.15.2:0/1202785133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563209406bb0 0x563209408fa0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe788005fd0 tx=0x7fe78800e3d0 comp rx=0 tx=0).stop 2024-09-19T04:47:52.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.081+0000 7fe7a2119740 1 -- 172.21.15.2:0/1202785133 shutdown_connections 2024-09-19T04:47:52.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.082+0000 7fe7a2119740 1 --2- 172.21.15.2:0/1202785133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563209406bb0 0x563209408fa0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:52.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.082+0000 7fe7a2119740 1 --2- 172.21.15.2:0/1202785133 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632093fc2f0 0x563209406670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:52.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.082+0000 7fe7a2119740 1 --2- 172.21.15.2:0/1202785133 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632093fb9d0 0x5632093fbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:52.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.082+0000 7fe7a2119740 1 -- 172.21.15.2:0/1202785133 >> 172.21.15.2:0/1202785133 conn(0x5632093f7f60 msgr2=0x5632093f8340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:52.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.082+0000 7fe7a2119740 1 -- 172.21.15.2:0/1202785133 shutdown_connections 2024-09-19T04:47:52.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.082+0000 7fe7a2119740 1 -- 172.21.15.2:0/1202785133 wait complete. 2024-09-19T04:47:52.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.082+0000 7fe7a2119740 1 -- start start 2024-09-19T04:47:52.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.082+0000 7fe7a2119740 1 Processor -- start 2024-09-19T04:47:52.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.082+0000 7fe7a2119740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632093fb9d0 0x563209406450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:52.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.082+0000 7fe7a2119740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632093fc2f0 0x5632094037a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:52.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.082+0000 7fe7a2119740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563209406bb0 0x563209403ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:52.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.082+0000 7fe7a2119740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563209409780 con 0x5632093fc2f0 2024-09-19T04:47:52.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.082+0000 7fe7a2119740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56320931cf20 con 0x563209406bb0 2024-09-19T04:47:52.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.082+0000 7fe7a2119740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x563209409900 con 0x5632093fb9d0 2024-09-19T04:47:52.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.082+0000 7fe7a2119740 10 client.0 _ll_register_callbacks cb 0x5632092e6030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:47:52.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.083+0000 7fe79dadc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632093fc2f0 0x5632094037a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:52.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.083+0000 7fe79dadc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632093fc2f0 0x5632094037a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45724/0 (socket says 172.21.15.2:45724) 2024-09-19T04:47:52.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.083+0000 7fe79dadc640 1 -- 172.21.15.2:0/373306277 learned_addr learned my addr 172.21.15.2:0/373306277 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:47:52.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.083+0000 7fe79d2db640 1 --2- 172.21.15.2:0/373306277 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632093fb9d0 0x563209406450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:52.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.083+0000 7fe79d2db640 1 --2- 172.21.15.2:0/373306277 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563209406bb0 0x563209403ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:52.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.083+0000 7fe79dadc640 1 -- 172.21.15.2:0/373306277 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632093fb9d0 msgr2=0x563209406450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:47:52.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.083+0000 7fe79dadc640 1 --2- 172.21.15.2:0/373306277 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632093fb9d0 0x563209406450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:52.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.083+0000 7fe79dadc640 1 -- 172.21.15.2:0/373306277 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563209406bb0 msgr2=0x563209403ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:47:52.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.083+0000 7fe79dadc640 1 --2- 172.21.15.2:0/373306277 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563209406bb0 0x563209403ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:52.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.083+0000 7fe79dadc640 1 -- 172.21.15.2:0/373306277 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632090d32b0 con 0x5632093fc2f0 2024-09-19T04:47:52.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.083+0000 7fe79d2db640 1 --2- 172.21.15.2:0/373306277 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563209406bb0 0x563209403ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:47:52.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.083+0000 7fe79dadc640 1 --2- 172.21.15.2:0/373306277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632093fc2f0 0x5632094037a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe794009900 tx=0x7fe7940316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bf1b2938240e084 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:52.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.083+0000 7fe7817fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:47:52.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.083+0000 7fe7817fa640 1 -- 172.21.15.2:0/373306277 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe794035040 con 0x5632093fc2f0 2024-09-19T04:47:52.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.083+0000 7fe7817fa640 1 -- 172.21.15.2:0/373306277 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fe794004040 con 0x5632093fc2f0 2024-09-19T04:47:52.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.083+0000 7fe7a2119740 1 -- 172.21.15.2:0/373306277 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe78800bcd0 con 0x5632093fc2f0 2024-09-19T04:47:52.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.083+0000 7fe7817fa640 1 -- 172.21.15.2:0/373306277 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe794004240 con 0x5632093fc2f0 2024-09-19T04:47:52.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.083+0000 7fe7a2119740 10 client.15066 fetch_fsmap learned FSMap version 19 2024-09-19T04:47:52.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.083+0000 7fe7a2119740 1 -- 172.21.15.2:0/373306277 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5632094150f0 con 0x5632093fc2f0 2024-09-19T04:47:52.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.084+0000 7fe7817fa640 1 -- 172.21.15.2:0/373306277 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe78800bcd0 con 0x5632093fc2f0 2024-09-19T04:47:52.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.084+0000 7fe7817fa640 1 -- 172.21.15.2:0/373306277 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fe794004850 con 0x5632093fc2f0 2024-09-19T04:47:52.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.084+0000 7fe7a2119740 10 client.15066 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:47:52.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.084+0000 7fe7a2119740 10 client.15066 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T04:47:52.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.084+0000 7fe7a2119740 20 client.15066 populate_metadata read hostname 'smithi002' 2024-09-19T04:47:52.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.084+0000 7fe7a2119740 1 --2- 172.21.15.2:0/373306277 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x563209417710 0x563209418b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:52.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.084+0000 7fe7a2119740 4 client.15066 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:47:52.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.084+0000 7fe7a2119740 1 -- 172.21.15.2:0/373306277 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56320936f600 con 0x563209417710 2024-09-19T04:47:52.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.084+0000 7fe79d2db640 1 --2- 172.21.15.2:0/373306277 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x563209417710 0x563209418b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:52.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.085+0000 7fe79d2db640 1 --2- 172.21.15.2:0/373306277 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x563209417710 0x563209418b80 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb6c6b382837b546 server_cookie=c8d2a2ef5646c491 in_seq=0 out_seq=0 2024-09-19T04:47:52.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.085+0000 7fe7817fa640 10 client.15066 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:47:52.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.085+0000 7fe7817fa640 1 -- 172.21.15.2:0/373306277 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56320936f600 con 0x563209417710 2024-09-19T04:47:52.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.085+0000 7fe7817fa640 10 client.15066 handle_command_reply: tid=0 2024-09-19T04:47:52.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.085+0000 7fe7a2119740 1 client.15066 shutdown 2024-09-19T04:47:52.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.085+0000 7fe7a2119740 1 -- 172.21.15.2:0/373306277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632093fc2f0 msgr2=0x5632094037a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:52.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.085+0000 7fe7a2119740 1 --2- 172.21.15.2:0/373306277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632093fc2f0 0x5632094037a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe794009900 tx=0x7fe7940316d0 comp rx=0 tx=0).stop 2024-09-19T04:47:52.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.086+0000 7fe7a2119740 1 -- 172.21.15.2:0/373306277 shutdown_connections 2024-09-19T04:47:52.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.086+0000 7fe7a2119740 1 --2- 172.21.15.2:0/373306277 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563209406bb0 0x563209403ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:52.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.086+0000 7fe7a2119740 1 --2- 172.21.15.2:0/373306277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632093fc2f0 0x5632094037a0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:52.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.086+0000 7fe7a2119740 1 --2- 172.21.15.2:0/373306277 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x563209417710 0x563209418b80 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:52.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.086+0000 7fe7a2119740 1 --2- 172.21.15.2:0/373306277 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632093fb9d0 0x563209406450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:52.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.086+0000 7fe7a2119740 1 -- 172.21.15.2:0/373306277 >> 172.21.15.2:0/373306277 conn(0x5632093f7f60 msgr2=0x5632093fdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:52.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.086+0000 7fe7817fa640 0 client.15066 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:47:52.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.086+0000 7fe7a2119740 1 -- 172.21.15.2:0/373306277 shutdown_connections 2024-09-19T04:47:52.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.086+0000 7fe7a2119740 1 -- 172.21.15.2:0/373306277 wait complete. 2024-09-19T04:47:52.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.086+0000 7fe7a2119740 20 client.15066 trim_cache size 0 max 16384 2024-09-19T04:47:52.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.104+0000 7fe7a2119740 1 Processor -- start 2024-09-19T04:47:52.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.104+0000 7fe7a2119740 1 -- start start 2024-09-19T04:47:52.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.104+0000 7fe7a2119740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632093fb9d0 0x563209418b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:52.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.104+0000 7fe7a2119740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632093fc2f0 0x5632094165b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:52.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.104+0000 7fe7a2119740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563209406bb0 0x563209400a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:52.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.104+0000 7fe7a2119740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563209416ec0 con 0x5632093fc2f0 2024-09-19T04:47:52.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.104+0000 7fe7a2119740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563209417590 con 0x5632093fb9d0 2024-09-19T04:47:52.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.104+0000 7fe7a2119740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x563209417c60 con 0x563209406bb0 2024-09-19T04:47:52.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.104+0000 7fe79dadc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632093fc2f0 0x5632094165b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:52.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.104+0000 7fe79dadc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632093fc2f0 0x5632094165b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45732/0 (socket says 172.21.15.2:45732) 2024-09-19T04:47:52.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.104+0000 7fe79dadc640 1 -- 172.21.15.2:0/4197059231 learned_addr learned my addr 172.21.15.2:0/4197059231 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:47:52.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.104+0000 7fe79d2db640 1 --2- 172.21.15.2:0/4197059231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632093fb9d0 0x563209418b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:52.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.104+0000 7fe79d2db640 1 --2- 172.21.15.2:0/4197059231 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563209406bb0 0x563209400a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:52.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.104+0000 7fe79dadc640 1 -- 172.21.15.2:0/4197059231 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563209406bb0 msgr2=0x563209400a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:47:52.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.104+0000 7fe79dadc640 1 --2- 172.21.15.2:0/4197059231 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563209406bb0 0x563209400a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:52.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.104+0000 7fe79dadc640 1 -- 172.21.15.2:0/4197059231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632093fb9d0 msgr2=0x563209418b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:47:52.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.104+0000 7fe79dadc640 1 --2- 172.21.15.2:0/4197059231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632093fb9d0 0x563209418b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:52.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.104+0000 7fe79dadc640 1 -- 172.21.15.2:0/4197059231 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632093fc120 con 0x5632093fc2f0 2024-09-19T04:47:52.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.105+0000 7fe79d2db640 1 --2- 172.21.15.2:0/4197059231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632093fb9d0 0x563209418b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:47:52.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.105+0000 7fe79dadc640 1 --2- 172.21.15.2:0/4197059231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632093fc2f0 0x5632094165b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe79402a930 tx=0x7fe794001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=198ec36df14623aa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:52.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.105+0000 7fe7837fe640 1 -- 172.21.15.2:0/4197059231 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe794035030 con 0x5632093fc2f0 2024-09-19T04:47:52.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.105+0000 7fe7837fe640 1 -- 172.21.15.2:0/4197059231 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe794031740 con 0x5632093fc2f0 2024-09-19T04:47:52.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.105+0000 7fe7837fe640 1 -- 172.21.15.2:0/4197059231 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe794003bc0 con 0x5632093fc2f0 2024-09-19T04:47:52.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.106+0000 7fe7a2119740 1 -- 172.21.15.2:0/4197059231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632093fc2f0 msgr2=0x5632094165b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:52.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.106+0000 7fe7a2119740 1 --2- 172.21.15.2:0/4197059231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632093fc2f0 0x5632094165b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe79402a930 tx=0x7fe794001e70 comp rx=0 tx=0).stop 2024-09-19T04:47:52.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.106+0000 7fe7a2119740 1 -- 172.21.15.2:0/4197059231 shutdown_connections 2024-09-19T04:47:52.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.106+0000 7fe7a2119740 1 --2- 172.21.15.2:0/4197059231 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563209406bb0 0x563209400a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:52.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.106+0000 7fe7a2119740 1 --2- 172.21.15.2:0/4197059231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632093fc2f0 0x5632094165b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:52.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.106+0000 7fe7a2119740 1 --2- 172.21.15.2:0/4197059231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632093fb9d0 0x563209418b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:52.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.106+0000 7fe7a2119740 1 -- 172.21.15.2:0/4197059231 >> 172.21.15.2:0/4197059231 conn(0x5632093f7f60 msgr2=0x563209402890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:52.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.106+0000 7fe7a2119740 1 -- 172.21.15.2:0/4197059231 shutdown_connections 2024-09-19T04:47:52.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.106+0000 7fe7a2119740 1 -- 172.21.15.2:0/4197059231 wait complete. 2024-09-19T04:47:52.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.106+0000 7fe7a2119740 1 -- start start 2024-09-19T04:47:52.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.106+0000 7fe7a2119740 1 Processor -- start 2024-09-19T04:47:52.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.107+0000 7fe7a2119740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632093fb9d0 0x563209400190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:52.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.107+0000 7fe7a2119740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632093fc2f0 0x5632094006d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:52.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.107+0000 7fe7a2119740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563209406bb0 0x56320941fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:52.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.107+0000 7fe7a2119740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563209418a00 con 0x5632093fc2f0 2024-09-19T04:47:52.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.107+0000 7fe7a2119740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563209418330 con 0x563209406bb0 2024-09-19T04:47:52.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.107+0000 7fe7a2119740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5632094190d0 con 0x5632093fb9d0 2024-09-19T04:47:52.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.107+0000 7fe7a2119740 10 client.0 _ll_register_callbacks cb 0x7fe794009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:47:52.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.107+0000 7fe79dadc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632093fc2f0 0x5632094006d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:52.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.107+0000 7fe79dadc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632093fc2f0 0x5632094006d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45744/0 (socket says 172.21.15.2:45744) 2024-09-19T04:47:52.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.107+0000 7fe79dadc640 1 -- 172.21.15.2:0/953760896 learned_addr learned my addr 172.21.15.2:0/953760896 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:47:52.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.107+0000 7fe79d2db640 1 --2- 172.21.15.2:0/953760896 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632093fb9d0 0x563209400190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:52.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.107+0000 7fe79dadc640 1 -- 172.21.15.2:0/953760896 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632093fb9d0 msgr2=0x563209400190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:47:52.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.107+0000 7fe79d2db640 1 --2- 172.21.15.2:0/953760896 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563209406bb0 0x56320941fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:52.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.107+0000 7fe79dadc640 1 --2- 172.21.15.2:0/953760896 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632093fb9d0 0x563209400190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:52.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.107+0000 7fe79dadc640 1 -- 172.21.15.2:0/953760896 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563209406bb0 msgr2=0x56320941fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:47:52.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.107+0000 7fe79dadc640 1 --2- 172.21.15.2:0/953760896 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563209406bb0 0x56320941fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:52.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.107+0000 7fe79dadc640 1 -- 172.21.15.2:0/953760896 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632094204e0 con 0x5632093fc2f0 2024-09-19T04:47:52.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.108+0000 7fe79dadc640 1 --2- 172.21.15.2:0/953760896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632093fc2f0 0x5632094006d0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe794006010 tx=0x7fe794005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a246070ebdf7932 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:52.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.108+0000 7fe7817fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:47:52.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.108+0000 7fe7817fa640 1 -- 172.21.15.2:0/953760896 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe794031d00 con 0x5632093fc2f0 2024-09-19T04:47:52.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.108+0000 7fe7817fa640 1 -- 172.21.15.2:0/953760896 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7fe794004e90 con 0x5632093fc2f0 2024-09-19T04:47:52.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.108+0000 7fe7a2119740 1 -- 172.21.15.2:0/953760896 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe794031740 con 0x5632093fc2f0 2024-09-19T04:47:52.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.108+0000 7fe7817fa640 1 -- 172.21.15.2:0/953760896 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe7940035f0 con 0x5632093fc2f0 2024-09-19T04:47:52.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.108+0000 7fe7a2119740 10 client.15072 fetch_fsmap learned FSMap version 19 2024-09-19T04:47:52.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.108+0000 7fe7a2119740 1 -- 172.21.15.2:0/953760896 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5632094217a0 con 0x5632093fc2f0 2024-09-19T04:47:52.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.108+0000 7fe7817fa640 1 -- 172.21.15.2:0/953760896 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe794031740 con 0x5632093fc2f0 2024-09-19T04:47:52.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.108+0000 7fe7817fa640 1 -- 172.21.15.2:0/953760896 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fe794003c30 con 0x5632093fc2f0 2024-09-19T04:47:52.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.108+0000 7fe7a2119740 10 client.15072 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:47:52.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.108+0000 7fe7a2119740 10 client.15072 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T04:47:52.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.108+0000 7fe7a2119740 20 client.15072 populate_metadata read hostname 'smithi002' 2024-09-19T04:47:52.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.109+0000 7fe7a2119740 1 --2- 172.21.15.2:0/953760896 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x563209486130 0x563209484e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:52.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.109+0000 7fe7a2119740 4 client.15072 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T04:47:52.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.109+0000 7fe7a2119740 1 -- 172.21.15.2:0/953760896 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "status"}) -- 0x563209369b10 con 0x563209486130 2024-09-19T04:47:52.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.109+0000 7fe79d2db640 1 --2- 172.21.15.2:0/953760896 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x563209486130 0x563209484e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:52.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.109+0000 7fe7817fa640 10 client.15072 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:47:52.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.109+0000 7fe79d2db640 1 --2- 172.21.15.2:0/953760896 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x563209486130 0x563209484e40 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11ce9969de39ea8f server_cookie=5432375e08da7822 in_seq=0 out_seq=0 2024-09-19T04:47:52.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.109+0000 7fe7817fa640 1 -- 172.21.15.2:0/953760896 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x563209369b10 con 0x563209486130 2024-09-19T04:47:52.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.109+0000 7fe7817fa640 10 client.15072 handle_command_reply: tid=0 2024-09-19T04:47:52.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.109+0000 7fe7a2119740 1 client.15072 shutdown 2024-09-19T04:47:52.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.110+0000 7fe7a2119740 1 -- 172.21.15.2:0/953760896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632093fc2f0 msgr2=0x5632094006d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:52.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.110+0000 7fe7a2119740 1 --2- 172.21.15.2:0/953760896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632093fc2f0 0x5632094006d0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe794006010 tx=0x7fe794005c00 comp rx=0 tx=0).stop 2024-09-19T04:47:52.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.110+0000 7fe7a2119740 1 -- 172.21.15.2:0/953760896 shutdown_connections 2024-09-19T04:47:52.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.110+0000 7fe7a2119740 1 --2- 172.21.15.2:0/953760896 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563209406bb0 0x56320941fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:52.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.110+0000 7fe7a2119740 1 --2- 172.21.15.2:0/953760896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632093fc2f0 0x5632094006d0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:52.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.110+0000 7fe7a2119740 1 --2- 172.21.15.2:0/953760896 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x563209486130 0x563209484e40 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:52.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.110+0000 7fe7a2119740 1 --2- 172.21.15.2:0/953760896 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632093fb9d0 0x563209400190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:52.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.110+0000 7fe7817fa640 0 client.15072 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:47:52.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.110+0000 7fe7a2119740 1 -- 172.21.15.2:0/953760896 >> 172.21.15.2:0/953760896 conn(0x5632093f7f60 msgr2=0x5632093fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:52.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.110+0000 7fe7a2119740 1 -- 172.21.15.2:0/953760896 shutdown_connections 2024-09-19T04:47:52.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.110+0000 7fe7a2119740 1 -- 172.21.15.2:0/953760896 wait complete. 2024-09-19T04:47:52.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.110+0000 7fe7a2119740 20 client.15072 trim_cache size 0 max 16384 2024-09-19T04:47:52.122 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:47:52.122 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "d46630c4-7640-11ef-bceb-c7b262605968", 2024-09-19T04:47:52.122 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 0, 2024-09-19T04:47:52.122 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24496, 2024-09-19T04:47:52.123 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-09-19T04:47:52.123 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-09-19T04:47:52.123 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-09-19T04:47:52.123 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 87.606437709999994, 2024-09-19T04:47:52.123 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 19, 2024-09-19T04:47:52.123 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 80, 2024-09-19T04:47:52.123 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 78, 2024-09-19T04:47:52.123 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 106.76233708700001 2024-09-19T04:47:52.123 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:47:52.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.111+0000 7fe79fd40640 1 -- 172.21.15.2:0/1737748636 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe7840a32d0 msgr2=0x7fe7840a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:52.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.111+0000 7fe79fd40640 1 --2- 172.21.15.2:0/1737748636 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe7840a32d0 0x7fe7840a5790 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe790098e20 tx=0x7fe7900a0040 comp rx=0 tx=0).stop 2024-09-19T04:47:52.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.111+0000 7fe79fd40640 1 -- 172.21.15.2:0/1737748636 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe79810e480 msgr2=0x7fe79819ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:52.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.111+0000 7fe79fd40640 1 --2- 172.21.15.2:0/1737748636 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe79810e480 0x7fe79819ee70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe790009fd0 tx=0x7fe79000ee60 comp rx=0 tx=0).stop 2024-09-19T04:47:52.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.111+0000 7fe79fd40640 1 -- 172.21.15.2:0/1737748636 shutdown_connections 2024-09-19T04:47:52.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.111+0000 7fe79fd40640 1 --2- 172.21.15.2:0/1737748636 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7fe7840a32d0 0x7fe7840a5790 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:52.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.111+0000 7fe79fd40640 1 --2- 172.21.15.2:0/1737748636 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe79810e480 0x7fe79819ee70 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:52.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.111+0000 7fe79fd40640 1 --2- 172.21.15.2:0/1737748636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe798101280 0x7fe79819aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:52.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.111+0000 7fe79fd40640 1 --2- 172.21.15.2:0/1737748636 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7981008d0 0x7fe79819a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:52.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.111+0000 7fe79fd40640 1 -- 172.21.15.2:0/1737748636 >> 172.21.15.2:0/1737748636 conn(0x7fe7980fc7a0 msgr2=0x7fe7980feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:52.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.111+0000 7fe79fd40640 1 -- 172.21.15.2:0/1737748636 shutdown_connections 2024-09-19T04:47:52.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.111+0000 7fe79fd40640 1 -- 172.21.15.2:0/1737748636 wait complete. 2024-09-19T04:47:52.710 INFO:teuthology.run_tasks:Running task sequential... 2024-09-19T04:47:52.723 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-19T04:47:52.724 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-19T04:47:52.724 INFO:teuthology.task.print:Enabling mgr modules 2024-09-19T04:47:52.724 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-09-19T04:47:52.725 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T04:47:52.725 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-19T04:47:52.725 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-09-19T04:47:52.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.831+0000 7f0d7039f640 1 -- 172.21.15.2:0/968213637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d68104fb0 msgr2=0x7f0d681073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:52.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.831+0000 7f0d7039f640 1 --2- 172.21.15.2:0/968213637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d68104fb0 0x7f0d681073a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c009900 tx=0x7f0d5c02a410 comp rx=0 tx=0).stop 2024-09-19T04:47:52.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.831+0000 7f0d7039f640 1 -- 172.21.15.2:0/968213637 shutdown_connections 2024-09-19T04:47:52.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.831+0000 7f0d7039f640 1 --2- 172.21.15.2:0/968213637 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d681078e0 0x7f0d68109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:52.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.831+0000 7f0d7039f640 1 --2- 172.21.15.2:0/968213637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d68104fb0 0x7f0d681073a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:52.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.831+0000 7f0d7039f640 1 --2- 172.21.15.2:0/968213637 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d68102680 0x7f0d68104a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:52.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.831+0000 7f0d7039f640 1 -- 172.21.15.2:0/968213637 >> 172.21.15.2:0/968213637 conn(0x7f0d680fc1c0 msgr2=0x7f0d680fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:52.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.831+0000 7f0d7039f640 1 -- 172.21.15.2:0/968213637 shutdown_connections 2024-09-19T04:47:52.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.831+0000 7f0d7039f640 1 -- 172.21.15.2:0/968213637 wait complete. 2024-09-19T04:47:52.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.831+0000 7f0d7039f640 1 Processor -- start 2024-09-19T04:47:52.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.831+0000 7f0d7039f640 1 -- start start 2024-09-19T04:47:52.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.832+0000 7f0d7039f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d68102680 0x7f0d68101ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:52.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.832+0000 7f0d7039f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d68104fb0 0x7f0d68100630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:52.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.832+0000 7f0d7039f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d681078e0 0x7f0d68100b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:52.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.832+0000 7f0d7039f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0d6810d6a0 con 0x7f0d68104fb0 2024-09-19T04:47:52.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.832+0000 7f0d7039f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0d6810d520 con 0x7f0d68102680 2024-09-19T04:47:52.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.832+0000 7f0d7039f640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f0d6810d820 con 0x7f0d681078e0 2024-09-19T04:47:52.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.832+0000 7f0d6d93a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d68104fb0 0x7f0d68100630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:52.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.832+0000 7f0d6d93a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d68104fb0 0x7f0d68100630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45762/0 (socket says 172.21.15.2:45762) 2024-09-19T04:47:52.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.832+0000 7f0d6d93a640 1 -- 172.21.15.2:0/1348188731 learned_addr learned my addr 172.21.15.2:0/1348188731 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:47:52.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.832+0000 7f0d6e13b640 1 --2- 172.21.15.2:0/1348188731 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d68102680 0x7f0d68101ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:52.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.832+0000 7f0d6e93c640 1 --2- 172.21.15.2:0/1348188731 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d681078e0 0x7f0d68100b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:52.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.832+0000 7f0d6d93a640 1 -- 172.21.15.2:0/1348188731 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d681078e0 msgr2=0x7f0d68100b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:52.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.832+0000 7f0d6d93a640 1 --2- 172.21.15.2:0/1348188731 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d681078e0 0x7f0d68100b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:52.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.832+0000 7f0d6d93a640 1 -- 172.21.15.2:0/1348188731 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d68102680 msgr2=0x7f0d68101ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:52.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.832+0000 7f0d6d93a640 1 --2- 172.21.15.2:0/1348188731 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d68102680 0x7f0d68101ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:52.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.832+0000 7f0d6d93a640 1 -- 172.21.15.2:0/1348188731 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d68101400 con 0x7f0d68104fb0 2024-09-19T04:47:52.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.832+0000 7f0d6e13b640 1 --2- 172.21.15.2:0/1348188731 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d68102680 0x7f0d68101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:47:52.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.832+0000 7f0d6d93a640 1 --2- 172.21.15.2:0/1348188731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d68104fb0 0x7f0d68100630 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c0314e0 tx=0x7f0d5c0042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:52.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.832+0000 7f0d677fe640 1 -- 172.21.15.2:0/1348188731 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c03f030 con 0x7f0d68104fb0 2024-09-19T04:47:52.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.832+0000 7f0d677fe640 1 -- 172.21.15.2:0/1348188731 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0d5c003cb0 con 0x7f0d68104fb0 2024-09-19T04:47:52.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.832+0000 7f0d7039f640 1 -- 172.21.15.2:0/1348188731 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d681a1f10 con 0x7f0d68104fb0 2024-09-19T04:47:52.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.832+0000 7f0d677fe640 1 -- 172.21.15.2:0/1348188731 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c035070 con 0x7f0d68104fb0 2024-09-19T04:47:52.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.832+0000 7f0d7039f640 1 -- 172.21.15.2:0/1348188731 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d681a2370 con 0x7f0d68104fb0 2024-09-19T04:47:52.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.833+0000 7f0d7039f640 1 -- 172.21.15.2:0/1348188731 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d680fdcb0 con 0x7f0d68104fb0 2024-09-19T04:47:52.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.835+0000 7f0d677fe640 1 -- 172.21.15.2:0/1348188731 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f0d5c042030 con 0x7f0d68104fb0 2024-09-19T04:47:52.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.835+0000 7f0d677fe640 1 --2- 172.21.15.2:0/1348188731 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f0d500a32d0 0x7f0d500a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:52.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.836+0000 7f0d6e13b640 1 --2- 172.21.15.2:0/1348188731 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f0d500a32d0 0x7f0d500a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:52.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.836+0000 7f0d677fe640 1 -- 172.21.15.2:0/1348188731 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f0d5c0f0410 con 0x7f0d68104fb0 2024-09-19T04:47:52.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.836+0000 7f0d6e13b640 1 --2- 172.21.15.2:0/1348188731 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f0d500a32d0 0x7f0d500a5790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0d58005fd0 tx=0x7f0d58009520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:52.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:52.839+0000 7f0d677fe640 1 -- 172.21.15.2:0/1348188731 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0d5c0bd120 con 0x7f0d68104fb0 2024-09-19T04:47:53.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:53.064+0000 7f0d7039f640 1 -- 172.21.15.2:0/1348188731 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7f0d6802da10 con 0x7f0d68104fb0 2024-09-19T04:47:53.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:52 smithi018 ceph-mon[34537]: pgmap v318: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:47:53.359 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:52 smithi002 ceph-mon[30975]: pgmap v318: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:47:53.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:52 smithi116 ceph-mon[34477]: pgmap v318: 97 pgs: 97 active+clean; 637 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:47:53.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:53.977+0000 7f0d677fe640 1 -- 172.21.15.2:0/1348188731 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v18) ==== 92+0+0 (secure 0 0 0) 0x7f0d5c0bca20 con 0x7f0d68104fb0 2024-09-19T04:47:53.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:53.980+0000 7f0d7039f640 1 -- 172.21.15.2:0/1348188731 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f0d500a32d0 msgr2=0x7f0d500a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:53.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:53.980+0000 7f0d7039f640 1 --2- 172.21.15.2:0/1348188731 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f0d500a32d0 0x7f0d500a5790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0d58005fd0 tx=0x7f0d58009520 comp rx=0 tx=0).stop 2024-09-19T04:47:53.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:53.980+0000 7f0d7039f640 1 -- 172.21.15.2:0/1348188731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d68104fb0 msgr2=0x7f0d68100630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:53.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:53.980+0000 7f0d7039f640 1 --2- 172.21.15.2:0/1348188731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d68104fb0 0x7f0d68100630 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c0314e0 tx=0x7f0d5c0042e0 comp rx=0 tx=0).stop 2024-09-19T04:47:53.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:53.980+0000 7f0d7039f640 1 -- 172.21.15.2:0/1348188731 shutdown_connections 2024-09-19T04:47:53.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:53.980+0000 7f0d7039f640 1 --2- 172.21.15.2:0/1348188731 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f0d500a32d0 0x7f0d500a5790 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:53.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:53.980+0000 7f0d7039f640 1 --2- 172.21.15.2:0/1348188731 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d681078e0 0x7f0d68100b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:53.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:53.980+0000 7f0d7039f640 1 --2- 172.21.15.2:0/1348188731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d68104fb0 0x7f0d68100630 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:53.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:53.980+0000 7f0d7039f640 1 --2- 172.21.15.2:0/1348188731 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d68102680 0x7f0d68101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:53.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:53.980+0000 7f0d7039f640 1 -- 172.21.15.2:0/1348188731 >> 172.21.15.2:0/1348188731 conn(0x7f0d680fc1c0 msgr2=0x7f0d68103120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:53.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:53.980+0000 7f0d7039f640 1 -- 172.21.15.2:0/1348188731 shutdown_connections 2024-09-19T04:47:53.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:53.981+0000 7f0d7039f640 1 -- 172.21.15.2:0/1348188731 wait complete. 2024-09-19T04:47:54.001 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-19T04:47:54.041 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-19T04:47:54.041 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-09-19T04:47:54.041 INFO:tasks.ceph_fuse:client.0 config is {'mount_subvol_num': 0} 2024-09-19T04:47:54.042 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T04:47:54.042 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T04:47:54.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:47:54.042 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-09-19T04:47:54.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:47:54.061 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link delete ceph-brx 2024-09-19T04:47:54.129 INFO:teuthology.orchestra.run.smithi002.stderr:Cannot find device "ceph-brx" 2024-09-19T04:47:54.131 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T04:47:54.131 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-19T04:47:54.131 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-19T04:47:54.132 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-19T04:47:54.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:53 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/1348188731' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-19T04:47:54.307 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:47:54 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: ignoring --setuser ceph since I am not root 2024-09-19T04:47:54.307 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:47:54 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: ignoring --setgroup ceph since I am not root 2024-09-19T04:47:54.307 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:47:54 smithi018 ceph-mgr[35907]: -- 172.21.15.18:0/2375992229 <== mon.2 v2:172.21.15.18:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55997d0f30e0 con 0x55997d0d0800 2024-09-19T04:47:54.308 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:47:54 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:47:54.137+0000 7f81e5ba8040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T04:47:54.308 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:47:54 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:47:54.196+0000 7f81e5ba8040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T04:47:54.333 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:53 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/1348188731' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-19T04:47:54.334 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:47:54 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: ignoring --setuser ceph since I am not root 2024-09-19T04:47:54.334 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:47:54 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: ignoring --setgroup ceph since I am not root 2024-09-19T04:47:54.334 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:47:54 smithi116 ceph-mgr[36293]: -- 172.21.15.116:0/1579030229 <== mon.1 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562cd85850e0 con 0x562cd8563000 2024-09-19T04:47:54.334 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:47:54 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:47:54.128+0000 7fa1ce086040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T04:47:54.334 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:47:54 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:47:54.184+0000 7fa1ce086040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T04:47:54.334 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:47:54 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:47:54.331+0000 7fa1ce086040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T04:47:54.357 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:53 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/1348188731' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-19T04:47:54.357 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:47:54 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: ignoring --setuser ceph since I am not root 2024-09-19T04:47:54.357 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:47:54 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: ignoring --setgroup ceph since I am not root 2024-09-19T04:47:54.357 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:47:54 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:47:54.137+0000 7f564b981040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T04:47:54.357 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:47:54 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:47:54.198+0000 7f564b981040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T04:47:54.357 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:47:54 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:47:54.355+0000 7f564b981040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T04:47:54.436 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:47:54.610 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:47:54 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:47:54.435+0000 7f564b981040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T04:47:54.610 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:47:54 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:47:54.591+0000 7f564b981040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T04:47:54.610 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:47:54 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:47:54.397+0000 7fa1ce086040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T04:47:54.610 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:47:54 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:47:54.542+0000 7fa1ce086040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T04:47:54.723 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:47:54 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:47:54.351+0000 7f81e5ba8040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T04:47:54.724 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:47:54 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:47:54.420+0000 7f81e5ba8040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T04:47:54.724 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:47:54 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:47:54.574+0000 7f81e5ba8040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T04:47:54.724 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:47:54 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:47:54.722+0000 7f81e5ba8040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T04:47:54.959 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:47:54 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:47:54.741+0000 7f564b981040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T04:47:54.979 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:47:54 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:47:54.683+0000 7fa1ce086040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T04:47:55.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.043+0000 7f900ffcd640 1 -- 172.21.15.2:0/2485974844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90081082a0 msgr2=0x7f900810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:55.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.043+0000 7f900ffcd640 1 --2- 172.21.15.2:0/2485974844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90081082a0 0x7f900810ec40 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9000009930 tx=0x7f900002a420 comp rx=0 tx=0).stop 2024-09-19T04:47:55.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.043+0000 7f900ffcd640 1 -- 172.21.15.2:0/2485974844 shutdown_connections 2024-09-19T04:47:55.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.043+0000 7f900ffcd640 1 --2- 172.21.15.2:0/2485974844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90081082a0 0x7f900810ec40 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:55.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.043+0000 7f900ffcd640 1 --2- 172.21.15.2:0/2485974844 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90081036e0 0x7f9008107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:55.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.043+0000 7f900ffcd640 1 --2- 172.21.15.2:0/2485974844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9008102d30 0x7f9008103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:55.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.043+0000 7f900ffcd640 1 -- 172.21.15.2:0/2485974844 >> 172.21.15.2:0/2485974844 conn(0x7f90080fc7d0 msgr2=0x7f90080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:55.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.043+0000 7f900ffcd640 1 -- 172.21.15.2:0/2485974844 shutdown_connections 2024-09-19T04:47:55.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.043+0000 7f900ffcd640 1 -- 172.21.15.2:0/2485974844 wait complete. 2024-09-19T04:47:55.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.043+0000 7f900ffcd640 1 Processor -- start 2024-09-19T04:47:55.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.043+0000 7f900ffcd640 1 -- start start 2024-09-19T04:47:55.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.044+0000 7f900ffcd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9008102d30 0x7f90081984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:55.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.044+0000 7f900ffcd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90081036e0 0x7f9008198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:55.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.044+0000 7f900ffcd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90081082a0 0x7f900819cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:55.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.044+0000 7f900ffcd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9008111f50 con 0x7f90081082a0 2024-09-19T04:47:55.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.044+0000 7f900ffcd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9008111dd0 con 0x7f90081036e0 2024-09-19T04:47:55.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.044+0000 7f900ffcd640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f90081120d0 con 0x7f9008102d30 2024-09-19T04:47:55.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.044+0000 7f900e56a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90081082a0 0x7f900819cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:55.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.044+0000 7f900dd69640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9008102d30 0x7f90081984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:55.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.044+0000 7f900e56a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90081082a0 0x7f900819cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45802/0 (socket says 172.21.15.2:45802) 2024-09-19T04:47:55.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.044+0000 7f900e56a640 1 -- 172.21.15.2:0/935734941 learned_addr learned my addr 172.21.15.2:0/935734941 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:47:55.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.044+0000 7f900d568640 1 --2- 172.21.15.2:0/935734941 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90081036e0 0x7f9008198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:47:55.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.044+0000 7f900dd69640 1 -- 172.21.15.2:0/935734941 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90081036e0 msgr2=0x7f9008198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:55.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.044+0000 7f900dd69640 1 --2- 172.21.15.2:0/935734941 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90081036e0 0x7f9008198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:55.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.044+0000 7f900dd69640 1 -- 172.21.15.2:0/935734941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90081082a0 msgr2=0x7f900819cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:55.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.044+0000 7f900dd69640 1 --2- 172.21.15.2:0/935734941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90081082a0 0x7f900819cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:55.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.044+0000 7f900dd69640 1 -- 172.21.15.2:0/935734941 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f900819d4a0 con 0x7f9008102d30 2024-09-19T04:47:55.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.044+0000 7f900e56a640 1 --2- 172.21.15.2:0/935734941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90081082a0 0x7f900819cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:47:55.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.044+0000 7f900dd69640 1 --2- 172.21.15.2:0/935734941 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9008102d30 0x7f90081984f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc00e9f0 tx=0x7f8ffc00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:47:55.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.045+0000 7f8ffaffd640 1 -- 172.21.15.2:0/935734941 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc00ccc0 con 0x7f9008102d30 2024-09-19T04:47:55.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.045+0000 7f900ffcd640 1 -- 172.21.15.2:0/935734941 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f900819d790 con 0x7f9008102d30 2024-09-19T04:47:55.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.045+0000 7f8ffaffd640 1 -- 172.21.15.2:0/935734941 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8ffc0108e0 con 0x7f9008102d30 2024-09-19T04:47:55.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.045+0000 7f8ffaffd640 1 -- 172.21.15.2:0/935734941 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc018880 con 0x7f9008102d30 2024-09-19T04:47:55.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.045+0000 7f900ffcd640 1 -- 172.21.15.2:0/935734941 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90081a5070 con 0x7f9008102d30 2024-09-19T04:47:55.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.046+0000 7f900ffcd640 1 -- 172.21.15.2:0/935734941 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9008103110 con 0x7f9008102d30 2024-09-19T04:47:55.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.047+0000 7f8ffaffd640 1 -- 172.21.15.2:0/935734941 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 18) ==== 138422+0+0 (secure 0 0 0) 0x7f8ffc010a90 con 0x7f9008102d30 2024-09-19T04:47:55.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.048+0000 7f8ffaffd640 1 --2- 172.21.15.2:0/935734941 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f8ff40a3320 0x7f8ff40a57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:47:55.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.048+0000 7f900d568640 1 -- 172.21.15.2:0/935734941 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f8ff40a3320 msgr2=0x7f8ff40a57e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/3171525177 2024-09-19T04:47:55.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.048+0000 7f8ffaffd640 1 -- 172.21.15.2:0/935734941 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8182+0+0 (secure 0 0 0) 0x7f8ffc0cff60 con 0x7f9008102d30 2024-09-19T04:47:55.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.048+0000 7f900d568640 1 --2- 172.21.15.2:0/935734941 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f8ff40a3320 0x7f8ff40a57e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T04:47:55.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.055+0000 7f8ffaffd640 1 -- 172.21.15.2:0/935734941 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8ffc09c4a0 con 0x7f9008102d30 2024-09-19T04:47:55.243 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:54 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/1348188731' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-19T04:47:55.243 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:54 smithi116 ceph-mon[34477]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T04:47:55.244 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:47:54 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:47:54.994+0000 7fa1ce086040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T04:47:55.244 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:47:55 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:47:55.059+0000 7fa1ce086040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T04:47:55.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.249+0000 7f900d568640 1 -- 172.21.15.2:0/935734941 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f8ff40a3320 msgr2=0x7f8ff40a57e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/3171525177 2024-09-19T04:47:55.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.249+0000 7f900d568640 1 --2- 172.21.15.2:0/935734941 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f8ff40a3320 0x7f8ff40a57e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T04:47:55.250 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:54 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/1348188731' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-19T04:47:55.250 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:54 smithi002 ceph-mon[30975]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T04:47:55.251 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:47:55 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:47:55.081+0000 7f564b981040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T04:47:55.251 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:47:55 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:47:55.145+0000 7f564b981040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T04:47:55.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.269+0000 7f900ffcd640 1 -- 172.21.15.2:0/935734941 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f900810a2b0 con 0x7f9008102d30 2024-09-19T04:47:55.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.270+0000 7f8ffaffd640 1 -- 172.21.15.2:0/935734941 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) ==== 53+0+73 (secure 0 0 0) 0x7f8ffc0a07a0 con 0x7f9008102d30 2024-09-19T04:47:55.273 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T04:47:55.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.272+0000 7f900ffcd640 1 -- 172.21.15.2:0/935734941 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f8ff40a3320 msgr2=0x7f8ff40a57e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T04:47:55.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.272+0000 7f900ffcd640 1 --2- 172.21.15.2:0/935734941 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f8ff40a3320 0x7f8ff40a57e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:55.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.272+0000 7f900ffcd640 1 -- 172.21.15.2:0/935734941 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9008102d30 msgr2=0x7f90081984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:47:55.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.272+0000 7f900ffcd640 1 --2- 172.21.15.2:0/935734941 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9008102d30 0x7f90081984f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc00e9f0 tx=0x7f8ffc00eeb0 comp rx=0 tx=0).stop 2024-09-19T04:47:55.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.272+0000 7f900ffcd640 1 -- 172.21.15.2:0/935734941 shutdown_connections 2024-09-19T04:47:55.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.272+0000 7f900ffcd640 1 --2- 172.21.15.2:0/935734941 >> [v2:172.21.15.2:6800/3171525177,v1:172.21.15.2:6801/3171525177] conn(0x7f8ff40a3320 0x7f8ff40a57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:55.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.272+0000 7f900ffcd640 1 --2- 172.21.15.2:0/935734941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90081082a0 0x7f900819cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:55.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.272+0000 7f900ffcd640 1 --2- 172.21.15.2:0/935734941 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90081036e0 0x7f9008198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:55.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.272+0000 7f900ffcd640 1 --2- 172.21.15.2:0/935734941 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9008102d30 0x7f90081984f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:47:55.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.272+0000 7f900ffcd640 1 -- 172.21.15.2:0/935734941 >> 172.21.15.2:0/935734941 conn(0x7f90080fc7d0 msgr2=0x7f9008105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:47:55.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.272+0000 7f900ffcd640 1 -- 172.21.15.2:0/935734941 shutdown_connections 2024-09-19T04:47:55.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:55.272+0000 7f900ffcd640 1 -- 172.21.15.2:0/935734941 wait complete. 2024-09-19T04:47:55.306 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:54 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/1348188731' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-19T04:47:55.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:54 smithi018 ceph-mon[34537]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T04:47:55.307 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:47:55 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:47:55.051+0000 7f81e5ba8040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T04:47:55.307 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:47:55 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:47:55.114+0000 7f81e5ba8040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T04:47:55.610 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:47:55 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:47:55.346+0000 7f564b981040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T04:47:55.610 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:47:55 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:47:55.241+0000 7fa1ce086040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T04:47:55.806 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:47:55 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:47:55.309+0000 7f81e5ba8040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T04:47:56.006 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:55 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/935734941' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T04:47:56.007 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T04:47:56.007 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T04:47:56.007 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi002.front.sepia.ceph.com 2024-09-19T04:47:56.007 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T04:47:56.007 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T04:47:56.007 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T04:47:56.007 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T04:47:56.008 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T04:47:56.008 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T04:47:56.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:47:56.008 DEBUG:teuthology.orchestra.run.smithi002:> ip addr 2024-09-19T04:47:56.025 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T04:47:56.025 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T04:47:56.025 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T04:47:56.025 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-09-19T04:47:56.025 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2024-09-19T04:47:56.026 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-09-19T04:47:56.026 INFO:teuthology.orchestra.run.smithi002.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T04:47:56.026 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:02 brd ff:ff:ff:ff:ff:ff 2024-09-19T04:47:56.026 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f0 2024-09-19T04:47:56.026 INFO:teuthology.orchestra.run.smithi002.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T04:47:56.026 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:03 brd ff:ff:ff:ff:ff:ff 2024-09-19T04:47:56.026 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f1 2024-09-19T04:47:56.026 INFO:teuthology.orchestra.run.smithi002.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T04:47:56.026 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:20 brd ff:ff:ff:ff:ff:ff 2024-09-19T04:47:56.027 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f0 2024-09-19T04:47:56.027 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.21.15.2/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-19T04:47:56.027 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft 42204sec preferred_lft 42204sec 2024-09-19T04:47:56.027 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::ec4:7aff:febd:1920/64 scope link 2024-09-19T04:47:56.027 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-09-19T04:47:56.027 INFO:teuthology.orchestra.run.smithi002.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T04:47:56.027 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:21 brd ff:ff:ff:ff:ff:ff 2024-09-19T04:47:56.027 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f1 2024-09-19T04:47:56.027 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T04:47:56.028 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T04:47:56.028 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-19T04:47:56.028 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add name ceph-brx type bridge 2024-09-19T04:47:56.028 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip addr flush dev ceph-brx 2024-09-19T04:47:56.028 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set ceph-brx up 2024-09-19T04:47:56.028 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T04:47:56.028 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-19T04:47:56.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T04:47:56.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T04:47:56.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:47:56.232 DEBUG:teuthology.orchestra.run.smithi002:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T04:47:56.234 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:55 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/935734941' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T04:47:56.259 INFO:teuthology.orchestra.run.smithi002.stdout:1 2024-09-19T04:47:56.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:47:56.261 DEBUG:teuthology.orchestra.run.smithi002:> route 2024-09-19T04:47:56.331 INFO:teuthology.orchestra.run.smithi002.stdout:Kernel IP routing table 2024-09-19T04:47:56.332 INFO:teuthology.orchestra.run.smithi002.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T04:47:56.332 INFO:teuthology.orchestra.run.smithi002.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-19T04:47:56.332 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-19T04:47:56.332 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T04:47:56.334 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T04:47:56.334 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-19T04:47:56.334 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-19T04:47:56.334 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-19T04:47:56.336 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-19T04:47:56.336 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-19T04:47:56.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:55 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/935734941' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T04:47:56.360 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:47:56 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:47:56.120+0000 7fa1ce086040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T04:47:56.361 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:47:56 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:47:56.187+0000 7fa1ce086040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T04:47:56.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T04:47:56.527 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:47:56 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:47:56.296+0000 7f564b981040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T04:47:56.527 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:47:56 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:47:56.367+0000 7f564b981040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T04:47:56.556 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:47:56 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:47:56.233+0000 7f81e5ba8040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T04:47:56.557 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:47:56 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:47:56.303+0000 7f81e5ba8040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T04:47:56.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T04:47:56.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:47:56.630 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-09-19T04:47:56.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:47:56.647 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list-id 2024-09-19T04:47:56.703 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T04:47:56.703 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-19T04:47:56.703 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T04:47:56.703 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-19T04:47:56.703 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-19T04:47:56.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T04:47:56.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T04:47:56.824 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-19T04:47:56.825 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T04:47:56.825 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-19T04:47:56.825 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-19T04:47:56.825 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T04:47:56.825 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-19T04:47:56.825 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-19T04:47:56.825 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-19T04:47:56.825 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-19T04:47:56.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T04:47:56.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T04:47:56.959 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T04:47:56.959 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-19T04:47:56.959 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.0 up 2024-09-19T04:47:56.959 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T04:47:56.960 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-19T04:47:57.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T04:47:57.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:47:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T04:47:57.047 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mount_subvol_num': 0} 2024-09-19T04:47:57.047 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T04:47:57.047 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T04:47:57.063 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T04:47:57.063 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T04:47:57.063 DEBUG:teuthology.orchestra.run.smithi002:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T04:47:57.119 DEBUG:teuthology.orchestra.run.smithi002:> sudo modprobe fuse 2024-09-19T04:47:57.152 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:47:56 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:47:56.891+0000 7fa1ce086040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T04:47:57.152 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:47:57 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:47:57.006+0000 7fa1ce086040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T04:47:57.186 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T04:47:57.243 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2024-09-19T04:47:57.243 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2024-09-19T04:47:57.244 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2024-09-19T04:47:57.244 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2024-09-19T04:47:57.244 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2024-09-19T04:47:57.244 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2024-09-19T04:47:57.244 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2024-09-19T04:47:57.244 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2024-09-19T04:47:57.244 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2024-09-19T04:47:57.244 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2024-09-19T04:47:57.244 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2024-09-19T04:47:57.244 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/selinux 2024-09-19T04:47:57.244 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T04:47:57.244 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2024-09-19T04:47:57.244 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2024-09-19T04:47:57.245 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2024-09-19T04:47:57.245 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2024-09-19T04:47:57.245 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T04:47:57.245 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2024-09-19T04:47:57.245 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2024-09-19T04:47:57.245 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T04:47:57.245 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T04:47:57.245 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T04:47:57.245 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2024-09-19T04:47:57.245 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2024-09-19T04:47:57.245 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay 2024-09-19T04:47:57.245 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/5c77a11fb8c5413044823965114d222527f5544e84e258ee0d8a58953cd44084/merged 2024-09-19T04:47:57.245 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/0e6aa44e34a46344b1ebfa79287ad3f0eb5a35840a792c33079e3d8e5d6d812c/merged 2024-09-19T04:47:57.246 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/0 2024-09-19T04:47:57.246 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T04:47:57.246 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/83ac9121c7c6ad4e0fbc61c026a5f5009c432eb34142dc0d17c75f4847f4e17a/merged 2024-09-19T04:47:57.246 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/c9bbfc60229d2349c11af9b3d11ccae77b66fa404a70d3c38d514928adc14258/merged 2024-09-19T04:47:57.246 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/ab9f1a5f4796813962662915c6390a373df0657935afb56f75f9ab348d6fdb2e/merged 2024-09-19T04:47:57.246 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/b2f209ac574f0387e3415ae660327b422936448023e4ae327561940ad3cd4e49/merged 2024-09-19T04:47:57.246 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/4eb02583ab7ac2272259c511880155947f60ec11f9c42cfe8494eb5c0253b176/merged 2024-09-19T04:47:57.246 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/a58d469e5bf00d491b17ba9c93833e466b836d494997d9d5feb2e531b16365f7/merged 2024-09-19T04:47:57.246 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/f493a6fc7868cfe14872f02a1aa04da65c9bc96dbfad967c72d8e6a7f4d1fc85/merged 2024-09-19T04:47:57.246 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/768faf41d275a5cb970d71fbea471dde85cc0e5d89ca97bafc1086271c252ca7/merged 2024-09-19T04:47:57.246 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2024-09-19T04:47:57.246 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T04:47:57.246 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T04:47:57.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:47:57.247 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2024-09-19T04:47:57.300 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-19T04:47:57.301 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/volumes/qa/sv_0/b818eb68-79b7-4204-bd66-083d29d75e70 --client_fs=cephfs) 2024-09-19T04:47:57.306 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:47:57 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:47:57.051+0000 7f81e5ba8040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T04:47:57.306 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:47:57 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:47:57.172+0000 7f81e5ba8040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T04:47:57.343 DEBUG:teuthology.orchestra.run.smithi002:> sudo modprobe fuse 2024-09-19T04:47:57.370 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T04:47:57.421 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:47:57 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:47:57.143+0000 7f564b981040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T04:47:57.422 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:47:57 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:47:57.266+0000 7f564b981040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T04:47:57.426 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:47:57 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:47:57.150+0000 7fa1ce086040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T04:47:57.426 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:47:57 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:47:57.210+0000 7fa1ce086040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T04:47:57.426 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:47:57 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:47:57.357+0000 7fa1ce086040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T04:47:57.426 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:47:57 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:47:57.424+0000 7fa1ce086040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T04:47:57.427 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2024-09-19T04:47:57.427 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2024-09-19T04:47:57.427 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2024-09-19T04:47:57.428 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2024-09-19T04:47:57.428 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2024-09-19T04:47:57.428 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2024-09-19T04:47:57.428 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2024-09-19T04:47:57.428 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2024-09-19T04:47:57.428 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2024-09-19T04:47:57.428 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2024-09-19T04:47:57.428 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2024-09-19T04:47:57.428 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/selinux 2024-09-19T04:47:57.428 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T04:47:57.429 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2024-09-19T04:47:57.429 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2024-09-19T04:47:57.429 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2024-09-19T04:47:57.429 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2024-09-19T04:47:57.429 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T04:47:57.429 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2024-09-19T04:47:57.429 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2024-09-19T04:47:57.429 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T04:47:57.429 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T04:47:57.429 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T04:47:57.430 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2024-09-19T04:47:57.430 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2024-09-19T04:47:57.430 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay 2024-09-19T04:47:57.430 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/5c77a11fb8c5413044823965114d222527f5544e84e258ee0d8a58953cd44084/merged 2024-09-19T04:47:57.430 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/0e6aa44e34a46344b1ebfa79287ad3f0eb5a35840a792c33079e3d8e5d6d812c/merged 2024-09-19T04:47:57.430 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/0 2024-09-19T04:47:57.430 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T04:47:57.430 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/83ac9121c7c6ad4e0fbc61c026a5f5009c432eb34142dc0d17c75f4847f4e17a/merged 2024-09-19T04:47:57.430 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/c9bbfc60229d2349c11af9b3d11ccae77b66fa404a70d3c38d514928adc14258/merged 2024-09-19T04:47:57.430 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/ab9f1a5f4796813962662915c6390a373df0657935afb56f75f9ab348d6fdb2e/merged 2024-09-19T04:47:57.430 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/b2f209ac574f0387e3415ae660327b422936448023e4ae327561940ad3cd4e49/merged 2024-09-19T04:47:57.430 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/4eb02583ab7ac2272259c511880155947f60ec11f9c42cfe8494eb5c0253b176/merged 2024-09-19T04:47:57.430 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/a58d469e5bf00d491b17ba9c93833e466b836d494997d9d5feb2e531b16365f7/merged 2024-09-19T04:47:57.431 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/f493a6fc7868cfe14872f02a1aa04da65c9bc96dbfad967c72d8e6a7f4d1fc85/merged 2024-09-19T04:47:57.431 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/768faf41d275a5cb970d71fbea471dde85cc0e5d89ca97bafc1086271c252ca7/merged 2024-09-19T04:47:57.431 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2024-09-19T04:47:57.431 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T04:47:57.431 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T04:47:57.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:47:57.433 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2024-09-19T04:47:57.467 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:2024-09-19T04:47:57.466+0000 7f8704b22480 -1 init, newargv = 0x55fd8e5e9b40 newargc=15 2024-09-19T04:47:57.467 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:ceph-fuse[81449]: starting ceph client 2024-09-19T04:47:57.617 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:47:57 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:47:57.321+0000 7f81e5ba8040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T04:47:57.617 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:47:57 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:47:57.385+0000 7f81e5ba8040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T04:47:57.617 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:47:57 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:47:57.544+0000 7f81e5ba8040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T04:47:57.713 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:47:57 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:47:57.485+0000 7fa1ce086040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T04:47:57.713 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:47:57 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:47:57.645+0000 7fa1ce086040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T04:47:57.719 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:47:57 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:47:57.420+0000 7f564b981040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T04:47:57.719 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:47:57 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:47:57.489+0000 7f564b981040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T04:47:57.719 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:47:57 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:47:57.646+0000 7f564b981040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T04:47:57.719 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:47:57 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:47:57.718+0000 7f564b981040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T04:47:57.905 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:47:57 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:47:57.615+0000 7f81e5ba8040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T04:47:57.905 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:47:57 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:47:57.678+0000 7f81e5ba8040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T04:47:57.905 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:47:57 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:47:57.845+0000 7f81e5ba8040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T04:47:57.979 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:47:57 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:47:57.711+0000 7fa1ce086040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T04:47:57.979 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:47:57 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:47:57.778+0000 7fa1ce086040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T04:47:57.979 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:47:57 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:47:57.859+0000 7fa1ce086040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T04:47:57.979 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:47:57 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:47:57.918+0000 7fa1ce086040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T04:47:57.979 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:47:57 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:47:57.977+0000 7fa1ce086040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T04:47:58.017 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:47:57 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:47:57.781+0000 7f564b981040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T04:47:58.018 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:47:57 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:47:57.947+0000 7f564b981040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T04:47:58.018 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:47:58 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:47:58.016+0000 7f564b981040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T04:47:58.211 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:47:57 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:47:57.930+0000 7f81e5ba8040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T04:47:58.211 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:47:58 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:47:58.000+0000 7f81e5ba8040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T04:47:58.212 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:47:58 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:47:58.086+0000 7f81e5ba8040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T04:47:58.212 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:47:58 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:47:58.148+0000 7f81e5ba8040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T04:47:58.212 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:47:58 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:47:58.210+0000 7f81e5ba8040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T04:47:58.298 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:47:58 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:47:58.086+0000 7f564b981040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T04:47:58.298 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:47:58 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:47:58.172+0000 7f564b981040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T04:47:58.298 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:47:58 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:47:58.235+0000 7f564b981040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T04:47:58.298 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:47:58 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:47:58.296+0000 7f564b981040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T04:47:58.585 DEBUG:teuthology.orchestra.run.smithi002:> sudo modprobe fuse 2024-09-19T04:47:58.612 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T04:47:58.669 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2024-09-19T04:47:58.669 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2024-09-19T04:47:58.669 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2024-09-19T04:47:58.669 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2024-09-19T04:47:58.669 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2024-09-19T04:47:58.670 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2024-09-19T04:47:58.670 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2024-09-19T04:47:58.670 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2024-09-19T04:47:58.670 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2024-09-19T04:47:58.670 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2024-09-19T04:47:58.670 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2024-09-19T04:47:58.670 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/selinux 2024-09-19T04:47:58.670 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T04:47:58.670 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2024-09-19T04:47:58.670 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2024-09-19T04:47:58.670 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2024-09-19T04:47:58.670 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2024-09-19T04:47:58.670 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T04:47:58.671 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2024-09-19T04:47:58.671 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2024-09-19T04:47:58.671 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T04:47:58.671 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T04:47:58.671 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T04:47:58.671 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2024-09-19T04:47:58.671 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2024-09-19T04:47:58.671 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay 2024-09-19T04:47:58.672 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/5c77a11fb8c5413044823965114d222527f5544e84e258ee0d8a58953cd44084/merged 2024-09-19T04:47:58.672 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/0e6aa44e34a46344b1ebfa79287ad3f0eb5a35840a792c33079e3d8e5d6d812c/merged 2024-09-19T04:47:58.672 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/0 2024-09-19T04:47:58.672 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T04:47:58.672 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/83ac9121c7c6ad4e0fbc61c026a5f5009c432eb34142dc0d17c75f4847f4e17a/merged 2024-09-19T04:47:58.672 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/c9bbfc60229d2349c11af9b3d11ccae77b66fa404a70d3c38d514928adc14258/merged 2024-09-19T04:47:58.672 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/ab9f1a5f4796813962662915c6390a373df0657935afb56f75f9ab348d6fdb2e/merged 2024-09-19T04:47:58.672 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/b2f209ac574f0387e3415ae660327b422936448023e4ae327561940ad3cd4e49/merged 2024-09-19T04:47:58.672 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/4eb02583ab7ac2272259c511880155947f60ec11f9c42cfe8494eb5c0253b176/merged 2024-09-19T04:47:58.672 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/a58d469e5bf00d491b17ba9c93833e466b836d494997d9d5feb2e531b16365f7/merged 2024-09-19T04:47:58.672 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/f493a6fc7868cfe14872f02a1aa04da65c9bc96dbfad967c72d8e6a7f4d1fc85/merged 2024-09-19T04:47:58.672 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/768faf41d275a5cb970d71fbea471dde85cc0e5d89ca97bafc1086271c252ca7/merged 2024-09-19T04:47:58.673 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2024-09-19T04:47:58.673 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T04:47:58.673 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T04:47:58.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:47:58.673 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2024-09-19T04:47:58.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:58 smithi002 ceph-mon[30975]: Standby manager daemon z restarted 2024-09-19T04:47:58.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:58 smithi002 ceph-mon[30975]: Standby manager daemon z started 2024-09-19T04:47:58.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:58 smithi002 ceph-mon[30975]: from='mgr.? 172.21.15.116:0/636370757' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T04:47:58.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:58 smithi002 ceph-mon[30975]: from='mgr.? 172.21.15.116:0/636370757' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T04:47:58.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:58 smithi002 ceph-mon[30975]: from='mgr.? 172.21.15.116:0/636370757' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T04:47:58.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:58 smithi002 ceph-mon[30975]: from='mgr.? 172.21.15.116:0/636370757' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T04:47:59.110 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 04:47:58 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z[36289]: 2024-09-19T04:47:58.767+0000 7fa1ce086040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T04:47:59.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:58 smithi116 ceph-mon[34477]: Standby manager daemon z restarted 2024-09-19T04:47:59.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:58 smithi116 ceph-mon[34477]: Standby manager daemon z started 2024-09-19T04:47:59.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:58 smithi116 ceph-mon[34477]: from='mgr.? 172.21.15.116:0/636370757' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T04:47:59.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:58 smithi116 ceph-mon[34477]: from='mgr.? 172.21.15.116:0/636370757' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T04:47:59.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:58 smithi116 ceph-mon[34477]: from='mgr.? 172.21.15.116:0/636370757' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T04:47:59.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:58 smithi116 ceph-mon[34477]: from='mgr.? 172.21.15.116:0/636370757' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T04:47:59.179 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:ceph-fuse[81449]: starting fuse 2024-09-19T04:47:59.307 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 04:47:59 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y[35903]: 2024-09-19T04:47:59.050+0000 7f81e5ba8040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T04:47:59.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:58 smithi018 ceph-mon[34537]: Standby manager daemon z restarted 2024-09-19T04:47:59.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:58 smithi018 ceph-mon[34537]: Standby manager daemon z started 2024-09-19T04:47:59.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:58 smithi018 ceph-mon[34537]: from='mgr.? 172.21.15.116:0/636370757' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T04:47:59.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:58 smithi018 ceph-mon[34537]: from='mgr.? 172.21.15.116:0/636370757' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T04:47:59.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:58 smithi018 ceph-mon[34537]: from='mgr.? 172.21.15.116:0/636370757' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T04:47:59.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:58 smithi018 ceph-mon[34537]: from='mgr.? 172.21.15.116:0/636370757' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T04:47:59.409 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:47:59.138+0000 7f564b981040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T04:47:59.716 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:47:59.407+0000 7f55b62d9640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:47:59.717 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:47:59.407+0000 7f55b62d9640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:47:59.717 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:47:59.408+0000 7f55b62d9640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:47:59.717 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:47:59.408+0000 7f55b62d9640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:47:59.717 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:47:59.408+0000 7f55b62d9640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:47:59.717 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:47:59.409+0000 7f55b2a92640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:47:59.717 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:47:59.409+0000 7f55b2a92640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:47:59.717 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:47:59.409+0000 7f55b2a92640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:47:59.717 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:47:59.409+0000 7f55b2a92640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:47:59.717 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:47:59.409+0000 7f55b2a92640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:47:59.826 DEBUG:teuthology.orchestra.run.smithi002:> sudo modprobe fuse 2024-09-19T04:47:59.857 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T04:47:59.914 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2024-09-19T04:47:59.914 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2024-09-19T04:47:59.914 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2024-09-19T04:47:59.914 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2024-09-19T04:47:59.914 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2024-09-19T04:47:59.914 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2024-09-19T04:47:59.914 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2024-09-19T04:47:59.914 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2024-09-19T04:47:59.914 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2024-09-19T04:47:59.914 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2024-09-19T04:47:59.915 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2024-09-19T04:47:59.915 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/selinux 2024-09-19T04:47:59.915 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T04:47:59.915 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2024-09-19T04:47:59.915 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2024-09-19T04:47:59.915 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2024-09-19T04:47:59.915 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2024-09-19T04:47:59.915 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T04:47:59.915 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2024-09-19T04:47:59.915 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2024-09-19T04:47:59.915 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T04:47:59.915 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T04:47:59.915 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T04:47:59.916 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2024-09-19T04:47:59.916 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2024-09-19T04:47:59.916 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay 2024-09-19T04:47:59.916 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/5c77a11fb8c5413044823965114d222527f5544e84e258ee0d8a58953cd44084/merged 2024-09-19T04:47:59.916 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/0e6aa44e34a46344b1ebfa79287ad3f0eb5a35840a792c33079e3d8e5d6d812c/merged 2024-09-19T04:47:59.916 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/0 2024-09-19T04:47:59.916 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T04:47:59.916 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/83ac9121c7c6ad4e0fbc61c026a5f5009c432eb34142dc0d17c75f4847f4e17a/merged 2024-09-19T04:47:59.916 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/c9bbfc60229d2349c11af9b3d11ccae77b66fa404a70d3c38d514928adc14258/merged 2024-09-19T04:47:59.916 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/ab9f1a5f4796813962662915c6390a373df0657935afb56f75f9ab348d6fdb2e/merged 2024-09-19T04:47:59.916 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/b2f209ac574f0387e3415ae660327b422936448023e4ae327561940ad3cd4e49/merged 2024-09-19T04:47:59.916 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/4eb02583ab7ac2272259c511880155947f60ec11f9c42cfe8494eb5c0253b176/merged 2024-09-19T04:47:59.916 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/a58d469e5bf00d491b17ba9c93833e466b836d494997d9d5feb2e531b16365f7/merged 2024-09-19T04:47:59.917 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/f493a6fc7868cfe14872f02a1aa04da65c9bc96dbfad967c72d8e6a7f4d1fc85/merged 2024-09-19T04:47:59.917 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/768faf41d275a5cb970d71fbea471dde85cc0e5d89ca97bafc1086271c252ca7/merged 2024-09-19T04:47:59.917 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2024-09-19T04:47:59.917 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T04:47:59.917 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T04:47:59.917 INFO:teuthology.orchestra.run.smithi002.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-19T04:47:59.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:47:59.917 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2024-09-19T04:47:59.970 INFO:teuthology.orchestra.run.smithi002.stdout:120 2024-09-19T04:47:59.970 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-19T04:47:59.970 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer -- python3 -c ' 2024-09-19T04:47:59.970 DEBUG:teuthology.orchestra.run.smithi002:> import glob 2024-09-19T04:47:59.970 DEBUG:teuthology.orchestra.run.smithi002:> import re 2024-09-19T04:47:59.971 DEBUG:teuthology.orchestra.run.smithi002:> import os 2024-09-19T04:47:59.971 DEBUG:teuthology.orchestra.run.smithi002:> import subprocess 2024-09-19T04:47:59.971 DEBUG:teuthology.orchestra.run.smithi002:> 2024-09-19T04:47:59.971 DEBUG:teuthology.orchestra.run.smithi002:> def _find_admin_socket(client_name): 2024-09-19T04:47:59.971 DEBUG:teuthology.orchestra.run.smithi002:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-19T04:47:59.971 DEBUG:teuthology.orchestra.run.smithi002:> files = glob.glob(asok_path) 2024-09-19T04:47:59.971 DEBUG:teuthology.orchestra.run.smithi002:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-19T04:47:59.971 DEBUG:teuthology.orchestra.run.smithi002:> 2024-09-19T04:47:59.971 DEBUG:teuthology.orchestra.run.smithi002:> # Given a non-glob path, it better be there 2024-09-19T04:47:59.971 DEBUG:teuthology.orchestra.run.smithi002:> if "*" not in asok_path: 2024-09-19T04:47:59.971 DEBUG:teuthology.orchestra.run.smithi002:> assert(len(files) == 1) 2024-09-19T04:47:59.971 DEBUG:teuthology.orchestra.run.smithi002:> return files[0] 2024-09-19T04:47:59.971 DEBUG:teuthology.orchestra.run.smithi002:> 2024-09-19T04:47:59.971 DEBUG:teuthology.orchestra.run.smithi002:> for f in files: 2024-09-19T04:47:59.972 DEBUG:teuthology.orchestra.run.smithi002:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-19T04:47:59.972 DEBUG:teuthology.orchestra.run.smithi002:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-19T04:47:59.972 DEBUG:teuthology.orchestra.run.smithi002:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-19T04:47:59.972 DEBUG:teuthology.orchestra.run.smithi002:> contents = proc_f.read() 2024-09-19T04:47:59.972 DEBUG:teuthology.orchestra.run.smithi002:> if mountpoint in contents: 2024-09-19T04:47:59.972 DEBUG:teuthology.orchestra.run.smithi002:> return f 2024-09-19T04:47:59.972 DEBUG:teuthology.orchestra.run.smithi002:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-19T04:47:59.972 DEBUG:teuthology.orchestra.run.smithi002:> 2024-09-19T04:47:59.972 DEBUG:teuthology.orchestra.run.smithi002:> print(_find_admin_socket("client.0")) 2024-09-19T04:47:59.972 DEBUG:teuthology.orchestra.run.smithi002:> ' 2024-09-19T04:48:00.036 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-mon[30975]: mgrmap e19: x(active, since 8m), standbys: y, z 2024-09-19T04:48:00.036 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-mon[30975]: Standby manager daemon y restarted 2024-09-19T04:48:00.036 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-mon[30975]: Standby manager daemon y started 2024-09-19T04:48:00.036 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-mon[30975]: from='mgr.? 172.21.15.18:0/2300943416' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T04:48:00.037 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-mon[30975]: from='mgr.? 172.21.15.18:0/2300943416' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T04:48:00.037 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-mon[30975]: from='mgr.? 172.21.15.18:0/2300943416' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T04:48:00.037 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-mon[30975]: from='mgr.? 172.21.15.18:0/2300943416' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T04:48:00.037 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-mon[30975]: Active manager daemon x restarted 2024-09-19T04:48:00.037 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-mon[30975]: Activating manager daemon x 2024-09-19T04:48:00.037 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-mon[30975]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T04:48:00.037 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-mon[30975]: mgrmap e20: x(active, starting, since 0.011118s), standbys: y, z 2024-09-19T04:48:00.037 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:48:00.037 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:48:00.037 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:48:00.037 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T04:48:00.037 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T04:48:00.038 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T04:48:00.038 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T04:48:00.038 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T04:48:00.038 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T04:48:00.038 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T04:48:00.038 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T04:48:00.038 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T04:48:00.038 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T04:48:00.038 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T04:48:00.038 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T04:48:00.038 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T04:48:00.038 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T04:48:00.039 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T04:48:00.039 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T04:48:00.039 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T04:48:00.039 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T04:48:00.039 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:48:00.039 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:48:00.039 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:48:00.039 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:48:00.039 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:48:00.039 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:48:00.039 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:48:00.039 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:48:00.039 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:48:00.039 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:48:00.040 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:48:00.040 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:48:00.040 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-mon[30975]: Manager daemon x is now available 2024-09-19T04:48:00.040 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:48:00.040 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T04:48:00.040 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:47:59 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T04:48:00.105 INFO:teuthology.orchestra.run.smithi002.stdout:/var/run/ceph/ceph-client.0.81449.asok 2024-09-19T04:48:00.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T04:48:00.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:59 smithi116 ceph-mon[34477]: mgrmap e19: x(active, since 8m), standbys: y, z 2024-09-19T04:48:00.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:59 smithi116 ceph-mon[34477]: Standby manager daemon y restarted 2024-09-19T04:48:00.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:59 smithi116 ceph-mon[34477]: Standby manager daemon y started 2024-09-19T04:48:00.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:59 smithi116 ceph-mon[34477]: from='mgr.? 172.21.15.18:0/2300943416' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T04:48:00.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:59 smithi116 ceph-mon[34477]: from='mgr.? 172.21.15.18:0/2300943416' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T04:48:00.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:59 smithi116 ceph-mon[34477]: from='mgr.? 172.21.15.18:0/2300943416' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T04:48:00.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:59 smithi116 ceph-mon[34477]: from='mgr.? 172.21.15.18:0/2300943416' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T04:48:00.112 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:59 smithi116 ceph-mon[34477]: Active manager daemon x restarted 2024-09-19T04:48:00.112 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:59 smithi116 ceph-mon[34477]: Activating manager daemon x 2024-09-19T04:48:00.112 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:59 smithi116 ceph-mon[34477]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T04:48:00.112 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:59 smithi116 ceph-mon[34477]: mgrmap e20: x(active, starting, since 0.011118s), standbys: y, z 2024-09-19T04:48:00.112 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:59 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:48:00.112 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:59 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:48:00.112 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:59 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:48:00.112 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:59 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T04:48:00.112 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:59 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T04:48:00.112 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:59 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T04:48:00.112 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:59 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T04:48:00.112 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:59 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T04:48:00.113 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:59 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T04:48:00.113 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:59 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T04:48:00.113 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:59 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T04:48:00.113 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:59 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T04:48:00.113 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:59 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T04:48:00.113 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:59 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T04:48:00.113 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:59 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T04:48:00.113 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:59 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T04:48:00.113 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:59 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T04:48:00.113 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:59 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T04:48:00.113 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:59 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T04:48:00.113 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:59 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T04:48:00.113 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:59 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T04:48:00.114 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:59 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:48:00.114 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:59 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:48:00.114 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:59 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:48:00.114 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:59 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:48:00.114 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:59 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:48:00.114 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:59 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:48:00.114 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:59 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:48:00.114 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:59 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:48:00.114 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:59 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:48:00.114 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:59 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:48:00.114 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:59 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:48:00.114 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:59 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:48:00.114 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:59 smithi116 ceph-mon[34477]: Manager daemon x is now available 2024-09-19T04:48:00.114 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:59 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:48:00.115 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:59 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T04:48:00.115 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:47:59 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T04:48:00.117 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.81449.asok 2024-09-19T04:48:00.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:48:00.117 DEBUG:teuthology.orchestra.run.smithi002:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.81449.asok status 2024-09-19T04:48:00.266 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:48:00.266 INFO:teuthology.orchestra.run.smithi002.stdout: "metadata": { 2024-09-19T04:48:00.266 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_sha1": "2f599a46ad10e37c929e5c43da2f6907ddcd1961", 2024-09-19T04:48:00.267 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T04:48:00.267 INFO:teuthology.orchestra.run.smithi002.stdout: "entity_id": "0", 2024-09-19T04:48:00.267 INFO:teuthology.orchestra.run.smithi002.stdout: "hostname": "smithi002", 2024-09-19T04:48:00.267 INFO:teuthology.orchestra.run.smithi002.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-19T04:48:00.267 INFO:teuthology.orchestra.run.smithi002.stdout: "pid": "81449", 2024-09-19T04:48:00.267 INFO:teuthology.orchestra.run.smithi002.stdout: "root": "/volumes/qa/sv_0/b818eb68-79b7-4204-bd66-083d29d75e70" 2024-09-19T04:48:00.267 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:48:00.267 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_count": 0, 2024-09-19T04:48:00.267 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_pinned_count": 0, 2024-09-19T04:48:00.267 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 15108, 2024-09-19T04:48:00.267 INFO:teuthology.orchestra.run.smithi002.stdout: "inst": { 2024-09-19T04:48:00.267 INFO:teuthology.orchestra.run.smithi002.stdout: "name": { 2024-09-19T04:48:00.267 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "client", 2024-09-19T04:48:00.267 INFO:teuthology.orchestra.run.smithi002.stdout: "num": 15108 2024-09-19T04:48:00.268 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:48:00.268 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2024-09-19T04:48:00.268 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2024-09-19T04:48:00.268 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "192.168.0.1:0", 2024-09-19T04:48:00.268 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 2440992183 2024-09-19T04:48:00.268 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:48:00.268 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:48:00.268 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2024-09-19T04:48:00.268 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2024-09-19T04:48:00.268 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "192.168.0.1:0", 2024-09-19T04:48:00.268 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 2440992183 2024-09-19T04:48:00.268 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:48:00.269 INFO:teuthology.orchestra.run.smithi002.stdout: "inst_str": "client.15108 192.168.0.1:0/2440992183", 2024-09-19T04:48:00.269 INFO:teuthology.orchestra.run.smithi002.stdout: "addr_str": "192.168.0.1:0/2440992183", 2024-09-19T04:48:00.269 INFO:teuthology.orchestra.run.smithi002.stdout: "inode_count": 5, 2024-09-19T04:48:00.269 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_epoch": 19, 2024-09-19T04:48:00.269 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch": 80, 2024-09-19T04:48:00.269 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch_barrier": 0, 2024-09-19T04:48:00.269 INFO:teuthology.orchestra.run.smithi002.stdout: "blocklisted": false, 2024-09-19T04:48:00.269 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs" 2024-09-19T04:48:00.269 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:48:00.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:48:00.275 DEBUG:teuthology.orchestra.run.smithi002:> stat --file-system '--printf=%T 2024-09-19T04:48:00.275 DEBUG:teuthology.orchestra.run.smithi002:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-19T04:48:00.291 INFO:teuthology.orchestra.run.smithi002.stdout:fuseblk 2024-09-19T04:48:00.291 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-19T04:48:00.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:48:00.292 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T04:48:00.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:59 smithi018 ceph-mon[34537]: mgrmap e19: x(active, since 8m), standbys: y, z 2024-09-19T04:48:00.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:59 smithi018 ceph-mon[34537]: Standby manager daemon y restarted 2024-09-19T04:48:00.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:59 smithi018 ceph-mon[34537]: Standby manager daemon y started 2024-09-19T04:48:00.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:59 smithi018 ceph-mon[34537]: from='mgr.? 172.21.15.18:0/2300943416' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T04:48:00.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:59 smithi018 ceph-mon[34537]: from='mgr.? 172.21.15.18:0/2300943416' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T04:48:00.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:59 smithi018 ceph-mon[34537]: from='mgr.? 172.21.15.18:0/2300943416' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T04:48:00.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:59 smithi018 ceph-mon[34537]: from='mgr.? 172.21.15.18:0/2300943416' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T04:48:00.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:59 smithi018 ceph-mon[34537]: Active manager daemon x restarted 2024-09-19T04:48:00.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:59 smithi018 ceph-mon[34537]: Activating manager daemon x 2024-09-19T04:48:00.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:59 smithi018 ceph-mon[34537]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T04:48:00.308 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:59 smithi018 ceph-mon[34537]: mgrmap e20: x(active, starting, since 0.011118s), standbys: y, z 2024-09-19T04:48:00.309 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:59 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:48:00.309 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:59 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:48:00.309 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:59 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:48:00.309 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:59 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T04:48:00.309 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:59 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T04:48:00.309 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:59 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T04:48:00.309 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:59 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T04:48:00.309 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:59 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T04:48:00.309 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:59 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T04:48:00.310 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:59 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T04:48:00.310 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:59 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T04:48:00.310 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:59 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T04:48:00.310 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:59 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T04:48:00.310 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:59 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T04:48:00.310 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:59 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T04:48:00.310 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:59 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T04:48:00.310 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:59 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T04:48:00.310 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:59 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T04:48:00.310 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:59 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T04:48:00.310 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:59 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T04:48:00.311 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:59 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T04:48:00.311 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:59 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:48:00.311 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:59 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:48:00.311 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:59 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:48:00.311 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:59 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:48:00.311 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:59 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:48:00.311 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:59 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:48:00.311 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:59 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:48:00.311 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:59 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:48:00.311 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:59 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:48:00.311 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:59 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:48:00.312 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:59 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:48:00.312 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:59 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:48:00.312 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:59 smithi018 ceph-mon[34537]: Manager daemon x is now available 2024-09-19T04:48:00.312 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:59 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:48:00.312 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:59 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T04:48:00.312 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:47:59 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T04:48:00.360 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-19T04:48:00.374 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-19T04:48:00.442 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T04:48:00.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.548+0000 7fb1a8d9f640 1 -- 172.21.15.2:0/1816387568 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1a41025d0 msgr2=0x7fb1a41049c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:00.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.548+0000 7fb1a8d9f640 1 --2- 172.21.15.2:0/1816387568 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1a41025d0 0x7fb1a41049c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb194009900 tx=0x7fb19402a410 comp rx=0 tx=0).stop 2024-09-19T04:48:00.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.549+0000 7fb1a8d9f640 1 -- 172.21.15.2:0/1816387568 shutdown_connections 2024-09-19T04:48:00.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.549+0000 7fb1a8d9f640 1 --2- 172.21.15.2:0/1816387568 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb1a4107830 0x7fb1a4109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:00.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.549+0000 7fb1a8d9f640 1 --2- 172.21.15.2:0/1816387568 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1a4104f00 0x7fb1a41072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:00.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.549+0000 7fb1a8d9f640 1 --2- 172.21.15.2:0/1816387568 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1a41025d0 0x7fb1a41049c0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:00.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.549+0000 7fb1a8d9f640 1 -- 172.21.15.2:0/1816387568 >> 172.21.15.2:0/1816387568 conn(0x7fb1a40fc1f0 msgr2=0x7fb1a40fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:00.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.549+0000 7fb1a8d9f640 1 -- 172.21.15.2:0/1816387568 shutdown_connections 2024-09-19T04:48:00.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.549+0000 7fb1a8d9f640 1 -- 172.21.15.2:0/1816387568 wait complete. 2024-09-19T04:48:00.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.549+0000 7fb1a8d9f640 1 Processor -- start 2024-09-19T04:48:00.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.549+0000 7fb1a8d9f640 1 -- start start 2024-09-19T04:48:00.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.549+0000 7fb1a8d9f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb1a41025d0 0x7fb1a4101f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:00.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.549+0000 7fb1a8d9f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1a4104f00 0x7fb1a4100580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:00.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.549+0000 7fb1a8d9f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1a4107830 0x7fb1a4100ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:00.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.550+0000 7fb1a8d9f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a410d710 con 0x7fb1a4107830 2024-09-19T04:48:00.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.550+0000 7fb1a8d9f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a410d590 con 0x7fb1a4104f00 2024-09-19T04:48:00.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.550+0000 7fb1a8d9f640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a410d890 con 0x7fb1a41025d0 2024-09-19T04:48:00.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.550+0000 7fb1a2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1a4107830 0x7fb1a4100ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:00.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.550+0000 7fb1a259c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb1a41025d0 0x7fb1a4101f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:00.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.550+0000 7fb1a2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1a4107830 0x7fb1a4100ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45920/0 (socket says 172.21.15.2:45920) 2024-09-19T04:48:00.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.550+0000 7fb1a259c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb1a41025d0 0x7fb1a4101f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.2:55290/0 (socket says 172.21.15.2:55290) 2024-09-19T04:48:00.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.550+0000 7fb1a2d9d640 1 -- 172.21.15.2:0/2181974152 learned_addr learned my addr 172.21.15.2:0/2181974152 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:48:00.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.550+0000 7fb1a1d9b640 1 --2- 172.21.15.2:0/2181974152 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1a4104f00 0x7fb1a4100580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:00.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.550+0000 7fb1a2d9d640 1 -- 172.21.15.2:0/2181974152 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb1a41025d0 msgr2=0x7fb1a4101f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:00.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.550+0000 7fb1a2d9d640 1 --2- 172.21.15.2:0/2181974152 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb1a41025d0 0x7fb1a4101f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:00.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.550+0000 7fb1a2d9d640 1 -- 172.21.15.2:0/2181974152 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1a4104f00 msgr2=0x7fb1a4100580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:00.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.550+0000 7fb1a2d9d640 1 --2- 172.21.15.2:0/2181974152 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1a4104f00 0x7fb1a4100580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:00.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.550+0000 7fb1a2d9d640 1 -- 172.21.15.2:0/2181974152 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1a4101350 con 0x7fb1a4107830 2024-09-19T04:48:00.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.550+0000 7fb1a259c640 1 --2- 172.21.15.2:0/2181974152 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb1a41025d0 0x7fb1a4101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:48:00.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.550+0000 7fb1a2d9d640 1 --2- 172.21.15.2:0/2181974152 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1a4107830 0x7fb1a4100ac0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb19c00eb40 tx=0x7fb19c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:00.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.550+0000 7fb1937fe640 1 -- 172.21.15.2:0/2181974152 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb19c004b20 con 0x7fb1a4107830 2024-09-19T04:48:00.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.550+0000 7fb1937fe640 1 -- 172.21.15.2:0/2181974152 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb19c004cc0 con 0x7fb1a4107830 2024-09-19T04:48:00.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.550+0000 7fb1a8d9f640 1 -- 172.21.15.2:0/2181974152 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1a41a1f40 con 0x7fb1a4107830 2024-09-19T04:48:00.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.550+0000 7fb1937fe640 1 -- 172.21.15.2:0/2181974152 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb19c0107b0 con 0x7fb1a4107830 2024-09-19T04:48:00.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.550+0000 7fb1a8d9f640 1 -- 172.21.15.2:0/2181974152 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1a41a2350 con 0x7fb1a4107830 2024-09-19T04:48:00.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.551+0000 7fb1a8d9f640 1 -- 172.21.15.2:0/2181974152 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1a40fdce0 con 0x7fb1a4107830 2024-09-19T04:48:00.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.553+0000 7fb1937fe640 1 -- 172.21.15.2:0/2181974152 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 138167+0+0 (secure 0 0 0) 0x7fb19c005000 con 0x7fb1a4107830 2024-09-19T04:48:00.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.554+0000 7fb1937fe640 1 --2- 172.21.15.2:0/2181974152 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fb18c0a3050 0x7fb18c0a5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:00.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.554+0000 7fb1937fe640 1 -- 172.21.15.2:0/2181974152 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7fb19c0cfd60 con 0x7fb1a4107830 2024-09-19T04:48:00.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.554+0000 7fb1a259c640 1 --2- 172.21.15.2:0/2181974152 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fb18c0a3050 0x7fb18c0a5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:00.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.555+0000 7fb1a259c640 1 --2- 172.21.15.2:0/2181974152 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fb18c0a3050 0x7fb18c0a5510 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb1940314e0 tx=0x7fb194005a20 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:00.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.558+0000 7fb1937fe640 1 -- 172.21.15.2:0/2181974152 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb19c09cc30 con 0x7fb1a4107830 2024-09-19T04:48:00.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.739+0000 7fb1a8d9f640 1 -- 172.21.15.2:0/2181974152 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb1a4062e90 con 0x7fb1a4107830 2024-09-19T04:48:00.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.740+0000 7fb1937fe640 1 -- 172.21.15.2:0/2181974152 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22923 (secure 0 0 0) 0x7fb19c0819a0 con 0x7fb1a4107830 2024-09-19T04:48:00.742 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:48:00.742 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":81,"fsid":"d46630c4-7640-11ef-bceb-c7b262605968","created":"2024-09-19T04:38:39.698488+0000","modified":"2024-09-19T04:47:59.140914+0000","last_up_change":"2024-09-19T04:45:33.839647+0000","last_in_change":"2024-09-19T04:45:09.816808+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T04:41:51.960734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T04:46:20.031485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T04:46:22.484767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7a7dc9b9-8d5d-4dd3-93a3-0d5efced07d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":611702745},{"type":"v1","addr":"172.21.15.2:6803","nonce":611702745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":611702745},{"type":"v1","addr":"172.21.15.2:6805","nonce":611702745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":611702745},{"type":"v1","addr":"172.21.15.2:6809","nonce":611702745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":611702745},{"type":"v1","addr":"172.21.15.2:6807","nonce":611702745}]},"public_addr":"172.21.15.2:6803/611702745","cluster_addr":"172.21.15.2:6805/611702745","heartbeat_back_addr":"172.21.15.2:6809/611702745","heartbeat_front_addr":"172.21.15.2:6807/611702745","state":["exists","up"]},{"osd":1,"uuid":"bea40dec-7d9c-497f-bf16-4bf6d3b839f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":58390709},{"type":"v1","addr":"172.21.15.18:6801","nonce":58390709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":58390709},{"type":"v1","addr":"172.21.15.18:6803","nonce":58390709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":58390709},{"type":"v1","addr":"172.21.15.18:6807","nonce":58390709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":58390709},{"type":"v1","addr":"172.21.15.18:6805","nonce":58390709}]},"public_addr":"172.21.15.18:6801/58390709","cluster_addr":"172.21.15.18:6803/58390709","heartbeat_back_addr":"172.21.15.18:6807/58390709","heartbeat_front_addr":"172.21.15.18:6805/58390709","state":["exists","up"]},{"osd":2,"uuid":"97716304-a31e-48c9-83de-84eed10a7a4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":627735759},{"type":"v1","addr":"172.21.15.116:6801","nonce":627735759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":627735759},{"type":"v1","addr":"172.21.15.116:6803","nonce":627735759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":627735759},{"type":"v1","addr":"172.21.15.116:6807","nonce":627735759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":627735759},{"type":"v1","addr":"172.21.15.116:6805","nonce":627735759}]},"public_addr":"172.21.15.116:6801/627735759","cluster_addr":"172.21.15.116:6803/627735759","heartbeat_back_addr":"172.21.15.116:6807/627735759","heartbeat_front_addr":"172.21.15.116:6805/627735759","state":["exists","up"]},{"osd":3,"uuid":"8d79514e-16cf-4bd0-a2eb-e9148b91183d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1936071687},{"type":"v1","addr":"172.21.15.2:6811","nonce":1936071687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1936071687},{"type":"v1","addr":"172.21.15.2:6813","nonce":1936071687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1936071687},{"type":"v1","addr":"172.21.15.2:6817","nonce":1936071687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1936071687},{"type":"v1","addr":"172.21.15.2:6815","nonce":1936071687}]},"public_addr":"172.21.15.2:6811/1936071687","cluster_addr":"172.21.15.2:6813/1936071687","heartbeat_back_addr":"172.21.15.2:6817/1936071687","heartbeat_front_addr":"172.21.15.2:6815/1936071687","state":["exists","up"]},{"osd":4,"uuid":"5136f03c-94a3-42a0-9bfc-020397836037","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1333533784},{"type":"v1","addr":"172.21.15.18:6809","nonce":1333533784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1333533784},{"type":"v1","addr":"172.21.15.18:6811","nonce":1333533784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1333533784},{"type":"v1","addr":"172.21.15.18:6815","nonce":1333533784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1333533784},{"type":"v1","addr":"172.21.15.18:6813","nonce":1333533784}]},"public_addr":"172.21.15.18:6809/1333533784","cluster_addr":"172.21.15.18:6811/1333533784","heartbeat_back_addr":"172.21.15.18:6815/1333533784","heartbeat_front_addr":"172.21.15.18:6813/1333533784","state":["exists","up"]},{"osd":5,"uuid":"9d3384b0-f87d-4513-b151-4cca21c339b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":316360741},{"type":"v1","addr":"172.21.15.116:6809","nonce":316360741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":316360741},{"type":"v1","addr":"172.21.15.116:6811","nonce":316360741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":316360741},{"type":"v1","addr":"172.21.15.116:6815","nonce":316360741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":316360741},{"type":"v1","addr":"172.21.15.116:6813","nonce":316360741}]},"public_addr":"172.21.15.116:6809/316360741","cluster_addr":"172.21.15.116:6811/316360741","heartbeat_back_addr":"172.21.15.116:6815/316360741","heartbeat_front_addr":"172.21.15.116:6813/316360741","state":["exists","up"]},{"osd":6,"uuid":"e54f44b5-a693-4b31-83b2-2bcf10ab9a75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1185564560},{"type":"v1","addr":"172.21.15.2:6819","nonce":1185564560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1185564560},{"type":"v1","addr":"172.21.15.2:6821","nonce":1185564560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1185564560},{"type":"v1","addr":"172.21.15.2:6825","nonce":1185564560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":1185564560},{"type":"v1","addr":"172.21.15.2:6823","nonce":1185564560}]},"public_addr":"172.21.15.2:6819/1185564560","cluster_addr":"172.21.15.2:6821/1185564560","heartbeat_back_addr":"172.21.15.2:6825/1185564560","heartbeat_front_addr":"172.21.15.2:6823/1185564560","state":["exists","up"]},{"osd":7,"uuid":"96a444c3-429a-48b6-9823-95c9e171341a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3691801363},{"type":"v1","addr":"172.21.15.18:6817","nonce":3691801363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3691801363},{"type":"v1","addr":"172.21.15.18:6819","nonce":3691801363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3691801363},{"type":"v1","addr":"172.21.15.18:6823","nonce":3691801363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3691801363},{"type":"v1","addr":"172.21.15.18:6821","nonce":3691801363}]},"public_addr":"172.21.15.18:6817/3691801363","cluster_addr":"172.21.15.18:6819/3691801363","heartbeat_back_addr":"172.21.15.18:6823/3691801363","heartbeat_front_addr":"172.21.15.18:6821/3691801363","state":["exists","up"]},{"osd":8,"uuid":"c3f696aa-be7d-4f67-9147-3751406e394d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":3709586119},{"type":"v1","addr":"172.21.15.116:6817","nonce":3709586119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":3709586119},{"type":"v1","addr":"172.21.15.116:6819","nonce":3709586119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":3709586119},{"type":"v1","addr":"172.21.15.116:6823","nonce":3709586119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":3709586119},{"type":"v1","addr":"172.21.15.116:6821","nonce":3709586119}]},"public_addr":"172.21.15.116:6817/3709586119","cluster_addr":"172.21.15.116:6819/3709586119","heartbeat_back_addr":"172.21.15.116:6823/3709586119","heartbeat_front_addr":"172.21.15.116:6821/3709586119","state":["exists","up"]},{"osd":9,"uuid":"4892549d-f050-48c5-b695-5924b612a581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1054791011},{"type":"v1","addr":"172.21.15.2:6827","nonce":1054791011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1054791011},{"type":"v1","addr":"172.21.15.2:6829","nonce":1054791011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1054791011},{"type":"v1","addr":"172.21.15.2:6833","nonce":1054791011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":1054791011},{"type":"v1","addr":"172.21.15.2:6831","nonce":1054791011}]},"public_addr":"172.21.15.2:6827/1054791011","cluster_addr":"172.21.15.2:6829/1054791011","heartbeat_back_addr":"172.21.15.2:6833/1054791011","heartbeat_front_addr":"172.21.15.2:6831/1054791011","state":["exists","up"]},{"osd":10,"uuid":"12b60238-6a35-4d48-bacd-ee5ddd8fdb0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1958683776},{"type":"v1","addr":"172.21.15.18:6825","nonce":1958683776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":1958683776},{"type":"v1","addr":"172.21.15.18:6827","nonce":1958683776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":1958683776},{"type":"v1","addr":"172.21.15.18:6831","nonce":1958683776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":1958683776},{"type":"v1","addr":"172.21.15.18:6829","nonce":1958683776}]},"public_addr":"172.21.15.18:6825/1958683776","cluster_addr":"172.21.15.18:6827/1958683776","heartbeat_back_addr":"172.21.15.18:6831/1958683776","heartbeat_front_addr":"172.21.15.18:6829/1958683776","state":["exists","up"]},{"osd":11,"uuid":"99b3e553-b42c-4b2f-817f-3900ad8bd223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3456789654},{"type":"v1","addr":"172.21.15.116:6825","nonce":3456789654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3456789654},{"type":"v1","addr":"172.21.15.116:6827","nonce":3456789654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3456789654},{"type":"v1","addr":"172.21.15.116:6831","nonce":3456789654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3456789654},{"type":"v1","addr":"172.21.15.116:6829","nonce":3456789654}]},"public_addr":"172.21.15.116:6825/3456789654","cluster_addr":"172.21.15.116:6827/3456789654","heartbeat_back_addr":"172.21.15.116:6831/3456789654","heartbeat_front_addr":"172.21.15.116:6829/3456789654","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:40:58.216702+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:41:22.852350+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:41:47.265084+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:42:12.785128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:42:38.475008+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:43:02.924009+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:43:28.050646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:43:52.715369+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:44:16.905066+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:44:42.071128+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:45:06.434525+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:45:31.569086+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":1}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/3848778984":"2024-09-20T04:47:59.140869+0000","172.21.15.2:0/2044166064":"2024-09-20T04:47:59.140869+0000","172.21.15.2:0/1092443021":"2024-09-20T04:47:59.140869+0000","172.21.15.2:0/2432243496":"2024-09-20T04:39:11.086431+0000","172.21.15.2:6800/3782987318":"2024-09-20T04:39:35.461329+0000","172.21.15.2:6801/1825825090":"2024-09-20T04:39:11.086431+0000","172.21.15.2:6800/1825825090":"2024-09-20T04:39:11.086431+0000","172.21.15.2:6800/3171525177":"2024-09-20T04:47:59.140869+0000","172.21.15.2:0/3064319092":"2024-09-20T04:39:11.086431+0000","172.21.15.2:6801/3782987318":"2024-09-20T04:39:35.461329+0000","172.21.15.2:0/256825166":"2024-09-20T04:39:35.461329+0000","172.21.15.2:0/1528097642":"2024-09-20T04:39:11.086431+0000","172.21.15.2:0/2801870985":"2024-09-20T04:39:35.461329+0000","172.21.15.2:6801/3171525177":"2024-09-20T04:47:59.140869+0000","172.21.15.2:0/4263572944":"2024-09-20T04:47:59.140869+0000","172.21.15.2:0/870383845":"2024-09-20T04:39:35.461329+0000","172.21.15.2:0/3466359926":"2024-09-20T04:47:59.140869+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T04:48:00.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.742+0000 7fb1a8d9f640 1 -- 172.21.15.2:0/2181974152 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fb18c0a3050 msgr2=0x7fb18c0a5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:00.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.742+0000 7fb1a8d9f640 1 --2- 172.21.15.2:0/2181974152 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fb18c0a3050 0x7fb18c0a5510 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb1940314e0 tx=0x7fb194005a20 comp rx=0 tx=0).stop 2024-09-19T04:48:00.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.742+0000 7fb1a8d9f640 1 -- 172.21.15.2:0/2181974152 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1a4107830 msgr2=0x7fb1a4100ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:00.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.742+0000 7fb1a8d9f640 1 --2- 172.21.15.2:0/2181974152 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1a4107830 0x7fb1a4100ac0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb19c00eb40 tx=0x7fb19c00c2d0 comp rx=0 tx=0).stop 2024-09-19T04:48:00.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.742+0000 7fb1a8d9f640 1 -- 172.21.15.2:0/2181974152 shutdown_connections 2024-09-19T04:48:00.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.742+0000 7fb1a8d9f640 1 --2- 172.21.15.2:0/2181974152 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1a4107830 0x7fb1a4100ac0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:00.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.742+0000 7fb1a8d9f640 1 --2- 172.21.15.2:0/2181974152 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1a4104f00 0x7fb1a4100580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:00.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.742+0000 7fb1a8d9f640 1 --2- 172.21.15.2:0/2181974152 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fb18c0a3050 0x7fb18c0a5510 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:00.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.742+0000 7fb1a8d9f640 1 --2- 172.21.15.2:0/2181974152 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb1a41025d0 0x7fb1a4101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:00.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.742+0000 7fb1a8d9f640 1 -- 172.21.15.2:0/2181974152 >> 172.21.15.2:0/2181974152 conn(0x7fb1a40fc1f0 msgr2=0x7fb1a4103030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:00.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.742+0000 7fb1a8d9f640 1 -- 172.21.15.2:0/2181974152 shutdown_connections 2024-09-19T04:48:00.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.743+0000 7fb1a8d9f640 1 -- 172.21.15.2:0/2181974152 wait complete. 2024-09-19T04:48:00.754 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T04:41:51.960734+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T04:46:20.031485+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T04:46:22.484767+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T04:48:00.755 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T04:48:00.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.861+0000 7f7eb2bb9640 1 -- 172.21.15.2:0/2137631727 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7eac104fa0 msgr2=0x7f7eac107390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:00.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.861+0000 7f7eb2bb9640 1 --2- 172.21.15.2:0/2137631727 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7eac104fa0 0x7f7eac107390 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7e98009900 tx=0x7f7e9802a410 comp rx=0 tx=0).stop 2024-09-19T04:48:00.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.861+0000 7f7eb2bb9640 1 -- 172.21.15.2:0/2137631727 shutdown_connections 2024-09-19T04:48:00.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.861+0000 7f7eb2bb9640 1 --2- 172.21.15.2:0/2137631727 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7eac1078d0 0x7f7eac109cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:00.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.861+0000 7f7eb2bb9640 1 --2- 172.21.15.2:0/2137631727 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7eac104fa0 0x7f7eac107390 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:00.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.861+0000 7f7eb2bb9640 1 --2- 172.21.15.2:0/2137631727 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7eac102670 0x7f7eac104a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:00.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.861+0000 7f7eb2bb9640 1 -- 172.21.15.2:0/2137631727 >> 172.21.15.2:0/2137631727 conn(0x7f7eac0fc190 msgr2=0x7f7eac0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:00.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.861+0000 7f7eb2bb9640 1 -- 172.21.15.2:0/2137631727 shutdown_connections 2024-09-19T04:48:00.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.861+0000 7f7eb2bb9640 1 -- 172.21.15.2:0/2137631727 wait complete. 2024-09-19T04:48:00.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.861+0000 7f7eb2bb9640 1 Processor -- start 2024-09-19T04:48:00.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.861+0000 7f7eb2bb9640 1 -- start start 2024-09-19T04:48:00.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.861+0000 7f7eb2bb9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7eac102670 0x7f7eac197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:00.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.861+0000 7f7eb2bb9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7eac104fa0 0x7f7eac198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:00.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.861+0000 7f7eb2bb9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7eac1078d0 0x7f7eac19f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:00.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.861+0000 7f7eb2bb9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7eac10d6b0 con 0x7f7eac1078d0 2024-09-19T04:48:00.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.861+0000 7f7eb2bb9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7eac10d530 con 0x7f7eac104fa0 2024-09-19T04:48:00.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.861+0000 7f7eb2bb9640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f7eac10d830 con 0x7f7eac102670 2024-09-19T04:48:00.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.862+0000 7f7eb1156640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7eac1078d0 0x7f7eac19f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:00.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.862+0000 7f7eb0955640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7eac102670 0x7f7eac197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:00.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.862+0000 7f7eb1156640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7eac1078d0 0x7f7eac19f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45938/0 (socket says 172.21.15.2:45938) 2024-09-19T04:48:00.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.862+0000 7f7eb1156640 1 -- 172.21.15.2:0/3322896677 learned_addr learned my addr 172.21.15.2:0/3322896677 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:48:00.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.862+0000 7f7eabfff640 1 --2- 172.21.15.2:0/3322896677 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7eac104fa0 0x7f7eac198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:00.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.862+0000 7f7eb1156640 1 -- 172.21.15.2:0/3322896677 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7eac102670 msgr2=0x7f7eac197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:00.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.862+0000 7f7eb1156640 1 --2- 172.21.15.2:0/3322896677 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7eac102670 0x7f7eac197e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:00.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.862+0000 7f7eb1156640 1 -- 172.21.15.2:0/3322896677 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7eac104fa0 msgr2=0x7f7eac198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:00.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.862+0000 7f7eb1156640 1 --2- 172.21.15.2:0/3322896677 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7eac104fa0 0x7f7eac198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:00.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.862+0000 7f7eb1156640 1 -- 172.21.15.2:0/3322896677 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7eac19fa40 con 0x7f7eac1078d0 2024-09-19T04:48:00.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.862+0000 7f7eb0955640 1 --2- 172.21.15.2:0/3322896677 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7eac102670 0x7f7eac197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:48:00.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.862+0000 7f7eb1156640 1 --2- 172.21.15.2:0/3322896677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7eac1078d0 0x7f7eac19f3d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7ea400eaa0 tx=0x7f7ea400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:00.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.862+0000 7f7ea9ffb640 1 -- 172.21.15.2:0/3322896677 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea400cdb0 con 0x7f7eac1078d0 2024-09-19T04:48:00.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.862+0000 7f7ea9ffb640 1 -- 172.21.15.2:0/3322896677 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7ea4005020 con 0x7f7eac1078d0 2024-09-19T04:48:00.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.862+0000 7f7eb2bb9640 1 -- 172.21.15.2:0/3322896677 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7eac19fd30 con 0x7f7eac1078d0 2024-09-19T04:48:00.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.862+0000 7f7ea9ffb640 1 -- 172.21.15.2:0/3322896677 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea40116d0 con 0x7f7eac1078d0 2024-09-19T04:48:00.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.862+0000 7f7eb2bb9640 1 -- 172.21.15.2:0/3322896677 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7eac1a01f0 con 0x7f7eac1078d0 2024-09-19T04:48:00.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.864+0000 7f7eb2bb9640 1 -- 172.21.15.2:0/3322896677 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7eac0fdc80 con 0x7f7eac1078d0 2024-09-19T04:48:00.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.865+0000 7f7ea9ffb640 1 -- 172.21.15.2:0/3322896677 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 138167+0+0 (secure 0 0 0) 0x7f7ea40051d0 con 0x7f7eac1078d0 2024-09-19T04:48:00.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.866+0000 7f7ea9ffb640 1 --2- 172.21.15.2:0/3322896677 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f7e9c0a30d0 0x7f7e9c0a5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:00.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.866+0000 7f7ea9ffb640 1 -- 172.21.15.2:0/3322896677 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f7ea40cf760 con 0x7f7eac1078d0 2024-09-19T04:48:00.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.866+0000 7f7eb0955640 1 --2- 172.21.15.2:0/3322896677 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f7e9c0a30d0 0x7f7e9c0a5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:00.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.867+0000 7f7eb0955640 1 --2- 172.21.15.2:0/3322896677 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f7e9c0a30d0 0x7f7e9c0a5590 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0009fc0 tx=0x7f7ea0005f90 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:00.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:00.870+0000 7f7ea9ffb640 1 -- 172.21.15.2:0/3322896677 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7ea4016030 con 0x7f7eac1078d0 2024-09-19T04:48:01.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.066+0000 7f7eb2bb9640 1 -- 172.21.15.2:0/3322896677 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7eac062e90 con 0x7f7eac1078d0 2024-09-19T04:48:01.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.066+0000 7f7ea9ffb640 1 -- 172.21.15.2:0/3322896677 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7f7ea409c670 con 0x7f7eac1078d0 2024-09-19T04:48:01.068 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-09-19T04:48:01.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.068+0000 7f7eb2bb9640 1 -- 172.21.15.2:0/3322896677 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f7e9c0a30d0 msgr2=0x7f7e9c0a5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:01.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.068+0000 7f7eb2bb9640 1 --2- 172.21.15.2:0/3322896677 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f7e9c0a30d0 0x7f7e9c0a5590 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0009fc0 tx=0x7f7ea0005f90 comp rx=0 tx=0).stop 2024-09-19T04:48:01.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.068+0000 7f7eb2bb9640 1 -- 172.21.15.2:0/3322896677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7eac1078d0 msgr2=0x7f7eac19f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:01.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.068+0000 7f7eb2bb9640 1 --2- 172.21.15.2:0/3322896677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7eac1078d0 0x7f7eac19f3d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7ea400eaa0 tx=0x7f7ea400ef60 comp rx=0 tx=0).stop 2024-09-19T04:48:01.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.068+0000 7f7eb2bb9640 1 -- 172.21.15.2:0/3322896677 shutdown_connections 2024-09-19T04:48:01.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.068+0000 7f7eb2bb9640 1 --2- 172.21.15.2:0/3322896677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7eac1078d0 0x7f7eac19f3d0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:01.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.068+0000 7f7eb2bb9640 1 --2- 172.21.15.2:0/3322896677 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7eac104fa0 0x7f7eac198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:01.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.068+0000 7f7eb2bb9640 1 --2- 172.21.15.2:0/3322896677 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f7e9c0a30d0 0x7f7e9c0a5590 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:01.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.068+0000 7f7eb2bb9640 1 --2- 172.21.15.2:0/3322896677 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7eac102670 0x7f7eac197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:01.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.068+0000 7f7eb2bb9640 1 -- 172.21.15.2:0/3322896677 >> 172.21.15.2:0/3322896677 conn(0x7f7eac0fc190 msgr2=0x7f7eac103150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:01.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.068+0000 7f7eb2bb9640 1 -- 172.21.15.2:0/3322896677 shutdown_connections 2024-09-19T04:48:01.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.068+0000 7f7eb2bb9640 1 -- 172.21.15.2:0/3322896677 wait complete. 2024-09-19T04:48:01.082 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T04:48:01.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.208+0000 7f9b1bb86640 1 -- 172.21.15.2:0/3543184475 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b141036d0 msgr2=0x7f9b14109f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:01.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.208+0000 7f9b1bb86640 1 --2- 172.21.15.2:0/3543184475 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b141036d0 0x7f9b14109f60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c009ca0 tx=0x7f9b0c02a8c0 comp rx=0 tx=0).stop 2024-09-19T04:48:01.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.208+0000 7f9b1bb86640 1 -- 172.21.15.2:0/3543184475 shutdown_connections 2024-09-19T04:48:01.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.208+0000 7f9b1bb86640 1 --2- 172.21.15.2:0/3543184475 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b141036d0 0x7f9b14109f60 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:01.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.208+0000 7f9b1bb86640 1 --2- 172.21.15.2:0/3543184475 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b14102d10 0x7f9b14103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:01.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.208+0000 7f9b1bb86640 1 --2- 172.21.15.2:0/3543184475 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b14101b20 0x7f9b14101f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:01.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.208+0000 7f9b1bb86640 1 -- 172.21.15.2:0/3543184475 >> 172.21.15.2:0/3543184475 conn(0x7f9b140fd2a0 msgr2=0x7f9b140ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:01.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.208+0000 7f9b1bb86640 1 -- 172.21.15.2:0/3543184475 shutdown_connections 2024-09-19T04:48:01.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.208+0000 7f9b1bb86640 1 -- 172.21.15.2:0/3543184475 wait complete. 2024-09-19T04:48:01.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.209+0000 7f9b1bb86640 1 Processor -- start 2024-09-19T04:48:01.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.209+0000 7f9b1bb86640 1 -- start start 2024-09-19T04:48:01.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.209+0000 7f9b1bb86640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b14101b20 0x7f9b14197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:01.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.209+0000 7f9b1bb86640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b14102d10 0x7f9b14198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:01.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.209+0000 7f9b1bb86640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b141036d0 0x7f9b1419f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:01.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.209+0000 7f9b1bb86640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9b1410d650 con 0x7f9b14101b20 2024-09-19T04:48:01.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.209+0000 7f9b1bb86640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9b1410d4d0 con 0x7f9b141036d0 2024-09-19T04:48:01.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.209+0000 7f9b1bb86640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f9b1410d7d0 con 0x7f9b14102d10 2024-09-19T04:48:01.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.210+0000 7f9b19922640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b14101b20 0x7f9b14197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:01.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.210+0000 7f9b19922640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b14101b20 0x7f9b14197d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45954/0 (socket says 172.21.15.2:45954) 2024-09-19T04:48:01.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.210+0000 7f9b19922640 1 -- 172.21.15.2:0/3258067939 learned_addr learned my addr 172.21.15.2:0/3258067939 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:48:01.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.210+0000 7f9b1a123640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b141036d0 0x7f9b1419f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:01.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.210+0000 7f9b19121640 1 --2- 172.21.15.2:0/3258067939 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b14102d10 0x7f9b14198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:01.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.210+0000 7f9b19922640 1 -- 172.21.15.2:0/3258067939 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b14102d10 msgr2=0x7f9b14198280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:01.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.210+0000 7f9b19922640 1 --2- 172.21.15.2:0/3258067939 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b14102d10 0x7f9b14198280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:01.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.210+0000 7f9b19922640 1 -- 172.21.15.2:0/3258067939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b141036d0 msgr2=0x7f9b1419f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:01.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.210+0000 7f9b19922640 1 --2- 172.21.15.2:0/3258067939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b141036d0 0x7f9b1419f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:01.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.210+0000 7f9b19922640 1 -- 172.21.15.2:0/3258067939 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b1419f960 con 0x7f9b14101b20 2024-09-19T04:48:01.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.210+0000 7f9b1a123640 1 --2- 172.21.15.2:0/3258067939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b141036d0 0x7f9b1419f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:48:01.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.210+0000 7f9b19922640 1 --2- 172.21.15.2:0/3258067939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b14101b20 0x7f9b14197d40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9b1000e9c0 tx=0x7f9b1000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:01.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.210+0000 7f9b0affd640 1 -- 172.21.15.2:0/3258067939 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b1000cd80 con 0x7f9b14101b20 2024-09-19T04:48:01.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.210+0000 7f9b0affd640 1 -- 172.21.15.2:0/3258067939 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9b100035f0 con 0x7f9b14101b20 2024-09-19T04:48:01.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.210+0000 7f9b1bb86640 1 -- 172.21.15.2:0/3258067939 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b1419fc50 con 0x7f9b14101b20 2024-09-19T04:48:01.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.210+0000 7f9b0affd640 1 -- 172.21.15.2:0/3258067939 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b10010690 con 0x7f9b14101b20 2024-09-19T04:48:01.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.210+0000 7f9b1bb86640 1 -- 172.21.15.2:0/3258067939 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b141a01a0 con 0x7f9b14101b20 2024-09-19T04:48:01.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.211+0000 7f9b1bb86640 1 -- 172.21.15.2:0/3258067939 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b14108f60 con 0x7f9b14101b20 2024-09-19T04:48:01.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.213+0000 7f9b0affd640 1 -- 172.21.15.2:0/3258067939 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 138167+0+0 (secure 0 0 0) 0x7f9b100037a0 con 0x7f9b14101b20 2024-09-19T04:48:01.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.214+0000 7f9b0affd640 1 --2- 172.21.15.2:0/3258067939 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f9b000a30d0 0x7f9b000a5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:01.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.214+0000 7f9b0affd640 1 -- 172.21.15.2:0/3258067939 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f9b100cf980 con 0x7f9b14101b20 2024-09-19T04:48:01.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.214+0000 7f9b19121640 1 --2- 172.21.15.2:0/3258067939 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f9b000a30d0 0x7f9b000a5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:01.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.215+0000 7f9b19121640 1 --2- 172.21.15.2:0/3258067939 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f9b000a30d0 0x7f9b000a5590 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9b14199250 tx=0x7f9b04005f90 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.218+0000 7f9b0affd640 1 -- 172.21.15.2:0/3258067939 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9b1009c850 con 0x7f9b14101b20 2024-09-19T04:48:01.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:01 smithi002 ceph-mon[30975]: mgrmap e21: x(active, since 1.019s), standbys: y, z 2024-09-19T04:48:01.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:01 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/2181974152' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:48:01.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:01 smithi002 ceph-mon[30975]: [19/Sep/2024:04:48:00] ENGINE Bus STARTING 2024-09-19T04:48:01.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:01 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/3322896677' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T04:48:01.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:01 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:01.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:01 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:01.361 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:48:01 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:48:01.178+0000 7f55999a1640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:04:48:01] ENGINE Error in HTTPServer.serve 2024-09-19T04:48:01.361 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:48:01 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: Traceback (most recent call last): 2024-09-19T04:48:01.361 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:48:01 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T04:48:01.361 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:48:01 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: self._connections.run(self.expiration_interval) 2024-09-19T04:48:01.361 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:48:01 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T04:48:01.361 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:48:01 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: self._run(expiration_interval) 2024-09-19T04:48:01.361 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:48:01 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T04:48:01.361 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:48:01 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T04:48:01.361 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:48:01 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T04:48:01.362 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:48:01 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T04:48:01.362 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:48:01 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T04:48:01.362 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:48:01 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: s = self.context.wrap_socket( 2024-09-19T04:48:01.362 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:48:01 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T04:48:01.362 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:48:01 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: return self.sslsocket_class._create( 2024-09-19T04:48:01.362 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:48:01 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T04:48:01.362 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:48:01 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: self.do_handshake() 2024-09-19T04:48:01.362 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:48:01 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T04:48:01.362 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:48:01 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: self._sslobj.do_handshake() 2024-09-19T04:48:01.362 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:48:01 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T04:48:01.362 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:48:01 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:48:01.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.422+0000 7f9b1bb86640 1 -- 172.21.15.2:0/3258067939 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f9b1402d7c0 con 0x7f9b14101b20 2024-09-19T04:48:01.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.423+0000 7f9b0affd640 1 -- 172.21.15.2:0/3258067939 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v81) ==== 104+0+11 (secure 0 0 0) 0x7f9b1402d7c0 con 0x7f9b14101b20 2024-09-19T04:48:01.425 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2024-09-19T04:48:01.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.425+0000 7f9b1bb86640 1 -- 172.21.15.2:0/3258067939 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f9b000a30d0 msgr2=0x7f9b000a5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:01.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.425+0000 7f9b1bb86640 1 --2- 172.21.15.2:0/3258067939 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f9b000a30d0 0x7f9b000a5590 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9b14199250 tx=0x7f9b04005f90 comp rx=0 tx=0).stop 2024-09-19T04:48:01.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.425+0000 7f9b1bb86640 1 -- 172.21.15.2:0/3258067939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b14101b20 msgr2=0x7f9b14197d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:01.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.425+0000 7f9b1bb86640 1 --2- 172.21.15.2:0/3258067939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b14101b20 0x7f9b14197d40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9b1000e9c0 tx=0x7f9b1000ee80 comp rx=0 tx=0).stop 2024-09-19T04:48:01.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.425+0000 7f9b1bb86640 1 -- 172.21.15.2:0/3258067939 shutdown_connections 2024-09-19T04:48:01.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.425+0000 7f9b1bb86640 1 --2- 172.21.15.2:0/3258067939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b141036d0 0x7f9b1419f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:01.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.425+0000 7f9b1bb86640 1 --2- 172.21.15.2:0/3258067939 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f9b000a30d0 0x7f9b000a5590 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:01.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.425+0000 7f9b1bb86640 1 --2- 172.21.15.2:0/3258067939 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b14102d10 0x7f9b14198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:01.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.425+0000 7f9b1bb86640 1 --2- 172.21.15.2:0/3258067939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b14101b20 0x7f9b14197d40 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:01.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.425+0000 7f9b1bb86640 1 -- 172.21.15.2:0/3258067939 >> 172.21.15.2:0/3258067939 conn(0x7f9b140fd2a0 msgr2=0x7f9b14106130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:01.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.425+0000 7f9b1bb86640 1 -- 172.21.15.2:0/3258067939 shutdown_connections 2024-09-19T04:48:01.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.425+0000 7f9b1bb86640 1 -- 172.21.15.2:0/3258067939 wait complete. 2024-09-19T04:48:01.438 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T04:48:01.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.545+0000 7f4d4780e640 1 -- 172.21.15.2:0/4060044799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d40104f80 msgr2=0x7f4d40107370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:01.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.545+0000 7f4d4780e640 1 --2- 172.21.15.2:0/4060044799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d40104f80 0x7f4d40107370 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4d30009900 tx=0x7f4d3002a410 comp rx=0 tx=0).stop 2024-09-19T04:48:01.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.546+0000 7f4d4780e640 1 -- 172.21.15.2:0/4060044799 shutdown_connections 2024-09-19T04:48:01.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.546+0000 7f4d4780e640 1 --2- 172.21.15.2:0/4060044799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d401078b0 0x7f4d40109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:01.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.546+0000 7f4d4780e640 1 --2- 172.21.15.2:0/4060044799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d40104f80 0x7f4d40107370 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:01.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.546+0000 7f4d4780e640 1 --2- 172.21.15.2:0/4060044799 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d40102650 0x7f4d40104a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:01.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.546+0000 7f4d4780e640 1 -- 172.21.15.2:0/4060044799 >> 172.21.15.2:0/4060044799 conn(0x7f4d400fc190 msgr2=0x7f4d400fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:01.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.546+0000 7f4d4780e640 1 -- 172.21.15.2:0/4060044799 shutdown_connections 2024-09-19T04:48:01.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.546+0000 7f4d4780e640 1 -- 172.21.15.2:0/4060044799 wait complete. 2024-09-19T04:48:01.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.546+0000 7f4d4780e640 1 Processor -- start 2024-09-19T04:48:01.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.546+0000 7f4d4780e640 1 -- start start 2024-09-19T04:48:01.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.546+0000 7f4d4780e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d40102650 0x7f4d40101fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:01.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.546+0000 7f4d4780e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d40104f80 0x7f4d40100600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:01.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.546+0000 7f4d4780e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d401078b0 0x7f4d40100b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:01.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.546+0000 7f4d4780e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4d4010d650 con 0x7f4d40102650 2024-09-19T04:48:01.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.547+0000 7f4d4780e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4d4010d4d0 con 0x7f4d40104f80 2024-09-19T04:48:01.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.547+0000 7f4d4780e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f4d4010d7d0 con 0x7f4d401078b0 2024-09-19T04:48:01.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.547+0000 7f4d455aa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d40102650 0x7f4d40101fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:01.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.547+0000 7f4d455aa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d40102650 0x7f4d40101fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45386/0 (socket says 172.21.15.2:45386) 2024-09-19T04:48:01.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.547+0000 7f4d455aa640 1 -- 172.21.15.2:0/826735607 learned_addr learned my addr 172.21.15.2:0/826735607 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:48:01.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.547+0000 7f4d44da9640 1 --2- 172.21.15.2:0/826735607 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d40104f80 0x7f4d40100600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:01.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.547+0000 7f4d45dab640 1 --2- 172.21.15.2:0/826735607 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d401078b0 0x7f4d40100b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:01.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.547+0000 7f4d455aa640 1 -- 172.21.15.2:0/826735607 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d401078b0 msgr2=0x7f4d40100b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:01.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.547+0000 7f4d455aa640 1 --2- 172.21.15.2:0/826735607 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d401078b0 0x7f4d40100b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:01.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.547+0000 7f4d455aa640 1 -- 172.21.15.2:0/826735607 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d40104f80 msgr2=0x7f4d40100600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:01.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.547+0000 7f4d455aa640 1 --2- 172.21.15.2:0/826735607 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d40104f80 0x7f4d40100600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:01.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.547+0000 7f4d455aa640 1 -- 172.21.15.2:0/826735607 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d401013d0 con 0x7f4d40102650 2024-09-19T04:48:01.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.547+0000 7f4d455aa640 1 --2- 172.21.15.2:0/826735607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d40102650 0x7f4d40101fc0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c00d950 tx=0x7f4d3c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:01.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.547+0000 7f4d367fc640 1 -- 172.21.15.2:0/826735607 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c017030 con 0x7f4d40102650 2024-09-19T04:48:01.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.547+0000 7f4d367fc640 1 -- 172.21.15.2:0/826735607 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4d3c004020 con 0x7f4d40102650 2024-09-19T04:48:01.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.547+0000 7f4d4780e640 1 -- 172.21.15.2:0/826735607 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d401a1f60 con 0x7f4d40102650 2024-09-19T04:48:01.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.547+0000 7f4d367fc640 1 -- 172.21.15.2:0/826735607 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c0047a0 con 0x7f4d40102650 2024-09-19T04:48:01.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.547+0000 7f4d4780e640 1 -- 172.21.15.2:0/826735607 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d401a2360 con 0x7f4d40102650 2024-09-19T04:48:01.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.549+0000 7f4d4780e640 1 -- 172.21.15.2:0/826735607 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d400fdc80 con 0x7f4d40102650 2024-09-19T04:48:01.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.550+0000 7f4d367fc640 1 -- 172.21.15.2:0/826735607 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 138167+0+0 (secure 0 0 0) 0x7f4d3c0041d0 con 0x7f4d40102650 2024-09-19T04:48:01.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.550+0000 7f4d367fc640 1 --2- 172.21.15.2:0/826735607 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f4d2c0a3050 0x7f4d2c0a5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:01.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.550+0000 7f4d367fc640 1 -- 172.21.15.2:0/826735607 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f4d3c0cf050 con 0x7f4d40102650 2024-09-19T04:48:01.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.551+0000 7f4d44da9640 1 --2- 172.21.15.2:0/826735607 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f4d2c0a3050 0x7f4d2c0a5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:01.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.551+0000 7f4d44da9640 1 --2- 172.21.15.2:0/826735607 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f4d2c0a3050 0x7f4d2c0a5510 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4d30004770 tx=0x7f4d30000bc0 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:01.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:01 smithi018 ceph-mon[34537]: mgrmap e21: x(active, since 1.019s), standbys: y, z 2024-09-19T04:48:01.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:01 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/2181974152' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:48:01.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:01 smithi018 ceph-mon[34537]: [19/Sep/2024:04:48:00] ENGINE Bus STARTING 2024-09-19T04:48:01.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:01 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/3322896677' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T04:48:01.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:01 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:01.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:01 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:01.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.555+0000 7f4d367fc640 1 -- 172.21.15.2:0/826735607 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4d3c09bf60 con 0x7f4d40102650 2024-09-19T04:48:01.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:01 smithi116 ceph-mon[34477]: mgrmap e21: x(active, since 1.019s), standbys: y, z 2024-09-19T04:48:01.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:01 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/2181974152' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:48:01.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:01 smithi116 ceph-mon[34477]: [19/Sep/2024:04:48:00] ENGINE Bus STARTING 2024-09-19T04:48:01.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:01 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/3322896677' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T04:48:01.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:01 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:01.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:01 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:01.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.733+0000 7f4d4780e640 1 -- 172.21.15.2:0/826735607 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4d40062ef0 con 0x7f4d40102650 2024-09-19T04:48:01.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.733+0000 7f4d367fc640 1 -- 172.21.15.2:0/826735607 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) ==== 100+0+11 (secure 0 0 0) 0x7f4d3c09b860 con 0x7f4d40102650 2024-09-19T04:48:01.735 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2024-09-19T04:48:01.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.735+0000 7f4d4780e640 1 -- 172.21.15.2:0/826735607 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f4d2c0a3050 msgr2=0x7f4d2c0a5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:01.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.735+0000 7f4d4780e640 1 --2- 172.21.15.2:0/826735607 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f4d2c0a3050 0x7f4d2c0a5510 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4d30004770 tx=0x7f4d30000bc0 comp rx=0 tx=0).stop 2024-09-19T04:48:01.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.735+0000 7f4d4780e640 1 -- 172.21.15.2:0/826735607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d40102650 msgr2=0x7f4d40101fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:01.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.735+0000 7f4d4780e640 1 --2- 172.21.15.2:0/826735607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d40102650 0x7f4d40101fc0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c00d950 tx=0x7f4d3c00de10 comp rx=0 tx=0).stop 2024-09-19T04:48:01.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.735+0000 7f4d4780e640 1 -- 172.21.15.2:0/826735607 shutdown_connections 2024-09-19T04:48:01.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.735+0000 7f4d4780e640 1 --2- 172.21.15.2:0/826735607 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f4d2c0a3050 0x7f4d2c0a5510 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:01.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.735+0000 7f4d4780e640 1 --2- 172.21.15.2:0/826735607 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d401078b0 0x7f4d40100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:01.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.735+0000 7f4d4780e640 1 --2- 172.21.15.2:0/826735607 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d40104f80 0x7f4d40100600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:01.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.735+0000 7f4d4780e640 1 --2- 172.21.15.2:0/826735607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d40102650 0x7f4d40101fc0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:01.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.735+0000 7f4d4780e640 1 -- 172.21.15.2:0/826735607 >> 172.21.15.2:0/826735607 conn(0x7f4d400fc190 msgr2=0x7f4d40102f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:01.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.735+0000 7f4d4780e640 1 -- 172.21.15.2:0/826735607 shutdown_connections 2024-09-19T04:48:01.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:01.735+0000 7f4d4780e640 1 -- 172.21.15.2:0/826735607 wait complete. 2024-09-19T04:48:01.751 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-19T04:48:01.752 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:48:02.024 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:48:02.444 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:02 smithi002 ceph-mon[30975]: [19/Sep/2024:04:48:01] ENGINE Serving on http://172.21.15.2:8765 2024-09-19T04:48:02.444 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:02 smithi002 ceph-mon[30975]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:48:02.444 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:02 smithi002 ceph-mon[30975]: [19/Sep/2024:04:48:01] ENGINE Serving on https://172.21.15.2:7150 2024-09-19T04:48:02.444 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:02 smithi002 ceph-mon[30975]: [19/Sep/2024:04:48:01] ENGINE Bus STARTED 2024-09-19T04:48:02.444 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:02 smithi002 ceph-mon[30975]: [19/Sep/2024:04:48:01] ENGINE Error in HTTPServer.serve 2024-09-19T04:48:02.444 INFO:journalctl@ceph.mon.a.smithi002.stdout: Traceback (most recent call last): 2024-09-19T04:48:02.444 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T04:48:02.444 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._connections.run(self.expiration_interval) 2024-09-19T04:48:02.445 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T04:48:02.445 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._run(expiration_interval) 2024-09-19T04:48:02.445 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T04:48:02.445 INFO:journalctl@ceph.mon.a.smithi002.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T04:48:02.445 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T04:48:02.445 INFO:journalctl@ceph.mon.a.smithi002.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T04:48:02.445 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T04:48:02.445 INFO:journalctl@ceph.mon.a.smithi002.stdout: s = self.context.wrap_socket( 2024-09-19T04:48:02.445 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T04:48:02.445 INFO:journalctl@ceph.mon.a.smithi002.stdout: return self.sslsocket_class._create( 2024-09-19T04:48:02.445 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T04:48:02.446 INFO:journalctl@ceph.mon.a.smithi002.stdout: self.do_handshake() 2024-09-19T04:48:02.446 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T04:48:02.448 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._sslobj.do_handshake() 2024-09-19T04:48:02.448 INFO:journalctl@ceph.mon.a.smithi002.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T04:48:02.448 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:02 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:02.448 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:02 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:02.448 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:02 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:02.448 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:02 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:02.448 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:02 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/3258067939' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T04:48:02.449 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:02 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/826735607' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T04:48:02.449 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:02 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:02.449 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:02 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:02.449 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:02 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:48:02.449 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:02 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:48:02.449 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:02 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:48:02.449 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:02 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:48:02.449 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:02 smithi002 ceph-mon[30975]: Adjusting osd_memory_target on smithi116 to 176.0M 2024-09-19T04:48:02.449 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:02 smithi002 ceph-mon[30975]: Unable to set osd_memory_target on smithi116 to 184578150: error parsing value: Value '184578150' is below minimum 939524096 2024-09-19T04:48:02.449 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:02 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:02.449 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:02 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:02.449 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:02 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:48:02.449 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:02 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:48:02.450 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:02 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:48:02.450 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:02 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:48:02.450 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:02 smithi002 ceph-mon[30975]: Adjusting osd_memory_target on smithi018 to 177.0M 2024-09-19T04:48:02.450 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:02 smithi002 ceph-mon[30975]: Unable to set osd_memory_target on smithi018 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-19T04:48:02.450 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:02 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:02.450 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:02 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:02.450 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:02 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:48:02.450 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:02 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:48:02.450 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:02 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:48:02.450 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:02 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:48:02.450 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:02 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:48:02.450 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:02 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:48:02.451 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:02 smithi002 ceph-mon[30975]: mgrmap e22: x(active, since 2s), standbys: y, z 2024-09-19T04:48:02.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.556+0000 7f72d00ea640 1 -- 172.21.15.2:0/1887154826 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72c8100100 msgr2=0x7f72c8100560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:02.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.556+0000 7f72d00ea640 1 --2- 172.21.15.2:0/1887154826 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72c8100100 0x7f72c8100560 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f72b8009900 tx=0x7f72b802a410 comp rx=0 tx=0).stop 2024-09-19T04:48:02.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.556+0000 7f72d00ea640 1 -- 172.21.15.2:0/1887154826 shutdown_connections 2024-09-19T04:48:02.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.556+0000 7f72d00ea640 1 --2- 172.21.15.2:0/1887154826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72c8100aa0 0x7f72c810ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:02.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.556+0000 7f72d00ea640 1 --2- 172.21.15.2:0/1887154826 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72c8100100 0x7f72c8100560 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:02.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.556+0000 7f72d00ea640 1 --2- 172.21.15.2:0/1887154826 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f72c8106b80 0x7f72c8106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:02.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.556+0000 7f72d00ea640 1 -- 172.21.15.2:0/1887154826 >> 172.21.15.2:0/1887154826 conn(0x7f72c8077230 msgr2=0x7f72c80fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:02.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.557+0000 7f72d00ea640 1 -- 172.21.15.2:0/1887154826 shutdown_connections 2024-09-19T04:48:02.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.557+0000 7f72d00ea640 1 -- 172.21.15.2:0/1887154826 wait complete. 2024-09-19T04:48:02.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.557+0000 7f72d00ea640 1 Processor -- start 2024-09-19T04:48:02.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.557+0000 7f72d00ea640 1 -- start start 2024-09-19T04:48:02.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.558+0000 7f72d00ea640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72c8100100 0x7f72c8198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:02.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.558+0000 7f72d00ea640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f72c8100aa0 0x7f72c8198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:02.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.558+0000 7f72d00ea640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72c8106b80 0x7f72c819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:02.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.558+0000 7f72d00ea640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f72c8111f10 con 0x7f72c8100100 2024-09-19T04:48:02.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.558+0000 7f72d00ea640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f72c8111d90 con 0x7f72c8106b80 2024-09-19T04:48:02.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.558+0000 7f72d00ea640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f72c8112090 con 0x7f72c8100aa0 2024-09-19T04:48:02.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.558+0000 7f72cd685640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f72c8100aa0 0x7f72c8198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:02.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.558+0000 7f72ce687640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72c8106b80 0x7f72c819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:02.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.558+0000 7f72cd685640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f72c8100aa0 0x7f72c8198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.2:51076/0 (socket says 172.21.15.2:51076) 2024-09-19T04:48:02.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.558+0000 7f72cd685640 1 -- 172.21.15.2:0/3194794748 learned_addr learned my addr 172.21.15.2:0/3194794748 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:48:02.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.558+0000 7f72cde86640 1 --2- 172.21.15.2:0/3194794748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72c8100100 0x7f72c8198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:02.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.558+0000 7f72cd685640 1 -- 172.21.15.2:0/3194794748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72c8106b80 msgr2=0x7f72c819cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:02.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.558+0000 7f72cd685640 1 --2- 172.21.15.2:0/3194794748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72c8106b80 0x7f72c819cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:02.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.558+0000 7f72cd685640 1 -- 172.21.15.2:0/3194794748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72c8100100 msgr2=0x7f72c8198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:02.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.558+0000 7f72cd685640 1 --2- 172.21.15.2:0/3194794748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72c8100100 0x7f72c8198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:02.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.558+0000 7f72cd685640 1 -- 172.21.15.2:0/3194794748 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72c819d400 con 0x7f72c8100aa0 2024-09-19T04:48:02.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.558+0000 7f72cd685640 1 --2- 172.21.15.2:0/3194794748 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f72c8100aa0 0x7f72c8198990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f72b8005ab0 tx=0x7f72b8003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:02.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.559+0000 7f72beffd640 1 -- 172.21.15.2:0/3194794748 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b803f070 con 0x7f72c8100aa0 2024-09-19T04:48:02.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.559+0000 7f72beffd640 1 -- 172.21.15.2:0/3194794748 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f72b8031b60 con 0x7f72c8100aa0 2024-09-19T04:48:02.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.559+0000 7f72d00ea640 1 -- 172.21.15.2:0/3194794748 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72c819d690 con 0x7f72c8100aa0 2024-09-19T04:48:02.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.559+0000 7f72beffd640 1 -- 172.21.15.2:0/3194794748 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b8035030 con 0x7f72c8100aa0 2024-09-19T04:48:02.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.559+0000 7f72d00ea640 1 -- 172.21.15.2:0/3194794748 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72c8101210 con 0x7f72c8100aa0 2024-09-19T04:48:02.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.560+0000 7f72d00ea640 1 -- 172.21.15.2:0/3194794748 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72ac005290 con 0x7f72c8100aa0 2024-09-19T04:48:02.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.561+0000 7f72beffd640 1 -- 172.21.15.2:0/3194794748 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 22) ==== 138474+0+0 (secure 0 0 0) 0x7f72b8042070 con 0x7f72c8100aa0 2024-09-19T04:48:02.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.562+0000 7f72beffd640 1 --2- 172.21.15.2:0/3194794748 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f72b40a3430 0x7f72b40a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:02.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.562+0000 7f72cde86640 1 --2- 172.21.15.2:0/3194794748 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f72b40a3430 0x7f72b40a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:02.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.562+0000 7f72beffd640 1 -- 172.21.15.2:0/3194794748 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f72b80f0200 con 0x7f72c8100aa0 2024-09-19T04:48:02.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.563+0000 7f72cde86640 1 --2- 172.21.15.2:0/3194794748 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f72b40a3430 0x7f72b40a58f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f72c4010d00 tx=0x7f72c4012040 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:02.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.566+0000 7f72beffd640 1 -- 172.21.15.2:0/3194794748 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f72b80bc550 con 0x7f72c8100aa0 2024-09-19T04:48:02.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:02 smithi116 ceph-mon[34477]: [19/Sep/2024:04:48:01] ENGINE Serving on http://172.21.15.2:8765 2024-09-19T04:48:02.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:02 smithi116 ceph-mon[34477]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:48:02.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:02 smithi116 ceph-mon[34477]: [19/Sep/2024:04:48:01] ENGINE Serving on https://172.21.15.2:7150 2024-09-19T04:48:02.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:02 smithi116 ceph-mon[34477]: [19/Sep/2024:04:48:01] ENGINE Bus STARTED 2024-09-19T04:48:02.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:02 smithi116 ceph-mon[34477]: [19/Sep/2024:04:48:01] ENGINE Error in HTTPServer.serve 2024-09-19T04:48:02.611 INFO:journalctl@ceph.mon.c.smithi116.stdout: Traceback (most recent call last): 2024-09-19T04:48:02.611 INFO:journalctl@ceph.mon.c.smithi116.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T04:48:02.611 INFO:journalctl@ceph.mon.c.smithi116.stdout: self._connections.run(self.expiration_interval) 2024-09-19T04:48:02.611 INFO:journalctl@ceph.mon.c.smithi116.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T04:48:02.611 INFO:journalctl@ceph.mon.c.smithi116.stdout: self._run(expiration_interval) 2024-09-19T04:48:02.611 INFO:journalctl@ceph.mon.c.smithi116.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T04:48:02.612 INFO:journalctl@ceph.mon.c.smithi116.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T04:48:02.612 INFO:journalctl@ceph.mon.c.smithi116.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T04:48:02.612 INFO:journalctl@ceph.mon.c.smithi116.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T04:48:02.612 INFO:journalctl@ceph.mon.c.smithi116.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T04:48:02.612 INFO:journalctl@ceph.mon.c.smithi116.stdout: s = self.context.wrap_socket( 2024-09-19T04:48:02.612 INFO:journalctl@ceph.mon.c.smithi116.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T04:48:02.612 INFO:journalctl@ceph.mon.c.smithi116.stdout: return self.sslsocket_class._create( 2024-09-19T04:48:02.612 INFO:journalctl@ceph.mon.c.smithi116.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T04:48:02.612 INFO:journalctl@ceph.mon.c.smithi116.stdout: self.do_handshake() 2024-09-19T04:48:02.612 INFO:journalctl@ceph.mon.c.smithi116.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T04:48:02.612 INFO:journalctl@ceph.mon.c.smithi116.stdout: self._sslobj.do_handshake() 2024-09-19T04:48:02.612 INFO:journalctl@ceph.mon.c.smithi116.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T04:48:02.613 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:02 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:02.613 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:02 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:02.613 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:02 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:02.613 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:02 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:02.613 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:02 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/3258067939' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T04:48:02.613 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:02 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/826735607' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T04:48:02.613 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:02 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:02.613 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:02 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:02.613 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:02 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:48:02.614 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:02 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:48:02.614 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:02 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:48:02.614 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:02 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:48:02.614 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:02 smithi116 ceph-mon[34477]: Adjusting osd_memory_target on smithi116 to 176.0M 2024-09-19T04:48:02.614 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:02 smithi116 ceph-mon[34477]: Unable to set osd_memory_target on smithi116 to 184578150: error parsing value: Value '184578150' is below minimum 939524096 2024-09-19T04:48:02.614 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:02 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:02.614 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:02 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:02.614 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:02 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:48:02.614 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:02 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:48:02.614 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:02 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:48:02.614 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:02 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:48:02.614 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:02 smithi116 ceph-mon[34477]: Adjusting osd_memory_target on smithi018 to 177.0M 2024-09-19T04:48:02.615 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:02 smithi116 ceph-mon[34477]: Unable to set osd_memory_target on smithi018 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-19T04:48:02.615 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:02 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:02.615 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:02 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:02.615 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:02 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:48:02.615 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:02 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:48:02.615 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:02 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:48:02.615 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:02 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:48:02.615 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:02 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:48:02.615 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:02 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:48:02.615 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:02 smithi116 ceph-mon[34477]: mgrmap e22: x(active, since 2s), standbys: y, z 2024-09-19T04:48:02.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.787+0000 7f72d00ea640 1 -- 172.21.15.2:0/3194794748 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f72ac005850 con 0x7f72c8100aa0 2024-09-19T04:48:02.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.788+0000 7f72beffd640 1 -- 172.21.15.2:0/3194794748 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11840 (secure 0 0 0) 0x7f72b80c0850 con 0x7f72c8100aa0 2024-09-19T04:48:02.790 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:48:02.790 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":19,"btime":"2024-09-19T04:46:33:537239+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2467365137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2467365137},{"type":"v1","addr":"172.21.15.2:6835","nonce":2467365137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3162441888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3162441888},{"type":"v1","addr":"172.21.15.2:6837","nonce":3162441888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14631,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2740862966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2740862966},{"type":"v1","addr":"172.21.15.2:6839","nonce":2740862966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/2394435504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2394435504},{"type":"v1","addr":"172.21.15.2:6841","nonce":2394435504}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1630480244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1630480244},{"type":"v1","addr":"172.21.15.18:6833","nonce":1630480244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1553897465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1553897465},{"type":"v1","addr":"172.21.15.116:6833","nonce":1553897465}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3035664608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3035664608},{"type":"v1","addr":"172.21.15.18:6835","nonce":3035664608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1096622392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1096622392},{"type":"v1","addr":"172.21.15.18:6837","nonce":1096622392}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3761157675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3761157675},{"type":"v1","addr":"172.21.15.116:6835","nonce":3761157675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/1120131594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1120131594},{"type":"v1","addr":"172.21.15.116:6837","nonce":1120131594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:46:24.050115+0000","modified":"2024-09-19T04:46:33.112369+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/4207677139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":4207677139},{"type":"v1","addr":"172.21.15.18:6839","nonce":4207677139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/2346874880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":2346874880},{"type":"v1","addr":"172.21.15.116:6839","nonce":2346874880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496]},"id":1}]} 2024-09-19T04:48:02.791 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 19 2024-09-19T04:48:02.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.790+0000 7f72d00ea640 1 -- 172.21.15.2:0/3194794748 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f72b40a3430 msgr2=0x7f72b40a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:02.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.790+0000 7f72d00ea640 1 --2- 172.21.15.2:0/3194794748 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f72b40a3430 0x7f72b40a58f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f72c4010d00 tx=0x7f72c4012040 comp rx=0 tx=0).stop 2024-09-19T04:48:02.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.790+0000 7f72d00ea640 1 -- 172.21.15.2:0/3194794748 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f72c8100aa0 msgr2=0x7f72c8198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:02.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.790+0000 7f72d00ea640 1 --2- 172.21.15.2:0/3194794748 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f72c8100aa0 0x7f72c8198990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f72b8005ab0 tx=0x7f72b8003c10 comp rx=0 tx=0).stop 2024-09-19T04:48:02.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.790+0000 7f72d00ea640 1 -- 172.21.15.2:0/3194794748 shutdown_connections 2024-09-19T04:48:02.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.790+0000 7f72d00ea640 1 --2- 172.21.15.2:0/3194794748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72c8106b80 0x7f72c819cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:02.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.790+0000 7f72d00ea640 1 --2- 172.21.15.2:0/3194794748 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f72b40a3430 0x7f72b40a58f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:02.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.790+0000 7f72d00ea640 1 --2- 172.21.15.2:0/3194794748 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f72c8100aa0 0x7f72c8198990 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:02.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.790+0000 7f72d00ea640 1 --2- 172.21.15.2:0/3194794748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72c8100100 0x7f72c8198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:02.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.790+0000 7f72d00ea640 1 -- 172.21.15.2:0/3194794748 >> 172.21.15.2:0/3194794748 conn(0x7f72c8077230 msgr2=0x7f72c81053b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:02.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.791+0000 7f72d00ea640 1 -- 172.21.15.2:0/3194794748 shutdown_connections 2024-09-19T04:48:02.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:02.791+0000 7f72d00ea640 1 -- 172.21.15.2:0/3194794748 wait complete. 2024-09-19T04:48:02.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:02 smithi018 ceph-mon[34537]: [19/Sep/2024:04:48:01] ENGINE Serving on http://172.21.15.2:8765 2024-09-19T04:48:02.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:02 smithi018 ceph-mon[34537]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:48:02.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:02 smithi018 ceph-mon[34537]: [19/Sep/2024:04:48:01] ENGINE Serving on https://172.21.15.2:7150 2024-09-19T04:48:02.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:02 smithi018 ceph-mon[34537]: [19/Sep/2024:04:48:01] ENGINE Bus STARTED 2024-09-19T04:48:02.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:02 smithi018 ceph-mon[34537]: [19/Sep/2024:04:48:01] ENGINE Error in HTTPServer.serve 2024-09-19T04:48:02.807 INFO:journalctl@ceph.mon.b.smithi018.stdout: Traceback (most recent call last): 2024-09-19T04:48:02.807 INFO:journalctl@ceph.mon.b.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T04:48:02.807 INFO:journalctl@ceph.mon.b.smithi018.stdout: self._connections.run(self.expiration_interval) 2024-09-19T04:48:02.807 INFO:journalctl@ceph.mon.b.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T04:48:02.808 INFO:journalctl@ceph.mon.b.smithi018.stdout: self._run(expiration_interval) 2024-09-19T04:48:02.808 INFO:journalctl@ceph.mon.b.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T04:48:02.808 INFO:journalctl@ceph.mon.b.smithi018.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T04:48:02.808 INFO:journalctl@ceph.mon.b.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T04:48:02.808 INFO:journalctl@ceph.mon.b.smithi018.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T04:48:02.808 INFO:journalctl@ceph.mon.b.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T04:48:02.808 INFO:journalctl@ceph.mon.b.smithi018.stdout: s = self.context.wrap_socket( 2024-09-19T04:48:02.808 INFO:journalctl@ceph.mon.b.smithi018.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T04:48:02.808 INFO:journalctl@ceph.mon.b.smithi018.stdout: return self.sslsocket_class._create( 2024-09-19T04:48:02.808 INFO:journalctl@ceph.mon.b.smithi018.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T04:48:02.808 INFO:journalctl@ceph.mon.b.smithi018.stdout: self.do_handshake() 2024-09-19T04:48:02.808 INFO:journalctl@ceph.mon.b.smithi018.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T04:48:02.809 INFO:journalctl@ceph.mon.b.smithi018.stdout: self._sslobj.do_handshake() 2024-09-19T04:48:02.809 INFO:journalctl@ceph.mon.b.smithi018.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T04:48:02.809 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:02 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:02.809 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:02 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:02.809 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:02 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:02.809 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:02 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:02.809 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:02 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/3258067939' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T04:48:02.809 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:02 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/826735607' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T04:48:02.809 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:02 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:02.809 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:02 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:02.809 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:02 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:48:02.809 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:02 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:48:02.810 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:02 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:48:02.810 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:02 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:48:02.810 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:02 smithi018 ceph-mon[34537]: Adjusting osd_memory_target on smithi116 to 176.0M 2024-09-19T04:48:02.810 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:02 smithi018 ceph-mon[34537]: Unable to set osd_memory_target on smithi116 to 184578150: error parsing value: Value '184578150' is below minimum 939524096 2024-09-19T04:48:02.810 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:02 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:02.810 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:02 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:02.810 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:02 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:48:02.810 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:02 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:48:02.810 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:02 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:48:02.810 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:02 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:48:02.810 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:02 smithi018 ceph-mon[34537]: Adjusting osd_memory_target on smithi018 to 177.0M 2024-09-19T04:48:02.810 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:02 smithi018 ceph-mon[34537]: Unable to set osd_memory_target on smithi018 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-19T04:48:02.810 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:02 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:02.810 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:02 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:02.811 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:02 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:48:02.811 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:02 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:48:02.811 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:02 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:48:02.811 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:02 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:48:02.811 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:02 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:48:02.811 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:02 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:48:02.811 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:02 smithi018 ceph-mon[34537]: mgrmap e22: x(active, since 2s), standbys: y, z 2024-09-19T04:48:03.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:03 smithi002 ceph-mon[30975]: Adjusting osd_memory_target on smithi002 to 177.0M 2024-09-19T04:48:03.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:03 smithi002 ceph-mon[30975]: Unable to set osd_memory_target on smithi002 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-19T04:48:03.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:03 smithi002 ceph-mon[30975]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-19T04:48:03.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:03 smithi002 ceph-mon[30975]: Updating smithi018:/etc/ceph/ceph.conf 2024-09-19T04:48:03.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:03 smithi002 ceph-mon[30975]: Updating smithi116:/etc/ceph/ceph.conf 2024-09-19T04:48:03.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:03 smithi002 ceph-mon[30975]: Updating smithi002:/var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:48:03.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:03 smithi002 ceph-mon[30975]: Updating smithi018:/var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:48:03.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:03 smithi002 ceph-mon[30975]: Updating smithi116:/var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:48:03.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:03 smithi002 ceph-mon[30975]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2024-09-19T04:48:03.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:03 smithi002 ceph-mon[30975]: Updating smithi018:/etc/ceph/ceph.client.admin.keyring 2024-09-19T04:48:03.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:03 smithi002 ceph-mon[30975]: Updating smithi116:/etc/ceph/ceph.client.admin.keyring 2024-09-19T04:48:03.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:03 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/3194794748' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:48:03.361 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:03 smithi002 ceph-mon[30975]: Updating smithi002:/var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T04:48:03.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:03 smithi116 ceph-mon[34477]: Adjusting osd_memory_target on smithi002 to 177.0M 2024-09-19T04:48:03.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:03 smithi116 ceph-mon[34477]: Unable to set osd_memory_target on smithi002 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-19T04:48:03.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:03 smithi116 ceph-mon[34477]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-19T04:48:03.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:03 smithi116 ceph-mon[34477]: Updating smithi018:/etc/ceph/ceph.conf 2024-09-19T04:48:03.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:03 smithi116 ceph-mon[34477]: Updating smithi116:/etc/ceph/ceph.conf 2024-09-19T04:48:03.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:03 smithi116 ceph-mon[34477]: Updating smithi002:/var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:48:03.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:03 smithi116 ceph-mon[34477]: Updating smithi018:/var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:48:03.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:03 smithi116 ceph-mon[34477]: Updating smithi116:/var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:48:03.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:03 smithi116 ceph-mon[34477]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2024-09-19T04:48:03.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:03 smithi116 ceph-mon[34477]: Updating smithi018:/etc/ceph/ceph.client.admin.keyring 2024-09-19T04:48:03.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:03 smithi116 ceph-mon[34477]: Updating smithi116:/etc/ceph/ceph.client.admin.keyring 2024-09-19T04:48:03.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:03 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/3194794748' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:48:03.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:03 smithi116 ceph-mon[34477]: Updating smithi002:/var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T04:48:03.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:03 smithi116 ceph-mon[34477]: Updating smithi116:/var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T04:48:03.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:03 smithi116 ceph-mon[34477]: Updating smithi018:/var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T04:48:03.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:03 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:03.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:03 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:03.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:03 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:03.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:03 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:03.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:03 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:03.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:03 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:03.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:03 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:03.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:03 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:48:03.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:03 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:48:03.613 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:03 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:48:03.613 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:03 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:03.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:03 smithi002 ceph-mon[30975]: Updating smithi116:/var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T04:48:03.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:03 smithi002 ceph-mon[30975]: Updating smithi018:/var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T04:48:03.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:03 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:03.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:03 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:03.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:03 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:03.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:03 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:03.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:03 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:03.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:03 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:03.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:03 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:03.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:03 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:48:03.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:03 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:48:03.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:03 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:48:03.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:03 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:03.632 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-19T04:48:03.632 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-19T04:48:03.633 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T04:48:03.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.736+0000 7f25afe82640 1 -- 172.21.15.2:0/3994328641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25a8101360 msgr2=0x7f25a810d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:03.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.736+0000 7f25afe82640 1 --2- 172.21.15.2:0/3994328641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25a8101360 0x7f25a810d890 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f25a0009cd0 tx=0x7f25a002a8e0 comp rx=0 tx=0).stop 2024-09-19T04:48:03.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.736+0000 7f25afe82640 1 -- 172.21.15.2:0/3994328641 shutdown_connections 2024-09-19T04:48:03.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.736+0000 7f25afe82640 1 --2- 172.21.15.2:0/3994328641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25a8101360 0x7f25a810d890 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:03.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.736+0000 7f25afe82640 1 --2- 172.21.15.2:0/3994328641 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25a81009c0 0x7f25a8100e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:03.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.736+0000 7f25afe82640 1 --2- 172.21.15.2:0/3994328641 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25a81069d0 0x7f25a8106db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:03.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.736+0000 7f25afe82640 1 -- 172.21.15.2:0/3994328641 >> 172.21.15.2:0/3994328641 conn(0x7f25a8077a10 msgr2=0x7f25a80fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:03.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.736+0000 7f25afe82640 1 -- 172.21.15.2:0/3994328641 shutdown_connections 2024-09-19T04:48:03.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.736+0000 7f25afe82640 1 -- 172.21.15.2:0/3994328641 wait complete. 2024-09-19T04:48:03.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.737+0000 7f25afe82640 1 Processor -- start 2024-09-19T04:48:03.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.737+0000 7f25afe82640 1 -- start start 2024-09-19T04:48:03.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.737+0000 7f25afe82640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25a81009c0 0x7f25a8199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:03.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.737+0000 7f25afe82640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25a8101360 0x7f25a8199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:03.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.737+0000 7f25afe82640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25a81069d0 0x7f25a81a41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:03.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.737+0000 7f25afe82640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f25a8110cc0 con 0x7f25a81009c0 2024-09-19T04:48:03.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.737+0000 7f25afe82640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f25a8110b40 con 0x7f25a81069d0 2024-09-19T04:48:03.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.737+0000 7f25afe82640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f25a8110e40 con 0x7f25a8101360 2024-09-19T04:48:03.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.737+0000 7f25adc1e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25a81009c0 0x7f25a8199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:03.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.737+0000 7f25adc1e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25a81009c0 0x7f25a8199130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45408/0 (socket says 172.21.15.2:45408) 2024-09-19T04:48:03.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.737+0000 7f25adc1e640 1 -- 172.21.15.2:0/538600264 learned_addr learned my addr 172.21.15.2:0/538600264 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:48:03.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.737+0000 7f25ae41f640 1 --2- 172.21.15.2:0/538600264 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25a81069d0 0x7f25a81a41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:03.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.737+0000 7f25ad41d640 1 --2- 172.21.15.2:0/538600264 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25a8101360 0x7f25a8199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:03.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.737+0000 7f25adc1e640 1 -- 172.21.15.2:0/538600264 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25a8101360 msgr2=0x7f25a8199670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:03.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.737+0000 7f25adc1e640 1 --2- 172.21.15.2:0/538600264 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25a8101360 0x7f25a8199670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:03.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.737+0000 7f25adc1e640 1 -- 172.21.15.2:0/538600264 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25a81069d0 msgr2=0x7f25a81a41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:03.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.737+0000 7f25adc1e640 1 --2- 172.21.15.2:0/538600264 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25a81069d0 0x7f25a81a41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:03.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.737+0000 7f25adc1e640 1 -- 172.21.15.2:0/538600264 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25a81a46f0 con 0x7f25a81009c0 2024-09-19T04:48:03.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.737+0000 7f25adc1e640 1 --2- 172.21.15.2:0/538600264 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25a81009c0 0x7f25a8199130 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f25a400e9f0 tx=0x7f25a400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:03.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.738+0000 7f259effd640 1 -- 172.21.15.2:0/538600264 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a400cd80 con 0x7f25a81009c0 2024-09-19T04:48:03.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.738+0000 7f259effd640 1 -- 172.21.15.2:0/538600264 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f25a40108e0 con 0x7f25a81009c0 2024-09-19T04:48:03.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.738+0000 7f25afe82640 1 -- 172.21.15.2:0/538600264 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25a81a48c0 con 0x7f25a81009c0 2024-09-19T04:48:03.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.738+0000 7f259effd640 1 -- 172.21.15.2:0/538600264 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a4018920 con 0x7f25a81009c0 2024-09-19T04:48:03.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.738+0000 7f25afe82640 1 -- 172.21.15.2:0/538600264 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25a81a4e30 con 0x7f25a81009c0 2024-09-19T04:48:03.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.739+0000 7f25afe82640 1 -- 172.21.15.2:0/538600264 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25a8100e20 con 0x7f25a81009c0 2024-09-19T04:48:03.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.740+0000 7f259effd640 1 -- 172.21.15.2:0/538600264 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138530+0+0 (secure 0 0 0) 0x7f25a4010a90 con 0x7f25a81009c0 2024-09-19T04:48:03.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.741+0000 7f259effd640 1 --2- 172.21.15.2:0/538600264 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f25940a34d0 0x7f25940a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:03.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.741+0000 7f25ad41d640 1 --2- 172.21.15.2:0/538600264 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f25940a34d0 0x7f25940a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:03.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.741+0000 7f259effd640 1 -- 172.21.15.2:0/538600264 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f25a40d0530 con 0x7f25a81009c0 2024-09-19T04:48:03.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.741+0000 7f25ad41d640 1 --2- 172.21.15.2:0/538600264 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f25940a34d0 0x7f25940a5990 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f25a806a040 tx=0x7f259800b390 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:03.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.748+0000 7f259effd640 1 -- 172.21.15.2:0/538600264 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f25a409c770 con 0x7f25a81009c0 2024-09-19T04:48:03.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:03 smithi018 ceph-mon[34537]: Adjusting osd_memory_target on smithi002 to 177.0M 2024-09-19T04:48:03.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:03 smithi018 ceph-mon[34537]: Unable to set osd_memory_target on smithi002 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-19T04:48:03.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:03 smithi018 ceph-mon[34537]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-19T04:48:03.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:03 smithi018 ceph-mon[34537]: Updating smithi018:/etc/ceph/ceph.conf 2024-09-19T04:48:03.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:03 smithi018 ceph-mon[34537]: Updating smithi116:/etc/ceph/ceph.conf 2024-09-19T04:48:03.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:03 smithi018 ceph-mon[34537]: Updating smithi002:/var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:48:03.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:03 smithi018 ceph-mon[34537]: Updating smithi018:/var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:48:03.808 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:03 smithi018 ceph-mon[34537]: Updating smithi116:/var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:48:03.808 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:03 smithi018 ceph-mon[34537]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2024-09-19T04:48:03.808 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:03 smithi018 ceph-mon[34537]: Updating smithi018:/etc/ceph/ceph.client.admin.keyring 2024-09-19T04:48:03.808 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:03 smithi018 ceph-mon[34537]: Updating smithi116:/etc/ceph/ceph.client.admin.keyring 2024-09-19T04:48:03.808 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:03 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/3194794748' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:48:03.808 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:03 smithi018 ceph-mon[34537]: Updating smithi002:/var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T04:48:03.808 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:03 smithi018 ceph-mon[34537]: Updating smithi116:/var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T04:48:03.808 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:03 smithi018 ceph-mon[34537]: Updating smithi018:/var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T04:48:03.808 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:03 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:03.808 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:03 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:03.808 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:03 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:03.808 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:03 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:03.808 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:03 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:03.809 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:03 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:03.809 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:03 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:03.809 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:03 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:48:03.809 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:03 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:48:03.809 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:03 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:48:03.809 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:03 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.921+0000 7f25afe82640 1 -- 172.21.15.2:0/538600264 --> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f25a8062630 con 0x7f25940a34d0 2024-09-19T04:48:03.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.928+0000 7f259effd640 1 -- 172.21.15.2:0/538600264 <== mgr.15096 v2:172.21.15.2:6800/852329670 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257781 (secure 0 0 0) 0x7f25a8062630 con 0x7f25940a34d0 2024-09-19T04:48:03.933 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:48:03.935 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-19T04:48:03.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.931+0000 7f25afe82640 1 -- 172.21.15.2:0/538600264 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f25940a34d0 msgr2=0x7f25940a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:03.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.931+0000 7f25afe82640 1 --2- 172.21.15.2:0/538600264 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f25940a34d0 0x7f25940a5990 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f25a806a040 tx=0x7f259800b390 comp rx=0 tx=0).stop 2024-09-19T04:48:03.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.931+0000 7f25afe82640 1 -- 172.21.15.2:0/538600264 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25a81009c0 msgr2=0x7f25a8199130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:03.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.931+0000 7f25afe82640 1 --2- 172.21.15.2:0/538600264 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25a81009c0 0x7f25a8199130 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f25a400e9f0 tx=0x7f25a400eeb0 comp rx=0 tx=0).stop 2024-09-19T04:48:03.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.931+0000 7f25afe82640 1 -- 172.21.15.2:0/538600264 shutdown_connections 2024-09-19T04:48:03.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.931+0000 7f25afe82640 1 --2- 172.21.15.2:0/538600264 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25a81069d0 0x7f25a81a41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:03.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.931+0000 7f25afe82640 1 --2- 172.21.15.2:0/538600264 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f25940a34d0 0x7f25940a5990 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:03.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.931+0000 7f25afe82640 1 --2- 172.21.15.2:0/538600264 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25a8101360 0x7f25a8199670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:03.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.931+0000 7f25afe82640 1 --2- 172.21.15.2:0/538600264 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25a81009c0 0x7f25a8199130 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:03.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.931+0000 7f25afe82640 1 -- 172.21.15.2:0/538600264 >> 172.21.15.2:0/538600264 conn(0x7f25a8077a10 msgr2=0x7f25a8103970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:03.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.931+0000 7f25afe82640 1 -- 172.21.15.2:0/538600264 shutdown_connections 2024-09-19T04:48:03.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:03.931+0000 7f25afe82640 1 -- 172.21.15.2:0/538600264 wait complete. 2024-09-19T04:48:03.945 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-09-19T04:48:03.165032+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1178945,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":420,"num_read_kb":357,"num_write":378,"num_write_kb":4336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1180770,"num_keys_recovered":10,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":783,"ondisk_log_size":783,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":408100,"kb_used_data":12992,"kb_used_omap":18,"kb_used_meta":394797,"kb_avail":1124533724,"statfs":{"total":1151940427776,"available":1151522533376,"internally_reserved":0,"allocated":13303808,"data_stored":7774591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":404272442},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.995966"},"pg_stats":[{"pgid":"3.3f","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.192783+0000","last_change":"2024-09-19T04:46:23.520907+0000","last_active":"2024-09-19T04:47:59.192783+0000","last_peered":"2024-09-19T04:47:59.192783+0000","last_clean":"2024-09-19T04:47:59.192783+0000","last_became_active":"2024-09-19T04:46:23.519321+0000","last_became_peered":"2024-09-19T04:46:23.519321+0000","last_unstale":"2024-09-19T04:47:59.192783+0000","last_undegraded":"2024-09-19T04:47:59.192783+0000","last_fullsized":"2024-09-19T04:47:59.192783+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:31.529472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.200073+0000","last_change":"2024-09-19T04:46:23.515272+0000","last_active":"2024-09-19T04:47:59.200073+0000","last_peered":"2024-09-19T04:47:59.200073+0000","last_clean":"2024-09-19T04:47:59.200073+0000","last_became_active":"2024-09-19T04:46:23.514760+0000","last_became_peered":"2024-09-19T04:46:23.514760+0000","last_unstale":"2024-09-19T04:47:59.200073+0000","last_undegraded":"2024-09-19T04:47:59.200073+0000","last_fullsized":"2024-09-19T04:47:59.200073+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:32.215940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.195688+0000","last_change":"2024-09-19T04:46:23.516809+0000","last_active":"2024-09-19T04:47:59.195688+0000","last_peered":"2024-09-19T04:47:59.195688+0000","last_clean":"2024-09-19T04:47:59.195688+0000","last_became_active":"2024-09-19T04:46:23.516489+0000","last_became_peered":"2024-09-19T04:46:23.516489+0000","last_unstale":"2024-09-19T04:47:59.195688+0000","last_undegraded":"2024-09-19T04:47:59.195688+0000","last_fullsized":"2024-09-19T04:47:59.195688+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:17:51.183061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.178331+0000","last_change":"2024-09-19T04:46:23.506868+0000","last_active":"2024-09-19T04:47:59.178331+0000","last_peered":"2024-09-19T04:47:59.178331+0000","last_clean":"2024-09-19T04:47:59.178331+0000","last_became_active":"2024-09-19T04:46:23.506489+0000","last_became_peered":"2024-09-19T04:46:23.506489+0000","last_unstale":"2024-09-19T04:47:59.178331+0000","last_undegraded":"2024-09-19T04:47:59.178331+0000","last_fullsized":"2024-09-19T04:47:59.178331+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:22.749973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.188617+0000","last_change":"2024-09-19T04:46:23.506733+0000","last_active":"2024-09-19T04:47:59.188617+0000","last_peered":"2024-09-19T04:47:59.188617+0000","last_clean":"2024-09-19T04:47:59.188617+0000","last_became_active":"2024-09-19T04:46:23.506408+0000","last_became_peered":"2024-09-19T04:46:23.506408+0000","last_unstale":"2024-09-19T04:47:59.188617+0000","last_undegraded":"2024-09-19T04:47:59.188617+0000","last_fullsized":"2024-09-19T04:47:59.188617+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:45:31.821607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.190602+0000","last_change":"2024-09-19T04:46:23.523109+0000","last_active":"2024-09-19T04:47:59.190602+0000","last_peered":"2024-09-19T04:47:59.190602+0000","last_clean":"2024-09-19T04:47:59.190602+0000","last_became_active":"2024-09-19T04:46:23.522783+0000","last_became_peered":"2024-09-19T04:46:23.522783+0000","last_unstale":"2024-09-19T04:47:59.190602+0000","last_undegraded":"2024-09-19T04:47:59.190602+0000","last_fullsized":"2024-09-19T04:47:59.190602+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:34:47.622562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.191408+0000","last_change":"2024-09-19T04:46:23.518297+0000","last_active":"2024-09-19T04:47:59.191408+0000","last_peered":"2024-09-19T04:47:59.191408+0000","last_clean":"2024-09-19T04:47:59.191408+0000","last_became_active":"2024-09-19T04:46:23.517974+0000","last_became_peered":"2024-09-19T04:46:23.517974+0000","last_unstale":"2024-09-19T04:47:59.191408+0000","last_undegraded":"2024-09-19T04:47:59.191408+0000","last_fullsized":"2024-09-19T04:47:59.191408+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:23:26.474961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.194736+0000","last_change":"2024-09-19T04:46:23.516255+0000","last_active":"2024-09-19T04:47:59.194736+0000","last_peered":"2024-09-19T04:47:59.194736+0000","last_clean":"2024-09-19T04:47:59.194736+0000","last_became_active":"2024-09-19T04:46:23.515861+0000","last_became_peered":"2024-09-19T04:46:23.515861+0000","last_unstale":"2024-09-19T04:47:59.194736+0000","last_undegraded":"2024-09-19T04:47:59.194736+0000","last_fullsized":"2024-09-19T04:47:59.194736+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:08:19.747905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.191238+0000","last_change":"2024-09-19T04:46:23.520947+0000","last_active":"2024-09-19T04:47:59.191238+0000","last_peered":"2024-09-19T04:47:59.191238+0000","last_clean":"2024-09-19T04:47:59.191238+0000","last_became_active":"2024-09-19T04:46:23.518463+0000","last_became_peered":"2024-09-19T04:46:23.518463+0000","last_unstale":"2024-09-19T04:47:59.191238+0000","last_undegraded":"2024-09-19T04:47:59.191238+0000","last_fullsized":"2024-09-19T04:47:59.191238+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:00.420868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.179165+0000","last_change":"2024-09-19T04:46:23.524145+0000","last_active":"2024-09-19T04:47:59.179165+0000","last_peered":"2024-09-19T04:47:59.179165+0000","last_clean":"2024-09-19T04:47:59.179165+0000","last_became_active":"2024-09-19T04:46:23.523698+0000","last_became_peered":"2024-09-19T04:46:23.523698+0000","last_unstale":"2024-09-19T04:47:59.179165+0000","last_undegraded":"2024-09-19T04:47:59.179165+0000","last_fullsized":"2024-09-19T04:47:59.179165+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:41.370871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.191896+0000","last_change":"2024-09-19T04:46:23.521782+0000","last_active":"2024-09-19T04:47:59.191896+0000","last_peered":"2024-09-19T04:47:59.191896+0000","last_clean":"2024-09-19T04:47:59.191896+0000","last_became_active":"2024-09-19T04:46:23.521452+0000","last_became_peered":"2024-09-19T04:46:23.521452+0000","last_unstale":"2024-09-19T04:47:59.191896+0000","last_undegraded":"2024-09-19T04:47:59.191896+0000","last_fullsized":"2024-09-19T04:47:59.191896+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:11:35.047064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.176831+0000","last_change":"2024-09-19T04:46:23.518174+0000","last_active":"2024-09-19T04:47:59.176831+0000","last_peered":"2024-09-19T04:47:59.176831+0000","last_clean":"2024-09-19T04:47:59.176831+0000","last_became_active":"2024-09-19T04:46:23.516507+0000","last_became_peered":"2024-09-19T04:46:23.516507+0000","last_unstale":"2024-09-19T04:47:59.176831+0000","last_undegraded":"2024-09-19T04:47:59.176831+0000","last_fullsized":"2024-09-19T04:47:59.176831+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:37.878245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.200586+0000","last_change":"2024-09-19T04:46:23.510582+0000","last_active":"2024-09-19T04:47:59.200586+0000","last_peered":"2024-09-19T04:47:59.200586+0000","last_clean":"2024-09-19T04:47:59.200586+0000","last_became_active":"2024-09-19T04:46:23.510135+0000","last_became_peered":"2024-09-19T04:46:23.510135+0000","last_unstale":"2024-09-19T04:47:59.200586+0000","last_undegraded":"2024-09-19T04:47:59.200586+0000","last_fullsized":"2024-09-19T04:47:59.200586+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:09.721696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.200294+0000","last_change":"2024-09-19T04:46:23.517963+0000","last_active":"2024-09-19T04:47:59.200294+0000","last_peered":"2024-09-19T04:47:59.200294+0000","last_clean":"2024-09-19T04:47:59.200294+0000","last_became_active":"2024-09-19T04:46:23.517574+0000","last_became_peered":"2024-09-19T04:46:23.517574+0000","last_unstale":"2024-09-19T04:47:59.200294+0000","last_undegraded":"2024-09-19T04:47:59.200294+0000","last_fullsized":"2024-09-19T04:47:59.200294+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:48:44.494267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.198957+0000","last_change":"2024-09-19T04:46:23.517318+0000","last_active":"2024-09-19T04:47:59.198957+0000","last_peered":"2024-09-19T04:47:59.198957+0000","last_clean":"2024-09-19T04:47:59.198957+0000","last_became_active":"2024-09-19T04:46:23.516973+0000","last_became_peered":"2024-09-19T04:46:23.516973+0000","last_unstale":"2024-09-19T04:47:59.198957+0000","last_undegraded":"2024-09-19T04:47:59.198957+0000","last_fullsized":"2024-09-19T04:47:59.198957+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:46:28.907400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.193578+0000","last_change":"2024-09-19T04:46:23.517468+0000","last_active":"2024-09-19T04:47:59.193578+0000","last_peered":"2024-09-19T04:47:59.193578+0000","last_clean":"2024-09-19T04:47:59.193578+0000","last_became_active":"2024-09-19T04:46:23.517093+0000","last_became_peered":"2024-09-19T04:46:23.517093+0000","last_unstale":"2024-09-19T04:47:59.193578+0000","last_undegraded":"2024-09-19T04:47:59.193578+0000","last_fullsized":"2024-09-19T04:47:59.193578+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:43.435560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.192587+0000","last_change":"2024-09-19T04:46:23.521679+0000","last_active":"2024-09-19T04:47:59.192587+0000","last_peered":"2024-09-19T04:47:59.192587+0000","last_clean":"2024-09-19T04:47:59.192587+0000","last_became_active":"2024-09-19T04:46:23.519346+0000","last_became_peered":"2024-09-19T04:46:23.519346+0000","last_unstale":"2024-09-19T04:47:59.192587+0000","last_undegraded":"2024-09-19T04:47:59.192587+0000","last_fullsized":"2024-09-19T04:47:59.192587+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:31.740226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.187745+0000","last_change":"2024-09-19T04:46:23.517518+0000","last_active":"2024-09-19T04:47:59.187745+0000","last_peered":"2024-09-19T04:47:59.187745+0000","last_clean":"2024-09-19T04:47:59.187745+0000","last_became_active":"2024-09-19T04:46:23.517179+0000","last_became_peered":"2024-09-19T04:46:23.517179+0000","last_unstale":"2024-09-19T04:47:59.187745+0000","last_undegraded":"2024-09-19T04:47:59.187745+0000","last_fullsized":"2024-09-19T04:47:59.187745+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:38.352433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.200230+0000","last_change":"2024-09-19T04:46:23.506618+0000","last_active":"2024-09-19T04:47:59.200230+0000","last_peered":"2024-09-19T04:47:59.200230+0000","last_clean":"2024-09-19T04:47:59.200230+0000","last_became_active":"2024-09-19T04:46:23.506276+0000","last_became_peered":"2024-09-19T04:46:23.506276+0000","last_unstale":"2024-09-19T04:47:59.200230+0000","last_undegraded":"2024-09-19T04:47:59.200230+0000","last_fullsized":"2024-09-19T04:47:59.200230+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:02:42.216717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.181611+0000","last_change":"2024-09-19T04:46:23.518793+0000","last_active":"2024-09-19T04:47:59.181611+0000","last_peered":"2024-09-19T04:47:59.181611+0000","last_clean":"2024-09-19T04:47:59.181611+0000","last_became_active":"2024-09-19T04:46:23.518386+0000","last_became_peered":"2024-09-19T04:46:23.518386+0000","last_unstale":"2024-09-19T04:47:59.181611+0000","last_undegraded":"2024-09-19T04:47:59.181611+0000","last_fullsized":"2024-09-19T04:47:59.181611+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:08:12.007678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.201240+0000","last_change":"2024-09-19T04:46:23.513022+0000","last_active":"2024-09-19T04:47:59.201240+0000","last_peered":"2024-09-19T04:47:59.201240+0000","last_clean":"2024-09-19T04:47:59.201240+0000","last_became_active":"2024-09-19T04:46:23.512541+0000","last_became_peered":"2024-09-19T04:46:23.512541+0000","last_unstale":"2024-09-19T04:47:59.201240+0000","last_undegraded":"2024-09-19T04:47:59.201240+0000","last_fullsized":"2024-09-19T04:47:59.201240+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:19.873546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.198798+0000","last_change":"2024-09-19T04:46:23.519523+0000","last_active":"2024-09-19T04:47:59.198798+0000","last_peered":"2024-09-19T04:47:59.198798+0000","last_clean":"2024-09-19T04:47:59.198798+0000","last_became_active":"2024-09-19T04:46:23.517995+0000","last_became_peered":"2024-09-19T04:46:23.517995+0000","last_unstale":"2024-09-19T04:47:59.198798+0000","last_undegraded":"2024-09-19T04:47:59.198798+0000","last_fullsized":"2024-09-19T04:47:59.198798+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:23.243522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.197448+0000","last_change":"2024-09-19T04:46:23.517564+0000","last_active":"2024-09-19T04:47:59.197448+0000","last_peered":"2024-09-19T04:47:59.197448+0000","last_clean":"2024-09-19T04:47:59.197448+0000","last_became_active":"2024-09-19T04:46:23.517248+0000","last_became_peered":"2024-09-19T04:46:23.517248+0000","last_unstale":"2024-09-19T04:47:59.197448+0000","last_undegraded":"2024-09-19T04:47:59.197448+0000","last_fullsized":"2024-09-19T04:47:59.197448+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:19.369346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.195030+0000","last_change":"2024-09-19T04:46:23.514150+0000","last_active":"2024-09-19T04:47:59.195030+0000","last_peered":"2024-09-19T04:47:59.195030+0000","last_clean":"2024-09-19T04:47:59.195030+0000","last_became_active":"2024-09-19T04:46:23.512169+0000","last_became_peered":"2024-09-19T04:46:23.512169+0000","last_unstale":"2024-09-19T04:47:59.195030+0000","last_undegraded":"2024-09-19T04:47:59.195030+0000","last_fullsized":"2024-09-19T04:47:59.195030+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:17.475389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.179284+0000","last_change":"2024-09-19T04:46:36.814692+0000","last_active":"2024-09-19T04:47:59.179284+0000","last_peered":"2024-09-19T04:47:59.179284+0000","last_clean":"2024-09-19T04:47:59.179284+0000","last_became_active":"2024-09-19T04:46:36.814429+0000","last_became_peered":"2024-09-19T04:46:36.814429+0000","last_unstale":"2024-09-19T04:47:59.179284+0000","last_undegraded":"2024-09-19T04:47:59.179284+0000","last_fullsized":"2024-09-19T04:47:59.179284+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:10:42.391448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.185392+0000","last_change":"2024-09-19T04:46:23.519273+0000","last_active":"2024-09-19T04:47:59.185392+0000","last_peered":"2024-09-19T04:47:59.185392+0000","last_clean":"2024-09-19T04:47:59.185392+0000","last_became_active":"2024-09-19T04:46:23.519001+0000","last_became_peered":"2024-09-19T04:46:23.519001+0000","last_unstale":"2024-09-19T04:47:59.185392+0000","last_undegraded":"2024-09-19T04:47:59.185392+0000","last_fullsized":"2024-09-19T04:47:59.185392+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:15:30.949066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.184874+0000","last_change":"2024-09-19T04:46:23.520888+0000","last_active":"2024-09-19T04:47:59.184874+0000","last_peered":"2024-09-19T04:47:59.184874+0000","last_clean":"2024-09-19T04:47:59.184874+0000","last_became_active":"2024-09-19T04:46:23.519476+0000","last_became_peered":"2024-09-19T04:46:23.519476+0000","last_unstale":"2024-09-19T04:47:59.184874+0000","last_undegraded":"2024-09-19T04:47:59.184874+0000","last_fullsized":"2024-09-19T04:47:59.184874+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:56.459724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.200464+0000","last_change":"2024-09-19T04:46:23.512152+0000","last_active":"2024-09-19T04:47:59.200464+0000","last_peered":"2024-09-19T04:47:59.200464+0000","last_clean":"2024-09-19T04:47:59.200464+0000","last_became_active":"2024-09-19T04:46:23.511784+0000","last_became_peered":"2024-09-19T04:46:23.511784+0000","last_unstale":"2024-09-19T04:47:59.200464+0000","last_undegraded":"2024-09-19T04:47:59.200464+0000","last_fullsized":"2024-09-19T04:47:59.200464+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:01:23.406580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.201261+0000","last_change":"2024-09-19T04:46:23.522491+0000","last_active":"2024-09-19T04:47:59.201261+0000","last_peered":"2024-09-19T04:47:59.201261+0000","last_clean":"2024-09-19T04:47:59.201261+0000","last_became_active":"2024-09-19T04:46:23.522025+0000","last_became_peered":"2024-09-19T04:46:23.522025+0000","last_unstale":"2024-09-19T04:47:59.201261+0000","last_undegraded":"2024-09-19T04:47:59.201261+0000","last_fullsized":"2024-09-19T04:47:59.201261+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:33.063300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.193481+0000","last_change":"2024-09-19T04:46:23.510057+0000","last_active":"2024-09-19T04:47:59.193481+0000","last_peered":"2024-09-19T04:47:59.193481+0000","last_clean":"2024-09-19T04:47:59.193481+0000","last_became_active":"2024-09-19T04:46:23.509691+0000","last_became_peered":"2024-09-19T04:46:23.509691+0000","last_unstale":"2024-09-19T04:47:59.193481+0000","last_undegraded":"2024-09-19T04:47:59.193481+0000","last_fullsized":"2024-09-19T04:47:59.193481+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:12:16.579944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.181233+0000","last_change":"2024-09-19T04:46:23.516876+0000","last_active":"2024-09-19T04:47:59.181233+0000","last_peered":"2024-09-19T04:47:59.181233+0000","last_clean":"2024-09-19T04:47:59.181233+0000","last_became_active":"2024-09-19T04:46:23.516533+0000","last_became_peered":"2024-09-19T04:46:23.516533+0000","last_unstale":"2024-09-19T04:47:59.181233+0000","last_undegraded":"2024-09-19T04:47:59.181233+0000","last_fullsized":"2024-09-19T04:47:59.181233+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:44.868936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.185917+0000","last_change":"2024-09-19T04:46:23.517607+0000","last_active":"2024-09-19T04:47:59.185917+0000","last_peered":"2024-09-19T04:47:59.185917+0000","last_clean":"2024-09-19T04:47:59.185917+0000","last_became_active":"2024-09-19T04:46:23.517289+0000","last_became_peered":"2024-09-19T04:46:23.517289+0000","last_unstale":"2024-09-19T04:47:59.185917+0000","last_undegraded":"2024-09-19T04:47:59.185917+0000","last_fullsized":"2024-09-19T04:47:59.185917+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:08:22.882886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.185070+0000","last_change":"2024-09-19T04:46:23.507713+0000","last_active":"2024-09-19T04:47:59.185070+0000","last_peered":"2024-09-19T04:47:59.185070+0000","last_clean":"2024-09-19T04:47:59.185070+0000","last_became_active":"2024-09-19T04:46:23.507350+0000","last_became_peered":"2024-09-19T04:46:23.507350+0000","last_unstale":"2024-09-19T04:47:59.185070+0000","last_undegraded":"2024-09-19T04:47:59.185070+0000","last_fullsized":"2024-09-19T04:47:59.185070+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:07:27.119097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.167495+0000","last_change":"2024-09-19T04:46:21.495958+0000","last_active":"2024-09-19T04:47:59.167495+0000","last_peered":"2024-09-19T04:47:59.167495+0000","last_clean":"2024-09-19T04:47:59.167495+0000","last_became_active":"2024-09-19T04:46:21.495562+0000","last_became_peered":"2024-09-19T04:46:21.495562+0000","last_unstale":"2024-09-19T04:47:59.167495+0000","last_undegraded":"2024-09-19T04:47:59.167495+0000","last_fullsized":"2024-09-19T04:47:59.167495+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:19:02.935893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.189671+0000","last_change":"2024-09-19T04:46:23.524151+0000","last_active":"2024-09-19T04:47:59.189671+0000","last_peered":"2024-09-19T04:47:59.189671+0000","last_clean":"2024-09-19T04:47:59.189671+0000","last_became_active":"2024-09-19T04:46:23.523795+0000","last_became_peered":"2024-09-19T04:46:23.523795+0000","last_unstale":"2024-09-19T04:47:59.189671+0000","last_undegraded":"2024-09-19T04:47:59.189671+0000","last_fullsized":"2024-09-19T04:47:59.189671+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:27.234766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.147123+0000","last_change":"2024-09-19T04:46:21.485072+0000","last_active":"2024-09-19T04:47:59.147123+0000","last_peered":"2024-09-19T04:47:59.147123+0000","last_clean":"2024-09-19T04:47:59.147123+0000","last_became_active":"2024-09-19T04:46:21.482727+0000","last_became_peered":"2024-09-19T04:46:21.482727+0000","last_unstale":"2024-09-19T04:47:59.147123+0000","last_undegraded":"2024-09-19T04:47:59.147123+0000","last_fullsized":"2024-09-19T04:47:59.147123+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:23.231570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.145676+0000","last_change":"2024-09-19T04:46:21.488537+0000","last_active":"2024-09-19T04:47:59.145676+0000","last_peered":"2024-09-19T04:47:59.145676+0000","last_clean":"2024-09-19T04:47:59.145676+0000","last_became_active":"2024-09-19T04:46:21.488176+0000","last_became_peered":"2024-09-19T04:46:21.488176+0000","last_unstale":"2024-09-19T04:47:59.145676+0000","last_undegraded":"2024-09-19T04:47:59.145676+0000","last_fullsized":"2024-09-19T04:47:59.145676+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:14.355956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.198415+0000","last_change":"2024-09-19T04:46:23.518619+0000","last_active":"2024-09-19T04:47:59.198415+0000","last_peered":"2024-09-19T04:47:59.198415+0000","last_clean":"2024-09-19T04:47:59.198415+0000","last_became_active":"2024-09-19T04:46:23.518313+0000","last_became_peered":"2024-09-19T04:46:23.518313+0000","last_unstale":"2024-09-19T04:47:59.198415+0000","last_undegraded":"2024-09-19T04:47:59.198415+0000","last_fullsized":"2024-09-19T04:47:59.198415+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:08:25.958935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.162195+0000","last_change":"2024-09-19T04:46:21.493873+0000","last_active":"2024-09-19T04:47:59.162195+0000","last_peered":"2024-09-19T04:47:59.162195+0000","last_clean":"2024-09-19T04:47:59.162195+0000","last_became_active":"2024-09-19T04:46:21.493447+0000","last_became_peered":"2024-09-19T04:46:21.493447+0000","last_unstale":"2024-09-19T04:47:59.162195+0000","last_undegraded":"2024-09-19T04:47:59.162195+0000","last_fullsized":"2024-09-19T04:47:59.162195+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:29.504001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.188563+0000","last_change":"2024-09-19T04:46:23.508247+0000","last_active":"2024-09-19T04:47:59.188563+0000","last_peered":"2024-09-19T04:47:59.188563+0000","last_clean":"2024-09-19T04:47:59.188563+0000","last_became_active":"2024-09-19T04:46:23.507936+0000","last_became_peered":"2024-09-19T04:46:23.507936+0000","last_unstale":"2024-09-19T04:47:59.188563+0000","last_undegraded":"2024-09-19T04:47:59.188563+0000","last_fullsized":"2024-09-19T04:47:59.188563+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:25:09.864664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.147589+0000","last_change":"2024-09-19T04:46:21.487636+0000","last_active":"2024-09-19T04:47:59.147589+0000","last_peered":"2024-09-19T04:47:59.147589+0000","last_clean":"2024-09-19T04:47:59.147589+0000","last_became_active":"2024-09-19T04:46:21.487162+0000","last_became_peered":"2024-09-19T04:46:21.487162+0000","last_unstale":"2024-09-19T04:47:59.147589+0000","last_undegraded":"2024-09-19T04:47:59.147589+0000","last_fullsized":"2024-09-19T04:47:59.147589+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:03:04.833769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.191093+0000","last_change":"2024-09-19T04:46:23.515047+0000","last_active":"2024-09-19T04:47:59.191093+0000","last_peered":"2024-09-19T04:47:59.191093+0000","last_clean":"2024-09-19T04:47:59.191093+0000","last_became_active":"2024-09-19T04:46:23.514607+0000","last_became_peered":"2024-09-19T04:46:23.514607+0000","last_unstale":"2024-09-19T04:47:59.191093+0000","last_undegraded":"2024-09-19T04:47:59.191093+0000","last_fullsized":"2024-09-19T04:47:59.191093+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:05:03.076568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.161276+0000","last_change":"2024-09-19T04:46:21.493732+0000","last_active":"2024-09-19T04:47:59.161276+0000","last_peered":"2024-09-19T04:47:59.161276+0000","last_clean":"2024-09-19T04:47:59.161276+0000","last_became_active":"2024-09-19T04:46:21.493069+0000","last_became_peered":"2024-09-19T04:46:21.493069+0000","last_unstale":"2024-09-19T04:47:59.161276+0000","last_undegraded":"2024-09-19T04:47:59.161276+0000","last_fullsized":"2024-09-19T04:47:59.161276+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:17.709419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.202047+0000","last_change":"2024-09-19T04:46:23.516530+0000","last_active":"2024-09-19T04:47:59.202047+0000","last_peered":"2024-09-19T04:47:59.202047+0000","last_clean":"2024-09-19T04:47:59.202047+0000","last_became_active":"2024-09-19T04:46:23.515816+0000","last_became_peered":"2024-09-19T04:46:23.515816+0000","last_unstale":"2024-09-19T04:47:59.202047+0000","last_undegraded":"2024-09-19T04:47:59.202047+0000","last_fullsized":"2024-09-19T04:47:59.202047+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:56:19.162009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.170650+0000","last_change":"2024-09-19T04:46:21.573930+0000","last_active":"2024-09-19T04:47:59.170650+0000","last_peered":"2024-09-19T04:47:59.170650+0000","last_clean":"2024-09-19T04:47:59.170650+0000","last_became_active":"2024-09-19T04:46:21.573579+0000","last_became_peered":"2024-09-19T04:46:21.573579+0000","last_unstale":"2024-09-19T04:47:59.170650+0000","last_undegraded":"2024-09-19T04:47:59.170650+0000","last_fullsized":"2024-09-19T04:47:59.170650+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:29.472481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.177548+0000","last_change":"2024-09-19T04:46:23.520569+0000","last_active":"2024-09-19T04:47:59.177548+0000","last_peered":"2024-09-19T04:47:59.177548+0000","last_clean":"2024-09-19T04:47:59.177548+0000","last_became_active":"2024-09-19T04:46:23.519894+0000","last_became_peered":"2024-09-19T04:46:23.519894+0000","last_unstale":"2024-09-19T04:47:59.177548+0000","last_undegraded":"2024-09-19T04:47:59.177548+0000","last_fullsized":"2024-09-19T04:47:59.177548+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:20.823559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'31","reported_seq":242,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.673982+0000","last_change":"2024-09-19T04:46:21.491853+0000","last_active":"2024-09-19T04:47:59.673982+0000","last_peered":"2024-09-19T04:47:59.673982+0000","last_clean":"2024-09-19T04:47:59.673982+0000","last_became_active":"2024-09-19T04:46:21.491499+0000","last_became_peered":"2024-09-19T04:46:21.491499+0000","last_unstale":"2024-09-19T04:47:59.673982+0000","last_undegraded":"2024-09-19T04:47:59.673982+0000","last_fullsized":"2024-09-19T04:47:59.673982+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:15.372001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62729,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":187,"num_read_kb":154,"num_write":31,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.186710+0000","last_change":"2024-09-19T04:46:23.516781+0000","last_active":"2024-09-19T04:47:59.186710+0000","last_peered":"2024-09-19T04:47:59.186710+0000","last_clean":"2024-09-19T04:47:59.186710+0000","last_became_active":"2024-09-19T04:46:23.515928+0000","last_became_peered":"2024-09-19T04:46:23.515928+0000","last_unstale":"2024-09-19T04:47:59.186710+0000","last_undegraded":"2024-09-19T04:47:59.186710+0000","last_fullsized":"2024-09-19T04:47:59.186710+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:31.319072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'2","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.157318+0000","last_change":"2024-09-19T04:46:36.576395+0000","last_active":"2024-09-19T04:47:59.157318+0000","last_peered":"2024-09-19T04:47:59.157318+0000","last_clean":"2024-09-19T04:47:59.157318+0000","last_became_active":"2024-09-19T04:46:36.567213+0000","last_became_peered":"2024-09-19T04:46:36.567213+0000","last_unstale":"2024-09-19T04:47:59.157318+0000","last_undegraded":"2024-09-19T04:47:59.157318+0000","last_fullsized":"2024-09-19T04:47:59.157318+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:26.802224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.199243+0000","last_change":"2024-09-19T04:46:23.512736+0000","last_active":"2024-09-19T04:47:59.199243+0000","last_peered":"2024-09-19T04:47:59.199243+0000","last_clean":"2024-09-19T04:47:59.199243+0000","last_became_active":"2024-09-19T04:46:23.512399+0000","last_became_peered":"2024-09-19T04:46:23.512399+0000","last_unstale":"2024-09-19T04:47:59.199243+0000","last_undegraded":"2024-09-19T04:47:59.199243+0000","last_fullsized":"2024-09-19T04:47:59.199243+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:54:28.607512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.167311+0000","last_change":"2024-09-19T04:46:21.495421+0000","last_active":"2024-09-19T04:47:59.167311+0000","last_peered":"2024-09-19T04:47:59.167311+0000","last_clean":"2024-09-19T04:47:59.167311+0000","last_became_active":"2024-09-19T04:46:21.495004+0000","last_became_peered":"2024-09-19T04:46:21.495004+0000","last_unstale":"2024-09-19T04:47:59.167311+0000","last_undegraded":"2024-09-19T04:47:59.167311+0000","last_fullsized":"2024-09-19T04:47:59.167311+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:11.038118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"81'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.200971+0000","last_change":"2024-09-19T04:46:23.519462+0000","last_active":"2024-09-19T04:47:59.200971+0000","last_peered":"2024-09-19T04:47:59.200971+0000","last_clean":"2024-09-19T04:47:59.200971+0000","last_became_active":"2024-09-19T04:46:23.519121+0000","last_became_peered":"2024-09-19T04:46:23.519121+0000","last_unstale":"2024-09-19T04:47:59.200971+0000","last_undegraded":"2024-09-19T04:47:59.200971+0000","last_fullsized":"2024-09-19T04:47:59.200971+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:19.643433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.155240+0000","last_change":"2024-09-19T04:46:21.496243+0000","last_active":"2024-09-19T04:47:59.155240+0000","last_peered":"2024-09-19T04:47:59.155240+0000","last_clean":"2024-09-19T04:47:59.155240+0000","last_became_active":"2024-09-19T04:46:21.495821+0000","last_became_peered":"2024-09-19T04:46:21.495821+0000","last_unstale":"2024-09-19T04:47:59.155240+0000","last_undegraded":"2024-09-19T04:47:59.155240+0000","last_fullsized":"2024-09-19T04:47:59.155240+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:35:02.729538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"81'6","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.189779+0000","last_change":"2024-09-19T04:46:36.570404+0000","last_active":"2024-09-19T04:47:59.189779+0000","last_peered":"2024-09-19T04:47:59.189779+0000","last_clean":"2024-09-19T04:47:59.189779+0000","last_became_active":"2024-09-19T04:46:36.569898+0000","last_became_peered":"2024-09-19T04:46:36.569898+0000","last_unstale":"2024-09-19T04:47:59.189779+0000","last_undegraded":"2024-09-19T04:47:59.189779+0000","last_fullsized":"2024-09-19T04:47:59.189779+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:20:47.441702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'8","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.156443+0000","last_change":"2024-09-19T04:46:21.572642+0000","last_active":"2024-09-19T04:47:59.156443+0000","last_peered":"2024-09-19T04:47:59.156443+0000","last_clean":"2024-09-19T04:47:59.156443+0000","last_became_active":"2024-09-19T04:46:21.571823+0000","last_became_peered":"2024-09-19T04:46:21.571823+0000","last_unstale":"2024-09-19T04:47:59.156443+0000","last_undegraded":"2024-09-19T04:47:59.156443+0000","last_fullsized":"2024-09-19T04:47:59.156443+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:28.956744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.190799+0000","last_change":"2024-09-19T04:46:23.524169+0000","last_active":"2024-09-19T04:47:59.190799+0000","last_peered":"2024-09-19T04:47:59.190799+0000","last_clean":"2024-09-19T04:47:59.190799+0000","last_became_active":"2024-09-19T04:46:23.523869+0000","last_became_peered":"2024-09-19T04:46:23.523869+0000","last_unstale":"2024-09-19T04:47:59.190799+0000","last_undegraded":"2024-09-19T04:47:59.190799+0000","last_fullsized":"2024-09-19T04:47:59.190799+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:46.131143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'1","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.157561+0000","last_change":"2024-09-19T04:46:21.490154+0000","last_active":"2024-09-19T04:47:59.157561+0000","last_peered":"2024-09-19T04:47:59.157561+0000","last_clean":"2024-09-19T04:47:59.157561+0000","last_became_active":"2024-09-19T04:46:21.489820+0000","last_became_peered":"2024-09-19T04:46:21.489820+0000","last_unstale":"2024-09-19T04:47:59.157561+0000","last_undegraded":"2024-09-19T04:47:59.157561+0000","last_fullsized":"2024-09-19T04:47:59.157561+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:34:27.446664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.184035+0000","last_change":"2024-09-19T04:46:23.518712+0000","last_active":"2024-09-19T04:47:59.184035+0000","last_peered":"2024-09-19T04:47:59.184035+0000","last_clean":"2024-09-19T04:47:59.184035+0000","last_became_active":"2024-09-19T04:46:23.518408+0000","last_became_peered":"2024-09-19T04:46:23.518408+0000","last_unstale":"2024-09-19T04:47:59.184035+0000","last_undegraded":"2024-09-19T04:47:59.184035+0000","last_fullsized":"2024-09-19T04:47:59.184035+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:45:17.398334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.145916+0000","last_change":"2024-09-19T04:46:21.487789+0000","last_active":"2024-09-19T04:47:59.145916+0000","last_peered":"2024-09-19T04:47:59.145916+0000","last_clean":"2024-09-19T04:47:59.145916+0000","last_became_active":"2024-09-19T04:46:21.487411+0000","last_became_peered":"2024-09-19T04:46:21.487411+0000","last_unstale":"2024-09-19T04:47:59.145916+0000","last_undegraded":"2024-09-19T04:47:59.145916+0000","last_fullsized":"2024-09-19T04:47:59.145916+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:25.353345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.189636+0000","last_change":"2024-09-19T04:46:23.515432+0000","last_active":"2024-09-19T04:47:59.189636+0000","last_peered":"2024-09-19T04:47:59.189636+0000","last_clean":"2024-09-19T04:47:59.189636+0000","last_became_active":"2024-09-19T04:46:23.515071+0000","last_became_peered":"2024-09-19T04:46:23.515071+0000","last_unstale":"2024-09-19T04:47:59.189636+0000","last_undegraded":"2024-09-19T04:47:59.189636+0000","last_fullsized":"2024-09-19T04:47:59.189636+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:56:04.743652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'39","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.370929+0000","last_change":"2024-09-19T04:46:21.487856+0000","last_active":"2024-09-19T04:47:59.370929+0000","last_peered":"2024-09-19T04:47:59.370929+0000","last_clean":"2024-09-19T04:47:59.370929+0000","last_became_active":"2024-09-19T04:46:21.487342+0000","last_became_peered":"2024-09-19T04:46:21.487342+0000","last_unstale":"2024-09-19T04:47:59.370929+0000","last_undegraded":"2024-09-19T04:47:59.370929+0000","last_fullsized":"2024-09-19T04:47:59.370929+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:29.275296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.190880+0000","last_change":"2024-09-19T04:46:23.517250+0000","last_active":"2024-09-19T04:47:59.190880+0000","last_peered":"2024-09-19T04:47:59.190880+0000","last_clean":"2024-09-19T04:47:59.190880+0000","last_became_active":"2024-09-19T04:46:23.516895+0000","last_became_peered":"2024-09-19T04:46:23.516895+0000","last_unstale":"2024-09-19T04:47:59.190880+0000","last_undegraded":"2024-09-19T04:47:59.190880+0000","last_fullsized":"2024-09-19T04:47:59.190880+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:51.982348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.147446+0000","last_change":"2024-09-19T04:46:21.572452+0000","last_active":"2024-09-19T04:47:59.147446+0000","last_peered":"2024-09-19T04:47:59.147446+0000","last_clean":"2024-09-19T04:47:59.147446+0000","last_became_active":"2024-09-19T04:46:21.572026+0000","last_became_peered":"2024-09-19T04:46:21.572026+0000","last_unstale":"2024-09-19T04:47:59.147446+0000","last_undegraded":"2024-09-19T04:47:59.147446+0000","last_fullsized":"2024-09-19T04:47:59.147446+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:07.859604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.192079+0000","last_change":"2024-09-19T04:46:23.523549+0000","last_active":"2024-09-19T04:47:59.192079+0000","last_peered":"2024-09-19T04:47:59.192079+0000","last_clean":"2024-09-19T04:47:59.192079+0000","last_became_active":"2024-09-19T04:46:23.522581+0000","last_became_peered":"2024-09-19T04:46:23.522581+0000","last_unstale":"2024-09-19T04:47:59.192079+0000","last_undegraded":"2024-09-19T04:47:59.192079+0000","last_fullsized":"2024-09-19T04:47:59.192079+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:51:33.504024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":343,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.159617+0000","last_change":"2024-09-19T04:45:12.271676+0000","last_active":"2024-09-19T04:47:59.159617+0000","last_peered":"2024-09-19T04:47:59.159617+0000","last_clean":"2024-09-19T04:47:59.159617+0000","last_became_active":"2024-09-19T04:45:12.271093+0000","last_became_peered":"2024-09-19T04:45:12.271093+0000","last_unstale":"2024-09-19T04:47:59.159617+0000","last_undegraded":"2024-09-19T04:47:59.159617+0000","last_fullsized":"2024-09-19T04:47:59.159617+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:41:52.010883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:41:52.010883+0000","last_clean_scrub_stamp":"2024-09-19T04:41:52.010883+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:48.499621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.155221+0000","last_change":"2024-09-19T04:46:21.493847+0000","last_active":"2024-09-19T04:47:59.155221+0000","last_peered":"2024-09-19T04:47:59.155221+0000","last_clean":"2024-09-19T04:47:59.155221+0000","last_became_active":"2024-09-19T04:46:21.493432+0000","last_became_peered":"2024-09-19T04:46:21.493432+0000","last_unstale":"2024-09-19T04:47:59.155221+0000","last_undegraded":"2024-09-19T04:47:59.155221+0000","last_fullsized":"2024-09-19T04:47:59.155221+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:10:21.398602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.196941+0000","last_change":"2024-09-19T04:46:23.517517+0000","last_active":"2024-09-19T04:47:59.196941+0000","last_peered":"2024-09-19T04:47:59.196941+0000","last_clean":"2024-09-19T04:47:59.196941+0000","last_became_active":"2024-09-19T04:46:23.517191+0000","last_became_peered":"2024-09-19T04:46:23.517191+0000","last_unstale":"2024-09-19T04:47:59.196941+0000","last_undegraded":"2024-09-19T04:47:59.196941+0000","last_fullsized":"2024-09-19T04:47:59.196941+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:17.896149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.158899+0000","last_change":"2024-09-19T04:46:36.794380+0000","last_active":"2024-09-19T04:47:59.158899+0000","last_peered":"2024-09-19T04:47:59.158899+0000","last_clean":"2024-09-19T04:47:59.158899+0000","last_became_active":"2024-09-19T04:46:36.793911+0000","last_became_peered":"2024-09-19T04:46:36.793911+0000","last_unstale":"2024-09-19T04:47:59.158899+0000","last_undegraded":"2024-09-19T04:47:59.158899+0000","last_fullsized":"2024-09-19T04:47:59.158899+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:01:37.733641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1],"acting":[7,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.192866+0000","last_change":"2024-09-19T04:46:23.514102+0000","last_active":"2024-09-19T04:47:59.192866+0000","last_peered":"2024-09-19T04:47:59.192866+0000","last_clean":"2024-09-19T04:47:59.192866+0000","last_became_active":"2024-09-19T04:46:23.513732+0000","last_became_peered":"2024-09-19T04:46:23.513732+0000","last_unstale":"2024-09-19T04:47:59.192866+0000","last_undegraded":"2024-09-19T04:47:59.192866+0000","last_fullsized":"2024-09-19T04:47:59.192866+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:13.533065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.145786+0000","last_change":"2024-09-19T04:46:21.572628+0000","last_active":"2024-09-19T04:47:59.145786+0000","last_peered":"2024-09-19T04:47:59.145786+0000","last_clean":"2024-09-19T04:47:59.145786+0000","last_became_active":"2024-09-19T04:46:21.571736+0000","last_became_peered":"2024-09-19T04:46:21.571736+0000","last_unstale":"2024-09-19T04:47:59.145786+0000","last_undegraded":"2024-09-19T04:47:59.145786+0000","last_fullsized":"2024-09-19T04:47:59.145786+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:10:50.204481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.185982+0000","last_change":"2024-09-19T04:46:36.991388+0000","last_active":"2024-09-19T04:47:59.185982+0000","last_peered":"2024-09-19T04:47:59.185982+0000","last_clean":"2024-09-19T04:47:59.185982+0000","last_became_active":"2024-09-19T04:46:36.990923+0000","last_became_peered":"2024-09-19T04:46:36.990923+0000","last_unstale":"2024-09-19T04:47:59.185982+0000","last_undegraded":"2024-09-19T04:47:59.185982+0000","last_fullsized":"2024-09-19T04:47:59.185982+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:31.148732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.160790+0000","last_change":"2024-09-19T04:46:21.492696+0000","last_active":"2024-09-19T04:47:59.160790+0000","last_peered":"2024-09-19T04:47:59.160790+0000","last_clean":"2024-09-19T04:47:59.160790+0000","last_became_active":"2024-09-19T04:46:21.492306+0000","last_became_peered":"2024-09-19T04:46:21.492306+0000","last_unstale":"2024-09-19T04:47:59.160790+0000","last_undegraded":"2024-09-19T04:47:59.160790+0000","last_fullsized":"2024-09-19T04:47:59.160790+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:51:56.975170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.186820+0000","last_change":"2024-09-19T04:46:36.989535+0000","last_active":"2024-09-19T04:47:59.186820+0000","last_peered":"2024-09-19T04:47:59.186820+0000","last_clean":"2024-09-19T04:47:59.186820+0000","last_became_active":"2024-09-19T04:46:36.989252+0000","last_became_peered":"2024-09-19T04:46:36.989252+0000","last_unstale":"2024-09-19T04:47:59.186820+0000","last_undegraded":"2024-09-19T04:47:59.186820+0000","last_fullsized":"2024-09-19T04:47:59.186820+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:49:45.767547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.159452+0000","last_change":"2024-09-19T04:46:21.572275+0000","last_active":"2024-09-19T04:47:59.159452+0000","last_peered":"2024-09-19T04:47:59.159452+0000","last_clean":"2024-09-19T04:47:59.159452+0000","last_became_active":"2024-09-19T04:46:21.571940+0000","last_became_peered":"2024-09-19T04:46:21.571940+0000","last_unstale":"2024-09-19T04:47:59.159452+0000","last_undegraded":"2024-09-19T04:47:59.159452+0000","last_fullsized":"2024-09-19T04:47:59.159452+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:13.399887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.200078+0000","last_change":"2024-09-19T04:46:23.514355+0000","last_active":"2024-09-19T04:47:59.200078+0000","last_peered":"2024-09-19T04:47:59.200078+0000","last_clean":"2024-09-19T04:47:59.200078+0000","last_became_active":"2024-09-19T04:46:23.513963+0000","last_became_peered":"2024-09-19T04:46:23.513963+0000","last_unstale":"2024-09-19T04:47:59.200078+0000","last_undegraded":"2024-09-19T04:47:59.200078+0000","last_fullsized":"2024-09-19T04:47:59.200078+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:06.742732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.158181+0000","last_change":"2024-09-19T04:46:21.572466+0000","last_active":"2024-09-19T04:47:59.158181+0000","last_peered":"2024-09-19T04:47:59.158181+0000","last_clean":"2024-09-19T04:47:59.158181+0000","last_became_active":"2024-09-19T04:46:21.571868+0000","last_became_peered":"2024-09-19T04:46:21.571868+0000","last_unstale":"2024-09-19T04:47:59.158181+0000","last_undegraded":"2024-09-19T04:47:59.158181+0000","last_fullsized":"2024-09-19T04:47:59.158181+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:01.132858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.193312+0000","last_change":"2024-09-19T04:46:23.509517+0000","last_active":"2024-09-19T04:47:59.193312+0000","last_peered":"2024-09-19T04:47:59.193312+0000","last_clean":"2024-09-19T04:47:59.193312+0000","last_became_active":"2024-09-19T04:46:23.509216+0000","last_became_peered":"2024-09-19T04:46:23.509216+0000","last_unstale":"2024-09-19T04:47:59.193312+0000","last_undegraded":"2024-09-19T04:47:59.193312+0000","last_fullsized":"2024-09-19T04:47:59.193312+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:29:52.747643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'43","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.377679+0000","last_change":"2024-09-19T04:46:21.484462+0000","last_active":"2024-09-19T04:47:59.377679+0000","last_peered":"2024-09-19T04:47:59.377679+0000","last_clean":"2024-09-19T04:47:59.377679+0000","last_became_active":"2024-09-19T04:46:21.484148+0000","last_became_peered":"2024-09-19T04:46:21.484148+0000","last_unstale":"2024-09-19T04:47:59.377679+0000","last_undegraded":"2024-09-19T04:47:59.377679+0000","last_fullsized":"2024-09-19T04:47:59.377679+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:17:18.742857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":78,"num_write_kb":836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.191385+0000","last_change":"2024-09-19T04:46:23.512768+0000","last_active":"2024-09-19T04:47:59.191385+0000","last_peered":"2024-09-19T04:47:59.191385+0000","last_clean":"2024-09-19T04:47:59.191385+0000","last_became_active":"2024-09-19T04:46:23.512416+0000","last_became_peered":"2024-09-19T04:46:23.512416+0000","last_unstale":"2024-09-19T04:47:59.191385+0000","last_undegraded":"2024-09-19T04:47:59.191385+0000","last_fullsized":"2024-09-19T04:47:59.191385+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:03:48.340126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.155622+0000","last_change":"2024-09-19T04:46:21.488634+0000","last_active":"2024-09-19T04:47:59.155622+0000","last_peered":"2024-09-19T04:47:59.155622+0000","last_clean":"2024-09-19T04:47:59.155622+0000","last_became_active":"2024-09-19T04:46:21.488078+0000","last_became_peered":"2024-09-19T04:46:21.488078+0000","last_unstale":"2024-09-19T04:47:59.155622+0000","last_undegraded":"2024-09-19T04:47:59.155622+0000","last_fullsized":"2024-09-19T04:47:59.155622+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:31:47.946873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.200463+0000","last_change":"2024-09-19T04:46:23.522419+0000","last_active":"2024-09-19T04:47:59.200463+0000","last_peered":"2024-09-19T04:47:59.200463+0000","last_clean":"2024-09-19T04:47:59.200463+0000","last_became_active":"2024-09-19T04:46:23.522054+0000","last_became_peered":"2024-09-19T04:46:23.522054+0000","last_unstale":"2024-09-19T04:47:59.200463+0000","last_undegraded":"2024-09-19T04:47:59.200463+0000","last_fullsized":"2024-09-19T04:47:59.200463+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:43.720439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.151788+0000","last_change":"2024-09-19T04:46:21.572283+0000","last_active":"2024-09-19T04:47:59.151788+0000","last_peered":"2024-09-19T04:47:59.151788+0000","last_clean":"2024-09-19T04:47:59.151788+0000","last_became_active":"2024-09-19T04:46:21.572023+0000","last_became_peered":"2024-09-19T04:46:21.572023+0000","last_unstale":"2024-09-19T04:47:59.151788+0000","last_undegraded":"2024-09-19T04:47:59.151788+0000","last_fullsized":"2024-09-19T04:47:59.151788+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:37:26.293900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.178263+0000","last_change":"2024-09-19T04:46:23.516278+0000","last_active":"2024-09-19T04:47:59.178263+0000","last_peered":"2024-09-19T04:47:59.178263+0000","last_clean":"2024-09-19T04:47:59.178263+0000","last_became_active":"2024-09-19T04:46:23.515922+0000","last_became_peered":"2024-09-19T04:46:23.515922+0000","last_unstale":"2024-09-19T04:47:59.178263+0000","last_undegraded":"2024-09-19T04:47:59.178263+0000","last_fullsized":"2024-09-19T04:47:59.178263+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:26:11.038230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.156384+0000","last_change":"2024-09-19T04:46:21.489250+0000","last_active":"2024-09-19T04:47:59.156384+0000","last_peered":"2024-09-19T04:47:59.156384+0000","last_clean":"2024-09-19T04:47:59.156384+0000","last_became_active":"2024-09-19T04:46:21.488910+0000","last_became_peered":"2024-09-19T04:46:21.488910+0000","last_unstale":"2024-09-19T04:47:59.156384+0000","last_undegraded":"2024-09-19T04:47:59.156384+0000","last_fullsized":"2024-09-19T04:47:59.156384+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:04:03.650494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.191047+0000","last_change":"2024-09-19T04:46:23.512663+0000","last_active":"2024-09-19T04:47:59.191047+0000","last_peered":"2024-09-19T04:47:59.191047+0000","last_clean":"2024-09-19T04:47:59.191047+0000","last_became_active":"2024-09-19T04:46:23.512265+0000","last_became_peered":"2024-09-19T04:46:23.512265+0000","last_unstale":"2024-09-19T04:47:59.191047+0000","last_undegraded":"2024-09-19T04:47:59.191047+0000","last_fullsized":"2024-09-19T04:47:59.191047+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:52.903900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.156847+0000","last_change":"2024-09-19T04:46:36.990653+0000","last_active":"2024-09-19T04:47:59.156847+0000","last_peered":"2024-09-19T04:47:59.156847+0000","last_clean":"2024-09-19T04:47:59.156847+0000","last_became_active":"2024-09-19T04:46:36.990202+0000","last_became_peered":"2024-09-19T04:46:36.990202+0000","last_unstale":"2024-09-19T04:47:59.156847+0000","last_undegraded":"2024-09-19T04:47:59.156847+0000","last_fullsized":"2024-09-19T04:47:59.156847+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:25:53.780614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.198485+0000","last_change":"2024-09-19T04:46:23.510196+0000","last_active":"2024-09-19T04:47:59.198485+0000","last_peered":"2024-09-19T04:47:59.198485+0000","last_clean":"2024-09-19T04:47:59.198485+0000","last_became_active":"2024-09-19T04:46:23.509871+0000","last_became_peered":"2024-09-19T04:46:23.509871+0000","last_unstale":"2024-09-19T04:47:59.198485+0000","last_undegraded":"2024-09-19T04:47:59.198485+0000","last_fullsized":"2024-09-19T04:47:59.198485+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:42:01.825770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'2","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.157561+0000","last_change":"2024-09-19T04:46:21.492279+0000","last_active":"2024-09-19T04:47:59.157561+0000","last_peered":"2024-09-19T04:47:59.157561+0000","last_clean":"2024-09-19T04:47:59.157561+0000","last_became_active":"2024-09-19T04:46:21.491669+0000","last_became_peered":"2024-09-19T04:46:21.491669+0000","last_unstale":"2024-09-19T04:47:59.157561+0000","last_undegraded":"2024-09-19T04:47:59.157561+0000","last_fullsized":"2024-09-19T04:47:59.157561+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:23:15.822887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.200076+0000","last_change":"2024-09-19T04:46:23.518114+0000","last_active":"2024-09-19T04:47:59.200076+0000","last_peered":"2024-09-19T04:47:59.200076+0000","last_clean":"2024-09-19T04:47:59.200076+0000","last_became_active":"2024-09-19T04:46:23.517707+0000","last_became_peered":"2024-09-19T04:46:23.517707+0000","last_unstale":"2024-09-19T04:47:59.200076+0000","last_undegraded":"2024-09-19T04:47:59.200076+0000","last_fullsized":"2024-09-19T04:47:59.200076+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:52.438748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.191968+0000","last_change":"2024-09-19T04:46:23.525164+0000","last_active":"2024-09-19T04:47:59.191968+0000","last_peered":"2024-09-19T04:47:59.191968+0000","last_clean":"2024-09-19T04:47:59.191968+0000","last_became_active":"2024-09-19T04:46:23.524735+0000","last_became_peered":"2024-09-19T04:46:23.524735+0000","last_unstale":"2024-09-19T04:47:59.191968+0000","last_undegraded":"2024-09-19T04:47:59.191968+0000","last_fullsized":"2024-09-19T04:47:59.191968+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:53.590834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.157901+0000","last_change":"2024-09-19T04:46:21.492940+0000","last_active":"2024-09-19T04:47:59.157901+0000","last_peered":"2024-09-19T04:47:59.157901+0000","last_clean":"2024-09-19T04:47:59.157901+0000","last_became_active":"2024-09-19T04:46:21.492602+0000","last_became_peered":"2024-09-19T04:46:21.492602+0000","last_unstale":"2024-09-19T04:47:59.157901+0000","last_undegraded":"2024-09-19T04:47:59.157901+0000","last_fullsized":"2024-09-19T04:47:59.157901+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:20.554832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.190998+0000","last_change":"2024-09-19T04:46:23.513432+0000","last_active":"2024-09-19T04:47:59.190998+0000","last_peered":"2024-09-19T04:47:59.190998+0000","last_clean":"2024-09-19T04:47:59.190998+0000","last_became_active":"2024-09-19T04:46:23.513084+0000","last_became_peered":"2024-09-19T04:46:23.513084+0000","last_unstale":"2024-09-19T04:47:59.190998+0000","last_undegraded":"2024-09-19T04:47:59.190998+0000","last_fullsized":"2024-09-19T04:47:59.190998+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:03:16.732545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.158117+0000","last_change":"2024-09-19T04:46:21.491823+0000","last_active":"2024-09-19T04:47:59.158117+0000","last_peered":"2024-09-19T04:47:59.158117+0000","last_clean":"2024-09-19T04:47:59.158117+0000","last_became_active":"2024-09-19T04:46:21.491401+0000","last_became_peered":"2024-09-19T04:46:21.491401+0000","last_unstale":"2024-09-19T04:47:59.158117+0000","last_undegraded":"2024-09-19T04:47:59.158117+0000","last_fullsized":"2024-09-19T04:47:59.158117+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:55.955868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.198560+0000","last_change":"2024-09-19T04:46:23.515884+0000","last_active":"2024-09-19T04:47:59.198560+0000","last_peered":"2024-09-19T04:47:59.198560+0000","last_clean":"2024-09-19T04:47:59.198560+0000","last_became_active":"2024-09-19T04:46:23.515243+0000","last_became_peered":"2024-09-19T04:46:23.515243+0000","last_unstale":"2024-09-19T04:47:59.198560+0000","last_undegraded":"2024-09-19T04:47:59.198560+0000","last_fullsized":"2024-09-19T04:47:59.198560+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:07:33.716942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.157750+0000","last_change":"2024-09-19T04:46:21.572122+0000","last_active":"2024-09-19T04:47:59.157750+0000","last_peered":"2024-09-19T04:47:59.157750+0000","last_clean":"2024-09-19T04:47:59.157750+0000","last_became_active":"2024-09-19T04:46:21.571747+0000","last_became_peered":"2024-09-19T04:46:21.571747+0000","last_unstale":"2024-09-19T04:47:59.157750+0000","last_undegraded":"2024-09-19T04:47:59.157750+0000","last_fullsized":"2024-09-19T04:47:59.157750+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:06:43.411409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.197280+0000","last_change":"2024-09-19T04:46:23.513876+0000","last_active":"2024-09-19T04:47:59.197280+0000","last_peered":"2024-09-19T04:47:59.197280+0000","last_clean":"2024-09-19T04:47:59.197280+0000","last_became_active":"2024-09-19T04:46:23.513562+0000","last_became_peered":"2024-09-19T04:46:23.513562+0000","last_unstale":"2024-09-19T04:47:59.197280+0000","last_undegraded":"2024-09-19T04:47:59.197280+0000","last_fullsized":"2024-09-19T04:47:59.197280+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:21.982001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'4","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.161181+0000","last_change":"2024-09-19T04:46:21.491550+0000","last_active":"2024-09-19T04:47:59.161181+0000","last_peered":"2024-09-19T04:47:59.161181+0000","last_clean":"2024-09-19T04:47:59.161181+0000","last_became_active":"2024-09-19T04:46:21.491259+0000","last_became_peered":"2024-09-19T04:46:21.491259+0000","last_unstale":"2024-09-19T04:47:59.161181+0000","last_undegraded":"2024-09-19T04:47:59.161181+0000","last_fullsized":"2024-09-19T04:47:59.161181+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:38.671211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":588343,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":284,"num_read_kb":238,"num_write":195,"num_write_kb":1396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1867776,"data_stored":1765029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645344,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":888832,"data_stored":435145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874277,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37068,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708084,"statfs":{"total":95995035648,"available":95957078016,"internally_reserved":0,"allocated":1703936,"data_stored":1220119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":36174273},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005098,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40760,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704392,"statfs":{"total":95995035648,"available":95953297408,"internally_reserved":0,"allocated":1282048,"data_stored":828909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234032,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":892928,"data_stored":435715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462964,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28480,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716672,"statfs":{"total":95995035648,"available":95965872128,"internally_reserved":0,"allocated":1486848,"data_stored":1026178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626489,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36216,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708936,"statfs":{"total":95995035648,"available":95957950464,"internally_reserved":0,"allocated":888832,"data_stored":435228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855421,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28556,"kb_used_data":1528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716596,"statfs":{"total":95995035648,"available":95965794304,"internally_reserved":0,"allocated":1564672,"data_stored":1091834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018947,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36216,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708936,"statfs":{"total":95995035648,"available":95957950464,"internally_reserved":0,"allocated":888832,"data_stored":435133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247880,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":901120,"data_stored":435449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476813,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":958464,"data_stored":497840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607634,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40444,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704708,"statfs":{"total":95995035648,"available":95953620992,"internally_reserved":0,"allocated":958464,"data_stored":497840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738454,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40376,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704776,"statfs":{"total":95995035648,"available":95953690624,"internally_reserved":0,"allocated":888832,"data_stored":435201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":536576,"data_stored":524920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":131782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":393820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":393798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":194523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T04:48:03.951 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T04:48:04.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.086+0000 7fb2e6235640 1 -- 172.21.15.2:0/2591998426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2e0102d00 msgr2=0x7fb2e01030e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:04.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.086+0000 7fb2e6235640 1 --2- 172.21.15.2:0/2591998426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2e0102d00 0x7fb2e01030e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8009900 tx=0x7fb2c802a480 comp rx=0 tx=0).stop 2024-09-19T04:48:04.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.086+0000 7fb2e6235640 1 -- 172.21.15.2:0/2591998426 shutdown_connections 2024-09-19T04:48:04.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.086+0000 7fb2e6235640 1 --2- 172.21.15.2:0/2591998426 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2e010c0d0 0x7fb2e010e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:04.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.086+0000 7fb2e6235640 1 --2- 172.21.15.2:0/2591998426 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2e0103620 0x7fb2e010bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:04.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.086+0000 7fb2e6235640 1 --2- 172.21.15.2:0/2591998426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2e0102d00 0x7fb2e01030e0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:04.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.086+0000 7fb2e6235640 1 -- 172.21.15.2:0/2591998426 >> 172.21.15.2:0/2591998426 conn(0x7fb2e00fc6b0 msgr2=0x7fb2e00fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:04.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.086+0000 7fb2e6235640 1 -- 172.21.15.2:0/2591998426 shutdown_connections 2024-09-19T04:48:04.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.086+0000 7fb2e6235640 1 -- 172.21.15.2:0/2591998426 wait complete. 2024-09-19T04:48:04.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.087+0000 7fb2e6235640 1 Processor -- start 2024-09-19T04:48:04.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.087+0000 7fb2e6235640 1 -- start start 2024-09-19T04:48:04.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.087+0000 7fb2e6235640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2e0102d00 0x7fb2e0198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:04.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.087+0000 7fb2e6235640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2e0103620 0x7fb2e0198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:04.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.087+0000 7fb2e6235640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2e010c0d0 0x7fb2e019cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:04.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.087+0000 7fb2e6235640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e0111d80 con 0x7fb2e010c0d0 2024-09-19T04:48:04.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.087+0000 7fb2e6235640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e0111c00 con 0x7fb2e0102d00 2024-09-19T04:48:04.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.087+0000 7fb2e6235640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e0111f00 con 0x7fb2e0103620 2024-09-19T04:48:04.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.088+0000 7fb2dffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2e010c0d0 0x7fb2e019cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:04.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.088+0000 7fb2dffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2e010c0d0 0x7fb2e019cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45420/0 (socket says 172.21.15.2:45420) 2024-09-19T04:48:04.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.088+0000 7fb2dffff640 1 -- 172.21.15.2:0/2637699373 learned_addr learned my addr 172.21.15.2:0/2637699373 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:48:04.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.088+0000 7fb2df7fe640 1 --2- 172.21.15.2:0/2637699373 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2e0102d00 0x7fb2e0198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:04.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.088+0000 7fb2deffd640 1 --2- 172.21.15.2:0/2637699373 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2e0103620 0x7fb2e0198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:04.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.088+0000 7fb2dffff640 1 -- 172.21.15.2:0/2637699373 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2e0103620 msgr2=0x7fb2e0198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:04.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.088+0000 7fb2dffff640 1 --2- 172.21.15.2:0/2637699373 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2e0103620 0x7fb2e0198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:04.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.088+0000 7fb2dffff640 1 -- 172.21.15.2:0/2637699373 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2e0102d00 msgr2=0x7fb2e0198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:04.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.088+0000 7fb2dffff640 1 --2- 172.21.15.2:0/2637699373 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2e0102d00 0x7fb2e0198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:04.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.088+0000 7fb2dffff640 1 -- 172.21.15.2:0/2637699373 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2e019d320 con 0x7fb2e010c0d0 2024-09-19T04:48:04.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.088+0000 7fb2dffff640 1 --2- 172.21.15.2:0/2637699373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2e010c0d0 0x7fb2e019cbf0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb2d800eaa0 tx=0x7fb2d800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:04.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.088+0000 7fb2dcff9640 1 -- 172.21.15.2:0/2637699373 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d800cdb0 con 0x7fb2e010c0d0 2024-09-19T04:48:04.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.088+0000 7fb2dcff9640 1 -- 172.21.15.2:0/2637699373 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb2d8005020 con 0x7fb2e010c0d0 2024-09-19T04:48:04.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.088+0000 7fb2e6235640 1 -- 172.21.15.2:0/2637699373 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2e019d610 con 0x7fb2e010c0d0 2024-09-19T04:48:04.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.088+0000 7fb2dcff9640 1 -- 172.21.15.2:0/2637699373 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d80116d0 con 0x7fb2e010c0d0 2024-09-19T04:48:04.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.088+0000 7fb2e6235640 1 -- 172.21.15.2:0/2637699373 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2e01a4ea0 con 0x7fb2e010c0d0 2024-09-19T04:48:04.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.089+0000 7fb2e6235640 1 -- 172.21.15.2:0/2637699373 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2e01030e0 con 0x7fb2e010c0d0 2024-09-19T04:48:04.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.090+0000 7fb2dcff9640 1 -- 172.21.15.2:0/2637699373 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138530+0+0 (secure 0 0 0) 0x7fb2d80051d0 con 0x7fb2e010c0d0 2024-09-19T04:48:04.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.091+0000 7fb2dcff9640 1 --2- 172.21.15.2:0/2637699373 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fb2cc0a34d0 0x7fb2cc0a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:04.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.091+0000 7fb2df7fe640 1 --2- 172.21.15.2:0/2637699373 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fb2cc0a34d0 0x7fb2cc0a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:04.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.091+0000 7fb2dcff9640 1 -- 172.21.15.2:0/2637699373 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7fb2d80cff60 con 0x7fb2e010c0d0 2024-09-19T04:48:04.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.092+0000 7fb2df7fe640 1 --2- 172.21.15.2:0/2637699373 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fb2cc0a34d0 0x7fb2cc0a5990 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8031440 tx=0x7fb2c8005b50 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:04.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.095+0000 7fb2dcff9640 1 -- 172.21.15.2:0/2637699373 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb2d8016030 con 0x7fb2e010c0d0 2024-09-19T04:48:04.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.270+0000 7fb2e6235640 1 -- 172.21.15.2:0/2637699373 --> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb2e0062630 con 0x7fb2cc0a34d0 2024-09-19T04:48:04.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.276+0000 7fb2dcff9640 1 -- 172.21.15.2:0/2637699373 <== mgr.15096 v2:172.21.15.2:6800/852329670 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257781 (secure 0 0 0) 0x7fb2e0062630 con 0x7fb2cc0a34d0 2024-09-19T04:48:04.282 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:48:04.283 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-19T04:48:04.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.280+0000 7fb2e6235640 1 -- 172.21.15.2:0/2637699373 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fb2cc0a34d0 msgr2=0x7fb2cc0a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:04.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.280+0000 7fb2e6235640 1 --2- 172.21.15.2:0/2637699373 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fb2cc0a34d0 0x7fb2cc0a5990 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8031440 tx=0x7fb2c8005b50 comp rx=0 tx=0).stop 2024-09-19T04:48:04.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.280+0000 7fb2e6235640 1 -- 172.21.15.2:0/2637699373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2e010c0d0 msgr2=0x7fb2e019cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:04.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.280+0000 7fb2e6235640 1 --2- 172.21.15.2:0/2637699373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2e010c0d0 0x7fb2e019cbf0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb2d800eaa0 tx=0x7fb2d800ef60 comp rx=0 tx=0).stop 2024-09-19T04:48:04.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.280+0000 7fb2e6235640 1 -- 172.21.15.2:0/2637699373 shutdown_connections 2024-09-19T04:48:04.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.280+0000 7fb2e6235640 1 --2- 172.21.15.2:0/2637699373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2e010c0d0 0x7fb2e019cbf0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:04.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.280+0000 7fb2e6235640 1 --2- 172.21.15.2:0/2637699373 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fb2cc0a34d0 0x7fb2cc0a5990 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:04.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.280+0000 7fb2e6235640 1 --2- 172.21.15.2:0/2637699373 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2e0103620 0x7fb2e0198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:04.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.280+0000 7fb2e6235640 1 --2- 172.21.15.2:0/2637699373 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2e0102d00 0x7fb2e0198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:04.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.280+0000 7fb2e6235640 1 -- 172.21.15.2:0/2637699373 >> 172.21.15.2:0/2637699373 conn(0x7fb2e00fc6b0 msgr2=0x7fb2e00fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:04.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.280+0000 7fb2e6235640 1 -- 172.21.15.2:0/2637699373 shutdown_connections 2024-09-19T04:48:04.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.280+0000 7fb2e6235640 1 -- 172.21.15.2:0/2637699373 wait complete. 2024-09-19T04:48:04.293 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-09-19T04:48:03.165032+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1178945,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":420,"num_read_kb":357,"num_write":378,"num_write_kb":4336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1180770,"num_keys_recovered":10,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":783,"ondisk_log_size":783,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":408100,"kb_used_data":12992,"kb_used_omap":18,"kb_used_meta":394797,"kb_avail":1124533724,"statfs":{"total":1151940427776,"available":1151522533376,"internally_reserved":0,"allocated":13303808,"data_stored":7774591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":404272442},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.995966"},"pg_stats":[{"pgid":"3.3f","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.192783+0000","last_change":"2024-09-19T04:46:23.520907+0000","last_active":"2024-09-19T04:47:59.192783+0000","last_peered":"2024-09-19T04:47:59.192783+0000","last_clean":"2024-09-19T04:47:59.192783+0000","last_became_active":"2024-09-19T04:46:23.519321+0000","last_became_peered":"2024-09-19T04:46:23.519321+0000","last_unstale":"2024-09-19T04:47:59.192783+0000","last_undegraded":"2024-09-19T04:47:59.192783+0000","last_fullsized":"2024-09-19T04:47:59.192783+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:31.529472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.200073+0000","last_change":"2024-09-19T04:46:23.515272+0000","last_active":"2024-09-19T04:47:59.200073+0000","last_peered":"2024-09-19T04:47:59.200073+0000","last_clean":"2024-09-19T04:47:59.200073+0000","last_became_active":"2024-09-19T04:46:23.514760+0000","last_became_peered":"2024-09-19T04:46:23.514760+0000","last_unstale":"2024-09-19T04:47:59.200073+0000","last_undegraded":"2024-09-19T04:47:59.200073+0000","last_fullsized":"2024-09-19T04:47:59.200073+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:32.215940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.195688+0000","last_change":"2024-09-19T04:46:23.516809+0000","last_active":"2024-09-19T04:47:59.195688+0000","last_peered":"2024-09-19T04:47:59.195688+0000","last_clean":"2024-09-19T04:47:59.195688+0000","last_became_active":"2024-09-19T04:46:23.516489+0000","last_became_peered":"2024-09-19T04:46:23.516489+0000","last_unstale":"2024-09-19T04:47:59.195688+0000","last_undegraded":"2024-09-19T04:47:59.195688+0000","last_fullsized":"2024-09-19T04:47:59.195688+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:17:51.183061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.178331+0000","last_change":"2024-09-19T04:46:23.506868+0000","last_active":"2024-09-19T04:47:59.178331+0000","last_peered":"2024-09-19T04:47:59.178331+0000","last_clean":"2024-09-19T04:47:59.178331+0000","last_became_active":"2024-09-19T04:46:23.506489+0000","last_became_peered":"2024-09-19T04:46:23.506489+0000","last_unstale":"2024-09-19T04:47:59.178331+0000","last_undegraded":"2024-09-19T04:47:59.178331+0000","last_fullsized":"2024-09-19T04:47:59.178331+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:22.749973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.188617+0000","last_change":"2024-09-19T04:46:23.506733+0000","last_active":"2024-09-19T04:47:59.188617+0000","last_peered":"2024-09-19T04:47:59.188617+0000","last_clean":"2024-09-19T04:47:59.188617+0000","last_became_active":"2024-09-19T04:46:23.506408+0000","last_became_peered":"2024-09-19T04:46:23.506408+0000","last_unstale":"2024-09-19T04:47:59.188617+0000","last_undegraded":"2024-09-19T04:47:59.188617+0000","last_fullsized":"2024-09-19T04:47:59.188617+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:45:31.821607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.190602+0000","last_change":"2024-09-19T04:46:23.523109+0000","last_active":"2024-09-19T04:47:59.190602+0000","last_peered":"2024-09-19T04:47:59.190602+0000","last_clean":"2024-09-19T04:47:59.190602+0000","last_became_active":"2024-09-19T04:46:23.522783+0000","last_became_peered":"2024-09-19T04:46:23.522783+0000","last_unstale":"2024-09-19T04:47:59.190602+0000","last_undegraded":"2024-09-19T04:47:59.190602+0000","last_fullsized":"2024-09-19T04:47:59.190602+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:34:47.622562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.191408+0000","last_change":"2024-09-19T04:46:23.518297+0000","last_active":"2024-09-19T04:47:59.191408+0000","last_peered":"2024-09-19T04:47:59.191408+0000","last_clean":"2024-09-19T04:47:59.191408+0000","last_became_active":"2024-09-19T04:46:23.517974+0000","last_became_peered":"2024-09-19T04:46:23.517974+0000","last_unstale":"2024-09-19T04:47:59.191408+0000","last_undegraded":"2024-09-19T04:47:59.191408+0000","last_fullsized":"2024-09-19T04:47:59.191408+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:23:26.474961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.194736+0000","last_change":"2024-09-19T04:46:23.516255+0000","last_active":"2024-09-19T04:47:59.194736+0000","last_peered":"2024-09-19T04:47:59.194736+0000","last_clean":"2024-09-19T04:47:59.194736+0000","last_became_active":"2024-09-19T04:46:23.515861+0000","last_became_peered":"2024-09-19T04:46:23.515861+0000","last_unstale":"2024-09-19T04:47:59.194736+0000","last_undegraded":"2024-09-19T04:47:59.194736+0000","last_fullsized":"2024-09-19T04:47:59.194736+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:08:19.747905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.191238+0000","last_change":"2024-09-19T04:46:23.520947+0000","last_active":"2024-09-19T04:47:59.191238+0000","last_peered":"2024-09-19T04:47:59.191238+0000","last_clean":"2024-09-19T04:47:59.191238+0000","last_became_active":"2024-09-19T04:46:23.518463+0000","last_became_peered":"2024-09-19T04:46:23.518463+0000","last_unstale":"2024-09-19T04:47:59.191238+0000","last_undegraded":"2024-09-19T04:47:59.191238+0000","last_fullsized":"2024-09-19T04:47:59.191238+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:00.420868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.179165+0000","last_change":"2024-09-19T04:46:23.524145+0000","last_active":"2024-09-19T04:47:59.179165+0000","last_peered":"2024-09-19T04:47:59.179165+0000","last_clean":"2024-09-19T04:47:59.179165+0000","last_became_active":"2024-09-19T04:46:23.523698+0000","last_became_peered":"2024-09-19T04:46:23.523698+0000","last_unstale":"2024-09-19T04:47:59.179165+0000","last_undegraded":"2024-09-19T04:47:59.179165+0000","last_fullsized":"2024-09-19T04:47:59.179165+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:41.370871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.191896+0000","last_change":"2024-09-19T04:46:23.521782+0000","last_active":"2024-09-19T04:47:59.191896+0000","last_peered":"2024-09-19T04:47:59.191896+0000","last_clean":"2024-09-19T04:47:59.191896+0000","last_became_active":"2024-09-19T04:46:23.521452+0000","last_became_peered":"2024-09-19T04:46:23.521452+0000","last_unstale":"2024-09-19T04:47:59.191896+0000","last_undegraded":"2024-09-19T04:47:59.191896+0000","last_fullsized":"2024-09-19T04:47:59.191896+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:11:35.047064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.176831+0000","last_change":"2024-09-19T04:46:23.518174+0000","last_active":"2024-09-19T04:47:59.176831+0000","last_peered":"2024-09-19T04:47:59.176831+0000","last_clean":"2024-09-19T04:47:59.176831+0000","last_became_active":"2024-09-19T04:46:23.516507+0000","last_became_peered":"2024-09-19T04:46:23.516507+0000","last_unstale":"2024-09-19T04:47:59.176831+0000","last_undegraded":"2024-09-19T04:47:59.176831+0000","last_fullsized":"2024-09-19T04:47:59.176831+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:37.878245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.200586+0000","last_change":"2024-09-19T04:46:23.510582+0000","last_active":"2024-09-19T04:47:59.200586+0000","last_peered":"2024-09-19T04:47:59.200586+0000","last_clean":"2024-09-19T04:47:59.200586+0000","last_became_active":"2024-09-19T04:46:23.510135+0000","last_became_peered":"2024-09-19T04:46:23.510135+0000","last_unstale":"2024-09-19T04:47:59.200586+0000","last_undegraded":"2024-09-19T04:47:59.200586+0000","last_fullsized":"2024-09-19T04:47:59.200586+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:09.721696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.200294+0000","last_change":"2024-09-19T04:46:23.517963+0000","last_active":"2024-09-19T04:47:59.200294+0000","last_peered":"2024-09-19T04:47:59.200294+0000","last_clean":"2024-09-19T04:47:59.200294+0000","last_became_active":"2024-09-19T04:46:23.517574+0000","last_became_peered":"2024-09-19T04:46:23.517574+0000","last_unstale":"2024-09-19T04:47:59.200294+0000","last_undegraded":"2024-09-19T04:47:59.200294+0000","last_fullsized":"2024-09-19T04:47:59.200294+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:48:44.494267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.198957+0000","last_change":"2024-09-19T04:46:23.517318+0000","last_active":"2024-09-19T04:47:59.198957+0000","last_peered":"2024-09-19T04:47:59.198957+0000","last_clean":"2024-09-19T04:47:59.198957+0000","last_became_active":"2024-09-19T04:46:23.516973+0000","last_became_peered":"2024-09-19T04:46:23.516973+0000","last_unstale":"2024-09-19T04:47:59.198957+0000","last_undegraded":"2024-09-19T04:47:59.198957+0000","last_fullsized":"2024-09-19T04:47:59.198957+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:46:28.907400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.193578+0000","last_change":"2024-09-19T04:46:23.517468+0000","last_active":"2024-09-19T04:47:59.193578+0000","last_peered":"2024-09-19T04:47:59.193578+0000","last_clean":"2024-09-19T04:47:59.193578+0000","last_became_active":"2024-09-19T04:46:23.517093+0000","last_became_peered":"2024-09-19T04:46:23.517093+0000","last_unstale":"2024-09-19T04:47:59.193578+0000","last_undegraded":"2024-09-19T04:47:59.193578+0000","last_fullsized":"2024-09-19T04:47:59.193578+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:43.435560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.192587+0000","last_change":"2024-09-19T04:46:23.521679+0000","last_active":"2024-09-19T04:47:59.192587+0000","last_peered":"2024-09-19T04:47:59.192587+0000","last_clean":"2024-09-19T04:47:59.192587+0000","last_became_active":"2024-09-19T04:46:23.519346+0000","last_became_peered":"2024-09-19T04:46:23.519346+0000","last_unstale":"2024-09-19T04:47:59.192587+0000","last_undegraded":"2024-09-19T04:47:59.192587+0000","last_fullsized":"2024-09-19T04:47:59.192587+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:31.740226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.187745+0000","last_change":"2024-09-19T04:46:23.517518+0000","last_active":"2024-09-19T04:47:59.187745+0000","last_peered":"2024-09-19T04:47:59.187745+0000","last_clean":"2024-09-19T04:47:59.187745+0000","last_became_active":"2024-09-19T04:46:23.517179+0000","last_became_peered":"2024-09-19T04:46:23.517179+0000","last_unstale":"2024-09-19T04:47:59.187745+0000","last_undegraded":"2024-09-19T04:47:59.187745+0000","last_fullsized":"2024-09-19T04:47:59.187745+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:38.352433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.200230+0000","last_change":"2024-09-19T04:46:23.506618+0000","last_active":"2024-09-19T04:47:59.200230+0000","last_peered":"2024-09-19T04:47:59.200230+0000","last_clean":"2024-09-19T04:47:59.200230+0000","last_became_active":"2024-09-19T04:46:23.506276+0000","last_became_peered":"2024-09-19T04:46:23.506276+0000","last_unstale":"2024-09-19T04:47:59.200230+0000","last_undegraded":"2024-09-19T04:47:59.200230+0000","last_fullsized":"2024-09-19T04:47:59.200230+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:02:42.216717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.181611+0000","last_change":"2024-09-19T04:46:23.518793+0000","last_active":"2024-09-19T04:47:59.181611+0000","last_peered":"2024-09-19T04:47:59.181611+0000","last_clean":"2024-09-19T04:47:59.181611+0000","last_became_active":"2024-09-19T04:46:23.518386+0000","last_became_peered":"2024-09-19T04:46:23.518386+0000","last_unstale":"2024-09-19T04:47:59.181611+0000","last_undegraded":"2024-09-19T04:47:59.181611+0000","last_fullsized":"2024-09-19T04:47:59.181611+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:08:12.007678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.201240+0000","last_change":"2024-09-19T04:46:23.513022+0000","last_active":"2024-09-19T04:47:59.201240+0000","last_peered":"2024-09-19T04:47:59.201240+0000","last_clean":"2024-09-19T04:47:59.201240+0000","last_became_active":"2024-09-19T04:46:23.512541+0000","last_became_peered":"2024-09-19T04:46:23.512541+0000","last_unstale":"2024-09-19T04:47:59.201240+0000","last_undegraded":"2024-09-19T04:47:59.201240+0000","last_fullsized":"2024-09-19T04:47:59.201240+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:19.873546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.198798+0000","last_change":"2024-09-19T04:46:23.519523+0000","last_active":"2024-09-19T04:47:59.198798+0000","last_peered":"2024-09-19T04:47:59.198798+0000","last_clean":"2024-09-19T04:47:59.198798+0000","last_became_active":"2024-09-19T04:46:23.517995+0000","last_became_peered":"2024-09-19T04:46:23.517995+0000","last_unstale":"2024-09-19T04:47:59.198798+0000","last_undegraded":"2024-09-19T04:47:59.198798+0000","last_fullsized":"2024-09-19T04:47:59.198798+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:23.243522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.197448+0000","last_change":"2024-09-19T04:46:23.517564+0000","last_active":"2024-09-19T04:47:59.197448+0000","last_peered":"2024-09-19T04:47:59.197448+0000","last_clean":"2024-09-19T04:47:59.197448+0000","last_became_active":"2024-09-19T04:46:23.517248+0000","last_became_peered":"2024-09-19T04:46:23.517248+0000","last_unstale":"2024-09-19T04:47:59.197448+0000","last_undegraded":"2024-09-19T04:47:59.197448+0000","last_fullsized":"2024-09-19T04:47:59.197448+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:19.369346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.195030+0000","last_change":"2024-09-19T04:46:23.514150+0000","last_active":"2024-09-19T04:47:59.195030+0000","last_peered":"2024-09-19T04:47:59.195030+0000","last_clean":"2024-09-19T04:47:59.195030+0000","last_became_active":"2024-09-19T04:46:23.512169+0000","last_became_peered":"2024-09-19T04:46:23.512169+0000","last_unstale":"2024-09-19T04:47:59.195030+0000","last_undegraded":"2024-09-19T04:47:59.195030+0000","last_fullsized":"2024-09-19T04:47:59.195030+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:17.475389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.179284+0000","last_change":"2024-09-19T04:46:36.814692+0000","last_active":"2024-09-19T04:47:59.179284+0000","last_peered":"2024-09-19T04:47:59.179284+0000","last_clean":"2024-09-19T04:47:59.179284+0000","last_became_active":"2024-09-19T04:46:36.814429+0000","last_became_peered":"2024-09-19T04:46:36.814429+0000","last_unstale":"2024-09-19T04:47:59.179284+0000","last_undegraded":"2024-09-19T04:47:59.179284+0000","last_fullsized":"2024-09-19T04:47:59.179284+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:10:42.391448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.185392+0000","last_change":"2024-09-19T04:46:23.519273+0000","last_active":"2024-09-19T04:47:59.185392+0000","last_peered":"2024-09-19T04:47:59.185392+0000","last_clean":"2024-09-19T04:47:59.185392+0000","last_became_active":"2024-09-19T04:46:23.519001+0000","last_became_peered":"2024-09-19T04:46:23.519001+0000","last_unstale":"2024-09-19T04:47:59.185392+0000","last_undegraded":"2024-09-19T04:47:59.185392+0000","last_fullsized":"2024-09-19T04:47:59.185392+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:15:30.949066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.184874+0000","last_change":"2024-09-19T04:46:23.520888+0000","last_active":"2024-09-19T04:47:59.184874+0000","last_peered":"2024-09-19T04:47:59.184874+0000","last_clean":"2024-09-19T04:47:59.184874+0000","last_became_active":"2024-09-19T04:46:23.519476+0000","last_became_peered":"2024-09-19T04:46:23.519476+0000","last_unstale":"2024-09-19T04:47:59.184874+0000","last_undegraded":"2024-09-19T04:47:59.184874+0000","last_fullsized":"2024-09-19T04:47:59.184874+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:56.459724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.200464+0000","last_change":"2024-09-19T04:46:23.512152+0000","last_active":"2024-09-19T04:47:59.200464+0000","last_peered":"2024-09-19T04:47:59.200464+0000","last_clean":"2024-09-19T04:47:59.200464+0000","last_became_active":"2024-09-19T04:46:23.511784+0000","last_became_peered":"2024-09-19T04:46:23.511784+0000","last_unstale":"2024-09-19T04:47:59.200464+0000","last_undegraded":"2024-09-19T04:47:59.200464+0000","last_fullsized":"2024-09-19T04:47:59.200464+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:01:23.406580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.201261+0000","last_change":"2024-09-19T04:46:23.522491+0000","last_active":"2024-09-19T04:47:59.201261+0000","last_peered":"2024-09-19T04:47:59.201261+0000","last_clean":"2024-09-19T04:47:59.201261+0000","last_became_active":"2024-09-19T04:46:23.522025+0000","last_became_peered":"2024-09-19T04:46:23.522025+0000","last_unstale":"2024-09-19T04:47:59.201261+0000","last_undegraded":"2024-09-19T04:47:59.201261+0000","last_fullsized":"2024-09-19T04:47:59.201261+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:33.063300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.193481+0000","last_change":"2024-09-19T04:46:23.510057+0000","last_active":"2024-09-19T04:47:59.193481+0000","last_peered":"2024-09-19T04:47:59.193481+0000","last_clean":"2024-09-19T04:47:59.193481+0000","last_became_active":"2024-09-19T04:46:23.509691+0000","last_became_peered":"2024-09-19T04:46:23.509691+0000","last_unstale":"2024-09-19T04:47:59.193481+0000","last_undegraded":"2024-09-19T04:47:59.193481+0000","last_fullsized":"2024-09-19T04:47:59.193481+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:12:16.579944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.181233+0000","last_change":"2024-09-19T04:46:23.516876+0000","last_active":"2024-09-19T04:47:59.181233+0000","last_peered":"2024-09-19T04:47:59.181233+0000","last_clean":"2024-09-19T04:47:59.181233+0000","last_became_active":"2024-09-19T04:46:23.516533+0000","last_became_peered":"2024-09-19T04:46:23.516533+0000","last_unstale":"2024-09-19T04:47:59.181233+0000","last_undegraded":"2024-09-19T04:47:59.181233+0000","last_fullsized":"2024-09-19T04:47:59.181233+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:44.868936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.185917+0000","last_change":"2024-09-19T04:46:23.517607+0000","last_active":"2024-09-19T04:47:59.185917+0000","last_peered":"2024-09-19T04:47:59.185917+0000","last_clean":"2024-09-19T04:47:59.185917+0000","last_became_active":"2024-09-19T04:46:23.517289+0000","last_became_peered":"2024-09-19T04:46:23.517289+0000","last_unstale":"2024-09-19T04:47:59.185917+0000","last_undegraded":"2024-09-19T04:47:59.185917+0000","last_fullsized":"2024-09-19T04:47:59.185917+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:08:22.882886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.185070+0000","last_change":"2024-09-19T04:46:23.507713+0000","last_active":"2024-09-19T04:47:59.185070+0000","last_peered":"2024-09-19T04:47:59.185070+0000","last_clean":"2024-09-19T04:47:59.185070+0000","last_became_active":"2024-09-19T04:46:23.507350+0000","last_became_peered":"2024-09-19T04:46:23.507350+0000","last_unstale":"2024-09-19T04:47:59.185070+0000","last_undegraded":"2024-09-19T04:47:59.185070+0000","last_fullsized":"2024-09-19T04:47:59.185070+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:07:27.119097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.167495+0000","last_change":"2024-09-19T04:46:21.495958+0000","last_active":"2024-09-19T04:47:59.167495+0000","last_peered":"2024-09-19T04:47:59.167495+0000","last_clean":"2024-09-19T04:47:59.167495+0000","last_became_active":"2024-09-19T04:46:21.495562+0000","last_became_peered":"2024-09-19T04:46:21.495562+0000","last_unstale":"2024-09-19T04:47:59.167495+0000","last_undegraded":"2024-09-19T04:47:59.167495+0000","last_fullsized":"2024-09-19T04:47:59.167495+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:19:02.935893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.189671+0000","last_change":"2024-09-19T04:46:23.524151+0000","last_active":"2024-09-19T04:47:59.189671+0000","last_peered":"2024-09-19T04:47:59.189671+0000","last_clean":"2024-09-19T04:47:59.189671+0000","last_became_active":"2024-09-19T04:46:23.523795+0000","last_became_peered":"2024-09-19T04:46:23.523795+0000","last_unstale":"2024-09-19T04:47:59.189671+0000","last_undegraded":"2024-09-19T04:47:59.189671+0000","last_fullsized":"2024-09-19T04:47:59.189671+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:27.234766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.147123+0000","last_change":"2024-09-19T04:46:21.485072+0000","last_active":"2024-09-19T04:47:59.147123+0000","last_peered":"2024-09-19T04:47:59.147123+0000","last_clean":"2024-09-19T04:47:59.147123+0000","last_became_active":"2024-09-19T04:46:21.482727+0000","last_became_peered":"2024-09-19T04:46:21.482727+0000","last_unstale":"2024-09-19T04:47:59.147123+0000","last_undegraded":"2024-09-19T04:47:59.147123+0000","last_fullsized":"2024-09-19T04:47:59.147123+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:23.231570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.145676+0000","last_change":"2024-09-19T04:46:21.488537+0000","last_active":"2024-09-19T04:47:59.145676+0000","last_peered":"2024-09-19T04:47:59.145676+0000","last_clean":"2024-09-19T04:47:59.145676+0000","last_became_active":"2024-09-19T04:46:21.488176+0000","last_became_peered":"2024-09-19T04:46:21.488176+0000","last_unstale":"2024-09-19T04:47:59.145676+0000","last_undegraded":"2024-09-19T04:47:59.145676+0000","last_fullsized":"2024-09-19T04:47:59.145676+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:14.355956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.198415+0000","last_change":"2024-09-19T04:46:23.518619+0000","last_active":"2024-09-19T04:47:59.198415+0000","last_peered":"2024-09-19T04:47:59.198415+0000","last_clean":"2024-09-19T04:47:59.198415+0000","last_became_active":"2024-09-19T04:46:23.518313+0000","last_became_peered":"2024-09-19T04:46:23.518313+0000","last_unstale":"2024-09-19T04:47:59.198415+0000","last_undegraded":"2024-09-19T04:47:59.198415+0000","last_fullsized":"2024-09-19T04:47:59.198415+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:08:25.958935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.162195+0000","last_change":"2024-09-19T04:46:21.493873+0000","last_active":"2024-09-19T04:47:59.162195+0000","last_peered":"2024-09-19T04:47:59.162195+0000","last_clean":"2024-09-19T04:47:59.162195+0000","last_became_active":"2024-09-19T04:46:21.493447+0000","last_became_peered":"2024-09-19T04:46:21.493447+0000","last_unstale":"2024-09-19T04:47:59.162195+0000","last_undegraded":"2024-09-19T04:47:59.162195+0000","last_fullsized":"2024-09-19T04:47:59.162195+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:29.504001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.188563+0000","last_change":"2024-09-19T04:46:23.508247+0000","last_active":"2024-09-19T04:47:59.188563+0000","last_peered":"2024-09-19T04:47:59.188563+0000","last_clean":"2024-09-19T04:47:59.188563+0000","last_became_active":"2024-09-19T04:46:23.507936+0000","last_became_peered":"2024-09-19T04:46:23.507936+0000","last_unstale":"2024-09-19T04:47:59.188563+0000","last_undegraded":"2024-09-19T04:47:59.188563+0000","last_fullsized":"2024-09-19T04:47:59.188563+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:25:09.864664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.147589+0000","last_change":"2024-09-19T04:46:21.487636+0000","last_active":"2024-09-19T04:47:59.147589+0000","last_peered":"2024-09-19T04:47:59.147589+0000","last_clean":"2024-09-19T04:47:59.147589+0000","last_became_active":"2024-09-19T04:46:21.487162+0000","last_became_peered":"2024-09-19T04:46:21.487162+0000","last_unstale":"2024-09-19T04:47:59.147589+0000","last_undegraded":"2024-09-19T04:47:59.147589+0000","last_fullsized":"2024-09-19T04:47:59.147589+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:03:04.833769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.191093+0000","last_change":"2024-09-19T04:46:23.515047+0000","last_active":"2024-09-19T04:47:59.191093+0000","last_peered":"2024-09-19T04:47:59.191093+0000","last_clean":"2024-09-19T04:47:59.191093+0000","last_became_active":"2024-09-19T04:46:23.514607+0000","last_became_peered":"2024-09-19T04:46:23.514607+0000","last_unstale":"2024-09-19T04:47:59.191093+0000","last_undegraded":"2024-09-19T04:47:59.191093+0000","last_fullsized":"2024-09-19T04:47:59.191093+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:05:03.076568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.161276+0000","last_change":"2024-09-19T04:46:21.493732+0000","last_active":"2024-09-19T04:47:59.161276+0000","last_peered":"2024-09-19T04:47:59.161276+0000","last_clean":"2024-09-19T04:47:59.161276+0000","last_became_active":"2024-09-19T04:46:21.493069+0000","last_became_peered":"2024-09-19T04:46:21.493069+0000","last_unstale":"2024-09-19T04:47:59.161276+0000","last_undegraded":"2024-09-19T04:47:59.161276+0000","last_fullsized":"2024-09-19T04:47:59.161276+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:17.709419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.202047+0000","last_change":"2024-09-19T04:46:23.516530+0000","last_active":"2024-09-19T04:47:59.202047+0000","last_peered":"2024-09-19T04:47:59.202047+0000","last_clean":"2024-09-19T04:47:59.202047+0000","last_became_active":"2024-09-19T04:46:23.515816+0000","last_became_peered":"2024-09-19T04:46:23.515816+0000","last_unstale":"2024-09-19T04:47:59.202047+0000","last_undegraded":"2024-09-19T04:47:59.202047+0000","last_fullsized":"2024-09-19T04:47:59.202047+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:56:19.162009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.170650+0000","last_change":"2024-09-19T04:46:21.573930+0000","last_active":"2024-09-19T04:47:59.170650+0000","last_peered":"2024-09-19T04:47:59.170650+0000","last_clean":"2024-09-19T04:47:59.170650+0000","last_became_active":"2024-09-19T04:46:21.573579+0000","last_became_peered":"2024-09-19T04:46:21.573579+0000","last_unstale":"2024-09-19T04:47:59.170650+0000","last_undegraded":"2024-09-19T04:47:59.170650+0000","last_fullsized":"2024-09-19T04:47:59.170650+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:29.472481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.177548+0000","last_change":"2024-09-19T04:46:23.520569+0000","last_active":"2024-09-19T04:47:59.177548+0000","last_peered":"2024-09-19T04:47:59.177548+0000","last_clean":"2024-09-19T04:47:59.177548+0000","last_became_active":"2024-09-19T04:46:23.519894+0000","last_became_peered":"2024-09-19T04:46:23.519894+0000","last_unstale":"2024-09-19T04:47:59.177548+0000","last_undegraded":"2024-09-19T04:47:59.177548+0000","last_fullsized":"2024-09-19T04:47:59.177548+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:20.823559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'31","reported_seq":242,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.673982+0000","last_change":"2024-09-19T04:46:21.491853+0000","last_active":"2024-09-19T04:47:59.673982+0000","last_peered":"2024-09-19T04:47:59.673982+0000","last_clean":"2024-09-19T04:47:59.673982+0000","last_became_active":"2024-09-19T04:46:21.491499+0000","last_became_peered":"2024-09-19T04:46:21.491499+0000","last_unstale":"2024-09-19T04:47:59.673982+0000","last_undegraded":"2024-09-19T04:47:59.673982+0000","last_fullsized":"2024-09-19T04:47:59.673982+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:15.372001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62729,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":187,"num_read_kb":154,"num_write":31,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.186710+0000","last_change":"2024-09-19T04:46:23.516781+0000","last_active":"2024-09-19T04:47:59.186710+0000","last_peered":"2024-09-19T04:47:59.186710+0000","last_clean":"2024-09-19T04:47:59.186710+0000","last_became_active":"2024-09-19T04:46:23.515928+0000","last_became_peered":"2024-09-19T04:46:23.515928+0000","last_unstale":"2024-09-19T04:47:59.186710+0000","last_undegraded":"2024-09-19T04:47:59.186710+0000","last_fullsized":"2024-09-19T04:47:59.186710+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:31.319072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'2","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.157318+0000","last_change":"2024-09-19T04:46:36.576395+0000","last_active":"2024-09-19T04:47:59.157318+0000","last_peered":"2024-09-19T04:47:59.157318+0000","last_clean":"2024-09-19T04:47:59.157318+0000","last_became_active":"2024-09-19T04:46:36.567213+0000","last_became_peered":"2024-09-19T04:46:36.567213+0000","last_unstale":"2024-09-19T04:47:59.157318+0000","last_undegraded":"2024-09-19T04:47:59.157318+0000","last_fullsized":"2024-09-19T04:47:59.157318+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:26.802224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.199243+0000","last_change":"2024-09-19T04:46:23.512736+0000","last_active":"2024-09-19T04:47:59.199243+0000","last_peered":"2024-09-19T04:47:59.199243+0000","last_clean":"2024-09-19T04:47:59.199243+0000","last_became_active":"2024-09-19T04:46:23.512399+0000","last_became_peered":"2024-09-19T04:46:23.512399+0000","last_unstale":"2024-09-19T04:47:59.199243+0000","last_undegraded":"2024-09-19T04:47:59.199243+0000","last_fullsized":"2024-09-19T04:47:59.199243+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:54:28.607512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.167311+0000","last_change":"2024-09-19T04:46:21.495421+0000","last_active":"2024-09-19T04:47:59.167311+0000","last_peered":"2024-09-19T04:47:59.167311+0000","last_clean":"2024-09-19T04:47:59.167311+0000","last_became_active":"2024-09-19T04:46:21.495004+0000","last_became_peered":"2024-09-19T04:46:21.495004+0000","last_unstale":"2024-09-19T04:47:59.167311+0000","last_undegraded":"2024-09-19T04:47:59.167311+0000","last_fullsized":"2024-09-19T04:47:59.167311+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:11.038118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"81'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.200971+0000","last_change":"2024-09-19T04:46:23.519462+0000","last_active":"2024-09-19T04:47:59.200971+0000","last_peered":"2024-09-19T04:47:59.200971+0000","last_clean":"2024-09-19T04:47:59.200971+0000","last_became_active":"2024-09-19T04:46:23.519121+0000","last_became_peered":"2024-09-19T04:46:23.519121+0000","last_unstale":"2024-09-19T04:47:59.200971+0000","last_undegraded":"2024-09-19T04:47:59.200971+0000","last_fullsized":"2024-09-19T04:47:59.200971+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:19.643433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.155240+0000","last_change":"2024-09-19T04:46:21.496243+0000","last_active":"2024-09-19T04:47:59.155240+0000","last_peered":"2024-09-19T04:47:59.155240+0000","last_clean":"2024-09-19T04:47:59.155240+0000","last_became_active":"2024-09-19T04:46:21.495821+0000","last_became_peered":"2024-09-19T04:46:21.495821+0000","last_unstale":"2024-09-19T04:47:59.155240+0000","last_undegraded":"2024-09-19T04:47:59.155240+0000","last_fullsized":"2024-09-19T04:47:59.155240+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:35:02.729538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"81'6","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.189779+0000","last_change":"2024-09-19T04:46:36.570404+0000","last_active":"2024-09-19T04:47:59.189779+0000","last_peered":"2024-09-19T04:47:59.189779+0000","last_clean":"2024-09-19T04:47:59.189779+0000","last_became_active":"2024-09-19T04:46:36.569898+0000","last_became_peered":"2024-09-19T04:46:36.569898+0000","last_unstale":"2024-09-19T04:47:59.189779+0000","last_undegraded":"2024-09-19T04:47:59.189779+0000","last_fullsized":"2024-09-19T04:47:59.189779+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:20:47.441702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'8","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.156443+0000","last_change":"2024-09-19T04:46:21.572642+0000","last_active":"2024-09-19T04:47:59.156443+0000","last_peered":"2024-09-19T04:47:59.156443+0000","last_clean":"2024-09-19T04:47:59.156443+0000","last_became_active":"2024-09-19T04:46:21.571823+0000","last_became_peered":"2024-09-19T04:46:21.571823+0000","last_unstale":"2024-09-19T04:47:59.156443+0000","last_undegraded":"2024-09-19T04:47:59.156443+0000","last_fullsized":"2024-09-19T04:47:59.156443+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:28.956744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.190799+0000","last_change":"2024-09-19T04:46:23.524169+0000","last_active":"2024-09-19T04:47:59.190799+0000","last_peered":"2024-09-19T04:47:59.190799+0000","last_clean":"2024-09-19T04:47:59.190799+0000","last_became_active":"2024-09-19T04:46:23.523869+0000","last_became_peered":"2024-09-19T04:46:23.523869+0000","last_unstale":"2024-09-19T04:47:59.190799+0000","last_undegraded":"2024-09-19T04:47:59.190799+0000","last_fullsized":"2024-09-19T04:47:59.190799+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:46.131143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'1","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.157561+0000","last_change":"2024-09-19T04:46:21.490154+0000","last_active":"2024-09-19T04:47:59.157561+0000","last_peered":"2024-09-19T04:47:59.157561+0000","last_clean":"2024-09-19T04:47:59.157561+0000","last_became_active":"2024-09-19T04:46:21.489820+0000","last_became_peered":"2024-09-19T04:46:21.489820+0000","last_unstale":"2024-09-19T04:47:59.157561+0000","last_undegraded":"2024-09-19T04:47:59.157561+0000","last_fullsized":"2024-09-19T04:47:59.157561+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:34:27.446664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.184035+0000","last_change":"2024-09-19T04:46:23.518712+0000","last_active":"2024-09-19T04:47:59.184035+0000","last_peered":"2024-09-19T04:47:59.184035+0000","last_clean":"2024-09-19T04:47:59.184035+0000","last_became_active":"2024-09-19T04:46:23.518408+0000","last_became_peered":"2024-09-19T04:46:23.518408+0000","last_unstale":"2024-09-19T04:47:59.184035+0000","last_undegraded":"2024-09-19T04:47:59.184035+0000","last_fullsized":"2024-09-19T04:47:59.184035+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:45:17.398334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.145916+0000","last_change":"2024-09-19T04:46:21.487789+0000","last_active":"2024-09-19T04:47:59.145916+0000","last_peered":"2024-09-19T04:47:59.145916+0000","last_clean":"2024-09-19T04:47:59.145916+0000","last_became_active":"2024-09-19T04:46:21.487411+0000","last_became_peered":"2024-09-19T04:46:21.487411+0000","last_unstale":"2024-09-19T04:47:59.145916+0000","last_undegraded":"2024-09-19T04:47:59.145916+0000","last_fullsized":"2024-09-19T04:47:59.145916+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:25.353345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.189636+0000","last_change":"2024-09-19T04:46:23.515432+0000","last_active":"2024-09-19T04:47:59.189636+0000","last_peered":"2024-09-19T04:47:59.189636+0000","last_clean":"2024-09-19T04:47:59.189636+0000","last_became_active":"2024-09-19T04:46:23.515071+0000","last_became_peered":"2024-09-19T04:46:23.515071+0000","last_unstale":"2024-09-19T04:47:59.189636+0000","last_undegraded":"2024-09-19T04:47:59.189636+0000","last_fullsized":"2024-09-19T04:47:59.189636+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:56:04.743652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'39","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.370929+0000","last_change":"2024-09-19T04:46:21.487856+0000","last_active":"2024-09-19T04:47:59.370929+0000","last_peered":"2024-09-19T04:47:59.370929+0000","last_clean":"2024-09-19T04:47:59.370929+0000","last_became_active":"2024-09-19T04:46:21.487342+0000","last_became_peered":"2024-09-19T04:46:21.487342+0000","last_unstale":"2024-09-19T04:47:59.370929+0000","last_undegraded":"2024-09-19T04:47:59.370929+0000","last_fullsized":"2024-09-19T04:47:59.370929+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:29.275296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.190880+0000","last_change":"2024-09-19T04:46:23.517250+0000","last_active":"2024-09-19T04:47:59.190880+0000","last_peered":"2024-09-19T04:47:59.190880+0000","last_clean":"2024-09-19T04:47:59.190880+0000","last_became_active":"2024-09-19T04:46:23.516895+0000","last_became_peered":"2024-09-19T04:46:23.516895+0000","last_unstale":"2024-09-19T04:47:59.190880+0000","last_undegraded":"2024-09-19T04:47:59.190880+0000","last_fullsized":"2024-09-19T04:47:59.190880+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:51.982348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.147446+0000","last_change":"2024-09-19T04:46:21.572452+0000","last_active":"2024-09-19T04:47:59.147446+0000","last_peered":"2024-09-19T04:47:59.147446+0000","last_clean":"2024-09-19T04:47:59.147446+0000","last_became_active":"2024-09-19T04:46:21.572026+0000","last_became_peered":"2024-09-19T04:46:21.572026+0000","last_unstale":"2024-09-19T04:47:59.147446+0000","last_undegraded":"2024-09-19T04:47:59.147446+0000","last_fullsized":"2024-09-19T04:47:59.147446+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:07.859604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.192079+0000","last_change":"2024-09-19T04:46:23.523549+0000","last_active":"2024-09-19T04:47:59.192079+0000","last_peered":"2024-09-19T04:47:59.192079+0000","last_clean":"2024-09-19T04:47:59.192079+0000","last_became_active":"2024-09-19T04:46:23.522581+0000","last_became_peered":"2024-09-19T04:46:23.522581+0000","last_unstale":"2024-09-19T04:47:59.192079+0000","last_undegraded":"2024-09-19T04:47:59.192079+0000","last_fullsized":"2024-09-19T04:47:59.192079+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:51:33.504024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":343,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.159617+0000","last_change":"2024-09-19T04:45:12.271676+0000","last_active":"2024-09-19T04:47:59.159617+0000","last_peered":"2024-09-19T04:47:59.159617+0000","last_clean":"2024-09-19T04:47:59.159617+0000","last_became_active":"2024-09-19T04:45:12.271093+0000","last_became_peered":"2024-09-19T04:45:12.271093+0000","last_unstale":"2024-09-19T04:47:59.159617+0000","last_undegraded":"2024-09-19T04:47:59.159617+0000","last_fullsized":"2024-09-19T04:47:59.159617+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:41:52.010883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:41:52.010883+0000","last_clean_scrub_stamp":"2024-09-19T04:41:52.010883+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:48.499621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.155221+0000","last_change":"2024-09-19T04:46:21.493847+0000","last_active":"2024-09-19T04:47:59.155221+0000","last_peered":"2024-09-19T04:47:59.155221+0000","last_clean":"2024-09-19T04:47:59.155221+0000","last_became_active":"2024-09-19T04:46:21.493432+0000","last_became_peered":"2024-09-19T04:46:21.493432+0000","last_unstale":"2024-09-19T04:47:59.155221+0000","last_undegraded":"2024-09-19T04:47:59.155221+0000","last_fullsized":"2024-09-19T04:47:59.155221+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:10:21.398602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.196941+0000","last_change":"2024-09-19T04:46:23.517517+0000","last_active":"2024-09-19T04:47:59.196941+0000","last_peered":"2024-09-19T04:47:59.196941+0000","last_clean":"2024-09-19T04:47:59.196941+0000","last_became_active":"2024-09-19T04:46:23.517191+0000","last_became_peered":"2024-09-19T04:46:23.517191+0000","last_unstale":"2024-09-19T04:47:59.196941+0000","last_undegraded":"2024-09-19T04:47:59.196941+0000","last_fullsized":"2024-09-19T04:47:59.196941+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:17.896149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.158899+0000","last_change":"2024-09-19T04:46:36.794380+0000","last_active":"2024-09-19T04:47:59.158899+0000","last_peered":"2024-09-19T04:47:59.158899+0000","last_clean":"2024-09-19T04:47:59.158899+0000","last_became_active":"2024-09-19T04:46:36.793911+0000","last_became_peered":"2024-09-19T04:46:36.793911+0000","last_unstale":"2024-09-19T04:47:59.158899+0000","last_undegraded":"2024-09-19T04:47:59.158899+0000","last_fullsized":"2024-09-19T04:47:59.158899+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:01:37.733641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1],"acting":[7,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.192866+0000","last_change":"2024-09-19T04:46:23.514102+0000","last_active":"2024-09-19T04:47:59.192866+0000","last_peered":"2024-09-19T04:47:59.192866+0000","last_clean":"2024-09-19T04:47:59.192866+0000","last_became_active":"2024-09-19T04:46:23.513732+0000","last_became_peered":"2024-09-19T04:46:23.513732+0000","last_unstale":"2024-09-19T04:47:59.192866+0000","last_undegraded":"2024-09-19T04:47:59.192866+0000","last_fullsized":"2024-09-19T04:47:59.192866+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:13.533065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.145786+0000","last_change":"2024-09-19T04:46:21.572628+0000","last_active":"2024-09-19T04:47:59.145786+0000","last_peered":"2024-09-19T04:47:59.145786+0000","last_clean":"2024-09-19T04:47:59.145786+0000","last_became_active":"2024-09-19T04:46:21.571736+0000","last_became_peered":"2024-09-19T04:46:21.571736+0000","last_unstale":"2024-09-19T04:47:59.145786+0000","last_undegraded":"2024-09-19T04:47:59.145786+0000","last_fullsized":"2024-09-19T04:47:59.145786+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:10:50.204481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.185982+0000","last_change":"2024-09-19T04:46:36.991388+0000","last_active":"2024-09-19T04:47:59.185982+0000","last_peered":"2024-09-19T04:47:59.185982+0000","last_clean":"2024-09-19T04:47:59.185982+0000","last_became_active":"2024-09-19T04:46:36.990923+0000","last_became_peered":"2024-09-19T04:46:36.990923+0000","last_unstale":"2024-09-19T04:47:59.185982+0000","last_undegraded":"2024-09-19T04:47:59.185982+0000","last_fullsized":"2024-09-19T04:47:59.185982+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:31.148732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.160790+0000","last_change":"2024-09-19T04:46:21.492696+0000","last_active":"2024-09-19T04:47:59.160790+0000","last_peered":"2024-09-19T04:47:59.160790+0000","last_clean":"2024-09-19T04:47:59.160790+0000","last_became_active":"2024-09-19T04:46:21.492306+0000","last_became_peered":"2024-09-19T04:46:21.492306+0000","last_unstale":"2024-09-19T04:47:59.160790+0000","last_undegraded":"2024-09-19T04:47:59.160790+0000","last_fullsized":"2024-09-19T04:47:59.160790+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:51:56.975170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.186820+0000","last_change":"2024-09-19T04:46:36.989535+0000","last_active":"2024-09-19T04:47:59.186820+0000","last_peered":"2024-09-19T04:47:59.186820+0000","last_clean":"2024-09-19T04:47:59.186820+0000","last_became_active":"2024-09-19T04:46:36.989252+0000","last_became_peered":"2024-09-19T04:46:36.989252+0000","last_unstale":"2024-09-19T04:47:59.186820+0000","last_undegraded":"2024-09-19T04:47:59.186820+0000","last_fullsized":"2024-09-19T04:47:59.186820+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:49:45.767547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.159452+0000","last_change":"2024-09-19T04:46:21.572275+0000","last_active":"2024-09-19T04:47:59.159452+0000","last_peered":"2024-09-19T04:47:59.159452+0000","last_clean":"2024-09-19T04:47:59.159452+0000","last_became_active":"2024-09-19T04:46:21.571940+0000","last_became_peered":"2024-09-19T04:46:21.571940+0000","last_unstale":"2024-09-19T04:47:59.159452+0000","last_undegraded":"2024-09-19T04:47:59.159452+0000","last_fullsized":"2024-09-19T04:47:59.159452+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:13.399887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.200078+0000","last_change":"2024-09-19T04:46:23.514355+0000","last_active":"2024-09-19T04:47:59.200078+0000","last_peered":"2024-09-19T04:47:59.200078+0000","last_clean":"2024-09-19T04:47:59.200078+0000","last_became_active":"2024-09-19T04:46:23.513963+0000","last_became_peered":"2024-09-19T04:46:23.513963+0000","last_unstale":"2024-09-19T04:47:59.200078+0000","last_undegraded":"2024-09-19T04:47:59.200078+0000","last_fullsized":"2024-09-19T04:47:59.200078+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:06.742732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.158181+0000","last_change":"2024-09-19T04:46:21.572466+0000","last_active":"2024-09-19T04:47:59.158181+0000","last_peered":"2024-09-19T04:47:59.158181+0000","last_clean":"2024-09-19T04:47:59.158181+0000","last_became_active":"2024-09-19T04:46:21.571868+0000","last_became_peered":"2024-09-19T04:46:21.571868+0000","last_unstale":"2024-09-19T04:47:59.158181+0000","last_undegraded":"2024-09-19T04:47:59.158181+0000","last_fullsized":"2024-09-19T04:47:59.158181+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:01.132858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.193312+0000","last_change":"2024-09-19T04:46:23.509517+0000","last_active":"2024-09-19T04:47:59.193312+0000","last_peered":"2024-09-19T04:47:59.193312+0000","last_clean":"2024-09-19T04:47:59.193312+0000","last_became_active":"2024-09-19T04:46:23.509216+0000","last_became_peered":"2024-09-19T04:46:23.509216+0000","last_unstale":"2024-09-19T04:47:59.193312+0000","last_undegraded":"2024-09-19T04:47:59.193312+0000","last_fullsized":"2024-09-19T04:47:59.193312+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:29:52.747643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'43","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.377679+0000","last_change":"2024-09-19T04:46:21.484462+0000","last_active":"2024-09-19T04:47:59.377679+0000","last_peered":"2024-09-19T04:47:59.377679+0000","last_clean":"2024-09-19T04:47:59.377679+0000","last_became_active":"2024-09-19T04:46:21.484148+0000","last_became_peered":"2024-09-19T04:46:21.484148+0000","last_unstale":"2024-09-19T04:47:59.377679+0000","last_undegraded":"2024-09-19T04:47:59.377679+0000","last_fullsized":"2024-09-19T04:47:59.377679+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:17:18.742857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":78,"num_write_kb":836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.191385+0000","last_change":"2024-09-19T04:46:23.512768+0000","last_active":"2024-09-19T04:47:59.191385+0000","last_peered":"2024-09-19T04:47:59.191385+0000","last_clean":"2024-09-19T04:47:59.191385+0000","last_became_active":"2024-09-19T04:46:23.512416+0000","last_became_peered":"2024-09-19T04:46:23.512416+0000","last_unstale":"2024-09-19T04:47:59.191385+0000","last_undegraded":"2024-09-19T04:47:59.191385+0000","last_fullsized":"2024-09-19T04:47:59.191385+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:03:48.340126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.155622+0000","last_change":"2024-09-19T04:46:21.488634+0000","last_active":"2024-09-19T04:47:59.155622+0000","last_peered":"2024-09-19T04:47:59.155622+0000","last_clean":"2024-09-19T04:47:59.155622+0000","last_became_active":"2024-09-19T04:46:21.488078+0000","last_became_peered":"2024-09-19T04:46:21.488078+0000","last_unstale":"2024-09-19T04:47:59.155622+0000","last_undegraded":"2024-09-19T04:47:59.155622+0000","last_fullsized":"2024-09-19T04:47:59.155622+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:31:47.946873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.200463+0000","last_change":"2024-09-19T04:46:23.522419+0000","last_active":"2024-09-19T04:47:59.200463+0000","last_peered":"2024-09-19T04:47:59.200463+0000","last_clean":"2024-09-19T04:47:59.200463+0000","last_became_active":"2024-09-19T04:46:23.522054+0000","last_became_peered":"2024-09-19T04:46:23.522054+0000","last_unstale":"2024-09-19T04:47:59.200463+0000","last_undegraded":"2024-09-19T04:47:59.200463+0000","last_fullsized":"2024-09-19T04:47:59.200463+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:43.720439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.151788+0000","last_change":"2024-09-19T04:46:21.572283+0000","last_active":"2024-09-19T04:47:59.151788+0000","last_peered":"2024-09-19T04:47:59.151788+0000","last_clean":"2024-09-19T04:47:59.151788+0000","last_became_active":"2024-09-19T04:46:21.572023+0000","last_became_peered":"2024-09-19T04:46:21.572023+0000","last_unstale":"2024-09-19T04:47:59.151788+0000","last_undegraded":"2024-09-19T04:47:59.151788+0000","last_fullsized":"2024-09-19T04:47:59.151788+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:37:26.293900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.178263+0000","last_change":"2024-09-19T04:46:23.516278+0000","last_active":"2024-09-19T04:47:59.178263+0000","last_peered":"2024-09-19T04:47:59.178263+0000","last_clean":"2024-09-19T04:47:59.178263+0000","last_became_active":"2024-09-19T04:46:23.515922+0000","last_became_peered":"2024-09-19T04:46:23.515922+0000","last_unstale":"2024-09-19T04:47:59.178263+0000","last_undegraded":"2024-09-19T04:47:59.178263+0000","last_fullsized":"2024-09-19T04:47:59.178263+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:26:11.038230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.156384+0000","last_change":"2024-09-19T04:46:21.489250+0000","last_active":"2024-09-19T04:47:59.156384+0000","last_peered":"2024-09-19T04:47:59.156384+0000","last_clean":"2024-09-19T04:47:59.156384+0000","last_became_active":"2024-09-19T04:46:21.488910+0000","last_became_peered":"2024-09-19T04:46:21.488910+0000","last_unstale":"2024-09-19T04:47:59.156384+0000","last_undegraded":"2024-09-19T04:47:59.156384+0000","last_fullsized":"2024-09-19T04:47:59.156384+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:04:03.650494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.191047+0000","last_change":"2024-09-19T04:46:23.512663+0000","last_active":"2024-09-19T04:47:59.191047+0000","last_peered":"2024-09-19T04:47:59.191047+0000","last_clean":"2024-09-19T04:47:59.191047+0000","last_became_active":"2024-09-19T04:46:23.512265+0000","last_became_peered":"2024-09-19T04:46:23.512265+0000","last_unstale":"2024-09-19T04:47:59.191047+0000","last_undegraded":"2024-09-19T04:47:59.191047+0000","last_fullsized":"2024-09-19T04:47:59.191047+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:52.903900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.156847+0000","last_change":"2024-09-19T04:46:36.990653+0000","last_active":"2024-09-19T04:47:59.156847+0000","last_peered":"2024-09-19T04:47:59.156847+0000","last_clean":"2024-09-19T04:47:59.156847+0000","last_became_active":"2024-09-19T04:46:36.990202+0000","last_became_peered":"2024-09-19T04:46:36.990202+0000","last_unstale":"2024-09-19T04:47:59.156847+0000","last_undegraded":"2024-09-19T04:47:59.156847+0000","last_fullsized":"2024-09-19T04:47:59.156847+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:25:53.780614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.198485+0000","last_change":"2024-09-19T04:46:23.510196+0000","last_active":"2024-09-19T04:47:59.198485+0000","last_peered":"2024-09-19T04:47:59.198485+0000","last_clean":"2024-09-19T04:47:59.198485+0000","last_became_active":"2024-09-19T04:46:23.509871+0000","last_became_peered":"2024-09-19T04:46:23.509871+0000","last_unstale":"2024-09-19T04:47:59.198485+0000","last_undegraded":"2024-09-19T04:47:59.198485+0000","last_fullsized":"2024-09-19T04:47:59.198485+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:42:01.825770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'2","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.157561+0000","last_change":"2024-09-19T04:46:21.492279+0000","last_active":"2024-09-19T04:47:59.157561+0000","last_peered":"2024-09-19T04:47:59.157561+0000","last_clean":"2024-09-19T04:47:59.157561+0000","last_became_active":"2024-09-19T04:46:21.491669+0000","last_became_peered":"2024-09-19T04:46:21.491669+0000","last_unstale":"2024-09-19T04:47:59.157561+0000","last_undegraded":"2024-09-19T04:47:59.157561+0000","last_fullsized":"2024-09-19T04:47:59.157561+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:23:15.822887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.200076+0000","last_change":"2024-09-19T04:46:23.518114+0000","last_active":"2024-09-19T04:47:59.200076+0000","last_peered":"2024-09-19T04:47:59.200076+0000","last_clean":"2024-09-19T04:47:59.200076+0000","last_became_active":"2024-09-19T04:46:23.517707+0000","last_became_peered":"2024-09-19T04:46:23.517707+0000","last_unstale":"2024-09-19T04:47:59.200076+0000","last_undegraded":"2024-09-19T04:47:59.200076+0000","last_fullsized":"2024-09-19T04:47:59.200076+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:52.438748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.191968+0000","last_change":"2024-09-19T04:46:23.525164+0000","last_active":"2024-09-19T04:47:59.191968+0000","last_peered":"2024-09-19T04:47:59.191968+0000","last_clean":"2024-09-19T04:47:59.191968+0000","last_became_active":"2024-09-19T04:46:23.524735+0000","last_became_peered":"2024-09-19T04:46:23.524735+0000","last_unstale":"2024-09-19T04:47:59.191968+0000","last_undegraded":"2024-09-19T04:47:59.191968+0000","last_fullsized":"2024-09-19T04:47:59.191968+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:53.590834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.157901+0000","last_change":"2024-09-19T04:46:21.492940+0000","last_active":"2024-09-19T04:47:59.157901+0000","last_peered":"2024-09-19T04:47:59.157901+0000","last_clean":"2024-09-19T04:47:59.157901+0000","last_became_active":"2024-09-19T04:46:21.492602+0000","last_became_peered":"2024-09-19T04:46:21.492602+0000","last_unstale":"2024-09-19T04:47:59.157901+0000","last_undegraded":"2024-09-19T04:47:59.157901+0000","last_fullsized":"2024-09-19T04:47:59.157901+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:20.554832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.190998+0000","last_change":"2024-09-19T04:46:23.513432+0000","last_active":"2024-09-19T04:47:59.190998+0000","last_peered":"2024-09-19T04:47:59.190998+0000","last_clean":"2024-09-19T04:47:59.190998+0000","last_became_active":"2024-09-19T04:46:23.513084+0000","last_became_peered":"2024-09-19T04:46:23.513084+0000","last_unstale":"2024-09-19T04:47:59.190998+0000","last_undegraded":"2024-09-19T04:47:59.190998+0000","last_fullsized":"2024-09-19T04:47:59.190998+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:03:16.732545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.158117+0000","last_change":"2024-09-19T04:46:21.491823+0000","last_active":"2024-09-19T04:47:59.158117+0000","last_peered":"2024-09-19T04:47:59.158117+0000","last_clean":"2024-09-19T04:47:59.158117+0000","last_became_active":"2024-09-19T04:46:21.491401+0000","last_became_peered":"2024-09-19T04:46:21.491401+0000","last_unstale":"2024-09-19T04:47:59.158117+0000","last_undegraded":"2024-09-19T04:47:59.158117+0000","last_fullsized":"2024-09-19T04:47:59.158117+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:55.955868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.198560+0000","last_change":"2024-09-19T04:46:23.515884+0000","last_active":"2024-09-19T04:47:59.198560+0000","last_peered":"2024-09-19T04:47:59.198560+0000","last_clean":"2024-09-19T04:47:59.198560+0000","last_became_active":"2024-09-19T04:46:23.515243+0000","last_became_peered":"2024-09-19T04:46:23.515243+0000","last_unstale":"2024-09-19T04:47:59.198560+0000","last_undegraded":"2024-09-19T04:47:59.198560+0000","last_fullsized":"2024-09-19T04:47:59.198560+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:07:33.716942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.157750+0000","last_change":"2024-09-19T04:46:21.572122+0000","last_active":"2024-09-19T04:47:59.157750+0000","last_peered":"2024-09-19T04:47:59.157750+0000","last_clean":"2024-09-19T04:47:59.157750+0000","last_became_active":"2024-09-19T04:46:21.571747+0000","last_became_peered":"2024-09-19T04:46:21.571747+0000","last_unstale":"2024-09-19T04:47:59.157750+0000","last_undegraded":"2024-09-19T04:47:59.157750+0000","last_fullsized":"2024-09-19T04:47:59.157750+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:06:43.411409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.197280+0000","last_change":"2024-09-19T04:46:23.513876+0000","last_active":"2024-09-19T04:47:59.197280+0000","last_peered":"2024-09-19T04:47:59.197280+0000","last_clean":"2024-09-19T04:47:59.197280+0000","last_became_active":"2024-09-19T04:46:23.513562+0000","last_became_peered":"2024-09-19T04:46:23.513562+0000","last_unstale":"2024-09-19T04:47:59.197280+0000","last_undegraded":"2024-09-19T04:47:59.197280+0000","last_fullsized":"2024-09-19T04:47:59.197280+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:21.982001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'4","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.161181+0000","last_change":"2024-09-19T04:46:21.491550+0000","last_active":"2024-09-19T04:47:59.161181+0000","last_peered":"2024-09-19T04:47:59.161181+0000","last_clean":"2024-09-19T04:47:59.161181+0000","last_became_active":"2024-09-19T04:46:21.491259+0000","last_became_peered":"2024-09-19T04:46:21.491259+0000","last_unstale":"2024-09-19T04:47:59.161181+0000","last_undegraded":"2024-09-19T04:47:59.161181+0000","last_fullsized":"2024-09-19T04:47:59.161181+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:38.671211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":588343,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":284,"num_read_kb":238,"num_write":195,"num_write_kb":1396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1867776,"data_stored":1765029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645344,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":888832,"data_stored":435145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874277,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37068,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708084,"statfs":{"total":95995035648,"available":95957078016,"internally_reserved":0,"allocated":1703936,"data_stored":1220119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":36174273},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005098,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40760,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704392,"statfs":{"total":95995035648,"available":95953297408,"internally_reserved":0,"allocated":1282048,"data_stored":828909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234032,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":892928,"data_stored":435715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462964,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28480,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716672,"statfs":{"total":95995035648,"available":95965872128,"internally_reserved":0,"allocated":1486848,"data_stored":1026178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626489,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36216,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708936,"statfs":{"total":95995035648,"available":95957950464,"internally_reserved":0,"allocated":888832,"data_stored":435228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855421,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28556,"kb_used_data":1528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716596,"statfs":{"total":95995035648,"available":95965794304,"internally_reserved":0,"allocated":1564672,"data_stored":1091834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018947,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36216,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708936,"statfs":{"total":95995035648,"available":95957950464,"internally_reserved":0,"allocated":888832,"data_stored":435133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247880,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":901120,"data_stored":435449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476813,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":958464,"data_stored":497840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607634,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40444,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704708,"statfs":{"total":95995035648,"available":95953620992,"internally_reserved":0,"allocated":958464,"data_stored":497840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738454,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40376,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704776,"statfs":{"total":95995035648,"available":95953690624,"internally_reserved":0,"allocated":888832,"data_stored":435201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":536576,"data_stored":524920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":131782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":393820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":393798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":194523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T04:48:04.298 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-19T04:48:04.298 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T04:48:04.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.435+0000 7f25129b7640 1 -- 172.21.15.2:0/1592450459 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f250c102ca0 msgr2=0x7f250c103080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:04.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.435+0000 7f25129b7640 1 --2- 172.21.15.2:0/1592450459 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f250c102ca0 0x7f250c103080 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f24fc009900 tx=0x7f24fc02a480 comp rx=0 tx=0).stop 2024-09-19T04:48:04.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.435+0000 7f25129b7640 1 -- 172.21.15.2:0/1592450459 shutdown_connections 2024-09-19T04:48:04.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.435+0000 7f25129b7640 1 --2- 172.21.15.2:0/1592450459 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f250c10c0f0 0x7f250c10e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:04.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.435+0000 7f25129b7640 1 --2- 172.21.15.2:0/1592450459 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f250c1035c0 0x7f250c10baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:04.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.435+0000 7f25129b7640 1 --2- 172.21.15.2:0/1592450459 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f250c102ca0 0x7f250c103080 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:04.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.435+0000 7f25129b7640 1 -- 172.21.15.2:0/1592450459 >> 172.21.15.2:0/1592450459 conn(0x7f250c0fc6b0 msgr2=0x7f250c0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:04.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.435+0000 7f25129b7640 1 -- 172.21.15.2:0/1592450459 shutdown_connections 2024-09-19T04:48:04.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.435+0000 7f25129b7640 1 -- 172.21.15.2:0/1592450459 wait complete. 2024-09-19T04:48:04.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.436+0000 7f25129b7640 1 Processor -- start 2024-09-19T04:48:04.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.436+0000 7f25129b7640 1 -- start start 2024-09-19T04:48:04.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.436+0000 7f25129b7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f250c102ca0 0x7f250c198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:04.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.436+0000 7f25129b7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f250c1035c0 0x7f250c198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:04.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.436+0000 7f25129b7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f250c10c0f0 0x7f250c19cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:04.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.436+0000 7f25129b7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f250c111d80 con 0x7f250c10c0f0 2024-09-19T04:48:04.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.436+0000 7f25129b7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f250c111c00 con 0x7f250c1035c0 2024-09-19T04:48:04.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.436+0000 7f25129b7640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f250c111f00 con 0x7f250c102ca0 2024-09-19T04:48:04.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.437+0000 7f2510f54640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f250c10c0f0 0x7f250c19cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:04.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.437+0000 7f2510f54640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f250c10c0f0 0x7f250c19cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45426/0 (socket says 172.21.15.2:45426) 2024-09-19T04:48:04.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.437+0000 7f2510f54640 1 -- 172.21.15.2:0/4049096713 learned_addr learned my addr 172.21.15.2:0/4049096713 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:48:04.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.437+0000 7f250b7fe640 1 --2- 172.21.15.2:0/4049096713 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f250c1035c0 0x7f250c198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:04.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.437+0000 7f250bfff640 1 --2- 172.21.15.2:0/4049096713 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f250c102ca0 0x7f250c198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:04.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.437+0000 7f2510f54640 1 -- 172.21.15.2:0/4049096713 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f250c102ca0 msgr2=0x7f250c198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:04.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.437+0000 7f2510f54640 1 --2- 172.21.15.2:0/4049096713 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f250c102ca0 0x7f250c198350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:04.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.437+0000 7f2510f54640 1 -- 172.21.15.2:0/4049096713 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f250c1035c0 msgr2=0x7f250c198890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:04.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.437+0000 7f2510f54640 1 --2- 172.21.15.2:0/4049096713 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f250c1035c0 0x7f250c198890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:04.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.437+0000 7f2510f54640 1 -- 172.21.15.2:0/4049096713 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f250c19d340 con 0x7f250c10c0f0 2024-09-19T04:48:04.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.437+0000 7f2510f54640 1 --2- 172.21.15.2:0/4049096713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f250c10c0f0 0x7f250c19cc10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f250400eaa0 tx=0x7f250400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:04.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.437+0000 7f25097fa640 1 -- 172.21.15.2:0/4049096713 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f250400cdb0 con 0x7f250c10c0f0 2024-09-19T04:48:04.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.437+0000 7f25097fa640 1 -- 172.21.15.2:0/4049096713 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2504005020 con 0x7f250c10c0f0 2024-09-19T04:48:04.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.437+0000 7f25129b7640 1 -- 172.21.15.2:0/4049096713 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f250c19d630 con 0x7f250c10c0f0 2024-09-19T04:48:04.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.437+0000 7f25097fa640 1 -- 172.21.15.2:0/4049096713 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25040116d0 con 0x7f250c10c0f0 2024-09-19T04:48:04.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.437+0000 7f25129b7640 1 -- 172.21.15.2:0/4049096713 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f250c1a4ec0 con 0x7f250c10c0f0 2024-09-19T04:48:04.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.438+0000 7f25129b7640 1 -- 172.21.15.2:0/4049096713 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f250c103080 con 0x7f250c10c0f0 2024-09-19T04:48:04.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.440+0000 7f25097fa640 1 -- 172.21.15.2:0/4049096713 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138530+0+0 (secure 0 0 0) 0x7f25040051d0 con 0x7f250c10c0f0 2024-09-19T04:48:04.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.440+0000 7f25097fa640 1 --2- 172.21.15.2:0/4049096713 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f24f40a3450 0x7f24f40a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:04.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.440+0000 7f250bfff640 1 --2- 172.21.15.2:0/4049096713 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f24f40a3450 0x7f24f40a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:04.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.440+0000 7f25097fa640 1 -- 172.21.15.2:0/4049096713 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f25040d0030 con 0x7f250c10c0f0 2024-09-19T04:48:04.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.441+0000 7f250bfff640 1 --2- 172.21.15.2:0/4049096713 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f24f40a3450 0x7f24f40a5910 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f24fc006010 tx=0x7f24fc000bc0 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:04.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.444+0000 7f25097fa640 1 -- 172.21.15.2:0/4049096713 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2504016030 con 0x7f250c10c0f0 2024-09-19T04:48:04.609 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:04 smithi002 ceph-mon[30975]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:48:04.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:04 smithi002 ceph-mon[30975]: mgrmap e23: x(active, since 4s), standbys: y, z 2024-09-19T04:48:04.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:04 smithi002 ceph-mon[30975]: from='client.15186 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:48:04.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.617+0000 7f25129b7640 1 -- 172.21.15.2:0/4049096713 --> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f250c062630 con 0x7f24f40a3450 2024-09-19T04:48:04.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.623+0000 7f25097fa640 1 -- 172.21.15.2:0/4049096713 <== mgr.15096 v2:172.21.15.2:6800/852329670 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257781 (secure 0 0 0) 0x7f250c062630 con 0x7f24f40a3450 2024-09-19T04:48:04.629 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:48:04.630 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-19T04:48:04.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.626+0000 7f25129b7640 1 -- 172.21.15.2:0/4049096713 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f24f40a3450 msgr2=0x7f24f40a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:04.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.626+0000 7f25129b7640 1 --2- 172.21.15.2:0/4049096713 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f24f40a3450 0x7f24f40a5910 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f24fc006010 tx=0x7f24fc000bc0 comp rx=0 tx=0).stop 2024-09-19T04:48:04.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.626+0000 7f25129b7640 1 -- 172.21.15.2:0/4049096713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f250c10c0f0 msgr2=0x7f250c19cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:04.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.626+0000 7f25129b7640 1 --2- 172.21.15.2:0/4049096713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f250c10c0f0 0x7f250c19cc10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f250400eaa0 tx=0x7f250400ef60 comp rx=0 tx=0).stop 2024-09-19T04:48:04.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.626+0000 7f25129b7640 1 -- 172.21.15.2:0/4049096713 shutdown_connections 2024-09-19T04:48:04.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.626+0000 7f25129b7640 1 --2- 172.21.15.2:0/4049096713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f250c10c0f0 0x7f250c19cc10 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:04.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.626+0000 7f25129b7640 1 --2- 172.21.15.2:0/4049096713 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f250c1035c0 0x7f250c198890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:04.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.626+0000 7f25129b7640 1 --2- 172.21.15.2:0/4049096713 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f24f40a3450 0x7f24f40a5910 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:04.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.626+0000 7f25129b7640 1 --2- 172.21.15.2:0/4049096713 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f250c102ca0 0x7f250c198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:04.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.626+0000 7f25129b7640 1 -- 172.21.15.2:0/4049096713 >> 172.21.15.2:0/4049096713 conn(0x7f250c0fc6b0 msgr2=0x7f250c0fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:04.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.626+0000 7f25129b7640 1 -- 172.21.15.2:0/4049096713 shutdown_connections 2024-09-19T04:48:04.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:04.626+0000 7f25129b7640 1 -- 172.21.15.2:0/4049096713 wait complete. 2024-09-19T04:48:04.639 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-09-19T04:48:03.165032+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1178945,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":420,"num_read_kb":357,"num_write":378,"num_write_kb":4336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1180770,"num_keys_recovered":10,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":783,"ondisk_log_size":783,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":408100,"kb_used_data":12992,"kb_used_omap":18,"kb_used_meta":394797,"kb_avail":1124533724,"statfs":{"total":1151940427776,"available":1151522533376,"internally_reserved":0,"allocated":13303808,"data_stored":7774591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":404272442},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.995966"},"pg_stats":[{"pgid":"3.3f","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.192783+0000","last_change":"2024-09-19T04:46:23.520907+0000","last_active":"2024-09-19T04:47:59.192783+0000","last_peered":"2024-09-19T04:47:59.192783+0000","last_clean":"2024-09-19T04:47:59.192783+0000","last_became_active":"2024-09-19T04:46:23.519321+0000","last_became_peered":"2024-09-19T04:46:23.519321+0000","last_unstale":"2024-09-19T04:47:59.192783+0000","last_undegraded":"2024-09-19T04:47:59.192783+0000","last_fullsized":"2024-09-19T04:47:59.192783+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:31.529472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.200073+0000","last_change":"2024-09-19T04:46:23.515272+0000","last_active":"2024-09-19T04:47:59.200073+0000","last_peered":"2024-09-19T04:47:59.200073+0000","last_clean":"2024-09-19T04:47:59.200073+0000","last_became_active":"2024-09-19T04:46:23.514760+0000","last_became_peered":"2024-09-19T04:46:23.514760+0000","last_unstale":"2024-09-19T04:47:59.200073+0000","last_undegraded":"2024-09-19T04:47:59.200073+0000","last_fullsized":"2024-09-19T04:47:59.200073+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:32.215940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.195688+0000","last_change":"2024-09-19T04:46:23.516809+0000","last_active":"2024-09-19T04:47:59.195688+0000","last_peered":"2024-09-19T04:47:59.195688+0000","last_clean":"2024-09-19T04:47:59.195688+0000","last_became_active":"2024-09-19T04:46:23.516489+0000","last_became_peered":"2024-09-19T04:46:23.516489+0000","last_unstale":"2024-09-19T04:47:59.195688+0000","last_undegraded":"2024-09-19T04:47:59.195688+0000","last_fullsized":"2024-09-19T04:47:59.195688+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:17:51.183061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.178331+0000","last_change":"2024-09-19T04:46:23.506868+0000","last_active":"2024-09-19T04:47:59.178331+0000","last_peered":"2024-09-19T04:47:59.178331+0000","last_clean":"2024-09-19T04:47:59.178331+0000","last_became_active":"2024-09-19T04:46:23.506489+0000","last_became_peered":"2024-09-19T04:46:23.506489+0000","last_unstale":"2024-09-19T04:47:59.178331+0000","last_undegraded":"2024-09-19T04:47:59.178331+0000","last_fullsized":"2024-09-19T04:47:59.178331+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:22.749973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.188617+0000","last_change":"2024-09-19T04:46:23.506733+0000","last_active":"2024-09-19T04:47:59.188617+0000","last_peered":"2024-09-19T04:47:59.188617+0000","last_clean":"2024-09-19T04:47:59.188617+0000","last_became_active":"2024-09-19T04:46:23.506408+0000","last_became_peered":"2024-09-19T04:46:23.506408+0000","last_unstale":"2024-09-19T04:47:59.188617+0000","last_undegraded":"2024-09-19T04:47:59.188617+0000","last_fullsized":"2024-09-19T04:47:59.188617+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:45:31.821607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.190602+0000","last_change":"2024-09-19T04:46:23.523109+0000","last_active":"2024-09-19T04:47:59.190602+0000","last_peered":"2024-09-19T04:47:59.190602+0000","last_clean":"2024-09-19T04:47:59.190602+0000","last_became_active":"2024-09-19T04:46:23.522783+0000","last_became_peered":"2024-09-19T04:46:23.522783+0000","last_unstale":"2024-09-19T04:47:59.190602+0000","last_undegraded":"2024-09-19T04:47:59.190602+0000","last_fullsized":"2024-09-19T04:47:59.190602+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:34:47.622562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.191408+0000","last_change":"2024-09-19T04:46:23.518297+0000","last_active":"2024-09-19T04:47:59.191408+0000","last_peered":"2024-09-19T04:47:59.191408+0000","last_clean":"2024-09-19T04:47:59.191408+0000","last_became_active":"2024-09-19T04:46:23.517974+0000","last_became_peered":"2024-09-19T04:46:23.517974+0000","last_unstale":"2024-09-19T04:47:59.191408+0000","last_undegraded":"2024-09-19T04:47:59.191408+0000","last_fullsized":"2024-09-19T04:47:59.191408+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:23:26.474961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.194736+0000","last_change":"2024-09-19T04:46:23.516255+0000","last_active":"2024-09-19T04:47:59.194736+0000","last_peered":"2024-09-19T04:47:59.194736+0000","last_clean":"2024-09-19T04:47:59.194736+0000","last_became_active":"2024-09-19T04:46:23.515861+0000","last_became_peered":"2024-09-19T04:46:23.515861+0000","last_unstale":"2024-09-19T04:47:59.194736+0000","last_undegraded":"2024-09-19T04:47:59.194736+0000","last_fullsized":"2024-09-19T04:47:59.194736+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:08:19.747905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.191238+0000","last_change":"2024-09-19T04:46:23.520947+0000","last_active":"2024-09-19T04:47:59.191238+0000","last_peered":"2024-09-19T04:47:59.191238+0000","last_clean":"2024-09-19T04:47:59.191238+0000","last_became_active":"2024-09-19T04:46:23.518463+0000","last_became_peered":"2024-09-19T04:46:23.518463+0000","last_unstale":"2024-09-19T04:47:59.191238+0000","last_undegraded":"2024-09-19T04:47:59.191238+0000","last_fullsized":"2024-09-19T04:47:59.191238+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:00.420868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.179165+0000","last_change":"2024-09-19T04:46:23.524145+0000","last_active":"2024-09-19T04:47:59.179165+0000","last_peered":"2024-09-19T04:47:59.179165+0000","last_clean":"2024-09-19T04:47:59.179165+0000","last_became_active":"2024-09-19T04:46:23.523698+0000","last_became_peered":"2024-09-19T04:46:23.523698+0000","last_unstale":"2024-09-19T04:47:59.179165+0000","last_undegraded":"2024-09-19T04:47:59.179165+0000","last_fullsized":"2024-09-19T04:47:59.179165+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:41.370871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.191896+0000","last_change":"2024-09-19T04:46:23.521782+0000","last_active":"2024-09-19T04:47:59.191896+0000","last_peered":"2024-09-19T04:47:59.191896+0000","last_clean":"2024-09-19T04:47:59.191896+0000","last_became_active":"2024-09-19T04:46:23.521452+0000","last_became_peered":"2024-09-19T04:46:23.521452+0000","last_unstale":"2024-09-19T04:47:59.191896+0000","last_undegraded":"2024-09-19T04:47:59.191896+0000","last_fullsized":"2024-09-19T04:47:59.191896+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:11:35.047064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.176831+0000","last_change":"2024-09-19T04:46:23.518174+0000","last_active":"2024-09-19T04:47:59.176831+0000","last_peered":"2024-09-19T04:47:59.176831+0000","last_clean":"2024-09-19T04:47:59.176831+0000","last_became_active":"2024-09-19T04:46:23.516507+0000","last_became_peered":"2024-09-19T04:46:23.516507+0000","last_unstale":"2024-09-19T04:47:59.176831+0000","last_undegraded":"2024-09-19T04:47:59.176831+0000","last_fullsized":"2024-09-19T04:47:59.176831+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:37.878245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.200586+0000","last_change":"2024-09-19T04:46:23.510582+0000","last_active":"2024-09-19T04:47:59.200586+0000","last_peered":"2024-09-19T04:47:59.200586+0000","last_clean":"2024-09-19T04:47:59.200586+0000","last_became_active":"2024-09-19T04:46:23.510135+0000","last_became_peered":"2024-09-19T04:46:23.510135+0000","last_unstale":"2024-09-19T04:47:59.200586+0000","last_undegraded":"2024-09-19T04:47:59.200586+0000","last_fullsized":"2024-09-19T04:47:59.200586+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:09.721696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.200294+0000","last_change":"2024-09-19T04:46:23.517963+0000","last_active":"2024-09-19T04:47:59.200294+0000","last_peered":"2024-09-19T04:47:59.200294+0000","last_clean":"2024-09-19T04:47:59.200294+0000","last_became_active":"2024-09-19T04:46:23.517574+0000","last_became_peered":"2024-09-19T04:46:23.517574+0000","last_unstale":"2024-09-19T04:47:59.200294+0000","last_undegraded":"2024-09-19T04:47:59.200294+0000","last_fullsized":"2024-09-19T04:47:59.200294+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:48:44.494267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.198957+0000","last_change":"2024-09-19T04:46:23.517318+0000","last_active":"2024-09-19T04:47:59.198957+0000","last_peered":"2024-09-19T04:47:59.198957+0000","last_clean":"2024-09-19T04:47:59.198957+0000","last_became_active":"2024-09-19T04:46:23.516973+0000","last_became_peered":"2024-09-19T04:46:23.516973+0000","last_unstale":"2024-09-19T04:47:59.198957+0000","last_undegraded":"2024-09-19T04:47:59.198957+0000","last_fullsized":"2024-09-19T04:47:59.198957+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:46:28.907400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.193578+0000","last_change":"2024-09-19T04:46:23.517468+0000","last_active":"2024-09-19T04:47:59.193578+0000","last_peered":"2024-09-19T04:47:59.193578+0000","last_clean":"2024-09-19T04:47:59.193578+0000","last_became_active":"2024-09-19T04:46:23.517093+0000","last_became_peered":"2024-09-19T04:46:23.517093+0000","last_unstale":"2024-09-19T04:47:59.193578+0000","last_undegraded":"2024-09-19T04:47:59.193578+0000","last_fullsized":"2024-09-19T04:47:59.193578+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:43.435560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.192587+0000","last_change":"2024-09-19T04:46:23.521679+0000","last_active":"2024-09-19T04:47:59.192587+0000","last_peered":"2024-09-19T04:47:59.192587+0000","last_clean":"2024-09-19T04:47:59.192587+0000","last_became_active":"2024-09-19T04:46:23.519346+0000","last_became_peered":"2024-09-19T04:46:23.519346+0000","last_unstale":"2024-09-19T04:47:59.192587+0000","last_undegraded":"2024-09-19T04:47:59.192587+0000","last_fullsized":"2024-09-19T04:47:59.192587+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:31.740226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.187745+0000","last_change":"2024-09-19T04:46:23.517518+0000","last_active":"2024-09-19T04:47:59.187745+0000","last_peered":"2024-09-19T04:47:59.187745+0000","last_clean":"2024-09-19T04:47:59.187745+0000","last_became_active":"2024-09-19T04:46:23.517179+0000","last_became_peered":"2024-09-19T04:46:23.517179+0000","last_unstale":"2024-09-19T04:47:59.187745+0000","last_undegraded":"2024-09-19T04:47:59.187745+0000","last_fullsized":"2024-09-19T04:47:59.187745+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:38.352433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.200230+0000","last_change":"2024-09-19T04:46:23.506618+0000","last_active":"2024-09-19T04:47:59.200230+0000","last_peered":"2024-09-19T04:47:59.200230+0000","last_clean":"2024-09-19T04:47:59.200230+0000","last_became_active":"2024-09-19T04:46:23.506276+0000","last_became_peered":"2024-09-19T04:46:23.506276+0000","last_unstale":"2024-09-19T04:47:59.200230+0000","last_undegraded":"2024-09-19T04:47:59.200230+0000","last_fullsized":"2024-09-19T04:47:59.200230+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:02:42.216717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.181611+0000","last_change":"2024-09-19T04:46:23.518793+0000","last_active":"2024-09-19T04:47:59.181611+0000","last_peered":"2024-09-19T04:47:59.181611+0000","last_clean":"2024-09-19T04:47:59.181611+0000","last_became_active":"2024-09-19T04:46:23.518386+0000","last_became_peered":"2024-09-19T04:46:23.518386+0000","last_unstale":"2024-09-19T04:47:59.181611+0000","last_undegraded":"2024-09-19T04:47:59.181611+0000","last_fullsized":"2024-09-19T04:47:59.181611+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:08:12.007678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.201240+0000","last_change":"2024-09-19T04:46:23.513022+0000","last_active":"2024-09-19T04:47:59.201240+0000","last_peered":"2024-09-19T04:47:59.201240+0000","last_clean":"2024-09-19T04:47:59.201240+0000","last_became_active":"2024-09-19T04:46:23.512541+0000","last_became_peered":"2024-09-19T04:46:23.512541+0000","last_unstale":"2024-09-19T04:47:59.201240+0000","last_undegraded":"2024-09-19T04:47:59.201240+0000","last_fullsized":"2024-09-19T04:47:59.201240+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:19.873546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.198798+0000","last_change":"2024-09-19T04:46:23.519523+0000","last_active":"2024-09-19T04:47:59.198798+0000","last_peered":"2024-09-19T04:47:59.198798+0000","last_clean":"2024-09-19T04:47:59.198798+0000","last_became_active":"2024-09-19T04:46:23.517995+0000","last_became_peered":"2024-09-19T04:46:23.517995+0000","last_unstale":"2024-09-19T04:47:59.198798+0000","last_undegraded":"2024-09-19T04:47:59.198798+0000","last_fullsized":"2024-09-19T04:47:59.198798+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:23.243522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.197448+0000","last_change":"2024-09-19T04:46:23.517564+0000","last_active":"2024-09-19T04:47:59.197448+0000","last_peered":"2024-09-19T04:47:59.197448+0000","last_clean":"2024-09-19T04:47:59.197448+0000","last_became_active":"2024-09-19T04:46:23.517248+0000","last_became_peered":"2024-09-19T04:46:23.517248+0000","last_unstale":"2024-09-19T04:47:59.197448+0000","last_undegraded":"2024-09-19T04:47:59.197448+0000","last_fullsized":"2024-09-19T04:47:59.197448+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:19.369346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.195030+0000","last_change":"2024-09-19T04:46:23.514150+0000","last_active":"2024-09-19T04:47:59.195030+0000","last_peered":"2024-09-19T04:47:59.195030+0000","last_clean":"2024-09-19T04:47:59.195030+0000","last_became_active":"2024-09-19T04:46:23.512169+0000","last_became_peered":"2024-09-19T04:46:23.512169+0000","last_unstale":"2024-09-19T04:47:59.195030+0000","last_undegraded":"2024-09-19T04:47:59.195030+0000","last_fullsized":"2024-09-19T04:47:59.195030+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:17.475389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.179284+0000","last_change":"2024-09-19T04:46:36.814692+0000","last_active":"2024-09-19T04:47:59.179284+0000","last_peered":"2024-09-19T04:47:59.179284+0000","last_clean":"2024-09-19T04:47:59.179284+0000","last_became_active":"2024-09-19T04:46:36.814429+0000","last_became_peered":"2024-09-19T04:46:36.814429+0000","last_unstale":"2024-09-19T04:47:59.179284+0000","last_undegraded":"2024-09-19T04:47:59.179284+0000","last_fullsized":"2024-09-19T04:47:59.179284+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:10:42.391448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.185392+0000","last_change":"2024-09-19T04:46:23.519273+0000","last_active":"2024-09-19T04:47:59.185392+0000","last_peered":"2024-09-19T04:47:59.185392+0000","last_clean":"2024-09-19T04:47:59.185392+0000","last_became_active":"2024-09-19T04:46:23.519001+0000","last_became_peered":"2024-09-19T04:46:23.519001+0000","last_unstale":"2024-09-19T04:47:59.185392+0000","last_undegraded":"2024-09-19T04:47:59.185392+0000","last_fullsized":"2024-09-19T04:47:59.185392+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:15:30.949066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.184874+0000","last_change":"2024-09-19T04:46:23.520888+0000","last_active":"2024-09-19T04:47:59.184874+0000","last_peered":"2024-09-19T04:47:59.184874+0000","last_clean":"2024-09-19T04:47:59.184874+0000","last_became_active":"2024-09-19T04:46:23.519476+0000","last_became_peered":"2024-09-19T04:46:23.519476+0000","last_unstale":"2024-09-19T04:47:59.184874+0000","last_undegraded":"2024-09-19T04:47:59.184874+0000","last_fullsized":"2024-09-19T04:47:59.184874+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:56.459724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.200464+0000","last_change":"2024-09-19T04:46:23.512152+0000","last_active":"2024-09-19T04:47:59.200464+0000","last_peered":"2024-09-19T04:47:59.200464+0000","last_clean":"2024-09-19T04:47:59.200464+0000","last_became_active":"2024-09-19T04:46:23.511784+0000","last_became_peered":"2024-09-19T04:46:23.511784+0000","last_unstale":"2024-09-19T04:47:59.200464+0000","last_undegraded":"2024-09-19T04:47:59.200464+0000","last_fullsized":"2024-09-19T04:47:59.200464+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:01:23.406580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.201261+0000","last_change":"2024-09-19T04:46:23.522491+0000","last_active":"2024-09-19T04:47:59.201261+0000","last_peered":"2024-09-19T04:47:59.201261+0000","last_clean":"2024-09-19T04:47:59.201261+0000","last_became_active":"2024-09-19T04:46:23.522025+0000","last_became_peered":"2024-09-19T04:46:23.522025+0000","last_unstale":"2024-09-19T04:47:59.201261+0000","last_undegraded":"2024-09-19T04:47:59.201261+0000","last_fullsized":"2024-09-19T04:47:59.201261+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:33.063300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.193481+0000","last_change":"2024-09-19T04:46:23.510057+0000","last_active":"2024-09-19T04:47:59.193481+0000","last_peered":"2024-09-19T04:47:59.193481+0000","last_clean":"2024-09-19T04:47:59.193481+0000","last_became_active":"2024-09-19T04:46:23.509691+0000","last_became_peered":"2024-09-19T04:46:23.509691+0000","last_unstale":"2024-09-19T04:47:59.193481+0000","last_undegraded":"2024-09-19T04:47:59.193481+0000","last_fullsized":"2024-09-19T04:47:59.193481+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:12:16.579944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.181233+0000","last_change":"2024-09-19T04:46:23.516876+0000","last_active":"2024-09-19T04:47:59.181233+0000","last_peered":"2024-09-19T04:47:59.181233+0000","last_clean":"2024-09-19T04:47:59.181233+0000","last_became_active":"2024-09-19T04:46:23.516533+0000","last_became_peered":"2024-09-19T04:46:23.516533+0000","last_unstale":"2024-09-19T04:47:59.181233+0000","last_undegraded":"2024-09-19T04:47:59.181233+0000","last_fullsized":"2024-09-19T04:47:59.181233+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:44.868936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.185917+0000","last_change":"2024-09-19T04:46:23.517607+0000","last_active":"2024-09-19T04:47:59.185917+0000","last_peered":"2024-09-19T04:47:59.185917+0000","last_clean":"2024-09-19T04:47:59.185917+0000","last_became_active":"2024-09-19T04:46:23.517289+0000","last_became_peered":"2024-09-19T04:46:23.517289+0000","last_unstale":"2024-09-19T04:47:59.185917+0000","last_undegraded":"2024-09-19T04:47:59.185917+0000","last_fullsized":"2024-09-19T04:47:59.185917+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:08:22.882886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.185070+0000","last_change":"2024-09-19T04:46:23.507713+0000","last_active":"2024-09-19T04:47:59.185070+0000","last_peered":"2024-09-19T04:47:59.185070+0000","last_clean":"2024-09-19T04:47:59.185070+0000","last_became_active":"2024-09-19T04:46:23.507350+0000","last_became_peered":"2024-09-19T04:46:23.507350+0000","last_unstale":"2024-09-19T04:47:59.185070+0000","last_undegraded":"2024-09-19T04:47:59.185070+0000","last_fullsized":"2024-09-19T04:47:59.185070+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:07:27.119097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.167495+0000","last_change":"2024-09-19T04:46:21.495958+0000","last_active":"2024-09-19T04:47:59.167495+0000","last_peered":"2024-09-19T04:47:59.167495+0000","last_clean":"2024-09-19T04:47:59.167495+0000","last_became_active":"2024-09-19T04:46:21.495562+0000","last_became_peered":"2024-09-19T04:46:21.495562+0000","last_unstale":"2024-09-19T04:47:59.167495+0000","last_undegraded":"2024-09-19T04:47:59.167495+0000","last_fullsized":"2024-09-19T04:47:59.167495+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:19:02.935893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.189671+0000","last_change":"2024-09-19T04:46:23.524151+0000","last_active":"2024-09-19T04:47:59.189671+0000","last_peered":"2024-09-19T04:47:59.189671+0000","last_clean":"2024-09-19T04:47:59.189671+0000","last_became_active":"2024-09-19T04:46:23.523795+0000","last_became_peered":"2024-09-19T04:46:23.523795+0000","last_unstale":"2024-09-19T04:47:59.189671+0000","last_undegraded":"2024-09-19T04:47:59.189671+0000","last_fullsized":"2024-09-19T04:47:59.189671+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:27.234766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.147123+0000","last_change":"2024-09-19T04:46:21.485072+0000","last_active":"2024-09-19T04:47:59.147123+0000","last_peered":"2024-09-19T04:47:59.147123+0000","last_clean":"2024-09-19T04:47:59.147123+0000","last_became_active":"2024-09-19T04:46:21.482727+0000","last_became_peered":"2024-09-19T04:46:21.482727+0000","last_unstale":"2024-09-19T04:47:59.147123+0000","last_undegraded":"2024-09-19T04:47:59.147123+0000","last_fullsized":"2024-09-19T04:47:59.147123+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:23.231570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.145676+0000","last_change":"2024-09-19T04:46:21.488537+0000","last_active":"2024-09-19T04:47:59.145676+0000","last_peered":"2024-09-19T04:47:59.145676+0000","last_clean":"2024-09-19T04:47:59.145676+0000","last_became_active":"2024-09-19T04:46:21.488176+0000","last_became_peered":"2024-09-19T04:46:21.488176+0000","last_unstale":"2024-09-19T04:47:59.145676+0000","last_undegraded":"2024-09-19T04:47:59.145676+0000","last_fullsized":"2024-09-19T04:47:59.145676+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:14.355956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.198415+0000","last_change":"2024-09-19T04:46:23.518619+0000","last_active":"2024-09-19T04:47:59.198415+0000","last_peered":"2024-09-19T04:47:59.198415+0000","last_clean":"2024-09-19T04:47:59.198415+0000","last_became_active":"2024-09-19T04:46:23.518313+0000","last_became_peered":"2024-09-19T04:46:23.518313+0000","last_unstale":"2024-09-19T04:47:59.198415+0000","last_undegraded":"2024-09-19T04:47:59.198415+0000","last_fullsized":"2024-09-19T04:47:59.198415+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:08:25.958935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.162195+0000","last_change":"2024-09-19T04:46:21.493873+0000","last_active":"2024-09-19T04:47:59.162195+0000","last_peered":"2024-09-19T04:47:59.162195+0000","last_clean":"2024-09-19T04:47:59.162195+0000","last_became_active":"2024-09-19T04:46:21.493447+0000","last_became_peered":"2024-09-19T04:46:21.493447+0000","last_unstale":"2024-09-19T04:47:59.162195+0000","last_undegraded":"2024-09-19T04:47:59.162195+0000","last_fullsized":"2024-09-19T04:47:59.162195+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:29.504001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.188563+0000","last_change":"2024-09-19T04:46:23.508247+0000","last_active":"2024-09-19T04:47:59.188563+0000","last_peered":"2024-09-19T04:47:59.188563+0000","last_clean":"2024-09-19T04:47:59.188563+0000","last_became_active":"2024-09-19T04:46:23.507936+0000","last_became_peered":"2024-09-19T04:46:23.507936+0000","last_unstale":"2024-09-19T04:47:59.188563+0000","last_undegraded":"2024-09-19T04:47:59.188563+0000","last_fullsized":"2024-09-19T04:47:59.188563+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:25:09.864664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.147589+0000","last_change":"2024-09-19T04:46:21.487636+0000","last_active":"2024-09-19T04:47:59.147589+0000","last_peered":"2024-09-19T04:47:59.147589+0000","last_clean":"2024-09-19T04:47:59.147589+0000","last_became_active":"2024-09-19T04:46:21.487162+0000","last_became_peered":"2024-09-19T04:46:21.487162+0000","last_unstale":"2024-09-19T04:47:59.147589+0000","last_undegraded":"2024-09-19T04:47:59.147589+0000","last_fullsized":"2024-09-19T04:47:59.147589+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:03:04.833769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.191093+0000","last_change":"2024-09-19T04:46:23.515047+0000","last_active":"2024-09-19T04:47:59.191093+0000","last_peered":"2024-09-19T04:47:59.191093+0000","last_clean":"2024-09-19T04:47:59.191093+0000","last_became_active":"2024-09-19T04:46:23.514607+0000","last_became_peered":"2024-09-19T04:46:23.514607+0000","last_unstale":"2024-09-19T04:47:59.191093+0000","last_undegraded":"2024-09-19T04:47:59.191093+0000","last_fullsized":"2024-09-19T04:47:59.191093+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:05:03.076568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.161276+0000","last_change":"2024-09-19T04:46:21.493732+0000","last_active":"2024-09-19T04:47:59.161276+0000","last_peered":"2024-09-19T04:47:59.161276+0000","last_clean":"2024-09-19T04:47:59.161276+0000","last_became_active":"2024-09-19T04:46:21.493069+0000","last_became_peered":"2024-09-19T04:46:21.493069+0000","last_unstale":"2024-09-19T04:47:59.161276+0000","last_undegraded":"2024-09-19T04:47:59.161276+0000","last_fullsized":"2024-09-19T04:47:59.161276+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:17.709419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.202047+0000","last_change":"2024-09-19T04:46:23.516530+0000","last_active":"2024-09-19T04:47:59.202047+0000","last_peered":"2024-09-19T04:47:59.202047+0000","last_clean":"2024-09-19T04:47:59.202047+0000","last_became_active":"2024-09-19T04:46:23.515816+0000","last_became_peered":"2024-09-19T04:46:23.515816+0000","last_unstale":"2024-09-19T04:47:59.202047+0000","last_undegraded":"2024-09-19T04:47:59.202047+0000","last_fullsized":"2024-09-19T04:47:59.202047+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:56:19.162009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.170650+0000","last_change":"2024-09-19T04:46:21.573930+0000","last_active":"2024-09-19T04:47:59.170650+0000","last_peered":"2024-09-19T04:47:59.170650+0000","last_clean":"2024-09-19T04:47:59.170650+0000","last_became_active":"2024-09-19T04:46:21.573579+0000","last_became_peered":"2024-09-19T04:46:21.573579+0000","last_unstale":"2024-09-19T04:47:59.170650+0000","last_undegraded":"2024-09-19T04:47:59.170650+0000","last_fullsized":"2024-09-19T04:47:59.170650+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:29.472481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.177548+0000","last_change":"2024-09-19T04:46:23.520569+0000","last_active":"2024-09-19T04:47:59.177548+0000","last_peered":"2024-09-19T04:47:59.177548+0000","last_clean":"2024-09-19T04:47:59.177548+0000","last_became_active":"2024-09-19T04:46:23.519894+0000","last_became_peered":"2024-09-19T04:46:23.519894+0000","last_unstale":"2024-09-19T04:47:59.177548+0000","last_undegraded":"2024-09-19T04:47:59.177548+0000","last_fullsized":"2024-09-19T04:47:59.177548+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:20.823559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'31","reported_seq":242,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.673982+0000","last_change":"2024-09-19T04:46:21.491853+0000","last_active":"2024-09-19T04:47:59.673982+0000","last_peered":"2024-09-19T04:47:59.673982+0000","last_clean":"2024-09-19T04:47:59.673982+0000","last_became_active":"2024-09-19T04:46:21.491499+0000","last_became_peered":"2024-09-19T04:46:21.491499+0000","last_unstale":"2024-09-19T04:47:59.673982+0000","last_undegraded":"2024-09-19T04:47:59.673982+0000","last_fullsized":"2024-09-19T04:47:59.673982+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:15.372001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62729,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":187,"num_read_kb":154,"num_write":31,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.186710+0000","last_change":"2024-09-19T04:46:23.516781+0000","last_active":"2024-09-19T04:47:59.186710+0000","last_peered":"2024-09-19T04:47:59.186710+0000","last_clean":"2024-09-19T04:47:59.186710+0000","last_became_active":"2024-09-19T04:46:23.515928+0000","last_became_peered":"2024-09-19T04:46:23.515928+0000","last_unstale":"2024-09-19T04:47:59.186710+0000","last_undegraded":"2024-09-19T04:47:59.186710+0000","last_fullsized":"2024-09-19T04:47:59.186710+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:31.319072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'2","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.157318+0000","last_change":"2024-09-19T04:46:36.576395+0000","last_active":"2024-09-19T04:47:59.157318+0000","last_peered":"2024-09-19T04:47:59.157318+0000","last_clean":"2024-09-19T04:47:59.157318+0000","last_became_active":"2024-09-19T04:46:36.567213+0000","last_became_peered":"2024-09-19T04:46:36.567213+0000","last_unstale":"2024-09-19T04:47:59.157318+0000","last_undegraded":"2024-09-19T04:47:59.157318+0000","last_fullsized":"2024-09-19T04:47:59.157318+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:26.802224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.199243+0000","last_change":"2024-09-19T04:46:23.512736+0000","last_active":"2024-09-19T04:47:59.199243+0000","last_peered":"2024-09-19T04:47:59.199243+0000","last_clean":"2024-09-19T04:47:59.199243+0000","last_became_active":"2024-09-19T04:46:23.512399+0000","last_became_peered":"2024-09-19T04:46:23.512399+0000","last_unstale":"2024-09-19T04:47:59.199243+0000","last_undegraded":"2024-09-19T04:47:59.199243+0000","last_fullsized":"2024-09-19T04:47:59.199243+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:54:28.607512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.167311+0000","last_change":"2024-09-19T04:46:21.495421+0000","last_active":"2024-09-19T04:47:59.167311+0000","last_peered":"2024-09-19T04:47:59.167311+0000","last_clean":"2024-09-19T04:47:59.167311+0000","last_became_active":"2024-09-19T04:46:21.495004+0000","last_became_peered":"2024-09-19T04:46:21.495004+0000","last_unstale":"2024-09-19T04:47:59.167311+0000","last_undegraded":"2024-09-19T04:47:59.167311+0000","last_fullsized":"2024-09-19T04:47:59.167311+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:11.038118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"81'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.200971+0000","last_change":"2024-09-19T04:46:23.519462+0000","last_active":"2024-09-19T04:47:59.200971+0000","last_peered":"2024-09-19T04:47:59.200971+0000","last_clean":"2024-09-19T04:47:59.200971+0000","last_became_active":"2024-09-19T04:46:23.519121+0000","last_became_peered":"2024-09-19T04:46:23.519121+0000","last_unstale":"2024-09-19T04:47:59.200971+0000","last_undegraded":"2024-09-19T04:47:59.200971+0000","last_fullsized":"2024-09-19T04:47:59.200971+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:19.643433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.155240+0000","last_change":"2024-09-19T04:46:21.496243+0000","last_active":"2024-09-19T04:47:59.155240+0000","last_peered":"2024-09-19T04:47:59.155240+0000","last_clean":"2024-09-19T04:47:59.155240+0000","last_became_active":"2024-09-19T04:46:21.495821+0000","last_became_peered":"2024-09-19T04:46:21.495821+0000","last_unstale":"2024-09-19T04:47:59.155240+0000","last_undegraded":"2024-09-19T04:47:59.155240+0000","last_fullsized":"2024-09-19T04:47:59.155240+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:35:02.729538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"81'6","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.189779+0000","last_change":"2024-09-19T04:46:36.570404+0000","last_active":"2024-09-19T04:47:59.189779+0000","last_peered":"2024-09-19T04:47:59.189779+0000","last_clean":"2024-09-19T04:47:59.189779+0000","last_became_active":"2024-09-19T04:46:36.569898+0000","last_became_peered":"2024-09-19T04:46:36.569898+0000","last_unstale":"2024-09-19T04:47:59.189779+0000","last_undegraded":"2024-09-19T04:47:59.189779+0000","last_fullsized":"2024-09-19T04:47:59.189779+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:20:47.441702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'8","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.156443+0000","last_change":"2024-09-19T04:46:21.572642+0000","last_active":"2024-09-19T04:47:59.156443+0000","last_peered":"2024-09-19T04:47:59.156443+0000","last_clean":"2024-09-19T04:47:59.156443+0000","last_became_active":"2024-09-19T04:46:21.571823+0000","last_became_peered":"2024-09-19T04:46:21.571823+0000","last_unstale":"2024-09-19T04:47:59.156443+0000","last_undegraded":"2024-09-19T04:47:59.156443+0000","last_fullsized":"2024-09-19T04:47:59.156443+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:28.956744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.190799+0000","last_change":"2024-09-19T04:46:23.524169+0000","last_active":"2024-09-19T04:47:59.190799+0000","last_peered":"2024-09-19T04:47:59.190799+0000","last_clean":"2024-09-19T04:47:59.190799+0000","last_became_active":"2024-09-19T04:46:23.523869+0000","last_became_peered":"2024-09-19T04:46:23.523869+0000","last_unstale":"2024-09-19T04:47:59.190799+0000","last_undegraded":"2024-09-19T04:47:59.190799+0000","last_fullsized":"2024-09-19T04:47:59.190799+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:46.131143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'1","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.157561+0000","last_change":"2024-09-19T04:46:21.490154+0000","last_active":"2024-09-19T04:47:59.157561+0000","last_peered":"2024-09-19T04:47:59.157561+0000","last_clean":"2024-09-19T04:47:59.157561+0000","last_became_active":"2024-09-19T04:46:21.489820+0000","last_became_peered":"2024-09-19T04:46:21.489820+0000","last_unstale":"2024-09-19T04:47:59.157561+0000","last_undegraded":"2024-09-19T04:47:59.157561+0000","last_fullsized":"2024-09-19T04:47:59.157561+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:34:27.446664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.184035+0000","last_change":"2024-09-19T04:46:23.518712+0000","last_active":"2024-09-19T04:47:59.184035+0000","last_peered":"2024-09-19T04:47:59.184035+0000","last_clean":"2024-09-19T04:47:59.184035+0000","last_became_active":"2024-09-19T04:46:23.518408+0000","last_became_peered":"2024-09-19T04:46:23.518408+0000","last_unstale":"2024-09-19T04:47:59.184035+0000","last_undegraded":"2024-09-19T04:47:59.184035+0000","last_fullsized":"2024-09-19T04:47:59.184035+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:45:17.398334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.145916+0000","last_change":"2024-09-19T04:46:21.487789+0000","last_active":"2024-09-19T04:47:59.145916+0000","last_peered":"2024-09-19T04:47:59.145916+0000","last_clean":"2024-09-19T04:47:59.145916+0000","last_became_active":"2024-09-19T04:46:21.487411+0000","last_became_peered":"2024-09-19T04:46:21.487411+0000","last_unstale":"2024-09-19T04:47:59.145916+0000","last_undegraded":"2024-09-19T04:47:59.145916+0000","last_fullsized":"2024-09-19T04:47:59.145916+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:25.353345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.189636+0000","last_change":"2024-09-19T04:46:23.515432+0000","last_active":"2024-09-19T04:47:59.189636+0000","last_peered":"2024-09-19T04:47:59.189636+0000","last_clean":"2024-09-19T04:47:59.189636+0000","last_became_active":"2024-09-19T04:46:23.515071+0000","last_became_peered":"2024-09-19T04:46:23.515071+0000","last_unstale":"2024-09-19T04:47:59.189636+0000","last_undegraded":"2024-09-19T04:47:59.189636+0000","last_fullsized":"2024-09-19T04:47:59.189636+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:56:04.743652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'39","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.370929+0000","last_change":"2024-09-19T04:46:21.487856+0000","last_active":"2024-09-19T04:47:59.370929+0000","last_peered":"2024-09-19T04:47:59.370929+0000","last_clean":"2024-09-19T04:47:59.370929+0000","last_became_active":"2024-09-19T04:46:21.487342+0000","last_became_peered":"2024-09-19T04:46:21.487342+0000","last_unstale":"2024-09-19T04:47:59.370929+0000","last_undegraded":"2024-09-19T04:47:59.370929+0000","last_fullsized":"2024-09-19T04:47:59.370929+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:29.275296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.190880+0000","last_change":"2024-09-19T04:46:23.517250+0000","last_active":"2024-09-19T04:47:59.190880+0000","last_peered":"2024-09-19T04:47:59.190880+0000","last_clean":"2024-09-19T04:47:59.190880+0000","last_became_active":"2024-09-19T04:46:23.516895+0000","last_became_peered":"2024-09-19T04:46:23.516895+0000","last_unstale":"2024-09-19T04:47:59.190880+0000","last_undegraded":"2024-09-19T04:47:59.190880+0000","last_fullsized":"2024-09-19T04:47:59.190880+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:51.982348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.147446+0000","last_change":"2024-09-19T04:46:21.572452+0000","last_active":"2024-09-19T04:47:59.147446+0000","last_peered":"2024-09-19T04:47:59.147446+0000","last_clean":"2024-09-19T04:47:59.147446+0000","last_became_active":"2024-09-19T04:46:21.572026+0000","last_became_peered":"2024-09-19T04:46:21.572026+0000","last_unstale":"2024-09-19T04:47:59.147446+0000","last_undegraded":"2024-09-19T04:47:59.147446+0000","last_fullsized":"2024-09-19T04:47:59.147446+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:07.859604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.192079+0000","last_change":"2024-09-19T04:46:23.523549+0000","last_active":"2024-09-19T04:47:59.192079+0000","last_peered":"2024-09-19T04:47:59.192079+0000","last_clean":"2024-09-19T04:47:59.192079+0000","last_became_active":"2024-09-19T04:46:23.522581+0000","last_became_peered":"2024-09-19T04:46:23.522581+0000","last_unstale":"2024-09-19T04:47:59.192079+0000","last_undegraded":"2024-09-19T04:47:59.192079+0000","last_fullsized":"2024-09-19T04:47:59.192079+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:51:33.504024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":343,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.159617+0000","last_change":"2024-09-19T04:45:12.271676+0000","last_active":"2024-09-19T04:47:59.159617+0000","last_peered":"2024-09-19T04:47:59.159617+0000","last_clean":"2024-09-19T04:47:59.159617+0000","last_became_active":"2024-09-19T04:45:12.271093+0000","last_became_peered":"2024-09-19T04:45:12.271093+0000","last_unstale":"2024-09-19T04:47:59.159617+0000","last_undegraded":"2024-09-19T04:47:59.159617+0000","last_fullsized":"2024-09-19T04:47:59.159617+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:41:52.010883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:41:52.010883+0000","last_clean_scrub_stamp":"2024-09-19T04:41:52.010883+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:48.499621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.155221+0000","last_change":"2024-09-19T04:46:21.493847+0000","last_active":"2024-09-19T04:47:59.155221+0000","last_peered":"2024-09-19T04:47:59.155221+0000","last_clean":"2024-09-19T04:47:59.155221+0000","last_became_active":"2024-09-19T04:46:21.493432+0000","last_became_peered":"2024-09-19T04:46:21.493432+0000","last_unstale":"2024-09-19T04:47:59.155221+0000","last_undegraded":"2024-09-19T04:47:59.155221+0000","last_fullsized":"2024-09-19T04:47:59.155221+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:10:21.398602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.196941+0000","last_change":"2024-09-19T04:46:23.517517+0000","last_active":"2024-09-19T04:47:59.196941+0000","last_peered":"2024-09-19T04:47:59.196941+0000","last_clean":"2024-09-19T04:47:59.196941+0000","last_became_active":"2024-09-19T04:46:23.517191+0000","last_became_peered":"2024-09-19T04:46:23.517191+0000","last_unstale":"2024-09-19T04:47:59.196941+0000","last_undegraded":"2024-09-19T04:47:59.196941+0000","last_fullsized":"2024-09-19T04:47:59.196941+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:17.896149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.158899+0000","last_change":"2024-09-19T04:46:36.794380+0000","last_active":"2024-09-19T04:47:59.158899+0000","last_peered":"2024-09-19T04:47:59.158899+0000","last_clean":"2024-09-19T04:47:59.158899+0000","last_became_active":"2024-09-19T04:46:36.793911+0000","last_became_peered":"2024-09-19T04:46:36.793911+0000","last_unstale":"2024-09-19T04:47:59.158899+0000","last_undegraded":"2024-09-19T04:47:59.158899+0000","last_fullsized":"2024-09-19T04:47:59.158899+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:01:37.733641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1],"acting":[7,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.192866+0000","last_change":"2024-09-19T04:46:23.514102+0000","last_active":"2024-09-19T04:47:59.192866+0000","last_peered":"2024-09-19T04:47:59.192866+0000","last_clean":"2024-09-19T04:47:59.192866+0000","last_became_active":"2024-09-19T04:46:23.513732+0000","last_became_peered":"2024-09-19T04:46:23.513732+0000","last_unstale":"2024-09-19T04:47:59.192866+0000","last_undegraded":"2024-09-19T04:47:59.192866+0000","last_fullsized":"2024-09-19T04:47:59.192866+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:13.533065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.145786+0000","last_change":"2024-09-19T04:46:21.572628+0000","last_active":"2024-09-19T04:47:59.145786+0000","last_peered":"2024-09-19T04:47:59.145786+0000","last_clean":"2024-09-19T04:47:59.145786+0000","last_became_active":"2024-09-19T04:46:21.571736+0000","last_became_peered":"2024-09-19T04:46:21.571736+0000","last_unstale":"2024-09-19T04:47:59.145786+0000","last_undegraded":"2024-09-19T04:47:59.145786+0000","last_fullsized":"2024-09-19T04:47:59.145786+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:10:50.204481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.185982+0000","last_change":"2024-09-19T04:46:36.991388+0000","last_active":"2024-09-19T04:47:59.185982+0000","last_peered":"2024-09-19T04:47:59.185982+0000","last_clean":"2024-09-19T04:47:59.185982+0000","last_became_active":"2024-09-19T04:46:36.990923+0000","last_became_peered":"2024-09-19T04:46:36.990923+0000","last_unstale":"2024-09-19T04:47:59.185982+0000","last_undegraded":"2024-09-19T04:47:59.185982+0000","last_fullsized":"2024-09-19T04:47:59.185982+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:31.148732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.160790+0000","last_change":"2024-09-19T04:46:21.492696+0000","last_active":"2024-09-19T04:47:59.160790+0000","last_peered":"2024-09-19T04:47:59.160790+0000","last_clean":"2024-09-19T04:47:59.160790+0000","last_became_active":"2024-09-19T04:46:21.492306+0000","last_became_peered":"2024-09-19T04:46:21.492306+0000","last_unstale":"2024-09-19T04:47:59.160790+0000","last_undegraded":"2024-09-19T04:47:59.160790+0000","last_fullsized":"2024-09-19T04:47:59.160790+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:51:56.975170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.186820+0000","last_change":"2024-09-19T04:46:36.989535+0000","last_active":"2024-09-19T04:47:59.186820+0000","last_peered":"2024-09-19T04:47:59.186820+0000","last_clean":"2024-09-19T04:47:59.186820+0000","last_became_active":"2024-09-19T04:46:36.989252+0000","last_became_peered":"2024-09-19T04:46:36.989252+0000","last_unstale":"2024-09-19T04:47:59.186820+0000","last_undegraded":"2024-09-19T04:47:59.186820+0000","last_fullsized":"2024-09-19T04:47:59.186820+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:49:45.767547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.159452+0000","last_change":"2024-09-19T04:46:21.572275+0000","last_active":"2024-09-19T04:47:59.159452+0000","last_peered":"2024-09-19T04:47:59.159452+0000","last_clean":"2024-09-19T04:47:59.159452+0000","last_became_active":"2024-09-19T04:46:21.571940+0000","last_became_peered":"2024-09-19T04:46:21.571940+0000","last_unstale":"2024-09-19T04:47:59.159452+0000","last_undegraded":"2024-09-19T04:47:59.159452+0000","last_fullsized":"2024-09-19T04:47:59.159452+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:13.399887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.200078+0000","last_change":"2024-09-19T04:46:23.514355+0000","last_active":"2024-09-19T04:47:59.200078+0000","last_peered":"2024-09-19T04:47:59.200078+0000","last_clean":"2024-09-19T04:47:59.200078+0000","last_became_active":"2024-09-19T04:46:23.513963+0000","last_became_peered":"2024-09-19T04:46:23.513963+0000","last_unstale":"2024-09-19T04:47:59.200078+0000","last_undegraded":"2024-09-19T04:47:59.200078+0000","last_fullsized":"2024-09-19T04:47:59.200078+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:06.742732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.158181+0000","last_change":"2024-09-19T04:46:21.572466+0000","last_active":"2024-09-19T04:47:59.158181+0000","last_peered":"2024-09-19T04:47:59.158181+0000","last_clean":"2024-09-19T04:47:59.158181+0000","last_became_active":"2024-09-19T04:46:21.571868+0000","last_became_peered":"2024-09-19T04:46:21.571868+0000","last_unstale":"2024-09-19T04:47:59.158181+0000","last_undegraded":"2024-09-19T04:47:59.158181+0000","last_fullsized":"2024-09-19T04:47:59.158181+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:01.132858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.193312+0000","last_change":"2024-09-19T04:46:23.509517+0000","last_active":"2024-09-19T04:47:59.193312+0000","last_peered":"2024-09-19T04:47:59.193312+0000","last_clean":"2024-09-19T04:47:59.193312+0000","last_became_active":"2024-09-19T04:46:23.509216+0000","last_became_peered":"2024-09-19T04:46:23.509216+0000","last_unstale":"2024-09-19T04:47:59.193312+0000","last_undegraded":"2024-09-19T04:47:59.193312+0000","last_fullsized":"2024-09-19T04:47:59.193312+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:29:52.747643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'43","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.377679+0000","last_change":"2024-09-19T04:46:21.484462+0000","last_active":"2024-09-19T04:47:59.377679+0000","last_peered":"2024-09-19T04:47:59.377679+0000","last_clean":"2024-09-19T04:47:59.377679+0000","last_became_active":"2024-09-19T04:46:21.484148+0000","last_became_peered":"2024-09-19T04:46:21.484148+0000","last_unstale":"2024-09-19T04:47:59.377679+0000","last_undegraded":"2024-09-19T04:47:59.377679+0000","last_fullsized":"2024-09-19T04:47:59.377679+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:17:18.742857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":78,"num_write_kb":836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.191385+0000","last_change":"2024-09-19T04:46:23.512768+0000","last_active":"2024-09-19T04:47:59.191385+0000","last_peered":"2024-09-19T04:47:59.191385+0000","last_clean":"2024-09-19T04:47:59.191385+0000","last_became_active":"2024-09-19T04:46:23.512416+0000","last_became_peered":"2024-09-19T04:46:23.512416+0000","last_unstale":"2024-09-19T04:47:59.191385+0000","last_undegraded":"2024-09-19T04:47:59.191385+0000","last_fullsized":"2024-09-19T04:47:59.191385+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:03:48.340126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.155622+0000","last_change":"2024-09-19T04:46:21.488634+0000","last_active":"2024-09-19T04:47:59.155622+0000","last_peered":"2024-09-19T04:47:59.155622+0000","last_clean":"2024-09-19T04:47:59.155622+0000","last_became_active":"2024-09-19T04:46:21.488078+0000","last_became_peered":"2024-09-19T04:46:21.488078+0000","last_unstale":"2024-09-19T04:47:59.155622+0000","last_undegraded":"2024-09-19T04:47:59.155622+0000","last_fullsized":"2024-09-19T04:47:59.155622+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:31:47.946873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.200463+0000","last_change":"2024-09-19T04:46:23.522419+0000","last_active":"2024-09-19T04:47:59.200463+0000","last_peered":"2024-09-19T04:47:59.200463+0000","last_clean":"2024-09-19T04:47:59.200463+0000","last_became_active":"2024-09-19T04:46:23.522054+0000","last_became_peered":"2024-09-19T04:46:23.522054+0000","last_unstale":"2024-09-19T04:47:59.200463+0000","last_undegraded":"2024-09-19T04:47:59.200463+0000","last_fullsized":"2024-09-19T04:47:59.200463+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:43.720439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.151788+0000","last_change":"2024-09-19T04:46:21.572283+0000","last_active":"2024-09-19T04:47:59.151788+0000","last_peered":"2024-09-19T04:47:59.151788+0000","last_clean":"2024-09-19T04:47:59.151788+0000","last_became_active":"2024-09-19T04:46:21.572023+0000","last_became_peered":"2024-09-19T04:46:21.572023+0000","last_unstale":"2024-09-19T04:47:59.151788+0000","last_undegraded":"2024-09-19T04:47:59.151788+0000","last_fullsized":"2024-09-19T04:47:59.151788+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:37:26.293900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.178263+0000","last_change":"2024-09-19T04:46:23.516278+0000","last_active":"2024-09-19T04:47:59.178263+0000","last_peered":"2024-09-19T04:47:59.178263+0000","last_clean":"2024-09-19T04:47:59.178263+0000","last_became_active":"2024-09-19T04:46:23.515922+0000","last_became_peered":"2024-09-19T04:46:23.515922+0000","last_unstale":"2024-09-19T04:47:59.178263+0000","last_undegraded":"2024-09-19T04:47:59.178263+0000","last_fullsized":"2024-09-19T04:47:59.178263+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:26:11.038230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.156384+0000","last_change":"2024-09-19T04:46:21.489250+0000","last_active":"2024-09-19T04:47:59.156384+0000","last_peered":"2024-09-19T04:47:59.156384+0000","last_clean":"2024-09-19T04:47:59.156384+0000","last_became_active":"2024-09-19T04:46:21.488910+0000","last_became_peered":"2024-09-19T04:46:21.488910+0000","last_unstale":"2024-09-19T04:47:59.156384+0000","last_undegraded":"2024-09-19T04:47:59.156384+0000","last_fullsized":"2024-09-19T04:47:59.156384+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:04:03.650494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.191047+0000","last_change":"2024-09-19T04:46:23.512663+0000","last_active":"2024-09-19T04:47:59.191047+0000","last_peered":"2024-09-19T04:47:59.191047+0000","last_clean":"2024-09-19T04:47:59.191047+0000","last_became_active":"2024-09-19T04:46:23.512265+0000","last_became_peered":"2024-09-19T04:46:23.512265+0000","last_unstale":"2024-09-19T04:47:59.191047+0000","last_undegraded":"2024-09-19T04:47:59.191047+0000","last_fullsized":"2024-09-19T04:47:59.191047+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:52.903900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.156847+0000","last_change":"2024-09-19T04:46:36.990653+0000","last_active":"2024-09-19T04:47:59.156847+0000","last_peered":"2024-09-19T04:47:59.156847+0000","last_clean":"2024-09-19T04:47:59.156847+0000","last_became_active":"2024-09-19T04:46:36.990202+0000","last_became_peered":"2024-09-19T04:46:36.990202+0000","last_unstale":"2024-09-19T04:47:59.156847+0000","last_undegraded":"2024-09-19T04:47:59.156847+0000","last_fullsized":"2024-09-19T04:47:59.156847+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:25:53.780614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.198485+0000","last_change":"2024-09-19T04:46:23.510196+0000","last_active":"2024-09-19T04:47:59.198485+0000","last_peered":"2024-09-19T04:47:59.198485+0000","last_clean":"2024-09-19T04:47:59.198485+0000","last_became_active":"2024-09-19T04:46:23.509871+0000","last_became_peered":"2024-09-19T04:46:23.509871+0000","last_unstale":"2024-09-19T04:47:59.198485+0000","last_undegraded":"2024-09-19T04:47:59.198485+0000","last_fullsized":"2024-09-19T04:47:59.198485+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:42:01.825770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'2","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.157561+0000","last_change":"2024-09-19T04:46:21.492279+0000","last_active":"2024-09-19T04:47:59.157561+0000","last_peered":"2024-09-19T04:47:59.157561+0000","last_clean":"2024-09-19T04:47:59.157561+0000","last_became_active":"2024-09-19T04:46:21.491669+0000","last_became_peered":"2024-09-19T04:46:21.491669+0000","last_unstale":"2024-09-19T04:47:59.157561+0000","last_undegraded":"2024-09-19T04:47:59.157561+0000","last_fullsized":"2024-09-19T04:47:59.157561+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:23:15.822887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.200076+0000","last_change":"2024-09-19T04:46:23.518114+0000","last_active":"2024-09-19T04:47:59.200076+0000","last_peered":"2024-09-19T04:47:59.200076+0000","last_clean":"2024-09-19T04:47:59.200076+0000","last_became_active":"2024-09-19T04:46:23.517707+0000","last_became_peered":"2024-09-19T04:46:23.517707+0000","last_unstale":"2024-09-19T04:47:59.200076+0000","last_undegraded":"2024-09-19T04:47:59.200076+0000","last_fullsized":"2024-09-19T04:47:59.200076+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:52.438748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.191968+0000","last_change":"2024-09-19T04:46:23.525164+0000","last_active":"2024-09-19T04:47:59.191968+0000","last_peered":"2024-09-19T04:47:59.191968+0000","last_clean":"2024-09-19T04:47:59.191968+0000","last_became_active":"2024-09-19T04:46:23.524735+0000","last_became_peered":"2024-09-19T04:46:23.524735+0000","last_unstale":"2024-09-19T04:47:59.191968+0000","last_undegraded":"2024-09-19T04:47:59.191968+0000","last_fullsized":"2024-09-19T04:47:59.191968+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:53.590834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.157901+0000","last_change":"2024-09-19T04:46:21.492940+0000","last_active":"2024-09-19T04:47:59.157901+0000","last_peered":"2024-09-19T04:47:59.157901+0000","last_clean":"2024-09-19T04:47:59.157901+0000","last_became_active":"2024-09-19T04:46:21.492602+0000","last_became_peered":"2024-09-19T04:46:21.492602+0000","last_unstale":"2024-09-19T04:47:59.157901+0000","last_undegraded":"2024-09-19T04:47:59.157901+0000","last_fullsized":"2024-09-19T04:47:59.157901+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:20.554832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.190998+0000","last_change":"2024-09-19T04:46:23.513432+0000","last_active":"2024-09-19T04:47:59.190998+0000","last_peered":"2024-09-19T04:47:59.190998+0000","last_clean":"2024-09-19T04:47:59.190998+0000","last_became_active":"2024-09-19T04:46:23.513084+0000","last_became_peered":"2024-09-19T04:46:23.513084+0000","last_unstale":"2024-09-19T04:47:59.190998+0000","last_undegraded":"2024-09-19T04:47:59.190998+0000","last_fullsized":"2024-09-19T04:47:59.190998+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:03:16.732545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.158117+0000","last_change":"2024-09-19T04:46:21.491823+0000","last_active":"2024-09-19T04:47:59.158117+0000","last_peered":"2024-09-19T04:47:59.158117+0000","last_clean":"2024-09-19T04:47:59.158117+0000","last_became_active":"2024-09-19T04:46:21.491401+0000","last_became_peered":"2024-09-19T04:46:21.491401+0000","last_unstale":"2024-09-19T04:47:59.158117+0000","last_undegraded":"2024-09-19T04:47:59.158117+0000","last_fullsized":"2024-09-19T04:47:59.158117+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:55.955868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.198560+0000","last_change":"2024-09-19T04:46:23.515884+0000","last_active":"2024-09-19T04:47:59.198560+0000","last_peered":"2024-09-19T04:47:59.198560+0000","last_clean":"2024-09-19T04:47:59.198560+0000","last_became_active":"2024-09-19T04:46:23.515243+0000","last_became_peered":"2024-09-19T04:46:23.515243+0000","last_unstale":"2024-09-19T04:47:59.198560+0000","last_undegraded":"2024-09-19T04:47:59.198560+0000","last_fullsized":"2024-09-19T04:47:59.198560+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:07:33.716942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.157750+0000","last_change":"2024-09-19T04:46:21.572122+0000","last_active":"2024-09-19T04:47:59.157750+0000","last_peered":"2024-09-19T04:47:59.157750+0000","last_clean":"2024-09-19T04:47:59.157750+0000","last_became_active":"2024-09-19T04:46:21.571747+0000","last_became_peered":"2024-09-19T04:46:21.571747+0000","last_unstale":"2024-09-19T04:47:59.157750+0000","last_undegraded":"2024-09-19T04:47:59.157750+0000","last_fullsized":"2024-09-19T04:47:59.157750+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:06:43.411409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.197280+0000","last_change":"2024-09-19T04:46:23.513876+0000","last_active":"2024-09-19T04:47:59.197280+0000","last_peered":"2024-09-19T04:47:59.197280+0000","last_clean":"2024-09-19T04:47:59.197280+0000","last_became_active":"2024-09-19T04:46:23.513562+0000","last_became_peered":"2024-09-19T04:46:23.513562+0000","last_unstale":"2024-09-19T04:47:59.197280+0000","last_undegraded":"2024-09-19T04:47:59.197280+0000","last_fullsized":"2024-09-19T04:47:59.197280+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:22.485224+0000","last_clean_scrub_stamp":"2024-09-19T04:46:22.485224+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:21.982001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'4","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T04:47:59.161181+0000","last_change":"2024-09-19T04:46:21.491550+0000","last_active":"2024-09-19T04:47:59.161181+0000","last_peered":"2024-09-19T04:47:59.161181+0000","last_clean":"2024-09-19T04:47:59.161181+0000","last_became_active":"2024-09-19T04:46:21.491259+0000","last_became_peered":"2024-09-19T04:46:21.491259+0000","last_unstale":"2024-09-19T04:47:59.161181+0000","last_undegraded":"2024-09-19T04:47:59.161181+0000","last_fullsized":"2024-09-19T04:47:59.161181+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:46:20.470050+0000","last_clean_scrub_stamp":"2024-09-19T04:46:20.470050+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:38.671211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":588343,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":284,"num_read_kb":238,"num_write":195,"num_write_kb":1396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1867776,"data_stored":1765029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645344,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":888832,"data_stored":435145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874277,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37068,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708084,"statfs":{"total":95995035648,"available":95957078016,"internally_reserved":0,"allocated":1703936,"data_stored":1220119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":36174273},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005098,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40760,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704392,"statfs":{"total":95995035648,"available":95953297408,"internally_reserved":0,"allocated":1282048,"data_stored":828909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234032,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":892928,"data_stored":435715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462964,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28480,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716672,"statfs":{"total":95995035648,"available":95965872128,"internally_reserved":0,"allocated":1486848,"data_stored":1026178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626489,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36216,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708936,"statfs":{"total":95995035648,"available":95957950464,"internally_reserved":0,"allocated":888832,"data_stored":435228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855421,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28556,"kb_used_data":1528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716596,"statfs":{"total":95995035648,"available":95965794304,"internally_reserved":0,"allocated":1564672,"data_stored":1091834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018947,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36216,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708936,"statfs":{"total":95995035648,"available":95957950464,"internally_reserved":0,"allocated":888832,"data_stored":435133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247880,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":901120,"data_stored":435449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476813,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":958464,"data_stored":497840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607634,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40444,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704708,"statfs":{"total":95995035648,"available":95953620992,"internally_reserved":0,"allocated":958464,"data_stored":497840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738454,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40376,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704776,"statfs":{"total":95995035648,"available":95953690624,"internally_reserved":0,"allocated":888832,"data_stored":435201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":536576,"data_stored":524920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":131782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":393820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":393798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":194523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T04:48:04.643 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:48:04.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:04 smithi018 ceph-mon[34537]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:48:04.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:04 smithi018 ceph-mon[34537]: mgrmap e23: x(active, since 4s), standbys: y, z 2024-09-19T04:48:04.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:04 smithi018 ceph-mon[34537]: from='client.15186 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:48:04.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:04 smithi116 ceph-mon[34477]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:48:04.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:04 smithi116 ceph-mon[34477]: mgrmap e23: x(active, since 4s), standbys: y, z 2024-09-19T04:48:04.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:04 smithi116 ceph-mon[34477]: from='client.15186 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:48:04.936 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:48:05.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.405+0000 7f64eb777640 1 -- 172.21.15.2:0/4134322060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64e4102790 msgr2=0x7f64e41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:05.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.405+0000 7f64eb777640 1 --2- 172.21.15.2:0/4134322060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64e4102790 0x7f64e41067e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f64d4009900 tx=0x7f64d402a410 comp rx=0 tx=0).stop 2024-09-19T04:48:05.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.405+0000 7f64eb777640 1 -- 172.21.15.2:0/4134322060 shutdown_connections 2024-09-19T04:48:05.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.405+0000 7f64eb777640 1 --2- 172.21.15.2:0/4134322060 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64e4106f10 0x7f64e410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:05.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.405+0000 7f64eb777640 1 --2- 172.21.15.2:0/4134322060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64e4102790 0x7f64e41067e0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:05.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.405+0000 7f64eb777640 1 --2- 172.21.15.2:0/4134322060 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64e4101de0 0x7f64e41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:05.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.405+0000 7f64eb777640 1 -- 172.21.15.2:0/4134322060 >> 172.21.15.2:0/4134322060 conn(0x7f64e40fd8c0 msgr2=0x7f64e40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:05.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.405+0000 7f64eb777640 1 -- 172.21.15.2:0/4134322060 shutdown_connections 2024-09-19T04:48:05.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.405+0000 7f64eb777640 1 -- 172.21.15.2:0/4134322060 wait complete. 2024-09-19T04:48:05.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.405+0000 7f64eb777640 1 Processor -- start 2024-09-19T04:48:05.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.406+0000 7f64eb777640 1 -- start start 2024-09-19T04:48:05.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.406+0000 7f64eb777640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64e4101de0 0x7f64e41983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:05.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.406+0000 7f64eb777640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64e4102790 0x7f64e4198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:05.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.406+0000 7f64eb777640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64e4106f10 0x7f64e419ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:05.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.406+0000 7f64eb777640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f64e4111de0 con 0x7f64e4106f10 2024-09-19T04:48:05.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.406+0000 7f64eb777640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f64e4111c60 con 0x7f64e4102790 2024-09-19T04:48:05.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.406+0000 7f64eb777640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f64e4111f60 con 0x7f64e4101de0 2024-09-19T04:48:05.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.406+0000 7f64e9d14640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64e4106f10 0x7f64e419ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:05.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.406+0000 7f64e9513640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64e4101de0 0x7f64e41983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:05.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.406+0000 7f64e9d14640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64e4106f10 0x7f64e419ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45436/0 (socket says 172.21.15.2:45436) 2024-09-19T04:48:05.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.406+0000 7f64e9d14640 1 -- 172.21.15.2:0/342504140 learned_addr learned my addr 172.21.15.2:0/342504140 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:48:05.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.406+0000 7f64e8d12640 1 --2- 172.21.15.2:0/342504140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64e4102790 0x7f64e4198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:05.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.406+0000 7f64e9d14640 1 -- 172.21.15.2:0/342504140 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64e4101de0 msgr2=0x7f64e41983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:05.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.406+0000 7f64e9d14640 1 --2- 172.21.15.2:0/342504140 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64e4101de0 0x7f64e41983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:05.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.406+0000 7f64e9d14640 1 -- 172.21.15.2:0/342504140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64e4102790 msgr2=0x7f64e4198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:05.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.406+0000 7f64e9d14640 1 --2- 172.21.15.2:0/342504140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64e4102790 0x7f64e4198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:05.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.406+0000 7f64e9d14640 1 -- 172.21.15.2:0/342504140 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64e419d390 con 0x7f64e4106f10 2024-09-19T04:48:05.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.407+0000 7f64e9d14640 1 --2- 172.21.15.2:0/342504140 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64e4106f10 0x7f64e419ccb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f64dc00cad0 tx=0x7f64dc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:05.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.407+0000 7f64da7fc640 1 -- 172.21.15.2:0/342504140 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64dc00ae20 con 0x7f64e4106f10 2024-09-19T04:48:05.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.407+0000 7f64da7fc640 1 -- 172.21.15.2:0/342504140 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f64dc005020 con 0x7f64e4106f10 2024-09-19T04:48:05.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.407+0000 7f64eb777640 1 -- 172.21.15.2:0/342504140 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64e419d680 con 0x7f64e4106f10 2024-09-19T04:48:05.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.407+0000 7f64da7fc640 1 -- 172.21.15.2:0/342504140 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64dc00f6b0 con 0x7f64e4106f10 2024-09-19T04:48:05.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.407+0000 7f64eb777640 1 -- 172.21.15.2:0/342504140 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64e41a4f60 con 0x7f64e4106f10 2024-09-19T04:48:05.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.408+0000 7f64eb777640 1 -- 172.21.15.2:0/342504140 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64e41021c0 con 0x7f64e4106f10 2024-09-19T04:48:05.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.409+0000 7f64da7fc640 1 -- 172.21.15.2:0/342504140 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138530+0+0 (secure 0 0 0) 0x7f64dc0051d0 con 0x7f64e4106f10 2024-09-19T04:48:05.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.410+0000 7f64da7fc640 1 --2- 172.21.15.2:0/342504140 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f64d00a3440 0x7f64d00a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:05.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.410+0000 7f64e9513640 1 --2- 172.21.15.2:0/342504140 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f64d00a3440 0x7f64d00a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:05.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.410+0000 7f64da7fc640 1 -- 172.21.15.2:0/342504140 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f64dc0cfe10 con 0x7f64e4106f10 2024-09-19T04:48:05.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.411+0000 7f64e9513640 1 --2- 172.21.15.2:0/342504140 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f64d00a3440 0x7f64d00a5900 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f64e0005d00 tx=0x7f64e000b410 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:05.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.415+0000 7f64da7fc640 1 -- 172.21.15.2:0/342504140 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f64dc014030 con 0x7f64e4106f10 2024-09-19T04:48:05.609 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:05 smithi002 ceph-mon[30975]: from='client.15192 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:48:05.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:05 smithi002 ceph-mon[30975]: from='client.15198 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:48:05.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.629+0000 7f64eb777640 1 -- 172.21.15.2:0/342504140 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f64e402d7c0 con 0x7f64e4106f10 2024-09-19T04:48:05.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.630+0000 7f64da7fc640 1 -- 172.21.15.2:0/342504140 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11840 (secure 0 0 0) 0x7f64dc09c050 con 0x7f64e4106f10 2024-09-19T04:48:05.633 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:48:05.633 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":19,"btime":"2024-09-19T04:46:33:537239+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2467365137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2467365137},{"type":"v1","addr":"172.21.15.2:6835","nonce":2467365137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3162441888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3162441888},{"type":"v1","addr":"172.21.15.2:6837","nonce":3162441888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14631,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2740862966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2740862966},{"type":"v1","addr":"172.21.15.2:6839","nonce":2740862966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/2394435504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2394435504},{"type":"v1","addr":"172.21.15.2:6841","nonce":2394435504}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1630480244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1630480244},{"type":"v1","addr":"172.21.15.18:6833","nonce":1630480244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1553897465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1553897465},{"type":"v1","addr":"172.21.15.116:6833","nonce":1553897465}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3035664608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3035664608},{"type":"v1","addr":"172.21.15.18:6835","nonce":3035664608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1096622392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1096622392},{"type":"v1","addr":"172.21.15.18:6837","nonce":1096622392}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3761157675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3761157675},{"type":"v1","addr":"172.21.15.116:6835","nonce":3761157675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/1120131594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1120131594},{"type":"v1","addr":"172.21.15.116:6837","nonce":1120131594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:46:24.050115+0000","modified":"2024-09-19T04:46:33.112369+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/4207677139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":4207677139},{"type":"v1","addr":"172.21.15.18:6839","nonce":4207677139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/2346874880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":2346874880},{"type":"v1","addr":"172.21.15.116:6839","nonce":2346874880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496]},"id":1}]} 2024-09-19T04:48:05.633 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 19 2024-09-19T04:48:05.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.632+0000 7f64eb777640 1 -- 172.21.15.2:0/342504140 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f64d00a3440 msgr2=0x7f64d00a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:05.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.632+0000 7f64eb777640 1 --2- 172.21.15.2:0/342504140 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f64d00a3440 0x7f64d00a5900 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f64e0005d00 tx=0x7f64e000b410 comp rx=0 tx=0).stop 2024-09-19T04:48:05.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.632+0000 7f64eb777640 1 -- 172.21.15.2:0/342504140 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64e4106f10 msgr2=0x7f64e419ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:05.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.632+0000 7f64eb777640 1 --2- 172.21.15.2:0/342504140 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64e4106f10 0x7f64e419ccb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f64dc00cad0 tx=0x7f64dc00cf90 comp rx=0 tx=0).stop 2024-09-19T04:48:05.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.632+0000 7f64eb777640 1 -- 172.21.15.2:0/342504140 shutdown_connections 2024-09-19T04:48:05.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.632+0000 7f64eb777640 1 --2- 172.21.15.2:0/342504140 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64e4106f10 0x7f64e419ccb0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:05.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.632+0000 7f64eb777640 1 --2- 172.21.15.2:0/342504140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64e4102790 0x7f64e4198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:05.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.632+0000 7f64eb777640 1 --2- 172.21.15.2:0/342504140 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f64d00a3440 0x7f64d00a5900 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:05.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.632+0000 7f64eb777640 1 --2- 172.21.15.2:0/342504140 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64e4101de0 0x7f64e41983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:05.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.632+0000 7f64eb777640 1 -- 172.21.15.2:0/342504140 >> 172.21.15.2:0/342504140 conn(0x7f64e40fd8c0 msgr2=0x7f64e40fed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:05.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.632+0000 7f64eb777640 1 -- 172.21.15.2:0/342504140 shutdown_connections 2024-09-19T04:48:05.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:05.632+0000 7f64eb777640 1 -- 172.21.15.2:0/342504140 wait complete. 2024-09-19T04:48:05.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:05 smithi018 ceph-mon[34537]: from='client.15192 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:48:05.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:05 smithi018 ceph-mon[34537]: from='client.15198 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:48:05.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:05 smithi116 ceph-mon[34477]: from='client.15192 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:48:05.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:05 smithi116 ceph-mon[34477]: from='client.15198 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:48:06.280 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T04:48:06.548 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:48:06.667 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:06 smithi002 ceph-mon[30975]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 0 B/s wr, 26 op/s 2024-09-19T04:48:06.667 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:06 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/342504140' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:48:06.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:06 smithi018 ceph-mon[34537]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 0 B/s wr, 26 op/s 2024-09-19T04:48:06.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:06 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/342504140' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:48:06.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:06 smithi116 ceph-mon[34477]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 0 B/s wr, 26 op/s 2024-09-19T04:48:06.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:06 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/342504140' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:48:07.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.039+0000 7f17f804b640 1 -- 172.21.15.2:0/2401478887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17f0101420 msgr2=0x7f17f010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:07.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.039+0000 7f17f804b640 1 --2- 172.21.15.2:0/2401478887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17f0101420 0x7f17f010d950 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f17e8009cf0 tx=0x7f17e802ed00 comp rx=0 tx=0).stop 2024-09-19T04:48:07.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.039+0000 7f17f804b640 1 -- 172.21.15.2:0/2401478887 shutdown_connections 2024-09-19T04:48:07.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.039+0000 7f17f804b640 1 --2- 172.21.15.2:0/2401478887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17f0101420 0x7f17f010d950 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:07.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.039+0000 7f17f804b640 1 --2- 172.21.15.2:0/2401478887 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17f0100a80 0x7f17f0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:07.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.039+0000 7f17f804b640 1 --2- 172.21.15.2:0/2401478887 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f17f0106a80 0x7f17f0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:07.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.039+0000 7f17f804b640 1 -- 172.21.15.2:0/2401478887 >> 172.21.15.2:0/2401478887 conn(0x7f17f00fc7a0 msgr2=0x7f17f00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:07.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.039+0000 7f17f804b640 1 -- 172.21.15.2:0/2401478887 shutdown_connections 2024-09-19T04:48:07.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.039+0000 7f17f804b640 1 -- 172.21.15.2:0/2401478887 wait complete. 2024-09-19T04:48:07.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.040+0000 7f17f804b640 1 Processor -- start 2024-09-19T04:48:07.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.040+0000 7f17f804b640 1 -- start start 2024-09-19T04:48:07.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.040+0000 7f17f804b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f17f0100a80 0x7f17f0196150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:07.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.040+0000 7f17f804b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17f0101420 0x7f17f0196690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:07.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.040+0000 7f17f804b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17f0106a80 0x7f17f019aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:07.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.040+0000 7f17f804b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f17f010fbd0 con 0x7f17f0106a80 2024-09-19T04:48:07.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.040+0000 7f17f804b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f17f010fa50 con 0x7f17f0101420 2024-09-19T04:48:07.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.040+0000 7f17f804b640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f17f010fd50 con 0x7f17f0100a80 2024-09-19T04:48:07.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.040+0000 7f17f65e8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17f0106a80 0x7f17f019aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:07.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.040+0000 7f17f65e8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17f0106a80 0x7f17f019aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45460/0 (socket says 172.21.15.2:45460) 2024-09-19T04:48:07.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.040+0000 7f17f65e8640 1 -- 172.21.15.2:0/1861798615 learned_addr learned my addr 172.21.15.2:0/1861798615 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:48:07.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.040+0000 7f17f5de7640 1 --2- 172.21.15.2:0/1861798615 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f17f0100a80 0x7f17f0196150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:07.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.040+0000 7f17f55e6640 1 --2- 172.21.15.2:0/1861798615 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17f0101420 0x7f17f0196690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:07.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.040+0000 7f17f65e8640 1 -- 172.21.15.2:0/1861798615 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f17f0100a80 msgr2=0x7f17f0196150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:07.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.040+0000 7f17f65e8640 1 --2- 172.21.15.2:0/1861798615 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f17f0100a80 0x7f17f0196150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:07.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.040+0000 7f17f65e8640 1 -- 172.21.15.2:0/1861798615 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17f0101420 msgr2=0x7f17f0196690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:07.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.040+0000 7f17f65e8640 1 --2- 172.21.15.2:0/1861798615 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17f0101420 0x7f17f0196690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:07.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.040+0000 7f17f65e8640 1 -- 172.21.15.2:0/1861798615 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f019b100 con 0x7f17f0106a80 2024-09-19T04:48:07.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.041+0000 7f17f65e8640 1 --2- 172.21.15.2:0/1861798615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17f0106a80 0x7f17f019aa20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f17e8009cc0 tx=0x7f17e8003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:07.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.041+0000 7f17e6ffd640 1 -- 172.21.15.2:0/1861798615 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e8044020 con 0x7f17f0106a80 2024-09-19T04:48:07.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.041+0000 7f17f804b640 1 -- 172.21.15.2:0/1861798615 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17f019b390 con 0x7f17f0106a80 2024-09-19T04:48:07.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.041+0000 7f17e6ffd640 1 -- 172.21.15.2:0/1861798615 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f17e802fcc0 con 0x7f17f0106a80 2024-09-19T04:48:07.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.041+0000 7f17e6ffd640 1 -- 172.21.15.2:0/1861798615 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e803c040 con 0x7f17f0106a80 2024-09-19T04:48:07.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.041+0000 7f17f804b640 1 -- 172.21.15.2:0/1861798615 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17f01a2cd0 con 0x7f17f0106a80 2024-09-19T04:48:07.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.042+0000 7f17f804b640 1 -- 172.21.15.2:0/1861798615 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17f01021c0 con 0x7f17f0106a80 2024-09-19T04:48:07.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.043+0000 7f17e6ffd640 1 -- 172.21.15.2:0/1861798615 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138530+0+0 (secure 0 0 0) 0x7f17e8047020 con 0x7f17f0106a80 2024-09-19T04:48:07.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.044+0000 7f17e6ffd640 1 --2- 172.21.15.2:0/1861798615 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f17dc0a3440 0x7f17dc0a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:07.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.044+0000 7f17f5de7640 1 --2- 172.21.15.2:0/1861798615 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f17dc0a3440 0x7f17dc0a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:07.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.044+0000 7f17e6ffd640 1 -- 172.21.15.2:0/1861798615 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f17e80f47a0 con 0x7f17f0106a80 2024-09-19T04:48:07.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.044+0000 7f17f5de7640 1 --2- 172.21.15.2:0/1861798615 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f17dc0a3440 0x7f17dc0a5900 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f17ec005fd0 tx=0x7f17ec00b390 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:07.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.048+0000 7f17e6ffd640 1 -- 172.21.15.2:0/1861798615 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f17e804e020 con 0x7f17f0106a80 2024-09-19T04:48:07.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.226+0000 7f17f804b640 1 -- 172.21.15.2:0/1861798615 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f17f0108ff0 con 0x7f17f0106a80 2024-09-19T04:48:07.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.227+0000 7f17e6ffd640 1 -- 172.21.15.2:0/1861798615 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22923 (secure 0 0 0) 0x7f17e80c1140 con 0x7f17f0106a80 2024-09-19T04:48:07.229 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:48:07.229 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":81,"fsid":"d46630c4-7640-11ef-bceb-c7b262605968","created":"2024-09-19T04:38:39.698488+0000","modified":"2024-09-19T04:47:59.140914+0000","last_up_change":"2024-09-19T04:45:33.839647+0000","last_in_change":"2024-09-19T04:45:09.816808+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T04:41:51.960734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T04:46:20.031485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T04:46:22.484767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7a7dc9b9-8d5d-4dd3-93a3-0d5efced07d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":611702745},{"type":"v1","addr":"172.21.15.2:6803","nonce":611702745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":611702745},{"type":"v1","addr":"172.21.15.2:6805","nonce":611702745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":611702745},{"type":"v1","addr":"172.21.15.2:6809","nonce":611702745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":611702745},{"type":"v1","addr":"172.21.15.2:6807","nonce":611702745}]},"public_addr":"172.21.15.2:6803/611702745","cluster_addr":"172.21.15.2:6805/611702745","heartbeat_back_addr":"172.21.15.2:6809/611702745","heartbeat_front_addr":"172.21.15.2:6807/611702745","state":["exists","up"]},{"osd":1,"uuid":"bea40dec-7d9c-497f-bf16-4bf6d3b839f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":58390709},{"type":"v1","addr":"172.21.15.18:6801","nonce":58390709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":58390709},{"type":"v1","addr":"172.21.15.18:6803","nonce":58390709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":58390709},{"type":"v1","addr":"172.21.15.18:6807","nonce":58390709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":58390709},{"type":"v1","addr":"172.21.15.18:6805","nonce":58390709}]},"public_addr":"172.21.15.18:6801/58390709","cluster_addr":"172.21.15.18:6803/58390709","heartbeat_back_addr":"172.21.15.18:6807/58390709","heartbeat_front_addr":"172.21.15.18:6805/58390709","state":["exists","up"]},{"osd":2,"uuid":"97716304-a31e-48c9-83de-84eed10a7a4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":627735759},{"type":"v1","addr":"172.21.15.116:6801","nonce":627735759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":627735759},{"type":"v1","addr":"172.21.15.116:6803","nonce":627735759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":627735759},{"type":"v1","addr":"172.21.15.116:6807","nonce":627735759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":627735759},{"type":"v1","addr":"172.21.15.116:6805","nonce":627735759}]},"public_addr":"172.21.15.116:6801/627735759","cluster_addr":"172.21.15.116:6803/627735759","heartbeat_back_addr":"172.21.15.116:6807/627735759","heartbeat_front_addr":"172.21.15.116:6805/627735759","state":["exists","up"]},{"osd":3,"uuid":"8d79514e-16cf-4bd0-a2eb-e9148b91183d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1936071687},{"type":"v1","addr":"172.21.15.2:6811","nonce":1936071687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1936071687},{"type":"v1","addr":"172.21.15.2:6813","nonce":1936071687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1936071687},{"type":"v1","addr":"172.21.15.2:6817","nonce":1936071687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1936071687},{"type":"v1","addr":"172.21.15.2:6815","nonce":1936071687}]},"public_addr":"172.21.15.2:6811/1936071687","cluster_addr":"172.21.15.2:6813/1936071687","heartbeat_back_addr":"172.21.15.2:6817/1936071687","heartbeat_front_addr":"172.21.15.2:6815/1936071687","state":["exists","up"]},{"osd":4,"uuid":"5136f03c-94a3-42a0-9bfc-020397836037","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1333533784},{"type":"v1","addr":"172.21.15.18:6809","nonce":1333533784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1333533784},{"type":"v1","addr":"172.21.15.18:6811","nonce":1333533784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1333533784},{"type":"v1","addr":"172.21.15.18:6815","nonce":1333533784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1333533784},{"type":"v1","addr":"172.21.15.18:6813","nonce":1333533784}]},"public_addr":"172.21.15.18:6809/1333533784","cluster_addr":"172.21.15.18:6811/1333533784","heartbeat_back_addr":"172.21.15.18:6815/1333533784","heartbeat_front_addr":"172.21.15.18:6813/1333533784","state":["exists","up"]},{"osd":5,"uuid":"9d3384b0-f87d-4513-b151-4cca21c339b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":316360741},{"type":"v1","addr":"172.21.15.116:6809","nonce":316360741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":316360741},{"type":"v1","addr":"172.21.15.116:6811","nonce":316360741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":316360741},{"type":"v1","addr":"172.21.15.116:6815","nonce":316360741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":316360741},{"type":"v1","addr":"172.21.15.116:6813","nonce":316360741}]},"public_addr":"172.21.15.116:6809/316360741","cluster_addr":"172.21.15.116:6811/316360741","heartbeat_back_addr":"172.21.15.116:6815/316360741","heartbeat_front_addr":"172.21.15.116:6813/316360741","state":["exists","up"]},{"osd":6,"uuid":"e54f44b5-a693-4b31-83b2-2bcf10ab9a75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1185564560},{"type":"v1","addr":"172.21.15.2:6819","nonce":1185564560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1185564560},{"type":"v1","addr":"172.21.15.2:6821","nonce":1185564560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1185564560},{"type":"v1","addr":"172.21.15.2:6825","nonce":1185564560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":1185564560},{"type":"v1","addr":"172.21.15.2:6823","nonce":1185564560}]},"public_addr":"172.21.15.2:6819/1185564560","cluster_addr":"172.21.15.2:6821/1185564560","heartbeat_back_addr":"172.21.15.2:6825/1185564560","heartbeat_front_addr":"172.21.15.2:6823/1185564560","state":["exists","up"]},{"osd":7,"uuid":"96a444c3-429a-48b6-9823-95c9e171341a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3691801363},{"type":"v1","addr":"172.21.15.18:6817","nonce":3691801363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3691801363},{"type":"v1","addr":"172.21.15.18:6819","nonce":3691801363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3691801363},{"type":"v1","addr":"172.21.15.18:6823","nonce":3691801363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3691801363},{"type":"v1","addr":"172.21.15.18:6821","nonce":3691801363}]},"public_addr":"172.21.15.18:6817/3691801363","cluster_addr":"172.21.15.18:6819/3691801363","heartbeat_back_addr":"172.21.15.18:6823/3691801363","heartbeat_front_addr":"172.21.15.18:6821/3691801363","state":["exists","up"]},{"osd":8,"uuid":"c3f696aa-be7d-4f67-9147-3751406e394d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":3709586119},{"type":"v1","addr":"172.21.15.116:6817","nonce":3709586119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":3709586119},{"type":"v1","addr":"172.21.15.116:6819","nonce":3709586119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":3709586119},{"type":"v1","addr":"172.21.15.116:6823","nonce":3709586119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":3709586119},{"type":"v1","addr":"172.21.15.116:6821","nonce":3709586119}]},"public_addr":"172.21.15.116:6817/3709586119","cluster_addr":"172.21.15.116:6819/3709586119","heartbeat_back_addr":"172.21.15.116:6823/3709586119","heartbeat_front_addr":"172.21.15.116:6821/3709586119","state":["exists","up"]},{"osd":9,"uuid":"4892549d-f050-48c5-b695-5924b612a581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1054791011},{"type":"v1","addr":"172.21.15.2:6827","nonce":1054791011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1054791011},{"type":"v1","addr":"172.21.15.2:6829","nonce":1054791011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1054791011},{"type":"v1","addr":"172.21.15.2:6833","nonce":1054791011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":1054791011},{"type":"v1","addr":"172.21.15.2:6831","nonce":1054791011}]},"public_addr":"172.21.15.2:6827/1054791011","cluster_addr":"172.21.15.2:6829/1054791011","heartbeat_back_addr":"172.21.15.2:6833/1054791011","heartbeat_front_addr":"172.21.15.2:6831/1054791011","state":["exists","up"]},{"osd":10,"uuid":"12b60238-6a35-4d48-bacd-ee5ddd8fdb0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1958683776},{"type":"v1","addr":"172.21.15.18:6825","nonce":1958683776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":1958683776},{"type":"v1","addr":"172.21.15.18:6827","nonce":1958683776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":1958683776},{"type":"v1","addr":"172.21.15.18:6831","nonce":1958683776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":1958683776},{"type":"v1","addr":"172.21.15.18:6829","nonce":1958683776}]},"public_addr":"172.21.15.18:6825/1958683776","cluster_addr":"172.21.15.18:6827/1958683776","heartbeat_back_addr":"172.21.15.18:6831/1958683776","heartbeat_front_addr":"172.21.15.18:6829/1958683776","state":["exists","up"]},{"osd":11,"uuid":"99b3e553-b42c-4b2f-817f-3900ad8bd223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3456789654},{"type":"v1","addr":"172.21.15.116:6825","nonce":3456789654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3456789654},{"type":"v1","addr":"172.21.15.116:6827","nonce":3456789654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3456789654},{"type":"v1","addr":"172.21.15.116:6831","nonce":3456789654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3456789654},{"type":"v1","addr":"172.21.15.116:6829","nonce":3456789654}]},"public_addr":"172.21.15.116:6825/3456789654","cluster_addr":"172.21.15.116:6827/3456789654","heartbeat_back_addr":"172.21.15.116:6831/3456789654","heartbeat_front_addr":"172.21.15.116:6829/3456789654","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:40:58.216702+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:41:22.852350+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:41:47.265084+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:42:12.785128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:42:38.475008+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:43:02.924009+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:43:28.050646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:43:52.715369+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:44:16.905066+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:44:42.071128+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:45:06.434525+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:45:31.569086+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":1}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/3848778984":"2024-09-20T04:47:59.140869+0000","172.21.15.2:0/2044166064":"2024-09-20T04:47:59.140869+0000","172.21.15.2:0/1092443021":"2024-09-20T04:47:59.140869+0000","172.21.15.2:0/2432243496":"2024-09-20T04:39:11.086431+0000","172.21.15.2:6800/3782987318":"2024-09-20T04:39:35.461329+0000","172.21.15.2:6801/1825825090":"2024-09-20T04:39:11.086431+0000","172.21.15.2:6800/1825825090":"2024-09-20T04:39:11.086431+0000","172.21.15.2:6800/3171525177":"2024-09-20T04:47:59.140869+0000","172.21.15.2:0/3064319092":"2024-09-20T04:39:11.086431+0000","172.21.15.2:6801/3782987318":"2024-09-20T04:39:35.461329+0000","172.21.15.2:0/256825166":"2024-09-20T04:39:35.461329+0000","172.21.15.2:0/1528097642":"2024-09-20T04:39:11.086431+0000","172.21.15.2:0/2801870985":"2024-09-20T04:39:35.461329+0000","172.21.15.2:6801/3171525177":"2024-09-20T04:47:59.140869+0000","172.21.15.2:0/4263572944":"2024-09-20T04:47:59.140869+0000","172.21.15.2:0/870383845":"2024-09-20T04:39:35.461329+0000","172.21.15.2:0/3466359926":"2024-09-20T04:47:59.140869+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T04:48:07.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.230+0000 7f17f804b640 1 -- 172.21.15.2:0/1861798615 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f17dc0a3440 msgr2=0x7f17dc0a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:07.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.230+0000 7f17f804b640 1 --2- 172.21.15.2:0/1861798615 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f17dc0a3440 0x7f17dc0a5900 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f17ec005fd0 tx=0x7f17ec00b390 comp rx=0 tx=0).stop 2024-09-19T04:48:07.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.230+0000 7f17f804b640 1 -- 172.21.15.2:0/1861798615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17f0106a80 msgr2=0x7f17f019aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:07.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.230+0000 7f17f804b640 1 --2- 172.21.15.2:0/1861798615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17f0106a80 0x7f17f019aa20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f17e8009cc0 tx=0x7f17e8003f10 comp rx=0 tx=0).stop 2024-09-19T04:48:07.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.230+0000 7f17f804b640 1 -- 172.21.15.2:0/1861798615 shutdown_connections 2024-09-19T04:48:07.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.230+0000 7f17f804b640 1 --2- 172.21.15.2:0/1861798615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17f0106a80 0x7f17f019aa20 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:07.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.230+0000 7f17f804b640 1 --2- 172.21.15.2:0/1861798615 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17f0101420 0x7f17f0196690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:07.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.230+0000 7f17f804b640 1 --2- 172.21.15.2:0/1861798615 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f17dc0a3440 0x7f17dc0a5900 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:07.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.230+0000 7f17f804b640 1 --2- 172.21.15.2:0/1861798615 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f17f0100a80 0x7f17f0196150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:07.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.230+0000 7f17f804b640 1 -- 172.21.15.2:0/1861798615 >> 172.21.15.2:0/1861798615 conn(0x7f17f00fc7a0 msgr2=0x7f17f00fd110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:07.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.230+0000 7f17f804b640 1 -- 172.21.15.2:0/1861798615 shutdown_connections 2024-09-19T04:48:07.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:07.230+0000 7f17f804b640 1 -- 172.21.15.2:0/1861798615 wait complete. 2024-09-19T04:48:07.604 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:07 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/1861798615' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:48:07.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:07 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/1861798615' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:48:07.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:07 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/1861798615' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:48:07.923 DEBUG:tasks.fwd_scrub:Yielding 2024-09-19T04:48:07.923 INFO:teuthology.run_tasks:Running task exec... 2024-09-19T04:48:07.933 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T04:48:07.933 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-19T04:48:07.934 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/log_level debug' 2024-09-19T04:48:07.934 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-19T04:48:07.934 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:48:07.934 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:48:08.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.047+0000 7f236f77f640 1 -- 172.21.15.2:0/146436677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2368101340 msgr2=0x7f236810d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:08.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.047+0000 7f236f77f640 1 --2- 172.21.15.2:0/146436677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2368101340 0x7f236810d870 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2360009930 tx=0x7f236002a420 comp rx=0 tx=0).stop 2024-09-19T04:48:08.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.047+0000 7f236f77f640 1 -- 172.21.15.2:0/146436677 shutdown_connections 2024-09-19T04:48:08.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.047+0000 7f236f77f640 1 --2- 172.21.15.2:0/146436677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2368101340 0x7f236810d870 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.047+0000 7f236f77f640 1 --2- 172.21.15.2:0/146436677 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23681009a0 0x7f2368100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.047+0000 7f236f77f640 1 --2- 172.21.15.2:0/146436677 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23681069b0 0x7f2368106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.047+0000 7f236f77f640 1 -- 172.21.15.2:0/146436677 >> 172.21.15.2:0/146436677 conn(0x7f23680779a0 msgr2=0x7f23680fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:08.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.047+0000 7f236f77f640 1 -- 172.21.15.2:0/146436677 shutdown_connections 2024-09-19T04:48:08.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.047+0000 7f236f77f640 1 -- 172.21.15.2:0/146436677 wait complete. 2024-09-19T04:48:08.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.047+0000 7f236f77f640 1 Processor -- start 2024-09-19T04:48:08.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.047+0000 7f236f77f640 1 -- start start 2024-09-19T04:48:08.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.048+0000 7f236f77f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23681009a0 0x7f23681971f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:08.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.048+0000 7f236f77f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2368101340 0x7f2368197730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:08.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.048+0000 7f236f77f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23681069b0 0x7f236819bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:08.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.048+0000 7f236f77f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2368110ca0 con 0x7f23681009a0 2024-09-19T04:48:08.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.048+0000 7f236f77f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2368110b20 con 0x7f2368101340 2024-09-19T04:48:08.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.048+0000 7f236f77f640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f2368110e20 con 0x7f23681069b0 2024-09-19T04:48:08.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.048+0000 7f236d51b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23681009a0 0x7f23681971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:08.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.048+0000 7f236d51b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23681009a0 0x7f23681971f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45464/0 (socket says 172.21.15.2:45464) 2024-09-19T04:48:08.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.048+0000 7f236d51b640 1 -- 172.21.15.2:0/3758417849 learned_addr learned my addr 172.21.15.2:0/3758417849 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:48:08.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.048+0000 7f236dd1c640 1 --2- 172.21.15.2:0/3758417849 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23681069b0 0x7f236819bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:08.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.048+0000 7f236cd1a640 1 --2- 172.21.15.2:0/3758417849 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2368101340 0x7f2368197730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:08.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.048+0000 7f236d51b640 1 -- 172.21.15.2:0/3758417849 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23681069b0 msgr2=0x7f236819bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:08.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.048+0000 7f236d51b640 1 --2- 172.21.15.2:0/3758417849 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23681069b0 0x7f236819bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.048+0000 7f236d51b640 1 -- 172.21.15.2:0/3758417849 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2368101340 msgr2=0x7f2368197730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:08.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.048+0000 7f236d51b640 1 --2- 172.21.15.2:0/3758417849 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2368101340 0x7f2368197730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.048+0000 7f236d51b640 1 -- 172.21.15.2:0/3758417849 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f236819c1e0 con 0x7f23681009a0 2024-09-19T04:48:08.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.048+0000 7f236dd1c640 1 --2- 172.21.15.2:0/3758417849 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23681069b0 0x7f236819bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:48:08.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.048+0000 7f236cd1a640 1 --2- 172.21.15.2:0/3758417849 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2368101340 0x7f2368197730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:48:08.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.048+0000 7f236d51b640 1 --2- 172.21.15.2:0/3758417849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23681009a0 0x7f23681971f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2364007c70 tx=0x7f236400e420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:08.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.048+0000 7f235a7fc640 1 -- 172.21.15.2:0/3758417849 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2364019020 con 0x7f23681009a0 2024-09-19T04:48:08.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.048+0000 7f235a7fc640 1 -- 172.21.15.2:0/3758417849 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f236400c2e0 con 0x7f23681009a0 2024-09-19T04:48:08.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.048+0000 7f236f77f640 1 -- 172.21.15.2:0/3758417849 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f236819c4d0 con 0x7f23681009a0 2024-09-19T04:48:08.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.048+0000 7f235a7fc640 1 -- 172.21.15.2:0/3758417849 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23640055f0 con 0x7f23681009a0 2024-09-19T04:48:08.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.048+0000 7f236f77f640 1 -- 172.21.15.2:0/3758417849 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2368069a10 con 0x7f23681009a0 2024-09-19T04:48:08.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.049+0000 7f236f77f640 1 -- 172.21.15.2:0/3758417849 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23681020e0 con 0x7f23681009a0 2024-09-19T04:48:08.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.051+0000 7f235a7fc640 1 -- 172.21.15.2:0/3758417849 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138530+0+0 (secure 0 0 0) 0x7f2364005790 con 0x7f23681009a0 2024-09-19T04:48:08.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.051+0000 7f235a7fc640 1 --2- 172.21.15.2:0/3758417849 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f23540a34c0 0x7f23540a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:08.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.052+0000 7f236cd1a640 1 --2- 172.21.15.2:0/3758417849 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f23540a34c0 0x7f23540a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:08.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.052+0000 7f235a7fc640 1 -- 172.21.15.2:0/3758417849 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f23640d1e90 con 0x7f23681009a0 2024-09-19T04:48:08.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.052+0000 7f236cd1a640 1 --2- 172.21.15.2:0/3758417849 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f23540a34c0 0x7f23540a5980 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f235c0058c0 tx=0x7f235c005850 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:08.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.059+0000 7f235a7fc640 1 -- 172.21.15.2:0/3758417849 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2364023020 con 0x7f23681009a0 2024-09-19T04:48:08.220 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:48:08.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.263+0000 7f236f77f640 1 -- 172.21.15.2:0/3758417849 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7f2368100e00 con 0x7f23681009a0 2024-09-19T04:48:08.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.266+0000 7f235a7fc640 1 -- 172.21.15.2:0/3758417849 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v31)=0 v31) ==== 129+0+0 (secure 0 0 0) 0x7f236409e7b0 con 0x7f23681009a0 2024-09-19T04:48:08.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.268+0000 7f236f77f640 1 -- 172.21.15.2:0/3758417849 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f23540a34c0 msgr2=0x7f23540a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:08.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.268+0000 7f236f77f640 1 --2- 172.21.15.2:0/3758417849 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f23540a34c0 0x7f23540a5980 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f235c0058c0 tx=0x7f235c005850 comp rx=0 tx=0).stop 2024-09-19T04:48:08.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.268+0000 7f236f77f640 1 -- 172.21.15.2:0/3758417849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23681009a0 msgr2=0x7f23681971f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:08.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.268+0000 7f236f77f640 1 --2- 172.21.15.2:0/3758417849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23681009a0 0x7f23681971f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2364007c70 tx=0x7f236400e420 comp rx=0 tx=0).stop 2024-09-19T04:48:08.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.269+0000 7f236f77f640 1 -- 172.21.15.2:0/3758417849 shutdown_connections 2024-09-19T04:48:08.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.269+0000 7f236f77f640 1 --2- 172.21.15.2:0/3758417849 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f23540a34c0 0x7f23540a5980 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.269+0000 7f236f77f640 1 --2- 172.21.15.2:0/3758417849 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23681069b0 0x7f236819bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.269+0000 7f236f77f640 1 --2- 172.21.15.2:0/3758417849 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2368101340 0x7f2368197730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.269+0000 7f236f77f640 1 --2- 172.21.15.2:0/3758417849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23681009a0 0x7f23681971f0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.269+0000 7f236f77f640 1 -- 172.21.15.2:0/3758417849 >> 172.21.15.2:0/3758417849 conn(0x7f23680779a0 msgr2=0x7f2368103920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:08.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.269+0000 7f236f77f640 1 -- 172.21.15.2:0/3758417849 shutdown_connections 2024-09-19T04:48:08.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.269+0000 7f236f77f640 1 -- 172.21.15.2:0/3758417849 wait complete. 2024-09-19T04:48:08.282 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-09-19T04:48:08.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.390+0000 7f0c79f4b640 1 -- 172.21.15.2:0/3890436439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c74102c30 msgr2=0x7f0c74103010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:08.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.390+0000 7f0c79f4b640 1 --2- 172.21.15.2:0/3890436439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c74102c30 0x7f0c74103010 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0c64009900 tx=0x7f0c6402a410 comp rx=0 tx=0).stop 2024-09-19T04:48:08.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.390+0000 7f0c79f4b640 1 -- 172.21.15.2:0/3890436439 shutdown_connections 2024-09-19T04:48:08.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.390+0000 7f0c79f4b640 1 --2- 172.21.15.2:0/3890436439 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c7410c130 0x7f0c7410e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.390+0000 7f0c79f4b640 1 --2- 172.21.15.2:0/3890436439 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0c741035e0 0x7f0c7410bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.390+0000 7f0c79f4b640 1 --2- 172.21.15.2:0/3890436439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c74102c30 0x7f0c74103010 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.390+0000 7f0c79f4b640 1 -- 172.21.15.2:0/3890436439 >> 172.21.15.2:0/3890436439 conn(0x7f0c740fc6f0 msgr2=0x7f0c740feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:08.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.390+0000 7f0c79f4b640 1 -- 172.21.15.2:0/3890436439 shutdown_connections 2024-09-19T04:48:08.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.390+0000 7f0c79f4b640 1 -- 172.21.15.2:0/3890436439 wait complete. 2024-09-19T04:48:08.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.390+0000 7f0c79f4b640 1 Processor -- start 2024-09-19T04:48:08.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.390+0000 7f0c79f4b640 1 -- start start 2024-09-19T04:48:08.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.391+0000 7f0c79f4b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0c74102c30 0x7f0c74198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:08.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.391+0000 7f0c79f4b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c741035e0 0x7f0c74198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:08.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.391+0000 7f0c79f4b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c7410c130 0x7f0c7419cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:08.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.391+0000 7f0c79f4b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0c74111de0 con 0x7f0c7410c130 2024-09-19T04:48:08.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.391+0000 7f0c79f4b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0c74111c60 con 0x7f0c741035e0 2024-09-19T04:48:08.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.391+0000 7f0c79f4b640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f0c74111f60 con 0x7f0c74102c30 2024-09-19T04:48:08.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.391+0000 7f0c73fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c7410c130 0x7f0c7419cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:08.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.391+0000 7f0c73fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c7410c130 0x7f0c7419cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45496/0 (socket says 172.21.15.2:45496) 2024-09-19T04:48:08.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.391+0000 7f0c73fff640 1 -- 172.21.15.2:0/3167379211 learned_addr learned my addr 172.21.15.2:0/3167379211 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:48:08.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.391+0000 7f0c737fe640 1 --2- 172.21.15.2:0/3167379211 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0c74102c30 0x7f0c74198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:08.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.391+0000 7f0c6affd640 1 --2- 172.21.15.2:0/3167379211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c741035e0 0x7f0c74198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:08.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.391+0000 7f0c73fff640 1 -- 172.21.15.2:0/3167379211 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0c74102c30 msgr2=0x7f0c74198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:08.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.391+0000 7f0c73fff640 1 --2- 172.21.15.2:0/3167379211 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0c74102c30 0x7f0c74198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.391+0000 7f0c73fff640 1 -- 172.21.15.2:0/3167379211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c741035e0 msgr2=0x7f0c74198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:08.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.391+0000 7f0c73fff640 1 --2- 172.21.15.2:0/3167379211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c741035e0 0x7f0c74198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.391+0000 7f0c73fff640 1 -- 172.21.15.2:0/3167379211 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c7419d330 con 0x7f0c7410c130 2024-09-19T04:48:08.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.391+0000 7f0c73fff640 1 --2- 172.21.15.2:0/3167379211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c7410c130 0x7f0c7419cc00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c00eaa0 tx=0x7f0c6c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:08.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.391+0000 7f0c717fa640 1 -- 172.21.15.2:0/3167379211 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c00cdb0 con 0x7f0c7410c130 2024-09-19T04:48:08.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.391+0000 7f0c717fa640 1 -- 172.21.15.2:0/3167379211 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0c6c005020 con 0x7f0c7410c130 2024-09-19T04:48:08.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.392+0000 7f0c79f4b640 1 -- 172.21.15.2:0/3167379211 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c7419d620 con 0x7f0c7410c130 2024-09-19T04:48:08.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.392+0000 7f0c717fa640 1 -- 172.21.15.2:0/3167379211 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c0116d0 con 0x7f0c7410c130 2024-09-19T04:48:08.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.392+0000 7f0c79f4b640 1 -- 172.21.15.2:0/3167379211 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c741a4eb0 con 0x7f0c7410c130 2024-09-19T04:48:08.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.392+0000 7f0c79f4b640 1 -- 172.21.15.2:0/3167379211 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c74103010 con 0x7f0c7410c130 2024-09-19T04:48:08.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.394+0000 7f0c717fa640 1 -- 172.21.15.2:0/3167379211 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138530+0+0 (secure 0 0 0) 0x7f0c6c0051d0 con 0x7f0c7410c130 2024-09-19T04:48:08.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.395+0000 7f0c717fa640 1 --2- 172.21.15.2:0/3167379211 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f0c600a34c0 0x7f0c600a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:08.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.395+0000 7f0c737fe640 1 --2- 172.21.15.2:0/3167379211 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f0c600a34c0 0x7f0c600a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:08.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.395+0000 7f0c717fa640 1 -- 172.21.15.2:0/3167379211 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f0c6c0d02a0 con 0x7f0c7410c130 2024-09-19T04:48:08.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.395+0000 7f0c737fe640 1 --2- 172.21.15.2:0/3167379211 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f0c600a34c0 0x7f0c600a5980 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0c64005ab0 tx=0x7f0c64005a20 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:08.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.397+0000 7f0c717fa640 1 -- 172.21.15.2:0/3167379211 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0c6c016030 con 0x7f0c7410c130 2024-09-19T04:48:08.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.576+0000 7f0c79f4b640 1 -- 172.21.15.2:0/3167379211 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f0c74199690 con 0x7f0c7410c130 2024-09-19T04:48:08.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.580+0000 7f0c717fa640 1 -- 172.21.15.2:0/3167379211 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v32)=0 v32) ==== 138+0+0 (secure 0 0 0) 0x7f0c74199690 con 0x7f0c7410c130 2024-09-19T04:48:08.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.582+0000 7f0c79f4b640 1 -- 172.21.15.2:0/3167379211 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f0c600a34c0 msgr2=0x7f0c600a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:08.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.582+0000 7f0c79f4b640 1 --2- 172.21.15.2:0/3167379211 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f0c600a34c0 0x7f0c600a5980 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0c64005ab0 tx=0x7f0c64005a20 comp rx=0 tx=0).stop 2024-09-19T04:48:08.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.582+0000 7f0c79f4b640 1 -- 172.21.15.2:0/3167379211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c7410c130 msgr2=0x7f0c7419cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:08.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.582+0000 7f0c79f4b640 1 --2- 172.21.15.2:0/3167379211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c7410c130 0x7f0c7419cc00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c00eaa0 tx=0x7f0c6c00ef60 comp rx=0 tx=0).stop 2024-09-19T04:48:08.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.583+0000 7f0c79f4b640 1 -- 172.21.15.2:0/3167379211 shutdown_connections 2024-09-19T04:48:08.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.583+0000 7f0c79f4b640 1 --2- 172.21.15.2:0/3167379211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c7410c130 0x7f0c7419cc00 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.583+0000 7f0c79f4b640 1 --2- 172.21.15.2:0/3167379211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c741035e0 0x7f0c74198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.583+0000 7f0c79f4b640 1 --2- 172.21.15.2:0/3167379211 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f0c600a34c0 0x7f0c600a5980 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.583+0000 7f0c79f4b640 1 --2- 172.21.15.2:0/3167379211 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0c74102c30 0x7f0c74198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.583+0000 7f0c79f4b640 1 -- 172.21.15.2:0/3167379211 >> 172.21.15.2:0/3167379211 conn(0x7f0c740fc6f0 msgr2=0x7f0c740fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:08.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.583+0000 7f0c79f4b640 1 -- 172.21.15.2:0/3167379211 shutdown_connections 2024-09-19T04:48:08.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.583+0000 7f0c79f4b640 1 -- 172.21.15.2:0/3167379211 wait complete. 2024-09-19T04:48:08.593 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:08 smithi002 ceph-mon[30975]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 0 B/s wr, 18 op/s 2024-09-19T04:48:08.594 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:08 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/3758417849' entity='client.admin' 2024-09-19T04:48:08.594 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:08 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:48:08.594 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:08 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:48:08.594 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:08 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:48:08.594 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:08 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:08.595 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-09-19T04:48:08.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.703+0000 7fcb35a53640 1 -- 172.21.15.2:0/1329795045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb3010e430 msgr2=0x7fcb30110820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:08.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.703+0000 7fcb35a53640 1 --2- 172.21.15.2:0/1329795045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb3010e430 0x7fcb30110820 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fcb28009ca0 tx=0x7fcb2802a8c0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.703+0000 7fcb35a53640 1 -- 172.21.15.2:0/1329795045 shutdown_connections 2024-09-19T04:48:08.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.703+0000 7fcb35a53640 1 --2- 172.21.15.2:0/1329795045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb3010e430 0x7fcb30110820 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.703+0000 7fcb35a53640 1 --2- 172.21.15.2:0/1329795045 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcb30101230 0x7fcb3010def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.703+0000 7fcb35a53640 1 --2- 172.21.15.2:0/1329795045 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb30100880 0x7fcb30100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.703+0000 7fcb35a53640 1 -- 172.21.15.2:0/1329795045 >> 172.21.15.2:0/1329795045 conn(0x7fcb300fc6b0 msgr2=0x7fcb300fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:08.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.703+0000 7fcb35a53640 1 -- 172.21.15.2:0/1329795045 shutdown_connections 2024-09-19T04:48:08.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.703+0000 7fcb35a53640 1 -- 172.21.15.2:0/1329795045 wait complete. 2024-09-19T04:48:08.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.703+0000 7fcb35a53640 1 Processor -- start 2024-09-19T04:48:08.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.703+0000 7fcb35a53640 1 -- start start 2024-09-19T04:48:08.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.704+0000 7fcb35a53640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcb30100880 0x7fcb3019a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:08.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.704+0000 7fcb35a53640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb30101230 0x7fcb3019a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:08.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.704+0000 7fcb35a53640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb3010e430 0x7fcb3019ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:08.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.704+0000 7fcb35a53640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcb30113f90 con 0x7fcb30101230 2024-09-19T04:48:08.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.704+0000 7fcb35a53640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcb30113e10 con 0x7fcb3010e430 2024-09-19T04:48:08.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.704+0000 7fcb35a53640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fcb30114110 con 0x7fcb30100880 2024-09-19T04:48:08.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.704+0000 7fcb2e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb30101230 0x7fcb3019a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:08.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.704+0000 7fcb2e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb30101230 0x7fcb3019a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45512/0 (socket says 172.21.15.2:45512) 2024-09-19T04:48:08.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.704+0000 7fcb2e7fc640 1 -- 172.21.15.2:0/1926189282 learned_addr learned my addr 172.21.15.2:0/1926189282 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:48:08.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.704+0000 7fcb2effd640 1 --2- 172.21.15.2:0/1926189282 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcb30100880 0x7fcb3019a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:08.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.704+0000 7fcb2f7fe640 1 --2- 172.21.15.2:0/1926189282 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb3010e430 0x7fcb3019ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:08.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.704+0000 7fcb2e7fc640 1 -- 172.21.15.2:0/1926189282 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcb30100880 msgr2=0x7fcb3019a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:08.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.704+0000 7fcb2e7fc640 1 --2- 172.21.15.2:0/1926189282 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcb30100880 0x7fcb3019a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.704+0000 7fcb2e7fc640 1 -- 172.21.15.2:0/1926189282 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb3010e430 msgr2=0x7fcb3019ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:08.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.704+0000 7fcb2e7fc640 1 --2- 172.21.15.2:0/1926189282 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb3010e430 0x7fcb3019ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.704+0000 7fcb2e7fc640 1 -- 172.21.15.2:0/1926189282 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb3019f490 con 0x7fcb30101230 2024-09-19T04:48:08.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.704+0000 7fcb2f7fe640 1 --2- 172.21.15.2:0/1926189282 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb3010e430 0x7fcb3019ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:48:08.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.704+0000 7fcb2e7fc640 1 --2- 172.21.15.2:0/1926189282 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb30101230 0x7fcb3019a9e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fcb2400e9f0 tx=0x7fcb2400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:08.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.705+0000 7fcb34a51640 1 -- 172.21.15.2:0/1926189282 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2400cd80 con 0x7fcb30101230 2024-09-19T04:48:08.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.705+0000 7fcb34a51640 1 -- 172.21.15.2:0/1926189282 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcb240108e0 con 0x7fcb30101230 2024-09-19T04:48:08.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.705+0000 7fcb35a53640 1 -- 172.21.15.2:0/1926189282 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb3019f780 con 0x7fcb30101230 2024-09-19T04:48:08.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.705+0000 7fcb34a51640 1 -- 172.21.15.2:0/1926189282 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb24018920 con 0x7fcb30101230 2024-09-19T04:48:08.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.705+0000 7fcb35a53640 1 -- 172.21.15.2:0/1926189282 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb301a7010 con 0x7fcb30101230 2024-09-19T04:48:08.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.706+0000 7fcb35a53640 1 -- 172.21.15.2:0/1926189282 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb30100c60 con 0x7fcb30101230 2024-09-19T04:48:08.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.708+0000 7fcb34a51640 1 -- 172.21.15.2:0/1926189282 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138530+0+0 (secure 0 0 0) 0x7fcb24010a90 con 0x7fcb30101230 2024-09-19T04:48:08.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.709+0000 7fcb34a51640 1 --2- 172.21.15.2:0/1926189282 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fcb180a3440 0x7fcb180a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:08.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.709+0000 7fcb2effd640 1 --2- 172.21.15.2:0/1926189282 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fcb180a3440 0x7fcb180a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:08.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.709+0000 7fcb34a51640 1 -- 172.21.15.2:0/1926189282 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7fcb240d06a0 con 0x7fcb30101230 2024-09-19T04:48:08.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.709+0000 7fcb2effd640 1 --2- 172.21.15.2:0/1926189282 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fcb180a3440 0x7fcb180a5900 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcb2000bbe0 tx=0x7fcb2000b390 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:08.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.711+0000 7fcb34a51640 1 -- 172.21.15.2:0/1926189282 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcb2409ced0 con 0x7fcb30101230 2024-09-19T04:48:08.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.728+0000 7f3775cde640 1 -- 172.21.15.2:0/2795024459 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3770102570 msgr2=0x7f37701029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:08.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.728+0000 7f3775cde640 1 --2- 172.21.15.2:0/2795024459 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3770102570 0x7f37701029b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3764009900 tx=0x7f376402a480 comp rx=0 tx=0).stop 2024-09-19T04:48:08.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.728+0000 7f3775cde640 1 -- 172.21.15.2:0/2795024459 shutdown_connections 2024-09-19T04:48:08.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.728+0000 7f3775cde640 1 --2- 172.21.15.2:0/2795024459 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3770102ef0 0x7f377010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.728+0000 7f3775cde640 1 --2- 172.21.15.2:0/2795024459 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3770102570 0x7f37701029b0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.728+0000 7f3775cde640 1 --2- 172.21.15.2:0/2795024459 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3770100e20 0x7f3770101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.728+0000 7f3775cde640 1 -- 172.21.15.2:0/2795024459 >> 172.21.15.2:0/2795024459 conn(0x7f37700fc7d0 msgr2=0x7f37700febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:08.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.728+0000 7f3775cde640 1 -- 172.21.15.2:0/2795024459 shutdown_connections 2024-09-19T04:48:08.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.728+0000 7f3775cde640 1 -- 172.21.15.2:0/2795024459 wait complete. 2024-09-19T04:48:08.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.729+0000 7f3775cde640 1 Processor -- start 2024-09-19T04:48:08.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.729+0000 7f3775cde640 1 -- start start 2024-09-19T04:48:08.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.729+0000 7f3775cde640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3770100e20 0x7f377019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:08.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.729+0000 7f3775cde640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3770102570 0x7f377019ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:08.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.729+0000 7f3775cde640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3770102ef0 0x7f377019eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:08.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.729+0000 7f3775cde640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3770110e80 con 0x7f3770100e20 2024-09-19T04:48:08.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.729+0000 7f3775cde640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3770110d00 con 0x7f3770102ef0 2024-09-19T04:48:08.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.729+0000 7f3775cde640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f3770111000 con 0x7f3770102570 2024-09-19T04:48:08.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.729+0000 7f376f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3770100e20 0x7f377019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:08.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.729+0000 7f376f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3770100e20 0x7f377019a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45532/0 (socket says 172.21.15.2:45532) 2024-09-19T04:48:08.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.729+0000 7f376f7fe640 1 -- 172.21.15.2:0/3552892303 learned_addr learned my addr 172.21.15.2:0/3552892303 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:48:08.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.729+0000 7f376effd640 1 --2- 172.21.15.2:0/3552892303 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3770102570 0x7f377019ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:08.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.730+0000 7f376ffff640 1 --2- 172.21.15.2:0/3552892303 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3770102ef0 0x7f377019eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:08.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.730+0000 7f376f7fe640 1 -- 172.21.15.2:0/3552892303 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3770102570 msgr2=0x7f377019ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:08.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.730+0000 7f376f7fe640 1 --2- 172.21.15.2:0/3552892303 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3770102570 0x7f377019ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.730+0000 7f376f7fe640 1 -- 172.21.15.2:0/3552892303 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3770102ef0 msgr2=0x7f377019eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:08.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.730+0000 7f376f7fe640 1 --2- 172.21.15.2:0/3552892303 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3770102ef0 0x7f377019eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.730+0000 7f376f7fe640 1 -- 172.21.15.2:0/3552892303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f377019f5d0 con 0x7f3770100e20 2024-09-19T04:48:08.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.730+0000 7f376f7fe640 1 --2- 172.21.15.2:0/3552892303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3770100e20 0x7f377019a620 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f376000c890 tx=0x7f376000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:08.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.730+0000 7f376cff9640 1 -- 172.21.15.2:0/3552892303 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3760004220 con 0x7f3770100e20 2024-09-19T04:48:08.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.730+0000 7f376cff9640 1 -- 172.21.15.2:0/3552892303 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f37600043c0 con 0x7f3770100e20 2024-09-19T04:48:08.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.730+0000 7f3775cde640 1 -- 172.21.15.2:0/3552892303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f377019f8c0 con 0x7f3770100e20 2024-09-19T04:48:08.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.730+0000 7f376cff9640 1 -- 172.21.15.2:0/3552892303 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3760004a00 con 0x7f3770100e20 2024-09-19T04:48:08.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.730+0000 7f3775cde640 1 -- 172.21.15.2:0/3552892303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37701a71a0 con 0x7f3770100e20 2024-09-19T04:48:08.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.733+0000 7f376cff9640 1 -- 172.21.15.2:0/3552892303 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138530+0+0 (secure 0 0 0) 0x7f3760004ba0 con 0x7f3770100e20 2024-09-19T04:48:08.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.733+0000 7f37780b7740 1 Processor -- start 2024-09-19T04:48:08.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.733+0000 7f37780b7740 1 -- start start 2024-09-19T04:48:08.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.733+0000 7f37780b7740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b8335eba80 0x55b8335ebe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:08.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.733+0000 7f37780b7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b8335ec3a0 0x55b8335ff010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:08.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.733+0000 7f37780b7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335ff550 0x55b833601940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:08.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.733+0000 7f37780b7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b833551280 con 0x55b8335ff550 2024-09-19T04:48:08.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.733+0000 7f37780b7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b8334f8b10 con 0x55b8335ec3a0 2024-09-19T04:48:08.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.733+0000 7f37780b7740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55b83354d240 con 0x55b8335eba80 2024-09-19T04:48:08.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.733+0000 7f376effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335ff550 0x55b833601940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:08.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.733+0000 7f376effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335ff550 0x55b833601940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45536/0 (socket says 172.21.15.2:45536) 2024-09-19T04:48:08.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.733+0000 7f376effd640 1 -- 172.21.15.2:0/4278582398 learned_addr learned my addr 172.21.15.2:0/4278582398 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:48:08.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.733+0000 7f376ffff640 1 --2- 172.21.15.2:0/4278582398 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b8335eba80 0x55b8335ebe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:08.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.733+0000 7f376f7fe640 1 --2- 172.21.15.2:0/4278582398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b8335ec3a0 0x55b8335ff010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:08.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.733+0000 7f376effd640 1 -- 172.21.15.2:0/4278582398 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b8335eba80 msgr2=0x55b8335ebe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:48:08.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.733+0000 7f376effd640 1 --2- 172.21.15.2:0/4278582398 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b8335eba80 0x55b8335ebe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.733+0000 7f376effd640 1 -- 172.21.15.2:0/4278582398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b8335ec3a0 msgr2=0x55b8335ff010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:48:08.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.733+0000 7f376effd640 1 --2- 172.21.15.2:0/4278582398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b8335ec3a0 0x55b8335ff010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.733+0000 7f376effd640 1 -- 172.21.15.2:0/4278582398 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8335051f0 con 0x55b8335ff550 2024-09-19T04:48:08.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.734+0000 7f376cff9640 1 --2- 172.21.15.2:0/3552892303 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f37580a34c0 0x7f37580a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:08.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.734+0000 7f376effd640 1 --2- 172.21.15.2:0/4278582398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335ff550 0x55b833601940 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3764009900 tx=0x7f3764004310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56541c417ec70e95 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:08.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.734+0000 7f376ffff640 1 --2- 172.21.15.2:0/3552892303 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f37580a34c0 0x7f37580a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:08.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.734+0000 7f376cff9640 1 -- 172.21.15.2:0/3552892303 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f37600cfae0 con 0x7f3770100e20 2024-09-19T04:48:08.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.734+0000 7f3755ffb640 1 -- 172.21.15.2:0/4278582398 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3764035040 con 0x55b8335ff550 2024-09-19T04:48:08.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.734+0000 7f3755ffb640 1 -- 172.21.15.2:0/4278582398 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3764004740 con 0x55b8335ff550 2024-09-19T04:48:08.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.734+0000 7f3755ffb640 1 -- 172.21.15.2:0/4278582398 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37640038e0 con 0x55b8335ff550 2024-09-19T04:48:08.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.735+0000 7f37780b7740 1 -- 172.21.15.2:0/4278582398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335ff550 msgr2=0x55b833601940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:08.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.735+0000 7f376ffff640 1 --2- 172.21.15.2:0/3552892303 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f37580a34c0 0x7f37580a5980 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3768005fd0 tx=0x7f3768009740 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:08.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.735+0000 7f37780b7740 1 --2- 172.21.15.2:0/4278582398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335ff550 0x55b833601940 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3764009900 tx=0x7f3764004310 comp rx=0 tx=0).stop 2024-09-19T04:48:08.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.735+0000 7f37780b7740 1 -- 172.21.15.2:0/4278582398 shutdown_connections 2024-09-19T04:48:08.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.735+0000 7f37780b7740 1 --2- 172.21.15.2:0/4278582398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335ff550 0x55b833601940 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.735+0000 7f37780b7740 1 --2- 172.21.15.2:0/4278582398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b8335ec3a0 0x55b8335ff010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.735+0000 7f37780b7740 1 --2- 172.21.15.2:0/4278582398 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b8335eba80 0x55b8335ebe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.735+0000 7f37780b7740 1 -- 172.21.15.2:0/4278582398 >> 172.21.15.2:0/4278582398 conn(0x55b8335e80f0 msgr2=0x55b8335e84d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:08.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.735+0000 7f37780b7740 1 -- 172.21.15.2:0/4278582398 shutdown_connections 2024-09-19T04:48:08.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.735+0000 7f37780b7740 1 -- 172.21.15.2:0/4278582398 wait complete. 2024-09-19T04:48:08.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.736+0000 7f37780b7740 1 -- start start 2024-09-19T04:48:08.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.736+0000 7f37780b7740 1 Processor -- start 2024-09-19T04:48:08.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.736+0000 7f37780b7740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b8335eba80 0x55b8335fc540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:08.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.736+0000 7f37780b7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335ec3a0 0x55b8335fca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:08.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.736+0000 7f37780b7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b8335ff550 0x55b8335fcfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:08.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.736+0000 7f37780b7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b833602060 con 0x55b8335ec3a0 2024-09-19T04:48:08.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.736+0000 7f37780b7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b83350bf10 con 0x55b8335ff550 2024-09-19T04:48:08.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.736+0000 7f376effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335ec3a0 0x55b8335fca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:08.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.737+0000 7f376effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335ec3a0 0x55b8335fca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45552/0 (socket says 172.21.15.2:45552) 2024-09-19T04:48:08.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.737+0000 7f376effd640 1 -- 172.21.15.2:0/2912775108 learned_addr learned my addr 172.21.15.2:0/2912775108 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:48:08.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.737+0000 7f37780b7740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55b8336021e0 con 0x55b8335eba80 2024-09-19T04:48:08.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.737+0000 7f376ffff640 1 --2- 172.21.15.2:0/2912775108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b8335ff550 0x55b8335fcfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:08.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.737+0000 7f376f7fe640 1 --2- 172.21.15.2:0/2912775108 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b8335eba80 0x55b8335fc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:08.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.737+0000 7f37780b7740 10 client.0 _ll_register_callbacks cb 0x55b8334d4a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:48:08.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.737+0000 7f376effd640 1 -- 172.21.15.2:0/2912775108 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b8335eba80 msgr2=0x55b8335fc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:48:08.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.737+0000 7f376effd640 1 --2- 172.21.15.2:0/2912775108 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b8335eba80 0x55b8335fc540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.737+0000 7f376effd640 1 -- 172.21.15.2:0/2912775108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b8335ff550 msgr2=0x55b8335fcfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:48:08.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.737+0000 7f376effd640 1 --2- 172.21.15.2:0/2912775108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b8335ff550 0x55b8335fcfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.737+0000 7f376effd640 1 -- 172.21.15.2:0/2912775108 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8332c26a0 con 0x55b8335ec3a0 2024-09-19T04:48:08.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.737+0000 7f37780b7740 1 -- 172.21.15.2:0/2912775108 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3764004740 con 0x55b8335ec3a0 2024-09-19T04:48:08.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.737+0000 7f376effd640 1 --2- 172.21.15.2:0/2912775108 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335ec3a0 0x55b8335fca80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3764004ec0 tx=0x7f3764000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c6ee6a9d81a06bc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:08.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.737+0000 7f374effd640 10 client.15240 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:48:08.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.737+0000 7f374effd640 1 -- 172.21.15.2:0/2912775108 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3764035070 con 0x55b8335ec3a0 2024-09-19T04:48:08.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.737+0000 7f374effd640 1 -- 172.21.15.2:0/2912775108 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f3764005130 con 0x55b8335ec3a0 2024-09-19T04:48:08.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.737+0000 7f374effd640 1 -- 172.21.15.2:0/2912775108 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f3764005370 con 0x55b8335ec3a0 2024-09-19T04:48:08.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.737+0000 7f37780b7740 10 client.15240 fetch_fsmap learned FSMap version 19 2024-09-19T04:48:08.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.738+0000 7f37780b7740 1 -- 172.21.15.2:0/2912775108 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55b83360dc50 con 0x55b8335ec3a0 2024-09-19T04:48:08.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.738+0000 7f374effd640 1 -- 172.21.15.2:0/2912775108 <== mon.0 v2:172.21.15.2:3300/0 4 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f3764059020 con 0x55b8335ec3a0 2024-09-19T04:48:08.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.738+0000 7f37780b7740 10 client.15240 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:48:08.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.738+0000 7f37780b7740 10 client.15240 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:48:08.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.738+0000 7f37780b7740 20 client.15240 populate_metadata read hostname 'smithi002' 2024-09-19T04:48:08.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.738+0000 7f37780b7740 1 --2- 172.21.15.2:0/2912775108 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55b83360efa0 0x55b833611390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:08.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.738+0000 7f37780b7740 4 client.15240 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:48:08.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.738+0000 7f37780b7740 1 -- 172.21.15.2:0/2912775108 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b83355e7f0 con 0x55b83360efa0 2024-09-19T04:48:08.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.738+0000 7f376f7fe640 1 --2- 172.21.15.2:0/2912775108 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55b83360efa0 0x55b833611390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:08.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.739+0000 7f374effd640 10 client.15240 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:48:08.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.739+0000 7f376f7fe640 1 --2- 172.21.15.2:0/2912775108 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55b83360efa0 0x55b833611390 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6e813a0012344a5 server_cookie=42aba8691cd044e in_seq=0 out_seq=0 2024-09-19T04:48:08.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.739+0000 7f374effd640 1 -- 172.21.15.2:0/2912775108 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b83355e7f0 con 0x55b83360efa0 2024-09-19T04:48:08.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.739+0000 7f374effd640 10 client.15240 handle_command_reply: tid=0 2024-09-19T04:48:08.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.740+0000 7f37780b7740 1 client.15240 shutdown 2024-09-19T04:48:08.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.740+0000 7f37780b7740 1 -- 172.21.15.2:0/2912775108 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335ec3a0 msgr2=0x55b8335fca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:08.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.740+0000 7f37780b7740 1 --2- 172.21.15.2:0/2912775108 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335ec3a0 0x55b8335fca80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3764004ec0 tx=0x7f3764000bc0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.740+0000 7f37780b7740 1 -- 172.21.15.2:0/2912775108 shutdown_connections 2024-09-19T04:48:08.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.740+0000 7f37780b7740 1 --2- 172.21.15.2:0/2912775108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b8335ff550 0x55b8335fcfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.740+0000 7f37780b7740 1 --2- 172.21.15.2:0/2912775108 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335ec3a0 0x55b8335fca80 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.740+0000 7f37780b7740 1 --2- 172.21.15.2:0/2912775108 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55b83360efa0 0x55b833611390 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.740+0000 7f37780b7740 1 --2- 172.21.15.2:0/2912775108 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b8335eba80 0x55b8335fc540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.740+0000 7f37780b7740 1 -- 172.21.15.2:0/2912775108 >> 172.21.15.2:0/2912775108 conn(0x55b8335e80f0 msgr2=0x55b8335edd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:08.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.740+0000 7f374effd640 0 client.15240 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:48:08.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.740+0000 7f37780b7740 1 -- 172.21.15.2:0/2912775108 shutdown_connections 2024-09-19T04:48:08.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.740+0000 7f37780b7740 1 -- 172.21.15.2:0/2912775108 wait complete. 2024-09-19T04:48:08.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.740+0000 7f37780b7740 20 client.15240 trim_cache size 0 max 16384 2024-09-19T04:48:08.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.757+0000 7f37780b7740 1 Processor -- start 2024-09-19T04:48:08.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.757+0000 7f37780b7740 1 -- start start 2024-09-19T04:48:08.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.758+0000 7f37780b7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b8335eba80 0x55b8335f97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:08.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.758+0000 7f37780b7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335ec3a0 0x55b8335f9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:08.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.758+0000 7f37780b7740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b8335ff550 0x55b83360a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:08.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.758+0000 7f37780b7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f37701a96e0 con 0x55b8335ec3a0 2024-09-19T04:48:08.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.758+0000 7f37780b7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f37701abf00 con 0x55b8335eba80 2024-09-19T04:48:08.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.758+0000 7f37780b7740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f37701a9d30 con 0x55b8335ff550 2024-09-19T04:48:08.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.758+0000 7f376effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335ec3a0 0x55b8335f9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:08.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.758+0000 7f376effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335ec3a0 0x55b8335f9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45554/0 (socket says 172.21.15.2:45554) 2024-09-19T04:48:08.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.758+0000 7f376effd640 1 -- 172.21.15.2:0/3495959230 learned_addr learned my addr 172.21.15.2:0/3495959230 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:48:08.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.758+0000 7f376f7fe640 1 --2- 172.21.15.2:0/3495959230 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b8335eba80 0x55b8335f97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:08.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.758+0000 7f376ffff640 1 --2- 172.21.15.2:0/3495959230 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b8335ff550 0x55b83360a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:08.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.758+0000 7f376effd640 1 -- 172.21.15.2:0/3495959230 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b8335ff550 msgr2=0x55b83360a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:48:08.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.758+0000 7f376effd640 1 --2- 172.21.15.2:0/3495959230 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b8335ff550 0x55b83360a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.758+0000 7f376effd640 1 -- 172.21.15.2:0/3495959230 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b8335eba80 msgr2=0x55b8335f97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:48:08.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.758+0000 7f376effd640 1 --2- 172.21.15.2:0/3495959230 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b8335eba80 0x55b8335f97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.758+0000 7f376effd640 1 -- 172.21.15.2:0/3495959230 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8335e2680 con 0x55b8335ec3a0 2024-09-19T04:48:08.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.759+0000 7f376effd640 1 --2- 172.21.15.2:0/3495959230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335ec3a0 0x55b8335f9ce0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3764004cf0 tx=0x7f3764035000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7e4be3815785d98 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:08.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.759+0000 7f37557fa640 1 -- 172.21.15.2:0/3495959230 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3764005600 con 0x55b8335ec3a0 2024-09-19T04:48:08.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.759+0000 7f37557fa640 1 -- 172.21.15.2:0/3495959230 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3764004740 con 0x55b8335ec3a0 2024-09-19T04:48:08.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.759+0000 7f37557fa640 1 -- 172.21.15.2:0/3495959230 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f376403c7c0 con 0x55b8335ec3a0 2024-09-19T04:48:08.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.759+0000 7f37780b7740 1 -- 172.21.15.2:0/3495959230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335ec3a0 msgr2=0x55b8335f9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:08.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.759+0000 7f37780b7740 1 --2- 172.21.15.2:0/3495959230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335ec3a0 0x55b8335f9ce0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3764004cf0 tx=0x7f3764035000 comp rx=0 tx=0).stop 2024-09-19T04:48:08.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.760+0000 7f37780b7740 1 -- 172.21.15.2:0/3495959230 shutdown_connections 2024-09-19T04:48:08.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.760+0000 7f37780b7740 1 --2- 172.21.15.2:0/3495959230 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b8335ff550 0x55b83360a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.760+0000 7f37780b7740 1 --2- 172.21.15.2:0/3495959230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335ec3a0 0x55b8335f9ce0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.760+0000 7f37780b7740 1 --2- 172.21.15.2:0/3495959230 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b8335eba80 0x55b8335f97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.760+0000 7f37780b7740 1 -- 172.21.15.2:0/3495959230 >> 172.21.15.2:0/3495959230 conn(0x55b8335e80f0 msgr2=0x55b8335f7870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:08.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.760+0000 7f37780b7740 1 -- 172.21.15.2:0/3495959230 shutdown_connections 2024-09-19T04:48:08.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.760+0000 7f37780b7740 1 -- 172.21.15.2:0/3495959230 wait complete. 2024-09-19T04:48:08.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.760+0000 7f37780b7740 1 -- start start 2024-09-19T04:48:08.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.760+0000 7f37780b7740 1 Processor -- start 2024-09-19T04:48:08.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.761+0000 7f37780b7740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b8335eba80 0x55b833611de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:08.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.761+0000 7f37780b7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335ec3a0 0x55b833612320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:08.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.761+0000 7f37780b7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b8335ff550 0x55b833612860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:08.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.761+0000 7f37780b7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f37701aa3c0 con 0x55b8335ec3a0 2024-09-19T04:48:08.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.761+0000 7f37780b7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f37701ab830 con 0x55b8335ff550 2024-09-19T04:48:08.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.761+0000 7f37780b7740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f37701aaa90 con 0x55b8335eba80 2024-09-19T04:48:08.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.761+0000 7f37780b7740 10 client.0 _ll_register_callbacks cb 0x7f37680095e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:48:08.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.761+0000 7f376f7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b8335eba80 0x55b833611de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:08.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.761+0000 7f376effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335ec3a0 0x55b833612320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:08.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.761+0000 7f376f7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b8335eba80 0x55b833611de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.2:51302/0 (socket says 172.21.15.2:51302) 2024-09-19T04:48:08.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.761+0000 7f376f7fe640 1 -- 172.21.15.2:0/2834694941 learned_addr learned my addr 172.21.15.2:0/2834694941 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:48:08.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.761+0000 7f376ffff640 1 --2- 172.21.15.2:0/2834694941 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b8335ff550 0x55b833612860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:08.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.761+0000 7f376f7fe640 1 -- 172.21.15.2:0/2834694941 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b8335ff550 msgr2=0x55b833612860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:48:08.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.761+0000 7f376f7fe640 1 --2- 172.21.15.2:0/2834694941 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b8335ff550 0x55b833612860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.761+0000 7f376f7fe640 1 -- 172.21.15.2:0/2834694941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335ec3a0 msgr2=0x55b833612320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:48:08.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.761+0000 7f376f7fe640 1 --2- 172.21.15.2:0/2834694941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335ec3a0 0x55b833612320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.761+0000 7f376f7fe640 1 -- 172.21.15.2:0/2834694941 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b833678960 con 0x55b8335eba80 2024-09-19T04:48:08.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.761+0000 7f376effd640 1 --2- 172.21.15.2:0/2834694941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335ec3a0 0x55b833612320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:48:08.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.761+0000 7f376f7fe640 1 --2- 172.21.15.2:0/2834694941 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b8335eba80 0x55b833611de0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f37600cd850 tx=0x7f3760086040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=398f57c0fd57df21 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:08.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.761+0000 7f374effd640 10 client.0 ms_handle_connect on v2:172.21.15.116:3300/0 2024-09-19T04:48:08.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.762+0000 7f374effd640 1 -- 172.21.15.2:0/2834694941 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f376001d040 con 0x55b8335eba80 2024-09-19T04:48:08.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.762+0000 7f374effd640 1 -- 172.21.15.2:0/2834694941 <== mon.1 v2:172.21.15.116:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f3760004e90 con 0x55b8335eba80 2024-09-19T04:48:08.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.762+0000 7f37780b7740 1 -- 172.21.15.2:0/2834694941 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3764004740 con 0x55b8335eba80 2024-09-19T04:48:08.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.762+0000 7f374effd640 1 -- 172.21.15.2:0/2834694941 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f376009bc70 con 0x55b8335eba80 2024-09-19T04:48:08.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.762+0000 7f37780b7740 10 client.24925 fetch_fsmap learned FSMap version 19 2024-09-19T04:48:08.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.762+0000 7f37780b7740 1 -- 172.21.15.2:0/2834694941 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55b833679c80 con 0x55b8335eba80 2024-09-19T04:48:08.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.762+0000 7f374effd640 1 -- 172.21.15.2:0/2834694941 <== mon.1 v2:172.21.15.116:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3764004740 con 0x55b8335eba80 2024-09-19T04:48:08.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.762+0000 7f374effd640 1 -- 172.21.15.2:0/2834694941 <== mon.1 v2:172.21.15.116:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f37600cd440 con 0x55b8335eba80 2024-09-19T04:48:08.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.762+0000 7f37780b7740 10 client.24925 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:48:08.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.762+0000 7f37780b7740 10 client.24925 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:48:08.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.762+0000 7f37780b7740 20 client.24925 populate_metadata read hostname 'smithi002' 2024-09-19T04:48:08.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.762+0000 7f37780b7740 1 --2- 172.21.15.2:0/2834694941 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55b83367a350 0x55b83367c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:08.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.762+0000 7f37780b7740 4 client.24925 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:48:08.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.762+0000 7f37780b7740 1 -- 172.21.15.2:0/2834694941 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b833558d00 con 0x55b83367a350 2024-09-19T04:48:08.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.763+0000 7f376effd640 1 --2- 172.21.15.2:0/2834694941 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55b83367a350 0x55b83367c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:08.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.763+0000 7f376effd640 1 --2- 172.21.15.2:0/2834694941 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55b83367a350 0x55b83367c760 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e54af7a9a46b10d4 server_cookie=fb188af2a43656f1 in_seq=0 out_seq=0 2024-09-19T04:48:08.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.763+0000 7f374effd640 10 client.24925 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:48:08.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.764+0000 7f374effd640 1 -- 172.21.15.2:0/2834694941 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b833558d00 con 0x55b83367a350 2024-09-19T04:48:08.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.764+0000 7f374effd640 10 client.24925 handle_command_reply: tid=0 2024-09-19T04:48:08.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.764+0000 7f37780b7740 1 client.24925 shutdown 2024-09-19T04:48:08.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.764+0000 7f37780b7740 1 -- 172.21.15.2:0/2834694941 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b8335eba80 msgr2=0x55b833611de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:08.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.764+0000 7f37780b7740 1 --2- 172.21.15.2:0/2834694941 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b8335eba80 0x55b833611de0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f37600cd850 tx=0x7f3760086040 comp rx=0 tx=0).stop 2024-09-19T04:48:08.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.764+0000 7f37780b7740 1 -- 172.21.15.2:0/2834694941 shutdown_connections 2024-09-19T04:48:08.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.764+0000 7f37780b7740 1 --2- 172.21.15.2:0/2834694941 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b8335ff550 0x55b833612860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.764+0000 7f37780b7740 1 --2- 172.21.15.2:0/2834694941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8335ec3a0 0x55b833612320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.764+0000 7f37780b7740 1 --2- 172.21.15.2:0/2834694941 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55b83367a350 0x55b83367c760 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.764+0000 7f37780b7740 1 --2- 172.21.15.2:0/2834694941 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b8335eba80 0x55b833611de0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.764+0000 7f37780b7740 1 -- 172.21.15.2:0/2834694941 >> 172.21.15.2:0/2834694941 conn(0x55b8335e80f0 msgr2=0x55b83360a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:08.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.764+0000 7f374effd640 0 client.24925 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:48:08.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.764+0000 7f37780b7740 1 -- 172.21.15.2:0/2834694941 shutdown_connections 2024-09-19T04:48:08.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.764+0000 7f37780b7740 1 -- 172.21.15.2:0/2834694941 wait complete. 2024-09-19T04:48:08.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.764+0000 7f37780b7740 20 client.24925 trim_cache size 0 max 16384 2024-09-19T04:48:08.771 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:48:08.771 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T04:48:08.771 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "3b545123-45d2-4617-ba50-df8cfb53d62f", 2024-09-19T04:48:08.771 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T04:48:08.771 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:48:08.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.765+0000 7f3775cde640 1 -- 172.21.15.2:0/3552892303 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f37580a34c0 msgr2=0x7f37580a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:08.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.765+0000 7f3775cde640 1 --2- 172.21.15.2:0/3552892303 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f37580a34c0 0x7f37580a5980 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3768005fd0 tx=0x7f3768009740 comp rx=0 tx=0).stop 2024-09-19T04:48:08.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.765+0000 7f3775cde640 1 -- 172.21.15.2:0/3552892303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3770100e20 msgr2=0x7f377019a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:08.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.765+0000 7f3775cde640 1 --2- 172.21.15.2:0/3552892303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3770100e20 0x7f377019a620 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f376000c890 tx=0x7f376000cd50 comp rx=0 tx=0).stop 2024-09-19T04:48:08.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.765+0000 7f3775cde640 1 -- 172.21.15.2:0/3552892303 shutdown_connections 2024-09-19T04:48:08.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.765+0000 7f3775cde640 1 --2- 172.21.15.2:0/3552892303 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3770102ef0 0x7f377019eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.765+0000 7f3775cde640 1 --2- 172.21.15.2:0/3552892303 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f37580a34c0 0x7f37580a5980 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.765+0000 7f3775cde640 1 --2- 172.21.15.2:0/3552892303 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3770102570 0x7f377019ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.765+0000 7f3775cde640 1 --2- 172.21.15.2:0/3552892303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3770100e20 0x7f377019a620 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.765+0000 7f3775cde640 1 -- 172.21.15.2:0/3552892303 >> 172.21.15.2:0/3552892303 conn(0x7f37700fc7d0 msgr2=0x7f37700ffc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:08.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.765+0000 7f3775cde640 1 -- 172.21.15.2:0/3552892303 shutdown_connections 2024-09-19T04:48:08.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.765+0000 7f3775cde640 1 -- 172.21.15.2:0/3552892303 wait complete. 2024-09-19T04:48:08.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:08 smithi018 ceph-mon[34537]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 0 B/s wr, 18 op/s 2024-09-19T04:48:08.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:08 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/3758417849' entity='client.admin' 2024-09-19T04:48:08.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:08 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:48:08.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:08 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:48:08.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:08 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:48:08.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:08 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:08.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:08 smithi116 ceph-mon[34477]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 0 B/s wr, 18 op/s 2024-09-19T04:48:08.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:08 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/3758417849' entity='client.admin' 2024-09-19T04:48:08.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:08 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:48:08.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:08 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:48:08.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:08 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:48:08.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:08 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:08.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.897+0000 7fcb35a53640 1 -- 172.21.15.2:0/1926189282 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7fcb3019b7f0 con 0x7fcb30101230 2024-09-19T04:48:08.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.901+0000 7fcb34a51640 1 -- 172.21.15.2:0/1926189282 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v33)=0 v33) ==== 133+0+0 (secure 0 0 0) 0x7fcb3019b7f0 con 0x7fcb30101230 2024-09-19T04:48:08.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.903+0000 7fcb35a53640 1 -- 172.21.15.2:0/1926189282 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fcb180a3440 msgr2=0x7fcb180a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:08.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.903+0000 7fcb35a53640 1 --2- 172.21.15.2:0/1926189282 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fcb180a3440 0x7fcb180a5900 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcb2000bbe0 tx=0x7fcb2000b390 comp rx=0 tx=0).stop 2024-09-19T04:48:08.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.903+0000 7fcb35a53640 1 -- 172.21.15.2:0/1926189282 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb30101230 msgr2=0x7fcb3019a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:08.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.903+0000 7fcb35a53640 1 --2- 172.21.15.2:0/1926189282 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb30101230 0x7fcb3019a9e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fcb2400e9f0 tx=0x7fcb2400eeb0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.903+0000 7fcb35a53640 1 -- 172.21.15.2:0/1926189282 shutdown_connections 2024-09-19T04:48:08.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.903+0000 7fcb35a53640 1 --2- 172.21.15.2:0/1926189282 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb3010e430 0x7fcb3019ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.903+0000 7fcb35a53640 1 --2- 172.21.15.2:0/1926189282 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb30101230 0x7fcb3019a9e0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.903+0000 7fcb35a53640 1 --2- 172.21.15.2:0/1926189282 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fcb180a3440 0x7fcb180a5900 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.903+0000 7fcb35a53640 1 --2- 172.21.15.2:0/1926189282 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcb30100880 0x7fcb3019a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:08.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.903+0000 7fcb35a53640 1 -- 172.21.15.2:0/1926189282 >> 172.21.15.2:0/1926189282 conn(0x7fcb300fc6b0 msgr2=0x7fcb300feaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:08.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.903+0000 7fcb35a53640 1 -- 172.21.15.2:0/1926189282 shutdown_connections 2024-09-19T04:48:08.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:08.903+0000 7fcb35a53640 1 -- 172.21.15.2:0/1926189282 wait complete. 2024-09-19T04:48:08.917 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-19T04:48:09.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.024+0000 7f376b865640 1 -- 172.21.15.2:0/899990661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3764101370 msgr2=0x7f376410d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:09.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.024+0000 7f376b865640 1 --2- 172.21.15.2:0/899990661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3764101370 0x7f376410d8a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f375c009cd0 tx=0x7f375c02a8e0 comp rx=0 tx=0).stop 2024-09-19T04:48:09.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.025+0000 7f376b865640 1 -- 172.21.15.2:0/899990661 shutdown_connections 2024-09-19T04:48:09.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.025+0000 7f376b865640 1 --2- 172.21.15.2:0/899990661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3764101370 0x7f376410d8a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:09.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.025+0000 7f376b865640 1 --2- 172.21.15.2:0/899990661 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37641009d0 0x7f3764100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:09.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.025+0000 7f376b865640 1 --2- 172.21.15.2:0/899990661 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f37641069e0 0x7f3764106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:09.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.025+0000 7f376b865640 1 -- 172.21.15.2:0/899990661 >> 172.21.15.2:0/899990661 conn(0x7f37640fc6b0 msgr2=0x7f37640fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:09.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.025+0000 7f376b865640 1 -- 172.21.15.2:0/899990661 shutdown_connections 2024-09-19T04:48:09.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.025+0000 7f376b865640 1 -- 172.21.15.2:0/899990661 wait complete. 2024-09-19T04:48:09.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.025+0000 7f376b865640 1 Processor -- start 2024-09-19T04:48:09.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.025+0000 7f376b865640 1 -- start start 2024-09-19T04:48:09.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.026+0000 7f376b865640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f37641009d0 0x7f3764198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:09.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.026+0000 7f376b865640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3764101370 0x7f3764198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:09.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.026+0000 7f376b865640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37641069e0 0x7f376419cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:09.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.026+0000 7f376b865640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3764110cd0 con 0x7f3764101370 2024-09-19T04:48:09.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.026+0000 7f376b865640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3764110b50 con 0x7f37641069e0 2024-09-19T04:48:09.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.026+0000 7f376b865640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f3764110e50 con 0x7f37641009d0 2024-09-19T04:48:09.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.026+0000 7f3768e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3764101370 0x7f3764198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:09.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.026+0000 7f3768e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3764101370 0x7f3764198870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45570/0 (socket says 172.21.15.2:45570) 2024-09-19T04:48:09.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.026+0000 7f3768e00640 1 -- 172.21.15.2:0/3911368106 learned_addr learned my addr 172.21.15.2:0/3911368106 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:48:09.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.026+0000 7f3769601640 1 --2- 172.21.15.2:0/3911368106 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f37641009d0 0x7f3764198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:09.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.026+0000 7f3769e02640 1 --2- 172.21.15.2:0/3911368106 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37641069e0 0x7f376419cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:09.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.026+0000 7f3768e00640 1 -- 172.21.15.2:0/3911368106 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f37641009d0 msgr2=0x7f3764198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:09.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.026+0000 7f3768e00640 1 --2- 172.21.15.2:0/3911368106 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f37641009d0 0x7f3764198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:09.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.026+0000 7f3768e00640 1 -- 172.21.15.2:0/3911368106 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37641069e0 msgr2=0x7f376419cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:09.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.026+0000 7f3768e00640 1 --2- 172.21.15.2:0/3911368106 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37641069e0 0x7f376419cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:09.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.026+0000 7f3768e00640 1 -- 172.21.15.2:0/3911368106 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f376419d320 con 0x7f3764101370 2024-09-19T04:48:09.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.026+0000 7f3769e02640 1 --2- 172.21.15.2:0/3911368106 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37641069e0 0x7f376419cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:48:09.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.026+0000 7f3768e00640 1 --2- 172.21.15.2:0/3911368106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3764101370 0x7f3764198870 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f375400e9f0 tx=0x7f375400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:09.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.026+0000 7f375a7fc640 1 -- 172.21.15.2:0/3911368106 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375400cd80 con 0x7f3764101370 2024-09-19T04:48:09.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.026+0000 7f375a7fc640 1 -- 172.21.15.2:0/3911368106 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f37540108e0 con 0x7f3764101370 2024-09-19T04:48:09.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.027+0000 7f376b865640 1 -- 172.21.15.2:0/3911368106 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f376419d610 con 0x7f3764101370 2024-09-19T04:48:09.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.027+0000 7f375a7fc640 1 -- 172.21.15.2:0/3911368106 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3754018920 con 0x7f3764101370 2024-09-19T04:48:09.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.027+0000 7f376b865640 1 -- 172.21.15.2:0/3911368106 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37641a4ea0 con 0x7f3764101370 2024-09-19T04:48:09.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.028+0000 7f376b865640 1 -- 172.21.15.2:0/3911368106 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3764100e30 con 0x7f3764101370 2024-09-19T04:48:09.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.029+0000 7f375a7fc640 1 -- 172.21.15.2:0/3911368106 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138530+0+0 (secure 0 0 0) 0x7f3754010a90 con 0x7f3764101370 2024-09-19T04:48:09.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.030+0000 7f375a7fc640 1 --2- 172.21.15.2:0/3911368106 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f37500a3440 0x7f37500a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:09.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.030+0000 7f3769601640 1 --2- 172.21.15.2:0/3911368106 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f37500a3440 0x7f37500a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:09.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.030+0000 7f375a7fc640 1 -- 172.21.15.2:0/3911368106 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f37540d0220 con 0x7f3764101370 2024-09-19T04:48:09.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.030+0000 7f3769601640 1 --2- 172.21.15.2:0/3911368106 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f37500a3440 0x7f37500a5900 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3760009b50 tx=0x7f3760005f90 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:09.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.034+0000 7f375a7fc640 1 -- 172.21.15.2:0/3911368106 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f375409cab0 con 0x7f3764101370 2024-09-19T04:48:09.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.239+0000 7f376b865640 1 -- 172.21.15.2:0/3911368106 --> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f3764062630 con 0x7f37500a3440 2024-09-19T04:48:09.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.306+0000 7f375a7fc640 1 -- 172.21.15.2:0/3911368106 <== mgr.15096 v2:172.21.15.2:6800/852329670 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f3764062630 con 0x7f37500a3440 2024-09-19T04:48:09.308 INFO:teuthology.orchestra.run.smithi002.stdout:Schedule set for path / 2024-09-19T04:48:09.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.308+0000 7f376b865640 1 -- 172.21.15.2:0/3911368106 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f37500a3440 msgr2=0x7f37500a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:09.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.308+0000 7f376b865640 1 --2- 172.21.15.2:0/3911368106 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f37500a3440 0x7f37500a5900 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3760009b50 tx=0x7f3760005f90 comp rx=0 tx=0).stop 2024-09-19T04:48:09.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.308+0000 7f376b865640 1 -- 172.21.15.2:0/3911368106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3764101370 msgr2=0x7f3764198870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:09.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.308+0000 7f376b865640 1 --2- 172.21.15.2:0/3911368106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3764101370 0x7f3764198870 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f375400e9f0 tx=0x7f375400eeb0 comp rx=0 tx=0).stop 2024-09-19T04:48:09.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.308+0000 7f376b865640 1 -- 172.21.15.2:0/3911368106 shutdown_connections 2024-09-19T04:48:09.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.308+0000 7f376b865640 1 --2- 172.21.15.2:0/3911368106 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37641069e0 0x7f376419cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:09.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.308+0000 7f376b865640 1 --2- 172.21.15.2:0/3911368106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3764101370 0x7f3764198870 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:09.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.308+0000 7f376b865640 1 --2- 172.21.15.2:0/3911368106 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f37500a3440 0x7f37500a5900 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:09.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.308+0000 7f376b865640 1 --2- 172.21.15.2:0/3911368106 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f37641009d0 0x7f3764198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:09.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.308+0000 7f376b865640 1 -- 172.21.15.2:0/3911368106 >> 172.21.15.2:0/3911368106 conn(0x7f37640fc6b0 msgr2=0x7f376406a620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:09.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.308+0000 7f376b865640 1 -- 172.21.15.2:0/3911368106 shutdown_connections 2024-09-19T04:48:09.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.308+0000 7f376b865640 1 -- 172.21.15.2:0/3911368106 wait complete. 2024-09-19T04:48:09.320 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-19T04:48:09.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.425+0000 7f7893b9f640 1 -- 172.21.15.2:0/367925953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f788c101380 msgr2=0x7f788c10d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:09.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.425+0000 7f7893b9f640 1 --2- 172.21.15.2:0/367925953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f788c101380 0x7f788c10d8b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7884009cd0 tx=0x7f788402a8e0 comp rx=0 tx=0).stop 2024-09-19T04:48:09.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.425+0000 7f7893b9f640 1 -- 172.21.15.2:0/367925953 shutdown_connections 2024-09-19T04:48:09.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.425+0000 7f7893b9f640 1 --2- 172.21.15.2:0/367925953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f788c101380 0x7f788c10d8b0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:09.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.425+0000 7f7893b9f640 1 --2- 172.21.15.2:0/367925953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f788c1009e0 0x7f788c100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:09.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.425+0000 7f7893b9f640 1 --2- 172.21.15.2:0/367925953 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f788c1069f0 0x7f788c106dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:09.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.425+0000 7f7893b9f640 1 -- 172.21.15.2:0/367925953 >> 172.21.15.2:0/367925953 conn(0x7f788c0fc6c0 msgr2=0x7f788c0feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:09.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.425+0000 7f7893b9f640 1 -- 172.21.15.2:0/367925953 shutdown_connections 2024-09-19T04:48:09.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.425+0000 7f7893b9f640 1 -- 172.21.15.2:0/367925953 wait complete. 2024-09-19T04:48:09.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.426+0000 7f7893b9f640 1 Processor -- start 2024-09-19T04:48:09.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.426+0000 7f7893b9f640 1 -- start start 2024-09-19T04:48:09.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.426+0000 7f7893b9f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f788c1009e0 0x7f788c1991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:09.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.426+0000 7f7893b9f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f788c101380 0x7f788c199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:09.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.426+0000 7f7893b9f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f788c1069f0 0x7f788c1a4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:09.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.426+0000 7f7893b9f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f788c110ce0 con 0x7f788c1009e0 2024-09-19T04:48:09.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.426+0000 7f7893b9f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f788c110b60 con 0x7f788c1069f0 2024-09-19T04:48:09.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.426+0000 7f7893b9f640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f788c110e60 con 0x7f788c101380 2024-09-19T04:48:09.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.426+0000 7f789193b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f788c1009e0 0x7f788c1991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:09.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.426+0000 7f789193b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f788c1009e0 0x7f788c1991d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45598/0 (socket says 172.21.15.2:45598) 2024-09-19T04:48:09.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.426+0000 7f789193b640 1 -- 172.21.15.2:0/3231693016 learned_addr learned my addr 172.21.15.2:0/3231693016 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:48:09.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.426+0000 7f789113a640 1 --2- 172.21.15.2:0/3231693016 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f788c101380 0x7f788c199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:09.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.427+0000 7f789193b640 1 -- 172.21.15.2:0/3231693016 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f788c101380 msgr2=0x7f788c199710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:09.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.427+0000 7f789193b640 1 --2- 172.21.15.2:0/3231693016 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f788c101380 0x7f788c199710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:09.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.427+0000 7f789193b640 1 -- 172.21.15.2:0/3231693016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f788c1069f0 msgr2=0x7f788c1a4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:09.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.427+0000 7f789193b640 1 --2- 172.21.15.2:0/3231693016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f788c1069f0 0x7f788c1a4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:09.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.427+0000 7f789193b640 1 -- 172.21.15.2:0/3231693016 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f788c1a4790 con 0x7f788c1009e0 2024-09-19T04:48:09.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.427+0000 7f789193b640 1 --2- 172.21.15.2:0/3231693016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f788c1009e0 0x7f788c1991d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f788800c890 tx=0x7f788800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:09.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.427+0000 7f7882ffd640 1 -- 172.21.15.2:0/3231693016 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7888004220 con 0x7f788c1009e0 2024-09-19T04:48:09.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.427+0000 7f7882ffd640 1 -- 172.21.15.2:0/3231693016 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f78880043c0 con 0x7f788c1009e0 2024-09-19T04:48:09.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.427+0000 7f7893b9f640 1 -- 172.21.15.2:0/3231693016 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f788c1a4960 con 0x7f788c1009e0 2024-09-19T04:48:09.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.427+0000 7f7882ffd640 1 -- 172.21.15.2:0/3231693016 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7888004a00 con 0x7f788c1009e0 2024-09-19T04:48:09.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.427+0000 7f7893b9f640 1 -- 172.21.15.2:0/3231693016 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f788c1a4ed0 con 0x7f788c1009e0 2024-09-19T04:48:09.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.428+0000 7f7893b9f640 1 -- 172.21.15.2:0/3231693016 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f788c100e40 con 0x7f788c1009e0 2024-09-19T04:48:09.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.429+0000 7f7882ffd640 1 -- 172.21.15.2:0/3231693016 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138530+0+0 (secure 0 0 0) 0x7f7888004ba0 con 0x7f788c1009e0 2024-09-19T04:48:09.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.430+0000 7f7882ffd640 1 --2- 172.21.15.2:0/3231693016 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f78780a34c0 0x7f78780a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:09.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.430+0000 7f789113a640 1 --2- 172.21.15.2:0/3231693016 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f78780a34c0 0x7f78780a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:09.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.430+0000 7f7882ffd640 1 -- 172.21.15.2:0/3231693016 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f78880cfe50 con 0x7f788c1009e0 2024-09-19T04:48:09.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.430+0000 7f789113a640 1 --2- 172.21.15.2:0/3231693016 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f78780a34c0 0x7f78780a5980 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f788c06ae70 tx=0x7f787c00a2d0 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:09.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.433+0000 7f7882ffd640 1 -- 172.21.15.2:0/3231693016 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7888014030 con 0x7f788c1009e0 2024-09-19T04:48:09.511 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:48:09.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.637+0000 7f7893b9f640 1 -- 172.21.15.2:0/3231693016 --> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7f788c062630 con 0x7f78780a34c0 2024-09-19T04:48:09.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.699+0000 7f7882ffd640 1 -- 172.21.15.2:0/3231693016 <== mgr.15096 v2:172.21.15.2:6800/852329670 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f788c062630 con 0x7f78780a34c0 2024-09-19T04:48:09.701 INFO:teuthology.orchestra.run.smithi002.stdout:Retention added to path / 2024-09-19T04:48:09.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.701+0000 7f7893b9f640 1 -- 172.21.15.2:0/3231693016 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f78780a34c0 msgr2=0x7f78780a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:09.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.701+0000 7f7893b9f640 1 --2- 172.21.15.2:0/3231693016 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f78780a34c0 0x7f78780a5980 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f788c06ae70 tx=0x7f787c00a2d0 comp rx=0 tx=0).stop 2024-09-19T04:48:09.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.701+0000 7f7893b9f640 1 -- 172.21.15.2:0/3231693016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f788c1009e0 msgr2=0x7f788c1991d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:09.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.701+0000 7f7893b9f640 1 --2- 172.21.15.2:0/3231693016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f788c1009e0 0x7f788c1991d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f788800c890 tx=0x7f788800cd50 comp rx=0 tx=0).stop 2024-09-19T04:48:09.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.701+0000 7f7893b9f640 1 -- 172.21.15.2:0/3231693016 shutdown_connections 2024-09-19T04:48:09.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.701+0000 7f7893b9f640 1 --2- 172.21.15.2:0/3231693016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f788c1069f0 0x7f788c1a4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:09.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.701+0000 7f7893b9f640 1 --2- 172.21.15.2:0/3231693016 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f78780a34c0 0x7f78780a5980 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:09.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.701+0000 7f7893b9f640 1 --2- 172.21.15.2:0/3231693016 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f788c101380 0x7f788c199710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:09.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.701+0000 7f7893b9f640 1 --2- 172.21.15.2:0/3231693016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f788c1009e0 0x7f788c1991d0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:09.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.701+0000 7f7893b9f640 1 -- 172.21.15.2:0/3231693016 >> 172.21.15.2:0/3231693016 conn(0x7f788c0fc6c0 msgr2=0x7f788c0fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:09.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.701+0000 7f7893b9f640 1 -- 172.21.15.2:0/3231693016 shutdown_connections 2024-09-19T04:48:09.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.701+0000 7f7893b9f640 1 -- 172.21.15.2:0/3231693016 wait complete. 2024-09-19T04:48:09.714 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-19T04:48:09.783 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:48:09.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.826+0000 7fd619131640 1 -- 172.21.15.2:0/984182359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd614101340 msgr2=0x7fd61410d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:09.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.826+0000 7fd619131640 1 --2- 172.21.15.2:0/984182359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd614101340 0x7fd61410d870 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd60c009cd0 tx=0x7fd60c02a8e0 comp rx=0 tx=0).stop 2024-09-19T04:48:09.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.826+0000 7fd619131640 1 -- 172.21.15.2:0/984182359 shutdown_connections 2024-09-19T04:48:09.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.826+0000 7fd619131640 1 --2- 172.21.15.2:0/984182359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd614101340 0x7fd61410d870 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:09.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.826+0000 7fd619131640 1 --2- 172.21.15.2:0/984182359 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd6141009a0 0x7fd614100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:09.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.826+0000 7fd619131640 1 --2- 172.21.15.2:0/984182359 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6141069b0 0x7fd614106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:09.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.826+0000 7fd619131640 1 -- 172.21.15.2:0/984182359 >> 172.21.15.2:0/984182359 conn(0x7fd6140779a0 msgr2=0x7fd6140fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:09.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.826+0000 7fd619131640 1 -- 172.21.15.2:0/984182359 shutdown_connections 2024-09-19T04:48:09.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.826+0000 7fd619131640 1 -- 172.21.15.2:0/984182359 wait complete. 2024-09-19T04:48:09.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.827+0000 7fd619131640 1 Processor -- start 2024-09-19T04:48:09.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.827+0000 7fd619131640 1 -- start start 2024-09-19T04:48:09.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.827+0000 7fd619131640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6141009a0 0x7fd6141990b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:09.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.827+0000 7fd619131640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd614101340 0x7fd6141995f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:09.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.827+0000 7fd619131640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6141069b0 0x7fd6141a4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:09.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.827+0000 7fd619131640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd614110ca0 con 0x7fd6141069b0 2024-09-19T04:48:09.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.827+0000 7fd619131640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd614110b20 con 0x7fd6141009a0 2024-09-19T04:48:09.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.827+0000 7fd619131640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fd614110e20 con 0x7fd614101340 2024-09-19T04:48:09.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.827+0000 7fd61359e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6141069b0 0x7fd6141a4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:09.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.827+0000 7fd61359e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6141069b0 0x7fd6141a4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45614/0 (socket says 172.21.15.2:45614) 2024-09-19T04:48:09.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.827+0000 7fd61359e640 1 -- 172.21.15.2:0/4255141190 learned_addr learned my addr 172.21.15.2:0/4255141190 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:48:09.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.827+0000 7fd61259c640 1 --2- 172.21.15.2:0/4255141190 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd614101340 0x7fd6141995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:09.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.828+0000 7fd612d9d640 1 --2- 172.21.15.2:0/4255141190 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6141009a0 0x7fd6141990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:09.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.828+0000 7fd61359e640 1 -- 172.21.15.2:0/4255141190 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd614101340 msgr2=0x7fd6141995f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:09.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.828+0000 7fd61359e640 1 --2- 172.21.15.2:0/4255141190 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd614101340 0x7fd6141995f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:09.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.828+0000 7fd61359e640 1 -- 172.21.15.2:0/4255141190 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6141009a0 msgr2=0x7fd6141990b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:09.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.828+0000 7fd61359e640 1 --2- 172.21.15.2:0/4255141190 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6141009a0 0x7fd6141990b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:09.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.828+0000 7fd61359e640 1 -- 172.21.15.2:0/4255141190 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6141a4670 con 0x7fd6141069b0 2024-09-19T04:48:09.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.828+0000 7fd61359e640 1 --2- 172.21.15.2:0/4255141190 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6141069b0 0x7fd6141a4130 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd60c005cc0 tx=0x7fd60c003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:09.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.828+0000 7fd5fbfff640 1 -- 172.21.15.2:0/4255141190 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd60c004240 con 0x7fd6141069b0 2024-09-19T04:48:09.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.828+0000 7fd5fbfff640 1 -- 172.21.15.2:0/4255141190 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd60c0305a0 con 0x7fd6141069b0 2024-09-19T04:48:09.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.828+0000 7fd619131640 1 -- 172.21.15.2:0/4255141190 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6141a4840 con 0x7fd6141069b0 2024-09-19T04:48:09.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.828+0000 7fd5fbfff640 1 -- 172.21.15.2:0/4255141190 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd60c0466c0 con 0x7fd6141069b0 2024-09-19T04:48:09.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.828+0000 7fd619131640 1 -- 172.21.15.2:0/4255141190 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6141a4d00 con 0x7fd6141069b0 2024-09-19T04:48:09.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.829+0000 7fd619131640 1 -- 172.21.15.2:0/4255141190 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd614100e00 con 0x7fd6141069b0 2024-09-19T04:48:09.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.830+0000 7fd5fbfff640 1 -- 172.21.15.2:0/4255141190 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138530+0+0 (secure 0 0 0) 0x7fd60c030ac0 con 0x7fd6141069b0 2024-09-19T04:48:09.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.831+0000 7fd5fbfff640 1 --2- 172.21.15.2:0/4255141190 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fd5fc0a3440 0x7fd5fc0a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:09.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.831+0000 7fd612d9d640 1 --2- 172.21.15.2:0/4255141190 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fd5fc0a3440 0x7fd5fc0a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:09.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.831+0000 7fd5fbfff640 1 -- 172.21.15.2:0/4255141190 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7fd60c02e030 con 0x7fd6141069b0 2024-09-19T04:48:09.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.831+0000 7fd612d9d640 1 --2- 172.21.15.2:0/4255141190 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fd5fc0a3440 0x7fd5fc0a5900 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd60400cac0 tx=0x7fd60400c4a0 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:09.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:09.835+0000 7fd5fbfff640 1 -- 172.21.15.2:0/4255141190 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd60c04b060 con 0x7fd6141069b0 2024-09-19T04:48:09.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:09 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/3167379211' entity='client.admin' 2024-09-19T04:48:09.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:09 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:48:09.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:09 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:48:09.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:09 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:48:09.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:09 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:09.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:09 smithi002 ceph-mon[30975]: scrub queued for path: / 2024-09-19T04:48:09.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:09 smithi002 ceph-mon[30975]: scrub summary: idle+waiting paths [/] 2024-09-19T04:48:09.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:09 smithi002 ceph-mon[30975]: scrub summary: active paths [/] 2024-09-19T04:48:09.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:09 smithi002 ceph-mon[30975]: scrub summary: idle+waiting paths [/] 2024-09-19T04:48:09.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:09 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/1926189282' entity='client.admin' 2024-09-19T04:48:09.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:09 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:48:09.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:09 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:48:09.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:09 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:48:09.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:09 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:09.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:09 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/3167379211' entity='client.admin' 2024-09-19T04:48:09.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:09 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:48:09.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:09 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:48:09.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:09 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:48:09.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:09 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:09.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:09 smithi116 ceph-mon[34477]: scrub queued for path: / 2024-09-19T04:48:09.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:09 smithi116 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-19T04:48:09.863 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:09 smithi116 ceph-mon[34477]: scrub summary: active paths [/] 2024-09-19T04:48:09.863 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:09 smithi116 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-19T04:48:09.863 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:09 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/1926189282' entity='client.admin' 2024-09-19T04:48:09.863 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:09 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:48:09.863 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:09 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:48:09.863 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:09 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:48:09.863 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:09 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:10.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.041+0000 7fd619131640 1 -- 172.21.15.2:0/4255141190 --> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7fd614103e30 con 0x7fd5fc0a3440 2024-09-19T04:48:10.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.048+0000 7fd5fbfff640 1 -- 172.21.15.2:0/4255141190 <== mgr.15096 v2:172.21.15.2:6800/852329670 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7fd614103e30 con 0x7fd5fc0a3440 2024-09-19T04:48:10.049 INFO:teuthology.orchestra.run.smithi002.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-19T00:00:00", "created": "2024-09-19T04:48:09", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-19T04:48:10.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.050+0000 7fd619131640 1 -- 172.21.15.2:0/4255141190 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fd5fc0a3440 msgr2=0x7fd5fc0a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:10.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.050+0000 7fd619131640 1 --2- 172.21.15.2:0/4255141190 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fd5fc0a3440 0x7fd5fc0a5900 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd60400cac0 tx=0x7fd60400c4a0 comp rx=0 tx=0).stop 2024-09-19T04:48:10.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.050+0000 7fd619131640 1 -- 172.21.15.2:0/4255141190 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6141069b0 msgr2=0x7fd6141a4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:10.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.050+0000 7fd619131640 1 --2- 172.21.15.2:0/4255141190 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6141069b0 0x7fd6141a4130 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd60c005cc0 tx=0x7fd60c003ba0 comp rx=0 tx=0).stop 2024-09-19T04:48:10.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.050+0000 7fd619131640 1 -- 172.21.15.2:0/4255141190 shutdown_connections 2024-09-19T04:48:10.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.050+0000 7fd619131640 1 --2- 172.21.15.2:0/4255141190 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6141069b0 0x7fd6141a4130 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:10.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.050+0000 7fd619131640 1 --2- 172.21.15.2:0/4255141190 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fd5fc0a3440 0x7fd5fc0a5900 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:10.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.050+0000 7fd619131640 1 --2- 172.21.15.2:0/4255141190 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd614101340 0x7fd6141995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:10.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.050+0000 7fd619131640 1 --2- 172.21.15.2:0/4255141190 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6141009a0 0x7fd6141990b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:10.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.051+0000 7fd619131640 1 -- 172.21.15.2:0/4255141190 >> 172.21.15.2:0/4255141190 conn(0x7fd6140779a0 msgr2=0x7fd614103720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:10.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.051+0000 7fd619131640 1 -- 172.21.15.2:0/4255141190 shutdown_connections 2024-09-19T04:48:10.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.051+0000 7fd619131640 1 -- 172.21.15.2:0/4255141190 wait complete. 2024-09-19T04:48:10.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:09 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/3167379211' entity='client.admin' 2024-09-19T04:48:10.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:09 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:48:10.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:09 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:48:10.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:09 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:48:10.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:09 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:10.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:09 smithi018 ceph-mon[34537]: scrub queued for path: / 2024-09-19T04:48:10.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:09 smithi018 ceph-mon[34537]: scrub summary: idle+waiting paths [/] 2024-09-19T04:48:10.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:09 smithi018 ceph-mon[34537]: scrub summary: active paths [/] 2024-09-19T04:48:10.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:09 smithi018 ceph-mon[34537]: scrub summary: idle+waiting paths [/] 2024-09-19T04:48:10.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:09 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/1926189282' entity='client.admin' 2024-09-19T04:48:10.058 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:09 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:48:10.058 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:09 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:48:10.058 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:09 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:48:10.058 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:09 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:48:10.065 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-19T04:48:10.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.171+0000 7fcb365af640 1 -- 172.21.15.2:0/3313392241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb30102c80 msgr2=0x7fcb30103060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:10.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.171+0000 7fcb365af640 1 --2- 172.21.15.2:0/3313392241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb30102c80 0x7fcb30103060 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fcb20009900 tx=0x7fcb2002a480 comp rx=0 tx=0).stop 2024-09-19T04:48:10.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.171+0000 7fcb365af640 1 -- 172.21.15.2:0/3313392241 shutdown_connections 2024-09-19T04:48:10.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.171+0000 7fcb365af640 1 --2- 172.21.15.2:0/3313392241 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcb3010c0a0 0x7fcb3010e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:10.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.171+0000 7fcb365af640 1 --2- 172.21.15.2:0/3313392241 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb301035a0 0x7fcb3010ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:10.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.171+0000 7fcb365af640 1 --2- 172.21.15.2:0/3313392241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb30102c80 0x7fcb30103060 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:10.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.171+0000 7fcb365af640 1 -- 172.21.15.2:0/3313392241 >> 172.21.15.2:0/3313392241 conn(0x7fcb300779a0 msgr2=0x7fcb300fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:10.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.171+0000 7fcb365af640 1 -- 172.21.15.2:0/3313392241 shutdown_connections 2024-09-19T04:48:10.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.171+0000 7fcb365af640 1 -- 172.21.15.2:0/3313392241 wait complete. 2024-09-19T04:48:10.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.172+0000 7fcb365af640 1 Processor -- start 2024-09-19T04:48:10.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.172+0000 7fcb365af640 1 -- start start 2024-09-19T04:48:10.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.172+0000 7fcb365af640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb30102c80 0x7fcb3019a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:10.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.172+0000 7fcb365af640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcb301035a0 0x7fcb3019a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:10.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.172+0000 7fcb365af640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb3010c0a0 0x7fcb3019ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:10.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.172+0000 7fcb365af640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcb30111d50 con 0x7fcb30102c80 2024-09-19T04:48:10.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.172+0000 7fcb365af640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcb30111bd0 con 0x7fcb3010c0a0 2024-09-19T04:48:10.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.172+0000 7fcb365af640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fcb30111ed0 con 0x7fcb301035a0 2024-09-19T04:48:10.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.172+0000 7fcb2ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb30102c80 0x7fcb3019a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:10.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.172+0000 7fcb2ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb30102c80 0x7fcb3019a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45640/0 (socket says 172.21.15.2:45640) 2024-09-19T04:48:10.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.172+0000 7fcb2ffff640 1 -- 172.21.15.2:0/2688245572 learned_addr learned my addr 172.21.15.2:0/2688245572 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:48:10.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.172+0000 7fcb2f7fe640 1 --2- 172.21.15.2:0/2688245572 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcb301035a0 0x7fcb3019a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:10.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.172+0000 7fcb2ffff640 1 -- 172.21.15.2:0/2688245572 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcb301035a0 msgr2=0x7fcb3019a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:10.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.172+0000 7fcb2ffff640 1 --2- 172.21.15.2:0/2688245572 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcb301035a0 0x7fcb3019a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:10.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.172+0000 7fcb2ffff640 1 -- 172.21.15.2:0/2688245572 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb3010c0a0 msgr2=0x7fcb3019ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:10.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.172+0000 7fcb2ffff640 1 --2- 172.21.15.2:0/2688245572 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb3010c0a0 0x7fcb3019ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:10.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.172+0000 7fcb2ffff640 1 -- 172.21.15.2:0/2688245572 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb3019f4a0 con 0x7fcb30102c80 2024-09-19T04:48:10.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.173+0000 7fcb2ffff640 1 --2- 172.21.15.2:0/2688245572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb30102c80 0x7fcb3019a4b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fcb20005940 tx=0x7fcb200042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:10.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.173+0000 7fcb2d7fa640 1 -- 172.21.15.2:0/2688245572 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2003f030 con 0x7fcb30102c80 2024-09-19T04:48:10.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.173+0000 7fcb365af640 1 -- 172.21.15.2:0/2688245572 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb3019f730 con 0x7fcb30102c80 2024-09-19T04:48:10.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.173+0000 7fcb2d7fa640 1 -- 172.21.15.2:0/2688245572 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcb20003cb0 con 0x7fcb30102c80 2024-09-19T04:48:10.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.173+0000 7fcb2d7fa640 1 -- 172.21.15.2:0/2688245572 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb20035070 con 0x7fcb30102c80 2024-09-19T04:48:10.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.173+0000 7fcb365af640 1 -- 172.21.15.2:0/2688245572 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb301a7020 con 0x7fcb30102c80 2024-09-19T04:48:10.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.174+0000 7fcb365af640 1 -- 172.21.15.2:0/2688245572 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb3006a2e0 con 0x7fcb30102c80 2024-09-19T04:48:10.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.175+0000 7fcb2d7fa640 1 -- 172.21.15.2:0/2688245572 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138530+0+0 (secure 0 0 0) 0x7fcb20042030 con 0x7fcb30102c80 2024-09-19T04:48:10.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.176+0000 7fcb2d7fa640 1 --2- 172.21.15.2:0/2688245572 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fcb180a3440 0x7fcb180a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:10.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.176+0000 7fcb2d7fa640 1 -- 172.21.15.2:0/2688245572 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7fcb200f07c0 con 0x7fcb30102c80 2024-09-19T04:48:10.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.176+0000 7fcb2f7fe640 1 --2- 172.21.15.2:0/2688245572 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fcb180a3440 0x7fcb180a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:10.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.177+0000 7fcb2f7fe640 1 --2- 172.21.15.2:0/2688245572 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fcb180a3440 0x7fcb180a5900 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcb300ffd80 tx=0x7fcb2400b590 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:10.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.180+0000 7fcb2d7fa640 1 -- 172.21.15.2:0/2688245572 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcb200bd050 con 0x7fcb30102c80 2024-09-19T04:48:10.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.239+0000 7f8869870640 1 -- 172.21.15.2:0/1104731792 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8864102ef0 msgr2=0x7f886410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:10.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.239+0000 7f8869870640 1 --2- 172.21.15.2:0/1104731792 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8864102ef0 0x7f886410da40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f885c009ca0 tx=0x7f885c02a950 comp rx=0 tx=0).stop 2024-09-19T04:48:10.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.239+0000 7f8869870640 1 -- 172.21.15.2:0/1104731792 shutdown_connections 2024-09-19T04:48:10.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.239+0000 7f8869870640 1 --2- 172.21.15.2:0/1104731792 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8864102ef0 0x7f886410da40 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:10.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.239+0000 7f8869870640 1 --2- 172.21.15.2:0/1104731792 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8864102570 0x7f88641029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:10.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.239+0000 7f8869870640 1 --2- 172.21.15.2:0/1104731792 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8864100e20 0x7f8864101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:10.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.239+0000 7f8869870640 1 -- 172.21.15.2:0/1104731792 >> 172.21.15.2:0/1104731792 conn(0x7f88640fc7d0 msgr2=0x7f88640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:10.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.239+0000 7f8869870640 1 -- 172.21.15.2:0/1104731792 shutdown_connections 2024-09-19T04:48:10.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.239+0000 7f8869870640 1 -- 172.21.15.2:0/1104731792 wait complete. 2024-09-19T04:48:10.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.240+0000 7f8869870640 1 Processor -- start 2024-09-19T04:48:10.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.240+0000 7f8869870640 1 -- start start 2024-09-19T04:48:10.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.240+0000 7f8869870640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8864100e20 0x7f88640fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:10.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.240+0000 7f8869870640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8864102570 0x7f88640fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:10.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.240+0000 7f8869870640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8864102ef0 0x7f88640fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:10.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.240+0000 7f8869870640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8864110e30 con 0x7f8864100e20 2024-09-19T04:48:10.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.240+0000 7f8869870640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8864110cb0 con 0x7f8864102570 2024-09-19T04:48:10.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.240+0000 7f8869870640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f8864110fb0 con 0x7f8864102ef0 2024-09-19T04:48:10.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.240+0000 7f8862ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8864100e20 0x7f88640fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:10.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.240+0000 7f8862ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8864100e20 0x7f88640fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45652/0 (socket says 172.21.15.2:45652) 2024-09-19T04:48:10.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.240+0000 7f8862ffd640 1 -- 172.21.15.2:0/1884741413 learned_addr learned my addr 172.21.15.2:0/1884741413 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:48:10.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.241+0000 7f88637fe640 1 --2- 172.21.15.2:0/1884741413 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8864102ef0 0x7f88640fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:10.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.241+0000 7f885a7fc640 1 --2- 172.21.15.2:0/1884741413 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8864102570 0x7f88640fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:10.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.241+0000 7f8862ffd640 1 -- 172.21.15.2:0/1884741413 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8864102ef0 msgr2=0x7f88640fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:10.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.241+0000 7f8862ffd640 1 --2- 172.21.15.2:0/1884741413 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8864102ef0 0x7f88640fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:10.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.241+0000 7f8862ffd640 1 -- 172.21.15.2:0/1884741413 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8864102570 msgr2=0x7f88640fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:10.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.241+0000 7f8862ffd640 1 --2- 172.21.15.2:0/1884741413 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8864102570 0x7f88640fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:10.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.241+0000 7f8862ffd640 1 -- 172.21.15.2:0/1884741413 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88641a6850 con 0x7f8864100e20 2024-09-19T04:48:10.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.241+0000 7f885a7fc640 1 --2- 172.21.15.2:0/1884741413 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8864102570 0x7f88640fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:48:10.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.241+0000 7f8862ffd640 1 --2- 172.21.15.2:0/1884741413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8864100e20 0x7f88640fcc80 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f885400d950 tx=0x7f885400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:10.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.241+0000 7f886886e640 1 -- 172.21.15.2:0/1884741413 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8854017070 con 0x7f8864100e20 2024-09-19T04:48:10.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.241+0000 7f8869870640 1 -- 172.21.15.2:0/1884741413 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88641a6b40 con 0x7f8864100e20 2024-09-19T04:48:10.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.241+0000 7f886886e640 1 -- 172.21.15.2:0/1884741413 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8854009c30 con 0x7f8864100e20 2024-09-19T04:48:10.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.241+0000 7f886886e640 1 -- 172.21.15.2:0/1884741413 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f885400f620 con 0x7f8864100e20 2024-09-19T04:48:10.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.241+0000 7f8869870640 1 -- 172.21.15.2:0/1884741413 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88641a70d0 con 0x7f8864100e20 2024-09-19T04:48:10.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.243+0000 7f886886e640 1 -- 172.21.15.2:0/1884741413 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138530+0+0 (secure 0 0 0) 0x7f88540109a0 con 0x7f8864100e20 2024-09-19T04:48:10.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.244+0000 7f886886e640 1 --2- 172.21.15.2:0/1884741413 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f88500a34c0 0x7f88500a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:10.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.244+0000 7f885a7fc640 1 --2- 172.21.15.2:0/1884741413 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f88500a34c0 0x7f88500a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:10.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.244+0000 7f886886e640 1 -- 172.21.15.2:0/1884741413 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f88540cfb10 con 0x7f8864100e20 2024-09-19T04:48:10.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.245+0000 7f885a7fc640 1 --2- 172.21.15.2:0/1884741413 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f88500a34c0 0x7f88500a5980 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f88640fe710 tx=0x7f884c005f90 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:10.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.245+0000 7f886bc49740 1 Processor -- start 2024-09-19T04:48:10.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.245+0000 7f886bc49740 1 -- start start 2024-09-19T04:48:10.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.245+0000 7f886bc49740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ec074ba4a0 0x55ec074ba880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:10.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.245+0000 7f886bc49740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec074badc0 0x55ec074c5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:10.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.245+0000 7f886bc49740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ec074c5680 0x55ec074c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:10.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.245+0000 7f886bc49740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ec074202e0 con 0x55ec074badc0 2024-09-19T04:48:10.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.245+0000 7f886bc49740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ec073c7ce0 con 0x55ec074ba4a0 2024-09-19T04:48:10.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.245+0000 7f886bc49740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55ec0741c2a0 con 0x55ec074c5680 2024-09-19T04:48:10.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.245+0000 7f885a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec074badc0 0x55ec074c5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:10.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.246+0000 7f8862ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ec074ba4a0 0x55ec074ba880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:10.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.246+0000 7f885a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec074badc0 0x55ec074c5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45660/0 (socket says 172.21.15.2:45660) 2024-09-19T04:48:10.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.246+0000 7f885a7fc640 1 -- 172.21.15.2:0/608607606 learned_addr learned my addr 172.21.15.2:0/608607606 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:48:10.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.246+0000 7f88637fe640 1 --2- 172.21.15.2:0/608607606 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ec074c5680 0x55ec074c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:10.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.246+0000 7f885a7fc640 1 -- 172.21.15.2:0/608607606 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ec074c5680 msgr2=0x55ec074c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:48:10.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.246+0000 7f885a7fc640 1 --2- 172.21.15.2:0/608607606 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ec074c5680 0x55ec074c7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:10.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.246+0000 7f885a7fc640 1 -- 172.21.15.2:0/608607606 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ec074ba4a0 msgr2=0x55ec074ba880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:48:10.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.246+0000 7f885a7fc640 1 --2- 172.21.15.2:0/608607606 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ec074ba4a0 0x55ec074ba880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:10.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.246+0000 7f885a7fc640 1 -- 172.21.15.2:0/608607606 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec073ac440 con 0x55ec074badc0 2024-09-19T04:48:10.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.246+0000 7f88637fe640 1 --2- 172.21.15.2:0/608607606 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ec074c5680 0x55ec074c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:48:10.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.246+0000 7f885a7fc640 1 --2- 172.21.15.2:0/608607606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec074badc0 0x55ec074c5140 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f884c010e00 tx=0x7f884c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe94beeb34b589d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:10.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.246+0000 7f8859ffb640 1 -- 172.21.15.2:0/608607606 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884c023070 con 0x55ec074badc0 2024-09-19T04:48:10.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.246+0000 7f8859ffb640 1 -- 172.21.15.2:0/608607606 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f884c003610 con 0x55ec074badc0 2024-09-19T04:48:10.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.246+0000 7f8859ffb640 1 -- 172.21.15.2:0/608607606 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884c009740 con 0x55ec074badc0 2024-09-19T04:48:10.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.247+0000 7f886bc49740 1 -- 172.21.15.2:0/608607606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec074badc0 msgr2=0x55ec074c5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:10.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.247+0000 7f886bc49740 1 --2- 172.21.15.2:0/608607606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec074badc0 0x55ec074c5140 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f884c010e00 tx=0x7f884c013000 comp rx=0 tx=0).stop 2024-09-19T04:48:10.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.247+0000 7f886bc49740 1 -- 172.21.15.2:0/608607606 shutdown_connections 2024-09-19T04:48:10.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.247+0000 7f886bc49740 1 --2- 172.21.15.2:0/608607606 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ec074c5680 0x55ec074c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:10.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.247+0000 7f886bc49740 1 --2- 172.21.15.2:0/608607606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec074badc0 0x55ec074c5140 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:10.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.247+0000 7f886bc49740 1 --2- 172.21.15.2:0/608607606 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ec074ba4a0 0x55ec074ba880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:10.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.247+0000 7f886bc49740 1 -- 172.21.15.2:0/608607606 >> 172.21.15.2:0/608607606 conn(0x55ec074b6a30 msgr2=0x55ec074b6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:10.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.247+0000 7f886bc49740 1 -- 172.21.15.2:0/608607606 shutdown_connections 2024-09-19T04:48:10.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.247+0000 7f886bc49740 1 -- 172.21.15.2:0/608607606 wait complete. 2024-09-19T04:48:10.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.247+0000 7f886bc49740 1 -- start start 2024-09-19T04:48:10.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.248+0000 7f886bc49740 1 Processor -- start 2024-09-19T04:48:10.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.248+0000 7f886bc49740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ec074ba4a0 0x55ec074c4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:10.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.248+0000 7f886bc49740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ec074badc0 0x55ec074c2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:10.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.248+0000 7f886bc49740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec074c5680 0x55ec074c2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:10.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.248+0000 7f886bc49740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ec074c8250 con 0x55ec074c5680 2024-09-19T04:48:10.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.248+0000 7f886bc49740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ec073db050 con 0x55ec074ba4a0 2024-09-19T04:48:10.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.248+0000 7f886bc49740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55ec074c83d0 con 0x55ec074badc0 2024-09-19T04:48:10.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.248+0000 7f886bc49740 10 client.0 _ll_register_callbacks cb 0x55ec0741b160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:48:10.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.248+0000 7f88637fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec074c5680 0x55ec074c2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:10.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.248+0000 7f88637fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec074c5680 0x55ec074c2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45666/0 (socket says 172.21.15.2:45666) 2024-09-19T04:48:10.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.248+0000 7f88637fe640 1 -- 172.21.15.2:0/1430062236 learned_addr learned my addr 172.21.15.2:0/1430062236 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:48:10.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.248+0000 7f8862ffd640 1 --2- 172.21.15.2:0/1430062236 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ec074ba4a0 0x55ec074c4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:10.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.248+0000 7f885a7fc640 1 --2- 172.21.15.2:0/1430062236 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ec074badc0 0x55ec074c2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:10.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.248+0000 7f88637fe640 1 -- 172.21.15.2:0/1430062236 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ec074badc0 msgr2=0x55ec074c2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:48:10.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.248+0000 7f88637fe640 1 --2- 172.21.15.2:0/1430062236 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ec074badc0 0x55ec074c2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:10.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.248+0000 7f88637fe640 1 -- 172.21.15.2:0/1430062236 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ec074ba4a0 msgr2=0x55ec074c4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:48:10.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.248+0000 7f88637fe640 1 --2- 172.21.15.2:0/1430062236 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ec074ba4a0 0x55ec074c4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:10.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.248+0000 7f88637fe640 1 -- 172.21.15.2:0/1430062236 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec071913c0 con 0x55ec074c5680 2024-09-19T04:48:10.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.248+0000 7f8862ffd640 1 --2- 172.21.15.2:0/1430062236 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ec074ba4a0 0x55ec074c4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:48:10.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.249+0000 7f88637fe640 1 --2- 172.21.15.2:0/1430062236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec074c5680 0x55ec074c2780 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f885c005cc0 tx=0x7f885c02ffc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=211a3909fcc7d0b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:10.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.249+0000 7f8842ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:48:10.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.249+0000 7f8842ffd640 1 -- 172.21.15.2:0/1430062236 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f885c034040 con 0x55ec074c5680 2024-09-19T04:48:10.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.249+0000 7f8842ffd640 1 -- 172.21.15.2:0/1430062236 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f885c02f630 con 0x55ec074c5680 2024-09-19T04:48:10.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.249+0000 7f886bc49740 1 -- 172.21.15.2:0/1430062236 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f884c003610 con 0x55ec074c5680 2024-09-19T04:48:10.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.249+0000 7f8842ffd640 1 -- 172.21.15.2:0/1430062236 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f885c003970 con 0x55ec074c5680 2024-09-19T04:48:10.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.249+0000 7f886bc49740 10 client.15282 fetch_fsmap learned FSMap version 19 2024-09-19T04:48:10.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.249+0000 7f886bc49740 1 -- 172.21.15.2:0/1430062236 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55ec074d3c50 con 0x55ec074c5680 2024-09-19T04:48:10.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.249+0000 7f8842ffd640 1 -- 172.21.15.2:0/1430062236 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f884c003610 con 0x55ec074c5680 2024-09-19T04:48:10.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.249+0000 7f8842ffd640 1 -- 172.21.15.2:0/1430062236 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f885c04b020 con 0x55ec074c5680 2024-09-19T04:48:10.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.250+0000 7f886bc49740 10 client.15282 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:48:10.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.250+0000 7f886bc49740 10 client.15282 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:48:10.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.250+0000 7f886bc49740 20 client.15282 populate_metadata read hostname 'smithi002' 2024-09-19T04:48:10.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.250+0000 7f886bc49740 1 --2- 172.21.15.2:0/1430062236 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55ec074d5160 0x55ec074d75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:10.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.250+0000 7f886bc49740 4 client.15282 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:48:10.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.250+0000 7f886bc49740 1 -- 172.21.15.2:0/1430062236 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec0742d850 con 0x55ec074d5160 2024-09-19T04:48:10.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.250+0000 7f8862ffd640 1 --2- 172.21.15.2:0/1430062236 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55ec074d5160 0x55ec074d75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:10.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.250+0000 7f8862ffd640 1 --2- 172.21.15.2:0/1430062236 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55ec074d5160 0x55ec074d75c0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a194ce42da9259a7 server_cookie=1a8afb08caa2887b in_seq=0 out_seq=0 2024-09-19T04:48:10.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.250+0000 7f8842ffd640 10 client.15282 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:48:10.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.251+0000 7f8842ffd640 1 -- 172.21.15.2:0/1430062236 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ec0742d850 con 0x55ec074d5160 2024-09-19T04:48:10.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.251+0000 7f8842ffd640 10 client.15282 handle_command_reply: tid=0 2024-09-19T04:48:10.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.251+0000 7f886bc49740 1 client.15282 shutdown 2024-09-19T04:48:10.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.251+0000 7f886bc49740 1 -- 172.21.15.2:0/1430062236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec074c5680 msgr2=0x55ec074c2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:10.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.251+0000 7f886bc49740 1 --2- 172.21.15.2:0/1430062236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec074c5680 0x55ec074c2780 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f885c005cc0 tx=0x7f885c02ffc0 comp rx=0 tx=0).stop 2024-09-19T04:48:10.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.251+0000 7f886bc49740 1 -- 172.21.15.2:0/1430062236 shutdown_connections 2024-09-19T04:48:10.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.251+0000 7f886bc49740 1 --2- 172.21.15.2:0/1430062236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec074c5680 0x55ec074c2780 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:10.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.251+0000 7f886bc49740 1 --2- 172.21.15.2:0/1430062236 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55ec074d5160 0x55ec074d75c0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:10.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.251+0000 7f8842ffd640 0 client.15282 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:48:10.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.251+0000 7f886bc49740 1 --2- 172.21.15.2:0/1430062236 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ec074badc0 0x55ec074c2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:10.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.251+0000 7f886bc49740 1 --2- 172.21.15.2:0/1430062236 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ec074ba4a0 0x55ec074c4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:10.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.251+0000 7f886bc49740 1 -- 172.21.15.2:0/1430062236 >> 172.21.15.2:0/1430062236 conn(0x55ec074b6a30 msgr2=0x55ec074bc760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:10.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.252+0000 7f886bc49740 1 -- 172.21.15.2:0/1430062236 shutdown_connections 2024-09-19T04:48:10.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.252+0000 7f886bc49740 1 -- 172.21.15.2:0/1430062236 wait complete. 2024-09-19T04:48:10.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.252+0000 7f886bc49740 20 client.15282 trim_cache size 0 max 16384 2024-09-19T04:48:10.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.269+0000 7f886bc49740 1 Processor -- start 2024-09-19T04:48:10.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.269+0000 7f886bc49740 1 -- start start 2024-09-19T04:48:10.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.269+0000 7f886bc49740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ec074b6a30 0x55ec074c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:10.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.269+0000 7f886bc49740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ec074ba4a0 0x55ec074dce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:10.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.269+0000 7f886bc49740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec074badc0 0x55ec074dd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:10.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.269+0000 7f886bc49740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f88641ad890 con 0x55ec074badc0 2024-09-19T04:48:10.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.269+0000 7f886bc49740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f88641b0110 con 0x55ec074ba4a0 2024-09-19T04:48:10.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.269+0000 7f886bc49740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f88641adf00 con 0x55ec074b6a30 2024-09-19T04:48:10.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.269+0000 7f88637fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec074badc0 0x55ec074dd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:10.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.269+0000 7f88637fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec074badc0 0x55ec074dd3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45672/0 (socket says 172.21.15.2:45672) 2024-09-19T04:48:10.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.269+0000 7f88637fe640 1 -- 172.21.15.2:0/2999659410 learned_addr learned my addr 172.21.15.2:0/2999659410 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:48:10.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.269+0000 7f8862ffd640 1 --2- 172.21.15.2:0/2999659410 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ec074b6a30 0x55ec074c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:10.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.269+0000 7f885a7fc640 1 --2- 172.21.15.2:0/2999659410 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ec074ba4a0 0x55ec074dce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:10.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.269+0000 7f88637fe640 1 -- 172.21.15.2:0/2999659410 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ec074b6a30 msgr2=0x55ec074c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:48:10.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.269+0000 7f88637fe640 1 --2- 172.21.15.2:0/2999659410 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ec074b6a30 0x55ec074c41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:10.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.269+0000 7f88637fe640 1 -- 172.21.15.2:0/2999659410 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ec074ba4a0 msgr2=0x55ec074dce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:48:10.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.269+0000 7f88637fe640 1 --2- 172.21.15.2:0/2999659410 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ec074ba4a0 0x55ec074dce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:10.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.269+0000 7f88637fe640 1 -- 172.21.15.2:0/2999659410 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec074b76c0 con 0x55ec074badc0 2024-09-19T04:48:10.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.270+0000 7f8862ffd640 1 --2- 172.21.15.2:0/2999659410 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ec074b6a30 0x55ec074c41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:48:10.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.270+0000 7f88637fe640 1 --2- 172.21.15.2:0/2999659410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec074badc0 0x55ec074dd3d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f885c009ca0 tx=0x7f885c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b45cf075b1ecaa4f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:10.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.270+0000 7f88597fa640 1 -- 172.21.15.2:0/2999659410 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f885c034040 con 0x55ec074badc0 2024-09-19T04:48:10.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.270+0000 7f88597fa640 1 -- 172.21.15.2:0/2999659410 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f885c009880 con 0x55ec074badc0 2024-09-19T04:48:10.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.270+0000 7f88597fa640 1 -- 172.21.15.2:0/2999659410 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f885c04d9a0 con 0x55ec074badc0 2024-09-19T04:48:10.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.271+0000 7f886bc49740 1 -- 172.21.15.2:0/2999659410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec074badc0 msgr2=0x55ec074dd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:10.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.271+0000 7f886bc49740 1 --2- 172.21.15.2:0/2999659410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec074badc0 0x55ec074dd3d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f885c009ca0 tx=0x7f885c009b20 comp rx=0 tx=0).stop 2024-09-19T04:48:10.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.271+0000 7f886bc49740 1 -- 172.21.15.2:0/2999659410 shutdown_connections 2024-09-19T04:48:10.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.271+0000 7f886bc49740 1 --2- 172.21.15.2:0/2999659410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec074badc0 0x55ec074dd3d0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:10.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.271+0000 7f886bc49740 1 --2- 172.21.15.2:0/2999659410 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ec074ba4a0 0x55ec074dce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:10.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.271+0000 7f886bc49740 1 --2- 172.21.15.2:0/2999659410 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ec074b6a30 0x55ec074c41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:10.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.271+0000 7f886bc49740 1 -- 172.21.15.2:0/2999659410 >> 172.21.15.2:0/2999659410 conn(0x55ec074c28e0 msgr2=0x55ec074c3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:10.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.271+0000 7f886bc49740 1 -- 172.21.15.2:0/2999659410 shutdown_connections 2024-09-19T04:48:10.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.271+0000 7f886bc49740 1 -- 172.21.15.2:0/2999659410 wait complete. 2024-09-19T04:48:10.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.271+0000 7f886bc49740 1 -- start start 2024-09-19T04:48:10.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.271+0000 7f886bc49740 1 Processor -- start 2024-09-19T04:48:10.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.272+0000 7f886bc49740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ec074b6a30 0x55ec074cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:10.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.272+0000 7f886bc49740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec074ba4a0 0x55ec074cb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:10.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.272+0000 7f886bc49740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ec074badc0 0x55ec074cba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:10.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.272+0000 7f886bc49740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f88641ae5d0 con 0x55ec074ba4a0 2024-09-19T04:48:10.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.272+0000 7f886bc49740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f88641afa40 con 0x55ec074badc0 2024-09-19T04:48:10.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.272+0000 7f886bc49740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f88641aeca0 con 0x55ec074b6a30 2024-09-19T04:48:10.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.272+0000 7f886bc49740 10 client.0 _ll_register_callbacks cb 0x7f884c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:48:10.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.272+0000 7f885a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec074ba4a0 0x55ec074cb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:10.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.272+0000 7f885a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec074ba4a0 0x55ec074cb2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45674/0 (socket says 172.21.15.2:45674) 2024-09-19T04:48:10.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.272+0000 7f885a7fc640 1 -- 172.21.15.2:0/1410370051 learned_addr learned my addr 172.21.15.2:0/1410370051 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:48:10.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.272+0000 7f88637fe640 1 --2- 172.21.15.2:0/1410370051 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ec074badc0 0x55ec074cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:10.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.272+0000 7f8862ffd640 1 --2- 172.21.15.2:0/1410370051 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ec074b6a30 0x55ec074cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:10.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.272+0000 7f885a7fc640 1 -- 172.21.15.2:0/1410370051 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ec074b6a30 msgr2=0x55ec074cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:48:10.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.272+0000 7f885a7fc640 1 --2- 172.21.15.2:0/1410370051 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ec074b6a30 0x55ec074cdf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:10.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.272+0000 7f885a7fc640 1 -- 172.21.15.2:0/1410370051 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ec074badc0 msgr2=0x55ec074cba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:48:10.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.272+0000 7f885a7fc640 1 --2- 172.21.15.2:0/1410370051 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ec074badc0 0x55ec074cba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:10.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.272+0000 7f885a7fc640 1 -- 172.21.15.2:0/1410370051 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec0753ee70 con 0x55ec074ba4a0 2024-09-19T04:48:10.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.272+0000 7f88637fe640 1 --2- 172.21.15.2:0/1410370051 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ec074badc0 0x55ec074cba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:48:10.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.272+0000 7f8862ffd640 1 --2- 172.21.15.2:0/1410370051 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ec074b6a30 0x55ec074cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:48:10.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.272+0000 7f885a7fc640 1 --2- 172.21.15.2:0/1410370051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec074ba4a0 0x55ec074cb2d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f884c010e00 tx=0x7f884c0097d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d11b32215c9e5f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:10.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.272+0000 7f8842ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:48:10.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.272+0000 7f8842ffd640 1 -- 172.21.15.2:0/1410370051 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884c023040 con 0x55ec074ba4a0 2024-09-19T04:48:10.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.272+0000 7f8842ffd640 1 -- 172.21.15.2:0/1410370051 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f884c005350 con 0x55ec074ba4a0 2024-09-19T04:48:10.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.272+0000 7f886bc49740 1 -- 172.21.15.2:0/1410370051 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f885c009880 con 0x55ec074ba4a0 2024-09-19T04:48:10.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.273+0000 7f8842ffd640 1 -- 172.21.15.2:0/1410370051 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f884c005550 con 0x55ec074ba4a0 2024-09-19T04:48:10.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.273+0000 7f886bc49740 10 client.15288 fetch_fsmap learned FSMap version 19 2024-09-19T04:48:10.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.273+0000 7f886bc49740 1 -- 172.21.15.2:0/1410370051 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55ec07540060 con 0x55ec074ba4a0 2024-09-19T04:48:10.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.273+0000 7f8842ffd640 1 -- 172.21.15.2:0/1410370051 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f885c009880 con 0x55ec074ba4a0 2024-09-19T04:48:10.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.273+0000 7f8842ffd640 1 -- 172.21.15.2:0/1410370051 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f884c039070 con 0x55ec074ba4a0 2024-09-19T04:48:10.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.273+0000 7f886bc49740 10 client.15288 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:48:10.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.273+0000 7f886bc49740 10 client.15288 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:48:10.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.273+0000 7f886bc49740 20 client.15288 populate_metadata read hostname 'smithi002' 2024-09-19T04:48:10.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.273+0000 7f886bc49740 1 --2- 172.21.15.2:0/1410370051 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55ec074c5680 0x55ec07542640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:10.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.273+0000 7f886bc49740 4 client.15288 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:48:10.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.273+0000 7f886bc49740 1 -- 172.21.15.2:0/1410370051 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ec07427d60 con 0x55ec074c5680 2024-09-19T04:48:10.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.273+0000 7f8862ffd640 1 --2- 172.21.15.2:0/1410370051 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55ec074c5680 0x55ec07542640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:10.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.274+0000 7f8862ffd640 1 --2- 172.21.15.2:0/1410370051 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55ec074c5680 0x55ec07542640 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10372f686d367ffe server_cookie=f851ffd7bda34d4a in_seq=0 out_seq=0 2024-09-19T04:48:10.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.274+0000 7f8842ffd640 10 client.15288 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:48:10.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.274+0000 7f8842ffd640 1 -- 172.21.15.2:0/1410370051 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55ec07427d60 con 0x55ec074c5680 2024-09-19T04:48:10.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.274+0000 7f8842ffd640 10 client.15288 handle_command_reply: tid=0 2024-09-19T04:48:10.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.274+0000 7f886bc49740 1 client.15288 shutdown 2024-09-19T04:48:10.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.274+0000 7f886bc49740 1 -- 172.21.15.2:0/1410370051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec074ba4a0 msgr2=0x55ec074cb2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:10.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.274+0000 7f886bc49740 1 --2- 172.21.15.2:0/1410370051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec074ba4a0 0x55ec074cb2d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f884c010e00 tx=0x7f884c0097d0 comp rx=0 tx=0).stop 2024-09-19T04:48:10.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.274+0000 7f886bc49740 1 -- 172.21.15.2:0/1410370051 shutdown_connections 2024-09-19T04:48:10.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.274+0000 7f886bc49740 1 --2- 172.21.15.2:0/1410370051 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ec074badc0 0x55ec074cba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:10.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.274+0000 7f886bc49740 1 --2- 172.21.15.2:0/1410370051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ec074ba4a0 0x55ec074cb2d0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:10.298 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:48:10.298 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T04:48:10.299 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-19T04:48:10.299 INFO:teuthology.orchestra.run.smithi002.stdout: "3b545123-45d2-4617-ba50-df8cfb53d62f": { 2024-09-19T04:48:10.299 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-19T04:48:10.299 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "3b545123-45d2-4617-ba50-df8cfb53d62f", 2024-09-19T04:48:10.299 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-19T04:48:10.299 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:48:10.299 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:48:10.299 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:48:10.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.274+0000 7f886bc49740 1 --2- 172.21.15.2:0/1410370051 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55ec074c5680 0x55ec07542640 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:10.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.274+0000 7f886bc49740 1 --2- 172.21.15.2:0/1410370051 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ec074b6a30 0x55ec074cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:10.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.274+0000 7f8842ffd640 0 client.15288 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:48:10.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.274+0000 7f886bc49740 1 -- 172.21.15.2:0/1410370051 >> 172.21.15.2:0/1410370051 conn(0x55ec074c28e0 msgr2=0x55ec074c06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:10.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.274+0000 7f886bc49740 1 -- 172.21.15.2:0/1410370051 shutdown_connections 2024-09-19T04:48:10.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.274+0000 7f886bc49740 1 -- 172.21.15.2:0/1410370051 wait complete. 2024-09-19T04:48:10.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.275+0000 7f886bc49740 20 client.15288 trim_cache size 0 max 16384 2024-09-19T04:48:10.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.275+0000 7f8869870640 1 -- 172.21.15.2:0/1884741413 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f88500a34c0 msgr2=0x7f88500a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:10.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.275+0000 7f8869870640 1 --2- 172.21.15.2:0/1884741413 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f88500a34c0 0x7f88500a5980 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f88640fe710 tx=0x7f884c005f90 comp rx=0 tx=0).stop 2024-09-19T04:48:10.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.275+0000 7f8869870640 1 -- 172.21.15.2:0/1884741413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8864100e20 msgr2=0x7f88640fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:10.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.275+0000 7f8869870640 1 --2- 172.21.15.2:0/1884741413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8864100e20 0x7f88640fcc80 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f885400d950 tx=0x7f885400de10 comp rx=0 tx=0).stop 2024-09-19T04:48:10.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.275+0000 7f8869870640 1 -- 172.21.15.2:0/1884741413 shutdown_connections 2024-09-19T04:48:10.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.275+0000 7f8869870640 1 --2- 172.21.15.2:0/1884741413 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f88500a34c0 0x7f88500a5980 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:10.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.275+0000 7f8869870640 1 --2- 172.21.15.2:0/1884741413 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8864102ef0 0x7f88640fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:10.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.275+0000 7f8869870640 1 --2- 172.21.15.2:0/1884741413 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8864102570 0x7f88640fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:10.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.275+0000 7f8869870640 1 --2- 172.21.15.2:0/1884741413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8864100e20 0x7f88640fcc80 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:10.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.275+0000 7f8869870640 1 -- 172.21.15.2:0/1884741413 >> 172.21.15.2:0/1884741413 conn(0x7f88640fc7d0 msgr2=0x7f886406a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:10.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.275+0000 7f8869870640 1 -- 172.21.15.2:0/1884741413 shutdown_connections 2024-09-19T04:48:10.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.275+0000 7f8869870640 1 -- 172.21.15.2:0/1884741413 wait complete. 2024-09-19T04:48:10.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.386+0000 7fcb365af640 1 -- 172.21.15.2:0/2688245572 --> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7fcb30100fe0 con 0x7fcb180a3440 2024-09-19T04:48:10.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.393+0000 7fcb2d7fa640 1 -- 172.21.15.2:0/2688245572 <== mgr.15096 v2:172.21.15.2:6800/852329670 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7fcb30100fe0 con 0x7fcb180a3440 2024-09-19T04:48:10.395 INFO:teuthology.orchestra.run.smithi002.stdout:/ 1m 6m3h 2024-09-19T04:48:10.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.395+0000 7fcb365af640 1 -- 172.21.15.2:0/2688245572 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fcb180a3440 msgr2=0x7fcb180a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:10.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.395+0000 7fcb365af640 1 --2- 172.21.15.2:0/2688245572 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fcb180a3440 0x7fcb180a5900 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcb300ffd80 tx=0x7fcb2400b590 comp rx=0 tx=0).stop 2024-09-19T04:48:10.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.395+0000 7fcb365af640 1 -- 172.21.15.2:0/2688245572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb30102c80 msgr2=0x7fcb3019a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:10.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.395+0000 7fcb365af640 1 --2- 172.21.15.2:0/2688245572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb30102c80 0x7fcb3019a4b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fcb20005940 tx=0x7fcb200042f0 comp rx=0 tx=0).stop 2024-09-19T04:48:10.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.395+0000 7fcb365af640 1 -- 172.21.15.2:0/2688245572 shutdown_connections 2024-09-19T04:48:10.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.395+0000 7fcb365af640 1 --2- 172.21.15.2:0/2688245572 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb3010c0a0 0x7fcb3019ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:10.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.395+0000 7fcb365af640 1 --2- 172.21.15.2:0/2688245572 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fcb180a3440 0x7fcb180a5900 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:10.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.395+0000 7fcb365af640 1 --2- 172.21.15.2:0/2688245572 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcb301035a0 0x7fcb3019a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:10.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.395+0000 7fcb365af640 1 --2- 172.21.15.2:0/2688245572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb30102c80 0x7fcb3019a4b0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:10.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.395+0000 7fcb365af640 1 -- 172.21.15.2:0/2688245572 >> 172.21.15.2:0/2688245572 conn(0x7fcb300779a0 msgr2=0x7fcb301008d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:10.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.395+0000 7fcb365af640 1 -- 172.21.15.2:0/2688245572 shutdown_connections 2024-09-19T04:48:10.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:10.395+0000 7fcb365af640 1 -- 172.21.15.2:0/2688245572 wait complete. 2024-09-19T04:48:10.407 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-19T04:48:10.434 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-19T04:48:10.445 INFO:teuthology.run_tasks:Running task workunit... 2024-09-19T04:48:10.500 INFO:tasks.workunit:Pulling workunits from ref 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T04:48:10.501 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-19T04:48:10.501 INFO:tasks.workunit:timeout=3h 2024-09-19T04:48:10.501 INFO:tasks.workunit:cleanup=True 2024-09-19T04:48:10.502 DEBUG:teuthology.orchestra.run.smithi002:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-19T04:48:10.518 INFO:teuthology.orchestra.run.smithi002.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-19T04:48:10.518 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-19T04:48:10.518 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 78h/120d Inode: 1 Links: 2 2024-09-19T04:48:10.518 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T04:48:10.518 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-19T04:48:10.518 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-19 04:46:36.788644439 +0000 2024-09-19T04:48:10.518 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-19 04:46:36.788644439 +0000 2024-09-19T04:48:10.519 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-19 04:48:00.356937106 +0000 2024-09-19T04:48:10.519 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: - 2024-09-19T04:48:10.519 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-19T04:48:10.519 DEBUG:teuthology.orchestra.run.smithi002:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-19T04:48:10.590 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T04:48:10.649 INFO:tasks.workunit.client.0.smithi002.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-19T04:48:11.068 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:10 smithi002 ceph-mon[30975]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-19T04:48:11.068 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:10 smithi002 ceph-mon[30975]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:48:11.068 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:10 smithi002 ceph-mon[30975]: from='client.15258 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:48:11.068 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:10 smithi002 ceph-mon[30975]: scrub summary: idle 2024-09-19T04:48:11.095 INFO:tasks.cephfs.filesystem:scrub status for tag:3b545123-45d2-4617-ba50-df8cfb53d62f - {'path': '/', 'tag': '3b545123-45d2-4617-ba50-df8cfb53d62f', 'options': 'recursive,force'} 2024-09-19T04:48:11.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:10 smithi018 ceph-mon[34537]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-19T04:48:11.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:10 smithi018 ceph-mon[34537]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:48:11.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:10 smithi018 ceph-mon[34537]: from='client.15258 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:48:11.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:10 smithi018 ceph-mon[34537]: scrub summary: idle 2024-09-19T04:48:11.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:10 smithi116 ceph-mon[34477]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-19T04:48:11.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:10 smithi116 ceph-mon[34477]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:48:11.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:10 smithi116 ceph-mon[34477]: from='client.15258 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:48:11.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:10 smithi116 ceph-mon[34477]: scrub summary: idle 2024-09-19T04:48:12.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:11 smithi018 ceph-mon[34537]: from='client.15264 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:48:12.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:11 smithi018 ceph-mon[34537]: from='client.15270 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:48:12.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:11 smithi002 ceph-mon[30975]: from='client.15264 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:48:12.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:11 smithi002 ceph-mon[30975]: from='client.15270 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:48:12.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:11 smithi116 ceph-mon[34477]: from='client.15264 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:48:12.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:11 smithi116 ceph-mon[34477]: from='client.15270 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:48:13.262 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:12 smithi116 ceph-mon[34477]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 84 KiB/s wr, 46 op/s 2024-09-19T04:48:13.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:12 smithi018 ceph-mon[34537]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 84 KiB/s wr, 46 op/s 2024-09-19T04:48:13.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:12 smithi002 ceph-mon[30975]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 84 KiB/s wr, 46 op/s 2024-09-19T04:48:15.245 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:14 smithi002 ceph-mon[30975]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 77 KiB/s wr, 42 op/s 2024-09-19T04:48:15.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:14 smithi018 ceph-mon[34537]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 77 KiB/s wr, 42 op/s 2024-09-19T04:48:15.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:14 smithi116 ceph-mon[34477]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 77 KiB/s wr, 42 op/s 2024-09-19T04:48:17.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:16 smithi018 ceph-mon[34537]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 77 KiB/s wr, 44 op/s 2024-09-19T04:48:17.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:16 smithi002 ceph-mon[30975]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 77 KiB/s wr, 44 op/s 2024-09-19T04:48:17.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:16 smithi116 ceph-mon[34477]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 77 KiB/s wr, 44 op/s 2024-09-19T04:48:19.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:18 smithi018 ceph-mon[34537]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 77 KiB/s wr, 33 op/s 2024-09-19T04:48:19.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:18 smithi002 ceph-mon[30975]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 77 KiB/s wr, 33 op/s 2024-09-19T04:48:19.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:18 smithi116 ceph-mon[34477]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 77 KiB/s wr, 33 op/s 2024-09-19T04:48:21.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:20 smithi018 ceph-mon[34537]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 77 KiB/s wr, 33 op/s 2024-09-19T04:48:21.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:20 smithi002 ceph-mon[30975]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 77 KiB/s wr, 33 op/s 2024-09-19T04:48:21.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:20 smithi116 ceph-mon[34477]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 77 KiB/s wr, 33 op/s 2024-09-19T04:48:23.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:22 smithi018 ceph-mon[34537]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 77 KiB/s wr, 34 op/s 2024-09-19T04:48:23.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:22 smithi002 ceph-mon[30975]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 77 KiB/s wr, 34 op/s 2024-09-19T04:48:23.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:22 smithi116 ceph-mon[34477]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 77 KiB/s wr, 34 op/s 2024-09-19T04:48:25.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:24 smithi018 ceph-mon[34537]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 682 B/s wr, 3 op/s 2024-09-19T04:48:25.359 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:24 smithi002 ceph-mon[30975]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 682 B/s wr, 3 op/s 2024-09-19T04:48:25.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:24 smithi116 ceph-mon[34477]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 682 B/s wr, 3 op/s 2024-09-19T04:48:27.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:26 smithi018 ceph-mon[34537]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-19T04:48:27.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:26 smithi002 ceph-mon[30975]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-19T04:48:27.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:26 smithi116 ceph-mon[34477]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-19T04:48:29.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:28 smithi018 ceph-mon[34537]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-19T04:48:29.359 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:28 smithi002 ceph-mon[30975]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-19T04:48:29.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:28 smithi116 ceph-mon[34477]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-19T04:48:31.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:30 smithi018 ceph-mon[34537]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-19T04:48:31.359 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:30 smithi002 ceph-mon[30975]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-19T04:48:31.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:30 smithi116 ceph-mon[34477]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-19T04:48:33.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:32 smithi018 ceph-mon[34537]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-19T04:48:33.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:32 smithi002 ceph-mon[30975]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-19T04:48:33.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:32 smithi116 ceph-mon[34477]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-19T04:48:35.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:34 smithi018 ceph-mon[34537]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-19T04:48:35.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:34 smithi002 ceph-mon[30975]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-19T04:48:35.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:34 smithi116 ceph-mon[34477]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-19T04:48:36.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:36 smithi002 ceph-mon[30975]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-19T04:48:36.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:36 smithi116 ceph-mon[34477]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-19T04:48:36.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:36 smithi018 ceph-mon[34537]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-19T04:48:38.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:38 smithi018 ceph-mon[34537]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:48:38.609 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:38 smithi002 ceph-mon[30975]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:48:38.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:38 smithi116 ceph-mon[34477]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:48:40.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:40 smithi018 ceph-mon[34537]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:48:40.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:40 smithi002 ceph-mon[30975]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:48:40.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:40 smithi116 ceph-mon[34477]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:48:41.095 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:48:41.427 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:48:42.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.000+0000 7f33368f8640 1 -- 172.21.15.2:0/4198389506 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3330102570 msgr2=0x7f33301029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:42.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.000+0000 7f33368f8640 1 --2- 172.21.15.2:0/4198389506 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3330102570 0x7f33301029b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3324009900 tx=0x7f332402a480 comp rx=0 tx=0).stop 2024-09-19T04:48:42.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.000+0000 7f33368f8640 1 -- 172.21.15.2:0/4198389506 shutdown_connections 2024-09-19T04:48:42.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.000+0000 7f33368f8640 1 --2- 172.21.15.2:0/4198389506 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3330102ef0 0x7f333010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:42.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.000+0000 7f33368f8640 1 --2- 172.21.15.2:0/4198389506 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3330102570 0x7f33301029b0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:42.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.000+0000 7f33368f8640 1 --2- 172.21.15.2:0/4198389506 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3330100e20 0x7f3330101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:42.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.000+0000 7f33368f8640 1 -- 172.21.15.2:0/4198389506 >> 172.21.15.2:0/4198389506 conn(0x7f33300fc7d0 msgr2=0x7f33300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:42.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.000+0000 7f33368f8640 1 -- 172.21.15.2:0/4198389506 shutdown_connections 2024-09-19T04:48:42.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.000+0000 7f33368f8640 1 -- 172.21.15.2:0/4198389506 wait complete. 2024-09-19T04:48:42.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.001+0000 7f33368f8640 1 Processor -- start 2024-09-19T04:48:42.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.001+0000 7f33368f8640 1 -- start start 2024-09-19T04:48:42.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.001+0000 7f33368f8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3330100e20 0x7f3330199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:42.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.002+0000 7f33368f8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3330102570 0x7f33301997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:42.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.002+0000 7f33368f8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3330102ef0 0x7f33301a42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:42.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.002+0000 7f33368f8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3330110e30 con 0x7f3330100e20 2024-09-19T04:48:42.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.002+0000 7f33368f8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3330110cb0 con 0x7f3330102570 2024-09-19T04:48:42.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.002+0000 7f33368f8640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f3330110fb0 con 0x7f3330102ef0 2024-09-19T04:48:42.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.002+0000 7f332ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3330100e20 0x7f3330199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:42.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.002+0000 7f332ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3330100e20 0x7f3330199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35156/0 (socket says 172.21.15.2:35156) 2024-09-19T04:48:42.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.002+0000 7f332ffff640 1 -- 172.21.15.2:0/626402159 learned_addr learned my addr 172.21.15.2:0/626402159 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:48:42.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.002+0000 7f3334e95640 1 --2- 172.21.15.2:0/626402159 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3330102ef0 0x7f33301a42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:42.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.002+0000 7f332f7fe640 1 --2- 172.21.15.2:0/626402159 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3330102570 0x7f33301997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:42.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.002+0000 7f332ffff640 1 -- 172.21.15.2:0/626402159 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3330102ef0 msgr2=0x7f33301a42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:42.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.002+0000 7f332ffff640 1 --2- 172.21.15.2:0/626402159 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3330102ef0 0x7f33301a42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:42.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.002+0000 7f332ffff640 1 -- 172.21.15.2:0/626402159 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3330102570 msgr2=0x7f33301997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:42.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.002+0000 7f332ffff640 1 --2- 172.21.15.2:0/626402159 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3330102570 0x7f33301997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:42.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.002+0000 7f332ffff640 1 -- 172.21.15.2:0/626402159 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33301a4820 con 0x7f3330100e20 2024-09-19T04:48:42.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.002+0000 7f332ffff640 1 --2- 172.21.15.2:0/626402159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3330100e20 0x7f3330199260 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f332000c890 tx=0x7f332000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:42.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.003+0000 7f332d7fa640 1 -- 172.21.15.2:0/626402159 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3320004220 con 0x7f3330100e20 2024-09-19T04:48:42.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.003+0000 7f332d7fa640 1 -- 172.21.15.2:0/626402159 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f33200043c0 con 0x7f3330100e20 2024-09-19T04:48:42.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.003+0000 7f33368f8640 1 -- 172.21.15.2:0/626402159 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33301a49f0 con 0x7f3330100e20 2024-09-19T04:48:42.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.003+0000 7f332d7fa640 1 -- 172.21.15.2:0/626402159 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3320004a00 con 0x7f3330100e20 2024-09-19T04:48:42.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.003+0000 7f33368f8640 1 -- 172.21.15.2:0/626402159 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33301a4eb0 con 0x7f3330100e20 2024-09-19T04:48:42.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.006+0000 7f332d7fa640 1 -- 172.21.15.2:0/626402159 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138530+0+0 (secure 0 0 0) 0x7f3320004ba0 con 0x7f3330100e20 2024-09-19T04:48:42.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.006+0000 7f3338cd1740 1 Processor -- start 2024-09-19T04:48:42.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.007+0000 7f3338cd1740 1 -- start start 2024-09-19T04:48:42.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.007+0000 7f3338cd1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563084acd640 0x563084acda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:42.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.007+0000 7f3338cd1740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563084ac8010 0x563084ac8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:42.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.007+0000 7f3338cd1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563084ac89d0 0x563084ad4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:42.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.007+0000 7f3338cd1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563084a242e0 con 0x563084acd640 2024-09-19T04:48:42.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.007+0000 7f3338cd1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5630849cbce0 con 0x563084ac89d0 2024-09-19T04:48:42.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.007+0000 7f3338cd1740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x563084a202a0 con 0x563084ac8010 2024-09-19T04:48:42.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.007+0000 7f332d7fa640 1 --2- 172.21.15.2:0/626402159 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f33180a3590 0x7f33180a5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:42.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.007+0000 7f3334e95640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563084acd640 0x563084acda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:42.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.007+0000 7f332f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563084ac89d0 0x563084ad4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:42.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.007+0000 7f332f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563084ac89d0 0x563084ad4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.2:46530/0 (socket says 172.21.15.2:46530) 2024-09-19T04:48:42.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.007+0000 7f332f7fe640 1 -- 172.21.15.2:0/2864974385 learned_addr learned my addr 172.21.15.2:0/2864974385 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:48:42.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.007+0000 7f332ffff640 1 --2- 172.21.15.2:0/2864974385 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563084ac8010 0x563084ac8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:42.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.007+0000 7f332d7fa640 1 -- 172.21.15.2:0/626402159 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f33200cfa40 con 0x7f3330100e20 2024-09-19T04:48:42.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.007+0000 7f3334e95640 1 --2- 172.21.15.2:0/626402159 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f33180a3590 0x7f33180a5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:42.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.008+0000 7f332f7fe640 1 -- 172.21.15.2:0/2864974385 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563084ac8010 msgr2=0x563084ac8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:48:42.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.008+0000 7f332f7fe640 1 --2- 172.21.15.2:0/2864974385 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563084ac8010 0x563084ac8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:42.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.008+0000 7f332f7fe640 1 -- 172.21.15.2:0/2864974385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563084acd640 msgr2=0x563084acda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:48:42.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.008+0000 7f332f7fe640 1 --2- 172.21.15.2:0/2864974385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563084acd640 0x563084acda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:42.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.008+0000 7f332f7fe640 1 -- 172.21.15.2:0/2864974385 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630849b0440 con 0x563084ac89d0 2024-09-19T04:48:42.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.008+0000 7f332f7fe640 1 --2- 172.21.15.2:0/2864974385 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563084ac89d0 0x563084ad4440 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3324009900 tx=0x7f3324031c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=623f97c5710d5af7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:42.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.008+0000 7f33167fc640 1 -- 172.21.15.2:0/2864974385 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3324040070 con 0x563084ac89d0 2024-09-19T04:48:42.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.008+0000 7f33167fc640 1 -- 172.21.15.2:0/2864974385 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3324031630 con 0x563084ac89d0 2024-09-19T04:48:42.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.009+0000 7f33167fc640 1 -- 172.21.15.2:0/2864974385 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3324035040 con 0x563084ac89d0 2024-09-19T04:48:42.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.009+0000 7f3338cd1740 1 -- 172.21.15.2:0/2864974385 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563084ac89d0 msgr2=0x563084ad4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:42.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.009+0000 7f3338cd1740 1 --2- 172.21.15.2:0/2864974385 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563084ac89d0 0x563084ad4440 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3324009900 tx=0x7f3324031c60 comp rx=0 tx=0).stop 2024-09-19T04:48:42.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.009+0000 7f3334e95640 1 --2- 172.21.15.2:0/626402159 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f33180a3590 0x7f33180a5a50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3328005fd0 tx=0x7f3328004ab0 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:42.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.009+0000 7f3338cd1740 1 -- 172.21.15.2:0/2864974385 shutdown_connections 2024-09-19T04:48:42.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.009+0000 7f3338cd1740 1 --2- 172.21.15.2:0/2864974385 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563084ac89d0 0x563084ad4440 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:42.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.009+0000 7f3338cd1740 1 --2- 172.21.15.2:0/2864974385 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563084ac8010 0x563084ac8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:42.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.009+0000 7f3338cd1740 1 --2- 172.21.15.2:0/2864974385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563084acd640 0x563084acda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:42.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.009+0000 7f3338cd1740 1 -- 172.21.15.2:0/2864974385 >> 172.21.15.2:0/2864974385 conn(0x563084aba4e0 msgr2=0x563084aba8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:42.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.010+0000 7f3338cd1740 1 -- 172.21.15.2:0/2864974385 shutdown_connections 2024-09-19T04:48:42.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.010+0000 7f3338cd1740 1 -- 172.21.15.2:0/2864974385 wait complete. 2024-09-19T04:48:42.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.010+0000 7f3338cd1740 1 -- start start 2024-09-19T04:48:42.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.010+0000 7f3338cd1740 1 Processor -- start 2024-09-19T04:48:42.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.011+0000 7f3338cd1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563084ac8010 0x563084ad4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:42.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.011+0000 7f3338cd1740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563084ac89d0 0x563084ad2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:42.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.011+0000 7f3338cd1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563084acd640 0x563084ad2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:42.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.011+0000 7f3338cd1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563084abe950 con 0x563084acd640 2024-09-19T04:48:42.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.011+0000 7f3338cd1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5630849df050 con 0x563084ac8010 2024-09-19T04:48:42.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.011+0000 7f3338cd1740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x563084abead0 con 0x563084ac89d0 2024-09-19T04:48:42.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.011+0000 7f3338cd1740 10 client.0 _ll_register_callbacks cb 0x563084a1f160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:48:42.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.011+0000 7f332ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563084ac8010 0x563084ad4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:42.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.011+0000 7f332f7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563084ac89d0 0x563084ad2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:42.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.011+0000 7f332ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563084ac8010 0x563084ad4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.2:46546/0 (socket says 172.21.15.2:46546) 2024-09-19T04:48:42.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.011+0000 7f332ffff640 1 -- 172.21.15.2:0/2129501063 learned_addr learned my addr 172.21.15.2:0/2129501063 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:48:42.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.011+0000 7f332ffff640 1 -- 172.21.15.2:0/2129501063 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563084ac89d0 msgr2=0x563084ad2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:48:42.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.011+0000 7f332ffff640 1 --2- 172.21.15.2:0/2129501063 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563084ac89d0 0x563084ad2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:42.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.011+0000 7f332ffff640 1 -- 172.21.15.2:0/2129501063 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563084acd640 msgr2=0x563084ad2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:48:42.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.011+0000 7f3334e95640 1 --2- 172.21.15.2:0/2129501063 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563084acd640 0x563084ad2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:42.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.011+0000 7f332ffff640 1 --2- 172.21.15.2:0/2129501063 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563084acd640 0x563084ad2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:42.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.011+0000 7f332ffff640 1 -- 172.21.15.2:0/2129501063 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630847953c0 con 0x563084ac8010 2024-09-19T04:48:42.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.011+0000 7f332f7fe640 1 --2- 172.21.15.2:0/2129501063 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563084ac89d0 0x563084ad2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:48:42.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.012+0000 7f332ffff640 1 --2- 172.21.15.2:0/2129501063 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563084ac8010 0x563084ad4140 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f33200058c0 tx=0x7f332009b850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee1c2e01bfb3d74f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:42.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.012+0000 7f330f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T04:48:42.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.012+0000 7f3334e95640 1 --2- 172.21.15.2:0/2129501063 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563084acd640 0x563084ad2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:48:42.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.012+0000 7f330f7fe640 1 -- 172.21.15.2:0/2129501063 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332001d040 con 0x563084ac8010 2024-09-19T04:48:42.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.012+0000 7f330f7fe640 1 -- 172.21.15.2:0/2129501063 <== mon.2 v2:172.21.15.18:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f33200cd340 con 0x563084ac8010 2024-09-19T04:48:42.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.012+0000 7f3338cd1740 1 -- 172.21.15.2:0/2129501063 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3324031630 con 0x563084ac8010 2024-09-19T04:48:42.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.012+0000 7f330f7fe640 1 -- 172.21.15.2:0/2129501063 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f33200a47e0 con 0x563084ac8010 2024-09-19T04:48:42.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.012+0000 7f3338cd1740 10 client.24935 fetch_fsmap learned FSMap version 19 2024-09-19T04:48:42.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.012+0000 7f3338cd1740 1 -- 172.21.15.2:0/2129501063 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x563084ae8b80 con 0x563084ac8010 2024-09-19T04:48:42.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.012+0000 7f330f7fe640 1 -- 172.21.15.2:0/2129501063 <== mon.2 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3324031630 con 0x563084ac8010 2024-09-19T04:48:42.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.012+0000 7f330f7fe640 1 -- 172.21.15.2:0/2129501063 <== mon.2 v2:172.21.15.18:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f332009aae0 con 0x563084ac8010 2024-09-19T04:48:42.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.012+0000 7f3338cd1740 10 client.24935 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:48:42.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.012+0000 7f3338cd1740 10 client.24935 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:48:42.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.012+0000 7f3338cd1740 20 client.24935 populate_metadata read hostname 'smithi002' 2024-09-19T04:48:42.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.012+0000 7f3338cd1740 1 --2- 172.21.15.2:0/2129501063 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x563084ae9ed0 0x563084aec320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:42.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.012+0000 7f3338cd1740 4 client.24935 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:48:42.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.012+0000 7f3338cd1740 1 -- 172.21.15.2:0/2129501063 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563084a31850 con 0x563084ae9ed0 2024-09-19T04:48:42.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.013+0000 7f332f7fe640 1 --2- 172.21.15.2:0/2129501063 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x563084ae9ed0 0x563084aec320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:42.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.013+0000 7f332f7fe640 1 --2- 172.21.15.2:0/2129501063 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x563084ae9ed0 0x563084aec320 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f1ea2f5ac406547 server_cookie=8b3cc84a5a125f67 in_seq=0 out_seq=0 2024-09-19T04:48:42.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.013+0000 7f330f7fe640 10 client.24935 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:48:42.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.014+0000 7f330f7fe640 1 -- 172.21.15.2:0/2129501063 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563084a31850 con 0x563084ae9ed0 2024-09-19T04:48:42.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.014+0000 7f330f7fe640 10 client.24935 handle_command_reply: tid=0 2024-09-19T04:48:42.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.014+0000 7f3338cd1740 1 client.24935 shutdown 2024-09-19T04:48:42.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.014+0000 7f3338cd1740 1 -- 172.21.15.2:0/2129501063 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563084ac8010 msgr2=0x563084ad4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:42.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.014+0000 7f3338cd1740 1 --2- 172.21.15.2:0/2129501063 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563084ac8010 0x563084ad4140 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f33200058c0 tx=0x7f332009b850 comp rx=0 tx=0).stop 2024-09-19T04:48:42.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.014+0000 7f3338cd1740 1 -- 172.21.15.2:0/2129501063 shutdown_connections 2024-09-19T04:48:42.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.014+0000 7f3338cd1740 1 --2- 172.21.15.2:0/2129501063 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563084acd640 0x563084ad2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:42.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.014+0000 7f3338cd1740 1 --2- 172.21.15.2:0/2129501063 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x563084ae9ed0 0x563084aec320 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:42.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.014+0000 7f3338cd1740 1 --2- 172.21.15.2:0/2129501063 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563084ac89d0 0x563084ad2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:42.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.014+0000 7f3338cd1740 1 --2- 172.21.15.2:0/2129501063 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563084ac8010 0x563084ad4140 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:42.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.014+0000 7f3338cd1740 1 -- 172.21.15.2:0/2129501063 >> 172.21.15.2:0/2129501063 conn(0x563084aba4e0 msgr2=0x563084ab9bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:42.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.014+0000 7f330f7fe640 0 client.24935 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:48:42.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.014+0000 7f3338cd1740 1 -- 172.21.15.2:0/2129501063 shutdown_connections 2024-09-19T04:48:42.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.014+0000 7f3338cd1740 1 -- 172.21.15.2:0/2129501063 wait complete. 2024-09-19T04:48:42.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.014+0000 7f3338cd1740 20 client.24935 trim_cache size 0 max 16384 2024-09-19T04:48:42.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.032+0000 7f3338cd1740 1 Processor -- start 2024-09-19T04:48:42.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.032+0000 7f3338cd1740 1 -- start start 2024-09-19T04:48:42.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.032+0000 7f3338cd1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563084ac8010 0x563084acf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:42.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.032+0000 7f3338cd1740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563084ac89d0 0x563084acfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:42.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.032+0000 7f3338cd1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563084acd640 0x563084af1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:42.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.032+0000 7f3338cd1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f33301a9400 con 0x563084ac8010 2024-09-19T04:48:42.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.032+0000 7f3338cd1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f33301abc80 con 0x563084acd640 2024-09-19T04:48:42.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.032+0000 7f3338cd1740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f33301a9a70 con 0x563084ac89d0 2024-09-19T04:48:42.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.032+0000 7f332ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563084ac8010 0x563084acf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:42.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.032+0000 7f332ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563084ac8010 0x563084acf7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35190/0 (socket says 172.21.15.2:35190) 2024-09-19T04:48:42.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.032+0000 7f332ffff640 1 -- 172.21.15.2:0/1145775946 learned_addr learned my addr 172.21.15.2:0/1145775946 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:48:42.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.032+0000 7f332f7fe640 1 --2- 172.21.15.2:0/1145775946 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563084ac89d0 0x563084acfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:42.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.032+0000 7f3334e95640 1 --2- 172.21.15.2:0/1145775946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563084acd640 0x563084af1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:42.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.032+0000 7f332ffff640 1 -- 172.21.15.2:0/1145775946 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563084ac89d0 msgr2=0x563084acfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:48:42.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.032+0000 7f332ffff640 1 --2- 172.21.15.2:0/1145775946 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563084ac89d0 0x563084acfd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:42.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.032+0000 7f332ffff640 1 -- 172.21.15.2:0/1145775946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563084acd640 msgr2=0x563084af1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:48:42.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.032+0000 7f332ffff640 1 --2- 172.21.15.2:0/1145775946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563084acd640 0x563084af1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:42.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.032+0000 7f332ffff640 1 -- 172.21.15.2:0/1145775946 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563084acdd90 con 0x563084ac8010 2024-09-19T04:48:42.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.033+0000 7f332ffff640 1 --2- 172.21.15.2:0/1145775946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563084ac8010 0x563084acf7c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f332009bbb0 tx=0x7f33200a00a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a57be9dbbe7fa2e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:42.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.033+0000 7f3315ffb640 1 -- 172.21.15.2:0/1145775946 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332001d050 con 0x563084ac8010 2024-09-19T04:48:42.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.033+0000 7f3315ffb640 1 -- 172.21.15.2:0/1145775946 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f33200a8020 con 0x563084ac8010 2024-09-19T04:48:42.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.033+0000 7f3315ffb640 1 -- 172.21.15.2:0/1145775946 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33200cd340 con 0x563084ac8010 2024-09-19T04:48:42.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.034+0000 7f3338cd1740 1 -- 172.21.15.2:0/1145775946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563084ac8010 msgr2=0x563084acf7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:42.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.034+0000 7f3338cd1740 1 --2- 172.21.15.2:0/1145775946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563084ac8010 0x563084acf7c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f332009bbb0 tx=0x7f33200a00a0 comp rx=0 tx=0).stop 2024-09-19T04:48:42.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.034+0000 7f3338cd1740 1 -- 172.21.15.2:0/1145775946 shutdown_connections 2024-09-19T04:48:42.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.034+0000 7f3338cd1740 1 --2- 172.21.15.2:0/1145775946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563084acd640 0x563084af1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:42.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.034+0000 7f3338cd1740 1 --2- 172.21.15.2:0/1145775946 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563084ac89d0 0x563084acfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:42.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.034+0000 7f3338cd1740 1 --2- 172.21.15.2:0/1145775946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563084ac8010 0x563084acf7c0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:42.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.034+0000 7f3338cd1740 1 -- 172.21.15.2:0/1145775946 >> 172.21.15.2:0/1145775946 conn(0x563084aba4e0 msgr2=0x563084ad1540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:42.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.034+0000 7f3338cd1740 1 -- 172.21.15.2:0/1145775946 shutdown_connections 2024-09-19T04:48:42.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.034+0000 7f3338cd1740 1 -- 172.21.15.2:0/1145775946 wait complete. 2024-09-19T04:48:42.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.035+0000 7f3338cd1740 1 -- start start 2024-09-19T04:48:42.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.035+0000 7f3338cd1740 1 Processor -- start 2024-09-19T04:48:42.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.035+0000 7f3338cd1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563084ac8010 0x563084ac41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:42.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.035+0000 7f3338cd1740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563084ac89d0 0x563084ac1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:42.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.035+0000 7f3338cd1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563084acd640 0x563084ac1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:42.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.036+0000 7f3334e95640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563084acd640 0x563084ac1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:42.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.036+0000 7f332ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563084ac8010 0x563084ac41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:42.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.036+0000 7f3334e95640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563084acd640 0x563084ac1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35192/0 (socket says 172.21.15.2:35192) 2024-09-19T04:48:42.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.036+0000 7f332f7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563084ac89d0 0x563084ac1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:42.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.036+0000 7f332f7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563084ac89d0 0x563084ac1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.2:38340/0 (socket says 172.21.15.2:38340) 2024-09-19T04:48:42.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.036+0000 7f3334e95640 1 -- 172.21.15.2:0/3235332640 learned_addr learned my addr 172.21.15.2:0/3235332640 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:48:42.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.036+0000 7f3338cd1740 1 -- 172.21.15.2:0/3235332640 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f33301aa140 con 0x563084acd640 2024-09-19T04:48:42.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.036+0000 7f3338cd1740 1 -- 172.21.15.2:0/3235332640 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f33301ab5b0 con 0x563084ac8010 2024-09-19T04:48:42.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.036+0000 7f3338cd1740 1 -- 172.21.15.2:0/3235332640 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f33301aa810 con 0x563084ac89d0 2024-09-19T04:48:42.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.036+0000 7f3338cd1740 10 client.0 _ll_register_callbacks cb 0x7f332009ba60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:48:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.036+0000 7f332ffff640 1 -- 172.21.15.2:0/3235332640 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563084ac89d0 msgr2=0x563084ac1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:48:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.036+0000 7f332ffff640 1 --2- 172.21.15.2:0/3235332640 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563084ac89d0 0x563084ac1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.036+0000 7f332ffff640 1 -- 172.21.15.2:0/3235332640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563084acd640 msgr2=0x563084ac1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:48:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.036+0000 7f332ffff640 1 --2- 172.21.15.2:0/3235332640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563084acd640 0x563084ac1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.036+0000 7f332ffff640 1 -- 172.21.15.2:0/3235332640 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563084ac2090 con 0x563084ac8010 2024-09-19T04:48:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.037+0000 7f332ffff640 1 --2- 172.21.15.2:0/3235332640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563084ac8010 0x563084ac41f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3320099ed0 tx=0x7f33200cd570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f70016ae71b926c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.037+0000 7f330f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T04:48:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.037+0000 7f330f7fe640 1 -- 172.21.15.2:0/3235332640 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332001d030 con 0x563084ac8010 2024-09-19T04:48:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.037+0000 7f330f7fe640 1 -- 172.21.15.2:0/3235332640 <== mon.2 v2:172.21.15.18:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f3320004e90 con 0x563084ac8010 2024-09-19T04:48:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.037+0000 7f3338cd1740 1 -- 172.21.15.2:0/3235332640 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33200a8020 con 0x563084ac8010 2024-09-19T04:48:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.037+0000 7f330f7fe640 1 -- 172.21.15.2:0/3235332640 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f332009bc20 con 0x563084ac8010 2024-09-19T04:48:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.037+0000 7f3338cd1740 10 client.24938 fetch_fsmap learned FSMap version 19 2024-09-19T04:48:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.037+0000 7f3338cd1740 1 -- 172.21.15.2:0/3235332640 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x563084ac2090 con 0x563084ac8010 2024-09-19T04:48:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.037+0000 7f330f7fe640 1 -- 172.21.15.2:0/3235332640 <== mon.2 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f33200b3060 con 0x563084ac8010 2024-09-19T04:48:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.037+0000 7f330f7fe640 1 -- 172.21.15.2:0/3235332640 <== mon.2 v2:172.21.15.18:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f33200ba3a0 con 0x563084ac8010 2024-09-19T04:48:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.038+0000 7f3338cd1740 10 client.24938 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:48:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.038+0000 7f3338cd1740 10 client.24938 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:48:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.038+0000 7f3338cd1740 20 client.24938 populate_metadata read hostname 'smithi002' 2024-09-19T04:48:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.038+0000 7f3338cd1740 1 --2- 172.21.15.2:0/3235332640 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x563084b54c50 0x563084b57040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.038+0000 7f3338cd1740 4 client.24938 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:48:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.038+0000 7f3338cd1740 1 -- 172.21.15.2:0/3235332640 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f33200a8020 con 0x563084b54c50 2024-09-19T04:48:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.038+0000 7f332f7fe640 1 --2- 172.21.15.2:0/3235332640 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x563084b54c50 0x563084b57040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.038+0000 7f330f7fe640 10 client.24938 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:48:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.039+0000 7f332f7fe640 1 --2- 172.21.15.2:0/3235332640 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x563084b54c50 0x563084b57040 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8b33cadbbe2833 server_cookie=b6772af0396e4360 in_seq=0 out_seq=0 2024-09-19T04:48:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.039+0000 7f330f7fe640 1 -- 172.21.15.2:0/3235332640 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f33200a8020 con 0x563084b54c50 2024-09-19T04:48:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.039+0000 7f330f7fe640 10 client.24938 handle_command_reply: tid=0 2024-09-19T04:48:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.039+0000 7f3338cd1740 1 client.24938 shutdown 2024-09-19T04:48:42.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.039+0000 7f3338cd1740 1 -- 172.21.15.2:0/3235332640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563084ac8010 msgr2=0x563084ac41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:42.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.039+0000 7f3338cd1740 1 --2- 172.21.15.2:0/3235332640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563084ac8010 0x563084ac41f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3320099ed0 tx=0x7f33200cd570 comp rx=0 tx=0).stop 2024-09-19T04:48:42.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.039+0000 7f3338cd1740 1 -- 172.21.15.2:0/3235332640 shutdown_connections 2024-09-19T04:48:42.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.039+0000 7f3338cd1740 1 --2- 172.21.15.2:0/3235332640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563084acd640 0x563084ac1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:42.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.039+0000 7f3338cd1740 1 --2- 172.21.15.2:0/3235332640 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x563084b54c50 0x563084b57040 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:42.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.040+0000 7f3338cd1740 1 --2- 172.21.15.2:0/3235332640 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563084ac89d0 0x563084ac1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:42.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.040+0000 7f3338cd1740 1 --2- 172.21.15.2:0/3235332640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563084ac8010 0x563084ac41f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:42.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.040+0000 7f330f7fe640 0 client.24938 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:48:42.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.040+0000 7f3338cd1740 1 -- 172.21.15.2:0/3235332640 >> 172.21.15.2:0/3235332640 conn(0x563084aba4e0 msgr2=0x563084ab93a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:42.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.040+0000 7f3338cd1740 1 -- 172.21.15.2:0/3235332640 shutdown_connections 2024-09-19T04:48:42.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.040+0000 7f3338cd1740 1 -- 172.21.15.2:0/3235332640 wait complete. 2024-09-19T04:48:42.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.040+0000 7f3338cd1740 20 client.24938 trim_cache size 0 max 16384 2024-09-19T04:48:42.044 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:48:42.044 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T04:48:42.044 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T04:48:42.044 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:48:42.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.040+0000 7f33368f8640 1 -- 172.21.15.2:0/626402159 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f33180a3590 msgr2=0x7f33180a5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:42.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.040+0000 7f33368f8640 1 --2- 172.21.15.2:0/626402159 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f33180a3590 0x7f33180a5a50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3328005fd0 tx=0x7f3328004ab0 comp rx=0 tx=0).stop 2024-09-19T04:48:42.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.040+0000 7f33368f8640 1 -- 172.21.15.2:0/626402159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3330100e20 msgr2=0x7f3330199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:42.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.040+0000 7f33368f8640 1 --2- 172.21.15.2:0/626402159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3330100e20 0x7f3330199260 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f332000c890 tx=0x7f332000cd50 comp rx=0 tx=0).stop 2024-09-19T04:48:42.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.041+0000 7f33368f8640 1 -- 172.21.15.2:0/626402159 shutdown_connections 2024-09-19T04:48:42.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.041+0000 7f33368f8640 1 --2- 172.21.15.2:0/626402159 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f33180a3590 0x7f33180a5a50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:42.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.041+0000 7f33368f8640 1 --2- 172.21.15.2:0/626402159 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3330102ef0 0x7f33301a42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:42.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.041+0000 7f33368f8640 1 --2- 172.21.15.2:0/626402159 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3330102570 0x7f33301997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:42.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.041+0000 7f33368f8640 1 --2- 172.21.15.2:0/626402159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3330100e20 0x7f3330199260 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:42.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.041+0000 7f33368f8640 1 -- 172.21.15.2:0/626402159 >> 172.21.15.2:0/626402159 conn(0x7f33300fc7d0 msgr2=0x7f33300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:42.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.041+0000 7f33368f8640 1 -- 172.21.15.2:0/626402159 shutdown_connections 2024-09-19T04:48:42.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:42.041+0000 7f33368f8640 1 -- 172.21.15.2:0/626402159 wait complete. 2024-09-19T04:48:42.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:42 smithi018 ceph-mon[34537]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T04:48:42.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:42 smithi002 ceph-mon[30975]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T04:48:42.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:42 smithi116 ceph-mon[34477]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T04:48:42.947 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:48:42.947 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:48:43.290 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:48:43.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:43.749+0000 7ff3df0f6640 1 -- 172.21.15.2:0/1588231673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3d8108290 msgr2=0x7ff3d810ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:43.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:43.749+0000 7ff3df0f6640 1 --2- 172.21.15.2:0/1588231673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3d8108290 0x7ff3d810ec30 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff3d0009cd0 tx=0x7ff3d002a8e0 comp rx=0 tx=0).stop 2024-09-19T04:48:43.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:43.749+0000 7ff3df0f6640 1 -- 172.21.15.2:0/1588231673 shutdown_connections 2024-09-19T04:48:43.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:43.749+0000 7ff3df0f6640 1 --2- 172.21.15.2:0/1588231673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3d8108290 0x7ff3d810ec30 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:43.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:43.749+0000 7ff3df0f6640 1 --2- 172.21.15.2:0/1588231673 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3d8103740 0x7ff3d8107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:43.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:43.749+0000 7ff3df0f6640 1 --2- 172.21.15.2:0/1588231673 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff3d8102d90 0x7ff3d8103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:43.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:43.749+0000 7ff3df0f6640 1 -- 172.21.15.2:0/1588231673 >> 172.21.15.2:0/1588231673 conn(0x7ff3d80fc7d0 msgr2=0x7ff3d80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:43.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:43.749+0000 7ff3df0f6640 1 -- 172.21.15.2:0/1588231673 shutdown_connections 2024-09-19T04:48:43.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:43.749+0000 7ff3df0f6640 1 -- 172.21.15.2:0/1588231673 wait complete. 2024-09-19T04:48:43.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:43.750+0000 7ff3df0f6640 1 Processor -- start 2024-09-19T04:48:43.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:43.750+0000 7ff3df0f6640 1 -- start start 2024-09-19T04:48:43.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:43.750+0000 7ff3df0f6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3d8102d90 0x7ff3d8198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:43.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:43.750+0000 7ff3df0f6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3d8103740 0x7ff3d8198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:43.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:43.751+0000 7ff3df0f6640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff3d8108290 0x7ff3d819cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:43.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:43.751+0000 7ff3df0f6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d8111fa0 con 0x7ff3d8102d90 2024-09-19T04:48:43.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:43.751+0000 7ff3df0f6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d8111e20 con 0x7ff3d8103740 2024-09-19T04:48:43.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:43.751+0000 7ff3dce92640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3d8102d90 0x7ff3d8198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:43.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:43.751+0000 7ff3df0f6640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d8112120 con 0x7ff3d8108290 2024-09-19T04:48:43.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:43.751+0000 7ff3dce92640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3d8102d90 0x7ff3d8198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35212/0 (socket says 172.21.15.2:35212) 2024-09-19T04:48:43.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:43.751+0000 7ff3d7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3d8103740 0x7ff3d8198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:43.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:43.751+0000 7ff3dce92640 1 -- 172.21.15.2:0/3047380547 learned_addr learned my addr 172.21.15.2:0/3047380547 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:48:43.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:43.751+0000 7ff3dd693640 1 --2- 172.21.15.2:0/3047380547 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff3d8108290 0x7ff3d819cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:43.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:43.751+0000 7ff3dce92640 1 -- 172.21.15.2:0/3047380547 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff3d8108290 msgr2=0x7ff3d819cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:43.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:43.751+0000 7ff3dce92640 1 --2- 172.21.15.2:0/3047380547 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff3d8108290 0x7ff3d819cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:43.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:43.751+0000 7ff3dce92640 1 -- 172.21.15.2:0/3047380547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3d8103740 msgr2=0x7ff3d8198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:43.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:43.751+0000 7ff3dce92640 1 --2- 172.21.15.2:0/3047380547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3d8103740 0x7ff3d8198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:43.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:43.751+0000 7ff3dce92640 1 -- 172.21.15.2:0/3047380547 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3d819d4b0 con 0x7ff3d8102d90 2024-09-19T04:48:43.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:43.751+0000 7ff3d7fff640 1 --2- 172.21.15.2:0/3047380547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3d8103740 0x7ff3d8198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:48:43.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:43.751+0000 7ff3dce92640 1 --2- 172.21.15.2:0/3047380547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3d8102d90 0x7ff3d8198500 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc00c970 tx=0x7ff3cc00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:43.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:43.752+0000 7ff3d5ffb640 1 -- 172.21.15.2:0/3047380547 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc007bb0 con 0x7ff3d8102d90 2024-09-19T04:48:43.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:43.752+0000 7ff3d5ffb640 1 -- 172.21.15.2:0/3047380547 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff3cc007d50 con 0x7ff3d8102d90 2024-09-19T04:48:43.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:43.752+0000 7ff3d5ffb640 1 -- 172.21.15.2:0/3047380547 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc004e50 con 0x7ff3d8102d90 2024-09-19T04:48:43.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:43.752+0000 7ff3df0f6640 1 -- 172.21.15.2:0/3047380547 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3d819d7a0 con 0x7ff3d8102d90 2024-09-19T04:48:43.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:43.752+0000 7ff3df0f6640 1 -- 172.21.15.2:0/3047380547 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3d819dc00 con 0x7ff3d8102d90 2024-09-19T04:48:43.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:43.753+0000 7ff3df0f6640 1 -- 172.21.15.2:0/3047380547 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3d8103170 con 0x7ff3d8102d90 2024-09-19T04:48:43.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:43.755+0000 7ff3d5ffb640 1 -- 172.21.15.2:0/3047380547 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138530+0+0 (secure 0 0 0) 0x7ff3cc005020 con 0x7ff3d8102d90 2024-09-19T04:48:43.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:43.756+0000 7ff3d5ffb640 1 --2- 172.21.15.2:0/3047380547 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7ff3c80a3660 0x7ff3c80a5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:43.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:43.756+0000 7ff3d7fff640 1 --2- 172.21.15.2:0/3047380547 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7ff3c80a3660 0x7ff3c80a5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:43.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:43.756+0000 7ff3d5ffb640 1 -- 172.21.15.2:0/3047380547 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7ff3cc0cfad0 con 0x7ff3d8102d90 2024-09-19T04:48:43.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:43.756+0000 7ff3d7fff640 1 --2- 172.21.15.2:0/3047380547 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7ff3c80a3660 0x7ff3c80a5b20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff3d80fee40 tx=0x7ff3c4009110 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:43.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:43.764+0000 7ff3d5ffb640 1 -- 172.21.15.2:0/3047380547 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff3d819dc00 con 0x7ff3d8102d90 2024-09-19T04:48:44.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:44.040+0000 7ff3df0f6640 1 -- 172.21.15.2:0/3047380547 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff3d802d7c0 con 0x7ff3d8102d90 2024-09-19T04:48:44.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:44.041+0000 7ff3d5ffb640 1 -- 172.21.15.2:0/3047380547 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11840 (secure 0 0 0) 0x7ff3cc014030 con 0x7ff3d8102d90 2024-09-19T04:48:44.043 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:48:44.043 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":19,"btime":"2024-09-19T04:46:33:537239+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2467365137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2467365137},{"type":"v1","addr":"172.21.15.2:6835","nonce":2467365137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3162441888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3162441888},{"type":"v1","addr":"172.21.15.2:6837","nonce":3162441888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14631,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2740862966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2740862966},{"type":"v1","addr":"172.21.15.2:6839","nonce":2740862966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/2394435504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2394435504},{"type":"v1","addr":"172.21.15.2:6841","nonce":2394435504}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1630480244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1630480244},{"type":"v1","addr":"172.21.15.18:6833","nonce":1630480244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1553897465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1553897465},{"type":"v1","addr":"172.21.15.116:6833","nonce":1553897465}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3035664608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3035664608},{"type":"v1","addr":"172.21.15.18:6835","nonce":3035664608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1096622392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1096622392},{"type":"v1","addr":"172.21.15.18:6837","nonce":1096622392}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3761157675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3761157675},{"type":"v1","addr":"172.21.15.116:6835","nonce":3761157675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/1120131594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1120131594},{"type":"v1","addr":"172.21.15.116:6837","nonce":1120131594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:46:24.050115+0000","modified":"2024-09-19T04:46:33.112369+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/4207677139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":4207677139},{"type":"v1","addr":"172.21.15.18:6839","nonce":4207677139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/2346874880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":2346874880},{"type":"v1","addr":"172.21.15.116:6839","nonce":2346874880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496]},"id":1}]} 2024-09-19T04:48:44.043 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 19 2024-09-19T04:48:44.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:44.044+0000 7ff3df0f6640 1 -- 172.21.15.2:0/3047380547 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7ff3c80a3660 msgr2=0x7ff3c80a5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:44.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:44.044+0000 7ff3df0f6640 1 --2- 172.21.15.2:0/3047380547 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7ff3c80a3660 0x7ff3c80a5b20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff3d80fee40 tx=0x7ff3c4009110 comp rx=0 tx=0).stop 2024-09-19T04:48:44.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:44.044+0000 7ff3df0f6640 1 -- 172.21.15.2:0/3047380547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3d8102d90 msgr2=0x7ff3d8198500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:44.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:44.044+0000 7ff3df0f6640 1 --2- 172.21.15.2:0/3047380547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3d8102d90 0x7ff3d8198500 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc00c970 tx=0x7ff3cc00cd70 comp rx=0 tx=0).stop 2024-09-19T04:48:44.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:44.044+0000 7ff3df0f6640 1 -- 172.21.15.2:0/3047380547 shutdown_connections 2024-09-19T04:48:44.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:44.044+0000 7ff3df0f6640 1 --2- 172.21.15.2:0/3047380547 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7ff3c80a3660 0x7ff3c80a5b20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:44.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:44.044+0000 7ff3df0f6640 1 --2- 172.21.15.2:0/3047380547 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff3d8108290 0x7ff3d819cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:44.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:44.044+0000 7ff3df0f6640 1 --2- 172.21.15.2:0/3047380547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3d8103740 0x7ff3d8198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:44.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:44.044+0000 7ff3df0f6640 1 --2- 172.21.15.2:0/3047380547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3d8102d90 0x7ff3d8198500 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:44.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:44.044+0000 7ff3df0f6640 1 -- 172.21.15.2:0/3047380547 >> 172.21.15.2:0/3047380547 conn(0x7ff3d80fc7d0 msgr2=0x7ff3d8105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:44.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:44.045+0000 7ff3df0f6640 1 -- 172.21.15.2:0/3047380547 shutdown_connections 2024-09-19T04:48:44.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:44.045+0000 7ff3df0f6640 1 -- 172.21.15.2:0/3047380547 wait complete. 2024-09-19T04:48:44.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:44 smithi002 ceph-mon[30975]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:48:44.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:44 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/3047380547' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:48:44.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:44 smithi018 ceph-mon[34537]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:48:44.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:44 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/3047380547' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:48:44.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:44 smithi116 ceph-mon[34477]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:48:44.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:44 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/3047380547' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:48:44.703 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:48:45.007 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:48:45.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.497+0000 7fb71fcd1640 1 -- 172.21.15.2:0/3151414168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7181055b0 msgr2=0x7fb71810d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:45.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.497+0000 7fb71fcd1640 1 --2- 172.21.15.2:0/3151414168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7181055b0 0x7fb71810d130 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fb710009ca0 tx=0x7fb71002a8c0 comp rx=0 tx=0).stop 2024-09-19T04:48:45.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.497+0000 7fb71fcd1640 1 -- 172.21.15.2:0/3151414168 shutdown_connections 2024-09-19T04:48:45.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.497+0000 7fb71fcd1640 1 --2- 172.21.15.2:0/3151414168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7181055b0 0x7fb71810d130 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:45.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.497+0000 7fb71fcd1640 1 --2- 172.21.15.2:0/3151414168 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb718100e30 0x7fb718104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:45.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.497+0000 7fb71fcd1640 1 --2- 172.21.15.2:0/3151414168 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb718100480 0x7fb718100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:45.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.497+0000 7fb71fcd1640 1 -- 172.21.15.2:0/3151414168 >> 172.21.15.2:0/3151414168 conn(0x7fb718077210 msgr2=0x7fb7180fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:45.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.498+0000 7fb71fcd1640 1 -- 172.21.15.2:0/3151414168 shutdown_connections 2024-09-19T04:48:45.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.498+0000 7fb71fcd1640 1 -- 172.21.15.2:0/3151414168 wait complete. 2024-09-19T04:48:45.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.498+0000 7fb71fcd1640 1 Processor -- start 2024-09-19T04:48:45.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.498+0000 7fb71fcd1640 1 -- start start 2024-09-19T04:48:45.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.499+0000 7fb71fcd1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb718100480 0x7fb7180fc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:45.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.499+0000 7fb71fcd1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb718100e30 0x7fb7180fcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:45.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.499+0000 7fb71fcd1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7181055b0 0x7fb7180fd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:45.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.499+0000 7fb71fcd1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb71810fc40 con 0x7fb7181055b0 2024-09-19T04:48:45.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.499+0000 7fb71fcd1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb71810fac0 con 0x7fb718100480 2024-09-19T04:48:45.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.499+0000 7fb71fcd1640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fb71810fdc0 con 0x7fb718100e30 2024-09-19T04:48:45.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.499+0000 7fb71da6d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb718100480 0x7fb7180fc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:45.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.499+0000 7fb71e26e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7181055b0 0x7fb7180fd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:45.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.499+0000 7fb71da6d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb718100480 0x7fb7180fc690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.2:46604/0 (socket says 172.21.15.2:46604) 2024-09-19T04:48:45.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.499+0000 7fb71da6d640 1 -- 172.21.15.2:0/3831511146 learned_addr learned my addr 172.21.15.2:0/3831511146 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:48:45.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.499+0000 7fb71d26c640 1 --2- 172.21.15.2:0/3831511146 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb718100e30 0x7fb7180fcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:45.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.499+0000 7fb71da6d640 1 -- 172.21.15.2:0/3831511146 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb718100e30 msgr2=0x7fb7180fcbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:45.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.499+0000 7fb71da6d640 1 --2- 172.21.15.2:0/3831511146 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb718100e30 0x7fb7180fcbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:45.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.499+0000 7fb71da6d640 1 -- 172.21.15.2:0/3831511146 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7181055b0 msgr2=0x7fb7180fd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:45.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.499+0000 7fb71da6d640 1 --2- 172.21.15.2:0/3831511146 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7181055b0 0x7fb7180fd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:45.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.499+0000 7fb71da6d640 1 -- 172.21.15.2:0/3831511146 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7181a6810 con 0x7fb718100480 2024-09-19T04:48:45.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.500+0000 7fb71da6d640 1 --2- 172.21.15.2:0/3831511146 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb718100480 0x7fb7180fc690 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb71400ea40 tx=0x7fb71400ef00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:45.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.500+0000 7fb70effd640 1 -- 172.21.15.2:0/3831511146 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71400cd40 con 0x7fb718100480 2024-09-19T04:48:45.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.500+0000 7fb71fcd1640 1 -- 172.21.15.2:0/3831511146 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7181a6b00 con 0x7fb718100480 2024-09-19T04:48:45.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.500+0000 7fb71fcd1640 1 -- 172.21.15.2:0/3831511146 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7181a7040 con 0x7fb718100480 2024-09-19T04:48:45.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.500+0000 7fb70effd640 1 -- 172.21.15.2:0/3831511146 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb7140054d0 con 0x7fb718100480 2024-09-19T04:48:45.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.500+0000 7fb70effd640 1 -- 172.21.15.2:0/3831511146 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb714016670 con 0x7fb718100480 2024-09-19T04:48:45.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.502+0000 7fb70effd640 1 -- 172.21.15.2:0/3831511146 <== mon.2 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 23) ==== 138530+0+0 (secure 0 0 0) 0x7fb7140046c0 con 0x7fb718100480 2024-09-19T04:48:45.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.503+0000 7fb7220aa740 1 Processor -- start 2024-09-19T04:48:45.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.503+0000 7fb70effd640 1 --2- 172.21.15.2:0/3831511146 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fb7040a3540 0x7fb7040a5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:45.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.504+0000 7fb70effd640 1 -- 172.21.15.2:0/3831511146 <== mon.2 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7fb7140cfb20 con 0x7fb718100480 2024-09-19T04:48:45.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.504+0000 7fb7220aa740 1 -- start start 2024-09-19T04:48:45.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.504+0000 7fb71d26c640 1 --2- 172.21.15.2:0/3831511146 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fb7040a3540 0x7fb7040a5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:45.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.504+0000 7fb7220aa740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55916d9eab40 0x55916d9e9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:45.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.504+0000 7fb7220aa740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55916d9e95d0 0x55916d9e9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:45.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.504+0000 7fb7220aa740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55916d9f4370 0x55916d9f6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:45.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.504+0000 7fb7220aa740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55916d94f2f0 con 0x55916d9e95d0 2024-09-19T04:48:45.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.504+0000 7fb7220aa740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55916d8f6cf0 con 0x55916d9eab40 2024-09-19T04:48:45.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.504+0000 7fb7220aa740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55916d94b2b0 con 0x55916d9f4370 2024-09-19T04:48:45.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.504+0000 7fb71e26e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55916d9f4370 0x55916d9f6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:45.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.504+0000 7fb71e26e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55916d9f4370 0x55916d9f6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.2:38380/0 (socket says 172.21.15.2:38380) 2024-09-19T04:48:45.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.504+0000 7fb71e26e640 1 -- 172.21.15.2:0/4002307445 learned_addr learned my addr 172.21.15.2:0/4002307445 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:48:45.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.504+0000 7fb71da6d640 1 --2- 172.21.15.2:0/4002307445 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55916d9eab40 0x55916d9e9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:45.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.505+0000 7fb71d26c640 1 --2- 172.21.15.2:0/3831511146 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fb7040a3540 0x7fb7040a5a00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb7180fe120 tx=0x7fb708005f90 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:45.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.505+0000 7fb71e26e640 1 -- 172.21.15.2:0/4002307445 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55916d9eab40 msgr2=0x55916d9e9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:48:45.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.505+0000 7fb71e26e640 1 --2- 172.21.15.2:0/4002307445 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55916d9eab40 0x55916d9e9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:45.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.505+0000 7fb71e26e640 1 -- 172.21.15.2:0/4002307445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55916d9e95d0 msgr2=0x55916d9e9a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T04:48:45.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.505+0000 7fb71d26c640 1 --2- 172.21.15.2:0/4002307445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55916d9e95d0 0x55916d9e9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:45.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.505+0000 7fb71e26e640 1 --2- 172.21.15.2:0/4002307445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55916d9e95d0 0x55916d9e9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:45.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.505+0000 7fb71e26e640 1 -- 172.21.15.2:0/4002307445 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55916d8db3a0 con 0x55916d9f4370 2024-09-19T04:48:45.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.505+0000 7fb71d26c640 1 --2- 172.21.15.2:0/4002307445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55916d9e95d0 0x55916d9e9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:48:45.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.505+0000 7fb71e26e640 1 --2- 172.21.15.2:0/4002307445 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55916d9f4370 0x55916d9f6760 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb710009ca0 tx=0x7fb710009a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8a97b839b35cfb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:45.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.505+0000 7fb703fff640 1 -- 172.21.15.2:0/4002307445 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb710031d00 con 0x55916d9f4370 2024-09-19T04:48:45.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.505+0000 7fb703fff640 1 -- 172.21.15.2:0/4002307445 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb710036030 con 0x55916d9f4370 2024-09-19T04:48:45.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.506+0000 7fb703fff640 1 -- 172.21.15.2:0/4002307445 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7100042a0 con 0x55916d9f4370 2024-09-19T04:48:45.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.506+0000 7fb7220aa740 1 -- 172.21.15.2:0/4002307445 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55916d9f4370 msgr2=0x55916d9f6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:45.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.506+0000 7fb7220aa740 1 --2- 172.21.15.2:0/4002307445 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55916d9f4370 0x55916d9f6760 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb710009ca0 tx=0x7fb710009a20 comp rx=0 tx=0).stop 2024-09-19T04:48:45.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.506+0000 7fb7220aa740 1 -- 172.21.15.2:0/4002307445 shutdown_connections 2024-09-19T04:48:45.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.506+0000 7fb7220aa740 1 --2- 172.21.15.2:0/4002307445 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55916d9f4370 0x55916d9f6760 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:45.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.506+0000 7fb7220aa740 1 --2- 172.21.15.2:0/4002307445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55916d9e95d0 0x55916d9e9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:45.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.506+0000 7fb7220aa740 1 --2- 172.21.15.2:0/4002307445 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55916d9eab40 0x55916d9e9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:45.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.506+0000 7fb7220aa740 1 -- 172.21.15.2:0/4002307445 >> 172.21.15.2:0/4002307445 conn(0x55916d9b2310 msgr2=0x55916d9e5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:45.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.507+0000 7fb7220aa740 1 -- 172.21.15.2:0/4002307445 shutdown_connections 2024-09-19T04:48:45.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.507+0000 7fb7220aa740 1 -- 172.21.15.2:0/4002307445 wait complete. 2024-09-19T04:48:45.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.507+0000 7fb7220aa740 1 -- start start 2024-09-19T04:48:45.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.507+0000 7fb7220aa740 1 Processor -- start 2024-09-19T04:48:45.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.508+0000 7fb7220aa740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55916d9e95d0 0x55916d9f3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:45.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.508+0000 7fb7220aa740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55916d9eab40 0x55916d9f0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:45.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.508+0000 7fb7220aa740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55916d9f4370 0x55916d9f1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:45.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.508+0000 7fb7220aa740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55916d9f6e90 con 0x55916d9f4370 2024-09-19T04:48:45.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.508+0000 7fb7220aa740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55916d90a060 con 0x55916d9e95d0 2024-09-19T04:48:45.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.508+0000 7fb7220aa740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55916d9f7010 con 0x55916d9eab40 2024-09-19T04:48:45.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.508+0000 7fb7220aa740 10 client.0 _ll_register_callbacks cb 0x55916d65d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:48:45.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.508+0000 7fb71e26e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55916d9f4370 0x55916d9f1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:45.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.508+0000 7fb71e26e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55916d9f4370 0x55916d9f1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35248/0 (socket says 172.21.15.2:35248) 2024-09-19T04:48:45.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.508+0000 7fb71e26e640 1 -- 172.21.15.2:0/506783093 learned_addr learned my addr 172.21.15.2:0/506783093 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:48:45.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.508+0000 7fb71da6d640 1 --2- 172.21.15.2:0/506783093 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55916d9e95d0 0x55916d9f3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:45.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.508+0000 7fb71d26c640 1 --2- 172.21.15.2:0/506783093 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55916d9eab40 0x55916d9f0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:45.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.509+0000 7fb71e26e640 1 -- 172.21.15.2:0/506783093 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55916d9eab40 msgr2=0x55916d9f0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:48:45.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.509+0000 7fb71e26e640 1 --2- 172.21.15.2:0/506783093 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55916d9eab40 0x55916d9f0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:45.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.509+0000 7fb71e26e640 1 -- 172.21.15.2:0/506783093 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55916d9e95d0 msgr2=0x55916d9f3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:48:45.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.509+0000 7fb71e26e640 1 --2- 172.21.15.2:0/506783093 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55916d9e95d0 0x55916d9f3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:45.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.509+0000 7fb71e26e640 1 -- 172.21.15.2:0/506783093 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55916d6c03c0 con 0x55916d9f4370 2024-09-19T04:48:45.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.509+0000 7fb71e26e640 1 --2- 172.21.15.2:0/506783093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55916d9f4370 0x55916d9f1420 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb71002ade0 tx=0x7fb7100095e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac187e8c47d8f62f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:45.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.509+0000 7fb7017fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:48:45.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.509+0000 7fb7017fa640 1 -- 172.21.15.2:0/506783093 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71004a040 con 0x55916d9f4370 2024-09-19T04:48:45.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.509+0000 7fb7017fa640 1 -- 172.21.15.2:0/506783093 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7fb710031650 con 0x55916d9f4370 2024-09-19T04:48:45.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.509+0000 7fb7220aa740 1 -- 172.21.15.2:0/506783093 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb710036030 con 0x55916d9f4370 2024-09-19T04:48:45.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.510+0000 7fb7017fa640 1 -- 172.21.15.2:0/506783093 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb710003fb0 con 0x55916d9f4370 2024-09-19T04:48:45.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.510+0000 7fb7220aa740 10 client.15318 fetch_fsmap learned FSMap version 19 2024-09-19T04:48:45.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.510+0000 7fb7220aa740 1 -- 172.21.15.2:0/506783093 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55916d9f6e90 con 0x55916d9f4370 2024-09-19T04:48:45.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.510+0000 7fb7017fa640 1 -- 172.21.15.2:0/506783093 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb710055070 con 0x55916d9f4370 2024-09-19T04:48:45.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.510+0000 7fb7017fa640 1 -- 172.21.15.2:0/506783093 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fb71004d030 con 0x55916d9f4370 2024-09-19T04:48:45.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.510+0000 7fb7220aa740 10 client.15318 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:48:45.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.511+0000 7fb7220aa740 10 client.15318 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:48:45.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.511+0000 7fb7220aa740 20 client.15318 populate_metadata read hostname 'smithi002' 2024-09-19T04:48:45.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.511+0000 7fb7220aa740 1 --2- 172.21.15.2:0/506783093 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55916da039a0 0x55916da05de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:45.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.511+0000 7fb7220aa740 4 client.15318 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:48:45.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.511+0000 7fb7220aa740 1 -- 172.21.15.2:0/506783093 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fb710036030 con 0x55916da039a0 2024-09-19T04:48:45.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.511+0000 7fb71da6d640 1 --2- 172.21.15.2:0/506783093 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55916da039a0 0x55916da05de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:45.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.511+0000 7fb7017fa640 10 client.15318 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:48:45.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.511+0000 7fb71da6d640 1 --2- 172.21.15.2:0/506783093 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55916da039a0 0x55916da05de0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e62051b08f28acb5 server_cookie=6a86643a90249dec in_seq=0 out_seq=0 2024-09-19T04:48:45.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.512+0000 7fb7017fa640 1 -- 172.21.15.2:0/506783093 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fb710036030 con 0x55916da039a0 2024-09-19T04:48:45.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.512+0000 7fb7017fa640 10 client.15318 handle_command_reply: tid=0 2024-09-19T04:48:45.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.512+0000 7fb7220aa740 1 client.15318 shutdown 2024-09-19T04:48:45.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.512+0000 7fb7220aa740 1 -- 172.21.15.2:0/506783093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55916d9f4370 msgr2=0x55916d9f1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:45.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.512+0000 7fb7220aa740 1 --2- 172.21.15.2:0/506783093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55916d9f4370 0x55916d9f1420 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb71002ade0 tx=0x7fb7100095e0 comp rx=0 tx=0).stop 2024-09-19T04:48:45.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.512+0000 7fb7220aa740 1 -- 172.21.15.2:0/506783093 shutdown_connections 2024-09-19T04:48:45.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.513+0000 7fb7220aa740 1 --2- 172.21.15.2:0/506783093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55916d9f4370 0x55916d9f1420 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:45.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.513+0000 7fb7220aa740 1 --2- 172.21.15.2:0/506783093 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55916da039a0 0x55916da05de0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:45.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.513+0000 7fb7017fa640 0 client.15318 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:48:45.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.513+0000 7fb7220aa740 1 --2- 172.21.15.2:0/506783093 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55916d9eab40 0x55916d9f0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:45.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.513+0000 7fb7220aa740 1 --2- 172.21.15.2:0/506783093 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55916d9e95d0 0x55916d9f3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:45.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.513+0000 7fb7220aa740 1 -- 172.21.15.2:0/506783093 >> 172.21.15.2:0/506783093 conn(0x55916d9b2310 msgr2=0x55916d9eb930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:45.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.513+0000 7fb7220aa740 1 -- 172.21.15.2:0/506783093 shutdown_connections 2024-09-19T04:48:45.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.513+0000 7fb7220aa740 1 -- 172.21.15.2:0/506783093 wait complete. 2024-09-19T04:48:45.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.513+0000 7fb7220aa740 20 client.15318 trim_cache size 0 max 16384 2024-09-19T04:48:45.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.538+0000 7fb7220aa740 1 Processor -- start 2024-09-19T04:48:45.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.538+0000 7fb7220aa740 1 -- start start 2024-09-19T04:48:45.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.538+0000 7fb7220aa740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55916d9e95d0 0x55916d9e4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:45.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.538+0000 7fb7220aa740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55916d9eab40 0x55916d9ec120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:45.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.539+0000 7fb7220aa740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55916d9f4370 0x55916d9ec660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:45.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.539+0000 7fb7220aa740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb6fc00c680 con 0x55916d9e95d0 2024-09-19T04:48:45.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.539+0000 7fb7220aa740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb6fc00ef00 con 0x55916d9eab40 2024-09-19T04:48:45.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.539+0000 7fb7220aa740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fb6fc00ccf0 con 0x55916d9f4370 2024-09-19T04:48:45.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.539+0000 7fb71da6d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55916d9e95d0 0x55916d9e4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:45.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.539+0000 7fb71da6d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55916d9e95d0 0x55916d9e4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35252/0 (socket says 172.21.15.2:35252) 2024-09-19T04:48:45.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.539+0000 7fb71da6d640 1 -- 172.21.15.2:0/2008285174 learned_addr learned my addr 172.21.15.2:0/2008285174 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:48:45.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.539+0000 7fb71d26c640 1 --2- 172.21.15.2:0/2008285174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55916d9eab40 0x55916d9ec120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:45.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.539+0000 7fb71da6d640 1 -- 172.21.15.2:0/2008285174 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55916d9f4370 msgr2=0x55916d9ec660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:48:45.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.539+0000 7fb71da6d640 1 --2- 172.21.15.2:0/2008285174 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55916d9f4370 0x55916d9ec660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:45.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.539+0000 7fb71da6d640 1 -- 172.21.15.2:0/2008285174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55916d9eab40 msgr2=0x55916d9ec120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:48:45.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.539+0000 7fb71da6d640 1 --2- 172.21.15.2:0/2008285174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55916d9eab40 0x55916d9ec120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:45.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.539+0000 7fb71da6d640 1 -- 172.21.15.2:0/2008285174 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55916d9ef430 con 0x55916d9e95d0 2024-09-19T04:48:45.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.539+0000 7fb71da6d640 1 --2- 172.21.15.2:0/2008285174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55916d9e95d0 0x55916d9e4bf0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb71409bc90 tx=0x7fb714086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d37c36e43201f353 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:45.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.539+0000 7fb7037fe640 1 -- 172.21.15.2:0/2008285174 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7140b1070 con 0x55916d9e95d0 2024-09-19T04:48:45.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.540+0000 7fb7037fe640 1 -- 172.21.15.2:0/2008285174 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb7140b4e50 con 0x55916d9e95d0 2024-09-19T04:48:45.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.540+0000 7fb7037fe640 1 -- 172.21.15.2:0/2008285174 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb714097a50 con 0x55916d9e95d0 2024-09-19T04:48:45.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.541+0000 7fb7220aa740 1 -- 172.21.15.2:0/2008285174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55916d9e95d0 msgr2=0x55916d9e4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:45.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.541+0000 7fb7220aa740 1 --2- 172.21.15.2:0/2008285174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55916d9e95d0 0x55916d9e4bf0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb71409bc90 tx=0x7fb714086040 comp rx=0 tx=0).stop 2024-09-19T04:48:45.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.541+0000 7fb7220aa740 1 -- 172.21.15.2:0/2008285174 shutdown_connections 2024-09-19T04:48:45.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.541+0000 7fb7220aa740 1 --2- 172.21.15.2:0/2008285174 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55916d9f4370 0x55916d9ec660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:45.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.541+0000 7fb7220aa740 1 --2- 172.21.15.2:0/2008285174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55916d9eab40 0x55916d9ec120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:45.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.541+0000 7fb7220aa740 1 --2- 172.21.15.2:0/2008285174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55916d9e95d0 0x55916d9e4bf0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:45.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.541+0000 7fb7220aa740 1 -- 172.21.15.2:0/2008285174 >> 172.21.15.2:0/2008285174 conn(0x55916d9b2310 msgr2=0x55916d9e44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:45.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.541+0000 7fb7220aa740 1 -- 172.21.15.2:0/2008285174 shutdown_connections 2024-09-19T04:48:45.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.541+0000 7fb7220aa740 1 -- 172.21.15.2:0/2008285174 wait complete. 2024-09-19T04:48:45.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.541+0000 7fb7220aa740 1 -- start start 2024-09-19T04:48:45.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.541+0000 7fb7220aa740 1 Processor -- start 2024-09-19T04:48:45.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.542+0000 7fb7220aa740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55916d9e95d0 0x55916d9f8340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:45.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.542+0000 7fb7220aa740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55916d9eab40 0x55916d9f8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:45.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.542+0000 7fb7220aa740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55916d9f4370 0x55916d9f8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:45.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.542+0000 7fb7220aa740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb6fc00d3c0 con 0x55916d9e95d0 2024-09-19T04:48:45.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.542+0000 7fb7220aa740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb6fc00e830 con 0x55916d9f4370 2024-09-19T04:48:45.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.542+0000 7fb7220aa740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fb6fc00da90 con 0x55916d9eab40 2024-09-19T04:48:45.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.542+0000 7fb7220aa740 10 client.0 _ll_register_callbacks cb 0x7fb7140cd000 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:48:45.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.542+0000 7fb71e26e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55916d9f4370 0x55916d9f8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:45.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.542+0000 7fb71e26e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55916d9f4370 0x55916d9f8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.2:46640/0 (socket says 172.21.15.2:46640) 2024-09-19T04:48:45.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.542+0000 7fb71e26e640 1 -- 172.21.15.2:0/3779840097 learned_addr learned my addr 172.21.15.2:0/3779840097 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:48:45.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.542+0000 7fb71d26c640 1 --2- 172.21.15.2:0/3779840097 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55916d9eab40 0x55916d9f8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:45.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.542+0000 7fb71da6d640 1 --2- 172.21.15.2:0/3779840097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55916d9e95d0 0x55916d9f8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:45.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.542+0000 7fb71e26e640 1 -- 172.21.15.2:0/3779840097 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55916d9eab40 msgr2=0x55916d9f8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:48:45.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.542+0000 7fb71e26e640 1 --2- 172.21.15.2:0/3779840097 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55916d9eab40 0x55916d9f8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:45.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.542+0000 7fb71e26e640 1 -- 172.21.15.2:0/3779840097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55916d9e95d0 msgr2=0x55916d9f8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:48:45.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.543+0000 7fb71e26e640 1 --2- 172.21.15.2:0/3779840097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55916d9e95d0 0x55916d9f8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:45.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.543+0000 7fb71e26e640 1 -- 172.21.15.2:0/3779840097 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55916da6d910 con 0x55916d9f4370 2024-09-19T04:48:45.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.543+0000 7fb71da6d640 1 --2- 172.21.15.2:0/3779840097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55916d9e95d0 0x55916d9f8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:48:45.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.543+0000 7fb71e26e640 1 --2- 172.21.15.2:0/3779840097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55916d9f4370 0x55916d9f8dc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb710009ca0 tx=0x7fb710030df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8650923e0e5d0ec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:45.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.543+0000 7fb7017fa640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T04:48:45.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.543+0000 7fb7017fa640 1 -- 172.21.15.2:0/3779840097 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb710031d10 con 0x55916d9f4370 2024-09-19T04:48:45.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.543+0000 7fb7220aa740 1 -- 172.21.15.2:0/3779840097 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7140b4e50 con 0x55916d9f4370 2024-09-19T04:48:45.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.544+0000 7fb7017fa640 1 -- 172.21.15.2:0/3779840097 <== mon.2 v2:172.21.15.18:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7fb710031650 con 0x55916d9f4370 2024-09-19T04:48:45.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.544+0000 7fb7017fa640 1 -- 172.21.15.2:0/3779840097 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb710031870 con 0x55916d9f4370 2024-09-19T04:48:45.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.544+0000 7fb7220aa740 10 client.24959 fetch_fsmap learned FSMap version 19 2024-09-19T04:48:45.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.544+0000 7fb7220aa740 1 -- 172.21.15.2:0/3779840097 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55916da6ec10 con 0x55916d9f4370 2024-09-19T04:48:45.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.544+0000 7fb7017fa640 1 -- 172.21.15.2:0/3779840097 <== mon.2 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb710036070 con 0x55916d9f4370 2024-09-19T04:48:45.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.544+0000 7fb7017fa640 1 -- 172.21.15.2:0/3779840097 <== mon.2 v2:172.21.15.18:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fb710061060 con 0x55916d9f4370 2024-09-19T04:48:45.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.544+0000 7fb7220aa740 10 client.24959 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:48:45.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.544+0000 7fb7220aa740 10 client.24959 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:48:45.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.544+0000 7fb7220aa740 20 client.24959 populate_metadata read hostname 'smithi002' 2024-09-19T04:48:45.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.544+0000 7fb7220aa740 1 --2- 172.21.15.2:0/3779840097 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55916da039a0 0x55916da713b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:45.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.544+0000 7fb7220aa740 4 client.24959 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:48:45.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.544+0000 7fb7220aa740 1 -- 172.21.15.2:0/3779840097 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fb7140b4e50 con 0x55916da039a0 2024-09-19T04:48:45.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.545+0000 7fb71da6d640 1 --2- 172.21.15.2:0/3779840097 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55916da039a0 0x55916da713b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:45.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.545+0000 7fb7017fa640 10 client.24959 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:48:45.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.545+0000 7fb71da6d640 1 --2- 172.21.15.2:0/3779840097 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55916da039a0 0x55916da713b0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=798ab9d91f35ca4a server_cookie=af5c9ada940553ba in_seq=0 out_seq=0 2024-09-19T04:48:45.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.545+0000 7fb7017fa640 1 -- 172.21.15.2:0/3779840097 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fb7140b4e50 con 0x55916da039a0 2024-09-19T04:48:45.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.545+0000 7fb7017fa640 10 client.24959 handle_command_reply: tid=0 2024-09-19T04:48:45.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.545+0000 7fb7220aa740 1 client.24959 shutdown 2024-09-19T04:48:45.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.545+0000 7fb7220aa740 1 -- 172.21.15.2:0/3779840097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55916d9f4370 msgr2=0x55916d9f8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:45.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.545+0000 7fb7220aa740 1 --2- 172.21.15.2:0/3779840097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55916d9f4370 0x55916d9f8dc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb710009ca0 tx=0x7fb710030df0 comp rx=0 tx=0).stop 2024-09-19T04:48:45.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.546+0000 7fb7220aa740 1 -- 172.21.15.2:0/3779840097 shutdown_connections 2024-09-19T04:48:45.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.546+0000 7fb7220aa740 1 --2- 172.21.15.2:0/3779840097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55916d9f4370 0x55916d9f8dc0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:45.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.546+0000 7fb7220aa740 1 --2- 172.21.15.2:0/3779840097 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55916da039a0 0x55916da713b0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:45.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.546+0000 7fb7220aa740 1 --2- 172.21.15.2:0/3779840097 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55916d9eab40 0x55916d9f8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:45.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.546+0000 7fb7220aa740 1 --2- 172.21.15.2:0/3779840097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55916d9e95d0 0x55916d9f8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:45.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.546+0000 7fb7017fa640 0 client.24959 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:48:45.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.546+0000 7fb7220aa740 1 -- 172.21.15.2:0/3779840097 >> 172.21.15.2:0/3779840097 conn(0x55916d9b2310 msgr2=0x55916d9e4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:45.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.546+0000 7fb7220aa740 1 -- 172.21.15.2:0/3779840097 shutdown_connections 2024-09-19T04:48:45.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.546+0000 7fb7220aa740 1 -- 172.21.15.2:0/3779840097 wait complete. 2024-09-19T04:48:45.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.546+0000 7fb7220aa740 20 client.24959 trim_cache size 0 max 16384 2024-09-19T04:48:45.552 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T04:48:45.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.547+0000 7fb71fcd1640 1 -- 172.21.15.2:0/3831511146 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fb7040a3540 msgr2=0x7fb7040a5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:45.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.547+0000 7fb71fcd1640 1 --2- 172.21.15.2:0/3831511146 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fb7040a3540 0x7fb7040a5a00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb7180fe120 tx=0x7fb708005f90 comp rx=0 tx=0).stop 2024-09-19T04:48:45.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.547+0000 7fb71fcd1640 1 -- 172.21.15.2:0/3831511146 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb718100480 msgr2=0x7fb7180fc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:45.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.547+0000 7fb71fcd1640 1 --2- 172.21.15.2:0/3831511146 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb718100480 0x7fb7180fc690 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb71400ea40 tx=0x7fb71400ef00 comp rx=0 tx=0).stop 2024-09-19T04:48:45.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.547+0000 7fb71fcd1640 1 -- 172.21.15.2:0/3831511146 shutdown_connections 2024-09-19T04:48:45.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.547+0000 7fb71fcd1640 1 --2- 172.21.15.2:0/3831511146 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7181055b0 0x7fb7180fd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:45.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.547+0000 7fb71fcd1640 1 --2- 172.21.15.2:0/3831511146 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fb7040a3540 0x7fb7040a5a00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:45.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.547+0000 7fb71fcd1640 1 --2- 172.21.15.2:0/3831511146 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb718100e30 0x7fb7180fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:45.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.547+0000 7fb71fcd1640 1 --2- 172.21.15.2:0/3831511146 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb718100480 0x7fb7180fc690 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:45.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.547+0000 7fb71fcd1640 1 -- 172.21.15.2:0/3831511146 >> 172.21.15.2:0/3831511146 conn(0x7fb718077210 msgr2=0x7fb7180fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:45.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.547+0000 7fb71fcd1640 1 -- 172.21.15.2:0/3831511146 shutdown_connections 2024-09-19T04:48:45.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:45.548+0000 7fb71fcd1640 1 -- 172.21.15.2:0/3831511146 wait complete. 2024-09-19T04:48:46.554 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:46 smithi002 ceph-mon[30975]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T04:48:46.556 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:46 smithi018 ceph-mon[34537]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T04:48:46.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:46 smithi116 ceph-mon[34477]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T04:48:47.331 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:48:47.332 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:48:47.685 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:48:48.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.145+0000 7fd771927640 1 -- 172.21.15.2:0/469176422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd76c101410 msgr2=0x7fd76c10d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:48.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.145+0000 7fd771927640 1 --2- 172.21.15.2:0/469176422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd76c101410 0x7fd76c10d940 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd764009cd0 tx=0x7fd76402a8e0 comp rx=0 tx=0).stop 2024-09-19T04:48:48.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.145+0000 7fd771927640 1 -- 172.21.15.2:0/469176422 shutdown_connections 2024-09-19T04:48:48.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.145+0000 7fd771927640 1 --2- 172.21.15.2:0/469176422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd76c101410 0x7fd76c10d940 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:48.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.145+0000 7fd771927640 1 --2- 172.21.15.2:0/469176422 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd76c100a70 0x7fd76c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:48.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.145+0000 7fd771927640 1 --2- 172.21.15.2:0/469176422 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd76c106a70 0x7fd76c106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:48.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.145+0000 7fd771927640 1 -- 172.21.15.2:0/469176422 >> 172.21.15.2:0/469176422 conn(0x7fd76c0fc790 msgr2=0x7fd76c0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:48.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.145+0000 7fd771927640 1 -- 172.21.15.2:0/469176422 shutdown_connections 2024-09-19T04:48:48.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.145+0000 7fd771927640 1 -- 172.21.15.2:0/469176422 wait complete. 2024-09-19T04:48:48.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.147+0000 7fd771927640 1 Processor -- start 2024-09-19T04:48:48.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.147+0000 7fd771927640 1 -- start start 2024-09-19T04:48:48.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.147+0000 7fd771927640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd76c100a70 0x7fd76c199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:48.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.147+0000 7fd771927640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd76c101410 0x7fd76c1997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:48.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.147+0000 7fd771927640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd76c106a70 0x7fd76c1a4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:48.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.147+0000 7fd771927640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd76c110d70 con 0x7fd76c106a70 2024-09-19T04:48:48.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.147+0000 7fd771927640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd76c110bf0 con 0x7fd76c100a70 2024-09-19T04:48:48.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.147+0000 7fd76b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd76c106a70 0x7fd76c1a4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:48.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.147+0000 7fd76b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd76c106a70 0x7fd76c1a4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35290/0 (socket says 172.21.15.2:35290) 2024-09-19T04:48:48.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.147+0000 7fd76b7fe640 1 -- 172.21.15.2:0/885266 learned_addr learned my addr 172.21.15.2:0/885266 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:48:48.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.147+0000 7fd76a7fc640 1 --2- 172.21.15.2:0/885266 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd76c101410 0x7fd76c1997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:48.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.148+0000 7fd771927640 1 -- 172.21.15.2:0/885266 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fd76c110ef0 con 0x7fd76c101410 2024-09-19T04:48:48.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.148+0000 7fd76affd640 1 --2- 172.21.15.2:0/885266 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd76c100a70 0x7fd76c199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:48.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.148+0000 7fd76affd640 1 -- 172.21.15.2:0/885266 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd76c101410 msgr2=0x7fd76c1997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:48.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.148+0000 7fd76affd640 1 --2- 172.21.15.2:0/885266 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd76c101410 0x7fd76c1997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:48.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.148+0000 7fd76affd640 1 -- 172.21.15.2:0/885266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd76c106a70 msgr2=0x7fd76c1a4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:48.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.148+0000 7fd76affd640 1 --2- 172.21.15.2:0/885266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd76c106a70 0x7fd76c1a4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:48.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.148+0000 7fd76affd640 1 -- 172.21.15.2:0/885266 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd76c1a4840 con 0x7fd76c100a70 2024-09-19T04:48:48.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.148+0000 7fd76a7fc640 1 --2- 172.21.15.2:0/885266 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd76c101410 0x7fd76c1997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:48:48.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.148+0000 7fd76b7fe640 1 --2- 172.21.15.2:0/885266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd76c106a70 0x7fd76c1a4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:48:48.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.149+0000 7fd76affd640 1 --2- 172.21.15.2:0/885266 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd76c100a70 0x7fd76c199280 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd75c00e9f0 tx=0x7fd75c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:48.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.149+0000 7fd770925640 1 -- 172.21.15.2:0/885266 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd75c00ccc0 con 0x7fd76c100a70 2024-09-19T04:48:48.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.149+0000 7fd771927640 1 -- 172.21.15.2:0/885266 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd76c1a4a10 con 0x7fd76c100a70 2024-09-19T04:48:48.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.149+0000 7fd770925640 1 -- 172.21.15.2:0/885266 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd75c0044d0 con 0x7fd76c100a70 2024-09-19T04:48:48.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.149+0000 7fd770925640 1 -- 172.21.15.2:0/885266 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd75c01c070 con 0x7fd76c100a70 2024-09-19T04:48:48.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.149+0000 7fd771927640 1 -- 172.21.15.2:0/885266 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd76c1a4ea0 con 0x7fd76c100a70 2024-09-19T04:48:48.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.153+0000 7fd770925640 1 -- 172.21.15.2:0/885266 <== mon.2 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 23) ==== 138530+0+0 (secure 0 0 0) 0x7fd75c0050b0 con 0x7fd76c100a70 2024-09-19T04:48:48.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.153+0000 7fd773d00740 1 Processor -- start 2024-09-19T04:48:48.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.153+0000 7fd773d00740 1 -- start start 2024-09-19T04:48:48.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.153+0000 7fd773d00740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560c00dc1a00 0x560c00dc1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:48.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.153+0000 7fd773d00740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c00dc2320 0x560c00dd0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:48.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.153+0000 7fd773d00740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c00dd1150 0x560c00dd3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:48.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.153+0000 7fd773d00740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560c00d27280 con 0x560c00dc2320 2024-09-19T04:48:48.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.153+0000 7fd773d00740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560c00cceb10 con 0x560c00dd1150 2024-09-19T04:48:48.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.153+0000 7fd773d00740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x560c00d23240 con 0x560c00dc1a00 2024-09-19T04:48:48.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.154+0000 7fd76a7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c00dd1150 0x560c00dd3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:48.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.154+0000 7fd76a7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c00dd1150 0x560c00dd3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.2:46654/0 (socket says 172.21.15.2:46654) 2024-09-19T04:48:48.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.154+0000 7fd76a7fc640 1 -- 172.21.15.2:0/3498420500 learned_addr learned my addr 172.21.15.2:0/3498420500 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:48:48.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.154+0000 7fd76affd640 1 --2- 172.21.15.2:0/3498420500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c00dc2320 0x560c00dd0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:48.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.154+0000 7fd76b7fe640 1 --2- 172.21.15.2:0/3498420500 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560c00dc1a00 0x560c00dc1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:48.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.154+0000 7fd76affd640 1 -- 172.21.15.2:0/3498420500 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560c00dc1a00 msgr2=0x560c00dc1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:48:48.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.154+0000 7fd76affd640 1 --2- 172.21.15.2:0/3498420500 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560c00dc1a00 0x560c00dc1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:48.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.154+0000 7fd76affd640 1 -- 172.21.15.2:0/3498420500 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c00dd1150 msgr2=0x560c00dd3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:48:48.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.154+0000 7fd76affd640 1 --2- 172.21.15.2:0/3498420500 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c00dd1150 0x560c00dd3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:48.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.154+0000 7fd76affd640 1 -- 172.21.15.2:0/3498420500 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c00cdb1f0 con 0x560c00dc2320 2024-09-19T04:48:48.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.154+0000 7fd76a7fc640 1 --2- 172.21.15.2:0/3498420500 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c00dd1150 0x560c00dd3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:48:48.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.154+0000 7fd76b7fe640 1 --2- 172.21.15.2:0/3498420500 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560c00dc1a00 0x560c00dc1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:48:48.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.155+0000 7fd770925640 1 --2- 172.21.15.2:0/885266 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fd7540a34c0 0x7fd7540a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:48.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.155+0000 7fd76b7fe640 1 --2- 172.21.15.2:0/885266 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fd7540a34c0 0x7fd7540a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:48.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.155+0000 7fd76affd640 1 --2- 172.21.15.2:0/3498420500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c00dc2320 0x560c00dd0c10 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd75c0cd3d0 tx=0x7fd75c0d3ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4211fe164e39feba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:48.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.155+0000 7fd770925640 1 -- 172.21.15.2:0/885266 <== mon.2 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7fd75c0cfd20 con 0x7fd76c100a70 2024-09-19T04:48:48.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.156+0000 7fd751ffb640 1 -- 172.21.15.2:0/3498420500 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd75c09b810 con 0x560c00dc2320 2024-09-19T04:48:48.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.156+0000 7fd751ffb640 1 -- 172.21.15.2:0/3498420500 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd75c09c5b0 con 0x560c00dc2320 2024-09-19T04:48:48.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.156+0000 7fd751ffb640 1 -- 172.21.15.2:0/3498420500 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd75c09b9f0 con 0x560c00dc2320 2024-09-19T04:48:48.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.157+0000 7fd76b7fe640 1 --2- 172.21.15.2:0/885266 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fd7540a34c0 0x7fd7540a5980 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd764009a60 tx=0x7fd764005d80 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:48.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.157+0000 7fd773d00740 1 -- 172.21.15.2:0/3498420500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c00dc2320 msgr2=0x560c00dd0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:48.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.157+0000 7fd773d00740 1 --2- 172.21.15.2:0/3498420500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c00dc2320 0x560c00dd0c10 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd75c0cd3d0 tx=0x7fd75c0d3ea0 comp rx=0 tx=0).stop 2024-09-19T04:48:48.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.157+0000 7fd773d00740 1 -- 172.21.15.2:0/3498420500 shutdown_connections 2024-09-19T04:48:48.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.157+0000 7fd773d00740 1 --2- 172.21.15.2:0/3498420500 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c00dd1150 0x560c00dd3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:48.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.157+0000 7fd773d00740 1 --2- 172.21.15.2:0/3498420500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c00dc2320 0x560c00dd0c10 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:48.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.157+0000 7fd773d00740 1 --2- 172.21.15.2:0/3498420500 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560c00dc1a00 0x560c00dc1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:48.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.157+0000 7fd773d00740 1 -- 172.21.15.2:0/3498420500 >> 172.21.15.2:0/3498420500 conn(0x560c00dbe0f0 msgr2=0x560c00dbe4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:48.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.157+0000 7fd773d00740 1 -- 172.21.15.2:0/3498420500 shutdown_connections 2024-09-19T04:48:48.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.157+0000 7fd773d00740 1 -- 172.21.15.2:0/3498420500 wait complete. 2024-09-19T04:48:48.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.157+0000 7fd773d00740 1 -- start start 2024-09-19T04:48:48.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.158+0000 7fd773d00740 1 Processor -- start 2024-09-19T04:48:48.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.158+0000 7fd773d00740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c00dc1a00 0x560c00dd0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:48.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.158+0000 7fd773d00740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c00dd1150 0x560c00dc9d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:48.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.158+0000 7fd773d00740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560c00dca290 0x560c00dca710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:48.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.158+0000 7fd773d00740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560c00dd3d70 con 0x560c00dc1a00 2024-09-19T04:48:48.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.158+0000 7fd773d00740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560c00ce1f10 con 0x560c00dd1150 2024-09-19T04:48:48.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.158+0000 7fd76a7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c00dd1150 0x560c00dc9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:48.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.159+0000 7fd76a7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c00dd1150 0x560c00dc9d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.2:46660/0 (socket says 172.21.15.2:46660) 2024-09-19T04:48:48.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.159+0000 7fd76a7fc640 1 -- 172.21.15.2:0/2262992395 learned_addr learned my addr 172.21.15.2:0/2262992395 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:48:48.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.159+0000 7fd76b7fe640 1 --2- 172.21.15.2:0/2262992395 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560c00dca290 0x560c00dca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:48.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.159+0000 7fd773d00740 1 -- 172.21.15.2:0/2262992395 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x560c00dd3ef0 con 0x560c00dca290 2024-09-19T04:48:48.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.159+0000 7fd773d00740 10 client.0 _ll_register_callbacks cb 0x560c00caaa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:48:48.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.159+0000 7fd76b7fe640 1 -- 172.21.15.2:0/2262992395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c00dd1150 msgr2=0x560c00dc9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:48:48.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.159+0000 7fd76b7fe640 1 --2- 172.21.15.2:0/2262992395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c00dd1150 0x560c00dc9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:48.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.159+0000 7fd76b7fe640 1 -- 172.21.15.2:0/2262992395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c00dc1a00 msgr2=0x560c00dd0ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T04:48:48.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.159+0000 7fd76b7fe640 1 --2- 172.21.15.2:0/2262992395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c00dc1a00 0x560c00dd0ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:48.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.159+0000 7fd76b7fe640 1 -- 172.21.15.2:0/2262992395 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c00a986a0 con 0x560c00dca290 2024-09-19T04:48:48.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.160+0000 7fd76b7fe640 1 --2- 172.21.15.2:0/2262992395 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560c00dca290 0x560c00dca710 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd76c06b870 tx=0x7fd76402a8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7130b572a51d6c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:48.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.160+0000 7fd74affd640 10 client.0 ms_handle_connect on v2:172.21.15.116:3300/0 2024-09-19T04:48:48.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.160+0000 7fd74affd640 1 -- 172.21.15.2:0/2262992395 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd764055060 con 0x560c00dca290 2024-09-19T04:48:48.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.160+0000 7fd74affd640 1 -- 172.21.15.2:0/2262992395 <== mon.1 v2:172.21.15.116:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7fd7640047a0 con 0x560c00dca290 2024-09-19T04:48:48.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.160+0000 7fd773d00740 1 -- 172.21.15.2:0/2262992395 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd75c09c5b0 con 0x560c00dca290 2024-09-19T04:48:48.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.161+0000 7fd74affd640 1 -- 172.21.15.2:0/2262992395 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fd7640305a0 con 0x560c00dca290 2024-09-19T04:48:48.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.161+0000 7fd773d00740 10 client.25003 fetch_fsmap learned FSMap version 19 2024-09-19T04:48:48.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.161+0000 7fd773d00740 1 -- 172.21.15.2:0/2262992395 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x560c00de4350 con 0x560c00dca290 2024-09-19T04:48:48.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.161+0000 7fd74affd640 1 -- 172.21.15.2:0/2262992395 <== mon.1 v2:172.21.15.116:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd75c09c5b0 con 0x560c00dca290 2024-09-19T04:48:48.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.161+0000 7fd74affd640 1 -- 172.21.15.2:0/2262992395 <== mon.1 v2:172.21.15.116:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fd76404f030 con 0x560c00dca290 2024-09-19T04:48:48.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.161+0000 7fd773d00740 10 client.25003 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:48:48.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.161+0000 7fd773d00740 10 client.25003 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:48:48.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.161+0000 7fd773d00740 20 client.25003 populate_metadata read hostname 'smithi002' 2024-09-19T04:48:48.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.161+0000 7fd773d00740 1 --2- 172.21.15.2:0/2262992395 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560c00de5810 0x560c00de7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:48.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.162+0000 7fd773d00740 4 client.25003 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:48:48.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.162+0000 7fd773d00740 1 -- 172.21.15.2:0/2262992395 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c00d347f0 con 0x560c00de5810 2024-09-19T04:48:48.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.162+0000 7fd76affd640 1 --2- 172.21.15.2:0/2262992395 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560c00de5810 0x560c00de7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:48.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.163+0000 7fd76affd640 1 --2- 172.21.15.2:0/2262992395 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560c00de5810 0x560c00de7cd0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f9168c468a7351c server_cookie=71b5bf50df73cc3 in_seq=0 out_seq=0 2024-09-19T04:48:48.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.163+0000 7fd74affd640 10 client.25003 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:48:48.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.163+0000 7fd74affd640 1 -- 172.21.15.2:0/2262992395 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560c00d347f0 con 0x560c00de5810 2024-09-19T04:48:48.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.163+0000 7fd74affd640 10 client.25003 handle_command_reply: tid=0 2024-09-19T04:48:48.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.163+0000 7fd773d00740 1 client.25003 shutdown 2024-09-19T04:48:48.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.164+0000 7fd773d00740 1 -- 172.21.15.2:0/2262992395 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560c00dca290 msgr2=0x560c00dca710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:48.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.164+0000 7fd773d00740 1 --2- 172.21.15.2:0/2262992395 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560c00dca290 0x560c00dca710 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd76c06b870 tx=0x7fd76402a8e0 comp rx=0 tx=0).stop 2024-09-19T04:48:48.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.164+0000 7fd773d00740 1 -- 172.21.15.2:0/2262992395 shutdown_connections 2024-09-19T04:48:48.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.164+0000 7fd773d00740 1 --2- 172.21.15.2:0/2262992395 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560c00de5810 0x560c00de7cd0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:48.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.164+0000 7fd773d00740 1 --2- 172.21.15.2:0/2262992395 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560c00dca290 0x560c00dca710 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:48.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.164+0000 7fd773d00740 1 --2- 172.21.15.2:0/2262992395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c00dd1150 0x560c00dc9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:48.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.164+0000 7fd74affd640 0 client.25003 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:48:48.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.164+0000 7fd773d00740 1 --2- 172.21.15.2:0/2262992395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c00dc1a00 0x560c00dd0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:48.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.164+0000 7fd773d00740 1 -- 172.21.15.2:0/2262992395 >> 172.21.15.2:0/2262992395 conn(0x560c00dbe0f0 msgr2=0x560c00dc3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:48.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.164+0000 7fd773d00740 1 -- 172.21.15.2:0/2262992395 shutdown_connections 2024-09-19T04:48:48.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.164+0000 7fd773d00740 1 -- 172.21.15.2:0/2262992395 wait complete. 2024-09-19T04:48:48.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.164+0000 7fd773d00740 20 client.25003 trim_cache size 0 max 16384 2024-09-19T04:48:48.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.199+0000 7fd773d00740 1 Processor -- start 2024-09-19T04:48:48.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.199+0000 7fd773d00740 1 -- start start 2024-09-19T04:48:48.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.199+0000 7fd773d00740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c00dc1a00 0x560c00dc4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:48.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.199+0000 7fd773d00740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c00dca290 0x560c00dcdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:48.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.199+0000 7fd773d00740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560c00dd1150 0x560c00ded5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:48.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.199+0000 7fd773d00740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd76c1a9540 con 0x560c00dca290 2024-09-19T04:48:48.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.199+0000 7fd773d00740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd76c1abdc0 con 0x560c00dc1a00 2024-09-19T04:48:48.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.199+0000 7fd773d00740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fd76c1a9bb0 con 0x560c00dd1150 2024-09-19T04:48:48.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.200+0000 7fd76b7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560c00dd1150 0x560c00ded5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:48.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.200+0000 7fd76a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c00dca290 0x560c00dcdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:48.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.200+0000 7fd76b7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560c00dd1150 0x560c00ded5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.2:38428/0 (socket says 172.21.15.2:38428) 2024-09-19T04:48:48.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.200+0000 7fd76affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c00dc1a00 0x560c00dc4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:48.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.200+0000 7fd76b7fe640 1 -- 172.21.15.2:0/2657885231 learned_addr learned my addr 172.21.15.2:0/2657885231 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:48:48.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.200+0000 7fd76affd640 1 -- 172.21.15.2:0/2657885231 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560c00dd1150 msgr2=0x560c00ded5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:48:48.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.200+0000 7fd76affd640 1 --2- 172.21.15.2:0/2657885231 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560c00dd1150 0x560c00ded5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:48.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.200+0000 7fd76affd640 1 -- 172.21.15.2:0/2657885231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c00dca290 msgr2=0x560c00dcdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:48:48.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.200+0000 7fd76affd640 1 --2- 172.21.15.2:0/2657885231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c00dca290 0x560c00dcdcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:48.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.200+0000 7fd76affd640 1 -- 172.21.15.2:0/2657885231 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c00db9830 con 0x560c00dc1a00 2024-09-19T04:48:48.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.200+0000 7fd76a7fc640 1 --2- 172.21.15.2:0/2657885231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c00dca290 0x560c00dcdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:48:48.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.200+0000 7fd76affd640 1 --2- 172.21.15.2:0/2657885231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c00dc1a00 0x560c00dc4520 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd75c01a040 tx=0x7fd75c0096e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70f3ab5d57221da2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:48.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.200+0000 7fd7517fa640 1 -- 172.21.15.2:0/2657885231 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd75c09bc80 con 0x560c00dc1a00 2024-09-19T04:48:48.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.201+0000 7fd7517fa640 1 -- 172.21.15.2:0/2657885231 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd75c09c5b0 con 0x560c00dc1a00 2024-09-19T04:48:48.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.201+0000 7fd7517fa640 1 -- 172.21.15.2:0/2657885231 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd75c098150 con 0x560c00dc1a00 2024-09-19T04:48:48.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.202+0000 7fd773d00740 1 -- 172.21.15.2:0/2657885231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c00dc1a00 msgr2=0x560c00dc4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:48.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.202+0000 7fd773d00740 1 --2- 172.21.15.2:0/2657885231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c00dc1a00 0x560c00dc4520 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd75c01a040 tx=0x7fd75c0096e0 comp rx=0 tx=0).stop 2024-09-19T04:48:48.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.202+0000 7fd773d00740 1 -- 172.21.15.2:0/2657885231 shutdown_connections 2024-09-19T04:48:48.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.202+0000 7fd773d00740 1 --2- 172.21.15.2:0/2657885231 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560c00dd1150 0x560c00ded5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:48.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.202+0000 7fd773d00740 1 --2- 172.21.15.2:0/2657885231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c00dca290 0x560c00dcdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:48.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.202+0000 7fd773d00740 1 --2- 172.21.15.2:0/2657885231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c00dc1a00 0x560c00dc4520 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:48.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.202+0000 7fd773d00740 1 -- 172.21.15.2:0/2657885231 >> 172.21.15.2:0/2657885231 conn(0x560c00dbe0f0 msgr2=0x560c00dcd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:48.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.202+0000 7fd773d00740 1 -- 172.21.15.2:0/2657885231 shutdown_connections 2024-09-19T04:48:48.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.202+0000 7fd773d00740 1 -- 172.21.15.2:0/2657885231 wait complete. 2024-09-19T04:48:48.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.203+0000 7fd773d00740 1 -- start start 2024-09-19T04:48:48.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.203+0000 7fd773d00740 1 Processor -- start 2024-09-19T04:48:48.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.203+0000 7fd773d00740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c00dc1a00 0x560c00de1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:48.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.203+0000 7fd773d00740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c00dca290 0x560c00de2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:48.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.203+0000 7fd773d00740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560c00dd1150 0x560c00dde120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:48.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.204+0000 7fd773d00740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd76c1aa280 con 0x560c00dc1a00 2024-09-19T04:48:48.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.204+0000 7fd773d00740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd76c1ab6f0 con 0x560c00dca290 2024-09-19T04:48:48.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.204+0000 7fd773d00740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fd76c1aa950 con 0x560c00dd1150 2024-09-19T04:48:48.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.204+0000 7fd76affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c00dc1a00 0x560c00de1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:48.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.204+0000 7fd773d00740 10 client.0 _ll_register_callbacks cb 0x7fd764031f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:48:48.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.204+0000 7fd76affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c00dc1a00 0x560c00de1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35318/0 (socket says 172.21.15.2:35318) 2024-09-19T04:48:48.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.204+0000 7fd76affd640 1 -- 172.21.15.2:0/81471375 learned_addr learned my addr 172.21.15.2:0/81471375 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:48:48.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.204+0000 7fd76b7fe640 1 --2- 172.21.15.2:0/81471375 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560c00dd1150 0x560c00dde120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:48.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.204+0000 7fd76a7fc640 1 --2- 172.21.15.2:0/81471375 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c00dca290 0x560c00de2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:48.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.204+0000 7fd76b7fe640 1 -- 172.21.15.2:0/81471375 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c00dca290 msgr2=0x560c00de2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:48:48.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.204+0000 7fd76b7fe640 1 --2- 172.21.15.2:0/81471375 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c00dca290 0x560c00de2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:48.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.204+0000 7fd76b7fe640 1 -- 172.21.15.2:0/81471375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c00dc1a00 msgr2=0x560c00de1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:48:48.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.204+0000 7fd76b7fe640 1 --2- 172.21.15.2:0/81471375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c00dc1a00 0x560c00de1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:48.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.204+0000 7fd76b7fe640 1 -- 172.21.15.2:0/81471375 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c00dde950 con 0x560c00dd1150 2024-09-19T04:48:48.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.204+0000 7fd76affd640 1 --2- 172.21.15.2:0/81471375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c00dc1a00 0x560c00de1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:48:48.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.204+0000 7fd76b7fe640 1 --2- 172.21.15.2:0/81471375 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560c00dd1150 0x560c00dde120 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd764031e80 tx=0x7fd7640095a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=459fae31564cbb2d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:48.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.204+0000 7fd74affd640 10 client.0 ms_handle_connect on v2:172.21.15.116:3300/0 2024-09-19T04:48:48.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.205+0000 7fd74affd640 1 -- 172.21.15.2:0/81471375 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd764055040 con 0x560c00dd1150 2024-09-19T04:48:48.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.205+0000 7fd74affd640 1 -- 172.21.15.2:0/81471375 <== mon.1 v2:172.21.15.116:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7fd764030740 con 0x560c00dd1150 2024-09-19T04:48:48.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.205+0000 7fd773d00740 1 -- 172.21.15.2:0/81471375 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd75c09c5b0 con 0x560c00dd1150 2024-09-19T04:48:48.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.205+0000 7fd74affd640 1 -- 172.21.15.2:0/81471375 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fd76406a050 con 0x560c00dd1150 2024-09-19T04:48:48.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.205+0000 7fd773d00740 10 client.25009 fetch_fsmap learned FSMap version 19 2024-09-19T04:48:48.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.205+0000 7fd773d00740 1 -- 172.21.15.2:0/81471375 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x560c00e510b0 con 0x560c00dd1150 2024-09-19T04:48:48.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.205+0000 7fd74affd640 1 -- 172.21.15.2:0/81471375 <== mon.1 v2:172.21.15.116:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd75c09c5b0 con 0x560c00dd1150 2024-09-19T04:48:48.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.206+0000 7fd74affd640 1 -- 172.21.15.2:0/81471375 <== mon.1 v2:172.21.15.116:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fd764061070 con 0x560c00dd1150 2024-09-19T04:48:48.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.206+0000 7fd773d00740 10 client.25009 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:48:48.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.206+0000 7fd773d00740 10 client.25009 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:48:48.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.206+0000 7fd773d00740 20 client.25009 populate_metadata read hostname 'smithi002' 2024-09-19T04:48:48.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.206+0000 7fd773d00740 1 --2- 172.21.15.2:0/81471375 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560c00de5810 0x560c00e538a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:48.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.206+0000 7fd773d00740 4 client.25009 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:48:48.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.206+0000 7fd773d00740 1 -- 172.21.15.2:0/81471375 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560c00d2ed00 con 0x560c00de5810 2024-09-19T04:48:48.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.206+0000 7fd76affd640 1 --2- 172.21.15.2:0/81471375 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560c00de5810 0x560c00e538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:48.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.207+0000 7fd76affd640 1 --2- 172.21.15.2:0/81471375 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560c00de5810 0x560c00e538a0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b48fcf5bc8c6558 server_cookie=b9d71cc24be8a38a in_seq=0 out_seq=0 2024-09-19T04:48:48.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.207+0000 7fd74affd640 10 client.25009 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:48:48.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.208+0000 7fd74affd640 1 -- 172.21.15.2:0/81471375 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560c00d2ed00 con 0x560c00de5810 2024-09-19T04:48:48.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.208+0000 7fd74affd640 10 client.25009 handle_command_reply: tid=0 2024-09-19T04:48:48.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.208+0000 7fd773d00740 1 client.25009 shutdown 2024-09-19T04:48:48.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.208+0000 7fd773d00740 1 -- 172.21.15.2:0/81471375 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560c00dd1150 msgr2=0x560c00dde120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:48.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.208+0000 7fd773d00740 1 --2- 172.21.15.2:0/81471375 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560c00dd1150 0x560c00dde120 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd764031e80 tx=0x7fd7640095a0 comp rx=0 tx=0).stop 2024-09-19T04:48:48.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.208+0000 7fd773d00740 1 -- 172.21.15.2:0/81471375 shutdown_connections 2024-09-19T04:48:48.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.208+0000 7fd773d00740 1 --2- 172.21.15.2:0/81471375 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560c00de5810 0x560c00e538a0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:48.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.208+0000 7fd74affd640 0 client.25009 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:48:48.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.208+0000 7fd773d00740 1 --2- 172.21.15.2:0/81471375 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560c00dd1150 0x560c00dde120 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:48.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.208+0000 7fd773d00740 1 --2- 172.21.15.2:0/81471375 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560c00dca290 0x560c00de2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:48.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.208+0000 7fd773d00740 1 --2- 172.21.15.2:0/81471375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560c00dc1a00 0x560c00de1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:48.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.208+0000 7fd773d00740 1 -- 172.21.15.2:0/81471375 >> 172.21.15.2:0/81471375 conn(0x560c00dbe0f0 msgr2=0x560c00dcdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:48.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.208+0000 7fd773d00740 1 -- 172.21.15.2:0/81471375 shutdown_connections 2024-09-19T04:48:48.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.208+0000 7fd773d00740 1 -- 172.21.15.2:0/81471375 wait complete. 2024-09-19T04:48:48.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.209+0000 7fd773d00740 20 client.25009 trim_cache size 0 max 16384 2024-09-19T04:48:48.219 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:48:48.219 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T04:48:48.219 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "2fa76107-9b5a-479d-a0d6-5fb8179e789e", 2024-09-19T04:48:48.219 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T04:48:48.220 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:48:48.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.209+0000 7fd771927640 1 -- 172.21.15.2:0/885266 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fd7540a34c0 msgr2=0x7fd7540a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:48.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.209+0000 7fd771927640 1 --2- 172.21.15.2:0/885266 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fd7540a34c0 0x7fd7540a5980 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd764009a60 tx=0x7fd764005d80 comp rx=0 tx=0).stop 2024-09-19T04:48:48.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.209+0000 7fd771927640 1 -- 172.21.15.2:0/885266 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd76c100a70 msgr2=0x7fd76c199280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:48.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.209+0000 7fd771927640 1 --2- 172.21.15.2:0/885266 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd76c100a70 0x7fd76c199280 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd75c00e9f0 tx=0x7fd75c00eeb0 comp rx=0 tx=0).stop 2024-09-19T04:48:48.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.210+0000 7fd771927640 1 -- 172.21.15.2:0/885266 shutdown_connections 2024-09-19T04:48:48.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.210+0000 7fd771927640 1 --2- 172.21.15.2:0/885266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd76c106a70 0x7fd76c1a4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:48.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.210+0000 7fd771927640 1 --2- 172.21.15.2:0/885266 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fd7540a34c0 0x7fd7540a5980 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:48.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.210+0000 7fd771927640 1 --2- 172.21.15.2:0/885266 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd76c101410 0x7fd76c1997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:48.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.210+0000 7fd771927640 1 --2- 172.21.15.2:0/885266 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd76c100a70 0x7fd76c199280 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:48.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.210+0000 7fd771927640 1 -- 172.21.15.2:0/885266 >> 172.21.15.2:0/885266 conn(0x7fd76c0fc790 msgr2=0x7fd76c0fdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:48.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.210+0000 7fd771927640 1 -- 172.21.15.2:0/885266 shutdown_connections 2024-09-19T04:48:48.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:48.210+0000 7fd771927640 1 -- 172.21.15.2:0/885266 wait complete. 2024-09-19T04:48:48.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:48 smithi002 ceph-mon[30975]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:48:48.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:48 smithi018 ceph-mon[34537]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:48:48.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:48 smithi116 ceph-mon[34477]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:48:48.795 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:48:49.169 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:48:49.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:49 smithi018 ceph-mon[34537]: scrub queued for path: / 2024-09-19T04:48:49.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:49 smithi018 ceph-mon[34537]: scrub summary: idle+waiting paths [/] 2024-09-19T04:48:49.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:49 smithi018 ceph-mon[34537]: scrub summary: active paths [/] 2024-09-19T04:48:49.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:49 smithi018 ceph-mon[34537]: scrub summary: idle+waiting paths [/] 2024-09-19T04:48:49.570 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:49 smithi002 ceph-mon[30975]: scrub queued for path: / 2024-09-19T04:48:49.570 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:49 smithi002 ceph-mon[30975]: scrub summary: idle+waiting paths [/] 2024-09-19T04:48:49.570 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:49 smithi002 ceph-mon[30975]: scrub summary: active paths [/] 2024-09-19T04:48:49.570 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:49 smithi002 ceph-mon[30975]: scrub summary: idle+waiting paths [/] 2024-09-19T04:48:49.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:49 smithi116 ceph-mon[34477]: scrub queued for path: / 2024-09-19T04:48:49.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:49 smithi116 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-19T04:48:49.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:49 smithi116 ceph-mon[34477]: scrub summary: active paths [/] 2024-09-19T04:48:49.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:49 smithi116 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-19T04:48:49.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.656+0000 7f6bb1ca7640 1 -- 172.21.15.2:0/2465563723 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bac100100 msgr2=0x7f6bac100560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:49.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.656+0000 7f6bb1ca7640 1 --2- 172.21.15.2:0/2465563723 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bac100100 0x7f6bac100560 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0009900 tx=0x7f6ba002a410 comp rx=0 tx=0).stop 2024-09-19T04:48:49.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.656+0000 7f6bb1ca7640 1 -- 172.21.15.2:0/2465563723 shutdown_connections 2024-09-19T04:48:49.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.656+0000 7f6bb1ca7640 1 --2- 172.21.15.2:0/2465563723 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6bac100aa0 0x7f6bac10ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:49.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.656+0000 7f6bb1ca7640 1 --2- 172.21.15.2:0/2465563723 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bac100100 0x7f6bac100560 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:49.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.656+0000 7f6bb1ca7640 1 --2- 172.21.15.2:0/2465563723 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6bac106b80 0x7f6bac106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:49.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.656+0000 7f6bb1ca7640 1 -- 172.21.15.2:0/2465563723 >> 172.21.15.2:0/2465563723 conn(0x7f6bac077230 msgr2=0x7f6bac0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:49.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.656+0000 7f6bb1ca7640 1 -- 172.21.15.2:0/2465563723 shutdown_connections 2024-09-19T04:48:49.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.656+0000 7f6bb1ca7640 1 -- 172.21.15.2:0/2465563723 wait complete. 2024-09-19T04:48:49.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.657+0000 7f6bb1ca7640 1 Processor -- start 2024-09-19T04:48:49.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.657+0000 7f6bb1ca7640 1 -- start start 2024-09-19T04:48:49.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.657+0000 7f6bb1ca7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bac100100 0x7f6bac198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:49.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.657+0000 7f6bb1ca7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6bac100aa0 0x7f6bac198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:49.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.657+0000 7f6bb1ca7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6bac106b80 0x7f6bac19cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:49.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.658+0000 7f6bab7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bac100100 0x7f6bac198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:49.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.658+0000 7f6bb1ca7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6bac111f50 con 0x7f6bac100100 2024-09-19T04:48:49.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.658+0000 7f6bb1ca7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6bac111dd0 con 0x7f6bac106b80 2024-09-19T04:48:49.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.658+0000 7f6bb1ca7640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f6bac1120d0 con 0x7f6bac100aa0 2024-09-19T04:48:49.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.658+0000 7f6bab7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bac100100 0x7f6bac198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35342/0 (socket says 172.21.15.2:35342) 2024-09-19T04:48:49.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.658+0000 7f6baaffd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6bac100aa0 0x7f6bac198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:49.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.658+0000 7f6bab7fe640 1 -- 172.21.15.2:0/44159576 learned_addr learned my addr 172.21.15.2:0/44159576 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:48:49.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.658+0000 7f6babfff640 1 --2- 172.21.15.2:0/44159576 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6bac106b80 0x7f6bac19cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:49.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.658+0000 7f6bab7fe640 1 -- 172.21.15.2:0/44159576 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6bac100aa0 msgr2=0x7f6bac198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:49.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.658+0000 7f6bab7fe640 1 --2- 172.21.15.2:0/44159576 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6bac100aa0 0x7f6bac198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:49.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.658+0000 7f6bab7fe640 1 -- 172.21.15.2:0/44159576 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6bac106b80 msgr2=0x7f6bac19cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:49.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.658+0000 7f6bab7fe640 1 --2- 172.21.15.2:0/44159576 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6bac106b80 0x7f6bac19cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:49.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.658+0000 7f6bab7fe640 1 -- 172.21.15.2:0/44159576 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bac19d3c0 con 0x7f6bac100100 2024-09-19T04:48:49.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.658+0000 7f6babfff640 1 --2- 172.21.15.2:0/44159576 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6bac106b80 0x7f6bac19cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:48:49.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.659+0000 7f6bab7fe640 1 --2- 172.21.15.2:0/44159576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bac100100 0x7f6bac198410 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c00c970 tx=0x7f6b9c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:49.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.659+0000 7f6ba8ff9640 1 -- 172.21.15.2:0/44159576 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c007bb0 con 0x7f6bac100100 2024-09-19T04:48:49.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.659+0000 7f6bb1ca7640 1 -- 172.21.15.2:0/44159576 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bac19d6b0 con 0x7f6bac100100 2024-09-19T04:48:49.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.659+0000 7f6ba8ff9640 1 -- 172.21.15.2:0/44159576 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6b9c007d50 con 0x7f6bac100100 2024-09-19T04:48:49.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.659+0000 7f6ba8ff9640 1 -- 172.21.15.2:0/44159576 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c00f450 con 0x7f6bac100100 2024-09-19T04:48:49.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.659+0000 7f6bb1ca7640 1 -- 172.21.15.2:0/44159576 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bac101210 con 0x7f6bac100100 2024-09-19T04:48:49.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.662+0000 7f6bb4080740 1 Processor -- start 2024-09-19T04:48:49.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.662+0000 7f6bb4080740 1 -- start start 2024-09-19T04:48:49.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.662+0000 7f6bb4080740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2d3abe3c0 0x55d2d3abe7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:49.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.662+0000 7f6bb4080740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d2d3abece0 0x55d2d3ad1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:49.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.662+0000 7f6bb4080740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2d3ad1e90 0x55d2d3ad4280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:49.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.662+0000 7f6bb4080740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d2d3a242e0 con 0x55d2d3abe3c0 2024-09-19T04:48:49.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.662+0000 7f6bb4080740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d2d39cbce0 con 0x55d2d3ad1e90 2024-09-19T04:48:49.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.662+0000 7f6bb4080740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55d2d3a202a0 con 0x55d2d3abece0 2024-09-19T04:48:49.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.663+0000 7f6babfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2d3abe3c0 0x55d2d3abe7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:49.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.663+0000 7f6babfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2d3abe3c0 0x55d2d3abe7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35350/0 (socket says 172.21.15.2:35350) 2024-09-19T04:48:49.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.663+0000 7f6babfff640 1 -- 172.21.15.2:0/1322492716 learned_addr learned my addr 172.21.15.2:0/1322492716 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:48:49.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.663+0000 7f6babfff640 1 -- 172.21.15.2:0/1322492716 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d2d3abece0 msgr2=0x55d2d3ad1950 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T04:48:49.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.663+0000 7f6babfff640 1 --2- 172.21.15.2:0/1322492716 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d2d3abece0 0x55d2d3ad1950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:49.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.663+0000 7f6babfff640 1 -- 172.21.15.2:0/1322492716 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2d3ad1e90 msgr2=0x55d2d3ad4280 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T04:48:49.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.663+0000 7f6babfff640 1 --2- 172.21.15.2:0/1322492716 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2d3ad1e90 0x55d2d3ad4280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:49.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.663+0000 7f6babfff640 1 -- 172.21.15.2:0/1322492716 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2d39b0440 con 0x55d2d3abe3c0 2024-09-19T04:48:49.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.663+0000 7f6babfff640 1 --2- 172.21.15.2:0/1322492716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2d3abe3c0 0x55d2d3abe7a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4010740 tx=0x7f6ba4010c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a41eb146a599076a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:49.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.663+0000 7f6b91ffb640 1 -- 172.21.15.2:0/1322492716 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba400ead0 con 0x55d2d3abe3c0 2024-09-19T04:48:49.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.664+0000 7f6b91ffb640 1 -- 172.21.15.2:0/1322492716 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6ba4010e50 con 0x55d2d3abe3c0 2024-09-19T04:48:49.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.664+0000 7f6b91ffb640 1 -- 172.21.15.2:0/1322492716 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba4012e60 con 0x55d2d3abe3c0 2024-09-19T04:48:49.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.664+0000 7f6ba8ff9640 1 -- 172.21.15.2:0/44159576 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138530+0+0 (secure 0 0 0) 0x7f6b9c004f40 con 0x7f6bac100100 2024-09-19T04:48:49.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.665+0000 7f6bb4080740 1 -- 172.21.15.2:0/1322492716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2d3abe3c0 msgr2=0x55d2d3abe7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:49.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.665+0000 7f6bb4080740 1 --2- 172.21.15.2:0/1322492716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2d3abe3c0 0x55d2d3abe7a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4010740 tx=0x7f6ba4010c00 comp rx=0 tx=0).stop 2024-09-19T04:48:49.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.665+0000 7f6bb4080740 1 -- 172.21.15.2:0/1322492716 shutdown_connections 2024-09-19T04:48:49.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.665+0000 7f6bb4080740 1 --2- 172.21.15.2:0/1322492716 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2d3ad1e90 0x55d2d3ad4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:49.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.665+0000 7f6bb4080740 1 --2- 172.21.15.2:0/1322492716 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d2d3abece0 0x55d2d3ad1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:49.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.665+0000 7f6bb4080740 1 --2- 172.21.15.2:0/1322492716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2d3abe3c0 0x55d2d3abe7a0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:49.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.665+0000 7f6bb4080740 1 -- 172.21.15.2:0/1322492716 >> 172.21.15.2:0/1322492716 conn(0x55d2d3abaa30 msgr2=0x55d2d3abae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:49.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.665+0000 7f6ba8ff9640 1 --2- 172.21.15.2:0/44159576 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f6b940a3550 0x7f6b940a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:49.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.665+0000 7f6bb4080740 1 -- 172.21.15.2:0/1322492716 shutdown_connections 2024-09-19T04:48:49.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.665+0000 7f6bb4080740 1 -- 172.21.15.2:0/1322492716 wait complete. 2024-09-19T04:48:49.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.665+0000 7f6baaffd640 1 --2- 172.21.15.2:0/44159576 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f6b940a3550 0x7f6b940a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:49.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.665+0000 7f6ba8ff9640 1 -- 172.21.15.2:0/44159576 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f6b9c0cfb40 con 0x7f6bac100100 2024-09-19T04:48:49.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.665+0000 7f6bb4080740 1 -- start start 2024-09-19T04:48:49.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.666+0000 7f6bb4080740 1 Processor -- start 2024-09-19T04:48:49.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.666+0000 7f6baaffd640 1 --2- 172.21.15.2:0/44159576 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f6b940a3550 0x7f6b940a5a10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0005ab0 tx=0x7f6ba0005a20 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:49.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.666+0000 7f6bb4080740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2d3abe3c0 0x55d2d3ad18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:49.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.666+0000 7f6bb4080740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d2d3abece0 0x55d2d3aceb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:49.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.666+0000 7f6bb4080740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2d3ad1e90 0x55d2d3acf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:49.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.666+0000 7f6baaffd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d2d3abece0 0x55d2d3aceb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:49.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.666+0000 7f6babfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2d3ad1e90 0x55d2d3acf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:49.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.666+0000 7f6babfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2d3ad1e90 0x55d2d3acf310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35360/0 (socket says 172.21.15.2:35360) 2024-09-19T04:48:49.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.666+0000 7f6baaffd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d2d3abece0 0x55d2d3aceb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.2:38456/0 (socket says 172.21.15.2:38456) 2024-09-19T04:48:49.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.666+0000 7f6babfff640 1 -- 172.21.15.2:0/944215798 learned_addr learned my addr 172.21.15.2:0/944215798 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:48:49.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.666+0000 7f6bb4080740 1 -- 172.21.15.2:0/944215798 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d2d3ad4a00 con 0x55d2d3ad1e90 2024-09-19T04:48:49.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.666+0000 7f6bb4080740 1 -- 172.21.15.2:0/944215798 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d2d39df050 con 0x55d2d3abe3c0 2024-09-19T04:48:49.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.666+0000 7f6bb4080740 1 -- 172.21.15.2:0/944215798 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55d2d3ad4b80 con 0x55d2d3abece0 2024-09-19T04:48:49.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.666+0000 7f6bab7fe640 1 --2- 172.21.15.2:0/944215798 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2d3abe3c0 0x55d2d3ad18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:49.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.667+0000 7f6babfff640 1 -- 172.21.15.2:0/944215798 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d2d3abece0 msgr2=0x55d2d3aceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:48:49.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.667+0000 7f6babfff640 1 --2- 172.21.15.2:0/944215798 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d2d3abece0 0x55d2d3aceb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:49.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.667+0000 7f6babfff640 1 -- 172.21.15.2:0/944215798 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2d3abe3c0 msgr2=0x55d2d3ad18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:48:49.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.667+0000 7f6babfff640 1 --2- 172.21.15.2:0/944215798 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2d3abe3c0 0x55d2d3ad18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:49.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.667+0000 7f6babfff640 1 -- 172.21.15.2:0/944215798 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2d37953c0 con 0x55d2d3ad1e90 2024-09-19T04:48:49.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.667+0000 7f6babfff640 1 --2- 172.21.15.2:0/944215798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2d3ad1e90 0x55d2d3acf310 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4006010 tx=0x7f6ba4004c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ca273ef484a254a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:49.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.667+0000 7f6b8affd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:48:49.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.667+0000 7f6bb4080740 10 client.0 _ll_register_callbacks cb 0x55d2d3a1f160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:48:49.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.667+0000 7f6bb4080740 1 -- 172.21.15.2:0/944215798 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ba4010e50 con 0x55d2d3ad1e90 2024-09-19T04:48:49.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.667+0000 7f6b8affd640 1 -- 172.21.15.2:0/944215798 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba402b060 con 0x55d2d3ad1e90 2024-09-19T04:48:49.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.667+0000 7f6b8affd640 1 -- 172.21.15.2:0/944215798 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f6ba400e8d0 con 0x55d2d3ad1e90 2024-09-19T04:48:49.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.667+0000 7f6b8affd640 1 -- 172.21.15.2:0/944215798 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f6ba4004e60 con 0x55d2d3ad1e90 2024-09-19T04:48:49.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.668+0000 7f6bb4080740 10 client.15348 fetch_fsmap learned FSMap version 19 2024-09-19T04:48:49.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.668+0000 7f6bb4080740 1 -- 172.21.15.2:0/944215798 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55d2d3ac3480 con 0x55d2d3ad1e90 2024-09-19T04:48:49.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.668+0000 7f6b8affd640 1 -- 172.21.15.2:0/944215798 <== mon.0 v2:172.21.15.2:3300/0 4 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f6ba400f040 con 0x55d2d3ad1e90 2024-09-19T04:48:49.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.668+0000 7f6bb4080740 10 client.15348 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:48:49.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.668+0000 7f6bb4080740 10 client.15348 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:48:49.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.668+0000 7f6bb4080740 20 client.15348 populate_metadata read hostname 'smithi002' 2024-09-19T04:48:49.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.668+0000 7f6bb4080740 1 --2- 172.21.15.2:0/944215798 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55d2d3ac47d0 0x55d2d3ac6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:49.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.668+0000 7f6bb4080740 4 client.15348 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:48:49.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.668+0000 7f6bb4080740 1 -- 172.21.15.2:0/944215798 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d2d3a31850 con 0x55d2d3ac47d0 2024-09-19T04:48:49.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.668+0000 7f6bab7fe640 1 --2- 172.21.15.2:0/944215798 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55d2d3ac47d0 0x55d2d3ac6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:49.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.669+0000 7f6b8affd640 10 client.15348 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:48:49.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.669+0000 7f6bab7fe640 1 --2- 172.21.15.2:0/944215798 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55d2d3ac47d0 0x55d2d3ac6c90 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=640cd2c17b8f9f4e server_cookie=df150999c00209d5 in_seq=0 out_seq=0 2024-09-19T04:48:49.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.669+0000 7f6b8affd640 1 -- 172.21.15.2:0/944215798 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d2d3a31850 con 0x55d2d3ac47d0 2024-09-19T04:48:49.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.669+0000 7f6b8affd640 10 client.15348 handle_command_reply: tid=0 2024-09-19T04:48:49.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.669+0000 7f6bb4080740 1 client.15348 shutdown 2024-09-19T04:48:49.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.670+0000 7f6bb4080740 1 -- 172.21.15.2:0/944215798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2d3ad1e90 msgr2=0x55d2d3acf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:49.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.670+0000 7f6bb4080740 1 --2- 172.21.15.2:0/944215798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2d3ad1e90 0x55d2d3acf310 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4006010 tx=0x7f6ba4004c70 comp rx=0 tx=0).stop 2024-09-19T04:48:49.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.670+0000 7f6bb4080740 1 -- 172.21.15.2:0/944215798 shutdown_connections 2024-09-19T04:48:49.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.670+0000 7f6bb4080740 1 --2- 172.21.15.2:0/944215798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2d3ad1e90 0x55d2d3acf310 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:49.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.670+0000 7f6bb4080740 1 --2- 172.21.15.2:0/944215798 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55d2d3ac47d0 0x55d2d3ac6c90 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:49.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.670+0000 7f6bb4080740 1 --2- 172.21.15.2:0/944215798 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d2d3abece0 0x55d2d3aceb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:49.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.670+0000 7f6bb4080740 1 --2- 172.21.15.2:0/944215798 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2d3abe3c0 0x55d2d3ad18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:49.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.670+0000 7f6bb4080740 1 -- 172.21.15.2:0/944215798 >> 172.21.15.2:0/944215798 conn(0x55d2d3abaa30 msgr2=0x55d2d3ab9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:49.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.670+0000 7f6b8affd640 0 client.15348 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:48:49.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.670+0000 7f6bb4080740 1 -- 172.21.15.2:0/944215798 shutdown_connections 2024-09-19T04:48:49.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.670+0000 7f6bb4080740 1 -- 172.21.15.2:0/944215798 wait complete. 2024-09-19T04:48:49.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.670+0000 7f6bb4080740 20 client.15348 trim_cache size 0 max 16384 2024-09-19T04:48:49.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.690+0000 7f6bb4080740 1 Processor -- start 2024-09-19T04:48:49.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.690+0000 7f6bb4080740 1 -- start start 2024-09-19T04:48:49.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.690+0000 7f6bb4080740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2d3abe3c0 0x55d2d3aba360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:49.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.690+0000 7f6bb4080740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d2d3abece0 0x55d2d3aca2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:49.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.691+0000 7f6bb4080740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2d3ad1e90 0x55d2d3af3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:49.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.691+0000 7f6bab7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2d3abe3c0 0x55d2d3aba360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:49.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.691+0000 7f6bab7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2d3abe3c0 0x55d2d3aba360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.2:46738/0 (socket says 172.21.15.2:46738) 2024-09-19T04:48:49.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.691+0000 7f6baaffd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d2d3abece0 0x55d2d3aca2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:49.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.691+0000 7f6baaffd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d2d3abece0 0x55d2d3aca2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.2:38462/0 (socket says 172.21.15.2:38462) 2024-09-19T04:48:49.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.691+0000 7f6babfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2d3ad1e90 0x55d2d3af3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:49.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.691+0000 7f6babfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2d3ad1e90 0x55d2d3af3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35376/0 (socket says 172.21.15.2:35376) 2024-09-19T04:48:49.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.691+0000 7f6bab7fe640 1 -- 172.21.15.2:0/3727598851 learned_addr learned my addr 172.21.15.2:0/3727598851 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:48:49.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.691+0000 7f6bb4080740 1 -- 172.21.15.2:0/3727598851 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6bac070150 con 0x55d2d3ad1e90 2024-09-19T04:48:49.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.691+0000 7f6bb4080740 1 -- 172.21.15.2:0/3727598851 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6bac0729d0 con 0x55d2d3abe3c0 2024-09-19T04:48:49.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.691+0000 7f6bb4080740 1 -- 172.21.15.2:0/3727598851 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f6bac0707c0 con 0x55d2d3abece0 2024-09-19T04:48:49.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.692+0000 7f6bab7fe640 1 -- 172.21.15.2:0/3727598851 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d2d3abece0 msgr2=0x55d2d3aca2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:48:49.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.692+0000 7f6bab7fe640 1 --2- 172.21.15.2:0/3727598851 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d2d3abece0 0x55d2d3aca2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:49.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.692+0000 7f6bab7fe640 1 -- 172.21.15.2:0/3727598851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2d3ad1e90 msgr2=0x55d2d3af3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:48:49.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.692+0000 7f6bab7fe640 1 --2- 172.21.15.2:0/3727598851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2d3ad1e90 0x55d2d3af3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:49.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.692+0000 7f6bab7fe640 1 -- 172.21.15.2:0/3727598851 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2d3ad45f0 con 0x55d2d3abe3c0 2024-09-19T04:48:49.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.692+0000 7f6babfff640 1 --2- 172.21.15.2:0/3727598851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2d3ad1e90 0x55d2d3af3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:48:49.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.693+0000 7f6bab7fe640 1 --2- 172.21.15.2:0/3727598851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2d3abe3c0 0x55d2d3aba360 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c09bcb0 tx=0x7f6b9c011040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bffbad45488137b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:49.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.693+0000 7f6b917fa640 1 -- 172.21.15.2:0/3727598851 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c01d040 con 0x55d2d3abe3c0 2024-09-19T04:48:49.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.693+0000 7f6b917fa640 1 -- 172.21.15.2:0/3727598851 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6b9c099dc0 con 0x55d2d3abe3c0 2024-09-19T04:48:49.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.693+0000 7f6b917fa640 1 -- 172.21.15.2:0/3727598851 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c0cd440 con 0x55d2d3abe3c0 2024-09-19T04:48:49.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.694+0000 7f6bb4080740 1 -- 172.21.15.2:0/3727598851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2d3abe3c0 msgr2=0x55d2d3aba360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:49.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.694+0000 7f6bb4080740 1 --2- 172.21.15.2:0/3727598851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2d3abe3c0 0x55d2d3aba360 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c09bcb0 tx=0x7f6b9c011040 comp rx=0 tx=0).stop 2024-09-19T04:48:49.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.694+0000 7f6bb4080740 1 -- 172.21.15.2:0/3727598851 shutdown_connections 2024-09-19T04:48:49.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.694+0000 7f6bb4080740 1 --2- 172.21.15.2:0/3727598851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2d3ad1e90 0x55d2d3af3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:49.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.694+0000 7f6bb4080740 1 --2- 172.21.15.2:0/3727598851 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d2d3abece0 0x55d2d3aca2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:49.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.694+0000 7f6bb4080740 1 --2- 172.21.15.2:0/3727598851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2d3abe3c0 0x55d2d3aba360 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:49.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.694+0000 7f6bb4080740 1 -- 172.21.15.2:0/3727598851 >> 172.21.15.2:0/3727598851 conn(0x55d2d3abaa30 msgr2=0x55d2d3ac0680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:49.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.694+0000 7f6bb4080740 1 -- 172.21.15.2:0/3727598851 shutdown_connections 2024-09-19T04:48:49.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.694+0000 7f6bb4080740 1 -- 172.21.15.2:0/3727598851 wait complete. 2024-09-19T04:48:49.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.694+0000 7f6bb4080740 1 -- start start 2024-09-19T04:48:49.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.695+0000 7f6bb4080740 1 Processor -- start 2024-09-19T04:48:49.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.695+0000 7f6bb4080740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2d3abe3c0 0x55d2d3ada470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:49.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.695+0000 7f6bb4080740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d2d3abece0 0x55d2d3acb810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:49.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.695+0000 7f6bb4080740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2d3ad1e90 0x55d2d3acbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:49.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.695+0000 7f6bb4080740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6bac070e90 con 0x55d2d3abe3c0 2024-09-19T04:48:49.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.695+0000 7f6bb4080740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6bac072300 con 0x55d2d3ad1e90 2024-09-19T04:48:49.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.695+0000 7f6bb4080740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f6bac071560 con 0x55d2d3abece0 2024-09-19T04:48:49.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.695+0000 7f6bb4080740 10 client.0 _ll_register_callbacks cb 0x7f6ba4016070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:48:49.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.695+0000 7f6bab7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2d3abe3c0 0x55d2d3ada470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:49.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.695+0000 7f6bab7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2d3abe3c0 0x55d2d3ada470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35378/0 (socket says 172.21.15.2:35378) 2024-09-19T04:48:49.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.695+0000 7f6bab7fe640 1 -- 172.21.15.2:0/641400844 learned_addr learned my addr 172.21.15.2:0/641400844 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:48:49.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.696+0000 7f6bab7fe640 1 -- 172.21.15.2:0/641400844 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d2d3abece0 msgr2=0x55d2d3acb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:48:49.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.696+0000 7f6baaffd640 1 --2- 172.21.15.2:0/641400844 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d2d3abece0 0x55d2d3acb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:49.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.696+0000 7f6bab7fe640 1 --2- 172.21.15.2:0/641400844 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d2d3abece0 0x55d2d3acb810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:49.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.696+0000 7f6babfff640 1 --2- 172.21.15.2:0/641400844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2d3ad1e90 0x55d2d3acbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:49.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.696+0000 7f6bab7fe640 1 -- 172.21.15.2:0/641400844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2d3ad1e90 msgr2=0x55d2d3acbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:48:49.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.696+0000 7f6bab7fe640 1 --2- 172.21.15.2:0/641400844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2d3ad1e90 0x55d2d3acbd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:49.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.696+0000 7f6bab7fe640 1 -- 172.21.15.2:0/641400844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2d3acc580 con 0x55d2d3abe3c0 2024-09-19T04:48:49.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.696+0000 7f6babfff640 1 --2- 172.21.15.2:0/641400844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2d3ad1e90 0x55d2d3acbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:48:49.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.696+0000 7f6bab7fe640 1 --2- 172.21.15.2:0/641400844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2d3abe3c0 0x55d2d3ada470 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c0986f0 tx=0x7f6b9c0985c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8fa355a21a45c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:48:49.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.696+0000 7f6b8affd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:48:49.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.696+0000 7f6b8affd640 1 -- 172.21.15.2:0/641400844 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c01d040 con 0x55d2d3abe3c0 2024-09-19T04:48:49.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.696+0000 7f6bb4080740 1 -- 172.21.15.2:0/641400844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b9c099dc0 con 0x55d2d3abe3c0 2024-09-19T04:48:49.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.696+0000 7f6b8affd640 1 -- 172.21.15.2:0/641400844 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f6b9c0a4660 con 0x55d2d3abe3c0 2024-09-19T04:48:49.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.696+0000 7f6b8affd640 1 -- 172.21.15.2:0/641400844 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f6b9c0cd440 con 0x55d2d3abe3c0 2024-09-19T04:48:49.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.696+0000 7f6bb4080740 10 client.15354 fetch_fsmap learned FSMap version 19 2024-09-19T04:48:49.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.696+0000 7f6bb4080740 1 -- 172.21.15.2:0/641400844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55d2d3b54d80 con 0x55d2d3abe3c0 2024-09-19T04:48:49.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.697+0000 7f6b8affd640 1 -- 172.21.15.2:0/641400844 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6b9c07f070 con 0x55d2d3abe3c0 2024-09-19T04:48:49.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.697+0000 7f6b8affd640 1 -- 172.21.15.2:0/641400844 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f6b9c097c30 con 0x55d2d3abe3c0 2024-09-19T04:48:49.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.697+0000 7f6bb4080740 10 client.15354 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:48:49.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.697+0000 7f6bb4080740 10 client.15354 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:48:49.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.697+0000 7f6bb4080740 20 client.15354 populate_metadata read hostname 'smithi002' 2024-09-19T04:48:49.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.697+0000 7f6bb4080740 1 --2- 172.21.15.2:0/641400844 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55d2d3b55390 0x55d2d3b57780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:48:49.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.697+0000 7f6bb4080740 4 client.15354 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:48:49.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.697+0000 7f6bb4080740 1 -- 172.21.15.2:0/641400844 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f6b9c099dc0 con 0x55d2d3b55390 2024-09-19T04:48:49.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.697+0000 7f6baaffd640 1 --2- 172.21.15.2:0/641400844 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55d2d3b55390 0x55d2d3b57780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:48:49.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.698+0000 7f6b8affd640 10 client.15354 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:48:49.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.698+0000 7f6baaffd640 1 --2- 172.21.15.2:0/641400844 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55d2d3b55390 0x55d2d3b57780 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=173778af98cb0ab2 server_cookie=a484e04c8d32b18f in_seq=0 out_seq=0 2024-09-19T04:48:49.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.698+0000 7f6b8affd640 1 -- 172.21.15.2:0/641400844 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7f6b9c099dc0 con 0x55d2d3b55390 2024-09-19T04:48:49.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.698+0000 7f6b8affd640 10 client.15354 handle_command_reply: tid=0 2024-09-19T04:48:49.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.698+0000 7f6bb4080740 1 client.15354 shutdown 2024-09-19T04:48:49.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.699+0000 7f6bb4080740 1 -- 172.21.15.2:0/641400844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2d3abe3c0 msgr2=0x55d2d3ada470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:49.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.699+0000 7f6bb4080740 1 --2- 172.21.15.2:0/641400844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2d3abe3c0 0x55d2d3ada470 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c0986f0 tx=0x7f6b9c0985c0 comp rx=0 tx=0).stop 2024-09-19T04:48:49.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.699+0000 7f6bb4080740 1 -- 172.21.15.2:0/641400844 shutdown_connections 2024-09-19T04:48:49.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.699+0000 7f6bb4080740 1 --2- 172.21.15.2:0/641400844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2d3ad1e90 0x55d2d3acbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:49.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.699+0000 7f6bb4080740 1 --2- 172.21.15.2:0/641400844 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55d2d3b55390 0x55d2d3b57780 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:49.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.699+0000 7f6bb4080740 1 --2- 172.21.15.2:0/641400844 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d2d3abece0 0x55d2d3acb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:49.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.699+0000 7f6bb4080740 1 --2- 172.21.15.2:0/641400844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d2d3abe3c0 0x55d2d3ada470 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:49.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.699+0000 7f6b8affd640 0 client.15354 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:48:49.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.699+0000 7f6bb4080740 1 -- 172.21.15.2:0/641400844 >> 172.21.15.2:0/641400844 conn(0x55d2d3abaa30 msgr2=0x55d2d3adcc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:49.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.699+0000 7f6bb4080740 1 -- 172.21.15.2:0/641400844 shutdown_connections 2024-09-19T04:48:49.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.699+0000 7f6bb4080740 1 -- 172.21.15.2:0/641400844 wait complete. 2024-09-19T04:48:49.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.699+0000 7f6bb4080740 20 client.15354 trim_cache size 0 max 16384 2024-09-19T04:48:49.708 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:48:49.708 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T04:48:49.708 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-19T04:48:49.708 INFO:teuthology.orchestra.run.smithi002.stdout: "2fa76107-9b5a-479d-a0d6-5fb8179e789e": { 2024-09-19T04:48:49.708 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-19T04:48:49.708 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "2fa76107-9b5a-479d-a0d6-5fb8179e789e", 2024-09-19T04:48:49.708 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-19T04:48:49.708 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:48:49.708 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:48:49.709 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:48:49.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.700+0000 7f6bb1ca7640 1 -- 172.21.15.2:0/44159576 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f6b940a3550 msgr2=0x7f6b940a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:49.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.700+0000 7f6bb1ca7640 1 --2- 172.21.15.2:0/44159576 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f6b940a3550 0x7f6b940a5a10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0005ab0 tx=0x7f6ba0005a20 comp rx=0 tx=0).stop 2024-09-19T04:48:49.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.700+0000 7f6bb1ca7640 1 -- 172.21.15.2:0/44159576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bac100100 msgr2=0x7f6bac198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:48:49.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.700+0000 7f6bb1ca7640 1 --2- 172.21.15.2:0/44159576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bac100100 0x7f6bac198410 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c00c970 tx=0x7f6b9c00ce30 comp rx=0 tx=0).stop 2024-09-19T04:48:49.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.700+0000 7f6bb1ca7640 1 -- 172.21.15.2:0/44159576 shutdown_connections 2024-09-19T04:48:49.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.700+0000 7f6bb1ca7640 1 --2- 172.21.15.2:0/44159576 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6bac106b80 0x7f6bac19cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:49.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.700+0000 7f6bb1ca7640 1 --2- 172.21.15.2:0/44159576 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f6b940a3550 0x7f6b940a5a10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:49.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.700+0000 7f6bb1ca7640 1 --2- 172.21.15.2:0/44159576 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6bac100aa0 0x7f6bac198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:49.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.700+0000 7f6bb1ca7640 1 --2- 172.21.15.2:0/44159576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bac100100 0x7f6bac198410 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:48:49.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.700+0000 7f6bb1ca7640 1 -- 172.21.15.2:0/44159576 >> 172.21.15.2:0/44159576 conn(0x7f6bac077230 msgr2=0x7f6bac104c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:48:49.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.701+0000 7f6bb1ca7640 1 -- 172.21.15.2:0/44159576 shutdown_connections 2024-09-19T04:48:49.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:48:49.701+0000 7f6bb1ca7640 1 -- 172.21.15.2:0/44159576 wait complete. 2024-09-19T04:48:50.311 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:50 smithi002 ceph-mon[30975]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:48:50.341 INFO:tasks.cephfs.filesystem:scrub status for tag:2fa76107-9b5a-479d-a0d6-5fb8179e789e - {'path': '/', 'tag': '2fa76107-9b5a-479d-a0d6-5fb8179e789e', 'options': 'recursive,force'} 2024-09-19T04:48:50.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:50 smithi018 ceph-mon[34537]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:48:50.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:50 smithi116 ceph-mon[34477]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:48:51.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:51 smithi018 ceph-mon[34537]: scrub summary: idle 2024-09-19T04:48:51.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:51 smithi002 ceph-mon[30975]: scrub summary: idle 2024-09-19T04:48:51.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:51 smithi116 ceph-mon[34477]: scrub summary: idle 2024-09-19T04:48:52.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:52 smithi018 ceph-mon[34537]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T04:48:52.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:52 smithi002 ceph-mon[30975]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T04:48:52.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:52 smithi116 ceph-mon[34477]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T04:48:54.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:54 smithi018 ceph-mon[34537]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T04:48:54.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:54 smithi002 ceph-mon[30975]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T04:48:54.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:54 smithi116 ceph-mon[34477]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T04:48:56.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:56 smithi018 ceph-mon[34537]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T04:48:56.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:56 smithi002 ceph-mon[30975]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T04:48:56.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:56 smithi116 ceph-mon[34477]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T04:48:58.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:48:58 smithi018 ceph-mon[34537]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T04:48:58.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:48:58 smithi002 ceph-mon[30975]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T04:48:58.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:48:58 smithi116 ceph-mon[34477]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T04:49:00.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:49:00 smithi018 ceph-mon[34537]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T04:49:00.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:49:00 smithi002 ceph-mon[30975]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T04:49:00.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:49:00 smithi116 ceph-mon[34477]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T04:49:01.110 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:49:00 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:49:00.710+0000 7f558f84d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:49:01.110 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:49:00 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:49:00.710+0000 7f558f84d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:49:01.110 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:49:00 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:49:00.710+0000 7f558f84d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:49:01.110 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:49:00 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:49:00.710+0000 7f558f84d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:49:01.111 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 04:49:00 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T04:49:00.710+0000 7f558f84d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:49:02.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:49:02 smithi018 ceph-mon[34537]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T04:49:02.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:49:02 smithi018 ceph-mon[34537]: mgrmap e24: x(active, since 62s), standbys: y, z 2024-09-19T04:49:02.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:49:02 smithi002 ceph-mon[30975]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T04:49:02.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:49:02 smithi002 ceph-mon[30975]: mgrmap e24: x(active, since 62s), standbys: y, z 2024-09-19T04:49:02.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:49:02 smithi116 ceph-mon[34477]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T04:49:02.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:49:02 smithi116 ceph-mon[34477]: mgrmap e24: x(active, since 62s), standbys: y, z 2024-09-19T04:49:04.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:49:04 smithi018 ceph-mon[34537]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:49:04.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:49:04 smithi002 ceph-mon[30975]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:49:04.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:49:04 smithi116 ceph-mon[34477]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:49:06.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:49:06 smithi018 ceph-mon[34537]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T04:49:06.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:49:06 smithi002 ceph-mon[30975]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T04:49:06.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:49:06 smithi116 ceph-mon[34477]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T04:49:08.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:49:08 smithi018 ceph-mon[34537]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T04:49:08.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:49:08 smithi002 ceph-mon[30975]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T04:49:08.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:49:08 smithi116 ceph-mon[34477]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T04:49:09.433 INFO:tasks.workunit.client.0.smithi002.stderr:Updating files: 94% (12158/12896) Updating files: 95% (12252/12896) Updating files: 96% (12381/12896) Updating files: 97% (12510/12896) Updating files: 98% (12639/12896) Updating files: 99% (12768/12896) Updating files: 100% (12896/12896) Updating files: 100% (12896/12896), done. 2024-09-19T04:49:09.556 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:49:09 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:49:09.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:49:09 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:49:09.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:49:09 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:49:10.173 INFO:tasks.workunit.client.0.smithi002.stderr:Note: switching to '6fad5dd73c93545e52f57f681e140a9c3529c11e'. 2024-09-19T04:49:10.174 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-19T04:49:10.174 INFO:tasks.workunit.client.0.smithi002.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T04:49:10.174 INFO:tasks.workunit.client.0.smithi002.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T04:49:10.174 INFO:tasks.workunit.client.0.smithi002.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T04:49:10.174 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-19T04:49:10.174 INFO:tasks.workunit.client.0.smithi002.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T04:49:10.174 INFO:tasks.workunit.client.0.smithi002.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T04:49:10.174 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-19T04:49:10.174 INFO:tasks.workunit.client.0.smithi002.stderr: git switch -c 2024-09-19T04:49:10.174 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-19T04:49:10.174 INFO:tasks.workunit.client.0.smithi002.stderr:Or undo this operation with: 2024-09-19T04:49:10.175 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-19T04:49:10.175 INFO:tasks.workunit.client.0.smithi002.stderr: git switch - 2024-09-19T04:49:10.175 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-19T04:49:10.175 INFO:tasks.workunit.client.0.smithi002.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T04:49:10.175 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-19T04:49:10.175 INFO:tasks.workunit.client.0.smithi002.stderr:HEAD is now at 6fad5dd73c9 Merge pull request #59812 from neha-ojha/wip-rtd-squid 2024-09-19T04:49:10.180 DEBUG:teuthology.orchestra.run.smithi002:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-19T04:49:10.206 INFO:tasks.workunit.client.0.smithi002.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-19T04:49:10.208 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T04:49:10.209 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-19T04:49:10.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:49:10 smithi018 ceph-mon[34537]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T04:49:10.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:49:10 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:49:10.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:49:10 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:49:10.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:49:10 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:49:10.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:49:10 smithi002 ceph-mon[30975]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T04:49:10.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:49:10 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:49:10.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:49:10 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:49:10.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:49:10 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:49:10.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:49:10 smithi116 ceph-mon[34477]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T04:49:10.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:49:10 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:49:10.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:49:10 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:49:10.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:49:10 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:49:10.933 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-19T04:49:11.004 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-19T04:49:11.047 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T04:49:11.049 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T04:49:11.049 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-19T04:49:11.089 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T04:49:11.092 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-19T04:49:11.092 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-19T04:49:11.149 INFO:tasks.workunit:Running workunits matching fs/test_o_trunc.sh on client.0... 2024-09-19T04:49:11.150 INFO:tasks.workunit:Running workunit fs/test_o_trunc.sh... 2024-09-19T04:49:11.150 DEBUG:teuthology.orchestra.run.smithi002:workunit test fs/test_o_trunc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_o_trunc.sh 2024-09-19T04:49:11.215 INFO:tasks.workunit.client.0.smithi002.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_o_trunc.sh 2024-09-19T04:49:11.216 INFO:tasks.workunit.client.0.smithi002.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs 2024-09-19T04:49:11.216 INFO:tasks.workunit.client.0.smithi002.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_o_trunc trunc.foo 600 2024-09-19T04:49:12.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:49:12 smithi018 ceph-mon[34537]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T04:49:12.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:49:12 smithi002 ceph-mon[30975]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T04:49:12.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:49:12 smithi116 ceph-mon[34477]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T04:49:14.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:49:14 smithi018 ceph-mon[34537]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T04:49:14.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:49:14 smithi002 ceph-mon[30975]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T04:49:14.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:49:14 smithi116 ceph-mon[34477]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T04:49:16.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:49:16 smithi018 ceph-mon[34537]: pgmap v41: 97 pgs: 97 active+clean; 1.4 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 27 KiB/s wr, 19 op/s 2024-09-19T04:49:16.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:49:16 smithi002 ceph-mon[30975]: pgmap v41: 97 pgs: 97 active+clean; 1.4 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 27 KiB/s wr, 19 op/s 2024-09-19T04:49:16.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:49:16 smithi116 ceph-mon[34477]: pgmap v41: 97 pgs: 97 active+clean; 1.4 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 27 KiB/s wr, 19 op/s 2024-09-19T04:49:18.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:49:18 smithi018 ceph-mon[34537]: pgmap v42: 97 pgs: 97 active+clean; 1.4 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 5.0 KiB/s wr, 3 op/s 2024-09-19T04:49:18.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:49:18 smithi002 ceph-mon[30975]: pgmap v42: 97 pgs: 97 active+clean; 1.4 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 5.0 KiB/s wr, 3 op/s 2024-09-19T04:49:18.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:49:18 smithi116 ceph-mon[34477]: pgmap v42: 97 pgs: 97 active+clean; 1.4 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 5.0 KiB/s wr, 3 op/s 2024-09-19T04:49:20.342 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:49:20.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:49:20 smithi018 ceph-mon[34537]: pgmap v43: 97 pgs: 97 active+clean; 1.4 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 5.0 KiB/s wr, 3 op/s 2024-09-19T04:49:20.609 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:49:20 smithi002 ceph-mon[30975]: pgmap v43: 97 pgs: 97 active+clean; 1.4 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 5.0 KiB/s wr, 3 op/s 2024-09-19T04:49:20.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:49:20 smithi116 ceph-mon[34477]: pgmap v43: 97 pgs: 97 active+clean; 1.4 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 5.0 KiB/s wr, 3 op/s 2024-09-19T04:49:20.617 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:49:21.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.057+0000 7efd8582a640 1 -- 172.21.15.2:0/148765486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd80103780 msgr2=0x7efd80107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:21.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.057+0000 7efd8582a640 1 --2- 172.21.15.2:0/148765486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd80103780 0x7efd80107bc0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7efd74009930 tx=0x7efd7402a420 comp rx=0 tx=0).stop 2024-09-19T04:49:21.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.057+0000 7efd8582a640 1 -- 172.21.15.2:0/148765486 shutdown_connections 2024-09-19T04:49:21.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.057+0000 7efd8582a640 1 --2- 172.21.15.2:0/148765486 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd80108300 0x7efd8010ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:21.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.057+0000 7efd8582a640 1 --2- 172.21.15.2:0/148765486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd80103780 0x7efd80107bc0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:21.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.057+0000 7efd8582a640 1 --2- 172.21.15.2:0/148765486 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efd80102dd0 0x7efd801031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:21.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.057+0000 7efd8582a640 1 -- 172.21.15.2:0/148765486 >> 172.21.15.2:0/148765486 conn(0x7efd800fc7d0 msgr2=0x7efd800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:49:21.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.057+0000 7efd8582a640 1 -- 172.21.15.2:0/148765486 shutdown_connections 2024-09-19T04:49:21.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.057+0000 7efd8582a640 1 -- 172.21.15.2:0/148765486 wait complete. 2024-09-19T04:49:21.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.058+0000 7efd8582a640 1 Processor -- start 2024-09-19T04:49:21.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.058+0000 7efd8582a640 1 -- start start 2024-09-19T04:49:21.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.058+0000 7efd8582a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efd80102dd0 0x7efd8019a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:21.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.058+0000 7efd8582a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd80103780 0x7efd8019abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:21.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.058+0000 7efd8582a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd80108300 0x7efd8019ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:21.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.058+0000 7efd8582a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efd80111f00 con 0x7efd80103780 2024-09-19T04:49:21.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.058+0000 7efd8582a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efd80111d80 con 0x7efd80108300 2024-09-19T04:49:21.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.058+0000 7efd8582a640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7efd80112080 con 0x7efd80102dd0 2024-09-19T04:49:21.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.058+0000 7efd7e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd80103780 0x7efd8019abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:21.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.058+0000 7efd7e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd80103780 0x7efd8019abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34634/0 (socket says 172.21.15.2:34634) 2024-09-19T04:49:21.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.058+0000 7efd7e7fc640 1 -- 172.21.15.2:0/1007857166 learned_addr learned my addr 172.21.15.2:0/1007857166 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:49:21.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.059+0000 7efd7effd640 1 --2- 172.21.15.2:0/1007857166 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efd80102dd0 0x7efd8019a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:21.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.059+0000 7efd7f7fe640 1 --2- 172.21.15.2:0/1007857166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd80108300 0x7efd8019ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:21.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.059+0000 7efd7e7fc640 1 -- 172.21.15.2:0/1007857166 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efd80102dd0 msgr2=0x7efd8019a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:21.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.059+0000 7efd7e7fc640 1 --2- 172.21.15.2:0/1007857166 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efd80102dd0 0x7efd8019a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:21.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.059+0000 7efd7e7fc640 1 -- 172.21.15.2:0/1007857166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd80108300 msgr2=0x7efd8019ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:21.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.059+0000 7efd7e7fc640 1 --2- 172.21.15.2:0/1007857166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd80108300 0x7efd8019ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:21.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.059+0000 7efd7e7fc640 1 -- 172.21.15.2:0/1007857166 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd8019f660 con 0x7efd80103780 2024-09-19T04:49:21.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.059+0000 7efd7e7fc640 1 --2- 172.21.15.2:0/1007857166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd80103780 0x7efd8019abf0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7efd74009230 tx=0x7efd74004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:49:21.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.059+0000 7efd84828640 1 -- 172.21.15.2:0/1007857166 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd7403f030 con 0x7efd80103780 2024-09-19T04:49:21.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.059+0000 7efd8582a640 1 -- 172.21.15.2:0/1007857166 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd8019f8f0 con 0x7efd80103780 2024-09-19T04:49:21.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.059+0000 7efd84828640 1 -- 172.21.15.2:0/1007857166 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efd740035f0 con 0x7efd80103780 2024-09-19T04:49:21.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.059+0000 7efd84828640 1 -- 172.21.15.2:0/1007857166 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd74035070 con 0x7efd80103780 2024-09-19T04:49:21.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.059+0000 7efd8582a640 1 -- 172.21.15.2:0/1007857166 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd801a7230 con 0x7efd80103780 2024-09-19T04:49:21.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.062+0000 7efd87c03740 1 Processor -- start 2024-09-19T04:49:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.062+0000 7efd87c03740 1 -- start start 2024-09-19T04:49:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.062+0000 7efd87c03740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b549d854a0 0x55b549d85880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.062+0000 7efd87c03740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b549d85dc0 0x55b549d90140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.062+0000 7efd87c03740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b549d90680 0x55b549d92a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.062+0000 7efd87c03740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b549ceb2e0 con 0x55b549d90680 2024-09-19T04:49:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.062+0000 7efd87c03740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b549c92ce0 con 0x55b549d85dc0 2024-09-19T04:49:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.062+0000 7efd87c03740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55b549ce72a0 con 0x55b549d854a0 2024-09-19T04:49:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.063+0000 7efd7f7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b549d854a0 0x55b549d85880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.063+0000 7efd84828640 1 -- 172.21.15.2:0/1007857166 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 24) ==== 138587+0+0 (secure 0 0 0) 0x7efd74032330 con 0x7efd80103780 2024-09-19T04:49:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.063+0000 7efd7f7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b549d854a0 0x55b549d85880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.2:44022/0 (socket says 172.21.15.2:44022) 2024-09-19T04:49:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.063+0000 7efd7f7fe640 1 -- 172.21.15.2:0/4284395316 learned_addr learned my addr 172.21.15.2:0/4284395316 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:49:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.063+0000 7efd7effd640 1 --2- 172.21.15.2:0/4284395316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b549d85dc0 0x55b549d90140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.063+0000 7efd7e7fc640 1 --2- 172.21.15.2:0/4284395316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b549d90680 0x55b549d92a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:21.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.063+0000 7efd7f7fe640 1 -- 172.21.15.2:0/4284395316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b549d85dc0 msgr2=0x55b549d90140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:49:21.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.063+0000 7efd7f7fe640 1 --2- 172.21.15.2:0/4284395316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b549d85dc0 0x55b549d90140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:21.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.063+0000 7efd7f7fe640 1 -- 172.21.15.2:0/4284395316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b549d90680 msgr2=0x55b549d92a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:49:21.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.063+0000 7efd7f7fe640 1 --2- 172.21.15.2:0/4284395316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b549d90680 0x55b549d92a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:21.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.063+0000 7efd7f7fe640 1 -- 172.21.15.2:0/4284395316 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b549c77440 con 0x55b549d854a0 2024-09-19T04:49:21.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.063+0000 7efd7f7fe640 1 --2- 172.21.15.2:0/4284395316 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b549d854a0 0x55b549d85880 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efd7800caa0 tx=0x7efd7800cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15edcd1886b12aba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:49:21.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.063+0000 7efd65ffb640 1 -- 172.21.15.2:0/4284395316 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd78004020 con 0x55b549d854a0 2024-09-19T04:49:21.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.063+0000 7efd84828640 1 --2- 172.21.15.2:0/1007857166 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7efd680a34d0 0x7efd680a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:21.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.063+0000 7efd65ffb640 1 -- 172.21.15.2:0/4284395316 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efd780041c0 con 0x55b549d854a0 2024-09-19T04:49:21.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.064+0000 7efd65ffb640 1 -- 172.21.15.2:0/4284395316 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd78010690 con 0x55b549d854a0 2024-09-19T04:49:21.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.064+0000 7efd7effd640 1 --2- 172.21.15.2:0/1007857166 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7efd680a34d0 0x7efd680a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:21.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.064+0000 7efd84828640 1 -- 172.21.15.2:0/1007857166 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7efd740f0880 con 0x7efd80103780 2024-09-19T04:49:21.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.064+0000 7efd87c03740 1 -- 172.21.15.2:0/4284395316 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b549d854a0 msgr2=0x55b549d85880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:21.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.064+0000 7efd7effd640 1 --2- 172.21.15.2:0/1007857166 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7efd680a34d0 0x7efd680a5990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x55b549d82890 tx=0x7efd700075b0 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:49:21.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.064+0000 7efd87c03740 1 --2- 172.21.15.2:0/4284395316 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b549d854a0 0x55b549d85880 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efd7800caa0 tx=0x7efd7800cf60 comp rx=0 tx=0).stop 2024-09-19T04:49:21.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.064+0000 7efd87c03740 1 -- 172.21.15.2:0/4284395316 shutdown_connections 2024-09-19T04:49:21.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.064+0000 7efd87c03740 1 --2- 172.21.15.2:0/4284395316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b549d90680 0x55b549d92a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:21.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.064+0000 7efd87c03740 1 --2- 172.21.15.2:0/4284395316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b549d85dc0 0x55b549d90140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:21.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.064+0000 7efd87c03740 1 --2- 172.21.15.2:0/4284395316 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b549d854a0 0x55b549d85880 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:21.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.064+0000 7efd87c03740 1 -- 172.21.15.2:0/4284395316 >> 172.21.15.2:0/4284395316 conn(0x55b549d81a30 msgr2=0x55b549d81e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:49:21.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.065+0000 7efd87c03740 1 -- 172.21.15.2:0/4284395316 shutdown_connections 2024-09-19T04:49:21.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.065+0000 7efd87c03740 1 -- 172.21.15.2:0/4284395316 wait complete. 2024-09-19T04:49:21.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.065+0000 7efd87c03740 1 -- start start 2024-09-19T04:49:21.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.065+0000 7efd87c03740 1 Processor -- start 2024-09-19T04:49:21.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.065+0000 7efd87c03740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b549d854a0 0x55b549d8fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:21.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.066+0000 7efd87c03740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b549d85dc0 0x55b549d8d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:21.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.066+0000 7efd87c03740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b549d90680 0x55b549d8d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:21.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.066+0000 7efd87c03740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b549d93250 con 0x55b549d85dc0 2024-09-19T04:49:21.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.066+0000 7efd87c03740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b549ca6050 con 0x55b549d90680 2024-09-19T04:49:21.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.066+0000 7efd87c03740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55b549d933d0 con 0x55b549d854a0 2024-09-19T04:49:21.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.066+0000 7efd87c03740 10 client.0 _ll_register_callbacks cb 0x55b549ce6160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:49:21.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.066+0000 7efd7e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b549d85dc0 0x55b549d8d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:21.130 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:49:21.131 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T04:49:21.131 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T04:49:21.131 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:49:21.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.066+0000 7efd7e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b549d85dc0 0x55b549d8d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34656/0 (socket says 172.21.15.2:34656) 2024-09-19T04:49:21.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.066+0000 7efd7e7fc640 1 -- 172.21.15.2:0/2436642127 learned_addr learned my addr 172.21.15.2:0/2436642127 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:49:21.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.066+0000 7efd7effd640 1 --2- 172.21.15.2:0/2436642127 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b549d854a0 0x55b549d8fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:21.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.066+0000 7efd7f7fe640 1 --2- 172.21.15.2:0/2436642127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b549d90680 0x55b549d8d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:21.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.066+0000 7efd7e7fc640 1 -- 172.21.15.2:0/2436642127 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b549d854a0 msgr2=0x55b549d8fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:49:21.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.066+0000 7efd7e7fc640 1 --2- 172.21.15.2:0/2436642127 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b549d854a0 0x55b549d8fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:21.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.066+0000 7efd7e7fc640 1 -- 172.21.15.2:0/2436642127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b549d90680 msgr2=0x55b549d8d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:49:21.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.066+0000 7efd7e7fc640 1 --2- 172.21.15.2:0/2436642127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b549d90680 0x55b549d8d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:21.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.066+0000 7efd7e7fc640 1 -- 172.21.15.2:0/2436642127 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b549a5c3c0 con 0x55b549d85dc0 2024-09-19T04:49:21.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.066+0000 7efd7effd640 1 --2- 172.21.15.2:0/2436642127 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b549d854a0 0x55b549d8fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:49:21.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.066+0000 7efd7e7fc640 1 --2- 172.21.15.2:0/2436642127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b549d85dc0 0x55b549d8d2a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7efd740b8e60 tx=0x7efd740bc890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eacc1fd9535102b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:49:21.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.066+0000 7efd5effd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:49:21.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.066+0000 7efd5effd640 1 -- 172.21.15.2:0/2436642127 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd74049070 con 0x55b549d85dc0 2024-09-19T04:49:21.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.066+0000 7efd5effd640 1 -- 172.21.15.2:0/2436642127 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7efd74003aa0 con 0x55b549d85dc0 2024-09-19T04:49:21.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.066+0000 7efd87c03740 1 -- 172.21.15.2:0/2436642127 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd780041c0 con 0x55b549d85dc0 2024-09-19T04:49:21.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.066+0000 7efd5effd640 1 -- 172.21.15.2:0/2436642127 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7efd740d5050 con 0x55b549d85dc0 2024-09-19T04:49:21.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.066+0000 7efd87c03740 10 client.15372 fetch_fsmap learned FSMap version 19 2024-09-19T04:49:21.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.066+0000 7efd87c03740 1 -- 172.21.15.2:0/2436642127 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55b549d9ec20 con 0x55b549d85dc0 2024-09-19T04:49:21.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.067+0000 7efd5effd640 1 -- 172.21.15.2:0/2436642127 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efd780041c0 con 0x55b549d85dc0 2024-09-19T04:49:21.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.067+0000 7efd5effd640 1 -- 172.21.15.2:0/2436642127 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7efd740b9070 con 0x55b549d85dc0 2024-09-19T04:49:21.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.067+0000 7efd87c03740 10 client.15372 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:49:21.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.067+0000 7efd87c03740 10 client.15372 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:49:21.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.067+0000 7efd87c03740 20 client.15372 populate_metadata read hostname 'smithi002' 2024-09-19T04:49:21.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.067+0000 7efd87c03740 1 --2- 172.21.15.2:0/2436642127 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55b549da0010 0x55b549da2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:21.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.067+0000 7efd87c03740 4 client.15372 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:49:21.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.067+0000 7efd87c03740 1 -- 172.21.15.2:0/2436642127 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b549cf8850 con 0x55b549da0010 2024-09-19T04:49:21.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.067+0000 7efd7effd640 1 --2- 172.21.15.2:0/2436642127 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55b549da0010 0x55b549da2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:21.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.068+0000 7efd7effd640 1 --2- 172.21.15.2:0/2436642127 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55b549da0010 0x55b549da2400 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cffb982f5d9db20f server_cookie=baa6f747e4d01f76 in_seq=0 out_seq=0 2024-09-19T04:49:21.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.068+0000 7efd5effd640 10 client.15372 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:49:21.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.068+0000 7efd5effd640 1 -- 172.21.15.2:0/2436642127 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b549cf8850 con 0x55b549da0010 2024-09-19T04:49:21.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.068+0000 7efd5effd640 10 client.15372 handle_command_reply: tid=0 2024-09-19T04:49:21.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.068+0000 7efd87c03740 1 client.15372 shutdown 2024-09-19T04:49:21.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.068+0000 7efd87c03740 1 -- 172.21.15.2:0/2436642127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b549d85dc0 msgr2=0x55b549d8d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:21.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.068+0000 7efd87c03740 1 --2- 172.21.15.2:0/2436642127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b549d85dc0 0x55b549d8d2a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7efd740b8e60 tx=0x7efd740bc890 comp rx=0 tx=0).stop 2024-09-19T04:49:21.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.068+0000 7efd87c03740 1 -- 172.21.15.2:0/2436642127 shutdown_connections 2024-09-19T04:49:21.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.068+0000 7efd87c03740 1 --2- 172.21.15.2:0/2436642127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b549d90680 0x55b549d8d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:21.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.068+0000 7efd87c03740 1 --2- 172.21.15.2:0/2436642127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b549d85dc0 0x55b549d8d2a0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:21.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.068+0000 7efd87c03740 1 --2- 172.21.15.2:0/2436642127 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55b549da0010 0x55b549da2400 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:21.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.068+0000 7efd87c03740 1 --2- 172.21.15.2:0/2436642127 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b549d854a0 0x55b549d8fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:21.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.069+0000 7efd87c03740 1 -- 172.21.15.2:0/2436642127 >> 172.21.15.2:0/2436642127 conn(0x55b549d81a30 msgr2=0x55b549d80b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:49:21.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.069+0000 7efd5effd640 0 client.15372 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:49:21.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.069+0000 7efd87c03740 1 -- 172.21.15.2:0/2436642127 shutdown_connections 2024-09-19T04:49:21.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.069+0000 7efd87c03740 1 -- 172.21.15.2:0/2436642127 wait complete. 2024-09-19T04:49:21.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.069+0000 7efd87c03740 20 client.15372 trim_cache size 0 max 16384 2024-09-19T04:49:21.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.086+0000 7efd87c03740 1 Processor -- start 2024-09-19T04:49:21.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.087+0000 7efd87c03740 1 -- start start 2024-09-19T04:49:21.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.087+0000 7efd87c03740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b549d854a0 0x55b549d9c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:21.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.087+0000 7efd87c03740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b549d85dc0 0x55b549d8bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.087+0000 7efd87c03740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b549d90680 0x55b549da7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.087+0000 7efd87c03740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efd801ad900 con 0x55b549d854a0 2024-09-19T04:49:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.087+0000 7efd87c03740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efd801b0180 con 0x55b549d85dc0 2024-09-19T04:49:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.087+0000 7efd87c03740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7efd801adf70 con 0x55b549d90680 2024-09-19T04:49:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.087+0000 7efd7effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b549d854a0 0x55b549d9c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.087+0000 7efd7effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b549d854a0 0x55b549d9c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34658/0 (socket says 172.21.15.2:34658) 2024-09-19T04:49:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.087+0000 7efd7effd640 1 -- 172.21.15.2:0/3056738502 learned_addr learned my addr 172.21.15.2:0/3056738502 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:49:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.087+0000 7efd7f7fe640 1 --2- 172.21.15.2:0/3056738502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b549d90680 0x55b549da7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.087+0000 7efd7effd640 1 -- 172.21.15.2:0/3056738502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b549d90680 msgr2=0x55b549da7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:49:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.087+0000 7efd7effd640 1 --2- 172.21.15.2:0/3056738502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b549d90680 0x55b549da7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.087+0000 7efd7effd640 1 -- 172.21.15.2:0/3056738502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b549d85dc0 msgr2=0x55b549d8bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:49:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.087+0000 7efd7effd640 1 --2- 172.21.15.2:0/3056738502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b549d85dc0 0x55b549d8bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.087+0000 7efd7effd640 1 -- 172.21.15.2:0/3056738502 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b549d8c2b0 con 0x55b549d854a0 2024-09-19T04:49:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.087+0000 7efd7effd640 1 --2- 172.21.15.2:0/3056738502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b549d854a0 0x55b549d9c4b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x55b549da2bf0 tx=0x7efd70015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b228f356746130a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:49:21.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.088+0000 7efd657fa640 1 -- 172.21.15.2:0/3056738502 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd7001f0d0 con 0x55b549d854a0 2024-09-19T04:49:21.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.088+0000 7efd657fa640 1 -- 172.21.15.2:0/3056738502 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efd7001f270 con 0x55b549d854a0 2024-09-19T04:49:21.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.088+0000 7efd657fa640 1 -- 172.21.15.2:0/3056738502 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd700053e0 con 0x55b549d854a0 2024-09-19T04:49:21.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.088+0000 7efd87c03740 1 -- 172.21.15.2:0/3056738502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b549d854a0 msgr2=0x55b549d9c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:21.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.088+0000 7efd87c03740 1 --2- 172.21.15.2:0/3056738502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b549d854a0 0x55b549d9c4b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x55b549da2bf0 tx=0x7efd70015000 comp rx=0 tx=0).stop 2024-09-19T04:49:21.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.088+0000 7efd87c03740 1 -- 172.21.15.2:0/3056738502 shutdown_connections 2024-09-19T04:49:21.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.088+0000 7efd87c03740 1 --2- 172.21.15.2:0/3056738502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b549d90680 0x55b549da7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:21.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.088+0000 7efd87c03740 1 --2- 172.21.15.2:0/3056738502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b549d85dc0 0x55b549d8bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:21.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.088+0000 7efd87c03740 1 --2- 172.21.15.2:0/3056738502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b549d854a0 0x55b549d9c4b0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:21.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.088+0000 7efd87c03740 1 -- 172.21.15.2:0/3056738502 >> 172.21.15.2:0/3056738502 conn(0x55b549d81a30 msgr2=0x55b549d80b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:49:21.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.089+0000 7efd87c03740 1 -- 172.21.15.2:0/3056738502 shutdown_connections 2024-09-19T04:49:21.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.089+0000 7efd87c03740 1 -- 172.21.15.2:0/3056738502 wait complete. 2024-09-19T04:49:21.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.089+0000 7efd87c03740 1 -- start start 2024-09-19T04:49:21.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.089+0000 7efd87c03740 1 Processor -- start 2024-09-19T04:49:21.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.090+0000 7efd87c03740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b549d854a0 0x55b549d98620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:21.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.090+0000 7efd87c03740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b549d85dc0 0x55b549d98b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:21.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.090+0000 7efd87c03740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b549d90680 0x55b549d955f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:21.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.090+0000 7efd87c03740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efd801ae640 con 0x55b549d90680 2024-09-19T04:49:21.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.090+0000 7efd87c03740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efd801afab0 con 0x55b549d854a0 2024-09-19T04:49:21.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.090+0000 7efd87c03740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7efd801aed10 con 0x55b549d85dc0 2024-09-19T04:49:21.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.090+0000 7efd87c03740 10 client.0 _ll_register_callbacks cb 0x7efd740f40f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:49:21.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.090+0000 7efd7f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b549d90680 0x55b549d955f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:21.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.090+0000 7efd7f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b549d90680 0x55b549d955f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34660/0 (socket says 172.21.15.2:34660) 2024-09-19T04:49:21.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.090+0000 7efd7f7fe640 1 -- 172.21.15.2:0/1341813599 learned_addr learned my addr 172.21.15.2:0/1341813599 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:49:21.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.090+0000 7efd7effd640 1 --2- 172.21.15.2:0/1341813599 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b549d854a0 0x55b549d98620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:21.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.090+0000 7efd7e7fc640 1 --2- 172.21.15.2:0/1341813599 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b549d85dc0 0x55b549d98b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:21.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.090+0000 7efd7f7fe640 1 -- 172.21.15.2:0/1341813599 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b549d85dc0 msgr2=0x55b549d98b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:49:21.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.090+0000 7efd7f7fe640 1 --2- 172.21.15.2:0/1341813599 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b549d85dc0 0x55b549d98b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:21.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.090+0000 7efd7f7fe640 1 -- 172.21.15.2:0/1341813599 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b549d854a0 msgr2=0x55b549d98620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:49:21.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.090+0000 7efd7f7fe640 1 --2- 172.21.15.2:0/1341813599 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b549d854a0 0x55b549d98620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:21.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.090+0000 7efd7f7fe640 1 -- 172.21.15.2:0/1341813599 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b549d90360 con 0x55b549d90680 2024-09-19T04:49:21.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.090+0000 7efd7e7fc640 1 --2- 172.21.15.2:0/1341813599 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b549d85dc0 0x55b549d98b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:49:21.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.090+0000 7efd7f7fe640 1 --2- 172.21.15.2:0/1341813599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b549d90680 0x55b549d955f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7efd78018000 tx=0x7efd7800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71d2b702ba912cde server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:49:21.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.090+0000 7efd5effd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:49:21.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.091+0000 7efd5effd640 1 -- 172.21.15.2:0/1341813599 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd780054d0 con 0x55b549d90680 2024-09-19T04:49:21.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.091+0000 7efd5effd640 1 -- 172.21.15.2:0/1341813599 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7efd78003e60 con 0x55b549d90680 2024-09-19T04:49:21.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.091+0000 7efd87c03740 1 -- 172.21.15.2:0/1341813599 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd7001f270 con 0x55b549d90680 2024-09-19T04:49:21.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.091+0000 7efd5effd640 1 -- 172.21.15.2:0/1341813599 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7efd78032050 con 0x55b549d90680 2024-09-19T04:49:21.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.091+0000 7efd87c03740 10 client.15378 fetch_fsmap learned FSMap version 19 2024-09-19T04:49:21.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.091+0000 7efd87c03740 1 -- 172.21.15.2:0/1341813599 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55b549e0b400 con 0x55b549d90680 2024-09-19T04:49:21.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.091+0000 7efd5effd640 1 -- 172.21.15.2:0/1341813599 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efd7001f270 con 0x55b549d90680 2024-09-19T04:49:21.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.091+0000 7efd5effd640 1 -- 172.21.15.2:0/1341813599 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7efd78004680 con 0x55b549d90680 2024-09-19T04:49:21.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.091+0000 7efd87c03740 10 client.15378 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:49:21.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.091+0000 7efd87c03740 10 client.15378 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:49:21.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.091+0000 7efd87c03740 20 client.15378 populate_metadata read hostname 'smithi002' 2024-09-19T04:49:21.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.091+0000 7efd87c03740 1 --2- 172.21.15.2:0/1341813599 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55b549e0b870 0x55b549e0dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:21.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.091+0000 7efd87c03740 4 client.15378 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:49:21.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.091+0000 7efd87c03740 1 -- 172.21.15.2:0/1341813599 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b549cf2d60 con 0x55b549e0b870 2024-09-19T04:49:21.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.092+0000 7efd7effd640 1 --2- 172.21.15.2:0/1341813599 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55b549e0b870 0x55b549e0dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:21.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.092+0000 7efd5effd640 10 client.15378 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:49:21.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.092+0000 7efd7effd640 1 --2- 172.21.15.2:0/1341813599 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55b549e0b870 0x55b549e0dc90 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d087929a273894e7 server_cookie=ba0bbfa2ca789a25 in_seq=0 out_seq=0 2024-09-19T04:49:21.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.092+0000 7efd5effd640 1 -- 172.21.15.2:0/1341813599 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55b549cf2d60 con 0x55b549e0b870 2024-09-19T04:49:21.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.092+0000 7efd5effd640 10 client.15378 handle_command_reply: tid=0 2024-09-19T04:49:21.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.092+0000 7efd87c03740 1 client.15378 shutdown 2024-09-19T04:49:21.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.092+0000 7efd87c03740 1 -- 172.21.15.2:0/1341813599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b549d90680 msgr2=0x55b549d955f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:21.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.092+0000 7efd87c03740 1 --2- 172.21.15.2:0/1341813599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b549d90680 0x55b549d955f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7efd78018000 tx=0x7efd7800c2d0 comp rx=0 tx=0).stop 2024-09-19T04:49:21.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.093+0000 7efd87c03740 1 -- 172.21.15.2:0/1341813599 shutdown_connections 2024-09-19T04:49:21.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.093+0000 7efd87c03740 1 --2- 172.21.15.2:0/1341813599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b549d90680 0x55b549d955f0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:21.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.093+0000 7efd87c03740 1 --2- 172.21.15.2:0/1341813599 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55b549e0b870 0x55b549e0dc90 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:21.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.093+0000 7efd87c03740 1 --2- 172.21.15.2:0/1341813599 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b549d85dc0 0x55b549d98b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:21.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.093+0000 7efd87c03740 1 --2- 172.21.15.2:0/1341813599 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b549d854a0 0x55b549d98620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:21.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.093+0000 7efd87c03740 1 -- 172.21.15.2:0/1341813599 >> 172.21.15.2:0/1341813599 conn(0x55b549d81a30 msgr2=0x55b549d80b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:49:21.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.093+0000 7efd5effd640 0 client.15378 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:49:21.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.093+0000 7efd87c03740 1 -- 172.21.15.2:0/1341813599 shutdown_connections 2024-09-19T04:49:21.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.093+0000 7efd87c03740 1 -- 172.21.15.2:0/1341813599 wait complete. 2024-09-19T04:49:21.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.093+0000 7efd87c03740 20 client.15378 trim_cache size 0 max 16384 2024-09-19T04:49:21.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.093+0000 7efd8582a640 1 -- 172.21.15.2:0/1007857166 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7efd680a34d0 msgr2=0x7efd680a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:21.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.093+0000 7efd8582a640 1 --2- 172.21.15.2:0/1007857166 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7efd680a34d0 0x7efd680a5990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x55b549d82890 tx=0x7efd700075b0 comp rx=0 tx=0).stop 2024-09-19T04:49:21.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.093+0000 7efd8582a640 1 -- 172.21.15.2:0/1007857166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd80103780 msgr2=0x7efd8019abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:21.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.093+0000 7efd8582a640 1 --2- 172.21.15.2:0/1007857166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd80103780 0x7efd8019abf0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7efd74009230 tx=0x7efd74004270 comp rx=0 tx=0).stop 2024-09-19T04:49:21.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.093+0000 7efd8582a640 1 -- 172.21.15.2:0/1007857166 shutdown_connections 2024-09-19T04:49:21.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.093+0000 7efd8582a640 1 --2- 172.21.15.2:0/1007857166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd80108300 0x7efd8019ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:21.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.093+0000 7efd8582a640 1 --2- 172.21.15.2:0/1007857166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd80103780 0x7efd8019abf0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:21.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.093+0000 7efd8582a640 1 --2- 172.21.15.2:0/1007857166 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7efd680a34d0 0x7efd680a5990 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:21.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.093+0000 7efd8582a640 1 --2- 172.21.15.2:0/1007857166 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efd80102dd0 0x7efd8019a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:21.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.093+0000 7efd8582a640 1 -- 172.21.15.2:0/1007857166 >> 172.21.15.2:0/1007857166 conn(0x7efd800fc7d0 msgr2=0x7efd80100aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:49:21.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.094+0000 7efd8582a640 1 -- 172.21.15.2:0/1007857166 shutdown_connections 2024-09-19T04:49:21.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:21.094+0000 7efd8582a640 1 -- 172.21.15.2:0/1007857166 wait complete. 2024-09-19T04:49:21.923 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:49:21.924 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:49:22.193 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:49:22.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:49:22 smithi018 ceph-mon[34537]: pgmap v44: 97 pgs: 97 active+clean; 1.4 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-09-19T04:49:22.606 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:49:22 smithi002 ceph-mon[30975]: pgmap v44: 97 pgs: 97 active+clean; 1.4 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-09-19T04:49:22.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:49:22 smithi116 ceph-mon[34477]: pgmap v44: 97 pgs: 97 active+clean; 1.4 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-09-19T04:49:22.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.688+0000 7f4ec053d640 1 -- 172.21.15.2:0/2214429236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4eb8102ef0 msgr2=0x7f4eb810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:22.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.688+0000 7f4ec053d640 1 --2- 172.21.15.2:0/2214429236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4eb8102ef0 0x7f4eb810da40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0009ca0 tx=0x7f4eb002a950 comp rx=0 tx=0).stop 2024-09-19T04:49:22.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.688+0000 7f4ec053d640 1 -- 172.21.15.2:0/2214429236 shutdown_connections 2024-09-19T04:49:22.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.688+0000 7f4ec053d640 1 --2- 172.21.15.2:0/2214429236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4eb8102ef0 0x7f4eb810da40 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:22.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.688+0000 7f4ec053d640 1 --2- 172.21.15.2:0/2214429236 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4eb8102570 0x7f4eb81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:22.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.688+0000 7f4ec053d640 1 --2- 172.21.15.2:0/2214429236 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4eb8100e20 0x7f4eb8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:22.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.688+0000 7f4ec053d640 1 -- 172.21.15.2:0/2214429236 >> 172.21.15.2:0/2214429236 conn(0x7f4eb80fc7d0 msgr2=0x7f4eb80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:49:22.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.688+0000 7f4ec053d640 1 -- 172.21.15.2:0/2214429236 shutdown_connections 2024-09-19T04:49:22.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.688+0000 7f4ec053d640 1 -- 172.21.15.2:0/2214429236 wait complete. 2024-09-19T04:49:22.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.689+0000 7f4ec053d640 1 Processor -- start 2024-09-19T04:49:22.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.689+0000 7f4ec053d640 1 -- start start 2024-09-19T04:49:22.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.689+0000 7f4ec053d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4eb8100e20 0x7f4eb81983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:22.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.689+0000 7f4ec053d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4eb8102570 0x7f4eb8198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:22.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.689+0000 7f4ec053d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4eb8102ef0 0x7f4eb819ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:22.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.689+0000 7f4ec053d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb8110e50 con 0x7f4eb8102570 2024-09-19T04:49:22.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.689+0000 7f4ec053d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb8110cd0 con 0x7f4eb8102ef0 2024-09-19T04:49:22.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.689+0000 7f4ec053d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb8110fd0 con 0x7f4eb8100e20 2024-09-19T04:49:22.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.689+0000 7f4ebdad8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4eb8102570 0x7f4eb8198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:22.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.689+0000 7f4ebdad8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4eb8102570 0x7f4eb8198920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45056/0 (socket says 172.21.15.2:45056) 2024-09-19T04:49:22.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.689+0000 7f4ebdad8640 1 -- 172.21.15.2:0/169791460 learned_addr learned my addr 172.21.15.2:0/169791460 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:49:22.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.689+0000 7f4ebe2d9640 1 --2- 172.21.15.2:0/169791460 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4eb8100e20 0x7f4eb81983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:22.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.689+0000 7f4ebeada640 1 --2- 172.21.15.2:0/169791460 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4eb8102ef0 0x7f4eb819ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:22.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.690+0000 7f4ebdad8640 1 -- 172.21.15.2:0/169791460 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4eb8100e20 msgr2=0x7f4eb81983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:22.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.690+0000 7f4ebdad8640 1 --2- 172.21.15.2:0/169791460 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4eb8100e20 0x7f4eb81983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:22.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.690+0000 7f4ebdad8640 1 -- 172.21.15.2:0/169791460 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4eb8102ef0 msgr2=0x7f4eb819ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:22.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.690+0000 7f4ebdad8640 1 --2- 172.21.15.2:0/169791460 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4eb8102ef0 0x7f4eb819ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:22.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.690+0000 7f4ebdad8640 1 -- 172.21.15.2:0/169791460 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eb819d390 con 0x7f4eb8102570 2024-09-19T04:49:22.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.690+0000 7f4ebdad8640 1 --2- 172.21.15.2:0/169791460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4eb8102570 0x7f4eb8198920 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4ea800c890 tx=0x7f4ea800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:49:22.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.690+0000 7f4eaf7fe640 1 -- 172.21.15.2:0/169791460 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea8004220 con 0x7f4eb8102570 2024-09-19T04:49:22.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.690+0000 7f4ec053d640 1 -- 172.21.15.2:0/169791460 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4eb819d680 con 0x7f4eb8102570 2024-09-19T04:49:22.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.690+0000 7f4eaf7fe640 1 -- 172.21.15.2:0/169791460 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4ea80043c0 con 0x7f4eb8102570 2024-09-19T04:49:22.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.690+0000 7f4eaf7fe640 1 -- 172.21.15.2:0/169791460 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea8004a00 con 0x7f4eb8102570 2024-09-19T04:49:22.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.690+0000 7f4ec053d640 1 -- 172.21.15.2:0/169791460 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4eb81a4f60 con 0x7f4eb8102570 2024-09-19T04:49:22.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.691+0000 7f4ec053d640 1 -- 172.21.15.2:0/169791460 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4eb8101200 con 0x7f4eb8102570 2024-09-19T04:49:22.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.692+0000 7f4eaf7fe640 1 -- 172.21.15.2:0/169791460 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 24) ==== 138587+0+0 (secure 0 0 0) 0x7f4ea80079b0 con 0x7f4eb8102570 2024-09-19T04:49:22.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.693+0000 7f4eaf7fe640 1 --2- 172.21.15.2:0/169791460 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f4ea40a34d0 0x7f4ea40a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:22.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.693+0000 7f4eaf7fe640 1 -- 172.21.15.2:0/169791460 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f4ea80cffe0 con 0x7f4eb8102570 2024-09-19T04:49:22.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.693+0000 7f4ebe2d9640 1 --2- 172.21.15.2:0/169791460 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f4ea40a34d0 0x7f4ea40a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:22.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.693+0000 7f4ebe2d9640 1 --2- 172.21.15.2:0/169791460 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f4ea40a34d0 0x7f4ea40a5990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4009990 tx=0x7f4eb4009110 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:49:22.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.696+0000 7f4eaf7fe640 1 -- 172.21.15.2:0/169791460 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4ea8014030 con 0x7f4eb8102570 2024-09-19T04:49:22.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.907+0000 7f4ec053d640 1 -- 172.21.15.2:0/169791460 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4eb810a0d0 con 0x7f4eb8102570 2024-09-19T04:49:22.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.907+0000 7f4eaf7fe640 1 -- 172.21.15.2:0/169791460 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11840 (secure 0 0 0) 0x7f4ea809c790 con 0x7f4eb8102570 2024-09-19T04:49:22.909 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:49:22.909 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":19,"btime":"2024-09-19T04:46:33:537239+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2467365137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2467365137},{"type":"v1","addr":"172.21.15.2:6835","nonce":2467365137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3162441888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3162441888},{"type":"v1","addr":"172.21.15.2:6837","nonce":3162441888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14631,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2740862966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2740862966},{"type":"v1","addr":"172.21.15.2:6839","nonce":2740862966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/2394435504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2394435504},{"type":"v1","addr":"172.21.15.2:6841","nonce":2394435504}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1630480244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1630480244},{"type":"v1","addr":"172.21.15.18:6833","nonce":1630480244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1553897465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1553897465},{"type":"v1","addr":"172.21.15.116:6833","nonce":1553897465}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3035664608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3035664608},{"type":"v1","addr":"172.21.15.18:6835","nonce":3035664608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1096622392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1096622392},{"type":"v1","addr":"172.21.15.18:6837","nonce":1096622392}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3761157675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3761157675},{"type":"v1","addr":"172.21.15.116:6835","nonce":3761157675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/1120131594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1120131594},{"type":"v1","addr":"172.21.15.116:6837","nonce":1120131594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:46:24.050115+0000","modified":"2024-09-19T04:46:33.112369+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/4207677139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":4207677139},{"type":"v1","addr":"172.21.15.18:6839","nonce":4207677139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/2346874880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":2346874880},{"type":"v1","addr":"172.21.15.116:6839","nonce":2346874880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496]},"id":1}]} 2024-09-19T04:49:22.910 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 19 2024-09-19T04:49:22.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.909+0000 7f4ec053d640 1 -- 172.21.15.2:0/169791460 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f4ea40a34d0 msgr2=0x7f4ea40a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:22.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.909+0000 7f4ec053d640 1 --2- 172.21.15.2:0/169791460 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f4ea40a34d0 0x7f4ea40a5990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4009990 tx=0x7f4eb4009110 comp rx=0 tx=0).stop 2024-09-19T04:49:22.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.909+0000 7f4ec053d640 1 -- 172.21.15.2:0/169791460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4eb8102570 msgr2=0x7f4eb8198920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:22.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.909+0000 7f4ec053d640 1 --2- 172.21.15.2:0/169791460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4eb8102570 0x7f4eb8198920 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4ea800c890 tx=0x7f4ea800cc90 comp rx=0 tx=0).stop 2024-09-19T04:49:22.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.909+0000 7f4ec053d640 1 -- 172.21.15.2:0/169791460 shutdown_connections 2024-09-19T04:49:22.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.909+0000 7f4ec053d640 1 --2- 172.21.15.2:0/169791460 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4eb8102ef0 0x7f4eb819ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:22.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.909+0000 7f4ec053d640 1 --2- 172.21.15.2:0/169791460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4eb8102570 0x7f4eb8198920 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:22.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.909+0000 7f4ec053d640 1 --2- 172.21.15.2:0/169791460 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f4ea40a34d0 0x7f4ea40a5990 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:22.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.909+0000 7f4ec053d640 1 --2- 172.21.15.2:0/169791460 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4eb8100e20 0x7f4eb81983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:22.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.909+0000 7f4ec053d640 1 -- 172.21.15.2:0/169791460 >> 172.21.15.2:0/169791460 conn(0x7f4eb80fc7d0 msgr2=0x7f4eb806a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:49:22.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.910+0000 7f4ec053d640 1 -- 172.21.15.2:0/169791460 shutdown_connections 2024-09-19T04:49:22.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:22.910+0000 7f4ec053d640 1 -- 172.21.15.2:0/169791460 wait complete. 2024-09-19T04:49:23.477 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:49:23 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/169791460' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:49:23.507 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:49:23.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:49:23 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/169791460' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:49:23.767 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:49:23.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:49:23 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/169791460' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:49:24.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.212+0000 7f435c748640 1 -- 172.21.15.2:0/234573235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4354103740 msgr2=0x7f4354107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:24.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.212+0000 7f435c748640 1 --2- 172.21.15.2:0/234573235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4354103740 0x7f4354107b80 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f4348009930 tx=0x7f434802a420 comp rx=0 tx=0).stop 2024-09-19T04:49:24.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.212+0000 7f435c748640 1 -- 172.21.15.2:0/234573235 shutdown_connections 2024-09-19T04:49:24.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.212+0000 7f435c748640 1 --2- 172.21.15.2:0/234573235 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4354108290 0x7f435410ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:24.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.212+0000 7f435c748640 1 --2- 172.21.15.2:0/234573235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4354103740 0x7f4354107b80 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:24.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.212+0000 7f435c748640 1 --2- 172.21.15.2:0/234573235 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4354102d90 0x7f4354103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:24.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.212+0000 7f435c748640 1 -- 172.21.15.2:0/234573235 >> 172.21.15.2:0/234573235 conn(0x7f43540fc7d0 msgr2=0x7f43540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:49:24.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.212+0000 7f435c748640 1 -- 172.21.15.2:0/234573235 shutdown_connections 2024-09-19T04:49:24.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.212+0000 7f435c748640 1 -- 172.21.15.2:0/234573235 wait complete. 2024-09-19T04:49:24.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.212+0000 7f435c748640 1 Processor -- start 2024-09-19T04:49:24.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.213+0000 7f435c748640 1 -- start start 2024-09-19T04:49:24.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.213+0000 7f435c748640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4354102d90 0x7f4354198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:24.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.213+0000 7f435c748640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4354103740 0x7f4354198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:24.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.213+0000 7f435c748640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4354108290 0x7f435419cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:24.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.213+0000 7f435c748640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4354111fe0 con 0x7f4354102d90 2024-09-19T04:49:24.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.213+0000 7f435c748640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4354111e60 con 0x7f4354108290 2024-09-19T04:49:24.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.213+0000 7f435c748640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f4354112160 con 0x7f4354103740 2024-09-19T04:49:24.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.213+0000 7f435a4e4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4354102d90 0x7f4354198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:24.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.213+0000 7f435a4e4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4354102d90 0x7f4354198640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45082/0 (socket says 172.21.15.2:45082) 2024-09-19T04:49:24.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.213+0000 7f435a4e4640 1 -- 172.21.15.2:0/594583062 learned_addr learned my addr 172.21.15.2:0/594583062 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:49:24.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.213+0000 7f4359ce3640 1 --2- 172.21.15.2:0/594583062 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4354103740 0x7f4354198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:24.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.213+0000 7f435ace5640 1 --2- 172.21.15.2:0/594583062 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4354108290 0x7f435419cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:24.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.213+0000 7f435a4e4640 1 -- 172.21.15.2:0/594583062 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4354103740 msgr2=0x7f4354198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:24.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.213+0000 7f435a4e4640 1 --2- 172.21.15.2:0/594583062 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4354103740 0x7f4354198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:24.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.213+0000 7f435a4e4640 1 -- 172.21.15.2:0/594583062 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4354108290 msgr2=0x7f435419cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:24.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.213+0000 7f435a4e4640 1 --2- 172.21.15.2:0/594583062 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4354108290 0x7f435419cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:24.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.213+0000 7f435a4e4640 1 -- 172.21.15.2:0/594583062 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f435419d5f0 con 0x7f4354102d90 2024-09-19T04:49:24.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.213+0000 7f435ace5640 1 --2- 172.21.15.2:0/594583062 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4354108290 0x7f435419cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:49:24.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.214+0000 7f435a4e4640 1 --2- 172.21.15.2:0/594583062 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4354102d90 0x7f4354198640 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f434c00b4a0 tx=0x7f434c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:49:24.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.214+0000 7f43537fe640 1 -- 172.21.15.2:0/594583062 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f434c014070 con 0x7f4354102d90 2024-09-19T04:49:24.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.214+0000 7f43537fe640 1 -- 172.21.15.2:0/594583062 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f434c010ac0 con 0x7f4354102d90 2024-09-19T04:49:24.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.214+0000 7f435c748640 1 -- 172.21.15.2:0/594583062 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f435419d8e0 con 0x7f4354102d90 2024-09-19T04:49:24.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.214+0000 7f43537fe640 1 -- 172.21.15.2:0/594583062 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f434c017c30 con 0x7f4354102d90 2024-09-19T04:49:24.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.214+0000 7f435c748640 1 -- 172.21.15.2:0/594583062 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43541a51c0 con 0x7f4354102d90 2024-09-19T04:49:24.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.216+0000 7f43537fe640 1 -- 172.21.15.2:0/594583062 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 24) ==== 138587+0+0 (secure 0 0 0) 0x7f434c017070 con 0x7f4354102d90 2024-09-19T04:49:24.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.217+0000 7f435eb21740 1 Processor -- start 2024-09-19T04:49:24.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.217+0000 7f435eb21740 1 -- start start 2024-09-19T04:49:24.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.217+0000 7f435eb21740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604ac366b40 0x5604ac365090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:24.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.217+0000 7f435eb21740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5604ac3655d0 0x5604ac365a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:24.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.217+0000 7f435eb21740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604ac370370 0x5604ac372760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:24.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.217+0000 7f435eb21740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5604ac2cb2f0 con 0x5604ac366b40 2024-09-19T04:49:24.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.217+0000 7f435eb21740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5604ac272cf0 con 0x5604ac370370 2024-09-19T04:49:24.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.217+0000 7f435eb21740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5604ac2c72b0 con 0x5604ac3655d0 2024-09-19T04:49:24.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.217+0000 7f435ace5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604ac366b40 0x5604ac365090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:24.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.217+0000 7f435ace5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604ac366b40 0x5604ac365090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45096/0 (socket says 172.21.15.2:45096) 2024-09-19T04:49:24.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.217+0000 7f435ace5640 1 -- 172.21.15.2:0/2868928066 learned_addr learned my addr 172.21.15.2:0/2868928066 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:49:24.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.217+0000 7f435a4e4640 1 --2- 172.21.15.2:0/2868928066 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5604ac3655d0 0x5604ac365a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:24.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.218+0000 7f4359ce3640 1 --2- 172.21.15.2:0/2868928066 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604ac370370 0x5604ac372760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:24.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.218+0000 7f43537fe640 1 --2- 172.21.15.2:0/594583062 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f433c0a34d0 0x7f433c0a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:24.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.218+0000 7f435ace5640 1 -- 172.21.15.2:0/2868928066 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5604ac3655d0 msgr2=0x5604ac365a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:49:24.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.218+0000 7f435ace5640 1 --2- 172.21.15.2:0/2868928066 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5604ac3655d0 0x5604ac365a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:24.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.218+0000 7f435ace5640 1 -- 172.21.15.2:0/2868928066 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604ac370370 msgr2=0x5604ac372760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:49:24.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.218+0000 7f435ace5640 1 --2- 172.21.15.2:0/2868928066 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604ac370370 0x5604ac372760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:24.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.218+0000 7f435ace5640 1 -- 172.21.15.2:0/2868928066 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604ac2573a0 con 0x5604ac366b40 2024-09-19T04:49:24.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.218+0000 7f43537fe640 1 -- 172.21.15.2:0/594583062 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f434c0cf580 con 0x7f4354102d90 2024-09-19T04:49:24.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.218+0000 7f435ace5640 1 --2- 172.21.15.2:0/594583062 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f433c0a34d0 0x7f433c0a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:24.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.218+0000 7f435ace5640 1 --2- 172.21.15.2:0/2868928066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604ac366b40 0x5604ac365090 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f434400c550 tx=0x7f434400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9952ea11bfc14805 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:49:24.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.218+0000 7f4350ff9640 1 -- 172.21.15.2:0/2868928066 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f434400a600 con 0x5604ac366b40 2024-09-19T04:49:24.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.218+0000 7f4350ff9640 1 -- 172.21.15.2:0/2868928066 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f434400ac50 con 0x5604ac366b40 2024-09-19T04:49:24.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.218+0000 7f4350ff9640 1 -- 172.21.15.2:0/2868928066 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4344017940 con 0x5604ac366b40 2024-09-19T04:49:24.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.218+0000 7f435ace5640 1 --2- 172.21.15.2:0/594583062 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f433c0a34d0 0x7f433c0a5990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f434401f000 tx=0x7f4344018000 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:49:24.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.219+0000 7f435eb21740 1 -- 172.21.15.2:0/2868928066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604ac366b40 msgr2=0x5604ac365090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:24.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.219+0000 7f435eb21740 1 --2- 172.21.15.2:0/2868928066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604ac366b40 0x5604ac365090 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f434400c550 tx=0x7f434400ca10 comp rx=0 tx=0).stop 2024-09-19T04:49:24.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.219+0000 7f435eb21740 1 -- 172.21.15.2:0/2868928066 shutdown_connections 2024-09-19T04:49:24.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.219+0000 7f435eb21740 1 --2- 172.21.15.2:0/2868928066 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604ac370370 0x5604ac372760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:24.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.219+0000 7f435eb21740 1 --2- 172.21.15.2:0/2868928066 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5604ac3655d0 0x5604ac365a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:24.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.219+0000 7f435eb21740 1 --2- 172.21.15.2:0/2868928066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604ac366b40 0x5604ac365090 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:24.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.219+0000 7f435eb21740 1 -- 172.21.15.2:0/2868928066 >> 172.21.15.2:0/2868928066 conn(0x5604ac32e310 msgr2=0x5604ac361c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:49:24.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.219+0000 7f435eb21740 1 -- 172.21.15.2:0/2868928066 shutdown_connections 2024-09-19T04:49:24.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.219+0000 7f435eb21740 1 -- 172.21.15.2:0/2868928066 wait complete. 2024-09-19T04:49:24.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.220+0000 7f435eb21740 1 -- start start 2024-09-19T04:49:24.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.220+0000 7f435eb21740 1 Processor -- start 2024-09-19T04:49:24.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.220+0000 7f435eb21740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604ac3655d0 0x5604ac36fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:24.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.220+0000 7f435eb21740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5604ac366b40 0x5604ac36d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:24.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.220+0000 7f435eb21740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604ac370370 0x5604ac36d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:24.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.220+0000 7f435eb21740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5604ac373070 con 0x5604ac3655d0 2024-09-19T04:49:24.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.220+0000 7f435eb21740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5604ac286060 con 0x5604ac370370 2024-09-19T04:49:24.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.220+0000 7f435eb21740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5604ac3731f0 con 0x5604ac366b40 2024-09-19T04:49:24.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.220+0000 7f435eb21740 10 client.0 _ll_register_callbacks cb 0x5604abfd98c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:49:24.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.220+0000 7f435a4e4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604ac3655d0 0x5604ac36fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:24.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.220+0000 7f435a4e4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604ac3655d0 0x5604ac36fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45100/0 (socket says 172.21.15.2:45100) 2024-09-19T04:49:24.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.220+0000 7f435a4e4640 1 -- 172.21.15.2:0/2856633685 learned_addr learned my addr 172.21.15.2:0/2856633685 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:49:24.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.220+0000 7f4359ce3640 1 --2- 172.21.15.2:0/2856633685 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5604ac366b40 0x5604ac36d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:24.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.221+0000 7f435ace5640 1 --2- 172.21.15.2:0/2856633685 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604ac370370 0x5604ac36d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:24.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.221+0000 7f435a4e4640 1 -- 172.21.15.2:0/2856633685 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5604ac366b40 msgr2=0x5604ac36d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:49:24.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.221+0000 7f435a4e4640 1 --2- 172.21.15.2:0/2856633685 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5604ac366b40 0x5604ac36d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:24.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.221+0000 7f435a4e4640 1 -- 172.21.15.2:0/2856633685 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604ac370370 msgr2=0x5604ac36d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:49:24.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.221+0000 7f435a4e4640 1 --2- 172.21.15.2:0/2856633685 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604ac370370 0x5604ac36d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:24.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.221+0000 7f435a4e4640 1 -- 172.21.15.2:0/2856633685 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604ac03c3c0 con 0x5604ac3655d0 2024-09-19T04:49:24.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.221+0000 7f4359ce3640 1 --2- 172.21.15.2:0/2856633685 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5604ac366b40 0x5604ac36d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:49:24.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.221+0000 7f435ace5640 1 --2- 172.21.15.2:0/2856633685 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604ac370370 0x5604ac36d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:49:24.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.221+0000 7f435a4e4640 1 --2- 172.21.15.2:0/2856633685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604ac3655d0 0x5604ac36fda0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f434c098110 tx=0x7f434c017420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=376198cbf3674b13 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:49:24.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.221+0000 7f4339ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:49:24.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.221+0000 7f4339ffb640 1 -- 172.21.15.2:0/2856633685 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f434c01e070 con 0x5604ac3655d0 2024-09-19T04:49:24.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.221+0000 7f4339ffb640 1 -- 172.21.15.2:0/2856633685 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f434c010c70 con 0x5604ac3655d0 2024-09-19T04:49:24.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.221+0000 7f435eb21740 1 -- 172.21.15.2:0/2856633685 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f434400ac50 con 0x5604ac3655d0 2024-09-19T04:49:24.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.221+0000 7f4339ffb640 1 -- 172.21.15.2:0/2856633685 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f434c09b0a0 con 0x5604ac3655d0 2024-09-19T04:49:24.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.221+0000 7f435eb21740 10 client.15396 fetch_fsmap learned FSMap version 19 2024-09-19T04:49:24.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.221+0000 7f435eb21740 1 -- 172.21.15.2:0/2856633685 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5604ac37ebb0 con 0x5604ac3655d0 2024-09-19T04:49:24.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.221+0000 7f4339ffb640 1 -- 172.21.15.2:0/2856633685 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f434400ac50 con 0x5604ac3655d0 2024-09-19T04:49:24.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.221+0000 7f4339ffb640 1 -- 172.21.15.2:0/2856633685 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f434c0a3f20 con 0x5604ac3655d0 2024-09-19T04:49:24.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.222+0000 7f435eb21740 10 client.15396 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:49:24.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.222+0000 7f435eb21740 10 client.15396 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:49:24.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.222+0000 7f435eb21740 20 client.15396 populate_metadata read hostname 'smithi002' 2024-09-19T04:49:24.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.222+0000 7f435eb21740 1 --2- 172.21.15.2:0/2856633685 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5604ac37ffc0 0x5604ac3823b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:24.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.222+0000 7f435eb21740 4 client.15396 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:49:24.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.222+0000 7f435eb21740 1 -- 172.21.15.2:0/2856633685 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604ac2d8860 con 0x5604ac37ffc0 2024-09-19T04:49:24.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.222+0000 7f4359ce3640 1 --2- 172.21.15.2:0/2856633685 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5604ac37ffc0 0x5604ac3823b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:24.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.222+0000 7f4359ce3640 1 --2- 172.21.15.2:0/2856633685 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5604ac37ffc0 0x5604ac3823b0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43c1b78fb6eeca14 server_cookie=5ae705467e7bbc2 in_seq=0 out_seq=0 2024-09-19T04:49:24.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.222+0000 7f4339ffb640 10 client.15396 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:49:24.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.223+0000 7f4339ffb640 1 -- 172.21.15.2:0/2856633685 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5604ac2d8860 con 0x5604ac37ffc0 2024-09-19T04:49:24.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.223+0000 7f4339ffb640 10 client.15396 handle_command_reply: tid=0 2024-09-19T04:49:24.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.223+0000 7f435eb21740 1 client.15396 shutdown 2024-09-19T04:49:24.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.223+0000 7f435eb21740 1 -- 172.21.15.2:0/2856633685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604ac3655d0 msgr2=0x5604ac36fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:24.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.223+0000 7f435eb21740 1 --2- 172.21.15.2:0/2856633685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604ac3655d0 0x5604ac36fda0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f434c098110 tx=0x7f434c017420 comp rx=0 tx=0).stop 2024-09-19T04:49:24.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.223+0000 7f435eb21740 1 -- 172.21.15.2:0/2856633685 shutdown_connections 2024-09-19T04:49:24.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.223+0000 7f435eb21740 1 --2- 172.21.15.2:0/2856633685 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604ac370370 0x5604ac36d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:24.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.223+0000 7f435eb21740 1 --2- 172.21.15.2:0/2856633685 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5604ac37ffc0 0x5604ac3823b0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:24.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.223+0000 7f4339ffb640 0 client.15396 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:49:24.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.223+0000 7f435eb21740 1 --2- 172.21.15.2:0/2856633685 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5604ac366b40 0x5604ac36d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:24.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.223+0000 7f435eb21740 1 --2- 172.21.15.2:0/2856633685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604ac3655d0 0x5604ac36fda0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:24.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.223+0000 7f435eb21740 1 -- 172.21.15.2:0/2856633685 >> 172.21.15.2:0/2856633685 conn(0x5604ac32e310 msgr2=0x5604ac367960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:49:24.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.223+0000 7f435eb21740 1 -- 172.21.15.2:0/2856633685 shutdown_connections 2024-09-19T04:49:24.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.223+0000 7f435eb21740 1 -- 172.21.15.2:0/2856633685 wait complete. 2024-09-19T04:49:24.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.223+0000 7f435eb21740 20 client.15396 trim_cache size 0 max 16384 2024-09-19T04:49:24.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.236+0000 7f435eb21740 1 Processor -- start 2024-09-19T04:49:24.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.236+0000 7f435eb21740 1 -- start start 2024-09-19T04:49:24.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.236+0000 7f435eb21740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5604ac3655d0 0x5604ac37ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:24.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.236+0000 7f435eb21740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604ac366b40 0x5604ac37bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:24.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.236+0000 7f435eb21740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604ac370370 0x5604ac368120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:24.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.236+0000 7f435eb21740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f43541ab8d0 con 0x5604ac370370 2024-09-19T04:49:24.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.236+0000 7f435eb21740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f43541ae150 con 0x5604ac366b40 2024-09-19T04:49:24.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.236+0000 7f435eb21740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f43541abf40 con 0x5604ac3655d0 2024-09-19T04:49:24.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.237+0000 7f435ace5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604ac370370 0x5604ac368120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:24.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.237+0000 7f435ace5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604ac370370 0x5604ac368120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45112/0 (socket says 172.21.15.2:45112) 2024-09-19T04:49:24.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.237+0000 7f435ace5640 1 -- 172.21.15.2:0/1461994181 learned_addr learned my addr 172.21.15.2:0/1461994181 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:49:24.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.237+0000 7f4359ce3640 1 --2- 172.21.15.2:0/1461994181 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604ac366b40 0x5604ac37bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:24.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.237+0000 7f435a4e4640 1 --2- 172.21.15.2:0/1461994181 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5604ac3655d0 0x5604ac37ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:24.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.237+0000 7f435ace5640 1 -- 172.21.15.2:0/1461994181 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5604ac3655d0 msgr2=0x5604ac37ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:49:24.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.237+0000 7f435ace5640 1 --2- 172.21.15.2:0/1461994181 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5604ac3655d0 0x5604ac37ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:24.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.237+0000 7f435ace5640 1 -- 172.21.15.2:0/1461994181 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604ac366b40 msgr2=0x5604ac37bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:49:24.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.237+0000 7f435ace5640 1 --2- 172.21.15.2:0/1461994181 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604ac366b40 0x5604ac37bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:24.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.237+0000 7f435ace5640 1 -- 172.21.15.2:0/1461994181 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604ac382990 con 0x5604ac370370 2024-09-19T04:49:24.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.237+0000 7f435ace5640 1 --2- 172.21.15.2:0/1461994181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604ac370370 0x5604ac368120 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f4344009830 tx=0x7f4344009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed2e4b744001f0f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:49:24.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.237+0000 7f433bfff640 1 -- 172.21.15.2:0/1461994181 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4344017e10 con 0x5604ac370370 2024-09-19T04:49:24.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.237+0000 7f433bfff640 1 -- 172.21.15.2:0/1461994181 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f434400c270 con 0x5604ac370370 2024-09-19T04:49:24.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.237+0000 7f433bfff640 1 -- 172.21.15.2:0/1461994181 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43440237a0 con 0x5604ac370370 2024-09-19T04:49:24.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.238+0000 7f435eb21740 1 -- 172.21.15.2:0/1461994181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604ac370370 msgr2=0x5604ac368120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:24.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.238+0000 7f435eb21740 1 --2- 172.21.15.2:0/1461994181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604ac370370 0x5604ac368120 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f4344009830 tx=0x7f4344009b20 comp rx=0 tx=0).stop 2024-09-19T04:49:24.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.238+0000 7f435eb21740 1 -- 172.21.15.2:0/1461994181 shutdown_connections 2024-09-19T04:49:24.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.238+0000 7f435eb21740 1 --2- 172.21.15.2:0/1461994181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604ac370370 0x5604ac368120 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:24.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.238+0000 7f435eb21740 1 --2- 172.21.15.2:0/1461994181 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604ac366b40 0x5604ac37bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:24.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.238+0000 7f435eb21740 1 --2- 172.21.15.2:0/1461994181 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5604ac3655d0 0x5604ac37ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:24.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.238+0000 7f435eb21740 1 -- 172.21.15.2:0/1461994181 >> 172.21.15.2:0/1461994181 conn(0x5604ac32e310 msgr2=0x5604ac37b300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:49:24.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.238+0000 7f435eb21740 1 -- 172.21.15.2:0/1461994181 shutdown_connections 2024-09-19T04:49:24.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.238+0000 7f435eb21740 1 -- 172.21.15.2:0/1461994181 wait complete. 2024-09-19T04:49:24.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.238+0000 7f435eb21740 1 -- start start 2024-09-19T04:49:24.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.238+0000 7f435eb21740 1 Processor -- start 2024-09-19T04:49:24.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.239+0000 7f435eb21740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5604ac3655d0 0x5604ac369fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:24.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.239+0000 7f435eb21740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604ac366b40 0x5604ac36a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:24.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.239+0000 7f435eb21740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604ac370370 0x5604ac36aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:24.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.239+0000 7f435eb21740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f43541ac610 con 0x5604ac366b40 2024-09-19T04:49:24.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.239+0000 7f435eb21740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f43541ada80 con 0x5604ac370370 2024-09-19T04:49:24.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.239+0000 7f435eb21740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f43541acce0 con 0x5604ac3655d0 2024-09-19T04:49:24.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.239+0000 7f435eb21740 10 client.0 _ll_register_callbacks cb 0x7f434c097370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:49:24.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.239+0000 7f4359ce3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604ac366b40 0x5604ac36a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:24.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.239+0000 7f4359ce3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604ac366b40 0x5604ac36a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45122/0 (socket says 172.21.15.2:45122) 2024-09-19T04:49:24.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.239+0000 7f4359ce3640 1 -- 172.21.15.2:0/1391863163 learned_addr learned my addr 172.21.15.2:0/1391863163 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:49:24.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.239+0000 7f435ace5640 1 --2- 172.21.15.2:0/1391863163 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604ac370370 0x5604ac36aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:24.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.239+0000 7f435a4e4640 1 --2- 172.21.15.2:0/1391863163 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5604ac3655d0 0x5604ac369fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:24.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.239+0000 7f4359ce3640 1 -- 172.21.15.2:0/1391863163 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5604ac3655d0 msgr2=0x5604ac369fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:49:24.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.239+0000 7f4359ce3640 1 --2- 172.21.15.2:0/1391863163 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5604ac3655d0 0x5604ac369fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:24.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.239+0000 7f4359ce3640 1 -- 172.21.15.2:0/1391863163 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604ac370370 msgr2=0x5604ac36aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:49:24.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.239+0000 7f4359ce3640 1 --2- 172.21.15.2:0/1391863163 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604ac370370 0x5604ac36aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:24.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.239+0000 7f4359ce3640 1 -- 172.21.15.2:0/1391863163 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604ac3e9b90 con 0x5604ac366b40 2024-09-19T04:49:24.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.239+0000 7f4359ce3640 1 --2- 172.21.15.2:0/1391863163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604ac366b40 0x5604ac36a510 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f4348009900 tx=0x7f43480041f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6be851b512f8f440 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:49:24.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.239+0000 7f4339ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:49:24.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.239+0000 7f4339ffb640 1 -- 172.21.15.2:0/1391863163 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4348035040 con 0x5604ac366b40 2024-09-19T04:49:24.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.239+0000 7f4339ffb640 1 -- 172.21.15.2:0/1391863163 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f4348005240 con 0x5604ac366b40 2024-09-19T04:49:24.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.240+0000 7f435eb21740 1 -- 172.21.15.2:0/1391863163 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f434400c270 con 0x5604ac366b40 2024-09-19T04:49:24.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.240+0000 7f4339ffb640 1 -- 172.21.15.2:0/1391863163 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4348055050 con 0x5604ac366b40 2024-09-19T04:49:24.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.240+0000 7f435eb21740 10 client.15402 fetch_fsmap learned FSMap version 19 2024-09-19T04:49:24.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.240+0000 7f435eb21740 1 -- 172.21.15.2:0/1391863163 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5604ac3ead90 con 0x5604ac366b40 2024-09-19T04:49:24.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.240+0000 7f4339ffb640 1 -- 172.21.15.2:0/1391863163 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f434400c270 con 0x5604ac366b40 2024-09-19T04:49:24.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.240+0000 7f4339ffb640 1 -- 172.21.15.2:0/1391863163 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f4348003680 con 0x5604ac366b40 2024-09-19T04:49:24.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.240+0000 7f435eb21740 10 client.15402 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:49:24.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.240+0000 7f435eb21740 10 client.15402 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:49:24.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.240+0000 7f435eb21740 20 client.15402 populate_metadata read hostname 'smithi002' 2024-09-19T04:49:24.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.240+0000 7f435eb21740 1 --2- 172.21.15.2:0/1391863163 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5604ac37ffc0 0x5604ac3ed5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:24.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.240+0000 7f435eb21740 4 client.15402 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:49:24.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.240+0000 7f435eb21740 1 -- 172.21.15.2:0/1391863163 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5604ac2d2d70 con 0x5604ac37ffc0 2024-09-19T04:49:24.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.240+0000 7f435a4e4640 1 --2- 172.21.15.2:0/1391863163 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5604ac37ffc0 0x5604ac3ed5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:24.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.241+0000 7f435a4e4640 1 --2- 172.21.15.2:0/1391863163 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5604ac37ffc0 0x5604ac3ed5d0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d42e7bf79ee2e62d server_cookie=450878ee4a560c34 in_seq=0 out_seq=0 2024-09-19T04:49:24.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.241+0000 7f4339ffb640 10 client.15402 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:49:24.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.241+0000 7f4339ffb640 1 -- 172.21.15.2:0/1391863163 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5604ac2d2d70 con 0x5604ac37ffc0 2024-09-19T04:49:24.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.241+0000 7f4339ffb640 10 client.15402 handle_command_reply: tid=0 2024-09-19T04:49:24.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.241+0000 7f435eb21740 1 client.15402 shutdown 2024-09-19T04:49:24.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.241+0000 7f435eb21740 1 -- 172.21.15.2:0/1391863163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604ac366b40 msgr2=0x5604ac36a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:24.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.241+0000 7f435eb21740 1 --2- 172.21.15.2:0/1391863163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604ac366b40 0x5604ac36a510 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f4348009900 tx=0x7f43480041f0 comp rx=0 tx=0).stop 2024-09-19T04:49:24.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.241+0000 7f435eb21740 1 -- 172.21.15.2:0/1391863163 shutdown_connections 2024-09-19T04:49:24.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.241+0000 7f435eb21740 1 --2- 172.21.15.2:0/1391863163 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604ac370370 0x5604ac36aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:24.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.241+0000 7f435eb21740 1 --2- 172.21.15.2:0/1391863163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604ac366b40 0x5604ac36a510 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:24.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.241+0000 7f435eb21740 1 --2- 172.21.15.2:0/1391863163 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5604ac37ffc0 0x5604ac3ed5d0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:24.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.241+0000 7f435eb21740 1 --2- 172.21.15.2:0/1391863163 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5604ac3655d0 0x5604ac369fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:24.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.241+0000 7f435eb21740 1 -- 172.21.15.2:0/1391863163 >> 172.21.15.2:0/1391863163 conn(0x5604ac32e310 msgr2=0x5604ac37bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:49:24.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.241+0000 7f4339ffb640 0 client.15402 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:49:24.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.241+0000 7f435eb21740 1 -- 172.21.15.2:0/1391863163 shutdown_connections 2024-09-19T04:49:24.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.241+0000 7f435eb21740 1 -- 172.21.15.2:0/1391863163 wait complete. 2024-09-19T04:49:24.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.241+0000 7f435eb21740 20 client.15402 trim_cache size 0 max 16384 2024-09-19T04:49:24.248 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T04:49:24.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.242+0000 7f435c748640 1 -- 172.21.15.2:0/594583062 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f433c0a34d0 msgr2=0x7f433c0a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:24.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.242+0000 7f435c748640 1 --2- 172.21.15.2:0/594583062 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f433c0a34d0 0x7f433c0a5990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f434401f000 tx=0x7f4344018000 comp rx=0 tx=0).stop 2024-09-19T04:49:24.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.242+0000 7f435c748640 1 -- 172.21.15.2:0/594583062 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4354102d90 msgr2=0x7f4354198640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:24.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.242+0000 7f435c748640 1 --2- 172.21.15.2:0/594583062 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4354102d90 0x7f4354198640 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f434c00b4a0 tx=0x7f434c00b960 comp rx=0 tx=0).stop 2024-09-19T04:49:24.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.242+0000 7f435c748640 1 -- 172.21.15.2:0/594583062 shutdown_connections 2024-09-19T04:49:24.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.242+0000 7f435c748640 1 --2- 172.21.15.2:0/594583062 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4354108290 0x7f435419cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:24.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.242+0000 7f435c748640 1 --2- 172.21.15.2:0/594583062 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f433c0a34d0 0x7f433c0a5990 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:24.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.242+0000 7f435c748640 1 --2- 172.21.15.2:0/594583062 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4354103740 0x7f4354198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:24.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.242+0000 7f435c748640 1 --2- 172.21.15.2:0/594583062 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4354102d90 0x7f4354198640 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:24.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.242+0000 7f435c748640 1 -- 172.21.15.2:0/594583062 >> 172.21.15.2:0/594583062 conn(0x7f43540fc7d0 msgr2=0x7f4354105eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:49:24.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.242+0000 7f435c748640 1 -- 172.21.15.2:0/594583062 shutdown_connections 2024-09-19T04:49:24.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:24.242+0000 7f435c748640 1 -- 172.21.15.2:0/594583062 wait complete. 2024-09-19T04:49:24.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:49:24 smithi002 ceph-mon[30975]: pgmap v45: 97 pgs: 97 active+clean; 1.4 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-09-19T04:49:24.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:49:24 smithi116 ceph-mon[34477]: pgmap v45: 97 pgs: 97 active+clean; 1.4 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-09-19T04:49:24.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:49:24 smithi018 ceph-mon[34537]: pgmap v45: 97 pgs: 97 active+clean; 1.4 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-09-19T04:49:25.959 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:49:25.960 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:49:26.231 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:49:26.597 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:49:26 smithi002 ceph-mon[30975]: pgmap v46: 97 pgs: 97 active+clean; 1.5 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 9 op/s 2024-09-19T04:49:26.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:49:26 smithi116 ceph-mon[34477]: pgmap v46: 97 pgs: 97 active+clean; 1.5 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 9 op/s 2024-09-19T04:49:26.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.682+0000 7f72f4b9c640 1 -- 172.21.15.2:0/3394631944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72f010c170 msgr2=0x7f72f010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:26.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.682+0000 7f72f4b9c640 1 --2- 172.21.15.2:0/3394631944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72f010c170 0x7f72f010e610 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f72e8009ca0 tx=0x7f72e802a950 comp rx=0 tx=0).stop 2024-09-19T04:49:26.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.682+0000 7f72f4b9c640 1 -- 172.21.15.2:0/3394631944 shutdown_connections 2024-09-19T04:49:26.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.682+0000 7f72f4b9c640 1 --2- 172.21.15.2:0/3394631944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72f010c170 0x7f72f010e610 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:26.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.682+0000 7f72f4b9c640 1 --2- 172.21.15.2:0/3394631944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72f0103660 0x7f72f010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:26.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.682+0000 7f72f4b9c640 1 --2- 172.21.15.2:0/3394631944 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f72f0102d40 0x7f72f0103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:26.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.682+0000 7f72f4b9c640 1 -- 172.21.15.2:0/3394631944 >> 172.21.15.2:0/3394631944 conn(0x7f72f00fc7a0 msgr2=0x7f72f00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:49:26.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.682+0000 7f72f4b9c640 1 -- 172.21.15.2:0/3394631944 shutdown_connections 2024-09-19T04:49:26.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.683+0000 7f72f4b9c640 1 -- 172.21.15.2:0/3394631944 wait complete. 2024-09-19T04:49:26.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.683+0000 7f72f4b9c640 1 Processor -- start 2024-09-19T04:49:26.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.683+0000 7f72f4b9c640 1 -- start start 2024-09-19T04:49:26.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.683+0000 7f72f4b9c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72f0102d40 0x7f72f01009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:26.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.684+0000 7f72f4b9c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72f0103660 0x7f72f0100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:26.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.684+0000 7f72f4b9c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f72f010c170 0x7f72f0101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:26.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.684+0000 7f72f4b9c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f72f0111e20 con 0x7f72f0102d40 2024-09-19T04:49:26.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.684+0000 7f72f4b9c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f72f0111ca0 con 0x7f72f0103660 2024-09-19T04:49:26.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.684+0000 7f72f4b9c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f72f0111fa0 con 0x7f72f010c170 2024-09-19T04:49:26.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.684+0000 7f72ee59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72f0102d40 0x7f72f01009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:26.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.684+0000 7f72ee59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72f0102d40 0x7f72f01009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45136/0 (socket says 172.21.15.2:45136) 2024-09-19T04:49:26.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.684+0000 7f72ee59c640 1 -- 172.21.15.2:0/3629219097 learned_addr learned my addr 172.21.15.2:0/3629219097 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:49:26.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.684+0000 7f72eed9d640 1 --2- 172.21.15.2:0/3629219097 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f72f010c170 0x7f72f0101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:26.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.684+0000 7f72e7fff640 1 --2- 172.21.15.2:0/3629219097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72f0103660 0x7f72f0100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:26.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.684+0000 7f72ee59c640 1 -- 172.21.15.2:0/3629219097 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f72f010c170 msgr2=0x7f72f0101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:26.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.684+0000 7f72ee59c640 1 --2- 172.21.15.2:0/3629219097 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f72f010c170 0x7f72f0101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:26.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.684+0000 7f72ee59c640 1 -- 172.21.15.2:0/3629219097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72f0103660 msgr2=0x7f72f0100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:26.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.684+0000 7f72ee59c640 1 --2- 172.21.15.2:0/3629219097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72f0103660 0x7f72f0100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:26.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.684+0000 7f72ee59c640 1 -- 172.21.15.2:0/3629219097 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f01a67c0 con 0x7f72f0102d40 2024-09-19T04:49:26.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.684+0000 7f72ee59c640 1 --2- 172.21.15.2:0/3629219097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72f0102d40 0x7f72f01009a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f72e000d950 tx=0x7f72e000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:49:26.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.684+0000 7f72e77fe640 1 -- 172.21.15.2:0/3629219097 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e0017070 con 0x7f72f0102d40 2024-09-19T04:49:26.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.684+0000 7f72e77fe640 1 -- 172.21.15.2:0/3629219097 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f72e0009c30 con 0x7f72f0102d40 2024-09-19T04:49:26.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.684+0000 7f72e77fe640 1 -- 172.21.15.2:0/3629219097 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e000f620 con 0x7f72f0102d40 2024-09-19T04:49:26.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.684+0000 7f72f4b9c640 1 -- 172.21.15.2:0/3629219097 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72f01a6ab0 con 0x7f72f0102d40 2024-09-19T04:49:26.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.684+0000 7f72f4b9c640 1 -- 172.21.15.2:0/3629219097 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72f01a6ff0 con 0x7f72f0102d40 2024-09-19T04:49:26.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.687+0000 7f72e77fe640 1 -- 172.21.15.2:0/3629219097 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 24) ==== 138587+0+0 (secure 0 0 0) 0x7f72e00109a0 con 0x7f72f0102d40 2024-09-19T04:49:26.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.687+0000 7f72f6f75740 1 Processor -- start 2024-09-19T04:49:26.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.687+0000 7f72f6f75740 1 -- start start 2024-09-19T04:49:26.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.687+0000 7f72f6f75740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e2ee152b60 0x55e2ee152f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:26.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.687+0000 7f72f6f75740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2ee153480 0x55e2ee15d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:26.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.688+0000 7f72f6f75740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e2ee15dd40 0x55e2ee160130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:26.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.688+0000 7f72f6f75740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e2ee0b8280 con 0x55e2ee153480 2024-09-19T04:49:26.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.688+0000 7f72f6f75740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e2ee05fb10 con 0x55e2ee15dd40 2024-09-19T04:49:26.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.688+0000 7f72f6f75740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55e2ee0b4240 con 0x55e2ee152b60 2024-09-19T04:49:26.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.688+0000 7f72ee59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2ee153480 0x55e2ee15d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:26.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.688+0000 7f72ee59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2ee153480 0x55e2ee15d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45138/0 (socket says 172.21.15.2:45138) 2024-09-19T04:49:26.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.688+0000 7f72eed9d640 1 --2- 172.21.15.2:0/2105875290 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e2ee152b60 0x55e2ee152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:26.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.688+0000 7f72ee59c640 1 -- 172.21.15.2:0/2105875290 learned_addr learned my addr 172.21.15.2:0/2105875290 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:49:26.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.688+0000 7f72e7fff640 1 --2- 172.21.15.2:0/2105875290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e2ee15dd40 0x55e2ee160130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:26.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.688+0000 7f72e77fe640 1 --2- 172.21.15.2:0/3629219097 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f72dc0a34d0 0x7f72dc0a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:26.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.688+0000 7f72ee59c640 1 -- 172.21.15.2:0/2105875290 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e2ee152b60 msgr2=0x55e2ee152f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:49:26.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.688+0000 7f72ee59c640 1 --2- 172.21.15.2:0/2105875290 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e2ee152b60 0x55e2ee152f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:26.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.688+0000 7f72ee59c640 1 -- 172.21.15.2:0/2105875290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e2ee15dd40 msgr2=0x55e2ee160130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:49:26.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.688+0000 7f72ee59c640 1 --2- 172.21.15.2:0/2105875290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e2ee15dd40 0x55e2ee160130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:26.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.688+0000 7f72ee59c640 1 -- 172.21.15.2:0/2105875290 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2ee06c1f0 con 0x55e2ee153480 2024-09-19T04:49:26.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.688+0000 7f72e7fff640 1 --2- 172.21.15.2:0/2105875290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e2ee15dd40 0x55e2ee160130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:49:26.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.688+0000 7f72eed9d640 1 --2- 172.21.15.2:0/3629219097 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f72dc0a34d0 0x7f72dc0a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:26.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.688+0000 7f72e77fe640 1 -- 172.21.15.2:0/3629219097 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f72e00cfcb0 con 0x7f72f0102d40 2024-09-19T04:49:26.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.689+0000 7f72ee59c640 1 --2- 172.21.15.2:0/2105875290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2ee153480 0x55e2ee15d800 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f72e00cd3b0 tx=0x7f72e0022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bb108be98a7a8dd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:49:26.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.689+0000 7f72e4ff9640 1 -- 172.21.15.2:0/2105875290 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e009b6c0 con 0x55e2ee153480 2024-09-19T04:49:26.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.689+0000 7f72eed9d640 1 --2- 172.21.15.2:0/3629219097 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f72dc0a34d0 0x7f72dc0a5990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f72e8004af0 tx=0x7f72e80095c0 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:49:26.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.689+0000 7f72e4ff9640 1 -- 172.21.15.2:0/2105875290 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f72e0009de0 con 0x55e2ee153480 2024-09-19T04:49:26.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.689+0000 7f72e4ff9640 1 -- 172.21.15.2:0/2105875290 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e00a0110 con 0x55e2ee153480 2024-09-19T04:49:26.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.689+0000 7f72f6f75740 1 -- 172.21.15.2:0/2105875290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2ee153480 msgr2=0x55e2ee15d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:26.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.689+0000 7f72f6f75740 1 --2- 172.21.15.2:0/2105875290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2ee153480 0x55e2ee15d800 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f72e00cd3b0 tx=0x7f72e0022000 comp rx=0 tx=0).stop 2024-09-19T04:49:26.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.690+0000 7f72f6f75740 1 -- 172.21.15.2:0/2105875290 shutdown_connections 2024-09-19T04:49:26.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.690+0000 7f72f6f75740 1 --2- 172.21.15.2:0/2105875290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e2ee15dd40 0x55e2ee160130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:26.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.690+0000 7f72f6f75740 1 --2- 172.21.15.2:0/2105875290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2ee153480 0x55e2ee15d800 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:26.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.690+0000 7f72f6f75740 1 --2- 172.21.15.2:0/2105875290 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e2ee152b60 0x55e2ee152f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:26.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.690+0000 7f72f6f75740 1 -- 172.21.15.2:0/2105875290 >> 172.21.15.2:0/2105875290 conn(0x55e2ee14f0f0 msgr2=0x55e2ee14f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:49:26.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.690+0000 7f72f6f75740 1 -- 172.21.15.2:0/2105875290 shutdown_connections 2024-09-19T04:49:26.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.690+0000 7f72f6f75740 1 -- 172.21.15.2:0/2105875290 wait complete. 2024-09-19T04:49:26.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.690+0000 7f72f6f75740 1 -- start start 2024-09-19T04:49:26.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.690+0000 7f72f6f75740 1 Processor -- start 2024-09-19T04:49:26.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.690+0000 7f72f6f75740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e2ee152b60 0x55e2ee15d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:26.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.690+0000 7f72f6f75740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2ee153480 0x55e2ee15ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:26.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.690+0000 7f72f6f75740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e2ee15dd40 0x55e2ee15b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:26.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.690+0000 7f72f6f75740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e2ee1608b0 con 0x55e2ee153480 2024-09-19T04:49:26.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.690+0000 7f72f6f75740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e2ee072f10 con 0x55e2ee15dd40 2024-09-19T04:49:26.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.690+0000 7f72f6f75740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55e2ee160a30 con 0x55e2ee152b60 2024-09-19T04:49:26.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.690+0000 7f72f6f75740 10 client.0 _ll_register_callbacks cb 0x55e2ee03ba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:49:26.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.691+0000 7f72e7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2ee153480 0x55e2ee15ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:26.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.691+0000 7f72e7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2ee153480 0x55e2ee15ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45142/0 (socket says 172.21.15.2:45142) 2024-09-19T04:49:26.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.691+0000 7f72e7fff640 1 -- 172.21.15.2:0/3107313955 learned_addr learned my addr 172.21.15.2:0/3107313955 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:49:26.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.691+0000 7f72ee59c640 1 --2- 172.21.15.2:0/3107313955 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e2ee152b60 0x55e2ee15d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:26.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.691+0000 7f72eed9d640 1 --2- 172.21.15.2:0/3107313955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e2ee15dd40 0x55e2ee15b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:26.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.691+0000 7f72e7fff640 1 -- 172.21.15.2:0/3107313955 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e2ee152b60 msgr2=0x55e2ee15d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:49:26.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.691+0000 7f72e7fff640 1 --2- 172.21.15.2:0/3107313955 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e2ee152b60 0x55e2ee15d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:26.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.691+0000 7f72e7fff640 1 -- 172.21.15.2:0/3107313955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e2ee15dd40 msgr2=0x55e2ee15b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:49:26.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.691+0000 7f72e7fff640 1 --2- 172.21.15.2:0/3107313955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e2ee15dd40 0x55e2ee15b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:26.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.691+0000 7f72e7fff640 1 -- 172.21.15.2:0/3107313955 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2ede296a0 con 0x55e2ee153480 2024-09-19T04:49:26.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.691+0000 7f72eed9d640 1 --2- 172.21.15.2:0/3107313955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e2ee15dd40 0x55e2ee15b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:49:26.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.691+0000 7f72e7fff640 1 --2- 172.21.15.2:0/3107313955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2ee153480 0x55e2ee15ab50 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f72d800bea0 tx=0x7f72d800bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c2cbac66882e59d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:49:26.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.691+0000 7f72d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:49:26.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.691+0000 7f72d5ffb640 1 -- 172.21.15.2:0/3107313955 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d8004440 con 0x55e2ee153480 2024-09-19T04:49:26.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.691+0000 7f72d5ffb640 1 -- 172.21.15.2:0/3107313955 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f72d80035f0 con 0x55e2ee153480 2024-09-19T04:49:26.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.691+0000 7f72f6f75740 1 -- 172.21.15.2:0/3107313955 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72e0009de0 con 0x55e2ee153480 2024-09-19T04:49:26.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.691+0000 7f72d5ffb640 1 -- 172.21.15.2:0/3107313955 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f72d80037f0 con 0x55e2ee153480 2024-09-19T04:49:26.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.691+0000 7f72f6f75740 10 client.15414 fetch_fsmap learned FSMap version 19 2024-09-19T04:49:26.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.691+0000 7f72f6f75740 1 -- 172.21.15.2:0/3107313955 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55e2ee16c470 con 0x55e2ee153480 2024-09-19T04:49:26.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.692+0000 7f72d5ffb640 1 -- 172.21.15.2:0/3107313955 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f72e0009de0 con 0x55e2ee153480 2024-09-19T04:49:26.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.692+0000 7f72d5ffb640 1 -- 172.21.15.2:0/3107313955 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f72d8022070 con 0x55e2ee153480 2024-09-19T04:49:26.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.692+0000 7f72f6f75740 10 client.15414 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:49:26.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.692+0000 7f72f6f75740 10 client.15414 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:49:26.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.692+0000 7f72f6f75740 20 client.15414 populate_metadata read hostname 'smithi002' 2024-09-19T04:49:26.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.692+0000 7f72f6f75740 1 --2- 172.21.15.2:0/3107313955 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55e2ee16d9d0 0x55e2ee16fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:26.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.692+0000 7f72f6f75740 4 client.15414 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:49:26.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.692+0000 7f72f6f75740 1 -- 172.21.15.2:0/3107313955 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e2ee0c57f0 con 0x55e2ee16d9d0 2024-09-19T04:49:26.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.692+0000 7f72ee59c640 1 --2- 172.21.15.2:0/3107313955 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55e2ee16d9d0 0x55e2ee16fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:26.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.693+0000 7f72ee59c640 1 --2- 172.21.15.2:0/3107313955 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55e2ee16d9d0 0x55e2ee16fdf0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1bd97c415773cda7 server_cookie=1d292d79002c6f8a in_seq=0 out_seq=0 2024-09-19T04:49:26.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.693+0000 7f72d5ffb640 10 client.15414 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:49:26.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.693+0000 7f72d5ffb640 1 -- 172.21.15.2:0/3107313955 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e2ee0c57f0 con 0x55e2ee16d9d0 2024-09-19T04:49:26.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.693+0000 7f72d5ffb640 10 client.15414 handle_command_reply: tid=0 2024-09-19T04:49:26.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.693+0000 7f72f6f75740 1 client.15414 shutdown 2024-09-19T04:49:26.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.693+0000 7f72f6f75740 1 -- 172.21.15.2:0/3107313955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2ee153480 msgr2=0x55e2ee15ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:26.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.693+0000 7f72f6f75740 1 --2- 172.21.15.2:0/3107313955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2ee153480 0x55e2ee15ab50 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f72d800bea0 tx=0x7f72d800bf90 comp rx=0 tx=0).stop 2024-09-19T04:49:26.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.693+0000 7f72f6f75740 1 -- 172.21.15.2:0/3107313955 shutdown_connections 2024-09-19T04:49:26.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.693+0000 7f72f6f75740 1 --2- 172.21.15.2:0/3107313955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e2ee15dd40 0x55e2ee15b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:26.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.693+0000 7f72f6f75740 1 --2- 172.21.15.2:0/3107313955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2ee153480 0x55e2ee15ab50 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:26.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.693+0000 7f72f6f75740 1 --2- 172.21.15.2:0/3107313955 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55e2ee16d9d0 0x55e2ee16fdf0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:26.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.693+0000 7f72d5ffb640 0 client.15414 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:49:26.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.693+0000 7f72f6f75740 1 --2- 172.21.15.2:0/3107313955 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e2ee152b60 0x55e2ee15d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:26.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.693+0000 7f72f6f75740 1 -- 172.21.15.2:0/3107313955 >> 172.21.15.2:0/3107313955 conn(0x55e2ee14f0f0 msgr2=0x55e2ee154e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:49:26.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.694+0000 7f72f6f75740 1 -- 172.21.15.2:0/3107313955 shutdown_connections 2024-09-19T04:49:26.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.694+0000 7f72f6f75740 1 -- 172.21.15.2:0/3107313955 wait complete. 2024-09-19T04:49:26.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.694+0000 7f72f6f75740 20 client.15414 trim_cache size 0 max 16384 2024-09-19T04:49:26.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.711+0000 7f72f6f75740 1 Processor -- start 2024-09-19T04:49:26.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.711+0000 7f72f6f75740 1 -- start start 2024-09-19T04:49:26.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.711+0000 7f72f6f75740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e2ee152b60 0x55e2ee159b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:26.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.711+0000 7f72f6f75740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2ee153480 0x55e2ee1756a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:26.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.711+0000 7f72f6f75740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e2ee15dd40 0x55e2ee175be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:26.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.711+0000 7f72f6f75740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f72f01ad960 con 0x55e2ee153480 2024-09-19T04:49:26.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.711+0000 7f72f6f75740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f72f01b01e0 con 0x55e2ee15dd40 2024-09-19T04:49:26.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.711+0000 7f72f6f75740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f72f01adfd0 con 0x55e2ee152b60 2024-09-19T04:49:26.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.711+0000 7f72e7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2ee153480 0x55e2ee1756a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:26.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.711+0000 7f72e7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2ee153480 0x55e2ee1756a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45150/0 (socket says 172.21.15.2:45150) 2024-09-19T04:49:26.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.711+0000 7f72e7fff640 1 -- 172.21.15.2:0/1755008328 learned_addr learned my addr 172.21.15.2:0/1755008328 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:49:26.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.711+0000 7f72ee59c640 1 --2- 172.21.15.2:0/1755008328 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e2ee152b60 0x55e2ee159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:26.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.711+0000 7f72eed9d640 1 --2- 172.21.15.2:0/1755008328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e2ee15dd40 0x55e2ee175be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:26.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.711+0000 7f72e7fff640 1 -- 172.21.15.2:0/1755008328 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e2ee152b60 msgr2=0x55e2ee159b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:49:26.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.711+0000 7f72e7fff640 1 --2- 172.21.15.2:0/1755008328 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e2ee152b60 0x55e2ee159b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:26.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.711+0000 7f72e7fff640 1 -- 172.21.15.2:0/1755008328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e2ee15dd40 msgr2=0x55e2ee175be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:49:26.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.711+0000 7f72e7fff640 1 --2- 172.21.15.2:0/1755008328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e2ee15dd40 0x55e2ee175be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:26.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.711+0000 7f72e7fff640 1 -- 172.21.15.2:0/1755008328 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2ee14fca0 con 0x55e2ee153480 2024-09-19T04:49:26.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.712+0000 7f72e7fff640 1 --2- 172.21.15.2:0/1755008328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2ee153480 0x55e2ee1756a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f72d801bd00 tx=0x7f72d8005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=796186c87e2b5435 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:49:26.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.712+0000 7f72d7fff640 1 -- 172.21.15.2:0/1755008328 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d8033070 con 0x55e2ee153480 2024-09-19T04:49:26.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.712+0000 7f72d7fff640 1 -- 172.21.15.2:0/1755008328 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f72d8003e40 con 0x55e2ee153480 2024-09-19T04:49:26.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.712+0000 7f72d7fff640 1 -- 172.21.15.2:0/1755008328 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d8028070 con 0x55e2ee153480 2024-09-19T04:49:26.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.712+0000 7f72f6f75740 1 -- 172.21.15.2:0/1755008328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2ee153480 msgr2=0x55e2ee1756a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:26.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.712+0000 7f72f6f75740 1 --2- 172.21.15.2:0/1755008328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2ee153480 0x55e2ee1756a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f72d801bd00 tx=0x7f72d8005850 comp rx=0 tx=0).stop 2024-09-19T04:49:26.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.712+0000 7f72f6f75740 1 -- 172.21.15.2:0/1755008328 shutdown_connections 2024-09-19T04:49:26.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.712+0000 7f72f6f75740 1 --2- 172.21.15.2:0/1755008328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e2ee15dd40 0x55e2ee175be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:26.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.712+0000 7f72f6f75740 1 --2- 172.21.15.2:0/1755008328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2ee153480 0x55e2ee1756a0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:26.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.713+0000 7f72f6f75740 1 --2- 172.21.15.2:0/1755008328 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e2ee152b60 0x55e2ee159b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:26.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.713+0000 7f72f6f75740 1 -- 172.21.15.2:0/1755008328 >> 172.21.15.2:0/1755008328 conn(0x55e2ee14f0f0 msgr2=0x55e2ee159420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:49:26.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.713+0000 7f72f6f75740 1 -- 172.21.15.2:0/1755008328 shutdown_connections 2024-09-19T04:49:26.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.713+0000 7f72f6f75740 1 -- 172.21.15.2:0/1755008328 wait complete. 2024-09-19T04:49:26.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.713+0000 7f72f6f75740 1 -- start start 2024-09-19T04:49:26.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.713+0000 7f72f6f75740 1 Processor -- start 2024-09-19T04:49:26.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.713+0000 7f72f6f75740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e2ee152b60 0x55e2ee165cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:26.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.713+0000 7f72f6f75740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2ee153480 0x55e2ee166200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:26.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.713+0000 7f72f6f75740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e2ee15dd40 0x55e2ee160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:26.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.713+0000 7f72f6f75740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f72f01ae6a0 con 0x55e2ee153480 2024-09-19T04:49:26.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.713+0000 7f72f6f75740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f72f01afb10 con 0x55e2ee152b60 2024-09-19T04:49:26.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.713+0000 7f72f6f75740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f72f01aed70 con 0x55e2ee15dd40 2024-09-19T04:49:26.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.713+0000 7f72f6f75740 10 client.0 _ll_register_callbacks cb 0x7f72d800b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:49:26.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.713+0000 7f72e7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2ee153480 0x55e2ee166200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:26.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.713+0000 7f72e7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2ee153480 0x55e2ee166200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45154/0 (socket says 172.21.15.2:45154) 2024-09-19T04:49:26.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.713+0000 7f72e7fff640 1 -- 172.21.15.2:0/3960323426 learned_addr learned my addr 172.21.15.2:0/3960323426 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:49:26.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.713+0000 7f72eed9d640 1 --2- 172.21.15.2:0/3960323426 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e2ee15dd40 0x55e2ee160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:26.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.714+0000 7f72ee59c640 1 --2- 172.21.15.2:0/3960323426 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e2ee152b60 0x55e2ee165cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:26.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.714+0000 7f72e7fff640 1 -- 172.21.15.2:0/3960323426 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e2ee15dd40 msgr2=0x55e2ee160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:49:26.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.714+0000 7f72e7fff640 1 --2- 172.21.15.2:0/3960323426 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e2ee15dd40 0x55e2ee160c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:26.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.714+0000 7f72e7fff640 1 -- 172.21.15.2:0/3960323426 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e2ee152b60 msgr2=0x55e2ee165cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:49:26.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.714+0000 7f72e7fff640 1 --2- 172.21.15.2:0/3960323426 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e2ee152b60 0x55e2ee165cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:26.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.714+0000 7f72e7fff640 1 -- 172.21.15.2:0/3960323426 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2ee1532b0 con 0x55e2ee153480 2024-09-19T04:49:26.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.714+0000 7f72ee59c640 1 --2- 172.21.15.2:0/3960323426 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e2ee152b60 0x55e2ee165cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:49:26.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.714+0000 7f72e7fff640 1 --2- 172.21.15.2:0/3960323426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2ee153480 0x55e2ee166200 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f72d8000c00 tx=0x7f72d8003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5850021bf8365147 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:49:26.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.714+0000 7f72d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:49:26.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.714+0000 7f72d5ffb640 1 -- 172.21.15.2:0/3960323426 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d803c060 con 0x55e2ee153480 2024-09-19T04:49:26.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.714+0000 7f72d5ffb640 1 -- 172.21.15.2:0/3960323426 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f72d801b850 con 0x55e2ee153480 2024-09-19T04:49:26.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.714+0000 7f72f6f75740 1 -- 172.21.15.2:0/3960323426 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72d8003e40 con 0x55e2ee153480 2024-09-19T04:49:26.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.714+0000 7f72d5ffb640 1 -- 172.21.15.2:0/3960323426 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f72d8033050 con 0x55e2ee153480 2024-09-19T04:49:26.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.714+0000 7f72f6f75740 10 client.15420 fetch_fsmap learned FSMap version 19 2024-09-19T04:49:26.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.714+0000 7f72f6f75740 1 -- 172.21.15.2:0/3960323426 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55e2ee1d8b90 con 0x55e2ee153480 2024-09-19T04:49:26.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.715+0000 7f72d5ffb640 1 -- 172.21.15.2:0/3960323426 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f72d8003e40 con 0x55e2ee153480 2024-09-19T04:49:26.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.715+0000 7f72d5ffb640 1 -- 172.21.15.2:0/3960323426 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f72d8022050 con 0x55e2ee153480 2024-09-19T04:49:26.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.715+0000 7f72f6f75740 10 client.15420 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:49:26.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.715+0000 7f72f6f75740 10 client.15420 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:49:26.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.715+0000 7f72f6f75740 20 client.15420 populate_metadata read hostname 'smithi002' 2024-09-19T04:49:26.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.715+0000 7f72f6f75740 1 --2- 172.21.15.2:0/3960323426 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55e2ee16d9d0 0x55e2ee1db200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:26.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.715+0000 7f72f6f75740 4 client.15420 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:49:26.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.715+0000 7f72f6f75740 1 -- 172.21.15.2:0/3960323426 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55e2ee0bfd00 con 0x55e2ee16d9d0 2024-09-19T04:49:26.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.715+0000 7f72ee59c640 1 --2- 172.21.15.2:0/3960323426 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55e2ee16d9d0 0x55e2ee1db200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:26.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.715+0000 7f72ee59c640 1 --2- 172.21.15.2:0/3960323426 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55e2ee16d9d0 0x55e2ee1db200 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=230fbfadb1a3d7ea server_cookie=ca5868523af37dbf in_seq=0 out_seq=0 2024-09-19T04:49:26.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.715+0000 7f72d5ffb640 10 client.15420 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:49:26.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.716+0000 7f72d5ffb640 1 -- 172.21.15.2:0/3960323426 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e2ee0bfd00 con 0x55e2ee16d9d0 2024-09-19T04:49:26.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.716+0000 7f72d5ffb640 10 client.15420 handle_command_reply: tid=0 2024-09-19T04:49:26.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.716+0000 7f72f6f75740 1 client.15420 shutdown 2024-09-19T04:49:26.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.716+0000 7f72f6f75740 1 -- 172.21.15.2:0/3960323426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2ee153480 msgr2=0x55e2ee166200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:26.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.716+0000 7f72f6f75740 1 --2- 172.21.15.2:0/3960323426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2ee153480 0x55e2ee166200 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f72d8000c00 tx=0x7f72d8003ba0 comp rx=0 tx=0).stop 2024-09-19T04:49:26.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.717+0000 7f72f6f75740 1 -- 172.21.15.2:0/3960323426 shutdown_connections 2024-09-19T04:49:26.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.717+0000 7f72f6f75740 1 --2- 172.21.15.2:0/3960323426 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55e2ee16d9d0 0x55e2ee1db200 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:26.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.717+0000 7f72f6f75740 1 --2- 172.21.15.2:0/3960323426 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e2ee15dd40 0x55e2ee160c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:26.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.717+0000 7f72f6f75740 1 --2- 172.21.15.2:0/3960323426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e2ee153480 0x55e2ee166200 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:26.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.717+0000 7f72f6f75740 1 --2- 172.21.15.2:0/3960323426 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e2ee152b60 0x55e2ee165cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:26.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.717+0000 7f72f6f75740 1 -- 172.21.15.2:0/3960323426 >> 172.21.15.2:0/3960323426 conn(0x55e2ee14f0f0 msgr2=0x55e2ee1545b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:49:26.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.717+0000 7f72d5ffb640 0 client.15420 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:49:26.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.717+0000 7f72f6f75740 1 -- 172.21.15.2:0/3960323426 shutdown_connections 2024-09-19T04:49:26.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.717+0000 7f72f6f75740 1 -- 172.21.15.2:0/3960323426 wait complete. 2024-09-19T04:49:26.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.717+0000 7f72f6f75740 20 client.15420 trim_cache size 0 max 16384 2024-09-19T04:49:26.723 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:49:26.723 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T04:49:26.724 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "da24ae40-65d3-4024-8bd8-0be3a2ef760e", 2024-09-19T04:49:26.724 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T04:49:26.724 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:49:26.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.717+0000 7f72f4b9c640 1 -- 172.21.15.2:0/3629219097 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f72dc0a34d0 msgr2=0x7f72dc0a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:26.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.717+0000 7f72f4b9c640 1 --2- 172.21.15.2:0/3629219097 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f72dc0a34d0 0x7f72dc0a5990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f72e8004af0 tx=0x7f72e80095c0 comp rx=0 tx=0).stop 2024-09-19T04:49:26.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.717+0000 7f72f4b9c640 1 -- 172.21.15.2:0/3629219097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72f0102d40 msgr2=0x7f72f01009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:26.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.717+0000 7f72f4b9c640 1 --2- 172.21.15.2:0/3629219097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72f0102d40 0x7f72f01009a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f72e000d950 tx=0x7f72e000de10 comp rx=0 tx=0).stop 2024-09-19T04:49:26.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.717+0000 7f72f4b9c640 1 -- 172.21.15.2:0/3629219097 shutdown_connections 2024-09-19T04:49:26.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.717+0000 7f72f4b9c640 1 --2- 172.21.15.2:0/3629219097 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f72dc0a34d0 0x7f72dc0a5990 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:26.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.717+0000 7f72f4b9c640 1 --2- 172.21.15.2:0/3629219097 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f72f010c170 0x7f72f0101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:26.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.717+0000 7f72f4b9c640 1 --2- 172.21.15.2:0/3629219097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72f0103660 0x7f72f0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:26.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.717+0000 7f72f4b9c640 1 --2- 172.21.15.2:0/3629219097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72f0102d40 0x7f72f01009a0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:26.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.717+0000 7f72f4b9c640 1 -- 172.21.15.2:0/3629219097 >> 172.21.15.2:0/3629219097 conn(0x7f72f00fc7a0 msgr2=0x7f72f00fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:49:26.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.718+0000 7f72f4b9c640 1 -- 172.21.15.2:0/3629219097 shutdown_connections 2024-09-19T04:49:26.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:26.718+0000 7f72f4b9c640 1 -- 172.21.15.2:0/3629219097 wait complete. 2024-09-19T04:49:26.806 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:49:26 smithi018 ceph-mon[34537]: pgmap v46: 97 pgs: 97 active+clean; 1.5 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 9 op/s 2024-09-19T04:49:27.414 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:49:27.675 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:49:28.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.113+0000 7f6320580640 1 -- 172.21.15.2:0/1697565056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6318102570 msgr2=0x7f63181029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:28.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.113+0000 7f6320580640 1 --2- 172.21.15.2:0/1697565056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6318102570 0x7f63181029b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6308009900 tx=0x7f630802a480 comp rx=0 tx=0).stop 2024-09-19T04:49:28.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.113+0000 7f6320580640 1 -- 172.21.15.2:0/1697565056 shutdown_connections 2024-09-19T04:49:28.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.113+0000 7f6320580640 1 --2- 172.21.15.2:0/1697565056 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6318102ef0 0x7f631810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:28.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.113+0000 7f6320580640 1 --2- 172.21.15.2:0/1697565056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6318102570 0x7f63181029b0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:28.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.113+0000 7f6320580640 1 --2- 172.21.15.2:0/1697565056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6318100e20 0x7f6318101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:28.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.113+0000 7f6320580640 1 -- 172.21.15.2:0/1697565056 >> 172.21.15.2:0/1697565056 conn(0x7f63180fc7d0 msgr2=0x7f63180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:49:28.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.113+0000 7f6320580640 1 -- 172.21.15.2:0/1697565056 shutdown_connections 2024-09-19T04:49:28.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.113+0000 7f6320580640 1 -- 172.21.15.2:0/1697565056 wait complete. 2024-09-19T04:49:28.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.113+0000 7f6320580640 1 Processor -- start 2024-09-19T04:49:28.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.114+0000 7f6320580640 1 -- start start 2024-09-19T04:49:28.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.114+0000 7f6320580640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6318100e20 0x7f631819a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:28.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.114+0000 7f6320580640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6318102570 0x7f631819aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:28.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.114+0000 7f6320580640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6318102ef0 0x7f631819ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:28.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.114+0000 7f6320580640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6318110e50 con 0x7f6318102ef0 2024-09-19T04:49:28.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.114+0000 7f6320580640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6318110cd0 con 0x7f6318102570 2024-09-19T04:49:28.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.114+0000 7f6320580640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f6318110fd0 con 0x7f6318100e20 2024-09-19T04:49:28.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.114+0000 7f631eb1d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6318102ef0 0x7f631819ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:28.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.114+0000 7f631eb1d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6318102ef0 0x7f631819ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45162/0 (socket says 172.21.15.2:45162) 2024-09-19T04:49:28.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.114+0000 7f631eb1d640 1 -- 172.21.15.2:0/613024388 learned_addr learned my addr 172.21.15.2:0/613024388 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:49:28.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.114+0000 7f631e31c640 1 --2- 172.21.15.2:0/613024388 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6318100e20 0x7f631819a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:28.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.114+0000 7f631eb1d640 1 -- 172.21.15.2:0/613024388 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6318100e20 msgr2=0x7f631819a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:28.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.114+0000 7f631db1b640 1 --2- 172.21.15.2:0/613024388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6318102570 0x7f631819aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:28.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.114+0000 7f631eb1d640 1 --2- 172.21.15.2:0/613024388 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6318100e20 0x7f631819a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:28.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.114+0000 7f631eb1d640 1 -- 172.21.15.2:0/613024388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6318102570 msgr2=0x7f631819aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:28.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.114+0000 7f631eb1d640 1 --2- 172.21.15.2:0/613024388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6318102570 0x7f631819aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:28.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.114+0000 7f631eb1d640 1 -- 172.21.15.2:0/613024388 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f631819f610 con 0x7f6318102ef0 2024-09-19T04:49:28.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.114+0000 7f631eb1d640 1 --2- 172.21.15.2:0/613024388 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6318102ef0 0x7f631819ef30 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f631000b970 tx=0x7f631000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:49:28.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.115+0000 7f630f7fe640 1 -- 172.21.15.2:0/613024388 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6310019070 con 0x7f6318102ef0 2024-09-19T04:49:28.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.115+0000 7f6320580640 1 -- 172.21.15.2:0/613024388 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f631819f900 con 0x7f6318102ef0 2024-09-19T04:49:28.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.115+0000 7f630f7fe640 1 -- 172.21.15.2:0/613024388 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6310014440 con 0x7f6318102ef0 2024-09-19T04:49:28.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.115+0000 7f630f7fe640 1 -- 172.21.15.2:0/613024388 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63100075d0 con 0x7f6318102ef0 2024-09-19T04:49:28.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.115+0000 7f6320580640 1 -- 172.21.15.2:0/613024388 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63181a71e0 con 0x7f6318102ef0 2024-09-19T04:49:28.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.118+0000 7f6322959740 1 Processor -- start 2024-09-19T04:49:28.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.118+0000 7f630f7fe640 1 -- 172.21.15.2:0/613024388 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 24) ==== 138587+0+0 (secure 0 0 0) 0x7f631001c070 con 0x7f6318102ef0 2024-09-19T04:49:28.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.118+0000 7f6322959740 1 -- start start 2024-09-19T04:49:28.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.118+0000 7f6322959740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c77e574a0 0x564c77e57880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:28.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.118+0000 7f6322959740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564c77e57dc0 0x564c77e62140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:28.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.118+0000 7f6322959740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c77e62680 0x564c77e64a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:28.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.118+0000 7f6322959740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564c77dbd2e0 con 0x564c77e574a0 2024-09-19T04:49:28.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.118+0000 7f6322959740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564c77d64ce0 con 0x564c77e62680 2024-09-19T04:49:28.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.118+0000 7f6322959740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x564c77db92a0 con 0x564c77e57dc0 2024-09-19T04:49:28.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.118+0000 7f631db1b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c77e574a0 0x564c77e57880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:28.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.118+0000 7f631db1b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c77e574a0 0x564c77e57880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45166/0 (socket says 172.21.15.2:45166) 2024-09-19T04:49:28.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.118+0000 7f631db1b640 1 -- 172.21.15.2:0/782601166 learned_addr learned my addr 172.21.15.2:0/782601166 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:49:28.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.119+0000 7f631e31c640 1 --2- 172.21.15.2:0/782601166 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564c77e57dc0 0x564c77e62140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:28.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.119+0000 7f630f7fe640 1 --2- 172.21.15.2:0/613024388 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f63040a34d0 0x7f63040a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:28.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.119+0000 7f631db1b640 1 --2- 172.21.15.2:0/782601166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c77e62680 0x564c77e64a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:28.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.119+0000 7f631db1b640 1 -- 172.21.15.2:0/782601166 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564c77e57dc0 msgr2=0x564c77e62140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:49:28.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.119+0000 7f631db1b640 1 --2- 172.21.15.2:0/782601166 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564c77e57dc0 0x564c77e62140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:28.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.119+0000 7f631db1b640 1 -- 172.21.15.2:0/782601166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c77e62680 msgr2=0x564c77e64a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:49:28.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.119+0000 7f631db1b640 1 --2- 172.21.15.2:0/782601166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c77e62680 0x564c77e64a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:28.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.119+0000 7f631db1b640 1 -- 172.21.15.2:0/782601166 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c77d49440 con 0x564c77e574a0 2024-09-19T04:49:28.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.119+0000 7f631eb1d640 1 --2- 172.21.15.2:0/613024388 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f63040a34d0 0x7f63040a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:28.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.119+0000 7f630f7fe640 1 -- 172.21.15.2:0/613024388 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f63100cf530 con 0x7f6318102ef0 2024-09-19T04:49:28.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.119+0000 7f631db1b640 1 --2- 172.21.15.2:0/782601166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c77e574a0 0x564c77e57880 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6308005940 tx=0x7f6308005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70855299bfd06a2e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:49:28.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.119+0000 7f630cff9640 1 -- 172.21.15.2:0/782601166 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6308035050 con 0x564c77e574a0 2024-09-19T04:49:28.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.119+0000 7f630cff9640 1 -- 172.21.15.2:0/782601166 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6308031630 con 0x564c77e574a0 2024-09-19T04:49:28.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.119+0000 7f630cff9640 1 -- 172.21.15.2:0/782601166 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63080046c0 con 0x564c77e574a0 2024-09-19T04:49:28.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.120+0000 7f6322959740 1 -- 172.21.15.2:0/782601166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c77e574a0 msgr2=0x564c77e57880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:28.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.120+0000 7f6322959740 1 --2- 172.21.15.2:0/782601166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c77e574a0 0x564c77e57880 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6308005940 tx=0x7f6308005d50 comp rx=0 tx=0).stop 2024-09-19T04:49:28.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.120+0000 7f631eb1d640 1 --2- 172.21.15.2:0/613024388 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f63040a34d0 0x7f63040a5990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f63100ccc90 tx=0x7f6310004a40 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:49:28.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.120+0000 7f6322959740 1 -- 172.21.15.2:0/782601166 shutdown_connections 2024-09-19T04:49:28.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.120+0000 7f6322959740 1 --2- 172.21.15.2:0/782601166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c77e62680 0x564c77e64a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:28.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.120+0000 7f6322959740 1 --2- 172.21.15.2:0/782601166 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564c77e57dc0 0x564c77e62140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:28.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.120+0000 7f6322959740 1 --2- 172.21.15.2:0/782601166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c77e574a0 0x564c77e57880 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:28.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.120+0000 7f6322959740 1 -- 172.21.15.2:0/782601166 >> 172.21.15.2:0/782601166 conn(0x564c77e53a30 msgr2=0x564c77e53e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:49:28.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.120+0000 7f6322959740 1 -- 172.21.15.2:0/782601166 shutdown_connections 2024-09-19T04:49:28.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.120+0000 7f6322959740 1 -- 172.21.15.2:0/782601166 wait complete. 2024-09-19T04:49:28.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.121+0000 7f6322959740 1 -- start start 2024-09-19T04:49:28.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.121+0000 7f6322959740 1 Processor -- start 2024-09-19T04:49:28.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.121+0000 7f6322959740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c77e574a0 0x564c77e61fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:28.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.121+0000 7f6322959740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564c77e57dc0 0x564c77e5f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:28.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.121+0000 7f6322959740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c77e62680 0x564c77e5f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:28.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.121+0000 7f6322959740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564c77e65250 con 0x564c77e574a0 2024-09-19T04:49:28.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.121+0000 7f6322959740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564c77d78050 con 0x564c77e62680 2024-09-19T04:49:28.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.121+0000 7f6322959740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x564c77e653d0 con 0x564c77e57dc0 2024-09-19T04:49:28.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.121+0000 7f6322959740 10 client.0 _ll_register_callbacks cb 0x564c77db8160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:49:28.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.121+0000 7f631db1b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c77e574a0 0x564c77e61fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:28.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.121+0000 7f631db1b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c77e574a0 0x564c77e61fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45170/0 (socket says 172.21.15.2:45170) 2024-09-19T04:49:28.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.121+0000 7f631db1b640 1 -- 172.21.15.2:0/4120640408 learned_addr learned my addr 172.21.15.2:0/4120640408 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:49:28.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.121+0000 7f631e31c640 1 --2- 172.21.15.2:0/4120640408 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564c77e57dc0 0x564c77e5f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:28.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.121+0000 7f631db1b640 1 --2- 172.21.15.2:0/4120640408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c77e62680 0x564c77e5f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:28.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.121+0000 7f631db1b640 1 -- 172.21.15.2:0/4120640408 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564c77e57dc0 msgr2=0x564c77e5f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:49:28.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.121+0000 7f631db1b640 1 --2- 172.21.15.2:0/4120640408 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564c77e57dc0 0x564c77e5f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:28.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.121+0000 7f631db1b640 1 -- 172.21.15.2:0/4120640408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c77e62680 msgr2=0x564c77e5f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:49:28.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.121+0000 7f631db1b640 1 --2- 172.21.15.2:0/4120640408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c77e62680 0x564c77e5f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:28.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.121+0000 7f631db1b640 1 -- 172.21.15.2:0/4120640408 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c77b2e3c0 con 0x564c77e574a0 2024-09-19T04:49:28.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.121+0000 7f631e31c640 1 --2- 172.21.15.2:0/4120640408 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564c77e57dc0 0x564c77e5f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:49:28.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.121+0000 7f631db1b640 1 --2- 172.21.15.2:0/4120640408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c77e574a0 0x564c77e61fd0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f63080315d0 tx=0x7f6308005330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56cfffe688144bc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:49:28.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.121+0000 7f6301ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:49:28.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.122+0000 7f6301ffb640 1 -- 172.21.15.2:0/4120640408 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6308049070 con 0x564c77e574a0 2024-09-19T04:49:28.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.122+0000 7f6322959740 1 -- 172.21.15.2:0/4120640408 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6308031630 con 0x564c77e574a0 2024-09-19T04:49:28.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.122+0000 7f6301ffb640 1 -- 172.21.15.2:0/4120640408 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f6308004020 con 0x564c77e574a0 2024-09-19T04:49:28.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.122+0000 7f6301ffb640 1 -- 172.21.15.2:0/4120640408 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f6308035040 con 0x564c77e574a0 2024-09-19T04:49:28.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.122+0000 7f6322959740 10 client.15432 fetch_fsmap learned FSMap version 19 2024-09-19T04:49:28.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.122+0000 7f6322959740 1 -- 172.21.15.2:0/4120640408 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x564c77e70c20 con 0x564c77e574a0 2024-09-19T04:49:28.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.122+0000 7f6301ffb640 1 -- 172.21.15.2:0/4120640408 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6308031630 con 0x564c77e574a0 2024-09-19T04:49:28.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.122+0000 7f6301ffb640 1 -- 172.21.15.2:0/4120640408 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f6308055030 con 0x564c77e574a0 2024-09-19T04:49:28.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.122+0000 7f6322959740 10 client.15432 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:49:28.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.122+0000 7f6322959740 10 client.15432 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:49:28.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.122+0000 7f6322959740 20 client.15432 populate_metadata read hostname 'smithi002' 2024-09-19T04:49:28.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.122+0000 7f6322959740 1 --2- 172.21.15.2:0/4120640408 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x564c77e71f70 0x564c77e74360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:28.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.122+0000 7f6322959740 4 client.15432 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:49:28.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.122+0000 7f6322959740 1 -- 172.21.15.2:0/4120640408 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564c77dca850 con 0x564c77e71f70 2024-09-19T04:49:28.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.123+0000 7f631e31c640 1 --2- 172.21.15.2:0/4120640408 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x564c77e71f70 0x564c77e74360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:28.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.123+0000 7f6301ffb640 10 client.15432 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:49:28.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.123+0000 7f631e31c640 1 --2- 172.21.15.2:0/4120640408 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x564c77e71f70 0x564c77e74360 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91975dfa8adabacb server_cookie=3a208fa2f6eaad0a in_seq=0 out_seq=0 2024-09-19T04:49:28.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.124+0000 7f6301ffb640 1 -- 172.21.15.2:0/4120640408 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564c77dca850 con 0x564c77e71f70 2024-09-19T04:49:28.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.124+0000 7f6301ffb640 10 client.15432 handle_command_reply: tid=0 2024-09-19T04:49:28.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.124+0000 7f6322959740 1 client.15432 shutdown 2024-09-19T04:49:28.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.124+0000 7f6322959740 1 -- 172.21.15.2:0/4120640408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c77e574a0 msgr2=0x564c77e61fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:28.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.124+0000 7f6322959740 1 --2- 172.21.15.2:0/4120640408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c77e574a0 0x564c77e61fd0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f63080315d0 tx=0x7f6308005330 comp rx=0 tx=0).stop 2024-09-19T04:49:28.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.124+0000 7f6322959740 1 -- 172.21.15.2:0/4120640408 shutdown_connections 2024-09-19T04:49:28.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.124+0000 7f6322959740 1 --2- 172.21.15.2:0/4120640408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c77e62680 0x564c77e5f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:28.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.124+0000 7f6322959740 1 --2- 172.21.15.2:0/4120640408 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x564c77e71f70 0x564c77e74360 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:28.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.124+0000 7f6322959740 1 --2- 172.21.15.2:0/4120640408 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564c77e57dc0 0x564c77e5f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:28.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.124+0000 7f6322959740 1 --2- 172.21.15.2:0/4120640408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c77e574a0 0x564c77e61fd0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:28.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.124+0000 7f6301ffb640 0 client.15432 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:49:28.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.124+0000 7f6322959740 1 -- 172.21.15.2:0/4120640408 >> 172.21.15.2:0/4120640408 conn(0x564c77e53a30 msgr2=0x564c77e59760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:49:28.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.124+0000 7f6322959740 1 -- 172.21.15.2:0/4120640408 shutdown_connections 2024-09-19T04:49:28.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.124+0000 7f6322959740 1 -- 172.21.15.2:0/4120640408 wait complete. 2024-09-19T04:49:28.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.124+0000 7f6322959740 20 client.15432 trim_cache size 0 max 16384 2024-09-19T04:49:28.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.141+0000 7f6322959740 1 Processor -- start 2024-09-19T04:49:28.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.142+0000 7f6322959740 1 -- start start 2024-09-19T04:49:28.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.142+0000 7f6322959740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c77e574a0 0x564c77e5c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:28.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.142+0000 7f6322959740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c77e57dc0 0x564c77e5ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:28.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.142+0000 7f6322959740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564c77e62680 0x564c77e60ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:28.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.142+0000 7f6322959740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f63181ad750 con 0x564c77e57dc0 2024-09-19T04:49:28.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.142+0000 7f6322959740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f63181affd0 con 0x564c77e574a0 2024-09-19T04:49:28.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.142+0000 7f6322959740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f63181addc0 con 0x564c77e62680 2024-09-19T04:49:28.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.142+0000 7f631e31c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c77e57dc0 0x564c77e5ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:28.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.142+0000 7f631e31c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c77e57dc0 0x564c77e5ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45182/0 (socket says 172.21.15.2:45182) 2024-09-19T04:49:28.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.142+0000 7f631e31c640 1 -- 172.21.15.2:0/1868090035 learned_addr learned my addr 172.21.15.2:0/1868090035 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:49:28.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.142+0000 7f631db1b640 1 --2- 172.21.15.2:0/1868090035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c77e574a0 0x564c77e5c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:28.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.142+0000 7f631e31c640 1 -- 172.21.15.2:0/1868090035 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564c77e62680 msgr2=0x564c77e60ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:49:28.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.142+0000 7f631e31c640 1 --2- 172.21.15.2:0/1868090035 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564c77e62680 0x564c77e60ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:28.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.142+0000 7f631e31c640 1 -- 172.21.15.2:0/1868090035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c77e574a0 msgr2=0x564c77e5c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:49:28.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.142+0000 7f631e31c640 1 --2- 172.21.15.2:0/1868090035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c77e574a0 0x564c77e5c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:28.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.142+0000 7f631e31c640 1 -- 172.21.15.2:0/1868090035 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c77e57bf0 con 0x564c77e57dc0 2024-09-19T04:49:28.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.142+0000 7f631db1b640 1 --2- 172.21.15.2:0/1868090035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c77e574a0 0x564c77e5c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:49:28.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.142+0000 7f631e31c640 1 --2- 172.21.15.2:0/1868090035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c77e57dc0 0x564c77e5ca20 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f631400bd60 tx=0x7f63140138f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8020a2ed3cd0ae7a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:49:28.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.143+0000 7f6303fff640 1 -- 172.21.15.2:0/1868090035 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6314004020 con 0x564c77e57dc0 2024-09-19T04:49:28.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.143+0000 7f6303fff640 1 -- 172.21.15.2:0/1868090035 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f63140041c0 con 0x564c77e57dc0 2024-09-19T04:49:28.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.143+0000 7f6303fff640 1 -- 172.21.15.2:0/1868090035 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63140116a0 con 0x564c77e57dc0 2024-09-19T04:49:28.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.143+0000 7f6322959740 1 -- 172.21.15.2:0/1868090035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c77e57dc0 msgr2=0x564c77e5ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:28.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.143+0000 7f6322959740 1 --2- 172.21.15.2:0/1868090035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c77e57dc0 0x564c77e5ca20 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f631400bd60 tx=0x7f63140138f0 comp rx=0 tx=0).stop 2024-09-19T04:49:28.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.143+0000 7f6322959740 1 -- 172.21.15.2:0/1868090035 shutdown_connections 2024-09-19T04:49:28.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.143+0000 7f6322959740 1 --2- 172.21.15.2:0/1868090035 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564c77e62680 0x564c77e60ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:28.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.143+0000 7f6322959740 1 --2- 172.21.15.2:0/1868090035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c77e57dc0 0x564c77e5ca20 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:28.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.143+0000 7f6322959740 1 --2- 172.21.15.2:0/1868090035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c77e574a0 0x564c77e5c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:28.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.143+0000 7f6322959740 1 -- 172.21.15.2:0/1868090035 >> 172.21.15.2:0/1868090035 conn(0x564c77e53a30 msgr2=0x564c77e5e370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:49:28.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.143+0000 7f6322959740 1 -- 172.21.15.2:0/1868090035 shutdown_connections 2024-09-19T04:49:28.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.143+0000 7f6322959740 1 -- 172.21.15.2:0/1868090035 wait complete. 2024-09-19T04:49:28.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.144+0000 7f6322959740 1 -- start start 2024-09-19T04:49:28.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.144+0000 7f6322959740 1 Processor -- start 2024-09-19T04:49:28.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.144+0000 7f6322959740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c77e574a0 0x564c77e76bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:28.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.144+0000 7f6322959740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c77e57dc0 0x564c77e77100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:28.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.144+0000 7f6322959740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564c77e62680 0x564c77ed3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:28.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.144+0000 7f6322959740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f63181ae490 con 0x564c77e57dc0 2024-09-19T04:49:28.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.144+0000 7f6322959740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f63181af900 con 0x564c77e574a0 2024-09-19T04:49:28.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.144+0000 7f6322959740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f63181aeb60 con 0x564c77e62680 2024-09-19T04:49:28.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.144+0000 7f6322959740 10 client.0 _ll_register_callbacks cb 0x7f631400b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:49:28.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.144+0000 7f631e31c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c77e57dc0 0x564c77e77100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:28.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.144+0000 7f631e31c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c77e57dc0 0x564c77e77100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45184/0 (socket says 172.21.15.2:45184) 2024-09-19T04:49:28.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.144+0000 7f631e31c640 1 -- 172.21.15.2:0/2640229524 learned_addr learned my addr 172.21.15.2:0/2640229524 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:49:28.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.144+0000 7f631db1b640 1 --2- 172.21.15.2:0/2640229524 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564c77e62680 0x564c77ed3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:28.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.145+0000 7f631db1b640 1 --2- 172.21.15.2:0/2640229524 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c77e574a0 0x564c77e76bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:28.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.145+0000 7f631e31c640 1 -- 172.21.15.2:0/2640229524 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564c77e62680 msgr2=0x564c77ed3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:49:28.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.145+0000 7f631e31c640 1 --2- 172.21.15.2:0/2640229524 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564c77e62680 0x564c77ed3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:28.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.145+0000 7f631e31c640 1 -- 172.21.15.2:0/2640229524 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c77e574a0 msgr2=0x564c77e76bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:49:28.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.145+0000 7f631e31c640 1 --2- 172.21.15.2:0/2640229524 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c77e574a0 0x564c77e76bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:28.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.145+0000 7f631e31c640 1 -- 172.21.15.2:0/2640229524 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c77ed3eb0 con 0x564c77e57dc0 2024-09-19T04:49:28.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.145+0000 7f631db1b640 1 --2- 172.21.15.2:0/2640229524 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564c77e62680 0x564c77ed3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:49:28.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.145+0000 7f631e31c640 1 --2- 172.21.15.2:0/2640229524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c77e57dc0 0x564c77e77100 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f631400b370 tx=0x7f631400bba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6939d0fa00a80a72 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:49:28.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.145+0000 7f6301ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:49:28.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.145+0000 7f6301ffb640 1 -- 172.21.15.2:0/2640229524 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63140037f0 con 0x564c77e57dc0 2024-09-19T04:49:28.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.145+0000 7f6301ffb640 1 -- 172.21.15.2:0/2640229524 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f6314003990 con 0x564c77e57dc0 2024-09-19T04:49:28.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.145+0000 7f6322959740 1 -- 172.21.15.2:0/2640229524 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63140041c0 con 0x564c77e57dc0 2024-09-19T04:49:28.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.145+0000 7f6301ffb640 1 -- 172.21.15.2:0/2640229524 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f6314034050 con 0x564c77e57dc0 2024-09-19T04:49:28.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.145+0000 7f6322959740 10 client.15438 fetch_fsmap learned FSMap version 19 2024-09-19T04:49:28.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.145+0000 7f6322959740 1 -- 172.21.15.2:0/2640229524 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x564c77edc3c0 con 0x564c77e57dc0 2024-09-19T04:49:28.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.145+0000 7f6301ffb640 1 -- 172.21.15.2:0/2640229524 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f63140041c0 con 0x564c77e57dc0 2024-09-19T04:49:28.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.146+0000 7f6301ffb640 1 -- 172.21.15.2:0/2640229524 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f6314026430 con 0x564c77e57dc0 2024-09-19T04:49:28.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.146+0000 7f6322959740 10 client.15438 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:49:28.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.146+0000 7f6322959740 10 client.15438 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:49:28.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.146+0000 7f6322959740 20 client.15438 populate_metadata read hostname 'smithi002' 2024-09-19T04:49:28.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.146+0000 7f6322959740 1 --2- 172.21.15.2:0/2640229524 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x564c77edcab0 0x564c77edeed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:28.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.146+0000 7f6322959740 4 client.15438 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:49:28.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.146+0000 7f6322959740 1 -- 172.21.15.2:0/2640229524 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564c77dc4d60 con 0x564c77edcab0 2024-09-19T04:49:28.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.146+0000 7f631db1b640 1 --2- 172.21.15.2:0/2640229524 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x564c77edcab0 0x564c77edeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:28.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.146+0000 7f631db1b640 1 --2- 172.21.15.2:0/2640229524 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x564c77edcab0 0x564c77edeed0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=770c349a28740685 server_cookie=b8930d5e9a5c0355 in_seq=0 out_seq=0 2024-09-19T04:49:28.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.146+0000 7f6301ffb640 10 client.15438 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:49:28.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.147+0000 7f6301ffb640 1 -- 172.21.15.2:0/2640229524 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x564c77dc4d60 con 0x564c77edcab0 2024-09-19T04:49:28.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.147+0000 7f6301ffb640 10 client.15438 handle_command_reply: tid=0 2024-09-19T04:49:28.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.147+0000 7f6322959740 1 client.15438 shutdown 2024-09-19T04:49:28.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.147+0000 7f6322959740 1 -- 172.21.15.2:0/2640229524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c77e57dc0 msgr2=0x564c77e77100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:28.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.147+0000 7f6322959740 1 --2- 172.21.15.2:0/2640229524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c77e57dc0 0x564c77e77100 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f631400b370 tx=0x7f631400bba0 comp rx=0 tx=0).stop 2024-09-19T04:49:28.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.147+0000 7f6322959740 1 -- 172.21.15.2:0/2640229524 shutdown_connections 2024-09-19T04:49:28.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.147+0000 7f6322959740 1 --2- 172.21.15.2:0/2640229524 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x564c77edcab0 0x564c77edeed0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:28.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.147+0000 7f6322959740 1 --2- 172.21.15.2:0/2640229524 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564c77e62680 0x564c77ed3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:28.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.147+0000 7f6322959740 1 --2- 172.21.15.2:0/2640229524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564c77e57dc0 0x564c77e77100 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:28.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.147+0000 7f6322959740 1 --2- 172.21.15.2:0/2640229524 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c77e574a0 0x564c77e76bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:28.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.147+0000 7f6322959740 1 -- 172.21.15.2:0/2640229524 >> 172.21.15.2:0/2640229524 conn(0x564c77e53a30 msgr2=0x564c77e52370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:49:28.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.147+0000 7f6301ffb640 0 client.15438 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:49:28.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.147+0000 7f6322959740 1 -- 172.21.15.2:0/2640229524 shutdown_connections 2024-09-19T04:49:28.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.147+0000 7f6322959740 1 -- 172.21.15.2:0/2640229524 wait complete. 2024-09-19T04:49:28.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.147+0000 7f6322959740 20 client.15438 trim_cache size 0 max 16384 2024-09-19T04:49:28.156 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:49:28.156 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T04:49:28.156 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-19T04:49:28.157 INFO:teuthology.orchestra.run.smithi002.stdout: "da24ae40-65d3-4024-8bd8-0be3a2ef760e": { 2024-09-19T04:49:28.157 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-19T04:49:28.157 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "da24ae40-65d3-4024-8bd8-0be3a2ef760e", 2024-09-19T04:49:28.157 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-19T04:49:28.157 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:49:28.157 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:49:28.157 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:49:28.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.148+0000 7f6320580640 1 -- 172.21.15.2:0/613024388 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f63040a34d0 msgr2=0x7f63040a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:28.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.148+0000 7f6320580640 1 --2- 172.21.15.2:0/613024388 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f63040a34d0 0x7f63040a5990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f63100ccc90 tx=0x7f6310004a40 comp rx=0 tx=0).stop 2024-09-19T04:49:28.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.148+0000 7f6320580640 1 -- 172.21.15.2:0/613024388 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6318102ef0 msgr2=0x7f631819ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:28.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.148+0000 7f6320580640 1 --2- 172.21.15.2:0/613024388 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6318102ef0 0x7f631819ef30 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f631000b970 tx=0x7f631000be30 comp rx=0 tx=0).stop 2024-09-19T04:49:28.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.148+0000 7f6320580640 1 -- 172.21.15.2:0/613024388 shutdown_connections 2024-09-19T04:49:28.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.148+0000 7f6320580640 1 --2- 172.21.15.2:0/613024388 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6318102ef0 0x7f631819ef30 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:28.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.148+0000 7f6320580640 1 --2- 172.21.15.2:0/613024388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6318102570 0x7f631819aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:28.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.148+0000 7f6320580640 1 --2- 172.21.15.2:0/613024388 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f63040a34d0 0x7f63040a5990 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:28.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.148+0000 7f6320580640 1 --2- 172.21.15.2:0/613024388 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6318100e20 0x7f631819a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:28.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.148+0000 7f6320580640 1 -- 172.21.15.2:0/613024388 >> 172.21.15.2:0/613024388 conn(0x7f63180fc7d0 msgr2=0x7f631806a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:49:28.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.148+0000 7f6320580640 1 -- 172.21.15.2:0/613024388 shutdown_connections 2024-09-19T04:49:28.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:28.148+0000 7f6320580640 1 -- 172.21.15.2:0/613024388 wait complete. 2024-09-19T04:49:28.517 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:49:28 smithi002 ceph-mon[30975]: scrub queued for path: / 2024-09-19T04:49:28.517 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:49:28 smithi002 ceph-mon[30975]: scrub summary: idle+waiting paths [/] 2024-09-19T04:49:28.517 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:49:28 smithi002 ceph-mon[30975]: scrub summary: active paths [/] 2024-09-19T04:49:28.517 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:49:28 smithi002 ceph-mon[30975]: scrub summary: idle+waiting paths [/] 2024-09-19T04:49:28.517 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:49:28 smithi002 ceph-mon[30975]: pgmap v47: 97 pgs: 97 active+clean; 1.5 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 KiB/s wr, 6 op/s 2024-09-19T04:49:28.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:49:28 smithi116 ceph-mon[34477]: scrub queued for path: / 2024-09-19T04:49:28.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:49:28 smithi116 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-19T04:49:28.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:49:28 smithi116 ceph-mon[34477]: scrub summary: active paths [/] 2024-09-19T04:49:28.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:49:28 smithi116 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-19T04:49:28.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:49:28 smithi116 ceph-mon[34477]: pgmap v47: 97 pgs: 97 active+clean; 1.5 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 KiB/s wr, 6 op/s 2024-09-19T04:49:28.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:49:28 smithi018 ceph-mon[34537]: scrub queued for path: / 2024-09-19T04:49:28.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:49:28 smithi018 ceph-mon[34537]: scrub summary: idle+waiting paths [/] 2024-09-19T04:49:28.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:49:28 smithi018 ceph-mon[34537]: scrub summary: active paths [/] 2024-09-19T04:49:28.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:49:28 smithi018 ceph-mon[34537]: scrub summary: idle+waiting paths [/] 2024-09-19T04:49:28.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:49:28 smithi018 ceph-mon[34537]: pgmap v47: 97 pgs: 97 active+clean; 1.5 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 KiB/s wr, 6 op/s 2024-09-19T04:49:29.013 INFO:tasks.cephfs.filesystem:scrub status for tag:da24ae40-65d3-4024-8bd8-0be3a2ef760e - {'path': '/', 'tag': 'da24ae40-65d3-4024-8bd8-0be3a2ef760e', 'options': 'recursive,force'} 2024-09-19T04:49:30.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:49:30 smithi002 ceph-mon[30975]: pgmap v48: 97 pgs: 97 active+clean; 1.5 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 KiB/s wr, 6 op/s 2024-09-19T04:49:30.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:49:30 smithi116 ceph-mon[34477]: pgmap v48: 97 pgs: 97 active+clean; 1.5 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 KiB/s wr, 6 op/s 2024-09-19T04:49:30.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:49:30 smithi018 ceph-mon[34537]: pgmap v48: 97 pgs: 97 active+clean; 1.5 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 KiB/s wr, 6 op/s 2024-09-19T04:49:31.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:49:31 smithi002 ceph-mon[30975]: scrub summary: idle 2024-09-19T04:49:31.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:49:31 smithi116 ceph-mon[34477]: scrub summary: idle 2024-09-19T04:49:31.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:49:31 smithi018 ceph-mon[34537]: scrub summary: idle 2024-09-19T04:49:32.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:49:32 smithi002 ceph-mon[30975]: pgmap v49: 97 pgs: 97 active+clean; 1.6 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 10 op/s 2024-09-19T04:49:32.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:49:32 smithi002 ceph-mon[30975]: mgrmap e25: x(active, since 92s), standbys: y, z 2024-09-19T04:49:32.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:49:32 smithi116 ceph-mon[34477]: pgmap v49: 97 pgs: 97 active+clean; 1.6 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 10 op/s 2024-09-19T04:49:32.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:49:32 smithi116 ceph-mon[34477]: mgrmap e25: x(active, since 92s), standbys: y, z 2024-09-19T04:49:32.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:49:32 smithi018 ceph-mon[34537]: pgmap v49: 97 pgs: 97 active+clean; 1.6 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 10 op/s 2024-09-19T04:49:32.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:49:32 smithi018 ceph-mon[34537]: mgrmap e25: x(active, since 92s), standbys: y, z 2024-09-19T04:49:34.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:49:34 smithi002 ceph-mon[30975]: pgmap v50: 97 pgs: 97 active+clean; 1.6 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-09-19T04:49:34.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:49:34 smithi116 ceph-mon[34477]: pgmap v50: 97 pgs: 97 active+clean; 1.6 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-09-19T04:49:34.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:49:34 smithi018 ceph-mon[34537]: pgmap v50: 97 pgs: 97 active+clean; 1.6 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-09-19T04:49:36.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:49:36 smithi002 ceph-mon[30975]: pgmap v51: 97 pgs: 97 active+clean; 1.6 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 10 op/s 2024-09-19T04:49:36.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:49:36 smithi116 ceph-mon[34477]: pgmap v51: 97 pgs: 97 active+clean; 1.6 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 10 op/s 2024-09-19T04:49:36.806 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:49:36 smithi018 ceph-mon[34537]: pgmap v51: 97 pgs: 97 active+clean; 1.6 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 10 op/s 2024-09-19T04:49:38.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:49:38 smithi002 ceph-mon[30975]: pgmap v52: 97 pgs: 97 active+clean; 1.6 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-09-19T04:49:38.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:49:38 smithi116 ceph-mon[34477]: pgmap v52: 97 pgs: 97 active+clean; 1.6 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-09-19T04:49:38.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:49:38 smithi018 ceph-mon[34537]: pgmap v52: 97 pgs: 97 active+clean; 1.6 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-09-19T04:49:40.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:49:40 smithi002 ceph-mon[30975]: pgmap v53: 97 pgs: 97 active+clean; 1.6 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-09-19T04:49:40.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:49:40 smithi116 ceph-mon[34477]: pgmap v53: 97 pgs: 97 active+clean; 1.6 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-09-19T04:49:40.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:49:40 smithi018 ceph-mon[34537]: pgmap v53: 97 pgs: 97 active+clean; 1.6 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-09-19T04:49:42.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:49:42 smithi002 ceph-mon[30975]: pgmap v54: 97 pgs: 97 active+clean; 1.7 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 10 op/s 2024-09-19T04:49:42.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:49:42 smithi116 ceph-mon[34477]: pgmap v54: 97 pgs: 97 active+clean; 1.7 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 10 op/s 2024-09-19T04:49:42.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:49:42 smithi018 ceph-mon[34537]: pgmap v54: 97 pgs: 97 active+clean; 1.7 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 10 op/s 2024-09-19T04:49:44.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:49:44 smithi002 ceph-mon[30975]: pgmap v55: 97 pgs: 97 active+clean; 1.7 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-09-19T04:49:44.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:49:44 smithi116 ceph-mon[34477]: pgmap v55: 97 pgs: 97 active+clean; 1.7 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-09-19T04:49:44.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:49:44 smithi018 ceph-mon[34537]: pgmap v55: 97 pgs: 97 active+clean; 1.7 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-09-19T04:49:46.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:49:46 smithi002 ceph-mon[30975]: pgmap v56: 97 pgs: 97 active+clean; 1.8 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 11 op/s 2024-09-19T04:49:46.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:49:46 smithi116 ceph-mon[34477]: pgmap v56: 97 pgs: 97 active+clean; 1.8 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 11 op/s 2024-09-19T04:49:46.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:49:46 smithi018 ceph-mon[34537]: pgmap v56: 97 pgs: 97 active+clean; 1.8 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 11 op/s 2024-09-19T04:49:48.609 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:49:48 smithi018 ceph-mon[34537]: pgmap v57: 97 pgs: 97 active+clean; 1.8 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-09-19T04:49:48.609 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:49:48 smithi002 ceph-mon[30975]: pgmap v57: 97 pgs: 97 active+clean; 1.8 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-09-19T04:49:48.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:49:48 smithi116 ceph-mon[34477]: pgmap v57: 97 pgs: 97 active+clean; 1.8 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-09-19T04:49:50.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:49:50 smithi002 ceph-mon[30975]: pgmap v58: 97 pgs: 97 active+clean; 1.8 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-09-19T04:49:50.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:49:50 smithi116 ceph-mon[34477]: pgmap v58: 97 pgs: 97 active+clean; 1.8 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-09-19T04:49:50.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:49:50 smithi018 ceph-mon[34537]: pgmap v58: 97 pgs: 97 active+clean; 1.8 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-09-19T04:49:52.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:49:52 smithi002 ceph-mon[30975]: pgmap v59: 97 pgs: 97 active+clean; 1.9 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 10 op/s 2024-09-19T04:49:52.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:49:52 smithi116 ceph-mon[34477]: pgmap v59: 97 pgs: 97 active+clean; 1.9 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 10 op/s 2024-09-19T04:49:52.806 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:49:52 smithi018 ceph-mon[34537]: pgmap v59: 97 pgs: 97 active+clean; 1.9 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 10 op/s 2024-09-19T04:49:54.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:49:54 smithi018 ceph-mon[34537]: pgmap v60: 97 pgs: 97 active+clean; 1.9 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-09-19T04:49:54.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:49:54 smithi002 ceph-mon[30975]: pgmap v60: 97 pgs: 97 active+clean; 1.9 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-09-19T04:49:54.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:49:54 smithi116 ceph-mon[34477]: pgmap v60: 97 pgs: 97 active+clean; 1.9 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-09-19T04:49:56.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:49:56 smithi018 ceph-mon[34537]: pgmap v61: 97 pgs: 97 active+clean; 1.9 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 11 op/s 2024-09-19T04:49:56.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:49:56 smithi002 ceph-mon[30975]: pgmap v61: 97 pgs: 97 active+clean; 1.9 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 11 op/s 2024-09-19T04:49:56.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:49:56 smithi116 ceph-mon[34477]: pgmap v61: 97 pgs: 97 active+clean; 1.9 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 11 op/s 2024-09-19T04:49:58.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:49:58 smithi018 ceph-mon[34537]: pgmap v62: 97 pgs: 97 active+clean; 1.9 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-09-19T04:49:58.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:49:58 smithi002 ceph-mon[30975]: pgmap v62: 97 pgs: 97 active+clean; 1.9 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-09-19T04:49:58.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:49:58 smithi116 ceph-mon[34477]: pgmap v62: 97 pgs: 97 active+clean; 1.9 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-09-19T04:49:59.014 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:49:59.292 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:49:59.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.754+0000 7fc7d0712640 1 -- 172.21.15.2:0/1201779133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7c8101df0 msgr2=0x7fc7c81021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:59.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.754+0000 7fc7d0712640 1 --2- 172.21.15.2:0/1201779133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7c8101df0 0x7fc7c81021d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4009900 tx=0x7fc7c402a410 comp rx=0 tx=0).stop 2024-09-19T04:49:59.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.754+0000 7fc7d0712640 1 -- 172.21.15.2:0/1201779133 shutdown_connections 2024-09-19T04:49:59.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.754+0000 7fc7d0712640 1 --2- 172.21.15.2:0/1201779133 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7c8106f20 0x7fc7c810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:59.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.754+0000 7fc7d0712640 1 --2- 172.21.15.2:0/1201779133 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7c81027a0 0x7fc7c81067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:59.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.754+0000 7fc7d0712640 1 --2- 172.21.15.2:0/1201779133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7c8101df0 0x7fc7c81021d0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:59.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.754+0000 7fc7d0712640 1 -- 172.21.15.2:0/1201779133 >> 172.21.15.2:0/1201779133 conn(0x7fc7c80fd8f0 msgr2=0x7fc7c80ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:49:59.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.754+0000 7fc7d0712640 1 -- 172.21.15.2:0/1201779133 shutdown_connections 2024-09-19T04:49:59.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.754+0000 7fc7d0712640 1 -- 172.21.15.2:0/1201779133 wait complete. 2024-09-19T04:49:59.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.755+0000 7fc7d0712640 1 Processor -- start 2024-09-19T04:49:59.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.755+0000 7fc7d0712640 1 -- start start 2024-09-19T04:49:59.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.755+0000 7fc7d0712640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7c8101df0 0x7fc7c8198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:59.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.755+0000 7fc7d0712640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7c81027a0 0x7fc7c8198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:59.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.755+0000 7fc7d0712640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7c8106f20 0x7fc7c819cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:59.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.755+0000 7fc7d0712640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c8111e80 con 0x7fc7c8106f20 2024-09-19T04:49:59.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.755+0000 7fc7d0712640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c8111d00 con 0x7fc7c8101df0 2024-09-19T04:49:59.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.755+0000 7fc7d0712640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c8112000 con 0x7fc7c81027a0 2024-09-19T04:49:59.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.755+0000 7fc7cecaf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7c8106f20 0x7fc7c819cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:59.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.755+0000 7fc7cecaf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7c8106f20 0x7fc7c819cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45028/0 (socket says 172.21.15.2:45028) 2024-09-19T04:49:59.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.755+0000 7fc7cecaf640 1 -- 172.21.15.2:0/2461424798 learned_addr learned my addr 172.21.15.2:0/2461424798 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:49:59.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.755+0000 7fc7cdcad640 1 --2- 172.21.15.2:0/2461424798 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7c81027a0 0x7fc7c8198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:59.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.755+0000 7fc7ce4ae640 1 --2- 172.21.15.2:0/2461424798 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7c8101df0 0x7fc7c8198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:59.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.756+0000 7fc7cecaf640 1 -- 172.21.15.2:0/2461424798 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7c81027a0 msgr2=0x7fc7c8198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:59.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.756+0000 7fc7cecaf640 1 --2- 172.21.15.2:0/2461424798 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7c81027a0 0x7fc7c8198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:59.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.756+0000 7fc7cecaf640 1 -- 172.21.15.2:0/2461424798 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7c8101df0 msgr2=0x7fc7c8198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:59.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.756+0000 7fc7cecaf640 1 --2- 172.21.15.2:0/2461424798 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7c8101df0 0x7fc7c8198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:59.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.756+0000 7fc7cecaf640 1 -- 172.21.15.2:0/2461424798 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7c819d2d0 con 0x7fc7c8106f20 2024-09-19T04:49:59.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.756+0000 7fc7ce4ae640 1 --2- 172.21.15.2:0/2461424798 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7c8101df0 0x7fc7c8198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:49:59.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.756+0000 7fc7cecaf640 1 --2- 172.21.15.2:0/2461424798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7c8106f20 0x7fc7c819cbf0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc7c000cce0 tx=0x7fc7c000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:49:59.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.756+0000 7fc7bf7fe640 1 -- 172.21.15.2:0/2461424798 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c000f450 con 0x7fc7c8106f20 2024-09-19T04:49:59.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.756+0000 7fc7bf7fe640 1 -- 172.21.15.2:0/2461424798 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc7c000faa0 con 0x7fc7c8106f20 2024-09-19T04:49:59.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.756+0000 7fc7d0712640 1 -- 172.21.15.2:0/2461424798 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7c819d5c0 con 0x7fc7c8106f20 2024-09-19T04:49:59.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.756+0000 7fc7bf7fe640 1 -- 172.21.15.2:0/2461424798 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c0018b70 con 0x7fc7c8106f20 2024-09-19T04:49:59.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.756+0000 7fc7d0712640 1 -- 172.21.15.2:0/2461424798 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7c81a4ea0 con 0x7fc7c8106f20 2024-09-19T04:49:59.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.758+0000 7fc7bf7fe640 1 -- 172.21.15.2:0/2461424798 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fc7c0018d10 con 0x7fc7c8106f20 2024-09-19T04:49:59.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.759+0000 7fc7d2aeb740 1 Processor -- start 2024-09-19T04:49:59.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.759+0000 7fc7d2aeb740 1 -- start start 2024-09-19T04:49:59.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.759+0000 7fc7bf7fe640 1 --2- 172.21.15.2:0/2461424798 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fc7b40a33b0 0x7fc7b40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:59.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.759+0000 7fc7d2aeb740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560e511294a0 0x560e51129880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:59.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.759+0000 7fc7d2aeb740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560e51129dc0 0x560e51134140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:59.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.759+0000 7fc7d2aeb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e51134680 0x560e51136a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:59.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.759+0000 7fc7d2aeb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560e5108f2e0 con 0x560e51134680 2024-09-19T04:49:59.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.759+0000 7fc7d2aeb740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560e51036ce0 con 0x560e51129dc0 2024-09-19T04:49:59.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.759+0000 7fc7d2aeb740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x560e5108b2a0 con 0x560e511294a0 2024-09-19T04:49:59.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.760+0000 7fc7bf7fe640 1 -- 172.21.15.2:0/2461424798 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7fc7c00d00d0 con 0x7fc7c8106f20 2024-09-19T04:49:59.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.760+0000 7fc7cecaf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e51134680 0x560e51136a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:59.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.760+0000 7fc7cecaf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e51134680 0x560e51136a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45032/0 (socket says 172.21.15.2:45032) 2024-09-19T04:49:59.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.760+0000 7fc7cecaf640 1 -- 172.21.15.2:0/866854042 learned_addr learned my addr 172.21.15.2:0/866854042 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:49:59.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.760+0000 7fc7cdcad640 1 --2- 172.21.15.2:0/2461424798 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fc7b40a33b0 0x7fc7b40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:59.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.760+0000 7fc7cdcad640 1 --2- 172.21.15.2:0/866854042 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560e51129dc0 0x560e51134140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:59.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.760+0000 7fc7ce4ae640 1 --2- 172.21.15.2:0/866854042 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560e511294a0 0x560e51129880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:59.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.760+0000 7fc7cecaf640 1 -- 172.21.15.2:0/866854042 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560e511294a0 msgr2=0x560e51129880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:49:59.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.760+0000 7fc7cecaf640 1 --2- 172.21.15.2:0/866854042 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560e511294a0 0x560e51129880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:59.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.760+0000 7fc7cecaf640 1 -- 172.21.15.2:0/866854042 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560e51129dc0 msgr2=0x560e51134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:49:59.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.760+0000 7fc7cecaf640 1 --2- 172.21.15.2:0/866854042 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560e51129dc0 0x560e51134140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:59.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.760+0000 7fc7cecaf640 1 -- 172.21.15.2:0/866854042 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e5101b440 con 0x560e51134680 2024-09-19T04:49:59.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.760+0000 7fc7cdcad640 1 --2- 172.21.15.2:0/866854042 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560e51129dc0 0x560e51134140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:49:59.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.760+0000 7fc7ce4ae640 1 --2- 172.21.15.2:0/866854042 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560e511294a0 0x560e51129880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:49:59.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.760+0000 7fc7cecaf640 1 --2- 172.21.15.2:0/866854042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e51134680 0x560e51136a70 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc7c00cd8a0 tx=0x7fc7c009bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d9079ef9a297fc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:49:59.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.760+0000 7fc7cdcad640 1 --2- 172.21.15.2:0/2461424798 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fc7b40a33b0 0x7fc7b40a5870 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x560e51126890 tx=0x7fc7b8005ce0 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:49:59.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.760+0000 7fc7bcff9640 1 -- 172.21.15.2:0/866854042 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c009c3d0 con 0x560e51134680 2024-09-19T04:49:59.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.761+0000 7fc7bcff9640 1 -- 172.21.15.2:0/866854042 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc7c0086e50 con 0x560e51134680 2024-09-19T04:49:59.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.761+0000 7fc7bcff9640 1 -- 172.21.15.2:0/866854042 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c00cdc50 con 0x560e51134680 2024-09-19T04:49:59.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.761+0000 7fc7d2aeb740 1 -- 172.21.15.2:0/866854042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e51134680 msgr2=0x560e51136a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:59.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.761+0000 7fc7d2aeb740 1 --2- 172.21.15.2:0/866854042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e51134680 0x560e51136a70 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc7c00cd8a0 tx=0x7fc7c009bd30 comp rx=0 tx=0).stop 2024-09-19T04:49:59.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.761+0000 7fc7d2aeb740 1 -- 172.21.15.2:0/866854042 shutdown_connections 2024-09-19T04:49:59.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.761+0000 7fc7d2aeb740 1 --2- 172.21.15.2:0/866854042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e51134680 0x560e51136a70 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:59.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.761+0000 7fc7d2aeb740 1 --2- 172.21.15.2:0/866854042 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560e51129dc0 0x560e51134140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:59.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.761+0000 7fc7d2aeb740 1 --2- 172.21.15.2:0/866854042 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560e511294a0 0x560e51129880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:59.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.761+0000 7fc7d2aeb740 1 -- 172.21.15.2:0/866854042 >> 172.21.15.2:0/866854042 conn(0x560e51125a30 msgr2=0x560e51125e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:49:59.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.761+0000 7fc7d2aeb740 1 -- 172.21.15.2:0/866854042 shutdown_connections 2024-09-19T04:49:59.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.762+0000 7fc7d2aeb740 1 -- 172.21.15.2:0/866854042 wait complete. 2024-09-19T04:49:59.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.762+0000 7fc7d2aeb740 1 -- start start 2024-09-19T04:49:59.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.762+0000 7fc7d2aeb740 1 Processor -- start 2024-09-19T04:49:59.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.762+0000 7fc7d2aeb740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560e511294a0 0x560e51133fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:59.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.762+0000 7fc7d2aeb740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560e51129dc0 0x560e51131270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:59.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.762+0000 7fc7d2aeb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e51134680 0x560e511317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:59.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.762+0000 7fc7d2aeb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560e51137250 con 0x560e51134680 2024-09-19T04:49:59.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.762+0000 7fc7d2aeb740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560e5104a050 con 0x560e511294a0 2024-09-19T04:49:59.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.762+0000 7fc7d2aeb740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x560e511373d0 con 0x560e51129dc0 2024-09-19T04:49:59.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.762+0000 7fc7d2aeb740 10 client.0 _ll_register_callbacks cb 0x560e5108a160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:49:59.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.762+0000 7fc7cecaf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e51134680 0x560e511317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:59.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.762+0000 7fc7cecaf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e51134680 0x560e511317b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45040/0 (socket says 172.21.15.2:45040) 2024-09-19T04:49:59.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.762+0000 7fc7cecaf640 1 -- 172.21.15.2:0/885277831 learned_addr learned my addr 172.21.15.2:0/885277831 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:49:59.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.763+0000 7fc7ce4ae640 1 --2- 172.21.15.2:0/885277831 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560e511294a0 0x560e51133fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:59.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.763+0000 7fc7cdcad640 1 --2- 172.21.15.2:0/885277831 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560e51129dc0 0x560e51131270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:59.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.763+0000 7fc7cecaf640 1 -- 172.21.15.2:0/885277831 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560e51129dc0 msgr2=0x560e51131270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:49:59.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.763+0000 7fc7cecaf640 1 --2- 172.21.15.2:0/885277831 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560e51129dc0 0x560e51131270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:59.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.763+0000 7fc7cecaf640 1 -- 172.21.15.2:0/885277831 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560e511294a0 msgr2=0x560e51133fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:49:59.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.763+0000 7fc7cecaf640 1 --2- 172.21.15.2:0/885277831 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560e511294a0 0x560e51133fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:59.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.763+0000 7fc7cecaf640 1 -- 172.21.15.2:0/885277831 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e50e003c0 con 0x560e51134680 2024-09-19T04:49:59.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.763+0000 7fc7cecaf640 1 --2- 172.21.15.2:0/885277831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e51134680 0x560e511317b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0098830 tx=0x7fc7c009cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87b38b111a123ca7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:49:59.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.763+0000 7fc7b1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:49:59.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.763+0000 7fc7b1ffb640 1 -- 172.21.15.2:0/885277831 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c00cdc30 con 0x560e51134680 2024-09-19T04:49:59.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.763+0000 7fc7b1ffb640 1 -- 172.21.15.2:0/885277831 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7fc7c0059130 con 0x560e51134680 2024-09-19T04:49:59.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.763+0000 7fc7d2aeb740 1 -- 172.21.15.2:0/885277831 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7c0086e50 con 0x560e51134680 2024-09-19T04:49:59.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.763+0000 7fc7b1ffb640 1 -- 172.21.15.2:0/885277831 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fc7c00a5040 con 0x560e51134680 2024-09-19T04:49:59.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.763+0000 7fc7d2aeb740 10 client.15450 fetch_fsmap learned FSMap version 19 2024-09-19T04:49:59.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.763+0000 7fc7d2aeb740 1 -- 172.21.15.2:0/885277831 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x560e51142b70 con 0x560e51134680 2024-09-19T04:49:59.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.764+0000 7fc7b1ffb640 1 -- 172.21.15.2:0/885277831 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc7c0086e50 con 0x560e51134680 2024-09-19T04:49:59.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.764+0000 7fc7b1ffb640 1 -- 172.21.15.2:0/885277831 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fc7c009b820 con 0x560e51134680 2024-09-19T04:49:59.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.764+0000 7fc7d2aeb740 10 client.15450 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:49:59.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.764+0000 7fc7d2aeb740 10 client.15450 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:49:59.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.764+0000 7fc7d2aeb740 20 client.15450 populate_metadata read hostname 'smithi002' 2024-09-19T04:49:59.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.764+0000 7fc7d2aeb740 1 --2- 172.21.15.2:0/885277831 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560e51143ec0 0x560e511462b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:59.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.764+0000 7fc7d2aeb740 4 client.15450 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:49:59.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.764+0000 7fc7d2aeb740 1 -- 172.21.15.2:0/885277831 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560e5109c850 con 0x560e51143ec0 2024-09-19T04:49:59.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.764+0000 7fc7ce4ae640 1 --2- 172.21.15.2:0/885277831 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560e51143ec0 0x560e511462b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:59.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.765+0000 7fc7b1ffb640 10 client.15450 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:49:59.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.765+0000 7fc7ce4ae640 1 --2- 172.21.15.2:0/885277831 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560e51143ec0 0x560e511462b0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5af3540a4e590e6d server_cookie=c7ff1b885ad7eaf2 in_seq=0 out_seq=0 2024-09-19T04:49:59.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.765+0000 7fc7b1ffb640 1 -- 172.21.15.2:0/885277831 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560e5109c850 con 0x560e51143ec0 2024-09-19T04:49:59.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.765+0000 7fc7b1ffb640 10 client.15450 handle_command_reply: tid=0 2024-09-19T04:49:59.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.765+0000 7fc7d2aeb740 1 client.15450 shutdown 2024-09-19T04:49:59.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.766+0000 7fc7d2aeb740 1 -- 172.21.15.2:0/885277831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e51134680 msgr2=0x560e511317b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:59.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.766+0000 7fc7d2aeb740 1 --2- 172.21.15.2:0/885277831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e51134680 0x560e511317b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0098830 tx=0x7fc7c009cb90 comp rx=0 tx=0).stop 2024-09-19T04:49:59.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.766+0000 7fc7d2aeb740 1 -- 172.21.15.2:0/885277831 shutdown_connections 2024-09-19T04:49:59.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.766+0000 7fc7d2aeb740 1 --2- 172.21.15.2:0/885277831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e51134680 0x560e511317b0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:59.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.766+0000 7fc7d2aeb740 1 --2- 172.21.15.2:0/885277831 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560e51143ec0 0x560e511462b0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:59.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.766+0000 7fc7d2aeb740 1 --2- 172.21.15.2:0/885277831 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560e51129dc0 0x560e51131270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:59.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.766+0000 7fc7b1ffb640 0 client.15450 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:49:59.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.766+0000 7fc7d2aeb740 1 --2- 172.21.15.2:0/885277831 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560e511294a0 0x560e51133fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:59.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.766+0000 7fc7d2aeb740 1 -- 172.21.15.2:0/885277831 >> 172.21.15.2:0/885277831 conn(0x560e51125a30 msgr2=0x560e5112b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:49:59.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.766+0000 7fc7d2aeb740 1 -- 172.21.15.2:0/885277831 shutdown_connections 2024-09-19T04:49:59.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.766+0000 7fc7d2aeb740 1 -- 172.21.15.2:0/885277831 wait complete. 2024-09-19T04:49:59.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.766+0000 7fc7d2aeb740 20 client.15450 trim_cache size 0 max 16384 2024-09-19T04:49:59.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.783+0000 7fc7d2aeb740 1 Processor -- start 2024-09-19T04:49:59.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.783+0000 7fc7d2aeb740 1 -- start start 2024-09-19T04:49:59.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.783+0000 7fc7d2aeb740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560e511294a0 0x560e511492d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:59.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.783+0000 7fc7d2aeb740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560e51129dc0 0x560e51149810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:59.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.783+0000 7fc7d2aeb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e51134680 0x560e5112e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:59.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.783+0000 7fc7d2aeb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c81a94d0 con 0x560e51134680 2024-09-19T04:49:59.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.783+0000 7fc7d2aeb740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c81abd30 con 0x560e511294a0 2024-09-19T04:49:59.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.783+0000 7fc7d2aeb740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c81a9b20 con 0x560e51129dc0 2024-09-19T04:49:59.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.784+0000 7fc7cecaf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e51134680 0x560e5112e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:59.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.784+0000 7fc7cecaf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e51134680 0x560e5112e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45052/0 (socket says 172.21.15.2:45052) 2024-09-19T04:49:59.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.784+0000 7fc7cecaf640 1 -- 172.21.15.2:0/2510026039 learned_addr learned my addr 172.21.15.2:0/2510026039 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:49:59.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.784+0000 7fc7cdcad640 1 --2- 172.21.15.2:0/2510026039 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560e51129dc0 0x560e51149810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:59.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.784+0000 7fc7ce4ae640 1 --2- 172.21.15.2:0/2510026039 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560e511294a0 0x560e511492d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:59.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.784+0000 7fc7cecaf640 1 -- 172.21.15.2:0/2510026039 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560e51129dc0 msgr2=0x560e51149810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:49:59.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.784+0000 7fc7cecaf640 1 --2- 172.21.15.2:0/2510026039 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560e51129dc0 0x560e51149810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:59.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.784+0000 7fc7cecaf640 1 -- 172.21.15.2:0/2510026039 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560e511294a0 msgr2=0x560e511492d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:49:59.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.784+0000 7fc7cecaf640 1 --2- 172.21.15.2:0/2510026039 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560e511294a0 0x560e511492d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:59.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.784+0000 7fc7cecaf640 1 -- 172.21.15.2:0/2510026039 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e51129bf0 con 0x560e51134680 2024-09-19T04:49:59.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.784+0000 7fc7cdcad640 1 --2- 172.21.15.2:0/2510026039 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560e51129dc0 0x560e51149810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:49:59.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.784+0000 7fc7cecaf640 1 --2- 172.21.15.2:0/2510026039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e51134680 0x560e5112e4d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc7c009a680 tx=0x7fc7c009bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86e5a7c883406f5f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:49:59.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.784+0000 7fc7b3fff640 1 -- 172.21.15.2:0/2510026039 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c00cdac0 con 0x560e51134680 2024-09-19T04:49:59.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.784+0000 7fc7b3fff640 1 -- 172.21.15.2:0/2510026039 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc7c0086e50 con 0x560e51134680 2024-09-19T04:49:59.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.784+0000 7fc7b3fff640 1 -- 172.21.15.2:0/2510026039 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c00b5140 con 0x560e51134680 2024-09-19T04:49:59.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.785+0000 7fc7d2aeb740 1 -- 172.21.15.2:0/2510026039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e51134680 msgr2=0x560e5112e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:59.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.785+0000 7fc7d2aeb740 1 --2- 172.21.15.2:0/2510026039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e51134680 0x560e5112e4d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc7c009a680 tx=0x7fc7c009bd30 comp rx=0 tx=0).stop 2024-09-19T04:49:59.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.785+0000 7fc7d2aeb740 1 -- 172.21.15.2:0/2510026039 shutdown_connections 2024-09-19T04:49:59.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.785+0000 7fc7d2aeb740 1 --2- 172.21.15.2:0/2510026039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e51134680 0x560e5112e4d0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:59.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.785+0000 7fc7d2aeb740 1 --2- 172.21.15.2:0/2510026039 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560e51129dc0 0x560e51149810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:59.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.785+0000 7fc7d2aeb740 1 --2- 172.21.15.2:0/2510026039 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560e511294a0 0x560e511492d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:59.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.785+0000 7fc7d2aeb740 1 -- 172.21.15.2:0/2510026039 >> 172.21.15.2:0/2510026039 conn(0x560e51125a30 msgr2=0x560e511332f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:49:59.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.785+0000 7fc7d2aeb740 1 -- 172.21.15.2:0/2510026039 shutdown_connections 2024-09-19T04:49:59.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.785+0000 7fc7d2aeb740 1 -- 172.21.15.2:0/2510026039 wait complete. 2024-09-19T04:49:59.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.785+0000 7fc7d2aeb740 1 -- start start 2024-09-19T04:49:59.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.786+0000 7fc7d2aeb740 1 Processor -- start 2024-09-19T04:49:59.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.786+0000 7fc7d2aeb740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560e511294a0 0x560e511498a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:59.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.786+0000 7fc7d2aeb740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560e51129dc0 0x560e51146c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:59.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.786+0000 7fc7d2aeb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e51134680 0x560e51147180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:59.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.786+0000 7fc7d2aeb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c81aa1f0 con 0x560e51134680 2024-09-19T04:49:59.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.786+0000 7fc7d2aeb740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c81ab660 con 0x560e511294a0 2024-09-19T04:49:59.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.786+0000 7fc7d2aeb740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c81aa8c0 con 0x560e51129dc0 2024-09-19T04:49:59.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.786+0000 7fc7d2aeb740 10 client.0 _ll_register_callbacks cb 0x7fc7c009c250 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:49:59.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.786+0000 7fc7cecaf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e51134680 0x560e51147180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:59.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.786+0000 7fc7cecaf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e51134680 0x560e51147180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45060/0 (socket says 172.21.15.2:45060) 2024-09-19T04:49:59.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.786+0000 7fc7cecaf640 1 -- 172.21.15.2:0/774092296 learned_addr learned my addr 172.21.15.2:0/774092296 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:49:59.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.786+0000 7fc7ce4ae640 1 --2- 172.21.15.2:0/774092296 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560e511294a0 0x560e511498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:59.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.786+0000 7fc7cdcad640 1 --2- 172.21.15.2:0/774092296 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560e51129dc0 0x560e51146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:59.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.786+0000 7fc7cecaf640 1 -- 172.21.15.2:0/774092296 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560e51129dc0 msgr2=0x560e51146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:49:59.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.786+0000 7fc7cecaf640 1 --2- 172.21.15.2:0/774092296 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560e51129dc0 0x560e51146c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:59.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.786+0000 7fc7cecaf640 1 -- 172.21.15.2:0/774092296 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560e511294a0 msgr2=0x560e511498a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:49:59.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.786+0000 7fc7cecaf640 1 --2- 172.21.15.2:0/774092296 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560e511294a0 0x560e511498a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:59.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.786+0000 7fc7cecaf640 1 -- 172.21.15.2:0/774092296 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e511477f0 con 0x560e51134680 2024-09-19T04:49:59.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.787+0000 7fc7cecaf640 1 --2- 172.21.15.2:0/774092296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e51134680 0x560e51147180 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc7c000ab20 tx=0x7fc7c0018400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10a04569d1d9a159 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:49:59.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.787+0000 7fc7b1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:49:59.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.787+0000 7fc7b1ffb640 1 -- 172.21.15.2:0/774092296 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c00b5340 con 0x560e51134680 2024-09-19T04:49:59.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.787+0000 7fc7b1ffb640 1 -- 172.21.15.2:0/774092296 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7fc7c000f5f0 con 0x560e51134680 2024-09-19T04:49:59.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.787+0000 7fc7d2aeb740 1 -- 172.21.15.2:0/774092296 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7c0086e50 con 0x560e51134680 2024-09-19T04:49:59.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.787+0000 7fc7b1ffb640 1 -- 172.21.15.2:0/774092296 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fc7c000f7f0 con 0x560e51134680 2024-09-19T04:49:59.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.787+0000 7fc7d2aeb740 10 client.15456 fetch_fsmap learned FSMap version 19 2024-09-19T04:49:59.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.787+0000 7fc7d2aeb740 1 -- 172.21.15.2:0/774092296 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x560e511477f0 con 0x560e51134680 2024-09-19T04:49:59.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.787+0000 7fc7b1ffb640 1 -- 172.21.15.2:0/774092296 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc7c0086e50 con 0x560e51134680 2024-09-19T04:49:59.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.787+0000 7fc7b1ffb640 1 -- 172.21.15.2:0/774092296 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fc7c009b450 con 0x560e51134680 2024-09-19T04:49:59.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.787+0000 7fc7d2aeb740 10 client.15456 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:49:59.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.787+0000 7fc7d2aeb740 10 client.15456 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:49:59.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.787+0000 7fc7d2aeb740 20 client.15456 populate_metadata read hostname 'smithi002' 2024-09-19T04:49:59.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.787+0000 7fc7d2aeb740 1 --2- 172.21.15.2:0/774092296 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560e51143ec0 0x560e511b0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:49:59.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.787+0000 7fc7d2aeb740 4 client.15456 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:49:59.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.787+0000 7fc7d2aeb740 1 -- 172.21.15.2:0/774092296 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560e51096d60 con 0x560e51143ec0 2024-09-19T04:49:59.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.788+0000 7fc7ce4ae640 1 --2- 172.21.15.2:0/774092296 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560e51143ec0 0x560e511b0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:49:59.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.788+0000 7fc7ce4ae640 1 --2- 172.21.15.2:0/774092296 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560e51143ec0 0x560e511b0990 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e6326530546f468 server_cookie=16aa67fa407796d0 in_seq=0 out_seq=0 2024-09-19T04:49:59.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.788+0000 7fc7b1ffb640 10 client.15456 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:49:59.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.788+0000 7fc7b1ffb640 1 -- 172.21.15.2:0/774092296 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x560e51096d60 con 0x560e51143ec0 2024-09-19T04:49:59.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.788+0000 7fc7b1ffb640 10 client.15456 handle_command_reply: tid=0 2024-09-19T04:49:59.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.789+0000 7fc7d2aeb740 1 client.15456 shutdown 2024-09-19T04:49:59.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.789+0000 7fc7d2aeb740 1 -- 172.21.15.2:0/774092296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e51134680 msgr2=0x560e51147180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:59.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.789+0000 7fc7d2aeb740 1 --2- 172.21.15.2:0/774092296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e51134680 0x560e51147180 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc7c000ab20 tx=0x7fc7c0018400 comp rx=0 tx=0).stop 2024-09-19T04:49:59.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.789+0000 7fc7d2aeb740 1 -- 172.21.15.2:0/774092296 shutdown_connections 2024-09-19T04:49:59.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.789+0000 7fc7d2aeb740 1 --2- 172.21.15.2:0/774092296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e51134680 0x560e51147180 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:59.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.789+0000 7fc7d2aeb740 1 --2- 172.21.15.2:0/774092296 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560e51143ec0 0x560e511b0990 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:59.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.789+0000 7fc7d2aeb740 1 --2- 172.21.15.2:0/774092296 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560e51129dc0 0x560e51146c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:59.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.789+0000 7fc7d2aeb740 1 --2- 172.21.15.2:0/774092296 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560e511294a0 0x560e511498a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:59.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.789+0000 7fc7b1ffb640 0 client.15456 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:49:59.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.789+0000 7fc7d2aeb740 1 -- 172.21.15.2:0/774092296 >> 172.21.15.2:0/774092296 conn(0x560e51125a30 msgr2=0x560e5112aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:49:59.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.789+0000 7fc7d2aeb740 1 -- 172.21.15.2:0/774092296 shutdown_connections 2024-09-19T04:49:59.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.789+0000 7fc7d2aeb740 1 -- 172.21.15.2:0/774092296 wait complete. 2024-09-19T04:49:59.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.789+0000 7fc7d2aeb740 20 client.15456 trim_cache size 0 max 16384 2024-09-19T04:49:59.796 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:49:59.796 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T04:49:59.796 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T04:49:59.796 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:49:59.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.789+0000 7fc7d0712640 1 -- 172.21.15.2:0/2461424798 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fc7b40a33b0 msgr2=0x7fc7b40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:59.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.789+0000 7fc7d0712640 1 --2- 172.21.15.2:0/2461424798 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fc7b40a33b0 0x7fc7b40a5870 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x560e51126890 tx=0x7fc7b8005ce0 comp rx=0 tx=0).stop 2024-09-19T04:49:59.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.789+0000 7fc7d0712640 1 -- 172.21.15.2:0/2461424798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7c8106f20 msgr2=0x7fc7c819cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:49:59.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.789+0000 7fc7d0712640 1 --2- 172.21.15.2:0/2461424798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7c8106f20 0x7fc7c819cbf0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc7c000cce0 tx=0x7fc7c000a620 comp rx=0 tx=0).stop 2024-09-19T04:49:59.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.790+0000 7fc7d0712640 1 -- 172.21.15.2:0/2461424798 shutdown_connections 2024-09-19T04:49:59.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.790+0000 7fc7d0712640 1 --2- 172.21.15.2:0/2461424798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7c8106f20 0x7fc7c819cbf0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:59.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.790+0000 7fc7d0712640 1 --2- 172.21.15.2:0/2461424798 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fc7b40a33b0 0x7fc7b40a5870 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:59.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.790+0000 7fc7d0712640 1 --2- 172.21.15.2:0/2461424798 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7c81027a0 0x7fc7c8198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:59.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.790+0000 7fc7d0712640 1 --2- 172.21.15.2:0/2461424798 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7c8101df0 0x7fc7c8198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:49:59.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.790+0000 7fc7d0712640 1 -- 172.21.15.2:0/2461424798 >> 172.21.15.2:0/2461424798 conn(0x7fc7c80fd8f0 msgr2=0x7fc7c80fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:49:59.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.790+0000 7fc7d0712640 1 -- 172.21.15.2:0/2461424798 shutdown_connections 2024-09-19T04:49:59.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:49:59.790+0000 7fc7d0712640 1 -- 172.21.15.2:0/2461424798 wait complete. 2024-09-19T04:50:00.731 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:00 smithi002 ceph-mon[30975]: pgmap v63: 97 pgs: 97 active+clean; 1.9 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-09-19T04:50:00.731 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:00 smithi002 ceph-mon[30975]: overall HEALTH_OK 2024-09-19T04:50:00.759 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:50:00.759 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:50:00.806 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:00 smithi018 ceph-mon[34537]: pgmap v63: 97 pgs: 97 active+clean; 1.9 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-09-19T04:50:00.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:00 smithi018 ceph-mon[34537]: overall HEALTH_OK 2024-09-19T04:50:00.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:00 smithi116 ceph-mon[34477]: pgmap v63: 97 pgs: 97 active+clean; 1.9 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-09-19T04:50:00.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:00 smithi116 ceph-mon[34477]: overall HEALTH_OK 2024-09-19T04:50:01.034 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:50:01.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.500+0000 7f0202bf7640 1 -- 172.21.15.2:0/3620167922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01fc102790 msgr2=0x7f01fc1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:01.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.500+0000 7f0202bf7640 1 --2- 172.21.15.2:0/3620167922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01fc102790 0x7f01fc1067e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f01e4009900 tx=0x7f01e402a410 comp rx=0 tx=0).stop 2024-09-19T04:50:01.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.500+0000 7f0202bf7640 1 -- 172.21.15.2:0/3620167922 shutdown_connections 2024-09-19T04:50:01.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.500+0000 7f0202bf7640 1 --2- 172.21.15.2:0/3620167922 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f01fc106f10 0x7f01fc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:01.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.500+0000 7f0202bf7640 1 --2- 172.21.15.2:0/3620167922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01fc102790 0x7f01fc1067e0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:01.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.500+0000 7f0202bf7640 1 --2- 172.21.15.2:0/3620167922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01fc101de0 0x7f01fc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:01.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.500+0000 7f0202bf7640 1 -- 172.21.15.2:0/3620167922 >> 172.21.15.2:0/3620167922 conn(0x7f01fc0fd8e0 msgr2=0x7f01fc0ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:01.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.500+0000 7f0202bf7640 1 -- 172.21.15.2:0/3620167922 shutdown_connections 2024-09-19T04:50:01.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.500+0000 7f0202bf7640 1 -- 172.21.15.2:0/3620167922 wait complete. 2024-09-19T04:50:01.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.500+0000 7f0202bf7640 1 Processor -- start 2024-09-19T04:50:01.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.500+0000 7f0202bf7640 1 -- start start 2024-09-19T04:50:01.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.501+0000 7f0202bf7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01fc101de0 0x7f01fc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:01.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.501+0000 7f0202bf7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01fc102790 0x7f01fc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:01.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.501+0000 7f0202bf7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f01fc106f10 0x7f01fc074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:01.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.501+0000 7f0202bf7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f01fc111e40 con 0x7f01fc102790 2024-09-19T04:50:01.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.501+0000 7f0202bf7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f01fc111cc0 con 0x7f01fc101de0 2024-09-19T04:50:01.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.501+0000 7f0202bf7640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f01fc111fc0 con 0x7f01fc106f10 2024-09-19T04:50:01.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.501+0000 7f01fbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01fc102790 0x7f01fc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:01.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.501+0000 7f01fbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01fc102790 0x7f01fc074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37054/0 (socket says 172.21.15.2:37054) 2024-09-19T04:50:01.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.501+0000 7f01fbfff640 1 -- 172.21.15.2:0/28451513 learned_addr learned my addr 172.21.15.2:0/28451513 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:01.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.501+0000 7f0200993640 1 --2- 172.21.15.2:0/28451513 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01fc101de0 0x7f01fc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:01.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.501+0000 7f0201194640 1 --2- 172.21.15.2:0/28451513 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f01fc106f10 0x7f01fc074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:01.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.501+0000 7f01fbfff640 1 -- 172.21.15.2:0/28451513 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f01fc106f10 msgr2=0x7f01fc074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:01.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.501+0000 7f01fbfff640 1 --2- 172.21.15.2:0/28451513 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f01fc106f10 0x7f01fc074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:01.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.501+0000 7f01fbfff640 1 -- 172.21.15.2:0/28451513 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01fc101de0 msgr2=0x7f01fc0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:01.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.501+0000 7f01fbfff640 1 --2- 172.21.15.2:0/28451513 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01fc101de0 0x7f01fc0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:01.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.501+0000 7f01fbfff640 1 -- 172.21.15.2:0/28451513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01fc1a68b0 con 0x7f01fc102790 2024-09-19T04:50:01.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.501+0000 7f01fbfff640 1 --2- 172.21.15.2:0/28451513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01fc102790 0x7f01fc074a30 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f01e4005940 tx=0x7f01e4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:01.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.501+0000 7f01f9ffb640 1 -- 172.21.15.2:0/28451513 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e403f030 con 0x7f01fc102790 2024-09-19T04:50:01.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.502+0000 7f01f9ffb640 1 -- 172.21.15.2:0/28451513 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f01e4003aa0 con 0x7f01fc102790 2024-09-19T04:50:01.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.502+0000 7f0202bf7640 1 -- 172.21.15.2:0/28451513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01fc1a6b40 con 0x7f01fc102790 2024-09-19T04:50:01.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.502+0000 7f01f9ffb640 1 -- 172.21.15.2:0/28451513 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e4035070 con 0x7f01fc102790 2024-09-19T04:50:01.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.502+0000 7f0202bf7640 1 -- 172.21.15.2:0/28451513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01fc1a7070 con 0x7f01fc102790 2024-09-19T04:50:01.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.503+0000 7f0202bf7640 1 -- 172.21.15.2:0/28451513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01fc1021c0 con 0x7f01fc102790 2024-09-19T04:50:01.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.504+0000 7f01f9ffb640 1 -- 172.21.15.2:0/28451513 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f01e4042030 con 0x7f01fc102790 2024-09-19T04:50:01.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.505+0000 7f01f9ffb640 1 --2- 172.21.15.2:0/28451513 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f01e80a3430 0x7f01e80a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:01.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.505+0000 7f0200993640 1 --2- 172.21.15.2:0/28451513 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f01e80a3430 0x7f01e80a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:01.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.505+0000 7f01f9ffb640 1 -- 172.21.15.2:0/28451513 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f01e40f0490 con 0x7f01fc102790 2024-09-19T04:50:01.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.505+0000 7f0200993640 1 --2- 172.21.15.2:0/28451513 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f01e80a3430 0x7f01e80a58f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f01ec00bbe0 tx=0x7f01ec00b390 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:01.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.509+0000 7f01f9ffb640 1 -- 172.21.15.2:0/28451513 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f01e40bce30 con 0x7f01fc102790 2024-09-19T04:50:01.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.727+0000 7f0202bf7640 1 -- 172.21.15.2:0/28451513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f01fc10a0f0 con 0x7f01fc102790 2024-09-19T04:50:01.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.727+0000 7f01f9ffb640 1 -- 172.21.15.2:0/28451513 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11840 (secure 0 0 0) 0x7f01e40bc730 con 0x7f01fc102790 2024-09-19T04:50:01.729 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:50:01.729 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":19,"btime":"2024-09-19T04:46:33:537239+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2467365137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2467365137},{"type":"v1","addr":"172.21.15.2:6835","nonce":2467365137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3162441888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3162441888},{"type":"v1","addr":"172.21.15.2:6837","nonce":3162441888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14631,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2740862966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2740862966},{"type":"v1","addr":"172.21.15.2:6839","nonce":2740862966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/2394435504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2394435504},{"type":"v1","addr":"172.21.15.2:6841","nonce":2394435504}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1630480244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1630480244},{"type":"v1","addr":"172.21.15.18:6833","nonce":1630480244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1553897465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1553897465},{"type":"v1","addr":"172.21.15.116:6833","nonce":1553897465}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3035664608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3035664608},{"type":"v1","addr":"172.21.15.18:6835","nonce":3035664608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1096622392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1096622392},{"type":"v1","addr":"172.21.15.18:6837","nonce":1096622392}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3761157675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3761157675},{"type":"v1","addr":"172.21.15.116:6835","nonce":3761157675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/1120131594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1120131594},{"type":"v1","addr":"172.21.15.116:6837","nonce":1120131594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:46:24.050115+0000","modified":"2024-09-19T04:46:33.112369+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/4207677139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":4207677139},{"type":"v1","addr":"172.21.15.18:6839","nonce":4207677139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/2346874880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":2346874880},{"type":"v1","addr":"172.21.15.116:6839","nonce":2346874880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496]},"id":1}]} 2024-09-19T04:50:01.729 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 19 2024-09-19T04:50:01.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.729+0000 7f0202bf7640 1 -- 172.21.15.2:0/28451513 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f01e80a3430 msgr2=0x7f01e80a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:01.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.729+0000 7f0202bf7640 1 --2- 172.21.15.2:0/28451513 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f01e80a3430 0x7f01e80a58f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f01ec00bbe0 tx=0x7f01ec00b390 comp rx=0 tx=0).stop 2024-09-19T04:50:01.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.729+0000 7f0202bf7640 1 -- 172.21.15.2:0/28451513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01fc102790 msgr2=0x7f01fc074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:01.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.729+0000 7f0202bf7640 1 --2- 172.21.15.2:0/28451513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01fc102790 0x7f01fc074a30 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f01e4005940 tx=0x7f01e4004270 comp rx=0 tx=0).stop 2024-09-19T04:50:01.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.729+0000 7f0202bf7640 1 -- 172.21.15.2:0/28451513 shutdown_connections 2024-09-19T04:50:01.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.729+0000 7f0202bf7640 1 --2- 172.21.15.2:0/28451513 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f01e80a3430 0x7f01e80a58f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:01.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.729+0000 7f0202bf7640 1 --2- 172.21.15.2:0/28451513 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f01fc106f10 0x7f01fc074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:01.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.729+0000 7f0202bf7640 1 --2- 172.21.15.2:0/28451513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01fc102790 0x7f01fc074a30 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:01.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.729+0000 7f0202bf7640 1 --2- 172.21.15.2:0/28451513 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01fc101de0 0x7f01fc0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:01.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.729+0000 7f0202bf7640 1 -- 172.21.15.2:0/28451513 >> 172.21.15.2:0/28451513 conn(0x7f01fc0fd8e0 msgr2=0x7f01fc0fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:01.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.730+0000 7f0202bf7640 1 -- 172.21.15.2:0/28451513 shutdown_connections 2024-09-19T04:50:01.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:01.730+0000 7f0202bf7640 1 -- 172.21.15.2:0/28451513 wait complete. 2024-09-19T04:50:02.343 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:50:02.601 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:50:02.609 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:02 smithi002 ceph-mon[30975]: pgmap v64: 97 pgs: 97 active+clean; 2.0 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 10 op/s 2024-09-19T04:50:02.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:02 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/28451513' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:50:02.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:02 smithi018 ceph-mon[34537]: pgmap v64: 97 pgs: 97 active+clean; 2.0 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 10 op/s 2024-09-19T04:50:02.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:02 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/28451513' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:50:02.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:02 smithi116 ceph-mon[34477]: pgmap v64: 97 pgs: 97 active+clean; 2.0 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 10 op/s 2024-09-19T04:50:02.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:02 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/28451513' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:50:03.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.067+0000 7f502d3e1640 1 -- 172.21.15.2:0/1716627987 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f502810c180 msgr2=0x7f502810e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:03.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.067+0000 7f502d3e1640 1 --2- 172.21.15.2:0/1716627987 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f502810c180 0x7f502810e600 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f5020009900 tx=0x7f502002a480 comp rx=0 tx=0).stop 2024-09-19T04:50:03.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.067+0000 7f502d3e1640 1 -- 172.21.15.2:0/1716627987 shutdown_connections 2024-09-19T04:50:03.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.067+0000 7f502d3e1640 1 --2- 172.21.15.2:0/1716627987 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f502810c180 0x7f502810e600 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:03.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.067+0000 7f502d3e1640 1 --2- 172.21.15.2:0/1716627987 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50281036c0 0x7f502810bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:03.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.067+0000 7f502d3e1640 1 --2- 172.21.15.2:0/1716627987 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5028102da0 0x7f5028103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:03.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.067+0000 7f502d3e1640 1 -- 172.21.15.2:0/1716627987 >> 172.21.15.2:0/1716627987 conn(0x7f50280fc7a0 msgr2=0x7f50280febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:03.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.067+0000 7f502d3e1640 1 -- 172.21.15.2:0/1716627987 shutdown_connections 2024-09-19T04:50:03.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.067+0000 7f502d3e1640 1 -- 172.21.15.2:0/1716627987 wait complete. 2024-09-19T04:50:03.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.067+0000 7f502d3e1640 1 Processor -- start 2024-09-19T04:50:03.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.068+0000 7f502d3e1640 1 -- start start 2024-09-19T04:50:03.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.068+0000 7f502d3e1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5028102da0 0x7f5028198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:03.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.068+0000 7f502d3e1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50281036c0 0x7f5028198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:03.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.068+0000 7f502d3e1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f502810c180 0x7f502819cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:03.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.068+0000 7f502d3e1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5028111ed0 con 0x7f502810c180 2024-09-19T04:50:03.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.068+0000 7f502d3e1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5028111d50 con 0x7f50281036c0 2024-09-19T04:50:03.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.068+0000 7f502d3e1640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f5028112050 con 0x7f5028102da0 2024-09-19T04:50:03.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.068+0000 7f50277fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f502810c180 0x7f502819cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:03.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.068+0000 7f50277fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f502810c180 0x7f502819cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37064/0 (socket says 172.21.15.2:37064) 2024-09-19T04:50:03.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.068+0000 7f50277fe640 1 -- 172.21.15.2:0/4020232150 learned_addr learned my addr 172.21.15.2:0/4020232150 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:03.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.068+0000 7f50267fc640 1 --2- 172.21.15.2:0/4020232150 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50281036c0 0x7f5028198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:03.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.068+0000 7f5026ffd640 1 --2- 172.21.15.2:0/4020232150 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5028102da0 0x7f5028198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:03.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.068+0000 7f50277fe640 1 -- 172.21.15.2:0/4020232150 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5028102da0 msgr2=0x7f5028198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:03.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.068+0000 7f50277fe640 1 --2- 172.21.15.2:0/4020232150 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5028102da0 0x7f5028198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:03.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.068+0000 7f50277fe640 1 -- 172.21.15.2:0/4020232150 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50281036c0 msgr2=0x7f5028198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:03.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.068+0000 7f50277fe640 1 --2- 172.21.15.2:0/4020232150 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50281036c0 0x7f5028198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:03.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.068+0000 7f50277fe640 1 -- 172.21.15.2:0/4020232150 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f502819d4c0 con 0x7f502810c180 2024-09-19T04:50:03.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.068+0000 7f50267fc640 1 --2- 172.21.15.2:0/4020232150 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50281036c0 0x7f5028198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:50:03.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.069+0000 7f50277fe640 1 --2- 172.21.15.2:0/4020232150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f502810c180 0x7f502819cde0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f5020009a20 tx=0x7f50200042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:03.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.069+0000 7f501ffff640 1 -- 172.21.15.2:0/4020232150 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f502003f030 con 0x7f502810c180 2024-09-19T04:50:03.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.069+0000 7f502d3e1640 1 -- 172.21.15.2:0/4020232150 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f502819d750 con 0x7f502810c180 2024-09-19T04:50:03.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.069+0000 7f501ffff640 1 -- 172.21.15.2:0/4020232150 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f50200044d0 con 0x7f502810c180 2024-09-19T04:50:03.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.069+0000 7f501ffff640 1 -- 172.21.15.2:0/4020232150 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5020035070 con 0x7f502810c180 2024-09-19T04:50:03.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.069+0000 7f502d3e1640 1 -- 172.21.15.2:0/4020232150 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50281a5090 con 0x7f502810c180 2024-09-19T04:50:03.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.072+0000 7f502f7ba740 1 Processor -- start 2024-09-19T04:50:03.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.072+0000 7f501ffff640 1 -- 172.21.15.2:0/4020232150 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f5020042030 con 0x7f502810c180 2024-09-19T04:50:03.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.072+0000 7f502f7ba740 1 -- start start 2024-09-19T04:50:03.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.072+0000 7f502f7ba740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffad45eb40 0x55ffad45d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:03.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.072+0000 7f502f7ba740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ffad45d5d0 0x55ffad45da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:03.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.072+0000 7f502f7ba740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ffad468370 0x55ffad46a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:03.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.072+0000 7f502f7ba740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ffad3c32f0 con 0x55ffad468370 2024-09-19T04:50:03.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.072+0000 7f502f7ba740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ffad36acf0 con 0x55ffad45d5d0 2024-09-19T04:50:03.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.072+0000 7f502f7ba740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55ffad3bf2b0 con 0x55ffad45eb40 2024-09-19T04:50:03.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.073+0000 7f50267fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ffad468370 0x55ffad46a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:03.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.073+0000 7f50267fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ffad468370 0x55ffad46a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37076/0 (socket says 172.21.15.2:37076) 2024-09-19T04:50:03.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.073+0000 7f50267fc640 1 -- 172.21.15.2:0/2323315283 learned_addr learned my addr 172.21.15.2:0/2323315283 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:03.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.073+0000 7f5026ffd640 1 --2- 172.21.15.2:0/2323315283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ffad45d5d0 0x55ffad45da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:03.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.073+0000 7f50267fc640 1 --2- 172.21.15.2:0/2323315283 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffad45eb40 0x55ffad45d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:03.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.073+0000 7f50267fc640 1 -- 172.21.15.2:0/2323315283 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffad45eb40 msgr2=0x55ffad45d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:03.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.073+0000 7f50267fc640 1 --2- 172.21.15.2:0/2323315283 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffad45eb40 0x55ffad45d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:03.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.073+0000 7f50267fc640 1 -- 172.21.15.2:0/2323315283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ffad45d5d0 msgr2=0x55ffad45da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:03.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.073+0000 7f50267fc640 1 --2- 172.21.15.2:0/2323315283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ffad45d5d0 0x55ffad45da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:03.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.073+0000 7f50267fc640 1 -- 172.21.15.2:0/2323315283 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffad34f3a0 con 0x55ffad468370 2024-09-19T04:50:03.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.073+0000 7f501ffff640 1 --2- 172.21.15.2:0/4020232150 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f50140a33b0 0x7f50140a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:03.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.073+0000 7f50267fc640 1 --2- 172.21.15.2:0/2323315283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ffad468370 0x55ffad46a760 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5010016560 tx=0x7f501000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=548d6354cab492e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:03.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.073+0000 7f5026ffd640 1 --2- 172.21.15.2:0/4020232150 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f50140a33b0 0x7f50140a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:03.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.073+0000 7f501ffff640 1 -- 172.21.15.2:0/4020232150 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f50200f06b0 con 0x7f502810c180 2024-09-19T04:50:03.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.073+0000 7f501d7fa640 1 -- 172.21.15.2:0/2323315283 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5010018430 con 0x55ffad468370 2024-09-19T04:50:03.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.073+0000 7f501d7fa640 1 -- 172.21.15.2:0/2323315283 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5010018a80 con 0x55ffad468370 2024-09-19T04:50:03.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.073+0000 7f501d7fa640 1 -- 172.21.15.2:0/2323315283 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50100177d0 con 0x55ffad468370 2024-09-19T04:50:03.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.074+0000 7f502f7ba740 1 -- 172.21.15.2:0/2323315283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ffad468370 msgr2=0x55ffad46a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:03.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.074+0000 7f5026ffd640 1 --2- 172.21.15.2:0/4020232150 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f50140a33b0 0x7f50140a5870 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x55ffad45aac0 tx=0x7f501800e040 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:03.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.074+0000 7f502f7ba740 1 --2- 172.21.15.2:0/2323315283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ffad468370 0x55ffad46a760 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5010016560 tx=0x7f501000a340 comp rx=0 tx=0).stop 2024-09-19T04:50:03.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.074+0000 7f502f7ba740 1 -- 172.21.15.2:0/2323315283 shutdown_connections 2024-09-19T04:50:03.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.074+0000 7f502f7ba740 1 --2- 172.21.15.2:0/2323315283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ffad468370 0x55ffad46a760 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:03.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.074+0000 7f502f7ba740 1 --2- 172.21.15.2:0/2323315283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ffad45d5d0 0x55ffad45da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:03.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.074+0000 7f502f7ba740 1 --2- 172.21.15.2:0/2323315283 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffad45eb40 0x55ffad45d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:03.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.074+0000 7f502f7ba740 1 -- 172.21.15.2:0/2323315283 >> 172.21.15.2:0/2323315283 conn(0x55ffad426310 msgr2=0x55ffad459c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:03.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.074+0000 7f502f7ba740 1 -- 172.21.15.2:0/2323315283 shutdown_connections 2024-09-19T04:50:03.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.074+0000 7f502f7ba740 1 -- 172.21.15.2:0/2323315283 wait complete. 2024-09-19T04:50:03.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.075+0000 7f502f7ba740 1 -- start start 2024-09-19T04:50:03.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.075+0000 7f502f7ba740 1 Processor -- start 2024-09-19T04:50:03.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.075+0000 7f502f7ba740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ffad45d5d0 0x55ffad467d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:03.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.075+0000 7f502f7ba740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ffad45eb40 0x55ffad465020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:03.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.075+0000 7f502f7ba740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffad468370 0x55ffad465610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:03.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.075+0000 7f502f7ba740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ffad46b010 con 0x55ffad45d5d0 2024-09-19T04:50:03.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.075+0000 7f502f7ba740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ffad37e060 con 0x55ffad45eb40 2024-09-19T04:50:03.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.075+0000 7f502f7ba740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55ffad46b190 con 0x55ffad468370 2024-09-19T04:50:03.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.075+0000 7f502f7ba740 10 client.0 _ll_register_callbacks cb 0x55ffad0d18c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:50:03.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.075+0000 7f5026ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ffad45d5d0 0x55ffad467d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:03.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.075+0000 7f5026ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ffad45d5d0 0x55ffad467d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37092/0 (socket says 172.21.15.2:37092) 2024-09-19T04:50:03.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.075+0000 7f5026ffd640 1 -- 172.21.15.2:0/1417771410 learned_addr learned my addr 172.21.15.2:0/1417771410 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:03.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.075+0000 7f50267fc640 1 --2- 172.21.15.2:0/1417771410 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ffad45eb40 0x55ffad465020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:03.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.075+0000 7f50277fe640 1 --2- 172.21.15.2:0/1417771410 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffad468370 0x55ffad465610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:03.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.075+0000 7f5026ffd640 1 -- 172.21.15.2:0/1417771410 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffad468370 msgr2=0x55ffad465610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:03.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.075+0000 7f5026ffd640 1 --2- 172.21.15.2:0/1417771410 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffad468370 0x55ffad465610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:03.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.075+0000 7f5026ffd640 1 -- 172.21.15.2:0/1417771410 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ffad45eb40 msgr2=0x55ffad465020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:03.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.075+0000 7f5026ffd640 1 --2- 172.21.15.2:0/1417771410 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ffad45eb40 0x55ffad465020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:03.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.075+0000 7f5026ffd640 1 -- 172.21.15.2:0/1417771410 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffad1343c0 con 0x55ffad45d5d0 2024-09-19T04:50:03.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.076+0000 7f5026ffd640 1 --2- 172.21.15.2:0/1417771410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ffad45d5d0 0x55ffad467d70 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f5018007be0 tx=0x7f5018004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb5aa5f60b2e2c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:03.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.076+0000 7f500e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:50:03.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.076+0000 7f500e7fc640 1 -- 172.21.15.2:0/1417771410 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5018018cb0 con 0x55ffad45d5d0 2024-09-19T04:50:03.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.076+0000 7f500e7fc640 1 -- 172.21.15.2:0/1417771410 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f5018022400 con 0x55ffad45d5d0 2024-09-19T04:50:03.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.076+0000 7f502f7ba740 1 -- 172.21.15.2:0/1417771410 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5010018a80 con 0x55ffad45d5d0 2024-09-19T04:50:03.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.076+0000 7f500e7fc640 1 -- 172.21.15.2:0/1417771410 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f5018018e50 con 0x55ffad45d5d0 2024-09-19T04:50:03.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.076+0000 7f502f7ba740 10 client.15474 fetch_fsmap learned FSMap version 19 2024-09-19T04:50:03.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.076+0000 7f502f7ba740 1 -- 172.21.15.2:0/1417771410 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55ffad476b10 con 0x55ffad45d5d0 2024-09-19T04:50:03.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.076+0000 7f500e7fc640 1 -- 172.21.15.2:0/1417771410 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5010018a80 con 0x55ffad45d5d0 2024-09-19T04:50:03.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.076+0000 7f500e7fc640 1 -- 172.21.15.2:0/1417771410 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f501802b8f0 con 0x55ffad45d5d0 2024-09-19T04:50:03.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.077+0000 7f502f7ba740 10 client.15474 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:50:03.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.077+0000 7f502f7ba740 10 client.15474 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:50:03.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.077+0000 7f502f7ba740 20 client.15474 populate_metadata read hostname 'smithi002' 2024-09-19T04:50:03.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.077+0000 7f502f7ba740 1 --2- 172.21.15.2:0/1417771410 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55ffad477fd0 0x55ffad47a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:03.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.077+0000 7f502f7ba740 4 client.15474 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:50:03.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.077+0000 7f502f7ba740 1 -- 172.21.15.2:0/1417771410 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ffad3d0860 con 0x55ffad477fd0 2024-09-19T04:50:03.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.077+0000 7f50267fc640 1 --2- 172.21.15.2:0/1417771410 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55ffad477fd0 0x55ffad47a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:03.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.077+0000 7f500e7fc640 10 client.15474 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:50:03.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.077+0000 7f50267fc640 1 --2- 172.21.15.2:0/1417771410 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55ffad477fd0 0x55ffad47a3c0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f9b26d587ba2487 server_cookie=79dc1bf7dbf1c2ee in_seq=0 out_seq=0 2024-09-19T04:50:03.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.078+0000 7f500e7fc640 1 -- 172.21.15.2:0/1417771410 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ffad3d0860 con 0x55ffad477fd0 2024-09-19T04:50:03.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.078+0000 7f500e7fc640 10 client.15474 handle_command_reply: tid=0 2024-09-19T04:50:03.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.078+0000 7f502f7ba740 1 client.15474 shutdown 2024-09-19T04:50:03.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.078+0000 7f502f7ba740 1 -- 172.21.15.2:0/1417771410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ffad45d5d0 msgr2=0x55ffad467d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:03.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.078+0000 7f502f7ba740 1 --2- 172.21.15.2:0/1417771410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ffad45d5d0 0x55ffad467d70 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f5018007be0 tx=0x7f5018004b50 comp rx=0 tx=0).stop 2024-09-19T04:50:03.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.078+0000 7f502f7ba740 1 -- 172.21.15.2:0/1417771410 shutdown_connections 2024-09-19T04:50:03.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.078+0000 7f502f7ba740 1 --2- 172.21.15.2:0/1417771410 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55ffad477fd0 0x55ffad47a3c0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:03.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.078+0000 7f502f7ba740 1 --2- 172.21.15.2:0/1417771410 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffad468370 0x55ffad465610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:03.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.078+0000 7f502f7ba740 1 --2- 172.21.15.2:0/1417771410 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ffad45eb40 0x55ffad465020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:03.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.078+0000 7f502f7ba740 1 --2- 172.21.15.2:0/1417771410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ffad45d5d0 0x55ffad467d70 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:03.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.078+0000 7f500e7fc640 0 client.15474 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:50:03.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.078+0000 7f502f7ba740 1 -- 172.21.15.2:0/1417771410 >> 172.21.15.2:0/1417771410 conn(0x55ffad426310 msgr2=0x55ffad45f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:03.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.078+0000 7f502f7ba740 1 -- 172.21.15.2:0/1417771410 shutdown_connections 2024-09-19T04:50:03.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.078+0000 7f502f7ba740 1 -- 172.21.15.2:0/1417771410 wait complete. 2024-09-19T04:50:03.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.079+0000 7f502f7ba740 20 client.15474 trim_cache size 0 max 16384 2024-09-19T04:50:03.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.092+0000 7f502f7ba740 1 Processor -- start 2024-09-19T04:50:03.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.092+0000 7f502f7ba740 1 -- start start 2024-09-19T04:50:03.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.092+0000 7f502f7ba740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ffad45d5d0 0x55ffad4742b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:03.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.092+0000 7f502f7ba740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffad45eb40 0x55ffad4648e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:03.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.092+0000 7f502f7ba740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ffad468370 0x55ffad466f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:03.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.092+0000 7f502f7ba740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f50281ab820 con 0x55ffad468370 2024-09-19T04:50:03.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.092+0000 7f502f7ba740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f50281ae080 con 0x55ffad45d5d0 2024-09-19T04:50:03.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.092+0000 7f502f7ba740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f50281abe70 con 0x55ffad45eb40 2024-09-19T04:50:03.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.092+0000 7f50277fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ffad468370 0x55ffad466f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:03.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.092+0000 7f50277fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ffad468370 0x55ffad466f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37106/0 (socket says 172.21.15.2:37106) 2024-09-19T04:50:03.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.092+0000 7f50277fe640 1 -- 172.21.15.2:0/1161242998 learned_addr learned my addr 172.21.15.2:0/1161242998 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:03.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.092+0000 7f5026ffd640 1 --2- 172.21.15.2:0/1161242998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ffad45d5d0 0x55ffad4742b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:03.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.093+0000 7f50267fc640 1 --2- 172.21.15.2:0/1161242998 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffad45eb40 0x55ffad4648e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:03.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.093+0000 7f50277fe640 1 -- 172.21.15.2:0/1161242998 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffad45eb40 msgr2=0x55ffad4648e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:03.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.093+0000 7f50277fe640 1 --2- 172.21.15.2:0/1161242998 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffad45eb40 0x55ffad4648e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:03.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.093+0000 7f50277fe640 1 -- 172.21.15.2:0/1161242998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ffad45d5d0 msgr2=0x55ffad4742b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:03.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.093+0000 7f50277fe640 1 --2- 172.21.15.2:0/1161242998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ffad45d5d0 0x55ffad4742b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:03.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.093+0000 7f50277fe640 1 -- 172.21.15.2:0/1161242998 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffad463ff0 con 0x55ffad468370 2024-09-19T04:50:03.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.093+0000 7f50267fc640 1 --2- 172.21.15.2:0/1161242998 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffad45eb40 0x55ffad4648e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:50:03.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.093+0000 7f50277fe640 1 --2- 172.21.15.2:0/1161242998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ffad468370 0x55ffad466f90 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f50200bc940 tx=0x7f50200b8d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce3951407128e22b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:03.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.093+0000 7f501cff9640 1 -- 172.21.15.2:0/1161242998 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5020049040 con 0x55ffad468370 2024-09-19T04:50:03.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.093+0000 7f501cff9640 1 -- 172.21.15.2:0/1161242998 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f50200bc9b0 con 0x55ffad468370 2024-09-19T04:50:03.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.093+0000 7f501cff9640 1 -- 172.21.15.2:0/1161242998 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f502003bc90 con 0x55ffad468370 2024-09-19T04:50:03.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.094+0000 7f502f7ba740 1 -- 172.21.15.2:0/1161242998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ffad468370 msgr2=0x55ffad466f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:03.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.094+0000 7f502f7ba740 1 --2- 172.21.15.2:0/1161242998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ffad468370 0x55ffad466f90 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f50200bc940 tx=0x7f50200b8d80 comp rx=0 tx=0).stop 2024-09-19T04:50:03.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.094+0000 7f502f7ba740 1 -- 172.21.15.2:0/1161242998 shutdown_connections 2024-09-19T04:50:03.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.094+0000 7f502f7ba740 1 --2- 172.21.15.2:0/1161242998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ffad468370 0x55ffad466f90 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:03.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.094+0000 7f502f7ba740 1 --2- 172.21.15.2:0/1161242998 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffad45eb40 0x55ffad4648e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:03.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.094+0000 7f502f7ba740 1 --2- 172.21.15.2:0/1161242998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ffad45d5d0 0x55ffad4742b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:03.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.094+0000 7f502f7ba740 1 -- 172.21.15.2:0/1161242998 >> 172.21.15.2:0/1161242998 conn(0x55ffad426310 msgr2=0x55ffad466880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:03.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.094+0000 7f502f7ba740 1 -- 172.21.15.2:0/1161242998 shutdown_connections 2024-09-19T04:50:03.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.094+0000 7f502f7ba740 1 -- 172.21.15.2:0/1161242998 wait complete. 2024-09-19T04:50:03.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.094+0000 7f502f7ba740 1 -- start start 2024-09-19T04:50:03.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.094+0000 7f502f7ba740 1 Processor -- start 2024-09-19T04:50:03.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.095+0000 7f502f7ba740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ffad45d5d0 0x55ffad470420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:03.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.095+0000 7f502f7ba740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ffad45eb40 0x55ffad470960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:03.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.095+0000 7f502f7ba740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffad468370 0x55ffad46d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:03.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.095+0000 7f502f7ba740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f50281ac540 con 0x55ffad45eb40 2024-09-19T04:50:03.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.095+0000 7f502f7ba740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f50281ad9b0 con 0x55ffad45d5d0 2024-09-19T04:50:03.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.095+0000 7f502f7ba740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f50281acc10 con 0x55ffad468370 2024-09-19T04:50:03.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.095+0000 7f502f7ba740 10 client.0 _ll_register_callbacks cb 0x7f5018009e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:50:03.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.095+0000 7f50267fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ffad45eb40 0x55ffad470960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:03.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.095+0000 7f50267fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ffad45eb40 0x55ffad470960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37108/0 (socket says 172.21.15.2:37108) 2024-09-19T04:50:03.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.095+0000 7f50267fc640 1 -- 172.21.15.2:0/4069290396 learned_addr learned my addr 172.21.15.2:0/4069290396 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:03.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.095+0000 7f5026ffd640 1 --2- 172.21.15.2:0/4069290396 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ffad45d5d0 0x55ffad470420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:03.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.095+0000 7f50277fe640 1 --2- 172.21.15.2:0/4069290396 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffad468370 0x55ffad46d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:03.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.095+0000 7f50267fc640 1 -- 172.21.15.2:0/4069290396 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffad468370 msgr2=0x55ffad46d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:03.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.095+0000 7f50267fc640 1 --2- 172.21.15.2:0/4069290396 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffad468370 0x55ffad46d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:03.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.095+0000 7f50267fc640 1 -- 172.21.15.2:0/4069290396 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ffad45d5d0 msgr2=0x55ffad470420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:03.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.095+0000 7f50267fc640 1 --2- 172.21.15.2:0/4069290396 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ffad45d5d0 0x55ffad470420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:03.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.095+0000 7f50267fc640 1 -- 172.21.15.2:0/4069290396 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffad46d9b0 con 0x55ffad45eb40 2024-09-19T04:50:03.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.095+0000 7f50267fc640 1 --2- 172.21.15.2:0/4069290396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ffad45eb40 0x55ffad470960 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f5010016560 tx=0x7f5010006a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=606d7370e1b79b2c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:03.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.095+0000 7f500e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:50:03.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.095+0000 7f500e7fc640 1 -- 172.21.15.2:0/4069290396 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50100059c0 con 0x55ffad45eb40 2024-09-19T04:50:03.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.095+0000 7f500e7fc640 1 -- 172.21.15.2:0/4069290396 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f5010005b60 con 0x55ffad45eb40 2024-09-19T04:50:03.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.096+0000 7f502f7ba740 1 -- 172.21.15.2:0/4069290396 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50200bc9b0 con 0x55ffad45eb40 2024-09-19T04:50:03.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.096+0000 7f500e7fc640 1 -- 172.21.15.2:0/4069290396 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f5010005da0 con 0x55ffad45eb40 2024-09-19T04:50:03.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.096+0000 7f502f7ba740 10 client.15480 fetch_fsmap learned FSMap version 19 2024-09-19T04:50:03.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.096+0000 7f502f7ba740 1 -- 172.21.15.2:0/4069290396 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55ffad4e3460 con 0x55ffad45eb40 2024-09-19T04:50:03.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.096+0000 7f500e7fc640 1 -- 172.21.15.2:0/4069290396 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f50200bc9b0 con 0x55ffad45eb40 2024-09-19T04:50:03.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.096+0000 7f500e7fc640 1 -- 172.21.15.2:0/4069290396 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f5010033070 con 0x55ffad45eb40 2024-09-19T04:50:03.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.096+0000 7f502f7ba740 10 client.15480 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:50:03.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.096+0000 7f502f7ba740 10 client.15480 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:50:03.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.096+0000 7f502f7ba740 20 client.15480 populate_metadata read hostname 'smithi002' 2024-09-19T04:50:03.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.096+0000 7f502f7ba740 1 --2- 172.21.15.2:0/4069290396 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55ffad4e3bc0 0x55ffad4e5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:03.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.096+0000 7f502f7ba740 4 client.15480 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:50:03.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.096+0000 7f502f7ba740 1 -- 172.21.15.2:0/4069290396 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ffad3cad70 con 0x55ffad4e3bc0 2024-09-19T04:50:03.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.097+0000 7f5026ffd640 1 --2- 172.21.15.2:0/4069290396 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55ffad4e3bc0 0x55ffad4e5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:03.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.097+0000 7f5026ffd640 1 --2- 172.21.15.2:0/4069290396 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55ffad4e3bc0 0x55ffad4e5fe0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56b3e79f9f88f223 server_cookie=fa857789b6c3ff00 in_seq=0 out_seq=0 2024-09-19T04:50:03.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.097+0000 7f500e7fc640 10 client.15480 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:50:03.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.097+0000 7f500e7fc640 1 -- 172.21.15.2:0/4069290396 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ffad3cad70 con 0x55ffad4e3bc0 2024-09-19T04:50:03.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.097+0000 7f500e7fc640 10 client.15480 handle_command_reply: tid=0 2024-09-19T04:50:03.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.097+0000 7f502f7ba740 1 client.15480 shutdown 2024-09-19T04:50:03.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.097+0000 7f502f7ba740 1 -- 172.21.15.2:0/4069290396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ffad45eb40 msgr2=0x55ffad470960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:03.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.097+0000 7f502f7ba740 1 --2- 172.21.15.2:0/4069290396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ffad45eb40 0x55ffad470960 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f5010016560 tx=0x7f5010006a30 comp rx=0 tx=0).stop 2024-09-19T04:50:03.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.097+0000 7f502f7ba740 1 -- 172.21.15.2:0/4069290396 shutdown_connections 2024-09-19T04:50:03.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.097+0000 7f502f7ba740 1 --2- 172.21.15.2:0/4069290396 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55ffad4e3bc0 0x55ffad4e5fe0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:03.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.097+0000 7f502f7ba740 1 --2- 172.21.15.2:0/4069290396 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffad468370 0x55ffad46d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:03.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.097+0000 7f502f7ba740 1 --2- 172.21.15.2:0/4069290396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ffad45eb40 0x55ffad470960 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:03.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.097+0000 7f500e7fc640 0 client.15480 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:50:03.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.097+0000 7f502f7ba740 1 --2- 172.21.15.2:0/4069290396 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ffad45d5d0 0x55ffad470420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:03.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.097+0000 7f502f7ba740 1 -- 172.21.15.2:0/4069290396 >> 172.21.15.2:0/4069290396 conn(0x55ffad426310 msgr2=0x55ffad4670a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:03.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.098+0000 7f502f7ba740 1 -- 172.21.15.2:0/4069290396 shutdown_connections 2024-09-19T04:50:03.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.098+0000 7f502f7ba740 1 -- 172.21.15.2:0/4069290396 wait complete. 2024-09-19T04:50:03.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.098+0000 7f502f7ba740 20 client.15480 trim_cache size 0 max 16384 2024-09-19T04:50:03.106 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T04:50:03.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.098+0000 7f502d3e1640 1 -- 172.21.15.2:0/4020232150 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f50140a33b0 msgr2=0x7f50140a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:03.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.098+0000 7f502d3e1640 1 --2- 172.21.15.2:0/4020232150 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f50140a33b0 0x7f50140a5870 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x55ffad45aac0 tx=0x7f501800e040 comp rx=0 tx=0).stop 2024-09-19T04:50:03.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.098+0000 7f502d3e1640 1 -- 172.21.15.2:0/4020232150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f502810c180 msgr2=0x7f502819cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:03.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.098+0000 7f502d3e1640 1 --2- 172.21.15.2:0/4020232150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f502810c180 0x7f502819cde0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f5020009a20 tx=0x7f50200042e0 comp rx=0 tx=0).stop 2024-09-19T04:50:03.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.098+0000 7f502d3e1640 1 -- 172.21.15.2:0/4020232150 shutdown_connections 2024-09-19T04:50:03.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.098+0000 7f502d3e1640 1 --2- 172.21.15.2:0/4020232150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f502810c180 0x7f502819cde0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:03.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.098+0000 7f502d3e1640 1 --2- 172.21.15.2:0/4020232150 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50281036c0 0x7f5028198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:03.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.098+0000 7f502d3e1640 1 --2- 172.21.15.2:0/4020232150 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f50140a33b0 0x7f50140a5870 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:03.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.098+0000 7f502d3e1640 1 --2- 172.21.15.2:0/4020232150 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5028102da0 0x7f5028198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:03.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.098+0000 7f502d3e1640 1 -- 172.21.15.2:0/4020232150 >> 172.21.15.2:0/4020232150 conn(0x7f50280fc7a0 msgr2=0x7f50280fe230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:03.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.098+0000 7f502d3e1640 1 -- 172.21.15.2:0/4020232150 shutdown_connections 2024-09-19T04:50:03.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:03.098+0000 7f502d3e1640 1 -- 172.21.15.2:0/4020232150 wait complete. 2024-09-19T04:50:04.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:04 smithi018 ceph-mon[34537]: pgmap v65: 97 pgs: 97 active+clean; 2.0 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-09-19T04:50:04.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:04 smithi002 ceph-mon[30975]: pgmap v65: 97 pgs: 97 active+clean; 2.0 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-09-19T04:50:04.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:04 smithi116 ceph-mon[34477]: pgmap v65: 97 pgs: 97 active+clean; 2.0 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-09-19T04:50:04.970 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:50:04.970 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:50:05.243 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:50:05.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.836+0000 7f9a0757e640 1 -- 172.21.15.2:0/854374825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a001082a0 msgr2=0x7f9a0010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:05.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.836+0000 7f9a0757e640 1 --2- 172.21.15.2:0/854374825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a001082a0 0x7f9a0010ec40 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f99f8009cd0 tx=0x7f99f802a8e0 comp rx=0 tx=0).stop 2024-09-19T04:50:05.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.836+0000 7f9a0757e640 1 -- 172.21.15.2:0/854374825 shutdown_connections 2024-09-19T04:50:05.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.836+0000 7f9a0757e640 1 --2- 172.21.15.2:0/854374825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a001082a0 0x7f9a0010ec40 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:05.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.836+0000 7f9a0757e640 1 --2- 172.21.15.2:0/854374825 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a001036e0 0x7f9a00107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:05.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.836+0000 7f9a0757e640 1 --2- 172.21.15.2:0/854374825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a00102d30 0x7f9a00103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:05.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.836+0000 7f9a0757e640 1 -- 172.21.15.2:0/854374825 >> 172.21.15.2:0/854374825 conn(0x7f9a000fc7d0 msgr2=0x7f9a000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:05.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.836+0000 7f9a0757e640 1 -- 172.21.15.2:0/854374825 shutdown_connections 2024-09-19T04:50:05.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.836+0000 7f9a0757e640 1 -- 172.21.15.2:0/854374825 wait complete. 2024-09-19T04:50:05.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.837+0000 7f9a0757e640 1 Processor -- start 2024-09-19T04:50:05.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.837+0000 7f9a0757e640 1 -- start start 2024-09-19T04:50:05.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.837+0000 7f9a0757e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a00102d30 0x7f9a00198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:05.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.837+0000 7f9a0757e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a001036e0 0x7f9a001989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:05.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.837+0000 7f9a0757e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a001082a0 0x7f9a0019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:05.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.837+0000 7f9a0757e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9a00111f30 con 0x7f9a001082a0 2024-09-19T04:50:05.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.837+0000 7f9a0757e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9a00111db0 con 0x7f9a001036e0 2024-09-19T04:50:05.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.837+0000 7f9a0757e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f9a001120b0 con 0x7f9a00102d30 2024-09-19T04:50:05.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.837+0000 7f9a05b1b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a001082a0 0x7f9a0019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:05.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.837+0000 7f9a05b1b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a001082a0 0x7f9a0019cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37132/0 (socket says 172.21.15.2:37132) 2024-09-19T04:50:05.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.837+0000 7f9a05b1b640 1 -- 172.21.15.2:0/732239571 learned_addr learned my addr 172.21.15.2:0/732239571 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:05.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.837+0000 7f9a0531a640 1 --2- 172.21.15.2:0/732239571 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a00102d30 0x7f9a00198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:05.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.837+0000 7f9a04b19640 1 --2- 172.21.15.2:0/732239571 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a001036e0 0x7f9a001989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:05.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.837+0000 7f9a05b1b640 1 -- 172.21.15.2:0/732239571 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a00102d30 msgr2=0x7f9a00198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:05.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.837+0000 7f9a05b1b640 1 --2- 172.21.15.2:0/732239571 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a00102d30 0x7f9a00198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:05.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.837+0000 7f9a05b1b640 1 -- 172.21.15.2:0/732239571 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a001036e0 msgr2=0x7f9a001989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:05.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.837+0000 7f9a05b1b640 1 --2- 172.21.15.2:0/732239571 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a001036e0 0x7f9a001989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:05.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.837+0000 7f9a05b1b640 1 -- 172.21.15.2:0/732239571 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a0019d440 con 0x7f9a001082a0 2024-09-19T04:50:05.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.838+0000 7f9a05b1b640 1 --2- 172.21.15.2:0/732239571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a001082a0 0x7f9a0019cd60 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f99f8005cc0 tx=0x7f99f8003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:05.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.838+0000 7f99f67fc640 1 -- 172.21.15.2:0/732239571 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f8004450 con 0x7f9a001082a0 2024-09-19T04:50:05.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.838+0000 7f99f67fc640 1 -- 172.21.15.2:0/732239571 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f99f8031c90 con 0x7f9a001082a0 2024-09-19T04:50:05.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.838+0000 7f9a0757e640 1 -- 172.21.15.2:0/732239571 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a0019d6d0 con 0x7f9a001082a0 2024-09-19T04:50:05.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.838+0000 7f99f67fc640 1 -- 172.21.15.2:0/732239571 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f803b400 con 0x7f9a001082a0 2024-09-19T04:50:05.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.838+0000 7f9a0757e640 1 -- 172.21.15.2:0/732239571 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a001a5010 con 0x7f9a001082a0 2024-09-19T04:50:05.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.841+0000 7f99f67fc640 1 -- 172.21.15.2:0/732239571 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f99f8004680 con 0x7f9a001082a0 2024-09-19T04:50:05.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.841+0000 7f9a09957740 1 Processor -- start 2024-09-19T04:50:05.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.841+0000 7f9a09957740 1 -- start start 2024-09-19T04:50:05.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.841+0000 7f9a09957740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564036574a80 0x564036574e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:05.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.841+0000 7f9a09957740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5640365753a0 0x564036583c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:05.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.841+0000 7f9a09957740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564036584150 0x564036586540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:05.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.841+0000 7f9a09957740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5640364da280 con 0x564036574a80 2024-09-19T04:50:05.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.841+0000 7f9a09957740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564036481b10 con 0x564036584150 2024-09-19T04:50:05.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.841+0000 7f9a09957740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5640364d6240 con 0x5640365753a0 2024-09-19T04:50:05.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.841+0000 7f9a04b19640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564036574a80 0x564036574e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:05.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.841+0000 7f9a04b19640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564036574a80 0x564036574e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37144/0 (socket says 172.21.15.2:37144) 2024-09-19T04:50:05.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.841+0000 7f9a04b19640 1 -- 172.21.15.2:0/1907392892 learned_addr learned my addr 172.21.15.2:0/1907392892 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:05.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.841+0000 7f9a0531a640 1 --2- 172.21.15.2:0/1907392892 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5640365753a0 0x564036583c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:05.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.841+0000 7f9a04b19640 1 --2- 172.21.15.2:0/1907392892 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564036584150 0x564036586540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:05.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.841+0000 7f99f67fc640 1 --2- 172.21.15.2:0/732239571 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f99ec0a33b0 0x7f99ec0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:05.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.842+0000 7f9a04b19640 1 -- 172.21.15.2:0/1907392892 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5640365753a0 msgr2=0x564036583c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:05.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.842+0000 7f9a04b19640 1 --2- 172.21.15.2:0/1907392892 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5640365753a0 0x564036583c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:05.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.842+0000 7f9a04b19640 1 -- 172.21.15.2:0/1907392892 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564036584150 msgr2=0x564036586540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:05.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.842+0000 7f9a04b19640 1 --2- 172.21.15.2:0/1907392892 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564036584150 0x564036586540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:05.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.842+0000 7f9a04b19640 1 -- 172.21.15.2:0/1907392892 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56403648e1f0 con 0x564036574a80 2024-09-19T04:50:05.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.842+0000 7f9a05b1b640 1 --2- 172.21.15.2:0/732239571 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f99ec0a33b0 0x7f99ec0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:05.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.842+0000 7f9a04b19640 1 --2- 172.21.15.2:0/1907392892 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564036574a80 0x564036574e60 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f99f0011410 tx=0x7f99f000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf7aac6fbfb817a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:05.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.842+0000 7f99f67fc640 1 -- 172.21.15.2:0/732239571 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f99f802e030 con 0x7f9a001082a0 2024-09-19T04:50:05.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.842+0000 7f99eb7fe640 1 -- 172.21.15.2:0/1907392892 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f0004020 con 0x564036574a80 2024-09-19T04:50:05.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.842+0000 7f99eb7fe640 1 -- 172.21.15.2:0/1907392892 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f99f00041c0 con 0x564036574a80 2024-09-19T04:50:05.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.842+0000 7f99eb7fe640 1 -- 172.21.15.2:0/1907392892 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f0012450 con 0x564036574a80 2024-09-19T04:50:05.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.843+0000 7f9a09957740 1 -- 172.21.15.2:0/1907392892 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564036574a80 msgr2=0x564036574e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:05.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.843+0000 7f9a09957740 1 --2- 172.21.15.2:0/1907392892 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564036574a80 0x564036574e60 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f99f0011410 tx=0x7f99f000a660 comp rx=0 tx=0).stop 2024-09-19T04:50:05.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.843+0000 7f9a05b1b640 1 --2- 172.21.15.2:0/732239571 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f99ec0a33b0 0x7f99ec0a5870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f99f80bcc50 tx=0x7f99f807f040 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:05.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.843+0000 7f9a09957740 1 -- 172.21.15.2:0/1907392892 shutdown_connections 2024-09-19T04:50:05.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.843+0000 7f9a09957740 1 --2- 172.21.15.2:0/1907392892 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564036584150 0x564036586540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:05.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.843+0000 7f9a09957740 1 --2- 172.21.15.2:0/1907392892 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5640365753a0 0x564036583c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:05.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.843+0000 7f9a09957740 1 --2- 172.21.15.2:0/1907392892 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564036574a80 0x564036574e60 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:05.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.843+0000 7f9a09957740 1 -- 172.21.15.2:0/1907392892 >> 172.21.15.2:0/1907392892 conn(0x5640365710f0 msgr2=0x5640365714d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:05.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.843+0000 7f9a09957740 1 -- 172.21.15.2:0/1907392892 shutdown_connections 2024-09-19T04:50:05.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.843+0000 7f9a09957740 1 -- 172.21.15.2:0/1907392892 wait complete. 2024-09-19T04:50:05.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.843+0000 7f9a09957740 1 -- start start 2024-09-19T04:50:05.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.843+0000 7f9a09957740 1 Processor -- start 2024-09-19T04:50:05.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.844+0000 7f9a09957740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564036574a80 0x5640365810b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:05.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.844+0000 7f9a09957740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640365753a0 0x5640365815f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:05.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.844+0000 7f9a09957740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564036584150 0x564036581b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:05.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.844+0000 7f9a09957740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564036586cc0 con 0x564036584150 2024-09-19T04:50:05.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.844+0000 7f9a09957740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564036494f10 con 0x5640365753a0 2024-09-19T04:50:05.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.844+0000 7f9a09957740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x564036586e40 con 0x564036574a80 2024-09-19T04:50:05.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.844+0000 7f9a09957740 10 client.0 _ll_register_callbacks cb 0x56403645da40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:50:05.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.844+0000 7f9a04b19640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564036584150 0x564036581b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:05.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.844+0000 7f9a04b19640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564036584150 0x564036581b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37150/0 (socket says 172.21.15.2:37150) 2024-09-19T04:50:05.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.844+0000 7f9a04b19640 1 -- 172.21.15.2:0/287122230 learned_addr learned my addr 172.21.15.2:0/287122230 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:05.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.844+0000 7f9a0531a640 1 --2- 172.21.15.2:0/287122230 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640365753a0 0x5640365815f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:05.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.844+0000 7f9a04b19640 1 --2- 172.21.15.2:0/287122230 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564036574a80 0x5640365810b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:05.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.844+0000 7f9a04b19640 1 -- 172.21.15.2:0/287122230 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564036574a80 msgr2=0x5640365810b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:05.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.844+0000 7f9a04b19640 1 --2- 172.21.15.2:0/287122230 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564036574a80 0x5640365810b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:05.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.844+0000 7f9a04b19640 1 -- 172.21.15.2:0/287122230 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640365753a0 msgr2=0x5640365815f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:05.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.844+0000 7f9a04b19640 1 --2- 172.21.15.2:0/287122230 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640365753a0 0x5640365815f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:05.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.844+0000 7f9a04b19640 1 -- 172.21.15.2:0/287122230 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56403624b6a0 con 0x564036584150 2024-09-19T04:50:05.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.844+0000 7f9a04b19640 1 --2- 172.21.15.2:0/287122230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564036584150 0x564036581b30 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f99f00045a0 tx=0x7f99f0003b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e6f2dfab0ac2305 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:05.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.844+0000 7f99e8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:50:05.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.845+0000 7f99e8ff9640 1 -- 172.21.15.2:0/287122230 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f000aac0 con 0x564036584150 2024-09-19T04:50:05.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.845+0000 7f9a09957740 1 -- 172.21.15.2:0/287122230 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99f00041c0 con 0x564036584150 2024-09-19T04:50:05.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.845+0000 7f99e8ff9640 1 -- 172.21.15.2:0/287122230 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f99f0012450 con 0x564036584150 2024-09-19T04:50:05.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.845+0000 7f99e8ff9640 1 -- 172.21.15.2:0/287122230 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f99f0012650 con 0x564036584150 2024-09-19T04:50:05.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.845+0000 7f9a09957740 10 client.15492 fetch_fsmap learned FSMap version 19 2024-09-19T04:50:05.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.845+0000 7f9a09957740 1 -- 172.21.15.2:0/287122230 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x564036592980 con 0x564036584150 2024-09-19T04:50:05.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.845+0000 7f99e8ff9640 1 -- 172.21.15.2:0/287122230 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f99f00041c0 con 0x564036584150 2024-09-19T04:50:05.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.845+0000 7f99e8ff9640 1 -- 172.21.15.2:0/287122230 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f99f000f4e0 con 0x564036584150 2024-09-19T04:50:05.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.845+0000 7f9a09957740 10 client.15492 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:50:05.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.845+0000 7f9a09957740 10 client.15492 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:50:05.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.845+0000 7f9a09957740 20 client.15492 populate_metadata read hostname 'smithi002' 2024-09-19T04:50:05.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.845+0000 7f9a09957740 1 --2- 172.21.15.2:0/287122230 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x564036593d30 0x564036596120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:05.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.845+0000 7f9a09957740 4 client.15492 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:50:05.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.845+0000 7f9a09957740 1 -- 172.21.15.2:0/287122230 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5640364e77f0 con 0x564036593d30 2024-09-19T04:50:05.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.846+0000 7f9a0531a640 1 --2- 172.21.15.2:0/287122230 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x564036593d30 0x564036596120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:05.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.846+0000 7f9a0531a640 1 --2- 172.21.15.2:0/287122230 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x564036593d30 0x564036596120 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2685a01783b8d20 server_cookie=8c56d969025deed9 in_seq=0 out_seq=0 2024-09-19T04:50:05.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.846+0000 7f99e8ff9640 10 client.15492 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:50:05.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.847+0000 7f99e8ff9640 1 -- 172.21.15.2:0/287122230 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5640364e77f0 con 0x564036593d30 2024-09-19T04:50:05.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.847+0000 7f99e8ff9640 10 client.15492 handle_command_reply: tid=0 2024-09-19T04:50:05.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.847+0000 7f9a09957740 1 client.15492 shutdown 2024-09-19T04:50:05.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.847+0000 7f9a09957740 1 -- 172.21.15.2:0/287122230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564036584150 msgr2=0x564036581b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:05.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.847+0000 7f9a09957740 1 --2- 172.21.15.2:0/287122230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564036584150 0x564036581b30 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f99f00045a0 tx=0x7f99f0003b40 comp rx=0 tx=0).stop 2024-09-19T04:50:05.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.847+0000 7f9a09957740 1 -- 172.21.15.2:0/287122230 shutdown_connections 2024-09-19T04:50:05.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.847+0000 7f9a09957740 1 --2- 172.21.15.2:0/287122230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564036584150 0x564036581b30 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:05.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.847+0000 7f9a09957740 1 --2- 172.21.15.2:0/287122230 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640365753a0 0x5640365815f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:05.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.847+0000 7f9a09957740 1 --2- 172.21.15.2:0/287122230 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x564036593d30 0x564036596120 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:05.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.847+0000 7f9a09957740 1 --2- 172.21.15.2:0/287122230 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564036574a80 0x5640365810b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:05.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.847+0000 7f99e8ff9640 0 client.15492 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:50:05.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.847+0000 7f9a09957740 1 -- 172.21.15.2:0/287122230 >> 172.21.15.2:0/287122230 conn(0x5640365710f0 msgr2=0x564036570270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:05.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.847+0000 7f9a09957740 1 -- 172.21.15.2:0/287122230 shutdown_connections 2024-09-19T04:50:05.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.847+0000 7f9a09957740 1 -- 172.21.15.2:0/287122230 wait complete. 2024-09-19T04:50:05.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.847+0000 7f9a09957740 20 client.15492 trim_cache size 0 max 16384 2024-09-19T04:50:05.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.865+0000 7f9a09957740 1 Processor -- start 2024-09-19T04:50:05.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.865+0000 7f9a09957740 1 -- start start 2024-09-19T04:50:05.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.865+0000 7f9a09957740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564036574a80 0x564036582f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:05.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.865+0000 7f9a09957740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640365753a0 0x56403659b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:05.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.865+0000 7f9a09957740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564036584150 0x56403659bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:05.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.865+0000 7f9a09957740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9a001a9510 con 0x5640365753a0 2024-09-19T04:50:05.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.865+0000 7f9a09957740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9a001abd70 con 0x564036574a80 2024-09-19T04:50:05.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.865+0000 7f9a09957740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f9a001a9b60 con 0x564036584150 2024-09-19T04:50:05.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.865+0000 7f9a0531a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640365753a0 0x56403659b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:05.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.865+0000 7f9a0531a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640365753a0 0x56403659b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37164/0 (socket says 172.21.15.2:37164) 2024-09-19T04:50:05.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.865+0000 7f9a0531a640 1 -- 172.21.15.2:0/1234533594 learned_addr learned my addr 172.21.15.2:0/1234533594 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:05.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.865+0000 7f9a04b19640 1 --2- 172.21.15.2:0/1234533594 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564036584150 0x56403659bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:05.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.865+0000 7f9a04b19640 1 --2- 172.21.15.2:0/1234533594 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564036574a80 0x564036582f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:05.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.865+0000 7f9a0531a640 1 -- 172.21.15.2:0/1234533594 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564036584150 msgr2=0x56403659bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:05.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.865+0000 7f9a0531a640 1 --2- 172.21.15.2:0/1234533594 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564036584150 0x56403659bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:05.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.865+0000 7f9a0531a640 1 -- 172.21.15.2:0/1234533594 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564036574a80 msgr2=0x564036582f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:05.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.865+0000 7f9a0531a640 1 --2- 172.21.15.2:0/1234533594 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564036574a80 0x564036582f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:05.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.865+0000 7f9a0531a640 1 -- 172.21.15.2:0/1234533594 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564036575190 con 0x5640365753a0 2024-09-19T04:50:05.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.866+0000 7f9a0531a640 1 --2- 172.21.15.2:0/1234533594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640365753a0 0x56403659b840 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x564036580940 tx=0x7f99fc00b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b6064d13d74b6cb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:05.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.866+0000 7f99eaffd640 1 -- 172.21.15.2:0/1234533594 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99fc004220 con 0x5640365753a0 2024-09-19T04:50:05.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.866+0000 7f99eaffd640 1 -- 172.21.15.2:0/1234533594 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f99fc0043c0 con 0x5640365753a0 2024-09-19T04:50:05.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.866+0000 7f99eaffd640 1 -- 172.21.15.2:0/1234533594 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99fc004e60 con 0x5640365753a0 2024-09-19T04:50:05.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.866+0000 7f9a09957740 1 -- 172.21.15.2:0/1234533594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640365753a0 msgr2=0x56403659b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:05.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.866+0000 7f9a09957740 1 --2- 172.21.15.2:0/1234533594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640365753a0 0x56403659b840 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x564036580940 tx=0x7f99fc00b410 comp rx=0 tx=0).stop 2024-09-19T04:50:05.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.866+0000 7f9a09957740 1 -- 172.21.15.2:0/1234533594 shutdown_connections 2024-09-19T04:50:05.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.866+0000 7f9a09957740 1 --2- 172.21.15.2:0/1234533594 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564036584150 0x56403659bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:05.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.866+0000 7f9a09957740 1 --2- 172.21.15.2:0/1234533594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640365753a0 0x56403659b840 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:05.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.866+0000 7f9a09957740 1 --2- 172.21.15.2:0/1234533594 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564036574a80 0x564036582f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:05.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.867+0000 7f9a09957740 1 -- 172.21.15.2:0/1234533594 >> 172.21.15.2:0/1234533594 conn(0x5640365710f0 msgr2=0x564036582800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:05.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.867+0000 7f9a09957740 1 -- 172.21.15.2:0/1234533594 shutdown_connections 2024-09-19T04:50:05.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.867+0000 7f9a09957740 1 -- 172.21.15.2:0/1234533594 wait complete. 2024-09-19T04:50:05.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.867+0000 7f9a09957740 1 -- start start 2024-09-19T04:50:05.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.867+0000 7f9a09957740 1 Processor -- start 2024-09-19T04:50:05.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.867+0000 7f9a09957740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564036574a80 0x5640365885a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:05.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.867+0000 7f9a09957740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640365753a0 0x564036588ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:05.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.867+0000 7f9a09957740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564036584150 0x5640365fd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:05.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.867+0000 7f9a09957740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9a001aa230 con 0x5640365753a0 2024-09-19T04:50:05.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.867+0000 7f9a09957740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9a001ab6a0 con 0x564036584150 2024-09-19T04:50:05.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.867+0000 7f9a09957740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f9a001aa900 con 0x564036574a80 2024-09-19T04:50:05.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.868+0000 7f9a09957740 10 client.0 _ll_register_callbacks cb 0x7f99fc00b810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:50:05.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.868+0000 7f9a0531a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640365753a0 0x564036588ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:05.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.868+0000 7f9a0531a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640365753a0 0x564036588ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37180/0 (socket says 172.21.15.2:37180) 2024-09-19T04:50:05.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.868+0000 7f9a0531a640 1 -- 172.21.15.2:0/3315181534 learned_addr learned my addr 172.21.15.2:0/3315181534 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:05.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.868+0000 7f9a04b19640 1 --2- 172.21.15.2:0/3315181534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564036584150 0x5640365fd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:05.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.868+0000 7f9a04b19640 1 --2- 172.21.15.2:0/3315181534 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564036574a80 0x5640365885a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:05.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.868+0000 7f9a0531a640 1 -- 172.21.15.2:0/3315181534 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564036574a80 msgr2=0x5640365885a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:05.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.868+0000 7f9a0531a640 1 --2- 172.21.15.2:0/3315181534 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564036574a80 0x5640365885a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:05.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.868+0000 7f9a0531a640 1 -- 172.21.15.2:0/3315181534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564036584150 msgr2=0x5640365fd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:05.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.868+0000 7f9a0531a640 1 --2- 172.21.15.2:0/3315181534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564036584150 0x5640365fd810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:05.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.868+0000 7f9a0531a640 1 -- 172.21.15.2:0/3315181534 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640365fddd0 con 0x5640365753a0 2024-09-19T04:50:05.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.868+0000 7f9a0531a640 1 --2- 172.21.15.2:0/3315181534 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640365753a0 0x564036588ae0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f99fc005940 tx=0x7f99fc00bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d41425671cf9eecd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:05.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.868+0000 7f99e8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:50:05.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.868+0000 7f99e8ff9640 1 -- 172.21.15.2:0/3315181534 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99fc035060 con 0x5640365753a0 2024-09-19T04:50:05.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.868+0000 7f99e8ff9640 1 -- 172.21.15.2:0/3315181534 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f99fc0035f0 con 0x5640365753a0 2024-09-19T04:50:05.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.868+0000 7f9a09957740 1 -- 172.21.15.2:0/3315181534 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99fc0043c0 con 0x5640365753a0 2024-09-19T04:50:05.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.869+0000 7f99e8ff9640 1 -- 172.21.15.2:0/3315181534 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f99fc02a040 con 0x5640365753a0 2024-09-19T04:50:05.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.869+0000 7f9a09957740 10 client.15498 fetch_fsmap learned FSMap version 19 2024-09-19T04:50:05.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.869+0000 7f9a09957740 1 -- 172.21.15.2:0/3315181534 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5640365ff0d0 con 0x5640365753a0 2024-09-19T04:50:05.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.869+0000 7f99e8ff9640 1 -- 172.21.15.2:0/3315181534 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f99fc0043c0 con 0x5640365753a0 2024-09-19T04:50:05.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.869+0000 7f99e8ff9640 1 -- 172.21.15.2:0/3315181534 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f99fc01d7a0 con 0x5640365753a0 2024-09-19T04:50:05.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.869+0000 7f9a09957740 10 client.15498 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:50:05.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.869+0000 7f9a09957740 10 client.15498 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:50:05.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.869+0000 7f9a09957740 20 client.15498 populate_metadata read hostname 'smithi002' 2024-09-19T04:50:05.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.869+0000 7f9a09957740 1 --2- 172.21.15.2:0/3315181534 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5640365ff800 0x564036601c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:05.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.869+0000 7f9a09957740 4 client.15498 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:50:05.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.869+0000 7f9a09957740 1 -- 172.21.15.2:0/3315181534 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5640364e1d00 con 0x5640365ff800 2024-09-19T04:50:05.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.869+0000 7f9a04b19640 1 --2- 172.21.15.2:0/3315181534 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5640365ff800 0x564036601c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:05.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.870+0000 7f9a04b19640 1 --2- 172.21.15.2:0/3315181534 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5640365ff800 0x564036601c20 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d055b50f14706986 server_cookie=964d37b375d55a1a in_seq=0 out_seq=0 2024-09-19T04:50:05.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.870+0000 7f99e8ff9640 10 client.15498 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:50:05.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.871+0000 7f99e8ff9640 1 -- 172.21.15.2:0/3315181534 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5640364e1d00 con 0x5640365ff800 2024-09-19T04:50:05.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.871+0000 7f99e8ff9640 10 client.15498 handle_command_reply: tid=0 2024-09-19T04:50:05.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.871+0000 7f9a09957740 1 client.15498 shutdown 2024-09-19T04:50:05.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.871+0000 7f9a09957740 1 -- 172.21.15.2:0/3315181534 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640365753a0 msgr2=0x564036588ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:05.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.871+0000 7f9a09957740 1 --2- 172.21.15.2:0/3315181534 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640365753a0 0x564036588ae0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f99fc005940 tx=0x7f99fc00bc50 comp rx=0 tx=0).stop 2024-09-19T04:50:05.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.871+0000 7f9a09957740 1 -- 172.21.15.2:0/3315181534 shutdown_connections 2024-09-19T04:50:05.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.871+0000 7f9a09957740 1 --2- 172.21.15.2:0/3315181534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564036584150 0x5640365fd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:05.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.871+0000 7f9a09957740 1 --2- 172.21.15.2:0/3315181534 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640365753a0 0x564036588ae0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:05.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.871+0000 7f9a09957740 1 --2- 172.21.15.2:0/3315181534 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5640365ff800 0x564036601c20 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:05.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.871+0000 7f9a09957740 1 --2- 172.21.15.2:0/3315181534 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564036574a80 0x5640365885a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:05.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.871+0000 7f99e8ff9640 0 client.15498 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:50:05.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.871+0000 7f9a09957740 1 -- 172.21.15.2:0/3315181534 >> 172.21.15.2:0/3315181534 conn(0x5640365710f0 msgr2=0x564036570270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:05.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.871+0000 7f9a09957740 1 -- 172.21.15.2:0/3315181534 shutdown_connections 2024-09-19T04:50:05.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.871+0000 7f9a09957740 1 -- 172.21.15.2:0/3315181534 wait complete. 2024-09-19T04:50:05.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.871+0000 7f9a09957740 20 client.15498 trim_cache size 0 max 16384 2024-09-19T04:50:05.882 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:50:05.882 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T04:50:05.882 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "e85c4791-7c80-433a-97ec-c71a6aad1594", 2024-09-19T04:50:05.882 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T04:50:05.882 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:50:05.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.872+0000 7f9a0757e640 1 -- 172.21.15.2:0/732239571 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f99ec0a33b0 msgr2=0x7f99ec0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:05.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.872+0000 7f9a0757e640 1 --2- 172.21.15.2:0/732239571 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f99ec0a33b0 0x7f99ec0a5870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f99f80bcc50 tx=0x7f99f807f040 comp rx=0 tx=0).stop 2024-09-19T04:50:05.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.872+0000 7f9a0757e640 1 -- 172.21.15.2:0/732239571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a001082a0 msgr2=0x7f9a0019cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:05.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.872+0000 7f9a0757e640 1 --2- 172.21.15.2:0/732239571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a001082a0 0x7f9a0019cd60 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f99f8005cc0 tx=0x7f99f8003c20 comp rx=0 tx=0).stop 2024-09-19T04:50:05.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.872+0000 7f9a0757e640 1 -- 172.21.15.2:0/732239571 shutdown_connections 2024-09-19T04:50:05.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.872+0000 7f9a0757e640 1 --2- 172.21.15.2:0/732239571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a001082a0 0x7f9a0019cd60 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:05.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.872+0000 7f9a0757e640 1 --2- 172.21.15.2:0/732239571 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a001036e0 0x7f9a001989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:05.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.872+0000 7f9a0757e640 1 --2- 172.21.15.2:0/732239571 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f99ec0a33b0 0x7f99ec0a5870 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:05.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.872+0000 7f9a0757e640 1 --2- 172.21.15.2:0/732239571 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a00102d30 0x7f9a00198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:05.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.872+0000 7f9a0757e640 1 -- 172.21.15.2:0/732239571 >> 172.21.15.2:0/732239571 conn(0x7f9a000fc7d0 msgr2=0x7f9a00105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:05.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.872+0000 7f9a0757e640 1 -- 172.21.15.2:0/732239571 shutdown_connections 2024-09-19T04:50:05.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:05.872+0000 7f9a0757e640 1 -- 172.21.15.2:0/732239571 wait complete. 2024-09-19T04:50:06.546 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:50:06.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:06 smithi018 ceph-mon[34537]: pgmap v66: 97 pgs: 97 active+clean; 2.1 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 45 KiB/s wr, 25 op/s 2024-09-19T04:50:06.809 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:50:06.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:06 smithi002 ceph-mon[30975]: pgmap v66: 97 pgs: 97 active+clean; 2.1 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 45 KiB/s wr, 25 op/s 2024-09-19T04:50:06.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:06 smithi116 ceph-mon[34477]: pgmap v66: 97 pgs: 97 active+clean; 2.1 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 45 KiB/s wr, 25 op/s 2024-09-19T04:50:07.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.258+0000 7f13a3c9e640 1 -- 172.21.15.2:0/1410972465 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f139c106f10 msgr2=0x7f139c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:07.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.258+0000 7f13a3c9e640 1 --2- 172.21.15.2:0/1410972465 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f139c106f10 0x7f139c10ea90 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f138c009ca0 tx=0x7f138c02a8c0 comp rx=0 tx=0).stop 2024-09-19T04:50:07.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.258+0000 7f13a3c9e640 1 -- 172.21.15.2:0/1410972465 shutdown_connections 2024-09-19T04:50:07.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.258+0000 7f13a3c9e640 1 --2- 172.21.15.2:0/1410972465 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f139c106f10 0x7f139c10ea90 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:07.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.258+0000 7f13a3c9e640 1 --2- 172.21.15.2:0/1410972465 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f139c102790 0x7f139c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:07.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.258+0000 7f13a3c9e640 1 --2- 172.21.15.2:0/1410972465 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f139c101de0 0x7f139c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:07.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.258+0000 7f13a3c9e640 1 -- 172.21.15.2:0/1410972465 >> 172.21.15.2:0/1410972465 conn(0x7f139c0fd8c0 msgr2=0x7f139c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:07.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.258+0000 7f13a3c9e640 1 -- 172.21.15.2:0/1410972465 shutdown_connections 2024-09-19T04:50:07.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.258+0000 7f13a3c9e640 1 -- 172.21.15.2:0/1410972465 wait complete. 2024-09-19T04:50:07.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.259+0000 7f13a3c9e640 1 Processor -- start 2024-09-19T04:50:07.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.259+0000 7f13a3c9e640 1 -- start start 2024-09-19T04:50:07.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.259+0000 7f13a3c9e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f139c101de0 0x7f139c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:07.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.259+0000 7f13a3c9e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f139c102790 0x7f139c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:07.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.259+0000 7f13a3c9e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f139c106f10 0x7f139c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:07.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.259+0000 7f13a3c9e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f139c111e20 con 0x7f139c101de0 2024-09-19T04:50:07.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.259+0000 7f13a3c9e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f139c111ca0 con 0x7f139c106f10 2024-09-19T04:50:07.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.259+0000 7f13a3c9e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f139c111fa0 con 0x7f139c102790 2024-09-19T04:50:07.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.259+0000 7f13a1a3a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f139c101de0 0x7f139c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:07.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.259+0000 7f13a1a3a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f139c101de0 0x7f139c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37200/0 (socket says 172.21.15.2:37200) 2024-09-19T04:50:07.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.259+0000 7f13a1a3a640 1 -- 172.21.15.2:0/3153777357 learned_addr learned my addr 172.21.15.2:0/3153777357 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:07.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.259+0000 7f13a1239640 1 --2- 172.21.15.2:0/3153777357 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f139c102790 0x7f139c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:07.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.259+0000 7f13a223b640 1 --2- 172.21.15.2:0/3153777357 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f139c106f10 0x7f139c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:07.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.259+0000 7f13a1a3a640 1 -- 172.21.15.2:0/3153777357 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f139c102790 msgr2=0x7f139c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:07.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.259+0000 7f13a1a3a640 1 --2- 172.21.15.2:0/3153777357 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f139c102790 0x7f139c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:07.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.259+0000 7f13a1a3a640 1 -- 172.21.15.2:0/3153777357 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f139c106f10 msgr2=0x7f139c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:07.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.259+0000 7f13a1a3a640 1 --2- 172.21.15.2:0/3153777357 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f139c106f10 0x7f139c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:07.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.259+0000 7f13a1a3a640 1 -- 172.21.15.2:0/3153777357 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f139c1a67e0 con 0x7f139c101de0 2024-09-19T04:50:07.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.260+0000 7f13a1a3a640 1 --2- 172.21.15.2:0/3153777357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f139c101de0 0x7f139c0744f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f139400c970 tx=0x7f139400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:07.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.260+0000 7f139affd640 1 -- 172.21.15.2:0/3153777357 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1394007bb0 con 0x7f139c101de0 2024-09-19T04:50:07.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.260+0000 7f139affd640 1 -- 172.21.15.2:0/3153777357 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1394007d50 con 0x7f139c101de0 2024-09-19T04:50:07.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.260+0000 7f13a3c9e640 1 -- 172.21.15.2:0/3153777357 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f139c1a6ad0 con 0x7f139c101de0 2024-09-19T04:50:07.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.260+0000 7f139affd640 1 -- 172.21.15.2:0/3153777357 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f139400f450 con 0x7f139c101de0 2024-09-19T04:50:07.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.260+0000 7f13a3c9e640 1 -- 172.21.15.2:0/3153777357 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f139c1a7010 con 0x7f139c101de0 2024-09-19T04:50:07.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.262+0000 7f139affd640 1 -- 172.21.15.2:0/3153777357 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f1394004f20 con 0x7f139c101de0 2024-09-19T04:50:07.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.262+0000 7f13a6077740 1 Processor -- start 2024-09-19T04:50:07.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.263+0000 7f13a6077740 1 -- start start 2024-09-19T04:50:07.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.263+0000 7f13a6077740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b4d76d54a0 0x55b4d76d5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:07.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.263+0000 7f13a6077740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4d76d5dc0 0x55b4d76e0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:07.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.263+0000 7f13a6077740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4d76e0680 0x55b4d76e2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:07.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.263+0000 7f13a6077740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b4d763b2e0 con 0x55b4d76e0680 2024-09-19T04:50:07.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.263+0000 7f13a6077740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b4d75e2ce0 con 0x55b4d76d5dc0 2024-09-19T04:50:07.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.263+0000 7f13a6077740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55b4d76372a0 con 0x55b4d76d54a0 2024-09-19T04:50:07.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.263+0000 7f13a1239640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4d76e0680 0x55b4d76e2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:07.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.263+0000 7f13a1a3a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4d76d5dc0 0x55b4d76e0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:07.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.263+0000 7f13a1239640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4d76e0680 0x55b4d76e2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37204/0 (socket says 172.21.15.2:37204) 2024-09-19T04:50:07.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.263+0000 7f13a1239640 1 -- 172.21.15.2:0/1019570631 learned_addr learned my addr 172.21.15.2:0/1019570631 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:07.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.263+0000 7f139affd640 1 --2- 172.21.15.2:0/3153777357 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f13840a3430 0x7f13840a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:07.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.263+0000 7f13a223b640 1 --2- 172.21.15.2:0/1019570631 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b4d76d54a0 0x55b4d76d5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:07.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.263+0000 7f13a223b640 1 --2- 172.21.15.2:0/3153777357 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f13840a3430 0x7f13840a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:07.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.263+0000 7f13a1239640 1 -- 172.21.15.2:0/1019570631 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b4d76d54a0 msgr2=0x55b4d76d5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:07.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.263+0000 7f13a1239640 1 --2- 172.21.15.2:0/1019570631 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b4d76d54a0 0x55b4d76d5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:07.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.263+0000 7f13a1239640 1 -- 172.21.15.2:0/1019570631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4d76d5dc0 msgr2=0x55b4d76e0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:07.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.263+0000 7f13a1239640 1 --2- 172.21.15.2:0/1019570631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4d76d5dc0 0x55b4d76e0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:07.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.263+0000 7f13a1239640 1 -- 172.21.15.2:0/1019570631 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4d75c7440 con 0x55b4d76e0680 2024-09-19T04:50:07.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.263+0000 7f139affd640 1 -- 172.21.15.2:0/3153777357 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f13940cfa70 con 0x7f139c101de0 2024-09-19T04:50:07.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.264+0000 7f13a1239640 1 --2- 172.21.15.2:0/1019570631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4d76e0680 0x55b4d76e2a70 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f139000ab70 tx=0x7f139000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f137b4ad3ba5c64 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:07.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.264+0000 7f1383fff640 1 -- 172.21.15.2:0/1019570631 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f139001d070 con 0x55b4d76e0680 2024-09-19T04:50:07.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.264+0000 7f1383fff640 1 -- 172.21.15.2:0/1019570631 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1390018af0 con 0x55b4d76e0680 2024-09-19T04:50:07.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.264+0000 7f1383fff640 1 -- 172.21.15.2:0/1019570631 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13900109f0 con 0x55b4d76e0680 2024-09-19T04:50:07.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.265+0000 7f13a6077740 1 -- 172.21.15.2:0/1019570631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4d76e0680 msgr2=0x55b4d76e2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:07.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.265+0000 7f13a6077740 1 --2- 172.21.15.2:0/1019570631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4d76e0680 0x55b4d76e2a70 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f139000ab70 tx=0x7f139000f790 comp rx=0 tx=0).stop 2024-09-19T04:50:07.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.265+0000 7f13a223b640 1 --2- 172.21.15.2:0/3153777357 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f13840a3430 0x7f13840a58f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f138c009430 tx=0x7f138c0095c0 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:07.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.265+0000 7f13a6077740 1 -- 172.21.15.2:0/1019570631 shutdown_connections 2024-09-19T04:50:07.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.265+0000 7f13a6077740 1 --2- 172.21.15.2:0/1019570631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4d76e0680 0x55b4d76e2a70 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:07.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.265+0000 7f13a6077740 1 --2- 172.21.15.2:0/1019570631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4d76d5dc0 0x55b4d76e0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:07.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.265+0000 7f13a6077740 1 --2- 172.21.15.2:0/1019570631 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b4d76d54a0 0x55b4d76d5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:07.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.265+0000 7f13a6077740 1 -- 172.21.15.2:0/1019570631 >> 172.21.15.2:0/1019570631 conn(0x55b4d76d1a30 msgr2=0x55b4d76d1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:07.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.265+0000 7f13a6077740 1 -- 172.21.15.2:0/1019570631 shutdown_connections 2024-09-19T04:50:07.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.265+0000 7f13a6077740 1 -- 172.21.15.2:0/1019570631 wait complete. 2024-09-19T04:50:07.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.265+0000 7f13a6077740 1 -- start start 2024-09-19T04:50:07.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.265+0000 7f13a6077740 1 Processor -- start 2024-09-19T04:50:07.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.266+0000 7f13a6077740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4d76d54a0 0x55b4d76dffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:07.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.266+0000 7f13a6077740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4d76d5dc0 0x55b4d76dd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:07.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.266+0000 7f13a6077740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b4d76e0680 0x55b4d76dd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:07.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.266+0000 7f13a6077740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b4d76e3250 con 0x55b4d76d54a0 2024-09-19T04:50:07.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.266+0000 7f13a6077740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b4d75f6050 con 0x55b4d76d5dc0 2024-09-19T04:50:07.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.266+0000 7f13a6077740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55b4d76e33d0 con 0x55b4d76e0680 2024-09-19T04:50:07.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.266+0000 7f13a6077740 10 client.0 _ll_register_callbacks cb 0x55b4d7636160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:50:07.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.266+0000 7f13a1a3a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4d76d54a0 0x55b4d76dffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:07.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.266+0000 7f13a1a3a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4d76d54a0 0x55b4d76dffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37208/0 (socket says 172.21.15.2:37208) 2024-09-19T04:50:07.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.266+0000 7f13a1a3a640 1 -- 172.21.15.2:0/3872489629 learned_addr learned my addr 172.21.15.2:0/3872489629 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:07.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.266+0000 7f13a223b640 1 --2- 172.21.15.2:0/3872489629 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b4d76e0680 0x55b4d76dd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:07.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.266+0000 7f13a1239640 1 --2- 172.21.15.2:0/3872489629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4d76d5dc0 0x55b4d76dd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:07.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.266+0000 7f13a1a3a640 1 -- 172.21.15.2:0/3872489629 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b4d76e0680 msgr2=0x55b4d76dd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:07.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.266+0000 7f13a1a3a640 1 --2- 172.21.15.2:0/3872489629 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b4d76e0680 0x55b4d76dd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:07.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.266+0000 7f13a1a3a640 1 -- 172.21.15.2:0/3872489629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4d76d5dc0 msgr2=0x55b4d76dd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:07.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.266+0000 7f13a1a3a640 1 --2- 172.21.15.2:0/3872489629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4d76d5dc0 0x55b4d76dd2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:07.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.266+0000 7f13a1a3a640 1 -- 172.21.15.2:0/3872489629 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4d73ac3c0 con 0x55b4d76d54a0 2024-09-19T04:50:07.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.266+0000 7f13a223b640 1 --2- 172.21.15.2:0/3872489629 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b4d76e0680 0x55b4d76dd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:50:07.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.266+0000 7f13a1a3a640 1 --2- 172.21.15.2:0/3872489629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4d76d54a0 0x55b4d76dffa0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f1394098170 tx=0x7f139400a580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23e0f5557c925351 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:07.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.266+0000 7f13817fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:50:07.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.267+0000 7f13817fa640 1 -- 172.21.15.2:0/3872489629 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13940cfe60 con 0x55b4d76d54a0 2024-09-19T04:50:07.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.267+0000 7f13817fa640 1 -- 172.21.15.2:0/3872489629 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f13940a44f0 con 0x55b4d76d54a0 2024-09-19T04:50:07.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.267+0000 7f13a6077740 1 -- 172.21.15.2:0/3872489629 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1390018af0 con 0x55b4d76d54a0 2024-09-19T04:50:07.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.267+0000 7f13817fa640 1 -- 172.21.15.2:0/3872489629 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f139401d040 con 0x55b4d76d54a0 2024-09-19T04:50:07.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.267+0000 7f13a6077740 10 client.15510 fetch_fsmap learned FSMap version 19 2024-09-19T04:50:07.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.267+0000 7f13a6077740 1 -- 172.21.15.2:0/3872489629 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55b4d76eecb0 con 0x55b4d76d54a0 2024-09-19T04:50:07.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.267+0000 7f13817fa640 1 -- 172.21.15.2:0/3872489629 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1390018af0 con 0x55b4d76d54a0 2024-09-19T04:50:07.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.267+0000 7f13817fa640 1 -- 172.21.15.2:0/3872489629 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f1394097a60 con 0x55b4d76d54a0 2024-09-19T04:50:07.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.267+0000 7f13a6077740 10 client.15510 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:50:07.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.267+0000 7f13a6077740 10 client.15510 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:50:07.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.267+0000 7f13a6077740 20 client.15510 populate_metadata read hostname 'smithi002' 2024-09-19T04:50:07.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.267+0000 7f13a6077740 1 --2- 172.21.15.2:0/3872489629 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55b4d76f00c0 0x55b4d76f24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:07.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.267+0000 7f13a6077740 4 client.15510 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:50:07.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.267+0000 7f13a6077740 1 -- 172.21.15.2:0/3872489629 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b4d7648850 con 0x55b4d76f00c0 2024-09-19T04:50:07.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.267+0000 7f13a1239640 1 --2- 172.21.15.2:0/3872489629 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55b4d76f00c0 0x55b4d76f24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:07.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.268+0000 7f13a1239640 1 --2- 172.21.15.2:0/3872489629 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55b4d76f00c0 0x55b4d76f24d0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e265560d4c5b19e server_cookie=6e45c542141d846f in_seq=0 out_seq=0 2024-09-19T04:50:07.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.268+0000 7f13817fa640 10 client.15510 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:50:07.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.269+0000 7f13817fa640 1 -- 172.21.15.2:0/3872489629 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b4d7648850 con 0x55b4d76f00c0 2024-09-19T04:50:07.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.269+0000 7f13817fa640 10 client.15510 handle_command_reply: tid=0 2024-09-19T04:50:07.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.269+0000 7f13a6077740 1 client.15510 shutdown 2024-09-19T04:50:07.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.269+0000 7f13a6077740 1 -- 172.21.15.2:0/3872489629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4d76d54a0 msgr2=0x55b4d76dffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:07.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.269+0000 7f13a6077740 1 --2- 172.21.15.2:0/3872489629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4d76d54a0 0x55b4d76dffa0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f1394098170 tx=0x7f139400a580 comp rx=0 tx=0).stop 2024-09-19T04:50:07.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.269+0000 7f13a6077740 1 -- 172.21.15.2:0/3872489629 shutdown_connections 2024-09-19T04:50:07.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.269+0000 7f13a6077740 1 --2- 172.21.15.2:0/3872489629 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55b4d76f00c0 0x55b4d76f24d0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:07.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.269+0000 7f13a6077740 1 --2- 172.21.15.2:0/3872489629 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b4d76e0680 0x55b4d76dd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:07.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.269+0000 7f13a6077740 1 --2- 172.21.15.2:0/3872489629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4d76d5dc0 0x55b4d76dd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:07.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.269+0000 7f13a6077740 1 --2- 172.21.15.2:0/3872489629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4d76d54a0 0x55b4d76dffa0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:07.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.269+0000 7f13817fa640 0 client.15510 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:50:07.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.269+0000 7f13a6077740 1 -- 172.21.15.2:0/3872489629 >> 172.21.15.2:0/3872489629 conn(0x55b4d76d1a30 msgr2=0x55b4d76d7710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:07.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.269+0000 7f13a6077740 1 -- 172.21.15.2:0/3872489629 shutdown_connections 2024-09-19T04:50:07.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.269+0000 7f13a6077740 1 -- 172.21.15.2:0/3872489629 wait complete. 2024-09-19T04:50:07.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.269+0000 7f13a6077740 20 client.15510 trim_cache size 0 max 16384 2024-09-19T04:50:07.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.291+0000 7f13a6077740 1 Processor -- start 2024-09-19T04:50:07.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.291+0000 7f13a6077740 1 -- start start 2024-09-19T04:50:07.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.291+0000 7f13a6077740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b4d76d54a0 0x55b4d76f7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:07.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.291+0000 7f13a6077740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4d76d5dc0 0x55b4d76f82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:07.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.291+0000 7f13a6077740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4d76e0680 0x55b4d76da500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:07.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.291+0000 7f13a6077740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f139c1ad8c0 con 0x55b4d76e0680 2024-09-19T04:50:07.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.291+0000 7f13a6077740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f139c1b0140 con 0x55b4d76d5dc0 2024-09-19T04:50:07.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.291+0000 7f13a6077740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f139c1adf30 con 0x55b4d76d54a0 2024-09-19T04:50:07.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.292+0000 7f13a223b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4d76e0680 0x55b4d76da500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:07.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.292+0000 7f13a223b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4d76e0680 0x55b4d76da500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37224/0 (socket says 172.21.15.2:37224) 2024-09-19T04:50:07.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.292+0000 7f13a223b640 1 -- 172.21.15.2:0/1038071810 learned_addr learned my addr 172.21.15.2:0/1038071810 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:07.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.292+0000 7f13a1239640 1 --2- 172.21.15.2:0/1038071810 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4d76d5dc0 0x55b4d76f82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:07.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.292+0000 7f13a1a3a640 1 --2- 172.21.15.2:0/1038071810 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b4d76d54a0 0x55b4d76f7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:07.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.292+0000 7f13a223b640 1 -- 172.21.15.2:0/1038071810 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b4d76d54a0 msgr2=0x55b4d76f7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:07.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.292+0000 7f13a223b640 1 --2- 172.21.15.2:0/1038071810 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b4d76d54a0 0x55b4d76f7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:07.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.292+0000 7f13a223b640 1 -- 172.21.15.2:0/1038071810 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4d76d5dc0 msgr2=0x55b4d76f82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:07.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.292+0000 7f13a223b640 1 --2- 172.21.15.2:0/1038071810 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4d76d5dc0 0x55b4d76f82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:07.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.292+0000 7f13a223b640 1 -- 172.21.15.2:0/1038071810 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4d76d2bc0 con 0x55b4d76e0680 2024-09-19T04:50:07.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.292+0000 7f13a223b640 1 --2- 172.21.15.2:0/1038071810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4d76e0680 0x55b4d76da500 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f138c009ca0 tx=0x7f138c03c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3d757a0ee1a2153 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:07.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.292+0000 7f13837fe640 1 -- 172.21.15.2:0/1038071810 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f138c044070 con 0x55b4d76e0680 2024-09-19T04:50:07.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.292+0000 7f13837fe640 1 -- 172.21.15.2:0/1038071810 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f138c036040 con 0x55b4d76e0680 2024-09-19T04:50:07.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.292+0000 7f13837fe640 1 -- 172.21.15.2:0/1038071810 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f138c030db0 con 0x55b4d76e0680 2024-09-19T04:50:07.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.293+0000 7f13a6077740 1 -- 172.21.15.2:0/1038071810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4d76e0680 msgr2=0x55b4d76da500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:07.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.293+0000 7f13a6077740 1 --2- 172.21.15.2:0/1038071810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4d76e0680 0x55b4d76da500 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f138c009ca0 tx=0x7f138c03c000 comp rx=0 tx=0).stop 2024-09-19T04:50:07.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.293+0000 7f13a6077740 1 -- 172.21.15.2:0/1038071810 shutdown_connections 2024-09-19T04:50:07.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.293+0000 7f13a6077740 1 --2- 172.21.15.2:0/1038071810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4d76e0680 0x55b4d76da500 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:07.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.293+0000 7f13a6077740 1 --2- 172.21.15.2:0/1038071810 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4d76d5dc0 0x55b4d76f82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:07.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.293+0000 7f13a6077740 1 --2- 172.21.15.2:0/1038071810 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b4d76d54a0 0x55b4d76f7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:07.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.293+0000 7f13a6077740 1 -- 172.21.15.2:0/1038071810 >> 172.21.15.2:0/1038071810 conn(0x55b4d76d1a30 msgr2=0x55b4d76d0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:07.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.293+0000 7f13a6077740 1 -- 172.21.15.2:0/1038071810 shutdown_connections 2024-09-19T04:50:07.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.293+0000 7f13a6077740 1 -- 172.21.15.2:0/1038071810 wait complete. 2024-09-19T04:50:07.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.293+0000 7f13a6077740 1 -- start start 2024-09-19T04:50:07.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.293+0000 7f13a6077740 1 Processor -- start 2024-09-19T04:50:07.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.294+0000 7f13a6077740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b4d76d54a0 0x55b4d76e6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:07.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.294+0000 7f13a6077740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4d76d5dc0 0x55b4d76e71d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:07.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.294+0000 7f13a6077740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4d76e0680 0x55b4d7753d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:07.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.294+0000 7f13a6077740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f139c1ae600 con 0x55b4d76d5dc0 2024-09-19T04:50:07.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.294+0000 7f13a6077740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f139c1afa70 con 0x55b4d76e0680 2024-09-19T04:50:07.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.294+0000 7f13a6077740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f139c1aecd0 con 0x55b4d76d54a0 2024-09-19T04:50:07.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.294+0000 7f13a6077740 10 client.0 _ll_register_callbacks cb 0x7f139409bbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:50:07.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.294+0000 7f13a1239640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4d76d5dc0 0x55b4d76e71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:07.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.294+0000 7f13a1239640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4d76d5dc0 0x55b4d76e71d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37234/0 (socket says 172.21.15.2:37234) 2024-09-19T04:50:07.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.294+0000 7f13a1239640 1 -- 172.21.15.2:0/2030275433 learned_addr learned my addr 172.21.15.2:0/2030275433 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:07.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.294+0000 7f13a223b640 1 --2- 172.21.15.2:0/2030275433 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4d76e0680 0x55b4d7753d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:07.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.294+0000 7f13a1a3a640 1 --2- 172.21.15.2:0/2030275433 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b4d76d54a0 0x55b4d76e6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:07.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.294+0000 7f13a1239640 1 -- 172.21.15.2:0/2030275433 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b4d76d54a0 msgr2=0x55b4d76e6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:07.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.294+0000 7f13a1239640 1 --2- 172.21.15.2:0/2030275433 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b4d76d54a0 0x55b4d76e6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:07.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.294+0000 7f13a1239640 1 -- 172.21.15.2:0/2030275433 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4d76e0680 msgr2=0x55b4d7753d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:07.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.294+0000 7f13a1239640 1 --2- 172.21.15.2:0/2030275433 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4d76e0680 0x55b4d7753d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:07.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.294+0000 7f13a1239640 1 -- 172.21.15.2:0/2030275433 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4d7754390 con 0x55b4d76d5dc0 2024-09-19T04:50:07.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.295+0000 7f13a1239640 1 --2- 172.21.15.2:0/2030275433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4d76d5dc0 0x55b4d76e71d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f139000ab70 tx=0x7f1390005ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34e59519c5aa2113 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:07.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.295+0000 7f13817fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:50:07.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.295+0000 7f13817fa640 1 -- 172.21.15.2:0/2030275433 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f139001d040 con 0x55b4d76d5dc0 2024-09-19T04:50:07.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.295+0000 7f13817fa640 1 -- 172.21.15.2:0/2030275433 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f1390018a10 con 0x55b4d76d5dc0 2024-09-19T04:50:07.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.295+0000 7f13a6077740 1 -- 172.21.15.2:0/2030275433 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f138c036040 con 0x55b4d76d5dc0 2024-09-19T04:50:07.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.295+0000 7f13817fa640 1 -- 172.21.15.2:0/2030275433 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1390005040 con 0x55b4d76d5dc0 2024-09-19T04:50:07.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.295+0000 7f13a6077740 10 client.15516 fetch_fsmap learned FSMap version 19 2024-09-19T04:50:07.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.295+0000 7f13a6077740 1 -- 172.21.15.2:0/2030275433 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55b4d775b710 con 0x55b4d76d5dc0 2024-09-19T04:50:07.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.295+0000 7f13817fa640 1 -- 172.21.15.2:0/2030275433 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f138c036040 con 0x55b4d76d5dc0 2024-09-19T04:50:07.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.295+0000 7f13817fa640 1 -- 172.21.15.2:0/2030275433 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f1390004c40 con 0x55b4d76d5dc0 2024-09-19T04:50:07.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.295+0000 7f13a6077740 10 client.15516 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:50:07.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.295+0000 7f13a6077740 10 client.15516 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:50:07.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.296+0000 7f13a6077740 20 client.15516 populate_metadata read hostname 'smithi002' 2024-09-19T04:50:07.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.296+0000 7f13a6077740 1 --2- 172.21.15.2:0/2030275433 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55b4d775bba0 0x55b4d775dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:07.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.296+0000 7f13a6077740 4 client.15516 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:50:07.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.296+0000 7f13a6077740 1 -- 172.21.15.2:0/2030275433 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b4d7642d60 con 0x55b4d775bba0 2024-09-19T04:50:07.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.296+0000 7f13a1a3a640 1 --2- 172.21.15.2:0/2030275433 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55b4d775bba0 0x55b4d775dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:07.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.296+0000 7f13a1a3a640 1 --2- 172.21.15.2:0/2030275433 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55b4d775bba0 0x55b4d775dfc0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b965e6453c4cebf4 server_cookie=a0f84da817861cde in_seq=0 out_seq=0 2024-09-19T04:50:07.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.296+0000 7f13817fa640 10 client.15516 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:50:07.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.296+0000 7f13817fa640 1 -- 172.21.15.2:0/2030275433 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55b4d7642d60 con 0x55b4d775bba0 2024-09-19T04:50:07.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.296+0000 7f13817fa640 10 client.15516 handle_command_reply: tid=0 2024-09-19T04:50:07.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.296+0000 7f13a6077740 1 client.15516 shutdown 2024-09-19T04:50:07.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.296+0000 7f13a6077740 1 -- 172.21.15.2:0/2030275433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4d76d5dc0 msgr2=0x55b4d76e71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:07.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.297+0000 7f13a6077740 1 --2- 172.21.15.2:0/2030275433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4d76d5dc0 0x55b4d76e71d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f139000ab70 tx=0x7f1390005ae0 comp rx=0 tx=0).stop 2024-09-19T04:50:07.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.297+0000 7f13a6077740 1 -- 172.21.15.2:0/2030275433 shutdown_connections 2024-09-19T04:50:07.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.297+0000 7f13a6077740 1 --2- 172.21.15.2:0/2030275433 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b4d76e0680 0x55b4d7753d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:07.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.297+0000 7f13a6077740 1 --2- 172.21.15.2:0/2030275433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b4d76d5dc0 0x55b4d76e71d0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:07.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.297+0000 7f13a6077740 1 --2- 172.21.15.2:0/2030275433 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55b4d775bba0 0x55b4d775dfc0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:07.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.297+0000 7f13a6077740 1 --2- 172.21.15.2:0/2030275433 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b4d76d54a0 0x55b4d76e6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:07.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.297+0000 7f13a6077740 1 -- 172.21.15.2:0/2030275433 >> 172.21.15.2:0/2030275433 conn(0x55b4d76d1a30 msgr2=0x55b4d76deb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:07.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.297+0000 7f13817fa640 0 client.15516 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:50:07.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.297+0000 7f13a6077740 1 -- 172.21.15.2:0/2030275433 shutdown_connections 2024-09-19T04:50:07.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.297+0000 7f13a6077740 1 -- 172.21.15.2:0/2030275433 wait complete. 2024-09-19T04:50:07.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.297+0000 7f13a6077740 20 client.15516 trim_cache size 0 max 16384 2024-09-19T04:50:07.304 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:50:07.304 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T04:50:07.305 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-19T04:50:07.305 INFO:teuthology.orchestra.run.smithi002.stdout: "e85c4791-7c80-433a-97ec-c71a6aad1594": { 2024-09-19T04:50:07.305 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-19T04:50:07.305 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "e85c4791-7c80-433a-97ec-c71a6aad1594", 2024-09-19T04:50:07.305 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-19T04:50:07.305 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:50:07.305 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:50:07.305 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:50:07.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.297+0000 7f13a3c9e640 1 -- 172.21.15.2:0/3153777357 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f13840a3430 msgr2=0x7f13840a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:07.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.297+0000 7f13a3c9e640 1 --2- 172.21.15.2:0/3153777357 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f13840a3430 0x7f13840a58f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f138c009430 tx=0x7f138c0095c0 comp rx=0 tx=0).stop 2024-09-19T04:50:07.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.297+0000 7f13a3c9e640 1 -- 172.21.15.2:0/3153777357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f139c101de0 msgr2=0x7f139c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:07.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.297+0000 7f13a3c9e640 1 --2- 172.21.15.2:0/3153777357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f139c101de0 0x7f139c0744f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f139400c970 tx=0x7f139400ce30 comp rx=0 tx=0).stop 2024-09-19T04:50:07.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.297+0000 7f13a3c9e640 1 -- 172.21.15.2:0/3153777357 shutdown_connections 2024-09-19T04:50:07.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.297+0000 7f13a3c9e640 1 --2- 172.21.15.2:0/3153777357 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f139c106f10 0x7f139c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:07.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.297+0000 7f13a3c9e640 1 --2- 172.21.15.2:0/3153777357 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f13840a3430 0x7f13840a58f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:07.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.297+0000 7f13a3c9e640 1 --2- 172.21.15.2:0/3153777357 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f139c102790 0x7f139c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:07.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.298+0000 7f13a3c9e640 1 --2- 172.21.15.2:0/3153777357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f139c101de0 0x7f139c0744f0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:07.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.298+0000 7f13a3c9e640 1 -- 172.21.15.2:0/3153777357 >> 172.21.15.2:0/3153777357 conn(0x7f139c0fd8c0 msgr2=0x7f139c0fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:07.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.298+0000 7f13a3c9e640 1 -- 172.21.15.2:0/3153777357 shutdown_connections 2024-09-19T04:50:07.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:07.298+0000 7f13a3c9e640 1 -- 172.21.15.2:0/3153777357 wait complete. 2024-09-19T04:50:07.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:07 smithi002 ceph-mon[30975]: scrub queued for path: / 2024-09-19T04:50:07.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:07 smithi002 ceph-mon[30975]: scrub summary: idle+waiting paths [/] 2024-09-19T04:50:07.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:07 smithi002 ceph-mon[30975]: scrub summary: active paths [/] 2024-09-19T04:50:07.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:07 smithi002 ceph-mon[30975]: scrub summary: idle+waiting paths [/] 2024-09-19T04:50:07.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:07 smithi018 ceph-mon[34537]: scrub queued for path: / 2024-09-19T04:50:07.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:07 smithi018 ceph-mon[34537]: scrub summary: idle+waiting paths [/] 2024-09-19T04:50:07.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:07 smithi018 ceph-mon[34537]: scrub summary: active paths [/] 2024-09-19T04:50:07.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:07 smithi018 ceph-mon[34537]: scrub summary: idle+waiting paths [/] 2024-09-19T04:50:07.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:07 smithi116 ceph-mon[34477]: scrub queued for path: / 2024-09-19T04:50:07.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:07 smithi116 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-19T04:50:07.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:07 smithi116 ceph-mon[34477]: scrub summary: active paths [/] 2024-09-19T04:50:07.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:07 smithi116 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-19T04:50:07.974 INFO:tasks.cephfs.filesystem:scrub status for tag:e85c4791-7c80-433a-97ec-c71a6aad1594 - {'path': '/', 'tag': 'e85c4791-7c80-433a-97ec-c71a6aad1594', 'options': 'recursive,force'} 2024-09-19T04:50:08.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:08 smithi018 ceph-mon[34537]: pgmap v67: 97 pgs: 97 active+clean; 2.1 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 38 KiB/s wr, 22 op/s 2024-09-19T04:50:08.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:08 smithi002 ceph-mon[30975]: pgmap v67: 97 pgs: 97 active+clean; 2.1 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 38 KiB/s wr, 22 op/s 2024-09-19T04:50:08.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:08 smithi116 ceph-mon[34477]: pgmap v67: 97 pgs: 97 active+clean; 2.1 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 38 KiB/s wr, 22 op/s 2024-09-19T04:50:10.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:10 smithi018 ceph-mon[34537]: pgmap v68: 97 pgs: 97 active+clean; 2.1 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 38 KiB/s wr, 22 op/s 2024-09-19T04:50:10.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:10 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:50:10.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:10 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:50:10.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:10 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:50:10.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:10 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:50:10.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:10 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:50:10.808 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:10 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:50:10.808 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:10 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:50:10.808 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:10 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:50:10.808 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:10 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:50:10.808 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:10 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:50:10.808 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:10 smithi018 ceph-mon[34537]: scrub summary: idle 2024-09-19T04:50:10.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:10 smithi002 ceph-mon[30975]: pgmap v68: 97 pgs: 97 active+clean; 2.1 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 38 KiB/s wr, 22 op/s 2024-09-19T04:50:10.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:10 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:50:10.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:10 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:50:10.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:10 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:50:10.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:10 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:50:10.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:10 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:50:10.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:10 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:50:10.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:10 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:50:10.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:10 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:50:10.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:10 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:50:10.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:10 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:50:10.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:10 smithi002 ceph-mon[30975]: scrub summary: idle 2024-09-19T04:50:10.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:10 smithi116 ceph-mon[34477]: pgmap v68: 97 pgs: 97 active+clean; 2.1 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 38 KiB/s wr, 22 op/s 2024-09-19T04:50:10.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:10 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:50:10.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:10 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:50:10.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:10 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:50:10.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:10 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:50:10.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:10 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:50:10.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:10 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:50:10.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:10 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:50:10.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:10 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:50:10.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:10 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:50:10.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:10 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:50:10.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:10 smithi116 ceph-mon[34477]: scrub summary: idle 2024-09-19T04:50:12.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:12 smithi018 ceph-mon[34537]: pgmap v69: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 46 KiB/s wr, 25 op/s 2024-09-19T04:50:12.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:12 smithi002 ceph-mon[30975]: pgmap v69: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 46 KiB/s wr, 25 op/s 2024-09-19T04:50:12.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:12 smithi116 ceph-mon[34477]: pgmap v69: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 46 KiB/s wr, 25 op/s 2024-09-19T04:50:14.663 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:14 smithi116 ceph-mon[34477]: pgmap v70: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 40 KiB/s wr, 22 op/s 2024-09-19T04:50:14.736 INFO:tasks.workunit.client.0.smithi002.stdout:1/600: open fd = 3 2024-09-19T04:50:14.737 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.737 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.737 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.737 INFO:tasks.workunit.client.0.smithi002.stdout:2/600: open fd = 3 2024-09-19T04:50:14.737 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.737 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.737 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.737 INFO:tasks.workunit.client.0.smithi002.stdout:3/600: open fd = 3 2024-09-19T04:50:14.737 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.737 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.737 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.737 INFO:tasks.workunit.client.0.smithi002.stdout:4/600: open fd = 3 2024-09-19T04:50:14.737 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.738 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.738 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.738 INFO:tasks.workunit.client.0.smithi002.stdout:5/600: open fd = 3 2024-09-19T04:50:14.738 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.738 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.738 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.738 INFO:tasks.workunit.client.0.smithi002.stdout:6/600: open fd = 3 2024-09-19T04:50:14.738 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.738 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.738 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.738 INFO:tasks.workunit.client.0.smithi002.stdout:7/600: open fd = 3 2024-09-19T04:50:14.738 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.738 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.739 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.739 INFO:tasks.workunit.client.0.smithi002.stdout:8/600: open fd = 3 2024-09-19T04:50:14.739 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.739 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.739 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.739 INFO:tasks.workunit.client.0.smithi002.stdout:9/600: open fd = 3 2024-09-19T04:50:14.739 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.739 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.739 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.739 INFO:tasks.workunit.client.0.smithi002.stdout:10/600: open fd = 3 2024-09-19T04:50:14.739 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.739 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.739 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.739 INFO:tasks.workunit.client.0.smithi002.stdout:11/600: open fd = 3 2024-09-19T04:50:14.740 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.740 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.740 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.740 INFO:tasks.workunit.client.0.smithi002.stdout:12/600: open fd = 3 2024-09-19T04:50:14.740 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.740 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.740 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.740 INFO:tasks.workunit.client.0.smithi002.stdout:13/600: open fd = 3 2024-09-19T04:50:14.740 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.740 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.740 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.740 INFO:tasks.workunit.client.0.smithi002.stdout:14/600: open fd = 3 2024-09-19T04:50:14.740 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.740 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.740 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.741 INFO:tasks.workunit.client.0.smithi002.stdout:15/600: open fd = 3 2024-09-19T04:50:14.741 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.741 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.741 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.741 INFO:tasks.workunit.client.0.smithi002.stdout:16/600: open fd = 3 2024-09-19T04:50:14.741 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.741 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.741 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.741 INFO:tasks.workunit.client.0.smithi002.stdout:17/600: open fd = 3 2024-09-19T04:50:14.741 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.741 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.741 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.741 INFO:tasks.workunit.client.0.smithi002.stdout:18/600: open fd = 3 2024-09-19T04:50:14.742 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.742 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.742 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.742 INFO:tasks.workunit.client.0.smithi002.stdout:19/600: open fd = 3 2024-09-19T04:50:14.742 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.742 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.742 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.742 INFO:tasks.workunit.client.0.smithi002.stdout:20/600: open fd = 3 2024-09-19T04:50:14.742 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.742 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.742 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.742 INFO:tasks.workunit.client.0.smithi002.stdout:21/600: open fd = 3 2024-09-19T04:50:14.742 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.743 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.743 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.743 INFO:tasks.workunit.client.0.smithi002.stdout:22/600: open fd = 3 2024-09-19T04:50:14.743 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.743 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.743 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.743 INFO:tasks.workunit.client.0.smithi002.stdout:23/600: open fd = 3 2024-09-19T04:50:14.743 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.743 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.743 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.743 INFO:tasks.workunit.client.0.smithi002.stdout:24/600: open fd = 3 2024-09-19T04:50:14.743 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.743 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.744 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.744 INFO:tasks.workunit.client.0.smithi002.stdout:25/600: open fd = 3 2024-09-19T04:50:14.744 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.744 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.744 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.744 INFO:tasks.workunit.client.0.smithi002.stdout:26/600: open fd = 3 2024-09-19T04:50:14.744 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.744 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.744 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.744 INFO:tasks.workunit.client.0.smithi002.stdout:27/600: open fd = 3 2024-09-19T04:50:14.744 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.744 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.744 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.745 INFO:tasks.workunit.client.0.smithi002.stdout:28/600: open fd = 3 2024-09-19T04:50:14.745 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.745 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.745 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.745 INFO:tasks.workunit.client.0.smithi002.stdout:29/600: open fd = 3 2024-09-19T04:50:14.745 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.745 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.745 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.745 INFO:tasks.workunit.client.0.smithi002.stdout:30/600: open fd = 3 2024-09-19T04:50:14.745 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.745 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.745 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.745 INFO:tasks.workunit.client.0.smithi002.stdout:31/600: open fd = 3 2024-09-19T04:50:14.745 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.746 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.746 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.746 INFO:tasks.workunit.client.0.smithi002.stdout:32/600: open fd = 3 2024-09-19T04:50:14.746 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.746 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.746 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.746 INFO:tasks.workunit.client.0.smithi002.stdout:33/600: open fd = 3 2024-09-19T04:50:14.746 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.746 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.746 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.746 INFO:tasks.workunit.client.0.smithi002.stdout:34/600: open fd = 3 2024-09-19T04:50:14.746 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.746 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.746 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.747 INFO:tasks.workunit.client.0.smithi002.stdout:35/600: open fd = 3 2024-09-19T04:50:14.747 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.747 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.747 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.747 INFO:tasks.workunit.client.0.smithi002.stdout:36/600: open fd = 3 2024-09-19T04:50:14.747 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.747 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.747 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.747 INFO:tasks.workunit.client.0.smithi002.stdout:37/600: open fd = 3 2024-09-19T04:50:14.747 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.747 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.747 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.747 INFO:tasks.workunit.client.0.smithi002.stdout:38/600: open fd = 3 2024-09-19T04:50:14.747 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.747 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.748 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.748 INFO:tasks.workunit.client.0.smithi002.stdout:39/600: open fd = 3 2024-09-19T04:50:14.748 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.748 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.748 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.748 INFO:tasks.workunit.client.0.smithi002.stdout:40/600: open fd = 3 2024-09-19T04:50:14.748 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.748 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.748 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.749 INFO:tasks.workunit.client.0.smithi002.stdout:41/600: open fd = 3 2024-09-19T04:50:14.749 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.749 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.749 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.749 INFO:tasks.workunit.client.0.smithi002.stdout:42/600: open fd = 3 2024-09-19T04:50:14.749 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.749 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.749 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.749 INFO:tasks.workunit.client.0.smithi002.stdout:43/600: open fd = 3 2024-09-19T04:50:14.749 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.749 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.749 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.749 INFO:tasks.workunit.client.0.smithi002.stdout:44/600: open fd = 3 2024-09-19T04:50:14.750 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.750 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.750 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.750 INFO:tasks.workunit.client.0.smithi002.stdout:45/600: open fd = 3 2024-09-19T04:50:14.750 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.750 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.750 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.750 INFO:tasks.workunit.client.0.smithi002.stdout:46/600: open fd = 3 2024-09-19T04:50:14.750 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.750 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.750 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.750 INFO:tasks.workunit.client.0.smithi002.stdout:47/600: open fd = 3 2024-09-19T04:50:14.750 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.750 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.751 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.751 INFO:tasks.workunit.client.0.smithi002.stdout:48/600: open fd = 3 2024-09-19T04:50:14.751 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.751 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.751 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.751 INFO:tasks.workunit.client.0.smithi002.stdout:49/600: open fd = 3 2024-09-19T04:50:14.751 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.751 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.751 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.751 INFO:tasks.workunit.client.0.smithi002.stdout:50/600: open fd = 3 2024-09-19T04:50:14.751 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.751 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.751 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.751 INFO:tasks.workunit.client.0.smithi002.stdout:51/600: open fd = 3 2024-09-19T04:50:14.752 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.752 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.752 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.752 INFO:tasks.workunit.client.0.smithi002.stdout:52/600: open fd = 3 2024-09-19T04:50:14.752 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.752 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.752 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.752 INFO:tasks.workunit.client.0.smithi002.stdout:53/600: open fd = 3 2024-09-19T04:50:14.752 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.752 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.752 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.752 INFO:tasks.workunit.client.0.smithi002.stdout:54/600: open fd = 3 2024-09-19T04:50:14.752 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.752 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.753 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.753 INFO:tasks.workunit.client.0.smithi002.stdout:55/600: open fd = 3 2024-09-19T04:50:14.753 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.753 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.753 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.753 INFO:tasks.workunit.client.0.smithi002.stdout:56/600: open fd = 3 2024-09-19T04:50:14.753 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.753 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.753 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.753 INFO:tasks.workunit.client.0.smithi002.stdout:57/600: open fd = 3 2024-09-19T04:50:14.753 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.753 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.753 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.753 INFO:tasks.workunit.client.0.smithi002.stdout:58/600: open fd = 3 2024-09-19T04:50:14.754 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.754 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.754 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.754 INFO:tasks.workunit.client.0.smithi002.stdout:59/600: open fd = 3 2024-09-19T04:50:14.754 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.754 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.754 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.754 INFO:tasks.workunit.client.0.smithi002.stdout:60/600: open fd = 3 2024-09-19T04:50:14.754 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.754 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.754 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.754 INFO:tasks.workunit.client.0.smithi002.stdout:61/600: open fd = 3 2024-09-19T04:50:14.754 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.754 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.754 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.755 INFO:tasks.workunit.client.0.smithi002.stdout:62/600: open fd = 3 2024-09-19T04:50:14.755 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.755 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.755 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.755 INFO:tasks.workunit.client.0.smithi002.stdout:63/600: open fd = 3 2024-09-19T04:50:14.755 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.755 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:50:14.755 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:50:14.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:14 smithi018 ceph-mon[34537]: pgmap v70: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 40 KiB/s wr, 22 op/s 2024-09-19T04:50:14.859 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:14 smithi002 ceph-mon[30975]: pgmap v70: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 40 KiB/s wr, 22 op/s 2024-09-19T04:50:16.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:16 smithi018 ceph-mon[34537]: pgmap v71: 97 pgs: 97 active+clean; 2.3 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 50 KiB/s wr, 26 op/s 2024-09-19T04:50:16.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:16 smithi002 ceph-mon[30975]: pgmap v71: 97 pgs: 97 active+clean; 2.3 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 50 KiB/s wr, 26 op/s 2024-09-19T04:50:16.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:16 smithi116 ceph-mon[34477]: pgmap v71: 97 pgs: 97 active+clean; 2.3 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 50 KiB/s wr, 26 op/s 2024-09-19T04:50:18.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:18 smithi018 ceph-mon[34537]: pgmap v72: 97 pgs: 97 active+clean; 2.3 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 18 KiB/s wr, 7 op/s 2024-09-19T04:50:18.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:18 smithi116 ceph-mon[34477]: pgmap v72: 97 pgs: 97 active+clean; 2.3 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 18 KiB/s wr, 7 op/s 2024-09-19T04:50:18.862 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:18 smithi002 ceph-mon[30975]: pgmap v72: 97 pgs: 97 active+clean; 2.3 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 18 KiB/s wr, 7 op/s 2024-09-19T04:50:20.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:20 smithi018 ceph-mon[34537]: pgmap v73: 97 pgs: 97 active+clean; 2.3 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 18 KiB/s wr, 7 op/s 2024-09-19T04:50:20.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:20 smithi002 ceph-mon[30975]: pgmap v73: 97 pgs: 97 active+clean; 2.3 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 18 KiB/s wr, 7 op/s 2024-09-19T04:50:20.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:20 smithi116 ceph-mon[34477]: pgmap v73: 97 pgs: 97 active+clean; 2.3 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 18 KiB/s wr, 7 op/s 2024-09-19T04:50:22.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:22 smithi018 ceph-mon[34537]: pgmap v74: 97 pgs: 97 active+clean; 2.4 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-09-19T04:50:22.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:22 smithi002 ceph-mon[30975]: pgmap v74: 97 pgs: 97 active+clean; 2.4 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-09-19T04:50:22.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:22 smithi116 ceph-mon[34477]: pgmap v74: 97 pgs: 97 active+clean; 2.4 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-09-19T04:50:24.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:24 smithi018 ceph-mon[34537]: pgmap v75: 97 pgs: 97 active+clean; 2.4 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 18 KiB/s wr, 7 op/s 2024-09-19T04:50:24.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:24 smithi002 ceph-mon[30975]: pgmap v75: 97 pgs: 97 active+clean; 2.4 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 18 KiB/s wr, 7 op/s 2024-09-19T04:50:24.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:24 smithi116 ceph-mon[34477]: pgmap v75: 97 pgs: 97 active+clean; 2.4 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 18 KiB/s wr, 7 op/s 2024-09-19T04:50:26.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:26 smithi018 ceph-mon[34537]: pgmap v76: 97 pgs: 97 active+clean; 2.5 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 28 KiB/s wr, 11 op/s 2024-09-19T04:50:26.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:26 smithi002 ceph-mon[30975]: pgmap v76: 97 pgs: 97 active+clean; 2.5 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 28 KiB/s wr, 11 op/s 2024-09-19T04:50:26.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:26 smithi116 ceph-mon[34477]: pgmap v76: 97 pgs: 97 active+clean; 2.5 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 28 KiB/s wr, 11 op/s 2024-09-19T04:50:28.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:28 smithi018 ceph-mon[34537]: pgmap v77: 97 pgs: 97 active+clean; 2.5 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-09-19T04:50:28.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:28 smithi002 ceph-mon[30975]: pgmap v77: 97 pgs: 97 active+clean; 2.5 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-09-19T04:50:28.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:28 smithi116 ceph-mon[34477]: pgmap v77: 97 pgs: 97 active+clean; 2.5 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-09-19T04:50:30.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:30 smithi018 ceph-mon[34537]: pgmap v78: 97 pgs: 97 active+clean; 2.5 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-09-19T04:50:30.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:30 smithi002 ceph-mon[30975]: pgmap v78: 97 pgs: 97 active+clean; 2.5 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-09-19T04:50:30.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:30 smithi116 ceph-mon[34477]: pgmap v78: 97 pgs: 97 active+clean; 2.5 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-09-19T04:50:32.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:32 smithi018 ceph-mon[34537]: pgmap v79: 97 pgs: 97 active+clean; 2.6 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-09-19T04:50:32.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:32 smithi002 ceph-mon[30975]: pgmap v79: 97 pgs: 97 active+clean; 2.6 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-09-19T04:50:32.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:32 smithi116 ceph-mon[34477]: pgmap v79: 97 pgs: 97 active+clean; 2.6 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-09-19T04:50:34.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:34 smithi018 ceph-mon[34537]: pgmap v80: 97 pgs: 97 active+clean; 2.6 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 18 KiB/s wr, 7 op/s 2024-09-19T04:50:34.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:34 smithi002 ceph-mon[30975]: pgmap v80: 97 pgs: 97 active+clean; 2.6 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 18 KiB/s wr, 7 op/s 2024-09-19T04:50:34.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:34 smithi116 ceph-mon[34477]: pgmap v80: 97 pgs: 97 active+clean; 2.6 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 18 KiB/s wr, 7 op/s 2024-09-19T04:50:36.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:36 smithi018 ceph-mon[34537]: pgmap v81: 97 pgs: 97 active+clean; 2.7 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 29 KiB/s wr, 11 op/s 2024-09-19T04:50:36.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:36 smithi002 ceph-mon[30975]: pgmap v81: 97 pgs: 97 active+clean; 2.7 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 29 KiB/s wr, 11 op/s 2024-09-19T04:50:36.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:36 smithi116 ceph-mon[34477]: pgmap v81: 97 pgs: 97 active+clean; 2.7 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 29 KiB/s wr, 11 op/s 2024-09-19T04:50:37.975 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:50:38.247 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:50:38.698 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:38 smithi002 ceph-mon[30975]: pgmap v82: 97 pgs: 97 active+clean; 2.7 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-09-19T04:50:38.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.698+0000 7f2a598c3640 1 -- 172.21.15.2:0/1141436020 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a54101df0 msgr2=0x7f2a541021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:38.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.698+0000 7f2a598c3640 1 --2- 172.21.15.2:0/1141436020 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a54101df0 0x7f2a541021d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2a44009900 tx=0x7f2a4402a3f0 comp rx=0 tx=0).stop 2024-09-19T04:50:38.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.699+0000 7f2a598c3640 1 -- 172.21.15.2:0/1141436020 shutdown_connections 2024-09-19T04:50:38.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.699+0000 7f2a598c3640 1 --2- 172.21.15.2:0/1141436020 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2a54106f20 0x7f2a5410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:38.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.699+0000 7f2a598c3640 1 --2- 172.21.15.2:0/1141436020 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2a541027a0 0x7f2a541067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:38.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.699+0000 7f2a598c3640 1 --2- 172.21.15.2:0/1141436020 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a54101df0 0x7f2a541021d0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:38.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.699+0000 7f2a598c3640 1 -- 172.21.15.2:0/1141436020 >> 172.21.15.2:0/1141436020 conn(0x7f2a540fd8b0 msgr2=0x7f2a540ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:38.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.699+0000 7f2a598c3640 1 -- 172.21.15.2:0/1141436020 shutdown_connections 2024-09-19T04:50:38.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.699+0000 7f2a598c3640 1 -- 172.21.15.2:0/1141436020 wait complete. 2024-09-19T04:50:38.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.699+0000 7f2a598c3640 1 Processor -- start 2024-09-19T04:50:38.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.700+0000 7f2a598c3640 1 -- start start 2024-09-19T04:50:38.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.700+0000 7f2a598c3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2a54101df0 0x7f2a541982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:38.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.700+0000 7f2a598c3640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2a541027a0 0x7f2a54198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:38.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.700+0000 7f2a598c3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a54106f20 0x7f2a5419cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:38.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.700+0000 7f2a598c3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2a54111df0 con 0x7f2a54106f20 2024-09-19T04:50:38.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.700+0000 7f2a598c3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2a54111c70 con 0x7f2a54101df0 2024-09-19T04:50:38.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.700+0000 7f2a598c3640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f2a54111f70 con 0x7f2a541027a0 2024-09-19T04:50:38.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.700+0000 7f2a537fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a54106f20 0x7f2a5419cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:38.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.700+0000 7f2a537fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a54106f20 0x7f2a5419cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54274/0 (socket says 172.21.15.2:54274) 2024-09-19T04:50:38.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.700+0000 7f2a537fe640 1 -- 172.21.15.2:0/693715730 learned_addr learned my addr 172.21.15.2:0/693715730 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:38.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.700+0000 7f2a527fc640 1 --2- 172.21.15.2:0/693715730 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2a541027a0 0x7f2a54198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:38.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.700+0000 7f2a52ffd640 1 --2- 172.21.15.2:0/693715730 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2a54101df0 0x7f2a541982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:38.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.701+0000 7f2a537fe640 1 -- 172.21.15.2:0/693715730 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2a541027a0 msgr2=0x7f2a54198810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:38.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.701+0000 7f2a537fe640 1 --2- 172.21.15.2:0/693715730 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2a541027a0 0x7f2a54198810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:38.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.701+0000 7f2a537fe640 1 -- 172.21.15.2:0/693715730 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2a54101df0 msgr2=0x7f2a541982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:38.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.701+0000 7f2a537fe640 1 --2- 172.21.15.2:0/693715730 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2a54101df0 0x7f2a541982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:38.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.701+0000 7f2a537fe640 1 -- 172.21.15.2:0/693715730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a5419d280 con 0x7f2a54106f20 2024-09-19T04:50:38.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.701+0000 7f2a52ffd640 1 --2- 172.21.15.2:0/693715730 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2a54101df0 0x7f2a541982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:50:38.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.701+0000 7f2a537fe640 1 --2- 172.21.15.2:0/693715730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a54106f20 0x7f2a5419cba0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c00cad0 tx=0x7f2a4c00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:38.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.701+0000 7f2a588c1640 1 -- 172.21.15.2:0/693715730 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c00ad60 con 0x7f2a54106f20 2024-09-19T04:50:38.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.701+0000 7f2a588c1640 1 -- 172.21.15.2:0/693715730 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2a4c005020 con 0x7f2a54106f20 2024-09-19T04:50:38.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.701+0000 7f2a598c3640 1 -- 172.21.15.2:0/693715730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a5419d570 con 0x7f2a54106f20 2024-09-19T04:50:38.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.701+0000 7f2a588c1640 1 -- 172.21.15.2:0/693715730 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c00f6b0 con 0x7f2a54106f20 2024-09-19T04:50:38.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.701+0000 7f2a598c3640 1 -- 172.21.15.2:0/693715730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a541a4e50 con 0x7f2a54106f20 2024-09-19T04:50:38.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.704+0000 7f2a588c1640 1 -- 172.21.15.2:0/693715730 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f2a4c0051d0 con 0x7f2a54106f20 2024-09-19T04:50:38.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.704+0000 7f2a5bc9c740 1 Processor -- start 2024-09-19T04:50:38.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.704+0000 7f2a5bc9c740 1 -- start start 2024-09-19T04:50:38.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.704+0000 7f2a5bc9c740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5556c14344a0 0x5556c1434880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:38.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.704+0000 7f2a5bc9c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5556c1434dc0 0x5556c143f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:38.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.705+0000 7f2a5bc9c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556c143f680 0x5556c1441a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:38.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.705+0000 7f2a5bc9c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5556c139a2e0 con 0x5556c143f680 2024-09-19T04:50:38.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.705+0000 7f2a5bc9c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5556c1341ce0 con 0x5556c1434dc0 2024-09-19T04:50:38.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.705+0000 7f2a5bc9c740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5556c13962a0 con 0x5556c14344a0 2024-09-19T04:50:38.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.705+0000 7f2a527fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556c143f680 0x5556c1441a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:38.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.705+0000 7f2a588c1640 1 --2- 172.21.15.2:0/693715730 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f2a3c0a33b0 0x7f2a3c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:38.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.705+0000 7f2a527fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556c143f680 0x5556c1441a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54290/0 (socket says 172.21.15.2:54290) 2024-09-19T04:50:38.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.705+0000 7f2a527fc640 1 -- 172.21.15.2:0/3323599980 learned_addr learned my addr 172.21.15.2:0/3323599980 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:38.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.705+0000 7f2a52ffd640 1 --2- 172.21.15.2:0/3323599980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5556c1434dc0 0x5556c143f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:38.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.705+0000 7f2a527fc640 1 --2- 172.21.15.2:0/3323599980 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5556c14344a0 0x5556c1434880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:38.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.705+0000 7f2a537fe640 1 --2- 172.21.15.2:0/693715730 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f2a3c0a33b0 0x7f2a3c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:38.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.705+0000 7f2a588c1640 1 -- 172.21.15.2:0/693715730 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f2a4c0cfd40 con 0x7f2a54106f20 2024-09-19T04:50:38.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.705+0000 7f2a527fc640 1 -- 172.21.15.2:0/3323599980 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5556c14344a0 msgr2=0x5556c1434880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:38.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.705+0000 7f2a527fc640 1 --2- 172.21.15.2:0/3323599980 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5556c14344a0 0x5556c1434880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:38.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.705+0000 7f2a527fc640 1 -- 172.21.15.2:0/3323599980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5556c1434dc0 msgr2=0x5556c143f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:38.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.705+0000 7f2a527fc640 1 --2- 172.21.15.2:0/3323599980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5556c1434dc0 0x5556c143f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:38.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.705+0000 7f2a527fc640 1 -- 172.21.15.2:0/3323599980 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556c1326440 con 0x5556c143f680 2024-09-19T04:50:38.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.705+0000 7f2a527fc640 1 --2- 172.21.15.2:0/3323599980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556c143f680 0x5556c1441a70 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f2a48011560 tx=0x7f2a4800a810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dd5eedd3912d532 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:38.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.705+0000 7f2a537fe640 1 --2- 172.21.15.2:0/693715730 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f2a3c0a33b0 0x7f2a3c0a5870 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c09bf70 tx=0x7f2a4c0bc040 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:38.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.706+0000 7f2a39ffb640 1 -- 172.21.15.2:0/3323599980 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a48005220 con 0x5556c143f680 2024-09-19T04:50:38.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.706+0000 7f2a39ffb640 1 -- 172.21.15.2:0/3323599980 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2a48004c50 con 0x5556c143f680 2024-09-19T04:50:38.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.706+0000 7f2a39ffb640 1 -- 172.21.15.2:0/3323599980 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a4800fbd0 con 0x5556c143f680 2024-09-19T04:50:38.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.706+0000 7f2a5bc9c740 1 -- 172.21.15.2:0/3323599980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556c143f680 msgr2=0x5556c1441a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:38.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.706+0000 7f2a5bc9c740 1 --2- 172.21.15.2:0/3323599980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556c143f680 0x5556c1441a70 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f2a48011560 tx=0x7f2a4800a810 comp rx=0 tx=0).stop 2024-09-19T04:50:38.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.706+0000 7f2a5bc9c740 1 -- 172.21.15.2:0/3323599980 shutdown_connections 2024-09-19T04:50:38.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.706+0000 7f2a5bc9c740 1 --2- 172.21.15.2:0/3323599980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556c143f680 0x5556c1441a70 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:38.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.706+0000 7f2a5bc9c740 1 --2- 172.21.15.2:0/3323599980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5556c1434dc0 0x5556c143f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:38.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.706+0000 7f2a5bc9c740 1 --2- 172.21.15.2:0/3323599980 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5556c14344a0 0x5556c1434880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:38.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.706+0000 7f2a5bc9c740 1 -- 172.21.15.2:0/3323599980 >> 172.21.15.2:0/3323599980 conn(0x5556c1430a30 msgr2=0x5556c1430e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:38.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.707+0000 7f2a5bc9c740 1 -- 172.21.15.2:0/3323599980 shutdown_connections 2024-09-19T04:50:38.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.707+0000 7f2a5bc9c740 1 -- 172.21.15.2:0/3323599980 wait complete. 2024-09-19T04:50:38.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.707+0000 7f2a5bc9c740 1 -- start start 2024-09-19T04:50:38.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.707+0000 7f2a5bc9c740 1 Processor -- start 2024-09-19T04:50:38.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.707+0000 7f2a5bc9c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556c14344a0 0x5556c143f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:38.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.707+0000 7f2a5bc9c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5556c1434dc0 0x5556c143c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:38.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.707+0000 7f2a5bc9c740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5556c143f680 0x5556c143c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:38.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.707+0000 7f2a5bc9c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5556c1446660 con 0x5556c14344a0 2024-09-19T04:50:38.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.707+0000 7f2a5bc9c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5556c1355050 con 0x5556c1434dc0 2024-09-19T04:50:38.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.707+0000 7f2a5bc9c740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5556c14467e0 con 0x5556c143f680 2024-09-19T04:50:38.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.708+0000 7f2a5bc9c740 10 client.0 _ll_register_callbacks cb 0x5556c1395160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:50:38.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.708+0000 7f2a527fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556c14344a0 0x5556c143f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:38.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.708+0000 7f2a527fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556c14344a0 0x5556c143f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54292/0 (socket says 172.21.15.2:54292) 2024-09-19T04:50:38.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.708+0000 7f2a527fc640 1 -- 172.21.15.2:0/2628724743 learned_addr learned my addr 172.21.15.2:0/2628724743 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:38.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.708+0000 7f2a52ffd640 1 --2- 172.21.15.2:0/2628724743 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5556c1434dc0 0x5556c143c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:38.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.708+0000 7f2a527fc640 1 -- 172.21.15.2:0/2628724743 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5556c143f680 msgr2=0x5556c143c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:38.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.708+0000 7f2a527fc640 1 --2- 172.21.15.2:0/2628724743 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5556c143f680 0x5556c143c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:38.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.708+0000 7f2a527fc640 1 -- 172.21.15.2:0/2628724743 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5556c1434dc0 msgr2=0x5556c143c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:38.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.708+0000 7f2a527fc640 1 --2- 172.21.15.2:0/2628724743 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5556c1434dc0 0x5556c143c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:38.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.708+0000 7f2a527fc640 1 -- 172.21.15.2:0/2628724743 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556c110b3c0 con 0x5556c14344a0 2024-09-19T04:50:38.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.708+0000 7f2a527fc640 1 --2- 172.21.15.2:0/2628724743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556c14344a0 0x5556c143f080 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2a48001eb0 tx=0x7f2a48005500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=635b23b7dba0e7b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:38.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.708+0000 7f2a32ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:50:38.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.708+0000 7f2a32ffd640 1 -- 172.21.15.2:0/2628724743 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a4800a2d0 con 0x5556c14344a0 2024-09-19T04:50:38.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.708+0000 7f2a32ffd640 1 -- 172.21.15.2:0/2628724743 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f2a48004e00 con 0x5556c14344a0 2024-09-19T04:50:38.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.708+0000 7f2a5bc9c740 1 -- 172.21.15.2:0/2628724743 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a48004c50 con 0x5556c14344a0 2024-09-19T04:50:38.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.709+0000 7f2a32ffd640 1 -- 172.21.15.2:0/2628724743 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f2a48034050 con 0x5556c14344a0 2024-09-19T04:50:38.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.709+0000 7f2a5bc9c740 10 client.15528 fetch_fsmap learned FSMap version 19 2024-09-19T04:50:38.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.709+0000 7f2a5bc9c740 1 -- 172.21.15.2:0/2628724743 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5556c14520c0 con 0x5556c14344a0 2024-09-19T04:50:38.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.709+0000 7f2a32ffd640 1 -- 172.21.15.2:0/2628724743 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2a48004c50 con 0x5556c14344a0 2024-09-19T04:50:38.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.709+0000 7f2a32ffd640 1 -- 172.21.15.2:0/2628724743 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f2a4801b070 con 0x5556c14344a0 2024-09-19T04:50:38.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.709+0000 7f2a5bc9c740 10 client.15528 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:50:38.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.709+0000 7f2a5bc9c740 10 client.15528 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:50:38.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.709+0000 7f2a5bc9c740 20 client.15528 populate_metadata read hostname 'smithi002' 2024-09-19T04:50:38.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.709+0000 7f2a5bc9c740 1 --2- 172.21.15.2:0/2628724743 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5556c1453470 0x5556c1455860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:38.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.709+0000 7f2a5bc9c740 4 client.15528 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:50:38.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.709+0000 7f2a5bc9c740 1 -- 172.21.15.2:0/2628724743 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5556c13a7850 con 0x5556c1453470 2024-09-19T04:50:38.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.710+0000 7f2a52ffd640 1 --2- 172.21.15.2:0/2628724743 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5556c1453470 0x5556c1455860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:38.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.710+0000 7f2a52ffd640 1 --2- 172.21.15.2:0/2628724743 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5556c1453470 0x5556c1455860 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ae131ae21851594 server_cookie=463e9d6958a78a00 in_seq=0 out_seq=0 2024-09-19T04:50:38.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.710+0000 7f2a32ffd640 10 client.15528 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:50:38.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.711+0000 7f2a32ffd640 1 -- 172.21.15.2:0/2628724743 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5556c13a7850 con 0x5556c1453470 2024-09-19T04:50:38.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.711+0000 7f2a32ffd640 10 client.15528 handle_command_reply: tid=0 2024-09-19T04:50:38.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.711+0000 7f2a5bc9c740 1 client.15528 shutdown 2024-09-19T04:50:38.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.711+0000 7f2a5bc9c740 1 -- 172.21.15.2:0/2628724743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556c14344a0 msgr2=0x5556c143f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:38.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.711+0000 7f2a5bc9c740 1 --2- 172.21.15.2:0/2628724743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556c14344a0 0x5556c143f080 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2a48001eb0 tx=0x7f2a48005500 comp rx=0 tx=0).stop 2024-09-19T04:50:38.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.711+0000 7f2a5bc9c740 1 -- 172.21.15.2:0/2628724743 shutdown_connections 2024-09-19T04:50:38.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.711+0000 7f2a5bc9c740 1 --2- 172.21.15.2:0/2628724743 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5556c1453470 0x5556c1455860 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:38.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.711+0000 7f2a5bc9c740 1 --2- 172.21.15.2:0/2628724743 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5556c143f680 0x5556c143c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:38.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.711+0000 7f2a5bc9c740 1 --2- 172.21.15.2:0/2628724743 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5556c1434dc0 0x5556c143c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:38.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.711+0000 7f2a5bc9c740 1 --2- 172.21.15.2:0/2628724743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556c14344a0 0x5556c143f080 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:38.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.711+0000 7f2a5bc9c740 1 -- 172.21.15.2:0/2628724743 >> 172.21.15.2:0/2628724743 conn(0x5556c1430a30 msgr2=0x5556c1436710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:38.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.711+0000 7f2a32ffd640 0 client.15528 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:50:38.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.711+0000 7f2a5bc9c740 1 -- 172.21.15.2:0/2628724743 shutdown_connections 2024-09-19T04:50:38.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.711+0000 7f2a5bc9c740 1 -- 172.21.15.2:0/2628724743 wait complete. 2024-09-19T04:50:38.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.711+0000 7f2a5bc9c740 20 client.15528 trim_cache size 0 max 16384 2024-09-19T04:50:38.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.729+0000 7f2a5bc9c740 1 Processor -- start 2024-09-19T04:50:38.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.729+0000 7f2a5bc9c740 1 -- start start 2024-09-19T04:50:38.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.729+0000 7f2a5bc9c740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5556c1430a30 0x5556c144f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:38.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.729+0000 7f2a5bc9c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556c14344a0 0x5556c145afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:38.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.729+0000 7f2a5bc9c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5556c1434dc0 0x5556c145b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:38.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.729+0000 7f2a5bc9c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2a541a94d0 con 0x5556c14344a0 2024-09-19T04:50:38.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.729+0000 7f2a5bc9c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2a541abd50 con 0x5556c1434dc0 2024-09-19T04:50:38.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.729+0000 7f2a5bc9c740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f2a541a9b40 con 0x5556c1430a30 2024-09-19T04:50:38.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.729+0000 7f2a52ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556c14344a0 0x5556c145afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:38.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.729+0000 7f2a52ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556c14344a0 0x5556c145afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54302/0 (socket says 172.21.15.2:54302) 2024-09-19T04:50:38.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.729+0000 7f2a52ffd640 1 -- 172.21.15.2:0/1853147368 learned_addr learned my addr 172.21.15.2:0/1853147368 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:38.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.729+0000 7f2a527fc640 1 --2- 172.21.15.2:0/1853147368 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5556c1434dc0 0x5556c145b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:38.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.729+0000 7f2a527fc640 1 --2- 172.21.15.2:0/1853147368 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5556c1430a30 0x5556c144f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:38.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.729+0000 7f2a52ffd640 1 -- 172.21.15.2:0/1853147368 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5556c1430a30 msgr2=0x5556c144f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:38.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.729+0000 7f2a52ffd640 1 --2- 172.21.15.2:0/1853147368 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5556c1430a30 0x5556c144f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:38.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.729+0000 7f2a52ffd640 1 -- 172.21.15.2:0/1853147368 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5556c1434dc0 msgr2=0x5556c145b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:38.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.730+0000 7f2a52ffd640 1 --2- 172.21.15.2:0/1853147368 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5556c1434dc0 0x5556c145b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:38.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.730+0000 7f2a52ffd640 1 -- 172.21.15.2:0/1853147368 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556c143cf20 con 0x5556c14344a0 2024-09-19T04:50:38.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.730+0000 7f2a52ffd640 1 --2- 172.21.15.2:0/1853147368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556c14344a0 0x5556c145afa0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2a44009900 tx=0x7f2a440058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bbb656c69133b8e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:38.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.730+0000 7f2a397fa640 1 -- 172.21.15.2:0/1853147368 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a44049070 con 0x5556c14344a0 2024-09-19T04:50:38.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.730+0000 7f2a397fa640 1 -- 172.21.15.2:0/1853147368 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2a44005020 con 0x5556c14344a0 2024-09-19T04:50:38.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.730+0000 7f2a397fa640 1 -- 172.21.15.2:0/1853147368 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a44035040 con 0x5556c14344a0 2024-09-19T04:50:38.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.731+0000 7f2a5bc9c740 1 -- 172.21.15.2:0/1853147368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556c14344a0 msgr2=0x5556c145afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:38.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.731+0000 7f2a5bc9c740 1 --2- 172.21.15.2:0/1853147368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556c14344a0 0x5556c145afa0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2a44009900 tx=0x7f2a440058b0 comp rx=0 tx=0).stop 2024-09-19T04:50:38.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.731+0000 7f2a5bc9c740 1 -- 172.21.15.2:0/1853147368 shutdown_connections 2024-09-19T04:50:38.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.731+0000 7f2a5bc9c740 1 --2- 172.21.15.2:0/1853147368 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5556c1434dc0 0x5556c145b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:38.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.731+0000 7f2a5bc9c740 1 --2- 172.21.15.2:0/1853147368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556c14344a0 0x5556c145afa0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:38.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.731+0000 7f2a5bc9c740 1 --2- 172.21.15.2:0/1853147368 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5556c1430a30 0x5556c144f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:38.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.731+0000 7f2a5bc9c740 1 -- 172.21.15.2:0/1853147368 >> 172.21.15.2:0/1853147368 conn(0x5556c1455b60 msgr2=0x5556c14378b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:38.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.731+0000 7f2a5bc9c740 1 -- 172.21.15.2:0/1853147368 shutdown_connections 2024-09-19T04:50:38.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.731+0000 7f2a5bc9c740 1 -- 172.21.15.2:0/1853147368 wait complete. 2024-09-19T04:50:38.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.731+0000 7f2a5bc9c740 1 -- start start 2024-09-19T04:50:38.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.732+0000 7f2a5bc9c740 1 Processor -- start 2024-09-19T04:50:38.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.732+0000 7f2a5bc9c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556c1430a30 0x5556c14471d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:38.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.732+0000 7f2a5bc9c740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5556c14344a0 0x5556c1447710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:38.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.732+0000 7f2a5bc9c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5556c1434dc0 0x5556c144b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:38.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.732+0000 7f2a5bc9c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2a541aa210 con 0x5556c1430a30 2024-09-19T04:50:38.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.732+0000 7f2a5bc9c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2a541ab680 con 0x5556c1434dc0 2024-09-19T04:50:38.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.732+0000 7f2a5bc9c740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f2a541aa8e0 con 0x5556c14344a0 2024-09-19T04:50:38.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.732+0000 7f2a5bc9c740 10 client.0 _ll_register_callbacks cb 0x7f2a44009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:50:38.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.732+0000 7f2a527fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556c1430a30 0x5556c14471d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:38.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.732+0000 7f2a527fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556c1430a30 0x5556c14471d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54310/0 (socket says 172.21.15.2:54310) 2024-09-19T04:50:38.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.732+0000 7f2a527fc640 1 -- 172.21.15.2:0/1060949910 learned_addr learned my addr 172.21.15.2:0/1060949910 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:38.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.732+0000 7f2a52ffd640 1 --2- 172.21.15.2:0/1060949910 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5556c14344a0 0x5556c1447710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:38.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.732+0000 7f2a527fc640 1 -- 172.21.15.2:0/1060949910 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5556c14344a0 msgr2=0x5556c1447710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:38.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.732+0000 7f2a527fc640 1 --2- 172.21.15.2:0/1060949910 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5556c14344a0 0x5556c1447710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:38.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.732+0000 7f2a527fc640 1 -- 172.21.15.2:0/1060949910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5556c1434dc0 msgr2=0x5556c144b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:38.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.732+0000 7f2a527fc640 1 --2- 172.21.15.2:0/1060949910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5556c1434dc0 0x5556c144b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:38.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.732+0000 7f2a527fc640 1 -- 172.21.15.2:0/1060949910 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556c144bec0 con 0x5556c1430a30 2024-09-19T04:50:38.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.732+0000 7f2a527fc640 1 --2- 172.21.15.2:0/1060949910 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556c1430a30 0x5556c14471d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2a48001eb0 tx=0x7f2a4800f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6186de2634ab5544 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:38.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.732+0000 7f2a32ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:50:38.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.733+0000 7f2a32ffd640 1 -- 172.21.15.2:0/1060949910 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a4800a390 con 0x5556c1430a30 2024-09-19T04:50:38.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.733+0000 7f2a32ffd640 1 -- 172.21.15.2:0/1060949910 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f2a480268a0 con 0x5556c1430a30 2024-09-19T04:50:38.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.733+0000 7f2a5bc9c740 1 -- 172.21.15.2:0/1060949910 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a44005020 con 0x5556c1430a30 2024-09-19T04:50:38.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.733+0000 7f2a32ffd640 1 -- 172.21.15.2:0/1060949910 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f2a48046050 con 0x5556c1430a30 2024-09-19T04:50:38.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.733+0000 7f2a5bc9c740 10 client.15534 fetch_fsmap learned FSMap version 19 2024-09-19T04:50:38.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.733+0000 7f2a5bc9c740 1 -- 172.21.15.2:0/1060949910 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5556c14bdaa0 con 0x5556c1430a30 2024-09-19T04:50:38.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.733+0000 7f2a32ffd640 1 -- 172.21.15.2:0/1060949910 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2a44005020 con 0x5556c1430a30 2024-09-19T04:50:38.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.733+0000 7f2a32ffd640 1 -- 172.21.15.2:0/1060949910 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f2a4801b070 con 0x5556c1430a30 2024-09-19T04:50:38.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.733+0000 7f2a5bc9c740 10 client.15534 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:50:38.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.733+0000 7f2a5bc9c740 10 client.15534 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:50:38.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.733+0000 7f2a5bc9c740 20 client.15534 populate_metadata read hostname 'smithi002' 2024-09-19T04:50:38.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.733+0000 7f2a5bc9c740 1 --2- 172.21.15.2:0/1060949910 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5556c143f680 0x5556c14c0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:38.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.733+0000 7f2a5bc9c740 4 client.15534 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:50:38.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.733+0000 7f2a5bc9c740 1 -- 172.21.15.2:0/1060949910 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5556c13a1d60 con 0x5556c143f680 2024-09-19T04:50:38.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.734+0000 7f2a52ffd640 1 --2- 172.21.15.2:0/1060949910 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5556c143f680 0x5556c14c0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:38.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.734+0000 7f2a32ffd640 10 client.15534 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:50:38.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.734+0000 7f2a52ffd640 1 --2- 172.21.15.2:0/1060949910 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5556c143f680 0x5556c14c0140 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f39e12aecf44bf9d server_cookie=b968161e5b6acbb0 in_seq=0 out_seq=0 2024-09-19T04:50:38.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.734+0000 7f2a32ffd640 1 -- 172.21.15.2:0/1060949910 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5556c13a1d60 con 0x5556c143f680 2024-09-19T04:50:38.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.734+0000 7f2a32ffd640 10 client.15534 handle_command_reply: tid=0 2024-09-19T04:50:38.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.734+0000 7f2a5bc9c740 1 client.15534 shutdown 2024-09-19T04:50:38.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.735+0000 7f2a5bc9c740 1 -- 172.21.15.2:0/1060949910 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556c1430a30 msgr2=0x5556c14471d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:38.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.735+0000 7f2a5bc9c740 1 --2- 172.21.15.2:0/1060949910 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556c1430a30 0x5556c14471d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2a48001eb0 tx=0x7f2a4800f3c0 comp rx=0 tx=0).stop 2024-09-19T04:50:38.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.735+0000 7f2a5bc9c740 1 -- 172.21.15.2:0/1060949910 shutdown_connections 2024-09-19T04:50:38.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.735+0000 7f2a5bc9c740 1 --2- 172.21.15.2:0/1060949910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5556c1434dc0 0x5556c144b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:38.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.735+0000 7f2a5bc9c740 1 --2- 172.21.15.2:0/1060949910 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5556c143f680 0x5556c14c0140 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:38.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.735+0000 7f2a5bc9c740 1 --2- 172.21.15.2:0/1060949910 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5556c14344a0 0x5556c1447710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:38.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.735+0000 7f2a5bc9c740 1 --2- 172.21.15.2:0/1060949910 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556c1430a30 0x5556c14471d0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:38.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.735+0000 7f2a32ffd640 0 client.15534 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:50:38.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.735+0000 7f2a5bc9c740 1 -- 172.21.15.2:0/1060949910 >> 172.21.15.2:0/1060949910 conn(0x5556c1455b60 msgr2=0x5556c1437070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:38.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.735+0000 7f2a5bc9c740 1 -- 172.21.15.2:0/1060949910 shutdown_connections 2024-09-19T04:50:38.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.735+0000 7f2a5bc9c740 1 -- 172.21.15.2:0/1060949910 wait complete. 2024-09-19T04:50:38.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.735+0000 7f2a5bc9c740 20 client.15534 trim_cache size 0 max 16384 2024-09-19T04:50:38.742 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:50:38.742 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T04:50:38.742 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T04:50:38.742 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:50:38.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.735+0000 7f2a598c3640 1 -- 172.21.15.2:0/693715730 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f2a3c0a33b0 msgr2=0x7f2a3c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:38.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.735+0000 7f2a598c3640 1 --2- 172.21.15.2:0/693715730 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f2a3c0a33b0 0x7f2a3c0a5870 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c09bf70 tx=0x7f2a4c0bc040 comp rx=0 tx=0).stop 2024-09-19T04:50:38.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.735+0000 7f2a598c3640 1 -- 172.21.15.2:0/693715730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a54106f20 msgr2=0x7f2a5419cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:38.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.735+0000 7f2a598c3640 1 --2- 172.21.15.2:0/693715730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a54106f20 0x7f2a5419cba0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c00cad0 tx=0x7f2a4c00ced0 comp rx=0 tx=0).stop 2024-09-19T04:50:38.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.735+0000 7f2a598c3640 1 -- 172.21.15.2:0/693715730 shutdown_connections 2024-09-19T04:50:38.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.735+0000 7f2a598c3640 1 --2- 172.21.15.2:0/693715730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a54106f20 0x7f2a5419cba0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:38.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.735+0000 7f2a598c3640 1 --2- 172.21.15.2:0/693715730 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f2a3c0a33b0 0x7f2a3c0a5870 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:38.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.736+0000 7f2a598c3640 1 --2- 172.21.15.2:0/693715730 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2a541027a0 0x7f2a54198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:38.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.736+0000 7f2a598c3640 1 --2- 172.21.15.2:0/693715730 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2a54101df0 0x7f2a541982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:38.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.736+0000 7f2a598c3640 1 -- 172.21.15.2:0/693715730 >> 172.21.15.2:0/693715730 conn(0x7f2a540fd8b0 msgr2=0x7f2a540fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:38.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.736+0000 7f2a598c3640 1 -- 172.21.15.2:0/693715730 shutdown_connections 2024-09-19T04:50:38.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:38.736+0000 7f2a598c3640 1 -- 172.21.15.2:0/693715730 wait complete. 2024-09-19T04:50:38.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:38 smithi018 ceph-mon[34537]: pgmap v82: 97 pgs: 97 active+clean; 2.7 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-09-19T04:50:38.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:38 smithi116 ceph-mon[34477]: pgmap v82: 97 pgs: 97 active+clean; 2.7 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-09-19T04:50:39.515 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:50:39.516 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:50:39.787 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:50:40.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.272+0000 7fce1b59e640 1 -- 172.21.15.2:0/7523470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce1c101270 msgr2=0x7fce1c10d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:40.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.272+0000 7fce1b59e640 1 --2- 172.21.15.2:0/7523470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce1c101270 0x7fce1c10d7a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fce14009cd0 tx=0x7fce1402a8e0 comp rx=0 tx=0).stop 2024-09-19T04:50:40.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.272+0000 7fce1b59e640 1 -- 172.21.15.2:0/7523470 shutdown_connections 2024-09-19T04:50:40.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.272+0000 7fce1b59e640 1 --2- 172.21.15.2:0/7523470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce1c101270 0x7fce1c10d7a0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:40.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.272+0000 7fce1b59e640 1 --2- 172.21.15.2:0/7523470 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fce1c1008d0 0x7fce1c100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:40.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.272+0000 7fce1b59e640 1 --2- 172.21.15.2:0/7523470 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce1c1068d0 0x7fce1c106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:40.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.272+0000 7fce1b59e640 1 -- 172.21.15.2:0/7523470 >> 172.21.15.2:0/7523470 conn(0x7fce1c0fc630 msgr2=0x7fce1c0fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:40.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.272+0000 7fce1b59e640 1 -- 172.21.15.2:0/7523470 shutdown_connections 2024-09-19T04:50:40.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.273+0000 7fce1b59e640 1 -- 172.21.15.2:0/7523470 wait complete. 2024-09-19T04:50:40.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.273+0000 7fce1b59e640 1 Processor -- start 2024-09-19T04:50:40.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.273+0000 7fce1b59e640 1 -- start start 2024-09-19T04:50:40.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.274+0000 7fce1b59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce1c1008d0 0x7fce1c0fccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:40.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.274+0000 7fce1b59e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce1c101270 0x7fce1c0fd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:40.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.274+0000 7fce1b59e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fce1c1068d0 0x7fce1c0fd750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:40.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.274+0000 7fce1b59e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fce1c110b80 con 0x7fce1c1008d0 2024-09-19T04:50:40.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.274+0000 7fce1b59e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fce1c110a00 con 0x7fce1c101270 2024-09-19T04:50:40.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.274+0000 7fce1b59e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fce1c110d00 con 0x7fce1c1068d0 2024-09-19T04:50:40.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.274+0000 7fce1a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce1c1008d0 0x7fce1c0fccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:40.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.274+0000 7fce1a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce1c1008d0 0x7fce1c0fccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54334/0 (socket says 172.21.15.2:54334) 2024-09-19T04:50:40.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.274+0000 7fce1a59c640 1 -- 172.21.15.2:0/1124268080 learned_addr learned my addr 172.21.15.2:0/1124268080 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:40.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.274+0000 7fce19d9b640 1 --2- 172.21.15.2:0/1124268080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce1c101270 0x7fce1c0fd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:40.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.274+0000 7fce1ad9d640 1 --2- 172.21.15.2:0/1124268080 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fce1c1068d0 0x7fce1c0fd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:40.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.274+0000 7fce1a59c640 1 -- 172.21.15.2:0/1124268080 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fce1c1068d0 msgr2=0x7fce1c0fd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:40.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.274+0000 7fce1a59c640 1 --2- 172.21.15.2:0/1124268080 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fce1c1068d0 0x7fce1c0fd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:40.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.274+0000 7fce1a59c640 1 -- 172.21.15.2:0/1124268080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce1c101270 msgr2=0x7fce1c0fd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:40.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.274+0000 7fce1a59c640 1 --2- 172.21.15.2:0/1124268080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce1c101270 0x7fce1c0fd210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:40.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.274+0000 7fce1a59c640 1 -- 172.21.15.2:0/1124268080 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce1c1aab40 con 0x7fce1c1008d0 2024-09-19T04:50:40.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.274+0000 7fce1a59c640 1 --2- 172.21.15.2:0/1124268080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce1c1008d0 0x7fce1c0fccd0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fce0c00d950 tx=0x7fce0c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:40.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.274+0000 7fce0b7fe640 1 -- 172.21.15.2:0/1124268080 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce0c017070 con 0x7fce1c1008d0 2024-09-19T04:50:40.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.274+0000 7fce0b7fe640 1 -- 172.21.15.2:0/1124268080 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fce0c009c30 con 0x7fce1c1008d0 2024-09-19T04:50:40.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.274+0000 7fce1b59e640 1 -- 172.21.15.2:0/1124268080 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce1c1aad70 con 0x7fce1c1008d0 2024-09-19T04:50:40.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.275+0000 7fce0b7fe640 1 -- 172.21.15.2:0/1124268080 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce0c00f620 con 0x7fce1c1008d0 2024-09-19T04:50:40.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.275+0000 7fce1b59e640 1 -- 172.21.15.2:0/1124268080 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce1c1ab1f0 con 0x7fce1c1008d0 2024-09-19T04:50:40.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.276+0000 7fce1b59e640 1 -- 172.21.15.2:0/1124268080 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce1c102010 con 0x7fce1c1008d0 2024-09-19T04:50:40.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.277+0000 7fce0b7fe640 1 -- 172.21.15.2:0/1124268080 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fce0c0109a0 con 0x7fce1c1008d0 2024-09-19T04:50:40.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.278+0000 7fce0b7fe640 1 --2- 172.21.15.2:0/1124268080 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fce040a33b0 0x7fce040a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:40.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.278+0000 7fce19d9b640 1 --2- 172.21.15.2:0/1124268080 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fce040a33b0 0x7fce040a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:40.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.278+0000 7fce0b7fe640 1 -- 172.21.15.2:0/1124268080 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7fce0c0cf820 con 0x7fce1c1008d0 2024-09-19T04:50:40.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.278+0000 7fce19d9b640 1 --2- 172.21.15.2:0/1124268080 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fce040a33b0 0x7fce040a5870 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fce1c0fe490 tx=0x7fce10005f90 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:40.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.282+0000 7fce0b7fe640 1 -- 172.21.15.2:0/1124268080 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fce0c009de0 con 0x7fce1c1008d0 2024-09-19T04:50:40.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.494+0000 7fce1b59e640 1 -- 172.21.15.2:0/1124268080 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce1c1098e0 con 0x7fce1c1008d0 2024-09-19T04:50:40.496 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:40 smithi002 ceph-mon[30975]: pgmap v83: 97 pgs: 97 active+clean; 2.7 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-09-19T04:50:40.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.495+0000 7fce0b7fe640 1 -- 172.21.15.2:0/1124268080 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11840 (secure 0 0 0) 0x7fce0c09bbd0 con 0x7fce1c1008d0 2024-09-19T04:50:40.496 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:50:40.497 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":19,"btime":"2024-09-19T04:46:33:537239+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2467365137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2467365137},{"type":"v1","addr":"172.21.15.2:6835","nonce":2467365137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3162441888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3162441888},{"type":"v1","addr":"172.21.15.2:6837","nonce":3162441888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14631,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2740862966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2740862966},{"type":"v1","addr":"172.21.15.2:6839","nonce":2740862966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/2394435504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2394435504},{"type":"v1","addr":"172.21.15.2:6841","nonce":2394435504}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1630480244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1630480244},{"type":"v1","addr":"172.21.15.18:6833","nonce":1630480244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1553897465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1553897465},{"type":"v1","addr":"172.21.15.116:6833","nonce":1553897465}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3035664608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3035664608},{"type":"v1","addr":"172.21.15.18:6835","nonce":3035664608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1096622392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1096622392},{"type":"v1","addr":"172.21.15.18:6837","nonce":1096622392}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3761157675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3761157675},{"type":"v1","addr":"172.21.15.116:6835","nonce":3761157675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/1120131594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1120131594},{"type":"v1","addr":"172.21.15.116:6837","nonce":1120131594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:46:24.050115+0000","modified":"2024-09-19T04:46:33.112369+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/4207677139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":4207677139},{"type":"v1","addr":"172.21.15.18:6839","nonce":4207677139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/2346874880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":2346874880},{"type":"v1","addr":"172.21.15.116:6839","nonce":2346874880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496]},"id":1}]} 2024-09-19T04:50:40.497 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 19 2024-09-19T04:50:40.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.497+0000 7fce1b59e640 1 -- 172.21.15.2:0/1124268080 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fce040a33b0 msgr2=0x7fce040a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:40.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.497+0000 7fce1b59e640 1 --2- 172.21.15.2:0/1124268080 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fce040a33b0 0x7fce040a5870 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fce1c0fe490 tx=0x7fce10005f90 comp rx=0 tx=0).stop 2024-09-19T04:50:40.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.497+0000 7fce1b59e640 1 -- 172.21.15.2:0/1124268080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce1c1008d0 msgr2=0x7fce1c0fccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:40.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.497+0000 7fce1b59e640 1 --2- 172.21.15.2:0/1124268080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce1c1008d0 0x7fce1c0fccd0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fce0c00d950 tx=0x7fce0c00de10 comp rx=0 tx=0).stop 2024-09-19T04:50:40.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.497+0000 7fce1b59e640 1 -- 172.21.15.2:0/1124268080 shutdown_connections 2024-09-19T04:50:40.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.497+0000 7fce1b59e640 1 --2- 172.21.15.2:0/1124268080 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fce040a33b0 0x7fce040a5870 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:40.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.497+0000 7fce1b59e640 1 --2- 172.21.15.2:0/1124268080 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fce1c1068d0 0x7fce1c0fd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:40.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.497+0000 7fce1b59e640 1 --2- 172.21.15.2:0/1124268080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce1c101270 0x7fce1c0fd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:40.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.497+0000 7fce1b59e640 1 --2- 172.21.15.2:0/1124268080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce1c1008d0 0x7fce1c0fccd0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:40.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.497+0000 7fce1b59e640 1 -- 172.21.15.2:0/1124268080 >> 172.21.15.2:0/1124268080 conn(0x7fce1c0fc630 msgr2=0x7fce1c06aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:40.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.497+0000 7fce1b59e640 1 -- 172.21.15.2:0/1124268080 shutdown_connections 2024-09-19T04:50:40.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:40.497+0000 7fce1b59e640 1 -- 172.21.15.2:0/1124268080 wait complete. 2024-09-19T04:50:40.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:40 smithi018 ceph-mon[34537]: pgmap v83: 97 pgs: 97 active+clean; 2.7 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-09-19T04:50:40.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:40 smithi116 ceph-mon[34477]: pgmap v83: 97 pgs: 97 active+clean; 2.7 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-09-19T04:50:41.158 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:50:41.417 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:50:41.789 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:41 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/1124268080' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:50:41.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:41 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/1124268080' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:50:41.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:41 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/1124268080' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:50:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.018+0000 7f1c853d6640 1 -- 172.21.15.2:0/3477554082 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c80106a80 msgr2=0x7f1c80106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.018+0000 7f1c853d6640 1 --2- 172.21.15.2:0/3477554082 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c80106a80 0x7f1c80106e60 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f1c70009930 tx=0x7f1c7002a420 comp rx=0 tx=0).stop 2024-09-19T04:50:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.018+0000 7f1c853d6640 1 -- 172.21.15.2:0/3477554082 shutdown_connections 2024-09-19T04:50:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.018+0000 7f1c853d6640 1 --2- 172.21.15.2:0/3477554082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c80101420 0x7f1c8010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.018+0000 7f1c853d6640 1 --2- 172.21.15.2:0/3477554082 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c80100a80 0x7f1c80100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.018+0000 7f1c853d6640 1 --2- 172.21.15.2:0/3477554082 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c80106a80 0x7f1c80106e60 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.018+0000 7f1c853d6640 1 -- 172.21.15.2:0/3477554082 >> 172.21.15.2:0/3477554082 conn(0x7f1c800fc7a0 msgr2=0x7f1c800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.018+0000 7f1c853d6640 1 -- 172.21.15.2:0/3477554082 shutdown_connections 2024-09-19T04:50:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.018+0000 7f1c853d6640 1 -- 172.21.15.2:0/3477554082 wait complete. 2024-09-19T04:50:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.019+0000 7f1c853d6640 1 Processor -- start 2024-09-19T04:50:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.019+0000 7f1c853d6640 1 -- start start 2024-09-19T04:50:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.019+0000 7f1c853d6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c80100a80 0x7f1c80198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.019+0000 7f1c853d6640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c80101420 0x7f1c801988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.019+0000 7f1c853d6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c80106a80 0x7f1c8019cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.019+0000 7f1c853d6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1c80110d30 con 0x7f1c80100a80 2024-09-19T04:50:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.019+0000 7f1c853d6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1c80110bb0 con 0x7f1c80106a80 2024-09-19T04:50:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.019+0000 7f1c853d6640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f1c80110eb0 con 0x7f1c80101420 2024-09-19T04:50:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.019+0000 7f1c7effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c80100a80 0x7f1c80198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.019+0000 7f1c7effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c80100a80 0x7f1c80198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44772/0 (socket says 172.21.15.2:44772) 2024-09-19T04:50:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.020+0000 7f1c7effd640 1 -- 172.21.15.2:0/1053507911 learned_addr learned my addr 172.21.15.2:0/1053507911 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.020+0000 7f1c7f7fe640 1 --2- 172.21.15.2:0/1053507911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c80106a80 0x7f1c8019cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.020+0000 7f1c7e7fc640 1 --2- 172.21.15.2:0/1053507911 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c80101420 0x7f1c801988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.020+0000 7f1c7effd640 1 -- 172.21.15.2:0/1053507911 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c80101420 msgr2=0x7f1c801988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.020+0000 7f1c7effd640 1 --2- 172.21.15.2:0/1053507911 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c80101420 0x7f1c801988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.020+0000 7f1c7effd640 1 -- 172.21.15.2:0/1053507911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c80106a80 msgr2=0x7f1c8019cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.020+0000 7f1c7effd640 1 --2- 172.21.15.2:0/1053507911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c80106a80 0x7f1c8019cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.020+0000 7f1c7effd640 1 -- 172.21.15.2:0/1053507911 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c8019d330 con 0x7f1c80100a80 2024-09-19T04:50:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.020+0000 7f1c7effd640 1 --2- 172.21.15.2:0/1053507911 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c80100a80 0x7f1c80198380 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1c70004770 tx=0x7f1c700042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.020+0000 7f1c67fff640 1 -- 172.21.15.2:0/1053507911 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c7003f070 con 0x7f1c80100a80 2024-09-19T04:50:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.020+0000 7f1c853d6640 1 -- 172.21.15.2:0/1053507911 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c8019d5c0 con 0x7f1c80100a80 2024-09-19T04:50:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.020+0000 7f1c67fff640 1 -- 172.21.15.2:0/1053507911 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1c7003b460 con 0x7f1c80100a80 2024-09-19T04:50:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.020+0000 7f1c67fff640 1 -- 172.21.15.2:0/1053507911 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c70035070 con 0x7f1c80100a80 2024-09-19T04:50:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.020+0000 7f1c853d6640 1 -- 172.21.15.2:0/1053507911 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c801a4f00 con 0x7f1c80100a80 2024-09-19T04:50:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.023+0000 7f1c67fff640 1 -- 172.21.15.2:0/1053507911 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f1c7003b610 con 0x7f1c80100a80 2024-09-19T04:50:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.023+0000 7f1c877af740 1 Processor -- start 2024-09-19T04:50:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.023+0000 7f1c877af740 1 -- start start 2024-09-19T04:50:42.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.023+0000 7f1c877af740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560a89395b40 0x560a89394090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:42.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.023+0000 7f1c877af740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a893945d0 0x560a89394a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:42.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.023+0000 7f1c877af740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560a8939f370 0x560a893a1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:42.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.023+0000 7f1c877af740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560a892fa2f0 con 0x560a893945d0 2024-09-19T04:50:42.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.023+0000 7f1c877af740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560a892a1cf0 con 0x560a8939f370 2024-09-19T04:50:42.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.023+0000 7f1c877af740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x560a892f62b0 con 0x560a89395b40 2024-09-19T04:50:42.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.023+0000 7f1c67fff640 1 --2- 172.21.15.2:0/1053507911 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f1c680a33b0 0x7f1c680a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:42.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.023+0000 7f1c7effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a893945d0 0x560a89394a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:42.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.023+0000 7f1c7effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a893945d0 0x560a89394a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44774/0 (socket says 172.21.15.2:44774) 2024-09-19T04:50:42.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.023+0000 7f1c7effd640 1 -- 172.21.15.2:0/3302872494 learned_addr learned my addr 172.21.15.2:0/3302872494 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:42.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.024+0000 7f1c7e7fc640 1 --2- 172.21.15.2:0/3302872494 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560a8939f370 0x560a893a1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:42.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.024+0000 7f1c7f7fe640 1 --2- 172.21.15.2:0/1053507911 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f1c680a33b0 0x7f1c680a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:42.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.024+0000 7f1c7f7fe640 1 --2- 172.21.15.2:0/3302872494 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560a89395b40 0x560a89394090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:42.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.024+0000 7f1c67fff640 1 -- 172.21.15.2:0/1053507911 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f1c700f00f0 con 0x7f1c80100a80 2024-09-19T04:50:42.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.024+0000 7f1c7effd640 1 -- 172.21.15.2:0/3302872494 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560a89395b40 msgr2=0x560a89394090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:42.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.024+0000 7f1c7effd640 1 --2- 172.21.15.2:0/3302872494 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560a89395b40 0x560a89394090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:42.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.024+0000 7f1c7effd640 1 -- 172.21.15.2:0/3302872494 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560a8939f370 msgr2=0x560a893a1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:42.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.024+0000 7f1c7effd640 1 --2- 172.21.15.2:0/3302872494 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560a8939f370 0x560a893a1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:42.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.024+0000 7f1c7effd640 1 -- 172.21.15.2:0/3302872494 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a892863a0 con 0x560a893945d0 2024-09-19T04:50:42.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.024+0000 7f1c7f7fe640 1 --2- 172.21.15.2:0/3302872494 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560a89395b40 0x560a89394090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:50:42.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.024+0000 7f1c7effd640 1 --2- 172.21.15.2:0/3302872494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a893945d0 0x560a89394a10 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f1c700a5690 tx=0x7f1c7002a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b13816d0edff6ff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:42.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.024+0000 7f1c7f7fe640 1 --2- 172.21.15.2:0/1053507911 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f1c680a33b0 0x7f1c680a5870 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1c78009fd0 tx=0x7f1c78009840 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:42.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.024+0000 7f1c657fa640 1 -- 172.21.15.2:0/3302872494 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c70048070 con 0x560a893945d0 2024-09-19T04:50:42.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.024+0000 7f1c657fa640 1 -- 172.21.15.2:0/3302872494 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1c700c0740 con 0x560a893945d0 2024-09-19T04:50:42.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.024+0000 7f1c657fa640 1 -- 172.21.15.2:0/3302872494 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c700eda80 con 0x560a893945d0 2024-09-19T04:50:42.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.025+0000 7f1c877af740 1 -- 172.21.15.2:0/3302872494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a893945d0 msgr2=0x560a89394a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:42.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.025+0000 7f1c877af740 1 --2- 172.21.15.2:0/3302872494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a893945d0 0x560a89394a10 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f1c700a5690 tx=0x7f1c7002a420 comp rx=0 tx=0).stop 2024-09-19T04:50:42.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.025+0000 7f1c877af740 1 -- 172.21.15.2:0/3302872494 shutdown_connections 2024-09-19T04:50:42.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.025+0000 7f1c877af740 1 --2- 172.21.15.2:0/3302872494 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560a8939f370 0x560a893a1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:42.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.025+0000 7f1c877af740 1 --2- 172.21.15.2:0/3302872494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a893945d0 0x560a89394a10 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:42.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.025+0000 7f1c877af740 1 --2- 172.21.15.2:0/3302872494 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560a89395b40 0x560a89394090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:42.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.025+0000 7f1c877af740 1 -- 172.21.15.2:0/3302872494 >> 172.21.15.2:0/3302872494 conn(0x560a8935d310 msgr2=0x560a89390c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:42.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.025+0000 7f1c877af740 1 -- 172.21.15.2:0/3302872494 shutdown_connections 2024-09-19T04:50:42.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.025+0000 7f1c877af740 1 -- 172.21.15.2:0/3302872494 wait complete. 2024-09-19T04:50:42.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.025+0000 7f1c877af740 1 -- start start 2024-09-19T04:50:42.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.025+0000 7f1c877af740 1 Processor -- start 2024-09-19T04:50:42.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.026+0000 7f1c877af740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560a893945d0 0x560a8939edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:42.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.026+0000 7f1c877af740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a89395b40 0x560a8939c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:42.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.026+0000 7f1c877af740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560a8939f370 0x560a8939c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:42.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.026+0000 7f1c877af740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560a893a1e30 con 0x560a89395b40 2024-09-19T04:50:42.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.026+0000 7f1c877af740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560a892b5060 con 0x560a8939f370 2024-09-19T04:50:42.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.026+0000 7f1c877af740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x560a893a1fb0 con 0x560a893945d0 2024-09-19T04:50:42.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.026+0000 7f1c877af740 10 client.0 _ll_register_callbacks cb 0x560a890088c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:50:42.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.026+0000 7f1c7e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a89395b40 0x560a8939c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:42.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.026+0000 7f1c7e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a89395b40 0x560a8939c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44786/0 (socket says 172.21.15.2:44786) 2024-09-19T04:50:42.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.026+0000 7f1c7e7fc640 1 -- 172.21.15.2:0/3621354086 learned_addr learned my addr 172.21.15.2:0/3621354086 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:42.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.026+0000 7f1c7f7fe640 1 --2- 172.21.15.2:0/3621354086 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560a8939f370 0x560a8939c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:42.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.026+0000 7f1c7effd640 1 --2- 172.21.15.2:0/3621354086 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560a893945d0 0x560a8939edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:42.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.026+0000 7f1c7e7fc640 1 -- 172.21.15.2:0/3621354086 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560a893945d0 msgr2=0x560a8939edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:42.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.026+0000 7f1c7e7fc640 1 --2- 172.21.15.2:0/3621354086 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560a893945d0 0x560a8939edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:42.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.026+0000 7f1c7e7fc640 1 -- 172.21.15.2:0/3621354086 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560a8939f370 msgr2=0x560a8939c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:42.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.026+0000 7f1c7e7fc640 1 --2- 172.21.15.2:0/3621354086 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560a8939f370 0x560a8939c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:42.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.026+0000 7f1c7e7fc640 1 -- 172.21.15.2:0/3621354086 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a8906b3c0 con 0x560a89395b40 2024-09-19T04:50:42.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.026+0000 7f1c7e7fc640 1 --2- 172.21.15.2:0/3621354086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a89395b40 0x560a8939c060 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f1c74011740 tx=0x7f1c74011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0944ecf6f35b8cc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:42.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.026+0000 7f1c62ff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:50:42.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.027+0000 7f1c62ff5640 1 -- 172.21.15.2:0/3621354086 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c7400fdb0 con 0x560a89395b40 2024-09-19T04:50:42.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.027+0000 7f1c877af740 1 -- 172.21.15.2:0/3621354086 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560a89307860 con 0x560a89395b40 2024-09-19T04:50:42.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.027+0000 7f1c62ff5640 1 -- 172.21.15.2:0/3621354086 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f1c74004020 con 0x560a89395b40 2024-09-19T04:50:42.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.027+0000 7f1c62ff5640 1 -- 172.21.15.2:0/3621354086 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1c74004220 con 0x560a89395b40 2024-09-19T04:50:42.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.027+0000 7f1c877af740 10 client.15552 fetch_fsmap learned FSMap version 19 2024-09-19T04:50:42.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.027+0000 7f1c877af740 1 -- 172.21.15.2:0/3621354086 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x560a893ad8c0 con 0x560a89395b40 2024-09-19T04:50:42.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.027+0000 7f1c62ff5640 1 -- 172.21.15.2:0/3621354086 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x560a89307860 con 0x560a89395b40 2024-09-19T04:50:42.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.027+0000 7f1c62ff5640 1 -- 172.21.15.2:0/3621354086 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f1c74020020 con 0x560a89395b40 2024-09-19T04:50:42.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.027+0000 7f1c877af740 10 client.15552 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:50:42.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.027+0000 7f1c877af740 10 client.15552 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:50:42.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.027+0000 7f1c877af740 20 client.15552 populate_metadata read hostname 'smithi002' 2024-09-19T04:50:42.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.027+0000 7f1c877af740 1 --2- 172.21.15.2:0/3621354086 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560a893aed90 0x560a893b11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:42.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.027+0000 7f1c877af740 4 client.15552 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:50:42.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.027+0000 7f1c877af740 1 -- 172.21.15.2:0/3621354086 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560a89301d70 con 0x560a893aed90 2024-09-19T04:50:42.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.028+0000 7f1c7effd640 1 --2- 172.21.15.2:0/3621354086 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560a893aed90 0x560a893b11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:42.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.028+0000 7f1c62ff5640 10 client.15552 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:50:42.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.028+0000 7f1c7effd640 1 --2- 172.21.15.2:0/3621354086 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560a893aed90 0x560a893b11f0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5905edb14459ebb9 server_cookie=a6db8f0215a814ec in_seq=0 out_seq=0 2024-09-19T04:50:42.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.029+0000 7f1c62ff5640 1 -- 172.21.15.2:0/3621354086 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560a89301d70 con 0x560a893aed90 2024-09-19T04:50:42.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.029+0000 7f1c62ff5640 10 client.15552 handle_command_reply: tid=0 2024-09-19T04:50:42.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.029+0000 7f1c877af740 1 client.15552 shutdown 2024-09-19T04:50:42.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.029+0000 7f1c877af740 1 -- 172.21.15.2:0/3621354086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a89395b40 msgr2=0x560a8939c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:42.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.029+0000 7f1c877af740 1 --2- 172.21.15.2:0/3621354086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a89395b40 0x560a8939c060 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f1c74011740 tx=0x7f1c74011b40 comp rx=0 tx=0).stop 2024-09-19T04:50:42.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.029+0000 7f1c877af740 1 -- 172.21.15.2:0/3621354086 shutdown_connections 2024-09-19T04:50:42.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.029+0000 7f1c877af740 1 --2- 172.21.15.2:0/3621354086 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560a8939f370 0x560a8939c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:42.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.029+0000 7f1c877af740 1 --2- 172.21.15.2:0/3621354086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a89395b40 0x560a8939c060 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:42.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.029+0000 7f1c877af740 1 --2- 172.21.15.2:0/3621354086 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560a893aed90 0x560a893b11f0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:42.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.029+0000 7f1c877af740 1 --2- 172.21.15.2:0/3621354086 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560a893945d0 0x560a8939edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:42.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.029+0000 7f1c877af740 1 -- 172.21.15.2:0/3621354086 >> 172.21.15.2:0/3621354086 conn(0x560a8935d310 msgr2=0x560a89396990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:42.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.029+0000 7f1c62ff5640 0 client.15552 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:50:42.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.029+0000 7f1c877af740 1 -- 172.21.15.2:0/3621354086 shutdown_connections 2024-09-19T04:50:42.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.029+0000 7f1c877af740 1 -- 172.21.15.2:0/3621354086 wait complete. 2024-09-19T04:50:42.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.029+0000 7f1c877af740 20 client.15552 trim_cache size 0 max 16384 2024-09-19T04:50:42.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.042+0000 7f1c877af740 1 Processor -- start 2024-09-19T04:50:42.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.042+0000 7f1c877af740 1 -- start start 2024-09-19T04:50:42.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.042+0000 7f1c877af740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560a893945d0 0x560a8939b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:42.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.042+0000 7f1c877af740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a89395b40 0x560a8939dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:42.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.042+0000 7f1c877af740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560a8939f370 0x560a893b6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:42.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.042+0000 7f1c877af740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1c801ab6a0 con 0x560a89395b40 2024-09-19T04:50:42.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.042+0000 7f1c877af740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1c801adf20 con 0x560a8939f370 2024-09-19T04:50:42.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.042+0000 7f1c877af740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f1c801abd10 con 0x560a893945d0 2024-09-19T04:50:42.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.042+0000 7f1c7e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a89395b40 0x560a8939dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:42.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.042+0000 7f1c7e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a89395b40 0x560a8939dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44794/0 (socket says 172.21.15.2:44794) 2024-09-19T04:50:42.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.042+0000 7f1c7e7fc640 1 -- 172.21.15.2:0/3056125701 learned_addr learned my addr 172.21.15.2:0/3056125701 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:42.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.043+0000 7f1c7f7fe640 1 --2- 172.21.15.2:0/3056125701 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560a8939f370 0x560a893b6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:42.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.043+0000 7f1c7effd640 1 --2- 172.21.15.2:0/3056125701 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560a893945d0 0x560a8939b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:42.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.043+0000 7f1c7e7fc640 1 -- 172.21.15.2:0/3056125701 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560a893945d0 msgr2=0x560a8939b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:42.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.043+0000 7f1c7e7fc640 1 --2- 172.21.15.2:0/3056125701 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560a893945d0 0x560a8939b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:42.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.043+0000 7f1c7e7fc640 1 -- 172.21.15.2:0/3056125701 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560a8939f370 msgr2=0x560a893b6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:42.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.043+0000 7f1c7e7fc640 1 --2- 172.21.15.2:0/3056125701 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560a8939f370 0x560a893b6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:42.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.043+0000 7f1c7e7fc640 1 -- 172.21.15.2:0/3056125701 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a89390de0 con 0x560a89395b40 2024-09-19T04:50:42.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.043+0000 7f1c7effd640 1 --2- 172.21.15.2:0/3056125701 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560a893945d0 0x560a8939b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:50:42.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.043+0000 7f1c7f7fe640 1 --2- 172.21.15.2:0/3056125701 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560a8939f370 0x560a893b6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:50:42.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.043+0000 7f1c7e7fc640 1 --2- 172.21.15.2:0/3056125701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a89395b40 0x560a8939dfd0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1c74011710 tx=0x7f1c74005c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=609c963b8e258b0b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:42.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.043+0000 7f1c64ff9640 1 -- 172.21.15.2:0/3056125701 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c74030070 con 0x560a89395b40 2024-09-19T04:50:42.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.043+0000 7f1c64ff9640 1 -- 172.21.15.2:0/3056125701 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1c74019c30 con 0x560a89395b40 2024-09-19T04:50:42.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.043+0000 7f1c64ff9640 1 -- 172.21.15.2:0/3056125701 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c7402b6e0 con 0x560a89395b40 2024-09-19T04:50:42.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.044+0000 7f1c877af740 1 -- 172.21.15.2:0/3056125701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a89395b40 msgr2=0x560a8939dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:42.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.044+0000 7f1c877af740 1 --2- 172.21.15.2:0/3056125701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a89395b40 0x560a8939dfd0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1c74011710 tx=0x7f1c74005c20 comp rx=0 tx=0).stop 2024-09-19T04:50:42.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.044+0000 7f1c877af740 1 -- 172.21.15.2:0/3056125701 shutdown_connections 2024-09-19T04:50:42.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.044+0000 7f1c877af740 1 --2- 172.21.15.2:0/3056125701 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560a8939f370 0x560a893b6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:42.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.044+0000 7f1c877af740 1 --2- 172.21.15.2:0/3056125701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a89395b40 0x560a8939dfd0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:42.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.044+0000 7f1c877af740 1 --2- 172.21.15.2:0/3056125701 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560a893945d0 0x560a8939b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:42.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.044+0000 7f1c877af740 1 -- 172.21.15.2:0/3056125701 >> 172.21.15.2:0/3056125701 conn(0x560a8935d310 msgr2=0x560a8939d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:42.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.044+0000 7f1c877af740 1 -- 172.21.15.2:0/3056125701 shutdown_connections 2024-09-19T04:50:42.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.044+0000 7f1c877af740 1 -- 172.21.15.2:0/3056125701 wait complete. 2024-09-19T04:50:42.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.044+0000 7f1c877af740 1 -- start start 2024-09-19T04:50:42.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.044+0000 7f1c877af740 1 Processor -- start 2024-09-19T04:50:42.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.045+0000 7f1c877af740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a893945d0 0x560a893a7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:42.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.045+0000 7f1c877af740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560a89395b40 0x560a893a2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:42.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.045+0000 7f1c877af740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560a8939f370 0x560a893a31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:42.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.045+0000 7f1c877af740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1c801ac3e0 con 0x560a893945d0 2024-09-19T04:50:42.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.045+0000 7f1c877af740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1c801ad850 con 0x560a89395b40 2024-09-19T04:50:42.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.045+0000 7f1c877af740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f1c801acab0 con 0x560a8939f370 2024-09-19T04:50:42.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.045+0000 7f1c877af740 10 client.0 _ll_register_callbacks cb 0x7f1c7400c690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:50:42.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.045+0000 7f1c7effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a893945d0 0x560a893a7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:42.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.045+0000 7f1c7effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a893945d0 0x560a893a7930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44796/0 (socket says 172.21.15.2:44796) 2024-09-19T04:50:42.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.045+0000 7f1c7effd640 1 -- 172.21.15.2:0/4111551851 learned_addr learned my addr 172.21.15.2:0/4111551851 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:42.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.045+0000 7f1c7e7fc640 1 --2- 172.21.15.2:0/4111551851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560a89395b40 0x560a893a2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:42.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.045+0000 7f1c7effd640 1 -- 172.21.15.2:0/4111551851 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560a8939f370 msgr2=0x560a893a31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:42.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.045+0000 7f1c7f7fe640 1 --2- 172.21.15.2:0/4111551851 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560a8939f370 0x560a893a31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:42.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.045+0000 7f1c7effd640 1 --2- 172.21.15.2:0/4111551851 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560a8939f370 0x560a893a31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:42.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.045+0000 7f1c7effd640 1 -- 172.21.15.2:0/4111551851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560a89395b40 msgr2=0x560a893a2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:42.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.045+0000 7f1c7effd640 1 --2- 172.21.15.2:0/4111551851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560a89395b40 0x560a893a2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:42.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.045+0000 7f1c7effd640 1 -- 172.21.15.2:0/4111551851 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a8939cb60 con 0x560a893945d0 2024-09-19T04:50:42.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.045+0000 7f1c7e7fc640 1 --2- 172.21.15.2:0/4111551851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560a89395b40 0x560a893a2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:50:42.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.046+0000 7f1c7effd640 1 --2- 172.21.15.2:0/4111551851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a893945d0 0x560a893a7930 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1c700c0900 tx=0x7f1c700ed7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60bf9fa886190bb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:42.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.046+0000 7f1c62ff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:50:42.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.046+0000 7f1c62ff5640 1 -- 172.21.15.2:0/4111551851 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c700ce070 con 0x560a893945d0 2024-09-19T04:50:42.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.046+0000 7f1c62ff5640 1 -- 172.21.15.2:0/4111551851 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f1c700d5260 con 0x560a893945d0 2024-09-19T04:50:42.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.046+0000 7f1c877af740 1 -- 172.21.15.2:0/4111551851 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c74019c30 con 0x560a893945d0 2024-09-19T04:50:42.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.046+0000 7f1c62ff5640 1 -- 172.21.15.2:0/4111551851 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1c70048040 con 0x560a893945d0 2024-09-19T04:50:42.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.046+0000 7f1c877af740 10 client.15558 fetch_fsmap learned FSMap version 19 2024-09-19T04:50:42.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.046+0000 7f1c877af740 1 -- 172.21.15.2:0/4111551851 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x560a8941dd70 con 0x560a893945d0 2024-09-19T04:50:42.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.046+0000 7f1c62ff5640 1 -- 172.21.15.2:0/4111551851 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1c74019c30 con 0x560a893945d0 2024-09-19T04:50:42.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.046+0000 7f1c62ff5640 1 -- 172.21.15.2:0/4111551851 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f1c7004b060 con 0x560a893945d0 2024-09-19T04:50:42.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.047+0000 7f1c877af740 10 client.15558 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:50:42.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.047+0000 7f1c877af740 10 client.15558 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:50:42.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.047+0000 7f1c877af740 20 client.15558 populate_metadata read hostname 'smithi002' 2024-09-19T04:50:42.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.047+0000 7f1c877af740 1 --2- 172.21.15.2:0/4111551851 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560a8941e300 0x560a89420710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:42.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.047+0000 7f1c877af740 4 client.15558 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:50:42.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.047+0000 7f1c877af740 1 -- 172.21.15.2:0/4111551851 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560a8927e170 con 0x560a8941e300 2024-09-19T04:50:42.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.047+0000 7f1c7e7fc640 1 --2- 172.21.15.2:0/4111551851 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560a8941e300 0x560a89420710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:42.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.047+0000 7f1c62ff5640 10 client.15558 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:50:42.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.047+0000 7f1c7e7fc640 1 --2- 172.21.15.2:0/4111551851 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560a8941e300 0x560a89420710 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4e199bebae6fb89 server_cookie=6f925e90a6b501f5 in_seq=0 out_seq=0 2024-09-19T04:50:42.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.047+0000 7f1c62ff5640 1 -- 172.21.15.2:0/4111551851 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560a8927e170 con 0x560a8941e300 2024-09-19T04:50:42.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.047+0000 7f1c62ff5640 10 client.15558 handle_command_reply: tid=0 2024-09-19T04:50:42.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.047+0000 7f1c877af740 1 client.15558 shutdown 2024-09-19T04:50:42.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.048+0000 7f1c877af740 1 -- 172.21.15.2:0/4111551851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a893945d0 msgr2=0x560a893a7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:42.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.048+0000 7f1c877af740 1 --2- 172.21.15.2:0/4111551851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a893945d0 0x560a893a7930 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1c700c0900 tx=0x7f1c700ed7f0 comp rx=0 tx=0).stop 2024-09-19T04:50:42.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.048+0000 7f1c877af740 1 -- 172.21.15.2:0/4111551851 shutdown_connections 2024-09-19T04:50:42.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.048+0000 7f1c877af740 1 --2- 172.21.15.2:0/4111551851 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560a8941e300 0x560a89420710 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:42.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.048+0000 7f1c877af740 1 --2- 172.21.15.2:0/4111551851 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560a8939f370 0x560a893a31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:42.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.048+0000 7f1c877af740 1 --2- 172.21.15.2:0/4111551851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560a89395b40 0x560a893a2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:42.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.048+0000 7f1c62ff5640 0 client.15558 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:50:42.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.048+0000 7f1c877af740 1 --2- 172.21.15.2:0/4111551851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a893945d0 0x560a893a7930 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:42.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.048+0000 7f1c877af740 1 -- 172.21.15.2:0/4111551851 >> 172.21.15.2:0/4111551851 conn(0x560a8935d310 msgr2=0x560a8939a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:42.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.048+0000 7f1c877af740 1 -- 172.21.15.2:0/4111551851 shutdown_connections 2024-09-19T04:50:42.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.048+0000 7f1c877af740 1 -- 172.21.15.2:0/4111551851 wait complete. 2024-09-19T04:50:42.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.048+0000 7f1c877af740 20 client.15558 trim_cache size 0 max 16384 2024-09-19T04:50:42.071 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T04:50:42.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.048+0000 7f1c853d6640 1 -- 172.21.15.2:0/1053507911 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f1c680a33b0 msgr2=0x7f1c680a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:42.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.048+0000 7f1c853d6640 1 --2- 172.21.15.2:0/1053507911 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f1c680a33b0 0x7f1c680a5870 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1c78009fd0 tx=0x7f1c78009840 comp rx=0 tx=0).stop 2024-09-19T04:50:42.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.048+0000 7f1c853d6640 1 -- 172.21.15.2:0/1053507911 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c80100a80 msgr2=0x7f1c80198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:42.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.048+0000 7f1c853d6640 1 --2- 172.21.15.2:0/1053507911 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c80100a80 0x7f1c80198380 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1c70004770 tx=0x7f1c700042f0 comp rx=0 tx=0).stop 2024-09-19T04:50:42.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.049+0000 7f1c853d6640 1 -- 172.21.15.2:0/1053507911 shutdown_connections 2024-09-19T04:50:42.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.049+0000 7f1c853d6640 1 --2- 172.21.15.2:0/1053507911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c80106a80 0x7f1c8019cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:42.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.049+0000 7f1c853d6640 1 --2- 172.21.15.2:0/1053507911 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f1c680a33b0 0x7f1c680a5870 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:42.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.049+0000 7f1c853d6640 1 --2- 172.21.15.2:0/1053507911 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c80101420 0x7f1c801988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:42.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.049+0000 7f1c853d6640 1 --2- 172.21.15.2:0/1053507911 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c80100a80 0x7f1c80198380 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:42.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.049+0000 7f1c853d6640 1 -- 172.21.15.2:0/1053507911 >> 172.21.15.2:0/1053507911 conn(0x7f1c800fc7a0 msgr2=0x7f1c8006abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:42.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.049+0000 7f1c853d6640 1 -- 172.21.15.2:0/1053507911 shutdown_connections 2024-09-19T04:50:42.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:42.049+0000 7f1c853d6640 1 -- 172.21.15.2:0/1053507911 wait complete. 2024-09-19T04:50:42.594 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:42 smithi002 ceph-mon[30975]: pgmap v84: 97 pgs: 97 active+clean; 2.8 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-09-19T04:50:42.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:42 smithi018 ceph-mon[34537]: pgmap v84: 97 pgs: 97 active+clean; 2.8 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-09-19T04:50:42.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:42 smithi116 ceph-mon[34477]: pgmap v84: 97 pgs: 97 active+clean; 2.8 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-09-19T04:50:43.624 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:50:43.624 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:50:43.897 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:50:44.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.345+0000 7f88a6b59640 1 -- 172.21.15.2:0/2992208736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88a0103660 msgr2=0x7f88a010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:44.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.345+0000 7f88a6b59640 1 --2- 172.21.15.2:0/2992208736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88a0103660 0x7f88a010bb50 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f888c009900 tx=0x7f888c02a480 comp rx=0 tx=0).stop 2024-09-19T04:50:44.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.345+0000 7f88a6b59640 1 -- 172.21.15.2:0/2992208736 shutdown_connections 2024-09-19T04:50:44.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.345+0000 7f88a6b59640 1 --2- 172.21.15.2:0/2992208736 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f88a010c170 0x7f88a010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:44.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.345+0000 7f88a6b59640 1 --2- 172.21.15.2:0/2992208736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88a0103660 0x7f88a010bb50 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:44.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.345+0000 7f88a6b59640 1 --2- 172.21.15.2:0/2992208736 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88a0102d40 0x7f88a0103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:44.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.345+0000 7f88a6b59640 1 -- 172.21.15.2:0/2992208736 >> 172.21.15.2:0/2992208736 conn(0x7f88a00fc7a0 msgr2=0x7f88a00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:44.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.345+0000 7f88a6b59640 1 -- 172.21.15.2:0/2992208736 shutdown_connections 2024-09-19T04:50:44.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.346+0000 7f88a6b59640 1 -- 172.21.15.2:0/2992208736 wait complete. 2024-09-19T04:50:44.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.346+0000 7f88a6b59640 1 Processor -- start 2024-09-19T04:50:44.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.346+0000 7f88a6b59640 1 -- start start 2024-09-19T04:50:44.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.346+0000 7f88a6b59640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f88a0102d40 0x7f88a0198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:44.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.346+0000 7f88a6b59640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88a0103660 0x7f88a0198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:44.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.347+0000 7f88a6b59640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88a010c170 0x7f88a019cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:44.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.347+0000 7f88a6b59640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f88a0111e20 con 0x7f88a010c170 2024-09-19T04:50:44.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.347+0000 7f88a6b59640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f88a0111ca0 con 0x7f88a0103660 2024-09-19T04:50:44.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.347+0000 7f88a6b59640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f88a0111fa0 con 0x7f88a0102d40 2024-09-19T04:50:44.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.347+0000 7f88a50f6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88a010c170 0x7f88a019cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:44.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.347+0000 7f88a50f6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88a010c170 0x7f88a019cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44808/0 (socket says 172.21.15.2:44808) 2024-09-19T04:50:44.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.347+0000 7f88a50f6640 1 -- 172.21.15.2:0/4188426263 learned_addr learned my addr 172.21.15.2:0/4188426263 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:44.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.347+0000 7f889ffff640 1 --2- 172.21.15.2:0/4188426263 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88a0103660 0x7f88a0198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:44.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.347+0000 7f88a48f5640 1 --2- 172.21.15.2:0/4188426263 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f88a0102d40 0x7f88a0198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:44.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.347+0000 7f88a50f6640 1 -- 172.21.15.2:0/4188426263 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f88a0102d40 msgr2=0x7f88a0198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:44.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.347+0000 7f88a50f6640 1 --2- 172.21.15.2:0/4188426263 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f88a0102d40 0x7f88a0198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:44.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.347+0000 7f88a50f6640 1 -- 172.21.15.2:0/4188426263 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88a0103660 msgr2=0x7f88a0198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:44.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.347+0000 7f88a50f6640 1 --2- 172.21.15.2:0/4188426263 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88a0103660 0x7f88a0198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:44.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.347+0000 7f88a50f6640 1 -- 172.21.15.2:0/4188426263 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88a019d2d0 con 0x7f88a010c170 2024-09-19T04:50:44.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.347+0000 7f88a48f5640 1 --2- 172.21.15.2:0/4188426263 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f88a0102d40 0x7f88a0198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:50:44.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.347+0000 7f88a50f6640 1 --2- 172.21.15.2:0/4188426263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88a010c170 0x7f88a019cbf0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f889800cce0 tx=0x7f889800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:44.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.347+0000 7f889dffb640 1 -- 172.21.15.2:0/4188426263 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f889800f450 con 0x7f88a010c170 2024-09-19T04:50:44.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.347+0000 7f88a6b59640 1 -- 172.21.15.2:0/4188426263 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88a019d5c0 con 0x7f88a010c170 2024-09-19T04:50:44.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.348+0000 7f889dffb640 1 -- 172.21.15.2:0/4188426263 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f889800faa0 con 0x7f88a010c170 2024-09-19T04:50:44.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.348+0000 7f889dffb640 1 -- 172.21.15.2:0/4188426263 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8898018b70 con 0x7f88a010c170 2024-09-19T04:50:44.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.348+0000 7f88a6b59640 1 -- 172.21.15.2:0/4188426263 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88a01a4ea0 con 0x7f88a010c170 2024-09-19T04:50:44.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.350+0000 7f889dffb640 1 -- 172.21.15.2:0/4188426263 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f8898018d10 con 0x7f88a010c170 2024-09-19T04:50:44.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.350+0000 7f88a8f32740 1 Processor -- start 2024-09-19T04:50:44.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.350+0000 7f88a8f32740 1 -- start start 2024-09-19T04:50:44.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.350+0000 7f88a8f32740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648acbbea20 0x5648acbbee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:44.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.350+0000 7f88a8f32740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5648acbbf340 0x5648acbcdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:44.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.350+0000 7f88a8f32740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648acbce150 0x5648acbd0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:44.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.350+0000 7f88a8f32740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5648acb24280 con 0x5648acbbea20 2024-09-19T04:50:44.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.350+0000 7f88a8f32740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5648acacbb10 con 0x5648acbce150 2024-09-19T04:50:44.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.350+0000 7f88a8f32740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5648acb20240 con 0x5648acbbf340 2024-09-19T04:50:44.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.351+0000 7f889ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648acbbea20 0x5648acbbee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:44.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.351+0000 7f889ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648acbbea20 0x5648acbbee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44814/0 (socket says 172.21.15.2:44814) 2024-09-19T04:50:44.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.351+0000 7f889ffff640 1 -- 172.21.15.2:0/2819166240 learned_addr learned my addr 172.21.15.2:0/2819166240 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:44.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.351+0000 7f889dffb640 1 --2- 172.21.15.2:0/4188426263 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f88900a33b0 0x7f88900a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:44.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.351+0000 7f889ffff640 1 --2- 172.21.15.2:0/2819166240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648acbce150 0x5648acbd0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:44.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.351+0000 7f88a48f5640 1 --2- 172.21.15.2:0/2819166240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5648acbbf340 0x5648acbcdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:44.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.351+0000 7f889ffff640 1 -- 172.21.15.2:0/2819166240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5648acbbf340 msgr2=0x5648acbcdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:44.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.351+0000 7f889ffff640 1 --2- 172.21.15.2:0/2819166240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5648acbbf340 0x5648acbcdc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:44.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.351+0000 7f889ffff640 1 -- 172.21.15.2:0/2819166240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648acbce150 msgr2=0x5648acbd0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:44.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.351+0000 7f889ffff640 1 --2- 172.21.15.2:0/2819166240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648acbce150 0x5648acbd0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:44.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.351+0000 7f889ffff640 1 -- 172.21.15.2:0/2819166240 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648acad81f0 con 0x5648acbbea20 2024-09-19T04:50:44.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.351+0000 7f88a50f6640 1 --2- 172.21.15.2:0/4188426263 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f88900a33b0 0x7f88900a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:44.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.351+0000 7f889dffb640 1 -- 172.21.15.2:0/4188426263 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f88980d0130 con 0x7f88a010c170 2024-09-19T04:50:44.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.351+0000 7f889ffff640 1 --2- 172.21.15.2:0/2819166240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648acbbea20 0x5648acbbee00 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f888c009900 tx=0x7f888c005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a826c49671f53c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:44.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.351+0000 7f888affd640 1 -- 172.21.15.2:0/2819166240 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888c044020 con 0x5648acbbea20 2024-09-19T04:50:44.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.351+0000 7f888affd640 1 -- 172.21.15.2:0/2819166240 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f888c0317e0 con 0x5648acbbea20 2024-09-19T04:50:44.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.351+0000 7f888affd640 1 -- 172.21.15.2:0/2819166240 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888c035040 con 0x5648acbbea20 2024-09-19T04:50:44.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.351+0000 7f88a50f6640 1 --2- 172.21.15.2:0/4188426263 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f88900a33b0 0x7f88900a5870 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f889809c0d0 tx=0x7f88980671b0 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:44.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.352+0000 7f88a8f32740 1 -- 172.21.15.2:0/2819166240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648acbbea20 msgr2=0x5648acbbee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:44.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.352+0000 7f88a8f32740 1 --2- 172.21.15.2:0/2819166240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648acbbea20 0x5648acbbee00 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f888c009900 tx=0x7f888c005db0 comp rx=0 tx=0).stop 2024-09-19T04:50:44.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.352+0000 7f88a8f32740 1 -- 172.21.15.2:0/2819166240 shutdown_connections 2024-09-19T04:50:44.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.352+0000 7f88a8f32740 1 --2- 172.21.15.2:0/2819166240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648acbce150 0x5648acbd0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:44.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.352+0000 7f88a8f32740 1 --2- 172.21.15.2:0/2819166240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5648acbbf340 0x5648acbcdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:44.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.352+0000 7f88a8f32740 1 --2- 172.21.15.2:0/2819166240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648acbbea20 0x5648acbbee00 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:44.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.352+0000 7f88a8f32740 1 -- 172.21.15.2:0/2819166240 >> 172.21.15.2:0/2819166240 conn(0x5648acbbb0f0 msgr2=0x5648acbbb4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:44.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.353+0000 7f88a8f32740 1 -- 172.21.15.2:0/2819166240 shutdown_connections 2024-09-19T04:50:44.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.353+0000 7f88a8f32740 1 -- 172.21.15.2:0/2819166240 wait complete. 2024-09-19T04:50:44.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.353+0000 7f88a8f32740 1 -- start start 2024-09-19T04:50:44.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.353+0000 7f88a8f32740 1 Processor -- start 2024-09-19T04:50:44.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.353+0000 7f88a8f32740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648acbbea20 0x5648acbcb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:44.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.353+0000 7f88a8f32740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5648acbbf340 0x5648acbcb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:44.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.353+0000 7f88a8f32740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648acbce150 0x5648acbcbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:44.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.353+0000 7f88a8f32740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5648acbd0cc0 con 0x5648acbce150 2024-09-19T04:50:44.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.353+0000 7f88a8f32740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5648acadef10 con 0x5648acbbea20 2024-09-19T04:50:44.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.353+0000 7f88a8f32740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5648acbd0e40 con 0x5648acbbf340 2024-09-19T04:50:44.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.353+0000 7f88a8f32740 10 client.0 _ll_register_callbacks cb 0x5648acaa7a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:50:44.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.354+0000 7f889ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648acbce150 0x5648acbcbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:44.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.354+0000 7f889ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648acbce150 0x5648acbcbaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44820/0 (socket says 172.21.15.2:44820) 2024-09-19T04:50:44.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.354+0000 7f889ffff640 1 -- 172.21.15.2:0/2684412077 learned_addr learned my addr 172.21.15.2:0/2684412077 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:44.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.354+0000 7f889ffff640 1 --2- 172.21.15.2:0/2684412077 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648acbbea20 0x5648acbcb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:44.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.354+0000 7f88a48f5640 1 --2- 172.21.15.2:0/2684412077 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5648acbbf340 0x5648acbcb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:44.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.354+0000 7f889ffff640 1 -- 172.21.15.2:0/2684412077 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5648acbbf340 msgr2=0x5648acbcb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:44.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.354+0000 7f889ffff640 1 --2- 172.21.15.2:0/2684412077 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5648acbbf340 0x5648acbcb5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:44.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.354+0000 7f889ffff640 1 -- 172.21.15.2:0/2684412077 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648acbbea20 msgr2=0x5648acbcb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:44.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.354+0000 7f889ffff640 1 --2- 172.21.15.2:0/2684412077 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648acbbea20 0x5648acbcb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:44.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.354+0000 7f889ffff640 1 -- 172.21.15.2:0/2684412077 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648ac8956a0 con 0x5648acbce150 2024-09-19T04:50:44.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.354+0000 7f889ffff640 1 --2- 172.21.15.2:0/2684412077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648acbce150 0x5648acbcbaf0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f888c005790 tx=0x7f888c040040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3610a890a7136606 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:44.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.354+0000 7f887ffff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:50:44.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.354+0000 7f887ffff640 1 -- 172.21.15.2:0/2684412077 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888c035070 con 0x5648acbce150 2024-09-19T04:50:44.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.354+0000 7f887ffff640 1 -- 172.21.15.2:0/2684412077 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f888c004ad0 con 0x5648acbce150 2024-09-19T04:50:44.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.354+0000 7f88a8f32740 1 -- 172.21.15.2:0/2684412077 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f888c0317e0 con 0x5648acbce150 2024-09-19T04:50:44.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.355+0000 7f887ffff640 1 -- 172.21.15.2:0/2684412077 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f888c044070 con 0x5648acbce150 2024-09-19T04:50:44.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.355+0000 7f88a8f32740 10 client.15570 fetch_fsmap learned FSMap version 19 2024-09-19T04:50:44.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.355+0000 7f88a8f32740 1 -- 172.21.15.2:0/2684412077 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5648acbdc960 con 0x5648acbce150 2024-09-19T04:50:44.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.355+0000 7f887ffff640 1 -- 172.21.15.2:0/2684412077 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f888c0317e0 con 0x5648acbce150 2024-09-19T04:50:44.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.355+0000 7f887ffff640 1 -- 172.21.15.2:0/2684412077 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f888c057c50 con 0x5648acbce150 2024-09-19T04:50:44.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.355+0000 7f88a8f32740 10 client.15570 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:50:44.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.355+0000 7f88a8f32740 10 client.15570 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:50:44.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.355+0000 7f88a8f32740 20 client.15570 populate_metadata read hostname 'smithi002' 2024-09-19T04:50:44.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.355+0000 7f88a8f32740 1 --2- 172.21.15.2:0/2684412077 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5648acbddcb0 0x5648acbe00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:44.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.355+0000 7f88a8f32740 4 client.15570 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:50:44.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.355+0000 7f88a8f32740 1 -- 172.21.15.2:0/2684412077 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5648acb317f0 con 0x5648acbddcb0 2024-09-19T04:50:44.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.355+0000 7f88a48f5640 1 --2- 172.21.15.2:0/2684412077 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5648acbddcb0 0x5648acbe00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:44.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.356+0000 7f887ffff640 10 client.15570 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:50:44.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.356+0000 7f88a48f5640 1 --2- 172.21.15.2:0/2684412077 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5648acbddcb0 0x5648acbe00a0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=248e22dc4ced5063 server_cookie=2b8333e037794eae in_seq=0 out_seq=0 2024-09-19T04:50:44.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.356+0000 7f887ffff640 1 -- 172.21.15.2:0/2684412077 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5648acb317f0 con 0x5648acbddcb0 2024-09-19T04:50:44.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.356+0000 7f887ffff640 10 client.15570 handle_command_reply: tid=0 2024-09-19T04:50:44.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.357+0000 7f88a8f32740 1 client.15570 shutdown 2024-09-19T04:50:44.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.357+0000 7f88a8f32740 1 -- 172.21.15.2:0/2684412077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648acbce150 msgr2=0x5648acbcbaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:44.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.357+0000 7f88a8f32740 1 --2- 172.21.15.2:0/2684412077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648acbce150 0x5648acbcbaf0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f888c005790 tx=0x7f888c040040 comp rx=0 tx=0).stop 2024-09-19T04:50:44.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.357+0000 7f88a8f32740 1 -- 172.21.15.2:0/2684412077 shutdown_connections 2024-09-19T04:50:44.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.357+0000 7f88a8f32740 1 --2- 172.21.15.2:0/2684412077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648acbce150 0x5648acbcbaf0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:44.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.357+0000 7f88a8f32740 1 --2- 172.21.15.2:0/2684412077 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5648acbddcb0 0x5648acbe00a0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:44.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.357+0000 7f88a8f32740 1 --2- 172.21.15.2:0/2684412077 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5648acbbf340 0x5648acbcb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:44.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.357+0000 7f88a8f32740 1 --2- 172.21.15.2:0/2684412077 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648acbbea20 0x5648acbcb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:44.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.357+0000 7f887ffff640 0 client.15570 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:50:44.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.357+0000 7f88a8f32740 1 -- 172.21.15.2:0/2684412077 >> 172.21.15.2:0/2684412077 conn(0x5648acbbb0f0 msgr2=0x5648acbc0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:44.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.357+0000 7f88a8f32740 1 -- 172.21.15.2:0/2684412077 shutdown_connections 2024-09-19T04:50:44.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.357+0000 7f88a8f32740 1 -- 172.21.15.2:0/2684412077 wait complete. 2024-09-19T04:50:44.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.357+0000 7f88a8f32740 20 client.15570 trim_cache size 0 max 16384 2024-09-19T04:50:44.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.375+0000 7f88a8f32740 1 Processor -- start 2024-09-19T04:50:44.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.375+0000 7f88a8f32740 1 -- start start 2024-09-19T04:50:44.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.375+0000 7f88a8f32740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648acbbea20 0x5648acbcced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:44.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.375+0000 7f88a8f32740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5648acbbf340 0x5648acbe30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:44.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.375+0000 7f88a8f32740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648acbce150 0x5648acbe3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:44.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.375+0000 7f88a8f32740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f88a01a9400 con 0x5648acbbea20 2024-09-19T04:50:44.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.375+0000 7f88a8f32740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f88a01abc60 con 0x5648acbce150 2024-09-19T04:50:44.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.375+0000 7f88a8f32740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f88a01a9a50 con 0x5648acbbf340 2024-09-19T04:50:44.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.375+0000 7f889ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648acbbea20 0x5648acbcced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:44.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.375+0000 7f889ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648acbbea20 0x5648acbcced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44834/0 (socket says 172.21.15.2:44834) 2024-09-19T04:50:44.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.376+0000 7f889ffff640 1 -- 172.21.15.2:0/2317150714 learned_addr learned my addr 172.21.15.2:0/2317150714 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:44.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.376+0000 7f88a48f5640 1 --2- 172.21.15.2:0/2317150714 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5648acbbf340 0x5648acbe30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:44.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.376+0000 7f889ffff640 1 -- 172.21.15.2:0/2317150714 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5648acbbf340 msgr2=0x5648acbe30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:44.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.376+0000 7f889ffff640 1 --2- 172.21.15.2:0/2317150714 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5648acbbf340 0x5648acbe30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:44.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.376+0000 7f889ffff640 1 -- 172.21.15.2:0/2317150714 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648acbce150 msgr2=0x5648acbe3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:44.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.376+0000 7f889ffff640 1 --2- 172.21.15.2:0/2317150714 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648acbce150 0x5648acbe3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:44.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.376+0000 7f889ffff640 1 -- 172.21.15.2:0/2317150714 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648acbbaf20 con 0x5648acbbea20 2024-09-19T04:50:44.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.376+0000 7f889ffff640 1 --2- 172.21.15.2:0/2317150714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648acbbea20 0x5648acbcced0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f888c009900 tx=0x7f888c02a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a4fcd22d10b464b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:44.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.376+0000 7f888a7fc640 1 -- 172.21.15.2:0/2317150714 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888c035040 con 0x5648acbbea20 2024-09-19T04:50:44.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.376+0000 7f888a7fc640 1 -- 172.21.15.2:0/2317150714 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f888c0317e0 con 0x5648acbbea20 2024-09-19T04:50:44.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.376+0000 7f888a7fc640 1 -- 172.21.15.2:0/2317150714 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888c04aca0 con 0x5648acbbea20 2024-09-19T04:50:44.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.377+0000 7f88a8f32740 1 -- 172.21.15.2:0/2317150714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648acbbea20 msgr2=0x5648acbcced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:44.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.377+0000 7f88a8f32740 1 --2- 172.21.15.2:0/2317150714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648acbbea20 0x5648acbcced0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f888c009900 tx=0x7f888c02a480 comp rx=0 tx=0).stop 2024-09-19T04:50:44.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.377+0000 7f88a8f32740 1 -- 172.21.15.2:0/2317150714 shutdown_connections 2024-09-19T04:50:44.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.377+0000 7f88a8f32740 1 --2- 172.21.15.2:0/2317150714 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648acbce150 0x5648acbe3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:44.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.377+0000 7f88a8f32740 1 --2- 172.21.15.2:0/2317150714 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5648acbbf340 0x5648acbe30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:44.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.377+0000 7f88a8f32740 1 --2- 172.21.15.2:0/2317150714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648acbbea20 0x5648acbcced0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:44.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.377+0000 7f88a8f32740 1 -- 172.21.15.2:0/2317150714 >> 172.21.15.2:0/2317150714 conn(0x5648acbbb0f0 msgr2=0x5648acbcc7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:44.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.377+0000 7f88a8f32740 1 -- 172.21.15.2:0/2317150714 shutdown_connections 2024-09-19T04:50:44.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.377+0000 7f88a8f32740 1 -- 172.21.15.2:0/2317150714 wait complete. 2024-09-19T04:50:44.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.377+0000 7f88a8f32740 1 -- start start 2024-09-19T04:50:44.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.378+0000 7f88a8f32740 1 Processor -- start 2024-09-19T04:50:44.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.378+0000 7f88a8f32740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648acbbea20 0x5648acbe1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:44.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.378+0000 7f88a8f32740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648acbbf340 0x5648acbe1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:44.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.378+0000 7f88a8f32740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5648acbce150 0x5648acc475f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:44.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.378+0000 7f88a8f32740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f88a01aa120 con 0x5648acbbf340 2024-09-19T04:50:44.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.378+0000 7f88a8f32740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f88a01ab590 con 0x5648acbbea20 2024-09-19T04:50:44.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.378+0000 7f88a8f32740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f88a01aa7f0 con 0x5648acbce150 2024-09-19T04:50:44.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.378+0000 7f88a8f32740 10 client.0 _ll_register_callbacks cb 0x7f888c032ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:50:44.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.378+0000 7f88a48f5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648acbbf340 0x5648acbe1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:44.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.378+0000 7f88a48f5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648acbbf340 0x5648acbe1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44850/0 (socket says 172.21.15.2:44850) 2024-09-19T04:50:44.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.378+0000 7f88a48f5640 1 -- 172.21.15.2:0/1232455608 learned_addr learned my addr 172.21.15.2:0/1232455608 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:44.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.378+0000 7f889ffff640 1 --2- 172.21.15.2:0/1232455608 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648acbbea20 0x5648acbe1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:44.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.378+0000 7f889ffff640 1 --2- 172.21.15.2:0/1232455608 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5648acbce150 0x5648acc475f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:44.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.379+0000 7f88a48f5640 1 -- 172.21.15.2:0/1232455608 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5648acbce150 msgr2=0x5648acc475f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:44.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.379+0000 7f88a48f5640 1 --2- 172.21.15.2:0/1232455608 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5648acbce150 0x5648acc475f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:44.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.379+0000 7f88a48f5640 1 -- 172.21.15.2:0/1232455608 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648acbbea20 msgr2=0x5648acbe1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:44.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.379+0000 7f88a48f5640 1 --2- 172.21.15.2:0/1232455608 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648acbbea20 0x5648acbe1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:44.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.379+0000 7f88a48f5640 1 -- 172.21.15.2:0/1232455608 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648acbc5de0 con 0x5648acbbf340 2024-09-19T04:50:44.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.379+0000 7f88a48f5640 1 --2- 172.21.15.2:0/1232455608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648acbbf340 0x5648acbe1ac0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x5648acbcc620 tx=0x7f889401a720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1835a598733f4211 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:44.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.379+0000 7f887ffff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:50:44.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.379+0000 7f887ffff640 1 -- 172.21.15.2:0/1232455608 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88940035f0 con 0x5648acbbf340 2024-09-19T04:50:44.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.379+0000 7f887ffff640 1 -- 172.21.15.2:0/1232455608 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f8894003790 con 0x5648acbbf340 2024-09-19T04:50:44.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.379+0000 7f88a8f32740 1 -- 172.21.15.2:0/1232455608 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f888c0317e0 con 0x5648acbbf340 2024-09-19T04:50:44.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.379+0000 7f887ffff640 1 -- 172.21.15.2:0/1232455608 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f88940039b0 con 0x5648acbbf340 2024-09-19T04:50:44.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.379+0000 7f88a8f32740 10 client.15576 fetch_fsmap learned FSMap version 19 2024-09-19T04:50:44.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.379+0000 7f88a8f32740 1 -- 172.21.15.2:0/1232455608 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5648acc48ca0 con 0x5648acbbf340 2024-09-19T04:50:44.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.379+0000 7f887ffff640 1 -- 172.21.15.2:0/1232455608 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f888c0317e0 con 0x5648acbbf340 2024-09-19T04:50:44.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.379+0000 7f887ffff640 1 -- 172.21.15.2:0/1232455608 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f889402a020 con 0x5648acbbf340 2024-09-19T04:50:44.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.379+0000 7f88a8f32740 10 client.15576 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:50:44.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.379+0000 7f88a8f32740 10 client.15576 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:50:44.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.380+0000 7f88a8f32740 20 client.15576 populate_metadata read hostname 'smithi002' 2024-09-19T04:50:44.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.380+0000 7f88a8f32740 1 --2- 172.21.15.2:0/1232455608 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5648acc493f0 0x5648acc4b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:44.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.380+0000 7f88a8f32740 4 client.15576 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:50:44.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.380+0000 7f88a8f32740 1 -- 172.21.15.2:0/1232455608 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5648acb2bd00 con 0x5648acc493f0 2024-09-19T04:50:44.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.380+0000 7f889ffff640 1 --2- 172.21.15.2:0/1232455608 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5648acc493f0 0x5648acc4b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:44.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.380+0000 7f887ffff640 10 client.15576 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:50:44.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.380+0000 7f889ffff640 1 --2- 172.21.15.2:0/1232455608 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5648acc493f0 0x5648acc4b810 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a029c920ae02765f server_cookie=9fc9fcf30cd62856 in_seq=0 out_seq=0 2024-09-19T04:50:44.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.381+0000 7f887ffff640 1 -- 172.21.15.2:0/1232455608 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5648acb2bd00 con 0x5648acc493f0 2024-09-19T04:50:44.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.381+0000 7f887ffff640 10 client.15576 handle_command_reply: tid=0 2024-09-19T04:50:44.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.381+0000 7f88a8f32740 1 client.15576 shutdown 2024-09-19T04:50:44.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.381+0000 7f88a8f32740 1 -- 172.21.15.2:0/1232455608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648acbbf340 msgr2=0x5648acbe1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:44.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.381+0000 7f88a8f32740 1 --2- 172.21.15.2:0/1232455608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648acbbf340 0x5648acbe1ac0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x5648acbcc620 tx=0x7f889401a720 comp rx=0 tx=0).stop 2024-09-19T04:50:44.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.381+0000 7f88a8f32740 1 -- 172.21.15.2:0/1232455608 shutdown_connections 2024-09-19T04:50:44.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.381+0000 7f88a8f32740 1 --2- 172.21.15.2:0/1232455608 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5648acc493f0 0x5648acc4b810 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:44.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.381+0000 7f88a8f32740 1 --2- 172.21.15.2:0/1232455608 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5648acbce150 0x5648acc475f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:44.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.381+0000 7f88a8f32740 1 --2- 172.21.15.2:0/1232455608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5648acbbf340 0x5648acbe1ac0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:44.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.381+0000 7f88a8f32740 1 --2- 172.21.15.2:0/1232455608 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648acbbea20 0x5648acbe1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:44.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.381+0000 7f88a8f32740 1 -- 172.21.15.2:0/1232455608 >> 172.21.15.2:0/1232455608 conn(0x5648acbbb0f0 msgr2=0x5648acbcb850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:44.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.382+0000 7f887ffff640 0 client.15576 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:50:44.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.382+0000 7f88a8f32740 1 -- 172.21.15.2:0/1232455608 shutdown_connections 2024-09-19T04:50:44.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.382+0000 7f88a8f32740 1 -- 172.21.15.2:0/1232455608 wait complete. 2024-09-19T04:50:44.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.382+0000 7f88a8f32740 20 client.15576 trim_cache size 0 max 16384 2024-09-19T04:50:44.393 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:50:44.393 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T04:50:44.393 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "32ef2fe4-91c3-4ce6-9d28-c0284d06d271", 2024-09-19T04:50:44.393 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T04:50:44.393 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:50:44.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.382+0000 7f88a6b59640 1 -- 172.21.15.2:0/4188426263 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f88900a33b0 msgr2=0x7f88900a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:44.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.382+0000 7f88a6b59640 1 --2- 172.21.15.2:0/4188426263 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f88900a33b0 0x7f88900a5870 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f889809c0d0 tx=0x7f88980671b0 comp rx=0 tx=0).stop 2024-09-19T04:50:44.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.382+0000 7f88a6b59640 1 -- 172.21.15.2:0/4188426263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88a010c170 msgr2=0x7f88a019cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:44.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.382+0000 7f88a6b59640 1 --2- 172.21.15.2:0/4188426263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88a010c170 0x7f88a019cbf0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f889800cce0 tx=0x7f889800a620 comp rx=0 tx=0).stop 2024-09-19T04:50:44.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.382+0000 7f88a6b59640 1 -- 172.21.15.2:0/4188426263 shutdown_connections 2024-09-19T04:50:44.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.382+0000 7f88a6b59640 1 --2- 172.21.15.2:0/4188426263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88a010c170 0x7f88a019cbf0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:44.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.382+0000 7f88a6b59640 1 --2- 172.21.15.2:0/4188426263 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88a0103660 0x7f88a0198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:44.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.382+0000 7f88a6b59640 1 --2- 172.21.15.2:0/4188426263 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f88900a33b0 0x7f88900a5870 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:44.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.382+0000 7f88a6b59640 1 --2- 172.21.15.2:0/4188426263 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f88a0102d40 0x7f88a0198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:44.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.382+0000 7f88a6b59640 1 -- 172.21.15.2:0/4188426263 >> 172.21.15.2:0/4188426263 conn(0x7f88a00fc7a0 msgr2=0x7f88a00fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:44.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.383+0000 7f88a6b59640 1 -- 172.21.15.2:0/4188426263 shutdown_connections 2024-09-19T04:50:44.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:44.383+0000 7f88a6b59640 1 -- 172.21.15.2:0/4188426263 wait complete. 2024-09-19T04:50:44.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:44 smithi002 ceph-mon[30975]: pgmap v85: 97 pgs: 97 active+clean; 2.8 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-09-19T04:50:44.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:44 smithi002 ceph-mon[30975]: scrub queued for path: / 2024-09-19T04:50:44.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:44 smithi002 ceph-mon[30975]: scrub summary: idle+waiting paths [/] 2024-09-19T04:50:44.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:44 smithi002 ceph-mon[30975]: scrub summary: active paths [/] 2024-09-19T04:50:44.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:44 smithi002 ceph-mon[30975]: scrub summary: idle+waiting paths [/] 2024-09-19T04:50:44.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:44 smithi018 ceph-mon[34537]: pgmap v85: 97 pgs: 97 active+clean; 2.8 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-09-19T04:50:44.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:44 smithi018 ceph-mon[34537]: scrub queued for path: / 2024-09-19T04:50:44.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:44 smithi018 ceph-mon[34537]: scrub summary: idle+waiting paths [/] 2024-09-19T04:50:44.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:44 smithi018 ceph-mon[34537]: scrub summary: active paths [/] 2024-09-19T04:50:44.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:44 smithi018 ceph-mon[34537]: scrub summary: idle+waiting paths [/] 2024-09-19T04:50:44.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:44 smithi116 ceph-mon[34477]: pgmap v85: 97 pgs: 97 active+clean; 2.8 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-09-19T04:50:44.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:44 smithi116 ceph-mon[34477]: scrub queued for path: / 2024-09-19T04:50:44.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:44 smithi116 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-19T04:50:44.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:44 smithi116 ceph-mon[34477]: scrub summary: active paths [/] 2024-09-19T04:50:44.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:44 smithi116 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-19T04:50:45.138 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:50:45.396 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:50:45.765 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:45 smithi002 ceph-mon[30975]: scrub summary: idle 2024-09-19T04:50:45.808 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:45 smithi018 ceph-mon[34537]: scrub summary: idle 2024-09-19T04:50:45.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.847+0000 7f3459ba2640 1 -- 172.21.15.2:0/2238304391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3454101270 msgr2=0x7f345410d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:45.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.847+0000 7f3459ba2640 1 --2- 172.21.15.2:0/2238304391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3454101270 0x7f345410d7a0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f344c009cd0 tx=0x7f344c02a8e0 comp rx=0 tx=0).stop 2024-09-19T04:50:45.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.847+0000 7f3459ba2640 1 -- 172.21.15.2:0/2238304391 shutdown_connections 2024-09-19T04:50:45.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.847+0000 7f3459ba2640 1 --2- 172.21.15.2:0/2238304391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3454101270 0x7f345410d7a0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:45.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.847+0000 7f3459ba2640 1 --2- 172.21.15.2:0/2238304391 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34541008d0 0x7f3454100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:45.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.847+0000 7f3459ba2640 1 --2- 172.21.15.2:0/2238304391 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f34541068d0 0x7f3454106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:45.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.847+0000 7f3459ba2640 1 -- 172.21.15.2:0/2238304391 >> 172.21.15.2:0/2238304391 conn(0x7f34540fc610 msgr2=0x7f34540fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:45.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.847+0000 7f3459ba2640 1 -- 172.21.15.2:0/2238304391 shutdown_connections 2024-09-19T04:50:45.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.847+0000 7f3459ba2640 1 -- 172.21.15.2:0/2238304391 wait complete. 2024-09-19T04:50:45.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.848+0000 7f3459ba2640 1 Processor -- start 2024-09-19T04:50:45.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.848+0000 7f3459ba2640 1 -- start start 2024-09-19T04:50:45.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.848+0000 7f3459ba2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34541008d0 0x7f3454198140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:45.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.848+0000 7f3459ba2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3454101270 0x7f3454198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:45.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.848+0000 7f3459ba2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34541068d0 0x7f345419ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:45.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.848+0000 7f3459ba2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3454111ca0 con 0x7f34541068d0 2024-09-19T04:50:45.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.848+0000 7f3459ba2640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3454111b20 con 0x7f34541008d0 2024-09-19T04:50:45.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.848+0000 7f3459ba2640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f3454111e20 con 0x7f3454101270 2024-09-19T04:50:45.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.849+0000 7f34593a1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34541068d0 0x7f345419ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:45.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.849+0000 7f34593a1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34541068d0 0x7f345419ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44862/0 (socket says 172.21.15.2:44862) 2024-09-19T04:50:45.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.849+0000 7f34593a1640 1 -- 172.21.15.2:0/2620905196 learned_addr learned my addr 172.21.15.2:0/2620905196 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:45.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.849+0000 7f3458ba0640 1 --2- 172.21.15.2:0/2620905196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34541008d0 0x7f3454198140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:45.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.849+0000 7f3453fff640 1 --2- 172.21.15.2:0/2620905196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3454101270 0x7f3454198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:45.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.849+0000 7f34593a1640 1 -- 172.21.15.2:0/2620905196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3454101270 msgr2=0x7f3454198680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:45.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.849+0000 7f34593a1640 1 --2- 172.21.15.2:0/2620905196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3454101270 0x7f3454198680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:45.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.849+0000 7f34593a1640 1 -- 172.21.15.2:0/2620905196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34541008d0 msgr2=0x7f3454198140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:45.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.849+0000 7f34593a1640 1 --2- 172.21.15.2:0/2620905196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34541008d0 0x7f3454198140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:45.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.849+0000 7f34593a1640 1 -- 172.21.15.2:0/2620905196 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f345419d0f0 con 0x7f34541068d0 2024-09-19T04:50:45.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.849+0000 7f3453fff640 1 --2- 172.21.15.2:0/2620905196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3454101270 0x7f3454198680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:50:45.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.849+0000 7f34593a1640 1 --2- 172.21.15.2:0/2620905196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34541068d0 0x7f345419ca10 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f344c005cc0 tx=0x7f344c003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:45.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.849+0000 7f3451ffb640 1 -- 172.21.15.2:0/2620905196 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344c004450 con 0x7f34541068d0 2024-09-19T04:50:45.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.849+0000 7f3451ffb640 1 -- 172.21.15.2:0/2620905196 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f344c031c90 con 0x7f34541068d0 2024-09-19T04:50:45.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.849+0000 7f3459ba2640 1 -- 172.21.15.2:0/2620905196 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f345419d380 con 0x7f34541068d0 2024-09-19T04:50:45.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.849+0000 7f3451ffb640 1 -- 172.21.15.2:0/2620905196 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344c03b400 con 0x7f34541068d0 2024-09-19T04:50:45.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.850+0000 7f3459ba2640 1 -- 172.21.15.2:0/2620905196 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34541a4cc0 con 0x7f34541068d0 2024-09-19T04:50:45.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.852+0000 7f3451ffb640 1 -- 172.21.15.2:0/2620905196 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f344c004680 con 0x7f34541068d0 2024-09-19T04:50:45.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.852+0000 7f345d1dd740 1 Processor -- start 2024-09-19T04:50:45.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.852+0000 7f345d1dd740 1 -- start start 2024-09-19T04:50:45.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.853+0000 7f345d1dd740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559315ac0670 0x559315ac0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:45.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.853+0000 7f345d1dd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559315ac0f90 0x559315acb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:45.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.853+0000 7f345d1dd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559315acb850 0x559315acdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:45.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.853+0000 7f345d1dd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559315a262e0 con 0x559315acb850 2024-09-19T04:50:45.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.853+0000 7f345d1dd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5593159cdce0 con 0x559315ac0f90 2024-09-19T04:50:45.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.853+0000 7f345d1dd740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x559315a222a0 con 0x559315ac0670 2024-09-19T04:50:45.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.853+0000 7f3453fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559315acb850 0x559315acdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:45.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.853+0000 7f3458ba0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559315ac0f90 0x559315acb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:45.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.853+0000 7f3458ba0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559315ac0f90 0x559315acb310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.2:44192/0 (socket says 172.21.15.2:44192) 2024-09-19T04:50:45.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.853+0000 7f3451ffb640 1 --2- 172.21.15.2:0/2620905196 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f343c0a33b0 0x7f343c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:45.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.853+0000 7f3453fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559315acb850 0x559315acdc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44872/0 (socket says 172.21.15.2:44872) 2024-09-19T04:50:45.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.853+0000 7f3458ba0640 1 -- 172.21.15.2:0/2269828639 learned_addr learned my addr 172.21.15.2:0/2269828639 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:45.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.853+0000 7f3453fff640 1 --2- 172.21.15.2:0/2269828639 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559315ac0670 0x559315ac0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:45.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.853+0000 7f3451ffb640 1 -- 172.21.15.2:0/2620905196 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f344c02e030 con 0x7f34541068d0 2024-09-19T04:50:45.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.853+0000 7f34593a1640 1 --2- 172.21.15.2:0/2620905196 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f343c0a33b0 0x7f343c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:45.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.853+0000 7f3458ba0640 1 -- 172.21.15.2:0/2269828639 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559315ac0670 msgr2=0x559315ac0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:45.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.853+0000 7f3458ba0640 1 --2- 172.21.15.2:0/2269828639 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559315ac0670 0x559315ac0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:45.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.853+0000 7f3458ba0640 1 -- 172.21.15.2:0/2269828639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559315acb850 msgr2=0x559315acdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:45.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.853+0000 7f3458ba0640 1 --2- 172.21.15.2:0/2269828639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559315acb850 0x559315acdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:45.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.853+0000 7f3458ba0640 1 -- 172.21.15.2:0/2269828639 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593159b2440 con 0x559315ac0f90 2024-09-19T04:50:45.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.853+0000 7f3453fff640 1 --2- 172.21.15.2:0/2269828639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559315acb850 0x559315acdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:50:45.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.854+0000 7f3458ba0640 1 --2- 172.21.15.2:0/2269828639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559315ac0f90 0x559315acb310 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f344400aba0 tx=0x7f344400f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f453782f56b7d30 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:45.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.854+0000 7f343affd640 1 -- 172.21.15.2:0/2269828639 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344401d070 con 0x559315ac0f90 2024-09-19T04:50:45.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.854+0000 7f34593a1640 1 --2- 172.21.15.2:0/2620905196 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f343c0a33b0 0x7f343c0a5870 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f344c0ee6e0 tx=0x7f344c003f10 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:45.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.854+0000 7f343affd640 1 -- 172.21.15.2:0/2269828639 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3444018af0 con 0x559315ac0f90 2024-09-19T04:50:45.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.854+0000 7f343affd640 1 -- 172.21.15.2:0/2269828639 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34440109b0 con 0x559315ac0f90 2024-09-19T04:50:45.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.854+0000 7f345d1dd740 1 -- 172.21.15.2:0/2269828639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559315ac0f90 msgr2=0x559315acb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:45.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.854+0000 7f345d1dd740 1 --2- 172.21.15.2:0/2269828639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559315ac0f90 0x559315acb310 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f344400aba0 tx=0x7f344400f790 comp rx=0 tx=0).stop 2024-09-19T04:50:45.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.855+0000 7f345d1dd740 1 -- 172.21.15.2:0/2269828639 shutdown_connections 2024-09-19T04:50:45.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.855+0000 7f345d1dd740 1 --2- 172.21.15.2:0/2269828639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559315acb850 0x559315acdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:45.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.855+0000 7f345d1dd740 1 --2- 172.21.15.2:0/2269828639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559315ac0f90 0x559315acb310 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:45.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.855+0000 7f345d1dd740 1 --2- 172.21.15.2:0/2269828639 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559315ac0670 0x559315ac0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:45.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.855+0000 7f345d1dd740 1 -- 172.21.15.2:0/2269828639 >> 172.21.15.2:0/2269828639 conn(0x559315abcc00 msgr2=0x559315abcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:45.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.855+0000 7f345d1dd740 1 -- 172.21.15.2:0/2269828639 shutdown_connections 2024-09-19T04:50:45.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.855+0000 7f345d1dd740 1 -- 172.21.15.2:0/2269828639 wait complete. 2024-09-19T04:50:45.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.855+0000 7f345d1dd740 1 -- start start 2024-09-19T04:50:45.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.855+0000 7f345d1dd740 1 Processor -- start 2024-09-19T04:50:45.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.855+0000 7f345d1dd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559315ac0670 0x559315acb190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:45.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.855+0000 7f345d1dd740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559315ac0f90 0x559315ac8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:45.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.855+0000 7f345d1dd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559315acb850 0x559315ac8980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:45.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.855+0000 7f345d1dd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559315ad2830 con 0x559315ac0670 2024-09-19T04:50:45.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.855+0000 7f345d1dd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5593159e1050 con 0x559315acb850 2024-09-19T04:50:45.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.856+0000 7f345d1dd740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x559315ad29b0 con 0x559315ac0f90 2024-09-19T04:50:45.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.856+0000 7f345d1dd740 10 client.0 _ll_register_callbacks cb 0x559315a21160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:50:45.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.856+0000 7f3453fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559315ac0670 0x559315acb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:45.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.856+0000 7f3453fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559315ac0670 0x559315acb190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44884/0 (socket says 172.21.15.2:44884) 2024-09-19T04:50:45.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.856+0000 7f3453fff640 1 -- 172.21.15.2:0/2300774403 learned_addr learned my addr 172.21.15.2:0/2300774403 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:45.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.856+0000 7f3458ba0640 1 --2- 172.21.15.2:0/2300774403 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559315ac0f90 0x559315ac8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:45.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.856+0000 7f3453fff640 1 --2- 172.21.15.2:0/2300774403 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559315acb850 0x559315ac8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:45.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.856+0000 7f3453fff640 1 -- 172.21.15.2:0/2300774403 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559315ac0f90 msgr2=0x559315ac8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:45.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.856+0000 7f3453fff640 1 --2- 172.21.15.2:0/2300774403 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559315ac0f90 0x559315ac8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:45.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.856+0000 7f3453fff640 1 -- 172.21.15.2:0/2300774403 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559315acb850 msgr2=0x559315ac8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:45.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.856+0000 7f3453fff640 1 --2- 172.21.15.2:0/2300774403 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559315acb850 0x559315ac8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:45.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.856+0000 7f3453fff640 1 -- 172.21.15.2:0/2300774403 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593157973c0 con 0x559315ac0670 2024-09-19T04:50:45.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.856+0000 7f3453fff640 1 --2- 172.21.15.2:0/2300774403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559315ac0670 0x559315acb190 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3448013ed0 tx=0x7f3448015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ede7d45966b0f48a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:45.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.856+0000 7f3433fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:50:45.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.856+0000 7f3433fff640 1 -- 172.21.15.2:0/2300774403 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3448004020 con 0x559315ac0670 2024-09-19T04:50:45.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.856+0000 7f3433fff640 1 -- 172.21.15.2:0/2300774403 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f34480041c0 con 0x559315ac0670 2024-09-19T04:50:45.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.856+0000 7f345d1dd740 1 -- 172.21.15.2:0/2300774403 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3444018af0 con 0x559315ac0670 2024-09-19T04:50:45.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.857+0000 7f3433fff640 1 -- 172.21.15.2:0/2300774403 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f3448027050 con 0x559315ac0670 2024-09-19T04:50:45.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.857+0000 7f345d1dd740 10 client.15588 fetch_fsmap learned FSMap version 19 2024-09-19T04:50:45.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.857+0000 7f345d1dd740 1 -- 172.21.15.2:0/2300774403 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x559315ade1e0 con 0x559315ac0670 2024-09-19T04:50:45.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.857+0000 7f3433fff640 1 -- 172.21.15.2:0/2300774403 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3444018af0 con 0x559315ac0670 2024-09-19T04:50:45.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.857+0000 7f3433fff640 1 -- 172.21.15.2:0/2300774403 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f344800f040 con 0x559315ac0670 2024-09-19T04:50:45.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.857+0000 7f345d1dd740 10 client.15588 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:50:45.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.857+0000 7f345d1dd740 10 client.15588 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:50:45.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.857+0000 7f345d1dd740 20 client.15588 populate_metadata read hostname 'smithi002' 2024-09-19T04:50:45.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.857+0000 7f345d1dd740 1 --2- 172.21.15.2:0/2300774403 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x559315adf5f0 0x559315ae1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:45.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.857+0000 7f345d1dd740 4 client.15588 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:50:45.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.857+0000 7f345d1dd740 1 -- 172.21.15.2:0/2300774403 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559315a33850 con 0x559315adf5f0 2024-09-19T04:50:45.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.857+0000 7f3458ba0640 1 --2- 172.21.15.2:0/2300774403 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x559315adf5f0 0x559315ae1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:45.871 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:45 smithi116 ceph-mon[34477]: scrub summary: idle 2024-09-19T04:50:45.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.858+0000 7f3458ba0640 1 --2- 172.21.15.2:0/2300774403 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x559315adf5f0 0x559315ae1a40 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d54e022493a7f27 server_cookie=d57b29a03bea955d in_seq=0 out_seq=0 2024-09-19T04:50:45.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.858+0000 7f3433fff640 10 client.15588 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:50:45.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.858+0000 7f3433fff640 1 -- 172.21.15.2:0/2300774403 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559315a33850 con 0x559315adf5f0 2024-09-19T04:50:45.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.858+0000 7f3433fff640 10 client.15588 handle_command_reply: tid=0 2024-09-19T04:50:45.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.858+0000 7f345d1dd740 1 client.15588 shutdown 2024-09-19T04:50:45.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.859+0000 7f345d1dd740 1 -- 172.21.15.2:0/2300774403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559315ac0670 msgr2=0x559315acb190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:45.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.859+0000 7f345d1dd740 1 --2- 172.21.15.2:0/2300774403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559315ac0670 0x559315acb190 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3448013ed0 tx=0x7f3448015040 comp rx=0 tx=0).stop 2024-09-19T04:50:45.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.859+0000 7f345d1dd740 1 -- 172.21.15.2:0/2300774403 shutdown_connections 2024-09-19T04:50:45.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.859+0000 7f345d1dd740 1 --2- 172.21.15.2:0/2300774403 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559315acb850 0x559315ac8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:45.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.859+0000 7f345d1dd740 1 --2- 172.21.15.2:0/2300774403 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x559315adf5f0 0x559315ae1a40 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:45.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.859+0000 7f345d1dd740 1 --2- 172.21.15.2:0/2300774403 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559315ac0f90 0x559315ac8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:45.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.859+0000 7f345d1dd740 1 --2- 172.21.15.2:0/2300774403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559315ac0670 0x559315acb190 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:45.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.859+0000 7f345d1dd740 1 -- 172.21.15.2:0/2300774403 >> 172.21.15.2:0/2300774403 conn(0x559315abcc00 msgr2=0x559315ac28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:45.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.859+0000 7f3433fff640 0 client.15588 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:50:45.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.859+0000 7f345d1dd740 1 -- 172.21.15.2:0/2300774403 shutdown_connections 2024-09-19T04:50:45.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.859+0000 7f345d1dd740 1 -- 172.21.15.2:0/2300774403 wait complete. 2024-09-19T04:50:45.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.859+0000 7f345d1dd740 20 client.15588 trim_cache size 0 max 16384 2024-09-19T04:50:45.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.876+0000 7f345d1dd740 1 Processor -- start 2024-09-19T04:50:45.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.876+0000 7f345d1dd740 1 -- start start 2024-09-19T04:50:45.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.876+0000 7f345d1dd740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559315abcc00 0x559315adba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:45.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.876+0000 7f345d1dd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559315ac0670 0x559315ac6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:45.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.876+0000 7f345d1dd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559315ac0f90 0x559315abbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:45.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.876+0000 7f345d1dd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f34541a9310 con 0x559315ac0670 2024-09-19T04:50:45.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.876+0000 7f345d1dd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f34541abb90 con 0x559315ac0f90 2024-09-19T04:50:45.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.876+0000 7f345d1dd740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f34541a9980 con 0x559315abcc00 2024-09-19T04:50:45.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.876+0000 7f3458ba0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559315ac0670 0x559315ac6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:45.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.876+0000 7f3458ba0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559315ac0670 0x559315ac6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44890/0 (socket says 172.21.15.2:44890) 2024-09-19T04:50:45.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.876+0000 7f3458ba0640 1 -- 172.21.15.2:0/1214809124 learned_addr learned my addr 172.21.15.2:0/1214809124 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:45.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.876+0000 7f3453fff640 1 --2- 172.21.15.2:0/1214809124 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559315abcc00 0x559315adba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:45.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.877+0000 7f3458ba0640 1 -- 172.21.15.2:0/1214809124 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559315abcc00 msgr2=0x559315adba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:45.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.877+0000 7f3453fff640 1 --2- 172.21.15.2:0/1214809124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559315ac0f90 0x559315abbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:45.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.877+0000 7f3458ba0640 1 --2- 172.21.15.2:0/1214809124 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559315abcc00 0x559315adba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:45.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.877+0000 7f3458ba0640 1 -- 172.21.15.2:0/1214809124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559315ac0f90 msgr2=0x559315abbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:45.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.877+0000 7f3458ba0640 1 --2- 172.21.15.2:0/1214809124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559315ac0f90 0x559315abbc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:45.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.877+0000 7f3458ba0640 1 -- 172.21.15.2:0/1214809124 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559315ac73f0 con 0x559315ac0670 2024-09-19T04:50:45.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.877+0000 7f3458ba0640 1 --2- 172.21.15.2:0/1214809124 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559315ac0670 0x559315ac6d10 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x559315abda60 tx=0x7f344400fdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ae6c3bd9cdf8ea4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:45.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.877+0000 7f343a7fc640 1 -- 172.21.15.2:0/1214809124 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344401d040 con 0x559315ac0670 2024-09-19T04:50:45.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.877+0000 7f343a7fc640 1 -- 172.21.15.2:0/1214809124 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f344401e040 con 0x559315ac0670 2024-09-19T04:50:45.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.877+0000 7f343a7fc640 1 -- 172.21.15.2:0/1214809124 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34440186a0 con 0x559315ac0670 2024-09-19T04:50:45.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.878+0000 7f345d1dd740 1 -- 172.21.15.2:0/1214809124 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559315ac0670 msgr2=0x559315ac6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:45.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.878+0000 7f345d1dd740 1 --2- 172.21.15.2:0/1214809124 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559315ac0670 0x559315ac6d10 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x559315abda60 tx=0x7f344400fdc0 comp rx=0 tx=0).stop 2024-09-19T04:50:45.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.878+0000 7f345d1dd740 1 -- 172.21.15.2:0/1214809124 shutdown_connections 2024-09-19T04:50:45.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.878+0000 7f345d1dd740 1 --2- 172.21.15.2:0/1214809124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559315ac0f90 0x559315abbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:45.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.878+0000 7f345d1dd740 1 --2- 172.21.15.2:0/1214809124 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559315ac0670 0x559315ac6d10 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:45.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.878+0000 7f345d1dd740 1 --2- 172.21.15.2:0/1214809124 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559315abcc00 0x559315adba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:45.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.878+0000 7f345d1dd740 1 -- 172.21.15.2:0/1214809124 >> 172.21.15.2:0/1214809124 conn(0x559315ac8ae0 msgr2=0x559315abb500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:45.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.878+0000 7f345d1dd740 1 -- 172.21.15.2:0/1214809124 shutdown_connections 2024-09-19T04:50:45.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.878+0000 7f345d1dd740 1 -- 172.21.15.2:0/1214809124 wait complete. 2024-09-19T04:50:45.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.878+0000 7f345d1dd740 1 -- start start 2024-09-19T04:50:45.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.878+0000 7f345d1dd740 1 Processor -- start 2024-09-19T04:50:45.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.879+0000 7f345d1dd740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559315abcc00 0x559315ad5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:45.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.879+0000 7f345d1dd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559315ac0670 0x559315ad6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:45.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.879+0000 7f345d1dd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559315ac0f90 0x559315ad6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:45.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.879+0000 7f345d1dd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f34541aa050 con 0x559315ac0f90 2024-09-19T04:50:45.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.879+0000 7f345d1dd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f34541ab4c0 con 0x559315ac0670 2024-09-19T04:50:45.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.879+0000 7f345d1dd740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f34541aa720 con 0x559315abcc00 2024-09-19T04:50:45.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.879+0000 7f345d1dd740 10 client.0 _ll_register_callbacks cb 0x7f3448013ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:50:45.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.879+0000 7f3453fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559315ac0f90 0x559315ad6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:45.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.879+0000 7f3453fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559315ac0f90 0x559315ad6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44898/0 (socket says 172.21.15.2:44898) 2024-09-19T04:50:45.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.879+0000 7f3453fff640 1 -- 172.21.15.2:0/1648106652 learned_addr learned my addr 172.21.15.2:0/1648106652 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:45.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.879+0000 7f3453fff640 1 --2- 172.21.15.2:0/1648106652 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559315abcc00 0x559315ad5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:45.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.879+0000 7f3458ba0640 1 --2- 172.21.15.2:0/1648106652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559315ac0670 0x559315ad6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:45.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.879+0000 7f3453fff640 1 -- 172.21.15.2:0/1648106652 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559315abcc00 msgr2=0x559315ad5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:45.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.879+0000 7f3453fff640 1 --2- 172.21.15.2:0/1648106652 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559315abcc00 0x559315ad5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:45.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.879+0000 7f3453fff640 1 -- 172.21.15.2:0/1648106652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559315ac0670 msgr2=0x559315ad6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:45.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.879+0000 7f3453fff640 1 --2- 172.21.15.2:0/1648106652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559315ac0670 0x559315ad6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:45.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.879+0000 7f3453fff640 1 -- 172.21.15.2:0/1648106652 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559315b49610 con 0x559315ac0f90 2024-09-19T04:50:45.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.879+0000 7f3458ba0640 1 --2- 172.21.15.2:0/1648106652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559315ac0670 0x559315ad6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:50:45.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.879+0000 7f3453fff640 1 --2- 172.21.15.2:0/1648106652 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559315ac0f90 0x559315ad6760 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f3448003ed0 tx=0x7f3448015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32253f2a0e1776e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:45.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.879+0000 7f3433fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:50:45.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.879+0000 7f3433fff640 1 -- 172.21.15.2:0/1648106652 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3448013940 con 0x559315ac0f90 2024-09-19T04:50:45.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.880+0000 7f3433fff640 1 -- 172.21.15.2:0/1648106652 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f344801c070 con 0x559315ac0f90 2024-09-19T04:50:45.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.880+0000 7f345d1dd740 1 -- 172.21.15.2:0/1648106652 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f344401e040 con 0x559315ac0f90 2024-09-19T04:50:45.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.880+0000 7f3433fff640 1 -- 172.21.15.2:0/1648106652 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f344803b050 con 0x559315ac0f90 2024-09-19T04:50:45.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.880+0000 7f345d1dd740 10 client.15594 fetch_fsmap learned FSMap version 19 2024-09-19T04:50:45.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.880+0000 7f345d1dd740 1 -- 172.21.15.2:0/1648106652 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x559315b4a920 con 0x559315ac0f90 2024-09-19T04:50:45.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.880+0000 7f3433fff640 1 -- 172.21.15.2:0/1648106652 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f344401e040 con 0x559315ac0f90 2024-09-19T04:50:45.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.880+0000 7f3433fff640 1 -- 172.21.15.2:0/1648106652 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f3448004290 con 0x559315ac0f90 2024-09-19T04:50:45.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.880+0000 7f345d1dd740 10 client.15594 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:50:45.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.880+0000 7f345d1dd740 10 client.15594 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:50:45.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.880+0000 7f345d1dd740 20 client.15594 populate_metadata read hostname 'smithi002' 2024-09-19T04:50:45.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.880+0000 7f345d1dd740 1 --2- 172.21.15.2:0/1648106652 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x559315acb850 0x559315b4cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:45.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.880+0000 7f345d1dd740 4 client.15594 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:50:45.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.880+0000 7f345d1dd740 1 -- 172.21.15.2:0/1648106652 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559315a2dd60 con 0x559315acb850 2024-09-19T04:50:45.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.881+0000 7f3458ba0640 1 --2- 172.21.15.2:0/1648106652 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x559315acb850 0x559315b4cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:45.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.881+0000 7f3458ba0640 1 --2- 172.21.15.2:0/1648106652 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x559315acb850 0x559315b4cf60 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=732ad928b7847f3b server_cookie=abfeb4de8e30e16e in_seq=0 out_seq=0 2024-09-19T04:50:45.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.881+0000 7f3433fff640 10 client.15594 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:50:45.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.881+0000 7f3433fff640 1 -- 172.21.15.2:0/1648106652 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x559315a2dd60 con 0x559315acb850 2024-09-19T04:50:45.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.881+0000 7f3433fff640 10 client.15594 handle_command_reply: tid=0 2024-09-19T04:50:45.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.881+0000 7f345d1dd740 1 client.15594 shutdown 2024-09-19T04:50:45.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.881+0000 7f345d1dd740 1 -- 172.21.15.2:0/1648106652 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559315ac0f90 msgr2=0x559315ad6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:45.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.881+0000 7f345d1dd740 1 --2- 172.21.15.2:0/1648106652 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559315ac0f90 0x559315ad6760 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f3448003ed0 tx=0x7f3448015040 comp rx=0 tx=0).stop 2024-09-19T04:50:45.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.881+0000 7f345d1dd740 1 -- 172.21.15.2:0/1648106652 shutdown_connections 2024-09-19T04:50:45.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.881+0000 7f345d1dd740 1 --2- 172.21.15.2:0/1648106652 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559315ac0f90 0x559315ad6760 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:45.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.881+0000 7f345d1dd740 1 --2- 172.21.15.2:0/1648106652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559315ac0670 0x559315ad6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:45.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.881+0000 7f345d1dd740 1 --2- 172.21.15.2:0/1648106652 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x559315acb850 0x559315b4cf60 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:45.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.881+0000 7f345d1dd740 1 --2- 172.21.15.2:0/1648106652 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559315abcc00 0x559315ad5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:45.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.881+0000 7f345d1dd740 1 -- 172.21.15.2:0/1648106652 >> 172.21.15.2:0/1648106652 conn(0x559315ac8ae0 msgr2=0x559315abb500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:45.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.881+0000 7f3433fff640 0 client.15594 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:50:45.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.882+0000 7f345d1dd740 1 -- 172.21.15.2:0/1648106652 shutdown_connections 2024-09-19T04:50:45.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.882+0000 7f345d1dd740 1 -- 172.21.15.2:0/1648106652 wait complete. 2024-09-19T04:50:45.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.882+0000 7f345d1dd740 20 client.15594 trim_cache size 0 max 16384 2024-09-19T04:50:45.896 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:50:45.896 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T04:50:45.896 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T04:50:45.896 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:50:45.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.882+0000 7f3459ba2640 1 -- 172.21.15.2:0/2620905196 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f343c0a33b0 msgr2=0x7f343c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:45.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.882+0000 7f3459ba2640 1 --2- 172.21.15.2:0/2620905196 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f343c0a33b0 0x7f343c0a5870 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f344c0ee6e0 tx=0x7f344c003f10 comp rx=0 tx=0).stop 2024-09-19T04:50:45.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.882+0000 7f3459ba2640 1 -- 172.21.15.2:0/2620905196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34541068d0 msgr2=0x7f345419ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:45.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.882+0000 7f3459ba2640 1 --2- 172.21.15.2:0/2620905196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34541068d0 0x7f345419ca10 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f344c005cc0 tx=0x7f344c003c20 comp rx=0 tx=0).stop 2024-09-19T04:50:45.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.882+0000 7f3459ba2640 1 -- 172.21.15.2:0/2620905196 shutdown_connections 2024-09-19T04:50:45.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.882+0000 7f3459ba2640 1 --2- 172.21.15.2:0/2620905196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34541068d0 0x7f345419ca10 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:45.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.882+0000 7f3459ba2640 1 --2- 172.21.15.2:0/2620905196 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f343c0a33b0 0x7f343c0a5870 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:45.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.882+0000 7f3459ba2640 1 --2- 172.21.15.2:0/2620905196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3454101270 0x7f3454198680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:45.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.882+0000 7f3459ba2640 1 --2- 172.21.15.2:0/2620905196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34541008d0 0x7f3454198140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:45.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.882+0000 7f3459ba2640 1 -- 172.21.15.2:0/2620905196 >> 172.21.15.2:0/2620905196 conn(0x7f34540fc610 msgr2=0x7f34540fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:45.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.882+0000 7f3459ba2640 1 -- 172.21.15.2:0/2620905196 shutdown_connections 2024-09-19T04:50:45.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:45.882+0000 7f3459ba2640 1 -- 172.21.15.2:0/2620905196 wait complete. 2024-09-19T04:50:46.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:46 smithi002 ceph-mon[30975]: pgmap v86: 97 pgs: 97 active+clean; 2.9 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 29 KiB/s wr, 11 op/s 2024-09-19T04:50:46.648 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:50:46.648 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:50:46.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:46 smithi018 ceph-mon[34537]: pgmap v86: 97 pgs: 97 active+clean; 2.9 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 29 KiB/s wr, 11 op/s 2024-09-19T04:50:46.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:46 smithi116 ceph-mon[34477]: pgmap v86: 97 pgs: 97 active+clean; 2.9 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 29 KiB/s wr, 11 op/s 2024-09-19T04:50:46.906 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:50:47.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.367+0000 7fc644c6c640 1 -- 172.21.15.2:0/3951590269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc640102790 msgr2=0x7fc6401067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:47.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.367+0000 7fc644c6c640 1 --2- 172.21.15.2:0/3951590269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc640102790 0x7fc6401067e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fc634009900 tx=0x7fc63402a410 comp rx=0 tx=0).stop 2024-09-19T04:50:47.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.367+0000 7fc644c6c640 1 -- 172.21.15.2:0/3951590269 shutdown_connections 2024-09-19T04:50:47.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.367+0000 7fc644c6c640 1 --2- 172.21.15.2:0/3951590269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc640106f10 0x7fc64010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:47.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.367+0000 7fc644c6c640 1 --2- 172.21.15.2:0/3951590269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc640102790 0x7fc6401067e0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:47.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.367+0000 7fc644c6c640 1 --2- 172.21.15.2:0/3951590269 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc640101de0 0x7fc6401021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:47.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.367+0000 7fc644c6c640 1 -- 172.21.15.2:0/3951590269 >> 172.21.15.2:0/3951590269 conn(0x7fc6400fd8c0 msgr2=0x7fc6400ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:47.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.367+0000 7fc644c6c640 1 -- 172.21.15.2:0/3951590269 shutdown_connections 2024-09-19T04:50:47.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.367+0000 7fc644c6c640 1 -- 172.21.15.2:0/3951590269 wait complete. 2024-09-19T04:50:47.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.367+0000 7fc644c6c640 1 Processor -- start 2024-09-19T04:50:47.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.367+0000 7fc644c6c640 1 -- start start 2024-09-19T04:50:47.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.368+0000 7fc644c6c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc640101de0 0x7fc640198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:47.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.368+0000 7fc644c6c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc640102790 0x7fc640198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:47.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.368+0000 7fc644c6c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc640106f10 0x7fc64019cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:47.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.368+0000 7fc644c6c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc640111e40 con 0x7fc640106f10 2024-09-19T04:50:47.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.368+0000 7fc644c6c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc640111cc0 con 0x7fc640102790 2024-09-19T04:50:47.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.368+0000 7fc644c6c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fc640111fc0 con 0x7fc640101de0 2024-09-19T04:50:47.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.368+0000 7fc63ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc640106f10 0x7fc64019cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:47.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.368+0000 7fc63ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc640106f10 0x7fc64019cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44910/0 (socket says 172.21.15.2:44910) 2024-09-19T04:50:47.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.368+0000 7fc63ed9d640 1 -- 172.21.15.2:0/790449502 learned_addr learned my addr 172.21.15.2:0/790449502 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:47.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.368+0000 7fc63dd9b640 1 --2- 172.21.15.2:0/790449502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc640102790 0x7fc640198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:47.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.368+0000 7fc63e59c640 1 --2- 172.21.15.2:0/790449502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc640101de0 0x7fc640198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:47.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.368+0000 7fc63ed9d640 1 -- 172.21.15.2:0/790449502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc640101de0 msgr2=0x7fc640198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:47.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.368+0000 7fc63ed9d640 1 --2- 172.21.15.2:0/790449502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc640101de0 0x7fc640198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:47.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.368+0000 7fc63ed9d640 1 -- 172.21.15.2:0/790449502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc640102790 msgr2=0x7fc640198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:47.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.368+0000 7fc63ed9d640 1 --2- 172.21.15.2:0/790449502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc640102790 0x7fc640198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:47.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.368+0000 7fc63ed9d640 1 -- 172.21.15.2:0/790449502 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc64019d3f0 con 0x7fc640106f10 2024-09-19T04:50:47.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.368+0000 7fc63e59c640 1 --2- 172.21.15.2:0/790449502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc640101de0 0x7fc640198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:50:47.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.368+0000 7fc63ed9d640 1 --2- 172.21.15.2:0/790449502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc640106f10 0x7fc64019cd10 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc63800cad0 tx=0x7fc63800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:47.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.369+0000 7fc62f7fe640 1 -- 172.21.15.2:0/790449502 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63800ae20 con 0x7fc640106f10 2024-09-19T04:50:47.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.369+0000 7fc644c6c640 1 -- 172.21.15.2:0/790449502 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc64019d6e0 con 0x7fc640106f10 2024-09-19T04:50:47.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.369+0000 7fc62f7fe640 1 -- 172.21.15.2:0/790449502 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc638005020 con 0x7fc640106f10 2024-09-19T04:50:47.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.369+0000 7fc62f7fe640 1 -- 172.21.15.2:0/790449502 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63800f6b0 con 0x7fc640106f10 2024-09-19T04:50:47.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.369+0000 7fc644c6c640 1 -- 172.21.15.2:0/790449502 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6401a4fc0 con 0x7fc640106f10 2024-09-19T04:50:47.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.370+0000 7fc644c6c640 1 -- 172.21.15.2:0/790449502 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6401021c0 con 0x7fc640106f10 2024-09-19T04:50:47.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.371+0000 7fc62f7fe640 1 -- 172.21.15.2:0/790449502 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fc6380051d0 con 0x7fc640106f10 2024-09-19T04:50:47.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.372+0000 7fc62f7fe640 1 --2- 172.21.15.2:0/790449502 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fc6280a33b0 0x7fc6280a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:47.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.372+0000 7fc63e59c640 1 --2- 172.21.15.2:0/790449502 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fc6280a33b0 0x7fc6280a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:47.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.372+0000 7fc62f7fe640 1 -- 172.21.15.2:0/790449502 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7fc6380d00f0 con 0x7fc640106f10 2024-09-19T04:50:47.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.372+0000 7fc63e59c640 1 --2- 172.21.15.2:0/790449502 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fc6280a33b0 0x7fc6280a5870 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc630006fd0 tx=0x7fc630008040 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:47.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.375+0000 7fc62f7fe640 1 -- 172.21.15.2:0/790449502 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc638014030 con 0x7fc640106f10 2024-09-19T04:50:47.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.590+0000 7fc644c6c640 1 -- 172.21.15.2:0/790449502 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc6401997a0 con 0x7fc640106f10 2024-09-19T04:50:47.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.590+0000 7fc62f7fe640 1 -- 172.21.15.2:0/790449502 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11840 (secure 0 0 0) 0x7fc6401997a0 con 0x7fc640106f10 2024-09-19T04:50:47.592 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:50:47.592 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":19,"btime":"2024-09-19T04:46:33:537239+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2467365137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2467365137},{"type":"v1","addr":"172.21.15.2:6835","nonce":2467365137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3162441888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3162441888},{"type":"v1","addr":"172.21.15.2:6837","nonce":3162441888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14631,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2740862966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2740862966},{"type":"v1","addr":"172.21.15.2:6839","nonce":2740862966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/2394435504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2394435504},{"type":"v1","addr":"172.21.15.2:6841","nonce":2394435504}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1630480244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1630480244},{"type":"v1","addr":"172.21.15.18:6833","nonce":1630480244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1553897465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1553897465},{"type":"v1","addr":"172.21.15.116:6833","nonce":1553897465}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3035664608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3035664608},{"type":"v1","addr":"172.21.15.18:6835","nonce":3035664608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1096622392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1096622392},{"type":"v1","addr":"172.21.15.18:6837","nonce":1096622392}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3761157675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3761157675},{"type":"v1","addr":"172.21.15.116:6835","nonce":3761157675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/1120131594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1120131594},{"type":"v1","addr":"172.21.15.116:6837","nonce":1120131594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:46:24.050115+0000","modified":"2024-09-19T04:46:33.112369+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/4207677139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":4207677139},{"type":"v1","addr":"172.21.15.18:6839","nonce":4207677139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/2346874880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":2346874880},{"type":"v1","addr":"172.21.15.116:6839","nonce":2346874880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496]},"id":1}]} 2024-09-19T04:50:47.592 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 19 2024-09-19T04:50:47.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.592+0000 7fc644c6c640 1 -- 172.21.15.2:0/790449502 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fc6280a33b0 msgr2=0x7fc6280a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:47.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.592+0000 7fc644c6c640 1 --2- 172.21.15.2:0/790449502 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fc6280a33b0 0x7fc6280a5870 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc630006fd0 tx=0x7fc630008040 comp rx=0 tx=0).stop 2024-09-19T04:50:47.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.592+0000 7fc644c6c640 1 -- 172.21.15.2:0/790449502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc640106f10 msgr2=0x7fc64019cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:47.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.592+0000 7fc644c6c640 1 --2- 172.21.15.2:0/790449502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc640106f10 0x7fc64019cd10 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc63800cad0 tx=0x7fc63800cf90 comp rx=0 tx=0).stop 2024-09-19T04:50:47.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.593+0000 7fc644c6c640 1 -- 172.21.15.2:0/790449502 shutdown_connections 2024-09-19T04:50:47.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.593+0000 7fc644c6c640 1 --2- 172.21.15.2:0/790449502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc640106f10 0x7fc64019cd10 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:47.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.593+0000 7fc644c6c640 1 --2- 172.21.15.2:0/790449502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc640102790 0x7fc640198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:47.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.593+0000 7fc644c6c640 1 --2- 172.21.15.2:0/790449502 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fc6280a33b0 0x7fc6280a5870 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:47.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.593+0000 7fc644c6c640 1 --2- 172.21.15.2:0/790449502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc640101de0 0x7fc640198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:47.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.593+0000 7fc644c6c640 1 -- 172.21.15.2:0/790449502 >> 172.21.15.2:0/790449502 conn(0x7fc6400fd8c0 msgr2=0x7fc6400fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:47.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.593+0000 7fc644c6c640 1 -- 172.21.15.2:0/790449502 shutdown_connections 2024-09-19T04:50:47.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:47.593+0000 7fc644c6c640 1 -- 172.21.15.2:0/790449502 wait complete. 2024-09-19T04:50:48.320 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:50:48.579 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:50:48.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:48 smithi002 ceph-mon[30975]: pgmap v87: 97 pgs: 97 active+clean; 2.9 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-09-19T04:50:48.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:48 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/790449502' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:50:48.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:48 smithi018 ceph-mon[34537]: pgmap v87: 97 pgs: 97 active+clean; 2.9 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-09-19T04:50:48.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:48 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/790449502' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:50:48.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:48 smithi116 ceph-mon[34477]: pgmap v87: 97 pgs: 97 active+clean; 2.9 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-09-19T04:50:48.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:48 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/790449502' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:50:48.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.981+0000 7fe66df56640 1 -- 172.21.15.2:0/3136478974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe668101de0 msgr2=0x7fe6681021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:48.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.981+0000 7fe66df56640 1 --2- 172.21.15.2:0/3136478974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe668101de0 0x7fe6681021c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fe650009900 tx=0x7fe65002a410 comp rx=0 tx=0).stop 2024-09-19T04:50:48.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.981+0000 7fe66df56640 1 -- 172.21.15.2:0/3136478974 shutdown_connections 2024-09-19T04:50:48.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.981+0000 7fe66df56640 1 --2- 172.21.15.2:0/3136478974 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe668106f10 0x7fe66810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:48.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.981+0000 7fe66df56640 1 --2- 172.21.15.2:0/3136478974 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe668102790 0x7fe6681067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:48.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.981+0000 7fe66df56640 1 --2- 172.21.15.2:0/3136478974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe668101de0 0x7fe6681021c0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:48.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.981+0000 7fe66df56640 1 -- 172.21.15.2:0/3136478974 >> 172.21.15.2:0/3136478974 conn(0x7fe6680fd8c0 msgr2=0x7fe6680ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:48.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.981+0000 7fe66df56640 1 -- 172.21.15.2:0/3136478974 shutdown_connections 2024-09-19T04:50:48.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.981+0000 7fe66df56640 1 -- 172.21.15.2:0/3136478974 wait complete. 2024-09-19T04:50:48.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.982+0000 7fe66df56640 1 Processor -- start 2024-09-19T04:50:48.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.982+0000 7fe66df56640 1 -- start start 2024-09-19T04:50:48.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.983+0000 7fe66df56640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe668101de0 0x7fe6681982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:48.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.983+0000 7fe66df56640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe668102790 0x7fe6681987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:48.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.983+0000 7fe66df56640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe668106f10 0x7fe66819cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:48.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.983+0000 7fe66df56640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe668111de0 con 0x7fe668101de0 2024-09-19T04:50:48.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.983+0000 7fe66df56640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe668111c60 con 0x7fe668106f10 2024-09-19T04:50:48.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.983+0000 7fe66df56640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fe668111f60 con 0x7fe668102790 2024-09-19T04:50:48.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.983+0000 7fe6677fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe668101de0 0x7fe6681982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:48.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.983+0000 7fe6677fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe668101de0 0x7fe6681982b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44922/0 (socket says 172.21.15.2:44922) 2024-09-19T04:50:48.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.983+0000 7fe6677fe640 1 -- 172.21.15.2:0/2520255276 learned_addr learned my addr 172.21.15.2:0/2520255276 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:48.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.983+0000 7fe667fff640 1 --2- 172.21.15.2:0/2520255276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe668106f10 0x7fe66819cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:48.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.983+0000 7fe666ffd640 1 --2- 172.21.15.2:0/2520255276 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe668102790 0x7fe6681987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:48.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.983+0000 7fe6677fe640 1 -- 172.21.15.2:0/2520255276 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe668102790 msgr2=0x7fe6681987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.983+0000 7fe6677fe640 1 --2- 172.21.15.2:0/2520255276 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe668102790 0x7fe6681987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.983+0000 7fe6677fe640 1 -- 172.21.15.2:0/2520255276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe668106f10 msgr2=0x7fe66819cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.983+0000 7fe6677fe640 1 --2- 172.21.15.2:0/2520255276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe668106f10 0x7fe66819cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.983+0000 7fe6677fe640 1 -- 172.21.15.2:0/2520255276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe66819d260 con 0x7fe668101de0 2024-09-19T04:50:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.983+0000 7fe666ffd640 1 --2- 172.21.15.2:0/2520255276 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe668102790 0x7fe6681987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:50:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.983+0000 7fe6677fe640 1 --2- 172.21.15.2:0/2520255276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe668101de0 0x7fe6681982b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe650006010 tx=0x7fe650004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.984+0000 7fe664ff9640 1 -- 172.21.15.2:0/2520255276 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65003f030 con 0x7fe668101de0 2024-09-19T04:50:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.984+0000 7fe66df56640 1 -- 172.21.15.2:0/2520255276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe66819d4f0 con 0x7fe668101de0 2024-09-19T04:50:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.984+0000 7fe664ff9640 1 -- 172.21.15.2:0/2520255276 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe6500035f0 con 0x7fe668101de0 2024-09-19T04:50:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.984+0000 7fe664ff9640 1 -- 172.21.15.2:0/2520255276 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe650035070 con 0x7fe668101de0 2024-09-19T04:50:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.984+0000 7fe66df56640 1 -- 172.21.15.2:0/2520255276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6681a4e30 con 0x7fe668101de0 2024-09-19T04:50:48.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.986+0000 7fe664ff9640 1 -- 172.21.15.2:0/2520255276 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fe650003b10 con 0x7fe668101de0 2024-09-19T04:50:48.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.986+0000 7fe67032f740 1 Processor -- start 2024-09-19T04:50:48.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.987+0000 7fe67032f740 1 -- start start 2024-09-19T04:50:48.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.987+0000 7fe67032f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641ecc00b40 0x5641ecbff090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:48.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.987+0000 7fe67032f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641ecbff5d0 0x5641ecbffa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:48.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.987+0000 7fe67032f740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5641ecc0a370 0x5641ecc0c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:48.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.987+0000 7fe67032f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5641ecb652f0 con 0x5641ecbff5d0 2024-09-19T04:50:48.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.987+0000 7fe67032f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5641ecb0ccf0 con 0x5641ecc00b40 2024-09-19T04:50:48.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.987+0000 7fe67032f740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5641ecb612b0 con 0x5641ecc0a370 2024-09-19T04:50:48.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.987+0000 7fe6677fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641ecbff5d0 0x5641ecbffa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:48.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.987+0000 7fe664ff9640 1 --2- 172.21.15.2:0/2520255276 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fe6540a3430 0x7fe6540a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:48.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.987+0000 7fe6677fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641ecbff5d0 0x5641ecbffa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44934/0 (socket says 172.21.15.2:44934) 2024-09-19T04:50:48.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.987+0000 7fe6677fe640 1 -- 172.21.15.2:0/2372828697 learned_addr learned my addr 172.21.15.2:0/2372828697 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:48.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.987+0000 7fe667fff640 1 --2- 172.21.15.2:0/2372828697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641ecc00b40 0x5641ecbff090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:48.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.987+0000 7fe666ffd640 1 --2- 172.21.15.2:0/2372828697 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5641ecc0a370 0x5641ecc0c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:48.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.987+0000 7fe667fff640 1 --2- 172.21.15.2:0/2520255276 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fe6540a3430 0x7fe6540a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:48.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.987+0000 7fe664ff9640 1 -- 172.21.15.2:0/2520255276 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7fe6500f0320 con 0x7fe668101de0 2024-09-19T04:50:48.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.987+0000 7fe6677fe640 1 -- 172.21.15.2:0/2372828697 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5641ecc0a370 msgr2=0x5641ecc0c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:48.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.987+0000 7fe6677fe640 1 --2- 172.21.15.2:0/2372828697 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5641ecc0a370 0x5641ecc0c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:48.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.987+0000 7fe6677fe640 1 -- 172.21.15.2:0/2372828697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641ecc00b40 msgr2=0x5641ecbff090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:48.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.987+0000 7fe6677fe640 1 --2- 172.21.15.2:0/2372828697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641ecc00b40 0x5641ecbff090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:48.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.987+0000 7fe6677fe640 1 -- 172.21.15.2:0/2372828697 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641ecaf13a0 con 0x5641ecbff5d0 2024-09-19T04:50:48.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.988+0000 7fe6677fe640 1 --2- 172.21.15.2:0/2372828697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641ecbff5d0 0x5641ecbffa10 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe6500b8a20 tx=0x7fe65002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ca7f80a3c7d7ec5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:48.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.988+0000 7fe65dffb640 1 -- 172.21.15.2:0/2372828697 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe650049030 con 0x5641ecbff5d0 2024-09-19T04:50:48.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.988+0000 7fe667fff640 1 --2- 172.21.15.2:0/2520255276 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fe6540a3430 0x7fe6540a58f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe66000a780 tx=0x7fe66000a4d0 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:48.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.988+0000 7fe65dffb640 1 -- 172.21.15.2:0/2372828697 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe6500ef070 con 0x5641ecbff5d0 2024-09-19T04:50:48.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.988+0000 7fe65dffb640 1 -- 172.21.15.2:0/2372828697 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6500c5270 con 0x5641ecbff5d0 2024-09-19T04:50:48.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.988+0000 7fe67032f740 1 -- 172.21.15.2:0/2372828697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641ecbff5d0 msgr2=0x5641ecbffa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:48.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.988+0000 7fe67032f740 1 --2- 172.21.15.2:0/2372828697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641ecbff5d0 0x5641ecbffa10 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe6500b8a20 tx=0x7fe65002a410 comp rx=0 tx=0).stop 2024-09-19T04:50:48.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.989+0000 7fe67032f740 1 -- 172.21.15.2:0/2372828697 shutdown_connections 2024-09-19T04:50:48.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.989+0000 7fe67032f740 1 --2- 172.21.15.2:0/2372828697 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5641ecc0a370 0x5641ecc0c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:48.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.989+0000 7fe67032f740 1 --2- 172.21.15.2:0/2372828697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641ecbff5d0 0x5641ecbffa10 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:48.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.989+0000 7fe67032f740 1 --2- 172.21.15.2:0/2372828697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641ecc00b40 0x5641ecbff090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:48.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.989+0000 7fe67032f740 1 -- 172.21.15.2:0/2372828697 >> 172.21.15.2:0/2372828697 conn(0x5641ecbc8310 msgr2=0x5641ecbfbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:48.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.989+0000 7fe67032f740 1 -- 172.21.15.2:0/2372828697 shutdown_connections 2024-09-19T04:50:48.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.989+0000 7fe67032f740 1 -- 172.21.15.2:0/2372828697 wait complete. 2024-09-19T04:50:48.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.989+0000 7fe67032f740 1 -- start start 2024-09-19T04:50:48.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.989+0000 7fe67032f740 1 Processor -- start 2024-09-19T04:50:48.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.989+0000 7fe67032f740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5641ecbff5d0 0x5641ecc09dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:48.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.990+0000 7fe67032f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641ecc00b40 0x5641ecc07080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:48.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.990+0000 7fe67032f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641ecc0a370 0x5641ecc07810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:48.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.990+0000 7fe67032f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5641ecb652f0 con 0x5641ecc0a370 2024-09-19T04:50:48.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.990+0000 7fe67032f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5641ecb20060 con 0x5641ecc00b40 2024-09-19T04:50:48.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.990+0000 7fe67032f740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5641ecc0ce30 con 0x5641ecbff5d0 2024-09-19T04:50:48.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.990+0000 7fe67032f740 10 client.0 _ll_register_callbacks cb 0x5641ec8738c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:50:48.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.990+0000 7fe667fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641ecc0a370 0x5641ecc07810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:48.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.990+0000 7fe667fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641ecc0a370 0x5641ecc07810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44946/0 (socket says 172.21.15.2:44946) 2024-09-19T04:50:48.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.990+0000 7fe667fff640 1 -- 172.21.15.2:0/1666932741 learned_addr learned my addr 172.21.15.2:0/1666932741 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:48.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.990+0000 7fe666ffd640 1 --2- 172.21.15.2:0/1666932741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641ecc00b40 0x5641ecc07080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:48.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.990+0000 7fe6677fe640 1 --2- 172.21.15.2:0/1666932741 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5641ecbff5d0 0x5641ecc09dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:48.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.990+0000 7fe667fff640 1 -- 172.21.15.2:0/1666932741 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5641ecbff5d0 msgr2=0x5641ecc09dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:48.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.990+0000 7fe667fff640 1 --2- 172.21.15.2:0/1666932741 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5641ecbff5d0 0x5641ecc09dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:48.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.990+0000 7fe667fff640 1 -- 172.21.15.2:0/1666932741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641ecc00b40 msgr2=0x5641ecc07080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:48.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.990+0000 7fe667fff640 1 --2- 172.21.15.2:0/1666932741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641ecc00b40 0x5641ecc07080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:48.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.990+0000 7fe667fff640 1 -- 172.21.15.2:0/1666932741 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641ec8d63c0 con 0x5641ecc0a370 2024-09-19T04:50:48.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.990+0000 7fe666ffd640 1 --2- 172.21.15.2:0/1666932741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641ecc00b40 0x5641ecc07080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:50:48.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.990+0000 7fe667fff640 1 --2- 172.21.15.2:0/1666932741 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641ecc0a370 0x5641ecc07810 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fe66000f730 tx=0x7fe660004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71609b3ab55d8af3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:48.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.990+0000 7fe646ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:50:48.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.990+0000 7fe646ffd640 1 -- 172.21.15.2:0/1666932741 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe660026070 con 0x5641ecc0a370 2024-09-19T04:50:48.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.990+0000 7fe646ffd640 1 -- 172.21.15.2:0/1666932741 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7fe660004d20 con 0x5641ecc0a370 2024-09-19T04:50:48.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.990+0000 7fe67032f740 1 -- 172.21.15.2:0/1666932741 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6500ef070 con 0x5641ecc0a370 2024-09-19T04:50:48.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.991+0000 7fe646ffd640 1 -- 172.21.15.2:0/1666932741 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe660003970 con 0x5641ecc0a370 2024-09-19T04:50:48.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.991+0000 7fe67032f740 10 client.15612 fetch_fsmap learned FSMap version 19 2024-09-19T04:50:48.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.991+0000 7fe67032f740 1 -- 172.21.15.2:0/1666932741 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5641ecc187d0 con 0x5641ecc0a370 2024-09-19T04:50:48.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.991+0000 7fe646ffd640 1 -- 172.21.15.2:0/1666932741 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe6500ef070 con 0x5641ecc0a370 2024-09-19T04:50:48.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.991+0000 7fe646ffd640 1 -- 172.21.15.2:0/1666932741 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fe6600045d0 con 0x5641ecc0a370 2024-09-19T04:50:48.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.991+0000 7fe67032f740 10 client.15612 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:50:48.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.991+0000 7fe67032f740 10 client.15612 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:50:48.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.991+0000 7fe67032f740 20 client.15612 populate_metadata read hostname 'smithi002' 2024-09-19T04:50:48.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.991+0000 7fe67032f740 1 --2- 172.21.15.2:0/1666932741 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5641ecc19d80 0x5641ecc1c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:48.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.991+0000 7fe67032f740 4 client.15612 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:50:48.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.991+0000 7fe67032f740 1 -- 172.21.15.2:0/1666932741 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5641ecb72860 con 0x5641ecc19d80 2024-09-19T04:50:48.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.991+0000 7fe6677fe640 1 --2- 172.21.15.2:0/1666932741 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5641ecc19d80 0x5641ecc1c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:48.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.992+0000 7fe646ffd640 10 client.15612 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:50:48.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.992+0000 7fe6677fe640 1 --2- 172.21.15.2:0/1666932741 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5641ecc19d80 0x5641ecc1c1b0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a716d8d07d90165a server_cookie=6c4ed80ea75b9708 in_seq=0 out_seq=0 2024-09-19T04:50:48.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.992+0000 7fe646ffd640 1 -- 172.21.15.2:0/1666932741 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5641ecb72860 con 0x5641ecc19d80 2024-09-19T04:50:48.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.992+0000 7fe646ffd640 10 client.15612 handle_command_reply: tid=0 2024-09-19T04:50:48.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.993+0000 7fe67032f740 1 client.15612 shutdown 2024-09-19T04:50:48.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.993+0000 7fe67032f740 1 -- 172.21.15.2:0/1666932741 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641ecc0a370 msgr2=0x5641ecc07810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:48.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.993+0000 7fe67032f740 1 --2- 172.21.15.2:0/1666932741 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641ecc0a370 0x5641ecc07810 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fe66000f730 tx=0x7fe660004a40 comp rx=0 tx=0).stop 2024-09-19T04:50:48.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.993+0000 7fe67032f740 1 -- 172.21.15.2:0/1666932741 shutdown_connections 2024-09-19T04:50:48.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.993+0000 7fe67032f740 1 --2- 172.21.15.2:0/1666932741 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641ecc0a370 0x5641ecc07810 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:49.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.993+0000 7fe67032f740 1 --2- 172.21.15.2:0/1666932741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641ecc00b40 0x5641ecc07080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:49.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.993+0000 7fe67032f740 1 --2- 172.21.15.2:0/1666932741 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5641ecc19d80 0x5641ecc1c1b0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:49.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.993+0000 7fe67032f740 1 --2- 172.21.15.2:0/1666932741 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5641ecbff5d0 0x5641ecc09dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:49.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.993+0000 7fe67032f740 1 -- 172.21.15.2:0/1666932741 >> 172.21.15.2:0/1666932741 conn(0x5641ecbc8310 msgr2=0x5641ecc01930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:49.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.993+0000 7fe646ffd640 0 client.15612 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:50:49.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.993+0000 7fe67032f740 1 -- 172.21.15.2:0/1666932741 shutdown_connections 2024-09-19T04:50:49.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.993+0000 7fe67032f740 1 -- 172.21.15.2:0/1666932741 wait complete. 2024-09-19T04:50:49.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:48.993+0000 7fe67032f740 20 client.15612 trim_cache size 0 max 16384 2024-09-19T04:50:49.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.006+0000 7fe67032f740 1 Processor -- start 2024-09-19T04:50:49.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.006+0000 7fe67032f740 1 -- start start 2024-09-19T04:50:49.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.006+0000 7fe67032f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641ecbff5d0 0x5641ecbfbe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:49.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.006+0000 7fe67032f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641ecc00b40 0x5641ecc21ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:49.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.006+0000 7fe67032f740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5641ecc0a370 0x5641ecc22000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:49.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.006+0000 7fe67032f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe6681a94d0 con 0x5641ecc00b40 2024-09-19T04:50:49.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.006+0000 7fe67032f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe6681abd50 con 0x5641ecbff5d0 2024-09-19T04:50:49.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.006+0000 7fe67032f740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fe6681a9b40 con 0x5641ecc0a370 2024-09-19T04:50:49.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.006+0000 7fe666ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641ecc00b40 0x5641ecc21ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:49.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.006+0000 7fe666ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641ecc00b40 0x5641ecc21ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44954/0 (socket says 172.21.15.2:44954) 2024-09-19T04:50:49.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.006+0000 7fe666ffd640 1 -- 172.21.15.2:0/1088076375 learned_addr learned my addr 172.21.15.2:0/1088076375 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:49.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.007+0000 7fe6677fe640 1 --2- 172.21.15.2:0/1088076375 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641ecbff5d0 0x5641ecbfbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:49.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.007+0000 7fe667fff640 1 --2- 172.21.15.2:0/1088076375 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5641ecc0a370 0x5641ecc22000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:49.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.007+0000 7fe666ffd640 1 -- 172.21.15.2:0/1088076375 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5641ecc0a370 msgr2=0x5641ecc22000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:49.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.007+0000 7fe666ffd640 1 --2- 172.21.15.2:0/1088076375 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5641ecc0a370 0x5641ecc22000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:49.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.007+0000 7fe666ffd640 1 -- 172.21.15.2:0/1088076375 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641ecbff5d0 msgr2=0x5641ecbfbe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:49.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.007+0000 7fe666ffd640 1 --2- 172.21.15.2:0/1088076375 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641ecbff5d0 0x5641ecbfbe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:49.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.007+0000 7fe666ffd640 1 -- 172.21.15.2:0/1088076375 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641ecc02120 con 0x5641ecc00b40 2024-09-19T04:50:49.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.007+0000 7fe667fff640 1 --2- 172.21.15.2:0/1088076375 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5641ecc0a370 0x5641ecc22000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:50:49.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.007+0000 7fe666ffd640 1 --2- 172.21.15.2:0/1088076375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641ecc00b40 0x5641ecc21ac0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fe65800f360 tx=0x7fe65801ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99888ceac19765f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:49.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.007+0000 7fe65d7fa640 1 -- 172.21.15.2:0/1088076375 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65800f510 con 0x5641ecc00b40 2024-09-19T04:50:49.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.007+0000 7fe65d7fa640 1 -- 172.21.15.2:0/1088076375 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe65800ce40 con 0x5641ecc00b40 2024-09-19T04:50:49.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.007+0000 7fe65d7fa640 1 -- 172.21.15.2:0/1088076375 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65800d400 con 0x5641ecc00b40 2024-09-19T04:50:49.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.008+0000 7fe67032f740 1 -- 172.21.15.2:0/1088076375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641ecc00b40 msgr2=0x5641ecc21ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:49.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.008+0000 7fe67032f740 1 --2- 172.21.15.2:0/1088076375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641ecc00b40 0x5641ecc21ac0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fe65800f360 tx=0x7fe65801ac40 comp rx=0 tx=0).stop 2024-09-19T04:50:49.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.008+0000 7fe67032f740 1 -- 172.21.15.2:0/1088076375 shutdown_connections 2024-09-19T04:50:49.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.008+0000 7fe67032f740 1 --2- 172.21.15.2:0/1088076375 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5641ecc0a370 0x5641ecc22000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:49.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.008+0000 7fe67032f740 1 --2- 172.21.15.2:0/1088076375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641ecc00b40 0x5641ecc21ac0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:49.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.008+0000 7fe67032f740 1 --2- 172.21.15.2:0/1088076375 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641ecbff5d0 0x5641ecbfbe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:49.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.008+0000 7fe67032f740 1 -- 172.21.15.2:0/1088076375 >> 172.21.15.2:0/1088076375 conn(0x5641ecbc8310 msgr2=0x5641ecbfb700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:49.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.008+0000 7fe67032f740 1 -- 172.21.15.2:0/1088076375 shutdown_connections 2024-09-19T04:50:49.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.008+0000 7fe67032f740 1 -- 172.21.15.2:0/1088076375 wait complete. 2024-09-19T04:50:49.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.008+0000 7fe67032f740 1 -- start start 2024-09-19T04:50:49.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.008+0000 7fe67032f740 1 Processor -- start 2024-09-19T04:50:49.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.009+0000 7fe67032f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641ecbff5d0 0x5641ecc120c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:49.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.009+0000 7fe67032f740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5641ecc00b40 0x5641ecc12600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:49.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.009+0000 7fe67032f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641ecc0a370 0x5641ecc036b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:49.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.009+0000 7fe67032f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe6681aa210 con 0x5641ecc0a370 2024-09-19T04:50:49.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.009+0000 7fe67032f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe6681ab680 con 0x5641ecbff5d0 2024-09-19T04:50:49.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.009+0000 7fe67032f740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fe6681aa8e0 con 0x5641ecc00b40 2024-09-19T04:50:49.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.009+0000 7fe67032f740 10 client.0 _ll_register_callbacks cb 0x7fe660014790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:50:49.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.009+0000 7fe667fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641ecc0a370 0x5641ecc036b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:49.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.009+0000 7fe667fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641ecc0a370 0x5641ecc036b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44968/0 (socket says 172.21.15.2:44968) 2024-09-19T04:50:49.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.009+0000 7fe667fff640 1 -- 172.21.15.2:0/748667731 learned_addr learned my addr 172.21.15.2:0/748667731 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:49.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.009+0000 7fe666ffd640 1 --2- 172.21.15.2:0/748667731 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5641ecc00b40 0x5641ecc12600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:49.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.009+0000 7fe6677fe640 1 --2- 172.21.15.2:0/748667731 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641ecbff5d0 0x5641ecc120c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:49.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.009+0000 7fe667fff640 1 -- 172.21.15.2:0/748667731 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5641ecc00b40 msgr2=0x5641ecc12600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:49.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.009+0000 7fe667fff640 1 --2- 172.21.15.2:0/748667731 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5641ecc00b40 0x5641ecc12600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:49.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.009+0000 7fe667fff640 1 -- 172.21.15.2:0/748667731 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641ecbff5d0 msgr2=0x5641ecc120c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:49.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.009+0000 7fe667fff640 1 --2- 172.21.15.2:0/748667731 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641ecbff5d0 0x5641ecc120c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:49.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.009+0000 7fe667fff640 1 -- 172.21.15.2:0/748667731 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641ecc03c20 con 0x5641ecc0a370 2024-09-19T04:50:49.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.009+0000 7fe667fff640 1 --2- 172.21.15.2:0/748667731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641ecc0a370 0x5641ecc036b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fe660016040 tx=0x7fe660020870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fec6decf698d260 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:49.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.009+0000 7fe646ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:50:49.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.009+0000 7fe646ffd640 1 -- 172.21.15.2:0/748667731 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe660038020 con 0x5641ecc0a370 2024-09-19T04:50:49.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.010+0000 7fe646ffd640 1 -- 172.21.15.2:0/748667731 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7fe660034660 con 0x5641ecc0a370 2024-09-19T04:50:49.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.010+0000 7fe67032f740 1 -- 172.21.15.2:0/748667731 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5641ecb6cd70 con 0x5641ecc0a370 2024-09-19T04:50:49.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.010+0000 7fe646ffd640 1 -- 172.21.15.2:0/748667731 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe660043050 con 0x5641ecc0a370 2024-09-19T04:50:49.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.010+0000 7fe67032f740 10 client.15618 fetch_fsmap learned FSMap version 19 2024-09-19T04:50:49.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.010+0000 7fe67032f740 1 -- 172.21.15.2:0/748667731 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5641ecc84260 con 0x5641ecc0a370 2024-09-19T04:50:49.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.010+0000 7fe646ffd640 1 -- 172.21.15.2:0/748667731 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x5641ecb6cd70 con 0x5641ecc0a370 2024-09-19T04:50:49.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.010+0000 7fe646ffd640 1 -- 172.21.15.2:0/748667731 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fe66002a800 con 0x5641ecc0a370 2024-09-19T04:50:49.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.010+0000 7fe67032f740 10 client.15618 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:50:49.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.010+0000 7fe67032f740 10 client.15618 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:50:49.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.010+0000 7fe67032f740 20 client.15618 populate_metadata read hostname 'smithi002' 2024-09-19T04:50:49.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.010+0000 7fe67032f740 1 --2- 172.21.15.2:0/748667731 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5641ecc849a0 0x5641ecc86dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:49.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.010+0000 7fe67032f740 4 client.15618 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:50:49.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.010+0000 7fe67032f740 1 -- 172.21.15.2:0/748667731 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5641ecae9170 con 0x5641ecc849a0 2024-09-19T04:50:49.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.010+0000 7fe6677fe640 1 --2- 172.21.15.2:0/748667731 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5641ecc849a0 0x5641ecc86dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:49.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.011+0000 7fe6677fe640 1 --2- 172.21.15.2:0/748667731 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5641ecc849a0 0x5641ecc86dc0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0cf70eaa2c25c05 server_cookie=6dfe1f6d558bd739 in_seq=0 out_seq=0 2024-09-19T04:50:49.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.011+0000 7fe646ffd640 10 client.15618 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:50:49.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.011+0000 7fe646ffd640 1 -- 172.21.15.2:0/748667731 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5641ecae9170 con 0x5641ecc849a0 2024-09-19T04:50:49.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.011+0000 7fe646ffd640 10 client.15618 handle_command_reply: tid=0 2024-09-19T04:50:49.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.011+0000 7fe67032f740 1 client.15618 shutdown 2024-09-19T04:50:49.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.011+0000 7fe67032f740 1 -- 172.21.15.2:0/748667731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641ecc0a370 msgr2=0x5641ecc036b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:49.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.011+0000 7fe67032f740 1 --2- 172.21.15.2:0/748667731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641ecc0a370 0x5641ecc036b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fe660016040 tx=0x7fe660020870 comp rx=0 tx=0).stop 2024-09-19T04:50:49.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.011+0000 7fe67032f740 1 -- 172.21.15.2:0/748667731 shutdown_connections 2024-09-19T04:50:49.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.011+0000 7fe67032f740 1 --2- 172.21.15.2:0/748667731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641ecc0a370 0x5641ecc036b0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:49.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.011+0000 7fe67032f740 1 --2- 172.21.15.2:0/748667731 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5641ecc849a0 0x5641ecc86dc0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:49.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.011+0000 7fe646ffd640 0 client.15618 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:50:49.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.011+0000 7fe67032f740 1 --2- 172.21.15.2:0/748667731 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5641ecc00b40 0x5641ecc12600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:49.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.011+0000 7fe67032f740 1 --2- 172.21.15.2:0/748667731 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641ecbff5d0 0x5641ecc120c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:49.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.011+0000 7fe67032f740 1 -- 172.21.15.2:0/748667731 >> 172.21.15.2:0/748667731 conn(0x5641ecbc8310 msgr2=0x5641ecc05950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:49.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.011+0000 7fe67032f740 1 -- 172.21.15.2:0/748667731 shutdown_connections 2024-09-19T04:50:49.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.011+0000 7fe67032f740 1 -- 172.21.15.2:0/748667731 wait complete. 2024-09-19T04:50:49.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.011+0000 7fe67032f740 20 client.15618 trim_cache size 0 max 16384 2024-09-19T04:50:49.019 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T04:50:49.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.012+0000 7fe66df56640 1 -- 172.21.15.2:0/2520255276 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fe6540a3430 msgr2=0x7fe6540a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:49.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.012+0000 7fe66df56640 1 --2- 172.21.15.2:0/2520255276 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fe6540a3430 0x7fe6540a58f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe66000a780 tx=0x7fe66000a4d0 comp rx=0 tx=0).stop 2024-09-19T04:50:49.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.012+0000 7fe66df56640 1 -- 172.21.15.2:0/2520255276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe668101de0 msgr2=0x7fe6681982b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:49.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.012+0000 7fe66df56640 1 --2- 172.21.15.2:0/2520255276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe668101de0 0x7fe6681982b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe650006010 tx=0x7fe650004270 comp rx=0 tx=0).stop 2024-09-19T04:50:49.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.012+0000 7fe66df56640 1 -- 172.21.15.2:0/2520255276 shutdown_connections 2024-09-19T04:50:49.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.012+0000 7fe66df56640 1 --2- 172.21.15.2:0/2520255276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe668106f10 0x7fe66819cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:49.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.012+0000 7fe66df56640 1 --2- 172.21.15.2:0/2520255276 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fe6540a3430 0x7fe6540a58f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:49.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.012+0000 7fe66df56640 1 --2- 172.21.15.2:0/2520255276 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe668102790 0x7fe6681987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:49.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.012+0000 7fe66df56640 1 --2- 172.21.15.2:0/2520255276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe668101de0 0x7fe6681982b0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:49.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.012+0000 7fe66df56640 1 -- 172.21.15.2:0/2520255276 >> 172.21.15.2:0/2520255276 conn(0x7fe6680fd8c0 msgr2=0x7fe6680fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:49.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.012+0000 7fe66df56640 1 -- 172.21.15.2:0/2520255276 shutdown_connections 2024-09-19T04:50:49.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:49.012+0000 7fe66df56640 1 -- 172.21.15.2:0/2520255276 wait complete. 2024-09-19T04:50:50.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:50 smithi018 ceph-mon[34537]: pgmap v88: 97 pgs: 97 active+clean; 2.9 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-09-19T04:50:50.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:50 smithi002 ceph-mon[30975]: pgmap v88: 97 pgs: 97 active+clean; 2.9 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-09-19T04:50:50.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:50 smithi116 ceph-mon[34477]: pgmap v88: 97 pgs: 97 active+clean; 2.9 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-09-19T04:50:50.862 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:50:50.862 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:50:51.133 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:50:51.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.595+0000 7f561f16c640 1 -- 172.21.15.2:0/3067747116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5618102790 msgr2=0x7f56181067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:51.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.595+0000 7f561f16c640 1 --2- 172.21.15.2:0/3067747116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5618102790 0x7f56181067e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f560c009900 tx=0x7f560c02a410 comp rx=0 tx=0).stop 2024-09-19T04:50:51.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.595+0000 7f561f16c640 1 -- 172.21.15.2:0/3067747116 shutdown_connections 2024-09-19T04:50:51.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.595+0000 7f561f16c640 1 --2- 172.21.15.2:0/3067747116 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5618106f10 0x7f561810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:51.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.595+0000 7f561f16c640 1 --2- 172.21.15.2:0/3067747116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5618102790 0x7f56181067e0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:51.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.595+0000 7f561f16c640 1 --2- 172.21.15.2:0/3067747116 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5618101de0 0x7f56181021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:51.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.595+0000 7f561f16c640 1 -- 172.21.15.2:0/3067747116 >> 172.21.15.2:0/3067747116 conn(0x7f56180fd8c0 msgr2=0x7f56180ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:51.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.596+0000 7f561f16c640 1 -- 172.21.15.2:0/3067747116 shutdown_connections 2024-09-19T04:50:51.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.596+0000 7f561f16c640 1 -- 172.21.15.2:0/3067747116 wait complete. 2024-09-19T04:50:51.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.596+0000 7f561f16c640 1 Processor -- start 2024-09-19T04:50:51.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.596+0000 7f561f16c640 1 -- start start 2024-09-19T04:50:51.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.596+0000 7f561f16c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5618101de0 0x7f56180744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:51.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.596+0000 7f561f16c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5618102790 0x7f5618074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:51.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.596+0000 7f561f16c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5618106f10 0x7f5618074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:51.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.596+0000 7f561f16c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5618111de0 con 0x7f5618101de0 2024-09-19T04:50:51.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.596+0000 7f561f16c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5618111c60 con 0x7f5618106f10 2024-09-19T04:50:51.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.596+0000 7f561f16c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f5618111f60 con 0x7f5618102790 2024-09-19T04:50:51.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.597+0000 7f561cf08640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5618101de0 0x7f56180744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:51.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.597+0000 7f561cf08640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5618101de0 0x7f56180744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60346/0 (socket says 172.21.15.2:60346) 2024-09-19T04:50:51.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.597+0000 7f561cf08640 1 -- 172.21.15.2:0/4024096617 learned_addr learned my addr 172.21.15.2:0/4024096617 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:51.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.597+0000 7f561d709640 1 --2- 172.21.15.2:0/4024096617 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5618106f10 0x7f5618074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:51.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.597+0000 7f5617fff640 1 --2- 172.21.15.2:0/4024096617 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5618102790 0x7f5618074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:51.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.597+0000 7f561cf08640 1 -- 172.21.15.2:0/4024096617 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5618102790 msgr2=0x7f5618074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:51.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.597+0000 7f561cf08640 1 --2- 172.21.15.2:0/4024096617 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5618102790 0x7f5618074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:51.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.597+0000 7f561cf08640 1 -- 172.21.15.2:0/4024096617 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5618106f10 msgr2=0x7f5618074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:51.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.597+0000 7f561cf08640 1 --2- 172.21.15.2:0/4024096617 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5618106f10 0x7f5618074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:51.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.597+0000 7f561cf08640 1 -- 172.21.15.2:0/4024096617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56181a67a0 con 0x7f5618101de0 2024-09-19T04:50:51.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.597+0000 7f561cf08640 1 --2- 172.21.15.2:0/4024096617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5618101de0 0x7f56180744f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f560800c920 tx=0x7f560800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:51.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.597+0000 7f5615ffb640 1 -- 172.21.15.2:0/4024096617 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5608007c70 con 0x7f5618101de0 2024-09-19T04:50:51.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.597+0000 7f5615ffb640 1 -- 172.21.15.2:0/4024096617 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5608007e10 con 0x7f5618101de0 2024-09-19T04:50:51.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.597+0000 7f561f16c640 1 -- 172.21.15.2:0/4024096617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56181a6a90 con 0x7f5618101de0 2024-09-19T04:50:51.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.597+0000 7f5615ffb640 1 -- 172.21.15.2:0/4024096617 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5608018820 con 0x7f5618101de0 2024-09-19T04:50:51.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.598+0000 7f561f16c640 1 -- 172.21.15.2:0/4024096617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56181a6ff0 con 0x7f5618101de0 2024-09-19T04:50:51.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.600+0000 7f5615ffb640 1 -- 172.21.15.2:0/4024096617 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f56080189c0 con 0x7f5618101de0 2024-09-19T04:50:51.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.600+0000 7f5621545740 1 Processor -- start 2024-09-19T04:50:51.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.600+0000 7f5621545740 1 -- start start 2024-09-19T04:50:51.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.600+0000 7f5621545740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5641c7c3cb60 0x5641c7c3cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:51.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.600+0000 7f5621545740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641c7c3d480 0x5641c7c47800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:51.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.600+0000 7f5615ffb640 1 --2- 172.21.15.2:0/4024096617 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f56000a3430 0x7f56000a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:51.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.601+0000 7f5621545740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641c7c47d40 0x5641c7c4a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:51.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.601+0000 7f5621545740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5641c7ba2280 con 0x5641c7c47d40 2024-09-19T04:50:51.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.601+0000 7f5621545740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5641c7b49b10 con 0x5641c7c3d480 2024-09-19T04:50:51.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.601+0000 7f5621545740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5641c7b9e240 con 0x5641c7c3cb60 2024-09-19T04:50:51.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.601+0000 7f561d709640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641c7c47d40 0x5641c7c4a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:51.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.601+0000 7f561d709640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641c7c47d40 0x5641c7c4a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60356/0 (socket says 172.21.15.2:60356) 2024-09-19T04:50:51.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.601+0000 7f561d709640 1 -- 172.21.15.2:0/3841312698 learned_addr learned my addr 172.21.15.2:0/3841312698 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:51.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.601+0000 7f5617fff640 1 --2- 172.21.15.2:0/4024096617 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f56000a3430 0x7f56000a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:51.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.601+0000 7f5615ffb640 1 -- 172.21.15.2:0/4024096617 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f56080cfe80 con 0x7f5618101de0 2024-09-19T04:50:51.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.601+0000 7f561cf08640 1 --2- 172.21.15.2:0/3841312698 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641c7c3d480 0x5641c7c47800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:51.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.601+0000 7f561d709640 1 --2- 172.21.15.2:0/3841312698 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5641c7c3cb60 0x5641c7c3cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:51.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.601+0000 7f561d709640 1 -- 172.21.15.2:0/3841312698 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5641c7c3cb60 msgr2=0x5641c7c3cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:51.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.601+0000 7f561d709640 1 --2- 172.21.15.2:0/3841312698 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5641c7c3cb60 0x5641c7c3cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:51.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.601+0000 7f561d709640 1 -- 172.21.15.2:0/3841312698 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641c7c3d480 msgr2=0x5641c7c47800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:51.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.601+0000 7f561d709640 1 --2- 172.21.15.2:0/3841312698 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641c7c3d480 0x5641c7c47800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:51.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.601+0000 7f561d709640 1 -- 172.21.15.2:0/3841312698 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641c7b561f0 con 0x5641c7c47d40 2024-09-19T04:50:51.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.601+0000 7f561cf08640 1 --2- 172.21.15.2:0/3841312698 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641c7c3d480 0x5641c7c47800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:50:51.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.601+0000 7f5617fff640 1 --2- 172.21.15.2:0/4024096617 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f56000a3430 0x7f56000a58f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f560c031440 tx=0x7f560c0095f0 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:51.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.601+0000 7f561d709640 1 --2- 172.21.15.2:0/3841312698 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641c7c47d40 0x5641c7c4a130 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f5610012af0 tx=0x7f5610007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fad7216e98521cb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:51.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.602+0000 7f55feffd640 1 -- 172.21.15.2:0/3841312698 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5610004d20 con 0x5641c7c47d40 2024-09-19T04:50:51.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.602+0000 7f55feffd640 1 -- 172.21.15.2:0/3841312698 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5610003970 con 0x5641c7c47d40 2024-09-19T04:50:51.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.602+0000 7f55feffd640 1 -- 172.21.15.2:0/3841312698 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5610004290 con 0x5641c7c47d40 2024-09-19T04:50:51.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.602+0000 7f5621545740 1 -- 172.21.15.2:0/3841312698 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641c7c47d40 msgr2=0x5641c7c4a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:51.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.602+0000 7f5621545740 1 --2- 172.21.15.2:0/3841312698 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641c7c47d40 0x5641c7c4a130 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f5610012af0 tx=0x7f5610007800 comp rx=0 tx=0).stop 2024-09-19T04:50:51.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.602+0000 7f5621545740 1 -- 172.21.15.2:0/3841312698 shutdown_connections 2024-09-19T04:50:51.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.602+0000 7f5621545740 1 --2- 172.21.15.2:0/3841312698 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641c7c47d40 0x5641c7c4a130 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:51.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.602+0000 7f5621545740 1 --2- 172.21.15.2:0/3841312698 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641c7c3d480 0x5641c7c47800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:51.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.602+0000 7f5621545740 1 --2- 172.21.15.2:0/3841312698 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5641c7c3cb60 0x5641c7c3cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:51.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.602+0000 7f5621545740 1 -- 172.21.15.2:0/3841312698 >> 172.21.15.2:0/3841312698 conn(0x5641c7c390f0 msgr2=0x5641c7c394d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:51.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.602+0000 7f5621545740 1 -- 172.21.15.2:0/3841312698 shutdown_connections 2024-09-19T04:50:51.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.602+0000 7f5621545740 1 -- 172.21.15.2:0/3841312698 wait complete. 2024-09-19T04:50:51.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.603+0000 7f5621545740 1 -- start start 2024-09-19T04:50:51.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.603+0000 7f5621545740 1 Processor -- start 2024-09-19T04:50:51.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.603+0000 7f5621545740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641c7c3cb60 0x5641c7c44c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:51.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.603+0000 7f5621545740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5641c7c3d480 0x5641c7c45180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:51.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.603+0000 7f5621545740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641c7c47d40 0x5641c7c456c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:51.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.603+0000 7f5621545740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5641c7c4a910 con 0x5641c7c3cb60 2024-09-19T04:50:51.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.603+0000 7f5621545740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5641c7b5cf10 con 0x5641c7c47d40 2024-09-19T04:50:51.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.603+0000 7f5621545740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5641c7c4aa90 con 0x5641c7c3d480 2024-09-19T04:50:51.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.603+0000 7f5621545740 10 client.0 _ll_register_callbacks cb 0x5641c7b25a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:50:51.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.603+0000 7f561cf08640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641c7c3cb60 0x5641c7c44c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:51.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.604+0000 7f561cf08640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641c7c3cb60 0x5641c7c44c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60368/0 (socket says 172.21.15.2:60368) 2024-09-19T04:50:51.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.604+0000 7f561cf08640 1 -- 172.21.15.2:0/1577277810 learned_addr learned my addr 172.21.15.2:0/1577277810 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:51.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.604+0000 7f561d709640 1 --2- 172.21.15.2:0/1577277810 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641c7c47d40 0x5641c7c456c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:51.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.604+0000 7f5617fff640 1 --2- 172.21.15.2:0/1577277810 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5641c7c3d480 0x5641c7c45180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:51.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.604+0000 7f561cf08640 1 -- 172.21.15.2:0/1577277810 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5641c7c3d480 msgr2=0x5641c7c45180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:51.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.604+0000 7f561cf08640 1 --2- 172.21.15.2:0/1577277810 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5641c7c3d480 0x5641c7c45180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:51.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.604+0000 7f561cf08640 1 -- 172.21.15.2:0/1577277810 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641c7c47d40 msgr2=0x5641c7c456c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:51.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.604+0000 7f561cf08640 1 --2- 172.21.15.2:0/1577277810 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641c7c47d40 0x5641c7c456c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:51.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.604+0000 7f561cf08640 1 -- 172.21.15.2:0/1577277810 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641c79136a0 con 0x5641c7c3cb60 2024-09-19T04:50:51.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.604+0000 7f561d709640 1 --2- 172.21.15.2:0/1577277810 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641c7c47d40 0x5641c7c456c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:50:51.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.604+0000 7f561cf08640 1 --2- 172.21.15.2:0/1577277810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641c7c3cb60 0x5641c7c44c40 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f56080985e0 tx=0x7f560809bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5855f4a9050c950f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:51.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.604+0000 7f55f7fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:50:51.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.604+0000 7f55f7fff640 1 -- 172.21.15.2:0/1577277810 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5608018cb0 con 0x5641c7c3cb60 2024-09-19T04:50:51.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.604+0000 7f55f7fff640 1 -- 172.21.15.2:0/1577277810 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f56080a0170 con 0x5641c7c3cb60 2024-09-19T04:50:51.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.604+0000 7f5621545740 1 -- 172.21.15.2:0/1577277810 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5610003970 con 0x5641c7c3cb60 2024-09-19T04:50:51.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.604+0000 7f55f7fff640 1 -- 172.21.15.2:0/1577277810 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f560800fb00 con 0x5641c7c3cb60 2024-09-19T04:50:51.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.604+0000 7f5621545740 10 client.15630 fetch_fsmap learned FSMap version 19 2024-09-19T04:50:51.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.604+0000 7f5621545740 1 -- 172.21.15.2:0/1577277810 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5641c7c565a0 con 0x5641c7c3cb60 2024-09-19T04:50:51.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.605+0000 7f55f7fff640 1 -- 172.21.15.2:0/1577277810 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5610003970 con 0x5641c7c3cb60 2024-09-19T04:50:51.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.605+0000 7f55f7fff640 1 -- 172.21.15.2:0/1577277810 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f56080bc0b0 con 0x5641c7c3cb60 2024-09-19T04:50:51.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.605+0000 7f5621545740 10 client.15630 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:50:51.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.605+0000 7f5621545740 10 client.15630 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:50:51.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.605+0000 7f5621545740 20 client.15630 populate_metadata read hostname 'smithi002' 2024-09-19T04:50:51.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.605+0000 7f5621545740 1 --2- 172.21.15.2:0/1577277810 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5641c7c579b0 0x5641c7c59dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:51.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.605+0000 7f5621545740 4 client.15630 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:50:51.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.605+0000 7f5621545740 1 -- 172.21.15.2:0/1577277810 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5641c7baf7f0 con 0x5641c7c579b0 2024-09-19T04:50:51.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.605+0000 7f5617fff640 1 --2- 172.21.15.2:0/1577277810 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5641c7c579b0 0x5641c7c59dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:51.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.606+0000 7f5617fff640 1 --2- 172.21.15.2:0/1577277810 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5641c7c579b0 0x5641c7c59dc0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5b6703be22deced server_cookie=28ec08cc9cbd263 in_seq=0 out_seq=0 2024-09-19T04:50:51.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.606+0000 7f55f7fff640 10 client.15630 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:50:51.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.606+0000 7f55f7fff640 1 -- 172.21.15.2:0/1577277810 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5641c7baf7f0 con 0x5641c7c579b0 2024-09-19T04:50:51.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.606+0000 7f55f7fff640 10 client.15630 handle_command_reply: tid=0 2024-09-19T04:50:51.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.606+0000 7f5621545740 1 client.15630 shutdown 2024-09-19T04:50:51.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.606+0000 7f5621545740 1 -- 172.21.15.2:0/1577277810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641c7c3cb60 msgr2=0x5641c7c44c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:51.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.606+0000 7f5621545740 1 --2- 172.21.15.2:0/1577277810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641c7c3cb60 0x5641c7c44c40 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f56080985e0 tx=0x7f560809bdf0 comp rx=0 tx=0).stop 2024-09-19T04:50:51.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.607+0000 7f5621545740 1 -- 172.21.15.2:0/1577277810 shutdown_connections 2024-09-19T04:50:51.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.607+0000 7f5621545740 1 --2- 172.21.15.2:0/1577277810 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641c7c47d40 0x5641c7c456c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:51.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.607+0000 7f5621545740 1 --2- 172.21.15.2:0/1577277810 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5641c7c579b0 0x5641c7c59dc0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:51.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.607+0000 7f5621545740 1 --2- 172.21.15.2:0/1577277810 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5641c7c3d480 0x5641c7c45180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:51.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.607+0000 7f5621545740 1 --2- 172.21.15.2:0/1577277810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641c7c3cb60 0x5641c7c44c40 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:51.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.607+0000 7f5621545740 1 -- 172.21.15.2:0/1577277810 >> 172.21.15.2:0/1577277810 conn(0x5641c7c390f0 msgr2=0x5641c7c3edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:51.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.607+0000 7f55f7fff640 0 client.15630 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:50:51.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.607+0000 7f5621545740 1 -- 172.21.15.2:0/1577277810 shutdown_connections 2024-09-19T04:50:51.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.607+0000 7f5621545740 1 -- 172.21.15.2:0/1577277810 wait complete. 2024-09-19T04:50:51.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.607+0000 7f5621545740 20 client.15630 trim_cache size 0 max 16384 2024-09-19T04:50:51.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.624+0000 7f5621545740 1 Processor -- start 2024-09-19T04:50:51.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.624+0000 7f5621545740 1 -- start start 2024-09-19T04:50:51.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.624+0000 7f5621545740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641c7c3cb60 0x5641c7c5f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:51.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.624+0000 7f5621545740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5641c7c3d480 0x5641c7c5fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:51.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.624+0000 7f5621545740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641c7c47d40 0x5641c7c41ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:51.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.624+0000 7f5621545740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f56181ad7c0 con 0x5641c7c3cb60 2024-09-19T04:50:51.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.624+0000 7f5621545740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f56181b0020 con 0x5641c7c47d40 2024-09-19T04:50:51.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.624+0000 7f5621545740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f56181ade10 con 0x5641c7c3d480 2024-09-19T04:50:51.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.625+0000 7f561cf08640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641c7c3cb60 0x5641c7c5f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:51.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.625+0000 7f561cf08640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641c7c3cb60 0x5641c7c5f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60382/0 (socket says 172.21.15.2:60382) 2024-09-19T04:50:51.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.625+0000 7f561cf08640 1 -- 172.21.15.2:0/606652261 learned_addr learned my addr 172.21.15.2:0/606652261 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:51.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.625+0000 7f5617fff640 1 --2- 172.21.15.2:0/606652261 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5641c7c3d480 0x5641c7c5fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:51.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.625+0000 7f561cf08640 1 -- 172.21.15.2:0/606652261 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5641c7c3d480 msgr2=0x5641c7c5fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:51.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.625+0000 7f561cf08640 1 --2- 172.21.15.2:0/606652261 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5641c7c3d480 0x5641c7c5fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:51.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.625+0000 7f561cf08640 1 -- 172.21.15.2:0/606652261 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641c7c47d40 msgr2=0x5641c7c41ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:51.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.625+0000 7f561cf08640 1 --2- 172.21.15.2:0/606652261 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641c7c47d40 0x5641c7c41ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:51.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.625+0000 7f561cf08640 1 -- 172.21.15.2:0/606652261 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641c7c34830 con 0x5641c7c3cb60 2024-09-19T04:50:51.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.625+0000 7f5617fff640 1 --2- 172.21.15.2:0/606652261 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5641c7c3d480 0x5641c7c5fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:50:51.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.625+0000 7f561cf08640 1 --2- 172.21.15.2:0/606652261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641c7c3cb60 0x5641c7c5f690 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f56080cdbf0 tx=0x7f5608000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35d195b8ce33acfb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:51.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.625+0000 7f55fe7fc640 1 -- 172.21.15.2:0/606652261 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5608018cb0 con 0x5641c7c3cb60 2024-09-19T04:50:51.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.625+0000 7f55fe7fc640 1 -- 172.21.15.2:0/606652261 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f56080a0530 con 0x5641c7c3cb60 2024-09-19T04:50:51.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.625+0000 7f55fe7fc640 1 -- 172.21.15.2:0/606652261 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f560809bf50 con 0x5641c7c3cb60 2024-09-19T04:50:51.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.626+0000 7f5621545740 1 -- 172.21.15.2:0/606652261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641c7c3cb60 msgr2=0x5641c7c5f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:51.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.626+0000 7f5621545740 1 --2- 172.21.15.2:0/606652261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641c7c3cb60 0x5641c7c5f690 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f56080cdbf0 tx=0x7f5608000bc0 comp rx=0 tx=0).stop 2024-09-19T04:50:51.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.626+0000 7f5621545740 1 -- 172.21.15.2:0/606652261 shutdown_connections 2024-09-19T04:50:51.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.626+0000 7f5621545740 1 --2- 172.21.15.2:0/606652261 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641c7c47d40 0x5641c7c41ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:51.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.626+0000 7f5621545740 1 --2- 172.21.15.2:0/606652261 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5641c7c3d480 0x5641c7c5fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:51.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.626+0000 7f5621545740 1 --2- 172.21.15.2:0/606652261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641c7c3cb60 0x5641c7c5f690 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:51.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.626+0000 7f5621545740 1 -- 172.21.15.2:0/606652261 >> 172.21.15.2:0/606652261 conn(0x5641c7c390f0 msgr2=0x5641c7c46bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:51.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.626+0000 7f5621545740 1 -- 172.21.15.2:0/606652261 shutdown_connections 2024-09-19T04:50:51.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.626+0000 7f5621545740 1 -- 172.21.15.2:0/606652261 wait complete. 2024-09-19T04:50:51.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.626+0000 7f5621545740 1 -- start start 2024-09-19T04:50:51.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.626+0000 7f5621545740 1 Processor -- start 2024-09-19T04:50:51.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.627+0000 7f5621545740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5641c7c3cb60 0x5641c7c4be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:51.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.627+0000 7f5621545740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641c7c3d480 0x5641c7c4c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:51.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.627+0000 7f5621545740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641c7c47d40 0x5641c7cc1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:51.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.627+0000 7f5621545740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f56181ae4e0 con 0x5641c7c47d40 2024-09-19T04:50:51.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.627+0000 7f5621545740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f56181af950 con 0x5641c7c3d480 2024-09-19T04:50:51.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.627+0000 7f5621545740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f56181aebb0 con 0x5641c7c3cb60 2024-09-19T04:50:51.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.627+0000 7f5621545740 10 client.0 _ll_register_callbacks cb 0x7f560800c870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:50:51.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.627+0000 7f561d709640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641c7c47d40 0x5641c7cc1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:51.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.627+0000 7f561d709640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641c7c47d40 0x5641c7cc1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60386/0 (socket says 172.21.15.2:60386) 2024-09-19T04:50:51.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.627+0000 7f561d709640 1 -- 172.21.15.2:0/1793457823 learned_addr learned my addr 172.21.15.2:0/1793457823 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:51.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.627+0000 7f5617fff640 1 --2- 172.21.15.2:0/1793457823 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641c7c3d480 0x5641c7c4c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:51.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.627+0000 7f561cf08640 1 --2- 172.21.15.2:0/1793457823 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5641c7c3cb60 0x5641c7c4be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:51.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.627+0000 7f561d709640 1 -- 172.21.15.2:0/1793457823 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5641c7c3cb60 msgr2=0x5641c7c4be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:51.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.627+0000 7f561d709640 1 --2- 172.21.15.2:0/1793457823 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5641c7c3cb60 0x5641c7c4be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:51.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.627+0000 7f561d709640 1 -- 172.21.15.2:0/1793457823 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641c7c3d480 msgr2=0x5641c7c4c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:51.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.627+0000 7f561d709640 1 --2- 172.21.15.2:0/1793457823 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641c7c3d480 0x5641c7c4c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:51.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.627+0000 7f561d709640 1 -- 172.21.15.2:0/1793457823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641c7cc1ba0 con 0x5641c7c47d40 2024-09-19T04:50:51.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.627+0000 7f561cf08640 1 --2- 172.21.15.2:0/1793457823 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5641c7c3cb60 0x5641c7c4be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:50:51.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.627+0000 7f561d709640 1 --2- 172.21.15.2:0/1793457823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641c7c47d40 0x5641c7cc1660 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5610007310 tx=0x7f5610003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de1d8667505344be server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:51.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.627+0000 7f55f7fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:50:51.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.628+0000 7f55f7fff640 1 -- 172.21.15.2:0/1793457823 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5610012760 con 0x5641c7c47d40 2024-09-19T04:50:51.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.628+0000 7f55f7fff640 1 -- 172.21.15.2:0/1793457823 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f5610002030 con 0x5641c7c47d40 2024-09-19T04:50:51.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.628+0000 7f5621545740 1 -- 172.21.15.2:0/1793457823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56080a0530 con 0x5641c7c47d40 2024-09-19T04:50:51.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.628+0000 7f55f7fff640 1 -- 172.21.15.2:0/1793457823 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f5610005020 con 0x5641c7c47d40 2024-09-19T04:50:51.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.628+0000 7f5621545740 10 client.15636 fetch_fsmap learned FSMap version 19 2024-09-19T04:50:51.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.628+0000 7f5621545740 1 -- 172.21.15.2:0/1793457823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5641c7cc2cb0 con 0x5641c7c47d40 2024-09-19T04:50:51.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.628+0000 7f55f7fff640 1 -- 172.21.15.2:0/1793457823 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f56080a0530 con 0x5641c7c47d40 2024-09-19T04:50:51.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.628+0000 7f55f7fff640 1 -- 172.21.15.2:0/1793457823 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f561001c020 con 0x5641c7c47d40 2024-09-19T04:50:51.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.628+0000 7f5621545740 10 client.15636 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:50:51.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.628+0000 7f5621545740 10 client.15636 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:50:51.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.628+0000 7f5621545740 20 client.15636 populate_metadata read hostname 'smithi002' 2024-09-19T04:50:51.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.628+0000 7f5621545740 1 --2- 172.21.15.2:0/1793457823 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5641c7cc3230 0x5641c7cc5620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:51.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.628+0000 7f5621545740 4 client.15636 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:50:51.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.628+0000 7f5621545740 1 -- 172.21.15.2:0/1793457823 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5641c7ba9d00 con 0x5641c7cc3230 2024-09-19T04:50:51.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.629+0000 7f561cf08640 1 --2- 172.21.15.2:0/1793457823 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5641c7cc3230 0x5641c7cc5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:51.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.629+0000 7f561cf08640 1 --2- 172.21.15.2:0/1793457823 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5641c7cc3230 0x5641c7cc5620 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13bc3d6207d33a39 server_cookie=1b19af797a384312 in_seq=0 out_seq=0 2024-09-19T04:50:51.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.629+0000 7f55f7fff640 10 client.15636 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:50:51.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.630+0000 7f55f7fff640 1 -- 172.21.15.2:0/1793457823 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5641c7ba9d00 con 0x5641c7cc3230 2024-09-19T04:50:51.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.630+0000 7f55f7fff640 10 client.15636 handle_command_reply: tid=0 2024-09-19T04:50:51.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.630+0000 7f5621545740 1 client.15636 shutdown 2024-09-19T04:50:51.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.630+0000 7f5621545740 1 -- 172.21.15.2:0/1793457823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641c7c47d40 msgr2=0x5641c7cc1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:51.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.630+0000 7f5621545740 1 --2- 172.21.15.2:0/1793457823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641c7c47d40 0x5641c7cc1660 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5610007310 tx=0x7f5610003ba0 comp rx=0 tx=0).stop 2024-09-19T04:50:51.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.630+0000 7f5621545740 1 -- 172.21.15.2:0/1793457823 shutdown_connections 2024-09-19T04:50:51.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.630+0000 7f5621545740 1 --2- 172.21.15.2:0/1793457823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641c7c47d40 0x5641c7cc1660 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:51.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.630+0000 7f5621545740 1 --2- 172.21.15.2:0/1793457823 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641c7c3d480 0x5641c7c4c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:51.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.630+0000 7f5621545740 1 --2- 172.21.15.2:0/1793457823 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5641c7cc3230 0x5641c7cc5620 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:51.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.630+0000 7f5621545740 1 --2- 172.21.15.2:0/1793457823 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5641c7c3cb60 0x5641c7c4be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:51.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.630+0000 7f5621545740 1 -- 172.21.15.2:0/1793457823 >> 172.21.15.2:0/1793457823 conn(0x5641c7c390f0 msgr2=0x5641c7c37a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:51.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.630+0000 7f55f7fff640 0 client.15636 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:50:51.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.631+0000 7f5621545740 1 -- 172.21.15.2:0/1793457823 shutdown_connections 2024-09-19T04:50:51.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.631+0000 7f5621545740 1 -- 172.21.15.2:0/1793457823 wait complete. 2024-09-19T04:50:51.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.631+0000 7f5621545740 20 client.15636 trim_cache size 0 max 16384 2024-09-19T04:50:51.638 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:50:51.638 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T04:50:51.638 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "fb7f1522-d773-4310-8bf9-5fc5ad27f3fe", 2024-09-19T04:50:51.638 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T04:50:51.639 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:50:51.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.631+0000 7f561f16c640 1 -- 172.21.15.2:0/4024096617 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f56000a3430 msgr2=0x7f56000a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:51.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.631+0000 7f561f16c640 1 --2- 172.21.15.2:0/4024096617 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f56000a3430 0x7f56000a58f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f560c031440 tx=0x7f560c0095f0 comp rx=0 tx=0).stop 2024-09-19T04:50:51.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.631+0000 7f561f16c640 1 -- 172.21.15.2:0/4024096617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5618101de0 msgr2=0x7f56180744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:51.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.631+0000 7f561f16c640 1 --2- 172.21.15.2:0/4024096617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5618101de0 0x7f56180744f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f560800c920 tx=0x7f560800cde0 comp rx=0 tx=0).stop 2024-09-19T04:50:51.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.631+0000 7f561f16c640 1 -- 172.21.15.2:0/4024096617 shutdown_connections 2024-09-19T04:50:51.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.631+0000 7f561f16c640 1 --2- 172.21.15.2:0/4024096617 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5618106f10 0x7f5618074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:51.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.631+0000 7f561f16c640 1 --2- 172.21.15.2:0/4024096617 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f56000a3430 0x7f56000a58f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:51.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.631+0000 7f561f16c640 1 --2- 172.21.15.2:0/4024096617 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5618102790 0x7f5618074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:51.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.631+0000 7f561f16c640 1 --2- 172.21.15.2:0/4024096617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5618101de0 0x7f56180744f0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:51.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.631+0000 7f561f16c640 1 -- 172.21.15.2:0/4024096617 >> 172.21.15.2:0/4024096617 conn(0x7f56180fd8c0 msgr2=0x7f56180fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:51.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.631+0000 7f561f16c640 1 -- 172.21.15.2:0/4024096617 shutdown_connections 2024-09-19T04:50:51.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:51.632+0000 7f561f16c640 1 -- 172.21.15.2:0/4024096617 wait complete. 2024-09-19T04:50:52.397 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:50:52.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:52 smithi002 ceph-mon[30975]: pgmap v89: 97 pgs: 97 active+clean; 2.9 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-09-19T04:50:52.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:52 smithi002 ceph-mon[30975]: scrub queued for path: / 2024-09-19T04:50:52.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:52 smithi002 ceph-mon[30975]: scrub summary: idle+waiting paths [/] 2024-09-19T04:50:52.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:52 smithi002 ceph-mon[30975]: scrub summary: active paths [/] 2024-09-19T04:50:52.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:52 smithi002 ceph-mon[30975]: scrub summary: idle+waiting paths [/] 2024-09-19T04:50:52.660 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:50:52.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:52 smithi018 ceph-mon[34537]: pgmap v89: 97 pgs: 97 active+clean; 2.9 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-09-19T04:50:52.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:52 smithi018 ceph-mon[34537]: scrub queued for path: / 2024-09-19T04:50:52.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:52 smithi018 ceph-mon[34537]: scrub summary: idle+waiting paths [/] 2024-09-19T04:50:52.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:52 smithi018 ceph-mon[34537]: scrub summary: active paths [/] 2024-09-19T04:50:52.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:52 smithi018 ceph-mon[34537]: scrub summary: idle+waiting paths [/] 2024-09-19T04:50:52.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:52 smithi116 ceph-mon[34477]: pgmap v89: 97 pgs: 97 active+clean; 2.9 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-09-19T04:50:52.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:52 smithi116 ceph-mon[34477]: scrub queued for path: / 2024-09-19T04:50:52.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:52 smithi116 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-19T04:50:52.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:52 smithi116 ceph-mon[34477]: scrub summary: active paths [/] 2024-09-19T04:50:52.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:52 smithi116 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-19T04:50:53.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.109+0000 7f3acb19f640 1 -- 172.21.15.2:0/3257513236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ac410e280 msgr2=0x7f3ac4110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:53.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.109+0000 7f3acb19f640 1 --2- 172.21.15.2:0/3257513236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ac410e280 0x7f3ac4110670 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f3abc009ca0 tx=0x7f3abc02a950 comp rx=0 tx=0).stop 2024-09-19T04:50:53.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.110+0000 7f3acb19f640 1 -- 172.21.15.2:0/3257513236 shutdown_connections 2024-09-19T04:50:53.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.110+0000 7f3acb19f640 1 --2- 172.21.15.2:0/3257513236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ac410e280 0x7f3ac4110670 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:53.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.110+0000 7f3acb19f640 1 --2- 172.21.15.2:0/3257513236 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ac4074e30 0x7f3ac410dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:53.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.110+0000 7f3acb19f640 1 --2- 172.21.15.2:0/3257513236 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ac4074510 0x7f3ac40748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:53.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.110+0000 7f3acb19f640 1 -- 172.21.15.2:0/3257513236 >> 172.21.15.2:0/3257513236 conn(0x7f3ac40fd6e0 msgr2=0x7f3ac40ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:53.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.110+0000 7f3acb19f640 1 -- 172.21.15.2:0/3257513236 shutdown_connections 2024-09-19T04:50:53.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.110+0000 7f3acb19f640 1 -- 172.21.15.2:0/3257513236 wait complete. 2024-09-19T04:50:53.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.110+0000 7f3acb19f640 1 Processor -- start 2024-09-19T04:50:53.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.110+0000 7f3acb19f640 1 -- start start 2024-09-19T04:50:53.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.111+0000 7f3acb19f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ac4074510 0x7f3ac419a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:53.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.111+0000 7f3acb19f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ac4074e30 0x7f3ac419a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:53.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.111+0000 7f3acb19f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ac410e280 0x7f3ac419ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:53.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.111+0000 7f3acb19f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac4113e60 con 0x7f3ac4074e30 2024-09-19T04:50:53.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.111+0000 7f3acb19f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac4113ce0 con 0x7f3ac410e280 2024-09-19T04:50:53.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.111+0000 7f3acb19f640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac4113fe0 con 0x7f3ac4074510 2024-09-19T04:50:53.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.111+0000 7f3ac999c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ac4074e30 0x7f3ac419a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:53.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.111+0000 7f3ac999c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ac4074e30 0x7f3ac419a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60410/0 (socket says 172.21.15.2:60410) 2024-09-19T04:50:53.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.111+0000 7f3ac999c640 1 -- 172.21.15.2:0/1847039793 learned_addr learned my addr 172.21.15.2:0/1847039793 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:53.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.111+0000 7f3aca19d640 1 --2- 172.21.15.2:0/1847039793 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ac4074510 0x7f3ac419a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:53.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.111+0000 7f3aca99e640 1 --2- 172.21.15.2:0/1847039793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ac410e280 0x7f3ac419ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:53.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.111+0000 7f3ac999c640 1 -- 172.21.15.2:0/1847039793 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ac4074510 msgr2=0x7f3ac419a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:53.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.111+0000 7f3ac999c640 1 --2- 172.21.15.2:0/1847039793 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ac4074510 0x7f3ac419a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:53.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.111+0000 7f3ac999c640 1 -- 172.21.15.2:0/1847039793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ac410e280 msgr2=0x7f3ac419ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:53.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.111+0000 7f3ac999c640 1 --2- 172.21.15.2:0/1847039793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ac410e280 0x7f3ac419ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:53.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.111+0000 7f3ac999c640 1 -- 172.21.15.2:0/1847039793 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ac419f2e0 con 0x7f3ac4074e30 2024-09-19T04:50:53.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.111+0000 7f3aca99e640 1 --2- 172.21.15.2:0/1847039793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ac410e280 0x7f3ac419ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:50:53.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.111+0000 7f3ac999c640 1 --2- 172.21.15.2:0/1847039793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ac4074e30 0x7f3ac419a870 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3ac000d950 tx=0x7f3ac000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:53.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.111+0000 7f3ab77fe640 1 -- 172.21.15.2:0/1847039793 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac0017070 con 0x7f3ac4074e30 2024-09-19T04:50:53.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.111+0000 7f3ab77fe640 1 -- 172.21.15.2:0/1847039793 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3ac0009c30 con 0x7f3ac4074e30 2024-09-19T04:50:53.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.112+0000 7f3acb19f640 1 -- 172.21.15.2:0/1847039793 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ac419f5d0 con 0x7f3ac4074e30 2024-09-19T04:50:53.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.112+0000 7f3ab77fe640 1 -- 172.21.15.2:0/1847039793 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac000f620 con 0x7f3ac4074e30 2024-09-19T04:50:53.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.112+0000 7f3acb19f640 1 -- 172.21.15.2:0/1847039793 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ac41a6eb0 con 0x7f3ac4074e30 2024-09-19T04:50:53.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.114+0000 7f3ab77fe640 1 -- 172.21.15.2:0/1847039793 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f3ac00109a0 con 0x7f3ac4074e30 2024-09-19T04:50:53.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.114+0000 7f3ace7da740 1 Processor -- start 2024-09-19T04:50:53.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.114+0000 7f3ace7da740 1 -- start start 2024-09-19T04:50:53.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.114+0000 7f3ace7da740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5626005cd670 0x5626005cda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:53.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.114+0000 7f3ace7da740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626005cdf90 0x5626005d8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:53.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.114+0000 7f3ace7da740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626005d8850 0x5626005dac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:53.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.114+0000 7f3ace7da740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5626005332e0 con 0x5626005d8850 2024-09-19T04:50:53.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.114+0000 7f3ace7da740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5626004dace0 con 0x5626005cdf90 2024-09-19T04:50:53.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.114+0000 7f3ace7da740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x56260052f2a0 con 0x5626005cd670 2024-09-19T04:50:53.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.115+0000 7f3ac999c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626005d8850 0x5626005dac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:53.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.115+0000 7f3ac999c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626005d8850 0x5626005dac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60412/0 (socket says 172.21.15.2:60412) 2024-09-19T04:50:53.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.115+0000 7f3ac999c640 1 -- 172.21.15.2:0/33913881 learned_addr learned my addr 172.21.15.2:0/33913881 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:53.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.115+0000 7f3aca19d640 1 --2- 172.21.15.2:0/33913881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626005cdf90 0x5626005d8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:53.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.115+0000 7f3aca99e640 1 --2- 172.21.15.2:0/33913881 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5626005cd670 0x5626005cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:53.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.115+0000 7f3ab77fe640 1 --2- 172.21.15.2:0/1847039793 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f3ab00a33b0 0x7f3ab00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:53.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.115+0000 7f3ac999c640 1 -- 172.21.15.2:0/33913881 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5626005cd670 msgr2=0x5626005cda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:53.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.115+0000 7f3ac999c640 1 --2- 172.21.15.2:0/33913881 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5626005cd670 0x5626005cda50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:53.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.115+0000 7f3ac999c640 1 -- 172.21.15.2:0/33913881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626005cdf90 msgr2=0x5626005d8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:53.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.115+0000 7f3ac999c640 1 --2- 172.21.15.2:0/33913881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626005cdf90 0x5626005d8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:53.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.115+0000 7f3ac999c640 1 -- 172.21.15.2:0/33913881 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626004bf440 con 0x5626005d8850 2024-09-19T04:50:53.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.115+0000 7f3aca99e640 1 --2- 172.21.15.2:0/1847039793 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f3ab00a33b0 0x7f3ab00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:53.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.115+0000 7f3ab77fe640 1 -- 172.21.15.2:0/1847039793 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f3ac00cf8e0 con 0x7f3ac4074e30 2024-09-19T04:50:53.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.115+0000 7f3ac999c640 1 --2- 172.21.15.2:0/33913881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626005d8850 0x5626005dac40 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f3ac00ccfc0 tx=0x7f3ac00c69b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7db52bd00bcc24f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:53.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.115+0000 7f3ab4dea640 1 -- 172.21.15.2:0/33913881 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac0020030 con 0x5626005d8850 2024-09-19T04:50:53.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.116+0000 7f3ab4dea640 1 -- 172.21.15.2:0/33913881 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3ac009c2e0 con 0x5626005d8850 2024-09-19T04:50:53.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.116+0000 7f3ab4dea640 1 -- 172.21.15.2:0/33913881 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac0009de0 con 0x5626005d8850 2024-09-19T04:50:53.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.116+0000 7f3ace7da740 1 -- 172.21.15.2:0/33913881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626005d8850 msgr2=0x5626005dac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:53.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.116+0000 7f3aca99e640 1 --2- 172.21.15.2:0/1847039793 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f3ab00a33b0 0x7f3ab00a5870 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3abc005e30 tx=0x7f3abc03e040 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:53.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.116+0000 7f3ace7da740 1 --2- 172.21.15.2:0/33913881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626005d8850 0x5626005dac40 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f3ac00ccfc0 tx=0x7f3ac00c69b0 comp rx=0 tx=0).stop 2024-09-19T04:50:53.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.116+0000 7f3ace7da740 1 -- 172.21.15.2:0/33913881 shutdown_connections 2024-09-19T04:50:53.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.116+0000 7f3ace7da740 1 --2- 172.21.15.2:0/33913881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626005d8850 0x5626005dac40 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:53.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.116+0000 7f3ace7da740 1 --2- 172.21.15.2:0/33913881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626005cdf90 0x5626005d8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:53.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.116+0000 7f3ace7da740 1 --2- 172.21.15.2:0/33913881 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5626005cd670 0x5626005cda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:53.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.116+0000 7f3ace7da740 1 -- 172.21.15.2:0/33913881 >> 172.21.15.2:0/33913881 conn(0x5626005c9c00 msgr2=0x5626005c9fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:53.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.116+0000 7f3ace7da740 1 -- 172.21.15.2:0/33913881 shutdown_connections 2024-09-19T04:50:53.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.116+0000 7f3ace7da740 1 -- 172.21.15.2:0/33913881 wait complete. 2024-09-19T04:50:53.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.117+0000 7f3ace7da740 1 -- start start 2024-09-19T04:50:53.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.117+0000 7f3ace7da740 1 Processor -- start 2024-09-19T04:50:53.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.117+0000 7f3ace7da740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626005cd670 0x5626005d81c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:53.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.117+0000 7f3ace7da740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626005cdf90 0x5626005d5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:53.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.117+0000 7f3ace7da740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5626005d8850 0x5626005d59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:53.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.117+0000 7f3ace7da740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5626005db3c0 con 0x5626005cdf90 2024-09-19T04:50:53.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.117+0000 7f3ace7da740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5626004ee050 con 0x5626005cd670 2024-09-19T04:50:53.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.117+0000 7f3ace7da740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5626005db540 con 0x5626005d8850 2024-09-19T04:50:53.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.117+0000 7f3ace7da740 10 client.0 _ll_register_callbacks cb 0x56260052e160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:50:53.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.117+0000 7f3ac999c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626005cdf90 0x5626005d5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:53.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.117+0000 7f3ac999c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626005cdf90 0x5626005d5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60428/0 (socket says 172.21.15.2:60428) 2024-09-19T04:50:53.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.117+0000 7f3ac999c640 1 -- 172.21.15.2:0/910180441 learned_addr learned my addr 172.21.15.2:0/910180441 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:53.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.117+0000 7f3aca99e640 1 --2- 172.21.15.2:0/910180441 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5626005d8850 0x5626005d59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:53.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.118+0000 7f3aca19d640 1 --2- 172.21.15.2:0/910180441 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626005cd670 0x5626005d81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:53.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.118+0000 7f3ac999c640 1 -- 172.21.15.2:0/910180441 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5626005d8850 msgr2=0x5626005d59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:53.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.118+0000 7f3ac999c640 1 --2- 172.21.15.2:0/910180441 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5626005d8850 0x5626005d59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:53.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.118+0000 7f3ac999c640 1 -- 172.21.15.2:0/910180441 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626005cd670 msgr2=0x5626005d81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:53.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.118+0000 7f3ac999c640 1 --2- 172.21.15.2:0/910180441 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626005cd670 0x5626005d81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:53.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.118+0000 7f3ac999c640 1 -- 172.21.15.2:0/910180441 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626002a43c0 con 0x5626005cdf90 2024-09-19T04:50:53.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.118+0000 7f3aca19d640 1 --2- 172.21.15.2:0/910180441 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626005cd670 0x5626005d81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:50:53.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.118+0000 7f3ac999c640 1 --2- 172.21.15.2:0/910180441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626005cdf90 0x5626005d5470 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0012040 tx=0x7f3ac0005f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=335447c7f718cfc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:53.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.118+0000 7f3aadffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:50:53.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.118+0000 7f3aadffb640 1 -- 172.21.15.2:0/910180441 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac0020030 con 0x5626005cdf90 2024-09-19T04:50:53.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.118+0000 7f3aadffb640 1 -- 172.21.15.2:0/910180441 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f3ac00cd2d0 con 0x5626005cdf90 2024-09-19T04:50:53.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.118+0000 7f3ace7da740 1 -- 172.21.15.2:0/910180441 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ac009c2e0 con 0x5626005cdf90 2024-09-19T04:50:53.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.118+0000 7f3aadffb640 1 -- 172.21.15.2:0/910180441 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f3ac009b720 con 0x5626005cdf90 2024-09-19T04:50:53.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.118+0000 7f3ace7da740 10 client.15648 fetch_fsmap learned FSMap version 19 2024-09-19T04:50:53.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.118+0000 7f3ace7da740 1 -- 172.21.15.2:0/910180441 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5626005e6d90 con 0x5626005cdf90 2024-09-19T04:50:53.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.118+0000 7f3aadffb640 1 -- 172.21.15.2:0/910180441 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3ac00b2080 con 0x5626005cdf90 2024-09-19T04:50:53.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.118+0000 7f3aadffb640 1 -- 172.21.15.2:0/910180441 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f3ac0098250 con 0x5626005cdf90 2024-09-19T04:50:53.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.118+0000 7f3ace7da740 10 client.15648 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:50:53.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.118+0000 7f3ace7da740 10 client.15648 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:50:53.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.118+0000 7f3ace7da740 20 client.15648 populate_metadata read hostname 'smithi002' 2024-09-19T04:50:53.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.118+0000 7f3ace7da740 1 --2- 172.21.15.2:0/910180441 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5626005e80e0 0x5626005ea4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:53.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.118+0000 7f3ace7da740 4 client.15648 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:50:53.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.118+0000 7f3ace7da740 1 -- 172.21.15.2:0/910180441 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562600540850 con 0x5626005e80e0 2024-09-19T04:50:53.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.119+0000 7f3aca19d640 1 --2- 172.21.15.2:0/910180441 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5626005e80e0 0x5626005ea4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:53.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.119+0000 7f3aadffb640 10 client.15648 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:50:53.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.119+0000 7f3aca19d640 1 --2- 172.21.15.2:0/910180441 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5626005e80e0 0x5626005ea4d0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=deaf2e1f8340e883 server_cookie=ff5bdd4f52d17f8d in_seq=0 out_seq=0 2024-09-19T04:50:53.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.120+0000 7f3aadffb640 1 -- 172.21.15.2:0/910180441 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562600540850 con 0x5626005e80e0 2024-09-19T04:50:53.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.120+0000 7f3aadffb640 10 client.15648 handle_command_reply: tid=0 2024-09-19T04:50:53.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.120+0000 7f3ace7da740 1 client.15648 shutdown 2024-09-19T04:50:53.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.120+0000 7f3ace7da740 1 -- 172.21.15.2:0/910180441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626005cdf90 msgr2=0x5626005d5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:53.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.120+0000 7f3ace7da740 1 --2- 172.21.15.2:0/910180441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626005cdf90 0x5626005d5470 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0012040 tx=0x7f3ac0005f70 comp rx=0 tx=0).stop 2024-09-19T04:50:53.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.120+0000 7f3ace7da740 1 -- 172.21.15.2:0/910180441 shutdown_connections 2024-09-19T04:50:53.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.120+0000 7f3ace7da740 1 --2- 172.21.15.2:0/910180441 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5626005e80e0 0x5626005ea4d0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:53.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.120+0000 7f3ace7da740 1 --2- 172.21.15.2:0/910180441 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5626005d8850 0x5626005d59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:53.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.120+0000 7f3ace7da740 1 --2- 172.21.15.2:0/910180441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626005cdf90 0x5626005d5470 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:53.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.120+0000 7f3aadffb640 0 client.15648 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:50:53.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.120+0000 7f3ace7da740 1 --2- 172.21.15.2:0/910180441 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626005cd670 0x5626005d81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:53.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.120+0000 7f3ace7da740 1 -- 172.21.15.2:0/910180441 >> 172.21.15.2:0/910180441 conn(0x5626005c9c00 msgr2=0x5626005cf930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:53.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.120+0000 7f3ace7da740 1 -- 172.21.15.2:0/910180441 shutdown_connections 2024-09-19T04:50:53.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.120+0000 7f3ace7da740 1 -- 172.21.15.2:0/910180441 wait complete. 2024-09-19T04:50:53.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.120+0000 7f3ace7da740 20 client.15648 trim_cache size 0 max 16384 2024-09-19T04:50:53.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.138+0000 7f3ace7da740 1 Processor -- start 2024-09-19T04:50:53.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.138+0000 7f3ace7da740 1 -- start start 2024-09-19T04:50:53.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.138+0000 7f3ace7da740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626005cd670 0x5626005d26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:53.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.138+0000 7f3ace7da740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626005cdf90 0x5626005d2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:53.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.138+0000 7f3ace7da740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5626005d8850 0x5626005d6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:53.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.138+0000 7f3ace7da740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac41ad720 con 0x5626005cd670 2024-09-19T04:50:53.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.138+0000 7f3ace7da740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac41affa0 con 0x5626005cdf90 2024-09-19T04:50:53.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.138+0000 7f3ace7da740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac41add90 con 0x5626005d8850 2024-09-19T04:50:53.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.138+0000 7f3aca19d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626005cd670 0x5626005d26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:53.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.138+0000 7f3aca19d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626005cd670 0x5626005d26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60432/0 (socket says 172.21.15.2:60432) 2024-09-19T04:50:53.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.138+0000 7f3aca19d640 1 -- 172.21.15.2:0/3434676374 learned_addr learned my addr 172.21.15.2:0/3434676374 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:53.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.138+0000 7f3aca99e640 1 --2- 172.21.15.2:0/3434676374 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5626005d8850 0x5626005d6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:53.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.138+0000 7f3aca19d640 1 -- 172.21.15.2:0/3434676374 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5626005d8850 msgr2=0x5626005d6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:53.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.138+0000 7f3ac999c640 1 --2- 172.21.15.2:0/3434676374 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626005cdf90 0x5626005d2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:53.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.138+0000 7f3aca19d640 1 --2- 172.21.15.2:0/3434676374 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5626005d8850 0x5626005d6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:53.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.138+0000 7f3aca19d640 1 -- 172.21.15.2:0/3434676374 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626005cdf90 msgr2=0x5626005d2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:53.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.138+0000 7f3aca19d640 1 --2- 172.21.15.2:0/3434676374 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626005cdf90 0x5626005d2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:53.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.138+0000 7f3aca19d640 1 -- 172.21.15.2:0/3434676374 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626005cd4a0 con 0x5626005cd670 2024-09-19T04:50:53.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.138+0000 7f3ac999c640 1 --2- 172.21.15.2:0/3434676374 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626005cdf90 0x5626005d2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:50:53.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.139+0000 7f3aca19d640 1 --2- 172.21.15.2:0/3434676374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626005cd670 0x5626005d26f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3ab8005d00 tx=0x7f3ab80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29c4606f901d9cdf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:53.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.139+0000 7f3aaffff640 1 -- 172.21.15.2:0/3434676374 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab8003d90 con 0x5626005cd670 2024-09-19T04:50:53.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.139+0000 7f3aaffff640 1 -- 172.21.15.2:0/3434676374 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3ab80108e0 con 0x5626005cd670 2024-09-19T04:50:53.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.139+0000 7f3aaffff640 1 -- 172.21.15.2:0/3434676374 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab801c8e0 con 0x5626005cd670 2024-09-19T04:50:53.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.139+0000 7f3ace7da740 1 -- 172.21.15.2:0/3434676374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626005cd670 msgr2=0x5626005d26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:53.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.139+0000 7f3ace7da740 1 --2- 172.21.15.2:0/3434676374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626005cd670 0x5626005d26f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3ab8005d00 tx=0x7f3ab80046c0 comp rx=0 tx=0).stop 2024-09-19T04:50:53.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.139+0000 7f3ace7da740 1 -- 172.21.15.2:0/3434676374 shutdown_connections 2024-09-19T04:50:53.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.139+0000 7f3ace7da740 1 --2- 172.21.15.2:0/3434676374 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5626005d8850 0x5626005d6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:53.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.139+0000 7f3ace7da740 1 --2- 172.21.15.2:0/3434676374 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626005cdf90 0x5626005d2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:53.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.139+0000 7f3ace7da740 1 --2- 172.21.15.2:0/3434676374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626005cd670 0x5626005d26f0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:53.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.139+0000 7f3ace7da740 1 -- 172.21.15.2:0/3434676374 >> 172.21.15.2:0/3434676374 conn(0x5626005c9c00 msgr2=0x5626005d0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:53.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.140+0000 7f3ace7da740 1 -- 172.21.15.2:0/3434676374 shutdown_connections 2024-09-19T04:50:53.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.140+0000 7f3ace7da740 1 -- 172.21.15.2:0/3434676374 wait complete. 2024-09-19T04:50:53.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.140+0000 7f3ace7da740 1 -- start start 2024-09-19T04:50:53.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.140+0000 7f3ace7da740 1 Processor -- start 2024-09-19T04:50:53.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.140+0000 7f3ace7da740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626005cd670 0x5626005edcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:53.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.140+0000 7f3ace7da740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5626005cdf90 0x5626005eb010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:53.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.140+0000 7f3ace7da740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626005d8850 0x5626005eb570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:53.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.140+0000 7f3ace7da740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac41ae460 con 0x5626005d8850 2024-09-19T04:50:53.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.140+0000 7f3ace7da740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac41af8d0 con 0x5626005cd670 2024-09-19T04:50:53.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.140+0000 7f3ace7da740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac41aeb30 con 0x5626005cdf90 2024-09-19T04:50:53.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.140+0000 7f3ace7da740 10 client.0 _ll_register_callbacks cb 0x7f3ab80097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:50:53.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.140+0000 7f3aca99e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626005d8850 0x5626005eb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:53.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.140+0000 7f3aca99e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626005d8850 0x5626005eb570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60442/0 (socket says 172.21.15.2:60442) 2024-09-19T04:50:53.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.140+0000 7f3aca99e640 1 -- 172.21.15.2:0/1456652148 learned_addr learned my addr 172.21.15.2:0/1456652148 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:50:53.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.140+0000 7f3aca19d640 1 --2- 172.21.15.2:0/1456652148 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626005cd670 0x5626005edcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:53.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.140+0000 7f3ac999c640 1 --2- 172.21.15.2:0/1456652148 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5626005cdf90 0x5626005eb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:53.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.141+0000 7f3aca99e640 1 -- 172.21.15.2:0/1456652148 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5626005cdf90 msgr2=0x5626005eb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:53.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.141+0000 7f3aca99e640 1 --2- 172.21.15.2:0/1456652148 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5626005cdf90 0x5626005eb010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:53.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.141+0000 7f3aca99e640 1 -- 172.21.15.2:0/1456652148 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626005cd670 msgr2=0x5626005edcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:50:53.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.141+0000 7f3aca99e640 1 --2- 172.21.15.2:0/1456652148 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626005cd670 0x5626005edcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:53.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.141+0000 7f3aca99e640 1 -- 172.21.15.2:0/1456652148 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626005ca890 con 0x5626005d8850 2024-09-19T04:50:53.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.141+0000 7f3aca19d640 1 --2- 172.21.15.2:0/1456652148 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626005cd670 0x5626005edcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:50:53.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.141+0000 7f3aca99e640 1 --2- 172.21.15.2:0/1456652148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626005d8850 0x5626005eb570 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f3abc009ca0 tx=0x7f3abc005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b60c92b38eb70a50 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:50:53.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.141+0000 7f3aadffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:50:53.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.141+0000 7f3aadffb640 1 -- 172.21.15.2:0/1456652148 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3abc034040 con 0x5626005d8850 2024-09-19T04:50:53.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.141+0000 7f3aadffb640 1 -- 172.21.15.2:0/1456652148 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f3abc003b80 con 0x5626005d8850 2024-09-19T04:50:53.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.141+0000 7f3ace7da740 1 -- 172.21.15.2:0/1456652148 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ab80108e0 con 0x5626005d8850 2024-09-19T04:50:53.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.141+0000 7f3aadffb640 1 -- 172.21.15.2:0/1456652148 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f3abc003d80 con 0x5626005d8850 2024-09-19T04:50:53.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.141+0000 7f3ace7da740 10 client.15654 fetch_fsmap learned FSMap version 19 2024-09-19T04:50:53.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.141+0000 7f3ace7da740 1 -- 172.21.15.2:0/1456652148 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x562600652850 con 0x5626005d8850 2024-09-19T04:50:53.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.142+0000 7f3aadffb640 1 -- 172.21.15.2:0/1456652148 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3ab80108e0 con 0x5626005d8850 2024-09-19T04:50:53.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.142+0000 7f3aadffb640 1 -- 172.21.15.2:0/1456652148 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f3abc058020 con 0x5626005d8850 2024-09-19T04:50:53.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.142+0000 7f3ace7da740 10 client.15654 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:50:53.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.142+0000 7f3ace7da740 10 client.15654 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:50:53.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.142+0000 7f3ace7da740 20 client.15654 populate_metadata read hostname 'smithi002' 2024-09-19T04:50:53.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.142+0000 7f3ace7da740 1 --2- 172.21.15.2:0/1456652148 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x562600652fa0 0x5626006553c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:50:53.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.142+0000 7f3ace7da740 4 client.15654 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:50:53.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.142+0000 7f3ace7da740 1 -- 172.21.15.2:0/1456652148 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56260053ad60 con 0x562600652fa0 2024-09-19T04:50:53.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.142+0000 7f3aca19d640 1 --2- 172.21.15.2:0/1456652148 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x562600652fa0 0x5626006553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:50:53.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.143+0000 7f3aca19d640 1 --2- 172.21.15.2:0/1456652148 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x562600652fa0 0x5626006553c0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c438d17bcba219f6 server_cookie=c64a0d32b62c03fb in_seq=0 out_seq=0 2024-09-19T04:50:53.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.143+0000 7f3aadffb640 10 client.15654 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:50:53.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.143+0000 7f3aadffb640 1 -- 172.21.15.2:0/1456652148 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x56260053ad60 con 0x562600652fa0 2024-09-19T04:50:53.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.143+0000 7f3aadffb640 10 client.15654 handle_command_reply: tid=0 2024-09-19T04:50:53.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.143+0000 7f3ace7da740 1 client.15654 shutdown 2024-09-19T04:50:53.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.143+0000 7f3ace7da740 1 -- 172.21.15.2:0/1456652148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626005d8850 msgr2=0x5626005eb570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:53.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.143+0000 7f3ace7da740 1 --2- 172.21.15.2:0/1456652148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626005d8850 0x5626005eb570 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f3abc009ca0 tx=0x7f3abc005d80 comp rx=0 tx=0).stop 2024-09-19T04:50:53.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.143+0000 7f3ace7da740 1 -- 172.21.15.2:0/1456652148 shutdown_connections 2024-09-19T04:50:53.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.143+0000 7f3ace7da740 1 --2- 172.21.15.2:0/1456652148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626005d8850 0x5626005eb570 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:53.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.143+0000 7f3ace7da740 1 --2- 172.21.15.2:0/1456652148 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x562600652fa0 0x5626006553c0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:53.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.143+0000 7f3aadffb640 0 client.15654 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:50:53.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.143+0000 7f3ace7da740 1 --2- 172.21.15.2:0/1456652148 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5626005cdf90 0x5626005eb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:53.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.143+0000 7f3ace7da740 1 --2- 172.21.15.2:0/1456652148 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626005cd670 0x5626005edcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:53.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.143+0000 7f3ace7da740 1 -- 172.21.15.2:0/1456652148 >> 172.21.15.2:0/1456652148 conn(0x5626005c9c00 msgr2=0x5626005cf0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:53.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.143+0000 7f3ace7da740 1 -- 172.21.15.2:0/1456652148 shutdown_connections 2024-09-19T04:50:53.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.143+0000 7f3ace7da740 1 -- 172.21.15.2:0/1456652148 wait complete. 2024-09-19T04:50:53.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.143+0000 7f3ace7da740 20 client.15654 trim_cache size 0 max 16384 2024-09-19T04:50:53.151 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:50:53.151 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T04:50:53.151 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-19T04:50:53.151 INFO:teuthology.orchestra.run.smithi002.stdout: "fb7f1522-d773-4310-8bf9-5fc5ad27f3fe": { 2024-09-19T04:50:53.151 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-19T04:50:53.151 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "fb7f1522-d773-4310-8bf9-5fc5ad27f3fe", 2024-09-19T04:50:53.152 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-19T04:50:53.152 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:50:53.152 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:50:53.152 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:50:53.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.144+0000 7f3acb19f640 1 -- 172.21.15.2:0/1847039793 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f3ab00a33b0 msgr2=0x7f3ab00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:53.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.144+0000 7f3acb19f640 1 --2- 172.21.15.2:0/1847039793 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f3ab00a33b0 0x7f3ab00a5870 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3abc005e30 tx=0x7f3abc03e040 comp rx=0 tx=0).stop 2024-09-19T04:50:53.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.144+0000 7f3acb19f640 1 -- 172.21.15.2:0/1847039793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ac4074e30 msgr2=0x7f3ac419a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:50:53.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.144+0000 7f3acb19f640 1 --2- 172.21.15.2:0/1847039793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ac4074e30 0x7f3ac419a870 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3ac000d950 tx=0x7f3ac000de10 comp rx=0 tx=0).stop 2024-09-19T04:50:53.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.144+0000 7f3acb19f640 1 -- 172.21.15.2:0/1847039793 shutdown_connections 2024-09-19T04:50:53.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.144+0000 7f3acb19f640 1 --2- 172.21.15.2:0/1847039793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ac410e280 0x7f3ac419ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:53.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.144+0000 7f3acb19f640 1 --2- 172.21.15.2:0/1847039793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ac4074e30 0x7f3ac419a870 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:53.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.144+0000 7f3acb19f640 1 --2- 172.21.15.2:0/1847039793 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f3ab00a33b0 0x7f3ab00a5870 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:53.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.144+0000 7f3acb19f640 1 --2- 172.21.15.2:0/1847039793 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ac4074510 0x7f3ac419a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:50:53.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.144+0000 7f3acb19f640 1 -- 172.21.15.2:0/1847039793 >> 172.21.15.2:0/1847039793 conn(0x7f3ac40fd6e0 msgr2=0x7f3ac40fee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:50:53.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.144+0000 7f3acb19f640 1 -- 172.21.15.2:0/1847039793 shutdown_connections 2024-09-19T04:50:53.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:50:53.144+0000 7f3acb19f640 1 -- 172.21.15.2:0/1847039793 wait complete. 2024-09-19T04:50:53.861 INFO:tasks.cephfs.filesystem:scrub status for tag:fb7f1522-d773-4310-8bf9-5fc5ad27f3fe - {'path': '/', 'tag': 'fb7f1522-d773-4310-8bf9-5fc5ad27f3fe', 'options': 'recursive,force'} 2024-09-19T04:50:54.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:54 smithi018 ceph-mon[34537]: pgmap v90: 97 pgs: 97 active+clean; 2.9 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-09-19T04:50:54.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:54 smithi002 ceph-mon[30975]: pgmap v90: 97 pgs: 97 active+clean; 2.9 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-09-19T04:50:54.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:54 smithi116 ceph-mon[34477]: pgmap v90: 97 pgs: 97 active+clean; 2.9 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-09-19T04:50:55.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:55 smithi018 ceph-mon[34537]: scrub summary: idle 2024-09-19T04:50:55.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:55 smithi002 ceph-mon[30975]: scrub summary: idle 2024-09-19T04:50:55.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:55 smithi116 ceph-mon[34477]: scrub summary: idle 2024-09-19T04:50:56.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:56 smithi018 ceph-mon[34537]: pgmap v91: 97 pgs: 97 active+clean; 3.0 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 29 KiB/s wr, 11 op/s 2024-09-19T04:50:56.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:56 smithi002 ceph-mon[30975]: pgmap v91: 97 pgs: 97 active+clean; 3.0 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 29 KiB/s wr, 11 op/s 2024-09-19T04:50:56.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:56 smithi116 ceph-mon[34477]: pgmap v91: 97 pgs: 97 active+clean; 3.0 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 29 KiB/s wr, 11 op/s 2024-09-19T04:50:58.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:50:58 smithi018 ceph-mon[34537]: pgmap v92: 97 pgs: 97 active+clean; 3.0 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 KiB/s wr, 7 op/s 2024-09-19T04:50:58.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:50:58 smithi002 ceph-mon[30975]: pgmap v92: 97 pgs: 97 active+clean; 3.0 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 KiB/s wr, 7 op/s 2024-09-19T04:50:58.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:50:58 smithi116 ceph-mon[34477]: pgmap v92: 97 pgs: 97 active+clean; 3.0 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 KiB/s wr, 7 op/s 2024-09-19T04:51:00.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:51:00 smithi018 ceph-mon[34537]: pgmap v93: 97 pgs: 97 active+clean; 3.0 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 KiB/s wr, 7 op/s 2024-09-19T04:51:00.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:51:00 smithi002 ceph-mon[30975]: pgmap v93: 97 pgs: 97 active+clean; 3.0 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 KiB/s wr, 7 op/s 2024-09-19T04:51:00.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:51:00 smithi116 ceph-mon[34477]: pgmap v93: 97 pgs: 97 active+clean; 3.0 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 KiB/s wr, 7 op/s 2024-09-19T04:51:02.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:51:02 smithi018 ceph-mon[34537]: pgmap v94: 97 pgs: 97 active+clean; 3.1 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-09-19T04:51:02.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:51:02 smithi002 ceph-mon[30975]: pgmap v94: 97 pgs: 97 active+clean; 3.1 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-09-19T04:51:02.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:51:02 smithi116 ceph-mon[34477]: pgmap v94: 97 pgs: 97 active+clean; 3.1 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-09-19T04:51:04.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:51:04 smithi018 ceph-mon[34537]: pgmap v95: 97 pgs: 97 active+clean; 3.1 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 18 KiB/s wr, 7 op/s 2024-09-19T04:51:04.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:51:04 smithi002 ceph-mon[30975]: pgmap v95: 97 pgs: 97 active+clean; 3.1 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 18 KiB/s wr, 7 op/s 2024-09-19T04:51:04.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:51:04 smithi116 ceph-mon[34477]: pgmap v95: 97 pgs: 97 active+clean; 3.1 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 18 KiB/s wr, 7 op/s 2024-09-19T04:51:06.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:51:06 smithi018 ceph-mon[34537]: pgmap v96: 97 pgs: 97 active+clean; 3.3 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 52 KiB/s wr, 26 op/s 2024-09-19T04:51:06.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:51:06 smithi002 ceph-mon[30975]: pgmap v96: 97 pgs: 97 active+clean; 3.3 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 52 KiB/s wr, 26 op/s 2024-09-19T04:51:06.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:51:06 smithi116 ceph-mon[34477]: pgmap v96: 97 pgs: 97 active+clean; 3.3 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 52 KiB/s wr, 26 op/s 2024-09-19T04:51:08.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:51:08 smithi018 ceph-mon[34537]: pgmap v97: 97 pgs: 97 active+clean; 3.3 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 42 KiB/s wr, 22 op/s 2024-09-19T04:51:08.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:51:08 smithi002 ceph-mon[30975]: pgmap v97: 97 pgs: 97 active+clean; 3.3 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 42 KiB/s wr, 22 op/s 2024-09-19T04:51:08.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:51:08 smithi116 ceph-mon[34477]: pgmap v97: 97 pgs: 97 active+clean; 3.3 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 42 KiB/s wr, 22 op/s 2024-09-19T04:51:10.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:51:10 smithi018 ceph-mon[34537]: pgmap v98: 97 pgs: 97 active+clean; 3.3 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 42 KiB/s wr, 22 op/s 2024-09-19T04:51:10.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:51:10 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:51:10.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:51:10 smithi002 ceph-mon[30975]: pgmap v98: 97 pgs: 97 active+clean; 3.3 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 42 KiB/s wr, 22 op/s 2024-09-19T04:51:10.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:51:10 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:51:10.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:51:10 smithi116 ceph-mon[34477]: pgmap v98: 97 pgs: 97 active+clean; 3.3 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 42 KiB/s wr, 22 op/s 2024-09-19T04:51:10.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:51:10 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:51:11.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:51:11 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:51:11.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:51:11 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:51:11.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:51:11 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:51:11.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:51:11 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:51:11.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:51:11 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:51:11.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:51:11 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:51:11.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:51:11 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:51:11.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:51:11 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:51:11.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:51:11 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:51:13.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:51:12 smithi018 ceph-mon[34537]: pgmap v99: 97 pgs: 97 active+clean; 3.3 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 50 KiB/s wr, 24 op/s 2024-09-19T04:51:13.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:51:12 smithi002 ceph-mon[30975]: pgmap v99: 97 pgs: 97 active+clean; 3.3 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 50 KiB/s wr, 24 op/s 2024-09-19T04:51:13.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:51:12 smithi116 ceph-mon[34477]: pgmap v99: 97 pgs: 97 active+clean; 3.3 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 50 KiB/s wr, 24 op/s 2024-09-19T04:51:15.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:51:14 smithi018 ceph-mon[34537]: pgmap v100: 97 pgs: 97 active+clean; 3.3 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 42 KiB/s wr, 21 op/s 2024-09-19T04:51:15.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:51:14 smithi002 ceph-mon[30975]: pgmap v100: 97 pgs: 97 active+clean; 3.3 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 42 KiB/s wr, 21 op/s 2024-09-19T04:51:15.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:51:14 smithi116 ceph-mon[34477]: pgmap v100: 97 pgs: 97 active+clean; 3.3 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 42 KiB/s wr, 21 op/s 2024-09-19T04:51:17.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:51:16 smithi018 ceph-mon[34537]: pgmap v101: 97 pgs: 97 active+clean; 3.5 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 53 KiB/s wr, 25 op/s 2024-09-19T04:51:17.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:51:16 smithi002 ceph-mon[30975]: pgmap v101: 97 pgs: 97 active+clean; 3.5 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 53 KiB/s wr, 25 op/s 2024-09-19T04:51:17.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:51:16 smithi116 ceph-mon[34477]: pgmap v101: 97 pgs: 97 active+clean; 3.5 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 53 KiB/s wr, 25 op/s 2024-09-19T04:51:18.264 INFO:tasks.workunit.client.0.smithi002.stdout:64/600: open fd = 3 2024-09-19T04:51:18.264 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.264 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.264 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.264 INFO:tasks.workunit.client.0.smithi002.stdout:65/600: open fd = 3 2024-09-19T04:51:18.264 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.265 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.265 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.265 INFO:tasks.workunit.client.0.smithi002.stdout:66/600: open fd = 3 2024-09-19T04:51:18.265 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.265 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.265 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.265 INFO:tasks.workunit.client.0.smithi002.stdout:67/600: open fd = 3 2024-09-19T04:51:18.265 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.265 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.265 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.265 INFO:tasks.workunit.client.0.smithi002.stdout:68/600: open fd = 3 2024-09-19T04:51:18.265 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.266 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.266 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.266 INFO:tasks.workunit.client.0.smithi002.stdout:69/600: open fd = 3 2024-09-19T04:51:18.266 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.266 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.266 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.266 INFO:tasks.workunit.client.0.smithi002.stdout:70/600: open fd = 3 2024-09-19T04:51:18.266 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.266 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.266 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.266 INFO:tasks.workunit.client.0.smithi002.stdout:71/600: open fd = 3 2024-09-19T04:51:18.266 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.266 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.266 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.267 INFO:tasks.workunit.client.0.smithi002.stdout:72/600: open fd = 3 2024-09-19T04:51:18.267 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.267 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.267 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.267 INFO:tasks.workunit.client.0.smithi002.stdout:73/600: open fd = 3 2024-09-19T04:51:18.267 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.267 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.267 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.267 INFO:tasks.workunit.client.0.smithi002.stdout:74/600: open fd = 3 2024-09-19T04:51:18.267 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.267 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.267 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.267 INFO:tasks.workunit.client.0.smithi002.stdout:75/600: open fd = 3 2024-09-19T04:51:18.267 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.268 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.268 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.268 INFO:tasks.workunit.client.0.smithi002.stdout:76/600: open fd = 3 2024-09-19T04:51:18.268 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.268 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.268 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.268 INFO:tasks.workunit.client.0.smithi002.stdout:77/600: open fd = 3 2024-09-19T04:51:18.268 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.268 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.268 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.268 INFO:tasks.workunit.client.0.smithi002.stdout:78/600: open fd = 3 2024-09-19T04:51:18.268 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.268 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.268 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.269 INFO:tasks.workunit.client.0.smithi002.stdout:79/600: open fd = 3 2024-09-19T04:51:18.269 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.269 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.269 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.269 INFO:tasks.workunit.client.0.smithi002.stdout:80/600: open fd = 3 2024-09-19T04:51:18.269 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.269 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.269 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.269 INFO:tasks.workunit.client.0.smithi002.stdout:81/600: open fd = 3 2024-09-19T04:51:18.269 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.269 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.269 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.269 INFO:tasks.workunit.client.0.smithi002.stdout:82/600: open fd = 3 2024-09-19T04:51:18.269 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.270 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.270 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.270 INFO:tasks.workunit.client.0.smithi002.stdout:83/600: open fd = 3 2024-09-19T04:51:18.270 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.270 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.270 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.270 INFO:tasks.workunit.client.0.smithi002.stdout:84/600: open fd = 3 2024-09-19T04:51:18.270 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.270 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.270 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.270 INFO:tasks.workunit.client.0.smithi002.stdout:85/600: open fd = 3 2024-09-19T04:51:18.270 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.270 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.271 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.271 INFO:tasks.workunit.client.0.smithi002.stdout:86/600: open fd = 3 2024-09-19T04:51:18.271 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.271 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.271 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.271 INFO:tasks.workunit.client.0.smithi002.stdout:87/600: open fd = 3 2024-09-19T04:51:18.271 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.271 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.271 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.271 INFO:tasks.workunit.client.0.smithi002.stdout:88/600: open fd = 3 2024-09-19T04:51:18.271 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.271 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.271 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.271 INFO:tasks.workunit.client.0.smithi002.stdout:89/600: open fd = 3 2024-09-19T04:51:18.272 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.272 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.272 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.272 INFO:tasks.workunit.client.0.smithi002.stdout:90/600: open fd = 3 2024-09-19T04:51:18.272 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.272 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.272 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.272 INFO:tasks.workunit.client.0.smithi002.stdout:91/600: open fd = 3 2024-09-19T04:51:18.272 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.272 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.272 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.272 INFO:tasks.workunit.client.0.smithi002.stdout:92/600: open fd = 3 2024-09-19T04:51:18.272 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.272 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.273 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.273 INFO:tasks.workunit.client.0.smithi002.stdout:93/600: open fd = 3 2024-09-19T04:51:18.273 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.273 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.273 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.273 INFO:tasks.workunit.client.0.smithi002.stdout:94/600: open fd = 3 2024-09-19T04:51:18.273 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.273 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.273 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.273 INFO:tasks.workunit.client.0.smithi002.stdout:95/600: open fd = 3 2024-09-19T04:51:18.273 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.273 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.273 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.273 INFO:tasks.workunit.client.0.smithi002.stdout:96/600: open fd = 3 2024-09-19T04:51:18.274 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.274 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.274 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.274 INFO:tasks.workunit.client.0.smithi002.stdout:97/600: open fd = 3 2024-09-19T04:51:18.274 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.274 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.274 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.274 INFO:tasks.workunit.client.0.smithi002.stdout:98/600: open fd = 3 2024-09-19T04:51:18.274 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.274 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.274 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.274 INFO:tasks.workunit.client.0.smithi002.stdout:99/600: open fd = 3 2024-09-19T04:51:18.274 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.274 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.275 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.275 INFO:tasks.workunit.client.0.smithi002.stdout:100/600: open fd = 3 2024-09-19T04:51:18.275 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.275 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.275 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.275 INFO:tasks.workunit.client.0.smithi002.stdout:101/600: open fd = 3 2024-09-19T04:51:18.275 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.275 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.275 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.275 INFO:tasks.workunit.client.0.smithi002.stdout:102/600: open fd = 3 2024-09-19T04:51:18.275 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.275 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.275 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.275 INFO:tasks.workunit.client.0.smithi002.stdout:103/600: open fd = 3 2024-09-19T04:51:18.275 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.276 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.276 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.276 INFO:tasks.workunit.client.0.smithi002.stdout:104/600: open fd = 3 2024-09-19T04:51:18.276 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.276 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.276 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.276 INFO:tasks.workunit.client.0.smithi002.stdout:105/600: open fd = 3 2024-09-19T04:51:18.276 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.276 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.276 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.276 INFO:tasks.workunit.client.0.smithi002.stdout:106/600: open fd = 3 2024-09-19T04:51:18.276 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.276 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.277 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.277 INFO:tasks.workunit.client.0.smithi002.stdout:107/600: open fd = 3 2024-09-19T04:51:18.277 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.277 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.277 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.277 INFO:tasks.workunit.client.0.smithi002.stdout:108/600: open fd = 3 2024-09-19T04:51:18.277 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.277 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.277 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.277 INFO:tasks.workunit.client.0.smithi002.stdout:109/600: open fd = 3 2024-09-19T04:51:18.277 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.278 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.278 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.278 INFO:tasks.workunit.client.0.smithi002.stdout:110/600: open fd = 3 2024-09-19T04:51:18.278 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.278 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.278 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.278 INFO:tasks.workunit.client.0.smithi002.stdout:111/600: open fd = 3 2024-09-19T04:51:18.278 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.278 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.278 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.278 INFO:tasks.workunit.client.0.smithi002.stdout:112/600: open fd = 3 2024-09-19T04:51:18.278 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.278 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.279 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.279 INFO:tasks.workunit.client.0.smithi002.stdout:113/600: open fd = 3 2024-09-19T04:51:18.279 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.279 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.279 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.279 INFO:tasks.workunit.client.0.smithi002.stdout:114/600: open fd = 3 2024-09-19T04:51:18.279 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.279 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.279 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.279 INFO:tasks.workunit.client.0.smithi002.stdout:115/600: open fd = 3 2024-09-19T04:51:18.279 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.279 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.279 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.279 INFO:tasks.workunit.client.0.smithi002.stdout:116/600: open fd = 3 2024-09-19T04:51:18.280 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.280 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.280 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.280 INFO:tasks.workunit.client.0.smithi002.stdout:117/600: open fd = 3 2024-09-19T04:51:18.280 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.280 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.280 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.280 INFO:tasks.workunit.client.0.smithi002.stdout:118/600: open fd = 3 2024-09-19T04:51:18.280 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.280 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.280 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.280 INFO:tasks.workunit.client.0.smithi002.stdout:119/600: open fd = 3 2024-09-19T04:51:18.281 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.281 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.281 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.281 INFO:tasks.workunit.client.0.smithi002.stdout:120/600: open fd = 3 2024-09-19T04:51:18.281 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.281 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.281 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.281 INFO:tasks.workunit.client.0.smithi002.stdout:121/600: open fd = 3 2024-09-19T04:51:18.281 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.281 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.281 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.282 INFO:tasks.workunit.client.0.smithi002.stdout:122/600: open fd = 3 2024-09-19T04:51:18.282 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.282 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.282 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.282 INFO:tasks.workunit.client.0.smithi002.stdout:123/600: open fd = 3 2024-09-19T04:51:18.282 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.282 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.282 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.282 INFO:tasks.workunit.client.0.smithi002.stdout:124/600: open fd = 3 2024-09-19T04:51:18.283 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.283 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.283 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.283 INFO:tasks.workunit.client.0.smithi002.stdout:125/600: open fd = 3 2024-09-19T04:51:18.283 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.283 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:18.283 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:51:18.283 INFO:tasks.workunit.client.0.smithi002.stdout:126/600: open fd = 3 2024-09-19T04:51:18.283 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:51:19.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:51:18 smithi018 ceph-mon[34537]: pgmap v102: 97 pgs: 97 active+clean; 3.5 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 6 op/s 2024-09-19T04:51:19.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:51:18 smithi002 ceph-mon[30975]: pgmap v102: 97 pgs: 97 active+clean; 3.5 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 6 op/s 2024-09-19T04:51:19.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:51:18 smithi116 ceph-mon[34477]: pgmap v102: 97 pgs: 97 active+clean; 3.5 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 6 op/s 2024-09-19T04:51:21.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:51:20 smithi018 ceph-mon[34537]: pgmap v103: 97 pgs: 97 active+clean; 3.5 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 6 op/s 2024-09-19T04:51:21.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:51:20 smithi002 ceph-mon[30975]: pgmap v103: 97 pgs: 97 active+clean; 3.5 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 6 op/s 2024-09-19T04:51:21.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:51:20 smithi116 ceph-mon[34477]: pgmap v103: 97 pgs: 97 active+clean; 3.5 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 6 op/s 2024-09-19T04:51:23.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:51:22 smithi018 ceph-mon[34537]: pgmap v104: 97 pgs: 97 active+clean; 3.6 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 29 KiB/s wr, 10 op/s 2024-09-19T04:51:23.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:51:22 smithi002 ceph-mon[30975]: pgmap v104: 97 pgs: 97 active+clean; 3.6 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 29 KiB/s wr, 10 op/s 2024-09-19T04:51:23.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:51:22 smithi116 ceph-mon[34477]: pgmap v104: 97 pgs: 97 active+clean; 3.6 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 29 KiB/s wr, 10 op/s 2024-09-19T04:51:23.863 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:51:24.139 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:51:24.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.610+0000 7f4d99147640 1 -- 172.21.15.2:0/2566165132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d9410c170 msgr2=0x7f4d9410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:51:24.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.610+0000 7f4d99147640 1 --2- 172.21.15.2:0/2566165132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d9410c170 0x7f4d9410e610 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c009900 tx=0x7f4d8c02a480 comp rx=0 tx=0).stop 2024-09-19T04:51:24.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.610+0000 7f4d99147640 1 -- 172.21.15.2:0/2566165132 shutdown_connections 2024-09-19T04:51:24.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.610+0000 7f4d99147640 1 --2- 172.21.15.2:0/2566165132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d9410c170 0x7f4d9410e610 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:24.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.610+0000 7f4d99147640 1 --2- 172.21.15.2:0/2566165132 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d94103660 0x7f4d9410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:24.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.610+0000 7f4d99147640 1 --2- 172.21.15.2:0/2566165132 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d94102d40 0x7f4d94103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:24.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.610+0000 7f4d99147640 1 -- 172.21.15.2:0/2566165132 >> 172.21.15.2:0/2566165132 conn(0x7f4d940fc7a0 msgr2=0x7f4d940febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:51:24.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.610+0000 7f4d99147640 1 -- 172.21.15.2:0/2566165132 shutdown_connections 2024-09-19T04:51:24.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.610+0000 7f4d99147640 1 -- 172.21.15.2:0/2566165132 wait complete. 2024-09-19T04:51:24.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.611+0000 7f4d99147640 1 Processor -- start 2024-09-19T04:51:24.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.611+0000 7f4d99147640 1 -- start start 2024-09-19T04:51:24.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.611+0000 7f4d99147640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d94102d40 0x7f4d941009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:24.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.611+0000 7f4d99147640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d94103660 0x7f4d94100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:24.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.611+0000 7f4d99147640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d9410c170 0x7f4d94101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:24.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.611+0000 7f4d99147640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4d94111de0 con 0x7f4d94103660 2024-09-19T04:51:24.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.611+0000 7f4d99147640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4d94111c60 con 0x7f4d9410c170 2024-09-19T04:51:24.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.611+0000 7f4d99147640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f4d94111f60 con 0x7f4d94102d40 2024-09-19T04:51:24.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.611+0000 7f4d9259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d94103660 0x7f4d94100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:24.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.611+0000 7f4d9259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d94103660 0x7f4d94100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42454/0 (socket says 172.21.15.2:42454) 2024-09-19T04:51:24.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.611+0000 7f4d9259c640 1 -- 172.21.15.2:0/2225738263 learned_addr learned my addr 172.21.15.2:0/2225738263 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:51:24.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.611+0000 7f4d92d9d640 1 --2- 172.21.15.2:0/2225738263 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d94102d40 0x7f4d941009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:24.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.612+0000 7f4d9359e640 1 --2- 172.21.15.2:0/2225738263 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d9410c170 0x7f4d94101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:24.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.612+0000 7f4d9259c640 1 -- 172.21.15.2:0/2225738263 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d94102d40 msgr2=0x7f4d941009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:51:24.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.612+0000 7f4d9259c640 1 --2- 172.21.15.2:0/2225738263 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d94102d40 0x7f4d941009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:24.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.612+0000 7f4d9259c640 1 -- 172.21.15.2:0/2225738263 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d9410c170 msgr2=0x7f4d94101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:51:24.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.612+0000 7f4d9259c640 1 --2- 172.21.15.2:0/2225738263 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d9410c170 0x7f4d94101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:24.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.612+0000 7f4d9259c640 1 -- 172.21.15.2:0/2225738263 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d941a6740 con 0x7f4d94103660 2024-09-19T04:51:24.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.612+0000 7f4d9359e640 1 --2- 172.21.15.2:0/2225738263 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d9410c170 0x7f4d94101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:51:24.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.612+0000 7f4d92d9d640 1 --2- 172.21.15.2:0/2225738263 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d94102d40 0x7f4d941009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:51:24.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.612+0000 7f4d9259c640 1 --2- 172.21.15.2:0/2225738263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d94103660 0x7f4d94100ee0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c00d740 tx=0x7f4d7c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:51:24.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.612+0000 7f4d8bfff640 1 -- 172.21.15.2:0/2225738263 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c017070 con 0x7f4d94103660 2024-09-19T04:51:24.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.612+0000 7f4d99147640 1 -- 172.21.15.2:0/2225738263 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d941a6a30 con 0x7f4d94103660 2024-09-19T04:51:24.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.612+0000 7f4d8bfff640 1 -- 172.21.15.2:0/2225738263 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4d7c00de50 con 0x7f4d94103660 2024-09-19T04:51:24.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.612+0000 7f4d8bfff640 1 -- 172.21.15.2:0/2225738263 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c00f620 con 0x7f4d94103660 2024-09-19T04:51:24.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.612+0000 7f4d99147640 1 -- 172.21.15.2:0/2225738263 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d941a6f70 con 0x7f4d94103660 2024-09-19T04:51:24.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.615+0000 7f4d8bfff640 1 -- 172.21.15.2:0/2225738263 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f4d7c009c30 con 0x7f4d94103660 2024-09-19T04:51:24.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.615+0000 7f4d9b520740 1 Processor -- start 2024-09-19T04:51:24.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.615+0000 7f4d9b520740 1 -- start start 2024-09-19T04:51:24.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.615+0000 7f4d9b520740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55573331b4a0 0x55573331b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:24.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.615+0000 7f4d9b520740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55573331bdc0 0x555733326140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:24.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.616+0000 7f4d9b520740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555733326680 0x555733328a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:24.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.616+0000 7f4d9b520740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5557332812e0 con 0x55573331bdc0 2024-09-19T04:51:24.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.616+0000 7f4d9b520740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555733228ce0 con 0x555733326680 2024-09-19T04:51:24.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.616+0000 7f4d9b520740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55573327d2a0 con 0x55573331b4a0 2024-09-19T04:51:24.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.616+0000 7f4d8bfff640 1 --2- 172.21.15.2:0/2225738263 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f4d800a33b0 0x7f4d800a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:24.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.616+0000 7f4d92d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55573331bdc0 0x555733326140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:24.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.616+0000 7f4d92d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55573331bdc0 0x555733326140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42460/0 (socket says 172.21.15.2:42460) 2024-09-19T04:51:24.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.616+0000 7f4d92d9d640 1 -- 172.21.15.2:0/3437592746 learned_addr learned my addr 172.21.15.2:0/3437592746 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:51:24.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.616+0000 7f4d9359e640 1 --2- 172.21.15.2:0/2225738263 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f4d800a33b0 0x7f4d800a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:24.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.616+0000 7f4d8bfff640 1 -- 172.21.15.2:0/2225738263 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f4d7c0cf910 con 0x7f4d94103660 2024-09-19T04:51:24.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.616+0000 7f4d9259c640 1 --2- 172.21.15.2:0/3437592746 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555733326680 0x555733328a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:24.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.616+0000 7f4d9359e640 1 --2- 172.21.15.2:0/3437592746 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55573331b4a0 0x55573331b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:24.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.616+0000 7f4d92d9d640 1 -- 172.21.15.2:0/3437592746 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55573331b4a0 msgr2=0x55573331b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:51:24.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.616+0000 7f4d92d9d640 1 --2- 172.21.15.2:0/3437592746 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55573331b4a0 0x55573331b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:24.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.616+0000 7f4d92d9d640 1 -- 172.21.15.2:0/3437592746 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555733326680 msgr2=0x555733328a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:51:24.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.616+0000 7f4d92d9d640 1 --2- 172.21.15.2:0/3437592746 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555733326680 0x555733328a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:24.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.616+0000 7f4d92d9d640 1 -- 172.21.15.2:0/3437592746 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55573320d440 con 0x55573331bdc0 2024-09-19T04:51:24.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.616+0000 7f4d92d9d640 1 --2- 172.21.15.2:0/3437592746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55573331bdc0 0x555733326140 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f4d84007f70 tx=0x7f4d8400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6bc302f9f1104dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:51:24.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.616+0000 7f4d9359e640 1 --2- 172.21.15.2:0/2225738263 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f4d800a33b0 0x7f4d800a5870 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c009900 tx=0x7f4d8c031400 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:51:24.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.617+0000 7f4d897fa640 1 -- 172.21.15.2:0/3437592746 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d84017dd0 con 0x55573331bdc0 2024-09-19T04:51:24.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.617+0000 7f4d897fa640 1 -- 172.21.15.2:0/3437592746 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4d84005020 con 0x55573331bdc0 2024-09-19T04:51:24.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.617+0000 7f4d897fa640 1 -- 172.21.15.2:0/3437592746 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d840206c0 con 0x55573331bdc0 2024-09-19T04:51:24.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.617+0000 7f4d9b520740 1 -- 172.21.15.2:0/3437592746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55573331bdc0 msgr2=0x555733326140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:51:24.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.617+0000 7f4d9b520740 1 --2- 172.21.15.2:0/3437592746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55573331bdc0 0x555733326140 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f4d84007f70 tx=0x7f4d8400e720 comp rx=0 tx=0).stop 2024-09-19T04:51:24.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.617+0000 7f4d9b520740 1 -- 172.21.15.2:0/3437592746 shutdown_connections 2024-09-19T04:51:24.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.617+0000 7f4d9b520740 1 --2- 172.21.15.2:0/3437592746 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555733326680 0x555733328a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:24.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.617+0000 7f4d9b520740 1 --2- 172.21.15.2:0/3437592746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55573331bdc0 0x555733326140 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:24.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.617+0000 7f4d9b520740 1 --2- 172.21.15.2:0/3437592746 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55573331b4a0 0x55573331b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:24.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.617+0000 7f4d9b520740 1 -- 172.21.15.2:0/3437592746 >> 172.21.15.2:0/3437592746 conn(0x555733317a30 msgr2=0x555733317e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:51:24.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.617+0000 7f4d9b520740 1 -- 172.21.15.2:0/3437592746 shutdown_connections 2024-09-19T04:51:24.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.617+0000 7f4d9b520740 1 -- 172.21.15.2:0/3437592746 wait complete. 2024-09-19T04:51:24.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.618+0000 7f4d9b520740 1 -- start start 2024-09-19T04:51:24.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.618+0000 7f4d9b520740 1 Processor -- start 2024-09-19T04:51:24.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.618+0000 7f4d9b520740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55573331b4a0 0x555733325f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:24.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.618+0000 7f4d9b520740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55573331bdc0 0x555733323210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:24.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.618+0000 7f4d9b520740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555733326680 0x555733323750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:24.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.618+0000 7f4d9b520740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555733329250 con 0x555733326680 2024-09-19T04:51:24.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.618+0000 7f4d9b520740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55573323c050 con 0x55573331b4a0 2024-09-19T04:51:24.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.618+0000 7f4d9b520740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5557333293d0 con 0x55573331bdc0 2024-09-19T04:51:24.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.618+0000 7f4d9b520740 10 client.0 _ll_register_callbacks cb 0x55573327c160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:51:24.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.618+0000 7f4d9359e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555733326680 0x555733323750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:24.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.618+0000 7f4d9359e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555733326680 0x555733323750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42472/0 (socket says 172.21.15.2:42472) 2024-09-19T04:51:24.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.618+0000 7f4d9359e640 1 -- 172.21.15.2:0/846576139 learned_addr learned my addr 172.21.15.2:0/846576139 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:51:24.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.619+0000 7f4d92d9d640 1 --2- 172.21.15.2:0/846576139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55573331b4a0 0x555733325f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:24.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.619+0000 7f4d9259c640 1 --2- 172.21.15.2:0/846576139 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55573331bdc0 0x555733323210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:24.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.619+0000 7f4d9359e640 1 -- 172.21.15.2:0/846576139 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55573331bdc0 msgr2=0x555733323210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:51:24.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.619+0000 7f4d9359e640 1 --2- 172.21.15.2:0/846576139 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55573331bdc0 0x555733323210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:24.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.619+0000 7f4d9359e640 1 -- 172.21.15.2:0/846576139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55573331b4a0 msgr2=0x555733325f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:51:24.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.619+0000 7f4d9359e640 1 --2- 172.21.15.2:0/846576139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55573331b4a0 0x555733325f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:24.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.619+0000 7f4d9359e640 1 -- 172.21.15.2:0/846576139 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555732ff23c0 con 0x555733326680 2024-09-19T04:51:24.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.619+0000 7f4d9359e640 1 --2- 172.21.15.2:0/846576139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555733326680 0x555733323750 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c0042f0 tx=0x7f4d8c02a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b50f50f32ced730 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:51:24.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.619+0000 7f4d7a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:51:24.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.619+0000 7f4d7a7fc640 1 -- 172.21.15.2:0/846576139 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c04d020 con 0x555733326680 2024-09-19T04:51:24.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.619+0000 7f4d7a7fc640 1 -- 172.21.15.2:0/846576139 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f4d8c0046c0 con 0x555733326680 2024-09-19T04:51:24.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.619+0000 7f4d9b520740 1 -- 172.21.15.2:0/846576139 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d84005020 con 0x555733326680 2024-09-19T04:51:24.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.619+0000 7f4d7a7fc640 1 -- 172.21.15.2:0/846576139 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4d8c058050 con 0x555733326680 2024-09-19T04:51:24.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.619+0000 7f4d9b520740 10 client.15666 fetch_fsmap learned FSMap version 19 2024-09-19T04:51:24.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.619+0000 7f4d9b520740 1 -- 172.21.15.2:0/846576139 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x555733334c10 con 0x555733326680 2024-09-19T04:51:24.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.619+0000 7f4d7a7fc640 1 -- 172.21.15.2:0/846576139 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4d84005020 con 0x555733326680 2024-09-19T04:51:24.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.620+0000 7f4d7a7fc640 1 -- 172.21.15.2:0/846576139 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f4d8c03a040 con 0x555733326680 2024-09-19T04:51:24.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.620+0000 7f4d9b520740 10 client.15666 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:51:24.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.620+0000 7f4d9b520740 10 client.15666 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:51:24.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.620+0000 7f4d9b520740 20 client.15666 populate_metadata read hostname 'smithi002' 2024-09-19T04:51:24.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.620+0000 7f4d9b520740 1 --2- 172.21.15.2:0/846576139 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5557333360d0 0x555733338570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:24.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.620+0000 7f4d9b520740 4 client.15666 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:51:24.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.620+0000 7f4d9b520740 1 -- 172.21.15.2:0/846576139 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55573328e850 con 0x5557333360d0 2024-09-19T04:51:24.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.620+0000 7f4d92d9d640 1 --2- 172.21.15.2:0/846576139 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5557333360d0 0x555733338570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:24.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.620+0000 7f4d92d9d640 1 --2- 172.21.15.2:0/846576139 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5557333360d0 0x555733338570 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24cb519dad89d911 server_cookie=6e271195554c4ef3 in_seq=0 out_seq=0 2024-09-19T04:51:24.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.620+0000 7f4d7a7fc640 10 client.15666 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:51:24.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.621+0000 7f4d7a7fc640 1 -- 172.21.15.2:0/846576139 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55573328e850 con 0x5557333360d0 2024-09-19T04:51:24.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.621+0000 7f4d7a7fc640 10 client.15666 handle_command_reply: tid=0 2024-09-19T04:51:24.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.621+0000 7f4d9b520740 1 client.15666 shutdown 2024-09-19T04:51:24.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.621+0000 7f4d9b520740 1 -- 172.21.15.2:0/846576139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555733326680 msgr2=0x555733323750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:51:24.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.621+0000 7f4d9b520740 1 --2- 172.21.15.2:0/846576139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555733326680 0x555733323750 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c0042f0 tx=0x7f4d8c02a480 comp rx=0 tx=0).stop 2024-09-19T04:51:24.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.621+0000 7f4d9b520740 1 -- 172.21.15.2:0/846576139 shutdown_connections 2024-09-19T04:51:24.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.621+0000 7f4d9b520740 1 --2- 172.21.15.2:0/846576139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555733326680 0x555733323750 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:24.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.621+0000 7f4d9b520740 1 --2- 172.21.15.2:0/846576139 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5557333360d0 0x555733338570 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:24.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.621+0000 7f4d9b520740 1 --2- 172.21.15.2:0/846576139 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55573331bdc0 0x555733323210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:24.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.621+0000 7f4d9b520740 1 --2- 172.21.15.2:0/846576139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55573331b4a0 0x555733325f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:24.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.621+0000 7f4d9b520740 1 -- 172.21.15.2:0/846576139 >> 172.21.15.2:0/846576139 conn(0x555733317a30 msgr2=0x55573331d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:51:24.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.621+0000 7f4d7a7fc640 0 client.15666 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:51:24.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.621+0000 7f4d9b520740 1 -- 172.21.15.2:0/846576139 shutdown_connections 2024-09-19T04:51:24.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.622+0000 7f4d9b520740 1 -- 172.21.15.2:0/846576139 wait complete. 2024-09-19T04:51:24.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.622+0000 7f4d9b520740 20 client.15666 trim_cache size 0 max 16384 2024-09-19T04:51:24.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.638+0000 7f4d9b520740 1 Processor -- start 2024-09-19T04:51:24.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.639+0000 7f4d9b520740 1 -- start start 2024-09-19T04:51:24.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.639+0000 7f4d9b520740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55573331b4a0 0x555733325180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:24.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.639+0000 7f4d9b520740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55573331bdc0 0x55573333de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:24.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.639+0000 7f4d9b520740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555733326680 0x55573333e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:24.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.639+0000 7f4d9b520740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4d941a9420 con 0x55573331b4a0 2024-09-19T04:51:24.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.639+0000 7f4d9b520740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4d941abca0 con 0x55573331bdc0 2024-09-19T04:51:24.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.639+0000 7f4d9b520740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f4d941a9a90 con 0x555733326680 2024-09-19T04:51:24.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.639+0000 7f4d92d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55573331b4a0 0x555733325180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:24.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.639+0000 7f4d92d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55573331b4a0 0x555733325180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42474/0 (socket says 172.21.15.2:42474) 2024-09-19T04:51:24.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.639+0000 7f4d92d9d640 1 -- 172.21.15.2:0/1087524802 learned_addr learned my addr 172.21.15.2:0/1087524802 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:51:24.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.639+0000 7f4d9259c640 1 --2- 172.21.15.2:0/1087524802 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55573331bdc0 0x55573333de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:24.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.639+0000 7f4d92d9d640 1 -- 172.21.15.2:0/1087524802 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555733326680 msgr2=0x55573333e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:51:24.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.639+0000 7f4d92d9d640 1 --2- 172.21.15.2:0/1087524802 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555733326680 0x55573333e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:24.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.639+0000 7f4d92d9d640 1 -- 172.21.15.2:0/1087524802 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55573331bdc0 msgr2=0x55573333de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:51:24.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.639+0000 7f4d92d9d640 1 --2- 172.21.15.2:0/1087524802 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55573331bdc0 0x55573333de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:24.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.639+0000 7f4d92d9d640 1 -- 172.21.15.2:0/1087524802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555733321760 con 0x55573331b4a0 2024-09-19T04:51:24.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.639+0000 7f4d9259c640 1 --2- 172.21.15.2:0/1087524802 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55573331bdc0 0x55573333de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:51:24.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.639+0000 7f4d92d9d640 1 --2- 172.21.15.2:0/1087524802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55573331b4a0 0x555733325180 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x555733318890 tx=0x7f4d8400ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a1e2f171ed416be server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:51:24.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.640+0000 7f4d88ff9640 1 -- 172.21.15.2:0/1087524802 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d84033070 con 0x55573331b4a0 2024-09-19T04:51:24.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.640+0000 7f4d88ff9640 1 -- 172.21.15.2:0/1087524802 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4d84005990 con 0x55573331b4a0 2024-09-19T04:51:24.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.640+0000 7f4d88ff9640 1 -- 172.21.15.2:0/1087524802 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d8402d3e0 con 0x55573331b4a0 2024-09-19T04:51:24.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.640+0000 7f4d9b520740 1 -- 172.21.15.2:0/1087524802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55573331b4a0 msgr2=0x555733325180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:51:24.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.640+0000 7f4d9b520740 1 --2- 172.21.15.2:0/1087524802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55573331b4a0 0x555733325180 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x555733318890 tx=0x7f4d8400ef90 comp rx=0 tx=0).stop 2024-09-19T04:51:24.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.640+0000 7f4d9b520740 1 -- 172.21.15.2:0/1087524802 shutdown_connections 2024-09-19T04:51:24.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.640+0000 7f4d9b520740 1 --2- 172.21.15.2:0/1087524802 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555733326680 0x55573333e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:24.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.640+0000 7f4d9b520740 1 --2- 172.21.15.2:0/1087524802 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55573331bdc0 0x55573333de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:24.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.640+0000 7f4d9b520740 1 --2- 172.21.15.2:0/1087524802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55573331b4a0 0x555733325180 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:24.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.640+0000 7f4d9b520740 1 -- 172.21.15.2:0/1087524802 >> 172.21.15.2:0/1087524802 conn(0x555733317a30 msgr2=0x555733324a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:51:24.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.640+0000 7f4d9b520740 1 -- 172.21.15.2:0/1087524802 shutdown_connections 2024-09-19T04:51:24.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.640+0000 7f4d9b520740 1 -- 172.21.15.2:0/1087524802 wait complete. 2024-09-19T04:51:24.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.641+0000 7f4d9b520740 1 -- start start 2024-09-19T04:51:24.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.641+0000 7f4d9b520740 1 Processor -- start 2024-09-19T04:51:24.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.641+0000 7f4d9b520740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55573331b4a0 0x55573332ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:24.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.641+0000 7f4d9b520740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55573331bdc0 0x55573332c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:24.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.641+0000 7f4d9b520740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555733326680 0x55573332c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:24.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.641+0000 7f4d9b520740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4d941aa160 con 0x555733326680 2024-09-19T04:51:24.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.641+0000 7f4d9b520740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4d941ab5d0 con 0x55573331b4a0 2024-09-19T04:51:24.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.641+0000 7f4d9b520740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f4d941aa830 con 0x55573331bdc0 2024-09-19T04:51:24.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.641+0000 7f4d9b520740 10 client.0 _ll_register_callbacks cb 0x7f4d8c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:51:24.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.641+0000 7f4d9359e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555733326680 0x55573332c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:24.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.641+0000 7f4d9359e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555733326680 0x55573332c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42488/0 (socket says 172.21.15.2:42488) 2024-09-19T04:51:24.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.641+0000 7f4d9359e640 1 -- 172.21.15.2:0/2407463315 learned_addr learned my addr 172.21.15.2:0/2407463315 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:51:24.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.642+0000 7f4d92d9d640 1 --2- 172.21.15.2:0/2407463315 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55573331b4a0 0x55573332ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:24.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.642+0000 7f4d9259c640 1 --2- 172.21.15.2:0/2407463315 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55573331bdc0 0x55573332c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:24.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.642+0000 7f4d9359e640 1 -- 172.21.15.2:0/2407463315 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55573331bdc0 msgr2=0x55573332c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:51:24.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.642+0000 7f4d9359e640 1 --2- 172.21.15.2:0/2407463315 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55573331bdc0 0x55573332c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:24.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.642+0000 7f4d9359e640 1 -- 172.21.15.2:0/2407463315 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55573331b4a0 msgr2=0x55573332ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:51:24.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.642+0000 7f4d9359e640 1 --2- 172.21.15.2:0/2407463315 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55573331b4a0 0x55573332ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:24.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.642+0000 7f4d9359e640 1 -- 172.21.15.2:0/2407463315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55573332cd80 con 0x555733326680 2024-09-19T04:51:24.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.642+0000 7f4d92d9d640 1 --2- 172.21.15.2:0/2407463315 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55573331b4a0 0x55573332ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:51:24.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.642+0000 7f4d9259c640 1 --2- 172.21.15.2:0/2407463315 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55573331bdc0 0x55573332c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:51:24.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.642+0000 7f4d9359e640 1 --2- 172.21.15.2:0/2407463315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555733326680 0x55573332c570 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c009850 tx=0x7f4d8c032f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f446e935e5d9d850 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:51:24.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.642+0000 7f4d7a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:51:24.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.642+0000 7f4d7a7fc640 1 -- 172.21.15.2:0/2407463315 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c04d070 con 0x555733326680 2024-09-19T04:51:24.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.642+0000 7f4d7a7fc640 1 -- 172.21.15.2:0/2407463315 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f4d8c0037f0 con 0x555733326680 2024-09-19T04:51:24.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.642+0000 7f4d9b520740 1 -- 172.21.15.2:0/2407463315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d84005990 con 0x555733326680 2024-09-19T04:51:24.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.642+0000 7f4d7a7fc640 1 -- 172.21.15.2:0/2407463315 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4d8c06a050 con 0x555733326680 2024-09-19T04:51:24.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.642+0000 7f4d9b520740 10 client.15672 fetch_fsmap learned FSMap version 19 2024-09-19T04:51:24.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.642+0000 7f4d9b520740 1 -- 172.21.15.2:0/2407463315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5557333a0df0 con 0x555733326680 2024-09-19T04:51:24.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.643+0000 7f4d7a7fc640 1 -- 172.21.15.2:0/2407463315 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4d84005990 con 0x555733326680 2024-09-19T04:51:24.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.643+0000 7f4d7a7fc640 1 -- 172.21.15.2:0/2407463315 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f4d8c03a040 con 0x555733326680 2024-09-19T04:51:24.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.643+0000 7f4d9b520740 10 client.15672 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:51:24.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.643+0000 7f4d9b520740 10 client.15672 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:51:24.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.643+0000 7f4d9b520740 20 client.15672 populate_metadata read hostname 'smithi002' 2024-09-19T04:51:24.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.643+0000 7f4d9b520740 1 --2- 172.21.15.2:0/2407463315 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5557333a1500 0x5557333a3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:24.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.643+0000 7f4d9b520740 4 client.15672 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:51:24.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.643+0000 7f4d9b520740 1 -- 172.21.15.2:0/2407463315 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555733288d60 con 0x5557333a1500 2024-09-19T04:51:24.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.643+0000 7f4d92d9d640 1 --2- 172.21.15.2:0/2407463315 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5557333a1500 0x5557333a3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:24.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.644+0000 7f4d92d9d640 1 --2- 172.21.15.2:0/2407463315 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5557333a1500 0x5557333a3920 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a4786495268304 server_cookie=45d367a2dd256ab1 in_seq=0 out_seq=0 2024-09-19T04:51:24.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.644+0000 7f4d7a7fc640 10 client.15672 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:51:24.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.644+0000 7f4d7a7fc640 1 -- 172.21.15.2:0/2407463315 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x555733288d60 con 0x5557333a1500 2024-09-19T04:51:24.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.644+0000 7f4d7a7fc640 10 client.15672 handle_command_reply: tid=0 2024-09-19T04:51:24.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.644+0000 7f4d9b520740 1 client.15672 shutdown 2024-09-19T04:51:24.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.644+0000 7f4d9b520740 1 -- 172.21.15.2:0/2407463315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555733326680 msgr2=0x55573332c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:51:24.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.644+0000 7f4d9b520740 1 --2- 172.21.15.2:0/2407463315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555733326680 0x55573332c570 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c009850 tx=0x7f4d8c032f80 comp rx=0 tx=0).stop 2024-09-19T04:51:24.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.644+0000 7f4d9b520740 1 -- 172.21.15.2:0/2407463315 shutdown_connections 2024-09-19T04:51:24.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.644+0000 7f4d9b520740 1 --2- 172.21.15.2:0/2407463315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555733326680 0x55573332c570 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:24.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.644+0000 7f4d9b520740 1 --2- 172.21.15.2:0/2407463315 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5557333a1500 0x5557333a3920 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:24.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.644+0000 7f4d9b520740 1 --2- 172.21.15.2:0/2407463315 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55573331bdc0 0x55573332c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:24.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.644+0000 7f4d7a7fc640 0 client.15672 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:51:24.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.644+0000 7f4d9b520740 1 --2- 172.21.15.2:0/2407463315 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55573331b4a0 0x55573332ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:24.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.644+0000 7f4d9b520740 1 -- 172.21.15.2:0/2407463315 >> 172.21.15.2:0/2407463315 conn(0x555733317a30 msgr2=0x555733325290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:51:24.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.644+0000 7f4d9b520740 1 -- 172.21.15.2:0/2407463315 shutdown_connections 2024-09-19T04:51:24.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.644+0000 7f4d9b520740 1 -- 172.21.15.2:0/2407463315 wait complete. 2024-09-19T04:51:24.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.644+0000 7f4d9b520740 20 client.15672 trim_cache size 0 max 16384 2024-09-19T04:51:24.664 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:51:24.664 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T04:51:24.664 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T04:51:24.664 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:51:24.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.645+0000 7f4d99147640 1 -- 172.21.15.2:0/2225738263 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f4d800a33b0 msgr2=0x7f4d800a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:51:24.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.645+0000 7f4d99147640 1 --2- 172.21.15.2:0/2225738263 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f4d800a33b0 0x7f4d800a5870 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c009900 tx=0x7f4d8c031400 comp rx=0 tx=0).stop 2024-09-19T04:51:24.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.645+0000 7f4d99147640 1 -- 172.21.15.2:0/2225738263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d94103660 msgr2=0x7f4d94100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:51:24.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.645+0000 7f4d99147640 1 --2- 172.21.15.2:0/2225738263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d94103660 0x7f4d94100ee0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c00d740 tx=0x7f4d7c00dc00 comp rx=0 tx=0).stop 2024-09-19T04:51:24.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.645+0000 7f4d99147640 1 -- 172.21.15.2:0/2225738263 shutdown_connections 2024-09-19T04:51:24.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.645+0000 7f4d99147640 1 --2- 172.21.15.2:0/2225738263 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d9410c170 0x7f4d94101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:24.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.645+0000 7f4d99147640 1 --2- 172.21.15.2:0/2225738263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d94103660 0x7f4d94100ee0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:24.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.645+0000 7f4d99147640 1 --2- 172.21.15.2:0/2225738263 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f4d800a33b0 0x7f4d800a5870 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:24.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.645+0000 7f4d99147640 1 --2- 172.21.15.2:0/2225738263 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d94102d40 0x7f4d941009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:24.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.645+0000 7f4d99147640 1 -- 172.21.15.2:0/2225738263 >> 172.21.15.2:0/2225738263 conn(0x7f4d940fc7a0 msgr2=0x7f4d940fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:51:24.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.645+0000 7f4d99147640 1 -- 172.21.15.2:0/2225738263 shutdown_connections 2024-09-19T04:51:24.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:24.645+0000 7f4d99147640 1 -- 172.21.15.2:0/2225738263 wait complete. 2024-09-19T04:51:25.285 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:51:24 smithi002 ceph-mon[30975]: pgmap v105: 97 pgs: 97 active+clean; 3.6 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 7 op/s 2024-09-19T04:51:25.306 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:51:24 smithi018 ceph-mon[34537]: pgmap v105: 97 pgs: 97 active+clean; 3.6 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 7 op/s 2024-09-19T04:51:25.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:51:24 smithi116 ceph-mon[34477]: pgmap v105: 97 pgs: 97 active+clean; 3.6 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 7 op/s 2024-09-19T04:51:25.419 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:51:25.419 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:51:25.689 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:51:26.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.166+0000 7fc8a407b640 1 -- 172.21.15.2:0/2675767918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc89c106050 msgr2=0x7fc89c10dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:51:26.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.166+0000 7fc8a407b640 1 --2- 172.21.15.2:0/2675767918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc89c106050 0x7fc89c10dbd0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc894009ca0 tx=0x7fc89402a8c0 comp rx=0 tx=0).stop 2024-09-19T04:51:26.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.166+0000 7fc8a407b640 1 -- 172.21.15.2:0/2675767918 shutdown_connections 2024-09-19T04:51:26.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.166+0000 7fc8a407b640 1 --2- 172.21.15.2:0/2675767918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc89c106050 0x7fc89c10dbd0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:26.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.166+0000 7fc8a407b640 1 --2- 172.21.15.2:0/2675767918 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc89c101df0 0x7fc89c105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:26.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.166+0000 7fc8a407b640 1 --2- 172.21.15.2:0/2675767918 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc89c101440 0x7fc89c101820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:26.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.166+0000 7fc8a407b640 1 -- 172.21.15.2:0/2675767918 >> 172.21.15.2:0/2675767918 conn(0x7fc89c077210 msgr2=0x7fc89c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:51:26.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.167+0000 7fc8a407b640 1 -- 172.21.15.2:0/2675767918 shutdown_connections 2024-09-19T04:51:26.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.167+0000 7fc8a407b640 1 -- 172.21.15.2:0/2675767918 wait complete. 2024-09-19T04:51:26.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.167+0000 7fc8a407b640 1 Processor -- start 2024-09-19T04:51:26.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.167+0000 7fc8a407b640 1 -- start start 2024-09-19T04:51:26.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.168+0000 7fc8a407b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc89c101440 0x7fc89c197440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:26.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.168+0000 7fc8a407b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc89c101df0 0x7fc89c197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:26.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.168+0000 7fc8a407b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc89c106050 0x7fc89c19bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:26.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.168+0000 7fc8a407b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc89c110f00 con 0x7fc89c101440 2024-09-19T04:51:26.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.168+0000 7fc8a407b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc89c110d80 con 0x7fc89c101df0 2024-09-19T04:51:26.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.168+0000 7fc8a407b640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fc89c111080 con 0x7fc89c106050 2024-09-19T04:51:26.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.168+0000 7fc8a1e17640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc89c101440 0x7fc89c197440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:26.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.168+0000 7fc8a1e17640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc89c101440 0x7fc89c197440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42510/0 (socket says 172.21.15.2:42510) 2024-09-19T04:51:26.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.168+0000 7fc8a1e17640 1 -- 172.21.15.2:0/2766630256 learned_addr learned my addr 172.21.15.2:0/2766630256 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:51:26.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.168+0000 7fc8a1e17640 1 -- 172.21.15.2:0/2766630256 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc89c106050 msgr2=0x7fc89c19bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:51:26.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.168+0000 7fc8a1616640 1 --2- 172.21.15.2:0/2766630256 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc89c101df0 0x7fc89c197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:26.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.168+0000 7fc8a1e17640 1 --2- 172.21.15.2:0/2766630256 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc89c106050 0x7fc89c19bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:26.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.168+0000 7fc8a1e17640 1 -- 172.21.15.2:0/2766630256 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc89c101df0 msgr2=0x7fc89c197980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:51:26.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.168+0000 7fc8a1e17640 1 --2- 172.21.15.2:0/2766630256 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc89c101df0 0x7fc89c197980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:26.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.168+0000 7fc8a1e17640 1 -- 172.21.15.2:0/2766630256 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc89c19c3f0 con 0x7fc89c101440 2024-09-19T04:51:26.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.168+0000 7fc8a1e17640 1 --2- 172.21.15.2:0/2766630256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc89c101440 0x7fc89c197440 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fc89800c890 tx=0x7fc89800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:51:26.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.168+0000 7fc892ffd640 1 -- 172.21.15.2:0/2766630256 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc898004220 con 0x7fc89c101440 2024-09-19T04:51:26.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.168+0000 7fc892ffd640 1 -- 172.21.15.2:0/2766630256 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc8980043c0 con 0x7fc89c101440 2024-09-19T04:51:26.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.169+0000 7fc8a407b640 1 -- 172.21.15.2:0/2766630256 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc89c19c6e0 con 0x7fc89c101440 2024-09-19T04:51:26.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.169+0000 7fc892ffd640 1 -- 172.21.15.2:0/2766630256 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc898004a00 con 0x7fc89c101440 2024-09-19T04:51:26.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.169+0000 7fc8a407b640 1 -- 172.21.15.2:0/2766630256 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc89c1a3fc0 con 0x7fc89c101440 2024-09-19T04:51:26.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.169+0000 7fc8a407b640 1 -- 172.21.15.2:0/2766630256 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc89c101820 con 0x7fc89c101440 2024-09-19T04:51:26.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.171+0000 7fc892ffd640 1 -- 172.21.15.2:0/2766630256 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fc898004ba0 con 0x7fc89c101440 2024-09-19T04:51:26.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.171+0000 7fc892ffd640 1 --2- 172.21.15.2:0/2766630256 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fc8880a3430 0x7fc8880a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:26.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.171+0000 7fc8a1616640 1 --2- 172.21.15.2:0/2766630256 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fc8880a3430 0x7fc8880a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:26.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.171+0000 7fc892ffd640 1 -- 172.21.15.2:0/2766630256 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7fc8980cfe40 con 0x7fc89c101440 2024-09-19T04:51:26.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.172+0000 7fc8a1616640 1 --2- 172.21.15.2:0/2766630256 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fc8880a3430 0x7fc8880a58f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc89c1038a0 tx=0x7fc88c005ed0 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:51:26.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.175+0000 7fc892ffd640 1 -- 172.21.15.2:0/2766630256 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc898014030 con 0x7fc89c101440 2024-09-19T04:51:26.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.388+0000 7fc8a407b640 1 -- 172.21.15.2:0/2766630256 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc89c1987a0 con 0x7fc89c101440 2024-09-19T04:51:26.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.389+0000 7fc892ffd640 1 -- 172.21.15.2:0/2766630256 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11840 (secure 0 0 0) 0x7fc89809c8c0 con 0x7fc89c101440 2024-09-19T04:51:26.391 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:51:26.391 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":19,"btime":"2024-09-19T04:46:33:537239+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2467365137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2467365137},{"type":"v1","addr":"172.21.15.2:6835","nonce":2467365137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3162441888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3162441888},{"type":"v1","addr":"172.21.15.2:6837","nonce":3162441888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14631,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2740862966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2740862966},{"type":"v1","addr":"172.21.15.2:6839","nonce":2740862966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/2394435504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2394435504},{"type":"v1","addr":"172.21.15.2:6841","nonce":2394435504}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1630480244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1630480244},{"type":"v1","addr":"172.21.15.18:6833","nonce":1630480244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1553897465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1553897465},{"type":"v1","addr":"172.21.15.116:6833","nonce":1553897465}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3035664608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3035664608},{"type":"v1","addr":"172.21.15.18:6835","nonce":3035664608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1096622392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1096622392},{"type":"v1","addr":"172.21.15.18:6837","nonce":1096622392}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3761157675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3761157675},{"type":"v1","addr":"172.21.15.116:6835","nonce":3761157675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/1120131594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1120131594},{"type":"v1","addr":"172.21.15.116:6837","nonce":1120131594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:46:24.050115+0000","modified":"2024-09-19T04:46:33.112369+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/4207677139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":4207677139},{"type":"v1","addr":"172.21.15.18:6839","nonce":4207677139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/2346874880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":2346874880},{"type":"v1","addr":"172.21.15.116:6839","nonce":2346874880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496]},"id":1}]} 2024-09-19T04:51:26.391 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 19 2024-09-19T04:51:26.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.391+0000 7fc8a407b640 1 -- 172.21.15.2:0/2766630256 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fc8880a3430 msgr2=0x7fc8880a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:51:26.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.391+0000 7fc8a407b640 1 --2- 172.21.15.2:0/2766630256 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fc8880a3430 0x7fc8880a58f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc89c1038a0 tx=0x7fc88c005ed0 comp rx=0 tx=0).stop 2024-09-19T04:51:26.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.391+0000 7fc8a407b640 1 -- 172.21.15.2:0/2766630256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc89c101440 msgr2=0x7fc89c197440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:51:26.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.391+0000 7fc8a407b640 1 --2- 172.21.15.2:0/2766630256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc89c101440 0x7fc89c197440 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fc89800c890 tx=0x7fc89800cd50 comp rx=0 tx=0).stop 2024-09-19T04:51:26.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.391+0000 7fc8a407b640 1 -- 172.21.15.2:0/2766630256 shutdown_connections 2024-09-19T04:51:26.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.391+0000 7fc8a407b640 1 --2- 172.21.15.2:0/2766630256 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fc8880a3430 0x7fc8880a58f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:26.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.391+0000 7fc8a407b640 1 --2- 172.21.15.2:0/2766630256 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc89c106050 0x7fc89c19bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:26.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.391+0000 7fc8a407b640 1 --2- 172.21.15.2:0/2766630256 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc89c101df0 0x7fc89c197980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:26.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.391+0000 7fc8a407b640 1 --2- 172.21.15.2:0/2766630256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc89c101440 0x7fc89c197440 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:26.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.391+0000 7fc8a407b640 1 -- 172.21.15.2:0/2766630256 >> 172.21.15.2:0/2766630256 conn(0x7fc89c077210 msgr2=0x7fc89c104950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:51:26.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.391+0000 7fc8a407b640 1 -- 172.21.15.2:0/2766630256 shutdown_connections 2024-09-19T04:51:26.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:26.391+0000 7fc8a407b640 1 -- 172.21.15.2:0/2766630256 wait complete. 2024-09-19T04:51:27.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:51:26 smithi002 ceph-mon[30975]: pgmap v106: 97 pgs: 97 active+clean; 3.7 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 33 KiB/s wr, 11 op/s 2024-09-19T04:51:27.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:51:26 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/2766630256' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:51:27.276 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:51:27.306 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:51:26 smithi018 ceph-mon[34537]: pgmap v106: 97 pgs: 97 active+clean; 3.7 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 33 KiB/s wr, 11 op/s 2024-09-19T04:51:27.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:51:26 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/2766630256' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:51:27.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:51:26 smithi116 ceph-mon[34477]: pgmap v106: 97 pgs: 97 active+clean; 3.7 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 33 KiB/s wr, 11 op/s 2024-09-19T04:51:27.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:51:26 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/2766630256' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:51:27.546 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:51:28.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.000+0000 7f3840fc0640 1 -- 172.21.15.2:0/984147534 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f383c101de0 msgr2=0x7f383c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:51:28.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.000+0000 7f3840fc0640 1 --2- 172.21.15.2:0/984147534 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f383c101de0 0x7f383c1021c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f382c009900 tx=0x7f382c02a410 comp rx=0 tx=0).stop 2024-09-19T04:51:28.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.001+0000 7f3840fc0640 1 -- 172.21.15.2:0/984147534 shutdown_connections 2024-09-19T04:51:28.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.001+0000 7f3840fc0640 1 --2- 172.21.15.2:0/984147534 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f383c106f10 0x7f383c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:28.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.001+0000 7f3840fc0640 1 --2- 172.21.15.2:0/984147534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f383c102790 0x7f383c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:28.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.001+0000 7f3840fc0640 1 --2- 172.21.15.2:0/984147534 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f383c101de0 0x7f383c1021c0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:28.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.001+0000 7f3840fc0640 1 -- 172.21.15.2:0/984147534 >> 172.21.15.2:0/984147534 conn(0x7f383c0fd8c0 msgr2=0x7f383c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:51:28.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.001+0000 7f3840fc0640 1 -- 172.21.15.2:0/984147534 shutdown_connections 2024-09-19T04:51:28.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.001+0000 7f3840fc0640 1 -- 172.21.15.2:0/984147534 wait complete. 2024-09-19T04:51:28.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.001+0000 7f3840fc0640 1 Processor -- start 2024-09-19T04:51:28.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.002+0000 7f3840fc0640 1 -- start start 2024-09-19T04:51:28.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.002+0000 7f3840fc0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f383c101de0 0x7f383c198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:28.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.002+0000 7f3840fc0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f383c102790 0x7f383c1988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:28.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.002+0000 7f3840fc0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f383c106f10 0x7f383c19cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:28.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.002+0000 7f3840fc0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f383c111de0 con 0x7f383c102790 2024-09-19T04:51:28.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.002+0000 7f3840fc0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f383c111c60 con 0x7f383c101de0 2024-09-19T04:51:28.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.002+0000 7f3840fc0640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f383c111f60 con 0x7f383c106f10 2024-09-19T04:51:28.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.002+0000 7f3839d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f383c102790 0x7f383c1988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:28.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.002+0000 7f3839d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f383c102790 0x7f383c1988c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42538/0 (socket says 172.21.15.2:42538) 2024-09-19T04:51:28.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.002+0000 7f3839d9b640 1 -- 172.21.15.2:0/4256066671 learned_addr learned my addr 172.21.15.2:0/4256066671 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:51:28.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.002+0000 7f383ad9d640 1 --2- 172.21.15.2:0/4256066671 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f383c106f10 0x7f383c19cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:28.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.002+0000 7f383a59c640 1 --2- 172.21.15.2:0/4256066671 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f383c101de0 0x7f383c198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:28.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.002+0000 7f3839d9b640 1 -- 172.21.15.2:0/4256066671 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f383c106f10 msgr2=0x7f383c19cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:51:28.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.002+0000 7f3839d9b640 1 --2- 172.21.15.2:0/4256066671 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f383c106f10 0x7f383c19cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:28.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.002+0000 7f3839d9b640 1 -- 172.21.15.2:0/4256066671 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f383c101de0 msgr2=0x7f383c198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:51:28.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.002+0000 7f3839d9b640 1 --2- 172.21.15.2:0/4256066671 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f383c101de0 0x7f383c198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:28.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.002+0000 7f3839d9b640 1 -- 172.21.15.2:0/4256066671 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f383c19d330 con 0x7f383c102790 2024-09-19T04:51:28.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.002+0000 7f383a59c640 1 --2- 172.21.15.2:0/4256066671 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f383c101de0 0x7f383c198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:51:28.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.003+0000 7f3839d9b640 1 --2- 172.21.15.2:0/4256066671 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f383c102790 0x7f383c1988c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f383000d950 tx=0x7f383000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:51:28.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.003+0000 7f382b7fe640 1 -- 172.21.15.2:0/4256066671 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3830017030 con 0x7f383c102790 2024-09-19T04:51:28.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.003+0000 7f382b7fe640 1 -- 172.21.15.2:0/4256066671 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3830004020 con 0x7f383c102790 2024-09-19T04:51:28.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.003+0000 7f3840fc0640 1 -- 172.21.15.2:0/4256066671 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f383c19d620 con 0x7f383c102790 2024-09-19T04:51:28.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.003+0000 7f382b7fe640 1 -- 172.21.15.2:0/4256066671 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38300047a0 con 0x7f383c102790 2024-09-19T04:51:28.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.003+0000 7f3840fc0640 1 -- 172.21.15.2:0/4256066671 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f383c1a4f00 con 0x7f383c102790 2024-09-19T04:51:28.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.005+0000 7f382b7fe640 1 -- 172.21.15.2:0/4256066671 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f38300041d0 con 0x7f383c102790 2024-09-19T04:51:28.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.005+0000 7f3843399740 1 Processor -- start 2024-09-19T04:51:28.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.005+0000 7f3843399740 1 -- start start 2024-09-19T04:51:28.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.006+0000 7f3843399740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db062c1b40 0x55db062c0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:28.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.006+0000 7f3843399740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db062c05d0 0x55db062c0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:28.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.006+0000 7f3843399740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55db062cb370 0x55db062cd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:28.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.006+0000 7f3843399740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55db062262f0 con 0x55db062c05d0 2024-09-19T04:51:28.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.006+0000 7f3843399740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55db061cdcf0 con 0x55db062c1b40 2024-09-19T04:51:28.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.006+0000 7f3843399740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55db062222b0 con 0x55db062cb370 2024-09-19T04:51:28.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.006+0000 7f383a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db062c05d0 0x55db062c0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:28.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.006+0000 7f383a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db062c05d0 0x55db062c0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42548/0 (socket says 172.21.15.2:42548) 2024-09-19T04:51:28.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.006+0000 7f383a59c640 1 -- 172.21.15.2:0/598491280 learned_addr learned my addr 172.21.15.2:0/598491280 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:51:28.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.006+0000 7f383ad9d640 1 --2- 172.21.15.2:0/598491280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db062c1b40 0x55db062c0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:28.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.006+0000 7f3839d9b640 1 --2- 172.21.15.2:0/598491280 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55db062cb370 0x55db062cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:28.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.006+0000 7f382b7fe640 1 --2- 172.21.15.2:0/4256066671 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f38240a33b0 0x7f38240a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:28.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.006+0000 7f383a59c640 1 -- 172.21.15.2:0/598491280 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55db062cb370 msgr2=0x55db062cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:51:28.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.006+0000 7f383a59c640 1 --2- 172.21.15.2:0/598491280 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55db062cb370 0x55db062cd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:28.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.006+0000 7f383a59c640 1 -- 172.21.15.2:0/598491280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db062c1b40 msgr2=0x55db062c0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:51:28.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.006+0000 7f383a59c640 1 --2- 172.21.15.2:0/598491280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db062c1b40 0x55db062c0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:28.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.006+0000 7f383a59c640 1 -- 172.21.15.2:0/598491280 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db061b23a0 con 0x55db062c05d0 2024-09-19T04:51:28.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.006+0000 7f383ad9d640 1 --2- 172.21.15.2:0/4256066671 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f38240a33b0 0x7f38240a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:28.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.006+0000 7f382b7fe640 1 -- 172.21.15.2:0/4256066671 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f38300cf750 con 0x7f383c102790 2024-09-19T04:51:28.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.007+0000 7f383a59c640 1 --2- 172.21.15.2:0/598491280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db062c05d0 0x55db062c0a10 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f382c000c00 tx=0x7f382c032cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdd41e598adbf5fd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:51:28.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.007+0000 7f3828ff9640 1 -- 172.21.15.2:0/598491280 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f382c03f070 con 0x55db062c05d0 2024-09-19T04:51:28.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.007+0000 7f383ad9d640 1 --2- 172.21.15.2:0/4256066671 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f38240a33b0 0x7f38240a5870 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3834005fd0 tx=0x7f3834004a40 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:51:28.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.007+0000 7f3828ff9640 1 -- 172.21.15.2:0/598491280 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f382c0316a0 con 0x55db062c05d0 2024-09-19T04:51:28.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.007+0000 7f3828ff9640 1 -- 172.21.15.2:0/598491280 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f382c035070 con 0x55db062c05d0 2024-09-19T04:51:28.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.008+0000 7f3843399740 1 -- 172.21.15.2:0/598491280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db062c05d0 msgr2=0x55db062c0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:51:28.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.008+0000 7f3843399740 1 --2- 172.21.15.2:0/598491280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db062c05d0 0x55db062c0a10 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f382c000c00 tx=0x7f382c032cc0 comp rx=0 tx=0).stop 2024-09-19T04:51:28.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.008+0000 7f3843399740 1 -- 172.21.15.2:0/598491280 shutdown_connections 2024-09-19T04:51:28.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.008+0000 7f3843399740 1 --2- 172.21.15.2:0/598491280 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55db062cb370 0x55db062cd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:28.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.008+0000 7f3843399740 1 --2- 172.21.15.2:0/598491280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db062c05d0 0x55db062c0a10 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:28.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.008+0000 7f3843399740 1 --2- 172.21.15.2:0/598491280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db062c1b40 0x55db062c0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:28.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.008+0000 7f3843399740 1 -- 172.21.15.2:0/598491280 >> 172.21.15.2:0/598491280 conn(0x55db06289310 msgr2=0x55db062bcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:51:28.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.008+0000 7f3843399740 1 -- 172.21.15.2:0/598491280 shutdown_connections 2024-09-19T04:51:28.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.008+0000 7f3843399740 1 -- 172.21.15.2:0/598491280 wait complete. 2024-09-19T04:51:28.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.008+0000 7f3843399740 1 -- start start 2024-09-19T04:51:28.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.008+0000 7f3843399740 1 Processor -- start 2024-09-19T04:51:28.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.008+0000 7f3843399740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db062c05d0 0x55db062cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:28.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.008+0000 7f3843399740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db062c1b40 0x55db062c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:28.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.008+0000 7f3843399740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55db062cb370 0x55db062c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:28.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.008+0000 7f3843399740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55db062ce010 con 0x55db062c1b40 2024-09-19T04:51:28.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.008+0000 7f3843399740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55db061e1060 con 0x55db062c05d0 2024-09-19T04:51:28.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.008+0000 7f3843399740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55db062ce190 con 0x55db062cb370 2024-09-19T04:51:28.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.009+0000 7f3843399740 10 client.0 _ll_register_callbacks cb 0x55db05f348c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:51:28.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.009+0000 7f3839d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db062c1b40 0x55db062c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:28.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.009+0000 7f3839d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db062c1b40 0x55db062c7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42558/0 (socket says 172.21.15.2:42558) 2024-09-19T04:51:28.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.009+0000 7f383a59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db062c05d0 0x55db062cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:28.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.009+0000 7f3839d9b640 1 -- 172.21.15.2:0/1707976575 learned_addr learned my addr 172.21.15.2:0/1707976575 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:51:28.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.009+0000 7f383ad9d640 1 --2- 172.21.15.2:0/1707976575 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55db062cb370 0x55db062c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:28.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.009+0000 7f3839d9b640 1 -- 172.21.15.2:0/1707976575 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55db062cb370 msgr2=0x55db062c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:51:28.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.009+0000 7f3839d9b640 1 --2- 172.21.15.2:0/1707976575 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55db062cb370 0x55db062c84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:28.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.009+0000 7f3839d9b640 1 -- 172.21.15.2:0/1707976575 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db062c05d0 msgr2=0x55db062cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:51:28.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.009+0000 7f3839d9b640 1 --2- 172.21.15.2:0/1707976575 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db062c05d0 0x55db062cacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:28.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.009+0000 7f3839d9b640 1 -- 172.21.15.2:0/1707976575 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db05f973c0 con 0x55db062c1b40 2024-09-19T04:51:28.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.009+0000 7f383a59c640 1 --2- 172.21.15.2:0/1707976575 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db062c05d0 0x55db062cacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:51:28.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.009+0000 7f3839d9b640 1 --2- 172.21.15.2:0/1707976575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db062c1b40 0x55db062c7f70 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f3830009610 tx=0x7f383009b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=655c28eef597d24d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:51:28.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.009+0000 7f3821ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:51:28.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.009+0000 7f3821ffb640 1 -- 172.21.15.2:0/1707976575 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f383009ba50 con 0x55db062c1b40 2024-09-19T04:51:28.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.009+0000 7f3821ffb640 1 -- 172.21.15.2:0/1707976575 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f3830086070 con 0x55db062c1b40 2024-09-19T04:51:28.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.009+0000 7f3843399740 1 -- 172.21.15.2:0/1707976575 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f382c0316a0 con 0x55db062c1b40 2024-09-19T04:51:28.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.009+0000 7f3821ffb640 1 -- 172.21.15.2:0/1707976575 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f383009fe00 con 0x55db062c1b40 2024-09-19T04:51:28.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.009+0000 7f3843399740 10 client.15690 fetch_fsmap learned FSMap version 19 2024-09-19T04:51:28.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.009+0000 7f3843399740 1 -- 172.21.15.2:0/1707976575 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55db062d9a20 con 0x55db062c1b40 2024-09-19T04:51:28.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.010+0000 7f3821ffb640 1 -- 172.21.15.2:0/1707976575 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f382c0316a0 con 0x55db062c1b40 2024-09-19T04:51:28.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.010+0000 7f3821ffb640 1 -- 172.21.15.2:0/1707976575 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f3830097930 con 0x55db062c1b40 2024-09-19T04:51:28.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.010+0000 7f3843399740 10 client.15690 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:51:28.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.010+0000 7f3843399740 10 client.15690 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:51:28.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.010+0000 7f3843399740 20 client.15690 populate_metadata read hostname 'smithi002' 2024-09-19T04:51:28.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.010+0000 7f3843399740 1 --2- 172.21.15.2:0/1707976575 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55db062daee0 0x55db062dd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:28.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.010+0000 7f3843399740 4 client.15690 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:51:28.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.010+0000 7f3843399740 1 -- 172.21.15.2:0/1707976575 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55db06233860 con 0x55db062daee0 2024-09-19T04:51:28.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.010+0000 7f383a59c640 1 --2- 172.21.15.2:0/1707976575 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55db062daee0 0x55db062dd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:28.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.011+0000 7f383a59c640 1 --2- 172.21.15.2:0/1707976575 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55db062daee0 0x55db062dd2d0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbb38f5464431dc6 server_cookie=752fa0b13f010842 in_seq=0 out_seq=0 2024-09-19T04:51:28.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.011+0000 7f3821ffb640 10 client.15690 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:51:28.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.012+0000 7f3821ffb640 1 -- 172.21.15.2:0/1707976575 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55db06233860 con 0x55db062daee0 2024-09-19T04:51:28.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.012+0000 7f3821ffb640 10 client.15690 handle_command_reply: tid=0 2024-09-19T04:51:28.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.012+0000 7f3843399740 1 client.15690 shutdown 2024-09-19T04:51:28.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.012+0000 7f3843399740 1 -- 172.21.15.2:0/1707976575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db062c1b40 msgr2=0x55db062c7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:51:28.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.012+0000 7f3843399740 1 --2- 172.21.15.2:0/1707976575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db062c1b40 0x55db062c7f70 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f3830009610 tx=0x7f383009b8e0 comp rx=0 tx=0).stop 2024-09-19T04:51:28.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.012+0000 7f3843399740 1 -- 172.21.15.2:0/1707976575 shutdown_connections 2024-09-19T04:51:28.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.012+0000 7f3843399740 1 --2- 172.21.15.2:0/1707976575 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55db062daee0 0x55db062dd2d0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:28.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.012+0000 7f3843399740 1 --2- 172.21.15.2:0/1707976575 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55db062cb370 0x55db062c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:28.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.012+0000 7f3843399740 1 --2- 172.21.15.2:0/1707976575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db062c1b40 0x55db062c7f70 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:28.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.012+0000 7f3843399740 1 --2- 172.21.15.2:0/1707976575 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db062c05d0 0x55db062cacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:28.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.012+0000 7f3843399740 1 -- 172.21.15.2:0/1707976575 >> 172.21.15.2:0/1707976575 conn(0x55db06289310 msgr2=0x55db062c2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:51:28.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.012+0000 7f3821ffb640 0 client.15690 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:51:28.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.012+0000 7f3843399740 1 -- 172.21.15.2:0/1707976575 shutdown_connections 2024-09-19T04:51:28.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.012+0000 7f3843399740 1 -- 172.21.15.2:0/1707976575 wait complete. 2024-09-19T04:51:28.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.012+0000 7f3843399740 20 client.15690 trim_cache size 0 max 16384 2024-09-19T04:51:28.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.025+0000 7f3843399740 1 Processor -- start 2024-09-19T04:51:28.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.025+0000 7f3843399740 1 -- start start 2024-09-19T04:51:28.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.025+0000 7f3843399740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db062c05d0 0x55db062bce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:28.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.025+0000 7f3843399740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db062c1b40 0x55db062d72b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:28.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.025+0000 7f3843399740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55db062cb370 0x55db062e2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:28.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.025+0000 7f3843399740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f383c1ab7c0 con 0x55db062c05d0 2024-09-19T04:51:28.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.025+0000 7f3843399740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f383c1ae040 con 0x55db062c1b40 2024-09-19T04:51:28.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.025+0000 7f3843399740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f383c1abe30 con 0x55db062cb370 2024-09-19T04:51:28.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.025+0000 7f383a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db062c05d0 0x55db062bce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:28.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.025+0000 7f383a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db062c05d0 0x55db062bce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42566/0 (socket says 172.21.15.2:42566) 2024-09-19T04:51:28.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.025+0000 7f383a59c640 1 -- 172.21.15.2:0/2120915782 learned_addr learned my addr 172.21.15.2:0/2120915782 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:51:28.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.025+0000 7f383a59c640 1 -- 172.21.15.2:0/2120915782 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55db062cb370 msgr2=0x55db062e2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:51:28.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.025+0000 7f383a59c640 1 --2- 172.21.15.2:0/2120915782 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55db062cb370 0x55db062e2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:28.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.025+0000 7f383a59c640 1 -- 172.21.15.2:0/2120915782 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db062c1b40 msgr2=0x55db062d72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:51:28.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.025+0000 7f383a59c640 1 --2- 172.21.15.2:0/2120915782 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db062c1b40 0x55db062d72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:28.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.025+0000 7f383a59c640 1 -- 172.21.15.2:0/2120915782 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db062c64e0 con 0x55db062c05d0 2024-09-19T04:51:28.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.026+0000 7f383a59c640 1 --2- 172.21.15.2:0/2120915782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db062c05d0 0x55db062bce10 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f382c009900 tx=0x7f382c0052d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=628e4034c7fb1a03 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:51:28.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.026+0000 7f3823fff640 1 -- 172.21.15.2:0/2120915782 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f382c03f040 con 0x55db062c05d0 2024-09-19T04:51:28.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.026+0000 7f3823fff640 1 -- 172.21.15.2:0/2120915782 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f382c032e60 con 0x55db062c05d0 2024-09-19T04:51:28.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.026+0000 7f3823fff640 1 -- 172.21.15.2:0/2120915782 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f382c035040 con 0x55db062c05d0 2024-09-19T04:51:28.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.026+0000 7f3843399740 1 -- 172.21.15.2:0/2120915782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db062c05d0 msgr2=0x55db062bce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:51:28.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.026+0000 7f3843399740 1 --2- 172.21.15.2:0/2120915782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db062c05d0 0x55db062bce10 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f382c009900 tx=0x7f382c0052d0 comp rx=0 tx=0).stop 2024-09-19T04:51:28.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.026+0000 7f3843399740 1 -- 172.21.15.2:0/2120915782 shutdown_connections 2024-09-19T04:51:28.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.026+0000 7f3843399740 1 --2- 172.21.15.2:0/2120915782 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55db062cb370 0x55db062e2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:28.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.026+0000 7f3843399740 1 --2- 172.21.15.2:0/2120915782 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db062c1b40 0x55db062d72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:28.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.026+0000 7f3843399740 1 --2- 172.21.15.2:0/2120915782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db062c05d0 0x55db062bce10 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:28.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.026+0000 7f3843399740 1 -- 172.21.15.2:0/2120915782 >> 172.21.15.2:0/2120915782 conn(0x55db06289310 msgr2=0x55db062bc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:51:28.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.026+0000 7f3843399740 1 -- 172.21.15.2:0/2120915782 shutdown_connections 2024-09-19T04:51:28.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.026+0000 7f3843399740 1 -- 172.21.15.2:0/2120915782 wait complete. 2024-09-19T04:51:28.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.027+0000 7f3843399740 1 -- start start 2024-09-19T04:51:28.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.027+0000 7f3843399740 1 Processor -- start 2024-09-19T04:51:28.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.027+0000 7f3843399740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55db062c05d0 0x55db062d3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:28.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.027+0000 7f3843399740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db062c1b40 0x55db062d3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:28.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.027+0000 7f3843399740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db062cb370 0x55db062c45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:28.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.027+0000 7f3843399740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f383c1ac500 con 0x55db062c1b40 2024-09-19T04:51:28.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.027+0000 7f3843399740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f383c1ad970 con 0x55db062cb370 2024-09-19T04:51:28.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.027+0000 7f3843399740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f383c1acbd0 con 0x55db062c05d0 2024-09-19T04:51:28.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.027+0000 7f3843399740 10 client.0 _ll_register_callbacks cb 0x7f3830004540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:51:28.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.027+0000 7f3839d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db062c1b40 0x55db062d3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:28.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.027+0000 7f3839d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db062c1b40 0x55db062d3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42580/0 (socket says 172.21.15.2:42580) 2024-09-19T04:51:28.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.027+0000 7f3839d9b640 1 -- 172.21.15.2:0/1014817070 learned_addr learned my addr 172.21.15.2:0/1014817070 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:51:28.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.027+0000 7f383a59c640 1 --2- 172.21.15.2:0/1014817070 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55db062c05d0 0x55db062d3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:28.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.027+0000 7f383ad9d640 1 --2- 172.21.15.2:0/1014817070 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db062cb370 0x55db062c45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:28.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.027+0000 7f3839d9b640 1 -- 172.21.15.2:0/1014817070 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55db062c05d0 msgr2=0x55db062d3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:51:28.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.027+0000 7f3839d9b640 1 --2- 172.21.15.2:0/1014817070 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55db062c05d0 0x55db062d3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:28.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.027+0000 7f3839d9b640 1 -- 172.21.15.2:0/1014817070 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db062cb370 msgr2=0x55db062c45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:51:28.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.027+0000 7f3839d9b640 1 --2- 172.21.15.2:0/1014817070 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db062cb370 0x55db062c45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:28.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.027+0000 7f3839d9b640 1 -- 172.21.15.2:0/1014817070 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db062c4b00 con 0x55db062c1b40 2024-09-19T04:51:28.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.028+0000 7f3839d9b640 1 --2- 172.21.15.2:0/1014817070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db062c1b40 0x55db062d3960 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f383009b750 tx=0x7f38300982f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20b83a313b088a06 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:51:28.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.028+0000 7f3821ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:51:28.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.028+0000 7f3821ffb640 1 -- 172.21.15.2:0/1014817070 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f383009ba50 con 0x55db062c1b40 2024-09-19T04:51:28.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.028+0000 7f3821ffb640 1 -- 172.21.15.2:0/1014817070 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f38300977a0 con 0x55db062c1b40 2024-09-19T04:51:28.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.028+0000 7f3843399740 1 -- 172.21.15.2:0/1014817070 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f382c032e60 con 0x55db062c1b40 2024-09-19T04:51:28.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.028+0000 7f3821ffb640 1 -- 172.21.15.2:0/1014817070 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f383009b3b0 con 0x55db062c1b40 2024-09-19T04:51:28.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.028+0000 7f3843399740 10 client.15696 fetch_fsmap learned FSMap version 19 2024-09-19T04:51:28.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.028+0000 7f3843399740 1 -- 172.21.15.2:0/1014817070 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55db06345280 con 0x55db062c1b40 2024-09-19T04:51:28.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.028+0000 7f3821ffb640 1 -- 172.21.15.2:0/1014817070 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f382c032e60 con 0x55db062c1b40 2024-09-19T04:51:28.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.028+0000 7f3821ffb640 1 -- 172.21.15.2:0/1014817070 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f38300a0f90 con 0x55db062c1b40 2024-09-19T04:51:28.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.028+0000 7f3843399740 10 client.15696 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:51:28.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.028+0000 7f3843399740 10 client.15696 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:51:28.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.028+0000 7f3843399740 20 client.15696 populate_metadata read hostname 'smithi002' 2024-09-19T04:51:28.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.028+0000 7f3843399740 1 --2- 172.21.15.2:0/1014817070 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55db06345870 0x55db06347c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:28.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.028+0000 7f3843399740 4 client.15696 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:51:28.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.028+0000 7f3843399740 1 -- 172.21.15.2:0/1014817070 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55db0622dd70 con 0x55db06345870 2024-09-19T04:51:28.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.029+0000 7f383a59c640 1 --2- 172.21.15.2:0/1014817070 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55db06345870 0x55db06347c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:28.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.029+0000 7f383a59c640 1 --2- 172.21.15.2:0/1014817070 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55db06345870 0x55db06347c90 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7caf661fcbf7ad64 server_cookie=e9009716a781fe6 in_seq=0 out_seq=0 2024-09-19T04:51:28.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.029+0000 7f3821ffb640 10 client.15696 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:51:28.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.029+0000 7f3821ffb640 1 -- 172.21.15.2:0/1014817070 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55db0622dd70 con 0x55db06345870 2024-09-19T04:51:28.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.029+0000 7f3821ffb640 10 client.15696 handle_command_reply: tid=0 2024-09-19T04:51:28.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.029+0000 7f3843399740 1 client.15696 shutdown 2024-09-19T04:51:28.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.029+0000 7f3843399740 1 -- 172.21.15.2:0/1014817070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db062c1b40 msgr2=0x55db062d3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:51:28.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.029+0000 7f3843399740 1 --2- 172.21.15.2:0/1014817070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db062c1b40 0x55db062d3960 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f383009b750 tx=0x7f38300982f0 comp rx=0 tx=0).stop 2024-09-19T04:51:28.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.029+0000 7f3843399740 1 -- 172.21.15.2:0/1014817070 shutdown_connections 2024-09-19T04:51:28.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.029+0000 7f3843399740 1 --2- 172.21.15.2:0/1014817070 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db062cb370 0x55db062c45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:28.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.029+0000 7f3843399740 1 --2- 172.21.15.2:0/1014817070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db062c1b40 0x55db062d3960 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:28.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.029+0000 7f3843399740 1 --2- 172.21.15.2:0/1014817070 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55db06345870 0x55db06347c90 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:28.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.029+0000 7f3843399740 1 --2- 172.21.15.2:0/1014817070 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55db062c05d0 0x55db062d3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:28.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.029+0000 7f3821ffb640 0 client.15696 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:51:28.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.029+0000 7f3843399740 1 -- 172.21.15.2:0/1014817070 >> 172.21.15.2:0/1014817070 conn(0x55db06289310 msgr2=0x55db062c6860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:51:28.050 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T04:51:28.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.029+0000 7f3843399740 1 -- 172.21.15.2:0/1014817070 shutdown_connections 2024-09-19T04:51:28.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.030+0000 7f3843399740 1 -- 172.21.15.2:0/1014817070 wait complete. 2024-09-19T04:51:28.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.030+0000 7f3843399740 20 client.15696 trim_cache size 0 max 16384 2024-09-19T04:51:28.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.030+0000 7f3840fc0640 1 -- 172.21.15.2:0/4256066671 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f38240a33b0 msgr2=0x7f38240a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:51:28.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.030+0000 7f3840fc0640 1 --2- 172.21.15.2:0/4256066671 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f38240a33b0 0x7f38240a5870 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3834005fd0 tx=0x7f3834004a40 comp rx=0 tx=0).stop 2024-09-19T04:51:28.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.030+0000 7f3840fc0640 1 -- 172.21.15.2:0/4256066671 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f383c102790 msgr2=0x7f383c1988c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:51:28.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.030+0000 7f3840fc0640 1 --2- 172.21.15.2:0/4256066671 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f383c102790 0x7f383c1988c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f383000d950 tx=0x7f383000de10 comp rx=0 tx=0).stop 2024-09-19T04:51:28.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.030+0000 7f3840fc0640 1 -- 172.21.15.2:0/4256066671 shutdown_connections 2024-09-19T04:51:28.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.030+0000 7f3840fc0640 1 --2- 172.21.15.2:0/4256066671 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f38240a33b0 0x7f38240a5870 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:28.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.030+0000 7f3840fc0640 1 --2- 172.21.15.2:0/4256066671 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f383c106f10 0x7f383c19cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:28.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.030+0000 7f3840fc0640 1 --2- 172.21.15.2:0/4256066671 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f383c102790 0x7f383c1988c0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:28.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.030+0000 7f3840fc0640 1 --2- 172.21.15.2:0/4256066671 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f383c101de0 0x7f383c198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:28.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.030+0000 7f3840fc0640 1 -- 172.21.15.2:0/4256066671 >> 172.21.15.2:0/4256066671 conn(0x7f383c0fd8c0 msgr2=0x7f383c0fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:51:28.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.030+0000 7f3840fc0640 1 -- 172.21.15.2:0/4256066671 shutdown_connections 2024-09-19T04:51:28.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:28.030+0000 7f3840fc0640 1 -- 172.21.15.2:0/4256066671 wait complete. 2024-09-19T04:51:29.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:51:28 smithi018 ceph-mon[34537]: pgmap v107: 97 pgs: 97 active+clean; 3.7 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 7 op/s 2024-09-19T04:51:29.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:51:28 smithi002 ceph-mon[30975]: pgmap v107: 97 pgs: 97 active+clean; 3.7 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 7 op/s 2024-09-19T04:51:29.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:51:28 smithi116 ceph-mon[34477]: pgmap v107: 97 pgs: 97 active+clean; 3.7 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 7 op/s 2024-09-19T04:51:29.811 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:51:29.811 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:51:30.086 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:51:30.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.562+0000 7fa1a2faa640 1 -- 172.21.15.2:0/4276107463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa19c106f10 msgr2=0x7fa19c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:51:30.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.562+0000 7fa1a2faa640 1 --2- 172.21.15.2:0/4276107463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa19c106f10 0x7fa19c10ea90 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fa194009ca0 tx=0x7fa19402a8c0 comp rx=0 tx=0).stop 2024-09-19T04:51:30.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.563+0000 7fa1a2faa640 1 -- 172.21.15.2:0/4276107463 shutdown_connections 2024-09-19T04:51:30.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.563+0000 7fa1a2faa640 1 --2- 172.21.15.2:0/4276107463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa19c106f10 0x7fa19c10ea90 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:30.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.563+0000 7fa1a2faa640 1 --2- 172.21.15.2:0/4276107463 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa19c102790 0x7fa19c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:30.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.563+0000 7fa1a2faa640 1 --2- 172.21.15.2:0/4276107463 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa19c101de0 0x7fa19c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:30.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.563+0000 7fa1a2faa640 1 -- 172.21.15.2:0/4276107463 >> 172.21.15.2:0/4276107463 conn(0x7fa19c0fd8c0 msgr2=0x7fa19c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:51:30.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.563+0000 7fa1a2faa640 1 -- 172.21.15.2:0/4276107463 shutdown_connections 2024-09-19T04:51:30.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.563+0000 7fa1a2faa640 1 -- 172.21.15.2:0/4276107463 wait complete. 2024-09-19T04:51:30.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.563+0000 7fa1a2faa640 1 Processor -- start 2024-09-19T04:51:30.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.563+0000 7fa1a2faa640 1 -- start start 2024-09-19T04:51:30.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.564+0000 7fa1a2faa640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa19c101de0 0x7fa19c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:30.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.564+0000 7fa1a2faa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa19c102790 0x7fa19c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:30.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.564+0000 7fa1a2faa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa19c106f10 0x7fa19c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:30.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.564+0000 7fa1a2faa640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa19c111e40 con 0x7fa19c102790 2024-09-19T04:51:30.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.564+0000 7fa1a2faa640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa19c111cc0 con 0x7fa19c106f10 2024-09-19T04:51:30.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.564+0000 7fa1a2faa640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa19c111fc0 con 0x7fa19c101de0 2024-09-19T04:51:30.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.564+0000 7fa19bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa19c102790 0x7fa19c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:30.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.564+0000 7fa19bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa19c102790 0x7fa19c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42596/0 (socket says 172.21.15.2:42596) 2024-09-19T04:51:30.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.564+0000 7fa19bfff640 1 -- 172.21.15.2:0/2643586678 learned_addr learned my addr 172.21.15.2:0/2643586678 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:51:30.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.564+0000 7fa1a1547640 1 --2- 172.21.15.2:0/2643586678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa19c106f10 0x7fa19c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:30.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.564+0000 7fa1a0d46640 1 --2- 172.21.15.2:0/2643586678 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa19c101de0 0x7fa19c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:30.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.564+0000 7fa19bfff640 1 -- 172.21.15.2:0/2643586678 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa19c101de0 msgr2=0x7fa19c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:51:30.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.564+0000 7fa19bfff640 1 --2- 172.21.15.2:0/2643586678 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa19c101de0 0x7fa19c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:30.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.564+0000 7fa19bfff640 1 -- 172.21.15.2:0/2643586678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa19c106f10 msgr2=0x7fa19c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:51:30.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.564+0000 7fa19bfff640 1 --2- 172.21.15.2:0/2643586678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa19c106f10 0x7fa19c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:30.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.564+0000 7fa19bfff640 1 -- 172.21.15.2:0/2643586678 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa19c1aadb0 con 0x7fa19c102790 2024-09-19T04:51:30.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.564+0000 7fa19bfff640 1 --2- 172.21.15.2:0/2643586678 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa19c102790 0x7fa19c074a30 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fa18400c890 tx=0x7fa18400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:51:30.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.564+0000 7fa199ffb640 1 -- 172.21.15.2:0/2643586678 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa184004220 con 0x7fa19c102790 2024-09-19T04:51:30.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.564+0000 7fa199ffb640 1 -- 172.21.15.2:0/2643586678 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa1840043c0 con 0x7fa19c102790 2024-09-19T04:51:30.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.564+0000 7fa1a2faa640 1 -- 172.21.15.2:0/2643586678 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa19c1aafe0 con 0x7fa19c102790 2024-09-19T04:51:30.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.564+0000 7fa199ffb640 1 -- 172.21.15.2:0/2643586678 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa184004a00 con 0x7fa19c102790 2024-09-19T04:51:30.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.565+0000 7fa1a2faa640 1 -- 172.21.15.2:0/2643586678 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa19c1ab430 con 0x7fa19c102790 2024-09-19T04:51:30.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.567+0000 7fa199ffb640 1 -- 172.21.15.2:0/2643586678 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fa184004ba0 con 0x7fa19c102790 2024-09-19T04:51:30.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.567+0000 7fa1a5383740 1 Processor -- start 2024-09-19T04:51:30.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.567+0000 7fa1a5383740 1 -- start start 2024-09-19T04:51:30.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.567+0000 7fa199ffb640 1 --2- 172.21.15.2:0/2643586678 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fa1880a33b0 0x7fa1880a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:30.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.567+0000 7fa1a5383740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ed9eb3b60 0x558ed9eb3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:30.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.567+0000 7fa1a5383740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ed9eb4480 0x558ed9ebe800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:30.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.568+0000 7fa1a5383740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ed9ebed40 0x558ed9ec1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:30.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.568+0000 7fa1a5383740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558ed9e19280 con 0x558ed9eb4480 2024-09-19T04:51:30.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.568+0000 7fa1a5383740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558ed9dc0b10 con 0x558ed9eb3b60 2024-09-19T04:51:30.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.568+0000 7fa1a5383740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x558ed9e15240 con 0x558ed9ebed40 2024-09-19T04:51:30.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.568+0000 7fa1a1547640 1 --2- 172.21.15.2:0/2643586678 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fa1880a33b0 0x7fa1880a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:30.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.568+0000 7fa199ffb640 1 -- 172.21.15.2:0/2643586678 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7fa1840cf990 con 0x7fa19c102790 2024-09-19T04:51:30.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.568+0000 7fa19bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ed9eb4480 0x558ed9ebe800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:30.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.568+0000 7fa19bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ed9eb4480 0x558ed9ebe800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42598/0 (socket says 172.21.15.2:42598) 2024-09-19T04:51:30.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.568+0000 7fa19bfff640 1 -- 172.21.15.2:0/2408500900 learned_addr learned my addr 172.21.15.2:0/2408500900 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:51:30.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.568+0000 7fa1a0d46640 1 --2- 172.21.15.2:0/2408500900 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ed9eb3b60 0x558ed9eb3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:30.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.568+0000 7fa19bfff640 1 -- 172.21.15.2:0/2408500900 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ed9ebed40 msgr2=0x558ed9ec1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:51:30.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.568+0000 7fa19bfff640 1 --2- 172.21.15.2:0/2408500900 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ed9ebed40 0x558ed9ec1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:30.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.568+0000 7fa19bfff640 1 -- 172.21.15.2:0/2408500900 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ed9eb3b60 msgr2=0x558ed9eb3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:51:30.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.568+0000 7fa19bfff640 1 --2- 172.21.15.2:0/2408500900 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ed9eb3b60 0x558ed9eb3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:30.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.568+0000 7fa19bfff640 1 -- 172.21.15.2:0/2408500900 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ed9dcd1f0 con 0x558ed9eb4480 2024-09-19T04:51:30.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.568+0000 7fa1a0d46640 1 --2- 172.21.15.2:0/2408500900 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ed9eb3b60 0x558ed9eb3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:51:30.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.568+0000 7fa1a1547640 1 --2- 172.21.15.2:0/2643586678 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fa1880a33b0 0x7fa1880a5870 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa194009430 tx=0x7fa194031c20 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:51:30.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.568+0000 7fa19bfff640 1 --2- 172.21.15.2:0/2408500900 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ed9eb4480 0x558ed9ebe800 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fa1840980f0 tx=0x7fa18409c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26a9c40d0c65fdb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:51:30.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.568+0000 7fa192ffd640 1 -- 172.21.15.2:0/2408500900 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1840131b0 con 0x558ed9eb4480 2024-09-19T04:51:30.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.568+0000 7fa192ffd640 1 -- 172.21.15.2:0/2408500900 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa1840133e0 con 0x558ed9eb4480 2024-09-19T04:51:30.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.568+0000 7fa192ffd640 1 -- 172.21.15.2:0/2408500900 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1840050b0 con 0x558ed9eb4480 2024-09-19T04:51:30.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.569+0000 7fa1a5383740 1 -- 172.21.15.2:0/2408500900 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ed9eb4480 msgr2=0x558ed9ebe800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:51:30.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.569+0000 7fa1a5383740 1 --2- 172.21.15.2:0/2408500900 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ed9eb4480 0x558ed9ebe800 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fa1840980f0 tx=0x7fa18409c390 comp rx=0 tx=0).stop 2024-09-19T04:51:30.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.569+0000 7fa1a5383740 1 -- 172.21.15.2:0/2408500900 shutdown_connections 2024-09-19T04:51:30.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.569+0000 7fa1a5383740 1 --2- 172.21.15.2:0/2408500900 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ed9ebed40 0x558ed9ec1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:30.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.569+0000 7fa1a5383740 1 --2- 172.21.15.2:0/2408500900 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ed9eb4480 0x558ed9ebe800 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:30.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.569+0000 7fa1a5383740 1 --2- 172.21.15.2:0/2408500900 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ed9eb3b60 0x558ed9eb3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:30.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.569+0000 7fa1a5383740 1 -- 172.21.15.2:0/2408500900 >> 172.21.15.2:0/2408500900 conn(0x558ed9eb00f0 msgr2=0x558ed9eb04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:51:30.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.569+0000 7fa1a5383740 1 -- 172.21.15.2:0/2408500900 shutdown_connections 2024-09-19T04:51:30.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.569+0000 7fa1a5383740 1 -- 172.21.15.2:0/2408500900 wait complete. 2024-09-19T04:51:30.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.570+0000 7fa1a5383740 1 -- start start 2024-09-19T04:51:30.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.570+0000 7fa1a5383740 1 Processor -- start 2024-09-19T04:51:30.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.570+0000 7fa1a5383740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ed9eb3b60 0x558ed9ebbce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:30.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.570+0000 7fa1a5383740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ed9eb4480 0x558ed9ebc220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:30.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.570+0000 7fa1a5383740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ed9ebed40 0x558ed9ebc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:30.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.570+0000 7fa1a5383740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558ed9ec1910 con 0x558ed9eb4480 2024-09-19T04:51:30.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.570+0000 7fa1a5383740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558ed9dd3f10 con 0x558ed9ebed40 2024-09-19T04:51:30.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.570+0000 7fa1a5383740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x558ed9ec1a90 con 0x558ed9eb3b60 2024-09-19T04:51:30.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.570+0000 7fa1a5383740 10 client.0 _ll_register_callbacks cb 0x558ed9d9ca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:51:30.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.570+0000 7fa19bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ed9eb4480 0x558ed9ebc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:30.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.570+0000 7fa19bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ed9eb4480 0x558ed9ebc220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42606/0 (socket says 172.21.15.2:42606) 2024-09-19T04:51:30.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.570+0000 7fa19bfff640 1 -- 172.21.15.2:0/4285248402 learned_addr learned my addr 172.21.15.2:0/4285248402 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:51:30.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.570+0000 7fa1a0d46640 1 --2- 172.21.15.2:0/4285248402 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ed9eb3b60 0x558ed9ebbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:30.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.571+0000 7fa19bfff640 1 -- 172.21.15.2:0/4285248402 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ed9eb3b60 msgr2=0x558ed9ebbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:51:30.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.571+0000 7fa19bfff640 1 --2- 172.21.15.2:0/4285248402 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ed9eb3b60 0x558ed9ebbce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:30.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.571+0000 7fa19bfff640 1 -- 172.21.15.2:0/4285248402 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ed9ebed40 msgr2=0x558ed9ebc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:51:30.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.571+0000 7fa19bfff640 1 --2- 172.21.15.2:0/4285248402 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ed9ebed40 0x558ed9ebc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:30.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.571+0000 7fa19bfff640 1 -- 172.21.15.2:0/4285248402 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ed9b8a6a0 con 0x558ed9eb4480 2024-09-19T04:51:30.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.571+0000 7fa19bfff640 1 --2- 172.21.15.2:0/4285248402 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ed9eb4480 0x558ed9ebc220 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fa1840cd700 tx=0x7fa184097810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e604bdaaea8761f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:51:30.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.571+0000 7fa17bfff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:51:30.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.571+0000 7fa17bfff640 1 -- 172.21.15.2:0/4285248402 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18409bc90 con 0x558ed9eb4480 2024-09-19T04:51:30.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.571+0000 7fa17bfff640 1 -- 172.21.15.2:0/4285248402 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7fa184014210 con 0x558ed9eb4480 2024-09-19T04:51:30.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.571+0000 7fa1a5383740 1 -- 172.21.15.2:0/4285248402 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1840133e0 con 0x558ed9eb4480 2024-09-19T04:51:30.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.571+0000 7fa17bfff640 1 -- 172.21.15.2:0/4285248402 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fa1840a4900 con 0x558ed9eb4480 2024-09-19T04:51:30.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.571+0000 7fa1a5383740 10 client.15708 fetch_fsmap learned FSMap version 19 2024-09-19T04:51:30.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.571+0000 7fa1a5383740 1 -- 172.21.15.2:0/4285248402 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x558ed9ecd5d0 con 0x558ed9eb4480 2024-09-19T04:51:30.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.571+0000 7fa17bfff640 1 -- 172.21.15.2:0/4285248402 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa1840133e0 con 0x558ed9eb4480 2024-09-19T04:51:30.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.571+0000 7fa17bfff640 1 -- 172.21.15.2:0/4285248402 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fa1840b3020 con 0x558ed9eb4480 2024-09-19T04:51:30.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.571+0000 7fa1a5383740 10 client.15708 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:51:30.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.571+0000 7fa1a5383740 10 client.15708 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:51:30.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.571+0000 7fa1a5383740 20 client.15708 populate_metadata read hostname 'smithi002' 2024-09-19T04:51:30.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.571+0000 7fa1a5383740 1 --2- 172.21.15.2:0/4285248402 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558ed9ece920 0x558ed9ed0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:30.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.572+0000 7fa1a5383740 4 client.15708 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:51:30.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.572+0000 7fa1a5383740 1 -- 172.21.15.2:0/4285248402 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558ed9e267f0 con 0x558ed9ece920 2024-09-19T04:51:30.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.572+0000 7fa1a0d46640 1 --2- 172.21.15.2:0/4285248402 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558ed9ece920 0x558ed9ed0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:30.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.572+0000 7fa17bfff640 10 client.15708 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:51:30.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.572+0000 7fa1a0d46640 1 --2- 172.21.15.2:0/4285248402 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558ed9ece920 0x558ed9ed0d10 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81fa8fbbc9fccf91 server_cookie=a9ef864a30f76ae4 in_seq=0 out_seq=0 2024-09-19T04:51:30.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.573+0000 7fa17bfff640 1 -- 172.21.15.2:0/4285248402 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558ed9e267f0 con 0x558ed9ece920 2024-09-19T04:51:30.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.573+0000 7fa17bfff640 10 client.15708 handle_command_reply: tid=0 2024-09-19T04:51:30.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.573+0000 7fa1a5383740 1 client.15708 shutdown 2024-09-19T04:51:30.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.573+0000 7fa1a5383740 1 -- 172.21.15.2:0/4285248402 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ed9eb4480 msgr2=0x558ed9ebc220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:51:30.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.573+0000 7fa1a5383740 1 --2- 172.21.15.2:0/4285248402 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ed9eb4480 0x558ed9ebc220 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fa1840cd700 tx=0x7fa184097810 comp rx=0 tx=0).stop 2024-09-19T04:51:30.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.573+0000 7fa1a5383740 1 -- 172.21.15.2:0/4285248402 shutdown_connections 2024-09-19T04:51:30.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.573+0000 7fa1a5383740 1 --2- 172.21.15.2:0/4285248402 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ed9ebed40 0x558ed9ebc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:30.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.573+0000 7fa1a5383740 1 --2- 172.21.15.2:0/4285248402 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ed9eb4480 0x558ed9ebc220 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:30.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.573+0000 7fa1a5383740 1 --2- 172.21.15.2:0/4285248402 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558ed9ece920 0x558ed9ed0d10 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:30.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.573+0000 7fa1a5383740 1 --2- 172.21.15.2:0/4285248402 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ed9eb3b60 0x558ed9ebbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:30.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.573+0000 7fa1a5383740 1 -- 172.21.15.2:0/4285248402 >> 172.21.15.2:0/4285248402 conn(0x558ed9eb00f0 msgr2=0x558ed9eaf270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:51:30.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.573+0000 7fa17bfff640 0 client.15708 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:51:30.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.573+0000 7fa1a5383740 1 -- 172.21.15.2:0/4285248402 shutdown_connections 2024-09-19T04:51:30.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.573+0000 7fa1a5383740 1 -- 172.21.15.2:0/4285248402 wait complete. 2024-09-19T04:51:30.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.573+0000 7fa1a5383740 20 client.15708 trim_cache size 0 max 16384 2024-09-19T04:51:30.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.591+0000 7fa1a5383740 1 Processor -- start 2024-09-19T04:51:30.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.591+0000 7fa1a5383740 1 -- start start 2024-09-19T04:51:30.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.591+0000 7fa1a5383740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ed9eb3b60 0x558ed9eb8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:30.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.591+0000 7fa1a5383740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ed9eb4480 0x558ed9eb9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:30.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.591+0000 7fa1a5383740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ed9ebed40 0x558ed9eb55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:30.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.591+0000 7fa1a5383740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa19c1b1be0 con 0x558ed9eb4480 2024-09-19T04:51:30.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.591+0000 7fa1a5383740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa19c1b4460 con 0x558ed9eb3b60 2024-09-19T04:51:30.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.591+0000 7fa1a5383740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa19c1b2250 con 0x558ed9ebed40 2024-09-19T04:51:30.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.591+0000 7fa19bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ed9eb4480 0x558ed9eb9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:30.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.591+0000 7fa19bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ed9eb4480 0x558ed9eb9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42612/0 (socket says 172.21.15.2:42612) 2024-09-19T04:51:30.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.592+0000 7fa19bfff640 1 -- 172.21.15.2:0/2458614165 learned_addr learned my addr 172.21.15.2:0/2458614165 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:51:30.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.592+0000 7fa1a0d46640 1 --2- 172.21.15.2:0/2458614165 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ed9eb3b60 0x558ed9eb8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:30.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.592+0000 7fa1a1547640 1 --2- 172.21.15.2:0/2458614165 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ed9ebed40 0x558ed9eb55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:30.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.592+0000 7fa19bfff640 1 -- 172.21.15.2:0/2458614165 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ed9ebed40 msgr2=0x558ed9eb55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:51:30.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.592+0000 7fa19bfff640 1 --2- 172.21.15.2:0/2458614165 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ed9ebed40 0x558ed9eb55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:30.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.592+0000 7fa19bfff640 1 -- 172.21.15.2:0/2458614165 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ed9eb3b60 msgr2=0x558ed9eb8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:51:30.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.592+0000 7fa19bfff640 1 --2- 172.21.15.2:0/2458614165 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ed9eb3b60 0x558ed9eb8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:30.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.592+0000 7fa19bfff640 1 -- 172.21.15.2:0/2458614165 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ed9eab830 con 0x558ed9eb4480 2024-09-19T04:51:30.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.592+0000 7fa1a0d46640 1 --2- 172.21.15.2:0/2458614165 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ed9eb3b60 0x558ed9eb8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:51:30.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.592+0000 7fa1a1547640 1 --2- 172.21.15.2:0/2458614165 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ed9ebed40 0x558ed9eb55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:51:30.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.592+0000 7fa19bfff640 1 --2- 172.21.15.2:0/2458614165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ed9eb4480 0x558ed9eb9480 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fa1840058c0 tx=0x7fa18409c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=472e706a56f40c40 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:51:30.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.592+0000 7fa1927fc640 1 -- 172.21.15.2:0/2458614165 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18409bc90 con 0x558ed9eb4480 2024-09-19T04:51:30.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.592+0000 7fa1927fc640 1 -- 172.21.15.2:0/2458614165 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa184014210 con 0x558ed9eb4480 2024-09-19T04:51:30.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.592+0000 7fa1927fc640 1 -- 172.21.15.2:0/2458614165 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18401d490 con 0x558ed9eb4480 2024-09-19T04:51:30.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.593+0000 7fa1a5383740 1 -- 172.21.15.2:0/2458614165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ed9eb4480 msgr2=0x558ed9eb9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:51:30.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.593+0000 7fa1a5383740 1 --2- 172.21.15.2:0/2458614165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ed9eb4480 0x558ed9eb9480 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fa1840058c0 tx=0x7fa18409c390 comp rx=0 tx=0).stop 2024-09-19T04:51:30.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.593+0000 7fa1a5383740 1 -- 172.21.15.2:0/2458614165 shutdown_connections 2024-09-19T04:51:30.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.593+0000 7fa1a5383740 1 --2- 172.21.15.2:0/2458614165 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ed9ebed40 0x558ed9eb55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:30.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.593+0000 7fa1a5383740 1 --2- 172.21.15.2:0/2458614165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ed9eb4480 0x558ed9eb9480 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:30.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.593+0000 7fa1a5383740 1 --2- 172.21.15.2:0/2458614165 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ed9eb3b60 0x558ed9eb8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:30.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.593+0000 7fa1a5383740 1 -- 172.21.15.2:0/2458614165 >> 172.21.15.2:0/2458614165 conn(0x558ed9eb00f0 msgr2=0x558ed9ebdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:51:30.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.593+0000 7fa1a5383740 1 -- 172.21.15.2:0/2458614165 shutdown_connections 2024-09-19T04:51:30.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.593+0000 7fa1a5383740 1 -- 172.21.15.2:0/2458614165 wait complete. 2024-09-19T04:51:30.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.593+0000 7fa1a5383740 1 -- start start 2024-09-19T04:51:30.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.593+0000 7fa1a5383740 1 Processor -- start 2024-09-19T04:51:30.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.594+0000 7fa1a5383740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ed9eb3b60 0x558ed9ed4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:30.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.594+0000 7fa1a5383740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ed9eb4480 0x558ed9ed1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:30.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.594+0000 7fa1a5383740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ed9ebed40 0x558ed9ed18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:30.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.594+0000 7fa1a5383740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa19c1b2920 con 0x558ed9eb3b60 2024-09-19T04:51:30.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.594+0000 7fa1a5383740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa19c1b3d90 con 0x558ed9ebed40 2024-09-19T04:51:30.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.594+0000 7fa1a5383740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa19c1b2ff0 con 0x558ed9eb4480 2024-09-19T04:51:30.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.594+0000 7fa1a5383740 10 client.0 _ll_register_callbacks cb 0x7fa18409b860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:51:30.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.594+0000 7fa1a0d46640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ed9eb3b60 0x558ed9ed4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:30.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.594+0000 7fa1a0d46640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ed9eb3b60 0x558ed9ed4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42618/0 (socket says 172.21.15.2:42618) 2024-09-19T04:51:30.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.594+0000 7fa1a0d46640 1 -- 172.21.15.2:0/2214660425 learned_addr learned my addr 172.21.15.2:0/2214660425 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:51:30.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.594+0000 7fa19bfff640 1 --2- 172.21.15.2:0/2214660425 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ed9eb4480 0x558ed9ed1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:30.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.594+0000 7fa1a1547640 1 --2- 172.21.15.2:0/2214660425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ed9ebed40 0x558ed9ed18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:30.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.594+0000 7fa1a0d46640 1 -- 172.21.15.2:0/2214660425 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ed9eb4480 msgr2=0x558ed9ed1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:51:30.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.594+0000 7fa1a0d46640 1 --2- 172.21.15.2:0/2214660425 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ed9eb4480 0x558ed9ed1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:30.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.594+0000 7fa1a0d46640 1 -- 172.21.15.2:0/2214660425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ed9ebed40 msgr2=0x558ed9ed18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:51:30.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.594+0000 7fa1a0d46640 1 --2- 172.21.15.2:0/2214660425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ed9ebed40 0x558ed9ed18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:30.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.594+0000 7fa1a0d46640 1 -- 172.21.15.2:0/2214660425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ed9eb42b0 con 0x558ed9eb3b60 2024-09-19T04:51:30.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.594+0000 7fa19bfff640 1 --2- 172.21.15.2:0/2214660425 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ed9eb4480 0x558ed9ed1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:51:30.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.594+0000 7fa1a1547640 1 --2- 172.21.15.2:0/2214660425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ed9ebed40 0x558ed9ed18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:51:30.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.595+0000 7fa1a0d46640 1 --2- 172.21.15.2:0/2214660425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ed9eb3b60 0x558ed9ed4020 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x558ed9dd4040 tx=0x7fa18c00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8918b88e47985b37 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:51:30.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.595+0000 7fa17bfff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:51:30.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.595+0000 7fa17bfff640 1 -- 172.21.15.2:0/2214660425 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18c023020 con 0x558ed9eb3b60 2024-09-19T04:51:30.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.595+0000 7fa17bfff640 1 -- 172.21.15.2:0/2214660425 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7fa18c017db0 con 0x558ed9eb3b60 2024-09-19T04:51:30.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.595+0000 7fa1a5383740 1 -- 172.21.15.2:0/2214660425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa184014210 con 0x558ed9eb3b60 2024-09-19T04:51:30.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.595+0000 7fa17bfff640 1 -- 172.21.15.2:0/2214660425 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fa18c02e050 con 0x558ed9eb3b60 2024-09-19T04:51:30.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.595+0000 7fa1a5383740 10 client.15714 fetch_fsmap learned FSMap version 19 2024-09-19T04:51:30.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.595+0000 7fa1a5383740 1 -- 172.21.15.2:0/2214660425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x558ed9f39020 con 0x558ed9eb3b60 2024-09-19T04:51:30.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.595+0000 7fa17bfff640 1 -- 172.21.15.2:0/2214660425 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa184014210 con 0x558ed9eb3b60 2024-09-19T04:51:30.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.595+0000 7fa17bfff640 1 -- 172.21.15.2:0/2214660425 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fa18c015540 con 0x558ed9eb3b60 2024-09-19T04:51:30.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.595+0000 7fa1a5383740 10 client.15714 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:51:30.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.595+0000 7fa1a5383740 10 client.15714 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:51:30.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.595+0000 7fa1a5383740 20 client.15714 populate_metadata read hostname 'smithi002' 2024-09-19T04:51:30.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.595+0000 7fa1a5383740 1 --2- 172.21.15.2:0/2214660425 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558ed9f39740 0x558ed9f3bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:30.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.595+0000 7fa1a5383740 4 client.15714 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:51:30.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.595+0000 7fa1a5383740 1 -- 172.21.15.2:0/2214660425 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x558ed9e20d00 con 0x558ed9f39740 2024-09-19T04:51:30.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.596+0000 7fa19bfff640 1 --2- 172.21.15.2:0/2214660425 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558ed9f39740 0x558ed9f3bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:30.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.596+0000 7fa19bfff640 1 --2- 172.21.15.2:0/2214660425 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558ed9f39740 0x558ed9f3bb30 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ce2d4606c3f24ad server_cookie=c1b3647eca4d6e2 in_seq=0 out_seq=0 2024-09-19T04:51:30.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.596+0000 7fa17bfff640 10 client.15714 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:51:30.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.597+0000 7fa17bfff640 1 -- 172.21.15.2:0/2214660425 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x558ed9e20d00 con 0x558ed9f39740 2024-09-19T04:51:30.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.597+0000 7fa17bfff640 10 client.15714 handle_command_reply: tid=0 2024-09-19T04:51:30.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.597+0000 7fa1a5383740 1 client.15714 shutdown 2024-09-19T04:51:30.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.597+0000 7fa1a5383740 1 -- 172.21.15.2:0/2214660425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ed9eb3b60 msgr2=0x558ed9ed4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:51:30.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.597+0000 7fa1a5383740 1 --2- 172.21.15.2:0/2214660425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ed9eb3b60 0x558ed9ed4020 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x558ed9dd4040 tx=0x7fa18c00be80 comp rx=0 tx=0).stop 2024-09-19T04:51:30.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.598+0000 7fa1a5383740 1 -- 172.21.15.2:0/2214660425 shutdown_connections 2024-09-19T04:51:30.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.598+0000 7fa1a5383740 1 --2- 172.21.15.2:0/2214660425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558ed9ebed40 0x558ed9ed18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:30.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.598+0000 7fa1a5383740 1 --2- 172.21.15.2:0/2214660425 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558ed9f39740 0x558ed9f3bb30 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:30.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.598+0000 7fa1a5383740 1 --2- 172.21.15.2:0/2214660425 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ed9eb4480 0x558ed9ed1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:30.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.598+0000 7fa1a5383740 1 --2- 172.21.15.2:0/2214660425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558ed9eb3b60 0x558ed9ed4020 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:30.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.598+0000 7fa17bfff640 0 client.15714 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:51:30.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.598+0000 7fa1a5383740 1 -- 172.21.15.2:0/2214660425 >> 172.21.15.2:0/2214660425 conn(0x558ed9eb00f0 msgr2=0x558ed9eaea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:51:30.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.598+0000 7fa1a5383740 1 -- 172.21.15.2:0/2214660425 shutdown_connections 2024-09-19T04:51:30.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.598+0000 7fa1a5383740 1 -- 172.21.15.2:0/2214660425 wait complete. 2024-09-19T04:51:30.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.598+0000 7fa1a5383740 20 client.15714 trim_cache size 0 max 16384 2024-09-19T04:51:30.607 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:51:30.607 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T04:51:30.607 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "95ad360d-6db3-4c2d-a715-79d867347a32", 2024-09-19T04:51:30.607 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T04:51:30.607 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:51:30.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.598+0000 7fa1a2faa640 1 -- 172.21.15.2:0/2643586678 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fa1880a33b0 msgr2=0x7fa1880a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:51:30.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.598+0000 7fa1a2faa640 1 --2- 172.21.15.2:0/2643586678 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fa1880a33b0 0x7fa1880a5870 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa194009430 tx=0x7fa194031c20 comp rx=0 tx=0).stop 2024-09-19T04:51:30.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.598+0000 7fa1a2faa640 1 -- 172.21.15.2:0/2643586678 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa19c102790 msgr2=0x7fa19c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:51:30.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.598+0000 7fa1a2faa640 1 --2- 172.21.15.2:0/2643586678 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa19c102790 0x7fa19c074a30 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fa18400c890 tx=0x7fa18400cd50 comp rx=0 tx=0).stop 2024-09-19T04:51:30.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.598+0000 7fa1a2faa640 1 -- 172.21.15.2:0/2643586678 shutdown_connections 2024-09-19T04:51:30.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.599+0000 7fa1a2faa640 1 --2- 172.21.15.2:0/2643586678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa19c106f10 0x7fa19c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:30.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.599+0000 7fa1a2faa640 1 --2- 172.21.15.2:0/2643586678 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa19c102790 0x7fa19c074a30 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:30.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.599+0000 7fa1a2faa640 1 --2- 172.21.15.2:0/2643586678 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fa1880a33b0 0x7fa1880a5870 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:30.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.599+0000 7fa1a2faa640 1 --2- 172.21.15.2:0/2643586678 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa19c101de0 0x7fa19c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:30.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.599+0000 7fa1a2faa640 1 -- 172.21.15.2:0/2643586678 >> 172.21.15.2:0/2643586678 conn(0x7fa19c0fd8c0 msgr2=0x7fa19c0fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:51:30.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.599+0000 7fa1a2faa640 1 -- 172.21.15.2:0/2643586678 shutdown_connections 2024-09-19T04:51:30.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:30.599+0000 7fa1a2faa640 1 -- 172.21.15.2:0/2643586678 wait complete. 2024-09-19T04:51:31.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:51:30 smithi002 ceph-mon[30975]: pgmap v108: 97 pgs: 97 active+clean; 3.7 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 7 op/s 2024-09-19T04:51:31.306 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:51:30 smithi018 ceph-mon[34537]: pgmap v108: 97 pgs: 97 active+clean; 3.7 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 7 op/s 2024-09-19T04:51:31.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:51:30 smithi116 ceph-mon[34477]: pgmap v108: 97 pgs: 97 active+clean; 3.7 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 7 op/s 2024-09-19T04:51:31.439 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:51:31.705 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:51:32.086 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:51:31 smithi002 ceph-mon[30975]: scrub queued for path: / 2024-09-19T04:51:32.086 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:51:31 smithi002 ceph-mon[30975]: scrub summary: idle+waiting paths [/] 2024-09-19T04:51:32.086 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:51:31 smithi002 ceph-mon[30975]: scrub summary: active paths [/] 2024-09-19T04:51:32.087 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:51:31 smithi002 ceph-mon[30975]: scrub summary: idle+waiting paths [/] 2024-09-19T04:51:32.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.168+0000 7f2362a12640 1 -- 172.21.15.2:0/1107735472 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f235c102ef0 msgr2=0x7f235c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:51:32.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.168+0000 7f2362a12640 1 --2- 172.21.15.2:0/1107735472 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f235c102ef0 0x7f235c10da40 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f2354009ca0 tx=0x7f235402a950 comp rx=0 tx=0).stop 2024-09-19T04:51:32.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.168+0000 7f2362a12640 1 -- 172.21.15.2:0/1107735472 shutdown_connections 2024-09-19T04:51:32.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.168+0000 7f2362a12640 1 --2- 172.21.15.2:0/1107735472 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f235c102ef0 0x7f235c10da40 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:32.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.168+0000 7f2362a12640 1 --2- 172.21.15.2:0/1107735472 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f235c102570 0x7f235c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:32.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.168+0000 7f2362a12640 1 --2- 172.21.15.2:0/1107735472 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f235c100e20 0x7f235c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:32.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.168+0000 7f2362a12640 1 -- 172.21.15.2:0/1107735472 >> 172.21.15.2:0/1107735472 conn(0x7f235c0fc7d0 msgr2=0x7f235c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:51:32.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.168+0000 7f2362a12640 1 -- 172.21.15.2:0/1107735472 shutdown_connections 2024-09-19T04:51:32.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.168+0000 7f2362a12640 1 -- 172.21.15.2:0/1107735472 wait complete. 2024-09-19T04:51:32.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.169+0000 7f2362a12640 1 Processor -- start 2024-09-19T04:51:32.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.169+0000 7f2362a12640 1 -- start start 2024-09-19T04:51:32.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.169+0000 7f2362a12640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f235c100e20 0x7f235c198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:32.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.169+0000 7f2362a12640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f235c102570 0x7f235c1988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:32.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.169+0000 7f2362a12640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f235c102ef0 0x7f235c19cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:32.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.169+0000 7f2362a12640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f235c110e30 con 0x7f235c102570 2024-09-19T04:51:32.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.169+0000 7f2362a12640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f235c110cb0 con 0x7f235c102ef0 2024-09-19T04:51:32.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.169+0000 7f2362a12640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f235c110fb0 con 0x7f235c100e20 2024-09-19T04:51:32.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.169+0000 7f2353fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f235c102570 0x7f235c1988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:32.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.169+0000 7f2353fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f235c102570 0x7f235c1988a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51930/0 (socket says 172.21.15.2:51930) 2024-09-19T04:51:32.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.169+0000 7f2353fff640 1 -- 172.21.15.2:0/2878628217 learned_addr learned my addr 172.21.15.2:0/2878628217 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:51:32.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.169+0000 7f2360faf640 1 --2- 172.21.15.2:0/2878628217 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f235c102ef0 0x7f235c19cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:32.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.169+0000 7f235bfff640 1 --2- 172.21.15.2:0/2878628217 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f235c100e20 0x7f235c198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:32.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.170+0000 7f2353fff640 1 -- 172.21.15.2:0/2878628217 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f235c100e20 msgr2=0x7f235c198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:51:32.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.170+0000 7f2353fff640 1 --2- 172.21.15.2:0/2878628217 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f235c100e20 0x7f235c198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:32.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.170+0000 7f2353fff640 1 -- 172.21.15.2:0/2878628217 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f235c102ef0 msgr2=0x7f235c19cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:51:32.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.170+0000 7f2353fff640 1 --2- 172.21.15.2:0/2878628217 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f235c102ef0 0x7f235c19cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:32.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.170+0000 7f2353fff640 1 -- 172.21.15.2:0/2878628217 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f235c19d310 con 0x7f235c102570 2024-09-19T04:51:32.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.170+0000 7f235bfff640 1 --2- 172.21.15.2:0/2878628217 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f235c100e20 0x7f235c198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:51:32.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.170+0000 7f2353fff640 1 --2- 172.21.15.2:0/2878628217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f235c102570 0x7f235c1988a0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f234400d950 tx=0x7f234400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:51:32.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.170+0000 7f2359ffb640 1 -- 172.21.15.2:0/2878628217 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2344017070 con 0x7f235c102570 2024-09-19T04:51:32.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.170+0000 7f2359ffb640 1 -- 172.21.15.2:0/2878628217 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2344009c30 con 0x7f235c102570 2024-09-19T04:51:32.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.170+0000 7f2362a12640 1 -- 172.21.15.2:0/2878628217 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f235c19d600 con 0x7f235c102570 2024-09-19T04:51:32.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.170+0000 7f2359ffb640 1 -- 172.21.15.2:0/2878628217 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f234400f620 con 0x7f235c102570 2024-09-19T04:51:32.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.170+0000 7f2362a12640 1 -- 172.21.15.2:0/2878628217 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f235c1a4ee0 con 0x7f235c102570 2024-09-19T04:51:32.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.172+0000 7f2359ffb640 1 -- 172.21.15.2:0/2878628217 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f23440109a0 con 0x7f235c102570 2024-09-19T04:51:32.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.173+0000 7f2364deb740 1 Processor -- start 2024-09-19T04:51:32.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.173+0000 7f2364deb740 1 -- start start 2024-09-19T04:51:32.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.173+0000 7f2364deb740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d3b0ac74a0 0x55d3b0ac7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:32.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.173+0000 7f2364deb740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d3b0ac7dc0 0x55d3b0ad2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:32.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.173+0000 7f2364deb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3b0ad2680 0x55d3b0ad4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:32.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.173+0000 7f2364deb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d3b0a2d2e0 con 0x55d3b0ad2680 2024-09-19T04:51:32.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.173+0000 7f2364deb740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d3b09d4ce0 con 0x55d3b0ac74a0 2024-09-19T04:51:32.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.173+0000 7f2364deb740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55d3b0a292a0 con 0x55d3b0ac7dc0 2024-09-19T04:51:32.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.173+0000 7f2353fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3b0ad2680 0x55d3b0ad4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:32.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.173+0000 7f2353fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3b0ad2680 0x55d3b0ad4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51938/0 (socket says 172.21.15.2:51938) 2024-09-19T04:51:32.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.173+0000 7f2353fff640 1 -- 172.21.15.2:0/483547986 learned_addr learned my addr 172.21.15.2:0/483547986 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:51:32.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.173+0000 7f2360faf640 1 --2- 172.21.15.2:0/483547986 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d3b0ac74a0 0x55d3b0ac7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:32.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.173+0000 7f235bfff640 1 --2- 172.21.15.2:0/483547986 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d3b0ac7dc0 0x55d3b0ad2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:32.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.173+0000 7f2359ffb640 1 --2- 172.21.15.2:0/2878628217 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f23480a33b0 0x7f23480a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:32.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.173+0000 7f2360faf640 1 --2- 172.21.15.2:0/2878628217 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f23480a33b0 0x7f23480a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:32.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.173+0000 7f2353fff640 1 -- 172.21.15.2:0/483547986 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d3b0ac7dc0 msgr2=0x55d3b0ad2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:51:32.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.173+0000 7f2353fff640 1 --2- 172.21.15.2:0/483547986 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d3b0ac7dc0 0x55d3b0ad2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:32.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.173+0000 7f2353fff640 1 -- 172.21.15.2:0/483547986 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d3b0ac74a0 msgr2=0x55d3b0ac7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:51:32.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.173+0000 7f2353fff640 1 --2- 172.21.15.2:0/483547986 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d3b0ac74a0 0x55d3b0ac7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:32.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.174+0000 7f2359ffb640 1 -- 172.21.15.2:0/2878628217 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f23440cf9b0 con 0x7f235c102570 2024-09-19T04:51:32.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.174+0000 7f2353fff640 1 -- 172.21.15.2:0/483547986 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3b09b9440 con 0x55d3b0ad2680 2024-09-19T04:51:32.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.174+0000 7f2353fff640 1 --2- 172.21.15.2:0/483547986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3b0ad2680 0x55d3b0ad4a70 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f234409b950 tx=0x7f234400bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bb443de80d840f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:51:32.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.174+0000 7f2360faf640 1 --2- 172.21.15.2:0/2878628217 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f23480a33b0 0x7f23480a5870 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2354004ad0 tx=0x7f235402a950 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:51:32.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.174+0000 7f23527fc640 1 -- 172.21.15.2:0/483547986 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2344020070 con 0x55d3b0ad2680 2024-09-19T04:51:32.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.174+0000 7f23527fc640 1 -- 172.21.15.2:0/483547986 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f234404c170 con 0x55d3b0ad2680 2024-09-19T04:51:32.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.174+0000 7f23527fc640 1 -- 172.21.15.2:0/483547986 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23440b1040 con 0x55d3b0ad2680 2024-09-19T04:51:32.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.175+0000 7f2364deb740 1 -- 172.21.15.2:0/483547986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3b0ad2680 msgr2=0x55d3b0ad4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:51:32.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.175+0000 7f2364deb740 1 --2- 172.21.15.2:0/483547986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3b0ad2680 0x55d3b0ad4a70 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f234409b950 tx=0x7f234400bf60 comp rx=0 tx=0).stop 2024-09-19T04:51:32.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.175+0000 7f2364deb740 1 -- 172.21.15.2:0/483547986 shutdown_connections 2024-09-19T04:51:32.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.175+0000 7f2364deb740 1 --2- 172.21.15.2:0/483547986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3b0ad2680 0x55d3b0ad4a70 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:32.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.175+0000 7f2364deb740 1 --2- 172.21.15.2:0/483547986 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d3b0ac7dc0 0x55d3b0ad2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:32.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.175+0000 7f2364deb740 1 --2- 172.21.15.2:0/483547986 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d3b0ac74a0 0x55d3b0ac7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:32.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.175+0000 7f2364deb740 1 -- 172.21.15.2:0/483547986 >> 172.21.15.2:0/483547986 conn(0x55d3b0ac3a30 msgr2=0x55d3b0ac3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:51:32.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.175+0000 7f2364deb740 1 -- 172.21.15.2:0/483547986 shutdown_connections 2024-09-19T04:51:32.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.175+0000 7f2364deb740 1 -- 172.21.15.2:0/483547986 wait complete. 2024-09-19T04:51:32.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.175+0000 7f2364deb740 1 -- start start 2024-09-19T04:51:32.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.175+0000 7f2364deb740 1 Processor -- start 2024-09-19T04:51:32.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.176+0000 7f2364deb740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d3b0ac74a0 0x55d3b0ad1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:32.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.176+0000 7f2364deb740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d3b0ac7dc0 0x55d3b0acf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:32.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.176+0000 7f2364deb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3b0ad2680 0x55d3b0acf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:32.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.176+0000 7f2364deb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d3b0ad51f0 con 0x55d3b0ad2680 2024-09-19T04:51:32.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.176+0000 7f2364deb740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d3b09e8050 con 0x55d3b0ac74a0 2024-09-19T04:51:32.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.176+0000 7f2364deb740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55d3b0ad5370 con 0x55d3b0ac7dc0 2024-09-19T04:51:32.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.176+0000 7f2364deb740 10 client.0 _ll_register_callbacks cb 0x55d3b0a28160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:51:32.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.176+0000 7f2360faf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3b0ad2680 0x55d3b0acf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:32.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.176+0000 7f2360faf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3b0ad2680 0x55d3b0acf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51952/0 (socket says 172.21.15.2:51952) 2024-09-19T04:51:32.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.176+0000 7f2360faf640 1 -- 172.21.15.2:0/5764049 learned_addr learned my addr 172.21.15.2:0/5764049 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:51:32.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.176+0000 7f235bfff640 1 --2- 172.21.15.2:0/5764049 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d3b0ac74a0 0x55d3b0ad1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:32.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.176+0000 7f2353fff640 1 --2- 172.21.15.2:0/5764049 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d3b0ac7dc0 0x55d3b0acf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:32.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.176+0000 7f2360faf640 1 -- 172.21.15.2:0/5764049 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d3b0ac7dc0 msgr2=0x55d3b0acf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:51:32.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.176+0000 7f2360faf640 1 --2- 172.21.15.2:0/5764049 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d3b0ac7dc0 0x55d3b0acf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:32.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.176+0000 7f2360faf640 1 -- 172.21.15.2:0/5764049 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d3b0ac74a0 msgr2=0x55d3b0ad1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:51:32.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.176+0000 7f2360faf640 1 --2- 172.21.15.2:0/5764049 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d3b0ac74a0 0x55d3b0ad1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:32.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.176+0000 7f2360faf640 1 -- 172.21.15.2:0/5764049 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3b079e3c0 con 0x55d3b0ad2680 2024-09-19T04:51:32.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.176+0000 7f235bfff640 1 --2- 172.21.15.2:0/5764049 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d3b0ac74a0 0x55d3b0ad1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:51:32.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.176+0000 7f2360faf640 1 --2- 172.21.15.2:0/5764049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3b0ad2680 0x55d3b0acf720 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2354035000 tx=0x7f23540095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5edd4398a5c310c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:51:32.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.176+0000 7f233b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:51:32.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.177+0000 7f233b7fe640 1 -- 172.21.15.2:0/5764049 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2354043050 con 0x55d3b0ad2680 2024-09-19T04:51:32.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.177+0000 7f233b7fe640 1 -- 172.21.15.2:0/5764049 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f2354004450 con 0x55d3b0ad2680 2024-09-19T04:51:32.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.177+0000 7f2364deb740 1 -- 172.21.15.2:0/5764049 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d3b0a3a850 con 0x55d3b0ad2680 2024-09-19T04:51:32.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.177+0000 7f233b7fe640 1 -- 172.21.15.2:0/5764049 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f2354034040 con 0x55d3b0ad2680 2024-09-19T04:51:32.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.177+0000 7f2364deb740 10 client.15726 fetch_fsmap learned FSMap version 19 2024-09-19T04:51:32.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.177+0000 7f2364deb740 1 -- 172.21.15.2:0/5764049 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55d3b0ae0b60 con 0x55d3b0ad2680 2024-09-19T04:51:32.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.177+0000 7f233b7fe640 1 -- 172.21.15.2:0/5764049 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55d3b0a3a850 con 0x55d3b0ad2680 2024-09-19T04:51:32.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.177+0000 7f233b7fe640 1 -- 172.21.15.2:0/5764049 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f2354030440 con 0x55d3b0ad2680 2024-09-19T04:51:32.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.177+0000 7f2364deb740 10 client.15726 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:51:32.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.177+0000 7f2364deb740 10 client.15726 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:51:32.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.177+0000 7f2364deb740 20 client.15726 populate_metadata read hostname 'smithi002' 2024-09-19T04:51:32.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.177+0000 7f2364deb740 1 --2- 172.21.15.2:0/5764049 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55d3b0ae1f70 0x55d3b0ae4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:32.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.177+0000 7f2364deb740 4 client.15726 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:51:32.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.177+0000 7f2364deb740 1 -- 172.21.15.2:0/5764049 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d3b0a34d60 con 0x55d3b0ae1f70 2024-09-19T04:51:32.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.178+0000 7f235bfff640 1 --2- 172.21.15.2:0/5764049 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55d3b0ae1f70 0x55d3b0ae4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:32.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.178+0000 7f233b7fe640 10 client.15726 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:51:32.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.178+0000 7f235bfff640 1 --2- 172.21.15.2:0/5764049 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55d3b0ae1f70 0x55d3b0ae4380 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82f0b03b03c373e9 server_cookie=45f30ceb17df4b47 in_seq=0 out_seq=0 2024-09-19T04:51:32.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.179+0000 7f233b7fe640 1 -- 172.21.15.2:0/5764049 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d3b0a34d60 con 0x55d3b0ae1f70 2024-09-19T04:51:32.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.179+0000 7f233b7fe640 10 client.15726 handle_command_reply: tid=0 2024-09-19T04:51:32.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.179+0000 7f2364deb740 1 client.15726 shutdown 2024-09-19T04:51:32.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.179+0000 7f2364deb740 1 -- 172.21.15.2:0/5764049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3b0ad2680 msgr2=0x55d3b0acf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:51:32.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.179+0000 7f2364deb740 1 --2- 172.21.15.2:0/5764049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3b0ad2680 0x55d3b0acf720 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2354035000 tx=0x7f23540095c0 comp rx=0 tx=0).stop 2024-09-19T04:51:32.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.179+0000 7f2364deb740 1 -- 172.21.15.2:0/5764049 shutdown_connections 2024-09-19T04:51:32.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.179+0000 7f2364deb740 1 --2- 172.21.15.2:0/5764049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3b0ad2680 0x55d3b0acf720 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:32.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.179+0000 7f2364deb740 1 --2- 172.21.15.2:0/5764049 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55d3b0ae1f70 0x55d3b0ae4380 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:32.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.179+0000 7f2364deb740 1 --2- 172.21.15.2:0/5764049 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d3b0ac7dc0 0x55d3b0acf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:32.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.179+0000 7f2364deb740 1 --2- 172.21.15.2:0/5764049 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d3b0ac74a0 0x55d3b0ad1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:32.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.179+0000 7f233b7fe640 0 client.15726 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:51:32.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.179+0000 7f2364deb740 1 -- 172.21.15.2:0/5764049 >> 172.21.15.2:0/5764049 conn(0x55d3b0ac3a30 msgr2=0x55d3b0ac9760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:51:32.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.179+0000 7f2364deb740 1 -- 172.21.15.2:0/5764049 shutdown_connections 2024-09-19T04:51:32.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.179+0000 7f2364deb740 1 -- 172.21.15.2:0/5764049 wait complete. 2024-09-19T04:51:32.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.179+0000 7f2364deb740 20 client.15726 trim_cache size 0 max 16384 2024-09-19T04:51:32.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.196+0000 7f2364deb740 1 Processor -- start 2024-09-19T04:51:32.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.196+0000 7f2364deb740 1 -- start start 2024-09-19T04:51:32.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.196+0000 7f2364deb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3b0ac3a30 0x55d3b0ade450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:32.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.196+0000 7f2364deb740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d3b0ac74a0 0x55d3b0aca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:32.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.197+0000 7f2364deb740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d3b0ac7dc0 0x55d3b0ae9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:32.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.197+0000 7f2364deb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f235c1ab5f0 con 0x55d3b0ac3a30 2024-09-19T04:51:32.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.197+0000 7f2364deb740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f235c1ade70 con 0x55d3b0ac74a0 2024-09-19T04:51:32.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.197+0000 7f2364deb740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f235c1abc60 con 0x55d3b0ac7dc0 2024-09-19T04:51:32.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.197+0000 7f235bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3b0ac3a30 0x55d3b0ade450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:32.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.197+0000 7f235bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3b0ac3a30 0x55d3b0ade450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51964/0 (socket says 172.21.15.2:51964) 2024-09-19T04:51:32.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.197+0000 7f235bfff640 1 -- 172.21.15.2:0/2890915951 learned_addr learned my addr 172.21.15.2:0/2890915951 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:51:32.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.197+0000 7f2353fff640 1 --2- 172.21.15.2:0/2890915951 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d3b0ac74a0 0x55d3b0aca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:32.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.197+0000 7f235bfff640 1 -- 172.21.15.2:0/2890915951 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d3b0ac7dc0 msgr2=0x55d3b0ae9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:51:32.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.197+0000 7f235bfff640 1 --2- 172.21.15.2:0/2890915951 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d3b0ac7dc0 0x55d3b0ae9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:32.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.197+0000 7f235bfff640 1 -- 172.21.15.2:0/2890915951 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d3b0ac74a0 msgr2=0x55d3b0aca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:51:32.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.197+0000 7f235bfff640 1 --2- 172.21.15.2:0/2890915951 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d3b0ac74a0 0x55d3b0aca7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:32.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.197+0000 7f235bfff640 1 -- 172.21.15.2:0/2890915951 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3b0ac3860 con 0x55d3b0ac3a30 2024-09-19T04:51:32.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.197+0000 7f235bfff640 1 --2- 172.21.15.2:0/2890915951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3b0ac3a30 0x55d3b0ade450 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x55d3b0ae4ba0 tx=0x7f234c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6419371fd6b6137 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:51:32.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.197+0000 7f2351ffb640 1 -- 172.21.15.2:0/2890915951 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f234c016070 con 0x55d3b0ac3a30 2024-09-19T04:51:32.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.197+0000 7f2351ffb640 1 -- 172.21.15.2:0/2890915951 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f234c01ea60 con 0x55d3b0ac3a30 2024-09-19T04:51:32.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.197+0000 7f2351ffb640 1 -- 172.21.15.2:0/2890915951 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f234c012ce0 con 0x55d3b0ac3a30 2024-09-19T04:51:32.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.198+0000 7f2364deb740 1 -- 172.21.15.2:0/2890915951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3b0ac3a30 msgr2=0x55d3b0ade450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:51:32.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.198+0000 7f2364deb740 1 --2- 172.21.15.2:0/2890915951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3b0ac3a30 0x55d3b0ade450 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x55d3b0ae4ba0 tx=0x7f234c0046c0 comp rx=0 tx=0).stop 2024-09-19T04:51:32.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.198+0000 7f2364deb740 1 -- 172.21.15.2:0/2890915951 shutdown_connections 2024-09-19T04:51:32.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.198+0000 7f2364deb740 1 --2- 172.21.15.2:0/2890915951 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d3b0ac7dc0 0x55d3b0ae9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:32.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.198+0000 7f2364deb740 1 --2- 172.21.15.2:0/2890915951 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d3b0ac74a0 0x55d3b0aca7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:32.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.198+0000 7f2364deb740 1 --2- 172.21.15.2:0/2890915951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3b0ac3a30 0x55d3b0ade450 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:32.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.198+0000 7f2364deb740 1 -- 172.21.15.2:0/2890915951 >> 172.21.15.2:0/2890915951 conn(0x55d3b0acf880 msgr2=0x55d3b0aca090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:51:32.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.198+0000 7f2364deb740 1 -- 172.21.15.2:0/2890915951 shutdown_connections 2024-09-19T04:51:32.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.198+0000 7f2364deb740 1 -- 172.21.15.2:0/2890915951 wait complete. 2024-09-19T04:51:32.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.198+0000 7f2364deb740 1 -- start start 2024-09-19T04:51:32.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.199+0000 7f2364deb740 1 Processor -- start 2024-09-19T04:51:32.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.199+0000 7f2364deb740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d3b0ac3a30 0x55d3b0adab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:32.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.199+0000 7f2364deb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3b0ac74a0 0x55d3b0ad5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:32.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.199+0000 7f2364deb740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d3b0ac7dc0 0x55d3b0ad63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:32.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.199+0000 7f2364deb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f235c1ac330 con 0x55d3b0ac74a0 2024-09-19T04:51:32.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.199+0000 7f2364deb740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f235c1ad7a0 con 0x55d3b0ac7dc0 2024-09-19T04:51:32.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.199+0000 7f2364deb740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f235c1aca00 con 0x55d3b0ac3a30 2024-09-19T04:51:32.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.199+0000 7f2364deb740 10 client.0 _ll_register_callbacks cb 0x7f235402f3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:51:32.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.199+0000 7f2353fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3b0ac74a0 0x55d3b0ad5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:32.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.199+0000 7f2353fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3b0ac74a0 0x55d3b0ad5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51968/0 (socket says 172.21.15.2:51968) 2024-09-19T04:51:32.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.199+0000 7f2353fff640 1 -- 172.21.15.2:0/2705906841 learned_addr learned my addr 172.21.15.2:0/2705906841 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:51:32.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.199+0000 7f2360faf640 1 --2- 172.21.15.2:0/2705906841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d3b0ac7dc0 0x55d3b0ad63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:32.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.199+0000 7f235bfff640 1 --2- 172.21.15.2:0/2705906841 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d3b0ac3a30 0x55d3b0adab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:32.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.199+0000 7f2353fff640 1 -- 172.21.15.2:0/2705906841 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d3b0ac3a30 msgr2=0x55d3b0adab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:51:32.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.199+0000 7f2353fff640 1 --2- 172.21.15.2:0/2705906841 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d3b0ac3a30 0x55d3b0adab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:32.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.199+0000 7f2353fff640 1 -- 172.21.15.2:0/2705906841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d3b0ac7dc0 msgr2=0x55d3b0ad63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:51:32.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.199+0000 7f2353fff640 1 --2- 172.21.15.2:0/2705906841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d3b0ac7dc0 0x55d3b0ad63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:32.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.199+0000 7f2353fff640 1 -- 172.21.15.2:0/2705906841 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3b0ad6a10 con 0x55d3b0ac74a0 2024-09-19T04:51:32.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.199+0000 7f2360faf640 1 --2- 172.21.15.2:0/2705906841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d3b0ac7dc0 0x55d3b0ad63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:51:32.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.199+0000 7f2353fff640 1 --2- 172.21.15.2:0/2705906841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3b0ac74a0 0x55d3b0ad5e90 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f234409b720 tx=0x7f23440978c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4feb07da5f30a37 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:51:32.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.199+0000 7f233b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:51:32.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.200+0000 7f233b7fe640 1 -- 172.21.15.2:0/2705906841 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23440b1020 con 0x55d3b0ac74a0 2024-09-19T04:51:32.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.200+0000 7f2364deb740 1 -- 172.21.15.2:0/2705906841 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f234c01ea60 con 0x55d3b0ac74a0 2024-09-19T04:51:32.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.200+0000 7f233b7fe640 1 -- 172.21.15.2:0/2705906841 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f234409b0a0 con 0x55d3b0ac74a0 2024-09-19T04:51:32.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.200+0000 7f233b7fe640 1 -- 172.21.15.2:0/2705906841 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f2344020040 con 0x55d3b0ac74a0 2024-09-19T04:51:32.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.200+0000 7f2364deb740 10 client.15732 fetch_fsmap learned FSMap version 19 2024-09-19T04:51:32.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.200+0000 7f2364deb740 1 -- 172.21.15.2:0/2705906841 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55d3b0b4ca30 con 0x55d3b0ac74a0 2024-09-19T04:51:32.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.200+0000 7f233b7fe640 1 -- 172.21.15.2:0/2705906841 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f234c01ea60 con 0x55d3b0ac74a0 2024-09-19T04:51:32.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.200+0000 7f233b7fe640 1 -- 172.21.15.2:0/2705906841 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f2344010460 con 0x55d3b0ac74a0 2024-09-19T04:51:32.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.200+0000 7f2364deb740 10 client.15732 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:51:32.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.200+0000 7f2364deb740 10 client.15732 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:51:32.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.200+0000 7f2364deb740 20 client.15732 populate_metadata read hostname 'smithi002' 2024-09-19T04:51:32.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.200+0000 7f2364deb740 1 --2- 172.21.15.2:0/2705906841 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55d3b0ad2680 0x55d3b0b4eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:51:32.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.200+0000 7f2364deb740 4 client.15732 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:51:32.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.200+0000 7f2364deb740 1 -- 172.21.15.2:0/2705906841 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d3b09b1210 con 0x55d3b0ad2680 2024-09-19T04:51:32.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.201+0000 7f235bfff640 1 --2- 172.21.15.2:0/2705906841 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55d3b0ad2680 0x55d3b0b4eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:51:32.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.201+0000 7f235bfff640 1 --2- 172.21.15.2:0/2705906841 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55d3b0ad2680 0x55d3b0b4eee0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=989f9588c7a8bcb3 server_cookie=69fada858057300b in_seq=0 out_seq=0 2024-09-19T04:51:32.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.201+0000 7f233b7fe640 10 client.15732 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:51:32.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.201+0000 7f233b7fe640 1 -- 172.21.15.2:0/2705906841 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55d3b09b1210 con 0x55d3b0ad2680 2024-09-19T04:51:32.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.201+0000 7f233b7fe640 10 client.15732 handle_command_reply: tid=0 2024-09-19T04:51:32.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.202+0000 7f2364deb740 1 client.15732 shutdown 2024-09-19T04:51:32.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.202+0000 7f2364deb740 1 -- 172.21.15.2:0/2705906841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3b0ac74a0 msgr2=0x55d3b0ad5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:51:32.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.202+0000 7f2364deb740 1 --2- 172.21.15.2:0/2705906841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3b0ac74a0 0x55d3b0ad5e90 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f234409b720 tx=0x7f23440978c0 comp rx=0 tx=0).stop 2024-09-19T04:51:32.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.202+0000 7f2364deb740 1 -- 172.21.15.2:0/2705906841 shutdown_connections 2024-09-19T04:51:32.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.202+0000 7f2364deb740 1 --2- 172.21.15.2:0/2705906841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d3b0ac7dc0 0x55d3b0ad63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:32.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.202+0000 7f2364deb740 1 --2- 172.21.15.2:0/2705906841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d3b0ac74a0 0x55d3b0ad5e90 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:32.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.202+0000 7f2364deb740 1 --2- 172.21.15.2:0/2705906841 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55d3b0ad2680 0x55d3b0b4eee0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:32.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.202+0000 7f2364deb740 1 --2- 172.21.15.2:0/2705906841 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d3b0ac3a30 0x55d3b0adab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:32.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.203+0000 7f233b7fe640 0 client.15732 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:51:32.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.203+0000 7f2364deb740 1 -- 172.21.15.2:0/2705906841 >> 172.21.15.2:0/2705906841 conn(0x55d3b0acf880 msgr2=0x55d3b0ad0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:51:32.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.203+0000 7f2364deb740 1 -- 172.21.15.2:0/2705906841 shutdown_connections 2024-09-19T04:51:32.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.203+0000 7f2364deb740 1 -- 172.21.15.2:0/2705906841 wait complete. 2024-09-19T04:51:32.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.203+0000 7f2364deb740 20 client.15732 trim_cache size 0 max 16384 2024-09-19T04:51:32.220 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:51:32.220 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T04:51:32.220 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-19T04:51:32.220 INFO:teuthology.orchestra.run.smithi002.stdout: "95ad360d-6db3-4c2d-a715-79d867347a32": { 2024-09-19T04:51:32.220 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-19T04:51:32.220 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "95ad360d-6db3-4c2d-a715-79d867347a32", 2024-09-19T04:51:32.220 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-19T04:51:32.220 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:51:32.220 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:51:32.220 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:51:32.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.203+0000 7f2362a12640 1 -- 172.21.15.2:0/2878628217 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f23480a33b0 msgr2=0x7f23480a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:51:32.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.203+0000 7f2362a12640 1 --2- 172.21.15.2:0/2878628217 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f23480a33b0 0x7f23480a5870 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2354004ad0 tx=0x7f235402a950 comp rx=0 tx=0).stop 2024-09-19T04:51:32.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.203+0000 7f2362a12640 1 -- 172.21.15.2:0/2878628217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f235c102570 msgr2=0x7f235c1988a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:51:32.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.203+0000 7f2362a12640 1 --2- 172.21.15.2:0/2878628217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f235c102570 0x7f235c1988a0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f234400d950 tx=0x7f234400de10 comp rx=0 tx=0).stop 2024-09-19T04:51:32.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.203+0000 7f2362a12640 1 -- 172.21.15.2:0/2878628217 shutdown_connections 2024-09-19T04:51:32.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.203+0000 7f2362a12640 1 --2- 172.21.15.2:0/2878628217 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f235c102ef0 0x7f235c19cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:32.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.203+0000 7f2362a12640 1 --2- 172.21.15.2:0/2878628217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f235c102570 0x7f235c1988a0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:32.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.203+0000 7f2362a12640 1 --2- 172.21.15.2:0/2878628217 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f23480a33b0 0x7f23480a5870 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:32.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.203+0000 7f2362a12640 1 --2- 172.21.15.2:0/2878628217 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f235c100e20 0x7f235c198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:51:32.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.203+0000 7f2362a12640 1 -- 172.21.15.2:0/2878628217 >> 172.21.15.2:0/2878628217 conn(0x7f235c0fc7d0 msgr2=0x7f235c06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:51:32.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.203+0000 7f2362a12640 1 -- 172.21.15.2:0/2878628217 shutdown_connections 2024-09-19T04:51:32.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:51:32.204+0000 7f2362a12640 1 -- 172.21.15.2:0/2878628217 wait complete. 2024-09-19T04:51:32.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:51:31 smithi018 ceph-mon[34537]: scrub queued for path: / 2024-09-19T04:51:32.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:51:31 smithi018 ceph-mon[34537]: scrub summary: idle+waiting paths [/] 2024-09-19T04:51:32.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:51:31 smithi018 ceph-mon[34537]: scrub summary: active paths [/] 2024-09-19T04:51:32.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:51:31 smithi018 ceph-mon[34537]: scrub summary: idle+waiting paths [/] 2024-09-19T04:51:32.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:51:31 smithi116 ceph-mon[34477]: scrub queued for path: / 2024-09-19T04:51:32.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:51:31 smithi116 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-19T04:51:32.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:51:31 smithi116 ceph-mon[34477]: scrub summary: active paths [/] 2024-09-19T04:51:32.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:51:31 smithi116 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-19T04:51:32.863 INFO:tasks.cephfs.filesystem:scrub status for tag:95ad360d-6db3-4c2d-a715-79d867347a32 - {'path': '/', 'tag': '95ad360d-6db3-4c2d-a715-79d867347a32', 'options': 'recursive,force'} 2024-09-19T04:51:33.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:51:32 smithi002 ceph-mon[30975]: pgmap v109: 97 pgs: 97 active+clean; 3.8 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 32 KiB/s wr, 10 op/s 2024-09-19T04:51:33.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:51:32 smithi018 ceph-mon[34537]: pgmap v109: 97 pgs: 97 active+clean; 3.8 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 32 KiB/s wr, 10 op/s 2024-09-19T04:51:33.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:51:32 smithi116 ceph-mon[34477]: pgmap v109: 97 pgs: 97 active+clean; 3.8 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 32 KiB/s wr, 10 op/s 2024-09-19T04:51:35.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:51:34 smithi018 ceph-mon[34537]: pgmap v110: 97 pgs: 97 active+clean; 3.8 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 7 op/s 2024-09-19T04:51:35.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:51:34 smithi002 ceph-mon[30975]: pgmap v110: 97 pgs: 97 active+clean; 3.8 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 7 op/s 2024-09-19T04:51:35.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:51:34 smithi116 ceph-mon[34477]: pgmap v110: 97 pgs: 97 active+clean; 3.8 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 7 op/s 2024-09-19T04:51:36.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:51:35 smithi018 ceph-mon[34537]: scrub summary: idle 2024-09-19T04:51:36.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:51:35 smithi002 ceph-mon[30975]: scrub summary: idle 2024-09-19T04:51:36.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:51:35 smithi116 ceph-mon[34477]: scrub summary: idle 2024-09-19T04:51:37.306 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:51:36 smithi018 ceph-mon[34537]: pgmap v111: 97 pgs: 97 active+clean; 3.9 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 KiB/s wr, 11 op/s 2024-09-19T04:51:37.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:51:36 smithi002 ceph-mon[30975]: pgmap v111: 97 pgs: 97 active+clean; 3.9 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 KiB/s wr, 11 op/s 2024-09-19T04:51:37.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:51:36 smithi116 ceph-mon[34477]: pgmap v111: 97 pgs: 97 active+clean; 3.9 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 KiB/s wr, 11 op/s 2024-09-19T04:51:39.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:51:38 smithi018 ceph-mon[34537]: pgmap v112: 97 pgs: 97 active+clean; 3.9 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 23 KiB/s wr, 7 op/s 2024-09-19T04:51:39.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:51:38 smithi002 ceph-mon[30975]: pgmap v112: 97 pgs: 97 active+clean; 3.9 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 23 KiB/s wr, 7 op/s 2024-09-19T04:51:39.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:51:38 smithi116 ceph-mon[34477]: pgmap v112: 97 pgs: 97 active+clean; 3.9 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 23 KiB/s wr, 7 op/s 2024-09-19T04:51:41.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:51:40 smithi018 ceph-mon[34537]: pgmap v113: 97 pgs: 97 active+clean; 3.9 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 23 KiB/s wr, 7 op/s 2024-09-19T04:51:41.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:51:40 smithi002 ceph-mon[30975]: pgmap v113: 97 pgs: 97 active+clean; 3.9 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 23 KiB/s wr, 7 op/s 2024-09-19T04:51:41.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:51:40 smithi116 ceph-mon[34477]: pgmap v113: 97 pgs: 97 active+clean; 3.9 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 23 KiB/s wr, 7 op/s 2024-09-19T04:51:43.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:51:42 smithi018 ceph-mon[34537]: pgmap v114: 97 pgs: 97 active+clean; 4.1 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 33 KiB/s wr, 11 op/s 2024-09-19T04:51:43.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:51:42 smithi002 ceph-mon[30975]: pgmap v114: 97 pgs: 97 active+clean; 4.1 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 33 KiB/s wr, 11 op/s 2024-09-19T04:51:43.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:51:42 smithi116 ceph-mon[34477]: pgmap v114: 97 pgs: 97 active+clean; 4.1 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 33 KiB/s wr, 11 op/s 2024-09-19T04:51:45.306 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:51:44 smithi018 ceph-mon[34537]: pgmap v115: 97 pgs: 97 active+clean; 4.1 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 23 KiB/s wr, 7 op/s 2024-09-19T04:51:45.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:51:44 smithi002 ceph-mon[30975]: pgmap v115: 97 pgs: 97 active+clean; 4.1 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 23 KiB/s wr, 7 op/s 2024-09-19T04:51:45.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:51:44 smithi116 ceph-mon[34477]: pgmap v115: 97 pgs: 97 active+clean; 4.1 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 23 KiB/s wr, 7 op/s 2024-09-19T04:51:47.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:51:46 smithi018 ceph-mon[34537]: pgmap v116: 97 pgs: 97 active+clean; 4.2 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 34 KiB/s wr, 11 op/s 2024-09-19T04:51:47.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:51:46 smithi002 ceph-mon[30975]: pgmap v116: 97 pgs: 97 active+clean; 4.2 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 34 KiB/s wr, 11 op/s 2024-09-19T04:51:47.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:51:46 smithi116 ceph-mon[34477]: pgmap v116: 97 pgs: 97 active+clean; 4.2 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 34 KiB/s wr, 11 op/s 2024-09-19T04:51:49.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:51:48 smithi002 ceph-mon[30975]: pgmap v117: 97 pgs: 97 active+clean; 4.2 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 6 op/s 2024-09-19T04:51:49.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:51:48 smithi018 ceph-mon[34537]: pgmap v117: 97 pgs: 97 active+clean; 4.2 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 6 op/s 2024-09-19T04:51:49.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:51:48 smithi116 ceph-mon[34477]: pgmap v117: 97 pgs: 97 active+clean; 4.2 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 6 op/s 2024-09-19T04:51:51.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:51:50 smithi018 ceph-mon[34537]: pgmap v118: 97 pgs: 97 active+clean; 4.2 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 6 op/s 2024-09-19T04:51:51.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:51:50 smithi002 ceph-mon[30975]: pgmap v118: 97 pgs: 97 active+clean; 4.2 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 6 op/s 2024-09-19T04:51:51.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:51:50 smithi116 ceph-mon[34477]: pgmap v118: 97 pgs: 97 active+clean; 4.2 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 6 op/s 2024-09-19T04:51:53.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:51:52 smithi018 ceph-mon[34537]: pgmap v119: 97 pgs: 97 active+clean; 4.3 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 31 KiB/s wr, 10 op/s 2024-09-19T04:51:53.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:51:52 smithi002 ceph-mon[30975]: pgmap v119: 97 pgs: 97 active+clean; 4.3 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 31 KiB/s wr, 10 op/s 2024-09-19T04:51:53.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:51:52 smithi116 ceph-mon[34477]: pgmap v119: 97 pgs: 97 active+clean; 4.3 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 31 KiB/s wr, 10 op/s 2024-09-19T04:51:55.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:51:54 smithi018 ceph-mon[34537]: pgmap v120: 97 pgs: 97 active+clean; 4.3 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 7 op/s 2024-09-19T04:51:55.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:51:54 smithi002 ceph-mon[30975]: pgmap v120: 97 pgs: 97 active+clean; 4.3 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 7 op/s 2024-09-19T04:51:55.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:51:54 smithi116 ceph-mon[34477]: pgmap v120: 97 pgs: 97 active+clean; 4.3 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 7 op/s 2024-09-19T04:51:57.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:51:56 smithi018 ceph-mon[34537]: pgmap v121: 97 pgs: 97 active+clean; 4.4 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 32 KiB/s wr, 10 op/s 2024-09-19T04:51:57.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:51:56 smithi002 ceph-mon[30975]: pgmap v121: 97 pgs: 97 active+clean; 4.4 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 32 KiB/s wr, 10 op/s 2024-09-19T04:51:57.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:51:56 smithi116 ceph-mon[34477]: pgmap v121: 97 pgs: 97 active+clean; 4.4 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 32 KiB/s wr, 10 op/s 2024-09-19T04:51:59.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:51:58 smithi018 ceph-mon[34537]: pgmap v122: 97 pgs: 97 active+clean; 4.4 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 7 op/s 2024-09-19T04:51:59.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:51:58 smithi002 ceph-mon[30975]: pgmap v122: 97 pgs: 97 active+clean; 4.4 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 7 op/s 2024-09-19T04:51:59.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:51:58 smithi116 ceph-mon[34477]: pgmap v122: 97 pgs: 97 active+clean; 4.4 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 7 op/s 2024-09-19T04:52:01.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:00 smithi018 ceph-mon[34537]: pgmap v123: 97 pgs: 97 active+clean; 4.4 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 7 op/s 2024-09-19T04:52:01.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:00 smithi002 ceph-mon[30975]: pgmap v123: 97 pgs: 97 active+clean; 4.4 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 7 op/s 2024-09-19T04:52:01.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:00 smithi116 ceph-mon[34477]: pgmap v123: 97 pgs: 97 active+clean; 4.4 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 7 op/s 2024-09-19T04:52:02.864 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:52:03.142 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:52:03.264 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:02 smithi002 ceph-mon[30975]: pgmap v124: 97 pgs: 97 active+clean; 4.5 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 31 KiB/s wr, 10 op/s 2024-09-19T04:52:03.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:02 smithi018 ceph-mon[34537]: pgmap v124: 97 pgs: 97 active+clean; 4.5 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 31 KiB/s wr, 10 op/s 2024-09-19T04:52:03.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:02 smithi116 ceph-mon[34477]: pgmap v124: 97 pgs: 97 active+clean; 4.5 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 31 KiB/s wr, 10 op/s 2024-09-19T04:52:03.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.603+0000 7ff0e6f2e640 1 -- 172.21.15.2:0/3137953936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0e0102ef0 msgr2=0x7ff0e010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:03.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.603+0000 7ff0e6f2e640 1 --2- 172.21.15.2:0/3137953936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0e0102ef0 0x7ff0e010da40 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8009be0 tx=0x7ff0d802a750 comp rx=0 tx=0).stop 2024-09-19T04:52:03.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.603+0000 7ff0e6f2e640 1 -- 172.21.15.2:0/3137953936 shutdown_connections 2024-09-19T04:52:03.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.603+0000 7ff0e6f2e640 1 --2- 172.21.15.2:0/3137953936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0e0102ef0 0x7ff0e010da40 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:03.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.603+0000 7ff0e6f2e640 1 --2- 172.21.15.2:0/3137953936 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0e0102570 0x7ff0e01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:03.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.603+0000 7ff0e6f2e640 1 --2- 172.21.15.2:0/3137953936 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff0e0100e20 0x7ff0e0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:03.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.603+0000 7ff0e6f2e640 1 -- 172.21.15.2:0/3137953936 >> 172.21.15.2:0/3137953936 conn(0x7ff0e00fc7d0 msgr2=0x7ff0e00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:03.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.603+0000 7ff0e6f2e640 1 -- 172.21.15.2:0/3137953936 shutdown_connections 2024-09-19T04:52:03.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.603+0000 7ff0e6f2e640 1 -- 172.21.15.2:0/3137953936 wait complete. 2024-09-19T04:52:03.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.604+0000 7ff0e6f2e640 1 Processor -- start 2024-09-19T04:52:03.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.604+0000 7ff0e6f2e640 1 -- start start 2024-09-19T04:52:03.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.604+0000 7ff0e6f2e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff0e0100e20 0x7ff0e00fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:03.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.604+0000 7ff0e6f2e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0e0102570 0x7ff0e00fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:03.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.604+0000 7ff0e6f2e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0e0102ef0 0x7ff0e00fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:03.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.604+0000 7ff0e6f2e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e0110e30 con 0x7ff0e0102570 2024-09-19T04:52:03.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.604+0000 7ff0e6f2e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e0110cb0 con 0x7ff0e0102ef0 2024-09-19T04:52:03.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.604+0000 7ff0e6f2e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e0110fb0 con 0x7ff0e0100e20 2024-09-19T04:52:03.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.604+0000 7ff0d7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0e0102570 0x7ff0e00fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:03.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.604+0000 7ff0d7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0e0102570 0x7ff0e00fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38170/0 (socket says 172.21.15.2:38170) 2024-09-19T04:52:03.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.604+0000 7ff0d7fff640 1 -- 172.21.15.2:0/3243500982 learned_addr learned my addr 172.21.15.2:0/3243500982 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:03.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.604+0000 7ff0e4cca640 1 --2- 172.21.15.2:0/3243500982 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff0e0100e20 0x7ff0e00fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:03.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.604+0000 7ff0e54cb640 1 --2- 172.21.15.2:0/3243500982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0e0102ef0 0x7ff0e00fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:03.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.604+0000 7ff0d7fff640 1 -- 172.21.15.2:0/3243500982 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff0e0100e20 msgr2=0x7ff0e00fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:03.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.604+0000 7ff0d7fff640 1 --2- 172.21.15.2:0/3243500982 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff0e0100e20 0x7ff0e00fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:03.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.604+0000 7ff0d7fff640 1 -- 172.21.15.2:0/3243500982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0e0102ef0 msgr2=0x7ff0e00fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:03.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.604+0000 7ff0d7fff640 1 --2- 172.21.15.2:0/3243500982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0e0102ef0 0x7ff0e00fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:03.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.604+0000 7ff0d7fff640 1 -- 172.21.15.2:0/3243500982 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0e01a6840 con 0x7ff0e0102570 2024-09-19T04:52:03.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.604+0000 7ff0e54cb640 1 --2- 172.21.15.2:0/3243500982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0e0102ef0 0x7ff0e00fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:52:03.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.605+0000 7ff0d7fff640 1 --2- 172.21.15.2:0/3243500982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0e0102570 0x7ff0e00fd1c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7ff0d000e9f0 tx=0x7ff0d000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:03.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.605+0000 7ff0d5ffb640 1 -- 172.21.15.2:0/3243500982 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d000ccc0 con 0x7ff0e0102570 2024-09-19T04:52:03.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.605+0000 7ff0d5ffb640 1 -- 172.21.15.2:0/3243500982 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff0d00108e0 con 0x7ff0e0102570 2024-09-19T04:52:03.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.605+0000 7ff0e6f2e640 1 -- 172.21.15.2:0/3243500982 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0e01a6b30 con 0x7ff0e0102570 2024-09-19T04:52:03.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.605+0000 7ff0d5ffb640 1 -- 172.21.15.2:0/3243500982 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d00187c0 con 0x7ff0e0102570 2024-09-19T04:52:03.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.605+0000 7ff0e6f2e640 1 -- 172.21.15.2:0/3243500982 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0e01a70c0 con 0x7ff0e0102570 2024-09-19T04:52:03.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.607+0000 7ff0d5ffb640 1 -- 172.21.15.2:0/3243500982 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7ff0d0010a90 con 0x7ff0e0102570 2024-09-19T04:52:03.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.607+0000 7ff0e9307740 1 Processor -- start 2024-09-19T04:52:03.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.608+0000 7ff0e9307740 1 -- start start 2024-09-19T04:52:03.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.608+0000 7ff0e9307740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55832df164a0 0x55832df16880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:03.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.608+0000 7ff0e9307740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55832df16dc0 0x55832df21140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:03.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.608+0000 7ff0e9307740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55832df21680 0x55832df23a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:03.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.608+0000 7ff0e9307740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55832de7c2e0 con 0x55832df16dc0 2024-09-19T04:52:03.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.608+0000 7ff0e9307740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55832de23ce0 con 0x55832df164a0 2024-09-19T04:52:03.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.608+0000 7ff0e9307740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55832de782a0 con 0x55832df21680 2024-09-19T04:52:03.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.608+0000 7ff0d5ffb640 1 --2- 172.21.15.2:0/3243500982 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7ff0c80a3430 0x7ff0c80a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:03.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.608+0000 7ff0e4cca640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55832df16dc0 0x55832df21140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:03.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.608+0000 7ff0e4cca640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55832df16dc0 0x55832df21140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38176/0 (socket says 172.21.15.2:38176) 2024-09-19T04:52:03.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.608+0000 7ff0e4cca640 1 -- 172.21.15.2:0/391024687 learned_addr learned my addr 172.21.15.2:0/391024687 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:03.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.608+0000 7ff0d7fff640 1 --2- 172.21.15.2:0/391024687 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55832df21680 0x55832df23a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:03.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.608+0000 7ff0e54cb640 1 --2- 172.21.15.2:0/391024687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55832df164a0 0x55832df16880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:03.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.608+0000 7ff0e54cb640 1 --2- 172.21.15.2:0/3243500982 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7ff0c80a3430 0x7ff0c80a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:03.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.608+0000 7ff0d5ffb640 1 -- 172.21.15.2:0/3243500982 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7ff0d00d00a0 con 0x7ff0e0102570 2024-09-19T04:52:03.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.608+0000 7ff0e4cca640 1 -- 172.21.15.2:0/391024687 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55832df21680 msgr2=0x55832df23a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:03.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.608+0000 7ff0e4cca640 1 --2- 172.21.15.2:0/391024687 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55832df21680 0x55832df23a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:03.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.608+0000 7ff0e4cca640 1 -- 172.21.15.2:0/391024687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55832df164a0 msgr2=0x55832df16880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:03.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.608+0000 7ff0e4cca640 1 --2- 172.21.15.2:0/391024687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55832df164a0 0x55832df16880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:03.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.608+0000 7ff0e4cca640 1 -- 172.21.15.2:0/391024687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55832de08440 con 0x55832df16dc0 2024-09-19T04:52:03.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.609+0000 7ff0e4cca640 1 --2- 172.21.15.2:0/391024687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55832df16dc0 0x55832df21140 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc009ce0 tx=0x7ff0dc011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2173a873daa2717f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:03.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.609+0000 7ff0e54cb640 1 --2- 172.21.15.2:0/3243500982 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7ff0c80a3430 0x7ff0c80a58f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff0d802ac70 tx=0x7ff0d8005fd0 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:03.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.609+0000 7ff0c6ffd640 1 -- 172.21.15.2:0/391024687 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc01e070 con 0x55832df16dc0 2024-09-19T04:52:03.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.609+0000 7ff0c6ffd640 1 -- 172.21.15.2:0/391024687 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff0dc019ae0 con 0x55832df16dc0 2024-09-19T04:52:03.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.609+0000 7ff0c6ffd640 1 -- 172.21.15.2:0/391024687 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc00e970 con 0x55832df16dc0 2024-09-19T04:52:03.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.609+0000 7ff0e9307740 1 -- 172.21.15.2:0/391024687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55832df16dc0 msgr2=0x55832df21140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:03.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.609+0000 7ff0e9307740 1 --2- 172.21.15.2:0/391024687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55832df16dc0 0x55832df21140 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc009ce0 tx=0x7ff0dc011810 comp rx=0 tx=0).stop 2024-09-19T04:52:03.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.610+0000 7ff0e9307740 1 -- 172.21.15.2:0/391024687 shutdown_connections 2024-09-19T04:52:03.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.610+0000 7ff0e9307740 1 --2- 172.21.15.2:0/391024687 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55832df21680 0x55832df23a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:03.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.610+0000 7ff0e9307740 1 --2- 172.21.15.2:0/391024687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55832df16dc0 0x55832df21140 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:03.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.610+0000 7ff0e9307740 1 --2- 172.21.15.2:0/391024687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55832df164a0 0x55832df16880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:03.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.610+0000 7ff0e9307740 1 -- 172.21.15.2:0/391024687 >> 172.21.15.2:0/391024687 conn(0x55832df12a30 msgr2=0x55832df12e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:03.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.610+0000 7ff0e9307740 1 -- 172.21.15.2:0/391024687 shutdown_connections 2024-09-19T04:52:03.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.610+0000 7ff0e9307740 1 -- 172.21.15.2:0/391024687 wait complete. 2024-09-19T04:52:03.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.610+0000 7ff0e9307740 1 -- start start 2024-09-19T04:52:03.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.610+0000 7ff0e9307740 1 Processor -- start 2024-09-19T04:52:03.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.610+0000 7ff0e9307740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55832df164a0 0x55832df20fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:03.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.610+0000 7ff0e9307740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55832df16dc0 0x55832df1e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:03.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.610+0000 7ff0e9307740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55832df21680 0x55832df1e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:03.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.610+0000 7ff0e9307740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55832df24250 con 0x55832df21680 2024-09-19T04:52:03.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.610+0000 7ff0e9307740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55832de37050 con 0x55832df164a0 2024-09-19T04:52:03.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.610+0000 7ff0e9307740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55832df243d0 con 0x55832df16dc0 2024-09-19T04:52:03.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.611+0000 7ff0e9307740 10 client.0 _ll_register_callbacks cb 0x55832de77160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:52:03.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.611+0000 7ff0e54cb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55832df21680 0x55832df1e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:03.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.611+0000 7ff0e54cb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55832df21680 0x55832df1e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38190/0 (socket says 172.21.15.2:38190) 2024-09-19T04:52:03.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.611+0000 7ff0e54cb640 1 -- 172.21.15.2:0/109078861 learned_addr learned my addr 172.21.15.2:0/109078861 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:03.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.611+0000 7ff0d7fff640 1 --2- 172.21.15.2:0/109078861 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55832df16dc0 0x55832df1e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:03.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.611+0000 7ff0e4cca640 1 --2- 172.21.15.2:0/109078861 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55832df164a0 0x55832df20fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:03.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.611+0000 7ff0e54cb640 1 -- 172.21.15.2:0/109078861 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55832df16dc0 msgr2=0x55832df1e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:03.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.611+0000 7ff0e54cb640 1 --2- 172.21.15.2:0/109078861 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55832df16dc0 0x55832df1e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:03.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.611+0000 7ff0e54cb640 1 -- 172.21.15.2:0/109078861 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55832df164a0 msgr2=0x55832df20fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:03.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.611+0000 7ff0e54cb640 1 --2- 172.21.15.2:0/109078861 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55832df164a0 0x55832df20fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:03.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.611+0000 7ff0e54cb640 1 -- 172.21.15.2:0/109078861 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55832dbed3c0 con 0x55832df21680 2024-09-19T04:52:03.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.611+0000 7ff0e4cca640 1 --2- 172.21.15.2:0/109078861 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55832df164a0 0x55832df20fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:52:03.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.611+0000 7ff0e54cb640 1 --2- 172.21.15.2:0/109078861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55832df21680 0x55832df1e7b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8033000 tx=0x7ff0d8009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24d3f14c19be4d0b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:03.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.611+0000 7ff0bffff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:52:03.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.611+0000 7ff0bffff640 1 -- 172.21.15.2:0/109078861 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d8036040 con 0x55832df21680 2024-09-19T04:52:03.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.611+0000 7ff0bffff640 1 -- 172.21.15.2:0/109078861 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7ff0d8004540 con 0x55832df21680 2024-09-19T04:52:03.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.611+0000 7ff0e9307740 1 -- 172.21.15.2:0/109078861 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0dc019ae0 con 0x55832df21680 2024-09-19T04:52:03.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.612+0000 7ff0bffff640 1 -- 172.21.15.2:0/109078861 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff0d8003a90 con 0x55832df21680 2024-09-19T04:52:03.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.612+0000 7ff0e9307740 10 client.15744 fetch_fsmap learned FSMap version 19 2024-09-19T04:52:03.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.612+0000 7ff0e9307740 1 -- 172.21.15.2:0/109078861 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55832df2fc00 con 0x55832df21680 2024-09-19T04:52:03.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.612+0000 7ff0bffff640 1 -- 172.21.15.2:0/109078861 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff0dc019ae0 con 0x55832df21680 2024-09-19T04:52:03.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.612+0000 7ff0bffff640 1 -- 172.21.15.2:0/109078861 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ff0d8031c90 con 0x55832df21680 2024-09-19T04:52:03.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.612+0000 7ff0e9307740 10 client.15744 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:52:03.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.612+0000 7ff0e9307740 10 client.15744 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:52:03.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.612+0000 7ff0e9307740 20 client.15744 populate_metadata read hostname 'smithi002' 2024-09-19T04:52:03.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.612+0000 7ff0e9307740 1 --2- 172.21.15.2:0/109078861 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55832df310c0 0x55832df33560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:03.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.612+0000 7ff0e9307740 4 client.15744 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:52:03.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.612+0000 7ff0e9307740 1 -- 172.21.15.2:0/109078861 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55832de89850 con 0x55832df310c0 2024-09-19T04:52:03.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.612+0000 7ff0e4cca640 1 --2- 172.21.15.2:0/109078861 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55832df310c0 0x55832df33560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:03.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.613+0000 7ff0e4cca640 1 --2- 172.21.15.2:0/109078861 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55832df310c0 0x55832df33560 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44c64f9cdc1165e1 server_cookie=67c2d4ecb148448a in_seq=0 out_seq=0 2024-09-19T04:52:03.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.613+0000 7ff0bffff640 10 client.15744 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:52:03.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.613+0000 7ff0bffff640 1 -- 172.21.15.2:0/109078861 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55832de89850 con 0x55832df310c0 2024-09-19T04:52:03.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.613+0000 7ff0bffff640 10 client.15744 handle_command_reply: tid=0 2024-09-19T04:52:03.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.613+0000 7ff0e9307740 1 client.15744 shutdown 2024-09-19T04:52:03.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.614+0000 7ff0e9307740 1 -- 172.21.15.2:0/109078861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55832df21680 msgr2=0x55832df1e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:03.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.614+0000 7ff0e9307740 1 --2- 172.21.15.2:0/109078861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55832df21680 0x55832df1e7b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8033000 tx=0x7ff0d8009500 comp rx=0 tx=0).stop 2024-09-19T04:52:03.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.614+0000 7ff0e9307740 1 -- 172.21.15.2:0/109078861 shutdown_connections 2024-09-19T04:52:03.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.614+0000 7ff0e9307740 1 --2- 172.21.15.2:0/109078861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55832df21680 0x55832df1e7b0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:03.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.614+0000 7ff0e9307740 1 --2- 172.21.15.2:0/109078861 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55832df310c0 0x55832df33560 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:03.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.614+0000 7ff0e9307740 1 --2- 172.21.15.2:0/109078861 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55832df16dc0 0x55832df1e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:03.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.614+0000 7ff0e9307740 1 --2- 172.21.15.2:0/109078861 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55832df164a0 0x55832df20fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:03.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.614+0000 7ff0bffff640 0 client.15744 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:52:03.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.614+0000 7ff0e9307740 1 -- 172.21.15.2:0/109078861 >> 172.21.15.2:0/109078861 conn(0x55832df12a30 msgr2=0x55832df18760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:03.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.614+0000 7ff0e9307740 1 -- 172.21.15.2:0/109078861 shutdown_connections 2024-09-19T04:52:03.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.614+0000 7ff0e9307740 1 -- 172.21.15.2:0/109078861 wait complete. 2024-09-19T04:52:03.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.614+0000 7ff0e9307740 20 client.15744 trim_cache size 0 max 16384 2024-09-19T04:52:03.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.631+0000 7ff0e9307740 1 Processor -- start 2024-09-19T04:52:03.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.631+0000 7ff0e9307740 1 -- start start 2024-09-19T04:52:03.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.631+0000 7ff0e9307740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55832df164a0 0x55832df201e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:03.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.631+0000 7ff0e9307740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55832df16dc0 0x55832df38e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:03.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.631+0000 7ff0e9307740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55832df21680 0x55832df393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:03.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.631+0000 7ff0e9307740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e01ad930 con 0x55832df164a0 2024-09-19T04:52:03.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.631+0000 7ff0e9307740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e01b0190 con 0x55832df16dc0 2024-09-19T04:52:03.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.631+0000 7ff0e9307740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e01adf80 con 0x55832df21680 2024-09-19T04:52:03.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.631+0000 7ff0e4cca640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55832df164a0 0x55832df201e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:03.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.631+0000 7ff0e4cca640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55832df164a0 0x55832df201e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38194/0 (socket says 172.21.15.2:38194) 2024-09-19T04:52:03.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.631+0000 7ff0e4cca640 1 -- 172.21.15.2:0/1374670576 learned_addr learned my addr 172.21.15.2:0/1374670576 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:03.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.632+0000 7ff0d7fff640 1 --2- 172.21.15.2:0/1374670576 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55832df16dc0 0x55832df38e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:03.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.632+0000 7ff0e4cca640 1 -- 172.21.15.2:0/1374670576 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55832df21680 msgr2=0x55832df393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:03.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.632+0000 7ff0e4cca640 1 --2- 172.21.15.2:0/1374670576 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55832df21680 0x55832df393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:03.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.632+0000 7ff0e4cca640 1 -- 172.21.15.2:0/1374670576 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55832df16dc0 msgr2=0x55832df38e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:03.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.632+0000 7ff0e4cca640 1 --2- 172.21.15.2:0/1374670576 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55832df16dc0 0x55832df38e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:03.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.632+0000 7ff0e4cca640 1 -- 172.21.15.2:0/1374670576 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55832df12860 con 0x55832df164a0 2024-09-19T04:52:03.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.632+0000 7ff0d7fff640 1 --2- 172.21.15.2:0/1374670576 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55832df16dc0 0x55832df38e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:52:03.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.632+0000 7ff0e4cca640 1 --2- 172.21.15.2:0/1374670576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55832df164a0 0x55832df201e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc009670 tx=0x7ff0dc005bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd813d10a99ecd9d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:03.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.632+0000 7ff0c67fc640 1 -- 172.21.15.2:0/1374670576 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc01e040 con 0x55832df164a0 2024-09-19T04:52:03.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.632+0000 7ff0c67fc640 1 -- 172.21.15.2:0/1374670576 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff0dc01f040 con 0x55832df164a0 2024-09-19T04:52:03.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.632+0000 7ff0c67fc640 1 -- 172.21.15.2:0/1374670576 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc003850 con 0x55832df164a0 2024-09-19T04:52:03.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.633+0000 7ff0e9307740 1 -- 172.21.15.2:0/1374670576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55832df164a0 msgr2=0x55832df201e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:03.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.633+0000 7ff0e9307740 1 --2- 172.21.15.2:0/1374670576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55832df164a0 0x55832df201e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc009670 tx=0x7ff0dc005bb0 comp rx=0 tx=0).stop 2024-09-19T04:52:03.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.633+0000 7ff0e9307740 1 -- 172.21.15.2:0/1374670576 shutdown_connections 2024-09-19T04:52:03.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.633+0000 7ff0e9307740 1 --2- 172.21.15.2:0/1374670576 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55832df21680 0x55832df393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:03.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.633+0000 7ff0e9307740 1 --2- 172.21.15.2:0/1374670576 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55832df16dc0 0x55832df38e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:03.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.633+0000 7ff0e9307740 1 --2- 172.21.15.2:0/1374670576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55832df164a0 0x55832df201e0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:03.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.633+0000 7ff0e9307740 1 -- 172.21.15.2:0/1374670576 >> 172.21.15.2:0/1374670576 conn(0x55832df12a30 msgr2=0x55832df1fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:03.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.633+0000 7ff0e9307740 1 -- 172.21.15.2:0/1374670576 shutdown_connections 2024-09-19T04:52:03.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.633+0000 7ff0e9307740 1 -- 172.21.15.2:0/1374670576 wait complete. 2024-09-19T04:52:03.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.633+0000 7ff0e9307740 1 -- start start 2024-09-19T04:52:03.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.633+0000 7ff0e9307740 1 Processor -- start 2024-09-19T04:52:03.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.634+0000 7ff0e9307740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55832df164a0 0x55832df29e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:03.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.634+0000 7ff0e9307740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55832df16dc0 0x55832df27150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:03.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.634+0000 7ff0e9307740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55832df21680 0x55832df276b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:03.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.634+0000 7ff0e9307740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e01ae650 con 0x55832df16dc0 2024-09-19T04:52:03.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.634+0000 7ff0e9307740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e01afac0 con 0x55832df21680 2024-09-19T04:52:03.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.634+0000 7ff0e9307740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e01aed20 con 0x55832df164a0 2024-09-19T04:52:03.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.634+0000 7ff0d7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55832df16dc0 0x55832df27150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:03.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.634+0000 7ff0d7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55832df16dc0 0x55832df27150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38208/0 (socket says 172.21.15.2:38208) 2024-09-19T04:52:03.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.634+0000 7ff0d7fff640 1 -- 172.21.15.2:0/2280157201 learned_addr learned my addr 172.21.15.2:0/2280157201 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:03.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.634+0000 7ff0e9307740 10 client.0 _ll_register_callbacks cb 0x7ff0d0005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:52:03.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.634+0000 7ff0e4cca640 1 --2- 172.21.15.2:0/2280157201 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55832df164a0 0x55832df29e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:03.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.634+0000 7ff0e54cb640 1 --2- 172.21.15.2:0/2280157201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55832df21680 0x55832df276b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:03.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.634+0000 7ff0d7fff640 1 -- 172.21.15.2:0/2280157201 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55832df164a0 msgr2=0x55832df29e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:03.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.634+0000 7ff0d7fff640 1 --2- 172.21.15.2:0/2280157201 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55832df164a0 0x55832df29e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:03.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.634+0000 7ff0d7fff640 1 -- 172.21.15.2:0/2280157201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55832df21680 msgr2=0x55832df276b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:03.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.634+0000 7ff0d7fff640 1 --2- 172.21.15.2:0/2280157201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55832df21680 0x55832df276b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:03.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.634+0000 7ff0d7fff640 1 -- 172.21.15.2:0/2280157201 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55832df27ee0 con 0x55832df16dc0 2024-09-19T04:52:03.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.634+0000 7ff0e4cca640 1 --2- 172.21.15.2:0/2280157201 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55832df164a0 0x55832df29e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:52:03.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.634+0000 7ff0e54cb640 1 --2- 172.21.15.2:0/2280157201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55832df21680 0x55832df276b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:52:03.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.634+0000 7ff0d7fff640 1 --2- 172.21.15.2:0/2280157201 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55832df16dc0 0x55832df27150 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7ff0d009c2d0 tx=0x7ff0d006bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caa4d61ced3a1bbc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:03.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.634+0000 7ff0bffff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:52:03.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.634+0000 7ff0bffff640 1 -- 172.21.15.2:0/2280157201 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d00cdc40 con 0x55832df16dc0 2024-09-19T04:52:03.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.635+0000 7ff0bffff640 1 -- 172.21.15.2:0/2280157201 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7ff0d00a4d20 con 0x55832df16dc0 2024-09-19T04:52:03.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.635+0000 7ff0e9307740 1 -- 172.21.15.2:0/2280157201 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0dc01f040 con 0x55832df16dc0 2024-09-19T04:52:03.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.635+0000 7ff0bffff640 1 -- 172.21.15.2:0/2280157201 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff0d009c340 con 0x55832df16dc0 2024-09-19T04:52:03.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.635+0000 7ff0e9307740 10 client.15750 fetch_fsmap learned FSMap version 19 2024-09-19T04:52:03.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.635+0000 7ff0e9307740 1 -- 172.21.15.2:0/2280157201 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55832df9bed0 con 0x55832df16dc0 2024-09-19T04:52:03.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.635+0000 7ff0bffff640 1 -- 172.21.15.2:0/2280157201 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff0dc01f040 con 0x55832df16dc0 2024-09-19T04:52:03.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.635+0000 7ff0bffff640 1 -- 172.21.15.2:0/2280157201 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ff0d0098090 con 0x55832df16dc0 2024-09-19T04:52:03.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.635+0000 7ff0e9307740 10 client.15750 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:52:03.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.635+0000 7ff0e9307740 10 client.15750 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:52:03.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.635+0000 7ff0e9307740 20 client.15750 populate_metadata read hostname 'smithi002' 2024-09-19T04:52:03.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.635+0000 7ff0e9307740 1 --2- 172.21.15.2:0/2280157201 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55832df9c630 0x55832df9ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:03.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.635+0000 7ff0e9307740 4 client.15750 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:52:03.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.635+0000 7ff0e9307740 1 -- 172.21.15.2:0/2280157201 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55832df1eb40 con 0x55832df9c630 2024-09-19T04:52:03.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.635+0000 7ff0e4cca640 1 --2- 172.21.15.2:0/2280157201 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55832df9c630 0x55832df9ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:03.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.636+0000 7ff0bffff640 10 client.15750 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:52:03.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.636+0000 7ff0e4cca640 1 --2- 172.21.15.2:0/2280157201 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55832df9c630 0x55832df9ea20 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9b0575549ac78d1 server_cookie=407716f2932c0252 in_seq=0 out_seq=0 2024-09-19T04:52:03.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.636+0000 7ff0bffff640 1 -- 172.21.15.2:0/2280157201 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55832df1eb40 con 0x55832df9c630 2024-09-19T04:52:03.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.636+0000 7ff0bffff640 10 client.15750 handle_command_reply: tid=0 2024-09-19T04:52:03.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.636+0000 7ff0e9307740 1 client.15750 shutdown 2024-09-19T04:52:03.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.636+0000 7ff0e9307740 1 -- 172.21.15.2:0/2280157201 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55832df16dc0 msgr2=0x55832df27150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:03.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.636+0000 7ff0e9307740 1 --2- 172.21.15.2:0/2280157201 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55832df16dc0 0x55832df27150 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7ff0d009c2d0 tx=0x7ff0d006bf60 comp rx=0 tx=0).stop 2024-09-19T04:52:03.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.636+0000 7ff0e9307740 1 -- 172.21.15.2:0/2280157201 shutdown_connections 2024-09-19T04:52:03.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.636+0000 7ff0e9307740 1 --2- 172.21.15.2:0/2280157201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55832df21680 0x55832df276b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:03.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.636+0000 7ff0e9307740 1 --2- 172.21.15.2:0/2280157201 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55832df16dc0 0x55832df27150 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:03.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.636+0000 7ff0e9307740 1 --2- 172.21.15.2:0/2280157201 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55832df9c630 0x55832df9ea20 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:03.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.636+0000 7ff0e9307740 1 --2- 172.21.15.2:0/2280157201 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55832df164a0 0x55832df29e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:03.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.636+0000 7ff0e9307740 1 -- 172.21.15.2:0/2280157201 >> 172.21.15.2:0/2280157201 conn(0x55832df12a30 msgr2=0x55832df1c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:03.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.636+0000 7ff0bffff640 0 client.15750 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:52:03.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.636+0000 7ff0e9307740 1 -- 172.21.15.2:0/2280157201 shutdown_connections 2024-09-19T04:52:03.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.636+0000 7ff0e9307740 1 -- 172.21.15.2:0/2280157201 wait complete. 2024-09-19T04:52:03.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.637+0000 7ff0e9307740 20 client.15750 trim_cache size 0 max 16384 2024-09-19T04:52:03.663 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:52:03.663 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T04:52:03.663 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T04:52:03.663 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:52:03.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.637+0000 7ff0e6f2e640 1 -- 172.21.15.2:0/3243500982 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7ff0c80a3430 msgr2=0x7ff0c80a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:03.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.637+0000 7ff0e6f2e640 1 --2- 172.21.15.2:0/3243500982 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7ff0c80a3430 0x7ff0c80a58f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff0d802ac70 tx=0x7ff0d8005fd0 comp rx=0 tx=0).stop 2024-09-19T04:52:03.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.637+0000 7ff0e6f2e640 1 -- 172.21.15.2:0/3243500982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0e0102570 msgr2=0x7ff0e00fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:03.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.637+0000 7ff0e6f2e640 1 --2- 172.21.15.2:0/3243500982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0e0102570 0x7ff0e00fd1c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7ff0d000e9f0 tx=0x7ff0d000edf0 comp rx=0 tx=0).stop 2024-09-19T04:52:03.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.637+0000 7ff0e6f2e640 1 -- 172.21.15.2:0/3243500982 shutdown_connections 2024-09-19T04:52:03.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.637+0000 7ff0e6f2e640 1 --2- 172.21.15.2:0/3243500982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0e0102ef0 0x7ff0e00fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:03.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.637+0000 7ff0e6f2e640 1 --2- 172.21.15.2:0/3243500982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0e0102570 0x7ff0e00fd1c0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:03.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.637+0000 7ff0e6f2e640 1 --2- 172.21.15.2:0/3243500982 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7ff0c80a3430 0x7ff0c80a58f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:03.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.637+0000 7ff0e6f2e640 1 --2- 172.21.15.2:0/3243500982 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff0e0100e20 0x7ff0e00fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:03.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.637+0000 7ff0e6f2e640 1 -- 172.21.15.2:0/3243500982 >> 172.21.15.2:0/3243500982 conn(0x7ff0e00fc7d0 msgr2=0x7ff0e006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:03.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.637+0000 7ff0e6f2e640 1 -- 172.21.15.2:0/3243500982 shutdown_connections 2024-09-19T04:52:03.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:03.637+0000 7ff0e6f2e640 1 -- 172.21.15.2:0/3243500982 wait complete. 2024-09-19T04:52:04.503 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:52:04.504 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:52:04.768 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:52:05.228 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:04 smithi002 ceph-mon[30975]: pgmap v125: 97 pgs: 97 active+clean; 4.5 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 21 KiB/s wr, 6 op/s 2024-09-19T04:52:05.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:04 smithi018 ceph-mon[34537]: pgmap v125: 97 pgs: 97 active+clean; 4.5 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 21 KiB/s wr, 6 op/s 2024-09-19T04:52:05.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.310+0000 7f8780f3f640 1 -- 172.21.15.2:0/2048928406 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f877c101de0 msgr2=0x7f877c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:05.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.310+0000 7f8780f3f640 1 --2- 172.21.15.2:0/2048928406 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f877c101de0 0x7f877c1021c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f876c009900 tx=0x7f876c02a410 comp rx=0 tx=0).stop 2024-09-19T04:52:05.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.310+0000 7f8780f3f640 1 -- 172.21.15.2:0/2048928406 shutdown_connections 2024-09-19T04:52:05.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.310+0000 7f8780f3f640 1 --2- 172.21.15.2:0/2048928406 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f877c106f10 0x7f877c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:05.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.310+0000 7f8780f3f640 1 --2- 172.21.15.2:0/2048928406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f877c102790 0x7f877c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:05.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.310+0000 7f8780f3f640 1 --2- 172.21.15.2:0/2048928406 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f877c101de0 0x7f877c1021c0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:05.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.310+0000 7f8780f3f640 1 -- 172.21.15.2:0/2048928406 >> 172.21.15.2:0/2048928406 conn(0x7f877c0fd8c0 msgr2=0x7f877c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:05.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.310+0000 7f8780f3f640 1 -- 172.21.15.2:0/2048928406 shutdown_connections 2024-09-19T04:52:05.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.310+0000 7f8780f3f640 1 -- 172.21.15.2:0/2048928406 wait complete. 2024-09-19T04:52:05.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.311+0000 7f8780f3f640 1 Processor -- start 2024-09-19T04:52:05.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.311+0000 7f8780f3f640 1 -- start start 2024-09-19T04:52:05.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.312+0000 7f8780f3f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f877c101de0 0x7f877c1983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:05.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.312+0000 7f8780f3f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f877c102790 0x7f877c198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:05.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.312+0000 7f8780f3f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f877c106f10 0x7f877c19ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:05.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.312+0000 7f8780f3f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f877c111e40 con 0x7f877c101de0 2024-09-19T04:52:05.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.312+0000 7f8780f3f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f877c111cc0 con 0x7f877c106f10 2024-09-19T04:52:05.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.312+0000 7f8780f3f640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f877c111fc0 con 0x7f877c102790 2024-09-19T04:52:05.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.312+0000 7f877a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f877c101de0 0x7f877c1983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:05.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.312+0000 7f877a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f877c101de0 0x7f877c1983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38232/0 (socket says 172.21.15.2:38232) 2024-09-19T04:52:05.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.312+0000 7f877a59c640 1 -- 172.21.15.2:0/2321319444 learned_addr learned my addr 172.21.15.2:0/2321319444 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:05.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.312+0000 7f877ad9d640 1 --2- 172.21.15.2:0/2321319444 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f877c106f10 0x7f877c19ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:05.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.312+0000 7f8779d9b640 1 --2- 172.21.15.2:0/2321319444 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f877c102790 0x7f877c198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:05.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.312+0000 7f877a59c640 1 -- 172.21.15.2:0/2321319444 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f877c102790 msgr2=0x7f877c198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:05.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.312+0000 7f877a59c640 1 --2- 172.21.15.2:0/2321319444 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f877c102790 0x7f877c198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:05.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.312+0000 7f877a59c640 1 -- 172.21.15.2:0/2321319444 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f877c106f10 msgr2=0x7f877c19ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:05.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.312+0000 7f877a59c640 1 --2- 172.21.15.2:0/2321319444 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f877c106f10 0x7f877c19ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:05.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.312+0000 7f877a59c640 1 -- 172.21.15.2:0/2321319444 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f877c19d390 con 0x7f877c101de0 2024-09-19T04:52:05.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.312+0000 7f877ad9d640 1 --2- 172.21.15.2:0/2321319444 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f877c106f10 0x7f877c19ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:52:05.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.312+0000 7f877a59c640 1 --2- 172.21.15.2:0/2321319444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f877c101de0 0x7f877c1983e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f876c005940 tx=0x7f876c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:05.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.312+0000 7f876b7fe640 1 -- 172.21.15.2:0/2321319444 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f876c03f030 con 0x7f877c101de0 2024-09-19T04:52:05.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.312+0000 7f876b7fe640 1 -- 172.21.15.2:0/2321319444 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f876c003aa0 con 0x7f877c101de0 2024-09-19T04:52:05.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.312+0000 7f8780f3f640 1 -- 172.21.15.2:0/2321319444 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f877c19d620 con 0x7f877c101de0 2024-09-19T04:52:05.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.313+0000 7f876b7fe640 1 -- 172.21.15.2:0/2321319444 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f876c035070 con 0x7f877c101de0 2024-09-19T04:52:05.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.313+0000 7f8780f3f640 1 -- 172.21.15.2:0/2321319444 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f877c1a4f60 con 0x7f877c101de0 2024-09-19T04:52:05.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.314+0000 7f8780f3f640 1 -- 172.21.15.2:0/2321319444 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f877c1032c0 con 0x7f877c101de0 2024-09-19T04:52:05.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.315+0000 7f876b7fe640 1 -- 172.21.15.2:0/2321319444 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f876c042030 con 0x7f877c101de0 2024-09-19T04:52:05.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.315+0000 7f876b7fe640 1 --2- 172.21.15.2:0/2321319444 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f87640a33b0 0x7f87640a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:05.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.316+0000 7f8779d9b640 1 --2- 172.21.15.2:0/2321319444 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f87640a33b0 0x7f87640a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:05.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.316+0000 7f876b7fe640 1 -- 172.21.15.2:0/2321319444 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f876c0f07a0 con 0x7f877c101de0 2024-09-19T04:52:05.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.316+0000 7f8779d9b640 1 --2- 172.21.15.2:0/2321319444 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f87640a33b0 0x7f87640a5870 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8770005fd0 tx=0x7f8770005850 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:05.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.319+0000 7f876b7fe640 1 -- 172.21.15.2:0/2321319444 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f876c0bd140 con 0x7f877c101de0 2024-09-19T04:52:05.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:04 smithi116 ceph-mon[34477]: pgmap v125: 97 pgs: 97 active+clean; 4.5 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 21 KiB/s wr, 6 op/s 2024-09-19T04:52:05.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.530+0000 7f8780f3f640 1 -- 172.21.15.2:0/2321319444 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f877c10a0f0 con 0x7f877c101de0 2024-09-19T04:52:05.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.531+0000 7f876b7fe640 1 -- 172.21.15.2:0/2321319444 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11840 (secure 0 0 0) 0x7f876c0bca40 con 0x7f877c101de0 2024-09-19T04:52:05.533 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:52:05.533 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":19,"btime":"2024-09-19T04:46:33:537239+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2467365137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2467365137},{"type":"v1","addr":"172.21.15.2:6835","nonce":2467365137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3162441888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3162441888},{"type":"v1","addr":"172.21.15.2:6837","nonce":3162441888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14631,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2740862966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2740862966},{"type":"v1","addr":"172.21.15.2:6839","nonce":2740862966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/2394435504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2394435504},{"type":"v1","addr":"172.21.15.2:6841","nonce":2394435504}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1630480244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1630480244},{"type":"v1","addr":"172.21.15.18:6833","nonce":1630480244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1553897465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1553897465},{"type":"v1","addr":"172.21.15.116:6833","nonce":1553897465}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3035664608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3035664608},{"type":"v1","addr":"172.21.15.18:6835","nonce":3035664608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1096622392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1096622392},{"type":"v1","addr":"172.21.15.18:6837","nonce":1096622392}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3761157675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3761157675},{"type":"v1","addr":"172.21.15.116:6835","nonce":3761157675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/1120131594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1120131594},{"type":"v1","addr":"172.21.15.116:6837","nonce":1120131594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:46:24.050115+0000","modified":"2024-09-19T04:46:33.112369+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/4207677139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":4207677139},{"type":"v1","addr":"172.21.15.18:6839","nonce":4207677139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/2346874880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":2346874880},{"type":"v1","addr":"172.21.15.116:6839","nonce":2346874880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496]},"id":1}]} 2024-09-19T04:52:05.533 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 19 2024-09-19T04:52:05.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.533+0000 7f8780f3f640 1 -- 172.21.15.2:0/2321319444 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f87640a33b0 msgr2=0x7f87640a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:05.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.533+0000 7f8780f3f640 1 --2- 172.21.15.2:0/2321319444 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f87640a33b0 0x7f87640a5870 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8770005fd0 tx=0x7f8770005850 comp rx=0 tx=0).stop 2024-09-19T04:52:05.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.533+0000 7f8780f3f640 1 -- 172.21.15.2:0/2321319444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f877c101de0 msgr2=0x7f877c1983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:05.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.533+0000 7f8780f3f640 1 --2- 172.21.15.2:0/2321319444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f877c101de0 0x7f877c1983e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f876c005940 tx=0x7f876c004270 comp rx=0 tx=0).stop 2024-09-19T04:52:05.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.533+0000 7f8780f3f640 1 -- 172.21.15.2:0/2321319444 shutdown_connections 2024-09-19T04:52:05.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.533+0000 7f8780f3f640 1 --2- 172.21.15.2:0/2321319444 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f877c106f10 0x7f877c19ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:05.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.533+0000 7f8780f3f640 1 --2- 172.21.15.2:0/2321319444 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f87640a33b0 0x7f87640a5870 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:05.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.533+0000 7f8780f3f640 1 --2- 172.21.15.2:0/2321319444 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f877c102790 0x7f877c198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:05.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.533+0000 7f8780f3f640 1 --2- 172.21.15.2:0/2321319444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f877c101de0 0x7f877c1983e0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:05.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.533+0000 7f8780f3f640 1 -- 172.21.15.2:0/2321319444 >> 172.21.15.2:0/2321319444 conn(0x7f877c0fd8c0 msgr2=0x7f877c0fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:05.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.533+0000 7f8780f3f640 1 -- 172.21.15.2:0/2321319444 shutdown_connections 2024-09-19T04:52:05.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:05.533+0000 7f8780f3f640 1 -- 172.21.15.2:0/2321319444 wait complete. 2024-09-19T04:52:06.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:05 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/2321319444' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:52:06.146 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:52:06.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:05 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/2321319444' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:52:06.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:05 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/2321319444' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:52:06.406 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:52:06.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.877+0000 7f37e1ae3640 1 -- 172.21.15.2:0/3502026168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37dc102790 msgr2=0x7f37dc1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:06.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.877+0000 7f37e1ae3640 1 --2- 172.21.15.2:0/3502026168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37dc102790 0x7f37dc1067e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f37c4009900 tx=0x7f37c402a410 comp rx=0 tx=0).stop 2024-09-19T04:52:06.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.877+0000 7f37e1ae3640 1 -- 172.21.15.2:0/3502026168 shutdown_connections 2024-09-19T04:52:06.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.877+0000 7f37e1ae3640 1 --2- 172.21.15.2:0/3502026168 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37dc106f10 0x7f37dc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:06.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.877+0000 7f37e1ae3640 1 --2- 172.21.15.2:0/3502026168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37dc102790 0x7f37dc1067e0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:06.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.877+0000 7f37e1ae3640 1 --2- 172.21.15.2:0/3502026168 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f37dc101de0 0x7f37dc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:06.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.877+0000 7f37e1ae3640 1 -- 172.21.15.2:0/3502026168 >> 172.21.15.2:0/3502026168 conn(0x7f37dc0fd8c0 msgr2=0x7f37dc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:06.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.877+0000 7f37e1ae3640 1 -- 172.21.15.2:0/3502026168 shutdown_connections 2024-09-19T04:52:06.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.877+0000 7f37e1ae3640 1 -- 172.21.15.2:0/3502026168 wait complete. 2024-09-19T04:52:06.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.877+0000 7f37e1ae3640 1 Processor -- start 2024-09-19T04:52:06.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.878+0000 7f37e1ae3640 1 -- start start 2024-09-19T04:52:06.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.878+0000 7f37e1ae3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37dc101de0 0x7f37dc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:06.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.878+0000 7f37e1ae3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37dc102790 0x7f37dc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:06.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.878+0000 7f37e1ae3640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f37dc106f10 0x7f37dc074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:06.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.878+0000 7f37e1ae3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f37dc111e40 con 0x7f37dc101de0 2024-09-19T04:52:06.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.878+0000 7f37e1ae3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f37dc111cc0 con 0x7f37dc102790 2024-09-19T04:52:06.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.878+0000 7f37e1ae3640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f37dc111fc0 con 0x7f37dc106f10 2024-09-19T04:52:06.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.878+0000 7f37db7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37dc101de0 0x7f37dc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:06.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.878+0000 7f37db7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37dc101de0 0x7f37dc0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38256/0 (socket says 172.21.15.2:38256) 2024-09-19T04:52:06.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.878+0000 7f37db7fe640 1 -- 172.21.15.2:0/3689033973 learned_addr learned my addr 172.21.15.2:0/3689033973 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:06.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.878+0000 7f37dbfff640 1 --2- 172.21.15.2:0/3689033973 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f37dc106f10 0x7f37dc074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:06.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.878+0000 7f37daffd640 1 --2- 172.21.15.2:0/3689033973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37dc102790 0x7f37dc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:06.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.878+0000 7f37db7fe640 1 -- 172.21.15.2:0/3689033973 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f37dc106f10 msgr2=0x7f37dc074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:06.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.878+0000 7f37db7fe640 1 --2- 172.21.15.2:0/3689033973 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f37dc106f10 0x7f37dc074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:06.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.878+0000 7f37db7fe640 1 -- 172.21.15.2:0/3689033973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37dc102790 msgr2=0x7f37dc074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:06.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.878+0000 7f37db7fe640 1 --2- 172.21.15.2:0/3689033973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37dc102790 0x7f37dc074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:06.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.878+0000 7f37db7fe640 1 -- 172.21.15.2:0/3689033973 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37dc1a68e0 con 0x7f37dc101de0 2024-09-19T04:52:06.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.879+0000 7f37db7fe640 1 --2- 172.21.15.2:0/3689033973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37dc101de0 0x7f37dc0744f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f37cc00b4a0 tx=0x7f37cc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:06.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.879+0000 7f37d8ff9640 1 -- 172.21.15.2:0/3689033973 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37cc014070 con 0x7f37dc101de0 2024-09-19T04:52:06.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.879+0000 7f37d8ff9640 1 -- 172.21.15.2:0/3689033973 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f37cc010ac0 con 0x7f37dc101de0 2024-09-19T04:52:06.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.879+0000 7f37d8ff9640 1 -- 172.21.15.2:0/3689033973 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37cc017c30 con 0x7f37dc101de0 2024-09-19T04:52:06.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.879+0000 7f37e1ae3640 1 -- 172.21.15.2:0/3689033973 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37dc1a6bd0 con 0x7f37dc101de0 2024-09-19T04:52:06.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.879+0000 7f37e1ae3640 1 -- 172.21.15.2:0/3689033973 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37dc1a7090 con 0x7f37dc101de0 2024-09-19T04:52:06.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.882+0000 7f37d8ff9640 1 -- 172.21.15.2:0/3689033973 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f37cc017070 con 0x7f37dc101de0 2024-09-19T04:52:06.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.882+0000 7f37e3ebc740 1 Processor -- start 2024-09-19T04:52:06.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.882+0000 7f37e3ebc740 1 -- start start 2024-09-19T04:52:06.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.882+0000 7f37e3ebc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a2879b40 0x5643a2878090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:06.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.882+0000 7f37e3ebc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643a28785d0 0x5643a2878a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:06.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.882+0000 7f37e3ebc740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5643a2883370 0x5643a2885760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:06.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.882+0000 7f37e3ebc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5643a27de2f0 con 0x5643a2879b40 2024-09-19T04:52:06.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.882+0000 7f37e3ebc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5643a2785cf0 con 0x5643a28785d0 2024-09-19T04:52:06.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.882+0000 7f37e3ebc740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5643a27da2b0 con 0x5643a2883370 2024-09-19T04:52:06.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.882+0000 7f37dbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a2879b40 0x5643a2878090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:06.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.882+0000 7f37dbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a2879b40 0x5643a2878090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38264/0 (socket says 172.21.15.2:38264) 2024-09-19T04:52:06.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.882+0000 7f37dbfff640 1 -- 172.21.15.2:0/2157547127 learned_addr learned my addr 172.21.15.2:0/2157547127 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:06.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.883+0000 7f37db7fe640 1 --2- 172.21.15.2:0/2157547127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643a28785d0 0x5643a2878a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:06.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.883+0000 7f37daffd640 1 --2- 172.21.15.2:0/2157547127 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5643a2883370 0x5643a2885760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:06.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.883+0000 7f37dbfff640 1 -- 172.21.15.2:0/2157547127 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5643a2883370 msgr2=0x5643a2885760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:06.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.883+0000 7f37dbfff640 1 --2- 172.21.15.2:0/2157547127 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5643a2883370 0x5643a2885760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:06.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.883+0000 7f37dbfff640 1 -- 172.21.15.2:0/2157547127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643a28785d0 msgr2=0x5643a2878a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:06.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.883+0000 7f37dbfff640 1 --2- 172.21.15.2:0/2157547127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643a28785d0 0x5643a2878a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:06.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.883+0000 7f37dbfff640 1 -- 172.21.15.2:0/2157547127 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643a276a3a0 con 0x5643a2879b40 2024-09-19T04:52:06.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.883+0000 7f37d8ff9640 1 --2- 172.21.15.2:0/3689033973 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f37c80a3430 0x7f37c80a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:06.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.883+0000 7f37db7fe640 1 --2- 172.21.15.2:0/3689033973 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f37c80a3430 0x7f37c80a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:06.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.883+0000 7f37dbfff640 1 --2- 172.21.15.2:0/2157547127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a2879b40 0x5643a2878090 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f37d4010370 tx=0x7f37d4010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45c51660056ff9c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:06.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.883+0000 7f37d8ff9640 1 -- 172.21.15.2:0/3689033973 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f37cc0cef10 con 0x7f37dc101de0 2024-09-19T04:52:06.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.883+0000 7f37d1ffb640 1 -- 172.21.15.2:0/2157547127 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d4016070 con 0x5643a2879b40 2024-09-19T04:52:06.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.883+0000 7f37d1ffb640 1 -- 172.21.15.2:0/2157547127 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f37d4004d20 con 0x5643a2879b40 2024-09-19T04:52:06.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.883+0000 7f37d1ffb640 1 -- 172.21.15.2:0/2157547127 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d4005350 con 0x5643a2879b40 2024-09-19T04:52:06.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.884+0000 7f37e3ebc740 1 -- 172.21.15.2:0/2157547127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a2879b40 msgr2=0x5643a2878090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:06.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.884+0000 7f37db7fe640 1 --2- 172.21.15.2:0/3689033973 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f37c80a3430 0x7f37c80a58f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f37cc0cc840 tx=0x7f37cc00bf90 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:06.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.884+0000 7f37e3ebc740 1 --2- 172.21.15.2:0/2157547127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a2879b40 0x5643a2878090 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f37d4010370 tx=0x7f37d4010830 comp rx=0 tx=0).stop 2024-09-19T04:52:06.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.884+0000 7f37e3ebc740 1 -- 172.21.15.2:0/2157547127 shutdown_connections 2024-09-19T04:52:06.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.884+0000 7f37e3ebc740 1 --2- 172.21.15.2:0/2157547127 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5643a2883370 0x5643a2885760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:06.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.884+0000 7f37e3ebc740 1 --2- 172.21.15.2:0/2157547127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643a28785d0 0x5643a2878a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:06.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.884+0000 7f37e3ebc740 1 --2- 172.21.15.2:0/2157547127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a2879b40 0x5643a2878090 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:06.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.884+0000 7f37e3ebc740 1 -- 172.21.15.2:0/2157547127 >> 172.21.15.2:0/2157547127 conn(0x5643a2841310 msgr2=0x5643a2874c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:06.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.884+0000 7f37e3ebc740 1 -- 172.21.15.2:0/2157547127 shutdown_connections 2024-09-19T04:52:06.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.884+0000 7f37e3ebc740 1 -- 172.21.15.2:0/2157547127 wait complete. 2024-09-19T04:52:06.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.884+0000 7f37e3ebc740 1 -- start start 2024-09-19T04:52:06.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.885+0000 7f37e3ebc740 1 Processor -- start 2024-09-19T04:52:06.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.885+0000 7f37e3ebc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643a28785d0 0x5643a2882d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:06.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.885+0000 7f37e3ebc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a2879b40 0x5643a287ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:06.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.885+0000 7f37e3ebc740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5643a2883370 0x5643a28805d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:06.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.885+0000 7f37e3ebc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5643a2886070 con 0x5643a2879b40 2024-09-19T04:52:06.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.885+0000 7f37e3ebc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5643a2799060 con 0x5643a28785d0 2024-09-19T04:52:06.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.885+0000 7f37e3ebc740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5643a28861f0 con 0x5643a2883370 2024-09-19T04:52:06.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.885+0000 7f37e3ebc740 10 client.0 _ll_register_callbacks cb 0x5643a24ec8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:52:06.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.885+0000 7f37daffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a2879b40 0x5643a287ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:06.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.885+0000 7f37daffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a2879b40 0x5643a287ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38274/0 (socket says 172.21.15.2:38274) 2024-09-19T04:52:06.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.885+0000 7f37daffd640 1 -- 172.21.15.2:0/1056025198 learned_addr learned my addr 172.21.15.2:0/1056025198 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:06.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.885+0000 7f37dbfff640 1 --2- 172.21.15.2:0/1056025198 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5643a2883370 0x5643a28805d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:06.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.885+0000 7f37dbfff640 1 --2- 172.21.15.2:0/1056025198 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643a28785d0 0x5643a2882d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:06.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.885+0000 7f37daffd640 1 -- 172.21.15.2:0/1056025198 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5643a2883370 msgr2=0x5643a28805d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:06.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.885+0000 7f37daffd640 1 --2- 172.21.15.2:0/1056025198 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5643a2883370 0x5643a28805d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:06.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.885+0000 7f37daffd640 1 -- 172.21.15.2:0/1056025198 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643a28785d0 msgr2=0x5643a2882d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:06.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.885+0000 7f37daffd640 1 --2- 172.21.15.2:0/1056025198 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643a28785d0 0x5643a2882d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:06.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.885+0000 7f37daffd640 1 -- 172.21.15.2:0/1056025198 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643a254f3c0 con 0x5643a2879b40 2024-09-19T04:52:06.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.885+0000 7f37dbfff640 1 --2- 172.21.15.2:0/1056025198 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5643a2883370 0x5643a28805d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:52:06.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.886+0000 7f37daffd640 1 --2- 172.21.15.2:0/1056025198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a2879b40 0x5643a287ffe0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f37c402a930 tx=0x7f37c4031740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ed175d917dabea3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:06.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.886+0000 7f37baffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:52:06.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.886+0000 7f37baffd640 1 -- 172.21.15.2:0/1056025198 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c4035070 con 0x5643a2879b40 2024-09-19T04:52:06.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.886+0000 7f37baffd640 1 -- 172.21.15.2:0/1056025198 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f37c4004240 con 0x5643a2879b40 2024-09-19T04:52:06.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.886+0000 7f37e3ebc740 1 -- 172.21.15.2:0/1056025198 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37d4004d20 con 0x5643a2879b40 2024-09-19T04:52:06.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.886+0000 7f37baffd640 1 -- 172.21.15.2:0/1056025198 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f37c4004440 con 0x5643a2879b40 2024-09-19T04:52:06.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.886+0000 7f37e3ebc740 10 client.15768 fetch_fsmap learned FSMap version 19 2024-09-19T04:52:06.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.886+0000 7f37e3ebc740 1 -- 172.21.15.2:0/1056025198 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5643a2891ad0 con 0x5643a2879b40 2024-09-19T04:52:06.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.886+0000 7f37baffd640 1 -- 172.21.15.2:0/1056025198 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f37d4004d20 con 0x5643a2879b40 2024-09-19T04:52:06.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.886+0000 7f37baffd640 1 -- 172.21.15.2:0/1056025198 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f37c404b020 con 0x5643a2879b40 2024-09-19T04:52:06.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.886+0000 7f37e3ebc740 10 client.15768 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:52:06.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.886+0000 7f37e3ebc740 10 client.15768 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:52:06.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.887+0000 7f37e3ebc740 20 client.15768 populate_metadata read hostname 'smithi002' 2024-09-19T04:52:06.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.887+0000 7f37e3ebc740 1 --2- 172.21.15.2:0/1056025198 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5643a2892f30 0x5643a2895320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:06.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.887+0000 7f37e3ebc740 4 client.15768 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:52:06.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.887+0000 7f37e3ebc740 1 -- 172.21.15.2:0/1056025198 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5643a27eb860 con 0x5643a2892f30 2024-09-19T04:52:06.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.887+0000 7f37dbfff640 1 --2- 172.21.15.2:0/1056025198 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5643a2892f30 0x5643a2895320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:06.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.887+0000 7f37dbfff640 1 --2- 172.21.15.2:0/1056025198 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5643a2892f30 0x5643a2895320 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4602d860b18d3bce server_cookie=f1dc0dc104a98703 in_seq=0 out_seq=0 2024-09-19T04:52:06.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.887+0000 7f37baffd640 10 client.15768 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:52:06.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.888+0000 7f37baffd640 1 -- 172.21.15.2:0/1056025198 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5643a27eb860 con 0x5643a2892f30 2024-09-19T04:52:06.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.888+0000 7f37baffd640 10 client.15768 handle_command_reply: tid=0 2024-09-19T04:52:06.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.888+0000 7f37e3ebc740 1 client.15768 shutdown 2024-09-19T04:52:06.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.888+0000 7f37e3ebc740 1 -- 172.21.15.2:0/1056025198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a2879b40 msgr2=0x5643a287ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:06.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.888+0000 7f37e3ebc740 1 --2- 172.21.15.2:0/1056025198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a2879b40 0x5643a287ffe0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f37c402a930 tx=0x7f37c4031740 comp rx=0 tx=0).stop 2024-09-19T04:52:06.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.888+0000 7f37e3ebc740 1 -- 172.21.15.2:0/1056025198 shutdown_connections 2024-09-19T04:52:06.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.888+0000 7f37e3ebc740 1 --2- 172.21.15.2:0/1056025198 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5643a2892f30 0x5643a2895320 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:06.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.888+0000 7f37e3ebc740 1 --2- 172.21.15.2:0/1056025198 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5643a2883370 0x5643a28805d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:06.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.888+0000 7f37e3ebc740 1 --2- 172.21.15.2:0/1056025198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a2879b40 0x5643a287ffe0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:06.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.888+0000 7f37e3ebc740 1 --2- 172.21.15.2:0/1056025198 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643a28785d0 0x5643a2882d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:06.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.888+0000 7f37baffd640 0 client.15768 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:52:06.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.888+0000 7f37e3ebc740 1 -- 172.21.15.2:0/1056025198 >> 172.21.15.2:0/1056025198 conn(0x5643a2841310 msgr2=0x5643a287a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:06.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.888+0000 7f37e3ebc740 1 -- 172.21.15.2:0/1056025198 shutdown_connections 2024-09-19T04:52:06.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.888+0000 7f37e3ebc740 1 -- 172.21.15.2:0/1056025198 wait complete. 2024-09-19T04:52:06.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.889+0000 7f37e3ebc740 20 client.15768 trim_cache size 0 max 16384 2024-09-19T04:52:06.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.902+0000 7f37e3ebc740 1 Processor -- start 2024-09-19T04:52:06.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.902+0000 7f37e3ebc740 1 -- start start 2024-09-19T04:52:06.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.902+0000 7f37e3ebc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a28785d0 0x5643a287ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:06.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.902+0000 7f37e3ebc740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5643a2879b40 0x5643a288f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:06.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.902+0000 7f37e3ebc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643a2883370 0x5643a286fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:06.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.902+0000 7f37e3ebc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f37dc1ad940 con 0x5643a28785d0 2024-09-19T04:52:06.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.902+0000 7f37e3ebc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f37dc1b01c0 con 0x5643a2883370 2024-09-19T04:52:06.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.902+0000 7f37e3ebc740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f37dc1adfb0 con 0x5643a2879b40 2024-09-19T04:52:06.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.902+0000 7f37dbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a28785d0 0x5643a287ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:06.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.902+0000 7f37dbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a28785d0 0x5643a287ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38276/0 (socket says 172.21.15.2:38276) 2024-09-19T04:52:06.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.902+0000 7f37dbfff640 1 -- 172.21.15.2:0/2583073111 learned_addr learned my addr 172.21.15.2:0/2583073111 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:06.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.902+0000 7f37dbfff640 1 -- 172.21.15.2:0/2583073111 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5643a2879b40 msgr2=0x5643a288f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:06.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.902+0000 7f37daffd640 1 --2- 172.21.15.2:0/2583073111 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5643a2879b40 0x5643a288f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:06.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.902+0000 7f37dbfff640 1 --2- 172.21.15.2:0/2583073111 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5643a2879b40 0x5643a288f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:06.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.902+0000 7f37dbfff640 1 -- 172.21.15.2:0/2583073111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643a2883370 msgr2=0x5643a286fad0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T04:52:06.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.902+0000 7f37dbfff640 1 --2- 172.21.15.2:0/2583073111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643a2883370 0x5643a286fad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:06.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.902+0000 7f37dbfff640 1 -- 172.21.15.2:0/2583073111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643a2874510 con 0x5643a28785d0 2024-09-19T04:52:06.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.902+0000 7f37daffd640 1 --2- 172.21.15.2:0/2583073111 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5643a2879b40 0x5643a288f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:52:06.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.903+0000 7f37dbfff640 1 --2- 172.21.15.2:0/2583073111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a28785d0 0x5643a287ffb0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f37d4009db0 tx=0x7f37d4000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46204d13ccc890aa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:06.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.903+0000 7f37d17fa640 1 -- 172.21.15.2:0/2583073111 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d4016070 con 0x5643a28785d0 2024-09-19T04:52:06.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.903+0000 7f37d17fa640 1 -- 172.21.15.2:0/2583073111 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f37d4012bc0 con 0x5643a28785d0 2024-09-19T04:52:06.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.903+0000 7f37d17fa640 1 -- 172.21.15.2:0/2583073111 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d402d040 con 0x5643a28785d0 2024-09-19T04:52:06.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.903+0000 7f37e3ebc740 1 -- 172.21.15.2:0/2583073111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a28785d0 msgr2=0x5643a287ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:06.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.903+0000 7f37e3ebc740 1 --2- 172.21.15.2:0/2583073111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a28785d0 0x5643a287ffb0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f37d4009db0 tx=0x7f37d4000f40 comp rx=0 tx=0).stop 2024-09-19T04:52:06.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.903+0000 7f37e3ebc740 1 -- 172.21.15.2:0/2583073111 shutdown_connections 2024-09-19T04:52:06.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.903+0000 7f37e3ebc740 1 --2- 172.21.15.2:0/2583073111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643a2883370 0x5643a286fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:06.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.903+0000 7f37e3ebc740 1 --2- 172.21.15.2:0/2583073111 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5643a2879b40 0x5643a288f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:06.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.903+0000 7f37e3ebc740 1 --2- 172.21.15.2:0/2583073111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a28785d0 0x5643a287ffb0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:06.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.903+0000 7f37e3ebc740 1 -- 172.21.15.2:0/2583073111 >> 172.21.15.2:0/2583073111 conn(0x5643a2841310 msgr2=0x5643a287f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:06.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.903+0000 7f37e3ebc740 1 -- 172.21.15.2:0/2583073111 shutdown_connections 2024-09-19T04:52:06.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.903+0000 7f37e3ebc740 1 -- 172.21.15.2:0/2583073111 wait complete. 2024-09-19T04:52:06.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.904+0000 7f37e3ebc740 1 -- start start 2024-09-19T04:52:06.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.904+0000 7f37e3ebc740 1 Processor -- start 2024-09-19T04:52:06.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.904+0000 7f37e3ebc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643a28785d0 0x5643a2887480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:06.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.904+0000 7f37e3ebc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a2879b40 0x5643a28879c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:06.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.904+0000 7f37e3ebc740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5643a2883370 0x5643a2887f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:06.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.904+0000 7f37e3ebc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f37dc1ae680 con 0x5643a2879b40 2024-09-19T04:52:06.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.904+0000 7f37e3ebc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f37dc1afaf0 con 0x5643a28785d0 2024-09-19T04:52:06.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.904+0000 7f37e3ebc740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f37dc1aed50 con 0x5643a2883370 2024-09-19T04:52:06.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.904+0000 7f37e3ebc740 10 client.0 _ll_register_callbacks cb 0x7f37c4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:52:06.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.905+0000 7f37daffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a2879b40 0x5643a28879c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:06.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.905+0000 7f37daffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a2879b40 0x5643a28879c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38278/0 (socket says 172.21.15.2:38278) 2024-09-19T04:52:06.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.905+0000 7f37daffd640 1 -- 172.21.15.2:0/2672699 learned_addr learned my addr 172.21.15.2:0/2672699 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:06.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.905+0000 7f37dbfff640 1 --2- 172.21.15.2:0/2672699 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643a28785d0 0x5643a2887480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:06.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.905+0000 7f37dbfff640 1 --2- 172.21.15.2:0/2672699 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5643a2883370 0x5643a2887f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:06.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.905+0000 7f37daffd640 1 -- 172.21.15.2:0/2672699 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5643a2883370 msgr2=0x5643a2887f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:06.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.905+0000 7f37daffd640 1 --2- 172.21.15.2:0/2672699 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5643a2883370 0x5643a2887f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:06.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.905+0000 7f37daffd640 1 -- 172.21.15.2:0/2672699 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643a28785d0 msgr2=0x5643a2887480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:06.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.905+0000 7f37daffd640 1 --2- 172.21.15.2:0/2672699 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643a28785d0 0x5643a2887480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:06.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.905+0000 7f37daffd640 1 -- 172.21.15.2:0/2672699 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643a28fce80 con 0x5643a2879b40 2024-09-19T04:52:06.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.905+0000 7f37dbfff640 1 --2- 172.21.15.2:0/2672699 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5643a2883370 0x5643a2887f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:52:06.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.905+0000 7f37daffd640 1 --2- 172.21.15.2:0/2672699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a2879b40 0x5643a28879c0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f37c4004b60 tx=0x7f37c40098b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3db2e8f66324dc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:06.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.905+0000 7f37baffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:52:06.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.905+0000 7f37baffd640 1 -- 172.21.15.2:0/2672699 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c4035040 con 0x5643a2879b40 2024-09-19T04:52:06.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.905+0000 7f37baffd640 1 -- 172.21.15.2:0/2672699 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f37c4005210 con 0x5643a2879b40 2024-09-19T04:52:06.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.905+0000 7f37e3ebc740 1 -- 172.21.15.2:0/2672699 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37d4012bc0 con 0x5643a2879b40 2024-09-19T04:52:06.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.905+0000 7f37baffd640 1 -- 172.21.15.2:0/2672699 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f37c405d050 con 0x5643a2879b40 2024-09-19T04:52:06.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.906+0000 7f37e3ebc740 10 client.15774 fetch_fsmap learned FSMap version 19 2024-09-19T04:52:06.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.906+0000 7f37e3ebc740 1 -- 172.21.15.2:0/2672699 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5643a28fe160 con 0x5643a2879b40 2024-09-19T04:52:06.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.906+0000 7f37baffd640 1 -- 172.21.15.2:0/2672699 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f37d4012bc0 con 0x5643a2879b40 2024-09-19T04:52:06.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.906+0000 7f37baffd640 1 -- 172.21.15.2:0/2672699 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f37c404b030 con 0x5643a2879b40 2024-09-19T04:52:06.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.906+0000 7f37e3ebc740 10 client.15774 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:52:06.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.906+0000 7f37e3ebc740 10 client.15774 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:52:06.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.906+0000 7f37e3ebc740 20 client.15774 populate_metadata read hostname 'smithi002' 2024-09-19T04:52:06.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.906+0000 7f37e3ebc740 1 --2- 172.21.15.2:0/2672699 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5643a28fe930 0x5643a2900d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:06.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.906+0000 7f37e3ebc740 4 client.15774 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:52:06.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.906+0000 7f37e3ebc740 1 -- 172.21.15.2:0/2672699 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5643a27e5d70 con 0x5643a28fe930 2024-09-19T04:52:06.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.906+0000 7f37dbfff640 1 --2- 172.21.15.2:0/2672699 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5643a28fe930 0x5643a2900d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:06.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.907+0000 7f37dbfff640 1 --2- 172.21.15.2:0/2672699 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5643a28fe930 0x5643a2900d50 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42bc5a06ac84a46e server_cookie=5c6ea4cb56512abc in_seq=0 out_seq=0 2024-09-19T04:52:06.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.907+0000 7f37baffd640 10 client.15774 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:52:06.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.907+0000 7f37baffd640 1 -- 172.21.15.2:0/2672699 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5643a27e5d70 con 0x5643a28fe930 2024-09-19T04:52:06.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.907+0000 7f37baffd640 10 client.15774 handle_command_reply: tid=0 2024-09-19T04:52:06.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.907+0000 7f37e3ebc740 1 client.15774 shutdown 2024-09-19T04:52:06.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.907+0000 7f37e3ebc740 1 -- 172.21.15.2:0/2672699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a2879b40 msgr2=0x5643a28879c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:06.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.907+0000 7f37e3ebc740 1 --2- 172.21.15.2:0/2672699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a2879b40 0x5643a28879c0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f37c4004b60 tx=0x7f37c40098b0 comp rx=0 tx=0).stop 2024-09-19T04:52:06.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.907+0000 7f37e3ebc740 1 -- 172.21.15.2:0/2672699 shutdown_connections 2024-09-19T04:52:06.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.907+0000 7f37e3ebc740 1 --2- 172.21.15.2:0/2672699 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5643a28fe930 0x5643a2900d50 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:06.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.907+0000 7f37e3ebc740 1 --2- 172.21.15.2:0/2672699 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5643a2883370 0x5643a2887f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:06.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.907+0000 7f37e3ebc740 1 --2- 172.21.15.2:0/2672699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5643a2879b40 0x5643a28879c0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:06.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.907+0000 7f37baffd640 0 client.15774 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:52:06.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.907+0000 7f37e3ebc740 1 --2- 172.21.15.2:0/2672699 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643a28785d0 0x5643a2887480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:06.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.907+0000 7f37e3ebc740 1 -- 172.21.15.2:0/2672699 >> 172.21.15.2:0/2672699 conn(0x5643a2841310 msgr2=0x5643a287e480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:06.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.907+0000 7f37e3ebc740 1 -- 172.21.15.2:0/2672699 shutdown_connections 2024-09-19T04:52:06.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.907+0000 7f37e3ebc740 1 -- 172.21.15.2:0/2672699 wait complete. 2024-09-19T04:52:06.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.907+0000 7f37e3ebc740 20 client.15774 trim_cache size 0 max 16384 2024-09-19T04:52:06.924 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T04:52:06.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.908+0000 7f37e1ae3640 1 -- 172.21.15.2:0/3689033973 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f37c80a3430 msgr2=0x7f37c80a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:06.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.908+0000 7f37e1ae3640 1 --2- 172.21.15.2:0/3689033973 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f37c80a3430 0x7f37c80a58f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f37cc0cc840 tx=0x7f37cc00bf90 comp rx=0 tx=0).stop 2024-09-19T04:52:06.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.908+0000 7f37e1ae3640 1 -- 172.21.15.2:0/3689033973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37dc101de0 msgr2=0x7f37dc0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:06.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.908+0000 7f37e1ae3640 1 --2- 172.21.15.2:0/3689033973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37dc101de0 0x7f37dc0744f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f37cc00b4a0 tx=0x7f37cc00b960 comp rx=0 tx=0).stop 2024-09-19T04:52:06.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.908+0000 7f37e1ae3640 1 -- 172.21.15.2:0/3689033973 shutdown_connections 2024-09-19T04:52:06.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.908+0000 7f37e1ae3640 1 --2- 172.21.15.2:0/3689033973 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f37c80a3430 0x7f37c80a58f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:06.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.908+0000 7f37e1ae3640 1 --2- 172.21.15.2:0/3689033973 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f37dc106f10 0x7f37dc074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:06.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.908+0000 7f37e1ae3640 1 --2- 172.21.15.2:0/3689033973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37dc102790 0x7f37dc074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:06.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.908+0000 7f37e1ae3640 1 --2- 172.21.15.2:0/3689033973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37dc101de0 0x7f37dc0744f0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:06.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.908+0000 7f37e1ae3640 1 -- 172.21.15.2:0/3689033973 >> 172.21.15.2:0/3689033973 conn(0x7f37dc0fd8c0 msgr2=0x7f37dc0fed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:06.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.908+0000 7f37e1ae3640 1 -- 172.21.15.2:0/3689033973 shutdown_connections 2024-09-19T04:52:06.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:06.908+0000 7f37e1ae3640 1 -- 172.21.15.2:0/3689033973 wait complete. 2024-09-19T04:52:07.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:06 smithi002 ceph-mon[30975]: pgmap v126: 97 pgs: 97 active+clean; 4.7 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 58 KiB/s wr, 25 op/s 2024-09-19T04:52:07.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:06 smithi018 ceph-mon[34537]: pgmap v126: 97 pgs: 97 active+clean; 4.7 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 58 KiB/s wr, 25 op/s 2024-09-19T04:52:07.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:06 smithi116 ceph-mon[34477]: pgmap v126: 97 pgs: 97 active+clean; 4.7 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 58 KiB/s wr, 25 op/s 2024-09-19T04:52:08.693 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:52:08.693 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:52:08.965 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:52:09.258 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:09 smithi002 ceph-mon[30975]: pgmap v127: 97 pgs: 97 active+clean; 4.7 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 47 KiB/s wr, 21 op/s 2024-09-19T04:52:09.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:09 smithi018 ceph-mon[34537]: pgmap v127: 97 pgs: 97 active+clean; 4.7 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 47 KiB/s wr, 21 op/s 2024-09-19T04:52:09.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:09 smithi116 ceph-mon[34477]: pgmap v127: 97 pgs: 97 active+clean; 4.7 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 47 KiB/s wr, 21 op/s 2024-09-19T04:52:09.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.465+0000 7f9b05ac8640 1 -- 172.21.15.2:0/2593513143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b00102ef0 msgr2=0x7f9b0010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:09.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.465+0000 7f9b05ac8640 1 --2- 172.21.15.2:0/2593513143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b00102ef0 0x7f9b0010da40 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f9af8009ca0 tx=0x7f9af802a950 comp rx=0 tx=0).stop 2024-09-19T04:52:09.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.465+0000 7f9b05ac8640 1 -- 172.21.15.2:0/2593513143 shutdown_connections 2024-09-19T04:52:09.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.465+0000 7f9b05ac8640 1 --2- 172.21.15.2:0/2593513143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b00102ef0 0x7f9b0010da40 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:09.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.465+0000 7f9b05ac8640 1 --2- 172.21.15.2:0/2593513143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b00102570 0x7f9b001029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:09.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.465+0000 7f9b05ac8640 1 --2- 172.21.15.2:0/2593513143 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b00100e20 0x7f9b00101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:09.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.465+0000 7f9b05ac8640 1 -- 172.21.15.2:0/2593513143 >> 172.21.15.2:0/2593513143 conn(0x7f9b000fc7d0 msgr2=0x7f9b000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:09.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.465+0000 7f9b05ac8640 1 -- 172.21.15.2:0/2593513143 shutdown_connections 2024-09-19T04:52:09.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.465+0000 7f9b05ac8640 1 -- 172.21.15.2:0/2593513143 wait complete. 2024-09-19T04:52:09.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.465+0000 7f9b05ac8640 1 Processor -- start 2024-09-19T04:52:09.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.466+0000 7f9b05ac8640 1 -- start start 2024-09-19T04:52:09.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.466+0000 7f9b05ac8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b00100e20 0x7f9b00198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:09.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.466+0000 7f9b05ac8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b00102570 0x7f9b001988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:09.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.466+0000 7f9b05ac8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b00102ef0 0x7f9b0019cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:09.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.466+0000 7f9b05ac8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9b00110e30 con 0x7f9b00102ef0 2024-09-19T04:52:09.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.466+0000 7f9b05ac8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9b00110cb0 con 0x7f9b00100e20 2024-09-19T04:52:09.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.466+0000 7f9b05ac8640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f9b00110fb0 con 0x7f9b00102570 2024-09-19T04:52:09.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.466+0000 7f9afffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b00102ef0 0x7f9b0019cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:09.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.466+0000 7f9afffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b00102ef0 0x7f9b0019cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38298/0 (socket says 172.21.15.2:38298) 2024-09-19T04:52:09.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.466+0000 7f9afffff640 1 -- 172.21.15.2:0/1598438715 learned_addr learned my addr 172.21.15.2:0/1598438715 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:09.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.466+0000 7f9afeffd640 1 --2- 172.21.15.2:0/1598438715 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b00102570 0x7f9b001988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:09.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.466+0000 7f9aff7fe640 1 --2- 172.21.15.2:0/1598438715 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b00100e20 0x7f9b00198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:09.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.466+0000 7f9afffff640 1 -- 172.21.15.2:0/1598438715 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b00102570 msgr2=0x7f9b001988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:09.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.466+0000 7f9afffff640 1 --2- 172.21.15.2:0/1598438715 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b00102570 0x7f9b001988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:09.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.466+0000 7f9afffff640 1 -- 172.21.15.2:0/1598438715 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b00100e20 msgr2=0x7f9b00198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:09.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.466+0000 7f9afffff640 1 --2- 172.21.15.2:0/1598438715 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b00100e20 0x7f9b00198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:09.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.466+0000 7f9afffff640 1 -- 172.21.15.2:0/1598438715 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b0019d330 con 0x7f9b00102ef0 2024-09-19T04:52:09.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.467+0000 7f9afffff640 1 --2- 172.21.15.2:0/1598438715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b00102ef0 0x7f9b0019cc50 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f9af8004af0 tx=0x7f9af802f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:09.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.467+0000 7f9afcff9640 1 -- 172.21.15.2:0/1598438715 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af8034040 con 0x7f9b00102ef0 2024-09-19T04:52:09.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.467+0000 7f9afcff9640 1 -- 172.21.15.2:0/1598438715 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9af80308f0 con 0x7f9b00102ef0 2024-09-19T04:52:09.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.467+0000 7f9afcff9640 1 -- 172.21.15.2:0/1598438715 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af8004670 con 0x7f9b00102ef0 2024-09-19T04:52:09.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.467+0000 7f9b05ac8640 1 -- 172.21.15.2:0/1598438715 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b0019d5c0 con 0x7f9b00102ef0 2024-09-19T04:52:09.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.467+0000 7f9b05ac8640 1 -- 172.21.15.2:0/1598438715 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b001a4f00 con 0x7f9b00102ef0 2024-09-19T04:52:09.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.469+0000 7f9afcff9640 1 -- 172.21.15.2:0/1598438715 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f9af8037020 con 0x7f9b00102ef0 2024-09-19T04:52:09.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.469+0000 7f9b07ea1740 1 Processor -- start 2024-09-19T04:52:09.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.469+0000 7f9b07ea1740 1 -- start start 2024-09-19T04:52:09.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.470+0000 7f9b07ea1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f3ae241b60 0x55f3ae241f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:09.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.470+0000 7f9b07ea1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3ae242480 0x55f3ae24c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:09.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.470+0000 7f9b07ea1740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f3ae24cd40 0x55f3ae24f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:09.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.470+0000 7f9afcff9640 1 --2- 172.21.15.2:0/1598438715 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f9ae80a3430 0x7f9ae80a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:09.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.470+0000 7f9b07ea1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f3ae1a7280 con 0x55f3ae242480 2024-09-19T04:52:09.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.470+0000 7f9b07ea1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f3ae14eb10 con 0x55f3ae241b60 2024-09-19T04:52:09.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.470+0000 7f9b07ea1740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55f3ae1a3240 con 0x55f3ae24cd40 2024-09-19T04:52:09.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.470+0000 7f9aff7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3ae242480 0x55f3ae24c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:09.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.470+0000 7f9afffff640 1 --2- 172.21.15.2:0/1598438715 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f9ae80a3430 0x7f9ae80a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:09.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.470+0000 7f9aff7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3ae242480 0x55f3ae24c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38304/0 (socket says 172.21.15.2:38304) 2024-09-19T04:52:09.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.470+0000 7f9aff7fe640 1 -- 172.21.15.2:0/3261486255 learned_addr learned my addr 172.21.15.2:0/3261486255 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:09.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.470+0000 7f9afcff9640 1 -- 172.21.15.2:0/1598438715 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f9af80f0a20 con 0x7f9b00102ef0 2024-09-19T04:52:09.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.470+0000 7f9afeffd640 1 --2- 172.21.15.2:0/3261486255 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f3ae241b60 0x55f3ae241f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:09.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.470+0000 7f9afeffd640 1 --2- 172.21.15.2:0/3261486255 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f3ae24cd40 0x55f3ae24f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:09.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.470+0000 7f9aff7fe640 1 -- 172.21.15.2:0/3261486255 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f3ae24cd40 msgr2=0x55f3ae24f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:09.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.470+0000 7f9aff7fe640 1 --2- 172.21.15.2:0/3261486255 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f3ae24cd40 0x55f3ae24f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:09.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.470+0000 7f9aff7fe640 1 -- 172.21.15.2:0/3261486255 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f3ae241b60 msgr2=0x55f3ae241f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:09.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.470+0000 7f9aff7fe640 1 --2- 172.21.15.2:0/3261486255 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f3ae241b60 0x55f3ae241f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:09.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.470+0000 7f9aff7fe640 1 -- 172.21.15.2:0/3261486255 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3ae15b1f0 con 0x55f3ae242480 2024-09-19T04:52:09.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.470+0000 7f9afffff640 1 --2- 172.21.15.2:0/1598438715 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f9ae80a3430 0x7f9ae80a58f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9af80b9290 tx=0x7f9af802a950 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:09.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.470+0000 7f9aff7fe640 1 --2- 172.21.15.2:0/3261486255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3ae242480 0x55f3ae24c800 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f9af0004640 tx=0x7f9af0011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d1dd96c50e41071 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:09.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.471+0000 7f9ae5ffb640 1 -- 172.21.15.2:0/3261486255 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af0022070 con 0x55f3ae242480 2024-09-19T04:52:09.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.471+0000 7f9ae5ffb640 1 -- 172.21.15.2:0/3261486255 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9af0009e40 con 0x55f3ae242480 2024-09-19T04:52:09.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.471+0000 7f9ae5ffb640 1 -- 172.21.15.2:0/3261486255 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af0003e30 con 0x55f3ae242480 2024-09-19T04:52:09.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.471+0000 7f9b07ea1740 1 -- 172.21.15.2:0/3261486255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3ae242480 msgr2=0x55f3ae24c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:09.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.471+0000 7f9b07ea1740 1 --2- 172.21.15.2:0/3261486255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3ae242480 0x55f3ae24c800 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f9af0004640 tx=0x7f9af0011810 comp rx=0 tx=0).stop 2024-09-19T04:52:09.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.471+0000 7f9b07ea1740 1 -- 172.21.15.2:0/3261486255 shutdown_connections 2024-09-19T04:52:09.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.471+0000 7f9b07ea1740 1 --2- 172.21.15.2:0/3261486255 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f3ae24cd40 0x55f3ae24f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:09.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.471+0000 7f9b07ea1740 1 --2- 172.21.15.2:0/3261486255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3ae242480 0x55f3ae24c800 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:09.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.471+0000 7f9b07ea1740 1 --2- 172.21.15.2:0/3261486255 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f3ae241b60 0x55f3ae241f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:09.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.471+0000 7f9b07ea1740 1 -- 172.21.15.2:0/3261486255 >> 172.21.15.2:0/3261486255 conn(0x55f3ae23e0f0 msgr2=0x55f3ae23e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:09.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.471+0000 7f9b07ea1740 1 -- 172.21.15.2:0/3261486255 shutdown_connections 2024-09-19T04:52:09.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.472+0000 7f9b07ea1740 1 -- 172.21.15.2:0/3261486255 wait complete. 2024-09-19T04:52:09.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.472+0000 7f9b07ea1740 1 -- start start 2024-09-19T04:52:09.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.472+0000 7f9b07ea1740 1 Processor -- start 2024-09-19T04:52:09.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.472+0000 7f9b07ea1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f3ae241b60 0x55f3ae249b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:09.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.472+0000 7f9b07ea1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3ae242480 0x55f3ae24a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:09.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.472+0000 7f9b07ea1740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f3ae24cd40 0x55f3ae24a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:09.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.472+0000 7f9b07ea1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f3ae24f910 con 0x55f3ae242480 2024-09-19T04:52:09.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.472+0000 7f9b07ea1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f3ae161f10 con 0x55f3ae241b60 2024-09-19T04:52:09.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.472+0000 7f9b07ea1740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55f3ae24fa90 con 0x55f3ae24cd40 2024-09-19T04:52:09.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.472+0000 7f9b07ea1740 10 client.0 _ll_register_callbacks cb 0x55f3ae12aa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:52:09.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.472+0000 7f9aff7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3ae242480 0x55f3ae24a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:09.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.472+0000 7f9aff7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3ae242480 0x55f3ae24a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38314/0 (socket says 172.21.15.2:38314) 2024-09-19T04:52:09.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.472+0000 7f9aff7fe640 1 -- 172.21.15.2:0/3171153531 learned_addr learned my addr 172.21.15.2:0/3171153531 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:09.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.473+0000 7f9afeffd640 1 --2- 172.21.15.2:0/3171153531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f3ae241b60 0x55f3ae249b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:09.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.473+0000 7f9aff7fe640 1 -- 172.21.15.2:0/3171153531 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f3ae24cd40 msgr2=0x55f3ae24a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:09.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.473+0000 7f9aff7fe640 1 --2- 172.21.15.2:0/3171153531 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f3ae24cd40 0x55f3ae24a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:09.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.473+0000 7f9aff7fe640 1 -- 172.21.15.2:0/3171153531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f3ae241b60 msgr2=0x55f3ae249b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:09.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.473+0000 7f9aff7fe640 1 --2- 172.21.15.2:0/3171153531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f3ae241b60 0x55f3ae249b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:09.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.473+0000 7f9aff7fe640 1 -- 172.21.15.2:0/3171153531 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3adf186a0 con 0x55f3ae242480 2024-09-19T04:52:09.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.473+0000 7f9afeffd640 1 --2- 172.21.15.2:0/3171153531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f3ae241b60 0x55f3ae249b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:52:09.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.473+0000 7f9aff7fe640 1 --2- 172.21.15.2:0/3171153531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3ae242480 0x55f3ae24a0b0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f9af0005790 tx=0x7f9af0003850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eb0e9f486ddfb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:09.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.473+0000 7f9adeffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:52:09.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.473+0000 7f9adeffd640 1 -- 172.21.15.2:0/3171153531 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af0022070 con 0x55f3ae242480 2024-09-19T04:52:09.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.473+0000 7f9adeffd640 1 -- 172.21.15.2:0/3171153531 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f9af0016250 con 0x55f3ae242480 2024-09-19T04:52:09.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.473+0000 7f9b07ea1740 1 -- 172.21.15.2:0/3171153531 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f3ae1b47f0 con 0x55f3ae242480 2024-09-19T04:52:09.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.473+0000 7f9adeffd640 1 -- 172.21.15.2:0/3171153531 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f9af00046c0 con 0x55f3ae242480 2024-09-19T04:52:09.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.473+0000 7f9b07ea1740 10 client.15786 fetch_fsmap learned FSMap version 19 2024-09-19T04:52:09.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.473+0000 7f9b07ea1740 1 -- 172.21.15.2:0/3171153531 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55f3ae25b460 con 0x55f3ae242480 2024-09-19T04:52:09.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.474+0000 7f9adeffd640 1 -- 172.21.15.2:0/3171153531 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55f3ae1b47f0 con 0x55f3ae242480 2024-09-19T04:52:09.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.474+0000 7f9adeffd640 1 -- 172.21.15.2:0/3171153531 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f9af0036020 con 0x55f3ae242480 2024-09-19T04:52:09.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.474+0000 7f9b07ea1740 10 client.15786 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:52:09.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.474+0000 7f9b07ea1740 10 client.15786 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:52:09.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.474+0000 7f9b07ea1740 20 client.15786 populate_metadata read hostname 'smithi002' 2024-09-19T04:52:09.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.474+0000 7f9b07ea1740 1 --2- 172.21.15.2:0/3171153531 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f3ae25c7b0 0x55f3ae25eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:09.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.474+0000 7f9b07ea1740 4 client.15786 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:52:09.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.474+0000 7f9b07ea1740 1 -- 172.21.15.2:0/3171153531 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f3ae1aed00 con 0x55f3ae25c7b0 2024-09-19T04:52:09.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.474+0000 7f9afeffd640 1 --2- 172.21.15.2:0/3171153531 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f3ae25c7b0 0x55f3ae25eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:09.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.475+0000 7f9adeffd640 10 client.15786 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:52:09.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.475+0000 7f9afeffd640 1 --2- 172.21.15.2:0/3171153531 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f3ae25c7b0 0x55f3ae25eba0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59a24589f27f1a6e server_cookie=5a92c544c960b873 in_seq=0 out_seq=0 2024-09-19T04:52:09.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.475+0000 7f9adeffd640 1 -- 172.21.15.2:0/3171153531 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f3ae1aed00 con 0x55f3ae25c7b0 2024-09-19T04:52:09.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.475+0000 7f9adeffd640 10 client.15786 handle_command_reply: tid=0 2024-09-19T04:52:09.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.475+0000 7f9b07ea1740 1 client.15786 shutdown 2024-09-19T04:52:09.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.476+0000 7f9b07ea1740 1 -- 172.21.15.2:0/3171153531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3ae242480 msgr2=0x55f3ae24a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:09.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.476+0000 7f9b07ea1740 1 --2- 172.21.15.2:0/3171153531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3ae242480 0x55f3ae24a0b0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f9af0005790 tx=0x7f9af0003850 comp rx=0 tx=0).stop 2024-09-19T04:52:09.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.476+0000 7f9b07ea1740 1 -- 172.21.15.2:0/3171153531 shutdown_connections 2024-09-19T04:52:09.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.476+0000 7f9b07ea1740 1 --2- 172.21.15.2:0/3171153531 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f3ae25c7b0 0x55f3ae25eba0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:09.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.476+0000 7f9b07ea1740 1 --2- 172.21.15.2:0/3171153531 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f3ae24cd40 0x55f3ae24a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:09.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.476+0000 7f9b07ea1740 1 --2- 172.21.15.2:0/3171153531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3ae242480 0x55f3ae24a0b0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:09.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.476+0000 7f9b07ea1740 1 --2- 172.21.15.2:0/3171153531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f3ae241b60 0x55f3ae249b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:09.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.476+0000 7f9adeffd640 0 client.15786 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:52:09.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.476+0000 7f9b07ea1740 1 -- 172.21.15.2:0/3171153531 >> 172.21.15.2:0/3171153531 conn(0x55f3ae23e0f0 msgr2=0x55f3ae23d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:09.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.476+0000 7f9b07ea1740 1 -- 172.21.15.2:0/3171153531 shutdown_connections 2024-09-19T04:52:09.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.476+0000 7f9b07ea1740 1 -- 172.21.15.2:0/3171153531 wait complete. 2024-09-19T04:52:09.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.476+0000 7f9b07ea1740 20 client.15786 trim_cache size 0 max 16384 2024-09-19T04:52:09.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.493+0000 7f9b07ea1740 1 Processor -- start 2024-09-19T04:52:09.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.493+0000 7f9b07ea1740 1 -- start start 2024-09-19T04:52:09.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.494+0000 7f9b07ea1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3ae23e0f0 0x55f3ae264470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:09.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.494+0000 7f9b07ea1740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f3ae241b60 0x55f3ae2649b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:09.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.494+0000 7f9b07ea1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f3ae242480 0x55f3ae248310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:09.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.494+0000 7f9b07ea1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9b001a9370 con 0x55f3ae23e0f0 2024-09-19T04:52:09.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.494+0000 7f9b07ea1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9b001abbf0 con 0x55f3ae242480 2024-09-19T04:52:09.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.494+0000 7f9b07ea1740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f9b001a99e0 con 0x55f3ae241b60 2024-09-19T04:52:09.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.494+0000 7f9afeffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3ae23e0f0 0x55f3ae264470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:09.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.494+0000 7f9afeffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3ae23e0f0 0x55f3ae264470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38324/0 (socket says 172.21.15.2:38324) 2024-09-19T04:52:09.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.494+0000 7f9afeffd640 1 -- 172.21.15.2:0/2120726775 learned_addr learned my addr 172.21.15.2:0/2120726775 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:09.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.494+0000 7f9afeffd640 1 -- 172.21.15.2:0/2120726775 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f3ae241b60 msgr2=0x55f3ae2649b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:09.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.494+0000 7f9afeffd640 1 --2- 172.21.15.2:0/2120726775 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f3ae241b60 0x55f3ae2649b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:09.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.494+0000 7f9afeffd640 1 -- 172.21.15.2:0/2120726775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f3ae242480 msgr2=0x55f3ae248310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:09.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.494+0000 7f9afeffd640 1 --2- 172.21.15.2:0/2120726775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f3ae242480 0x55f3ae248310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:09.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.494+0000 7f9afeffd640 1 -- 172.21.15.2:0/2120726775 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3ae2422b0 con 0x55f3ae23e0f0 2024-09-19T04:52:09.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.494+0000 7f9afeffd640 1 --2- 172.21.15.2:0/2120726775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3ae23e0f0 0x55f3ae264470 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x55f3ae25f410 tx=0x7f9af4013830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e8856f117e71748 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:09.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.494+0000 7f9ae57fa640 1 -- 172.21.15.2:0/2120726775 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af40130d0 con 0x55f3ae23e0f0 2024-09-19T04:52:09.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.494+0000 7f9ae57fa640 1 -- 172.21.15.2:0/2120726775 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9af4013270 con 0x55f3ae23e0f0 2024-09-19T04:52:09.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.495+0000 7f9ae57fa640 1 -- 172.21.15.2:0/2120726775 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af401e650 con 0x55f3ae23e0f0 2024-09-19T04:52:09.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.495+0000 7f9b07ea1740 1 -- 172.21.15.2:0/2120726775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3ae23e0f0 msgr2=0x55f3ae264470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:09.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.495+0000 7f9b07ea1740 1 --2- 172.21.15.2:0/2120726775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3ae23e0f0 0x55f3ae264470 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x55f3ae25f410 tx=0x7f9af4013830 comp rx=0 tx=0).stop 2024-09-19T04:52:09.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.495+0000 7f9b07ea1740 1 -- 172.21.15.2:0/2120726775 shutdown_connections 2024-09-19T04:52:09.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.495+0000 7f9b07ea1740 1 --2- 172.21.15.2:0/2120726775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f3ae242480 0x55f3ae248310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:09.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.495+0000 7f9b07ea1740 1 --2- 172.21.15.2:0/2120726775 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f3ae241b60 0x55f3ae2649b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:09.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.495+0000 7f9b07ea1740 1 --2- 172.21.15.2:0/2120726775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3ae23e0f0 0x55f3ae264470 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:09.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.495+0000 7f9b07ea1740 1 -- 172.21.15.2:0/2120726775 >> 172.21.15.2:0/2120726775 conn(0x55f3ae245560 msgr2=0x55f3ae243dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:09.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.495+0000 7f9b07ea1740 1 -- 172.21.15.2:0/2120726775 shutdown_connections 2024-09-19T04:52:09.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.495+0000 7f9b07ea1740 1 -- 172.21.15.2:0/2120726775 wait complete. 2024-09-19T04:52:09.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.495+0000 7f9b07ea1740 1 -- start start 2024-09-19T04:52:09.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.496+0000 7f9b07ea1740 1 Processor -- start 2024-09-19T04:52:09.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.496+0000 7f9b07ea1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f3ae23e0f0 0x55f3ae255440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:09.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.496+0000 7f9b07ea1740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f3ae241b60 0x55f3ae2507c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:09.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.496+0000 7f9b07ea1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3ae242480 0x55f3ae250d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:09.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.496+0000 7f9b07ea1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9b001aa0b0 con 0x55f3ae242480 2024-09-19T04:52:09.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.496+0000 7f9b07ea1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9b001ab520 con 0x55f3ae23e0f0 2024-09-19T04:52:09.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.496+0000 7f9b07ea1740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f9b001aa780 con 0x55f3ae241b60 2024-09-19T04:52:09.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.496+0000 7f9b07ea1740 10 client.0 _ll_register_callbacks cb 0x7f9af0009bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:52:09.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.496+0000 7f9afeffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3ae242480 0x55f3ae250d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:09.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.496+0000 7f9afeffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3ae242480 0x55f3ae250d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38338/0 (socket says 172.21.15.2:38338) 2024-09-19T04:52:09.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.496+0000 7f9afeffd640 1 -- 172.21.15.2:0/1192831646 learned_addr learned my addr 172.21.15.2:0/1192831646 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:09.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.496+0000 7f9aff7fe640 1 --2- 172.21.15.2:0/1192831646 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f3ae241b60 0x55f3ae2507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:09.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.496+0000 7f9afeffd640 1 --2- 172.21.15.2:0/1192831646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f3ae23e0f0 0x55f3ae255440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:09.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.496+0000 7f9afeffd640 1 -- 172.21.15.2:0/1192831646 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f3ae241b60 msgr2=0x55f3ae2507c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:09.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.496+0000 7f9afeffd640 1 --2- 172.21.15.2:0/1192831646 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f3ae241b60 0x55f3ae2507c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:09.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.496+0000 7f9afeffd640 1 -- 172.21.15.2:0/1192831646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f3ae23e0f0 msgr2=0x55f3ae255440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:09.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.496+0000 7f9afeffd640 1 --2- 172.21.15.2:0/1192831646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f3ae23e0f0 0x55f3ae255440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:09.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.496+0000 7f9afeffd640 1 -- 172.21.15.2:0/1192831646 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3ae2514e0 con 0x55f3ae242480 2024-09-19T04:52:09.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.497+0000 7f9afeffd640 1 --2- 172.21.15.2:0/1192831646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3ae242480 0x55f3ae250d00 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f9af4005c20 tx=0x7f9af4005b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d8902d2e60d8c69 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:09.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.497+0000 7f9adeffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:52:09.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.497+0000 7f9adeffd640 1 -- 172.21.15.2:0/1192831646 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af4011e60 con 0x55f3ae242480 2024-09-19T04:52:09.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.497+0000 7f9adeffd640 1 -- 172.21.15.2:0/1192831646 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f9af4005020 con 0x55f3ae242480 2024-09-19T04:52:09.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.497+0000 7f9b07ea1740 1 -- 172.21.15.2:0/1192831646 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9af4013270 con 0x55f3ae242480 2024-09-19T04:52:09.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.497+0000 7f9adeffd640 1 -- 172.21.15.2:0/1192831646 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f9af4005220 con 0x55f3ae242480 2024-09-19T04:52:09.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.497+0000 7f9b07ea1740 10 client.15792 fetch_fsmap learned FSMap version 19 2024-09-19T04:52:09.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.497+0000 7f9b07ea1740 1 -- 172.21.15.2:0/1192831646 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55f3ae2c7490 con 0x55f3ae242480 2024-09-19T04:52:09.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.497+0000 7f9adeffd640 1 -- 172.21.15.2:0/1192831646 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9af4013270 con 0x55f3ae242480 2024-09-19T04:52:09.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.497+0000 7f9adeffd640 1 -- 172.21.15.2:0/1192831646 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f9af403a020 con 0x55f3ae242480 2024-09-19T04:52:09.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.497+0000 7f9b07ea1740 10 client.15792 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:52:09.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.497+0000 7f9b07ea1740 10 client.15792 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:52:09.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.497+0000 7f9b07ea1740 20 client.15792 populate_metadata read hostname 'smithi002' 2024-09-19T04:52:09.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.498+0000 7f9b07ea1740 1 --2- 172.21.15.2:0/1192831646 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f3ae24cd40 0x55f3ae2c9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:09.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.498+0000 7f9b07ea1740 4 client.15792 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:52:09.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.498+0000 7f9b07ea1740 1 -- 172.21.15.2:0/1192831646 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f3ae12b110 con 0x55f3ae24cd40 2024-09-19T04:52:09.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.498+0000 7f9aff7fe640 1 --2- 172.21.15.2:0/1192831646 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f3ae24cd40 0x55f3ae2c9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:09.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.498+0000 7f9aff7fe640 1 --2- 172.21.15.2:0/1192831646 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f3ae24cd40 0x55f3ae2c9aa0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca1348f1c7ea0a13 server_cookie=cd25f9433b8ab949 in_seq=0 out_seq=0 2024-09-19T04:52:09.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.498+0000 7f9adeffd640 10 client.15792 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:52:09.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.499+0000 7f9adeffd640 1 -- 172.21.15.2:0/1192831646 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f3ae12b110 con 0x55f3ae24cd40 2024-09-19T04:52:09.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.499+0000 7f9adeffd640 10 client.15792 handle_command_reply: tid=0 2024-09-19T04:52:09.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.499+0000 7f9b07ea1740 1 client.15792 shutdown 2024-09-19T04:52:09.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.500+0000 7f9b07ea1740 1 -- 172.21.15.2:0/1192831646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3ae242480 msgr2=0x55f3ae250d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:09.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.500+0000 7f9b07ea1740 1 --2- 172.21.15.2:0/1192831646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3ae242480 0x55f3ae250d00 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f9af4005c20 tx=0x7f9af4005b90 comp rx=0 tx=0).stop 2024-09-19T04:52:09.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.500+0000 7f9b07ea1740 1 -- 172.21.15.2:0/1192831646 shutdown_connections 2024-09-19T04:52:09.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.500+0000 7f9b07ea1740 1 --2- 172.21.15.2:0/1192831646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3ae242480 0x55f3ae250d00 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:09.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.500+0000 7f9b07ea1740 1 --2- 172.21.15.2:0/1192831646 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f3ae24cd40 0x55f3ae2c9aa0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:09.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.500+0000 7f9b07ea1740 1 --2- 172.21.15.2:0/1192831646 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f3ae241b60 0x55f3ae2507c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:09.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.500+0000 7f9b07ea1740 1 --2- 172.21.15.2:0/1192831646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f3ae23e0f0 0x55f3ae255440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:09.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.500+0000 7f9adeffd640 0 client.15792 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:52:09.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.500+0000 7f9b07ea1740 1 -- 172.21.15.2:0/1192831646 >> 172.21.15.2:0/1192831646 conn(0x55f3ae245560 msgr2=0x55f3ae23ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:09.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.500+0000 7f9b07ea1740 1 -- 172.21.15.2:0/1192831646 shutdown_connections 2024-09-19T04:52:09.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.500+0000 7f9b07ea1740 1 -- 172.21.15.2:0/1192831646 wait complete. 2024-09-19T04:52:09.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.500+0000 7f9b07ea1740 20 client.15792 trim_cache size 0 max 16384 2024-09-19T04:52:09.514 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:52:09.515 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T04:52:09.515 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "b6fbf2fe-f3b0-4524-8a66-3da3fddeb9f3", 2024-09-19T04:52:09.515 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T04:52:09.515 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:52:09.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.500+0000 7f9b05ac8640 1 -- 172.21.15.2:0/1598438715 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f9ae80a3430 msgr2=0x7f9ae80a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:09.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.500+0000 7f9b05ac8640 1 --2- 172.21.15.2:0/1598438715 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f9ae80a3430 0x7f9ae80a58f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9af80b9290 tx=0x7f9af802a950 comp rx=0 tx=0).stop 2024-09-19T04:52:09.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.500+0000 7f9b05ac8640 1 -- 172.21.15.2:0/1598438715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b00102ef0 msgr2=0x7f9b0019cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:09.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.500+0000 7f9b05ac8640 1 --2- 172.21.15.2:0/1598438715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b00102ef0 0x7f9b0019cc50 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f9af8004af0 tx=0x7f9af802f5d0 comp rx=0 tx=0).stop 2024-09-19T04:52:09.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.501+0000 7f9b05ac8640 1 -- 172.21.15.2:0/1598438715 shutdown_connections 2024-09-19T04:52:09.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.501+0000 7f9b05ac8640 1 --2- 172.21.15.2:0/1598438715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b00102ef0 0x7f9b0019cc50 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:09.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.501+0000 7f9b05ac8640 1 --2- 172.21.15.2:0/1598438715 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f9ae80a3430 0x7f9ae80a58f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:09.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.501+0000 7f9b05ac8640 1 --2- 172.21.15.2:0/1598438715 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b00102570 0x7f9b001988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:09.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.501+0000 7f9b05ac8640 1 --2- 172.21.15.2:0/1598438715 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b00100e20 0x7f9b00198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:09.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.501+0000 7f9b05ac8640 1 -- 172.21.15.2:0/1598438715 >> 172.21.15.2:0/1598438715 conn(0x7f9b000fc7d0 msgr2=0x7f9b0006a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:09.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.501+0000 7f9b05ac8640 1 -- 172.21.15.2:0/1598438715 shutdown_connections 2024-09-19T04:52:09.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:09.501+0000 7f9b05ac8640 1 -- 172.21.15.2:0/1598438715 wait complete. 2024-09-19T04:52:10.182 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:52:10.442 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:52:11.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.002+0000 7f281c1ca640 1 -- 172.21.15.2:0/732240141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2814102570 msgr2=0x7f28141029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:11.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.002+0000 7f281c1ca640 1 --2- 172.21.15.2:0/732240141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2814102570 0x7f28141029b0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f2804009900 tx=0x7f280402a480 comp rx=0 tx=0).stop 2024-09-19T04:52:11.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.002+0000 7f281c1ca640 1 -- 172.21.15.2:0/732240141 shutdown_connections 2024-09-19T04:52:11.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.002+0000 7f281c1ca640 1 --2- 172.21.15.2:0/732240141 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2814102ef0 0x7f281410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:11.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.002+0000 7f281c1ca640 1 --2- 172.21.15.2:0/732240141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2814102570 0x7f28141029b0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:11.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.002+0000 7f281c1ca640 1 --2- 172.21.15.2:0/732240141 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2814100e20 0x7f2814101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:11.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.002+0000 7f281c1ca640 1 -- 172.21.15.2:0/732240141 >> 172.21.15.2:0/732240141 conn(0x7f28140fc7d0 msgr2=0x7f28140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:11.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.002+0000 7f281c1ca640 1 -- 172.21.15.2:0/732240141 shutdown_connections 2024-09-19T04:52:11.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.002+0000 7f281c1ca640 1 -- 172.21.15.2:0/732240141 wait complete. 2024-09-19T04:52:11.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.003+0000 7f281c1ca640 1 Processor -- start 2024-09-19T04:52:11.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.003+0000 7f281c1ca640 1 -- start start 2024-09-19T04:52:11.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.003+0000 7f281c1ca640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2814100e20 0x7f28141972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:11.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.003+0000 7f281c1ca640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2814102570 0x7f2814197830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:11.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.003+0000 7f281c1ca640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2814102ef0 0x7f281419bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:11.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.003+0000 7f281c1ca640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2814110e50 con 0x7f2814102570 2024-09-19T04:52:11.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.003+0000 7f281c1ca640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2814110cd0 con 0x7f2814100e20 2024-09-19T04:52:11.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.003+0000 7f281c1ca640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f2814110fd0 con 0x7f2814102ef0 2024-09-19T04:52:11.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.004+0000 7f2819765640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2814102570 0x7f2814197830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:11.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.004+0000 7f2819765640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2814102570 0x7f2814197830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38358/0 (socket says 172.21.15.2:38358) 2024-09-19T04:52:11.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.004+0000 7f2819765640 1 -- 172.21.15.2:0/4099194616 learned_addr learned my addr 172.21.15.2:0/4099194616 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:11.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.004+0000 7f2819f66640 1 --2- 172.21.15.2:0/4099194616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2814100e20 0x7f28141972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:11.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.004+0000 7f281a767640 1 --2- 172.21.15.2:0/4099194616 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2814102ef0 0x7f281419bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:11.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.004+0000 7f2819765640 1 -- 172.21.15.2:0/4099194616 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2814102ef0 msgr2=0x7f281419bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:11.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.004+0000 7f2819765640 1 --2- 172.21.15.2:0/4099194616 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2814102ef0 0x7f281419bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:11.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.004+0000 7f2819765640 1 -- 172.21.15.2:0/4099194616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2814100e20 msgr2=0x7f28141972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:11.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.004+0000 7f2819765640 1 --2- 172.21.15.2:0/4099194616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2814100e20 0x7f28141972f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:11.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.004+0000 7f2819765640 1 -- 172.21.15.2:0/4099194616 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f281419c2a0 con 0x7f2814102570 2024-09-19T04:52:11.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.004+0000 7f2819765640 1 --2- 172.21.15.2:0/4099194616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2814102570 0x7f2814197830 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f2804006010 tx=0x7f28040042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:11.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.007+0000 7f280affd640 1 -- 172.21.15.2:0/4099194616 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f280403f070 con 0x7f2814102570 2024-09-19T04:52:11.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.007+0000 7f280affd640 1 -- 172.21.15.2:0/4099194616 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2804003aa0 con 0x7f2814102570 2024-09-19T04:52:11.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.007+0000 7f280affd640 1 -- 172.21.15.2:0/4099194616 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2804035030 con 0x7f2814102570 2024-09-19T04:52:11.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.007+0000 7f281c1ca640 1 -- 172.21.15.2:0/4099194616 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f281419c530 con 0x7f2814102570 2024-09-19T04:52:11.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.007+0000 7f281c1ca640 1 -- 172.21.15.2:0/4099194616 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28141a3e70 con 0x7f2814102570 2024-09-19T04:52:11.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.009+0000 7f280affd640 1 -- 172.21.15.2:0/4099194616 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f2804042070 con 0x7f2814102570 2024-09-19T04:52:11.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.010+0000 7f281e5a3740 1 Processor -- start 2024-09-19T04:52:11.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.010+0000 7f281e5a3740 1 -- start start 2024-09-19T04:52:11.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.010+0000 7f280affd640 1 --2- 172.21.15.2:0/4099194616 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f28000a3430 0x7f28000a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:11.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.010+0000 7f281e5a3740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c6c04e6b0 0x555c6c04ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:11.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.010+0000 7f281a767640 1 --2- 172.21.15.2:0/4099194616 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f28000a3430 0x7f28000a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:11.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.010+0000 7f281e5a3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c6c04efd0 0x555c6c059350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:11.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.011+0000 7f281e5a3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c6c059890 0x555c6c05bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:11.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.011+0000 7f281e5a3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555c6bfb22e0 con 0x555c6c04efd0 2024-09-19T04:52:11.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.011+0000 7f281e5a3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555c6bf59ce0 con 0x555c6c059890 2024-09-19T04:52:11.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.011+0000 7f281e5a3740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x555c6bfae2a0 con 0x555c6c04e6b0 2024-09-19T04:52:11.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.011+0000 7f280affd640 1 -- 172.21.15.2:0/4099194616 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f28040f0580 con 0x7f2814102570 2024-09-19T04:52:11.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.011+0000 7f2819765640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c6c04efd0 0x555c6c059350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:11.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.011+0000 7f2819f66640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c6c04e6b0 0x555c6c04ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:11.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.011+0000 7f2819f66640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c6c04e6b0 0x555c6c04ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.2:47416/0 (socket says 172.21.15.2:47416) 2024-09-19T04:52:11.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.011+0000 7f2819765640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c6c04efd0 0x555c6c059350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38366/0 (socket says 172.21.15.2:38366) 2024-09-19T04:52:11.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.011+0000 7f2819f66640 1 -- 172.21.15.2:0/1253918068 learned_addr learned my addr 172.21.15.2:0/1253918068 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:11.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.011+0000 7f281a767640 1 --2- 172.21.15.2:0/1253918068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c6c059890 0x555c6c05bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:11.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.011+0000 7f2819765640 1 -- 172.21.15.2:0/1253918068 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c6c04e6b0 msgr2=0x555c6c04ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:11.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.011+0000 7f2819765640 1 --2- 172.21.15.2:0/1253918068 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c6c04e6b0 0x555c6c04ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:11.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.011+0000 7f2819765640 1 -- 172.21.15.2:0/1253918068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c6c059890 msgr2=0x555c6c05bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:11.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.011+0000 7f2819765640 1 --2- 172.21.15.2:0/1253918068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c6c059890 0x555c6c05bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:11.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.011+0000 7f2819765640 1 -- 172.21.15.2:0/1253918068 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c6bf3e440 con 0x555c6c04efd0 2024-09-19T04:52:11.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.011+0000 7f2819f66640 1 --2- 172.21.15.2:0/1253918068 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c6c04e6b0 0x555c6c04ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:52:11.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.011+0000 7f281a767640 1 --2- 172.21.15.2:0/4099194616 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f28000a3430 0x7f28000a58f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f280c013750 tx=0x7f280c013b50 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:11.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.011+0000 7f2819765640 1 --2- 172.21.15.2:0/1253918068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c6c04efd0 0x555c6c059350 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f28040edcf0 tx=0x7f28040bc6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4305e3f8e35d5aad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:11.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.011+0000 7f27fffff640 1 -- 172.21.15.2:0/1253918068 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2804049040 con 0x555c6c04efd0 2024-09-19T04:52:11.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.011+0000 7f27fffff640 1 -- 172.21.15.2:0/1253918068 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f28040bcf80 con 0x555c6c04efd0 2024-09-19T04:52:11.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.012+0000 7f27fffff640 1 -- 172.21.15.2:0/1253918068 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2804003c50 con 0x555c6c04efd0 2024-09-19T04:52:11.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.012+0000 7f281e5a3740 1 -- 172.21.15.2:0/1253918068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c6c04efd0 msgr2=0x555c6c059350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:11.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.012+0000 7f281e5a3740 1 --2- 172.21.15.2:0/1253918068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c6c04efd0 0x555c6c059350 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f28040edcf0 tx=0x7f28040bc6d0 comp rx=0 tx=0).stop 2024-09-19T04:52:11.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.012+0000 7f281e5a3740 1 -- 172.21.15.2:0/1253918068 shutdown_connections 2024-09-19T04:52:11.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.012+0000 7f281e5a3740 1 --2- 172.21.15.2:0/1253918068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c6c059890 0x555c6c05bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:11.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.012+0000 7f281e5a3740 1 --2- 172.21.15.2:0/1253918068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c6c04efd0 0x555c6c059350 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:11.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.012+0000 7f281e5a3740 1 --2- 172.21.15.2:0/1253918068 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c6c04e6b0 0x555c6c04ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:11.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.012+0000 7f281e5a3740 1 -- 172.21.15.2:0/1253918068 >> 172.21.15.2:0/1253918068 conn(0x555c6c04ac40 msgr2=0x555c6c04b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:11.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.012+0000 7f281e5a3740 1 -- 172.21.15.2:0/1253918068 shutdown_connections 2024-09-19T04:52:11.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.012+0000 7f281e5a3740 1 -- 172.21.15.2:0/1253918068 wait complete. 2024-09-19T04:52:11.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.013+0000 7f281e5a3740 1 -- start start 2024-09-19T04:52:11.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.013+0000 7f281e5a3740 1 Processor -- start 2024-09-19T04:52:11.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.013+0000 7f281e5a3740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c6c04e6b0 0x555c6c0546e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:11.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.013+0000 7f281e5a3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c6c04efd0 0x555c6c054c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:11.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.013+0000 7f281e5a3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c6c059890 0x555c6c055160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:11.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.013+0000 7f281e5a3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555c6c048420 con 0x555c6c04efd0 2024-09-19T04:52:11.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.013+0000 7f281e5a3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555c6bf6d050 con 0x555c6c059890 2024-09-19T04:52:11.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.013+0000 7f281e5a3740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x555c6c0485a0 con 0x555c6c04e6b0 2024-09-19T04:52:11.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.013+0000 7f281e5a3740 10 client.0 _ll_register_callbacks cb 0x555c6bfad160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:52:11.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.013+0000 7f2819765640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c6c04efd0 0x555c6c054c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:11.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.013+0000 7f2819765640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c6c04efd0 0x555c6c054c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38376/0 (socket says 172.21.15.2:38376) 2024-09-19T04:52:11.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.013+0000 7f2819765640 1 -- 172.21.15.2:0/523302374 learned_addr learned my addr 172.21.15.2:0/523302374 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:11.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.014+0000 7f2819f66640 1 --2- 172.21.15.2:0/523302374 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c6c04e6b0 0x555c6c0546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:11.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.014+0000 7f281a767640 1 --2- 172.21.15.2:0/523302374 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c6c059890 0x555c6c055160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:11.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.014+0000 7f2819765640 1 -- 172.21.15.2:0/523302374 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c6c04e6b0 msgr2=0x555c6c0546e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:11.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.014+0000 7f2819765640 1 --2- 172.21.15.2:0/523302374 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c6c04e6b0 0x555c6c0546e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:11.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.014+0000 7f2819765640 1 -- 172.21.15.2:0/523302374 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c6c059890 msgr2=0x555c6c055160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:11.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.014+0000 7f2819765640 1 --2- 172.21.15.2:0/523302374 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c6c059890 0x555c6c055160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:11.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.014+0000 7f2819765640 1 -- 172.21.15.2:0/523302374 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c6bd233c0 con 0x555c6c04efd0 2024-09-19T04:52:11.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.014+0000 7f281a767640 1 --2- 172.21.15.2:0/523302374 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c6c059890 0x555c6c055160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:52:11.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.014+0000 7f2819765640 1 --2- 172.21.15.2:0/523302374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c6c04efd0 0x555c6c054c20 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f28040edda0 tx=0x7f2804005900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d494d6519ccc68a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:11.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.014+0000 7f27fd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:52:11.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.014+0000 7f27fd7fa640 1 -- 172.21.15.2:0/523302374 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28040db060 con 0x555c6c04efd0 2024-09-19T04:52:11.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.014+0000 7f281e5a3740 1 -- 172.21.15.2:0/523302374 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28040bcf80 con 0x555c6c04efd0 2024-09-19T04:52:11.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.014+0000 7f27fd7fa640 1 -- 172.21.15.2:0/523302374 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f28040db200 con 0x555c6c04efd0 2024-09-19T04:52:11.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.015+0000 7f27fd7fa640 1 -- 172.21.15.2:0/523302374 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f28040a2050 con 0x555c6c04efd0 2024-09-19T04:52:11.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.015+0000 7f281e5a3740 10 client.15804 fetch_fsmap learned FSMap version 19 2024-09-19T04:52:11.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.015+0000 7f281e5a3740 1 -- 172.21.15.2:0/523302374 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x555c6c048420 con 0x555c6c04efd0 2024-09-19T04:52:11.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.015+0000 7f27fd7fa640 1 -- 172.21.15.2:0/523302374 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f28040bcf80 con 0x555c6c04efd0 2024-09-19T04:52:11.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.015+0000 7f27fd7fa640 1 -- 172.21.15.2:0/523302374 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f28040c50f0 con 0x555c6c04efd0 2024-09-19T04:52:11.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.015+0000 7f281e5a3740 10 client.15804 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:52:11.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.015+0000 7f281e5a3740 10 client.15804 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:52:11.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.015+0000 7f281e5a3740 20 client.15804 populate_metadata read hostname 'smithi002' 2024-09-19T04:52:11.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.015+0000 7f281e5a3740 1 --2- 172.21.15.2:0/523302374 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x555c6c06b060 0x555c6c06d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:11.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.015+0000 7f281e5a3740 4 client.15804 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:52:11.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.015+0000 7f281e5a3740 1 -- 172.21.15.2:0/523302374 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c6bfbf850 con 0x555c6c06b060 2024-09-19T04:52:11.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.016+0000 7f2819f66640 1 --2- 172.21.15.2:0/523302374 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x555c6c06b060 0x555c6c06d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:11.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.016+0000 7f2819f66640 1 --2- 172.21.15.2:0/523302374 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x555c6c06b060 0x555c6c06d450 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afebb5f8f843c69e server_cookie=968ee9a026df0fe0 in_seq=0 out_seq=0 2024-09-19T04:52:11.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.016+0000 7f27fd7fa640 10 client.15804 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:52:11.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.017+0000 7f27fd7fa640 1 -- 172.21.15.2:0/523302374 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555c6bfbf850 con 0x555c6c06b060 2024-09-19T04:52:11.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.017+0000 7f27fd7fa640 10 client.15804 handle_command_reply: tid=0 2024-09-19T04:52:11.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.017+0000 7f281e5a3740 1 client.15804 shutdown 2024-09-19T04:52:11.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.017+0000 7f281e5a3740 1 -- 172.21.15.2:0/523302374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c6c04efd0 msgr2=0x555c6c054c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:11.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.017+0000 7f281e5a3740 1 --2- 172.21.15.2:0/523302374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c6c04efd0 0x555c6c054c20 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f28040edda0 tx=0x7f2804005900 comp rx=0 tx=0).stop 2024-09-19T04:52:11.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.017+0000 7f281e5a3740 1 -- 172.21.15.2:0/523302374 shutdown_connections 2024-09-19T04:52:11.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.017+0000 7f281e5a3740 1 --2- 172.21.15.2:0/523302374 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c6c059890 0x555c6c055160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:11.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.017+0000 7f281e5a3740 1 --2- 172.21.15.2:0/523302374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c6c04efd0 0x555c6c054c20 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:11.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.017+0000 7f281e5a3740 1 --2- 172.21.15.2:0/523302374 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x555c6c06b060 0x555c6c06d450 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:11.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.017+0000 7f281e5a3740 1 --2- 172.21.15.2:0/523302374 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c6c04e6b0 0x555c6c0546e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:11.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.017+0000 7f281e5a3740 1 -- 172.21.15.2:0/523302374 >> 172.21.15.2:0/523302374 conn(0x555c6c04ac40 msgr2=0x555c6c047b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:11.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.017+0000 7f27fd7fa640 0 client.15804 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:52:11.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.017+0000 7f281e5a3740 1 -- 172.21.15.2:0/523302374 shutdown_connections 2024-09-19T04:52:11.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.017+0000 7f281e5a3740 1 -- 172.21.15.2:0/523302374 wait complete. 2024-09-19T04:52:11.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.017+0000 7f281e5a3740 20 client.15804 trim_cache size 0 max 16384 2024-09-19T04:52:11.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.035+0000 7f281e5a3740 1 Processor -- start 2024-09-19T04:52:11.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.035+0000 7f281e5a3740 1 -- start start 2024-09-19T04:52:11.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.035+0000 7f281e5a3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c6c04e6b0 0x555c6c050bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:11.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.035+0000 7f281e5a3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c6c04efd0 0x555c6c05ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:11.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.035+0000 7f281e5a3740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c6c059890 0x555c6c054fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:11.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.035+0000 7f281e5a3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f28141a9390 con 0x555c6c04efd0 2024-09-19T04:52:11.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.035+0000 7f281e5a3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f28141abbf0 con 0x555c6c04e6b0 2024-09-19T04:52:11.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.035+0000 7f281e5a3740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f28141a99e0 con 0x555c6c059890 2024-09-19T04:52:11.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.035+0000 7f2819765640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c6c04efd0 0x555c6c05ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:11.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.035+0000 7f2819765640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c6c04efd0 0x555c6c05ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38392/0 (socket says 172.21.15.2:38392) 2024-09-19T04:52:11.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.035+0000 7f2819765640 1 -- 172.21.15.2:0/1240420811 learned_addr learned my addr 172.21.15.2:0/1240420811 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:11.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.035+0000 7f2819f66640 1 --2- 172.21.15.2:0/1240420811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c6c04e6b0 0x555c6c050bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:11.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.035+0000 7f281a767640 1 --2- 172.21.15.2:0/1240420811 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c6c059890 0x555c6c054fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:11.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.035+0000 7f2819765640 1 -- 172.21.15.2:0/1240420811 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c6c059890 msgr2=0x555c6c054fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:11.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.035+0000 7f2819765640 1 --2- 172.21.15.2:0/1240420811 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c6c059890 0x555c6c054fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:11.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.035+0000 7f2819765640 1 -- 172.21.15.2:0/1240420811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c6c04e6b0 msgr2=0x555c6c050bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:11.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.035+0000 7f2819765640 1 --2- 172.21.15.2:0/1240420811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c6c04e6b0 0x555c6c050bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:11.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.035+0000 7f2819765640 1 -- 172.21.15.2:0/1240420811 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c6c04bdd0 con 0x555c6c04efd0 2024-09-19T04:52:11.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.036+0000 7f2819765640 1 --2- 172.21.15.2:0/1240420811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c6c04efd0 0x555c6c05ac80 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f28040bc580 tx=0x7f28040319b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d3615ac9ebb3138 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:11.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.036+0000 7f27ff7fe640 1 -- 172.21.15.2:0/1240420811 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28040db050 con 0x555c6c04efd0 2024-09-19T04:52:11.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.036+0000 7f27ff7fe640 1 -- 172.21.15.2:0/1240420811 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f28040bcf80 con 0x555c6c04efd0 2024-09-19T04:52:11.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.036+0000 7f27ff7fe640 1 -- 172.21.15.2:0/1240420811 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2804049070 con 0x555c6c04efd0 2024-09-19T04:52:11.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.037+0000 7f281e5a3740 1 -- 172.21.15.2:0/1240420811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c6c04efd0 msgr2=0x555c6c05ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:11.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.037+0000 7f281e5a3740 1 --2- 172.21.15.2:0/1240420811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c6c04efd0 0x555c6c05ac80 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f28040bc580 tx=0x7f28040319b0 comp rx=0 tx=0).stop 2024-09-19T04:52:11.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.037+0000 7f281e5a3740 1 -- 172.21.15.2:0/1240420811 shutdown_connections 2024-09-19T04:52:11.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.037+0000 7f281e5a3740 1 --2- 172.21.15.2:0/1240420811 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c6c059890 0x555c6c054fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:11.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.037+0000 7f281e5a3740 1 --2- 172.21.15.2:0/1240420811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c6c04efd0 0x555c6c05ac80 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:11.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.037+0000 7f281e5a3740 1 --2- 172.21.15.2:0/1240420811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c6c04e6b0 0x555c6c050bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:11.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.037+0000 7f281e5a3740 1 -- 172.21.15.2:0/1240420811 >> 172.21.15.2:0/1240420811 conn(0x555c6c04ac40 msgr2=0x555c6c053490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:11.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.037+0000 7f281e5a3740 1 -- 172.21.15.2:0/1240420811 shutdown_connections 2024-09-19T04:52:11.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.037+0000 7f281e5a3740 1 -- 172.21.15.2:0/1240420811 wait complete. 2024-09-19T04:52:11.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.037+0000 7f281e5a3740 1 -- start start 2024-09-19T04:52:11.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.038+0000 7f281e5a3740 1 Processor -- start 2024-09-19T04:52:11.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.038+0000 7f281e5a3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c6c04e6b0 0x555c6c0605d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:11.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.038+0000 7f281e5a3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c6c04efd0 0x555c6c060b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:11.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.038+0000 7f281e5a3740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c6c059890 0x555c6c061050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:11.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.038+0000 7f281e5a3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f28141aa0b0 con 0x555c6c04e6b0 2024-09-19T04:52:11.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.038+0000 7f281e5a3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f28141ab520 con 0x555c6c04efd0 2024-09-19T04:52:11.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.038+0000 7f281e5a3740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f28141aa780 con 0x555c6c059890 2024-09-19T04:52:11.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.038+0000 7f2819f66640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c6c04e6b0 0x555c6c0605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:11.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.038+0000 7f2819f66640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c6c04e6b0 0x555c6c0605d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38406/0 (socket says 172.21.15.2:38406) 2024-09-19T04:52:11.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.038+0000 7f2819f66640 1 -- 172.21.15.2:0/3715598177 learned_addr learned my addr 172.21.15.2:0/3715598177 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:11.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.038+0000 7f281e5a3740 10 client.0 _ll_register_callbacks cb 0x7f28100094a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:52:11.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.038+0000 7f2819765640 1 --2- 172.21.15.2:0/3715598177 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c6c04efd0 0x555c6c060b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:11.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.039+0000 7f281a767640 1 --2- 172.21.15.2:0/3715598177 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c6c059890 0x555c6c061050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:11.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.039+0000 7f2819f66640 1 -- 172.21.15.2:0/3715598177 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c6c059890 msgr2=0x555c6c061050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:11.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.039+0000 7f2819f66640 1 --2- 172.21.15.2:0/3715598177 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c6c059890 0x555c6c061050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:11.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.039+0000 7f2819f66640 1 -- 172.21.15.2:0/3715598177 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c6c04efd0 msgr2=0x555c6c060b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:11.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.039+0000 7f2819f66640 1 --2- 172.21.15.2:0/3715598177 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c6c04efd0 0x555c6c060b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:11.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.039+0000 7f2819f66640 1 -- 172.21.15.2:0/3715598177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c6c064cb0 con 0x555c6c04e6b0 2024-09-19T04:52:11.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.039+0000 7f2819765640 1 --2- 172.21.15.2:0/3715598177 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c6c04efd0 0x555c6c060b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:52:11.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.039+0000 7f2819f66640 1 --2- 172.21.15.2:0/3715598177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c6c04e6b0 0x555c6c0605d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x555c6c06dca0 tx=0x7f2810015420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc379017d6cfc3c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:11.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.039+0000 7f27fd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:52:11.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.039+0000 7f27fd7fa640 1 -- 172.21.15.2:0/3715598177 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28100059c0 con 0x555c6c04e6b0 2024-09-19T04:52:11.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.039+0000 7f27fd7fa640 1 -- 172.21.15.2:0/3715598177 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f2810005b60 con 0x555c6c04e6b0 2024-09-19T04:52:11.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.039+0000 7f281e5a3740 1 -- 172.21.15.2:0/3715598177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28040bcf80 con 0x555c6c04e6b0 2024-09-19T04:52:11.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.040+0000 7f27fd7fa640 1 -- 172.21.15.2:0/3715598177 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f281002f050 con 0x555c6c04e6b0 2024-09-19T04:52:11.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.040+0000 7f281e5a3740 10 client.15810 fetch_fsmap learned FSMap version 19 2024-09-19T04:52:11.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.040+0000 7f281e5a3740 1 -- 172.21.15.2:0/3715598177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x555c6c0d5fd0 con 0x555c6c04e6b0 2024-09-19T04:52:11.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.040+0000 7f27fd7fa640 1 -- 172.21.15.2:0/3715598177 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f28040bcf80 con 0x555c6c04e6b0 2024-09-19T04:52:11.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.040+0000 7f27fd7fa640 1 -- 172.21.15.2:0/3715598177 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f281001f4c0 con 0x555c6c04e6b0 2024-09-19T04:52:11.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.040+0000 7f281e5a3740 10 client.15810 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:52:11.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.040+0000 7f281e5a3740 10 client.15810 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:52:11.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.040+0000 7f281e5a3740 20 client.15810 populate_metadata read hostname 'smithi002' 2024-09-19T04:52:11.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.040+0000 7f281e5a3740 1 --2- 172.21.15.2:0/3715598177 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x555c6c0d67a0 0x555c6c0d8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:11.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.040+0000 7f281e5a3740 4 client.15810 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:52:11.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.040+0000 7f281e5a3740 1 -- 172.21.15.2:0/3715598177 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555c6bfb9d60 con 0x555c6c0d67a0 2024-09-19T04:52:11.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.040+0000 7f2819765640 1 --2- 172.21.15.2:0/3715598177 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x555c6c0d67a0 0x555c6c0d8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:11.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.041+0000 7f27fd7fa640 10 client.15810 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:52:11.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.041+0000 7f2819765640 1 --2- 172.21.15.2:0/3715598177 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x555c6c0d67a0 0x555c6c0d8bc0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b3ac94e7402c05e server_cookie=1a1d76e020599ad6 in_seq=0 out_seq=0 2024-09-19T04:52:11.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.041+0000 7f27fd7fa640 1 -- 172.21.15.2:0/3715598177 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x555c6bfb9d60 con 0x555c6c0d67a0 2024-09-19T04:52:11.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.041+0000 7f27fd7fa640 10 client.15810 handle_command_reply: tid=0 2024-09-19T04:52:11.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.041+0000 7f281e5a3740 1 client.15810 shutdown 2024-09-19T04:52:11.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.041+0000 7f281e5a3740 1 -- 172.21.15.2:0/3715598177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c6c04e6b0 msgr2=0x555c6c0605d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:11.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.041+0000 7f281e5a3740 1 --2- 172.21.15.2:0/3715598177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c6c04e6b0 0x555c6c0605d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x555c6c06dca0 tx=0x7f2810015420 comp rx=0 tx=0).stop 2024-09-19T04:52:11.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.041+0000 7f281e5a3740 1 -- 172.21.15.2:0/3715598177 shutdown_connections 2024-09-19T04:52:11.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.041+0000 7f281e5a3740 1 --2- 172.21.15.2:0/3715598177 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x555c6c0d67a0 0x555c6c0d8bc0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:11.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.041+0000 7f281e5a3740 1 --2- 172.21.15.2:0/3715598177 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c6c059890 0x555c6c061050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:11.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.041+0000 7f281e5a3740 1 --2- 172.21.15.2:0/3715598177 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c6c04efd0 0x555c6c060b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:11.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.041+0000 7f281e5a3740 1 --2- 172.21.15.2:0/3715598177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c6c04e6b0 0x555c6c0605d0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:11.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.041+0000 7f27fd7fa640 0 client.15810 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:52:11.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.041+0000 7f281e5a3740 1 -- 172.21.15.2:0/3715598177 >> 172.21.15.2:0/3715598177 conn(0x555c6c04ac40 msgr2=0x555c6c054c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:11.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.042+0000 7f281e5a3740 1 -- 172.21.15.2:0/3715598177 shutdown_connections 2024-09-19T04:52:11.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.042+0000 7f281e5a3740 1 -- 172.21.15.2:0/3715598177 wait complete. 2024-09-19T04:52:11.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.042+0000 7f281e5a3740 20 client.15810 trim_cache size 0 max 16384 2024-09-19T04:52:11.051 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:52:11.051 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T04:52:11.052 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T04:52:11.052 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:52:11.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.042+0000 7f281c1ca640 1 -- 172.21.15.2:0/4099194616 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f28000a3430 msgr2=0x7f28000a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:11.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.042+0000 7f281c1ca640 1 --2- 172.21.15.2:0/4099194616 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f28000a3430 0x7f28000a58f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f280c013750 tx=0x7f280c013b50 comp rx=0 tx=0).stop 2024-09-19T04:52:11.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.042+0000 7f281c1ca640 1 -- 172.21.15.2:0/4099194616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2814102570 msgr2=0x7f2814197830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:11.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.042+0000 7f281c1ca640 1 --2- 172.21.15.2:0/4099194616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2814102570 0x7f2814197830 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f2804006010 tx=0x7f28040042f0 comp rx=0 tx=0).stop 2024-09-19T04:52:11.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.043+0000 7f281c1ca640 1 -- 172.21.15.2:0/4099194616 shutdown_connections 2024-09-19T04:52:11.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.043+0000 7f281c1ca640 1 --2- 172.21.15.2:0/4099194616 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f28000a3430 0x7f28000a58f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:11.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.043+0000 7f281c1ca640 1 --2- 172.21.15.2:0/4099194616 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2814102ef0 0x7f281419bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:11.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.043+0000 7f281c1ca640 1 --2- 172.21.15.2:0/4099194616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2814102570 0x7f2814197830 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:11.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.043+0000 7f281c1ca640 1 --2- 172.21.15.2:0/4099194616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2814100e20 0x7f28141972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:11.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.043+0000 7f281c1ca640 1 -- 172.21.15.2:0/4099194616 >> 172.21.15.2:0/4099194616 conn(0x7f28140fc7d0 msgr2=0x7f28140febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:11.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.043+0000 7f281c1ca640 1 -- 172.21.15.2:0/4099194616 shutdown_connections 2024-09-19T04:52:11.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:11.043+0000 7f281c1ca640 1 -- 172.21.15.2:0/4099194616 wait complete. 2024-09-19T04:52:11.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:11 smithi018 ceph-mon[34537]: pgmap v128: 97 pgs: 97 active+clean; 4.7 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 47 KiB/s wr, 21 op/s 2024-09-19T04:52:11.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:11 smithi018 ceph-mon[34537]: scrub queued for path: / 2024-09-19T04:52:11.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:11 smithi018 ceph-mon[34537]: scrub summary: idle+waiting paths [/] 2024-09-19T04:52:11.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:11 smithi018 ceph-mon[34537]: scrub summary: active paths [/] 2024-09-19T04:52:11.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:11 smithi018 ceph-mon[34537]: scrub summary: idle+waiting paths [/] 2024-09-19T04:52:11.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:11 smithi018 ceph-mon[34537]: scrub summary: idle 2024-09-19T04:52:11.357 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:11 smithi002 ceph-mon[30975]: pgmap v128: 97 pgs: 97 active+clean; 4.7 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 47 KiB/s wr, 21 op/s 2024-09-19T04:52:11.357 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:11 smithi002 ceph-mon[30975]: scrub queued for path: / 2024-09-19T04:52:11.357 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:11 smithi002 ceph-mon[30975]: scrub summary: idle+waiting paths [/] 2024-09-19T04:52:11.357 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:11 smithi002 ceph-mon[30975]: scrub summary: active paths [/] 2024-09-19T04:52:11.357 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:11 smithi002 ceph-mon[30975]: scrub summary: idle+waiting paths [/] 2024-09-19T04:52:11.358 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:11 smithi002 ceph-mon[30975]: scrub summary: idle 2024-09-19T04:52:11.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:11 smithi116 ceph-mon[34477]: pgmap v128: 97 pgs: 97 active+clean; 4.7 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 47 KiB/s wr, 21 op/s 2024-09-19T04:52:11.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:11 smithi116 ceph-mon[34477]: scrub queued for path: / 2024-09-19T04:52:11.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:11 smithi116 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-19T04:52:11.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:11 smithi116 ceph-mon[34477]: scrub summary: active paths [/] 2024-09-19T04:52:11.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:11 smithi116 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-19T04:52:11.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:11 smithi116 ceph-mon[34477]: scrub summary: idle 2024-09-19T04:52:11.888 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:52:11.888 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:52:12.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:12 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:52:12.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:12 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:52:12.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:12 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:52:12.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:12 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:52:12.149 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:52:12.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:12 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:52:12.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:12 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:52:12.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:12 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:52:12.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:12 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:52:12.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:12 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:52:12.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:12 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:52:12.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:12 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:52:12.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:12 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:52:12.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.720+0000 7fc0cdf1b640 1 -- 172.21.15.2:0/3551706074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0c8101420 msgr2=0x7fc0c810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:12.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.720+0000 7fc0cdf1b640 1 --2- 172.21.15.2:0/3551706074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0c8101420 0x7fc0c810d950 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc0c0009cd0 tx=0x7fc0c002a8e0 comp rx=0 tx=0).stop 2024-09-19T04:52:12.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.720+0000 7fc0cdf1b640 1 -- 172.21.15.2:0/3551706074 shutdown_connections 2024-09-19T04:52:12.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.720+0000 7fc0cdf1b640 1 --2- 172.21.15.2:0/3551706074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0c8101420 0x7fc0c810d950 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:12.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.720+0000 7fc0cdf1b640 1 --2- 172.21.15.2:0/3551706074 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0c8100a80 0x7fc0c8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:12.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.720+0000 7fc0cdf1b640 1 --2- 172.21.15.2:0/3551706074 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0c8106a80 0x7fc0c8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:12.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.720+0000 7fc0cdf1b640 1 -- 172.21.15.2:0/3551706074 >> 172.21.15.2:0/3551706074 conn(0x7fc0c80fc7a0 msgr2=0x7fc0c80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:12.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.720+0000 7fc0cdf1b640 1 -- 172.21.15.2:0/3551706074 shutdown_connections 2024-09-19T04:52:12.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.720+0000 7fc0cdf1b640 1 -- 172.21.15.2:0/3551706074 wait complete. 2024-09-19T04:52:12.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.720+0000 7fc0cdf1b640 1 Processor -- start 2024-09-19T04:52:12.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.720+0000 7fc0cdf1b640 1 -- start start 2024-09-19T04:52:12.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.721+0000 7fc0cdf1b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0c8100a80 0x7fc0c81991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:12.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.721+0000 7fc0cdf1b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0c8101420 0x7fc0c8199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:12.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.721+0000 7fc0cdf1b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0c8106a80 0x7fc0c81a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:12.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.721+0000 7fc0cdf1b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c8110d30 con 0x7fc0c8101420 2024-09-19T04:52:12.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.721+0000 7fc0cdf1b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c8110bb0 con 0x7fc0c8106a80 2024-09-19T04:52:12.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.721+0000 7fc0cdf1b640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c8110eb0 con 0x7fc0c8100a80 2024-09-19T04:52:12.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.721+0000 7fc0c6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0c8101420 0x7fc0c8199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:12.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.721+0000 7fc0c6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0c8101420 0x7fc0c8199700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53964/0 (socket says 172.21.15.2:53964) 2024-09-19T04:52:12.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.721+0000 7fc0c6ffd640 1 -- 172.21.15.2:0/2260756309 learned_addr learned my addr 172.21.15.2:0/2260756309 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:12.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.721+0000 7fc0c77fe640 1 --2- 172.21.15.2:0/2260756309 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0c8100a80 0x7fc0c81991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:12.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.721+0000 7fc0c7fff640 1 --2- 172.21.15.2:0/2260756309 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0c8106a80 0x7fc0c81a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:12.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.721+0000 7fc0c6ffd640 1 -- 172.21.15.2:0/2260756309 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0c8100a80 msgr2=0x7fc0c81991c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:12.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.721+0000 7fc0c6ffd640 1 --2- 172.21.15.2:0/2260756309 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0c8100a80 0x7fc0c81991c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:12.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.721+0000 7fc0c6ffd640 1 -- 172.21.15.2:0/2260756309 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0c8106a80 msgr2=0x7fc0c81a4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:12.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.721+0000 7fc0c6ffd640 1 --2- 172.21.15.2:0/2260756309 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0c8106a80 0x7fc0c81a4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:12.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.721+0000 7fc0c6ffd640 1 -- 172.21.15.2:0/2260756309 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0c81a4780 con 0x7fc0c8101420 2024-09-19T04:52:12.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.721+0000 7fc0c77fe640 1 --2- 172.21.15.2:0/2260756309 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0c8100a80 0x7fc0c81991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:52:12.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.721+0000 7fc0c6ffd640 1 --2- 172.21.15.2:0/2260756309 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0c8101420 0x7fc0c8199700 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc00d950 tx=0x7fc0bc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:12.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.722+0000 7fc0c4ff9640 1 -- 172.21.15.2:0/2260756309 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc017030 con 0x7fc0c8101420 2024-09-19T04:52:12.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.722+0000 7fc0cdf1b640 1 -- 172.21.15.2:0/2260756309 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0c81a4950 con 0x7fc0c8101420 2024-09-19T04:52:12.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.722+0000 7fc0c4ff9640 1 -- 172.21.15.2:0/2260756309 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc0bc004020 con 0x7fc0c8101420 2024-09-19T04:52:12.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.722+0000 7fc0c4ff9640 1 -- 172.21.15.2:0/2260756309 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc0047a0 con 0x7fc0c8101420 2024-09-19T04:52:12.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.722+0000 7fc0cdf1b640 1 -- 172.21.15.2:0/2260756309 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0c81a4e90 con 0x7fc0c8101420 2024-09-19T04:52:12.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.723+0000 7fc0cdf1b640 1 -- 172.21.15.2:0/2260756309 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0c8100ee0 con 0x7fc0c8101420 2024-09-19T04:52:12.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.724+0000 7fc0c4ff9640 1 -- 172.21.15.2:0/2260756309 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fc0bc0041d0 con 0x7fc0c8101420 2024-09-19T04:52:12.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.725+0000 7fc0c4ff9640 1 --2- 172.21.15.2:0/2260756309 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fc0b00a33b0 0x7fc0b00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:12.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.725+0000 7fc0c77fe640 1 --2- 172.21.15.2:0/2260756309 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fc0b00a33b0 0x7fc0b00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:12.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.725+0000 7fc0c4ff9640 1 -- 172.21.15.2:0/2260756309 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7fc0bc0cfd50 con 0x7fc0c8101420 2024-09-19T04:52:12.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.725+0000 7fc0c77fe640 1 --2- 172.21.15.2:0/2260756309 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fc0b00a33b0 0x7fc0b00a5870 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc0b8009f40 tx=0x7fc0b8005f90 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:12.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.728+0000 7fc0c4ff9640 1 -- 172.21.15.2:0/2260756309 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc0bc09c750 con 0x7fc0c8101420 2024-09-19T04:52:12.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.942+0000 7fc0cdf1b640 1 -- 172.21.15.2:0/2260756309 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc0c8109050 con 0x7fc0c8101420 2024-09-19T04:52:12.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.942+0000 7fc0c4ff9640 1 -- 172.21.15.2:0/2260756309 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11840 (secure 0 0 0) 0x7fc0bc09c050 con 0x7fc0c8101420 2024-09-19T04:52:12.944 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:52:12.944 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":19,"btime":"2024-09-19T04:46:33:537239+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2467365137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2467365137},{"type":"v1","addr":"172.21.15.2:6835","nonce":2467365137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3162441888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3162441888},{"type":"v1","addr":"172.21.15.2:6837","nonce":3162441888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14631,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2740862966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2740862966},{"type":"v1","addr":"172.21.15.2:6839","nonce":2740862966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/2394435504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2394435504},{"type":"v1","addr":"172.21.15.2:6841","nonce":2394435504}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1630480244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1630480244},{"type":"v1","addr":"172.21.15.18:6833","nonce":1630480244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1553897465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1553897465},{"type":"v1","addr":"172.21.15.116:6833","nonce":1553897465}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3035664608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3035664608},{"type":"v1","addr":"172.21.15.18:6835","nonce":3035664608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1096622392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1096622392},{"type":"v1","addr":"172.21.15.18:6837","nonce":1096622392}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3761157675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3761157675},{"type":"v1","addr":"172.21.15.116:6835","nonce":3761157675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/1120131594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1120131594},{"type":"v1","addr":"172.21.15.116:6837","nonce":1120131594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:46:24.050115+0000","modified":"2024-09-19T04:46:33.112369+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/4207677139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":4207677139},{"type":"v1","addr":"172.21.15.18:6839","nonce":4207677139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/2346874880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":2346874880},{"type":"v1","addr":"172.21.15.116:6839","nonce":2346874880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496]},"id":1}]} 2024-09-19T04:52:12.945 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 19 2024-09-19T04:52:12.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.945+0000 7fc0cdf1b640 1 -- 172.21.15.2:0/2260756309 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fc0b00a33b0 msgr2=0x7fc0b00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:12.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.945+0000 7fc0cdf1b640 1 --2- 172.21.15.2:0/2260756309 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fc0b00a33b0 0x7fc0b00a5870 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc0b8009f40 tx=0x7fc0b8005f90 comp rx=0 tx=0).stop 2024-09-19T04:52:12.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.945+0000 7fc0cdf1b640 1 -- 172.21.15.2:0/2260756309 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0c8101420 msgr2=0x7fc0c8199700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:12.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.945+0000 7fc0cdf1b640 1 --2- 172.21.15.2:0/2260756309 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0c8101420 0x7fc0c8199700 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc00d950 tx=0x7fc0bc00de10 comp rx=0 tx=0).stop 2024-09-19T04:52:12.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.945+0000 7fc0cdf1b640 1 -- 172.21.15.2:0/2260756309 shutdown_connections 2024-09-19T04:52:12.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.945+0000 7fc0cdf1b640 1 --2- 172.21.15.2:0/2260756309 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0c8106a80 0x7fc0c81a4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:12.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.945+0000 7fc0cdf1b640 1 --2- 172.21.15.2:0/2260756309 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0c8101420 0x7fc0c8199700 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:12.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.945+0000 7fc0cdf1b640 1 --2- 172.21.15.2:0/2260756309 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fc0b00a33b0 0x7fc0b00a5870 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:12.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.945+0000 7fc0cdf1b640 1 --2- 172.21.15.2:0/2260756309 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0c8100a80 0x7fc0c81991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:12.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.945+0000 7fc0cdf1b640 1 -- 172.21.15.2:0/2260756309 >> 172.21.15.2:0/2260756309 conn(0x7fc0c80fc7a0 msgr2=0x7fc0c80fd050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:12.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.945+0000 7fc0cdf1b640 1 -- 172.21.15.2:0/2260756309 shutdown_connections 2024-09-19T04:52:12.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:12.945+0000 7fc0cdf1b640 1 -- 172.21.15.2:0/2260756309 wait complete. 2024-09-19T04:52:13.283 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:13 smithi002 ceph-mon[30975]: pgmap v129: 97 pgs: 97 active+clean; 4.8 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 59 KiB/s wr, 25 op/s 2024-09-19T04:52:13.283 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:13 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/2260756309' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:52:13.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:13 smithi018 ceph-mon[34537]: pgmap v129: 97 pgs: 97 active+clean; 4.8 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 59 KiB/s wr, 25 op/s 2024-09-19T04:52:13.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:13 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/2260756309' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:52:13.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:13 smithi116 ceph-mon[34477]: pgmap v129: 97 pgs: 97 active+clean; 4.8 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 59 KiB/s wr, 25 op/s 2024-09-19T04:52:13.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:13 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/2260756309' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:52:13.718 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:52:13.980 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:52:14.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.545+0000 7f1a90ca3640 1 -- 172.21.15.2:0/1103590247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a8c101420 msgr2=0x7f1a8c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:14.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.545+0000 7f1a90ca3640 1 --2- 172.21.15.2:0/1103590247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a8c101420 0x7f1a8c10d950 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f1a84009cd0 tx=0x7f1a8402a8e0 comp rx=0 tx=0).stop 2024-09-19T04:52:14.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.545+0000 7f1a90ca3640 1 -- 172.21.15.2:0/1103590247 shutdown_connections 2024-09-19T04:52:14.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.545+0000 7f1a90ca3640 1 --2- 172.21.15.2:0/1103590247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a8c101420 0x7f1a8c10d950 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:14.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.545+0000 7f1a90ca3640 1 --2- 172.21.15.2:0/1103590247 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a8c100a80 0x7f1a8c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:14.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.545+0000 7f1a90ca3640 1 --2- 172.21.15.2:0/1103590247 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a8c106a80 0x7f1a8c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:14.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.545+0000 7f1a90ca3640 1 -- 172.21.15.2:0/1103590247 >> 172.21.15.2:0/1103590247 conn(0x7f1a8c0fc7a0 msgr2=0x7f1a8c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:14.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.545+0000 7f1a90ca3640 1 -- 172.21.15.2:0/1103590247 shutdown_connections 2024-09-19T04:52:14.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.545+0000 7f1a90ca3640 1 -- 172.21.15.2:0/1103590247 wait complete. 2024-09-19T04:52:14.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.546+0000 7f1a90ca3640 1 Processor -- start 2024-09-19T04:52:14.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.546+0000 7f1a90ca3640 1 -- start start 2024-09-19T04:52:14.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.547+0000 7f1a90ca3640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a8c100a80 0x7f1a8c197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:14.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.547+0000 7f1a90ca3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a8c101420 0x7f1a8c1977b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:14.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.547+0000 7f1a90ca3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a8c106a80 0x7f1a8c19bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:14.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.547+0000 7f1a90ca3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1a8c110d30 con 0x7f1a8c101420 2024-09-19T04:52:14.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.547+0000 7f1a90ca3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1a8c110bb0 con 0x7f1a8c106a80 2024-09-19T04:52:14.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.547+0000 7f1a90ca3640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f1a8c110eb0 con 0x7f1a8c100a80 2024-09-19T04:52:14.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.547+0000 7f1a81d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a8c101420 0x7f1a8c1977b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:14.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.547+0000 7f1a81d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a8c101420 0x7f1a8c1977b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53982/0 (socket says 172.21.15.2:53982) 2024-09-19T04:52:14.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.547+0000 7f1a81d9b640 1 -- 172.21.15.2:0/1812632454 learned_addr learned my addr 172.21.15.2:0/1812632454 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:14.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.547+0000 7f1a8ad9d640 1 --2- 172.21.15.2:0/1812632454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a8c106a80 0x7f1a8c19bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:14.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.547+0000 7f1a8a59c640 1 --2- 172.21.15.2:0/1812632454 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a8c100a80 0x7f1a8c197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:14.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.547+0000 7f1a81d9b640 1 -- 172.21.15.2:0/1812632454 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a8c100a80 msgr2=0x7f1a8c197270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:14.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.547+0000 7f1a81d9b640 1 --2- 172.21.15.2:0/1812632454 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a8c100a80 0x7f1a8c197270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:14.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.547+0000 7f1a81d9b640 1 -- 172.21.15.2:0/1812632454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a8c106a80 msgr2=0x7f1a8c19bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:14.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.547+0000 7f1a81d9b640 1 --2- 172.21.15.2:0/1812632454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a8c106a80 0x7f1a8c19bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:14.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.547+0000 7f1a81d9b640 1 -- 172.21.15.2:0/1812632454 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a8c19c220 con 0x7f1a8c101420 2024-09-19T04:52:14.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.547+0000 7f1a8a59c640 1 --2- 172.21.15.2:0/1812632454 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a8c100a80 0x7f1a8c197270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:52:14.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.547+0000 7f1a81d9b640 1 --2- 172.21.15.2:0/1812632454 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a8c101420 0x7f1a8c1977b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f1a74009f40 tx=0x7f1a7400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:14.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.547+0000 7f1a83fff640 1 -- 172.21.15.2:0/1812632454 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a7400cd80 con 0x7f1a8c101420 2024-09-19T04:52:14.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.547+0000 7f1a90ca3640 1 -- 172.21.15.2:0/1812632454 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a8c19c510 con 0x7f1a8c101420 2024-09-19T04:52:14.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.548+0000 7f1a83fff640 1 -- 172.21.15.2:0/1812632454 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1a740054d0 con 0x7f1a8c101420 2024-09-19T04:52:14.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.548+0000 7f1a83fff640 1 -- 172.21.15.2:0/1812632454 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a740115d0 con 0x7f1a8c101420 2024-09-19T04:52:14.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.548+0000 7f1a90ca3640 1 -- 172.21.15.2:0/1812632454 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a8c06a790 con 0x7f1a8c101420 2024-09-19T04:52:14.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.550+0000 7f1a83fff640 1 -- 172.21.15.2:0/1812632454 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f1a74005020 con 0x7f1a8c101420 2024-09-19T04:52:14.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.550+0000 7f1a9307c740 1 Processor -- start 2024-09-19T04:52:14.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.550+0000 7f1a9307c740 1 -- start start 2024-09-19T04:52:14.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.551+0000 7f1a9307c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560899ae2b40 0x560899ae1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:14.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.551+0000 7f1a9307c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560899ae15d0 0x560899ae1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:14.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.551+0000 7f1a9307c740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560899aec370 0x560899aee760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:14.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.551+0000 7f1a9307c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560899a472f0 con 0x560899ae15d0 2024-09-19T04:52:14.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.551+0000 7f1a9307c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5608999eecf0 con 0x560899ae2b40 2024-09-19T04:52:14.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.551+0000 7f1a9307c740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x560899a432b0 con 0x560899aec370 2024-09-19T04:52:14.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.551+0000 7f1a8a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560899ae15d0 0x560899ae1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:14.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.551+0000 7f1a8a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560899ae15d0 0x560899ae1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53984/0 (socket says 172.21.15.2:53984) 2024-09-19T04:52:14.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.551+0000 7f1a8a59c640 1 -- 172.21.15.2:0/4255368510 learned_addr learned my addr 172.21.15.2:0/4255368510 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:14.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.551+0000 7f1a8ad9d640 1 --2- 172.21.15.2:0/4255368510 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560899ae2b40 0x560899ae1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:14.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.551+0000 7f1a83fff640 1 --2- 172.21.15.2:0/1812632454 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f1a780a77c0 0x7f1a780a9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:14.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.551+0000 7f1a81d9b640 1 --2- 172.21.15.2:0/4255368510 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560899aec370 0x560899aee760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:14.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.551+0000 7f1a8a59c640 1 -- 172.21.15.2:0/4255368510 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560899aec370 msgr2=0x560899aee760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:14.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.551+0000 7f1a8ad9d640 1 --2- 172.21.15.2:0/1812632454 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f1a780a77c0 0x7f1a780a9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:14.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.551+0000 7f1a8a59c640 1 --2- 172.21.15.2:0/4255368510 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560899aec370 0x560899aee760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:14.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.551+0000 7f1a8a59c640 1 -- 172.21.15.2:0/4255368510 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560899ae2b40 msgr2=0x560899ae1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:14.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.551+0000 7f1a8a59c640 1 --2- 172.21.15.2:0/4255368510 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560899ae2b40 0x560899ae1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:14.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.551+0000 7f1a8a59c640 1 -- 172.21.15.2:0/4255368510 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608999d33a0 con 0x560899ae15d0 2024-09-19T04:52:14.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.551+0000 7f1a81d9b640 1 --2- 172.21.15.2:0/4255368510 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560899aec370 0x560899aee760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:52:14.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.551+0000 7f1a83fff640 1 -- 172.21.15.2:0/1812632454 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f1a740d1ef0 con 0x7f1a8c101420 2024-09-19T04:52:14.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.551+0000 7f1a8a59c640 1 --2- 172.21.15.2:0/4255368510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560899ae15d0 0x560899ae1a10 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c00bcc0 tx=0x7f1a7c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5d8794f36a93524 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:14.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.552+0000 7f1a80d99640 1 -- 172.21.15.2:0/4255368510 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c015070 con 0x560899ae15d0 2024-09-19T04:52:14.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.552+0000 7f1a8ad9d640 1 --2- 172.21.15.2:0/1812632454 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f1a780a77c0 0x7f1a780a9c80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1a84004af0 tx=0x7f1a8402a8e0 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:14.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.552+0000 7f1a80d99640 1 -- 172.21.15.2:0/4255368510 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1a7c01a910 con 0x560899ae15d0 2024-09-19T04:52:14.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.552+0000 7f1a80d99640 1 -- 172.21.15.2:0/4255368510 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c011990 con 0x560899ae15d0 2024-09-19T04:52:14.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.552+0000 7f1a9307c740 1 -- 172.21.15.2:0/4255368510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560899ae15d0 msgr2=0x560899ae1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:14.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.552+0000 7f1a9307c740 1 --2- 172.21.15.2:0/4255368510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560899ae15d0 0x560899ae1a10 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c00bcc0 tx=0x7f1a7c00f730 comp rx=0 tx=0).stop 2024-09-19T04:52:14.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.552+0000 7f1a9307c740 1 -- 172.21.15.2:0/4255368510 shutdown_connections 2024-09-19T04:52:14.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.552+0000 7f1a9307c740 1 --2- 172.21.15.2:0/4255368510 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560899aec370 0x560899aee760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:14.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.552+0000 7f1a9307c740 1 --2- 172.21.15.2:0/4255368510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560899ae15d0 0x560899ae1a10 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:14.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.552+0000 7f1a9307c740 1 --2- 172.21.15.2:0/4255368510 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560899ae2b40 0x560899ae1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:14.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.552+0000 7f1a9307c740 1 -- 172.21.15.2:0/4255368510 >> 172.21.15.2:0/4255368510 conn(0x560899aaa310 msgr2=0x560899addc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:14.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.553+0000 7f1a9307c740 1 -- 172.21.15.2:0/4255368510 shutdown_connections 2024-09-19T04:52:14.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.553+0000 7f1a9307c740 1 -- 172.21.15.2:0/4255368510 wait complete. 2024-09-19T04:52:14.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.553+0000 7f1a9307c740 1 -- start start 2024-09-19T04:52:14.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.553+0000 7f1a9307c740 1 Processor -- start 2024-09-19T04:52:14.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.553+0000 7f1a9307c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560899ae15d0 0x560899aebd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:14.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.553+0000 7f1a9307c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560899ae2b40 0x560899ae8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:14.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.553+0000 7f1a9307c740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560899aec370 0x560899ae95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:14.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.553+0000 7f1a9307c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560899aef070 con 0x560899ae15d0 2024-09-19T04:52:14.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.553+0000 7f1a9307c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560899a02060 con 0x560899ae2b40 2024-09-19T04:52:14.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.553+0000 7f1a9307c740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x560899aef1f0 con 0x560899aec370 2024-09-19T04:52:14.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.553+0000 7f1a9307c740 10 client.0 _ll_register_callbacks cb 0x5608997558c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:52:14.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.553+0000 7f1a8a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560899ae15d0 0x560899aebd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:14.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.553+0000 7f1a8a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560899ae15d0 0x560899aebd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53992/0 (socket says 172.21.15.2:53992) 2024-09-19T04:52:14.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.553+0000 7f1a8a59c640 1 -- 172.21.15.2:0/2077611662 learned_addr learned my addr 172.21.15.2:0/2077611662 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:14.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.553+0000 7f1a81d9b640 1 --2- 172.21.15.2:0/2077611662 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560899ae2b40 0x560899ae8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:14.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.554+0000 7f1a8ad9d640 1 --2- 172.21.15.2:0/2077611662 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560899aec370 0x560899ae95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:14.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.554+0000 7f1a8a59c640 1 -- 172.21.15.2:0/2077611662 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560899aec370 msgr2=0x560899ae95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:14.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.554+0000 7f1a8a59c640 1 --2- 172.21.15.2:0/2077611662 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560899aec370 0x560899ae95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:14.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.554+0000 7f1a8a59c640 1 -- 172.21.15.2:0/2077611662 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560899ae2b40 msgr2=0x560899ae8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:14.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.554+0000 7f1a8a59c640 1 --2- 172.21.15.2:0/2077611662 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560899ae2b40 0x560899ae8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:14.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.554+0000 7f1a8a59c640 1 -- 172.21.15.2:0/2077611662 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608997b83c0 con 0x560899ae15d0 2024-09-19T04:52:14.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.554+0000 7f1a81d9b640 1 --2- 172.21.15.2:0/2077611662 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560899ae2b40 0x560899ae8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:52:14.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.554+0000 7f1a8ad9d640 1 --2- 172.21.15.2:0/2077611662 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560899aec370 0x560899ae95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:52:14.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.554+0000 7f1a8a59c640 1 --2- 172.21.15.2:0/2077611662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560899ae15d0 0x560899aebd40 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c000c00 tx=0x7f1a7c011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78b1b2fc51f6b689 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:14.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.554+0000 7f1a71ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:52:14.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.554+0000 7f1a71ffb640 1 -- 172.21.15.2:0/2077611662 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c015070 con 0x560899ae15d0 2024-09-19T04:52:14.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.554+0000 7f1a71ffb640 1 -- 172.21.15.2:0/2077611662 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f1a7c01a460 con 0x560899ae15d0 2024-09-19T04:52:14.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.554+0000 7f1a9307c740 1 -- 172.21.15.2:0/2077611662 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a7c01a910 con 0x560899ae15d0 2024-09-19T04:52:14.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.554+0000 7f1a71ffb640 1 -- 172.21.15.2:0/2077611662 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1a7c01a660 con 0x560899ae15d0 2024-09-19T04:52:14.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.554+0000 7f1a9307c740 10 client.15828 fetch_fsmap learned FSMap version 19 2024-09-19T04:52:14.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.554+0000 7f1a9307c740 1 -- 172.21.15.2:0/2077611662 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x560899afaae0 con 0x560899ae15d0 2024-09-19T04:52:14.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.554+0000 7f1a71ffb640 1 -- 172.21.15.2:0/2077611662 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1a7c01a910 con 0x560899ae15d0 2024-09-19T04:52:14.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.555+0000 7f1a71ffb640 1 -- 172.21.15.2:0/2077611662 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f1a7c02b070 con 0x560899ae15d0 2024-09-19T04:52:14.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.555+0000 7f1a9307c740 10 client.15828 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:52:14.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.555+0000 7f1a9307c740 10 client.15828 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:52:14.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.555+0000 7f1a9307c740 20 client.15828 populate_metadata read hostname 'smithi002' 2024-09-19T04:52:14.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.555+0000 7f1a9307c740 1 --2- 172.21.15.2:0/2077611662 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560899afbf40 0x560899afe330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:14.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.555+0000 7f1a9307c740 4 client.15828 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:52:14.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.555+0000 7f1a9307c740 1 -- 172.21.15.2:0/2077611662 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560899a54860 con 0x560899afbf40 2024-09-19T04:52:14.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.555+0000 7f1a81d9b640 1 --2- 172.21.15.2:0/2077611662 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560899afbf40 0x560899afe330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:14.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.555+0000 7f1a71ffb640 10 client.15828 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:52:14.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.555+0000 7f1a81d9b640 1 --2- 172.21.15.2:0/2077611662 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560899afbf40 0x560899afe330 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e555ca253143ed4 server_cookie=fa6c9fae792046f3 in_seq=0 out_seq=0 2024-09-19T04:52:14.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.556+0000 7f1a71ffb640 1 -- 172.21.15.2:0/2077611662 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560899a54860 con 0x560899afbf40 2024-09-19T04:52:14.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.556+0000 7f1a71ffb640 10 client.15828 handle_command_reply: tid=0 2024-09-19T04:52:14.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.556+0000 7f1a9307c740 1 client.15828 shutdown 2024-09-19T04:52:14.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.556+0000 7f1a9307c740 1 -- 172.21.15.2:0/2077611662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560899ae15d0 msgr2=0x560899aebd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:14.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.556+0000 7f1a9307c740 1 --2- 172.21.15.2:0/2077611662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560899ae15d0 0x560899aebd40 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c000c00 tx=0x7f1a7c011440 comp rx=0 tx=0).stop 2024-09-19T04:52:14.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.556+0000 7f1a9307c740 1 -- 172.21.15.2:0/2077611662 shutdown_connections 2024-09-19T04:52:14.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.556+0000 7f1a9307c740 1 --2- 172.21.15.2:0/2077611662 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560899afbf40 0x560899afe330 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:14.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.556+0000 7f1a9307c740 1 --2- 172.21.15.2:0/2077611662 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560899aec370 0x560899ae95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:14.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.556+0000 7f1a9307c740 1 --2- 172.21.15.2:0/2077611662 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560899ae2b40 0x560899ae8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:14.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.556+0000 7f1a71ffb640 0 client.15828 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:52:14.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.556+0000 7f1a9307c740 1 --2- 172.21.15.2:0/2077611662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560899ae15d0 0x560899aebd40 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:14.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.556+0000 7f1a9307c740 1 -- 172.21.15.2:0/2077611662 >> 172.21.15.2:0/2077611662 conn(0x560899aaa310 msgr2=0x560899ae3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:14.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.556+0000 7f1a9307c740 1 -- 172.21.15.2:0/2077611662 shutdown_connections 2024-09-19T04:52:14.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.556+0000 7f1a9307c740 1 -- 172.21.15.2:0/2077611662 wait complete. 2024-09-19T04:52:14.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.556+0000 7f1a9307c740 20 client.15828 trim_cache size 0 max 16384 2024-09-19T04:52:14.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.570+0000 7f1a9307c740 1 Processor -- start 2024-09-19T04:52:14.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.570+0000 7f1a9307c740 1 -- start start 2024-09-19T04:52:14.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.570+0000 7f1a9307c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560899ae15d0 0x560899af8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:14.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.570+0000 7f1a9307c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560899ae2b40 0x560899ae4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:14.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.570+0000 7f1a9307c740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560899aec370 0x560899ae4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:14.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.570+0000 7f1a9307c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1a8c1a9470 con 0x560899ae15d0 2024-09-19T04:52:14.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.570+0000 7f1a9307c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1a8c1abcf0 con 0x560899ae2b40 2024-09-19T04:52:14.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.570+0000 7f1a9307c740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f1a8c1a9ae0 con 0x560899aec370 2024-09-19T04:52:14.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.571+0000 7f1a8a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560899ae15d0 0x560899af8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:14.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.571+0000 7f1a8a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560899ae15d0 0x560899af8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54006/0 (socket says 172.21.15.2:54006) 2024-09-19T04:52:14.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.571+0000 7f1a8a59c640 1 -- 172.21.15.2:0/3972146412 learned_addr learned my addr 172.21.15.2:0/3972146412 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:14.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.571+0000 7f1a81d9b640 1 --2- 172.21.15.2:0/3972146412 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560899ae2b40 0x560899ae4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:14.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.571+0000 7f1a8ad9d640 1 --2- 172.21.15.2:0/3972146412 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560899aec370 0x560899ae4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:14.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.571+0000 7f1a8a59c640 1 -- 172.21.15.2:0/3972146412 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560899aec370 msgr2=0x560899ae4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:14.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.571+0000 7f1a8a59c640 1 --2- 172.21.15.2:0/3972146412 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560899aec370 0x560899ae4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:14.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.571+0000 7f1a8a59c640 1 -- 172.21.15.2:0/3972146412 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560899ae2b40 msgr2=0x560899ae4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:14.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.571+0000 7f1a8a59c640 1 --2- 172.21.15.2:0/3972146412 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560899ae2b40 0x560899ae4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:14.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.571+0000 7f1a8a59c640 1 -- 172.21.15.2:0/3972146412 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560899ae9be0 con 0x560899ae15d0 2024-09-19T04:52:14.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.571+0000 7f1a81d9b640 1 --2- 172.21.15.2:0/3972146412 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560899ae2b40 0x560899ae4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:52:14.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.571+0000 7f1a8a59c640 1 --2- 172.21.15.2:0/3972146412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560899ae15d0 0x560899af8310 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c005bc0 tx=0x7f1a7c00b560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4da852fd1520ca63 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:14.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.571+0000 7f1a73fff640 1 -- 172.21.15.2:0/3972146412 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c031070 con 0x560899ae15d0 2024-09-19T04:52:14.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.571+0000 7f1a73fff640 1 -- 172.21.15.2:0/3972146412 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1a7c01a460 con 0x560899ae15d0 2024-09-19T04:52:14.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.571+0000 7f1a73fff640 1 -- 172.21.15.2:0/3972146412 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c015040 con 0x560899ae15d0 2024-09-19T04:52:14.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.572+0000 7f1a9307c740 1 -- 172.21.15.2:0/3972146412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560899ae15d0 msgr2=0x560899af8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:14.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.572+0000 7f1a9307c740 1 --2- 172.21.15.2:0/3972146412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560899ae15d0 0x560899af8310 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c005bc0 tx=0x7f1a7c00b560 comp rx=0 tx=0).stop 2024-09-19T04:52:14.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.572+0000 7f1a9307c740 1 -- 172.21.15.2:0/3972146412 shutdown_connections 2024-09-19T04:52:14.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.572+0000 7f1a9307c740 1 --2- 172.21.15.2:0/3972146412 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560899aec370 0x560899ae4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:14.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.572+0000 7f1a9307c740 1 --2- 172.21.15.2:0/3972146412 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560899ae2b40 0x560899ae4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:14.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.572+0000 7f1a9307c740 1 --2- 172.21.15.2:0/3972146412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560899ae15d0 0x560899af8310 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:14.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.572+0000 7f1a9307c740 1 -- 172.21.15.2:0/3972146412 >> 172.21.15.2:0/3972146412 conn(0x560899aaa310 msgr2=0x560899aeb070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:14.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.572+0000 7f1a9307c740 1 -- 172.21.15.2:0/3972146412 shutdown_connections 2024-09-19T04:52:14.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.572+0000 7f1a9307c740 1 -- 172.21.15.2:0/3972146412 wait complete. 2024-09-19T04:52:14.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.572+0000 7f1a9307c740 1 -- start start 2024-09-19T04:52:14.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.573+0000 7f1a9307c740 1 Processor -- start 2024-09-19T04:52:14.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.573+0000 7f1a9307c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560899ae15d0 0x560899af4a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:14.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.573+0000 7f1a9307c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560899ae2b40 0x560899ae5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:14.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.573+0000 7f1a9307c740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560899aec370 0x560899ae60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:14.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.573+0000 7f1a9307c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1a8c1aa1b0 con 0x560899ae15d0 2024-09-19T04:52:14.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.573+0000 7f1a9307c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1a8c1ab620 con 0x560899ae2b40 2024-09-19T04:52:14.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.573+0000 7f1a9307c740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f1a8c1aa880 con 0x560899aec370 2024-09-19T04:52:14.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.573+0000 7f1a9307c740 10 client.0 _ll_register_callbacks cb 0x7f1a7c01af50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:52:14.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.573+0000 7f1a8a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560899ae15d0 0x560899af4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:14.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.573+0000 7f1a8a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560899ae15d0 0x560899af4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54010/0 (socket says 172.21.15.2:54010) 2024-09-19T04:52:14.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.573+0000 7f1a8a59c640 1 -- 172.21.15.2:0/4153006935 learned_addr learned my addr 172.21.15.2:0/4153006935 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:14.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.573+0000 7f1a8ad9d640 1 --2- 172.21.15.2:0/4153006935 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560899aec370 0x560899ae60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:14.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.573+0000 7f1a81d9b640 1 --2- 172.21.15.2:0/4153006935 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560899ae2b40 0x560899ae5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:14.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.573+0000 7f1a8a59c640 1 -- 172.21.15.2:0/4153006935 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560899aec370 msgr2=0x560899ae60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:14.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.573+0000 7f1a8a59c640 1 --2- 172.21.15.2:0/4153006935 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560899aec370 0x560899ae60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:14.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.573+0000 7f1a8a59c640 1 -- 172.21.15.2:0/4153006935 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560899ae2b40 msgr2=0x560899ae5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:14.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.573+0000 7f1a8a59c640 1 --2- 172.21.15.2:0/4153006935 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560899ae2b40 0x560899ae5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:14.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.573+0000 7f1a8a59c640 1 -- 172.21.15.2:0/4153006935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560899ae6760 con 0x560899ae15d0 2024-09-19T04:52:14.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.573+0000 7f1a8ad9d640 1 --2- 172.21.15.2:0/4153006935 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560899aec370 0x560899ae60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:52:14.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.574+0000 7f1a8a59c640 1 --2- 172.21.15.2:0/4153006935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560899ae15d0 0x560899af4a30 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c005550 tx=0x7f1a7c011570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2928f7fe5cbf9896 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:14.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.574+0000 7f1a71ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:52:14.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.574+0000 7f1a71ffb640 1 -- 172.21.15.2:0/4153006935 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c03a070 con 0x560899ae15d0 2024-09-19T04:52:14.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.574+0000 7f1a71ffb640 1 -- 172.21.15.2:0/4153006935 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f1a7c01a800 con 0x560899ae15d0 2024-09-19T04:52:14.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.574+0000 7f1a9307c740 1 -- 172.21.15.2:0/4153006935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a7c01a460 con 0x560899ae15d0 2024-09-19T04:52:14.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.574+0000 7f1a71ffb640 1 -- 172.21.15.2:0/4153006935 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1a7c046050 con 0x560899ae15d0 2024-09-19T04:52:14.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.574+0000 7f1a9307c740 10 client.15834 fetch_fsmap learned FSMap version 19 2024-09-19T04:52:14.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.574+0000 7f1a9307c740 1 -- 172.21.15.2:0/4153006935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x560899b668b0 con 0x560899ae15d0 2024-09-19T04:52:14.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.574+0000 7f1a71ffb640 1 -- 172.21.15.2:0/4153006935 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1a7c01a460 con 0x560899ae15d0 2024-09-19T04:52:14.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.574+0000 7f1a71ffb640 1 -- 172.21.15.2:0/4153006935 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f1a7c02b040 con 0x560899ae15d0 2024-09-19T04:52:14.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.574+0000 7f1a9307c740 10 client.15834 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:52:14.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.574+0000 7f1a9307c740 10 client.15834 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:52:14.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.574+0000 7f1a9307c740 20 client.15834 populate_metadata read hostname 'smithi002' 2024-09-19T04:52:14.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.574+0000 7f1a9307c740 1 --2- 172.21.15.2:0/4153006935 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560899b66ef0 0x560899b69310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:14.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.574+0000 7f1a9307c740 4 client.15834 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:52:14.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.574+0000 7f1a9307c740 1 -- 172.21.15.2:0/4153006935 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560899a4ed70 con 0x560899b66ef0 2024-09-19T04:52:14.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.575+0000 7f1a81d9b640 1 --2- 172.21.15.2:0/4153006935 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560899b66ef0 0x560899b69310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:14.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.575+0000 7f1a71ffb640 10 client.15834 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:52:14.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.575+0000 7f1a81d9b640 1 --2- 172.21.15.2:0/4153006935 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560899b66ef0 0x560899b69310 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=627da4cac3a6ef4e server_cookie=7831bed7b30b75f9 in_seq=0 out_seq=0 2024-09-19T04:52:14.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.575+0000 7f1a71ffb640 1 -- 172.21.15.2:0/4153006935 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560899a4ed70 con 0x560899b66ef0 2024-09-19T04:52:14.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.575+0000 7f1a71ffb640 10 client.15834 handle_command_reply: tid=0 2024-09-19T04:52:14.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.576+0000 7f1a9307c740 1 client.15834 shutdown 2024-09-19T04:52:14.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.576+0000 7f1a9307c740 1 -- 172.21.15.2:0/4153006935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560899ae15d0 msgr2=0x560899af4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:14.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.576+0000 7f1a9307c740 1 --2- 172.21.15.2:0/4153006935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560899ae15d0 0x560899af4a30 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c005550 tx=0x7f1a7c011570 comp rx=0 tx=0).stop 2024-09-19T04:52:14.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.576+0000 7f1a9307c740 1 -- 172.21.15.2:0/4153006935 shutdown_connections 2024-09-19T04:52:14.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.576+0000 7f1a9307c740 1 --2- 172.21.15.2:0/4153006935 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560899b66ef0 0x560899b69310 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:14.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.576+0000 7f1a9307c740 1 --2- 172.21.15.2:0/4153006935 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560899aec370 0x560899ae60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:14.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.576+0000 7f1a9307c740 1 --2- 172.21.15.2:0/4153006935 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560899ae2b40 0x560899ae5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:14.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.576+0000 7f1a9307c740 1 --2- 172.21.15.2:0/4153006935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560899ae15d0 0x560899af4a30 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:14.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.576+0000 7f1a9307c740 1 -- 172.21.15.2:0/4153006935 >> 172.21.15.2:0/4153006935 conn(0x560899aaa310 msgr2=0x560899adc4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:14.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.576+0000 7f1a71ffb640 0 client.15834 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:52:14.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.576+0000 7f1a9307c740 1 -- 172.21.15.2:0/4153006935 shutdown_connections 2024-09-19T04:52:14.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.576+0000 7f1a9307c740 1 -- 172.21.15.2:0/4153006935 wait complete. 2024-09-19T04:52:14.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.576+0000 7f1a9307c740 20 client.15834 trim_cache size 0 max 16384 2024-09-19T04:52:14.587 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T04:52:14.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.576+0000 7f1a90ca3640 1 -- 172.21.15.2:0/1812632454 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f1a780a77c0 msgr2=0x7f1a780a9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:14.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.576+0000 7f1a90ca3640 1 --2- 172.21.15.2:0/1812632454 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f1a780a77c0 0x7f1a780a9c80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1a84004af0 tx=0x7f1a8402a8e0 comp rx=0 tx=0).stop 2024-09-19T04:52:14.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.576+0000 7f1a90ca3640 1 -- 172.21.15.2:0/1812632454 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a8c101420 msgr2=0x7f1a8c1977b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:14.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.576+0000 7f1a90ca3640 1 --2- 172.21.15.2:0/1812632454 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a8c101420 0x7f1a8c1977b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f1a74009f40 tx=0x7f1a7400ee80 comp rx=0 tx=0).stop 2024-09-19T04:52:14.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.576+0000 7f1a90ca3640 1 -- 172.21.15.2:0/1812632454 shutdown_connections 2024-09-19T04:52:14.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.577+0000 7f1a90ca3640 1 --2- 172.21.15.2:0/1812632454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a8c106a80 0x7f1a8c19bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:14.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.577+0000 7f1a90ca3640 1 --2- 172.21.15.2:0/1812632454 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a8c101420 0x7f1a8c1977b0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:14.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.577+0000 7f1a90ca3640 1 --2- 172.21.15.2:0/1812632454 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f1a780a77c0 0x7f1a780a9c80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:14.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.577+0000 7f1a90ca3640 1 --2- 172.21.15.2:0/1812632454 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a8c100a80 0x7f1a8c197270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:14.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.577+0000 7f1a90ca3640 1 -- 172.21.15.2:0/1812632454 >> 172.21.15.2:0/1812632454 conn(0x7f1a8c0fc7a0 msgr2=0x7f1a8c0fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:14.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.577+0000 7f1a90ca3640 1 -- 172.21.15.2:0/1812632454 shutdown_connections 2024-09-19T04:52:14.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:14.577+0000 7f1a90ca3640 1 -- 172.21.15.2:0/1812632454 wait complete. 2024-09-19T04:52:15.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:15 smithi018 ceph-mon[34537]: pgmap v130: 97 pgs: 97 active+clean; 4.8 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 49 KiB/s wr, 22 op/s 2024-09-19T04:52:15.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:15 smithi002 ceph-mon[30975]: pgmap v130: 97 pgs: 97 active+clean; 4.8 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 49 KiB/s wr, 22 op/s 2024-09-19T04:52:15.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:15 smithi116 ceph-mon[34477]: pgmap v130: 97 pgs: 97 active+clean; 4.8 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 49 KiB/s wr, 22 op/s 2024-09-19T04:52:16.404 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:52:16.405 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:52:16.677 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:52:17.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:17 smithi002 ceph-mon[30975]: pgmap v131: 97 pgs: 97 active+clean; 4.9 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 63 KiB/s wr, 26 op/s 2024-09-19T04:52:17.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.123+0000 7f151027f640 1 -- 172.21.15.2:0/2162002118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15081082a0 msgr2=0x7f150810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:17.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.123+0000 7f151027f640 1 --2- 172.21.15.2:0/2162002118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15081082a0 0x7f150810ec40 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f1500009cd0 tx=0x7f150002a8e0 comp rx=0 tx=0).stop 2024-09-19T04:52:17.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.123+0000 7f151027f640 1 -- 172.21.15.2:0/2162002118 shutdown_connections 2024-09-19T04:52:17.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.123+0000 7f151027f640 1 --2- 172.21.15.2:0/2162002118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15081082a0 0x7f150810ec40 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:17.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.123+0000 7f151027f640 1 --2- 172.21.15.2:0/2162002118 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f15081036e0 0x7f1508107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:17.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.123+0000 7f151027f640 1 --2- 172.21.15.2:0/2162002118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1508102d30 0x7f1508103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:17.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.123+0000 7f151027f640 1 -- 172.21.15.2:0/2162002118 >> 172.21.15.2:0/2162002118 conn(0x7f15080fc7d0 msgr2=0x7f15080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:17.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.123+0000 7f151027f640 1 -- 172.21.15.2:0/2162002118 shutdown_connections 2024-09-19T04:52:17.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.123+0000 7f151027f640 1 -- 172.21.15.2:0/2162002118 wait complete. 2024-09-19T04:52:17.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.123+0000 7f151027f640 1 Processor -- start 2024-09-19T04:52:17.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.123+0000 7f151027f640 1 -- start start 2024-09-19T04:52:17.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.124+0000 7f151027f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1508102d30 0x7f15081984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:17.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.124+0000 7f151027f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15081036e0 0x7f15081989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:17.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.124+0000 7f151027f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15081082a0 0x7f150819cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:17.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.124+0000 7f151027f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1508111f50 con 0x7f15081036e0 2024-09-19T04:52:17.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.124+0000 7f151027f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1508111dd0 con 0x7f15081082a0 2024-09-19T04:52:17.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.124+0000 7f151027f640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f15081120d0 con 0x7f1508102d30 2024-09-19T04:52:17.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.124+0000 7f150d81a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15081036e0 0x7f15081989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:17.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.124+0000 7f150d81a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15081036e0 0x7f15081989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54034/0 (socket says 172.21.15.2:54034) 2024-09-19T04:52:17.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.124+0000 7f150d81a640 1 -- 172.21.15.2:0/3583070007 learned_addr learned my addr 172.21.15.2:0/3583070007 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:17.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.124+0000 7f150e01b640 1 --2- 172.21.15.2:0/3583070007 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1508102d30 0x7f15081984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:17.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.124+0000 7f150d81a640 1 -- 172.21.15.2:0/3583070007 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1508102d30 msgr2=0x7f15081984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:17.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.124+0000 7f150d81a640 1 --2- 172.21.15.2:0/3583070007 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1508102d30 0x7f15081984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:17.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.124+0000 7f150e81c640 1 --2- 172.21.15.2:0/3583070007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15081082a0 0x7f150819cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:17.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.124+0000 7f150d81a640 1 -- 172.21.15.2:0/3583070007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15081082a0 msgr2=0x7f150819cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:17.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.124+0000 7f150d81a640 1 --2- 172.21.15.2:0/3583070007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15081082a0 0x7f150819cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:17.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.124+0000 7f150d81a640 1 -- 172.21.15.2:0/3583070007 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f150819d460 con 0x7f15081036e0 2024-09-19T04:52:17.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.124+0000 7f150e81c640 1 --2- 172.21.15.2:0/3583070007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15081082a0 0x7f150819cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:52:17.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.124+0000 7f150d81a640 1 --2- 172.21.15.2:0/3583070007 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15081036e0 0x7f15081989f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f14f800d750 tx=0x7f14f800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:17.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.124+0000 7f14ff7fe640 1 -- 172.21.15.2:0/3583070007 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f8017070 con 0x7f15081036e0 2024-09-19T04:52:17.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.124+0000 7f14ff7fe640 1 -- 172.21.15.2:0/3583070007 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f14f80054d0 con 0x7f15081036e0 2024-09-19T04:52:17.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.124+0000 7f151027f640 1 -- 172.21.15.2:0/3583070007 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f150819d750 con 0x7f15081036e0 2024-09-19T04:52:17.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.125+0000 7f14ff7fe640 1 -- 172.21.15.2:0/3583070007 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f8004cf0 con 0x7f15081036e0 2024-09-19T04:52:17.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.125+0000 7f151027f640 1 -- 172.21.15.2:0/3583070007 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15081a5030 con 0x7f15081036e0 2024-09-19T04:52:17.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.128+0000 7f14ff7fe640 1 -- 172.21.15.2:0/3583070007 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f14f8004e90 con 0x7f15081036e0 2024-09-19T04:52:17.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.128+0000 7f1512658740 1 Processor -- start 2024-09-19T04:52:17.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.128+0000 7f1512658740 1 -- start start 2024-09-19T04:52:17.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.128+0000 7f1512658740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c91a927a20 0x55c91a927e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:17.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.128+0000 7f1512658740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91a928340 0x55c91a936c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:17.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.128+0000 7f1512658740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91a937150 0x55c91a939540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:17.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.128+0000 7f1512658740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c91a88d280 con 0x55c91a928340 2024-09-19T04:52:17.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.128+0000 7f1512658740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c91a834b10 con 0x55c91a937150 2024-09-19T04:52:17.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.128+0000 7f1512658740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55c91a889240 con 0x55c91a927a20 2024-09-19T04:52:17.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.128+0000 7f150e01b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91a928340 0x55c91a936c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:17.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.128+0000 7f150e01b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91a928340 0x55c91a936c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54044/0 (socket says 172.21.15.2:54044) 2024-09-19T04:52:17.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.128+0000 7f150e01b640 1 -- 172.21.15.2:0/2083125899 learned_addr learned my addr 172.21.15.2:0/2083125899 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:17.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.128+0000 7f150e81c640 1 --2- 172.21.15.2:0/2083125899 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c91a927a20 0x55c91a927e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:17.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.128+0000 7f150e01b640 1 -- 172.21.15.2:0/2083125899 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c91a927a20 msgr2=0x55c91a927e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:17.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.128+0000 7f150e01b640 1 --2- 172.21.15.2:0/2083125899 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c91a927a20 0x55c91a927e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:17.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.128+0000 7f150e01b640 1 -- 172.21.15.2:0/2083125899 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91a937150 msgr2=0x55c91a939540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:17.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.128+0000 7f150e01b640 1 --2- 172.21.15.2:0/2083125899 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91a937150 0x55c91a939540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:17.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.128+0000 7f14ff7fe640 1 --2- 172.21.15.2:0/3583070007 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f14f40a3430 0x7f14f40a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:17.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.128+0000 7f150e01b640 1 -- 172.21.15.2:0/2083125899 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c91a8411f0 con 0x55c91a928340 2024-09-19T04:52:17.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.129+0000 7f150e81c640 1 --2- 172.21.15.2:0/2083125899 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c91a927a20 0x55c91a927e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:52:17.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.129+0000 7f14ff7fe640 1 -- 172.21.15.2:0/3583070007 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f14f80cf5b0 con 0x7f15081036e0 2024-09-19T04:52:17.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.129+0000 7f150e81c640 1 --2- 172.21.15.2:0/3583070007 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f14f40a3430 0x7f14f40a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:17.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.129+0000 7f150e01b640 1 --2- 172.21.15.2:0/2083125899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91a928340 0x55c91a936c10 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f1504009cf0 tx=0x7f1504011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=904e2819b51f036f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:17.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.129+0000 7f14fcdea640 1 -- 172.21.15.2:0/2083125899 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1504004230 con 0x55c91a928340 2024-09-19T04:52:17.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.129+0000 7f14fcdea640 1 -- 172.21.15.2:0/2083125899 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f15040043d0 con 0x55c91a928340 2024-09-19T04:52:17.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.129+0000 7f14fcdea640 1 -- 172.21.15.2:0/2083125899 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15040197e0 con 0x55c91a928340 2024-09-19T04:52:17.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.130+0000 7f1512658740 1 -- 172.21.15.2:0/2083125899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91a928340 msgr2=0x55c91a936c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:17.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.130+0000 7f1512658740 1 --2- 172.21.15.2:0/2083125899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91a928340 0x55c91a936c10 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f1504009cf0 tx=0x7f1504011810 comp rx=0 tx=0).stop 2024-09-19T04:52:17.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.130+0000 7f150e81c640 1 --2- 172.21.15.2:0/3583070007 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f14f40a3430 0x7f14f40a58f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1500009a60 tx=0x7f1500005f80 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:17.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.130+0000 7f1512658740 1 -- 172.21.15.2:0/2083125899 shutdown_connections 2024-09-19T04:52:17.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.130+0000 7f1512658740 1 --2- 172.21.15.2:0/2083125899 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91a937150 0x55c91a939540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:17.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.130+0000 7f1512658740 1 --2- 172.21.15.2:0/2083125899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91a928340 0x55c91a936c10 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:17.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.130+0000 7f1512658740 1 --2- 172.21.15.2:0/2083125899 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c91a927a20 0x55c91a927e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:17.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.130+0000 7f1512658740 1 -- 172.21.15.2:0/2083125899 >> 172.21.15.2:0/2083125899 conn(0x55c91a9240f0 msgr2=0x55c91a9244d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:17.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.130+0000 7f1512658740 1 -- 172.21.15.2:0/2083125899 shutdown_connections 2024-09-19T04:52:17.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.130+0000 7f1512658740 1 -- 172.21.15.2:0/2083125899 wait complete. 2024-09-19T04:52:17.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.130+0000 7f1512658740 1 -- start start 2024-09-19T04:52:17.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.130+0000 7f1512658740 1 Processor -- start 2024-09-19T04:52:17.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.131+0000 7f1512658740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91a927a20 0x55c91a9340e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:17.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.131+0000 7f1512658740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c91a928340 0x55c91a934620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:17.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.131+0000 7f1512658740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91a937150 0x55c91a934b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:17.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.131+0000 7f1512658740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c91a939d20 con 0x55c91a937150 2024-09-19T04:52:17.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.131+0000 7f1512658740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c91a847f10 con 0x55c91a927a20 2024-09-19T04:52:17.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.131+0000 7f1512658740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55c91a939ea0 con 0x55c91a928340 2024-09-19T04:52:17.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.131+0000 7f1512658740 10 client.0 _ll_register_callbacks cb 0x55c91a810a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:52:17.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.131+0000 7f150e81c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91a937150 0x55c91a934b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:17.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.131+0000 7f150e81c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91a937150 0x55c91a934b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54046/0 (socket says 172.21.15.2:54046) 2024-09-19T04:52:17.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.131+0000 7f150e81c640 1 -- 172.21.15.2:0/1091434372 learned_addr learned my addr 172.21.15.2:0/1091434372 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:17.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.131+0000 7f150e01b640 1 --2- 172.21.15.2:0/1091434372 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91a927a20 0x55c91a9340e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:17.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.131+0000 7f150d81a640 1 --2- 172.21.15.2:0/1091434372 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c91a928340 0x55c91a934620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:17.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.131+0000 7f150e81c640 1 -- 172.21.15.2:0/1091434372 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c91a928340 msgr2=0x55c91a934620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:17.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.131+0000 7f150e81c640 1 --2- 172.21.15.2:0/1091434372 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c91a928340 0x55c91a934620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:17.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.131+0000 7f150e81c640 1 -- 172.21.15.2:0/1091434372 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91a927a20 msgr2=0x55c91a9340e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:17.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.131+0000 7f150e81c640 1 --2- 172.21.15.2:0/1091434372 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91a927a20 0x55c91a9340e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:17.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.131+0000 7f150e81c640 1 -- 172.21.15.2:0/1091434372 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c91a5fe6a0 con 0x55c91a937150 2024-09-19T04:52:17.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.131+0000 7f150e81c640 1 --2- 172.21.15.2:0/1091434372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91a937150 0x55c91a934b60 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f15000099c0 tx=0x7f15000095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c79cb2f6e2f5f46 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:17.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.131+0000 7f14f1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:52:17.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.131+0000 7f14f1ffb640 1 -- 172.21.15.2:0/1091434372 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150004b070 con 0x55c91a937150 2024-09-19T04:52:17.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.131+0000 7f14f1ffb640 1 -- 172.21.15.2:0/1091434372 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f15000047d0 con 0x55c91a937150 2024-09-19T04:52:17.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.131+0000 7f1512658740 1 -- 172.21.15.2:0/1091434372 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15040043d0 con 0x55c91a937150 2024-09-19T04:52:17.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.132+0000 7f14f1ffb640 1 -- 172.21.15.2:0/1091434372 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f15000305a0 con 0x55c91a937150 2024-09-19T04:52:17.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.132+0000 7f1512658740 10 client.15846 fetch_fsmap learned FSMap version 19 2024-09-19T04:52:17.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.132+0000 7f1512658740 1 -- 172.21.15.2:0/1091434372 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55c91a945a60 con 0x55c91a937150 2024-09-19T04:52:17.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.132+0000 7f14f1ffb640 1 -- 172.21.15.2:0/1091434372 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f15040043d0 con 0x55c91a937150 2024-09-19T04:52:17.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.132+0000 7f14f1ffb640 1 -- 172.21.15.2:0/1091434372 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f1500030070 con 0x55c91a937150 2024-09-19T04:52:17.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.132+0000 7f1512658740 10 client.15846 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:52:17.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.132+0000 7f1512658740 10 client.15846 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:52:17.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.132+0000 7f1512658740 20 client.15846 populate_metadata read hostname 'smithi002' 2024-09-19T04:52:17.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.132+0000 7f1512658740 1 --2- 172.21.15.2:0/1091434372 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55c91a946f20 0x55c91a949310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:17.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.132+0000 7f1512658740 4 client.15846 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:52:17.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.132+0000 7f1512658740 1 -- 172.21.15.2:0/1091434372 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c91a89a7f0 con 0x55c91a946f20 2024-09-19T04:52:17.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.132+0000 7f150e01b640 1 --2- 172.21.15.2:0/1091434372 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55c91a946f20 0x55c91a949310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:17.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.133+0000 7f150e01b640 1 --2- 172.21.15.2:0/1091434372 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55c91a946f20 0x55c91a949310 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6edc8bce674ccf27 server_cookie=c768ddc24dcdbd1c in_seq=0 out_seq=0 2024-09-19T04:52:17.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.133+0000 7f14f1ffb640 10 client.15846 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:52:17.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.133+0000 7f14f1ffb640 1 -- 172.21.15.2:0/1091434372 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c91a89a7f0 con 0x55c91a946f20 2024-09-19T04:52:17.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.133+0000 7f14f1ffb640 10 client.15846 handle_command_reply: tid=0 2024-09-19T04:52:17.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.134+0000 7f1512658740 1 client.15846 shutdown 2024-09-19T04:52:17.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.134+0000 7f1512658740 1 -- 172.21.15.2:0/1091434372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91a937150 msgr2=0x55c91a934b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:17.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.134+0000 7f1512658740 1 --2- 172.21.15.2:0/1091434372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91a937150 0x55c91a934b60 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f15000099c0 tx=0x7f15000095c0 comp rx=0 tx=0).stop 2024-09-19T04:52:17.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.134+0000 7f1512658740 1 -- 172.21.15.2:0/1091434372 shutdown_connections 2024-09-19T04:52:17.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.134+0000 7f1512658740 1 --2- 172.21.15.2:0/1091434372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91a937150 0x55c91a934b60 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:17.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.134+0000 7f1512658740 1 --2- 172.21.15.2:0/1091434372 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55c91a946f20 0x55c91a949310 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:17.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.134+0000 7f1512658740 1 --2- 172.21.15.2:0/1091434372 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c91a928340 0x55c91a934620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:17.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.134+0000 7f1512658740 1 --2- 172.21.15.2:0/1091434372 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91a927a20 0x55c91a9340e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:17.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.134+0000 7f14f1ffb640 0 client.15846 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:52:17.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.134+0000 7f1512658740 1 -- 172.21.15.2:0/1091434372 >> 172.21.15.2:0/1091434372 conn(0x55c91a9240f0 msgr2=0x55c91a929e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:17.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.134+0000 7f1512658740 1 -- 172.21.15.2:0/1091434372 shutdown_connections 2024-09-19T04:52:17.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.134+0000 7f1512658740 1 -- 172.21.15.2:0/1091434372 wait complete. 2024-09-19T04:52:17.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.134+0000 7f1512658740 20 client.15846 trim_cache size 0 max 16384 2024-09-19T04:52:17.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.151+0000 7f1512658740 1 Processor -- start 2024-09-19T04:52:17.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.151+0000 7f1512658740 1 -- start start 2024-09-19T04:52:17.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.152+0000 7f1512658740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91a927a20 0x55c91a94ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:17.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.152+0000 7f1512658740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c91a928340 0x55c91a94f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:17.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.152+0000 7f1512658740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91a937150 0x55c91a931340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:17.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.152+0000 7f1512658740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f15081a94d0 con 0x55c91a927a20 2024-09-19T04:52:17.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.152+0000 7f1512658740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f15081abd30 con 0x55c91a937150 2024-09-19T04:52:17.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.152+0000 7f1512658740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f15081a9b20 con 0x55c91a928340 2024-09-19T04:52:17.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.152+0000 7f150e01b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91a927a20 0x55c91a94ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:17.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.152+0000 7f150e01b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91a927a20 0x55c91a94ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54052/0 (socket says 172.21.15.2:54052) 2024-09-19T04:52:17.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.152+0000 7f150e01b640 1 -- 172.21.15.2:0/1714944175 learned_addr learned my addr 172.21.15.2:0/1714944175 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:17.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.152+0000 7f150d81a640 1 --2- 172.21.15.2:0/1714944175 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c91a928340 0x55c91a94f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:17.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.152+0000 7f150e01b640 1 -- 172.21.15.2:0/1714944175 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c91a928340 msgr2=0x55c91a94f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:17.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.152+0000 7f150e01b640 1 --2- 172.21.15.2:0/1714944175 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c91a928340 0x55c91a94f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:17.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.152+0000 7f150e01b640 1 -- 172.21.15.2:0/1714944175 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91a937150 msgr2=0x55c91a931340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:17.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.152+0000 7f150e01b640 1 --2- 172.21.15.2:0/1714944175 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91a937150 0x55c91a931340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:17.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.152+0000 7f150e01b640 1 -- 172.21.15.2:0/1714944175 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c91a928170 con 0x55c91a927a20 2024-09-19T04:52:17.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.152+0000 7f150e01b640 1 --2- 172.21.15.2:0/1714944175 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91a927a20 0x55c91a94ebc0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f15040099b0 tx=0x7f1504011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12f49f8828590a68 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:17.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.152+0000 7f14f3fff640 1 -- 172.21.15.2:0/1714944175 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1504003b30 con 0x55c91a927a20 2024-09-19T04:52:17.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.153+0000 7f14f3fff640 1 -- 172.21.15.2:0/1714944175 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f15040054f0 con 0x55c91a927a20 2024-09-19T04:52:17.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.153+0000 7f14f3fff640 1 -- 172.21.15.2:0/1714944175 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150402b970 con 0x55c91a927a20 2024-09-19T04:52:17.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.153+0000 7f1512658740 1 -- 172.21.15.2:0/1714944175 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91a927a20 msgr2=0x55c91a94ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:17.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.153+0000 7f1512658740 1 --2- 172.21.15.2:0/1714944175 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91a927a20 0x55c91a94ebc0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f15040099b0 tx=0x7f1504011810 comp rx=0 tx=0).stop 2024-09-19T04:52:17.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.153+0000 7f1512658740 1 -- 172.21.15.2:0/1714944175 shutdown_connections 2024-09-19T04:52:17.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.153+0000 7f1512658740 1 --2- 172.21.15.2:0/1714944175 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91a937150 0x55c91a931340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:17.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.153+0000 7f1512658740 1 --2- 172.21.15.2:0/1714944175 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c91a928340 0x55c91a94f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:17.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.153+0000 7f1512658740 1 --2- 172.21.15.2:0/1714944175 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91a927a20 0x55c91a94ebc0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:17.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.153+0000 7f1512658740 1 -- 172.21.15.2:0/1714944175 >> 172.21.15.2:0/1714944175 conn(0x55c91a9240f0 msgr2=0x55c91a936050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:17.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.153+0000 7f1512658740 1 -- 172.21.15.2:0/1714944175 shutdown_connections 2024-09-19T04:52:17.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.153+0000 7f1512658740 1 -- 172.21.15.2:0/1714944175 wait complete. 2024-09-19T04:52:17.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.154+0000 7f1512658740 1 -- start start 2024-09-19T04:52:17.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.154+0000 7f1512658740 1 Processor -- start 2024-09-19T04:52:17.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.154+0000 7f1512658740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91a927a20 0x55c91a93b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:17.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.154+0000 7f1512658740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c91a928340 0x55c91a93b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:17.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.154+0000 7f1512658740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91a937150 0x55c91a9b0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:17.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.154+0000 7f1512658740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f15081aa1f0 con 0x55c91a927a20 2024-09-19T04:52:17.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.154+0000 7f1512658740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f15081ab660 con 0x55c91a937150 2024-09-19T04:52:17.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.154+0000 7f1512658740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f15081aa8c0 con 0x55c91a928340 2024-09-19T04:52:17.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.154+0000 7f1512658740 10 client.0 _ll_register_callbacks cb 0x7f1504005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:52:17.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.154+0000 7f150e01b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91a927a20 0x55c91a93b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:17.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.154+0000 7f150e01b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91a927a20 0x55c91a93b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54064/0 (socket says 172.21.15.2:54064) 2024-09-19T04:52:17.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.154+0000 7f150e01b640 1 -- 172.21.15.2:0/1257806739 learned_addr learned my addr 172.21.15.2:0/1257806739 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:17.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.154+0000 7f150e01b640 1 -- 172.21.15.2:0/1257806739 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c91a928340 msgr2=0x55c91a93b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:17.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.154+0000 7f150e01b640 1 --2- 172.21.15.2:0/1257806739 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c91a928340 0x55c91a93b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:17.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.154+0000 7f150e01b640 1 -- 172.21.15.2:0/1257806739 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91a937150 msgr2=0x55c91a9b0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:17.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.154+0000 7f150e01b640 1 --2- 172.21.15.2:0/1257806739 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91a937150 0x55c91a9b0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:17.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.154+0000 7f150e01b640 1 -- 172.21.15.2:0/1257806739 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c91a9b10d0 con 0x55c91a927a20 2024-09-19T04:52:17.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.155+0000 7f150e01b640 1 --2- 172.21.15.2:0/1257806739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91a927a20 0x55c91a93b2d0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f1504006010 tx=0x7f15040035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e506664c7a49f20 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:17.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.155+0000 7f14f1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:52:17.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.155+0000 7f14f1ffb640 1 -- 172.21.15.2:0/1257806739 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1504005a70 con 0x55c91a927a20 2024-09-19T04:52:17.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.155+0000 7f14f1ffb640 1 -- 172.21.15.2:0/1257806739 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f1504030070 con 0x55c91a927a20 2024-09-19T04:52:17.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.155+0000 7f1512658740 1 -- 172.21.15.2:0/1257806739 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15040054f0 con 0x55c91a927a20 2024-09-19T04:52:17.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.155+0000 7f14f1ffb640 1 -- 172.21.15.2:0/1257806739 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f15040052c0 con 0x55c91a927a20 2024-09-19T04:52:17.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.155+0000 7f1512658740 10 client.15852 fetch_fsmap learned FSMap version 19 2024-09-19T04:52:17.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.155+0000 7f1512658740 1 -- 172.21.15.2:0/1257806739 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55c91a9b22f0 con 0x55c91a927a20 2024-09-19T04:52:17.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.155+0000 7f14f1ffb640 1 -- 172.21.15.2:0/1257806739 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f15040054f0 con 0x55c91a927a20 2024-09-19T04:52:17.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.155+0000 7f14f1ffb640 1 -- 172.21.15.2:0/1257806739 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f150402b030 con 0x55c91a927a20 2024-09-19T04:52:17.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.155+0000 7f1512658740 10 client.15852 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:52:17.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.155+0000 7f1512658740 10 client.15852 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:52:17.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.155+0000 7f1512658740 20 client.15852 populate_metadata read hostname 'smithi002' 2024-09-19T04:52:17.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.155+0000 7f1512658740 1 --2- 172.21.15.2:0/1257806739 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55c91a9b2800 0x55c91a9b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:17.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.155+0000 7f1512658740 4 client.15852 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:52:17.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.155+0000 7f1512658740 1 -- 172.21.15.2:0/1257806739 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c91a894d00 con 0x55c91a9b2800 2024-09-19T04:52:17.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.156+0000 7f150d81a640 1 --2- 172.21.15.2:0/1257806739 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55c91a9b2800 0x55c91a9b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:17.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.156+0000 7f150d81a640 1 --2- 172.21.15.2:0/1257806739 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55c91a9b2800 0x55c91a9b4bf0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4584236736513ead server_cookie=fcd37d31ce369bed in_seq=0 out_seq=0 2024-09-19T04:52:17.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.156+0000 7f14f1ffb640 10 client.15852 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:52:17.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.157+0000 7f14f1ffb640 1 -- 172.21.15.2:0/1257806739 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c91a894d00 con 0x55c91a9b2800 2024-09-19T04:52:17.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.157+0000 7f14f1ffb640 10 client.15852 handle_command_reply: tid=0 2024-09-19T04:52:17.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.157+0000 7f1512658740 1 client.15852 shutdown 2024-09-19T04:52:17.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.157+0000 7f1512658740 1 -- 172.21.15.2:0/1257806739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91a927a20 msgr2=0x55c91a93b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:17.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.157+0000 7f1512658740 1 --2- 172.21.15.2:0/1257806739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91a927a20 0x55c91a93b2d0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f1504006010 tx=0x7f15040035f0 comp rx=0 tx=0).stop 2024-09-19T04:52:17.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.157+0000 7f1512658740 1 -- 172.21.15.2:0/1257806739 shutdown_connections 2024-09-19T04:52:17.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.157+0000 7f1512658740 1 --2- 172.21.15.2:0/1257806739 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c91a937150 0x55c91a9b0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:17.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.157+0000 7f1512658740 1 --2- 172.21.15.2:0/1257806739 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55c91a9b2800 0x55c91a9b4bf0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:17.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.157+0000 7f1512658740 1 --2- 172.21.15.2:0/1257806739 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c91a928340 0x55c91a93b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:17.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.157+0000 7f1512658740 1 --2- 172.21.15.2:0/1257806739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c91a927a20 0x55c91a93b2d0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:17.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.157+0000 7f1512658740 1 -- 172.21.15.2:0/1257806739 >> 172.21.15.2:0/1257806739 conn(0x55c91a9240f0 msgr2=0x55c91a935670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:17.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.157+0000 7f14f1ffb640 0 client.15852 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:52:17.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.157+0000 7f1512658740 1 -- 172.21.15.2:0/1257806739 shutdown_connections 2024-09-19T04:52:17.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.157+0000 7f1512658740 1 -- 172.21.15.2:0/1257806739 wait complete. 2024-09-19T04:52:17.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.157+0000 7f1512658740 20 client.15852 trim_cache size 0 max 16384 2024-09-19T04:52:17.167 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:52:17.167 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T04:52:17.168 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "57771974-d61d-4cf7-a511-ce7e9d47fb08", 2024-09-19T04:52:17.168 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T04:52:17.168 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:52:17.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.158+0000 7f151027f640 1 -- 172.21.15.2:0/3583070007 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f14f40a3430 msgr2=0x7f14f40a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:17.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.158+0000 7f151027f640 1 --2- 172.21.15.2:0/3583070007 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f14f40a3430 0x7f14f40a58f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1500009a60 tx=0x7f1500005f80 comp rx=0 tx=0).stop 2024-09-19T04:52:17.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.158+0000 7f151027f640 1 -- 172.21.15.2:0/3583070007 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15081036e0 msgr2=0x7f15081989f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:17.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.158+0000 7f151027f640 1 --2- 172.21.15.2:0/3583070007 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15081036e0 0x7f15081989f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f14f800d750 tx=0x7f14f800dc10 comp rx=0 tx=0).stop 2024-09-19T04:52:17.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.158+0000 7f151027f640 1 -- 172.21.15.2:0/3583070007 shutdown_connections 2024-09-19T04:52:17.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.158+0000 7f151027f640 1 --2- 172.21.15.2:0/3583070007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15081082a0 0x7f150819cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:17.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.158+0000 7f151027f640 1 --2- 172.21.15.2:0/3583070007 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15081036e0 0x7f15081989f0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:17.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.158+0000 7f151027f640 1 --2- 172.21.15.2:0/3583070007 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f14f40a3430 0x7f14f40a58f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:17.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.158+0000 7f151027f640 1 --2- 172.21.15.2:0/3583070007 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1508102d30 0x7f15081984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:17.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.158+0000 7f151027f640 1 -- 172.21.15.2:0/3583070007 >> 172.21.15.2:0/3583070007 conn(0x7f15080fc7d0 msgr2=0x7f1508105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:17.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.158+0000 7f151027f640 1 -- 172.21.15.2:0/3583070007 shutdown_connections 2024-09-19T04:52:17.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:17.158+0000 7f151027f640 1 -- 172.21.15.2:0/3583070007 wait complete. 2024-09-19T04:52:17.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:17 smithi018 ceph-mon[34537]: pgmap v131: 97 pgs: 97 active+clean; 4.9 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 63 KiB/s wr, 26 op/s 2024-09-19T04:52:17.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:17 smithi116 ceph-mon[34477]: pgmap v131: 97 pgs: 97 active+clean; 4.9 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 63 KiB/s wr, 26 op/s 2024-09-19T04:52:18.031 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:52:18.289 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:52:18.306 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:18 smithi018 ceph-mon[34537]: scrub queued for path: / 2024-09-19T04:52:18.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:18 smithi018 ceph-mon[34537]: scrub summary: idle+waiting paths [/] 2024-09-19T04:52:18.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:18 smithi018 ceph-mon[34537]: scrub summary: active paths [/] 2024-09-19T04:52:18.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:18 smithi018 ceph-mon[34537]: scrub summary: idle+waiting paths [/] 2024-09-19T04:52:18.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:18 smithi002 ceph-mon[30975]: scrub queued for path: / 2024-09-19T04:52:18.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:18 smithi002 ceph-mon[30975]: scrub summary: idle+waiting paths [/] 2024-09-19T04:52:18.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:18 smithi002 ceph-mon[30975]: scrub summary: active paths [/] 2024-09-19T04:52:18.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:18 smithi002 ceph-mon[30975]: scrub summary: idle+waiting paths [/] 2024-09-19T04:52:18.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:18 smithi116 ceph-mon[34477]: scrub queued for path: / 2024-09-19T04:52:18.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:18 smithi116 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-19T04:52:18.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:18 smithi116 ceph-mon[34477]: scrub summary: active paths [/] 2024-09-19T04:52:18.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:18 smithi116 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-19T04:52:18.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.815+0000 7f78d4aef640 1 -- 172.21.15.2:0/603547919 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78d0102d20 msgr2=0x7f78d0103100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:18.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.815+0000 7f78d4aef640 1 --2- 172.21.15.2:0/603547919 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78d0102d20 0x7f78d0103100 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f78c0009900 tx=0x7f78c002a480 comp rx=0 tx=0).stop 2024-09-19T04:52:18.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.815+0000 7f78d4aef640 1 -- 172.21.15.2:0/603547919 shutdown_connections 2024-09-19T04:52:18.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.815+0000 7f78d4aef640 1 --2- 172.21.15.2:0/603547919 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78d010c150 0x7f78d010e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:18.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.815+0000 7f78d4aef640 1 --2- 172.21.15.2:0/603547919 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f78d0103640 0x7f78d010bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:18.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.815+0000 7f78d4aef640 1 --2- 172.21.15.2:0/603547919 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78d0102d20 0x7f78d0103100 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:18.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.815+0000 7f78d4aef640 1 -- 172.21.15.2:0/603547919 >> 172.21.15.2:0/603547919 conn(0x7f78d00fc780 msgr2=0x7f78d00feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:18.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.815+0000 7f78d4aef640 1 -- 172.21.15.2:0/603547919 shutdown_connections 2024-09-19T04:52:18.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.815+0000 7f78d4aef640 1 -- 172.21.15.2:0/603547919 wait complete. 2024-09-19T04:52:18.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.816+0000 7f78d4aef640 1 Processor -- start 2024-09-19T04:52:18.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.816+0000 7f78d4aef640 1 -- start start 2024-09-19T04:52:18.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.817+0000 7f78d4aef640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78d0102d20 0x7f78d0198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:18.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.817+0000 7f78d4aef640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f78d0103640 0x7f78d01988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:18.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.817+0000 7f78d4aef640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78d010c150 0x7f78d019cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:18.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.817+0000 7f78d4aef640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f78d0111e00 con 0x7f78d0102d20 2024-09-19T04:52:18.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.817+0000 7f78d4aef640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f78d0111c80 con 0x7f78d010c150 2024-09-19T04:52:18.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.817+0000 7f78d4aef640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f78d0111f80 con 0x7f78d0103640 2024-09-19T04:52:18.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.817+0000 7f78ce59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78d0102d20 0x7f78d0198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:18.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.817+0000 7f78ce59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78d0102d20 0x7f78d0198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54070/0 (socket says 172.21.15.2:54070) 2024-09-19T04:52:18.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.817+0000 7f78ce59c640 1 -- 172.21.15.2:0/2663059242 learned_addr learned my addr 172.21.15.2:0/2663059242 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:18.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.817+0000 7f78ced9d640 1 --2- 172.21.15.2:0/2663059242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78d010c150 0x7f78d019cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:18.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.817+0000 7f78cdd9b640 1 --2- 172.21.15.2:0/2663059242 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f78d0103640 0x7f78d01988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:18.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.817+0000 7f78ce59c640 1 -- 172.21.15.2:0/2663059242 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f78d0103640 msgr2=0x7f78d01988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:18.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.817+0000 7f78ce59c640 1 --2- 172.21.15.2:0/2663059242 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f78d0103640 0x7f78d01988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:18.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.817+0000 7f78ce59c640 1 -- 172.21.15.2:0/2663059242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78d010c150 msgr2=0x7f78d019cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:18.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.817+0000 7f78ce59c640 1 --2- 172.21.15.2:0/2663059242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78d010c150 0x7f78d019cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:18.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.817+0000 7f78ce59c640 1 -- 172.21.15.2:0/2663059242 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78d019d310 con 0x7f78d0102d20 2024-09-19T04:52:18.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.817+0000 7f78cdd9b640 1 --2- 172.21.15.2:0/2663059242 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f78d0103640 0x7f78d01988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:52:18.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.817+0000 7f78ce59c640 1 --2- 172.21.15.2:0/2663059242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78d0102d20 0x7f78d0198360 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f78c0005940 tx=0x7f78c0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:18.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.817+0000 7f78bf7fe640 1 -- 172.21.15.2:0/2663059242 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c003f030 con 0x7f78d0102d20 2024-09-19T04:52:18.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.817+0000 7f78bf7fe640 1 -- 172.21.15.2:0/2663059242 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f78c0003aa0 con 0x7f78d0102d20 2024-09-19T04:52:18.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.817+0000 7f78d4aef640 1 -- 172.21.15.2:0/2663059242 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78d019d5a0 con 0x7f78d0102d20 2024-09-19T04:52:18.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.817+0000 7f78bf7fe640 1 -- 172.21.15.2:0/2663059242 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c0035070 con 0x7f78d0102d20 2024-09-19T04:52:18.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.818+0000 7f78d4aef640 1 -- 172.21.15.2:0/2663059242 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78d01a4ee0 con 0x7f78d0102d20 2024-09-19T04:52:18.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.820+0000 7f78bf7fe640 1 -- 172.21.15.2:0/2663059242 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f78c0042030 con 0x7f78d0102d20 2024-09-19T04:52:18.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.820+0000 7f78d6ec8740 1 Processor -- start 2024-09-19T04:52:18.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.820+0000 7f78d6ec8740 1 -- start start 2024-09-19T04:52:18.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.820+0000 7f78d6ec8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642a869a380 0x5642a869a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:18.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.820+0000 7f78d6ec8740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5642a869aca0 0x5642a86a9550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:18.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.820+0000 7f78d6ec8740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5642a86a9a90 0x5642a86abe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:18.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.820+0000 7f78d6ec8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5642a86002e0 con 0x5642a869a380 2024-09-19T04:52:18.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.820+0000 7f78d6ec8740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5642a85a7ce0 con 0x5642a86a9a90 2024-09-19T04:52:18.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.820+0000 7f78d6ec8740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5642a85fc2a0 con 0x5642a869aca0 2024-09-19T04:52:18.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.821+0000 7f78ced9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642a869a380 0x5642a869a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:18.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.821+0000 7f78ced9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642a869a380 0x5642a869a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54086/0 (socket says 172.21.15.2:54086) 2024-09-19T04:52:18.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.821+0000 7f78ced9d640 1 -- 172.21.15.2:0/561657196 learned_addr learned my addr 172.21.15.2:0/561657196 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:18.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.821+0000 7f78bf7fe640 1 --2- 172.21.15.2:0/2663059242 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f78b80a3430 0x7f78b80a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:18.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.821+0000 7f78cdd9b640 1 --2- 172.21.15.2:0/561657196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5642a86a9a90 0x5642a86abe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:18.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.821+0000 7f78ce59c640 1 --2- 172.21.15.2:0/561657196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5642a869aca0 0x5642a86a9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:18.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.821+0000 7f78ced9d640 1 -- 172.21.15.2:0/561657196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5642a869aca0 msgr2=0x5642a86a9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:18.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.821+0000 7f78ced9d640 1 --2- 172.21.15.2:0/561657196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5642a869aca0 0x5642a86a9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:18.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.821+0000 7f78ced9d640 1 -- 172.21.15.2:0/561657196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5642a86a9a90 msgr2=0x5642a86abe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:18.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.821+0000 7f78ced9d640 1 --2- 172.21.15.2:0/561657196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5642a86a9a90 0x5642a86abe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:18.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.821+0000 7f78ced9d640 1 -- 172.21.15.2:0/561657196 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642a858c440 con 0x5642a869a380 2024-09-19T04:52:18.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.821+0000 7f78ce59c640 1 --2- 172.21.15.2:0/561657196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5642a869aca0 0x5642a86a9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:52:18.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.821+0000 7f78ced9d640 1 --2- 172.21.15.2:0/2663059242 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f78b80a3430 0x7f78b80a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:18.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.821+0000 7f78bf7fe640 1 -- 172.21.15.2:0/2663059242 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f78c00f0450 con 0x7f78d0102d20 2024-09-19T04:52:18.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.821+0000 7f78ced9d640 1 --2- 172.21.15.2:0/561657196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642a869a380 0x5642a869a760 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f78c8010440 tx=0x7f78c8010900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e80076b3cce3ea7f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:18.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.821+0000 7f78bcff9640 1 -- 172.21.15.2:0/561657196 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c801d400 con 0x5642a869a380 2024-09-19T04:52:18.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.821+0000 7f78bcff9640 1 -- 172.21.15.2:0/561657196 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f78c8013520 con 0x5642a869a380 2024-09-19T04:52:18.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.821+0000 7f78bcff9640 1 -- 172.21.15.2:0/561657196 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c8011880 con 0x5642a869a380 2024-09-19T04:52:18.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.822+0000 7f78d6ec8740 1 -- 172.21.15.2:0/561657196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642a869a380 msgr2=0x5642a869a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:18.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.822+0000 7f78d6ec8740 1 --2- 172.21.15.2:0/561657196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642a869a380 0x5642a869a760 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f78c8010440 tx=0x7f78c8010900 comp rx=0 tx=0).stop 2024-09-19T04:52:18.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.822+0000 7f78ced9d640 1 --2- 172.21.15.2:0/2663059242 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f78b80a3430 0x7f78b80a58f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f78c8021000 tx=0x7f78c801e000 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:18.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.822+0000 7f78d6ec8740 1 -- 172.21.15.2:0/561657196 shutdown_connections 2024-09-19T04:52:18.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.822+0000 7f78d6ec8740 1 --2- 172.21.15.2:0/561657196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5642a86a9a90 0x5642a86abe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:18.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.822+0000 7f78d6ec8740 1 --2- 172.21.15.2:0/561657196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5642a869aca0 0x5642a86a9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:18.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.822+0000 7f78d6ec8740 1 --2- 172.21.15.2:0/561657196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642a869a380 0x5642a869a760 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:18.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.822+0000 7f78d6ec8740 1 -- 172.21.15.2:0/561657196 >> 172.21.15.2:0/561657196 conn(0x5642a8696a30 msgr2=0x5642a8696e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:18.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.822+0000 7f78d6ec8740 1 -- 172.21.15.2:0/561657196 shutdown_connections 2024-09-19T04:52:18.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.822+0000 7f78d6ec8740 1 -- 172.21.15.2:0/561657196 wait complete. 2024-09-19T04:52:18.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.823+0000 7f78d6ec8740 1 -- start start 2024-09-19T04:52:18.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.823+0000 7f78d6ec8740 1 Processor -- start 2024-09-19T04:52:18.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.823+0000 7f78d6ec8740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5642a869a380 0x5642a86a9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:18.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.823+0000 7f78d6ec8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642a869aca0 0x5642a86a6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:18.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.823+0000 7f78d6ec8740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5642a86a9a90 0x5642a86a6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:18.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.823+0000 7f78d6ec8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5642a86ac660 con 0x5642a869aca0 2024-09-19T04:52:18.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.823+0000 7f78d6ec8740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5642a85bb050 con 0x5642a869a380 2024-09-19T04:52:18.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.823+0000 7f78d6ec8740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5642a86ac7e0 con 0x5642a86a9a90 2024-09-19T04:52:18.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.823+0000 7f78d6ec8740 10 client.0 _ll_register_callbacks cb 0x5642a85fb160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:52:18.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.823+0000 7f78cdd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642a869aca0 0x5642a86a6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:18.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.823+0000 7f78cdd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642a869aca0 0x5642a86a6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54088/0 (socket says 172.21.15.2:54088) 2024-09-19T04:52:18.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.823+0000 7f78cdd9b640 1 -- 172.21.15.2:0/1554498442 learned_addr learned my addr 172.21.15.2:0/1554498442 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:18.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.823+0000 7f78ce59c640 1 --2- 172.21.15.2:0/1554498442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5642a869a380 0x5642a86a9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:18.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.823+0000 7f78ced9d640 1 --2- 172.21.15.2:0/1554498442 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5642a86a9a90 0x5642a86a6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:18.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.823+0000 7f78cdd9b640 1 -- 172.21.15.2:0/1554498442 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5642a86a9a90 msgr2=0x5642a86a6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:18.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.823+0000 7f78cdd9b640 1 --2- 172.21.15.2:0/1554498442 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5642a86a9a90 0x5642a86a6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:18.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.823+0000 7f78cdd9b640 1 -- 172.21.15.2:0/1554498442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5642a869a380 msgr2=0x5642a86a9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:18.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.823+0000 7f78cdd9b640 1 --2- 172.21.15.2:0/1554498442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5642a869a380 0x5642a86a9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:18.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.824+0000 7f78cdd9b640 1 -- 172.21.15.2:0/1554498442 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642a83713c0 con 0x5642a869aca0 2024-09-19T04:52:18.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.824+0000 7f78cdd9b640 1 --2- 172.21.15.2:0/1554498442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642a869aca0 0x5642a86a6730 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f78c4009e30 tx=0x7f78c40117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d36e26347b823f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:18.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.824+0000 7f78b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:52:18.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.824+0000 7f78b5ffb640 1 -- 172.21.15.2:0/1554498442 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c4004220 con 0x5642a869aca0 2024-09-19T04:52:18.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.824+0000 7f78b5ffb640 1 -- 172.21.15.2:0/1554498442 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f78c40043c0 con 0x5642a869aca0 2024-09-19T04:52:18.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.824+0000 7f78d6ec8740 1 -- 172.21.15.2:0/1554498442 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78c8013520 con 0x5642a869aca0 2024-09-19T04:52:18.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.824+0000 7f78b5ffb640 1 -- 172.21.15.2:0/1554498442 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f78c4012660 con 0x5642a869aca0 2024-09-19T04:52:18.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.824+0000 7f78d6ec8740 10 client.15864 fetch_fsmap learned FSMap version 19 2024-09-19T04:52:18.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.824+0000 7f78d6ec8740 1 -- 172.21.15.2:0/1554498442 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5642a86b80d0 con 0x5642a869aca0 2024-09-19T04:52:18.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.824+0000 7f78b5ffb640 1 -- 172.21.15.2:0/1554498442 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f78c8013520 con 0x5642a869aca0 2024-09-19T04:52:18.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.824+0000 7f78b5ffb640 1 -- 172.21.15.2:0/1554498442 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f78c4021070 con 0x5642a869aca0 2024-09-19T04:52:18.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.824+0000 7f78d6ec8740 10 client.15864 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:52:18.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.824+0000 7f78d6ec8740 10 client.15864 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:52:18.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.824+0000 7f78d6ec8740 20 client.15864 populate_metadata read hostname 'smithi002' 2024-09-19T04:52:18.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.824+0000 7f78d6ec8740 1 --2- 172.21.15.2:0/1554498442 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5642a86b9630 0x5642a86bba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:18.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.824+0000 7f78d6ec8740 4 client.15864 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:52:18.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.824+0000 7f78d6ec8740 1 -- 172.21.15.2:0/1554498442 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5642a860d850 con 0x5642a86b9630 2024-09-19T04:52:18.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.825+0000 7f78ce59c640 1 --2- 172.21.15.2:0/1554498442 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5642a86b9630 0x5642a86bba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:18.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.825+0000 7f78b5ffb640 10 client.15864 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:52:18.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.825+0000 7f78ce59c640 1 --2- 172.21.15.2:0/1554498442 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5642a86b9630 0x5642a86bba70 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=947a4e10014f2478 server_cookie=f91c57b50316cafb in_seq=0 out_seq=0 2024-09-19T04:52:18.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.826+0000 7f78b5ffb640 1 -- 172.21.15.2:0/1554498442 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5642a860d850 con 0x5642a86b9630 2024-09-19T04:52:18.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.826+0000 7f78b5ffb640 10 client.15864 handle_command_reply: tid=0 2024-09-19T04:52:18.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.826+0000 7f78d6ec8740 1 client.15864 shutdown 2024-09-19T04:52:18.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.826+0000 7f78d6ec8740 1 -- 172.21.15.2:0/1554498442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642a869aca0 msgr2=0x5642a86a6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:18.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.826+0000 7f78d6ec8740 1 --2- 172.21.15.2:0/1554498442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642a869aca0 0x5642a86a6730 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f78c4009e30 tx=0x7f78c40117b0 comp rx=0 tx=0).stop 2024-09-19T04:52:18.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.826+0000 7f78d6ec8740 1 -- 172.21.15.2:0/1554498442 shutdown_connections 2024-09-19T04:52:18.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.826+0000 7f78d6ec8740 1 --2- 172.21.15.2:0/1554498442 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5642a86b9630 0x5642a86bba70 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:18.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.826+0000 7f78d6ec8740 1 --2- 172.21.15.2:0/1554498442 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5642a86a9a90 0x5642a86a6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:18.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.826+0000 7f78d6ec8740 1 --2- 172.21.15.2:0/1554498442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642a869aca0 0x5642a86a6730 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:18.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.826+0000 7f78d6ec8740 1 --2- 172.21.15.2:0/1554498442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5642a869a380 0x5642a86a9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:18.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.826+0000 7f78b5ffb640 0 client.15864 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:52:18.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.826+0000 7f78d6ec8740 1 -- 172.21.15.2:0/1554498442 >> 172.21.15.2:0/1554498442 conn(0x5642a8696a30 msgr2=0x5642a869c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:18.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.826+0000 7f78d6ec8740 1 -- 172.21.15.2:0/1554498442 shutdown_connections 2024-09-19T04:52:18.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.826+0000 7f78d6ec8740 1 -- 172.21.15.2:0/1554498442 wait complete. 2024-09-19T04:52:18.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.826+0000 7f78d6ec8740 20 client.15864 trim_cache size 0 max 16384 2024-09-19T04:52:18.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.844+0000 7f78d6ec8740 1 Processor -- start 2024-09-19T04:52:18.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.844+0000 7f78d6ec8740 1 -- start start 2024-09-19T04:52:18.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.844+0000 7f78d6ec8740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5642a869a380 0x5642a86a5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:18.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.844+0000 7f78d6ec8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642a869aca0 0x5642a86b5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:18.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.844+0000 7f78d6ec8740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5642a86a9a90 0x5642a86c1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:18.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.844+0000 7f78d6ec8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f78d01a94a0 con 0x5642a869aca0 2024-09-19T04:52:18.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.844+0000 7f78d6ec8740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f78d01abd20 con 0x5642a869a380 2024-09-19T04:52:18.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.844+0000 7f78d6ec8740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f78d01a9b10 con 0x5642a86a9a90 2024-09-19T04:52:18.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.844+0000 7f78cdd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642a869aca0 0x5642a86b5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:18.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.844+0000 7f78cdd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642a869aca0 0x5642a86b5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54094/0 (socket says 172.21.15.2:54094) 2024-09-19T04:52:18.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.844+0000 7f78cdd9b640 1 -- 172.21.15.2:0/3833274082 learned_addr learned my addr 172.21.15.2:0/3833274082 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:18.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.844+0000 7f78ced9d640 1 --2- 172.21.15.2:0/3833274082 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5642a86a9a90 0x5642a86c1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:18.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.844+0000 7f78ce59c640 1 --2- 172.21.15.2:0/3833274082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5642a869a380 0x5642a86a5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:18.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.844+0000 7f78cdd9b640 1 -- 172.21.15.2:0/3833274082 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5642a86a9a90 msgr2=0x5642a86c1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:18.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.844+0000 7f78cdd9b640 1 --2- 172.21.15.2:0/3833274082 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5642a86a9a90 0x5642a86c1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:18.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.844+0000 7f78cdd9b640 1 -- 172.21.15.2:0/3833274082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5642a869a380 msgr2=0x5642a86a5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:18.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.844+0000 7f78cdd9b640 1 --2- 172.21.15.2:0/3833274082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5642a869a380 0x5642a86a5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:18.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.844+0000 7f78cdd9b640 1 -- 172.21.15.2:0/3833274082 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642a86a56e0 con 0x5642a869aca0 2024-09-19T04:52:18.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.844+0000 7f78ce59c640 1 --2- 172.21.15.2:0/3833274082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5642a869a380 0x5642a86a5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:52:18.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.844+0000 7f78ced9d640 1 --2- 172.21.15.2:0/3833274082 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5642a86a9a90 0x5642a86c1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:52:18.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.845+0000 7f78cdd9b640 1 --2- 172.21.15.2:0/3833274082 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642a869aca0 0x5642a86b5900 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f78c4005c40 tx=0x7f78c40058f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=217a71cd55a171e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:18.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.845+0000 7f78b7fff640 1 -- 172.21.15.2:0/3833274082 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c4030070 con 0x5642a869aca0 2024-09-19T04:52:18.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.845+0000 7f78b7fff640 1 -- 172.21.15.2:0/3833274082 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f78c4011cb0 con 0x5642a869aca0 2024-09-19T04:52:18.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.845+0000 7f78b7fff640 1 -- 172.21.15.2:0/3833274082 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c4027040 con 0x5642a869aca0 2024-09-19T04:52:18.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.845+0000 7f78d6ec8740 1 -- 172.21.15.2:0/3833274082 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642a869aca0 msgr2=0x5642a86b5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:18.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.845+0000 7f78d6ec8740 1 --2- 172.21.15.2:0/3833274082 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642a869aca0 0x5642a86b5900 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f78c4005c40 tx=0x7f78c40058f0 comp rx=0 tx=0).stop 2024-09-19T04:52:18.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.845+0000 7f78d6ec8740 1 -- 172.21.15.2:0/3833274082 shutdown_connections 2024-09-19T04:52:18.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.845+0000 7f78d6ec8740 1 --2- 172.21.15.2:0/3833274082 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5642a86a9a90 0x5642a86c1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:18.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.845+0000 7f78d6ec8740 1 --2- 172.21.15.2:0/3833274082 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642a869aca0 0x5642a86b5900 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:18.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.845+0000 7f78d6ec8740 1 --2- 172.21.15.2:0/3833274082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5642a869a380 0x5642a86a5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:18.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.845+0000 7f78d6ec8740 1 -- 172.21.15.2:0/3833274082 >> 172.21.15.2:0/3833274082 conn(0x5642a8696a30 msgr2=0x5642a86a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:18.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.846+0000 7f78d6ec8740 1 -- 172.21.15.2:0/3833274082 shutdown_connections 2024-09-19T04:52:18.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.846+0000 7f78d6ec8740 1 -- 172.21.15.2:0/3833274082 wait complete. 2024-09-19T04:52:18.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.846+0000 7f78d6ec8740 1 -- start start 2024-09-19T04:52:18.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.846+0000 7f78d6ec8740 1 Processor -- start 2024-09-19T04:52:18.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.846+0000 7f78d6ec8740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5642a869a380 0x5642a86ad700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:18.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.846+0000 7f78d6ec8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642a869aca0 0x5642a86adc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:18.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.846+0000 7f78d6ec8740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5642a86a9a90 0x5642a86ae180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:18.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.846+0000 7f78d6ec8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f78d01aa1e0 con 0x5642a869aca0 2024-09-19T04:52:18.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.846+0000 7f78d6ec8740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f78d01ab650 con 0x5642a869a380 2024-09-19T04:52:18.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.846+0000 7f78d6ec8740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f78d01aa8b0 con 0x5642a86a9a90 2024-09-19T04:52:18.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.846+0000 7f78d6ec8740 10 client.0 _ll_register_callbacks cb 0x7f78c40096c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:52:18.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.846+0000 7f78cdd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642a869aca0 0x5642a86adc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:18.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.846+0000 7f78cdd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642a869aca0 0x5642a86adc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54108/0 (socket says 172.21.15.2:54108) 2024-09-19T04:52:18.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.846+0000 7f78cdd9b640 1 -- 172.21.15.2:0/3702726432 learned_addr learned my addr 172.21.15.2:0/3702726432 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:18.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.847+0000 7f78ced9d640 1 --2- 172.21.15.2:0/3702726432 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5642a86a9a90 0x5642a86ae180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:18.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.847+0000 7f78ce59c640 1 --2- 172.21.15.2:0/3702726432 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5642a869a380 0x5642a86ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:18.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.847+0000 7f78cdd9b640 1 -- 172.21.15.2:0/3702726432 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5642a86a9a90 msgr2=0x5642a86ae180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:18.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.847+0000 7f78cdd9b640 1 --2- 172.21.15.2:0/3702726432 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5642a86a9a90 0x5642a86ae180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:18.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.847+0000 7f78cdd9b640 1 -- 172.21.15.2:0/3702726432 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5642a869a380 msgr2=0x5642a86ad700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:18.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.847+0000 7f78cdd9b640 1 --2- 172.21.15.2:0/3702726432 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5642a869a380 0x5642a86ad700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:18.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.847+0000 7f78cdd9b640 1 -- 172.21.15.2:0/3702726432 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642a8723310 con 0x5642a869aca0 2024-09-19T04:52:18.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.847+0000 7f78ce59c640 1 --2- 172.21.15.2:0/3702726432 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5642a869a380 0x5642a86ad700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:52:18.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.847+0000 7f78cdd9b640 1 --2- 172.21.15.2:0/3702726432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642a869aca0 0x5642a86adc40 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f78c4003af0 tx=0x7f78c4003b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6bae8c657275372 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:18.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.847+0000 7f78b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:52:18.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.847+0000 7f78b5ffb640 1 -- 172.21.15.2:0/3702726432 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c4039060 con 0x5642a869aca0 2024-09-19T04:52:18.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.847+0000 7f78b5ffb640 1 -- 172.21.15.2:0/3702726432 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f78c40040a0 con 0x5642a869aca0 2024-09-19T04:52:18.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.847+0000 7f78d6ec8740 1 -- 172.21.15.2:0/3702726432 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78c4011cb0 con 0x5642a869aca0 2024-09-19T04:52:18.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.847+0000 7f78b5ffb640 1 -- 172.21.15.2:0/3702726432 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f78c4027050 con 0x5642a869aca0 2024-09-19T04:52:18.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.847+0000 7f78d6ec8740 10 client.15870 fetch_fsmap learned FSMap version 19 2024-09-19T04:52:18.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.847+0000 7f78d6ec8740 1 -- 172.21.15.2:0/3702726432 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5642a8724540 con 0x5642a869aca0 2024-09-19T04:52:18.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.848+0000 7f78b5ffb640 1 -- 172.21.15.2:0/3702726432 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f78c4011cb0 con 0x5642a869aca0 2024-09-19T04:52:18.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.848+0000 7f78b5ffb640 1 -- 172.21.15.2:0/3702726432 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f78c4033070 con 0x5642a869aca0 2024-09-19T04:52:18.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.848+0000 7f78d6ec8740 10 client.15870 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:52:18.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.848+0000 7f78d6ec8740 10 client.15870 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:52:18.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.848+0000 7f78d6ec8740 20 client.15870 populate_metadata read hostname 'smithi002' 2024-09-19T04:52:18.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.848+0000 7f78d6ec8740 1 --2- 172.21.15.2:0/3702726432 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5642a8724c50 0x5642a8727070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:18.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.848+0000 7f78d6ec8740 4 client.15870 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:52:18.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.848+0000 7f78d6ec8740 1 -- 172.21.15.2:0/3702726432 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5642a8607d60 con 0x5642a8724c50 2024-09-19T04:52:18.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.848+0000 7f78ce59c640 1 --2- 172.21.15.2:0/3702726432 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5642a8724c50 0x5642a8727070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:18.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.848+0000 7f78ce59c640 1 --2- 172.21.15.2:0/3702726432 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5642a8724c50 0x5642a8727070 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18429272142f057d server_cookie=5683e3caffb21905 in_seq=0 out_seq=0 2024-09-19T04:52:18.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.848+0000 7f78b5ffb640 10 client.15870 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:52:18.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.849+0000 7f78b5ffb640 1 -- 172.21.15.2:0/3702726432 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5642a8607d60 con 0x5642a8724c50 2024-09-19T04:52:18.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.849+0000 7f78b5ffb640 10 client.15870 handle_command_reply: tid=0 2024-09-19T04:52:18.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.849+0000 7f78d6ec8740 1 client.15870 shutdown 2024-09-19T04:52:18.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.849+0000 7f78d6ec8740 1 -- 172.21.15.2:0/3702726432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642a869aca0 msgr2=0x5642a86adc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:18.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.849+0000 7f78d6ec8740 1 --2- 172.21.15.2:0/3702726432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642a869aca0 0x5642a86adc40 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f78c4003af0 tx=0x7f78c4003b20 comp rx=0 tx=0).stop 2024-09-19T04:52:18.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.849+0000 7f78d6ec8740 1 -- 172.21.15.2:0/3702726432 shutdown_connections 2024-09-19T04:52:18.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.849+0000 7f78d6ec8740 1 --2- 172.21.15.2:0/3702726432 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5642a8724c50 0x5642a8727070 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:18.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.849+0000 7f78d6ec8740 1 --2- 172.21.15.2:0/3702726432 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5642a86a9a90 0x5642a86ae180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:18.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.849+0000 7f78d6ec8740 1 --2- 172.21.15.2:0/3702726432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5642a869aca0 0x5642a86adc40 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:18.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.849+0000 7f78d6ec8740 1 --2- 172.21.15.2:0/3702726432 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5642a869a380 0x5642a86ad700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:18.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.849+0000 7f78b5ffb640 0 client.15870 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:52:18.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.849+0000 7f78d6ec8740 1 -- 172.21.15.2:0/3702726432 >> 172.21.15.2:0/3702726432 conn(0x5642a8696a30 msgr2=0x5642a86a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:18.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.849+0000 7f78d6ec8740 1 -- 172.21.15.2:0/3702726432 shutdown_connections 2024-09-19T04:52:18.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.849+0000 7f78d6ec8740 1 -- 172.21.15.2:0/3702726432 wait complete. 2024-09-19T04:52:18.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.849+0000 7f78d6ec8740 20 client.15870 trim_cache size 0 max 16384 2024-09-19T04:52:18.865 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:52:18.865 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T04:52:18.865 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-19T04:52:18.865 INFO:teuthology.orchestra.run.smithi002.stdout: "57771974-d61d-4cf7-a511-ce7e9d47fb08": { 2024-09-19T04:52:18.865 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-19T04:52:18.865 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "57771974-d61d-4cf7-a511-ce7e9d47fb08", 2024-09-19T04:52:18.865 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-19T04:52:18.865 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:52:18.865 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:52:18.865 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:52:18.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.850+0000 7f78d4aef640 1 -- 172.21.15.2:0/2663059242 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f78b80a3430 msgr2=0x7f78b80a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:18.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.850+0000 7f78d4aef640 1 --2- 172.21.15.2:0/2663059242 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f78b80a3430 0x7f78b80a58f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f78c8021000 tx=0x7f78c801e000 comp rx=0 tx=0).stop 2024-09-19T04:52:18.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.850+0000 7f78d4aef640 1 -- 172.21.15.2:0/2663059242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78d0102d20 msgr2=0x7f78d0198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:18.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.850+0000 7f78d4aef640 1 --2- 172.21.15.2:0/2663059242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78d0102d20 0x7f78d0198360 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f78c0005940 tx=0x7f78c0004270 comp rx=0 tx=0).stop 2024-09-19T04:52:18.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.850+0000 7f78d4aef640 1 -- 172.21.15.2:0/2663059242 shutdown_connections 2024-09-19T04:52:18.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.850+0000 7f78d4aef640 1 --2- 172.21.15.2:0/2663059242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78d010c150 0x7f78d019cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:18.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.850+0000 7f78d4aef640 1 --2- 172.21.15.2:0/2663059242 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f78b80a3430 0x7f78b80a58f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:18.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.850+0000 7f78d4aef640 1 --2- 172.21.15.2:0/2663059242 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f78d0103640 0x7f78d01988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:18.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.850+0000 7f78d4aef640 1 --2- 172.21.15.2:0/2663059242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78d0102d20 0x7f78d0198360 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:18.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.850+0000 7f78d4aef640 1 -- 172.21.15.2:0/2663059242 >> 172.21.15.2:0/2663059242 conn(0x7f78d00fc780 msgr2=0x7f78d00fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:18.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.850+0000 7f78d4aef640 1 -- 172.21.15.2:0/2663059242 shutdown_connections 2024-09-19T04:52:18.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:18.850+0000 7f78d4aef640 1 -- 172.21.15.2:0/2663059242 wait complete. 2024-09-19T04:52:19.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:19 smithi018 ceph-mon[34537]: pgmap v132: 97 pgs: 97 active+clean; 4.9 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 7 op/s 2024-09-19T04:52:19.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:19 smithi002 ceph-mon[30975]: pgmap v132: 97 pgs: 97 active+clean; 4.9 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 7 op/s 2024-09-19T04:52:19.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:19 smithi116 ceph-mon[34477]: pgmap v132: 97 pgs: 97 active+clean; 4.9 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 7 op/s 2024-09-19T04:52:19.625 INFO:tasks.cephfs.filesystem:scrub status for tag:57771974-d61d-4cf7-a511-ce7e9d47fb08 - {'path': '/', 'tag': '57771974-d61d-4cf7-a511-ce7e9d47fb08', 'options': 'recursive,force'} 2024-09-19T04:52:20.806 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.806 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.806 INFO:tasks.workunit.client.0.smithi002.stdout:127/600: open fd = 3 2024-09-19T04:52:20.806 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.806 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.807 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.807 INFO:tasks.workunit.client.0.smithi002.stdout:128/600: open fd = 3 2024-09-19T04:52:20.807 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.807 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.807 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.807 INFO:tasks.workunit.client.0.smithi002.stdout:129/600: open fd = 3 2024-09-19T04:52:20.807 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.807 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.807 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.807 INFO:tasks.workunit.client.0.smithi002.stdout:130/600: open fd = 3 2024-09-19T04:52:20.807 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.807 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.808 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.808 INFO:tasks.workunit.client.0.smithi002.stdout:131/600: open fd = 3 2024-09-19T04:52:20.808 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.808 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.808 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.808 INFO:tasks.workunit.client.0.smithi002.stdout:132/600: open fd = 3 2024-09-19T04:52:20.808 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.808 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.808 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.808 INFO:tasks.workunit.client.0.smithi002.stdout:133/600: open fd = 3 2024-09-19T04:52:20.808 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.808 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.809 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.809 INFO:tasks.workunit.client.0.smithi002.stdout:134/600: open fd = 3 2024-09-19T04:52:20.809 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.809 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.809 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.809 INFO:tasks.workunit.client.0.smithi002.stdout:135/600: open fd = 3 2024-09-19T04:52:20.809 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.809 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.809 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.809 INFO:tasks.workunit.client.0.smithi002.stdout:136/600: open fd = 3 2024-09-19T04:52:20.809 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.809 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.809 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.809 INFO:tasks.workunit.client.0.smithi002.stdout:137/600: open fd = 3 2024-09-19T04:52:20.810 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.810 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.810 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.810 INFO:tasks.workunit.client.0.smithi002.stdout:138/600: open fd = 3 2024-09-19T04:52:20.810 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.810 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.810 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.810 INFO:tasks.workunit.client.0.smithi002.stdout:139/600: open fd = 3 2024-09-19T04:52:20.810 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.810 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.810 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.810 INFO:tasks.workunit.client.0.smithi002.stdout:140/600: open fd = 3 2024-09-19T04:52:20.810 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.810 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.811 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.811 INFO:tasks.workunit.client.0.smithi002.stdout:141/600: open fd = 3 2024-09-19T04:52:20.811 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.811 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.811 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.811 INFO:tasks.workunit.client.0.smithi002.stdout:142/600: open fd = 3 2024-09-19T04:52:20.811 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.811 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.811 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.811 INFO:tasks.workunit.client.0.smithi002.stdout:143/600: open fd = 3 2024-09-19T04:52:20.811 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.811 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.811 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.811 INFO:tasks.workunit.client.0.smithi002.stdout:144/600: open fd = 3 2024-09-19T04:52:20.812 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.812 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.812 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.812 INFO:tasks.workunit.client.0.smithi002.stdout:145/600: open fd = 3 2024-09-19T04:52:20.812 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.812 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.812 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.812 INFO:tasks.workunit.client.0.smithi002.stdout:146/600: open fd = 3 2024-09-19T04:52:20.812 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.812 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.812 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.812 INFO:tasks.workunit.client.0.smithi002.stdout:147/600: open fd = 3 2024-09-19T04:52:20.813 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.813 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.813 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.813 INFO:tasks.workunit.client.0.smithi002.stdout:148/600: open fd = 3 2024-09-19T04:52:20.813 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.813 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.813 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.813 INFO:tasks.workunit.client.0.smithi002.stdout:149/600: open fd = 3 2024-09-19T04:52:20.813 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.813 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.813 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.813 INFO:tasks.workunit.client.0.smithi002.stdout:150/600: open fd = 3 2024-09-19T04:52:20.814 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.814 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.814 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.814 INFO:tasks.workunit.client.0.smithi002.stdout:151/600: open fd = 3 2024-09-19T04:52:20.814 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.814 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.814 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.814 INFO:tasks.workunit.client.0.smithi002.stdout:152/600: open fd = 3 2024-09-19T04:52:20.814 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.814 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.814 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.814 INFO:tasks.workunit.client.0.smithi002.stdout:153/600: open fd = 3 2024-09-19T04:52:20.814 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.814 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.815 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.815 INFO:tasks.workunit.client.0.smithi002.stdout:154/600: open fd = 3 2024-09-19T04:52:20.815 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.815 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.815 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.815 INFO:tasks.workunit.client.0.smithi002.stdout:155/600: open fd = 3 2024-09-19T04:52:20.815 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.815 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.815 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.815 INFO:tasks.workunit.client.0.smithi002.stdout:156/600: open fd = 3 2024-09-19T04:52:20.815 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.815 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.815 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.816 INFO:tasks.workunit.client.0.smithi002.stdout:157/600: open fd = 3 2024-09-19T04:52:20.816 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.816 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.816 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.816 INFO:tasks.workunit.client.0.smithi002.stdout:158/600: open fd = 3 2024-09-19T04:52:20.816 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.816 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.816 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.816 INFO:tasks.workunit.client.0.smithi002.stdout:159/600: open fd = 3 2024-09-19T04:52:20.816 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.816 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.816 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.816 INFO:tasks.workunit.client.0.smithi002.stdout:160/600: open fd = 3 2024-09-19T04:52:20.817 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.817 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.817 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.817 INFO:tasks.workunit.client.0.smithi002.stdout:161/600: open fd = 3 2024-09-19T04:52:20.817 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.817 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.817 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.817 INFO:tasks.workunit.client.0.smithi002.stdout:162/600: open fd = 3 2024-09-19T04:52:20.817 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.817 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.817 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.817 INFO:tasks.workunit.client.0.smithi002.stdout:163/600: open fd = 3 2024-09-19T04:52:20.817 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.817 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.818 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.818 INFO:tasks.workunit.client.0.smithi002.stdout:164/600: open fd = 3 2024-09-19T04:52:20.818 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.818 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.818 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.818 INFO:tasks.workunit.client.0.smithi002.stdout:165/600: open fd = 3 2024-09-19T04:52:20.818 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.818 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.818 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.818 INFO:tasks.workunit.client.0.smithi002.stdout:166/600: open fd = 3 2024-09-19T04:52:20.818 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.818 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.818 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.818 INFO:tasks.workunit.client.0.smithi002.stdout:167/600: open fd = 3 2024-09-19T04:52:20.819 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.819 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.819 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.819 INFO:tasks.workunit.client.0.smithi002.stdout:168/600: open fd = 3 2024-09-19T04:52:20.819 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.819 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.819 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.819 INFO:tasks.workunit.client.0.smithi002.stdout:169/600: open fd = 3 2024-09-19T04:52:20.819 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.819 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.820 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.820 INFO:tasks.workunit.client.0.smithi002.stdout:170/600: open fd = 3 2024-09-19T04:52:20.820 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.820 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.820 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.820 INFO:tasks.workunit.client.0.smithi002.stdout:171/600: open fd = 3 2024-09-19T04:52:20.820 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.820 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.820 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.820 INFO:tasks.workunit.client.0.smithi002.stdout:172/600: open fd = 3 2024-09-19T04:52:20.821 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.821 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.821 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.821 INFO:tasks.workunit.client.0.smithi002.stdout:173/600: open fd = 3 2024-09-19T04:52:20.822 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.822 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.822 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.822 INFO:tasks.workunit.client.0.smithi002.stdout:174/600: open fd = 3 2024-09-19T04:52:20.822 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.822 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.822 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.822 INFO:tasks.workunit.client.0.smithi002.stdout:175/600: open fd = 3 2024-09-19T04:52:20.823 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.823 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.823 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.823 INFO:tasks.workunit.client.0.smithi002.stdout:176/600: open fd = 3 2024-09-19T04:52:20.823 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.823 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.823 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.824 INFO:tasks.workunit.client.0.smithi002.stdout:177/600: open fd = 3 2024-09-19T04:52:20.824 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.824 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.824 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.824 INFO:tasks.workunit.client.0.smithi002.stdout:178/600: open fd = 3 2024-09-19T04:52:20.824 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.824 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.824 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.824 INFO:tasks.workunit.client.0.smithi002.stdout:179/600: open fd = 3 2024-09-19T04:52:20.824 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.824 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.825 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.825 INFO:tasks.workunit.client.0.smithi002.stdout:180/600: open fd = 3 2024-09-19T04:52:20.825 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.825 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.825 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.825 INFO:tasks.workunit.client.0.smithi002.stdout:181/600: open fd = 3 2024-09-19T04:52:20.825 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.825 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.825 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.825 INFO:tasks.workunit.client.0.smithi002.stdout:182/600: open fd = 3 2024-09-19T04:52:20.825 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.825 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.826 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.826 INFO:tasks.workunit.client.0.smithi002.stdout:183/600: open fd = 3 2024-09-19T04:52:20.826 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.826 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.826 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.826 INFO:tasks.workunit.client.0.smithi002.stdout:184/600: open fd = 3 2024-09-19T04:52:20.826 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.826 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.826 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.826 INFO:tasks.workunit.client.0.smithi002.stdout:185/600: open fd = 3 2024-09-19T04:52:20.827 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.827 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.827 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.827 INFO:tasks.workunit.client.0.smithi002.stdout:186/600: open fd = 3 2024-09-19T04:52:20.827 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.827 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.827 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.827 INFO:tasks.workunit.client.0.smithi002.stdout:187/600: open fd = 3 2024-09-19T04:52:20.827 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.827 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.827 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:52:20.827 INFO:tasks.workunit.client.0.smithi002.stdout:188/600: open fd = 3 2024-09-19T04:52:20.827 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:20.828 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:52:21.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:21 smithi018 ceph-mon[34537]: pgmap v133: 97 pgs: 97 active+clean; 4.9 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 7 op/s 2024-09-19T04:52:21.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:21 smithi018 ceph-mon[34537]: scrub summary: idle 2024-09-19T04:52:21.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:21 smithi002 ceph-mon[30975]: pgmap v133: 97 pgs: 97 active+clean; 4.9 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 7 op/s 2024-09-19T04:52:21.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:21 smithi002 ceph-mon[30975]: scrub summary: idle 2024-09-19T04:52:21.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:21 smithi116 ceph-mon[34477]: pgmap v133: 97 pgs: 97 active+clean; 4.9 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 7 op/s 2024-09-19T04:52:21.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:21 smithi116 ceph-mon[34477]: scrub summary: idle 2024-09-19T04:52:23.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:23 smithi018 ceph-mon[34537]: pgmap v134: 97 pgs: 97 active+clean; 5.1 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 38 KiB/s wr, 10 op/s 2024-09-19T04:52:23.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:23 smithi002 ceph-mon[30975]: pgmap v134: 97 pgs: 97 active+clean; 5.1 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 38 KiB/s wr, 10 op/s 2024-09-19T04:52:23.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:23 smithi116 ceph-mon[34477]: pgmap v134: 97 pgs: 97 active+clean; 5.1 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 38 KiB/s wr, 10 op/s 2024-09-19T04:52:25.306 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:25 smithi018 ceph-mon[34537]: pgmap v135: 97 pgs: 97 active+clean; 5.1 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 7 op/s 2024-09-19T04:52:25.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:25 smithi002 ceph-mon[30975]: pgmap v135: 97 pgs: 97 active+clean; 5.1 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 7 op/s 2024-09-19T04:52:25.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:25 smithi116 ceph-mon[34477]: pgmap v135: 97 pgs: 97 active+clean; 5.1 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 7 op/s 2024-09-19T04:52:27.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:27 smithi018 ceph-mon[34537]: pgmap v136: 97 pgs: 97 active+clean; 5.2 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 40 KiB/s wr, 11 op/s 2024-09-19T04:52:27.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:27 smithi002 ceph-mon[30975]: pgmap v136: 97 pgs: 97 active+clean; 5.2 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 40 KiB/s wr, 11 op/s 2024-09-19T04:52:27.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:27 smithi116 ceph-mon[34477]: pgmap v136: 97 pgs: 97 active+clean; 5.2 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 40 KiB/s wr, 11 op/s 2024-09-19T04:52:29.306 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:29 smithi018 ceph-mon[34537]: pgmap v137: 97 pgs: 97 active+clean; 5.2 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 27 KiB/s wr, 7 op/s 2024-09-19T04:52:29.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:29 smithi002 ceph-mon[30975]: pgmap v137: 97 pgs: 97 active+clean; 5.2 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 27 KiB/s wr, 7 op/s 2024-09-19T04:52:29.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:29 smithi116 ceph-mon[34477]: pgmap v137: 97 pgs: 97 active+clean; 5.2 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 27 KiB/s wr, 7 op/s 2024-09-19T04:52:31.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:31 smithi018 ceph-mon[34537]: pgmap v138: 97 pgs: 97 active+clean; 5.2 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 27 KiB/s wr, 7 op/s 2024-09-19T04:52:31.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:31 smithi002 ceph-mon[30975]: pgmap v138: 97 pgs: 97 active+clean; 5.2 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 27 KiB/s wr, 7 op/s 2024-09-19T04:52:31.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:31 smithi116 ceph-mon[34477]: pgmap v138: 97 pgs: 97 active+clean; 5.2 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 27 KiB/s wr, 7 op/s 2024-09-19T04:52:33.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:33 smithi018 ceph-mon[34537]: pgmap v139: 97 pgs: 97 active+clean; 5.3 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 39 KiB/s wr, 11 op/s 2024-09-19T04:52:33.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:33 smithi002 ceph-mon[30975]: pgmap v139: 97 pgs: 97 active+clean; 5.3 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 39 KiB/s wr, 11 op/s 2024-09-19T04:52:33.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:33 smithi116 ceph-mon[34477]: pgmap v139: 97 pgs: 97 active+clean; 5.3 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 39 KiB/s wr, 11 op/s 2024-09-19T04:52:35.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:35 smithi018 ceph-mon[34537]: pgmap v140: 97 pgs: 97 active+clean; 5.3 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 7 op/s 2024-09-19T04:52:35.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:35 smithi002 ceph-mon[30975]: pgmap v140: 97 pgs: 97 active+clean; 5.3 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 7 op/s 2024-09-19T04:52:35.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:35 smithi116 ceph-mon[34477]: pgmap v140: 97 pgs: 97 active+clean; 5.3 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 7 op/s 2024-09-19T04:52:37.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:37 smithi018 ceph-mon[34537]: pgmap v141: 97 pgs: 97 active+clean; 5.5 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 41 KiB/s wr, 11 op/s 2024-09-19T04:52:37.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:37 smithi002 ceph-mon[30975]: pgmap v141: 97 pgs: 97 active+clean; 5.5 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 41 KiB/s wr, 11 op/s 2024-09-19T04:52:37.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:37 smithi116 ceph-mon[34477]: pgmap v141: 97 pgs: 97 active+clean; 5.5 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 41 KiB/s wr, 11 op/s 2024-09-19T04:52:39.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:39 smithi018 ceph-mon[34537]: pgmap v142: 97 pgs: 97 active+clean; 5.5 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 27 KiB/s wr, 8 op/s 2024-09-19T04:52:39.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:39 smithi002 ceph-mon[30975]: pgmap v142: 97 pgs: 97 active+clean; 5.5 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 27 KiB/s wr, 8 op/s 2024-09-19T04:52:39.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:39 smithi116 ceph-mon[34477]: pgmap v142: 97 pgs: 97 active+clean; 5.5 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 27 KiB/s wr, 8 op/s 2024-09-19T04:52:41.307 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:41 smithi018 ceph-mon[34537]: pgmap v143: 97 pgs: 97 active+clean; 5.5 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 27 KiB/s wr, 8 op/s 2024-09-19T04:52:41.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:41 smithi002 ceph-mon[30975]: pgmap v143: 97 pgs: 97 active+clean; 5.5 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 27 KiB/s wr, 8 op/s 2024-09-19T04:52:41.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:41 smithi116 ceph-mon[34477]: pgmap v143: 97 pgs: 97 active+clean; 5.5 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 27 KiB/s wr, 8 op/s 2024-09-19T04:52:43.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:43 smithi002 ceph-mon[30975]: pgmap v144: 97 pgs: 97 active+clean; 5.6 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 39 KiB/s wr, 11 op/s 2024-09-19T04:52:43.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:43 smithi116 ceph-mon[34477]: pgmap v144: 97 pgs: 97 active+clean; 5.6 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 39 KiB/s wr, 11 op/s 2024-09-19T04:52:43.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:43 smithi018 ceph-mon[34537]: pgmap v144: 97 pgs: 97 active+clean; 5.6 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 39 KiB/s wr, 11 op/s 2024-09-19T04:52:45.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:45 smithi002 ceph-mon[30975]: pgmap v145: 97 pgs: 97 active+clean; 5.6 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 7 op/s 2024-09-19T04:52:45.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:45 smithi116 ceph-mon[34477]: pgmap v145: 97 pgs: 97 active+clean; 5.6 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 7 op/s 2024-09-19T04:52:45.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:45 smithi018 ceph-mon[34537]: pgmap v145: 97 pgs: 97 active+clean; 5.6 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 7 op/s 2024-09-19T04:52:47.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:47 smithi002 ceph-mon[30975]: pgmap v146: 97 pgs: 97 active+clean; 5.8 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 41 KiB/s wr, 11 op/s 2024-09-19T04:52:47.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:47 smithi116 ceph-mon[34477]: pgmap v146: 97 pgs: 97 active+clean; 5.8 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 41 KiB/s wr, 11 op/s 2024-09-19T04:52:47.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:47 smithi018 ceph-mon[34537]: pgmap v146: 97 pgs: 97 active+clean; 5.8 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 41 KiB/s wr, 11 op/s 2024-09-19T04:52:49.359 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:49 smithi018 ceph-mon[34537]: pgmap v147: 97 pgs: 97 active+clean; 5.8 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 27 KiB/s wr, 7 op/s 2024-09-19T04:52:49.359 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:49 smithi002 ceph-mon[30975]: pgmap v147: 97 pgs: 97 active+clean; 5.8 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 27 KiB/s wr, 7 op/s 2024-09-19T04:52:49.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:49 smithi116 ceph-mon[34477]: pgmap v147: 97 pgs: 97 active+clean; 5.8 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 27 KiB/s wr, 7 op/s 2024-09-19T04:52:49.626 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:52:49.902 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:52:50.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.374+0000 7fad64935640 1 -- 172.21.15.2:0/530215859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad601036e0 msgr2=0x7fad60107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:50.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.374+0000 7fad64935640 1 --2- 172.21.15.2:0/530215859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad601036e0 0x7fad60107b90 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fad48009930 tx=0x7fad4802a420 comp rx=0 tx=0).stop 2024-09-19T04:52:50.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.374+0000 7fad64935640 1 -- 172.21.15.2:0/530215859 shutdown_connections 2024-09-19T04:52:50.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.374+0000 7fad64935640 1 --2- 172.21.15.2:0/530215859 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad601082a0 0x7fad6010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:50.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.374+0000 7fad64935640 1 --2- 172.21.15.2:0/530215859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad601036e0 0x7fad60107b90 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:50.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.374+0000 7fad64935640 1 --2- 172.21.15.2:0/530215859 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad60102d30 0x7fad60103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:50.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.374+0000 7fad64935640 1 -- 172.21.15.2:0/530215859 >> 172.21.15.2:0/530215859 conn(0x7fad600fc7d0 msgr2=0x7fad600febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:50.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.374+0000 7fad64935640 1 -- 172.21.15.2:0/530215859 shutdown_connections 2024-09-19T04:52:50.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.374+0000 7fad64935640 1 -- 172.21.15.2:0/530215859 wait complete. 2024-09-19T04:52:50.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.375+0000 7fad64935640 1 Processor -- start 2024-09-19T04:52:50.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.375+0000 7fad64935640 1 -- start start 2024-09-19T04:52:50.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.375+0000 7fad64935640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad60102d30 0x7fad60198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:50.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.375+0000 7fad64935640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad601036e0 0x7fad60198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:50.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.375+0000 7fad64935640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad601082a0 0x7fad6019ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:50.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.376+0000 7fad64935640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fad60111f50 con 0x7fad601036e0 2024-09-19T04:52:50.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.376+0000 7fad64935640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fad60111dd0 con 0x7fad60102d30 2024-09-19T04:52:50.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.376+0000 7fad64935640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fad601120d0 con 0x7fad601082a0 2024-09-19T04:52:50.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.376+0000 7fad55d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad601036e0 0x7fad60198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:50.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.376+0000 7fad5e59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad60102d30 0x7fad60198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:50.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.376+0000 7fad55d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad601036e0 0x7fad60198ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49154/0 (socket says 172.21.15.2:49154) 2024-09-19T04:52:50.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.376+0000 7fad5e59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad60102d30 0x7fad60198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.2:49366/0 (socket says 172.21.15.2:49366) 2024-09-19T04:52:50.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.376+0000 7fad55d9b640 1 -- 172.21.15.2:0/1085716529 learned_addr learned my addr 172.21.15.2:0/1085716529 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:50.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.376+0000 7fad5ed9d640 1 --2- 172.21.15.2:0/1085716529 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad601082a0 0x7fad6019ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:50.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.376+0000 7fad5e59c640 1 -- 172.21.15.2:0/1085716529 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad601082a0 msgr2=0x7fad6019ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:50.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.376+0000 7fad5e59c640 1 --2- 172.21.15.2:0/1085716529 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad601082a0 0x7fad6019ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:50.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.376+0000 7fad5e59c640 1 -- 172.21.15.2:0/1085716529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad601036e0 msgr2=0x7fad60198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:50.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.376+0000 7fad5e59c640 1 --2- 172.21.15.2:0/1085716529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad601036e0 0x7fad60198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:50.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.376+0000 7fad5e59c640 1 -- 172.21.15.2:0/1085716529 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad6019d530 con 0x7fad60102d30 2024-09-19T04:52:50.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.376+0000 7fad5ed9d640 1 --2- 172.21.15.2:0/1085716529 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad601082a0 0x7fad6019ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:52:50.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.376+0000 7fad5e59c640 1 --2- 172.21.15.2:0/1085716529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad60102d30 0x7fad60198580 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fad500099c0 tx=0x7fad50009e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:50.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.377+0000 7fad57fff640 1 -- 172.21.15.2:0/1085716529 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad500078c0 con 0x7fad60102d30 2024-09-19T04:52:50.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.377+0000 7fad64935640 1 -- 172.21.15.2:0/1085716529 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad6019d820 con 0x7fad60102d30 2024-09-19T04:52:50.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.377+0000 7fad57fff640 1 -- 172.21.15.2:0/1085716529 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fad50005020 con 0x7fad60102d30 2024-09-19T04:52:50.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.377+0000 7fad64935640 1 -- 172.21.15.2:0/1085716529 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad601008c0 con 0x7fad60102d30 2024-09-19T04:52:50.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.377+0000 7fad57fff640 1 -- 172.21.15.2:0/1085716529 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad50004c30 con 0x7fad60102d30 2024-09-19T04:52:50.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.380+0000 7fad57fff640 1 -- 172.21.15.2:0/1085716529 <== mon.2 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fad50007a60 con 0x7fad60102d30 2024-09-19T04:52:50.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.380+0000 7fad66d0e740 1 Processor -- start 2024-09-19T04:52:50.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.380+0000 7fad66d0e740 1 -- start start 2024-09-19T04:52:50.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.381+0000 7fad66d0e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56206722a4a0 0x56206722a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:50.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.381+0000 7fad66d0e740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56206722adc0 0x562067235140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:50.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.381+0000 7fad66d0e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562067235680 0x562067237a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:50.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.381+0000 7fad66d0e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5620671902e0 con 0x562067235680 2024-09-19T04:52:50.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.381+0000 7fad66d0e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562067137ce0 con 0x56206722a4a0 2024-09-19T04:52:50.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.381+0000 7fad66d0e740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x56206718c2a0 con 0x56206722adc0 2024-09-19T04:52:50.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.381+0000 7fad55d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562067235680 0x562067237a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:50.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.381+0000 7fad5ed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56206722a4a0 0x56206722a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:50.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.381+0000 7fad5ed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56206722a4a0 0x56206722a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.2:49376/0 (socket says 172.21.15.2:49376) 2024-09-19T04:52:50.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.381+0000 7fad55d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562067235680 0x562067237a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49158/0 (socket says 172.21.15.2:49158) 2024-09-19T04:52:50.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.381+0000 7fad57fff640 1 --2- 172.21.15.2:0/1085716529 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fad4c0a3430 0x7fad4c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:50.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.381+0000 7fad5ed9d640 1 -- 172.21.15.2:0/2550361344 learned_addr learned my addr 172.21.15.2:0/2550361344 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:50.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.381+0000 7fad5e59c640 1 --2- 172.21.15.2:0/2550361344 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56206722adc0 0x562067235140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:50.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.381+0000 7fad55d9b640 1 -- 172.21.15.2:0/2550361344 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56206722adc0 msgr2=0x562067235140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:50.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.381+0000 7fad55d9b640 1 --2- 172.21.15.2:0/2550361344 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56206722adc0 0x562067235140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:50.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.381+0000 7fad55d9b640 1 -- 172.21.15.2:0/2550361344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56206722a4a0 msgr2=0x56206722a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:50.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.381+0000 7fad55d9b640 1 --2- 172.21.15.2:0/2550361344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56206722a4a0 0x56206722a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:50.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.381+0000 7fad55d9b640 1 -- 172.21.15.2:0/2550361344 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56206711c440 con 0x562067235680 2024-09-19T04:52:50.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.381+0000 7fad5ed9d640 1 --2- 172.21.15.2:0/2550361344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56206722a4a0 0x56206722a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:52:50.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.381+0000 7fad57fff640 1 -- 172.21.15.2:0/1085716529 <== mon.2 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7fad500d3120 con 0x7fad60102d30 2024-09-19T04:52:50.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.381+0000 7fad5e59c640 1 --2- 172.21.15.2:0/2550361344 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56206722adc0 0x562067235140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:52:50.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.381+0000 7fad5ed9d640 1 --2- 172.21.15.2:0/1085716529 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fad4c0a3430 0x7fad4c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:50.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.382+0000 7fad55d9b640 1 --2- 172.21.15.2:0/2550361344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562067235680 0x562067237a70 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fad48009900 tx=0x7fad48031dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8494541bb9ecb5fc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:50.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.382+0000 7fad54d99640 1 -- 172.21.15.2:0/2550361344 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad48040070 con 0x562067235680 2024-09-19T04:52:50.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.382+0000 7fad54d99640 1 -- 172.21.15.2:0/2550361344 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fad480316a0 con 0x562067235680 2024-09-19T04:52:50.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.382+0000 7fad54d99640 1 -- 172.21.15.2:0/2550361344 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad48035040 con 0x562067235680 2024-09-19T04:52:50.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.383+0000 7fad66d0e740 1 -- 172.21.15.2:0/2550361344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562067235680 msgr2=0x562067237a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:50.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.383+0000 7fad66d0e740 1 --2- 172.21.15.2:0/2550361344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562067235680 0x562067237a70 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fad48009900 tx=0x7fad48031dc0 comp rx=0 tx=0).stop 2024-09-19T04:52:50.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.383+0000 7fad5ed9d640 1 --2- 172.21.15.2:0/1085716529 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fad4c0a3430 0x7fad4c0a58f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fad58011660 tx=0x7fad58004a40 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:50.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.383+0000 7fad66d0e740 1 -- 172.21.15.2:0/2550361344 shutdown_connections 2024-09-19T04:52:50.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.383+0000 7fad66d0e740 1 --2- 172.21.15.2:0/2550361344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562067235680 0x562067237a70 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:50.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.383+0000 7fad66d0e740 1 --2- 172.21.15.2:0/2550361344 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56206722adc0 0x562067235140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:50.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.383+0000 7fad66d0e740 1 --2- 172.21.15.2:0/2550361344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56206722a4a0 0x56206722a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:50.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.383+0000 7fad66d0e740 1 -- 172.21.15.2:0/2550361344 >> 172.21.15.2:0/2550361344 conn(0x562067226a30 msgr2=0x562067226e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:50.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.383+0000 7fad66d0e740 1 -- 172.21.15.2:0/2550361344 shutdown_connections 2024-09-19T04:52:50.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.383+0000 7fad66d0e740 1 -- 172.21.15.2:0/2550361344 wait complete. 2024-09-19T04:52:50.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.383+0000 7fad66d0e740 1 -- start start 2024-09-19T04:52:50.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.383+0000 7fad66d0e740 1 Processor -- start 2024-09-19T04:52:50.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.384+0000 7fad66d0e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56206722a4a0 0x562067234e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:50.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.384+0000 7fad66d0e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56206722adc0 0x562067232130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:50.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.384+0000 7fad66d0e740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562067235680 0x562067232670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:50.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.384+0000 7fad66d0e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562067238250 con 0x56206722adc0 2024-09-19T04:52:50.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.384+0000 7fad66d0e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56206714b050 con 0x56206722a4a0 2024-09-19T04:52:50.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.384+0000 7fad66d0e740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5620672383d0 con 0x562067235680 2024-09-19T04:52:50.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.384+0000 7fad66d0e740 10 client.0 _ll_register_callbacks cb 0x56206718b160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:52:50.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.384+0000 7fad55d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56206722adc0 0x562067232130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:50.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.384+0000 7fad55d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56206722adc0 0x562067232130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49170/0 (socket says 172.21.15.2:49170) 2024-09-19T04:52:50.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.384+0000 7fad55d9b640 1 -- 172.21.15.2:0/3726355356 learned_addr learned my addr 172.21.15.2:0/3726355356 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:50.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.384+0000 7fad5e59c640 1 --2- 172.21.15.2:0/3726355356 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56206722a4a0 0x562067234e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:50.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.384+0000 7fad5ed9d640 1 --2- 172.21.15.2:0/3726355356 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562067235680 0x562067232670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:50.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.384+0000 7fad55d9b640 1 -- 172.21.15.2:0/3726355356 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562067235680 msgr2=0x562067232670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:50.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.384+0000 7fad55d9b640 1 --2- 172.21.15.2:0/3726355356 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562067235680 0x562067232670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:50.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.384+0000 7fad55d9b640 1 -- 172.21.15.2:0/3726355356 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56206722a4a0 msgr2=0x562067234e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:50.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.384+0000 7fad55d9b640 1 --2- 172.21.15.2:0/3726355356 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56206722a4a0 0x562067234e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:50.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.384+0000 7fad55d9b640 1 -- 172.21.15.2:0/3726355356 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562066f013c0 con 0x56206722adc0 2024-09-19T04:52:50.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.384+0000 7fad55d9b640 1 --2- 172.21.15.2:0/3726355356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56206722adc0 0x562067232130 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fad48031c00 tx=0x7fad480314a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dc71ff000eb860 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:50.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.384+0000 7fad45ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:52:50.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.384+0000 7fad45ffb640 1 -- 172.21.15.2:0/3726355356 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad4804b020 con 0x56206722adc0 2024-09-19T04:52:50.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.384+0000 7fad45ffb640 1 -- 172.21.15.2:0/3726355356 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7fad48004250 con 0x56206722adc0 2024-09-19T04:52:50.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.384+0000 7fad66d0e740 1 -- 172.21.15.2:0/3726355356 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad480316a0 con 0x56206722adc0 2024-09-19T04:52:50.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.385+0000 7fad45ffb640 1 -- 172.21.15.2:0/3726355356 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fad48035070 con 0x56206722adc0 2024-09-19T04:52:50.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.385+0000 7fad66d0e740 10 client.15882 fetch_fsmap learned FSMap version 19 2024-09-19T04:52:50.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.385+0000 7fad66d0e740 1 -- 172.21.15.2:0/3726355356 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x562067243b10 con 0x56206722adc0 2024-09-19T04:52:50.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.385+0000 7fad45ffb640 1 -- 172.21.15.2:0/3726355356 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fad480316a0 con 0x56206722adc0 2024-09-19T04:52:50.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.385+0000 7fad45ffb640 1 -- 172.21.15.2:0/3726355356 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fad4803c600 con 0x56206722adc0 2024-09-19T04:52:50.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.385+0000 7fad66d0e740 10 client.15882 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:52:50.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.385+0000 7fad66d0e740 10 client.15882 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:52:50.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.385+0000 7fad66d0e740 20 client.15882 populate_metadata read hostname 'smithi002' 2024-09-19T04:52:50.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.385+0000 7fad66d0e740 1 --2- 172.21.15.2:0/3726355356 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x562067244e60 0x562067247250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:50.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.385+0000 7fad66d0e740 4 client.15882 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:52:50.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.385+0000 7fad66d0e740 1 -- 172.21.15.2:0/3726355356 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56206719d850 con 0x562067244e60 2024-09-19T04:52:50.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.385+0000 7fad5e59c640 1 --2- 172.21.15.2:0/3726355356 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x562067244e60 0x562067247250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:50.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.386+0000 7fad5e59c640 1 --2- 172.21.15.2:0/3726355356 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x562067244e60 0x562067247250 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff8368ff1abaf096 server_cookie=abc3e4fd64d0a728 in_seq=0 out_seq=0 2024-09-19T04:52:50.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.386+0000 7fad45ffb640 10 client.15882 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:52:50.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.386+0000 7fad45ffb640 1 -- 172.21.15.2:0/3726355356 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56206719d850 con 0x562067244e60 2024-09-19T04:52:50.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.387+0000 7fad45ffb640 10 client.15882 handle_command_reply: tid=0 2024-09-19T04:52:50.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.387+0000 7fad66d0e740 1 client.15882 shutdown 2024-09-19T04:52:50.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.387+0000 7fad66d0e740 1 -- 172.21.15.2:0/3726355356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56206722adc0 msgr2=0x562067232130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:50.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.387+0000 7fad66d0e740 1 --2- 172.21.15.2:0/3726355356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56206722adc0 0x562067232130 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fad48031c00 tx=0x7fad480314a0 comp rx=0 tx=0).stop 2024-09-19T04:52:50.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.387+0000 7fad66d0e740 1 -- 172.21.15.2:0/3726355356 shutdown_connections 2024-09-19T04:52:50.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.387+0000 7fad66d0e740 1 --2- 172.21.15.2:0/3726355356 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x562067244e60 0x562067247250 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:50.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.387+0000 7fad45ffb640 0 client.15882 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:52:50.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.387+0000 7fad66d0e740 1 --2- 172.21.15.2:0/3726355356 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562067235680 0x562067232670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:50.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.387+0000 7fad66d0e740 1 --2- 172.21.15.2:0/3726355356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56206722adc0 0x562067232130 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:50.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.387+0000 7fad66d0e740 1 --2- 172.21.15.2:0/3726355356 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56206722a4a0 0x562067234e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:50.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.387+0000 7fad66d0e740 1 -- 172.21.15.2:0/3726355356 >> 172.21.15.2:0/3726355356 conn(0x562067226a30 msgr2=0x56206722c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:50.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.387+0000 7fad66d0e740 1 -- 172.21.15.2:0/3726355356 shutdown_connections 2024-09-19T04:52:50.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.387+0000 7fad66d0e740 1 -- 172.21.15.2:0/3726355356 wait complete. 2024-09-19T04:52:50.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.387+0000 7fad66d0e740 20 client.15882 trim_cache size 0 max 16384 2024-09-19T04:52:50.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.404+0000 7fad66d0e740 1 Processor -- start 2024-09-19T04:52:50.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.404+0000 7fad66d0e740 1 -- start start 2024-09-19T04:52:50.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.405+0000 7fad66d0e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56206722a4a0 0x562067226e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:50.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.405+0000 7fad66d0e740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56206722adc0 0x562067231110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:50.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.405+0000 7fad66d0e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562067235680 0x56206724c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:50.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.405+0000 7fad66d0e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fad4000c680 con 0x56206722a4a0 2024-09-19T04:52:50.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.405+0000 7fad66d0e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fad4000ef00 con 0x562067235680 2024-09-19T04:52:50.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.405+0000 7fad66d0e740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fad4000ccf0 con 0x56206722adc0 2024-09-19T04:52:50.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.405+0000 7fad5e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56206722a4a0 0x562067226e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:50.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.405+0000 7fad5e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56206722a4a0 0x562067226e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49182/0 (socket says 172.21.15.2:49182) 2024-09-19T04:52:50.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.405+0000 7fad5e59c640 1 -- 172.21.15.2:0/679257408 learned_addr learned my addr 172.21.15.2:0/679257408 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:50.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.405+0000 7fad55d9b640 1 --2- 172.21.15.2:0/679257408 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56206722adc0 0x562067231110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:50.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.405+0000 7fad5ed9d640 1 --2- 172.21.15.2:0/679257408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562067235680 0x56206724c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:50.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.405+0000 7fad5e59c640 1 -- 172.21.15.2:0/679257408 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56206722adc0 msgr2=0x562067231110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:50.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.405+0000 7fad5e59c640 1 --2- 172.21.15.2:0/679257408 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56206722adc0 0x562067231110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:50.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.405+0000 7fad5e59c640 1 -- 172.21.15.2:0/679257408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562067235680 msgr2=0x56206724c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:50.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.405+0000 7fad5e59c640 1 --2- 172.21.15.2:0/679257408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562067235680 0x56206724c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:50.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.405+0000 7fad5e59c640 1 -- 172.21.15.2:0/679257408 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620672351f0 con 0x56206722a4a0 2024-09-19T04:52:50.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.405+0000 7fad55d9b640 1 --2- 172.21.15.2:0/679257408 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56206722adc0 0x562067231110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:52:50.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.405+0000 7fad5e59c640 1 --2- 172.21.15.2:0/679257408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56206722a4a0 0x562067226e10 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fad5009b820 tx=0x7fad500721f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c028bbbf63dc57ce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:50.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.405+0000 7fad47fff640 1 -- 172.21.15.2:0/679257408 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad5009d460 con 0x56206722a4a0 2024-09-19T04:52:50.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.406+0000 7fad47fff640 1 -- 172.21.15.2:0/679257408 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fad50004dd0 con 0x56206722a4a0 2024-09-19T04:52:50.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.406+0000 7fad47fff640 1 -- 172.21.15.2:0/679257408 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad500d50b0 con 0x56206722a4a0 2024-09-19T04:52:50.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.406+0000 7fad66d0e740 1 -- 172.21.15.2:0/679257408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56206722a4a0 msgr2=0x562067226e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:50.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.406+0000 7fad66d0e740 1 --2- 172.21.15.2:0/679257408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56206722a4a0 0x562067226e10 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fad5009b820 tx=0x7fad500721f0 comp rx=0 tx=0).stop 2024-09-19T04:52:50.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.406+0000 7fad66d0e740 1 -- 172.21.15.2:0/679257408 shutdown_connections 2024-09-19T04:52:50.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.406+0000 7fad66d0e740 1 --2- 172.21.15.2:0/679257408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562067235680 0x56206724c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:50.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.406+0000 7fad66d0e740 1 --2- 172.21.15.2:0/679257408 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56206722adc0 0x562067231110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:50.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.406+0000 7fad66d0e740 1 --2- 172.21.15.2:0/679257408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56206722a4a0 0x562067226e10 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:50.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.406+0000 7fad66d0e740 1 -- 172.21.15.2:0/679257408 >> 172.21.15.2:0/679257408 conn(0x562067226a30 msgr2=0x562067230a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:50.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.406+0000 7fad66d0e740 1 -- 172.21.15.2:0/679257408 shutdown_connections 2024-09-19T04:52:50.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.406+0000 7fad66d0e740 1 -- 172.21.15.2:0/679257408 wait complete. 2024-09-19T04:52:50.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.407+0000 7fad66d0e740 1 -- start start 2024-09-19T04:52:50.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.407+0000 7fad66d0e740 1 Processor -- start 2024-09-19T04:52:50.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.407+0000 7fad66d0e740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56206722a4a0 0x56206723d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:50.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.407+0000 7fad66d0e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56206722adc0 0x56206723dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:50.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.407+0000 7fad66d0e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562067235680 0x562067238610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:50.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.407+0000 7fad66d0e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fad4000d3c0 con 0x562067235680 2024-09-19T04:52:50.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.407+0000 7fad66d0e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fad4000e830 con 0x56206722adc0 2024-09-19T04:52:50.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.407+0000 7fad66d0e740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fad4000da90 con 0x56206722a4a0 2024-09-19T04:52:50.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.407+0000 7fad66d0e740 10 client.0 _ll_register_callbacks cb 0x7fad5800a6d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:52:50.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.407+0000 7fad5ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562067235680 0x562067238610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:50.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.407+0000 7fad5ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562067235680 0x562067238610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49198/0 (socket says 172.21.15.2:49198) 2024-09-19T04:52:50.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.407+0000 7fad5ed9d640 1 -- 172.21.15.2:0/196647679 learned_addr learned my addr 172.21.15.2:0/196647679 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:50.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.407+0000 7fad5e59c640 1 --2- 172.21.15.2:0/196647679 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56206722a4a0 0x56206723d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:50.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.407+0000 7fad55d9b640 1 --2- 172.21.15.2:0/196647679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56206722adc0 0x56206723dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:50.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.408+0000 7fad5ed9d640 1 -- 172.21.15.2:0/196647679 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56206722a4a0 msgr2=0x56206723d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:50.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.408+0000 7fad5ed9d640 1 --2- 172.21.15.2:0/196647679 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56206722a4a0 0x56206723d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:50.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.408+0000 7fad5ed9d640 1 -- 172.21.15.2:0/196647679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56206722adc0 msgr2=0x56206723dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:50.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.408+0000 7fad5ed9d640 1 --2- 172.21.15.2:0/196647679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56206722adc0 0x56206723dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:50.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.408+0000 7fad5ed9d640 1 -- 172.21.15.2:0/196647679 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562067238b50 con 0x562067235680 2024-09-19T04:52:50.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.408+0000 7fad5ed9d640 1 --2- 172.21.15.2:0/196647679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562067235680 0x562067238610 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fad5800acc0 tx=0x7fad5800a5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6671f868ef113aae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:50.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.408+0000 7fad45ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:52:50.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.408+0000 7fad45ffb640 1 -- 172.21.15.2:0/196647679 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad5801f430 con 0x562067235680 2024-09-19T04:52:50.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.408+0000 7fad45ffb640 1 -- 172.21.15.2:0/196647679 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7fad5801f5d0 con 0x562067235680 2024-09-19T04:52:50.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.408+0000 7fad66d0e740 1 -- 172.21.15.2:0/196647679 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad50004dd0 con 0x562067235680 2024-09-19T04:52:50.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.408+0000 7fad45ffb640 1 -- 172.21.15.2:0/196647679 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fad5801f7d0 con 0x562067235680 2024-09-19T04:52:50.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.408+0000 7fad66d0e740 10 client.15888 fetch_fsmap learned FSMap version 19 2024-09-19T04:52:50.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.408+0000 7fad66d0e740 1 -- 172.21.15.2:0/196647679 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5620672affa0 con 0x562067235680 2024-09-19T04:52:50.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.408+0000 7fad45ffb640 1 -- 172.21.15.2:0/196647679 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fad50004dd0 con 0x562067235680 2024-09-19T04:52:50.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.409+0000 7fad45ffb640 1 -- 172.21.15.2:0/196647679 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fad58030050 con 0x562067235680 2024-09-19T04:52:50.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.409+0000 7fad66d0e740 10 client.15888 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:52:50.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.409+0000 7fad66d0e740 10 client.15888 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:52:50.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.409+0000 7fad66d0e740 20 client.15888 populate_metadata read hostname 'smithi002' 2024-09-19T04:52:50.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.409+0000 7fad66d0e740 1 --2- 172.21.15.2:0/196647679 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x562067244e60 0x5620672b2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:50.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.409+0000 7fad66d0e740 4 client.15888 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:52:50.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.409+0000 7fad66d0e740 1 -- 172.21.15.2:0/196647679 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562067197d60 con 0x562067244e60 2024-09-19T04:52:50.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.409+0000 7fad5e59c640 1 --2- 172.21.15.2:0/196647679 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x562067244e60 0x5620672b2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:50.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.409+0000 7fad5e59c640 1 --2- 172.21.15.2:0/196647679 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x562067244e60 0x5620672b2790 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9062cc88cb3b9a40 server_cookie=fcc60603e6559e93 in_seq=0 out_seq=0 2024-09-19T04:52:50.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.409+0000 7fad45ffb640 10 client.15888 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:52:50.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.410+0000 7fad45ffb640 1 -- 172.21.15.2:0/196647679 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x562067197d60 con 0x562067244e60 2024-09-19T04:52:50.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.410+0000 7fad45ffb640 10 client.15888 handle_command_reply: tid=0 2024-09-19T04:52:50.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.410+0000 7fad66d0e740 1 client.15888 shutdown 2024-09-19T04:52:50.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.410+0000 7fad66d0e740 1 -- 172.21.15.2:0/196647679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562067235680 msgr2=0x562067238610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:50.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.410+0000 7fad66d0e740 1 --2- 172.21.15.2:0/196647679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562067235680 0x562067238610 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fad5800acc0 tx=0x7fad5800a5e0 comp rx=0 tx=0).stop 2024-09-19T04:52:50.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.410+0000 7fad66d0e740 1 -- 172.21.15.2:0/196647679 shutdown_connections 2024-09-19T04:52:50.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.410+0000 7fad66d0e740 1 --2- 172.21.15.2:0/196647679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562067235680 0x562067238610 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:50.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.410+0000 7fad66d0e740 1 --2- 172.21.15.2:0/196647679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56206722adc0 0x56206723dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:50.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.410+0000 7fad66d0e740 1 --2- 172.21.15.2:0/196647679 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x562067244e60 0x5620672b2790 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:50.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.410+0000 7fad66d0e740 1 --2- 172.21.15.2:0/196647679 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56206722a4a0 0x56206723d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:50.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.410+0000 7fad66d0e740 1 -- 172.21.15.2:0/196647679 >> 172.21.15.2:0/196647679 conn(0x562067226a30 msgr2=0x562067231220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:50.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.410+0000 7fad45ffb640 0 client.15888 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:52:50.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.410+0000 7fad66d0e740 1 -- 172.21.15.2:0/196647679 shutdown_connections 2024-09-19T04:52:50.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.410+0000 7fad66d0e740 1 -- 172.21.15.2:0/196647679 wait complete. 2024-09-19T04:52:50.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.410+0000 7fad66d0e740 20 client.15888 trim_cache size 0 max 16384 2024-09-19T04:52:50.417 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:52:50.417 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T04:52:50.417 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T04:52:50.418 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:52:50.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.411+0000 7fad64935640 1 -- 172.21.15.2:0/1085716529 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fad4c0a3430 msgr2=0x7fad4c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:50.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.411+0000 7fad64935640 1 --2- 172.21.15.2:0/1085716529 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fad4c0a3430 0x7fad4c0a58f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fad58011660 tx=0x7fad58004a40 comp rx=0 tx=0).stop 2024-09-19T04:52:50.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.411+0000 7fad64935640 1 -- 172.21.15.2:0/1085716529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad60102d30 msgr2=0x7fad60198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:50.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.411+0000 7fad64935640 1 --2- 172.21.15.2:0/1085716529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad60102d30 0x7fad60198580 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fad500099c0 tx=0x7fad50009e80 comp rx=0 tx=0).stop 2024-09-19T04:52:50.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.411+0000 7fad64935640 1 -- 172.21.15.2:0/1085716529 shutdown_connections 2024-09-19T04:52:50.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.411+0000 7fad64935640 1 --2- 172.21.15.2:0/1085716529 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fad4c0a3430 0x7fad4c0a58f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:50.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.411+0000 7fad64935640 1 --2- 172.21.15.2:0/1085716529 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad601082a0 0x7fad6019ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:50.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.411+0000 7fad64935640 1 --2- 172.21.15.2:0/1085716529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad601036e0 0x7fad60198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:50.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.411+0000 7fad64935640 1 --2- 172.21.15.2:0/1085716529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad60102d30 0x7fad60198580 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:50.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.411+0000 7fad64935640 1 -- 172.21.15.2:0/1085716529 >> 172.21.15.2:0/1085716529 conn(0x7fad600fc7d0 msgr2=0x7fad60105ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:50.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.411+0000 7fad64935640 1 -- 172.21.15.2:0/1085716529 shutdown_connections 2024-09-19T04:52:50.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:50.411+0000 7fad64935640 1 -- 172.21.15.2:0/1085716529 wait complete. 2024-09-19T04:52:51.280 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:52:51.281 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:52:51.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:51 smithi002 ceph-mon[30975]: pgmap v148: 97 pgs: 97 active+clean; 5.8 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 27 KiB/s wr, 7 op/s 2024-09-19T04:52:51.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:51 smithi116 ceph-mon[34477]: pgmap v148: 97 pgs: 97 active+clean; 5.8 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 27 KiB/s wr, 7 op/s 2024-09-19T04:52:51.543 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:52:51.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:51 smithi018 ceph-mon[34537]: pgmap v148: 97 pgs: 97 active+clean; 5.8 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 27 KiB/s wr, 7 op/s 2024-09-19T04:52:52.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.003+0000 7fe14138b640 1 -- 172.21.15.2:0/2232875048 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe13c101de0 msgr2=0x7fe13c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:52.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.003+0000 7fe14138b640 1 --2- 172.21.15.2:0/2232875048 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe13c101de0 0x7fe13c1021c0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fe12c009900 tx=0x7fe12c02a410 comp rx=0 tx=0).stop 2024-09-19T04:52:52.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.003+0000 7fe14138b640 1 -- 172.21.15.2:0/2232875048 shutdown_connections 2024-09-19T04:52:52.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.003+0000 7fe14138b640 1 --2- 172.21.15.2:0/2232875048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe13c106f10 0x7fe13c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:52.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.003+0000 7fe14138b640 1 --2- 172.21.15.2:0/2232875048 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe13c102790 0x7fe13c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:52.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.003+0000 7fe14138b640 1 --2- 172.21.15.2:0/2232875048 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe13c101de0 0x7fe13c1021c0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:52.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.003+0000 7fe14138b640 1 -- 172.21.15.2:0/2232875048 >> 172.21.15.2:0/2232875048 conn(0x7fe13c0fd8c0 msgr2=0x7fe13c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:52.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.003+0000 7fe14138b640 1 -- 172.21.15.2:0/2232875048 shutdown_connections 2024-09-19T04:52:52.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.003+0000 7fe14138b640 1 -- 172.21.15.2:0/2232875048 wait complete. 2024-09-19T04:52:52.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.004+0000 7fe14138b640 1 Processor -- start 2024-09-19T04:52:52.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.004+0000 7fe14138b640 1 -- start start 2024-09-19T04:52:52.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.004+0000 7fe14138b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe13c101de0 0x7fe13c1982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:52.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.004+0000 7fe14138b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe13c102790 0x7fe13c198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:52.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.004+0000 7fe14138b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe13c106f10 0x7fe13c19cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:52.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.004+0000 7fe14138b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe13c111e20 con 0x7fe13c101de0 2024-09-19T04:52:52.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.004+0000 7fe14138b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe13c111ca0 con 0x7fe13c102790 2024-09-19T04:52:52.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.004+0000 7fe14138b640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fe13c111fa0 con 0x7fe13c106f10 2024-09-19T04:52:52.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.004+0000 7fe13affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe13c101de0 0x7fe13c1982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:52.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.004+0000 7fe13affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe13c101de0 0x7fe13c1982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43194/0 (socket says 172.21.15.2:43194) 2024-09-19T04:52:52.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.004+0000 7fe13affd640 1 -- 172.21.15.2:0/1666561199 learned_addr learned my addr 172.21.15.2:0/1666561199 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:52.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.004+0000 7fe13a7fc640 1 --2- 172.21.15.2:0/1666561199 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe13c102790 0x7fe13c198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:52.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.004+0000 7fe13b7fe640 1 --2- 172.21.15.2:0/1666561199 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe13c106f10 0x7fe13c19cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:52.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.005+0000 7fe13affd640 1 -- 172.21.15.2:0/1666561199 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe13c106f10 msgr2=0x7fe13c19cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:52.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.005+0000 7fe13affd640 1 --2- 172.21.15.2:0/1666561199 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe13c106f10 0x7fe13c19cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:52.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.005+0000 7fe13affd640 1 -- 172.21.15.2:0/1666561199 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe13c102790 msgr2=0x7fe13c198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:52.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.005+0000 7fe13affd640 1 --2- 172.21.15.2:0/1666561199 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe13c102790 0x7fe13c198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:52.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.005+0000 7fe13affd640 1 -- 172.21.15.2:0/1666561199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe13c19d290 con 0x7fe13c101de0 2024-09-19T04:52:52.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.005+0000 7fe13affd640 1 --2- 172.21.15.2:0/1666561199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe13c101de0 0x7fe13c1982e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fe12c005940 tx=0x7fe12c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:52.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.005+0000 7fe123fff640 1 -- 172.21.15.2:0/1666561199 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe12c03f030 con 0x7fe13c101de0 2024-09-19T04:52:52.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.005+0000 7fe123fff640 1 -- 172.21.15.2:0/1666561199 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe12c003aa0 con 0x7fe13c101de0 2024-09-19T04:52:52.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.005+0000 7fe14138b640 1 -- 172.21.15.2:0/1666561199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe13c19d520 con 0x7fe13c101de0 2024-09-19T04:52:52.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.005+0000 7fe123fff640 1 -- 172.21.15.2:0/1666561199 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe12c035070 con 0x7fe13c101de0 2024-09-19T04:52:52.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.005+0000 7fe14138b640 1 -- 172.21.15.2:0/1666561199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe13c1a4e60 con 0x7fe13c101de0 2024-09-19T04:52:52.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.006+0000 7fe14138b640 1 -- 172.21.15.2:0/1666561199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe13c1032c0 con 0x7fe13c101de0 2024-09-19T04:52:52.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.008+0000 7fe123fff640 1 -- 172.21.15.2:0/1666561199 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fe12c042030 con 0x7fe13c101de0 2024-09-19T04:52:52.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.008+0000 7fe123fff640 1 --2- 172.21.15.2:0/1666561199 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fe1240a33b0 0x7fe1240a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:52.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.008+0000 7fe13a7fc640 1 --2- 172.21.15.2:0/1666561199 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fe1240a33b0 0x7fe1240a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:52.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.008+0000 7fe123fff640 1 -- 172.21.15.2:0/1666561199 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7fe12c0f0400 con 0x7fe13c101de0 2024-09-19T04:52:52.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.009+0000 7fe13a7fc640 1 --2- 172.21.15.2:0/1666561199 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fe1240a33b0 0x7fe1240a5870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe13c0fdd50 tx=0x7fe13000b390 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:52.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.012+0000 7fe123fff640 1 -- 172.21.15.2:0/1666561199 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe12c0bc7b0 con 0x7fe13c101de0 2024-09-19T04:52:52.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.226+0000 7fe14138b640 1 -- 172.21.15.2:0/1666561199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe13c10a0f0 con 0x7fe13c101de0 2024-09-19T04:52:52.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.227+0000 7fe123fff640 1 -- 172.21.15.2:0/1666561199 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11840 (secure 0 0 0) 0x7fe12c0c0ab0 con 0x7fe13c101de0 2024-09-19T04:52:52.233 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:52:52.233 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":19,"btime":"2024-09-19T04:46:33:537239+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2467365137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2467365137},{"type":"v1","addr":"172.21.15.2:6835","nonce":2467365137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3162441888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3162441888},{"type":"v1","addr":"172.21.15.2:6837","nonce":3162441888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14631,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2740862966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2740862966},{"type":"v1","addr":"172.21.15.2:6839","nonce":2740862966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/2394435504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2394435504},{"type":"v1","addr":"172.21.15.2:6841","nonce":2394435504}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1630480244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1630480244},{"type":"v1","addr":"172.21.15.18:6833","nonce":1630480244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1553897465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1553897465},{"type":"v1","addr":"172.21.15.116:6833","nonce":1553897465}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3035664608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3035664608},{"type":"v1","addr":"172.21.15.18:6835","nonce":3035664608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1096622392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1096622392},{"type":"v1","addr":"172.21.15.18:6837","nonce":1096622392}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3761157675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3761157675},{"type":"v1","addr":"172.21.15.116:6835","nonce":3761157675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/1120131594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1120131594},{"type":"v1","addr":"172.21.15.116:6837","nonce":1120131594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:46:24.050115+0000","modified":"2024-09-19T04:46:33.112369+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/4207677139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":4207677139},{"type":"v1","addr":"172.21.15.18:6839","nonce":4207677139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/2346874880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":2346874880},{"type":"v1","addr":"172.21.15.116:6839","nonce":2346874880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496]},"id":1}]} 2024-09-19T04:52:52.234 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 19 2024-09-19T04:52:52.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.229+0000 7fe14138b640 1 -- 172.21.15.2:0/1666561199 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fe1240a33b0 msgr2=0x7fe1240a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:52.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.229+0000 7fe14138b640 1 --2- 172.21.15.2:0/1666561199 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fe1240a33b0 0x7fe1240a5870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe13c0fdd50 tx=0x7fe13000b390 comp rx=0 tx=0).stop 2024-09-19T04:52:52.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.229+0000 7fe14138b640 1 -- 172.21.15.2:0/1666561199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe13c101de0 msgr2=0x7fe13c1982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:52.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.229+0000 7fe14138b640 1 --2- 172.21.15.2:0/1666561199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe13c101de0 0x7fe13c1982e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fe12c005940 tx=0x7fe12c004270 comp rx=0 tx=0).stop 2024-09-19T04:52:52.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.229+0000 7fe14138b640 1 -- 172.21.15.2:0/1666561199 shutdown_connections 2024-09-19T04:52:52.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.229+0000 7fe14138b640 1 --2- 172.21.15.2:0/1666561199 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fe1240a33b0 0x7fe1240a5870 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:52.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.229+0000 7fe14138b640 1 --2- 172.21.15.2:0/1666561199 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe13c106f10 0x7fe13c19cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:52.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.229+0000 7fe14138b640 1 --2- 172.21.15.2:0/1666561199 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe13c102790 0x7fe13c198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:52.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.229+0000 7fe14138b640 1 --2- 172.21.15.2:0/1666561199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe13c101de0 0x7fe13c1982e0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:52.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.229+0000 7fe14138b640 1 -- 172.21.15.2:0/1666561199 >> 172.21.15.2:0/1666561199 conn(0x7fe13c0fd8c0 msgr2=0x7fe13c0fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:52.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.229+0000 7fe14138b640 1 -- 172.21.15.2:0/1666561199 shutdown_connections 2024-09-19T04:52:52.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:52.229+0000 7fe14138b640 1 -- 172.21.15.2:0/1666561199 wait complete. 2024-09-19T04:52:53.004 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:52:53.269 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:52:53.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:53 smithi002 ceph-mon[30975]: pgmap v149: 97 pgs: 97 active+clean; 5.9 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 39 KiB/s wr, 10 op/s 2024-09-19T04:52:53.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:53 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/1666561199' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:52:53.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:53 smithi116 ceph-mon[34477]: pgmap v149: 97 pgs: 97 active+clean; 5.9 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 39 KiB/s wr, 10 op/s 2024-09-19T04:52:53.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:53 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/1666561199' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:52:53.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:53 smithi018 ceph-mon[34537]: pgmap v149: 97 pgs: 97 active+clean; 5.9 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 39 KiB/s wr, 10 op/s 2024-09-19T04:52:53.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:53 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/1666561199' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:52:53.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.781+0000 7f7970018640 1 -- 172.21.15.2:0/993139937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7968102790 msgr2=0x7f79681067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:53.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.781+0000 7f7970018640 1 --2- 172.21.15.2:0/993139937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7968102790 0x7f79681067e0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f7958009900 tx=0x7f795802a410 comp rx=0 tx=0).stop 2024-09-19T04:52:53.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.781+0000 7f7970018640 1 -- 172.21.15.2:0/993139937 shutdown_connections 2024-09-19T04:52:53.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.781+0000 7f7970018640 1 --2- 172.21.15.2:0/993139937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7968106f10 0x7f796810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:53.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.781+0000 7f7970018640 1 --2- 172.21.15.2:0/993139937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7968102790 0x7f79681067e0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:53.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.781+0000 7f7970018640 1 --2- 172.21.15.2:0/993139937 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7968101de0 0x7f79681021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:53.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.781+0000 7f7970018640 1 -- 172.21.15.2:0/993139937 >> 172.21.15.2:0/993139937 conn(0x7f79680fd8c0 msgr2=0x7f79680ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:53.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.781+0000 7f7970018640 1 -- 172.21.15.2:0/993139937 shutdown_connections 2024-09-19T04:52:53.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.781+0000 7f7970018640 1 -- 172.21.15.2:0/993139937 wait complete. 2024-09-19T04:52:53.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.782+0000 7f7970018640 1 Processor -- start 2024-09-19T04:52:53.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.782+0000 7f7970018640 1 -- start start 2024-09-19T04:52:53.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.782+0000 7f7970018640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7968101de0 0x7f79680744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:53.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.782+0000 7f7970018640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7968102790 0x7f7968074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:53.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.782+0000 7f7970018640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7968106f10 0x7f7968074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:53.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.782+0000 7f7970018640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7968111ec0 con 0x7f7968102790 2024-09-19T04:52:53.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.782+0000 7f7970018640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7968111d40 con 0x7f7968101de0 2024-09-19T04:52:53.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.782+0000 7f7970018640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f7968112040 con 0x7f7968106f10 2024-09-19T04:52:53.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.782+0000 7f796d5b3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7968102790 0x7f7968074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:53.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.782+0000 7f796d5b3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7968102790 0x7f7968074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43214/0 (socket says 172.21.15.2:43214) 2024-09-19T04:52:53.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.782+0000 7f796d5b3640 1 -- 172.21.15.2:0/555706089 learned_addr learned my addr 172.21.15.2:0/555706089 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:53.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.782+0000 7f796e5b5640 1 --2- 172.21.15.2:0/555706089 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7968106f10 0x7f7968074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:53.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.782+0000 7f796ddb4640 1 --2- 172.21.15.2:0/555706089 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7968101de0 0x7f79680744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:53.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.782+0000 7f796d5b3640 1 -- 172.21.15.2:0/555706089 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7968106f10 msgr2=0x7f7968074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:53.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.782+0000 7f796d5b3640 1 --2- 172.21.15.2:0/555706089 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7968106f10 0x7f7968074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:53.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.782+0000 7f796d5b3640 1 -- 172.21.15.2:0/555706089 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7968101de0 msgr2=0x7f79680744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:53.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.782+0000 7f796d5b3640 1 --2- 172.21.15.2:0/555706089 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7968101de0 0x7f79680744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:53.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.782+0000 7f796d5b3640 1 -- 172.21.15.2:0/555706089 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79681a69e0 con 0x7f7968102790 2024-09-19T04:52:53.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.782+0000 7f796ddb4640 1 --2- 172.21.15.2:0/555706089 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7968101de0 0x7f79680744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:52:53.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.783+0000 7f796d5b3640 1 --2- 172.21.15.2:0/555706089 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7968102790 0x7f7968074a30 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f7958006010 tx=0x7f7958004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:53.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.783+0000 7f795effd640 1 -- 172.21.15.2:0/555706089 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f795803f030 con 0x7f7968102790 2024-09-19T04:52:53.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.783+0000 7f795effd640 1 -- 172.21.15.2:0/555706089 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f79580035f0 con 0x7f7968102790 2024-09-19T04:52:53.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.783+0000 7f7970018640 1 -- 172.21.15.2:0/555706089 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79681a6c70 con 0x7f7968102790 2024-09-19T04:52:53.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.783+0000 7f795effd640 1 -- 172.21.15.2:0/555706089 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7958035070 con 0x7f7968102790 2024-09-19T04:52:53.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.783+0000 7f7970018640 1 -- 172.21.15.2:0/555706089 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79681a7150 con 0x7f7968102790 2024-09-19T04:52:53.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.785+0000 7f795effd640 1 -- 172.21.15.2:0/555706089 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f7958003b10 con 0x7f7968102790 2024-09-19T04:52:53.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.785+0000 7f79723f1740 1 Processor -- start 2024-09-19T04:52:53.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.786+0000 7f79723f1740 1 -- start start 2024-09-19T04:52:53.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.786+0000 7f79723f1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0df164b40 0x55b0df163090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:53.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.786+0000 7f79723f1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0df1635d0 0x55b0df163a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:53.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.786+0000 7f79723f1740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b0df16e370 0x55b0df170760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:53.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.786+0000 7f79723f1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b0df0c92f0 con 0x55b0df164b40 2024-09-19T04:52:53.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.786+0000 7f79723f1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b0df070cf0 con 0x55b0df1635d0 2024-09-19T04:52:53.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.786+0000 7f79723f1740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55b0df0c52b0 con 0x55b0df16e370 2024-09-19T04:52:53.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.786+0000 7f796e5b5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0df164b40 0x55b0df163090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:53.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.786+0000 7f795effd640 1 --2- 172.21.15.2:0/555706089 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f79540a33b0 0x7f79540a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:53.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.786+0000 7f796e5b5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0df164b40 0x55b0df163090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43220/0 (socket says 172.21.15.2:43220) 2024-09-19T04:52:53.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.786+0000 7f796e5b5640 1 -- 172.21.15.2:0/3387286095 learned_addr learned my addr 172.21.15.2:0/3387286095 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:53.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.786+0000 7f796d5b3640 1 --2- 172.21.15.2:0/3387286095 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b0df16e370 0x55b0df170760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:53.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.786+0000 7f796ddb4640 1 --2- 172.21.15.2:0/3387286095 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0df1635d0 0x55b0df163a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:53.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.786+0000 7f796e5b5640 1 --2- 172.21.15.2:0/555706089 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f79540a33b0 0x7f79540a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:53.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.786+0000 7f795effd640 1 -- 172.21.15.2:0/555706089 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f79580f0930 con 0x7f7968102790 2024-09-19T04:52:53.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.786+0000 7f796e5b5640 1 -- 172.21.15.2:0/3387286095 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b0df16e370 msgr2=0x55b0df170760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:53.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.786+0000 7f796e5b5640 1 --2- 172.21.15.2:0/3387286095 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b0df16e370 0x55b0df170760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:53.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.786+0000 7f796e5b5640 1 -- 172.21.15.2:0/3387286095 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0df1635d0 msgr2=0x55b0df163a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:53.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.786+0000 7f796e5b5640 1 --2- 172.21.15.2:0/3387286095 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0df1635d0 0x55b0df163a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:53.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.786+0000 7f796e5b5640 1 -- 172.21.15.2:0/3387286095 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0df0553a0 con 0x55b0df164b40 2024-09-19T04:52:53.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.786+0000 7f796ddb4640 1 --2- 172.21.15.2:0/3387286095 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0df1635d0 0x55b0df163a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:52:53.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.787+0000 7f796e5b5640 1 --2- 172.21.15.2:0/3387286095 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0df164b40 0x55b0df163090 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f796000cb20 tx=0x7f79600072b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8ccb8a88dae548b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:53.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.787+0000 7f7953fff640 1 -- 172.21.15.2:0/3387286095 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7960015070 con 0x55b0df164b40 2024-09-19T04:52:53.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.787+0000 7f796e5b5640 1 --2- 172.21.15.2:0/555706089 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f79540a33b0 0x7f79540a5870 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f796000c000 tx=0x7f796001b000 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:53.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.787+0000 7f7953fff640 1 -- 172.21.15.2:0/3387286095 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f796001e070 con 0x55b0df164b40 2024-09-19T04:52:53.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.787+0000 7f7953fff640 1 -- 172.21.15.2:0/3387286095 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f796000a660 con 0x55b0df164b40 2024-09-19T04:52:53.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.788+0000 7f79723f1740 1 -- 172.21.15.2:0/3387286095 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0df164b40 msgr2=0x55b0df163090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:53.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.788+0000 7f79723f1740 1 --2- 172.21.15.2:0/3387286095 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0df164b40 0x55b0df163090 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f796000cb20 tx=0x7f79600072b0 comp rx=0 tx=0).stop 2024-09-19T04:52:53.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.788+0000 7f79723f1740 1 -- 172.21.15.2:0/3387286095 shutdown_connections 2024-09-19T04:52:53.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.788+0000 7f79723f1740 1 --2- 172.21.15.2:0/3387286095 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b0df16e370 0x55b0df170760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:53.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.788+0000 7f79723f1740 1 --2- 172.21.15.2:0/3387286095 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0df1635d0 0x55b0df163a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:53.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.788+0000 7f79723f1740 1 --2- 172.21.15.2:0/3387286095 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0df164b40 0x55b0df163090 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:53.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.788+0000 7f79723f1740 1 -- 172.21.15.2:0/3387286095 >> 172.21.15.2:0/3387286095 conn(0x55b0df12c310 msgr2=0x55b0df15fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:53.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.788+0000 7f79723f1740 1 -- 172.21.15.2:0/3387286095 shutdown_connections 2024-09-19T04:52:53.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.788+0000 7f79723f1740 1 -- 172.21.15.2:0/3387286095 wait complete. 2024-09-19T04:52:53.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.788+0000 7f79723f1740 1 -- start start 2024-09-19T04:52:53.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.788+0000 7f79723f1740 1 Processor -- start 2024-09-19T04:52:53.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.789+0000 7f79723f1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0df1635d0 0x55b0df16ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:53.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.789+0000 7f79723f1740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b0df164b40 0x55b0df16b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:53.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.789+0000 7f79723f1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0df16e370 0x55b0df16b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:53.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.789+0000 7f79723f1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b0df171010 con 0x55b0df1635d0 2024-09-19T04:52:53.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.789+0000 7f79723f1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b0df084060 con 0x55b0df16e370 2024-09-19T04:52:53.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.789+0000 7f79723f1740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55b0df171190 con 0x55b0df164b40 2024-09-19T04:52:53.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.789+0000 7f79723f1740 10 client.0 _ll_register_callbacks cb 0x55b0dedd78c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:52:53.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.789+0000 7f796ddb4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0df1635d0 0x55b0df16ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:53.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.789+0000 7f796ddb4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0df1635d0 0x55b0df16ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43236/0 (socket says 172.21.15.2:43236) 2024-09-19T04:52:53.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.789+0000 7f796ddb4640 1 -- 172.21.15.2:0/4106879868 learned_addr learned my addr 172.21.15.2:0/4106879868 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:53.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.789+0000 7f796e5b5640 1 --2- 172.21.15.2:0/4106879868 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0df16e370 0x55b0df16b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:53.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.789+0000 7f796d5b3640 1 --2- 172.21.15.2:0/4106879868 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b0df164b40 0x55b0df16b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:53.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.789+0000 7f796ddb4640 1 -- 172.21.15.2:0/4106879868 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b0df164b40 msgr2=0x55b0df16b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:53.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.789+0000 7f796ddb4640 1 --2- 172.21.15.2:0/4106879868 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b0df164b40 0x55b0df16b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:53.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.789+0000 7f796ddb4640 1 -- 172.21.15.2:0/4106879868 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0df16e370 msgr2=0x55b0df16b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:53.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.789+0000 7f796ddb4640 1 --2- 172.21.15.2:0/4106879868 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0df16e370 0x55b0df16b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:53.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.789+0000 7f796ddb4640 1 -- 172.21.15.2:0/4106879868 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0dee3a3c0 con 0x55b0df1635d0 2024-09-19T04:52:53.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.789+0000 7f796d5b3640 1 --2- 172.21.15.2:0/4106879868 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b0df164b40 0x55b0df16b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:52:53.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.790+0000 7f796ddb4640 1 --2- 172.21.15.2:0/4106879868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0df1635d0 0x55b0df16ddd0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f796400e2d0 tx=0x7f796400e790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45287800331bfd89 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:53.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.790+0000 7f79517fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:52:53.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.790+0000 7f79517fa640 1 -- 172.21.15.2:0/4106879868 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7964018020 con 0x55b0df1635d0 2024-09-19T04:52:53.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.790+0000 7f79517fa640 1 -- 172.21.15.2:0/4106879868 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f7964013660 con 0x55b0df1635d0 2024-09-19T04:52:53.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.790+0000 7f79723f1740 1 -- 172.21.15.2:0/4106879868 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f796001e070 con 0x55b0df1635d0 2024-09-19T04:52:53.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.790+0000 7f79517fa640 1 -- 172.21.15.2:0/4106879868 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f7964023050 con 0x55b0df1635d0 2024-09-19T04:52:53.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.790+0000 7f79723f1740 10 client.15906 fetch_fsmap learned FSMap version 19 2024-09-19T04:52:53.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.790+0000 7f79723f1740 1 -- 172.21.15.2:0/4106879868 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55b0df17cb90 con 0x55b0df1635d0 2024-09-19T04:52:53.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.790+0000 7f79517fa640 1 -- 172.21.15.2:0/4106879868 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f796001e070 con 0x55b0df1635d0 2024-09-19T04:52:53.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.790+0000 7f79517fa640 1 -- 172.21.15.2:0/4106879868 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f7964014a80 con 0x55b0df1635d0 2024-09-19T04:52:53.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.790+0000 7f79723f1740 10 client.15906 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:52:53.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.790+0000 7f79723f1740 10 client.15906 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:52:53.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.790+0000 7f79723f1740 20 client.15906 populate_metadata read hostname 'smithi002' 2024-09-19T04:52:53.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.790+0000 7f79723f1740 1 --2- 172.21.15.2:0/4106879868 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55b0df17e050 0x55b0df180440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:53.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.790+0000 7f79723f1740 4 client.15906 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:52:53.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.790+0000 7f79723f1740 1 -- 172.21.15.2:0/4106879868 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b0df0d6860 con 0x55b0df17e050 2024-09-19T04:52:53.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.791+0000 7f796d5b3640 1 --2- 172.21.15.2:0/4106879868 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55b0df17e050 0x55b0df180440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:53.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.791+0000 7f796d5b3640 1 --2- 172.21.15.2:0/4106879868 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55b0df17e050 0x55b0df180440 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59437af5556e8da0 server_cookie=6fb33d06020b708e in_seq=0 out_seq=0 2024-09-19T04:52:53.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.791+0000 7f79517fa640 10 client.15906 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:52:53.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.792+0000 7f79517fa640 1 -- 172.21.15.2:0/4106879868 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b0df0d6860 con 0x55b0df17e050 2024-09-19T04:52:53.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.792+0000 7f79517fa640 10 client.15906 handle_command_reply: tid=0 2024-09-19T04:52:53.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.792+0000 7f79723f1740 1 client.15906 shutdown 2024-09-19T04:52:53.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.792+0000 7f79723f1740 1 -- 172.21.15.2:0/4106879868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0df1635d0 msgr2=0x55b0df16ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:53.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.792+0000 7f79723f1740 1 --2- 172.21.15.2:0/4106879868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0df1635d0 0x55b0df16ddd0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f796400e2d0 tx=0x7f796400e790 comp rx=0 tx=0).stop 2024-09-19T04:52:53.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.792+0000 7f79723f1740 1 -- 172.21.15.2:0/4106879868 shutdown_connections 2024-09-19T04:52:53.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.792+0000 7f79723f1740 1 --2- 172.21.15.2:0/4106879868 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0df16e370 0x55b0df16b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:53.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.792+0000 7f79723f1740 1 --2- 172.21.15.2:0/4106879868 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55b0df17e050 0x55b0df180440 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:53.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.792+0000 7f79723f1740 1 --2- 172.21.15.2:0/4106879868 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b0df164b40 0x55b0df16b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:53.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.792+0000 7f79723f1740 1 --2- 172.21.15.2:0/4106879868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0df1635d0 0x55b0df16ddd0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:53.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.792+0000 7f79723f1740 1 -- 172.21.15.2:0/4106879868 >> 172.21.15.2:0/4106879868 conn(0x55b0df12c310 msgr2=0x55b0df165930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:53.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.792+0000 7f79517fa640 0 client.15906 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:52:53.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.793+0000 7f79723f1740 1 -- 172.21.15.2:0/4106879868 shutdown_connections 2024-09-19T04:52:53.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.793+0000 7f79723f1740 1 -- 172.21.15.2:0/4106879868 wait complete. 2024-09-19T04:52:53.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.793+0000 7f79723f1740 20 client.15906 trim_cache size 0 max 16384 2024-09-19T04:52:53.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.806+0000 7f79723f1740 1 Processor -- start 2024-09-19T04:52:53.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.806+0000 7f79723f1740 1 -- start start 2024-09-19T04:52:53.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.806+0000 7f79723f1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0df1635d0 0x55b0df16a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:53.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.806+0000 7f79723f1740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b0df164b40 0x55b0df15ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:53.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.806+0000 7f79723f1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0df16e370 0x55b0df166120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:53.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.806+0000 7f79723f1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f79681ad9c0 con 0x55b0df16e370 2024-09-19T04:52:53.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.806+0000 7f79723f1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f79681b0220 con 0x55b0df1635d0 2024-09-19T04:52:53.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.806+0000 7f79723f1740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f79681ae010 con 0x55b0df164b40 2024-09-19T04:52:53.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.806+0000 7f796e5b5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0df16e370 0x55b0df166120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:53.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.806+0000 7f796e5b5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0df16e370 0x55b0df166120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43242/0 (socket says 172.21.15.2:43242) 2024-09-19T04:52:53.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.806+0000 7f796e5b5640 1 -- 172.21.15.2:0/3360333005 learned_addr learned my addr 172.21.15.2:0/3360333005 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:53.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.806+0000 7f796ddb4640 1 --2- 172.21.15.2:0/3360333005 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0df1635d0 0x55b0df16a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:53.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.806+0000 7f796d5b3640 1 --2- 172.21.15.2:0/3360333005 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b0df164b40 0x55b0df15ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:53.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.806+0000 7f796e5b5640 1 -- 172.21.15.2:0/3360333005 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b0df164b40 msgr2=0x55b0df15ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:53.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.806+0000 7f796e5b5640 1 --2- 172.21.15.2:0/3360333005 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b0df164b40 0x55b0df15ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:53.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.806+0000 7f796e5b5640 1 -- 172.21.15.2:0/3360333005 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0df1635d0 msgr2=0x55b0df16a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:53.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.806+0000 7f796e5b5640 1 --2- 172.21.15.2:0/3360333005 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0df1635d0 0x55b0df16a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:53.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.806+0000 7f796e5b5640 1 -- 172.21.15.2:0/3360333005 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0df15e310 con 0x55b0df16e370 2024-09-19T04:52:53.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.806+0000 7f796ddb4640 1 --2- 172.21.15.2:0/3360333005 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0df1635d0 0x55b0df16a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:52:53.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.807+0000 7f796e5b5640 1 --2- 172.21.15.2:0/3360333005 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0df16e370 0x55b0df166120 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f796000f000 tx=0x7f7960009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c33fe44a225e210 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:53.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.807+0000 7f79537fe640 1 -- 172.21.15.2:0/3360333005 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7960031070 con 0x55b0df16e370 2024-09-19T04:52:53.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.807+0000 7f79537fe640 1 -- 172.21.15.2:0/3360333005 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f796001e050 con 0x55b0df16e370 2024-09-19T04:52:53.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.807+0000 7f79537fe640 1 -- 172.21.15.2:0/3360333005 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7960015040 con 0x55b0df16e370 2024-09-19T04:52:53.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.807+0000 7f79723f1740 1 -- 172.21.15.2:0/3360333005 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0df16e370 msgr2=0x55b0df166120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:53.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.807+0000 7f79723f1740 1 --2- 172.21.15.2:0/3360333005 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0df16e370 0x55b0df166120 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f796000f000 tx=0x7f7960009810 comp rx=0 tx=0).stop 2024-09-19T04:52:53.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.807+0000 7f79723f1740 1 -- 172.21.15.2:0/3360333005 shutdown_connections 2024-09-19T04:52:53.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.807+0000 7f79723f1740 1 --2- 172.21.15.2:0/3360333005 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0df16e370 0x55b0df166120 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:53.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.807+0000 7f79723f1740 1 --2- 172.21.15.2:0/3360333005 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b0df164b40 0x55b0df15ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:53.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.807+0000 7f79723f1740 1 --2- 172.21.15.2:0/3360333005 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0df1635d0 0x55b0df16a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:53.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.807+0000 7f79723f1740 1 -- 172.21.15.2:0/3360333005 >> 172.21.15.2:0/3360333005 conn(0x55b0df12c310 msgr2=0x55b0df15e500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:53.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.808+0000 7f79723f1740 1 -- 172.21.15.2:0/3360333005 shutdown_connections 2024-09-19T04:52:53.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.808+0000 7f79723f1740 1 -- 172.21.15.2:0/3360333005 wait complete. 2024-09-19T04:52:53.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.808+0000 7f79723f1740 1 -- start start 2024-09-19T04:52:53.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.808+0000 7f79723f1740 1 Processor -- start 2024-09-19T04:52:53.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.808+0000 7f79723f1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0df1635d0 0x55b0df176b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:53.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.808+0000 7f79723f1740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b0df164b40 0x55b0df171eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:53.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.808+0000 7f79723f1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0df16e370 0x55b0df1723f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:53.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.808+0000 7f79723f1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f79681ae6e0 con 0x55b0df16e370 2024-09-19T04:52:53.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.808+0000 7f79723f1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f79681afb50 con 0x55b0df1635d0 2024-09-19T04:52:53.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.808+0000 7f79723f1740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f79681aedb0 con 0x55b0df164b40 2024-09-19T04:52:53.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.808+0000 7f79723f1740 10 client.0 _ll_register_callbacks cb 0x7f796400c170 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:52:53.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.809+0000 7f796ddb4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0df1635d0 0x55b0df176b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:53.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.809+0000 7f796e5b5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0df16e370 0x55b0df1723f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:53.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.809+0000 7f796ddb4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0df1635d0 0x55b0df176b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.2:41890/0 (socket says 172.21.15.2:41890) 2024-09-19T04:52:53.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.809+0000 7f796e5b5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0df16e370 0x55b0df1723f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43246/0 (socket says 172.21.15.2:43246) 2024-09-19T04:52:53.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.809+0000 7f796ddb4640 1 -- 172.21.15.2:0/3942659829 learned_addr learned my addr 172.21.15.2:0/3942659829 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:53.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.809+0000 7f796d5b3640 1 --2- 172.21.15.2:0/3942659829 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b0df164b40 0x55b0df171eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:53.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.809+0000 7f796e5b5640 1 -- 172.21.15.2:0/3942659829 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b0df164b40 msgr2=0x55b0df171eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:53.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.809+0000 7f796e5b5640 1 --2- 172.21.15.2:0/3942659829 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b0df164b40 0x55b0df171eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:53.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.809+0000 7f796e5b5640 1 -- 172.21.15.2:0/3942659829 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0df1635d0 msgr2=0x55b0df176b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:53.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.809+0000 7f796e5b5640 1 --2- 172.21.15.2:0/3942659829 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0df1635d0 0x55b0df176b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:53.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.809+0000 7f796e5b5640 1 -- 172.21.15.2:0/3942659829 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0df160960 con 0x55b0df16e370 2024-09-19T04:52:53.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.809+0000 7f796d5b3640 1 --2- 172.21.15.2:0/3942659829 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b0df164b40 0x55b0df171eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:52:53.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.809+0000 7f796e5b5640 1 --2- 172.21.15.2:0/3942659829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0df16e370 0x55b0df1723f0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f796000cb20 tx=0x7f7960023f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb7d245c5bcb3975 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:53.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.809+0000 7f79517fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:52:53.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.809+0000 7f79517fa640 1 -- 172.21.15.2:0/3942659829 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7960031030 con 0x55b0df16e370 2024-09-19T04:52:53.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.809+0000 7f79517fa640 1 -- 172.21.15.2:0/3942659829 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f7960029050 con 0x55b0df16e370 2024-09-19T04:52:53.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.809+0000 7f79723f1740 1 -- 172.21.15.2:0/3942659829 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f796001e050 con 0x55b0df16e370 2024-09-19T04:52:53.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.809+0000 7f79517fa640 1 -- 172.21.15.2:0/3942659829 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f7960015040 con 0x55b0df16e370 2024-09-19T04:52:53.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.809+0000 7f79723f1740 10 client.15912 fetch_fsmap learned FSMap version 19 2024-09-19T04:52:53.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.809+0000 7f79723f1740 1 -- 172.21.15.2:0/3942659829 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55b0df1e8b00 con 0x55b0df16e370 2024-09-19T04:52:53.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.810+0000 7f79517fa640 1 -- 172.21.15.2:0/3942659829 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f796001e050 con 0x55b0df16e370 2024-09-19T04:52:53.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.810+0000 7f79517fa640 1 -- 172.21.15.2:0/3942659829 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f796003e020 con 0x55b0df16e370 2024-09-19T04:52:53.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.810+0000 7f79723f1740 10 client.15912 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:52:53.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.810+0000 7f79723f1740 10 client.15912 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:52:53.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.810+0000 7f79723f1740 20 client.15912 populate_metadata read hostname 'smithi002' 2024-09-19T04:52:53.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.810+0000 7f79723f1740 1 --2- 172.21.15.2:0/3942659829 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55b0df1e8f80 0x55b0df1eb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:53.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.810+0000 7f79723f1740 4 client.15912 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:52:53.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.810+0000 7f79723f1740 1 -- 172.21.15.2:0/3942659829 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b0df0d0d70 con 0x55b0df1e8f80 2024-09-19T04:52:53.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.810+0000 7f796ddb4640 1 --2- 172.21.15.2:0/3942659829 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55b0df1e8f80 0x55b0df1eb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:53.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.811+0000 7f796ddb4640 1 --2- 172.21.15.2:0/3942659829 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55b0df1e8f80 0x55b0df1eb370 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d50003e494027886 server_cookie=816aa90e7d5999fc in_seq=0 out_seq=0 2024-09-19T04:52:53.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.811+0000 7f79517fa640 10 client.15912 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:52:53.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.811+0000 7f79517fa640 1 -- 172.21.15.2:0/3942659829 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b0df0d0d70 con 0x55b0df1e8f80 2024-09-19T04:52:53.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.811+0000 7f79517fa640 10 client.15912 handle_command_reply: tid=0 2024-09-19T04:52:53.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.811+0000 7f79723f1740 1 client.15912 shutdown 2024-09-19T04:52:53.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.811+0000 7f79723f1740 1 -- 172.21.15.2:0/3942659829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0df16e370 msgr2=0x55b0df1723f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:53.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.811+0000 7f79723f1740 1 --2- 172.21.15.2:0/3942659829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0df16e370 0x55b0df1723f0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f796000cb20 tx=0x7f7960023f80 comp rx=0 tx=0).stop 2024-09-19T04:52:53.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.811+0000 7f79723f1740 1 -- 172.21.15.2:0/3942659829 shutdown_connections 2024-09-19T04:52:53.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.811+0000 7f79723f1740 1 --2- 172.21.15.2:0/3942659829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0df16e370 0x55b0df1723f0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:53.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.811+0000 7f79723f1740 1 --2- 172.21.15.2:0/3942659829 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55b0df1e8f80 0x55b0df1eb370 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:53.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.811+0000 7f79723f1740 1 --2- 172.21.15.2:0/3942659829 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b0df164b40 0x55b0df171eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:53.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.811+0000 7f79723f1740 1 --2- 172.21.15.2:0/3942659829 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0df1635d0 0x55b0df176b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:53.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.811+0000 7f79723f1740 1 -- 172.21.15.2:0/3942659829 >> 172.21.15.2:0/3942659829 conn(0x55b0df12c310 msgr2=0x55b0df16a880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:53.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.811+0000 7f79517fa640 0 client.15912 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:52:53.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.811+0000 7f79723f1740 1 -- 172.21.15.2:0/3942659829 shutdown_connections 2024-09-19T04:52:53.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.811+0000 7f79723f1740 1 -- 172.21.15.2:0/3942659829 wait complete. 2024-09-19T04:52:53.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.811+0000 7f79723f1740 20 client.15912 trim_cache size 0 max 16384 2024-09-19T04:52:53.818 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T04:52:53.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.812+0000 7f7970018640 1 -- 172.21.15.2:0/555706089 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f79540a33b0 msgr2=0x7f79540a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:53.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.812+0000 7f7970018640 1 --2- 172.21.15.2:0/555706089 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f79540a33b0 0x7f79540a5870 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f796000c000 tx=0x7f796001b000 comp rx=0 tx=0).stop 2024-09-19T04:52:53.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.812+0000 7f7970018640 1 -- 172.21.15.2:0/555706089 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7968102790 msgr2=0x7f7968074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:53.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.812+0000 7f7970018640 1 --2- 172.21.15.2:0/555706089 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7968102790 0x7f7968074a30 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f7958006010 tx=0x7f7958004270 comp rx=0 tx=0).stop 2024-09-19T04:52:53.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.812+0000 7f7970018640 1 -- 172.21.15.2:0/555706089 shutdown_connections 2024-09-19T04:52:53.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.812+0000 7f7970018640 1 --2- 172.21.15.2:0/555706089 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f79540a33b0 0x7f79540a5870 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:53.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.812+0000 7f7970018640 1 --2- 172.21.15.2:0/555706089 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7968106f10 0x7f7968074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:53.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.812+0000 7f7970018640 1 --2- 172.21.15.2:0/555706089 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7968102790 0x7f7968074a30 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:53.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.812+0000 7f7970018640 1 --2- 172.21.15.2:0/555706089 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7968101de0 0x7f79680744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:53.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.812+0000 7f7970018640 1 -- 172.21.15.2:0/555706089 >> 172.21.15.2:0/555706089 conn(0x7f79680fd8c0 msgr2=0x7f79680fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:53.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.812+0000 7f7970018640 1 -- 172.21.15.2:0/555706089 shutdown_connections 2024-09-19T04:52:53.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:53.812+0000 7f7970018640 1 -- 172.21.15.2:0/555706089 wait complete. 2024-09-19T04:52:55.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:55 smithi002 ceph-mon[30975]: pgmap v150: 97 pgs: 97 active+clean; 5.9 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 27 KiB/s wr, 7 op/s 2024-09-19T04:52:55.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:55 smithi116 ceph-mon[34477]: pgmap v150: 97 pgs: 97 active+clean; 5.9 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 27 KiB/s wr, 7 op/s 2024-09-19T04:52:55.514 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:52:55.515 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:52:55.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:55 smithi018 ceph-mon[34537]: pgmap v150: 97 pgs: 97 active+clean; 5.9 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 27 KiB/s wr, 7 op/s 2024-09-19T04:52:55.788 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:52:56.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.256+0000 7feea50ac640 1 -- 172.21.15.2:0/1184108555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feea0106ba0 msgr2=0x7feea0106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:56.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.256+0000 7feea50ac640 1 --2- 172.21.15.2:0/1184108555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feea0106ba0 0x7feea0106f80 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fee90009900 tx=0x7fee9002a410 comp rx=0 tx=0).stop 2024-09-19T04:52:56.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.256+0000 7feea50ac640 1 -- 172.21.15.2:0/1184108555 shutdown_connections 2024-09-19T04:52:56.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.256+0000 7feea50ac640 1 --2- 172.21.15.2:0/1184108555 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feea0100a70 0x7feea010ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:56.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.256+0000 7feea50ac640 1 --2- 172.21.15.2:0/1184108555 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feea01000d0 0x7feea0100530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:56.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.256+0000 7feea50ac640 1 --2- 172.21.15.2:0/1184108555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feea0106ba0 0x7feea0106f80 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:56.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.256+0000 7feea50ac640 1 -- 172.21.15.2:0/1184108555 >> 172.21.15.2:0/1184108555 conn(0x7feea0077210 msgr2=0x7feea00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:56.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.256+0000 7feea50ac640 1 -- 172.21.15.2:0/1184108555 shutdown_connections 2024-09-19T04:52:56.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.256+0000 7feea50ac640 1 -- 172.21.15.2:0/1184108555 wait complete. 2024-09-19T04:52:56.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.257+0000 7feea50ac640 1 Processor -- start 2024-09-19T04:52:56.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.257+0000 7feea50ac640 1 -- start start 2024-09-19T04:52:56.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.257+0000 7feea50ac640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feea01000d0 0x7feea019a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:56.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.257+0000 7feea50ac640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feea0100a70 0x7feea019aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:56.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.257+0000 7feea50ac640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feea0106ba0 0x7feea019ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:56.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.257+0000 7feea50ac640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7feea0111f40 con 0x7feea01000d0 2024-09-19T04:52:56.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.257+0000 7feea50ac640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7feea0111dc0 con 0x7feea0100a70 2024-09-19T04:52:56.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.257+0000 7feea50ac640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7feea01120c0 con 0x7feea0106ba0 2024-09-19T04:52:56.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.257+0000 7fee9ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feea01000d0 0x7feea019a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:56.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.257+0000 7fee9ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feea01000d0 0x7feea019a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43254/0 (socket says 172.21.15.2:43254) 2024-09-19T04:52:56.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.257+0000 7fee9ed9d640 1 -- 172.21.15.2:0/3561852888 learned_addr learned my addr 172.21.15.2:0/3561852888 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:56.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.257+0000 7fee9f59e640 1 --2- 172.21.15.2:0/3561852888 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feea0106ba0 0x7feea019ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:56.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.258+0000 7fee9e59c640 1 --2- 172.21.15.2:0/3561852888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feea0100a70 0x7feea019aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:56.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.258+0000 7fee9ed9d640 1 -- 172.21.15.2:0/3561852888 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feea0106ba0 msgr2=0x7feea019ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:56.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.258+0000 7fee9ed9d640 1 --2- 172.21.15.2:0/3561852888 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feea0106ba0 0x7feea019ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:56.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.258+0000 7fee9ed9d640 1 -- 172.21.15.2:0/3561852888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feea0100a70 msgr2=0x7feea019aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:56.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.258+0000 7fee9ed9d640 1 --2- 172.21.15.2:0/3561852888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feea0100a70 0x7feea019aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:56.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.258+0000 7fee9ed9d640 1 -- 172.21.15.2:0/3561852888 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feea019f530 con 0x7feea01000d0 2024-09-19T04:52:56.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.258+0000 7fee9e59c640 1 --2- 172.21.15.2:0/3561852888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feea0100a70 0x7feea019aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:52:56.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.258+0000 7fee9ed9d640 1 --2- 172.21.15.2:0/3561852888 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feea01000d0 0x7feea019a580 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fee90006010 tx=0x7fee900042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:56.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.258+0000 7fee87fff640 1 -- 172.21.15.2:0/3561852888 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee9003f070 con 0x7feea01000d0 2024-09-19T04:52:56.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.258+0000 7feea50ac640 1 -- 172.21.15.2:0/3561852888 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feea019f7c0 con 0x7feea01000d0 2024-09-19T04:52:56.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.258+0000 7fee87fff640 1 -- 172.21.15.2:0/3561852888 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fee90003aa0 con 0x7feea01000d0 2024-09-19T04:52:56.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.258+0000 7feea50ac640 1 -- 172.21.15.2:0/3561852888 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feea01a7100 con 0x7feea01000d0 2024-09-19T04:52:56.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.258+0000 7fee87fff640 1 -- 172.21.15.2:0/3561852888 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee90035030 con 0x7feea01000d0 2024-09-19T04:52:56.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.260+0000 7fee87fff640 1 -- 172.21.15.2:0/3561852888 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fee90042070 con 0x7feea01000d0 2024-09-19T04:52:56.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.261+0000 7feea7485740 1 Processor -- start 2024-09-19T04:52:56.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.261+0000 7feea7485740 1 -- start start 2024-09-19T04:52:56.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.261+0000 7feea7485740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608bf8cbb60 0x5608bf8cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:56.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.261+0000 7feea7485740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5608bf8cc480 0x5608bf8d6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:56.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.261+0000 7feea7485740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608bf8d6d40 0x5608bf8d9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:56.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.261+0000 7feea7485740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5608bf831280 con 0x5608bf8d6d40 2024-09-19T04:52:56.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.261+0000 7feea7485740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5608bf7d8b10 con 0x5608bf8cbb60 2024-09-19T04:52:56.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.261+0000 7feea7485740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5608bf82d240 con 0x5608bf8cc480 2024-09-19T04:52:56.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.261+0000 7fee9e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608bf8d6d40 0x5608bf8d9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:56.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.261+0000 7fee9e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608bf8d6d40 0x5608bf8d9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43270/0 (socket says 172.21.15.2:43270) 2024-09-19T04:52:56.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.261+0000 7fee9e59c640 1 -- 172.21.15.2:0/435566468 learned_addr learned my addr 172.21.15.2:0/435566468 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:56.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.261+0000 7fee9ed9d640 1 --2- 172.21.15.2:0/435566468 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5608bf8cc480 0x5608bf8d6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:56.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.261+0000 7fee9f59e640 1 --2- 172.21.15.2:0/435566468 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608bf8cbb60 0x5608bf8cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:56.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.261+0000 7fee87fff640 1 --2- 172.21.15.2:0/3561852888 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fee880a33b0 0x7fee880a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:56.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.261+0000 7fee9e59c640 1 -- 172.21.15.2:0/435566468 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5608bf8cc480 msgr2=0x5608bf8d6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:56.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.261+0000 7fee9e59c640 1 --2- 172.21.15.2:0/435566468 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5608bf8cc480 0x5608bf8d6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:56.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.261+0000 7fee9e59c640 1 -- 172.21.15.2:0/435566468 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608bf8cbb60 msgr2=0x5608bf8cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:56.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.261+0000 7fee9e59c640 1 --2- 172.21.15.2:0/435566468 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608bf8cbb60 0x5608bf8cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:56.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.261+0000 7fee9e59c640 1 -- 172.21.15.2:0/435566468 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608bf7e51f0 con 0x5608bf8d6d40 2024-09-19T04:52:56.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.262+0000 7fee9f59e640 1 --2- 172.21.15.2:0/435566468 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608bf8cbb60 0x5608bf8cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:52:56.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.262+0000 7fee9f59e640 1 --2- 172.21.15.2:0/3561852888 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fee880a33b0 0x7fee880a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:56.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.262+0000 7fee87fff640 1 -- 172.21.15.2:0/3561852888 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7fee900f0330 con 0x7feea01000d0 2024-09-19T04:52:56.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.262+0000 7fee9e59c640 1 --2- 172.21.15.2:0/435566468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608bf8d6d40 0x5608bf8d9130 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fee9400bb40 tx=0x7fee9400d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d49a44a5e5bc348d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:56.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.262+0000 7fee857fa640 1 -- 172.21.15.2:0/435566468 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee94017420 con 0x5608bf8d6d40 2024-09-19T04:52:56.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.262+0000 7fee857fa640 1 -- 172.21.15.2:0/435566468 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fee94017a70 con 0x5608bf8d6d40 2024-09-19T04:52:56.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.262+0000 7fee857fa640 1 -- 172.21.15.2:0/435566468 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee9400fb30 con 0x5608bf8d6d40 2024-09-19T04:52:56.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.263+0000 7feea7485740 1 -- 172.21.15.2:0/435566468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608bf8d6d40 msgr2=0x5608bf8d9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:56.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.263+0000 7feea7485740 1 --2- 172.21.15.2:0/435566468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608bf8d6d40 0x5608bf8d9130 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fee9400bb40 tx=0x7fee9400d340 comp rx=0 tx=0).stop 2024-09-19T04:52:56.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.263+0000 7fee9f59e640 1 --2- 172.21.15.2:0/3561852888 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fee880a33b0 0x7fee880a5870 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fee98007310 tx=0x7fee98004a40 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:56.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.263+0000 7feea7485740 1 -- 172.21.15.2:0/435566468 shutdown_connections 2024-09-19T04:52:56.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.263+0000 7feea7485740 1 --2- 172.21.15.2:0/435566468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608bf8d6d40 0x5608bf8d9130 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:56.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.263+0000 7feea7485740 1 --2- 172.21.15.2:0/435566468 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5608bf8cc480 0x5608bf8d6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:56.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.263+0000 7feea7485740 1 --2- 172.21.15.2:0/435566468 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608bf8cbb60 0x5608bf8cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:56.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.263+0000 7feea7485740 1 -- 172.21.15.2:0/435566468 >> 172.21.15.2:0/435566468 conn(0x5608bf8c80f0 msgr2=0x5608bf8c84d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:56.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.263+0000 7feea7485740 1 -- 172.21.15.2:0/435566468 shutdown_connections 2024-09-19T04:52:56.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.263+0000 7feea7485740 1 -- 172.21.15.2:0/435566468 wait complete. 2024-09-19T04:52:56.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.263+0000 7feea7485740 1 -- start start 2024-09-19T04:52:56.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.263+0000 7feea7485740 1 Processor -- start 2024-09-19T04:52:56.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.263+0000 7feea7485740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608bf8cbb60 0x5608bf8d3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:56.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.263+0000 7feea7485740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608bf8cc480 0x5608bf8d4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:56.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.263+0000 7feea7485740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5608bf8d6d40 0x5608bf8d4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:56.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.263+0000 7feea7485740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5608bf8d9910 con 0x5608bf8cbb60 2024-09-19T04:52:56.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.263+0000 7feea7485740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5608bf7ebf10 con 0x5608bf8cc480 2024-09-19T04:52:56.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.263+0000 7feea7485740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5608bf8d9a90 con 0x5608bf8d6d40 2024-09-19T04:52:56.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.263+0000 7feea7485740 10 client.0 _ll_register_callbacks cb 0x5608bf7b4a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:52:56.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.263+0000 7fee9ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608bf8cbb60 0x5608bf8d3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:56.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.264+0000 7fee9ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608bf8cbb60 0x5608bf8d3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43286/0 (socket says 172.21.15.2:43286) 2024-09-19T04:52:56.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.264+0000 7fee9ed9d640 1 -- 172.21.15.2:0/265593614 learned_addr learned my addr 172.21.15.2:0/265593614 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:56.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.264+0000 7fee9e59c640 1 --2- 172.21.15.2:0/265593614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608bf8cc480 0x5608bf8d4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:56.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.264+0000 7fee9ed9d640 1 -- 172.21.15.2:0/265593614 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5608bf8d6d40 msgr2=0x5608bf8d4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:56.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.264+0000 7fee9ed9d640 1 --2- 172.21.15.2:0/265593614 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5608bf8d6d40 0x5608bf8d4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:56.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.264+0000 7fee9ed9d640 1 -- 172.21.15.2:0/265593614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608bf8cc480 msgr2=0x5608bf8d4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:56.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.264+0000 7fee9ed9d640 1 --2- 172.21.15.2:0/265593614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608bf8cc480 0x5608bf8d4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:56.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.264+0000 7fee9ed9d640 1 -- 172.21.15.2:0/265593614 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608bf5a26a0 con 0x5608bf8cbb60 2024-09-19T04:52:56.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.264+0000 7fee9e59c640 1 --2- 172.21.15.2:0/265593614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608bf8cc480 0x5608bf8d4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:52:56.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.264+0000 7fee9ed9d640 1 --2- 172.21.15.2:0/265593614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608bf8cbb60 0x5608bf8d3c00 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fee900b8fa0 tx=0x7fee900bc4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2495e2e1c66da282 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:56.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.264+0000 7fee82ff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:52:56.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.264+0000 7fee82ff5640 1 -- 172.21.15.2:0/265593614 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee90049040 con 0x5608bf8cbb60 2024-09-19T04:52:56.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.264+0000 7fee82ff5640 1 -- 172.21.15.2:0/265593614 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7fee900edcc0 con 0x5608bf8cbb60 2024-09-19T04:52:56.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.264+0000 7feea7485740 1 -- 172.21.15.2:0/265593614 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee94017a70 con 0x5608bf8cbb60 2024-09-19T04:52:56.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.264+0000 7fee82ff5640 1 -- 172.21.15.2:0/265593614 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fee90031eb0 con 0x5608bf8cbb60 2024-09-19T04:52:56.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.264+0000 7feea7485740 10 client.15924 fetch_fsmap learned FSMap version 19 2024-09-19T04:52:56.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.264+0000 7feea7485740 1 -- 172.21.15.2:0/265593614 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5608bf8e54f0 con 0x5608bf8cbb60 2024-09-19T04:52:56.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.264+0000 7fee82ff5640 1 -- 172.21.15.2:0/265593614 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fee94017a70 con 0x5608bf8cbb60 2024-09-19T04:52:56.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.265+0000 7fee82ff5640 1 -- 172.21.15.2:0/265593614 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fee9004c060 con 0x5608bf8cbb60 2024-09-19T04:52:56.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.265+0000 7feea7485740 10 client.15924 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:52:56.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.265+0000 7feea7485740 10 client.15924 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:52:56.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.265+0000 7feea7485740 20 client.15924 populate_metadata read hostname 'smithi002' 2024-09-19T04:52:56.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.265+0000 7feea7485740 1 --2- 172.21.15.2:0/265593614 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5608bf8e69c0 0x5608bf8e8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:56.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.265+0000 7feea7485740 4 client.15924 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:52:56.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.265+0000 7feea7485740 1 -- 172.21.15.2:0/265593614 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5608bf83e7f0 con 0x5608bf8e69c0 2024-09-19T04:52:56.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.265+0000 7fee9e59c640 1 --2- 172.21.15.2:0/265593614 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5608bf8e69c0 0x5608bf8e8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:56.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.265+0000 7fee82ff5640 10 client.15924 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:52:56.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.265+0000 7fee9e59c640 1 --2- 172.21.15.2:0/265593614 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5608bf8e69c0 0x5608bf8e8e50 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33c8e018c2be4aa5 server_cookie=1aa91c4fbe5f7c20 in_seq=0 out_seq=0 2024-09-19T04:52:56.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.266+0000 7fee82ff5640 1 -- 172.21.15.2:0/265593614 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5608bf83e7f0 con 0x5608bf8e69c0 2024-09-19T04:52:56.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.266+0000 7fee82ff5640 10 client.15924 handle_command_reply: tid=0 2024-09-19T04:52:56.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.266+0000 7feea7485740 1 client.15924 shutdown 2024-09-19T04:52:56.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.266+0000 7feea7485740 1 -- 172.21.15.2:0/265593614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608bf8cbb60 msgr2=0x5608bf8d3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:56.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.266+0000 7feea7485740 1 --2- 172.21.15.2:0/265593614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608bf8cbb60 0x5608bf8d3c00 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fee900b8fa0 tx=0x7fee900bc4b0 comp rx=0 tx=0).stop 2024-09-19T04:52:56.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.266+0000 7feea7485740 1 -- 172.21.15.2:0/265593614 shutdown_connections 2024-09-19T04:52:56.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.266+0000 7feea7485740 1 --2- 172.21.15.2:0/265593614 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5608bf8e69c0 0x5608bf8e8e50 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:56.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.266+0000 7feea7485740 1 --2- 172.21.15.2:0/265593614 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5608bf8d6d40 0x5608bf8d4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:56.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.266+0000 7feea7485740 1 --2- 172.21.15.2:0/265593614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608bf8cc480 0x5608bf8d4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:56.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.266+0000 7fee82ff5640 0 client.15924 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:52:56.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.266+0000 7feea7485740 1 --2- 172.21.15.2:0/265593614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608bf8cbb60 0x5608bf8d3c00 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:56.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.266+0000 7feea7485740 1 -- 172.21.15.2:0/265593614 >> 172.21.15.2:0/265593614 conn(0x5608bf8c80f0 msgr2=0x5608bf8c7270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:56.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.267+0000 7feea7485740 1 -- 172.21.15.2:0/265593614 shutdown_connections 2024-09-19T04:52:56.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.267+0000 7feea7485740 1 -- 172.21.15.2:0/265593614 wait complete. 2024-09-19T04:52:56.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.267+0000 7feea7485740 20 client.15924 trim_cache size 0 max 16384 2024-09-19T04:52:56.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.284+0000 7feea7485740 1 Processor -- start 2024-09-19T04:52:56.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.284+0000 7feea7485740 1 -- start start 2024-09-19T04:52:56.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.284+0000 7feea7485740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5608bf8cbb60 0x5608bf8ce5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:56.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.284+0000 7feea7485740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608bf8cc480 0x5608bf8d5a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:56.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.284+0000 7feea7485740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608bf8d6d40 0x5608bf8ee760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:56.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.284+0000 7feea7485740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7feea01ad850 con 0x5608bf8cc480 2024-09-19T04:52:56.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.284+0000 7feea7485740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7feea01b00d0 con 0x5608bf8d6d40 2024-09-19T04:52:56.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.284+0000 7feea7485740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7feea01adec0 con 0x5608bf8cbb60 2024-09-19T04:52:56.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.284+0000 7fee9e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608bf8cc480 0x5608bf8d5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:56.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.284+0000 7fee9e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608bf8cc480 0x5608bf8d5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43300/0 (socket says 172.21.15.2:43300) 2024-09-19T04:52:56.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.284+0000 7fee9e59c640 1 -- 172.21.15.2:0/3797186272 learned_addr learned my addr 172.21.15.2:0/3797186272 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:56.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.284+0000 7fee9f59e640 1 --2- 172.21.15.2:0/3797186272 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608bf8d6d40 0x5608bf8ee760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:56.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.284+0000 7fee9ed9d640 1 --2- 172.21.15.2:0/3797186272 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5608bf8cbb60 0x5608bf8ce5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:56.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.284+0000 7fee9e59c640 1 -- 172.21.15.2:0/3797186272 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5608bf8cbb60 msgr2=0x5608bf8ce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:56.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.284+0000 7fee9e59c640 1 --2- 172.21.15.2:0/3797186272 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5608bf8cbb60 0x5608bf8ce5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:56.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.284+0000 7fee9e59c640 1 -- 172.21.15.2:0/3797186272 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608bf8d6d40 msgr2=0x5608bf8ee760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:56.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.285+0000 7fee9e59c640 1 --2- 172.21.15.2:0/3797186272 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608bf8d6d40 0x5608bf8ee760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:56.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.285+0000 7fee9e59c640 1 -- 172.21.15.2:0/3797186272 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608bf8d9470 con 0x5608bf8cc480 2024-09-19T04:52:56.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.285+0000 7fee9f59e640 1 --2- 172.21.15.2:0/3797186272 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608bf8d6d40 0x5608bf8ee760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:52:56.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.285+0000 7fee9e59c640 1 --2- 172.21.15.2:0/3797186272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608bf8cc480 0x5608bf8d5a60 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fee9400d840 tx=0x7fee9400b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8798e3c4eec1fc94 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:56.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.285+0000 7fee84ff9640 1 -- 172.21.15.2:0/3797186272 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee9402e070 con 0x5608bf8cc480 2024-09-19T04:52:56.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.285+0000 7fee84ff9640 1 -- 172.21.15.2:0/3797186272 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fee9400fc90 con 0x5608bf8cc480 2024-09-19T04:52:56.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.285+0000 7fee84ff9640 1 -- 172.21.15.2:0/3797186272 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee94028840 con 0x5608bf8cc480 2024-09-19T04:52:56.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.285+0000 7feea7485740 1 -- 172.21.15.2:0/3797186272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608bf8cc480 msgr2=0x5608bf8d5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:56.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.285+0000 7feea7485740 1 --2- 172.21.15.2:0/3797186272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608bf8cc480 0x5608bf8d5a60 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fee9400d840 tx=0x7fee9400b7e0 comp rx=0 tx=0).stop 2024-09-19T04:52:56.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.285+0000 7feea7485740 1 -- 172.21.15.2:0/3797186272 shutdown_connections 2024-09-19T04:52:56.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.285+0000 7feea7485740 1 --2- 172.21.15.2:0/3797186272 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608bf8d6d40 0x5608bf8ee760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:56.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.286+0000 7feea7485740 1 --2- 172.21.15.2:0/3797186272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608bf8cc480 0x5608bf8d5a60 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:56.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.286+0000 7feea7485740 1 --2- 172.21.15.2:0/3797186272 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5608bf8cbb60 0x5608bf8ce5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:56.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.286+0000 7feea7485740 1 -- 172.21.15.2:0/3797186272 >> 172.21.15.2:0/3797186272 conn(0x5608bf8c80f0 msgr2=0x5608bf8d5350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:56.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.286+0000 7feea7485740 1 -- 172.21.15.2:0/3797186272 shutdown_connections 2024-09-19T04:52:56.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.286+0000 7feea7485740 1 -- 172.21.15.2:0/3797186272 wait complete. 2024-09-19T04:52:56.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.286+0000 7feea7485740 1 -- start start 2024-09-19T04:52:56.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.286+0000 7feea7485740 1 Processor -- start 2024-09-19T04:52:56.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.286+0000 7feea7485740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5608bf8cbb60 0x5608bf8df430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:56.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.286+0000 7feea7485740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608bf8cc480 0x5608bf8d09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:56.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.286+0000 7feea7485740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608bf8d6d40 0x5608bf8d0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:56.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.286+0000 7feea7485740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7feea01ae590 con 0x5608bf8cc480 2024-09-19T04:52:56.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.286+0000 7feea7485740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7feea01afa00 con 0x5608bf8d6d40 2024-09-19T04:52:56.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.286+0000 7feea7485740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7feea01aec60 con 0x5608bf8cbb60 2024-09-19T04:52:56.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.286+0000 7feea7485740 10 client.0 _ll_register_callbacks cb 0x7fee90005b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:52:56.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.286+0000 7fee9e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608bf8cc480 0x5608bf8d09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:56.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.287+0000 7fee9e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608bf8cc480 0x5608bf8d09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43306/0 (socket says 172.21.15.2:43306) 2024-09-19T04:52:56.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.287+0000 7fee9e59c640 1 -- 172.21.15.2:0/381089308 learned_addr learned my addr 172.21.15.2:0/381089308 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:56.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.287+0000 7fee9f59e640 1 --2- 172.21.15.2:0/381089308 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608bf8d6d40 0x5608bf8d0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:56.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.287+0000 7fee9ed9d640 1 --2- 172.21.15.2:0/381089308 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5608bf8cbb60 0x5608bf8df430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:56.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.287+0000 7fee9e59c640 1 -- 172.21.15.2:0/381089308 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5608bf8cbb60 msgr2=0x5608bf8df430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:56.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.287+0000 7fee9e59c640 1 --2- 172.21.15.2:0/381089308 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5608bf8cbb60 0x5608bf8df430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:56.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.287+0000 7fee9e59c640 1 -- 172.21.15.2:0/381089308 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608bf8d6d40 msgr2=0x5608bf8d0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:56.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.287+0000 7fee9e59c640 1 --2- 172.21.15.2:0/381089308 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608bf8d6d40 0x5608bf8d0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:56.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.287+0000 7fee9e59c640 1 -- 172.21.15.2:0/381089308 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608bf8d1730 con 0x5608bf8cc480 2024-09-19T04:52:56.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.287+0000 7fee9ed9d640 1 --2- 172.21.15.2:0/381089308 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5608bf8cbb60 0x5608bf8df430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:52:56.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.287+0000 7fee9e59c640 1 --2- 172.21.15.2:0/381089308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608bf8cc480 0x5608bf8d09c0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fee94005940 tx=0x7fee9400b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ce6666b81052af server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:56.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.287+0000 7fee82ff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:52:56.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.287+0000 7fee82ff5640 1 -- 172.21.15.2:0/381089308 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee94037060 con 0x5608bf8cc480 2024-09-19T04:52:56.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.287+0000 7fee82ff5640 1 -- 172.21.15.2:0/381089308 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7fee9400f420 con 0x5608bf8cc480 2024-09-19T04:52:56.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.287+0000 7feea7485740 1 -- 172.21.15.2:0/381089308 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee9400fc90 con 0x5608bf8cc480 2024-09-19T04:52:56.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.287+0000 7fee82ff5640 1 -- 172.21.15.2:0/381089308 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fee9402e070 con 0x5608bf8cc480 2024-09-19T04:52:56.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.287+0000 7feea7485740 10 client.15930 fetch_fsmap learned FSMap version 19 2024-09-19T04:52:56.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.287+0000 7feea7485740 1 -- 172.21.15.2:0/381089308 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5608bf9517d0 con 0x5608bf8cc480 2024-09-19T04:52:56.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.288+0000 7fee82ff5640 1 -- 172.21.15.2:0/381089308 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fee9400fc90 con 0x5608bf8cc480 2024-09-19T04:52:56.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.288+0000 7fee82ff5640 1 -- 172.21.15.2:0/381089308 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fee94032470 con 0x5608bf8cc480 2024-09-19T04:52:56.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.288+0000 7feea7485740 10 client.15930 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:52:56.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.288+0000 7feea7485740 10 client.15930 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:52:56.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.288+0000 7feea7485740 20 client.15930 populate_metadata read hostname 'smithi002' 2024-09-19T04:52:56.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.288+0000 7feea7485740 1 --2- 172.21.15.2:0/381089308 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5608bf951c40 0x5608bf954030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:56.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.288+0000 7feea7485740 4 client.15930 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:52:56.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.288+0000 7feea7485740 1 -- 172.21.15.2:0/381089308 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5608bf838d00 con 0x5608bf951c40 2024-09-19T04:52:56.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.288+0000 7fee9ed9d640 1 --2- 172.21.15.2:0/381089308 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5608bf951c40 0x5608bf954030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:56.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.289+0000 7fee9ed9d640 1 --2- 172.21.15.2:0/381089308 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5608bf951c40 0x5608bf954030 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=642576de9ea9e6c9 server_cookie=ba0fad3a4e2fce74 in_seq=0 out_seq=0 2024-09-19T04:52:56.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.289+0000 7fee82ff5640 10 client.15930 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:52:56.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.289+0000 7fee82ff5640 1 -- 172.21.15.2:0/381089308 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5608bf838d00 con 0x5608bf951c40 2024-09-19T04:52:56.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.289+0000 7fee82ff5640 10 client.15930 handle_command_reply: tid=0 2024-09-19T04:52:56.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.289+0000 7feea7485740 1 client.15930 shutdown 2024-09-19T04:52:56.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.290+0000 7feea7485740 1 -- 172.21.15.2:0/381089308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608bf8cc480 msgr2=0x5608bf8d09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:56.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.290+0000 7feea7485740 1 --2- 172.21.15.2:0/381089308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608bf8cc480 0x5608bf8d09c0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fee94005940 tx=0x7fee9400b6e0 comp rx=0 tx=0).stop 2024-09-19T04:52:56.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.290+0000 7feea7485740 1 -- 172.21.15.2:0/381089308 shutdown_connections 2024-09-19T04:52:56.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.290+0000 7feea7485740 1 --2- 172.21.15.2:0/381089308 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608bf8d6d40 0x5608bf8d0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:56.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.290+0000 7feea7485740 1 --2- 172.21.15.2:0/381089308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608bf8cc480 0x5608bf8d09c0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:56.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.290+0000 7feea7485740 1 --2- 172.21.15.2:0/381089308 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5608bf951c40 0x5608bf954030 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:56.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.290+0000 7feea7485740 1 --2- 172.21.15.2:0/381089308 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5608bf8cbb60 0x5608bf8df430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:56.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.290+0000 7feea7485740 1 -- 172.21.15.2:0/381089308 >> 172.21.15.2:0/381089308 conn(0x5608bf8c80f0 msgr2=0x5608bf8c7270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:56.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.290+0000 7fee82ff5640 0 client.15930 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:52:56.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.290+0000 7feea7485740 1 -- 172.21.15.2:0/381089308 shutdown_connections 2024-09-19T04:52:56.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.290+0000 7feea7485740 1 -- 172.21.15.2:0/381089308 wait complete. 2024-09-19T04:52:56.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.290+0000 7feea7485740 20 client.15930 trim_cache size 0 max 16384 2024-09-19T04:52:56.312 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:52:56.312 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T04:52:56.312 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "69bf36a4-3958-4840-89c7-006dfd8723d6", 2024-09-19T04:52:56.313 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T04:52:56.313 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:52:56.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.290+0000 7feea50ac640 1 -- 172.21.15.2:0/3561852888 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fee880a33b0 msgr2=0x7fee880a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:56.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.290+0000 7feea50ac640 1 --2- 172.21.15.2:0/3561852888 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fee880a33b0 0x7fee880a5870 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fee98007310 tx=0x7fee98004a40 comp rx=0 tx=0).stop 2024-09-19T04:52:56.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.290+0000 7feea50ac640 1 -- 172.21.15.2:0/3561852888 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feea01000d0 msgr2=0x7feea019a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:56.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.290+0000 7feea50ac640 1 --2- 172.21.15.2:0/3561852888 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feea01000d0 0x7feea019a580 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fee90006010 tx=0x7fee900042f0 comp rx=0 tx=0).stop 2024-09-19T04:52:56.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.290+0000 7feea50ac640 1 -- 172.21.15.2:0/3561852888 shutdown_connections 2024-09-19T04:52:56.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.290+0000 7feea50ac640 1 --2- 172.21.15.2:0/3561852888 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fee880a33b0 0x7fee880a5870 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:56.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.290+0000 7feea50ac640 1 --2- 172.21.15.2:0/3561852888 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feea0106ba0 0x7feea019ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:56.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.291+0000 7feea50ac640 1 --2- 172.21.15.2:0/3561852888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feea0100a70 0x7feea019aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:56.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.291+0000 7feea50ac640 1 --2- 172.21.15.2:0/3561852888 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feea01000d0 0x7feea019a580 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:56.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.291+0000 7feea50ac640 1 -- 172.21.15.2:0/3561852888 >> 172.21.15.2:0/3561852888 conn(0x7feea0077210 msgr2=0x7feea0104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:56.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.291+0000 7feea50ac640 1 -- 172.21.15.2:0/3561852888 shutdown_connections 2024-09-19T04:52:56.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:56.291+0000 7feea50ac640 1 -- 172.21.15.2:0/3561852888 wait complete. 2024-09-19T04:52:57.170 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:57 smithi002 ceph-mon[30975]: pgmap v151: 97 pgs: 97 active+clean; 6.1 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 41 KiB/s wr, 11 op/s 2024-09-19T04:52:57.170 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:57 smithi002 ceph-mon[30975]: scrub queued for path: / 2024-09-19T04:52:57.171 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:57 smithi002 ceph-mon[30975]: scrub summary: idle+waiting paths [/] 2024-09-19T04:52:57.171 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:57 smithi002 ceph-mon[30975]: scrub summary: active paths [/] 2024-09-19T04:52:57.171 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:57 smithi002 ceph-mon[30975]: scrub summary: idle+waiting paths [/] 2024-09-19T04:52:57.172 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:52:57.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:57 smithi116 ceph-mon[34477]: pgmap v151: 97 pgs: 97 active+clean; 6.1 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 41 KiB/s wr, 11 op/s 2024-09-19T04:52:57.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:57 smithi116 ceph-mon[34477]: scrub queued for path: / 2024-09-19T04:52:57.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:57 smithi116 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-19T04:52:57.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:57 smithi116 ceph-mon[34477]: scrub summary: active paths [/] 2024-09-19T04:52:57.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:57 smithi116 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-19T04:52:57.433 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:52:57.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:57 smithi018 ceph-mon[34537]: pgmap v151: 97 pgs: 97 active+clean; 6.1 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 41 KiB/s wr, 11 op/s 2024-09-19T04:52:57.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:57 smithi018 ceph-mon[34537]: scrub queued for path: / 2024-09-19T04:52:57.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:57 smithi018 ceph-mon[34537]: scrub summary: idle+waiting paths [/] 2024-09-19T04:52:57.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:57 smithi018 ceph-mon[34537]: scrub summary: active paths [/] 2024-09-19T04:52:57.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:57 smithi018 ceph-mon[34537]: scrub summary: idle+waiting paths [/] 2024-09-19T04:52:58.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.006+0000 7f3859c63640 1 -- 172.21.15.2:0/764890555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3854101de0 msgr2=0x7f38541021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:58.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.006+0000 7f3859c63640 1 --2- 172.21.15.2:0/764890555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3854101de0 0x7f38541021c0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f3844009ca0 tx=0x7f384402a8c0 comp rx=0 tx=0).stop 2024-09-19T04:52:58.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.006+0000 7f3859c63640 1 -- 172.21.15.2:0/764890555 shutdown_connections 2024-09-19T04:52:58.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.006+0000 7f3859c63640 1 --2- 172.21.15.2:0/764890555 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3854106f10 0x7f385410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:58.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.006+0000 7f3859c63640 1 --2- 172.21.15.2:0/764890555 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3854102790 0x7f38541067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:58.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.006+0000 7f3859c63640 1 --2- 172.21.15.2:0/764890555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3854101de0 0x7f38541021c0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:58.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.006+0000 7f3859c63640 1 -- 172.21.15.2:0/764890555 >> 172.21.15.2:0/764890555 conn(0x7f38540fd8c0 msgr2=0x7f38540ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:58.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.007+0000 7f3859c63640 1 -- 172.21.15.2:0/764890555 shutdown_connections 2024-09-19T04:52:58.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.007+0000 7f3859c63640 1 -- 172.21.15.2:0/764890555 wait complete. 2024-09-19T04:52:58.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.007+0000 7f3859c63640 1 Processor -- start 2024-09-19T04:52:58.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.007+0000 7f3859c63640 1 -- start start 2024-09-19T04:52:58.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.008+0000 7f3859c63640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3854101de0 0x7f3854198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:58.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.008+0000 7f3859c63640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3854102790 0x7f38541988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:58.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.008+0000 7f3859c63640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3854106f10 0x7f385419cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:58.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.008+0000 7f3859c63640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3854111e20 con 0x7f3854101de0 2024-09-19T04:52:58.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.008+0000 7f3859c63640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3854111ca0 con 0x7f3854102790 2024-09-19T04:52:58.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.008+0000 7f3859c63640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f3854111fa0 con 0x7f3854106f10 2024-09-19T04:52:58.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.008+0000 7f38537fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3854101de0 0x7f3854198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:58.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.008+0000 7f38537fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3854101de0 0x7f3854198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43320/0 (socket says 172.21.15.2:43320) 2024-09-19T04:52:58.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.008+0000 7f38537fe640 1 -- 172.21.15.2:0/1500359986 learned_addr learned my addr 172.21.15.2:0/1500359986 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:58.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.008+0000 7f3852ffd640 1 --2- 172.21.15.2:0/1500359986 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3854102790 0x7f38541988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:58.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.008+0000 7f3853fff640 1 --2- 172.21.15.2:0/1500359986 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3854106f10 0x7f385419cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:58.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.008+0000 7f38537fe640 1 -- 172.21.15.2:0/1500359986 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3854106f10 msgr2=0x7f385419cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:58.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.008+0000 7f38537fe640 1 --2- 172.21.15.2:0/1500359986 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3854106f10 0x7f385419cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:58.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.008+0000 7f38537fe640 1 -- 172.21.15.2:0/1500359986 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3854102790 msgr2=0x7f38541988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:58.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.008+0000 7f38537fe640 1 --2- 172.21.15.2:0/1500359986 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3854102790 0x7f38541988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:58.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.008+0000 7f38537fe640 1 -- 172.21.15.2:0/1500359986 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f385419d310 con 0x7f3854101de0 2024-09-19T04:52:58.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.008+0000 7f38537fe640 1 --2- 172.21.15.2:0/1500359986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3854101de0 0x7f3854198360 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f384402ade0 tx=0x7f3844032ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:58.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.009+0000 7f3850ff9640 1 -- 172.21.15.2:0/1500359986 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3844003cf0 con 0x7f3854101de0 2024-09-19T04:52:58.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.009+0000 7f3850ff9640 1 -- 172.21.15.2:0/1500359986 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f38440044f0 con 0x7f3854101de0 2024-09-19T04:52:58.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.009+0000 7f3859c63640 1 -- 172.21.15.2:0/1500359986 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f385419d5a0 con 0x7f3854101de0 2024-09-19T04:52:58.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.009+0000 7f3850ff9640 1 -- 172.21.15.2:0/1500359986 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3844030c40 con 0x7f3854101de0 2024-09-19T04:52:58.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.009+0000 7f3859c63640 1 -- 172.21.15.2:0/1500359986 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38541a4ee0 con 0x7f3854101de0 2024-09-19T04:52:58.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.011+0000 7f3850ff9640 1 -- 172.21.15.2:0/1500359986 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f3844004040 con 0x7f3854101de0 2024-09-19T04:52:58.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.011+0000 7f385c03c740 1 Processor -- start 2024-09-19T04:52:58.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.011+0000 7f385c03c740 1 -- start start 2024-09-19T04:52:58.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.012+0000 7f385c03c740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558e6d8da490 0x558e6d8da870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:58.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.012+0000 7f385c03c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e6d8dadb0 0x558e6d8e5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:58.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.012+0000 7f385c03c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e6d8e5670 0x558e6d8e7a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:58.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.012+0000 7f385c03c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558e6d8402e0 con 0x558e6d8e5670 2024-09-19T04:52:58.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.012+0000 7f385c03c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558e6d7e7ce0 con 0x558e6d8dadb0 2024-09-19T04:52:58.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.012+0000 7f385c03c740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x558e6d83c2a0 con 0x558e6d8da490 2024-09-19T04:52:58.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.012+0000 7f3852ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e6d8e5670 0x558e6d8e7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:58.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.012+0000 7f3852ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e6d8e5670 0x558e6d8e7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43328/0 (socket says 172.21.15.2:43328) 2024-09-19T04:52:58.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.012+0000 7f3852ffd640 1 -- 172.21.15.2:0/877075511 learned_addr learned my addr 172.21.15.2:0/877075511 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:58.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.012+0000 7f3850ff9640 1 --2- 172.21.15.2:0/1500359986 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f383c0a3430 0x7f383c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:58.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.012+0000 7f38537fe640 1 --2- 172.21.15.2:0/877075511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e6d8dadb0 0x558e6d8e5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:58.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.012+0000 7f3853fff640 1 --2- 172.21.15.2:0/877075511 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558e6d8da490 0x558e6d8da870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:58.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.012+0000 7f3853fff640 1 --2- 172.21.15.2:0/1500359986 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f383c0a3430 0x7f383c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:58.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.012+0000 7f3852ffd640 1 -- 172.21.15.2:0/877075511 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558e6d8da490 msgr2=0x558e6d8da870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:58.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.012+0000 7f3852ffd640 1 --2- 172.21.15.2:0/877075511 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558e6d8da490 0x558e6d8da870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:58.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.012+0000 7f3852ffd640 1 -- 172.21.15.2:0/877075511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e6d8dadb0 msgr2=0x558e6d8e5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:58.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.012+0000 7f3852ffd640 1 --2- 172.21.15.2:0/877075511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e6d8dadb0 0x558e6d8e5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:58.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.012+0000 7f3852ffd640 1 -- 172.21.15.2:0/877075511 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e6d7cc440 con 0x558e6d8e5670 2024-09-19T04:52:58.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.012+0000 7f3850ff9640 1 -- 172.21.15.2:0/1500359986 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f38440f1190 con 0x7f3854101de0 2024-09-19T04:52:58.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.012+0000 7f3853fff640 1 --2- 172.21.15.2:0/877075511 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558e6d8da490 0x558e6d8da870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:52:58.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.013+0000 7f3852ffd640 1 --2- 172.21.15.2:0/877075511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e6d8e5670 0x558e6d8e7a60 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f384800b740 tx=0x7f384800bc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=220eacf3dabf3f1e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:58.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.013+0000 7f3853fff640 1 --2- 172.21.15.2:0/1500359986 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f383c0a3430 0x7f383c0a58f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f384c005fd0 tx=0x7f384c005850 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:58.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.013+0000 7f3839ffb640 1 -- 172.21.15.2:0/877075511 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3848003dd0 con 0x558e6d8e5670 2024-09-19T04:52:58.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.013+0000 7f3839ffb640 1 -- 172.21.15.2:0/877075511 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3848015070 con 0x558e6d8e5670 2024-09-19T04:52:58.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.013+0000 7f3839ffb640 1 -- 172.21.15.2:0/877075511 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3848004de0 con 0x558e6d8e5670 2024-09-19T04:52:58.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.014+0000 7f385c03c740 1 -- 172.21.15.2:0/877075511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e6d8e5670 msgr2=0x558e6d8e7a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:58.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.014+0000 7f385c03c740 1 --2- 172.21.15.2:0/877075511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e6d8e5670 0x558e6d8e7a60 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f384800b740 tx=0x7f384800bc00 comp rx=0 tx=0).stop 2024-09-19T04:52:58.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.014+0000 7f385c03c740 1 -- 172.21.15.2:0/877075511 shutdown_connections 2024-09-19T04:52:58.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.014+0000 7f385c03c740 1 --2- 172.21.15.2:0/877075511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e6d8e5670 0x558e6d8e7a60 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:58.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.014+0000 7f385c03c740 1 --2- 172.21.15.2:0/877075511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e6d8dadb0 0x558e6d8e5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:58.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.014+0000 7f385c03c740 1 --2- 172.21.15.2:0/877075511 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558e6d8da490 0x558e6d8da870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:58.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.014+0000 7f385c03c740 1 -- 172.21.15.2:0/877075511 >> 172.21.15.2:0/877075511 conn(0x558e6d8d6a20 msgr2=0x558e6d8d6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:58.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.014+0000 7f385c03c740 1 -- 172.21.15.2:0/877075511 shutdown_connections 2024-09-19T04:52:58.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.014+0000 7f385c03c740 1 -- 172.21.15.2:0/877075511 wait complete. 2024-09-19T04:52:58.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.014+0000 7f385c03c740 1 -- start start 2024-09-19T04:52:58.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.014+0000 7f385c03c740 1 Processor -- start 2024-09-19T04:52:58.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.015+0000 7f385c03c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e6d8da490 0x558e6d8e4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:58.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.015+0000 7f385c03c740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558e6d8dadb0 0x558e6d8e21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:58.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.015+0000 7f385c03c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e6d8e5670 0x558e6d8e2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:58.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.015+0000 7f385c03c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558e6d8e8240 con 0x558e6d8da490 2024-09-19T04:52:58.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.015+0000 7f385c03c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558e6d7fb050 con 0x558e6d8e5670 2024-09-19T04:52:58.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.015+0000 7f385c03c740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x558e6d8e83c0 con 0x558e6d8dadb0 2024-09-19T04:52:58.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.015+0000 7f385c03c740 10 client.0 _ll_register_callbacks cb 0x558e6d83b160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:52:58.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.015+0000 7f38537fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e6d8da490 0x558e6d8e4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:58.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.015+0000 7f38537fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e6d8da490 0x558e6d8e4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43338/0 (socket says 172.21.15.2:43338) 2024-09-19T04:52:58.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.015+0000 7f38537fe640 1 -- 172.21.15.2:0/645322707 learned_addr learned my addr 172.21.15.2:0/645322707 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:58.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.015+0000 7f3852ffd640 1 --2- 172.21.15.2:0/645322707 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558e6d8dadb0 0x558e6d8e21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:58.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.015+0000 7f38537fe640 1 -- 172.21.15.2:0/645322707 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558e6d8dadb0 msgr2=0x558e6d8e21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:58.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.015+0000 7f3853fff640 1 --2- 172.21.15.2:0/645322707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e6d8e5670 0x558e6d8e2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:58.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.015+0000 7f38537fe640 1 --2- 172.21.15.2:0/645322707 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558e6d8dadb0 0x558e6d8e21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:58.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.015+0000 7f38537fe640 1 -- 172.21.15.2:0/645322707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e6d8e5670 msgr2=0x558e6d8e2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:58.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.015+0000 7f38537fe640 1 --2- 172.21.15.2:0/645322707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e6d8e5670 0x558e6d8e2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:58.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.015+0000 7f38537fe640 1 -- 172.21.15.2:0/645322707 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e6d5b13c0 con 0x558e6d8da490 2024-09-19T04:52:58.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.015+0000 7f3853fff640 1 --2- 172.21.15.2:0/645322707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e6d8e5670 0x558e6d8e2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:52:58.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.015+0000 7f38537fe640 1 --2- 172.21.15.2:0/645322707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e6d8da490 0x558e6d8e4f40 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f38440eea10 tx=0x7f384408f2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbdb1599e964da66 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:58.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.015+0000 7f3832ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:52:58.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.015+0000 7f3832ffd640 1 -- 172.21.15.2:0/645322707 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38440305c0 con 0x558e6d8da490 2024-09-19T04:52:58.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.015+0000 7f3832ffd640 1 -- 172.21.15.2:0/645322707 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f38440046a0 con 0x558e6d8da490 2024-09-19T04:52:58.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.015+0000 7f385c03c740 1 -- 172.21.15.2:0/645322707 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3848015070 con 0x558e6d8da490 2024-09-19T04:52:58.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.016+0000 7f3832ffd640 1 -- 172.21.15.2:0/645322707 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f38440bdc40 con 0x558e6d8da490 2024-09-19T04:52:58.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.016+0000 7f385c03c740 10 client.15942 fetch_fsmap learned FSMap version 19 2024-09-19T04:52:58.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.016+0000 7f385c03c740 1 -- 172.21.15.2:0/645322707 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x558e6d8e8240 con 0x558e6d8da490 2024-09-19T04:52:58.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.016+0000 7f3832ffd640 1 -- 172.21.15.2:0/645322707 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3848015070 con 0x558e6d8da490 2024-09-19T04:52:58.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.016+0000 7f3832ffd640 1 -- 172.21.15.2:0/645322707 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f38440b9bb0 con 0x558e6d8da490 2024-09-19T04:52:58.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.016+0000 7f385c03c740 10 client.15942 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:52:58.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.016+0000 7f385c03c740 10 client.15942 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:52:58.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.016+0000 7f385c03c740 20 client.15942 populate_metadata read hostname 'smithi002' 2024-09-19T04:52:58.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.016+0000 7f385c03c740 1 --2- 172.21.15.2:0/645322707 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558e6d8f4fb0 0x558e6d8f7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:58.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.016+0000 7f385c03c740 4 client.15942 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:52:58.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.016+0000 7f385c03c740 1 -- 172.21.15.2:0/645322707 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558e6d84d850 con 0x558e6d8f4fb0 2024-09-19T04:52:58.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.016+0000 7f3852ffd640 1 --2- 172.21.15.2:0/645322707 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558e6d8f4fb0 0x558e6d8f7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:58.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.017+0000 7f3832ffd640 10 client.15942 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:52:58.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.017+0000 7f3852ffd640 1 --2- 172.21.15.2:0/645322707 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558e6d8f4fb0 0x558e6d8f7400 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=272841ef6b614932 server_cookie=13f417942c9fe2e6 in_seq=0 out_seq=0 2024-09-19T04:52:58.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.017+0000 7f3832ffd640 1 -- 172.21.15.2:0/645322707 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558e6d84d850 con 0x558e6d8f4fb0 2024-09-19T04:52:58.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.017+0000 7f3832ffd640 10 client.15942 handle_command_reply: tid=0 2024-09-19T04:52:58.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.018+0000 7f385c03c740 1 client.15942 shutdown 2024-09-19T04:52:58.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.018+0000 7f385c03c740 1 -- 172.21.15.2:0/645322707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e6d8da490 msgr2=0x558e6d8e4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:58.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.018+0000 7f385c03c740 1 --2- 172.21.15.2:0/645322707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e6d8da490 0x558e6d8e4f40 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f38440eea10 tx=0x7f384408f2c0 comp rx=0 tx=0).stop 2024-09-19T04:52:58.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.018+0000 7f385c03c740 1 -- 172.21.15.2:0/645322707 shutdown_connections 2024-09-19T04:52:58.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.018+0000 7f385c03c740 1 --2- 172.21.15.2:0/645322707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e6d8e5670 0x558e6d8e2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:58.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.018+0000 7f385c03c740 1 --2- 172.21.15.2:0/645322707 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558e6d8f4fb0 0x558e6d8f7400 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:58.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.018+0000 7f3832ffd640 0 client.15942 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:52:58.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.018+0000 7f385c03c740 1 --2- 172.21.15.2:0/645322707 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558e6d8dadb0 0x558e6d8e21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:58.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.018+0000 7f385c03c740 1 --2- 172.21.15.2:0/645322707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e6d8da490 0x558e6d8e4f40 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:58.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.018+0000 7f385c03c740 1 -- 172.21.15.2:0/645322707 >> 172.21.15.2:0/645322707 conn(0x558e6d8d6a20 msgr2=0x558e6d8d5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:58.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.018+0000 7f385c03c740 1 -- 172.21.15.2:0/645322707 shutdown_connections 2024-09-19T04:52:58.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.018+0000 7f385c03c740 1 -- 172.21.15.2:0/645322707 wait complete. 2024-09-19T04:52:58.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.018+0000 7f385c03c740 20 client.15942 trim_cache size 0 max 16384 2024-09-19T04:52:58.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.035+0000 7f385c03c740 1 Processor -- start 2024-09-19T04:52:58.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.035+0000 7f385c03c740 1 -- start start 2024-09-19T04:52:58.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.035+0000 7f385c03c740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558e6d8da490 0x558e6d8f14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:58.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.035+0000 7f385c03c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e6d8dadb0 0x558e6d8dd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:58.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.035+0000 7f385c03c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e6d8e5670 0x558e6d8fccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:58.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.035+0000 7f385c03c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f38541ab710 con 0x558e6d8dadb0 2024-09-19T04:52:58.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.035+0000 7f385c03c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f38541adf90 con 0x558e6d8e5670 2024-09-19T04:52:58.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.035+0000 7f385c03c740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f38541abd80 con 0x558e6d8da490 2024-09-19T04:52:58.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.036+0000 7f3852ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e6d8dadb0 0x558e6d8dd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:58.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.036+0000 7f3852ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e6d8dadb0 0x558e6d8dd7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43348/0 (socket says 172.21.15.2:43348) 2024-09-19T04:52:58.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.036+0000 7f3852ffd640 1 -- 172.21.15.2:0/113446372 learned_addr learned my addr 172.21.15.2:0/113446372 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:58.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.036+0000 7f3853fff640 1 --2- 172.21.15.2:0/113446372 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e6d8e5670 0x558e6d8fccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:58.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.036+0000 7f38537fe640 1 --2- 172.21.15.2:0/113446372 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558e6d8da490 0x558e6d8f14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:58.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.036+0000 7f3852ffd640 1 -- 172.21.15.2:0/113446372 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558e6d8da490 msgr2=0x558e6d8f14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:58.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.036+0000 7f3852ffd640 1 --2- 172.21.15.2:0/113446372 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558e6d8da490 0x558e6d8f14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:58.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.036+0000 7f3852ffd640 1 -- 172.21.15.2:0/113446372 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e6d8e5670 msgr2=0x558e6d8fccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:58.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.036+0000 7f3852ffd640 1 --2- 172.21.15.2:0/113446372 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e6d8e5670 0x558e6d8fccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:58.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.036+0000 7f3852ffd640 1 -- 172.21.15.2:0/113446372 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e6d8d2000 con 0x558e6d8dadb0 2024-09-19T04:52:58.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.036+0000 7f3853fff640 1 --2- 172.21.15.2:0/113446372 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e6d8e5670 0x558e6d8fccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:52:58.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.036+0000 7f3852ffd640 1 --2- 172.21.15.2:0/113446372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e6d8dadb0 0x558e6d8dd7e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f3848004620 tx=0x7f3848013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65fa7e7e2924bb45 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:58.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.036+0000 7f38397fa640 1 -- 172.21.15.2:0/113446372 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3848004680 con 0x558e6d8dadb0 2024-09-19T04:52:58.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.036+0000 7f38397fa640 1 -- 172.21.15.2:0/113446372 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3848015040 con 0x558e6d8dadb0 2024-09-19T04:52:58.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.036+0000 7f38397fa640 1 -- 172.21.15.2:0/113446372 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3848028c80 con 0x558e6d8dadb0 2024-09-19T04:52:58.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.037+0000 7f385c03c740 1 -- 172.21.15.2:0/113446372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e6d8dadb0 msgr2=0x558e6d8dd7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:58.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.037+0000 7f385c03c740 1 --2- 172.21.15.2:0/113446372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e6d8dadb0 0x558e6d8dd7e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f3848004620 tx=0x7f3848013040 comp rx=0 tx=0).stop 2024-09-19T04:52:58.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.037+0000 7f385c03c740 1 -- 172.21.15.2:0/113446372 shutdown_connections 2024-09-19T04:52:58.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.037+0000 7f385c03c740 1 --2- 172.21.15.2:0/113446372 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e6d8e5670 0x558e6d8fccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:58.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.037+0000 7f385c03c740 1 --2- 172.21.15.2:0/113446372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e6d8dadb0 0x558e6d8dd7e0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:58.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.037+0000 7f385c03c740 1 --2- 172.21.15.2:0/113446372 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558e6d8da490 0x558e6d8f14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:58.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.037+0000 7f385c03c740 1 -- 172.21.15.2:0/113446372 >> 172.21.15.2:0/113446372 conn(0x558e6d8d6a20 msgr2=0x558e6d8dd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:58.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.037+0000 7f385c03c740 1 -- 172.21.15.2:0/113446372 shutdown_connections 2024-09-19T04:52:58.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.037+0000 7f385c03c740 1 -- 172.21.15.2:0/113446372 wait complete. 2024-09-19T04:52:58.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.037+0000 7f385c03c740 1 -- start start 2024-09-19T04:52:58.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.038+0000 7f385c03c740 1 Processor -- start 2024-09-19T04:52:58.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.038+0000 7f385c03c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e6d8da490 0x558e6d8e92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:58.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.038+0000 7f385c03c740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558e6d8dadb0 0x558e6d8e9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:58.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.038+0000 7f385c03c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e6d8e5670 0x558e6d8e9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:58.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.038+0000 7f385c03c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f38541ac450 con 0x558e6d8da490 2024-09-19T04:52:58.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.038+0000 7f385c03c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f38541ad8c0 con 0x558e6d8e5670 2024-09-19T04:52:58.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.038+0000 7f385c03c740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f38541acb20 con 0x558e6d8dadb0 2024-09-19T04:52:58.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.038+0000 7f385c03c740 10 client.0 _ll_register_callbacks cb 0x7f38440b9180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:52:58.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.038+0000 7f38537fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e6d8da490 0x558e6d8e92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:58.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.038+0000 7f38537fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e6d8da490 0x558e6d8e92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43352/0 (socket says 172.21.15.2:43352) 2024-09-19T04:52:58.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.038+0000 7f38537fe640 1 -- 172.21.15.2:0/3578716435 learned_addr learned my addr 172.21.15.2:0/3578716435 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:52:58.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.038+0000 7f3852ffd640 1 --2- 172.21.15.2:0/3578716435 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558e6d8dadb0 0x558e6d8e9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:58.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.038+0000 7f3853fff640 1 --2- 172.21.15.2:0/3578716435 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e6d8e5670 0x558e6d8e9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:58.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.038+0000 7f38537fe640 1 -- 172.21.15.2:0/3578716435 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558e6d8dadb0 msgr2=0x558e6d8e9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:58.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.038+0000 7f38537fe640 1 --2- 172.21.15.2:0/3578716435 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558e6d8dadb0 0x558e6d8e9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:58.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.038+0000 7f38537fe640 1 -- 172.21.15.2:0/3578716435 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e6d8e5670 msgr2=0x558e6d8e9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:52:58.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.038+0000 7f38537fe640 1 --2- 172.21.15.2:0/3578716435 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e6d8e5670 0x558e6d8e9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:58.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.038+0000 7f38537fe640 1 -- 172.21.15.2:0/3578716435 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e6d8d7bb0 con 0x558e6d8da490 2024-09-19T04:52:58.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.038+0000 7f3853fff640 1 --2- 172.21.15.2:0/3578716435 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e6d8e5670 0x558e6d8e9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:52:58.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.039+0000 7f38537fe640 1 --2- 172.21.15.2:0/3578716435 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e6d8da490 0x558e6d8e92f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f38440bd4d0 tx=0x7f38440b9840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6676b8645eaeef4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:52:58.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.039+0000 7f3832ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:52:58.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.039+0000 7f3832ffd640 1 -- 172.21.15.2:0/3578716435 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38440bd540 con 0x558e6d8da490 2024-09-19T04:52:58.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.039+0000 7f3832ffd640 1 -- 172.21.15.2:0/3578716435 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f38440c5d20 con 0x558e6d8da490 2024-09-19T04:52:58.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.039+0000 7f385c03c740 1 -- 172.21.15.2:0/3578716435 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3848015040 con 0x558e6d8da490 2024-09-19T04:52:58.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.039+0000 7f3832ffd640 1 -- 172.21.15.2:0/3578716435 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f38440c18f0 con 0x558e6d8da490 2024-09-19T04:52:58.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.039+0000 7f385c03c740 10 client.15948 fetch_fsmap learned FSMap version 19 2024-09-19T04:52:58.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.039+0000 7f385c03c740 1 -- 172.21.15.2:0/3578716435 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x558e6d964130 con 0x558e6d8da490 2024-09-19T04:52:58.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.039+0000 7f3832ffd640 1 -- 172.21.15.2:0/3578716435 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3848015040 con 0x558e6d8da490 2024-09-19T04:52:58.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.039+0000 7f3832ffd640 1 -- 172.21.15.2:0/3578716435 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f384408d030 con 0x558e6d8da490 2024-09-19T04:52:58.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.039+0000 7f385c03c740 10 client.15948 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:52:58.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.039+0000 7f385c03c740 10 client.15948 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:52:58.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.039+0000 7f385c03c740 20 client.15948 populate_metadata read hostname 'smithi002' 2024-09-19T04:52:58.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.039+0000 7f385c03c740 1 --2- 172.21.15.2:0/3578716435 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558e6d8f4fb0 0x558e6d9666d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:52:58.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.039+0000 7f385c03c740 4 client.15948 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:52:58.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.039+0000 7f385c03c740 1 -- 172.21.15.2:0/3578716435 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558e6d8e2ac0 con 0x558e6d8f4fb0 2024-09-19T04:52:58.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.040+0000 7f3852ffd640 1 --2- 172.21.15.2:0/3578716435 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558e6d8f4fb0 0x558e6d9666d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:52:58.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.040+0000 7f3852ffd640 1 --2- 172.21.15.2:0/3578716435 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558e6d8f4fb0 0x558e6d9666d0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6c38315a09b517f server_cookie=43faf67912ac764e in_seq=0 out_seq=0 2024-09-19T04:52:58.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.040+0000 7f3832ffd640 10 client.15948 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:52:58.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.040+0000 7f3832ffd640 1 -- 172.21.15.2:0/3578716435 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x558e6d8e2ac0 con 0x558e6d8f4fb0 2024-09-19T04:52:58.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.040+0000 7f3832ffd640 10 client.15948 handle_command_reply: tid=0 2024-09-19T04:52:58.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.040+0000 7f385c03c740 1 client.15948 shutdown 2024-09-19T04:52:58.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.041+0000 7f385c03c740 1 -- 172.21.15.2:0/3578716435 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e6d8da490 msgr2=0x558e6d8e92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:58.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.041+0000 7f385c03c740 1 --2- 172.21.15.2:0/3578716435 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e6d8da490 0x558e6d8e92f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f38440bd4d0 tx=0x7f38440b9840 comp rx=0 tx=0).stop 2024-09-19T04:52:58.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.041+0000 7f385c03c740 1 -- 172.21.15.2:0/3578716435 shutdown_connections 2024-09-19T04:52:58.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.041+0000 7f385c03c740 1 --2- 172.21.15.2:0/3578716435 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e6d8e5670 0x558e6d8e9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:58.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.041+0000 7f385c03c740 1 --2- 172.21.15.2:0/3578716435 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558e6d8f4fb0 0x558e6d9666d0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:58.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.041+0000 7f385c03c740 1 --2- 172.21.15.2:0/3578716435 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558e6d8dadb0 0x558e6d8e9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:58.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.041+0000 7f3832ffd640 0 client.15948 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:52:58.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.041+0000 7f385c03c740 1 --2- 172.21.15.2:0/3578716435 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558e6d8da490 0x558e6d8e92f0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:58.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.041+0000 7f385c03c740 1 -- 172.21.15.2:0/3578716435 >> 172.21.15.2:0/3578716435 conn(0x558e6d8d6a20 msgr2=0x558e6d8d5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:58.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.041+0000 7f385c03c740 1 -- 172.21.15.2:0/3578716435 shutdown_connections 2024-09-19T04:52:58.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.041+0000 7f385c03c740 1 -- 172.21.15.2:0/3578716435 wait complete. 2024-09-19T04:52:58.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.041+0000 7f385c03c740 20 client.15948 trim_cache size 0 max 16384 2024-09-19T04:52:58.050 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:52:58.050 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T04:52:58.050 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-19T04:52:58.050 INFO:teuthology.orchestra.run.smithi002.stdout: "69bf36a4-3958-4840-89c7-006dfd8723d6": { 2024-09-19T04:52:58.051 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-19T04:52:58.051 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "69bf36a4-3958-4840-89c7-006dfd8723d6", 2024-09-19T04:52:58.051 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-19T04:52:58.051 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:52:58.051 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:52:58.051 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:52:58.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.041+0000 7f3859c63640 1 -- 172.21.15.2:0/1500359986 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f383c0a3430 msgr2=0x7f383c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:58.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.041+0000 7f3859c63640 1 --2- 172.21.15.2:0/1500359986 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f383c0a3430 0x7f383c0a58f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f384c005fd0 tx=0x7f384c005850 comp rx=0 tx=0).stop 2024-09-19T04:52:58.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.041+0000 7f3859c63640 1 -- 172.21.15.2:0/1500359986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3854101de0 msgr2=0x7f3854198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:52:58.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.041+0000 7f3859c63640 1 --2- 172.21.15.2:0/1500359986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3854101de0 0x7f3854198360 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f384402ade0 tx=0x7f3844032ff0 comp rx=0 tx=0).stop 2024-09-19T04:52:58.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.041+0000 7f3859c63640 1 -- 172.21.15.2:0/1500359986 shutdown_connections 2024-09-19T04:52:58.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.041+0000 7f3859c63640 1 --2- 172.21.15.2:0/1500359986 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f383c0a3430 0x7f383c0a58f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:58.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.041+0000 7f3859c63640 1 --2- 172.21.15.2:0/1500359986 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3854106f10 0x7f385419cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:58.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.041+0000 7f3859c63640 1 --2- 172.21.15.2:0/1500359986 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3854102790 0x7f38541988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:58.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.041+0000 7f3859c63640 1 --2- 172.21.15.2:0/1500359986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3854101de0 0x7f3854198360 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:52:58.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.041+0000 7f3859c63640 1 -- 172.21.15.2:0/1500359986 >> 172.21.15.2:0/1500359986 conn(0x7f38540fd8c0 msgr2=0x7f38540fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:52:58.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.042+0000 7f3859c63640 1 -- 172.21.15.2:0/1500359986 shutdown_connections 2024-09-19T04:52:58.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:52:58.042+0000 7f3859c63640 1 -- 172.21.15.2:0/1500359986 wait complete. 2024-09-19T04:52:58.802 INFO:tasks.cephfs.filesystem:scrub status for tag:69bf36a4-3958-4840-89c7-006dfd8723d6 - {'path': '/', 'tag': '69bf36a4-3958-4840-89c7-006dfd8723d6', 'options': 'recursive,force'} 2024-09-19T04:52:59.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:52:59 smithi002 ceph-mon[30975]: pgmap v152: 97 pgs: 97 active+clean; 6.1 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 7 op/s 2024-09-19T04:52:59.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:52:59 smithi116 ceph-mon[34477]: pgmap v152: 97 pgs: 97 active+clean; 6.1 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 7 op/s 2024-09-19T04:52:59.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:52:59 smithi018 ceph-mon[34537]: pgmap v152: 97 pgs: 97 active+clean; 6.1 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 7 op/s 2024-09-19T04:53:01.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:53:01 smithi002 ceph-mon[30975]: pgmap v153: 97 pgs: 97 active+clean; 6.1 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 7 op/s 2024-09-19T04:53:01.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:53:01 smithi002 ceph-mon[30975]: scrub summary: idle 2024-09-19T04:53:01.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:53:01 smithi116 ceph-mon[34477]: pgmap v153: 97 pgs: 97 active+clean; 6.1 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 7 op/s 2024-09-19T04:53:01.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:53:01 smithi116 ceph-mon[34477]: scrub summary: idle 2024-09-19T04:53:01.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:53:01 smithi018 ceph-mon[34537]: pgmap v153: 97 pgs: 97 active+clean; 6.1 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 7 op/s 2024-09-19T04:53:01.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:53:01 smithi018 ceph-mon[34537]: scrub summary: idle 2024-09-19T04:53:03.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:53:03 smithi002 ceph-mon[30975]: pgmap v154: 97 pgs: 97 active+clean; 6.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 62 KiB/s wr, 25 op/s 2024-09-19T04:53:03.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:53:03 smithi116 ceph-mon[34477]: pgmap v154: 97 pgs: 97 active+clean; 6.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 62 KiB/s wr, 25 op/s 2024-09-19T04:53:03.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:53:03 smithi018 ceph-mon[34537]: pgmap v154: 97 pgs: 97 active+clean; 6.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 62 KiB/s wr, 25 op/s 2024-09-19T04:53:05.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:53:05 smithi002 ceph-mon[30975]: pgmap v155: 97 pgs: 97 active+clean; 6.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 50 KiB/s wr, 22 op/s 2024-09-19T04:53:05.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:53:05 smithi116 ceph-mon[34477]: pgmap v155: 97 pgs: 97 active+clean; 6.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 50 KiB/s wr, 22 op/s 2024-09-19T04:53:05.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:53:05 smithi018 ceph-mon[34537]: pgmap v155: 97 pgs: 97 active+clean; 6.2 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 50 KiB/s wr, 22 op/s 2024-09-19T04:53:07.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:53:07 smithi002 ceph-mon[30975]: pgmap v156: 97 pgs: 97 active+clean; 6.4 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 65 KiB/s wr, 26 op/s 2024-09-19T04:53:07.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:53:07 smithi116 ceph-mon[34477]: pgmap v156: 97 pgs: 97 active+clean; 6.4 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 65 KiB/s wr, 26 op/s 2024-09-19T04:53:07.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:53:07 smithi018 ceph-mon[34537]: pgmap v156: 97 pgs: 97 active+clean; 6.4 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 65 KiB/s wr, 26 op/s 2024-09-19T04:53:09.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:53:09 smithi002 ceph-mon[30975]: pgmap v157: 97 pgs: 97 active+clean; 6.4 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 51 KiB/s wr, 22 op/s 2024-09-19T04:53:09.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:53:09 smithi116 ceph-mon[34477]: pgmap v157: 97 pgs: 97 active+clean; 6.4 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 51 KiB/s wr, 22 op/s 2024-09-19T04:53:09.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:53:09 smithi018 ceph-mon[34537]: pgmap v157: 97 pgs: 97 active+clean; 6.4 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 51 KiB/s wr, 22 op/s 2024-09-19T04:53:11.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:53:11 smithi002 ceph-mon[30975]: pgmap v158: 97 pgs: 97 active+clean; 6.4 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 51 KiB/s wr, 22 op/s 2024-09-19T04:53:11.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:53:11 smithi116 ceph-mon[34477]: pgmap v158: 97 pgs: 97 active+clean; 6.4 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 51 KiB/s wr, 22 op/s 2024-09-19T04:53:11.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:53:11 smithi018 ceph-mon[34537]: pgmap v158: 97 pgs: 97 active+clean; 6.4 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 51 KiB/s wr, 22 op/s 2024-09-19T04:53:12.361 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:53:12 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:53:12.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:53:12 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:53:12.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:53:12 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:53:12.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:53:12 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:53:12.362 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:53:12 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:53:12.363 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:53:12 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:53:12.363 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:53:12 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:53:12.363 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:53:12 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:53:12.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:53:12 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:53:12.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:53:12 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:53:12.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:53:12 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:53:12.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:53:12 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:53:13.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:53:13 smithi002 ceph-mon[30975]: pgmap v159: 97 pgs: 97 active+clean; 6.5 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 62 KiB/s wr, 25 op/s 2024-09-19T04:53:13.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:53:13 smithi116 ceph-mon[34477]: pgmap v159: 97 pgs: 97 active+clean; 6.5 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 62 KiB/s wr, 25 op/s 2024-09-19T04:53:13.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:53:13 smithi018 ceph-mon[34537]: pgmap v159: 97 pgs: 97 active+clean; 6.5 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 62 KiB/s wr, 25 op/s 2024-09-19T04:53:15.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:53:15 smithi002 ceph-mon[30975]: pgmap v160: 97 pgs: 97 active+clean; 6.5 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 6 op/s 2024-09-19T04:53:15.360 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:53:15 smithi116 ceph-mon[34477]: pgmap v160: 97 pgs: 97 active+clean; 6.5 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 6 op/s 2024-09-19T04:53:15.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:53:15 smithi018 ceph-mon[34537]: pgmap v160: 97 pgs: 97 active+clean; 6.5 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 6 op/s 2024-09-19T04:53:17.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:53:17 smithi018 ceph-mon[34537]: pgmap v161: 97 pgs: 97 active+clean; 6.7 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 10 op/s 2024-09-19T04:53:17.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:53:17 smithi002 ceph-mon[30975]: pgmap v161: 97 pgs: 97 active+clean; 6.7 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 10 op/s 2024-09-19T04:53:17.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:53:17 smithi116 ceph-mon[34477]: pgmap v161: 97 pgs: 97 active+clean; 6.7 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 10 op/s 2024-09-19T04:53:18.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:53:18 smithi018 ceph-mon[34537]: pgmap v162: 97 pgs: 97 active+clean; 6.7 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 6 op/s 2024-09-19T04:53:18.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:53:18 smithi002 ceph-mon[30975]: pgmap v162: 97 pgs: 97 active+clean; 6.7 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 6 op/s 2024-09-19T04:53:18.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:53:18 smithi116 ceph-mon[34477]: pgmap v162: 97 pgs: 97 active+clean; 6.7 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 6 op/s 2024-09-19T04:53:20.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:53:20 smithi018 ceph-mon[34537]: pgmap v163: 97 pgs: 97 active+clean; 6.7 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 6 op/s 2024-09-19T04:53:20.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:53:20 smithi002 ceph-mon[30975]: pgmap v163: 97 pgs: 97 active+clean; 6.7 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 6 op/s 2024-09-19T04:53:20.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:53:20 smithi116 ceph-mon[34477]: pgmap v163: 97 pgs: 97 active+clean; 6.7 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 6 op/s 2024-09-19T04:53:22.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:53:22 smithi018 ceph-mon[34537]: pgmap v164: 97 pgs: 97 active+clean; 6.8 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 10 op/s 2024-09-19T04:53:22.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:53:22 smithi002 ceph-mon[30975]: pgmap v164: 97 pgs: 97 active+clean; 6.8 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 10 op/s 2024-09-19T04:53:22.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:53:22 smithi116 ceph-mon[34477]: pgmap v164: 97 pgs: 97 active+clean; 6.8 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 10 op/s 2024-09-19T04:53:23.316 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.316 INFO:tasks.workunit.client.0.smithi002.stdout:189/600: open fd = 3 2024-09-19T04:53:23.316 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.316 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.316 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.316 INFO:tasks.workunit.client.0.smithi002.stdout:190/600: open fd = 3 2024-09-19T04:53:23.316 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.316 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.317 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.317 INFO:tasks.workunit.client.0.smithi002.stdout:191/600: open fd = 3 2024-09-19T04:53:23.317 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.317 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.317 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.317 INFO:tasks.workunit.client.0.smithi002.stdout:192/600: open fd = 3 2024-09-19T04:53:23.317 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.317 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.317 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.317 INFO:tasks.workunit.client.0.smithi002.stdout:193/600: open fd = 3 2024-09-19T04:53:23.317 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.317 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.317 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.318 INFO:tasks.workunit.client.0.smithi002.stdout:194/600: open fd = 3 2024-09-19T04:53:23.318 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.318 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.318 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.318 INFO:tasks.workunit.client.0.smithi002.stdout:195/600: open fd = 3 2024-09-19T04:53:23.318 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.318 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.318 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.318 INFO:tasks.workunit.client.0.smithi002.stdout:196/600: open fd = 3 2024-09-19T04:53:23.318 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.318 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.318 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.318 INFO:tasks.workunit.client.0.smithi002.stdout:197/600: open fd = 3 2024-09-19T04:53:23.319 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.319 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.319 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.319 INFO:tasks.workunit.client.0.smithi002.stdout:198/600: open fd = 3 2024-09-19T04:53:23.319 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.319 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.319 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.319 INFO:tasks.workunit.client.0.smithi002.stdout:199/600: open fd = 3 2024-09-19T04:53:23.319 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.319 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.319 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.319 INFO:tasks.workunit.client.0.smithi002.stdout:200/600: open fd = 3 2024-09-19T04:53:23.319 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.320 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.320 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.320 INFO:tasks.workunit.client.0.smithi002.stdout:201/600: open fd = 3 2024-09-19T04:53:23.320 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.320 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.320 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.320 INFO:tasks.workunit.client.0.smithi002.stdout:202/600: open fd = 3 2024-09-19T04:53:23.320 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.320 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.320 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.320 INFO:tasks.workunit.client.0.smithi002.stdout:203/600: open fd = 3 2024-09-19T04:53:23.320 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.321 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.321 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.321 INFO:tasks.workunit.client.0.smithi002.stdout:204/600: open fd = 3 2024-09-19T04:53:23.321 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.321 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.321 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.321 INFO:tasks.workunit.client.0.smithi002.stdout:205/600: open fd = 3 2024-09-19T04:53:23.321 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.321 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.321 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.321 INFO:tasks.workunit.client.0.smithi002.stdout:206/600: open fd = 3 2024-09-19T04:53:23.321 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.321 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.321 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.322 INFO:tasks.workunit.client.0.smithi002.stdout:207/600: open fd = 3 2024-09-19T04:53:23.322 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.322 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.322 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.322 INFO:tasks.workunit.client.0.smithi002.stdout:208/600: open fd = 3 2024-09-19T04:53:23.322 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.322 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.322 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.322 INFO:tasks.workunit.client.0.smithi002.stdout:209/600: open fd = 3 2024-09-19T04:53:23.323 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.323 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.323 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.323 INFO:tasks.workunit.client.0.smithi002.stdout:210/600: open fd = 3 2024-09-19T04:53:23.323 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.323 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.323 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.323 INFO:tasks.workunit.client.0.smithi002.stdout:211/600: open fd = 3 2024-09-19T04:53:23.324 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.324 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.324 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.324 INFO:tasks.workunit.client.0.smithi002.stdout:212/600: open fd = 3 2024-09-19T04:53:23.324 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.324 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.324 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.324 INFO:tasks.workunit.client.0.smithi002.stdout:213/600: open fd = 3 2024-09-19T04:53:23.324 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.324 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.324 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.324 INFO:tasks.workunit.client.0.smithi002.stdout:214/600: open fd = 3 2024-09-19T04:53:23.324 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.325 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.325 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.325 INFO:tasks.workunit.client.0.smithi002.stdout:215/600: open fd = 3 2024-09-19T04:53:23.325 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.325 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.325 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.325 INFO:tasks.workunit.client.0.smithi002.stdout:216/600: open fd = 3 2024-09-19T04:53:23.325 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.325 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.325 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.325 INFO:tasks.workunit.client.0.smithi002.stdout:217/600: open fd = 3 2024-09-19T04:53:23.325 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.325 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.326 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.326 INFO:tasks.workunit.client.0.smithi002.stdout:218/600: open fd = 3 2024-09-19T04:53:23.326 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.326 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.326 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.326 INFO:tasks.workunit.client.0.smithi002.stdout:219/600: open fd = 3 2024-09-19T04:53:23.326 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.326 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.326 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.326 INFO:tasks.workunit.client.0.smithi002.stdout:220/600: open fd = 3 2024-09-19T04:53:23.326 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.326 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.326 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.327 INFO:tasks.workunit.client.0.smithi002.stdout:221/600: open fd = 3 2024-09-19T04:53:23.327 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.327 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.327 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.327 INFO:tasks.workunit.client.0.smithi002.stdout:222/600: open fd = 3 2024-09-19T04:53:23.327 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.327 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.327 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.327 INFO:tasks.workunit.client.0.smithi002.stdout:223/600: open fd = 3 2024-09-19T04:53:23.327 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.327 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.327 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.327 INFO:tasks.workunit.client.0.smithi002.stdout:224/600: open fd = 3 2024-09-19T04:53:23.328 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.328 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.328 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.328 INFO:tasks.workunit.client.0.smithi002.stdout:225/600: open fd = 3 2024-09-19T04:53:23.328 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.328 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.328 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.328 INFO:tasks.workunit.client.0.smithi002.stdout:226/600: open fd = 3 2024-09-19T04:53:23.328 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.328 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.328 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.328 INFO:tasks.workunit.client.0.smithi002.stdout:227/600: open fd = 3 2024-09-19T04:53:23.328 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.328 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.329 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.329 INFO:tasks.workunit.client.0.smithi002.stdout:228/600: open fd = 3 2024-09-19T04:53:23.329 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.329 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.329 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.329 INFO:tasks.workunit.client.0.smithi002.stdout:229/600: open fd = 3 2024-09-19T04:53:23.329 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.329 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.329 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.329 INFO:tasks.workunit.client.0.smithi002.stdout:230/600: open fd = 3 2024-09-19T04:53:23.329 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.329 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.329 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.329 INFO:tasks.workunit.client.0.smithi002.stdout:231/600: open fd = 3 2024-09-19T04:53:23.330 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.330 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.330 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.330 INFO:tasks.workunit.client.0.smithi002.stdout:232/600: open fd = 3 2024-09-19T04:53:23.330 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.330 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.330 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.330 INFO:tasks.workunit.client.0.smithi002.stdout:233/600: open fd = 3 2024-09-19T04:53:23.330 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.330 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.330 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.330 INFO:tasks.workunit.client.0.smithi002.stdout:234/600: open fd = 3 2024-09-19T04:53:23.330 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.330 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.331 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.331 INFO:tasks.workunit.client.0.smithi002.stdout:235/600: open fd = 3 2024-09-19T04:53:23.331 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.331 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.331 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.331 INFO:tasks.workunit.client.0.smithi002.stdout:236/600: open fd = 3 2024-09-19T04:53:23.331 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.331 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.331 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.331 INFO:tasks.workunit.client.0.smithi002.stdout:237/600: open fd = 3 2024-09-19T04:53:23.331 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.331 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.331 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.332 INFO:tasks.workunit.client.0.smithi002.stdout:238/600: open fd = 3 2024-09-19T04:53:23.332 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.332 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.332 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.332 INFO:tasks.workunit.client.0.smithi002.stdout:239/600: open fd = 3 2024-09-19T04:53:23.332 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.332 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.332 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.332 INFO:tasks.workunit.client.0.smithi002.stdout:240/600: open fd = 3 2024-09-19T04:53:23.332 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.332 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.332 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.332 INFO:tasks.workunit.client.0.smithi002.stdout:241/600: open fd = 3 2024-09-19T04:53:23.333 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.333 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.333 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.333 INFO:tasks.workunit.client.0.smithi002.stdout:242/600: open fd = 3 2024-09-19T04:53:23.333 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.333 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.333 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.333 INFO:tasks.workunit.client.0.smithi002.stdout:243/600: open fd = 3 2024-09-19T04:53:23.333 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.333 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.333 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.333 INFO:tasks.workunit.client.0.smithi002.stdout:244/600: open fd = 3 2024-09-19T04:53:23.333 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.333 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.334 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.334 INFO:tasks.workunit.client.0.smithi002.stdout:245/600: open fd = 3 2024-09-19T04:53:23.334 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.334 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.334 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.334 INFO:tasks.workunit.client.0.smithi002.stdout:246/600: open fd = 3 2024-09-19T04:53:23.334 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.334 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.334 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.334 INFO:tasks.workunit.client.0.smithi002.stdout:247/600: open fd = 3 2024-09-19T04:53:23.334 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.334 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.334 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.334 INFO:tasks.workunit.client.0.smithi002.stdout:248/600: open fd = 3 2024-09-19T04:53:23.335 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.335 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.335 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.335 INFO:tasks.workunit.client.0.smithi002.stdout:249/600: open fd = 3 2024-09-19T04:53:23.335 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.335 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.335 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:53:23.335 INFO:tasks.workunit.client.0.smithi002.stdout:250/600: open fd = 3 2024-09-19T04:53:23.335 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:23.335 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:53:24.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:53:24 smithi018 ceph-mon[34537]: pgmap v165: 97 pgs: 97 active+clean; 6.8 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 29 KiB/s wr, 7 op/s 2024-09-19T04:53:24.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:53:24 smithi002 ceph-mon[30975]: pgmap v165: 97 pgs: 97 active+clean; 6.8 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 29 KiB/s wr, 7 op/s 2024-09-19T04:53:24.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:53:24 smithi116 ceph-mon[34477]: pgmap v165: 97 pgs: 97 active+clean; 6.8 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 29 KiB/s wr, 7 op/s 2024-09-19T04:53:26.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:53:26 smithi002 ceph-mon[30975]: pgmap v166: 97 pgs: 97 active+clean; 7.0 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 46 KiB/s wr, 11 op/s 2024-09-19T04:53:26.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:53:26 smithi116 ceph-mon[34477]: pgmap v166: 97 pgs: 97 active+clean; 7.0 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 46 KiB/s wr, 11 op/s 2024-09-19T04:53:26.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:53:26 smithi018 ceph-mon[34537]: pgmap v166: 97 pgs: 97 active+clean; 7.0 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 46 KiB/s wr, 11 op/s 2024-09-19T04:53:28.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:53:28 smithi002 ceph-mon[30975]: pgmap v167: 97 pgs: 97 active+clean; 7.0 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 30 KiB/s wr, 7 op/s 2024-09-19T04:53:28.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:53:28 smithi116 ceph-mon[34477]: pgmap v167: 97 pgs: 97 active+clean; 7.0 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 30 KiB/s wr, 7 op/s 2024-09-19T04:53:28.804 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:53:28.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:53:28 smithi018 ceph-mon[34537]: pgmap v167: 97 pgs: 97 active+clean; 7.0 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 30 KiB/s wr, 7 op/s 2024-09-19T04:53:29.077 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:53:29.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.525+0000 7f006f788640 1 -- 172.21.15.2:0/3057888042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0068074620 msgr2=0x7f0068074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:29.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.525+0000 7f006f788640 1 --2- 172.21.15.2:0/3057888042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0068074620 0x7f0068074a00 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f0064009900 tx=0x7f006402a480 comp rx=0 tx=0).stop 2024-09-19T04:53:29.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.525+0000 7f006f788640 1 -- 172.21.15.2:0/3057888042 shutdown_connections 2024-09-19T04:53:29.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.526+0000 7f006f788640 1 --2- 172.21.15.2:0/3057888042 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f006810e3c0 0x7f0068110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:29.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.526+0000 7f006f788640 1 --2- 172.21.15.2:0/3057888042 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0068074f40 0x7f006810de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:29.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.526+0000 7f006f788640 1 --2- 172.21.15.2:0/3057888042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0068074620 0x7f0068074a00 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:29.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.526+0000 7f006f788640 1 -- 172.21.15.2:0/3057888042 >> 172.21.15.2:0/3057888042 conn(0x7f00680fd8c0 msgr2=0x7f00680ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:53:29.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.526+0000 7f006f788640 1 -- 172.21.15.2:0/3057888042 shutdown_connections 2024-09-19T04:53:29.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.526+0000 7f006f788640 1 -- 172.21.15.2:0/3057888042 wait complete. 2024-09-19T04:53:29.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.526+0000 7f006f788640 1 Processor -- start 2024-09-19T04:53:29.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.526+0000 7f006f788640 1 -- start start 2024-09-19T04:53:29.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.526+0000 7f006f788640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0068074620 0x7f006819a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:29.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.526+0000 7f006f788640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0068074f40 0x7f006819aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:29.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.526+0000 7f006f788640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f006810e3c0 0x7f006819ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:29.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.526+0000 7f006f788640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0068114020 con 0x7f006810e3c0 2024-09-19T04:53:29.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.526+0000 7f006f788640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0068113ea0 con 0x7f0068074f40 2024-09-19T04:53:29.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.526+0000 7f006f788640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f00681141a0 con 0x7f0068074620 2024-09-19T04:53:29.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.527+0000 7f006dd25640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f006810e3c0 0x7f006819ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:29.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.527+0000 7f006dd25640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f006810e3c0 0x7f006819ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34844/0 (socket says 172.21.15.2:34844) 2024-09-19T04:53:29.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.527+0000 7f006dd25640 1 -- 172.21.15.2:0/4032264473 learned_addr learned my addr 172.21.15.2:0/4032264473 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:53:29.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.527+0000 7f006cd23640 1 --2- 172.21.15.2:0/4032264473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0068074f40 0x7f006819aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:29.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.527+0000 7f006d524640 1 --2- 172.21.15.2:0/4032264473 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0068074620 0x7f006819a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:29.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.527+0000 7f006cd23640 1 -- 172.21.15.2:0/4032264473 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0068074620 msgr2=0x7f006819a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:29.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.527+0000 7f006cd23640 1 --2- 172.21.15.2:0/4032264473 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0068074620 0x7f006819a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:29.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.527+0000 7f006cd23640 1 -- 172.21.15.2:0/4032264473 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f006810e3c0 msgr2=0x7f006819ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:29.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.527+0000 7f006cd23640 1 --2- 172.21.15.2:0/4032264473 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f006810e3c0 0x7f006819ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:29.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.527+0000 7f006cd23640 1 -- 172.21.15.2:0/4032264473 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f006819f4f0 con 0x7f0068074f40 2024-09-19T04:53:29.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.527+0000 7f006dd25640 1 --2- 172.21.15.2:0/4032264473 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f006810e3c0 0x7f006819ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:53:29.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.527+0000 7f006cd23640 1 --2- 172.21.15.2:0/4032264473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0068074f40 0x7f006819aa80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f005800d720 tx=0x7f005800dbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:53:29.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.527+0000 7f005e7fc640 1 -- 172.21.15.2:0/4032264473 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0058017070 con 0x7f0068074f40 2024-09-19T04:53:29.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.528+0000 7f006f788640 1 -- 172.21.15.2:0/4032264473 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f006819f7e0 con 0x7f0068074f40 2024-09-19T04:53:29.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.528+0000 7f005e7fc640 1 -- 172.21.15.2:0/4032264473 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f005800de30 con 0x7f0068074f40 2024-09-19T04:53:29.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.528+0000 7f005e7fc640 1 -- 172.21.15.2:0/4032264473 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00580047a0 con 0x7f0068074f40 2024-09-19T04:53:29.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.528+0000 7f006f788640 1 -- 172.21.15.2:0/4032264473 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00681a70c0 con 0x7f0068074f40 2024-09-19T04:53:29.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.530+0000 7f0071b61740 1 Processor -- start 2024-09-19T04:53:29.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.530+0000 7f0071b61740 1 -- start start 2024-09-19T04:53:29.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.530+0000 7f005e7fc640 1 -- 172.21.15.2:0/4032264473 <== mon.2 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f00580099d0 con 0x7f0068074f40 2024-09-19T04:53:29.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.530+0000 7f0071b61740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628e44064a0 0x5628e4406880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:29.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.530+0000 7f0071b61740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5628e4406dc0 0x5628e4411140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:29.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.530+0000 7f0071b61740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5628e4411680 0x5628e4413a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:29.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.531+0000 7f0071b61740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5628e436c2e0 con 0x5628e44064a0 2024-09-19T04:53:29.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.531+0000 7f0071b61740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5628e4313ce0 con 0x5628e4411680 2024-09-19T04:53:29.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.531+0000 7f0071b61740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5628e43682a0 con 0x5628e4406dc0 2024-09-19T04:53:29.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.531+0000 7f006dd25640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628e44064a0 0x5628e4406880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:29.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.531+0000 7f006dd25640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628e44064a0 0x5628e4406880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34854/0 (socket says 172.21.15.2:34854) 2024-09-19T04:53:29.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.531+0000 7f006dd25640 1 -- 172.21.15.2:0/2568248599 learned_addr learned my addr 172.21.15.2:0/2568248599 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:53:29.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.531+0000 7f006cd23640 1 --2- 172.21.15.2:0/2568248599 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5628e4411680 0x5628e4413a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:29.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.531+0000 7f006d524640 1 --2- 172.21.15.2:0/2568248599 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5628e4406dc0 0x5628e4411140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:29.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.531+0000 7f006dd25640 1 -- 172.21.15.2:0/2568248599 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5628e4406dc0 msgr2=0x5628e4411140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:29.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.531+0000 7f006dd25640 1 --2- 172.21.15.2:0/2568248599 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5628e4406dc0 0x5628e4411140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:29.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.531+0000 7f006dd25640 1 -- 172.21.15.2:0/2568248599 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5628e4411680 msgr2=0x5628e4413a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:29.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.531+0000 7f006dd25640 1 --2- 172.21.15.2:0/2568248599 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5628e4411680 0x5628e4413a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:29.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.531+0000 7f006dd25640 1 -- 172.21.15.2:0/2568248599 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628e42f8440 con 0x5628e44064a0 2024-09-19T04:53:29.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.531+0000 7f005e7fc640 1 --2- 172.21.15.2:0/4032264473 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f00540a33b0 0x7f00540a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:29.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.531+0000 7f006dd25640 1 --2- 172.21.15.2:0/2568248599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628e44064a0 0x5628e4406880 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f006000f790 tx=0x7f006000fb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1d8f33d8d321f9b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:53:29.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.531+0000 7f006d524640 1 --2- 172.21.15.2:0/4032264473 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f00540a33b0 0x7f00540a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:29.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.531+0000 7f005e7fc640 1 -- 172.21.15.2:0/4032264473 <== mon.2 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f00580cf900 con 0x7f0068074f40 2024-09-19T04:53:29.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.531+0000 7f00537fe640 1 -- 172.21.15.2:0/2568248599 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0060004d20 con 0x5628e44064a0 2024-09-19T04:53:29.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.532+0000 7f00537fe640 1 -- 172.21.15.2:0/2568248599 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f006000ddd0 con 0x5628e44064a0 2024-09-19T04:53:29.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.532+0000 7f00537fe640 1 -- 172.21.15.2:0/2568248599 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0060010430 con 0x5628e44064a0 2024-09-19T04:53:29.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.532+0000 7f0071b61740 1 -- 172.21.15.2:0/2568248599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628e44064a0 msgr2=0x5628e4406880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:29.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.532+0000 7f0071b61740 1 --2- 172.21.15.2:0/2568248599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628e44064a0 0x5628e4406880 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f006000f790 tx=0x7f006000fb90 comp rx=0 tx=0).stop 2024-09-19T04:53:29.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.532+0000 7f006d524640 1 --2- 172.21.15.2:0/4032264473 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f00540a33b0 0x7f00540a5870 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0064031440 tx=0x7f0064005890 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:53:29.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.532+0000 7f0071b61740 1 -- 172.21.15.2:0/2568248599 shutdown_connections 2024-09-19T04:53:29.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.532+0000 7f0071b61740 1 --2- 172.21.15.2:0/2568248599 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5628e4411680 0x5628e4413a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:29.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.532+0000 7f0071b61740 1 --2- 172.21.15.2:0/2568248599 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5628e4406dc0 0x5628e4411140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:29.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.532+0000 7f0071b61740 1 --2- 172.21.15.2:0/2568248599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628e44064a0 0x5628e4406880 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:29.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.532+0000 7f0071b61740 1 -- 172.21.15.2:0/2568248599 >> 172.21.15.2:0/2568248599 conn(0x5628e4402a30 msgr2=0x5628e4402e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:53:29.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.532+0000 7f0071b61740 1 -- 172.21.15.2:0/2568248599 shutdown_connections 2024-09-19T04:53:29.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.532+0000 7f0071b61740 1 -- 172.21.15.2:0/2568248599 wait complete. 2024-09-19T04:53:29.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.533+0000 7f0071b61740 1 -- start start 2024-09-19T04:53:29.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.533+0000 7f0071b61740 1 Processor -- start 2024-09-19T04:53:29.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.533+0000 7f0071b61740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628e44064a0 0x5628e4410f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:29.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.533+0000 7f0071b61740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5628e4406dc0 0x5628e440e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:29.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.533+0000 7f0071b61740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5628e4411680 0x5628e440e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:29.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.533+0000 7f0071b61740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5628e4414250 con 0x5628e44064a0 2024-09-19T04:53:29.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.533+0000 7f0071b61740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5628e4327050 con 0x5628e4406dc0 2024-09-19T04:53:29.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.533+0000 7f0071b61740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5628e44143d0 con 0x5628e4411680 2024-09-19T04:53:29.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.533+0000 7f0071b61740 10 client.0 _ll_register_callbacks cb 0x5628e4367160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:53:29.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.533+0000 7f006d524640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628e44064a0 0x5628e4410f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:29.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.533+0000 7f006d524640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628e44064a0 0x5628e4410f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34866/0 (socket says 172.21.15.2:34866) 2024-09-19T04:53:29.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.533+0000 7f006d524640 1 -- 172.21.15.2:0/464853718 learned_addr learned my addr 172.21.15.2:0/464853718 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:53:29.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.534+0000 7f006cd23640 1 --2- 172.21.15.2:0/464853718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5628e4406dc0 0x5628e440e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:29.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.534+0000 7f006dd25640 1 --2- 172.21.15.2:0/464853718 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5628e4411680 0x5628e440e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:29.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.534+0000 7f006d524640 1 -- 172.21.15.2:0/464853718 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5628e4411680 msgr2=0x5628e440e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:29.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.534+0000 7f006d524640 1 --2- 172.21.15.2:0/464853718 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5628e4411680 0x5628e440e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:29.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.534+0000 7f006d524640 1 -- 172.21.15.2:0/464853718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5628e4406dc0 msgr2=0x5628e440e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:29.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.534+0000 7f006d524640 1 --2- 172.21.15.2:0/464853718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5628e4406dc0 0x5628e440e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:29.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.534+0000 7f006d524640 1 -- 172.21.15.2:0/464853718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628e40dd3c0 con 0x5628e44064a0 2024-09-19T04:53:29.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.534+0000 7f006d524640 1 --2- 172.21.15.2:0/464853718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628e44064a0 0x5628e4410f30 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f0064032cd0 tx=0x7f0064009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2e13ec5983e8dfa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:53:29.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.534+0000 7f0050ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:53:29.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.534+0000 7f0050ff9640 1 -- 172.21.15.2:0/464853718 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f006404c070 con 0x5628e44064a0 2024-09-19T04:53:29.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.534+0000 7f0050ff9640 1 -- 172.21.15.2:0/464853718 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f0064005440 con 0x5628e44064a0 2024-09-19T04:53:29.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.534+0000 7f0071b61740 1 -- 172.21.15.2:0/464853718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f006000ddd0 con 0x5628e44064a0 2024-09-19T04:53:29.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.534+0000 7f0050ff9640 1 -- 172.21.15.2:0/464853718 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f0064058050 con 0x5628e44064a0 2024-09-19T04:53:29.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.534+0000 7f0071b61740 10 client.15960 fetch_fsmap learned FSMap version 19 2024-09-19T04:53:29.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.534+0000 7f0071b61740 1 -- 172.21.15.2:0/464853718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5628e441fb70 con 0x5628e44064a0 2024-09-19T04:53:29.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.535+0000 7f0050ff9640 1 -- 172.21.15.2:0/464853718 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f006000ddd0 con 0x5628e44064a0 2024-09-19T04:53:29.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.535+0000 7f0050ff9640 1 -- 172.21.15.2:0/464853718 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f00640037b0 con 0x5628e44064a0 2024-09-19T04:53:29.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.535+0000 7f0071b61740 10 client.15960 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:53:29.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.535+0000 7f0071b61740 10 client.15960 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:53:29.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.535+0000 7f0071b61740 20 client.15960 populate_metadata read hostname 'smithi002' 2024-09-19T04:53:29.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.535+0000 7f0071b61740 1 --2- 172.21.15.2:0/464853718 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5628e4420f80 0x5628e44233f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:29.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.535+0000 7f0071b61740 4 client.15960 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:53:29.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.535+0000 7f0071b61740 1 -- 172.21.15.2:0/464853718 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5628e4379850 con 0x5628e4420f80 2024-09-19T04:53:29.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.535+0000 7f006cd23640 1 --2- 172.21.15.2:0/464853718 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5628e4420f80 0x5628e44233f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.536+0000 7f006cd23640 1 --2- 172.21.15.2:0/464853718 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5628e4420f80 0x5628e44233f0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7dff8b50b02a81e7 server_cookie=82a057b44f3cc790 in_seq=0 out_seq=0 2024-09-19T04:53:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.536+0000 7f0050ff9640 10 client.15960 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:53:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.536+0000 7f0050ff9640 1 -- 172.21.15.2:0/464853718 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5628e4379850 con 0x5628e4420f80 2024-09-19T04:53:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.536+0000 7f0050ff9640 10 client.15960 handle_command_reply: tid=0 2024-09-19T04:53:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.536+0000 7f0071b61740 1 client.15960 shutdown 2024-09-19T04:53:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.537+0000 7f0071b61740 1 -- 172.21.15.2:0/464853718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628e44064a0 msgr2=0x5628e4410f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.537+0000 7f0071b61740 1 --2- 172.21.15.2:0/464853718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628e44064a0 0x5628e4410f30 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f0064032cd0 tx=0x7f0064009260 comp rx=0 tx=0).stop 2024-09-19T04:53:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.537+0000 7f0071b61740 1 -- 172.21.15.2:0/464853718 shutdown_connections 2024-09-19T04:53:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.537+0000 7f0071b61740 1 --2- 172.21.15.2:0/464853718 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5628e4420f80 0x5628e44233f0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.537+0000 7f0050ff9640 0 client.15960 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:53:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.537+0000 7f0071b61740 1 --2- 172.21.15.2:0/464853718 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5628e4411680 0x5628e440e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.537+0000 7f0071b61740 1 --2- 172.21.15.2:0/464853718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5628e4406dc0 0x5628e440e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.537+0000 7f0071b61740 1 --2- 172.21.15.2:0/464853718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628e44064a0 0x5628e4410f30 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:29.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.537+0000 7f0071b61740 1 -- 172.21.15.2:0/464853718 >> 172.21.15.2:0/464853718 conn(0x5628e4402a30 msgr2=0x5628e4408710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:53:29.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.537+0000 7f0071b61740 1 -- 172.21.15.2:0/464853718 shutdown_connections 2024-09-19T04:53:29.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.537+0000 7f0071b61740 1 -- 172.21.15.2:0/464853718 wait complete. 2024-09-19T04:53:29.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.537+0000 7f0071b61740 20 client.15960 trim_cache size 0 max 16384 2024-09-19T04:53:29.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.554+0000 7f0071b61740 1 Processor -- start 2024-09-19T04:53:29.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.554+0000 7f0071b61740 1 -- start start 2024-09-19T04:53:29.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.554+0000 7f0071b61740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5628e44064a0 0x5628e4428d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:29.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.554+0000 7f0071b61740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628e4406dc0 0x5628e4429250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:29.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.554+0000 7f0071b61740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5628e4411680 0x5628e440b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:29.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.554+0000 7f0071b61740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f00681ad880 con 0x5628e4406dc0 2024-09-19T04:53:29.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.554+0000 7f0071b61740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f00681b00e0 con 0x5628e44064a0 2024-09-19T04:53:29.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.554+0000 7f0071b61740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f00681aded0 con 0x5628e4411680 2024-09-19T04:53:29.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.554+0000 7f006cd23640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628e4406dc0 0x5628e4429250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:29.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.554+0000 7f006cd23640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628e4406dc0 0x5628e4429250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34870/0 (socket says 172.21.15.2:34870) 2024-09-19T04:53:29.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.554+0000 7f006cd23640 1 -- 172.21.15.2:0/3307296471 learned_addr learned my addr 172.21.15.2:0/3307296471 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:53:29.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.555+0000 7f006dd25640 1 --2- 172.21.15.2:0/3307296471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5628e4411680 0x5628e440b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:29.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.555+0000 7f006d524640 1 --2- 172.21.15.2:0/3307296471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5628e44064a0 0x5628e4428d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:29.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.555+0000 7f006cd23640 1 -- 172.21.15.2:0/3307296471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5628e4411680 msgr2=0x5628e440b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:29.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.555+0000 7f006cd23640 1 --2- 172.21.15.2:0/3307296471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5628e4411680 0x5628e440b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:29.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.555+0000 7f006cd23640 1 -- 172.21.15.2:0/3307296471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5628e44064a0 msgr2=0x5628e4428d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:29.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.555+0000 7f006cd23640 1 --2- 172.21.15.2:0/3307296471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5628e44064a0 0x5628e4428d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:29.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.555+0000 7f006cd23640 1 -- 172.21.15.2:0/3307296471 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628e44022e0 con 0x5628e4406dc0 2024-09-19T04:53:29.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.555+0000 7f006d524640 1 --2- 172.21.15.2:0/3307296471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5628e44064a0 0x5628e4428d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:53:29.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.555+0000 7f006dd25640 1 --2- 172.21.15.2:0/3307296471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5628e4411680 0x5628e440b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:53:29.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.555+0000 7f006cd23640 1 --2- 172.21.15.2:0/3307296471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628e4406dc0 0x5628e4429250 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f005809b900 tx=0x7f00580d1de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd59a0c4d933cf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:53:29.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.555+0000 7f0052ffd640 1 -- 172.21.15.2:0/3307296471 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f005809c300 con 0x5628e4406dc0 2024-09-19T04:53:29.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.555+0000 7f0052ffd640 1 -- 172.21.15.2:0/3307296471 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0058004220 con 0x5628e4406dc0 2024-09-19T04:53:29.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.555+0000 7f0052ffd640 1 -- 172.21.15.2:0/3307296471 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0058009cc0 con 0x5628e4406dc0 2024-09-19T04:53:29.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.556+0000 7f0071b61740 1 -- 172.21.15.2:0/3307296471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628e4406dc0 msgr2=0x5628e4429250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:29.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.556+0000 7f0071b61740 1 --2- 172.21.15.2:0/3307296471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628e4406dc0 0x5628e4429250 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f005809b900 tx=0x7f00580d1de0 comp rx=0 tx=0).stop 2024-09-19T04:53:29.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.556+0000 7f0071b61740 1 -- 172.21.15.2:0/3307296471 shutdown_connections 2024-09-19T04:53:29.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.556+0000 7f0071b61740 1 --2- 172.21.15.2:0/3307296471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5628e4411680 0x5628e440b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:29.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.556+0000 7f0071b61740 1 --2- 172.21.15.2:0/3307296471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628e4406dc0 0x5628e4429250 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:29.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.556+0000 7f0071b61740 1 --2- 172.21.15.2:0/3307296471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5628e44064a0 0x5628e4428d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:29.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.556+0000 7f0071b61740 1 -- 172.21.15.2:0/3307296471 >> 172.21.15.2:0/3307296471 conn(0x5628e4402a30 msgr2=0x5628e4401b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:53:29.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.556+0000 7f0071b61740 1 -- 172.21.15.2:0/3307296471 shutdown_connections 2024-09-19T04:53:29.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.556+0000 7f0071b61740 1 -- 172.21.15.2:0/3307296471 wait complete. 2024-09-19T04:53:29.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.556+0000 7f0071b61740 1 -- start start 2024-09-19T04:53:29.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.556+0000 7f0071b61740 1 Processor -- start 2024-09-19T04:53:29.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.557+0000 7f0071b61740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5628e44064a0 0x5628e4417630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:29.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.557+0000 7f0071b61740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628e4406dc0 0x5628e4417b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:29.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.557+0000 7f0071b61740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5628e4411680 0x5628e44180b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:29.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.557+0000 7f0071b61740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f00681ae5a0 con 0x5628e4406dc0 2024-09-19T04:53:29.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.557+0000 7f0071b61740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f00681afa10 con 0x5628e44064a0 2024-09-19T04:53:29.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.557+0000 7f0071b61740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f00681aec70 con 0x5628e4411680 2024-09-19T04:53:29.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.557+0000 7f0071b61740 10 client.0 _ll_register_callbacks cb 0x7f0064032c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:53:29.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.557+0000 7f006cd23640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628e4406dc0 0x5628e4417b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:29.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.557+0000 7f006cd23640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628e4406dc0 0x5628e4417b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34876/0 (socket says 172.21.15.2:34876) 2024-09-19T04:53:29.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.557+0000 7f006cd23640 1 -- 172.21.15.2:0/18034883 learned_addr learned my addr 172.21.15.2:0/18034883 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:53:29.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.557+0000 7f006dd25640 1 --2- 172.21.15.2:0/18034883 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5628e4411680 0x5628e44180b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:29.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.557+0000 7f006d524640 1 --2- 172.21.15.2:0/18034883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5628e44064a0 0x5628e4417630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:29.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.557+0000 7f006cd23640 1 -- 172.21.15.2:0/18034883 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5628e4411680 msgr2=0x5628e44180b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:29.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.557+0000 7f006cd23640 1 --2- 172.21.15.2:0/18034883 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5628e4411680 0x5628e44180b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:29.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.557+0000 7f006cd23640 1 -- 172.21.15.2:0/18034883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5628e44064a0 msgr2=0x5628e4417630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:29.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.557+0000 7f006cd23640 1 --2- 172.21.15.2:0/18034883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5628e44064a0 0x5628e4417630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:29.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.557+0000 7f006cd23640 1 -- 172.21.15.2:0/18034883 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628e4406bf0 con 0x5628e4406dc0 2024-09-19T04:53:29.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.557+0000 7f006d524640 1 --2- 172.21.15.2:0/18034883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5628e44064a0 0x5628e4417630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:53:29.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.557+0000 7f006dd25640 1 --2- 172.21.15.2:0/18034883 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5628e4411680 0x5628e44180b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:53:29.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.557+0000 7f006cd23640 1 --2- 172.21.15.2:0/18034883 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628e4406dc0 0x5628e4417b70 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f0058005fd0 tx=0x7f00580a00a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff64e37bf3960df3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:53:29.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.557+0000 7f0050ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:53:29.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.557+0000 7f0050ff9640 1 -- 172.21.15.2:0/18034883 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00580b2030 con 0x5628e4406dc0 2024-09-19T04:53:29.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.557+0000 7f0050ff9640 1 -- 172.21.15.2:0/18034883 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f00580b3070 con 0x5628e4406dc0 2024-09-19T04:53:29.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.557+0000 7f0071b61740 1 -- 172.21.15.2:0/18034883 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0058004220 con 0x5628e4406dc0 2024-09-19T04:53:29.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.558+0000 7f0050ff9640 1 -- 172.21.15.2:0/18034883 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f0058099f00 con 0x5628e4406dc0 2024-09-19T04:53:29.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.558+0000 7f0071b61740 10 client.15966 fetch_fsmap learned FSMap version 19 2024-09-19T04:53:29.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.558+0000 7f0071b61740 1 -- 172.21.15.2:0/18034883 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5628e448c020 con 0x5628e4406dc0 2024-09-19T04:53:29.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.558+0000 7f0050ff9640 1 -- 172.21.15.2:0/18034883 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0058004220 con 0x5628e4406dc0 2024-09-19T04:53:29.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.558+0000 7f0050ff9640 1 -- 172.21.15.2:0/18034883 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f00580cd2f0 con 0x5628e4406dc0 2024-09-19T04:53:29.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.558+0000 7f0071b61740 10 client.15966 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:53:29.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.558+0000 7f0071b61740 10 client.15966 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:53:29.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.558+0000 7f0071b61740 20 client.15966 populate_metadata read hostname 'smithi002' 2024-09-19T04:53:29.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.558+0000 7f0071b61740 1 --2- 172.21.15.2:0/18034883 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5628e4420f80 0x5628e448e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:29.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.558+0000 7f0071b61740 4 client.15966 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:53:29.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.558+0000 7f0071b61740 1 -- 172.21.15.2:0/18034883 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5628e440eab0 con 0x5628e4420f80 2024-09-19T04:53:29.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.558+0000 7f006d524640 1 --2- 172.21.15.2:0/18034883 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5628e4420f80 0x5628e448e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:29.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.559+0000 7f006d524640 1 --2- 172.21.15.2:0/18034883 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5628e4420f80 0x5628e448e760 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0da7f47ee4e6c01 server_cookie=dbb9d7f11d3c722f in_seq=0 out_seq=0 2024-09-19T04:53:29.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.559+0000 7f0050ff9640 10 client.15966 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:53:29.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.559+0000 7f0050ff9640 1 -- 172.21.15.2:0/18034883 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5628e440eab0 con 0x5628e4420f80 2024-09-19T04:53:29.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.559+0000 7f0050ff9640 10 client.15966 handle_command_reply: tid=0 2024-09-19T04:53:29.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.559+0000 7f0071b61740 1 client.15966 shutdown 2024-09-19T04:53:29.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.559+0000 7f0071b61740 1 -- 172.21.15.2:0/18034883 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628e4406dc0 msgr2=0x5628e4417b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:29.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.559+0000 7f0071b61740 1 --2- 172.21.15.2:0/18034883 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628e4406dc0 0x5628e4417b70 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f0058005fd0 tx=0x7f00580a00a0 comp rx=0 tx=0).stop 2024-09-19T04:53:29.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.559+0000 7f0071b61740 1 -- 172.21.15.2:0/18034883 shutdown_connections 2024-09-19T04:53:29.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.559+0000 7f0071b61740 1 --2- 172.21.15.2:0/18034883 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5628e4420f80 0x5628e448e760 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:29.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.559+0000 7f0071b61740 1 --2- 172.21.15.2:0/18034883 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5628e4411680 0x5628e44180b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:29.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.559+0000 7f0071b61740 1 --2- 172.21.15.2:0/18034883 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5628e4406dc0 0x5628e4417b70 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:29.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.559+0000 7f0050ff9640 0 client.15966 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:53:29.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.559+0000 7f0071b61740 1 --2- 172.21.15.2:0/18034883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5628e44064a0 0x5628e4417630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:29.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.559+0000 7f0071b61740 1 -- 172.21.15.2:0/18034883 >> 172.21.15.2:0/18034883 conn(0x5628e4402a30 msgr2=0x5628e440fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:53:29.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.559+0000 7f0071b61740 1 -- 172.21.15.2:0/18034883 shutdown_connections 2024-09-19T04:53:29.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.559+0000 7f0071b61740 1 -- 172.21.15.2:0/18034883 wait complete. 2024-09-19T04:53:29.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.559+0000 7f0071b61740 20 client.15966 trim_cache size 0 max 16384 2024-09-19T04:53:29.567 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:53:29.567 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T04:53:29.567 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T04:53:29.567 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:53:29.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.560+0000 7f006f788640 1 -- 172.21.15.2:0/4032264473 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f00540a33b0 msgr2=0x7f00540a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:29.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.560+0000 7f006f788640 1 --2- 172.21.15.2:0/4032264473 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f00540a33b0 0x7f00540a5870 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0064031440 tx=0x7f0064005890 comp rx=0 tx=0).stop 2024-09-19T04:53:29.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.560+0000 7f006f788640 1 -- 172.21.15.2:0/4032264473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0068074f40 msgr2=0x7f006819aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:29.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.560+0000 7f006f788640 1 --2- 172.21.15.2:0/4032264473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0068074f40 0x7f006819aa80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f005800d720 tx=0x7f005800dbe0 comp rx=0 tx=0).stop 2024-09-19T04:53:29.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.560+0000 7f006f788640 1 -- 172.21.15.2:0/4032264473 shutdown_connections 2024-09-19T04:53:29.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.560+0000 7f006f788640 1 --2- 172.21.15.2:0/4032264473 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f006810e3c0 0x7f006819ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:29.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.560+0000 7f006f788640 1 --2- 172.21.15.2:0/4032264473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0068074f40 0x7f006819aa80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:29.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.560+0000 7f006f788640 1 --2- 172.21.15.2:0/4032264473 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f00540a33b0 0x7f00540a5870 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:29.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.560+0000 7f006f788640 1 --2- 172.21.15.2:0/4032264473 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0068074620 0x7f006819a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:29.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.560+0000 7f006f788640 1 -- 172.21.15.2:0/4032264473 >> 172.21.15.2:0/4032264473 conn(0x7f00680fd8c0 msgr2=0x7f00680ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:53:29.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.560+0000 7f006f788640 1 -- 172.21.15.2:0/4032264473 shutdown_connections 2024-09-19T04:53:29.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:29.560+0000 7f006f788640 1 -- 172.21.15.2:0/4032264473 wait complete. 2024-09-19T04:53:30.392 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:53:30.393 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:53:30.609 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:53:30 smithi002 ceph-mon[30975]: pgmap v168: 97 pgs: 97 active+clean; 7.0 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 30 KiB/s wr, 7 op/s 2024-09-19T04:53:30.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:53:30 smithi116 ceph-mon[34477]: pgmap v168: 97 pgs: 97 active+clean; 7.0 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 30 KiB/s wr, 7 op/s 2024-09-19T04:53:30.657 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:53:30.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:53:30 smithi018 ceph-mon[34537]: pgmap v168: 97 pgs: 97 active+clean; 7.0 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 30 KiB/s wr, 7 op/s 2024-09-19T04:53:31.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.108+0000 7f9515018640 1 -- 172.21.15.2:0/310819865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95101036e0 msgr2=0x7f9510107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:31.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.108+0000 7f9515018640 1 --2- 172.21.15.2:0/310819865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95101036e0 0x7f9510107b90 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f9500009930 tx=0x7f950002a420 comp rx=0 tx=0).stop 2024-09-19T04:53:31.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.108+0000 7f9515018640 1 -- 172.21.15.2:0/310819865 shutdown_connections 2024-09-19T04:53:31.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.108+0000 7f9515018640 1 --2- 172.21.15.2:0/310819865 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95101082a0 0x7f951010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:31.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.108+0000 7f9515018640 1 --2- 172.21.15.2:0/310819865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95101036e0 0x7f9510107b90 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:31.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.108+0000 7f9515018640 1 --2- 172.21.15.2:0/310819865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9510102d30 0x7f9510103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:31.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.108+0000 7f9515018640 1 -- 172.21.15.2:0/310819865 >> 172.21.15.2:0/310819865 conn(0x7f95100fc7d0 msgr2=0x7f95100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:53:31.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.108+0000 7f9515018640 1 -- 172.21.15.2:0/310819865 shutdown_connections 2024-09-19T04:53:31.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.108+0000 7f9515018640 1 -- 172.21.15.2:0/310819865 wait complete. 2024-09-19T04:53:31.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.109+0000 7f9515018640 1 Processor -- start 2024-09-19T04:53:31.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.109+0000 7f9515018640 1 -- start start 2024-09-19T04:53:31.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.109+0000 7f9515018640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9510102d30 0x7f9510198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:31.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.109+0000 7f9515018640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95101036e0 0x7f95101989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:31.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.109+0000 7f9515018640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95101082a0 0x7f951019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:31.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.109+0000 7f9515018640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9510111f50 con 0x7f95101036e0 2024-09-19T04:53:31.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.109+0000 7f9515018640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9510111dd0 con 0x7f9510102d30 2024-09-19T04:53:31.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.109+0000 7f9515018640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f95101120d0 con 0x7f95101082a0 2024-09-19T04:53:31.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.109+0000 7f950e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95101036e0 0x7f95101989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:31.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.109+0000 7f950e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95101036e0 0x7f95101989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34890/0 (socket says 172.21.15.2:34890) 2024-09-19T04:53:31.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.109+0000 7f950e59c640 1 -- 172.21.15.2:0/2899386529 learned_addr learned my addr 172.21.15.2:0/2899386529 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:53:31.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.109+0000 7f950f59e640 1 --2- 172.21.15.2:0/2899386529 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95101082a0 0x7f951019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:31.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.109+0000 7f950ed9d640 1 --2- 172.21.15.2:0/2899386529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9510102d30 0x7f9510198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:31.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.110+0000 7f950e59c640 1 -- 172.21.15.2:0/2899386529 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95101082a0 msgr2=0x7f951019cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:31.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.110+0000 7f950e59c640 1 --2- 172.21.15.2:0/2899386529 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95101082a0 0x7f951019cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:31.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.110+0000 7f950e59c640 1 -- 172.21.15.2:0/2899386529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9510102d30 msgr2=0x7f9510198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:31.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.110+0000 7f950e59c640 1 --2- 172.21.15.2:0/2899386529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9510102d30 0x7f9510198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:31.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.110+0000 7f950e59c640 1 -- 172.21.15.2:0/2899386529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f951019d440 con 0x7f95101036e0 2024-09-19T04:53:31.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.110+0000 7f950f59e640 1 --2- 172.21.15.2:0/2899386529 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95101082a0 0x7f951019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:53:31.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.110+0000 7f950e59c640 1 --2- 172.21.15.2:0/2899386529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95101036e0 0x7f95101989d0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f9500009230 tx=0x7f9500004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:53:31.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.110+0000 7f9507fff640 1 -- 172.21.15.2:0/2899386529 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950003f030 con 0x7f95101036e0 2024-09-19T04:53:31.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.110+0000 7f9515018640 1 -- 172.21.15.2:0/2899386529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f951019d6d0 con 0x7f95101036e0 2024-09-19T04:53:31.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.110+0000 7f9507fff640 1 -- 172.21.15.2:0/2899386529 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f95000035f0 con 0x7f95101036e0 2024-09-19T04:53:31.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.110+0000 7f9507fff640 1 -- 172.21.15.2:0/2899386529 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9500035070 con 0x7f95101036e0 2024-09-19T04:53:31.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.110+0000 7f9515018640 1 -- 172.21.15.2:0/2899386529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95101a5010 con 0x7f95101036e0 2024-09-19T04:53:31.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.111+0000 7f9515018640 1 -- 172.21.15.2:0/2899386529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9510103110 con 0x7f95101036e0 2024-09-19T04:53:31.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.112+0000 7f9507fff640 1 -- 172.21.15.2:0/2899386529 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f9500003aa0 con 0x7f95101036e0 2024-09-19T04:53:31.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.113+0000 7f9507fff640 1 --2- 172.21.15.2:0/2899386529 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f94fc0a33b0 0x7f94fc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:31.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.113+0000 7f950ed9d640 1 --2- 172.21.15.2:0/2899386529 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f94fc0a33b0 0x7f94fc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:31.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.113+0000 7f9507fff640 1 -- 172.21.15.2:0/2899386529 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f95000f0df0 con 0x7f95101036e0 2024-09-19T04:53:31.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.114+0000 7f950ed9d640 1 --2- 172.21.15.2:0/2899386529 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f94fc0a33b0 0x7f94fc0a5870 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f94f8005e10 tx=0x7f94f8005da0 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:53:31.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.116+0000 7f9507fff640 1 -- 172.21.15.2:0/2899386529 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f95000bd790 con 0x7f95101036e0 2024-09-19T04:53:31.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.332+0000 7f9515018640 1 -- 172.21.15.2:0/2899386529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f95101997f0 con 0x7f95101036e0 2024-09-19T04:53:31.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.333+0000 7f9507fff640 1 -- 172.21.15.2:0/2899386529 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11840 (secure 0 0 0) 0x7f95101997f0 con 0x7f95101036e0 2024-09-19T04:53:31.335 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:53:31.335 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":19,"btime":"2024-09-19T04:46:33:537239+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2467365137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2467365137},{"type":"v1","addr":"172.21.15.2:6835","nonce":2467365137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3162441888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3162441888},{"type":"v1","addr":"172.21.15.2:6837","nonce":3162441888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14631,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2740862966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2740862966},{"type":"v1","addr":"172.21.15.2:6839","nonce":2740862966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/2394435504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2394435504},{"type":"v1","addr":"172.21.15.2:6841","nonce":2394435504}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1630480244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1630480244},{"type":"v1","addr":"172.21.15.18:6833","nonce":1630480244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1553897465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1553897465},{"type":"v1","addr":"172.21.15.116:6833","nonce":1553897465}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3035664608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3035664608},{"type":"v1","addr":"172.21.15.18:6835","nonce":3035664608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1096622392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1096622392},{"type":"v1","addr":"172.21.15.18:6837","nonce":1096622392}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3761157675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3761157675},{"type":"v1","addr":"172.21.15.116:6835","nonce":3761157675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/1120131594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1120131594},{"type":"v1","addr":"172.21.15.116:6837","nonce":1120131594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:46:24.050115+0000","modified":"2024-09-19T04:46:33.112369+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/4207677139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":4207677139},{"type":"v1","addr":"172.21.15.18:6839","nonce":4207677139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/2346874880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":2346874880},{"type":"v1","addr":"172.21.15.116:6839","nonce":2346874880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496]},"id":1}]} 2024-09-19T04:53:31.335 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 19 2024-09-19T04:53:31.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.335+0000 7f9515018640 1 -- 172.21.15.2:0/2899386529 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f94fc0a33b0 msgr2=0x7f94fc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:31.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.335+0000 7f9515018640 1 --2- 172.21.15.2:0/2899386529 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f94fc0a33b0 0x7f94fc0a5870 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f94f8005e10 tx=0x7f94f8005da0 comp rx=0 tx=0).stop 2024-09-19T04:53:31.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.335+0000 7f9515018640 1 -- 172.21.15.2:0/2899386529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95101036e0 msgr2=0x7f95101989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:31.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.335+0000 7f9515018640 1 --2- 172.21.15.2:0/2899386529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95101036e0 0x7f95101989d0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f9500009230 tx=0x7f9500004270 comp rx=0 tx=0).stop 2024-09-19T04:53:31.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.335+0000 7f9515018640 1 -- 172.21.15.2:0/2899386529 shutdown_connections 2024-09-19T04:53:31.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.335+0000 7f9515018640 1 --2- 172.21.15.2:0/2899386529 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f94fc0a33b0 0x7f94fc0a5870 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:31.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.335+0000 7f9515018640 1 --2- 172.21.15.2:0/2899386529 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95101082a0 0x7f951019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:31.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.335+0000 7f9515018640 1 --2- 172.21.15.2:0/2899386529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95101036e0 0x7f95101989d0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:31.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.335+0000 7f9515018640 1 --2- 172.21.15.2:0/2899386529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9510102d30 0x7f9510198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:31.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.335+0000 7f9515018640 1 -- 172.21.15.2:0/2899386529 >> 172.21.15.2:0/2899386529 conn(0x7f95100fc7d0 msgr2=0x7f9510105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:53:31.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.335+0000 7f9515018640 1 -- 172.21.15.2:0/2899386529 shutdown_connections 2024-09-19T04:53:31.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:31.335+0000 7f9515018640 1 -- 172.21.15.2:0/2899386529 wait complete. 2024-09-19T04:53:32.021 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:53:32.284 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:53:32.566 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:53:32 smithi002 ceph-mon[30975]: pgmap v169: 97 pgs: 97 active+clean; 7.1 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 43 KiB/s wr, 10 op/s 2024-09-19T04:53:32.566 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:53:32 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/2899386529' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:53:32.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:53:32 smithi116 ceph-mon[34477]: pgmap v169: 97 pgs: 97 active+clean; 7.1 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 43 KiB/s wr, 10 op/s 2024-09-19T04:53:32.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:53:32 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/2899386529' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:53:32.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.741+0000 7f445b139640 1 -- 172.21.15.2:0/395845335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4454106f10 msgr2=0x7f445410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:32.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.741+0000 7f445b139640 1 --2- 172.21.15.2:0/395845335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4454106f10 0x7f445410ea90 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f444c009ca0 tx=0x7f444c02a8c0 comp rx=0 tx=0).stop 2024-09-19T04:53:32.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.741+0000 7f445b139640 1 -- 172.21.15.2:0/395845335 shutdown_connections 2024-09-19T04:53:32.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.741+0000 7f445b139640 1 --2- 172.21.15.2:0/395845335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4454106f10 0x7f445410ea90 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:32.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.741+0000 7f445b139640 1 --2- 172.21.15.2:0/395845335 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4454102790 0x7f44541067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:32.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.741+0000 7f445b139640 1 --2- 172.21.15.2:0/395845335 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4454101de0 0x7f44541021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:32.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.741+0000 7f445b139640 1 -- 172.21.15.2:0/395845335 >> 172.21.15.2:0/395845335 conn(0x7f44540fd8c0 msgr2=0x7f44540ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:53:32.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.741+0000 7f445b139640 1 -- 172.21.15.2:0/395845335 shutdown_connections 2024-09-19T04:53:32.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.741+0000 7f445b139640 1 -- 172.21.15.2:0/395845335 wait complete. 2024-09-19T04:53:32.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.742+0000 7f445b139640 1 Processor -- start 2024-09-19T04:53:32.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.742+0000 7f445b139640 1 -- start start 2024-09-19T04:53:32.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.742+0000 7f445b139640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4454101de0 0x7f445419a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:32.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.742+0000 7f445b139640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4454102790 0x7f445419aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:32.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.742+0000 7f445b139640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4454106f10 0x7f445419ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:32.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.742+0000 7f445b139640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4454111e20 con 0x7f4454106f10 2024-09-19T04:53:32.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.742+0000 7f445b139640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4454111ca0 con 0x7f4454102790 2024-09-19T04:53:32.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.742+0000 7f445b139640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f4454111fa0 con 0x7f4454101de0 2024-09-19T04:53:32.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.742+0000 7f44596d6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4454106f10 0x7f445419ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:32.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.742+0000 7f44596d6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4454106f10 0x7f445419ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58100/0 (socket says 172.21.15.2:58100) 2024-09-19T04:53:32.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.742+0000 7f44596d6640 1 -- 172.21.15.2:0/2869086777 learned_addr learned my addr 172.21.15.2:0/2869086777 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:53:32.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.742+0000 7f4458ed5640 1 --2- 172.21.15.2:0/2869086777 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4454101de0 0x7f445419a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:32.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.742+0000 7f4453fff640 1 --2- 172.21.15.2:0/2869086777 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4454102790 0x7f445419aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:32.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.742+0000 7f44596d6640 1 -- 172.21.15.2:0/2869086777 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4454101de0 msgr2=0x7f445419a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:32.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.742+0000 7f44596d6640 1 --2- 172.21.15.2:0/2869086777 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4454101de0 0x7f445419a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:32.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.742+0000 7f44596d6640 1 -- 172.21.15.2:0/2869086777 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4454102790 msgr2=0x7f445419aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:32.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.742+0000 7f44596d6640 1 --2- 172.21.15.2:0/2869086777 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4454102790 0x7f445419aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:32.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.742+0000 7f44596d6640 1 -- 172.21.15.2:0/2869086777 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f445419f4c0 con 0x7f4454106f10 2024-09-19T04:53:32.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.743+0000 7f44596d6640 1 --2- 172.21.15.2:0/2869086777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4454106f10 0x7f445419ede0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f444c009dc0 tx=0x7f444c032ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:53:32.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.743+0000 7f4451ffb640 1 -- 172.21.15.2:0/2869086777 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f444c003cf0 con 0x7f4454106f10 2024-09-19T04:53:32.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.743+0000 7f4451ffb640 1 -- 172.21.15.2:0/2869086777 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f444c0044f0 con 0x7f4454106f10 2024-09-19T04:53:32.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.743+0000 7f445b139640 1 -- 172.21.15.2:0/2869086777 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f445419f750 con 0x7f4454106f10 2024-09-19T04:53:32.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.743+0000 7f4451ffb640 1 -- 172.21.15.2:0/2869086777 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f444c030bf0 con 0x7f4454106f10 2024-09-19T04:53:32.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.743+0000 7f445b139640 1 -- 172.21.15.2:0/2869086777 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44541a7090 con 0x7f4454106f10 2024-09-19T04:53:32.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.746+0000 7f4451ffb640 1 -- 172.21.15.2:0/2869086777 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f444c004040 con 0x7f4454106f10 2024-09-19T04:53:32.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.746+0000 7f445d512740 1 Processor -- start 2024-09-19T04:53:32.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.746+0000 7f445d512740 1 -- start start 2024-09-19T04:53:32.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.747+0000 7f445d512740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563c6b193b40 0x563c6b192090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:32.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.747+0000 7f445d512740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c6b1925d0 0x563c6b192a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:32.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.747+0000 7f445d512740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c6b19d370 0x563c6b19f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:32.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.747+0000 7f445d512740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563c6b0f82f0 con 0x563c6b1925d0 2024-09-19T04:53:32.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.747+0000 7f445d512740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563c6b09fcf0 con 0x563c6b19d370 2024-09-19T04:53:32.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.747+0000 7f445d512740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x563c6b0f42b0 con 0x563c6b193b40 2024-09-19T04:53:32.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.747+0000 7f4458ed5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c6b1925d0 0x563c6b192a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:32.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.747+0000 7f4458ed5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c6b1925d0 0x563c6b192a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58108/0 (socket says 172.21.15.2:58108) 2024-09-19T04:53:32.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.747+0000 7f4458ed5640 1 -- 172.21.15.2:0/2522406249 learned_addr learned my addr 172.21.15.2:0/2522406249 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:53:32.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.747+0000 7f4453fff640 1 --2- 172.21.15.2:0/2522406249 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c6b19d370 0x563c6b19f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:32.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.747+0000 7f4453fff640 1 --2- 172.21.15.2:0/2522406249 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563c6b193b40 0x563c6b192090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:32.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.747+0000 7f4458ed5640 1 -- 172.21.15.2:0/2522406249 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563c6b193b40 msgr2=0x563c6b192090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:32.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.747+0000 7f4458ed5640 1 --2- 172.21.15.2:0/2522406249 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563c6b193b40 0x563c6b192090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:32.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.747+0000 7f4458ed5640 1 -- 172.21.15.2:0/2522406249 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c6b19d370 msgr2=0x563c6b19f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:32.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.747+0000 7f4458ed5640 1 --2- 172.21.15.2:0/2522406249 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c6b19d370 0x563c6b19f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:32.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.747+0000 7f4458ed5640 1 -- 172.21.15.2:0/2522406249 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c6b0843a0 con 0x563c6b1925d0 2024-09-19T04:53:32.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.747+0000 7f4453fff640 1 --2- 172.21.15.2:0/2522406249 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563c6b193b40 0x563c6b192090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:53:32.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.747+0000 7f4451ffb640 1 --2- 172.21.15.2:0/2869086777 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f443c0a33b0 0x7f443c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:32.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.747+0000 7f4453fff640 1 --2- 172.21.15.2:0/2869086777 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f443c0a33b0 0x7f443c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:32.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.747+0000 7f4451ffb640 1 -- 172.21.15.2:0/2869086777 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f444c0f12c0 con 0x7f4454106f10 2024-09-19T04:53:32.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.747+0000 7f4458ed5640 1 --2- 172.21.15.2:0/2522406249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c6b1925d0 0x563c6b192a10 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f444400dcb0 tx=0x7f444400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10322b14da8c8556 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:53:32.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.748+0000 7f443affd640 1 -- 172.21.15.2:0/2522406249 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4444011440 con 0x563c6b1925d0 2024-09-19T04:53:32.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.748+0000 7f443affd640 1 -- 172.21.15.2:0/2522406249 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4444011a90 con 0x563c6b1925d0 2024-09-19T04:53:32.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.748+0000 7f443affd640 1 -- 172.21.15.2:0/2522406249 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4444010a00 con 0x563c6b1925d0 2024-09-19T04:53:32.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.748+0000 7f445d512740 1 -- 172.21.15.2:0/2522406249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c6b1925d0 msgr2=0x563c6b192a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:32.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.748+0000 7f4453fff640 1 --2- 172.21.15.2:0/2869086777 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f443c0a33b0 0x7f443c0a5870 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x563c6b193070 tx=0x7f444800a5c0 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:53:32.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.748+0000 7f445d512740 1 --2- 172.21.15.2:0/2522406249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c6b1925d0 0x563c6b192a10 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f444400dcb0 tx=0x7f444400f730 comp rx=0 tx=0).stop 2024-09-19T04:53:32.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.748+0000 7f445d512740 1 -- 172.21.15.2:0/2522406249 shutdown_connections 2024-09-19T04:53:32.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.748+0000 7f445d512740 1 --2- 172.21.15.2:0/2522406249 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c6b19d370 0x563c6b19f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:32.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.748+0000 7f445d512740 1 --2- 172.21.15.2:0/2522406249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c6b1925d0 0x563c6b192a10 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:32.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.748+0000 7f445d512740 1 --2- 172.21.15.2:0/2522406249 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563c6b193b40 0x563c6b192090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:32.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.748+0000 7f445d512740 1 -- 172.21.15.2:0/2522406249 >> 172.21.15.2:0/2522406249 conn(0x563c6b15b310 msgr2=0x563c6b18ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:53:32.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.749+0000 7f445d512740 1 -- 172.21.15.2:0/2522406249 shutdown_connections 2024-09-19T04:53:32.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.749+0000 7f445d512740 1 -- 172.21.15.2:0/2522406249 wait complete. 2024-09-19T04:53:32.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.749+0000 7f445d512740 1 -- start start 2024-09-19T04:53:32.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.749+0000 7f445d512740 1 Processor -- start 2024-09-19T04:53:32.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.749+0000 7f445d512740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c6b1925d0 0x563c6b19cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:32.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.749+0000 7f445d512740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563c6b193b40 0x563c6b19a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:32.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.749+0000 7f445d512740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c6b19d370 0x563c6b19a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:32.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.749+0000 7f445d512740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563c6b1a0070 con 0x563c6b19d370 2024-09-19T04:53:32.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.749+0000 7f445d512740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563c6b0b3060 con 0x563c6b1925d0 2024-09-19T04:53:32.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.749+0000 7f445d512740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x563c6b1a01f0 con 0x563c6b193b40 2024-09-19T04:53:32.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.749+0000 7f445d512740 10 client.0 _ll_register_callbacks cb 0x563c6ae068c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:53:32.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.750+0000 7f44596d6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c6b19d370 0x563c6b19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:32.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.750+0000 7f4458ed5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c6b1925d0 0x563c6b19cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:32.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.750+0000 7f44596d6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c6b19d370 0x563c6b19a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58118/0 (socket says 172.21.15.2:58118) 2024-09-19T04:53:32.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.750+0000 7f44596d6640 1 -- 172.21.15.2:0/4088670789 learned_addr learned my addr 172.21.15.2:0/4088670789 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:53:32.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.750+0000 7f4453fff640 1 --2- 172.21.15.2:0/4088670789 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563c6b193b40 0x563c6b19a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:32.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.750+0000 7f44596d6640 1 -- 172.21.15.2:0/4088670789 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563c6b193b40 msgr2=0x563c6b19a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:32.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.750+0000 7f44596d6640 1 --2- 172.21.15.2:0/4088670789 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563c6b193b40 0x563c6b19a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:32.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.750+0000 7f44596d6640 1 -- 172.21.15.2:0/4088670789 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c6b1925d0 msgr2=0x563c6b19cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:32.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.750+0000 7f44596d6640 1 --2- 172.21.15.2:0/4088670789 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c6b1925d0 0x563c6b19cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:32.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.750+0000 7f44596d6640 1 -- 172.21.15.2:0/4088670789 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c6ae693c0 con 0x563c6b19d370 2024-09-19T04:53:32.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.750+0000 7f4458ed5640 1 --2- 172.21.15.2:0/4088670789 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c6b1925d0 0x563c6b19cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:53:32.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.750+0000 7f44596d6640 1 --2- 172.21.15.2:0/4088670789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c6b19d370 0x563c6b19a600 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f444c02f3b0 tx=0x7f444c0bd230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30b032c53cea312f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:53:32.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.750+0000 7f4433fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:53:32.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.750+0000 7f4433fff640 1 -- 172.21.15.2:0/4088670789 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f444c0bd670 con 0x563c6b19d370 2024-09-19T04:53:32.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.750+0000 7f4433fff640 1 -- 172.21.15.2:0/4088670789 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f444c0eec50 con 0x563c6b19d370 2024-09-19T04:53:32.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.750+0000 7f445d512740 1 -- 172.21.15.2:0/4088670789 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4444011a90 con 0x563c6b19d370 2024-09-19T04:53:32.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.751+0000 7f4433fff640 1 -- 172.21.15.2:0/4088670789 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f444c0c1a20 con 0x563c6b19d370 2024-09-19T04:53:32.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.751+0000 7f445d512740 10 client.15984 fetch_fsmap learned FSMap version 19 2024-09-19T04:53:32.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.751+0000 7f445d512740 1 -- 172.21.15.2:0/4088670789 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x563c6b1a0070 con 0x563c6b19d370 2024-09-19T04:53:32.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.751+0000 7f4433fff640 1 -- 172.21.15.2:0/4088670789 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4444011a90 con 0x563c6b19d370 2024-09-19T04:53:32.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.751+0000 7f4433fff640 1 -- 172.21.15.2:0/4088670789 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f444c0bd8d0 con 0x563c6b19d370 2024-09-19T04:53:32.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.751+0000 7f445d512740 10 client.15984 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:53:32.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.751+0000 7f445d512740 10 client.15984 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:53:32.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.751+0000 7f445d512740 20 client.15984 populate_metadata read hostname 'smithi002' 2024-09-19T04:53:32.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.751+0000 7f445d512740 1 --2- 172.21.15.2:0/4088670789 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x563c6b1acf30 0x563c6b1af380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:32.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.751+0000 7f445d512740 4 client.15984 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:53:32.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.751+0000 7f445d512740 1 -- 172.21.15.2:0/4088670789 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c6b105860 con 0x563c6b1acf30 2024-09-19T04:53:32.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.751+0000 7f4458ed5640 1 --2- 172.21.15.2:0/4088670789 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x563c6b1acf30 0x563c6b1af380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:32.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.752+0000 7f4433fff640 10 client.15984 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:53:32.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.752+0000 7f4458ed5640 1 --2- 172.21.15.2:0/4088670789 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x563c6b1acf30 0x563c6b1af380 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6384b0c92ad3a36d server_cookie=14dddc550fe186a0 in_seq=0 out_seq=0 2024-09-19T04:53:32.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.752+0000 7f4433fff640 1 -- 172.21.15.2:0/4088670789 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563c6b105860 con 0x563c6b1acf30 2024-09-19T04:53:32.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.752+0000 7f4433fff640 10 client.15984 handle_command_reply: tid=0 2024-09-19T04:53:32.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.753+0000 7f445d512740 1 client.15984 shutdown 2024-09-19T04:53:32.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.753+0000 7f445d512740 1 -- 172.21.15.2:0/4088670789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c6b19d370 msgr2=0x563c6b19a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:32.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.753+0000 7f445d512740 1 --2- 172.21.15.2:0/4088670789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c6b19d370 0x563c6b19a600 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f444c02f3b0 tx=0x7f444c0bd230 comp rx=0 tx=0).stop 2024-09-19T04:53:32.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.753+0000 7f445d512740 1 -- 172.21.15.2:0/4088670789 shutdown_connections 2024-09-19T04:53:32.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.753+0000 7f445d512740 1 --2- 172.21.15.2:0/4088670789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c6b19d370 0x563c6b19a600 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:32.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.753+0000 7f445d512740 1 --2- 172.21.15.2:0/4088670789 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x563c6b1acf30 0x563c6b1af380 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:32.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.753+0000 7f445d512740 1 --2- 172.21.15.2:0/4088670789 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563c6b193b40 0x563c6b19a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:32.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.753+0000 7f445d512740 1 --2- 172.21.15.2:0/4088670789 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c6b1925d0 0x563c6b19cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:32.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.753+0000 7f445d512740 1 -- 172.21.15.2:0/4088670789 >> 172.21.15.2:0/4088670789 conn(0x563c6b15b310 msgr2=0x563c6b194960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:53:32.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.753+0000 7f4433fff640 0 client.15984 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:53:32.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.753+0000 7f445d512740 1 -- 172.21.15.2:0/4088670789 shutdown_connections 2024-09-19T04:53:32.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.753+0000 7f445d512740 1 -- 172.21.15.2:0/4088670789 wait complete. 2024-09-19T04:53:32.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.753+0000 7f445d512740 20 client.15984 trim_cache size 0 max 16384 2024-09-19T04:53:32.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.766+0000 7f445d512740 1 Processor -- start 2024-09-19T04:53:32.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.766+0000 7f445d512740 1 -- start start 2024-09-19T04:53:32.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.766+0000 7f445d512740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563c6b1925d0 0x563c6b1a9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:32.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.766+0000 7f445d512740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c6b193b40 0x563c6b18e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:32.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.766+0000 7f445d512740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c6b19d370 0x563c6b18ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:32.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.766+0000 7f445d512740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f44541ad960 con 0x563c6b193b40 2024-09-19T04:53:32.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.766+0000 7f445d512740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f44541b01e0 con 0x563c6b19d370 2024-09-19T04:53:32.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.766+0000 7f445d512740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f44541adfd0 con 0x563c6b1925d0 2024-09-19T04:53:32.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.766+0000 7f4453fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c6b193b40 0x563c6b18e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:32.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.766+0000 7f4453fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c6b193b40 0x563c6b18e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58134/0 (socket says 172.21.15.2:58134) 2024-09-19T04:53:32.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.766+0000 7f4453fff640 1 -- 172.21.15.2:0/1727654581 learned_addr learned my addr 172.21.15.2:0/1727654581 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:53:32.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.767+0000 7f4458ed5640 1 --2- 172.21.15.2:0/1727654581 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563c6b1925d0 0x563c6b1a9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:32.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.767+0000 7f44596d6640 1 --2- 172.21.15.2:0/1727654581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c6b19d370 0x563c6b18ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:32.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.767+0000 7f4453fff640 1 -- 172.21.15.2:0/1727654581 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563c6b1925d0 msgr2=0x563c6b1a9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:32.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.767+0000 7f4453fff640 1 --2- 172.21.15.2:0/1727654581 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563c6b1925d0 0x563c6b1a9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:32.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.767+0000 7f4453fff640 1 -- 172.21.15.2:0/1727654581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c6b19d370 msgr2=0x563c6b18ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:32.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.767+0000 7f4453fff640 1 --2- 172.21.15.2:0/1727654581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c6b19d370 0x563c6b18ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:32.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.767+0000 7f4453fff640 1 -- 172.21.15.2:0/1727654581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c6b18f180 con 0x563c6b193b40 2024-09-19T04:53:32.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.767+0000 7f4453fff640 1 --2- 172.21.15.2:0/1727654581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c6b193b40 0x563c6b18e700 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f44480058c0 tx=0x7f4448016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=967d831bba61a001 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:53:32.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.767+0000 7f443a7fc640 1 -- 172.21.15.2:0/1727654581 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f444802c070 con 0x563c6b193b40 2024-09-19T04:53:32.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.767+0000 7f443a7fc640 1 -- 172.21.15.2:0/1727654581 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f444801c400 con 0x563c6b193b40 2024-09-19T04:53:32.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.767+0000 7f443a7fc640 1 -- 172.21.15.2:0/1727654581 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44480273f0 con 0x563c6b193b40 2024-09-19T04:53:32.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.768+0000 7f445d512740 1 -- 172.21.15.2:0/1727654581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c6b193b40 msgr2=0x563c6b18e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:32.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.768+0000 7f445d512740 1 --2- 172.21.15.2:0/1727654581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c6b193b40 0x563c6b18e700 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f44480058c0 tx=0x7f4448016000 comp rx=0 tx=0).stop 2024-09-19T04:53:32.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.768+0000 7f445d512740 1 -- 172.21.15.2:0/1727654581 shutdown_connections 2024-09-19T04:53:32.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.768+0000 7f445d512740 1 --2- 172.21.15.2:0/1727654581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c6b19d370 0x563c6b18ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:32.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.768+0000 7f445d512740 1 --2- 172.21.15.2:0/1727654581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c6b193b40 0x563c6b18e700 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:32.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.768+0000 7f445d512740 1 --2- 172.21.15.2:0/1727654581 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563c6b1925d0 0x563c6b1a9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:32.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.768+0000 7f445d512740 1 -- 172.21.15.2:0/1727654581 >> 172.21.15.2:0/1727654581 conn(0x563c6b15b310 msgr2=0x563c6b199fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:53:32.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.768+0000 7f445d512740 1 -- 172.21.15.2:0/1727654581 shutdown_connections 2024-09-19T04:53:32.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.768+0000 7f445d512740 1 -- 172.21.15.2:0/1727654581 wait complete. 2024-09-19T04:53:32.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.768+0000 7f445d512740 1 -- start start 2024-09-19T04:53:32.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.768+0000 7f445d512740 1 Processor -- start 2024-09-19T04:53:32.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.769+0000 7f445d512740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c6b1925d0 0x563c6b196fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:32.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.769+0000 7f445d512740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c6b193b40 0x563c6b197510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:32.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.769+0000 7f445d512740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563c6b19d370 0x563c6b197a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:32.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.769+0000 7f445d512740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f44541ae6a0 con 0x563c6b193b40 2024-09-19T04:53:32.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.769+0000 7f445d512740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f44541afb10 con 0x563c6b1925d0 2024-09-19T04:53:32.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.769+0000 7f445d512740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f44541aed70 con 0x563c6b19d370 2024-09-19T04:53:32.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.769+0000 7f445d512740 10 client.0 _ll_register_callbacks cb 0x7f444c003e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:53:32.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.769+0000 7f4453fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c6b193b40 0x563c6b197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:32.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.769+0000 7f4453fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c6b193b40 0x563c6b197510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58142/0 (socket says 172.21.15.2:58142) 2024-09-19T04:53:32.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.769+0000 7f4453fff640 1 -- 172.21.15.2:0/850134353 learned_addr learned my addr 172.21.15.2:0/850134353 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:53:32.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.769+0000 7f44596d6640 1 --2- 172.21.15.2:0/850134353 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563c6b19d370 0x563c6b197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:32.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.769+0000 7f4458ed5640 1 --2- 172.21.15.2:0/850134353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c6b1925d0 0x563c6b196fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:32.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.769+0000 7f4453fff640 1 -- 172.21.15.2:0/850134353 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563c6b19d370 msgr2=0x563c6b197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:32.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.769+0000 7f4453fff640 1 --2- 172.21.15.2:0/850134353 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563c6b19d370 0x563c6b197a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:32.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.769+0000 7f4453fff640 1 -- 172.21.15.2:0/850134353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c6b1925d0 msgr2=0x563c6b196fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:32.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.769+0000 7f4453fff640 1 --2- 172.21.15.2:0/850134353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c6b1925d0 0x563c6b196fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:32.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.769+0000 7f4453fff640 1 -- 172.21.15.2:0/850134353 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c6b216c30 con 0x563c6b193b40 2024-09-19T04:53:32.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.769+0000 7f44596d6640 1 --2- 172.21.15.2:0/850134353 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563c6b19d370 0x563c6b197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:53:32.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.769+0000 7f4458ed5640 1 --2- 172.21.15.2:0/850134353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c6b1925d0 0x563c6b196fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:53:32.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.770+0000 7f4453fff640 1 --2- 172.21.15.2:0/850134353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c6b193b40 0x563c6b197510 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f44480058c0 tx=0x7f444801ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d967c75f7308ef99 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:53:32.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.770+0000 7f4433fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:53:32.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.770+0000 7f4433fff640 1 -- 172.21.15.2:0/850134353 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f444802c070 con 0x563c6b193b40 2024-09-19T04:53:32.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.770+0000 7f445d512740 1 -- 172.21.15.2:0/850134353 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f444801c400 con 0x563c6b193b40 2024-09-19T04:53:32.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.770+0000 7f4433fff640 1 -- 172.21.15.2:0/850134353 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f4448005440 con 0x563c6b193b40 2024-09-19T04:53:32.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.770+0000 7f4433fff640 1 -- 172.21.15.2:0/850134353 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f44480046c0 con 0x563c6b193b40 2024-09-19T04:53:32.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.770+0000 7f445d512740 10 client.15990 fetch_fsmap learned FSMap version 19 2024-09-19T04:53:32.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.770+0000 7f445d512740 1 -- 172.21.15.2:0/850134353 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x563c6b217ed0 con 0x563c6b193b40 2024-09-19T04:53:32.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.770+0000 7f4433fff640 1 -- 172.21.15.2:0/850134353 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f444801c400 con 0x563c6b193b40 2024-09-19T04:53:32.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.770+0000 7f4433fff640 1 -- 172.21.15.2:0/850134353 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f4448026070 con 0x563c6b193b40 2024-09-19T04:53:32.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.770+0000 7f445d512740 10 client.15990 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:53:32.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.770+0000 7f445d512740 10 client.15990 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:53:32.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.770+0000 7f445d512740 20 client.15990 populate_metadata read hostname 'smithi002' 2024-09-19T04:53:32.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.770+0000 7f445d512740 1 --2- 172.21.15.2:0/850134353 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x563c6b218610 0x563c6b21aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:32.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.770+0000 7f445d512740 4 client.15990 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:53:32.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.770+0000 7f445d512740 1 -- 172.21.15.2:0/850134353 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563c6b0ffd70 con 0x563c6b218610 2024-09-19T04:53:32.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.771+0000 7f4458ed5640 1 --2- 172.21.15.2:0/850134353 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x563c6b218610 0x563c6b21aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:32.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.771+0000 7f4458ed5640 1 --2- 172.21.15.2:0/850134353 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x563c6b218610 0x563c6b21aa30 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e774b57fa0b88fe server_cookie=e0fc0d11038f32d4 in_seq=0 out_seq=0 2024-09-19T04:53:32.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.771+0000 7f4433fff640 10 client.15990 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:53:32.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.771+0000 7f4433fff640 1 -- 172.21.15.2:0/850134353 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563c6b0ffd70 con 0x563c6b218610 2024-09-19T04:53:32.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.771+0000 7f4433fff640 10 client.15990 handle_command_reply: tid=0 2024-09-19T04:53:32.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.771+0000 7f445d512740 1 client.15990 shutdown 2024-09-19T04:53:32.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.772+0000 7f445d512740 1 -- 172.21.15.2:0/850134353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c6b193b40 msgr2=0x563c6b197510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:32.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.772+0000 7f445d512740 1 --2- 172.21.15.2:0/850134353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c6b193b40 0x563c6b197510 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f44480058c0 tx=0x7f444801ec30 comp rx=0 tx=0).stop 2024-09-19T04:53:32.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.772+0000 7f445d512740 1 -- 172.21.15.2:0/850134353 shutdown_connections 2024-09-19T04:53:32.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.772+0000 7f445d512740 1 --2- 172.21.15.2:0/850134353 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x563c6b218610 0x563c6b21aa30 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:32.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.772+0000 7f445d512740 1 --2- 172.21.15.2:0/850134353 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563c6b19d370 0x563c6b197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:32.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.772+0000 7f445d512740 1 --2- 172.21.15.2:0/850134353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563c6b193b40 0x563c6b197510 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:32.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.772+0000 7f445d512740 1 --2- 172.21.15.2:0/850134353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c6b1925d0 0x563c6b196fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:32.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.772+0000 7f445d512740 1 -- 172.21.15.2:0/850134353 >> 172.21.15.2:0/850134353 conn(0x563c6b15b310 msgr2=0x563c6b194110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:53:32.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.772+0000 7f4433fff640 0 client.15990 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:53:32.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.772+0000 7f445d512740 1 -- 172.21.15.2:0/850134353 shutdown_connections 2024-09-19T04:53:32.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.772+0000 7f445d512740 1 -- 172.21.15.2:0/850134353 wait complete. 2024-09-19T04:53:32.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.772+0000 7f445d512740 20 client.15990 trim_cache size 0 max 16384 2024-09-19T04:53:32.778 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T04:53:32.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.773+0000 7f445b139640 1 -- 172.21.15.2:0/2869086777 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f443c0a33b0 msgr2=0x7f443c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:32.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.773+0000 7f445b139640 1 --2- 172.21.15.2:0/2869086777 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f443c0a33b0 0x7f443c0a5870 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x563c6b193070 tx=0x7f444800a5c0 comp rx=0 tx=0).stop 2024-09-19T04:53:32.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.773+0000 7f445b139640 1 -- 172.21.15.2:0/2869086777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4454106f10 msgr2=0x7f445419ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:32.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.773+0000 7f445b139640 1 --2- 172.21.15.2:0/2869086777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4454106f10 0x7f445419ede0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f444c009dc0 tx=0x7f444c032ff0 comp rx=0 tx=0).stop 2024-09-19T04:53:32.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.773+0000 7f445b139640 1 -- 172.21.15.2:0/2869086777 shutdown_connections 2024-09-19T04:53:32.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.773+0000 7f445b139640 1 --2- 172.21.15.2:0/2869086777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4454106f10 0x7f445419ede0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:32.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.773+0000 7f445b139640 1 --2- 172.21.15.2:0/2869086777 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4454102790 0x7f445419aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:32.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.773+0000 7f445b139640 1 --2- 172.21.15.2:0/2869086777 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f443c0a33b0 0x7f443c0a5870 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:32.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.773+0000 7f445b139640 1 --2- 172.21.15.2:0/2869086777 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4454101de0 0x7f445419a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:32.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.773+0000 7f445b139640 1 -- 172.21.15.2:0/2869086777 >> 172.21.15.2:0/2869086777 conn(0x7f44540fd8c0 msgr2=0x7f44540febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:53:32.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.773+0000 7f445b139640 1 -- 172.21.15.2:0/2869086777 shutdown_connections 2024-09-19T04:53:32.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:32.773+0000 7f445b139640 1 -- 172.21.15.2:0/2869086777 wait complete. 2024-09-19T04:53:32.806 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:53:32 smithi018 ceph-mon[34537]: pgmap v169: 97 pgs: 97 active+clean; 7.1 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 43 KiB/s wr, 10 op/s 2024-09-19T04:53:32.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:53:32 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/2899386529' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:53:34.557 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:53:34.557 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:53:34.586 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:53:34 smithi002 ceph-mon[30975]: pgmap v170: 97 pgs: 97 active+clean; 7.1 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 30 KiB/s wr, 7 op/s 2024-09-19T04:53:34.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:53:34 smithi116 ceph-mon[34477]: pgmap v170: 97 pgs: 97 active+clean; 7.1 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 30 KiB/s wr, 7 op/s 2024-09-19T04:53:34.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:53:34 smithi018 ceph-mon[34537]: pgmap v170: 97 pgs: 97 active+clean; 7.1 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 30 KiB/s wr, 7 op/s 2024-09-19T04:53:34.828 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:53:35.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.276+0000 7f2255b55640 1 -- 172.21.15.2:0/3282525280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2250102d40 msgr2=0x7f2250103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:35.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.276+0000 7f2255b55640 1 --2- 172.21.15.2:0/3282525280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2250102d40 0x7f2250103120 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f2244009900 tx=0x7f224402a480 comp rx=0 tx=0).stop 2024-09-19T04:53:35.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.276+0000 7f2255b55640 1 -- 172.21.15.2:0/3282525280 shutdown_connections 2024-09-19T04:53:35.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.276+0000 7f2255b55640 1 --2- 172.21.15.2:0/3282525280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f225010c170 0x7f225010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:35.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.276+0000 7f2255b55640 1 --2- 172.21.15.2:0/3282525280 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2250103660 0x7f225010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:35.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.276+0000 7f2255b55640 1 --2- 172.21.15.2:0/3282525280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2250102d40 0x7f2250103120 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:35.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.276+0000 7f2255b55640 1 -- 172.21.15.2:0/3282525280 >> 172.21.15.2:0/3282525280 conn(0x7f22500fc7a0 msgr2=0x7f22500febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:53:35.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.276+0000 7f2255b55640 1 -- 172.21.15.2:0/3282525280 shutdown_connections 2024-09-19T04:53:35.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.276+0000 7f2255b55640 1 -- 172.21.15.2:0/3282525280 wait complete. 2024-09-19T04:53:35.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.277+0000 7f2255b55640 1 Processor -- start 2024-09-19T04:53:35.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.277+0000 7f2255b55640 1 -- start start 2024-09-19T04:53:35.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.277+0000 7f2255b55640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2250102d40 0x7f2250198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:35.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.277+0000 7f2255b55640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2250103660 0x7f2250198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:35.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.277+0000 7f2255b55640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f225010c170 0x7f225019ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:35.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.278+0000 7f2255b55640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2250111e80 con 0x7f2250102d40 2024-09-19T04:53:35.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.278+0000 7f2255b55640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2250111d00 con 0x7f225010c170 2024-09-19T04:53:35.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.278+0000 7f2255b55640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f2250112000 con 0x7f2250103660 2024-09-19T04:53:35.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.278+0000 7f224f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2250102d40 0x7f2250198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:35.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.278+0000 7f224f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2250102d40 0x7f2250198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58172/0 (socket says 172.21.15.2:58172) 2024-09-19T04:53:35.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.278+0000 7f224f7fe640 1 -- 172.21.15.2:0/4118571667 learned_addr learned my addr 172.21.15.2:0/4118571667 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:53:35.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.278+0000 7f224effd640 1 --2- 172.21.15.2:0/4118571667 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2250103660 0x7f2250198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:35.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.278+0000 7f224ffff640 1 --2- 172.21.15.2:0/4118571667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f225010c170 0x7f225019ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:35.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.278+0000 7f224f7fe640 1 -- 172.21.15.2:0/4118571667 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2250103660 msgr2=0x7f2250198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:35.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.278+0000 7f224f7fe640 1 --2- 172.21.15.2:0/4118571667 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2250103660 0x7f2250198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:35.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.278+0000 7f224f7fe640 1 -- 172.21.15.2:0/4118571667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f225010c170 msgr2=0x7f225019ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:35.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.278+0000 7f224f7fe640 1 --2- 172.21.15.2:0/4118571667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f225010c170 0x7f225019ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:35.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.278+0000 7f224f7fe640 1 -- 172.21.15.2:0/4118571667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f225019d3b0 con 0x7f2250102d40 2024-09-19T04:53:35.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.278+0000 7f224f7fe640 1 --2- 172.21.15.2:0/4118571667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2250102d40 0x7f2250198400 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f2244005940 tx=0x7f2244004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:53:35.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.278+0000 7f224cff9640 1 -- 172.21.15.2:0/4118571667 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224403f030 con 0x7f2250102d40 2024-09-19T04:53:35.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.278+0000 7f224cff9640 1 -- 172.21.15.2:0/4118571667 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2244003aa0 con 0x7f2250102d40 2024-09-19T04:53:35.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.278+0000 7f2255b55640 1 -- 172.21.15.2:0/4118571667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f225019d640 con 0x7f2250102d40 2024-09-19T04:53:35.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.278+0000 7f224cff9640 1 -- 172.21.15.2:0/4118571667 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2244035070 con 0x7f2250102d40 2024-09-19T04:53:35.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.279+0000 7f2255b55640 1 -- 172.21.15.2:0/4118571667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22501a4f80 con 0x7f2250102d40 2024-09-19T04:53:35.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.282+0000 7f2257f2e740 1 Processor -- start 2024-09-19T04:53:35.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.282+0000 7f224cff9640 1 -- 172.21.15.2:0/4118571667 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f2244042030 con 0x7f2250102d40 2024-09-19T04:53:35.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.282+0000 7f2257f2e740 1 -- start start 2024-09-19T04:53:35.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.282+0000 7f2257f2e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c142446a40 0x55c142446e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:35.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.282+0000 7f2257f2e740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c142447360 0x55c142455c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:35.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.282+0000 7f2257f2e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c142456150 0x55c142458540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:35.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.282+0000 7f2257f2e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c1423ac280 con 0x55c142456150 2024-09-19T04:53:35.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.282+0000 7f2257f2e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c142353b10 con 0x55c142446a40 2024-09-19T04:53:35.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.282+0000 7f2257f2e740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55c1423a8240 con 0x55c142447360 2024-09-19T04:53:35.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.282+0000 7f224effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c142456150 0x55c142458540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:35.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.282+0000 7f224effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c142456150 0x55c142458540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58176/0 (socket says 172.21.15.2:58176) 2024-09-19T04:53:35.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.282+0000 7f224effd640 1 -- 172.21.15.2:0/332105762 learned_addr learned my addr 172.21.15.2:0/332105762 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:53:35.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.282+0000 7f224ffff640 1 --2- 172.21.15.2:0/332105762 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c142446a40 0x55c142446e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:35.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.282+0000 7f224f7fe640 1 --2- 172.21.15.2:0/332105762 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c142447360 0x55c142455c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:35.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.283+0000 7f224effd640 1 -- 172.21.15.2:0/332105762 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c142447360 msgr2=0x55c142455c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:35.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.283+0000 7f224effd640 1 --2- 172.21.15.2:0/332105762 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c142447360 0x55c142455c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:35.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.283+0000 7f224effd640 1 -- 172.21.15.2:0/332105762 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c142446a40 msgr2=0x55c142446e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:35.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.283+0000 7f224effd640 1 --2- 172.21.15.2:0/332105762 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c142446a40 0x55c142446e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:35.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.283+0000 7f224effd640 1 -- 172.21.15.2:0/332105762 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1423601f0 con 0x55c142456150 2024-09-19T04:53:35.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.283+0000 7f224effd640 1 --2- 172.21.15.2:0/332105762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c142456150 0x55c142458540 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f224000b730 tx=0x7f224000bbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7394c7108ae0bb12 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:53:35.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.283+0000 7f224cff9640 1 --2- 172.21.15.2:0/4118571667 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f22380a33b0 0x7f22380a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:35.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.283+0000 7f2235ffb640 1 -- 172.21.15.2:0/332105762 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2240003dd0 con 0x55c142456150 2024-09-19T04:53:35.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.283+0000 7f2235ffb640 1 -- 172.21.15.2:0/332105762 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2240015070 con 0x55c142456150 2024-09-19T04:53:35.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.283+0000 7f2235ffb640 1 -- 172.21.15.2:0/332105762 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2240004d10 con 0x55c142456150 2024-09-19T04:53:35.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.283+0000 7f224ffff640 1 --2- 172.21.15.2:0/4118571667 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f22380a33b0 0x7f22380a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:35.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.283+0000 7f224cff9640 1 -- 172.21.15.2:0/4118571667 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f22440f04b0 con 0x7f2250102d40 2024-09-19T04:53:35.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.284+0000 7f224ffff640 1 --2- 172.21.15.2:0/4118571667 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f22380a33b0 0x7f22380a5870 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f224800b4d0 tx=0x7f224800e040 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:53:35.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.284+0000 7f2257f2e740 1 -- 172.21.15.2:0/332105762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c142456150 msgr2=0x55c142458540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:35.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.284+0000 7f2257f2e740 1 --2- 172.21.15.2:0/332105762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c142456150 0x55c142458540 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f224000b730 tx=0x7f224000bbf0 comp rx=0 tx=0).stop 2024-09-19T04:53:35.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.284+0000 7f2257f2e740 1 -- 172.21.15.2:0/332105762 shutdown_connections 2024-09-19T04:53:35.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.284+0000 7f2257f2e740 1 --2- 172.21.15.2:0/332105762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c142456150 0x55c142458540 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:35.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.284+0000 7f2257f2e740 1 --2- 172.21.15.2:0/332105762 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c142447360 0x55c142455c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:35.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.284+0000 7f2257f2e740 1 --2- 172.21.15.2:0/332105762 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c142446a40 0x55c142446e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:35.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.284+0000 7f2257f2e740 1 -- 172.21.15.2:0/332105762 >> 172.21.15.2:0/332105762 conn(0x55c1424430f0 msgr2=0x55c1424434d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:53:35.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.284+0000 7f2257f2e740 1 -- 172.21.15.2:0/332105762 shutdown_connections 2024-09-19T04:53:35.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.284+0000 7f2257f2e740 1 -- 172.21.15.2:0/332105762 wait complete. 2024-09-19T04:53:35.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.284+0000 7f2257f2e740 1 -- start start 2024-09-19T04:53:35.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.284+0000 7f2257f2e740 1 Processor -- start 2024-09-19T04:53:35.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.285+0000 7f2257f2e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c142446a40 0x55c142453040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:35.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.285+0000 7f2257f2e740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c142447360 0x55c142453580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:35.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.285+0000 7f2257f2e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c142456150 0x55c142453ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:35.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.285+0000 7f2257f2e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c142458d20 con 0x55c142446a40 2024-09-19T04:53:35.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.285+0000 7f2257f2e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c142366f10 con 0x55c142456150 2024-09-19T04:53:35.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.285+0000 7f2257f2e740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55c142458ea0 con 0x55c142447360 2024-09-19T04:53:35.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.285+0000 7f2257f2e740 10 client.0 _ll_register_callbacks cb 0x55c14232fa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:53:35.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.285+0000 7f224f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c142446a40 0x55c142453040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:35.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.285+0000 7f224f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c142446a40 0x55c142453040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58190/0 (socket says 172.21.15.2:58190) 2024-09-19T04:53:35.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.285+0000 7f224f7fe640 1 -- 172.21.15.2:0/1546966717 learned_addr learned my addr 172.21.15.2:0/1546966717 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:53:35.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.285+0000 7f224effd640 1 --2- 172.21.15.2:0/1546966717 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c142447360 0x55c142453580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:35.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.285+0000 7f224ffff640 1 --2- 172.21.15.2:0/1546966717 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c142456150 0x55c142453ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:35.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.285+0000 7f224f7fe640 1 -- 172.21.15.2:0/1546966717 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c142447360 msgr2=0x55c142453580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:35.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.285+0000 7f224f7fe640 1 --2- 172.21.15.2:0/1546966717 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c142447360 0x55c142453580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:35.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.285+0000 7f224f7fe640 1 -- 172.21.15.2:0/1546966717 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c142456150 msgr2=0x55c142453ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:35.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.285+0000 7f224f7fe640 1 --2- 172.21.15.2:0/1546966717 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c142456150 0x55c142453ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:35.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.285+0000 7f224f7fe640 1 -- 172.21.15.2:0/1546966717 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c14211d6a0 con 0x55c142446a40 2024-09-19T04:53:35.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.285+0000 7f224ffff640 1 --2- 172.21.15.2:0/1546966717 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c142456150 0x55c142453ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:53:35.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.285+0000 7f224f7fe640 1 --2- 172.21.15.2:0/1546966717 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c142446a40 0x55c142453040 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f22440bc740 tx=0x7f2244009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc1013f536df85a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:53:35.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.285+0000 7f222effd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:53:35.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.286+0000 7f222effd640 1 -- 172.21.15.2:0/1546966717 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2244049070 con 0x55c142446a40 2024-09-19T04:53:35.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.286+0000 7f222effd640 1 -- 172.21.15.2:0/1546966717 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f22440edea0 con 0x55c142446a40 2024-09-19T04:53:35.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.286+0000 7f2257f2e740 1 -- 172.21.15.2:0/1546966717 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2240015070 con 0x55c142446a40 2024-09-19T04:53:35.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.286+0000 7f222effd640 1 -- 172.21.15.2:0/1546966717 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f22440bc2f0 con 0x55c142446a40 2024-09-19T04:53:35.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.286+0000 7f2257f2e740 10 client.16002 fetch_fsmap learned FSMap version 19 2024-09-19T04:53:35.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.286+0000 7f2257f2e740 1 -- 172.21.15.2:0/1546966717 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55c142464970 con 0x55c142446a40 2024-09-19T04:53:35.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.286+0000 7f222effd640 1 -- 172.21.15.2:0/1546966717 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2240015070 con 0x55c142446a40 2024-09-19T04:53:35.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.286+0000 7f222effd640 1 -- 172.21.15.2:0/1546966717 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f22440b8e20 con 0x55c142446a40 2024-09-19T04:53:35.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.286+0000 7f2257f2e740 10 client.16002 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:53:35.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.286+0000 7f2257f2e740 10 client.16002 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:53:35.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.286+0000 7f2257f2e740 20 client.16002 populate_metadata read hostname 'smithi002' 2024-09-19T04:53:35.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.286+0000 7f2257f2e740 1 --2- 172.21.15.2:0/1546966717 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55c142465cc0 0x55c1424680d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:35.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.286+0000 7f2257f2e740 4 client.16002 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:53:35.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.286+0000 7f2257f2e740 1 -- 172.21.15.2:0/1546966717 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c1423b97f0 con 0x55c142465cc0 2024-09-19T04:53:35.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.286+0000 7f224effd640 1 --2- 172.21.15.2:0/1546966717 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55c142465cc0 0x55c1424680d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:35.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.287+0000 7f222effd640 10 client.16002 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:53:35.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.287+0000 7f224effd640 1 --2- 172.21.15.2:0/1546966717 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55c142465cc0 0x55c1424680d0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d58270e4f77d3cb1 server_cookie=8387980b6801e6a3 in_seq=0 out_seq=0 2024-09-19T04:53:35.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.288+0000 7f222effd640 1 -- 172.21.15.2:0/1546966717 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c1423b97f0 con 0x55c142465cc0 2024-09-19T04:53:35.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.288+0000 7f222effd640 10 client.16002 handle_command_reply: tid=0 2024-09-19T04:53:35.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.288+0000 7f2257f2e740 1 client.16002 shutdown 2024-09-19T04:53:35.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.288+0000 7f2257f2e740 1 -- 172.21.15.2:0/1546966717 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c142446a40 msgr2=0x55c142453040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:35.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.288+0000 7f2257f2e740 1 --2- 172.21.15.2:0/1546966717 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c142446a40 0x55c142453040 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f22440bc740 tx=0x7f2244009560 comp rx=0 tx=0).stop 2024-09-19T04:53:35.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.288+0000 7f2257f2e740 1 -- 172.21.15.2:0/1546966717 shutdown_connections 2024-09-19T04:53:35.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.288+0000 7f2257f2e740 1 --2- 172.21.15.2:0/1546966717 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c142456150 0x55c142453ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:35.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.288+0000 7f2257f2e740 1 --2- 172.21.15.2:0/1546966717 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55c142465cc0 0x55c1424680d0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:35.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.288+0000 7f2257f2e740 1 --2- 172.21.15.2:0/1546966717 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c142447360 0x55c142453580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:35.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.288+0000 7f2257f2e740 1 --2- 172.21.15.2:0/1546966717 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c142446a40 0x55c142453040 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:35.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.288+0000 7f222effd640 0 client.16002 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:53:35.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.288+0000 7f2257f2e740 1 -- 172.21.15.2:0/1546966717 >> 172.21.15.2:0/1546966717 conn(0x55c1424430f0 msgr2=0x55c142448e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:53:35.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.288+0000 7f2257f2e740 1 -- 172.21.15.2:0/1546966717 shutdown_connections 2024-09-19T04:53:35.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.288+0000 7f2257f2e740 1 -- 172.21.15.2:0/1546966717 wait complete. 2024-09-19T04:53:35.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.288+0000 7f2257f2e740 20 client.16002 trim_cache size 0 max 16384 2024-09-19T04:53:35.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.306+0000 7f2257f2e740 1 Processor -- start 2024-09-19T04:53:35.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.306+0000 7f2257f2e740 1 -- start start 2024-09-19T04:53:35.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.306+0000 7f2257f2e740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c142446a40 0x55c14246d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:35.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.306+0000 7f2257f2e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c142447360 0x55c14246deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:35.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.306+0000 7f2257f2e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c142456150 0x55c1424502c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:35.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.306+0000 7f2257f2e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f22501a94a0 con 0x55c142456150 2024-09-19T04:53:35.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.306+0000 7f2257f2e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f22501abd20 con 0x55c142447360 2024-09-19T04:53:35.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.306+0000 7f2257f2e740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f22501a9b10 con 0x55c142446a40 2024-09-19T04:53:35.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.306+0000 7f224ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c142456150 0x55c1424502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:35.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.306+0000 7f224ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c142456150 0x55c1424502c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58198/0 (socket says 172.21.15.2:58198) 2024-09-19T04:53:35.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.306+0000 7f224ffff640 1 -- 172.21.15.2:0/766569674 learned_addr learned my addr 172.21.15.2:0/766569674 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:53:35.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.306+0000 7f224f7fe640 1 --2- 172.21.15.2:0/766569674 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c142446a40 0x55c14246d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:35.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.306+0000 7f224effd640 1 --2- 172.21.15.2:0/766569674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c142447360 0x55c14246deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:35.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.306+0000 7f224ffff640 1 -- 172.21.15.2:0/766569674 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c142446a40 msgr2=0x55c14246d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:35.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.306+0000 7f224ffff640 1 --2- 172.21.15.2:0/766569674 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c142446a40 0x55c14246d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:35.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.306+0000 7f224ffff640 1 -- 172.21.15.2:0/766569674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c142447360 msgr2=0x55c14246deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:35.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.306+0000 7f224ffff640 1 --2- 172.21.15.2:0/766569674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c142447360 0x55c14246deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:35.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.306+0000 7f224ffff640 1 -- 172.21.15.2:0/766569674 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c142447880 con 0x55c142456150 2024-09-19T04:53:35.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.306+0000 7f224effd640 1 --2- 172.21.15.2:0/766569674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c142447360 0x55c14246deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:53:35.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.307+0000 7f224ffff640 1 --2- 172.21.15.2:0/766569674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c142456150 0x55c1424502c0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f2248018920 tx=0x7f2248013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e09e105bd038b63 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:53:35.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.307+0000 7f22357fa640 1 -- 172.21.15.2:0/766569674 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2248029070 con 0x55c142456150 2024-09-19T04:53:35.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.307+0000 7f22357fa640 1 -- 172.21.15.2:0/766569674 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2248007d00 con 0x55c142456150 2024-09-19T04:53:35.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.307+0000 7f22357fa640 1 -- 172.21.15.2:0/766569674 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2248022680 con 0x55c142456150 2024-09-19T04:53:35.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.307+0000 7f2257f2e740 1 -- 172.21.15.2:0/766569674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c142456150 msgr2=0x55c1424502c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:35.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.307+0000 7f2257f2e740 1 --2- 172.21.15.2:0/766569674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c142456150 0x55c1424502c0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f2248018920 tx=0x7f2248013000 comp rx=0 tx=0).stop 2024-09-19T04:53:35.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.307+0000 7f2257f2e740 1 -- 172.21.15.2:0/766569674 shutdown_connections 2024-09-19T04:53:35.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.307+0000 7f2257f2e740 1 --2- 172.21.15.2:0/766569674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c142456150 0x55c1424502c0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:35.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.307+0000 7f2257f2e740 1 --2- 172.21.15.2:0/766569674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c142447360 0x55c14246deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:35.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.307+0000 7f2257f2e740 1 --2- 172.21.15.2:0/766569674 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c142446a40 0x55c14246d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:35.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.307+0000 7f2257f2e740 1 -- 172.21.15.2:0/766569674 >> 172.21.15.2:0/766569674 conn(0x55c1424430f0 msgr2=0x55c142442270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:53:35.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.307+0000 7f2257f2e740 1 -- 172.21.15.2:0/766569674 shutdown_connections 2024-09-19T04:53:35.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.308+0000 7f2257f2e740 1 -- 172.21.15.2:0/766569674 wait complete. 2024-09-19T04:53:35.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.308+0000 7f2257f2e740 1 -- start start 2024-09-19T04:53:35.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.308+0000 7f2257f2e740 1 Processor -- start 2024-09-19T04:53:35.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.308+0000 7f2257f2e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c142446a40 0x55c14245e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:35.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.308+0000 7f2257f2e740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c142447360 0x55c14245e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:35.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.308+0000 7f2257f2e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c142456150 0x55c14245b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:35.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.308+0000 7f2257f2e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f22501aa1e0 con 0x55c142446a40 2024-09-19T04:53:35.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.308+0000 7f2257f2e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f22501ab650 con 0x55c142456150 2024-09-19T04:53:35.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.308+0000 7f2257f2e740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f22501aa8b0 con 0x55c142447360 2024-09-19T04:53:35.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.308+0000 7f2257f2e740 10 client.0 _ll_register_callbacks cb 0x7f2244005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:53:35.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.308+0000 7f224f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c142446a40 0x55c14245e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:35.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.308+0000 7f224f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c142446a40 0x55c14245e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58202/0 (socket says 172.21.15.2:58202) 2024-09-19T04:53:35.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.308+0000 7f224f7fe640 1 -- 172.21.15.2:0/2091820135 learned_addr learned my addr 172.21.15.2:0/2091820135 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:53:35.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.309+0000 7f224effd640 1 --2- 172.21.15.2:0/2091820135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c142447360 0x55c14245e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:35.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.309+0000 7f224ffff640 1 --2- 172.21.15.2:0/2091820135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c142456150 0x55c14245b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:35.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.309+0000 7f224f7fe640 1 -- 172.21.15.2:0/2091820135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c142447360 msgr2=0x55c14245e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:35.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.309+0000 7f224f7fe640 1 --2- 172.21.15.2:0/2091820135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c142447360 0x55c14245e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:35.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.309+0000 7f224f7fe640 1 -- 172.21.15.2:0/2091820135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c142456150 msgr2=0x55c14245b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:35.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.309+0000 7f224f7fe640 1 --2- 172.21.15.2:0/2091820135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c142456150 0x55c14245b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:35.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.309+0000 7f224f7fe640 1 -- 172.21.15.2:0/2091820135 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c142442f20 con 0x55c142446a40 2024-09-19T04:53:35.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.309+0000 7f224effd640 1 --2- 172.21.15.2:0/2091820135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c142447360 0x55c14245e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:53:35.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.309+0000 7f224ffff640 1 --2- 172.21.15.2:0/2091820135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c142456150 0x55c14245b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:53:35.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.309+0000 7f224f7fe640 1 --2- 172.21.15.2:0/2091820135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c142446a40 0x55c14245e310 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f2244005e00 tx=0x7f224403bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8cc9fb2e0e2319d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:53:35.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.309+0000 7f222effd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:53:35.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.309+0000 7f222effd640 1 -- 172.21.15.2:0/2091820135 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2244049070 con 0x55c142446a40 2024-09-19T04:53:35.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.309+0000 7f222effd640 1 -- 172.21.15.2:0/2091820135 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f22440b8e20 con 0x55c142446a40 2024-09-19T04:53:35.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.309+0000 7f2257f2e740 1 -- 172.21.15.2:0/2091820135 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2248007d00 con 0x55c142446a40 2024-09-19T04:53:35.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.309+0000 7f222effd640 1 -- 172.21.15.2:0/2091820135 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f22440bc110 con 0x55c142446a40 2024-09-19T04:53:35.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.309+0000 7f2257f2e740 10 client.16008 fetch_fsmap learned FSMap version 19 2024-09-19T04:53:35.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.309+0000 7f2257f2e740 1 -- 172.21.15.2:0/2091820135 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55c1424d10e0 con 0x55c142446a40 2024-09-19T04:53:35.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.310+0000 7f222effd640 1 -- 172.21.15.2:0/2091820135 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2248007d00 con 0x55c142446a40 2024-09-19T04:53:35.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.310+0000 7f222effd640 1 -- 172.21.15.2:0/2091820135 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f22440bbd00 con 0x55c142446a40 2024-09-19T04:53:35.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.310+0000 7f2257f2e740 10 client.16008 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:53:35.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.310+0000 7f2257f2e740 10 client.16008 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:53:35.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.310+0000 7f2257f2e740 20 client.16008 populate_metadata read hostname 'smithi002' 2024-09-19T04:53:35.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.310+0000 7f2257f2e740 1 --2- 172.21.15.2:0/2091820135 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55c1424d16c0 0x55c1424d3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:35.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.310+0000 7f2257f2e740 4 client.16008 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:53:35.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.310+0000 7f2257f2e740 1 -- 172.21.15.2:0/2091820135 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c1423b3d00 con 0x55c1424d16c0 2024-09-19T04:53:35.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.310+0000 7f224effd640 1 --2- 172.21.15.2:0/2091820135 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55c1424d16c0 0x55c1424d3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:35.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.311+0000 7f224effd640 1 --2- 172.21.15.2:0/2091820135 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55c1424d16c0 0x55c1424d3ab0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f80923d1dffca143 server_cookie=9dd991c9f680efd9 in_seq=0 out_seq=0 2024-09-19T04:53:35.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.311+0000 7f222effd640 10 client.16008 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:53:35.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.312+0000 7f222effd640 1 -- 172.21.15.2:0/2091820135 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c1423b3d00 con 0x55c1424d16c0 2024-09-19T04:53:35.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.312+0000 7f222effd640 10 client.16008 handle_command_reply: tid=0 2024-09-19T04:53:35.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.312+0000 7f2257f2e740 1 client.16008 shutdown 2024-09-19T04:53:35.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.312+0000 7f2257f2e740 1 -- 172.21.15.2:0/2091820135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c142446a40 msgr2=0x55c14245e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:35.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.312+0000 7f2257f2e740 1 --2- 172.21.15.2:0/2091820135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c142446a40 0x55c14245e310 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f2244005e00 tx=0x7f224403bb10 comp rx=0 tx=0).stop 2024-09-19T04:53:35.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.312+0000 7f2257f2e740 1 -- 172.21.15.2:0/2091820135 shutdown_connections 2024-09-19T04:53:35.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.312+0000 7f2257f2e740 1 --2- 172.21.15.2:0/2091820135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c142456150 0x55c14245b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:35.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.312+0000 7f2257f2e740 1 --2- 172.21.15.2:0/2091820135 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55c1424d16c0 0x55c1424d3ab0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:35.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.312+0000 7f222effd640 0 client.16008 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:53:35.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.312+0000 7f2257f2e740 1 --2- 172.21.15.2:0/2091820135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c142447360 0x55c14245e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:35.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.312+0000 7f2257f2e740 1 --2- 172.21.15.2:0/2091820135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c142446a40 0x55c14245e310 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:35.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.312+0000 7f2257f2e740 1 -- 172.21.15.2:0/2091820135 >> 172.21.15.2:0/2091820135 conn(0x55c1424430f0 msgr2=0x55c142442270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:53:35.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.312+0000 7f2257f2e740 1 -- 172.21.15.2:0/2091820135 shutdown_connections 2024-09-19T04:53:35.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.312+0000 7f2257f2e740 1 -- 172.21.15.2:0/2091820135 wait complete. 2024-09-19T04:53:35.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.312+0000 7f2257f2e740 20 client.16008 trim_cache size 0 max 16384 2024-09-19T04:53:35.326 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:53:35.326 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T04:53:35.326 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "b0e1fdd7-1a70-4c33-9b09-146a94b069fb", 2024-09-19T04:53:35.326 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T04:53:35.326 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:53:35.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.313+0000 7f2255b55640 1 -- 172.21.15.2:0/4118571667 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f22380a33b0 msgr2=0x7f22380a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:35.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.313+0000 7f2255b55640 1 --2- 172.21.15.2:0/4118571667 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f22380a33b0 0x7f22380a5870 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f224800b4d0 tx=0x7f224800e040 comp rx=0 tx=0).stop 2024-09-19T04:53:35.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.313+0000 7f2255b55640 1 -- 172.21.15.2:0/4118571667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2250102d40 msgr2=0x7f2250198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:35.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.313+0000 7f2255b55640 1 --2- 172.21.15.2:0/4118571667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2250102d40 0x7f2250198400 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f2244005940 tx=0x7f2244004270 comp rx=0 tx=0).stop 2024-09-19T04:53:35.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.313+0000 7f2255b55640 1 -- 172.21.15.2:0/4118571667 shutdown_connections 2024-09-19T04:53:35.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.313+0000 7f2255b55640 1 --2- 172.21.15.2:0/4118571667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f225010c170 0x7f225019ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:35.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.313+0000 7f2255b55640 1 --2- 172.21.15.2:0/4118571667 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f22380a33b0 0x7f22380a5870 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:35.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.313+0000 7f2255b55640 1 --2- 172.21.15.2:0/4118571667 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2250103660 0x7f2250198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:35.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.313+0000 7f2255b55640 1 --2- 172.21.15.2:0/4118571667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2250102d40 0x7f2250198400 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:35.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.313+0000 7f2255b55640 1 -- 172.21.15.2:0/4118571667 >> 172.21.15.2:0/4118571667 conn(0x7f22500fc7a0 msgr2=0x7f22500fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:53:35.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.313+0000 7f2255b55640 1 -- 172.21.15.2:0/4118571667 shutdown_connections 2024-09-19T04:53:35.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:35.313+0000 7f2255b55640 1 -- 172.21.15.2:0/4118571667 wait complete. 2024-09-19T04:53:36.041 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:53:36.340 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:53:36.598 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:53:36 smithi002 ceph-mon[30975]: pgmap v171: 97 pgs: 97 active+clean; 7.3 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 46 KiB/s wr, 11 op/s 2024-09-19T04:53:36.598 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:53:36 smithi002 ceph-mon[30975]: scrub queued for path: / 2024-09-19T04:53:36.599 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:53:36 smithi002 ceph-mon[30975]: scrub summary: idle+waiting paths [/] 2024-09-19T04:53:36.599 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:53:36 smithi002 ceph-mon[30975]: scrub summary: active paths [/] 2024-09-19T04:53:36.599 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:53:36 smithi002 ceph-mon[30975]: scrub summary: idle+waiting paths [/] 2024-09-19T04:53:36.599 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:53:36 smithi002 ceph-mon[30975]: scrub summary: idle 2024-09-19T04:53:36.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:53:36 smithi116 ceph-mon[34477]: pgmap v171: 97 pgs: 97 active+clean; 7.3 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 46 KiB/s wr, 11 op/s 2024-09-19T04:53:36.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:53:36 smithi116 ceph-mon[34477]: scrub queued for path: / 2024-09-19T04:53:36.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:53:36 smithi116 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-19T04:53:36.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:53:36 smithi116 ceph-mon[34477]: scrub summary: active paths [/] 2024-09-19T04:53:36.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:53:36 smithi116 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-19T04:53:36.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:53:36 smithi116 ceph-mon[34477]: scrub summary: idle 2024-09-19T04:53:36.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:53:36 smithi018 ceph-mon[34537]: pgmap v171: 97 pgs: 97 active+clean; 7.3 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 46 KiB/s wr, 11 op/s 2024-09-19T04:53:36.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:53:36 smithi018 ceph-mon[34537]: scrub queued for path: / 2024-09-19T04:53:36.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:53:36 smithi018 ceph-mon[34537]: scrub summary: idle+waiting paths [/] 2024-09-19T04:53:36.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:53:36 smithi018 ceph-mon[34537]: scrub summary: active paths [/] 2024-09-19T04:53:36.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:53:36 smithi018 ceph-mon[34537]: scrub summary: idle+waiting paths [/] 2024-09-19T04:53:36.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:53:36 smithi018 ceph-mon[34537]: scrub summary: idle 2024-09-19T04:53:36.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.840+0000 7f33ee430640 1 -- 172.21.15.2:0/2325952630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33e8101de0 msgr2=0x7f33e81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:36.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.840+0000 7f33ee430640 1 --2- 172.21.15.2:0/2325952630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33e8101de0 0x7f33e81021c0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f33d8009900 tx=0x7f33d802a410 comp rx=0 tx=0).stop 2024-09-19T04:53:36.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.840+0000 7f33ee430640 1 -- 172.21.15.2:0/2325952630 shutdown_connections 2024-09-19T04:53:36.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.840+0000 7f33ee430640 1 --2- 172.21.15.2:0/2325952630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33e8106f10 0x7f33e810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:36.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.840+0000 7f33ee430640 1 --2- 172.21.15.2:0/2325952630 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f33e8102790 0x7f33e81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:36.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.840+0000 7f33ee430640 1 --2- 172.21.15.2:0/2325952630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33e8101de0 0x7f33e81021c0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:36.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.840+0000 7f33ee430640 1 -- 172.21.15.2:0/2325952630 >> 172.21.15.2:0/2325952630 conn(0x7f33e80fd8c0 msgr2=0x7f33e80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:53:36.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.840+0000 7f33ee430640 1 -- 172.21.15.2:0/2325952630 shutdown_connections 2024-09-19T04:53:36.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.840+0000 7f33ee430640 1 -- 172.21.15.2:0/2325952630 wait complete. 2024-09-19T04:53:36.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.841+0000 7f33ee430640 1 Processor -- start 2024-09-19T04:53:36.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.841+0000 7f33ee430640 1 -- start start 2024-09-19T04:53:36.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.842+0000 7f33ee430640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f33e8101de0 0x7f33e81983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:36.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.842+0000 7f33ee430640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33e8102790 0x7f33e8198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:36.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.842+0000 7f33ee430640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33e8106f10 0x7f33e819ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:36.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.842+0000 7f33ee430640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f33e8111e40 con 0x7f33e8102790 2024-09-19T04:53:36.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.842+0000 7f33ee430640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f33e8111cc0 con 0x7f33e8106f10 2024-09-19T04:53:36.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.842+0000 7f33ee430640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f33e8111fc0 con 0x7f33e8101de0 2024-09-19T04:53:36.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.842+0000 7f33e77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33e8102790 0x7f33e8198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:36.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.842+0000 7f33e77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33e8102790 0x7f33e8198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58224/0 (socket says 172.21.15.2:58224) 2024-09-19T04:53:36.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.842+0000 7f33e77fe640 1 -- 172.21.15.2:0/144858684 learned_addr learned my addr 172.21.15.2:0/144858684 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:53:36.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.842+0000 7f33ec9cd640 1 --2- 172.21.15.2:0/144858684 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33e8106f10 0x7f33e819ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:36.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.842+0000 7f33e7fff640 1 --2- 172.21.15.2:0/144858684 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f33e8101de0 0x7f33e81983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:36.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.842+0000 7f33e77fe640 1 -- 172.21.15.2:0/144858684 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f33e8101de0 msgr2=0x7f33e81983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:36.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.842+0000 7f33e77fe640 1 --2- 172.21.15.2:0/144858684 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f33e8101de0 0x7f33e81983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:36.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.842+0000 7f33e77fe640 1 -- 172.21.15.2:0/144858684 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33e8106f10 msgr2=0x7f33e819ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:36.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.842+0000 7f33e77fe640 1 --2- 172.21.15.2:0/144858684 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33e8106f10 0x7f33e819ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:36.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.842+0000 7f33e77fe640 1 -- 172.21.15.2:0/144858684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33e819d3a0 con 0x7f33e8102790 2024-09-19T04:53:36.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.842+0000 7f33e7fff640 1 --2- 172.21.15.2:0/144858684 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f33e8101de0 0x7f33e81983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:53:36.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.842+0000 7f33e77fe640 1 --2- 172.21.15.2:0/144858684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33e8102790 0x7f33e8198930 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f33dc00b4a0 tx=0x7f33dc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:53:36.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.842+0000 7f33e57fa640 1 -- 172.21.15.2:0/144858684 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33dc014070 con 0x7f33e8102790 2024-09-19T04:53:36.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.842+0000 7f33e57fa640 1 -- 172.21.15.2:0/144858684 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f33dc010ac0 con 0x7f33e8102790 2024-09-19T04:53:36.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.843+0000 7f33e57fa640 1 -- 172.21.15.2:0/144858684 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33dc017c30 con 0x7f33e8102790 2024-09-19T04:53:36.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.843+0000 7f33ee430640 1 -- 172.21.15.2:0/144858684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33e819d690 con 0x7f33e8102790 2024-09-19T04:53:36.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.843+0000 7f33ee430640 1 -- 172.21.15.2:0/144858684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33e81a4f70 con 0x7f33e8102790 2024-09-19T04:53:36.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.845+0000 7f33e57fa640 1 -- 172.21.15.2:0/144858684 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f33dc017070 con 0x7f33e8102790 2024-09-19T04:53:36.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.845+0000 7f33f0809740 1 Processor -- start 2024-09-19T04:53:36.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.845+0000 7f33f0809740 1 -- start start 2024-09-19T04:53:36.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.846+0000 7f33f0809740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56084750b4a0 0x56084750b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:36.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.846+0000 7f33f0809740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56084750bdc0 0x560847516140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:36.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.846+0000 7f33f0809740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560847516680 0x560847518a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:36.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.846+0000 7f33f0809740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5608474712e0 con 0x560847516680 2024-09-19T04:53:36.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.846+0000 7f33f0809740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560847418ce0 con 0x56084750b4a0 2024-09-19T04:53:36.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.846+0000 7f33f0809740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x56084746d2a0 con 0x56084750bdc0 2024-09-19T04:53:36.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.846+0000 7f33e77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560847516680 0x560847518a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:36.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.846+0000 7f33e57fa640 1 --2- 172.21.15.2:0/144858684 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f33d00a33b0 0x7f33d00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:36.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.846+0000 7f33e77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560847516680 0x560847518a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58238/0 (socket says 172.21.15.2:58238) 2024-09-19T04:53:36.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.846+0000 7f33e77fe640 1 -- 172.21.15.2:0/2144671448 learned_addr learned my addr 172.21.15.2:0/2144671448 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:53:36.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.846+0000 7f33ec9cd640 1 --2- 172.21.15.2:0/2144671448 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56084750b4a0 0x56084750b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:36.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.846+0000 7f33e7fff640 1 --2- 172.21.15.2:0/2144671448 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56084750bdc0 0x560847516140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:36.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.846+0000 7f33ec9cd640 1 --2- 172.21.15.2:0/144858684 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f33d00a33b0 0x7f33d00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:36.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.846+0000 7f33e57fa640 1 -- 172.21.15.2:0/144858684 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f33dc0cf2c0 con 0x7f33e8102790 2024-09-19T04:53:36.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.846+0000 7f33e77fe640 1 -- 172.21.15.2:0/2144671448 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56084750bdc0 msgr2=0x560847516140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:36.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.846+0000 7f33e77fe640 1 --2- 172.21.15.2:0/2144671448 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56084750bdc0 0x560847516140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:36.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.846+0000 7f33e77fe640 1 -- 172.21.15.2:0/2144671448 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56084750b4a0 msgr2=0x56084750b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:36.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.846+0000 7f33e77fe640 1 --2- 172.21.15.2:0/2144671448 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56084750b4a0 0x56084750b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:36.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.846+0000 7f33e77fe640 1 -- 172.21.15.2:0/2144671448 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608473fd440 con 0x560847516680 2024-09-19T04:53:36.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.846+0000 7f33ec9cd640 1 --2- 172.21.15.2:0/2144671448 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56084750b4a0 0x56084750b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:53:36.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.846+0000 7f33e77fe640 1 --2- 172.21.15.2:0/2144671448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560847516680 0x560847518a70 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f33dc0a42b0 tx=0x7f33dc01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67fb2fb598075dde server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:53:36.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.847+0000 7f33ec9cd640 1 --2- 172.21.15.2:0/144858684 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f33d00a33b0 0x7f33d00a5870 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f33e0009fd0 tx=0x7f33e0009600 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:53:36.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.847+0000 7f33ce7fc640 1 -- 172.21.15.2:0/2144671448 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33dc01e050 con 0x560847516680 2024-09-19T04:53:36.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.847+0000 7f33ce7fc640 1 -- 172.21.15.2:0/2144671448 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f33dc0ce070 con 0x560847516680 2024-09-19T04:53:36.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.847+0000 7f33ce7fc640 1 -- 172.21.15.2:0/2144671448 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33dc097d40 con 0x560847516680 2024-09-19T04:53:36.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.848+0000 7f33f0809740 1 -- 172.21.15.2:0/2144671448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560847516680 msgr2=0x560847518a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:36.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.848+0000 7f33f0809740 1 --2- 172.21.15.2:0/2144671448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560847516680 0x560847518a70 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f33dc0a42b0 tx=0x7f33dc01c000 comp rx=0 tx=0).stop 2024-09-19T04:53:36.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.848+0000 7f33f0809740 1 -- 172.21.15.2:0/2144671448 shutdown_connections 2024-09-19T04:53:36.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.848+0000 7f33f0809740 1 --2- 172.21.15.2:0/2144671448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560847516680 0x560847518a70 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:36.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.848+0000 7f33f0809740 1 --2- 172.21.15.2:0/2144671448 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56084750bdc0 0x560847516140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:36.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.848+0000 7f33f0809740 1 --2- 172.21.15.2:0/2144671448 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56084750b4a0 0x56084750b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:36.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.848+0000 7f33f0809740 1 -- 172.21.15.2:0/2144671448 >> 172.21.15.2:0/2144671448 conn(0x560847507a30 msgr2=0x560847507e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:53:36.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.848+0000 7f33f0809740 1 -- 172.21.15.2:0/2144671448 shutdown_connections 2024-09-19T04:53:36.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.848+0000 7f33f0809740 1 -- 172.21.15.2:0/2144671448 wait complete. 2024-09-19T04:53:36.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.848+0000 7f33f0809740 1 -- start start 2024-09-19T04:53:36.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.849+0000 7f33f0809740 1 Processor -- start 2024-09-19T04:53:36.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.849+0000 7f33f0809740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56084750b4a0 0x560847515fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:36.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.849+0000 7f33f0809740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56084750bdc0 0x560847513260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:36.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.849+0000 7f33f0809740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560847516680 0x5608475137a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:36.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.849+0000 7f33f0809740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560847519250 con 0x56084750bdc0 2024-09-19T04:53:36.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.849+0000 7f33f0809740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56084742c050 con 0x560847516680 2024-09-19T04:53:36.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.849+0000 7f33f0809740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5608475193d0 con 0x56084750b4a0 2024-09-19T04:53:36.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.849+0000 7f33f0809740 10 client.0 _ll_register_callbacks cb 0x56084746c160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:53:36.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.849+0000 7f33e77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56084750bdc0 0x560847513260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:36.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.849+0000 7f33e77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56084750bdc0 0x560847513260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58254/0 (socket says 172.21.15.2:58254) 2024-09-19T04:53:36.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.849+0000 7f33e77fe640 1 -- 172.21.15.2:0/433174273 learned_addr learned my addr 172.21.15.2:0/433174273 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:53:36.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.849+0000 7f33ec9cd640 1 --2- 172.21.15.2:0/433174273 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560847516680 0x5608475137a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:36.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.849+0000 7f33e7fff640 1 --2- 172.21.15.2:0/433174273 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56084750b4a0 0x560847515fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:36.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.849+0000 7f33e77fe640 1 -- 172.21.15.2:0/433174273 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56084750b4a0 msgr2=0x560847515fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:36.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.849+0000 7f33e77fe640 1 --2- 172.21.15.2:0/433174273 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56084750b4a0 0x560847515fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:36.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.849+0000 7f33e77fe640 1 -- 172.21.15.2:0/433174273 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560847516680 msgr2=0x5608475137a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:36.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.849+0000 7f33e77fe640 1 --2- 172.21.15.2:0/433174273 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560847516680 0x5608475137a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:36.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.849+0000 7f33e77fe640 1 -- 172.21.15.2:0/433174273 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608471e23c0 con 0x56084750bdc0 2024-09-19T04:53:36.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.849+0000 7f33ec9cd640 1 --2- 172.21.15.2:0/433174273 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560847516680 0x5608475137a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:53:36.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.849+0000 7f33e77fe640 1 --2- 172.21.15.2:0/433174273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56084750bdc0 0x560847513260 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f33dc09b3d0 tx=0x7f33dc0ccf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4615a41f553e9c72 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:53:36.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.849+0000 7f33c77fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:53:36.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.850+0000 7f33c77fe640 1 -- 172.21.15.2:0/433174273 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33dc0b4060 con 0x56084750bdc0 2024-09-19T04:53:36.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.850+0000 7f33c77fe640 1 -- 172.21.15.2:0/433174273 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f33dc010c70 con 0x56084750bdc0 2024-09-19T04:53:36.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.850+0000 7f33f0809740 1 -- 172.21.15.2:0/433174273 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33dc0ce070 con 0x56084750bdc0 2024-09-19T04:53:36.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.850+0000 7f33c77fe640 1 -- 172.21.15.2:0/433174273 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f33dc01e030 con 0x56084750bdc0 2024-09-19T04:53:36.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.850+0000 7f33f0809740 10 client.16020 fetch_fsmap learned FSMap version 19 2024-09-19T04:53:36.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.850+0000 7f33f0809740 1 -- 172.21.15.2:0/433174273 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x560847524c00 con 0x56084750bdc0 2024-09-19T04:53:36.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.850+0000 7f33c77fe640 1 -- 172.21.15.2:0/433174273 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f33dc0ce070 con 0x56084750bdc0 2024-09-19T04:53:36.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.850+0000 7f33c77fe640 1 -- 172.21.15.2:0/433174273 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f33dc09ab20 con 0x56084750bdc0 2024-09-19T04:53:36.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.850+0000 7f33f0809740 10 client.16020 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:53:36.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.850+0000 7f33f0809740 10 client.16020 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:53:36.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.850+0000 7f33f0809740 20 client.16020 populate_metadata read hostname 'smithi002' 2024-09-19T04:53:36.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.850+0000 7f33f0809740 1 --2- 172.21.15.2:0/433174273 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560847525f50 0x560847528340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:36.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.850+0000 7f33f0809740 4 client.16020 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:53:36.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.850+0000 7f33f0809740 1 -- 172.21.15.2:0/433174273 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56084747e850 con 0x560847525f50 2024-09-19T04:53:36.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.850+0000 7f33e7fff640 1 --2- 172.21.15.2:0/433174273 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560847525f50 0x560847528340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:36.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.851+0000 7f33e7fff640 1 --2- 172.21.15.2:0/433174273 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560847525f50 0x560847528340 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f727f2d8e2d5d26 server_cookie=22455e7b6768f44 in_seq=0 out_seq=0 2024-09-19T04:53:36.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.851+0000 7f33c77fe640 10 client.16020 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:53:36.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.852+0000 7f33c77fe640 1 -- 172.21.15.2:0/433174273 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56084747e850 con 0x560847525f50 2024-09-19T04:53:36.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.852+0000 7f33c77fe640 10 client.16020 handle_command_reply: tid=0 2024-09-19T04:53:36.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.852+0000 7f33f0809740 1 client.16020 shutdown 2024-09-19T04:53:36.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.852+0000 7f33f0809740 1 -- 172.21.15.2:0/433174273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56084750bdc0 msgr2=0x560847513260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:36.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.852+0000 7f33f0809740 1 --2- 172.21.15.2:0/433174273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56084750bdc0 0x560847513260 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f33dc09b3d0 tx=0x7f33dc0ccf60 comp rx=0 tx=0).stop 2024-09-19T04:53:36.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.852+0000 7f33f0809740 1 -- 172.21.15.2:0/433174273 shutdown_connections 2024-09-19T04:53:36.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.852+0000 7f33f0809740 1 --2- 172.21.15.2:0/433174273 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560847516680 0x5608475137a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:36.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.852+0000 7f33f0809740 1 --2- 172.21.15.2:0/433174273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56084750bdc0 0x560847513260 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:36.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.852+0000 7f33f0809740 1 --2- 172.21.15.2:0/433174273 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560847525f50 0x560847528340 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:36.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.852+0000 7f33f0809740 1 --2- 172.21.15.2:0/433174273 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56084750b4a0 0x560847515fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:36.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.852+0000 7f33f0809740 1 -- 172.21.15.2:0/433174273 >> 172.21.15.2:0/433174273 conn(0x560847507a30 msgr2=0x56084750d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:53:36.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.852+0000 7f33c77fe640 0 client.16020 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:53:36.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.852+0000 7f33f0809740 1 -- 172.21.15.2:0/433174273 shutdown_connections 2024-09-19T04:53:36.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.852+0000 7f33f0809740 1 -- 172.21.15.2:0/433174273 wait complete. 2024-09-19T04:53:36.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.852+0000 7f33f0809740 20 client.16020 trim_cache size 0 max 16384 2024-09-19T04:53:36.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.869+0000 7f33f0809740 1 Processor -- start 2024-09-19T04:53:36.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.869+0000 7f33f0809740 1 -- start start 2024-09-19T04:53:36.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.869+0000 7f33f0809740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56084750b4a0 0x56084750e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:36.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.869+0000 7f33f0809740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56084750bdc0 0x56084750d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:36.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.869+0000 7f33f0809740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560847516680 0x56084752af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:36.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.869+0000 7f33f0809740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f33e81ab800 con 0x56084750b4a0 2024-09-19T04:53:36.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.869+0000 7f33f0809740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f33e81ae080 con 0x56084750bdc0 2024-09-19T04:53:36.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.869+0000 7f33f0809740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f33e81abe70 con 0x560847516680 2024-09-19T04:53:36.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.870+0000 7f33e7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56084750b4a0 0x56084750e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:36.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.870+0000 7f33e7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56084750b4a0 0x56084750e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58266/0 (socket says 172.21.15.2:58266) 2024-09-19T04:53:36.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.870+0000 7f33e7fff640 1 -- 172.21.15.2:0/3303452143 learned_addr learned my addr 172.21.15.2:0/3303452143 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:53:36.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.870+0000 7f33ec9cd640 1 --2- 172.21.15.2:0/3303452143 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560847516680 0x56084752af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:36.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.870+0000 7f33e7fff640 1 -- 172.21.15.2:0/3303452143 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560847516680 msgr2=0x56084752af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:36.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.870+0000 7f33e7fff640 1 --2- 172.21.15.2:0/3303452143 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560847516680 0x56084752af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:36.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.870+0000 7f33e77fe640 1 --2- 172.21.15.2:0/3303452143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56084750bdc0 0x56084750d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:36.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.870+0000 7f33e7fff640 1 -- 172.21.15.2:0/3303452143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56084750bdc0 msgr2=0x56084750d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:36.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.870+0000 7f33e7fff640 1 --2- 172.21.15.2:0/3303452143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56084750bdc0 0x56084750d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:36.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.870+0000 7f33e7fff640 1 -- 172.21.15.2:0/3303452143 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608475142a0 con 0x56084750b4a0 2024-09-19T04:53:36.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.870+0000 7f33ec9cd640 1 --2- 172.21.15.2:0/3303452143 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560847516680 0x56084752af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:53:36.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.870+0000 7f33e77fe640 1 --2- 172.21.15.2:0/3303452143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56084750bdc0 0x56084750d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:53:36.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.870+0000 7f33e7fff640 1 --2- 172.21.15.2:0/3303452143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56084750b4a0 0x56084750e090 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f33d8033000 tx=0x7f33d8009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1836678656b41ade server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:53:36.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.870+0000 7f33cdffb640 1 -- 172.21.15.2:0/3303452143 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d8035040 con 0x56084750b4a0 2024-09-19T04:53:36.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.870+0000 7f33cdffb640 1 -- 172.21.15.2:0/3303452143 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f33d8005040 con 0x56084750b4a0 2024-09-19T04:53:36.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.870+0000 7f33cdffb640 1 -- 172.21.15.2:0/3303452143 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d8004c80 con 0x56084750b4a0 2024-09-19T04:53:36.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.871+0000 7f33f0809740 1 -- 172.21.15.2:0/3303452143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56084750b4a0 msgr2=0x56084750e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:36.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.871+0000 7f33f0809740 1 --2- 172.21.15.2:0/3303452143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56084750b4a0 0x56084750e090 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f33d8033000 tx=0x7f33d8009680 comp rx=0 tx=0).stop 2024-09-19T04:53:36.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.871+0000 7f33f0809740 1 -- 172.21.15.2:0/3303452143 shutdown_connections 2024-09-19T04:53:36.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.871+0000 7f33f0809740 1 --2- 172.21.15.2:0/3303452143 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560847516680 0x56084752af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:36.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.871+0000 7f33f0809740 1 --2- 172.21.15.2:0/3303452143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56084750bdc0 0x56084750d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:36.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.871+0000 7f33f0809740 1 --2- 172.21.15.2:0/3303452143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56084750b4a0 0x56084750e090 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:36.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.871+0000 7f33f0809740 1 -- 172.21.15.2:0/3303452143 >> 172.21.15.2:0/3303452143 conn(0x560847507a30 msgr2=0x56084750cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:53:36.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.871+0000 7f33f0809740 1 -- 172.21.15.2:0/3303452143 shutdown_connections 2024-09-19T04:53:36.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.871+0000 7f33f0809740 1 -- 172.21.15.2:0/3303452143 wait complete. 2024-09-19T04:53:36.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.871+0000 7f33f0809740 1 -- start start 2024-09-19T04:53:36.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.872+0000 7f33f0809740 1 Processor -- start 2024-09-19T04:53:36.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.872+0000 7f33f0809740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56084750b4a0 0x56084752b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:36.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.872+0000 7f33f0809740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56084750bdc0 0x560847528780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:36.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.872+0000 7f33f0809740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560847516680 0x560847528cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:36.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.872+0000 7f33f0809740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f33e81ac540 con 0x560847516680 2024-09-19T04:53:36.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.872+0000 7f33f0809740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f33e81ad9b0 con 0x56084750bdc0 2024-09-19T04:53:36.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.872+0000 7f33f0809740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f33e81acc10 con 0x56084750b4a0 2024-09-19T04:53:36.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.872+0000 7f33f0809740 10 client.0 _ll_register_callbacks cb 0x7f33e0009f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:53:36.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.872+0000 7f33ec9cd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560847516680 0x560847528cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:36.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.872+0000 7f33ec9cd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560847516680 0x560847528cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58282/0 (socket says 172.21.15.2:58282) 2024-09-19T04:53:36.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.872+0000 7f33ec9cd640 1 -- 172.21.15.2:0/620436961 learned_addr learned my addr 172.21.15.2:0/620436961 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:53:36.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.872+0000 7f33e77fe640 1 --2- 172.21.15.2:0/620436961 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56084750bdc0 0x560847528780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:36.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.872+0000 7f33e7fff640 1 --2- 172.21.15.2:0/620436961 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56084750b4a0 0x56084752b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:36.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.872+0000 7f33ec9cd640 1 -- 172.21.15.2:0/620436961 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56084750b4a0 msgr2=0x56084752b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:36.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.872+0000 7f33ec9cd640 1 --2- 172.21.15.2:0/620436961 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56084750b4a0 0x56084752b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:36.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.872+0000 7f33ec9cd640 1 -- 172.21.15.2:0/620436961 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56084750bdc0 msgr2=0x560847528780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:36.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.872+0000 7f33ec9cd640 1 --2- 172.21.15.2:0/620436961 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56084750bdc0 0x560847528780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:36.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.872+0000 7f33ec9cd640 1 -- 172.21.15.2:0/620436961 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560847529200 con 0x560847516680 2024-09-19T04:53:36.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.872+0000 7f33e77fe640 1 --2- 172.21.15.2:0/620436961 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56084750bdc0 0x560847528780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:53:36.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.873+0000 7f33ec9cd640 1 --2- 172.21.15.2:0/620436961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560847516680 0x560847528cc0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f33e0012fe0 tx=0x7f33e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b101c14d906f4ba8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:53:36.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.873+0000 7f33c77fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:53:36.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.873+0000 7f33c77fe640 1 -- 172.21.15.2:0/620436961 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e0011b40 con 0x560847516680 2024-09-19T04:53:36.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.873+0000 7f33c77fe640 1 -- 172.21.15.2:0/620436961 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f33e0011ce0 con 0x560847516680 2024-09-19T04:53:36.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.873+0000 7f33f0809740 1 -- 172.21.15.2:0/620436961 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33d8005040 con 0x560847516680 2024-09-19T04:53:36.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.873+0000 7f33c77fe640 1 -- 172.21.15.2:0/620436961 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f33e0004b20 con 0x560847516680 2024-09-19T04:53:36.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.873+0000 7f33f0809740 10 client.16026 fetch_fsmap learned FSMap version 19 2024-09-19T04:53:36.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.873+0000 7f33f0809740 1 -- 172.21.15.2:0/620436961 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5608475905c0 con 0x560847516680 2024-09-19T04:53:36.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.873+0000 7f33c77fe640 1 -- 172.21.15.2:0/620436961 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f33e0025070 con 0x560847516680 2024-09-19T04:53:36.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.873+0000 7f33c77fe640 1 -- 172.21.15.2:0/620436961 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f33e000f040 con 0x560847516680 2024-09-19T04:53:36.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.873+0000 7f33f0809740 10 client.16026 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:53:36.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.873+0000 7f33f0809740 10 client.16026 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:53:36.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.873+0000 7f33f0809740 20 client.16026 populate_metadata read hostname 'smithi002' 2024-09-19T04:53:36.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.873+0000 7f33f0809740 1 --2- 172.21.15.2:0/620436961 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560847590cf0 0x560847593110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:36.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.873+0000 7f33f0809740 4 client.16026 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:53:36.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.873+0000 7f33f0809740 1 -- 172.21.15.2:0/620436961 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f33d8005040 con 0x560847590cf0 2024-09-19T04:53:36.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.874+0000 7f33e7fff640 1 --2- 172.21.15.2:0/620436961 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560847590cf0 0x560847593110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:36.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.874+0000 7f33c77fe640 10 client.16026 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:53:36.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.874+0000 7f33e7fff640 1 --2- 172.21.15.2:0/620436961 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560847590cf0 0x560847593110 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8779018a14c66665 server_cookie=64fb04ea2414d977 in_seq=0 out_seq=0 2024-09-19T04:53:36.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.874+0000 7f33c77fe640 1 -- 172.21.15.2:0/620436961 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f33d8005040 con 0x560847590cf0 2024-09-19T04:53:36.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.874+0000 7f33c77fe640 10 client.16026 handle_command_reply: tid=0 2024-09-19T04:53:36.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.874+0000 7f33f0809740 1 client.16026 shutdown 2024-09-19T04:53:36.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.875+0000 7f33f0809740 1 -- 172.21.15.2:0/620436961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560847516680 msgr2=0x560847528cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:36.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.875+0000 7f33f0809740 1 --2- 172.21.15.2:0/620436961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560847516680 0x560847528cc0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f33e0012fe0 tx=0x7f33e0004a40 comp rx=0 tx=0).stop 2024-09-19T04:53:36.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.875+0000 7f33f0809740 1 -- 172.21.15.2:0/620436961 shutdown_connections 2024-09-19T04:53:36.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.875+0000 7f33f0809740 1 --2- 172.21.15.2:0/620436961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560847516680 0x560847528cc0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:36.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.875+0000 7f33f0809740 1 --2- 172.21.15.2:0/620436961 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56084750bdc0 0x560847528780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:36.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.875+0000 7f33f0809740 1 --2- 172.21.15.2:0/620436961 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560847590cf0 0x560847593110 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:36.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.875+0000 7f33f0809740 1 --2- 172.21.15.2:0/620436961 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56084750b4a0 0x56084752b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:36.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.875+0000 7f33f0809740 1 -- 172.21.15.2:0/620436961 >> 172.21.15.2:0/620436961 conn(0x560847507a30 msgr2=0x5608475152e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:53:36.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.875+0000 7f33c77fe640 0 client.16026 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:53:36.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.875+0000 7f33f0809740 1 -- 172.21.15.2:0/620436961 shutdown_connections 2024-09-19T04:53:36.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.875+0000 7f33f0809740 1 -- 172.21.15.2:0/620436961 wait complete. 2024-09-19T04:53:36.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.875+0000 7f33f0809740 20 client.16026 trim_cache size 0 max 16384 2024-09-19T04:53:36.882 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:53:36.882 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T04:53:36.882 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T04:53:36.882 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:53:36.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.875+0000 7f33ee430640 1 -- 172.21.15.2:0/144858684 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f33d00a33b0 msgr2=0x7f33d00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:36.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.875+0000 7f33ee430640 1 --2- 172.21.15.2:0/144858684 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f33d00a33b0 0x7f33d00a5870 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f33e0009fd0 tx=0x7f33e0009600 comp rx=0 tx=0).stop 2024-09-19T04:53:36.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.875+0000 7f33ee430640 1 -- 172.21.15.2:0/144858684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33e8102790 msgr2=0x7f33e8198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:36.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.875+0000 7f33ee430640 1 --2- 172.21.15.2:0/144858684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33e8102790 0x7f33e8198930 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f33dc00b4a0 tx=0x7f33dc00b960 comp rx=0 tx=0).stop 2024-09-19T04:53:36.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.875+0000 7f33ee430640 1 -- 172.21.15.2:0/144858684 shutdown_connections 2024-09-19T04:53:36.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.875+0000 7f33ee430640 1 --2- 172.21.15.2:0/144858684 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33e8106f10 0x7f33e819ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:36.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.875+0000 7f33ee430640 1 --2- 172.21.15.2:0/144858684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33e8102790 0x7f33e8198930 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:36.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.875+0000 7f33ee430640 1 --2- 172.21.15.2:0/144858684 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f33d00a33b0 0x7f33d00a5870 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:36.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.875+0000 7f33ee430640 1 --2- 172.21.15.2:0/144858684 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f33e8101de0 0x7f33e81983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:36.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.875+0000 7f33ee430640 1 -- 172.21.15.2:0/144858684 >> 172.21.15.2:0/144858684 conn(0x7f33e80fd8c0 msgr2=0x7f33e80fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:53:36.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.876+0000 7f33ee430640 1 -- 172.21.15.2:0/144858684 shutdown_connections 2024-09-19T04:53:36.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:36.876+0000 7f33ee430640 1 -- 172.21.15.2:0/144858684 wait complete. 2024-09-19T04:53:37.557 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:53:37.557 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:53:37.813 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:53:38.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.262+0000 7fe3acc14640 1 -- 172.21.15.2:0/704181383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3a8102d40 msgr2=0x7fe3a8103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:38.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.262+0000 7fe3acc14640 1 --2- 172.21.15.2:0/704181383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3a8102d40 0x7fe3a8103120 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fe398009900 tx=0x7fe39802a480 comp rx=0 tx=0).stop 2024-09-19T04:53:38.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.262+0000 7fe3acc14640 1 -- 172.21.15.2:0/704181383 shutdown_connections 2024-09-19T04:53:38.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.262+0000 7fe3acc14640 1 --2- 172.21.15.2:0/704181383 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe3a810c170 0x7fe3a810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:38.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.262+0000 7fe3acc14640 1 --2- 172.21.15.2:0/704181383 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3a8103660 0x7fe3a810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:38.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.262+0000 7fe3acc14640 1 --2- 172.21.15.2:0/704181383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3a8102d40 0x7fe3a8103120 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:38.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.262+0000 7fe3acc14640 1 -- 172.21.15.2:0/704181383 >> 172.21.15.2:0/704181383 conn(0x7fe3a80fc7a0 msgr2=0x7fe3a80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:53:38.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.262+0000 7fe3acc14640 1 -- 172.21.15.2:0/704181383 shutdown_connections 2024-09-19T04:53:38.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.262+0000 7fe3acc14640 1 -- 172.21.15.2:0/704181383 wait complete. 2024-09-19T04:53:38.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.263+0000 7fe3acc14640 1 Processor -- start 2024-09-19T04:53:38.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.263+0000 7fe3acc14640 1 -- start start 2024-09-19T04:53:38.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.263+0000 7fe3acc14640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3a8102d40 0x7fe3a81009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:38.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.263+0000 7fe3acc14640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3a8103660 0x7fe3a8100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:38.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.263+0000 7fe3acc14640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe3a810c170 0x7fe3a8101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:38.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.263+0000 7fe3acc14640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a8111ee0 con 0x7fe3a8102d40 2024-09-19T04:53:38.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.263+0000 7fe3acc14640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a8111d60 con 0x7fe3a8103660 2024-09-19T04:53:38.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.263+0000 7fe3acc14640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a8112060 con 0x7fe3a810c170 2024-09-19T04:53:38.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.263+0000 7fe3a659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3a8102d40 0x7fe3a81009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:38.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.263+0000 7fe3a659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3a8102d40 0x7fe3a81009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58288/0 (socket says 172.21.15.2:58288) 2024-09-19T04:53:38.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.263+0000 7fe3a659c640 1 -- 172.21.15.2:0/4214629742 learned_addr learned my addr 172.21.15.2:0/4214629742 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:53:38.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.264+0000 7fe3a5d9b640 1 --2- 172.21.15.2:0/4214629742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3a8103660 0x7fe3a8100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:38.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.264+0000 7fe3a6d9d640 1 --2- 172.21.15.2:0/4214629742 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe3a810c170 0x7fe3a8101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:38.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.264+0000 7fe3a659c640 1 -- 172.21.15.2:0/4214629742 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe3a810c170 msgr2=0x7fe3a8101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:38.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.264+0000 7fe3a659c640 1 --2- 172.21.15.2:0/4214629742 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe3a810c170 0x7fe3a8101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:38.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.264+0000 7fe3a659c640 1 -- 172.21.15.2:0/4214629742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3a8103660 msgr2=0x7fe3a8100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:38.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.264+0000 7fe3a659c640 1 --2- 172.21.15.2:0/4214629742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3a8103660 0x7fe3a8100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:38.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.264+0000 7fe3a659c640 1 -- 172.21.15.2:0/4214629742 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3a81a69c0 con 0x7fe3a8102d40 2024-09-19T04:53:38.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.264+0000 7fe3a5d9b640 1 --2- 172.21.15.2:0/4214629742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3a8103660 0x7fe3a8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:53:38.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.264+0000 7fe3a659c640 1 --2- 172.21.15.2:0/4214629742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3a8102d40 0x7fe3a81009a0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fe398006010 tx=0x7fe398004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:53:38.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.264+0000 7fe3977fe640 1 -- 172.21.15.2:0/4214629742 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39803f030 con 0x7fe3a8102d40 2024-09-19T04:53:38.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.264+0000 7fe3acc14640 1 -- 172.21.15.2:0/4214629742 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3a81a6c50 con 0x7fe3a8102d40 2024-09-19T04:53:38.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.264+0000 7fe3977fe640 1 -- 172.21.15.2:0/4214629742 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe3980035f0 con 0x7fe3a8102d40 2024-09-19T04:53:38.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.264+0000 7fe3977fe640 1 -- 172.21.15.2:0/4214629742 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe398035070 con 0x7fe3a8102d40 2024-09-19T04:53:38.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.264+0000 7fe3acc14640 1 -- 172.21.15.2:0/4214629742 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3a81a7130 con 0x7fe3a8102d40 2024-09-19T04:53:38.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.265+0000 7fe3acc14640 1 -- 172.21.15.2:0/4214629742 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3a81031a0 con 0x7fe3a8102d40 2024-09-19T04:53:38.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.267+0000 7fe3977fe640 1 -- 172.21.15.2:0/4214629742 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fe398003b10 con 0x7fe3a8102d40 2024-09-19T04:53:38.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.267+0000 7fe3977fe640 1 --2- 172.21.15.2:0/4214629742 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fe3900a33b0 0x7fe3900a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:38.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.267+0000 7fe3977fe640 1 -- 172.21.15.2:0/4214629742 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7fe3980f0ba0 con 0x7fe3a8102d40 2024-09-19T04:53:38.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.267+0000 7fe3a5d9b640 1 --2- 172.21.15.2:0/4214629742 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fe3900a33b0 0x7fe3900a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:38.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.268+0000 7fe3a5d9b640 1 --2- 172.21.15.2:0/4214629742 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fe3900a33b0 0x7fe3900a5870 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe3a8102430 tx=0x7fe39c008040 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:53:38.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.270+0000 7fe3977fe640 1 -- 172.21.15.2:0/4214629742 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe3980bd540 con 0x7fe3a8102d40 2024-09-19T04:53:38.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.483+0000 7fe3acc14640 1 -- 172.21.15.2:0/4214629742 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe3a8101ed0 con 0x7fe3a8102d40 2024-09-19T04:53:38.485 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:53:38 smithi002 ceph-mon[30975]: pgmap v172: 97 pgs: 97 active+clean; 7.3 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 29 KiB/s wr, 7 op/s 2024-09-19T04:53:38.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.484+0000 7fe3977fe640 1 -- 172.21.15.2:0/4214629742 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11840 (secure 0 0 0) 0x7fe3a8101ed0 con 0x7fe3a8102d40 2024-09-19T04:53:38.486 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:53:38.486 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":19,"btime":"2024-09-19T04:46:33:537239+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2467365137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2467365137},{"type":"v1","addr":"172.21.15.2:6835","nonce":2467365137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3162441888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3162441888},{"type":"v1","addr":"172.21.15.2:6837","nonce":3162441888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14631,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2740862966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2740862966},{"type":"v1","addr":"172.21.15.2:6839","nonce":2740862966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/2394435504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2394435504},{"type":"v1","addr":"172.21.15.2:6841","nonce":2394435504}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1630480244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1630480244},{"type":"v1","addr":"172.21.15.18:6833","nonce":1630480244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1553897465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1553897465},{"type":"v1","addr":"172.21.15.116:6833","nonce":1553897465}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3035664608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3035664608},{"type":"v1","addr":"172.21.15.18:6835","nonce":3035664608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1096622392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1096622392},{"type":"v1","addr":"172.21.15.18:6837","nonce":1096622392}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3761157675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3761157675},{"type":"v1","addr":"172.21.15.116:6835","nonce":3761157675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/1120131594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1120131594},{"type":"v1","addr":"172.21.15.116:6837","nonce":1120131594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:46:24.050115+0000","modified":"2024-09-19T04:46:33.112369+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/4207677139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":4207677139},{"type":"v1","addr":"172.21.15.18:6839","nonce":4207677139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/2346874880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":2346874880},{"type":"v1","addr":"172.21.15.116:6839","nonce":2346874880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496]},"id":1}]} 2024-09-19T04:53:38.486 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 19 2024-09-19T04:53:38.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.487+0000 7fe3acc14640 1 -- 172.21.15.2:0/4214629742 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fe3900a33b0 msgr2=0x7fe3900a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:38.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.487+0000 7fe3acc14640 1 --2- 172.21.15.2:0/4214629742 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fe3900a33b0 0x7fe3900a5870 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe3a8102430 tx=0x7fe39c008040 comp rx=0 tx=0).stop 2024-09-19T04:53:38.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.487+0000 7fe3acc14640 1 -- 172.21.15.2:0/4214629742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3a8102d40 msgr2=0x7fe3a81009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:38.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.487+0000 7fe3acc14640 1 --2- 172.21.15.2:0/4214629742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3a8102d40 0x7fe3a81009a0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fe398006010 tx=0x7fe398004270 comp rx=0 tx=0).stop 2024-09-19T04:53:38.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.487+0000 7fe3acc14640 1 -- 172.21.15.2:0/4214629742 shutdown_connections 2024-09-19T04:53:38.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.487+0000 7fe3acc14640 1 --2- 172.21.15.2:0/4214629742 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fe3900a33b0 0x7fe3900a5870 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:38.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.487+0000 7fe3acc14640 1 --2- 172.21.15.2:0/4214629742 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe3a810c170 0x7fe3a8101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:38.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.487+0000 7fe3acc14640 1 --2- 172.21.15.2:0/4214629742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3a8103660 0x7fe3a8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:38.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.487+0000 7fe3acc14640 1 --2- 172.21.15.2:0/4214629742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3a8102d40 0x7fe3a81009a0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:38.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.487+0000 7fe3acc14640 1 -- 172.21.15.2:0/4214629742 >> 172.21.15.2:0/4214629742 conn(0x7fe3a80fc7a0 msgr2=0x7fe3a80fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:53:38.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.487+0000 7fe3acc14640 1 -- 172.21.15.2:0/4214629742 shutdown_connections 2024-09-19T04:53:38.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:38.487+0000 7fe3acc14640 1 -- 172.21.15.2:0/4214629742 wait complete. 2024-09-19T04:53:38.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:53:38 smithi116 ceph-mon[34477]: pgmap v172: 97 pgs: 97 active+clean; 7.3 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 29 KiB/s wr, 7 op/s 2024-09-19T04:53:38.810 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:53:38 smithi018 ceph-mon[34537]: pgmap v172: 97 pgs: 97 active+clean; 7.3 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 29 KiB/s wr, 7 op/s 2024-09-19T04:53:39.195 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:53:39.458 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:53:39.570 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:53:39 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/4214629742' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:53:39.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:53:39 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/4214629742' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:53:39.806 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:53:39 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/4214629742' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:53:39.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.921+0000 7f4f59082640 1 -- 172.21.15.2:0/2729206390 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f54102d30 msgr2=0x7f4f54103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:39.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.921+0000 7f4f59082640 1 --2- 172.21.15.2:0/2729206390 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f54102d30 0x7f4f54103110 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f4f44009930 tx=0x7f4f4402a420 comp rx=0 tx=0).stop 2024-09-19T04:53:39.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.921+0000 7f4f59082640 1 -- 172.21.15.2:0/2729206390 shutdown_connections 2024-09-19T04:53:39.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.921+0000 7f4f59082640 1 --2- 172.21.15.2:0/2729206390 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4f541082a0 0x7f4f5410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:39.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.921+0000 7f4f59082640 1 --2- 172.21.15.2:0/2729206390 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f541036e0 0x7f4f54107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:39.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.921+0000 7f4f59082640 1 --2- 172.21.15.2:0/2729206390 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f54102d30 0x7f4f54103110 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:39.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.921+0000 7f4f59082640 1 -- 172.21.15.2:0/2729206390 >> 172.21.15.2:0/2729206390 conn(0x7f4f540fc7d0 msgr2=0x7f4f540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:53:39.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.922+0000 7f4f59082640 1 -- 172.21.15.2:0/2729206390 shutdown_connections 2024-09-19T04:53:39.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.922+0000 7f4f59082640 1 -- 172.21.15.2:0/2729206390 wait complete. 2024-09-19T04:53:39.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.922+0000 7f4f59082640 1 Processor -- start 2024-09-19T04:53:39.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.922+0000 7f4f59082640 1 -- start start 2024-09-19T04:53:39.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.923+0000 7f4f59082640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f54102d30 0x7f4f541984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:39.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.923+0000 7f4f59082640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4f541036e0 0x7f4f54198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:39.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.923+0000 7f4f59082640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f541082a0 0x7f4f5419cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:39.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.923+0000 7f4f59082640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4f54111f50 con 0x7f4f54102d30 2024-09-19T04:53:39.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.923+0000 7f4f59082640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4f54111dd0 con 0x7f4f541082a0 2024-09-19T04:53:39.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.923+0000 7f4f59082640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f4f541120d0 con 0x7f4f541036e0 2024-09-19T04:53:39.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.923+0000 7f4f52d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f54102d30 0x7f4f541984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:39.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.923+0000 7f4f52d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f54102d30 0x7f4f541984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58300/0 (socket says 172.21.15.2:58300) 2024-09-19T04:53:39.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.923+0000 7f4f52d9d640 1 -- 172.21.15.2:0/159384093 learned_addr learned my addr 172.21.15.2:0/159384093 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:53:39.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.923+0000 7f4f5259c640 1 --2- 172.21.15.2:0/159384093 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4f541036e0 0x7f4f54198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:39.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.923+0000 7f4f5359e640 1 --2- 172.21.15.2:0/159384093 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f541082a0 0x7f4f5419cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:39.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.923+0000 7f4f52d9d640 1 -- 172.21.15.2:0/159384093 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4f541036e0 msgr2=0x7f4f54198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:39.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.923+0000 7f4f52d9d640 1 --2- 172.21.15.2:0/159384093 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4f541036e0 0x7f4f54198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:39.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.923+0000 7f4f52d9d640 1 -- 172.21.15.2:0/159384093 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f541082a0 msgr2=0x7f4f5419cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:39.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.923+0000 7f4f52d9d640 1 --2- 172.21.15.2:0/159384093 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f541082a0 0x7f4f5419cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:39.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.923+0000 7f4f52d9d640 1 -- 172.21.15.2:0/159384093 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f5419d4a0 con 0x7f4f54102d30 2024-09-19T04:53:39.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.923+0000 7f4f5259c640 1 --2- 172.21.15.2:0/159384093 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4f541036e0 0x7f4f54198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:53:39.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.924+0000 7f4f52d9d640 1 --2- 172.21.15.2:0/159384093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f54102d30 0x7f4f541984f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f4f44004770 tx=0x7f4f440042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:53:39.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.924+0000 7f4f3bfff640 1 -- 172.21.15.2:0/159384093 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4403f070 con 0x7f4f54102d30 2024-09-19T04:53:39.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.924+0000 7f4f3bfff640 1 -- 172.21.15.2:0/159384093 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4f4403b460 con 0x7f4f54102d30 2024-09-19T04:53:39.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.924+0000 7f4f59082640 1 -- 172.21.15.2:0/159384093 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f5419d730 con 0x7f4f54102d30 2024-09-19T04:53:39.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.924+0000 7f4f3bfff640 1 -- 172.21.15.2:0/159384093 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f44035070 con 0x7f4f54102d30 2024-09-19T04:53:39.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.924+0000 7f4f59082640 1 -- 172.21.15.2:0/159384093 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f541a5070 con 0x7f4f54102d30 2024-09-19T04:53:39.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.926+0000 7f4f5b45b740 1 Processor -- start 2024-09-19T04:53:39.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.926+0000 7f4f5b45b740 1 -- start start 2024-09-19T04:53:39.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.926+0000 7f4f3bfff640 1 -- 172.21.15.2:0/159384093 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f4f4403a620 con 0x7f4f54102d30 2024-09-19T04:53:39.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.927+0000 7f4f5b45b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1c1b57b40 0x55e1c1b56090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:39.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.927+0000 7f4f5b45b740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e1c1b565d0 0x55e1c1b56a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:39.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.927+0000 7f4f5b45b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e1c1b61370 0x55e1c1b63760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:39.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.927+0000 7f4f5b45b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e1c1abc2f0 con 0x55e1c1b57b40 2024-09-19T04:53:39.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.927+0000 7f4f5b45b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e1c1a63cf0 con 0x55e1c1b61370 2024-09-19T04:53:39.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.927+0000 7f4f5b45b740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55e1c1ab82b0 con 0x55e1c1b565d0 2024-09-19T04:53:39.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.927+0000 7f4f5359e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1c1b57b40 0x55e1c1b56090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:39.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.927+0000 7f4f5359e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1c1b57b40 0x55e1c1b56090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58304/0 (socket says 172.21.15.2:58304) 2024-09-19T04:53:39.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.927+0000 7f4f5359e640 1 -- 172.21.15.2:0/3769115202 learned_addr learned my addr 172.21.15.2:0/3769115202 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:53:39.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.927+0000 7f4f52d9d640 1 --2- 172.21.15.2:0/3769115202 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e1c1b565d0 0x55e1c1b56a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:39.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.927+0000 7f4f5259c640 1 --2- 172.21.15.2:0/3769115202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e1c1b61370 0x55e1c1b63760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:39.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.927+0000 7f4f5359e640 1 -- 172.21.15.2:0/3769115202 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e1c1b565d0 msgr2=0x55e1c1b56a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:39.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.927+0000 7f4f5359e640 1 --2- 172.21.15.2:0/3769115202 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e1c1b565d0 0x55e1c1b56a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:39.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.927+0000 7f4f5359e640 1 -- 172.21.15.2:0/3769115202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e1c1b61370 msgr2=0x55e1c1b63760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:39.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.927+0000 7f4f5359e640 1 --2- 172.21.15.2:0/3769115202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e1c1b61370 0x55e1c1b63760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:39.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.927+0000 7f4f5359e640 1 -- 172.21.15.2:0/3769115202 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1c1a483a0 con 0x55e1c1b57b40 2024-09-19T04:53:39.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.927+0000 7f4f3bfff640 1 --2- 172.21.15.2:0/159384093 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f4f3c0a33b0 0x7f4f3c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:39.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.927+0000 7f4f52d9d640 1 --2- 172.21.15.2:0/159384093 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f4f3c0a33b0 0x7f4f3c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:39.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.928+0000 7f4f5359e640 1 --2- 172.21.15.2:0/3769115202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1c1b57b40 0x55e1c1b56090 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c009e60 tx=0x7f4f4c010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=221125641f17a126 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:53:39.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.928+0000 7f4f3bfff640 1 -- 172.21.15.2:0/159384093 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f4f440f0130 con 0x7f4f54102d30 2024-09-19T04:53:39.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.928+0000 7f4f397fa640 1 -- 172.21.15.2:0/3769115202 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c016070 con 0x55e1c1b57b40 2024-09-19T04:53:39.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.928+0000 7f4f397fa640 1 -- 172.21.15.2:0/3769115202 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4f4c004d20 con 0x55e1c1b57b40 2024-09-19T04:53:39.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.928+0000 7f4f397fa640 1 -- 172.21.15.2:0/3769115202 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c0126e0 con 0x55e1c1b57b40 2024-09-19T04:53:39.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.928+0000 7f4f5b45b740 1 -- 172.21.15.2:0/3769115202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1c1b57b40 msgr2=0x55e1c1b56090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:39.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.928+0000 7f4f52d9d640 1 --2- 172.21.15.2:0/159384093 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f4f3c0a33b0 0x7f4f3c0a5870 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4f440ed950 tx=0x7f4f440f3c80 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:53:39.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.928+0000 7f4f5b45b740 1 --2- 172.21.15.2:0/3769115202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1c1b57b40 0x55e1c1b56090 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c009e60 tx=0x7f4f4c010740 comp rx=0 tx=0).stop 2024-09-19T04:53:39.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.929+0000 7f4f5b45b740 1 -- 172.21.15.2:0/3769115202 shutdown_connections 2024-09-19T04:53:39.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.929+0000 7f4f5b45b740 1 --2- 172.21.15.2:0/3769115202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e1c1b61370 0x55e1c1b63760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:39.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.929+0000 7f4f5b45b740 1 --2- 172.21.15.2:0/3769115202 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e1c1b565d0 0x55e1c1b56a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:39.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.929+0000 7f4f5b45b740 1 --2- 172.21.15.2:0/3769115202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1c1b57b40 0x55e1c1b56090 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:39.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.929+0000 7f4f5b45b740 1 -- 172.21.15.2:0/3769115202 >> 172.21.15.2:0/3769115202 conn(0x55e1c1b1f310 msgr2=0x55e1c1b52c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:53:39.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.929+0000 7f4f5b45b740 1 -- 172.21.15.2:0/3769115202 shutdown_connections 2024-09-19T04:53:39.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.929+0000 7f4f5b45b740 1 -- 172.21.15.2:0/3769115202 wait complete. 2024-09-19T04:53:39.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.929+0000 7f4f5b45b740 1 -- start start 2024-09-19T04:53:39.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.929+0000 7f4f5b45b740 1 Processor -- start 2024-09-19T04:53:39.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.929+0000 7f4f5b45b740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e1c1b565d0 0x55e1c1b60cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:39.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.929+0000 7f4f5b45b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1c1b57b40 0x55e1c1b5dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:39.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.929+0000 7f4f5b45b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e1c1b61370 0x55e1c1b5e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:39.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.929+0000 7f4f5b45b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e1c1b68480 con 0x55e1c1b57b40 2024-09-19T04:53:39.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.929+0000 7f4f5b45b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e1c1a77060 con 0x55e1c1b61370 2024-09-19T04:53:39.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.929+0000 7f4f5b45b740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55e1c1b68600 con 0x55e1c1b565d0 2024-09-19T04:53:39.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.929+0000 7f4f5b45b740 10 client.0 _ll_register_callbacks cb 0x55e1c17ca8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:53:39.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.929+0000 7f4f5259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1c1b57b40 0x55e1c1b5dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:39.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.929+0000 7f4f5259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1c1b57b40 0x55e1c1b5dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58314/0 (socket says 172.21.15.2:58314) 2024-09-19T04:53:39.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.929+0000 7f4f5259c640 1 -- 172.21.15.2:0/613641739 learned_addr learned my addr 172.21.15.2:0/613641739 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:53:39.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.929+0000 7f4f5359e640 1 --2- 172.21.15.2:0/613641739 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e1c1b565d0 0x55e1c1b60cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:39.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.930+0000 7f4f5359e640 1 --2- 172.21.15.2:0/613641739 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e1c1b61370 0x55e1c1b5e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:39.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.930+0000 7f4f5259c640 1 -- 172.21.15.2:0/613641739 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e1c1b565d0 msgr2=0x55e1c1b60cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:39.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.930+0000 7f4f5259c640 1 --2- 172.21.15.2:0/613641739 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e1c1b565d0 0x55e1c1b60cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:39.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.930+0000 7f4f5259c640 1 -- 172.21.15.2:0/613641739 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e1c1b61370 msgr2=0x55e1c1b5e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:39.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.930+0000 7f4f5259c640 1 --2- 172.21.15.2:0/613641739 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e1c1b61370 0x55e1c1b5e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:39.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.930+0000 7f4f5259c640 1 -- 172.21.15.2:0/613641739 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1c182d3c0 con 0x55e1c1b57b40 2024-09-19T04:53:39.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.930+0000 7f4f5359e640 1 --2- 172.21.15.2:0/613641739 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e1c1b61370 0x55e1c1b5e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:53:39.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.930+0000 7f4f5259c640 1 --2- 172.21.15.2:0/613641739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1c1b57b40 0x55e1c1b5dff0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f4f4800cfd0 tx=0x7f4f48011c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a21c3182c97ecab2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:53:39.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.930+0000 7f4f36ff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:53:39.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.930+0000 7f4f36ff5640 1 -- 172.21.15.2:0/613641739 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4800fe70 con 0x55e1c1b57b40 2024-09-19T04:53:39.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.930+0000 7f4f36ff5640 1 -- 172.21.15.2:0/613641739 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f4f48004020 con 0x55e1c1b57b40 2024-09-19T04:53:39.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.930+0000 7f4f5b45b740 1 -- 172.21.15.2:0/613641739 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f4c004d20 con 0x55e1c1b57b40 2024-09-19T04:53:39.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.930+0000 7f4f36ff5640 1 -- 172.21.15.2:0/613641739 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4f48004220 con 0x55e1c1b57b40 2024-09-19T04:53:39.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.930+0000 7f4f5b45b740 10 client.16044 fetch_fsmap learned FSMap version 19 2024-09-19T04:53:39.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.930+0000 7f4f5b45b740 1 -- 172.21.15.2:0/613641739 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55e1c1b73f50 con 0x55e1c1b57b40 2024-09-19T04:53:39.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.931+0000 7f4f36ff5640 1 -- 172.21.15.2:0/613641739 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4f4c004d20 con 0x55e1c1b57b40 2024-09-19T04:53:39.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.931+0000 7f4f36ff5640 1 -- 172.21.15.2:0/613641739 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f4f48018030 con 0x55e1c1b57b40 2024-09-19T04:53:39.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.931+0000 7f4f5b45b740 10 client.16044 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:53:39.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.931+0000 7f4f5b45b740 10 client.16044 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:53:39.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.931+0000 7f4f5b45b740 20 client.16044 populate_metadata read hostname 'smithi002' 2024-09-19T04:53:39.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.931+0000 7f4f5b45b740 1 --2- 172.21.15.2:0/613641739 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55e1c1b754b0 0x55e1c1b778d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:39.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.931+0000 7f4f5b45b740 4 client.16044 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:53:39.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.931+0000 7f4f5b45b740 1 -- 172.21.15.2:0/613641739 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e1c1ac9860 con 0x55e1c1b754b0 2024-09-19T04:53:39.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.931+0000 7f4f5359e640 1 --2- 172.21.15.2:0/613641739 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55e1c1b754b0 0x55e1c1b778d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:39.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.932+0000 7f4f5359e640 1 --2- 172.21.15.2:0/613641739 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55e1c1b754b0 0x55e1c1b778d0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab10cc190b4e86e3 server_cookie=8172bd63a216f996 in_seq=0 out_seq=0 2024-09-19T04:53:39.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.932+0000 7f4f36ff5640 10 client.16044 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:53:39.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.932+0000 7f4f36ff5640 1 -- 172.21.15.2:0/613641739 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e1c1ac9860 con 0x55e1c1b754b0 2024-09-19T04:53:39.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.932+0000 7f4f36ff5640 10 client.16044 handle_command_reply: tid=0 2024-09-19T04:53:39.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.932+0000 7f4f5b45b740 1 client.16044 shutdown 2024-09-19T04:53:39.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.932+0000 7f4f5b45b740 1 -- 172.21.15.2:0/613641739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1c1b57b40 msgr2=0x55e1c1b5dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:39.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.932+0000 7f4f5b45b740 1 --2- 172.21.15.2:0/613641739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1c1b57b40 0x55e1c1b5dff0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f4f4800cfd0 tx=0x7f4f48011c90 comp rx=0 tx=0).stop 2024-09-19T04:53:39.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.932+0000 7f4f5b45b740 1 -- 172.21.15.2:0/613641739 shutdown_connections 2024-09-19T04:53:39.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.932+0000 7f4f5b45b740 1 --2- 172.21.15.2:0/613641739 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e1c1b61370 0x55e1c1b5e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:39.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.932+0000 7f4f5b45b740 1 --2- 172.21.15.2:0/613641739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1c1b57b40 0x55e1c1b5dff0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:39.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.932+0000 7f4f5b45b740 1 --2- 172.21.15.2:0/613641739 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55e1c1b754b0 0x55e1c1b778d0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:39.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.932+0000 7f4f5b45b740 1 --2- 172.21.15.2:0/613641739 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e1c1b565d0 0x55e1c1b60cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:39.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.932+0000 7f4f5b45b740 1 -- 172.21.15.2:0/613641739 >> 172.21.15.2:0/613641739 conn(0x55e1c1b1f310 msgr2=0x55e1c1b58960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:53:39.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.933+0000 7f4f36ff5640 0 client.16044 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:53:39.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.933+0000 7f4f5b45b740 1 -- 172.21.15.2:0/613641739 shutdown_connections 2024-09-19T04:53:39.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.933+0000 7f4f5b45b740 1 -- 172.21.15.2:0/613641739 wait complete. 2024-09-19T04:53:39.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.933+0000 7f4f5b45b740 20 client.16044 trim_cache size 0 max 16384 2024-09-19T04:53:39.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.946+0000 7f4f5b45b740 1 Processor -- start 2024-09-19T04:53:39.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.946+0000 7f4f5b45b740 1 -- start start 2024-09-19T04:53:39.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.946+0000 7f4f5b45b740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e1c1b565d0 0x55e1c1b71720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:39.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.946+0000 7f4f5b45b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1c1b57b40 0x55e1c1b7d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:39.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.946+0000 7f4f5b45b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e1c1b61370 0x55e1c1b7d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:39.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.946+0000 7f4f5b45b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4f541a95d0 con 0x55e1c1b57b40 2024-09-19T04:53:39.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.946+0000 7f4f5b45b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4f541abe50 con 0x55e1c1b61370 2024-09-19T04:53:39.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.946+0000 7f4f5b45b740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f4f541a9c40 con 0x55e1c1b565d0 2024-09-19T04:53:39.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.946+0000 7f4f5259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1c1b57b40 0x55e1c1b7d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:39.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.946+0000 7f4f5259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1c1b57b40 0x55e1c1b7d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58320/0 (socket says 172.21.15.2:58320) 2024-09-19T04:53:39.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.946+0000 7f4f5259c640 1 -- 172.21.15.2:0/855138400 learned_addr learned my addr 172.21.15.2:0/855138400 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:53:39.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.946+0000 7f4f5259c640 1 -- 172.21.15.2:0/855138400 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e1c1b565d0 msgr2=0x55e1c1b71720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:39.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.946+0000 7f4f5259c640 1 --2- 172.21.15.2:0/855138400 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e1c1b565d0 0x55e1c1b71720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:39.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.946+0000 7f4f5259c640 1 -- 172.21.15.2:0/855138400 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e1c1b61370 msgr2=0x55e1c1b7d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:39.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.946+0000 7f4f5259c640 1 --2- 172.21.15.2:0/855138400 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e1c1b61370 0x55e1c1b7d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:39.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.946+0000 7f4f5259c640 1 -- 172.21.15.2:0/855138400 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1c1b77f50 con 0x55e1c1b57b40 2024-09-19T04:53:39.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.946+0000 7f4f5259c640 1 --2- 172.21.15.2:0/855138400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1c1b57b40 0x55e1c1b7d1a0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f4f48004d00 tx=0x7f4f480058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ad9134ff7a23460 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:53:39.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.946+0000 7f4f38ff9640 1 -- 172.21.15.2:0/855138400 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f480035f0 con 0x55e1c1b57b40 2024-09-19T04:53:39.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.947+0000 7f4f38ff9640 1 -- 172.21.15.2:0/855138400 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4f4800fc70 con 0x55e1c1b57b40 2024-09-19T04:53:39.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.947+0000 7f4f38ff9640 1 -- 172.21.15.2:0/855138400 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f48003e70 con 0x55e1c1b57b40 2024-09-19T04:53:39.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.947+0000 7f4f5b45b740 1 -- 172.21.15.2:0/855138400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1c1b57b40 msgr2=0x55e1c1b7d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:39.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.947+0000 7f4f5b45b740 1 --2- 172.21.15.2:0/855138400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1c1b57b40 0x55e1c1b7d1a0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f4f48004d00 tx=0x7f4f480058a0 comp rx=0 tx=0).stop 2024-09-19T04:53:39.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.947+0000 7f4f5b45b740 1 -- 172.21.15.2:0/855138400 shutdown_connections 2024-09-19T04:53:39.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.947+0000 7f4f5b45b740 1 --2- 172.21.15.2:0/855138400 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e1c1b61370 0x55e1c1b7d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:39.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.947+0000 7f4f5b45b740 1 --2- 172.21.15.2:0/855138400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1c1b57b40 0x55e1c1b7d1a0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:39.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.947+0000 7f4f5b45b740 1 --2- 172.21.15.2:0/855138400 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e1c1b565d0 0x55e1c1b71720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:39.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.947+0000 7f4f5b45b740 1 -- 172.21.15.2:0/855138400 >> 172.21.15.2:0/855138400 conn(0x55e1c1b1f310 msgr2=0x55e1c1b5d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:53:39.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.947+0000 7f4f5b45b740 1 -- 172.21.15.2:0/855138400 shutdown_connections 2024-09-19T04:53:39.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.947+0000 7f4f5b45b740 1 -- 172.21.15.2:0/855138400 wait complete. 2024-09-19T04:53:39.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.947+0000 7f4f5b45b740 1 -- start start 2024-09-19T04:53:39.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.948+0000 7f4f5b45b740 1 Processor -- start 2024-09-19T04:53:39.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.948+0000 7f4f5b45b740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e1c1b565d0 0x55e1c1b6d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:39.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.948+0000 7f4f5b45b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1c1b57b40 0x55e1c1b6ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:39.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.948+0000 7f4f5b45b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e1c1b61370 0x55e1c1b6a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:39.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.948+0000 7f4f5b45b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4f541aa310 con 0x55e1c1b57b40 2024-09-19T04:53:39.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.948+0000 7f4f5b45b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4f541ab780 con 0x55e1c1b61370 2024-09-19T04:53:39.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.948+0000 7f4f5b45b740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f4f541aa9e0 con 0x55e1c1b565d0 2024-09-19T04:53:39.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.948+0000 7f4f5b45b740 10 client.0 _ll_register_callbacks cb 0x7f4f4800c830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:53:39.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.948+0000 7f4f5259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1c1b57b40 0x55e1c1b6ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:39.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.948+0000 7f4f5259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1c1b57b40 0x55e1c1b6ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58322/0 (socket says 172.21.15.2:58322) 2024-09-19T04:53:39.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.948+0000 7f4f5259c640 1 -- 172.21.15.2:0/2634296102 learned_addr learned my addr 172.21.15.2:0/2634296102 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:53:39.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.948+0000 7f4f5359e640 1 --2- 172.21.15.2:0/2634296102 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e1c1b565d0 0x55e1c1b6d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:39.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.948+0000 7f4f5259c640 1 -- 172.21.15.2:0/2634296102 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e1c1b565d0 msgr2=0x55e1c1b6d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:39.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.948+0000 7f4f5259c640 1 --2- 172.21.15.2:0/2634296102 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e1c1b565d0 0x55e1c1b6d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:39.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.948+0000 7f4f5359e640 1 --2- 172.21.15.2:0/2634296102 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e1c1b61370 0x55e1c1b6a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:39.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.948+0000 7f4f5259c640 1 -- 172.21.15.2:0/2634296102 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e1c1b61370 msgr2=0x55e1c1b6a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:39.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.948+0000 7f4f5259c640 1 --2- 172.21.15.2:0/2634296102 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e1c1b61370 0x55e1c1b6a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:39.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.948+0000 7f4f5259c640 1 -- 172.21.15.2:0/2634296102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1c1b6e4c0 con 0x55e1c1b57b40 2024-09-19T04:53:39.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.948+0000 7f4f5259c640 1 --2- 172.21.15.2:0/2634296102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1c1b57b40 0x55e1c1b6ddd0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f4f48005ad0 tx=0x7f4f48003a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f9a8809f64a3c06 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:53:39.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.948+0000 7f4f36ff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:53:39.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.949+0000 7f4f36ff5640 1 -- 172.21.15.2:0/2634296102 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f48036020 con 0x55e1c1b57b40 2024-09-19T04:53:39.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.949+0000 7f4f36ff5640 1 -- 172.21.15.2:0/2634296102 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f4f480035f0 con 0x55e1c1b57b40 2024-09-19T04:53:39.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.949+0000 7f4f5b45b740 1 -- 172.21.15.2:0/2634296102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f4800fc70 con 0x55e1c1b57b40 2024-09-19T04:53:39.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.949+0000 7f4f36ff5640 1 -- 172.21.15.2:0/2634296102 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4f48041050 con 0x55e1c1b57b40 2024-09-19T04:53:39.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.949+0000 7f4f5b45b740 10 client.16050 fetch_fsmap learned FSMap version 19 2024-09-19T04:53:39.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.949+0000 7f4f5b45b740 1 -- 172.21.15.2:0/2634296102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55e1c1be0780 con 0x55e1c1b57b40 2024-09-19T04:53:39.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.949+0000 7f4f36ff5640 1 -- 172.21.15.2:0/2634296102 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4f4800fc70 con 0x55e1c1b57b40 2024-09-19T04:53:39.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.949+0000 7f4f36ff5640 1 -- 172.21.15.2:0/2634296102 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f4f48018070 con 0x55e1c1b57b40 2024-09-19T04:53:39.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.949+0000 7f4f5b45b740 10 client.16050 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:53:39.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.949+0000 7f4f5b45b740 10 client.16050 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:53:39.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.949+0000 7f4f5b45b740 20 client.16050 populate_metadata read hostname 'smithi002' 2024-09-19T04:53:39.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.949+0000 7f4f5b45b740 1 --2- 172.21.15.2:0/2634296102 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55e1c1be0e00 0x55e1c1be3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:39.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.949+0000 7f4f5b45b740 4 client.16050 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:53:39.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.949+0000 7f4f5b45b740 1 -- 172.21.15.2:0/2634296102 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e1c1ac3d70 con 0x55e1c1be0e00 2024-09-19T04:53:39.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.949+0000 7f4f5359e640 1 --2- 172.21.15.2:0/2634296102 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55e1c1be0e00 0x55e1c1be3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:39.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.950+0000 7f4f36ff5640 10 client.16050 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:53:39.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.950+0000 7f4f5359e640 1 --2- 172.21.15.2:0/2634296102 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55e1c1be0e00 0x55e1c1be3220 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d12fe7b7fb71143 server_cookie=f7f48f2dd1f9bdc6 in_seq=0 out_seq=0 2024-09-19T04:53:39.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.950+0000 7f4f36ff5640 1 -- 172.21.15.2:0/2634296102 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e1c1ac3d70 con 0x55e1c1be0e00 2024-09-19T04:53:39.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.950+0000 7f4f36ff5640 10 client.16050 handle_command_reply: tid=0 2024-09-19T04:53:39.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.950+0000 7f4f5b45b740 1 client.16050 shutdown 2024-09-19T04:53:39.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.950+0000 7f4f5b45b740 1 -- 172.21.15.2:0/2634296102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1c1b57b40 msgr2=0x55e1c1b6ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:39.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.950+0000 7f4f5b45b740 1 --2- 172.21.15.2:0/2634296102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1c1b57b40 0x55e1c1b6ddd0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f4f48005ad0 tx=0x7f4f48003a70 comp rx=0 tx=0).stop 2024-09-19T04:53:39.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.950+0000 7f4f5b45b740 1 -- 172.21.15.2:0/2634296102 shutdown_connections 2024-09-19T04:53:39.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.950+0000 7f4f5b45b740 1 --2- 172.21.15.2:0/2634296102 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e1c1b61370 0x55e1c1b6a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:39.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.950+0000 7f4f5b45b740 1 --2- 172.21.15.2:0/2634296102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e1c1b57b40 0x55e1c1b6ddd0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:39.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.950+0000 7f4f5b45b740 1 --2- 172.21.15.2:0/2634296102 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55e1c1be0e00 0x55e1c1be3220 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:39.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.950+0000 7f4f5b45b740 1 --2- 172.21.15.2:0/2634296102 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e1c1b565d0 0x55e1c1b6d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:39.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.950+0000 7f4f5b45b740 1 -- 172.21.15.2:0/2634296102 >> 172.21.15.2:0/2634296102 conn(0x55e1c1b1f310 msgr2=0x55e1c1b514e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:53:39.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.950+0000 7f4f36ff5640 0 client.16050 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:53:39.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.950+0000 7f4f5b45b740 1 -- 172.21.15.2:0/2634296102 shutdown_connections 2024-09-19T04:53:39.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.950+0000 7f4f5b45b740 1 -- 172.21.15.2:0/2634296102 wait complete. 2024-09-19T04:53:39.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.951+0000 7f4f5b45b740 20 client.16050 trim_cache size 0 max 16384 2024-09-19T04:53:39.958 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T04:53:39.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.951+0000 7f4f59082640 1 -- 172.21.15.2:0/159384093 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f4f3c0a33b0 msgr2=0x7f4f3c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:39.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.951+0000 7f4f59082640 1 --2- 172.21.15.2:0/159384093 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f4f3c0a33b0 0x7f4f3c0a5870 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4f440ed950 tx=0x7f4f440f3c80 comp rx=0 tx=0).stop 2024-09-19T04:53:39.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.951+0000 7f4f59082640 1 -- 172.21.15.2:0/159384093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f54102d30 msgr2=0x7f4f541984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:39.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.951+0000 7f4f59082640 1 --2- 172.21.15.2:0/159384093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f54102d30 0x7f4f541984f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f4f44004770 tx=0x7f4f440042f0 comp rx=0 tx=0).stop 2024-09-19T04:53:39.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.951+0000 7f4f59082640 1 -- 172.21.15.2:0/159384093 shutdown_connections 2024-09-19T04:53:39.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.951+0000 7f4f59082640 1 --2- 172.21.15.2:0/159384093 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f541082a0 0x7f4f5419cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:39.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.951+0000 7f4f59082640 1 --2- 172.21.15.2:0/159384093 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f4f3c0a33b0 0x7f4f3c0a5870 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:39.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.951+0000 7f4f59082640 1 --2- 172.21.15.2:0/159384093 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4f541036e0 0x7f4f54198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:39.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.951+0000 7f4f59082640 1 --2- 172.21.15.2:0/159384093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f54102d30 0x7f4f541984f0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:39.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.951+0000 7f4f59082640 1 -- 172.21.15.2:0/159384093 >> 172.21.15.2:0/159384093 conn(0x7f4f540fc7d0 msgr2=0x7f4f54105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:53:39.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.951+0000 7f4f59082640 1 -- 172.21.15.2:0/159384093 shutdown_connections 2024-09-19T04:53:39.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:39.951+0000 7f4f59082640 1 -- 172.21.15.2:0/159384093 wait complete. 2024-09-19T04:53:40.605 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:53:40 smithi002 ceph-mon[30975]: pgmap v173: 97 pgs: 97 active+clean; 7.3 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 29 KiB/s wr, 7 op/s 2024-09-19T04:53:40.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:53:40 smithi116 ceph-mon[34477]: pgmap v173: 97 pgs: 97 active+clean; 7.3 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 29 KiB/s wr, 7 op/s 2024-09-19T04:53:40.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:53:40 smithi018 ceph-mon[34537]: pgmap v173: 97 pgs: 97 active+clean; 7.3 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 29 KiB/s wr, 7 op/s 2024-09-19T04:53:41.636 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:53:41.636 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:53:41.909 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:53:42.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.391+0000 7f38e678c640 1 -- 172.21.15.2:0/1696297997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38e0106f10 msgr2=0x7f38e010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:42.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.391+0000 7f38e678c640 1 --2- 172.21.15.2:0/1696297997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38e0106f10 0x7f38e010ea90 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f38d8009ca0 tx=0x7f38d802a8c0 comp rx=0 tx=0).stop 2024-09-19T04:53:42.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.391+0000 7f38e678c640 1 -- 172.21.15.2:0/1696297997 shutdown_connections 2024-09-19T04:53:42.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.391+0000 7f38e678c640 1 --2- 172.21.15.2:0/1696297997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38e0106f10 0x7f38e010ea90 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:42.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.391+0000 7f38e678c640 1 --2- 172.21.15.2:0/1696297997 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38e0102790 0x7f38e01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:42.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.391+0000 7f38e678c640 1 --2- 172.21.15.2:0/1696297997 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38e0101de0 0x7f38e01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:42.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.391+0000 7f38e678c640 1 -- 172.21.15.2:0/1696297997 >> 172.21.15.2:0/1696297997 conn(0x7f38e00fd8c0 msgr2=0x7f38e00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:53:42.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.391+0000 7f38e678c640 1 -- 172.21.15.2:0/1696297997 shutdown_connections 2024-09-19T04:53:42.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.391+0000 7f38e678c640 1 -- 172.21.15.2:0/1696297997 wait complete. 2024-09-19T04:53:42.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.392+0000 7f38e678c640 1 Processor -- start 2024-09-19T04:53:42.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.392+0000 7f38e678c640 1 -- start start 2024-09-19T04:53:42.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.392+0000 7f38e678c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38e0101de0 0x7f38e01982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:42.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.392+0000 7f38e678c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38e0102790 0x7f38e0198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:42.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.392+0000 7f38e678c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38e0106f10 0x7f38e019cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:42.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.392+0000 7f38e678c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f38e0111e70 con 0x7f38e0101de0 2024-09-19T04:53:42.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.392+0000 7f38e678c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f38e0111cf0 con 0x7f38e0106f10 2024-09-19T04:53:42.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.392+0000 7f38e678c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f38e0111ff0 con 0x7f38e0102790 2024-09-19T04:53:42.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.392+0000 7f38dffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38e0101de0 0x7f38e01982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:42.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.392+0000 7f38dffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38e0101de0 0x7f38e01982f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52540/0 (socket says 172.21.15.2:52540) 2024-09-19T04:53:42.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.392+0000 7f38dffff640 1 -- 172.21.15.2:0/2256498218 learned_addr learned my addr 172.21.15.2:0/2256498218 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:53:42.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.393+0000 7f38df7fe640 1 --2- 172.21.15.2:0/2256498218 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38e0102790 0x7f38e0198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:42.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.393+0000 7f38e4d29640 1 --2- 172.21.15.2:0/2256498218 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38e0106f10 0x7f38e019cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:42.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.393+0000 7f38dffff640 1 -- 172.21.15.2:0/2256498218 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38e0102790 msgr2=0x7f38e0198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:42.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.393+0000 7f38dffff640 1 --2- 172.21.15.2:0/2256498218 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38e0102790 0x7f38e0198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:42.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.393+0000 7f38dffff640 1 -- 172.21.15.2:0/2256498218 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38e0106f10 msgr2=0x7f38e019cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:42.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.393+0000 7f38dffff640 1 --2- 172.21.15.2:0/2256498218 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38e0106f10 0x7f38e019cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:42.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.393+0000 7f38dffff640 1 -- 172.21.15.2:0/2256498218 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38e019d2a0 con 0x7f38e0101de0 2024-09-19T04:53:42.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.393+0000 7f38df7fe640 1 --2- 172.21.15.2:0/2256498218 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38e0102790 0x7f38e0198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:53:42.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.393+0000 7f38dffff640 1 --2- 172.21.15.2:0/2256498218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38e0101de0 0x7f38e01982f0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f38d000d950 tx=0x7f38d000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:53:42.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.393+0000 7f38dd7fa640 1 -- 172.21.15.2:0/2256498218 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d0017030 con 0x7f38e0101de0 2024-09-19T04:53:42.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.393+0000 7f38dd7fa640 1 -- 172.21.15.2:0/2256498218 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f38d0004020 con 0x7f38e0101de0 2024-09-19T04:53:42.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.393+0000 7f38e678c640 1 -- 172.21.15.2:0/2256498218 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38e019d590 con 0x7f38e0101de0 2024-09-19T04:53:42.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.393+0000 7f38dd7fa640 1 -- 172.21.15.2:0/2256498218 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d00047a0 con 0x7f38e0101de0 2024-09-19T04:53:42.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.393+0000 7f38e678c640 1 -- 172.21.15.2:0/2256498218 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38e01a4e70 con 0x7f38e0101de0 2024-09-19T04:53:42.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.395+0000 7f38dd7fa640 1 -- 172.21.15.2:0/2256498218 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f38d00041d0 con 0x7f38e0101de0 2024-09-19T04:53:42.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.396+0000 7f38e8b65740 1 Processor -- start 2024-09-19T04:53:42.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.396+0000 7f38e8b65740 1 -- start start 2024-09-19T04:53:42.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.396+0000 7f38e8b65740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d703dda40 0x562d703dde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:42.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.396+0000 7f38e8b65740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d703de360 0x562d703ecc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:42.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.396+0000 7f38e8b65740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562d703ed150 0x562d703ef540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:42.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.396+0000 7f38e8b65740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562d70343280 con 0x562d703dda40 2024-09-19T04:53:42.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.396+0000 7f38e8b65740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562d702eab10 con 0x562d703de360 2024-09-19T04:53:42.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.396+0000 7f38e8b65740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x562d7033f240 con 0x562d703ed150 2024-09-19T04:53:42.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.396+0000 7f38e4d29640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d703dda40 0x562d703dde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:42.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.396+0000 7f38e4d29640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d703dda40 0x562d703dde20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52546/0 (socket says 172.21.15.2:52546) 2024-09-19T04:53:42.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.396+0000 7f38e4d29640 1 -- 172.21.15.2:0/3996644481 learned_addr learned my addr 172.21.15.2:0/3996644481 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:53:42.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.396+0000 7f38dd7fa640 1 --2- 172.21.15.2:0/2256498218 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f38c80a33b0 0x7f38c80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:42.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.396+0000 7f38df7fe640 1 --2- 172.21.15.2:0/3996644481 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562d703ed150 0x562d703ef540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:42.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.396+0000 7f38e4d29640 1 --2- 172.21.15.2:0/2256498218 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f38c80a33b0 0x7f38c80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:42.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.397+0000 7f38dd7fa640 1 -- 172.21.15.2:0/2256498218 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f38d00cf840 con 0x7f38e0101de0 2024-09-19T04:53:42.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.397+0000 7f38dffff640 1 --2- 172.21.15.2:0/3996644481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d703de360 0x562d703ecc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:42.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.397+0000 7f38e4d29640 1 -- 172.21.15.2:0/3996644481 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562d703ed150 msgr2=0x562d703ef540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:42.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.397+0000 7f38e4d29640 1 --2- 172.21.15.2:0/3996644481 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562d703ed150 0x562d703ef540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:42.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.397+0000 7f38e4d29640 1 -- 172.21.15.2:0/3996644481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d703de360 msgr2=0x562d703ecc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:42.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.397+0000 7f38e4d29640 1 --2- 172.21.15.2:0/3996644481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d703de360 0x562d703ecc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:42.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.397+0000 7f38e4d29640 1 -- 172.21.15.2:0/3996644481 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d702f71f0 con 0x562d703dda40 2024-09-19T04:53:42.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.397+0000 7f38df7fe640 1 --2- 172.21.15.2:0/3996644481 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562d703ed150 0x562d703ef540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:53:42.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.397+0000 7f38dffff640 1 --2- 172.21.15.2:0/3996644481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d703de360 0x562d703ecc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:53:42.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.397+0000 7f38e4d29640 1 --2- 172.21.15.2:0/3996644481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d703dda40 0x562d703dde20 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f38d8035000 tx=0x7f38d80314d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b8d5eec4e70d3c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:53:42.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.397+0000 7f38e4d29640 1 --2- 172.21.15.2:0/2256498218 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f38c80a33b0 0x7f38c80a5870 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f38d8047000 tx=0x7f38d8049000 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:53:42.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.397+0000 7f38c67fc640 1 -- 172.21.15.2:0/3996644481 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d8004410 con 0x562d703dda40 2024-09-19T04:53:42.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.397+0000 7f38c67fc640 1 -- 172.21.15.2:0/3996644481 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f38d8036040 con 0x562d703dda40 2024-09-19T04:53:42.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.397+0000 7f38c67fc640 1 -- 172.21.15.2:0/3996644481 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d8030e70 con 0x562d703dda40 2024-09-19T04:53:42.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.398+0000 7f38e8b65740 1 -- 172.21.15.2:0/3996644481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d703dda40 msgr2=0x562d703dde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:42.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.398+0000 7f38e8b65740 1 --2- 172.21.15.2:0/3996644481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d703dda40 0x562d703dde20 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f38d8035000 tx=0x7f38d80314d0 comp rx=0 tx=0).stop 2024-09-19T04:53:42.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.398+0000 7f38e8b65740 1 -- 172.21.15.2:0/3996644481 shutdown_connections 2024-09-19T04:53:42.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.398+0000 7f38e8b65740 1 --2- 172.21.15.2:0/3996644481 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562d703ed150 0x562d703ef540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:42.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.398+0000 7f38e8b65740 1 --2- 172.21.15.2:0/3996644481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d703de360 0x562d703ecc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:42.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.398+0000 7f38e8b65740 1 --2- 172.21.15.2:0/3996644481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d703dda40 0x562d703dde20 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:42.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.398+0000 7f38e8b65740 1 -- 172.21.15.2:0/3996644481 >> 172.21.15.2:0/3996644481 conn(0x562d703da0f0 msgr2=0x562d703da4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:53:42.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.398+0000 7f38e8b65740 1 -- 172.21.15.2:0/3996644481 shutdown_connections 2024-09-19T04:53:42.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.398+0000 7f38e8b65740 1 -- 172.21.15.2:0/3996644481 wait complete. 2024-09-19T04:53:42.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.398+0000 7f38e8b65740 1 -- start start 2024-09-19T04:53:42.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.399+0000 7f38e8b65740 1 Processor -- start 2024-09-19T04:53:42.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.399+0000 7f38e8b65740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d703dda40 0x562d703ea0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:42.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.399+0000 7f38e8b65740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d703de360 0x562d703ea5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:42.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.399+0000 7f38e8b65740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562d703ed150 0x562d703eab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:42.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.399+0000 7f38e8b65740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562d703efcc0 con 0x562d703dda40 2024-09-19T04:53:42.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.399+0000 7f38e8b65740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562d702fdf10 con 0x562d703de360 2024-09-19T04:53:42.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.399+0000 7f38e8b65740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x562d703efe40 con 0x562d703ed150 2024-09-19T04:53:42.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.399+0000 7f38e8b65740 10 client.0 _ll_register_callbacks cb 0x562d702c6a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:53:42.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.399+0000 7f38dffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d703dda40 0x562d703ea0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:42.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.399+0000 7f38dffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d703dda40 0x562d703ea0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52554/0 (socket says 172.21.15.2:52554) 2024-09-19T04:53:42.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.399+0000 7f38dffff640 1 -- 172.21.15.2:0/149151936 learned_addr learned my addr 172.21.15.2:0/149151936 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:53:42.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.399+0000 7f38e4d29640 1 --2- 172.21.15.2:0/149151936 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562d703ed150 0x562d703eab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:42.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.399+0000 7f38df7fe640 1 --2- 172.21.15.2:0/149151936 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d703de360 0x562d703ea5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:42.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.399+0000 7f38dffff640 1 -- 172.21.15.2:0/149151936 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562d703ed150 msgr2=0x562d703eab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:42.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.399+0000 7f38dffff640 1 --2- 172.21.15.2:0/149151936 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562d703ed150 0x562d703eab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:42.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.399+0000 7f38dffff640 1 -- 172.21.15.2:0/149151936 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d703de360 msgr2=0x562d703ea5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:42.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.399+0000 7f38dffff640 1 --2- 172.21.15.2:0/149151936 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d703de360 0x562d703ea5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:42.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.399+0000 7f38dffff640 1 -- 172.21.15.2:0/149151936 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d700b46a0 con 0x562d703dda40 2024-09-19T04:53:42.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.399+0000 7f38dffff640 1 --2- 172.21.15.2:0/149151936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d703dda40 0x562d703ea0b0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f38d009b840 tx=0x7f38d009b5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b63d45e80994c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:53:42.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.399+0000 7f38bf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:53:42.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.400+0000 7f38bf7fe640 1 -- 172.21.15.2:0/149151936 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d00a47b0 con 0x562d703dda40 2024-09-19T04:53:42.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.400+0000 7f38bf7fe640 1 -- 172.21.15.2:0/149151936 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f38d00860c0 con 0x562d703dda40 2024-09-19T04:53:42.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.400+0000 7f38e8b65740 1 -- 172.21.15.2:0/149151936 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38d8036040 con 0x562d703dda40 2024-09-19T04:53:42.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.400+0000 7f38bf7fe640 1 -- 172.21.15.2:0/149151936 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f38d00862c0 con 0x562d703dda40 2024-09-19T04:53:42.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.400+0000 7f38e8b65740 10 client.16062 fetch_fsmap learned FSMap version 19 2024-09-19T04:53:42.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.400+0000 7f38e8b65740 1 -- 172.21.15.2:0/149151936 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x562d703fb940 con 0x562d703dda40 2024-09-19T04:53:42.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.400+0000 7f38bf7fe640 1 -- 172.21.15.2:0/149151936 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f38d8036040 con 0x562d703dda40 2024-09-19T04:53:42.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.400+0000 7f38bf7fe640 1 -- 172.21.15.2:0/149151936 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f38d00979b0 con 0x562d703dda40 2024-09-19T04:53:42.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.400+0000 7f38e8b65740 10 client.16062 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:53:42.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.400+0000 7f38e8b65740 10 client.16062 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:53:42.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.400+0000 7f38e8b65740 20 client.16062 populate_metadata read hostname 'smithi002' 2024-09-19T04:53:42.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.400+0000 7f38e8b65740 1 --2- 172.21.15.2:0/149151936 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x562d703fce00 0x562d703ff230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:42.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.400+0000 7f38e8b65740 4 client.16062 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:53:42.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.400+0000 7f38e8b65740 1 -- 172.21.15.2:0/149151936 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d703507f0 con 0x562d703fce00 2024-09-19T04:53:42.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.401+0000 7f38df7fe640 1 --2- 172.21.15.2:0/149151936 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x562d703fce00 0x562d703ff230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:42.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.401+0000 7f38df7fe640 1 --2- 172.21.15.2:0/149151936 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x562d703fce00 0x562d703ff230 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de5957d17dc70b9f server_cookie=a7afb683e333075a in_seq=0 out_seq=0 2024-09-19T04:53:42.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.401+0000 7f38bf7fe640 10 client.16062 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:53:42.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.402+0000 7f38bf7fe640 1 -- 172.21.15.2:0/149151936 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562d703507f0 con 0x562d703fce00 2024-09-19T04:53:42.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.402+0000 7f38bf7fe640 10 client.16062 handle_command_reply: tid=0 2024-09-19T04:53:42.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.402+0000 7f38e8b65740 1 client.16062 shutdown 2024-09-19T04:53:42.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.402+0000 7f38e8b65740 1 -- 172.21.15.2:0/149151936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d703dda40 msgr2=0x562d703ea0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:42.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.402+0000 7f38e8b65740 1 --2- 172.21.15.2:0/149151936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d703dda40 0x562d703ea0b0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f38d009b840 tx=0x7f38d009b5d0 comp rx=0 tx=0).stop 2024-09-19T04:53:42.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.402+0000 7f38e8b65740 1 -- 172.21.15.2:0/149151936 shutdown_connections 2024-09-19T04:53:42.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.402+0000 7f38e8b65740 1 --2- 172.21.15.2:0/149151936 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x562d703fce00 0x562d703ff230 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:42.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.402+0000 7f38e8b65740 1 --2- 172.21.15.2:0/149151936 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562d703ed150 0x562d703eab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:42.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.402+0000 7f38bf7fe640 0 client.16062 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:53:42.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.402+0000 7f38e8b65740 1 --2- 172.21.15.2:0/149151936 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d703de360 0x562d703ea5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:42.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.402+0000 7f38e8b65740 1 --2- 172.21.15.2:0/149151936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d703dda40 0x562d703ea0b0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:42.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.402+0000 7f38e8b65740 1 -- 172.21.15.2:0/149151936 >> 172.21.15.2:0/149151936 conn(0x562d703da0f0 msgr2=0x562d703dfe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:53:42.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.402+0000 7f38e8b65740 1 -- 172.21.15.2:0/149151936 shutdown_connections 2024-09-19T04:53:42.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.402+0000 7f38e8b65740 1 -- 172.21.15.2:0/149151936 wait complete. 2024-09-19T04:53:42.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.402+0000 7f38e8b65740 20 client.16062 trim_cache size 0 max 16384 2024-09-19T04:53:42.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.419+0000 7f38e8b65740 1 Processor -- start 2024-09-19T04:53:42.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.419+0000 7f38e8b65740 1 -- start start 2024-09-19T04:53:42.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.420+0000 7f38e8b65740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d703dda40 0x562d703d9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:42.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.420+0000 7f38e8b65740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562d703de360 0x562d70404b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:42.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.420+0000 7f38e8b65740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d703ed150 0x562d70405080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:42.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.420+0000 7f38e8b65740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f38e01a94f0 con 0x562d703ed150 2024-09-19T04:53:42.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.420+0000 7f38e8b65740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f38e01abd70 con 0x562d703dda40 2024-09-19T04:53:42.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.420+0000 7f38e8b65740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f38e01a9b60 con 0x562d703de360 2024-09-19T04:53:42.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.420+0000 7f38e4d29640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d703ed150 0x562d70405080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:42.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.420+0000 7f38e4d29640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d703ed150 0x562d70405080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52566/0 (socket says 172.21.15.2:52566) 2024-09-19T04:53:42.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.420+0000 7f38e4d29640 1 -- 172.21.15.2:0/3939395087 learned_addr learned my addr 172.21.15.2:0/3939395087 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:53:42.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.420+0000 7f38df7fe640 1 --2- 172.21.15.2:0/3939395087 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562d703de360 0x562d70404b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:42.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.420+0000 7f38dffff640 1 --2- 172.21.15.2:0/3939395087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d703dda40 0x562d703d9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:42.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.420+0000 7f38e4d29640 1 -- 172.21.15.2:0/3939395087 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562d703de360 msgr2=0x562d70404b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:42.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.420+0000 7f38e4d29640 1 --2- 172.21.15.2:0/3939395087 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562d703de360 0x562d70404b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:42.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.420+0000 7f38e4d29640 1 -- 172.21.15.2:0/3939395087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d703dda40 msgr2=0x562d703d9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:42.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.420+0000 7f38e4d29640 1 --2- 172.21.15.2:0/3939395087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d703dda40 0x562d703d9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:42.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.420+0000 7f38e4d29640 1 -- 172.21.15.2:0/3939395087 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d703e8600 con 0x562d703ed150 2024-09-19T04:53:42.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.420+0000 7f38df7fe640 1 --2- 172.21.15.2:0/3939395087 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562d703de360 0x562d70404b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:53:42.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.420+0000 7f38e4d29640 1 --2- 172.21.15.2:0/3939395087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d703ed150 0x562d70405080 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f38d802ade0 tx=0x7f38d802f310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=694fccfcc6f82ac1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:53:42.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.421+0000 7f38c5ffb640 1 -- 172.21.15.2:0/3939395087 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d805b070 con 0x562d703ed150 2024-09-19T04:53:42.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.421+0000 7f38c5ffb640 1 -- 172.21.15.2:0/3939395087 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f38d8036040 con 0x562d703ed150 2024-09-19T04:53:42.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.421+0000 7f38c5ffb640 1 -- 172.21.15.2:0/3939395087 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d8030c40 con 0x562d703ed150 2024-09-19T04:53:42.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.421+0000 7f38e8b65740 1 -- 172.21.15.2:0/3939395087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d703ed150 msgr2=0x562d70405080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:42.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.421+0000 7f38e8b65740 1 --2- 172.21.15.2:0/3939395087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d703ed150 0x562d70405080 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f38d802ade0 tx=0x7f38d802f310 comp rx=0 tx=0).stop 2024-09-19T04:53:42.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.421+0000 7f38e8b65740 1 -- 172.21.15.2:0/3939395087 shutdown_connections 2024-09-19T04:53:42.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.421+0000 7f38e8b65740 1 --2- 172.21.15.2:0/3939395087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d703ed150 0x562d70405080 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:42.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.421+0000 7f38e8b65740 1 --2- 172.21.15.2:0/3939395087 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562d703de360 0x562d70404b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:42.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.421+0000 7f38e8b65740 1 --2- 172.21.15.2:0/3939395087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d703dda40 0x562d703d9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:42.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.421+0000 7f38e8b65740 1 -- 172.21.15.2:0/3939395087 >> 172.21.15.2:0/3939395087 conn(0x562d703da0f0 msgr2=0x562d703d8a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:53:42.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.421+0000 7f38e8b65740 1 -- 172.21.15.2:0/3939395087 shutdown_connections 2024-09-19T04:53:42.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.421+0000 7f38e8b65740 1 -- 172.21.15.2:0/3939395087 wait complete. 2024-09-19T04:53:42.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.421+0000 7f38e8b65740 1 -- start start 2024-09-19T04:53:42.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.422+0000 7f38e8b65740 1 Processor -- start 2024-09-19T04:53:42.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.422+0000 7f38e8b65740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d703dda40 0x562d703e7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:42.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.422+0000 7f38e8b65740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562d703de360 0x562d703e75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:42.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.422+0000 7f38e8b65740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d703ed150 0x562d703e7b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:42.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.422+0000 7f38e8b65740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f38e01aa230 con 0x562d703ed150 2024-09-19T04:53:42.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.422+0000 7f38e8b65740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f38e01ab6a0 con 0x562d703dda40 2024-09-19T04:53:42.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.422+0000 7f38e8b65740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f38e01aa900 con 0x562d703de360 2024-09-19T04:53:42.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.422+0000 7f38e8b65740 10 client.0 _ll_register_callbacks cb 0x7f38d0004540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:53:42.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.422+0000 7f38e4d29640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d703ed150 0x562d703e7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:42.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.422+0000 7f38e4d29640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d703ed150 0x562d703e7b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52574/0 (socket says 172.21.15.2:52574) 2024-09-19T04:53:42.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.422+0000 7f38dffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d703dda40 0x562d703e7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:42.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.422+0000 7f38e4d29640 1 -- 172.21.15.2:0/3649326317 learned_addr learned my addr 172.21.15.2:0/3649326317 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:53:42.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.422+0000 7f38df7fe640 1 --2- 172.21.15.2:0/3649326317 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562d703de360 0x562d703e75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:42.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.423+0000 7f38e4d29640 1 -- 172.21.15.2:0/3649326317 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562d703de360 msgr2=0x562d703e75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:42.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.423+0000 7f38e4d29640 1 --2- 172.21.15.2:0/3649326317 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562d703de360 0x562d703e75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:42.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.423+0000 7f38e4d29640 1 -- 172.21.15.2:0/3649326317 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d703dda40 msgr2=0x562d703e7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:42.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.423+0000 7f38e4d29640 1 --2- 172.21.15.2:0/3649326317 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d703dda40 0x562d703e7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:42.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.423+0000 7f38e4d29640 1 -- 172.21.15.2:0/3649326317 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d70466b10 con 0x562d703ed150 2024-09-19T04:53:42.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.423+0000 7f38e4d29640 1 --2- 172.21.15.2:0/3649326317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d703ed150 0x562d703e7b00 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f38d8009430 tx=0x7f38d8009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cfb6ab6884aa8d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:53:42.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.423+0000 7f38bf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:53:42.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.423+0000 7f38bf7fe640 1 -- 172.21.15.2:0/3649326317 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d8067070 con 0x562d703ed150 2024-09-19T04:53:42.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.423+0000 7f38bf7fe640 1 -- 172.21.15.2:0/3649326317 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f38d80305c0 con 0x562d703ed150 2024-09-19T04:53:42.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.423+0000 7f38e8b65740 1 -- 172.21.15.2:0/3649326317 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38d8036040 con 0x562d703ed150 2024-09-19T04:53:42.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.423+0000 7f38bf7fe640 1 -- 172.21.15.2:0/3649326317 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f38d805b040 con 0x562d703ed150 2024-09-19T04:53:42.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.423+0000 7f38e8b65740 10 client.16068 fetch_fsmap learned FSMap version 19 2024-09-19T04:53:42.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.423+0000 7f38e8b65740 1 -- 172.21.15.2:0/3649326317 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x562d70467df0 con 0x562d703ed150 2024-09-19T04:53:42.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.423+0000 7f38bf7fe640 1 -- 172.21.15.2:0/3649326317 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f38d8036040 con 0x562d703ed150 2024-09-19T04:53:42.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.423+0000 7f38bf7fe640 1 -- 172.21.15.2:0/3649326317 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f38d80608e0 con 0x562d703ed150 2024-09-19T04:53:42.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.424+0000 7f38e8b65740 10 client.16068 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:53:42.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.424+0000 7f38e8b65740 10 client.16068 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:53:42.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.424+0000 7f38e8b65740 20 client.16068 populate_metadata read hostname 'smithi002' 2024-09-19T04:53:42.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.424+0000 7f38e8b65740 1 --2- 172.21.15.2:0/3649326317 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x562d703fce00 0x562d7046a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:42.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.424+0000 7f38e8b65740 4 client.16068 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:53:42.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.424+0000 7f38e8b65740 1 -- 172.21.15.2:0/3649326317 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562d7034ad00 con 0x562d703fce00 2024-09-19T04:53:42.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.424+0000 7f38dffff640 1 --2- 172.21.15.2:0/3649326317 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x562d703fce00 0x562d7046a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:42.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.424+0000 7f38bf7fe640 10 client.16068 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:53:42.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.424+0000 7f38dffff640 1 --2- 172.21.15.2:0/3649326317 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x562d703fce00 0x562d7046a080 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f77f5bc1b6df6ed server_cookie=6c8181d322e03789 in_seq=0 out_seq=0 2024-09-19T04:53:42.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.425+0000 7f38bf7fe640 1 -- 172.21.15.2:0/3649326317 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562d7034ad00 con 0x562d703fce00 2024-09-19T04:53:42.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.425+0000 7f38bf7fe640 10 client.16068 handle_command_reply: tid=0 2024-09-19T04:53:42.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.425+0000 7f38e8b65740 1 client.16068 shutdown 2024-09-19T04:53:42.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.426+0000 7f38e8b65740 1 -- 172.21.15.2:0/3649326317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d703ed150 msgr2=0x562d703e7b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:42.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.426+0000 7f38e8b65740 1 --2- 172.21.15.2:0/3649326317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d703ed150 0x562d703e7b00 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f38d8009430 tx=0x7f38d8009800 comp rx=0 tx=0).stop 2024-09-19T04:53:42.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.426+0000 7f38e8b65740 1 -- 172.21.15.2:0/3649326317 shutdown_connections 2024-09-19T04:53:42.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.426+0000 7f38e8b65740 1 --2- 172.21.15.2:0/3649326317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d703ed150 0x562d703e7b00 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:42.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.426+0000 7f38e8b65740 1 --2- 172.21.15.2:0/3649326317 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x562d703fce00 0x562d7046a080 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:42.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.426+0000 7f38e8b65740 1 --2- 172.21.15.2:0/3649326317 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562d703de360 0x562d703e75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:42.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.426+0000 7f38e8b65740 1 --2- 172.21.15.2:0/3649326317 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d703dda40 0x562d703e7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:42.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.426+0000 7f38bf7fe640 0 client.16068 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:53:42.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.426+0000 7f38e8b65740 1 -- 172.21.15.2:0/3649326317 >> 172.21.15.2:0/3649326317 conn(0x562d703da0f0 msgr2=0x562d703d9270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:53:42.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.426+0000 7f38e8b65740 1 -- 172.21.15.2:0/3649326317 shutdown_connections 2024-09-19T04:53:42.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.426+0000 7f38e8b65740 1 -- 172.21.15.2:0/3649326317 wait complete. 2024-09-19T04:53:42.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.426+0000 7f38e8b65740 20 client.16068 trim_cache size 0 max 16384 2024-09-19T04:53:42.441 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:53:42.441 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T04:53:42.441 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "b0f9691c-3920-4d20-affb-13aa30757c34", 2024-09-19T04:53:42.441 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T04:53:42.441 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:53:42.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.426+0000 7f38e678c640 1 -- 172.21.15.2:0/2256498218 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f38c80a33b0 msgr2=0x7f38c80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:42.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.426+0000 7f38e678c640 1 --2- 172.21.15.2:0/2256498218 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f38c80a33b0 0x7f38c80a5870 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f38d8047000 tx=0x7f38d8049000 comp rx=0 tx=0).stop 2024-09-19T04:53:42.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.426+0000 7f38e678c640 1 -- 172.21.15.2:0/2256498218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38e0101de0 msgr2=0x7f38e01982f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:42.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.426+0000 7f38e678c640 1 --2- 172.21.15.2:0/2256498218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38e0101de0 0x7f38e01982f0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f38d000d950 tx=0x7f38d000de10 comp rx=0 tx=0).stop 2024-09-19T04:53:42.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.427+0000 7f38e678c640 1 -- 172.21.15.2:0/2256498218 shutdown_connections 2024-09-19T04:53:42.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.427+0000 7f38e678c640 1 --2- 172.21.15.2:0/2256498218 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38e0106f10 0x7f38e019cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:42.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.427+0000 7f38e678c640 1 --2- 172.21.15.2:0/2256498218 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f38c80a33b0 0x7f38c80a5870 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:42.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.427+0000 7f38e678c640 1 --2- 172.21.15.2:0/2256498218 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38e0102790 0x7f38e0198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:42.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.427+0000 7f38e678c640 1 --2- 172.21.15.2:0/2256498218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38e0101de0 0x7f38e01982f0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:42.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.427+0000 7f38e678c640 1 -- 172.21.15.2:0/2256498218 >> 172.21.15.2:0/2256498218 conn(0x7f38e00fd8c0 msgr2=0x7f38e00fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:53:42.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.427+0000 7f38e678c640 1 -- 172.21.15.2:0/2256498218 shutdown_connections 2024-09-19T04:53:42.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:42.427+0000 7f38e678c640 1 -- 172.21.15.2:0/2256498218 wait complete. 2024-09-19T04:53:42.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:53:42 smithi002 ceph-mon[30975]: pgmap v174: 97 pgs: 97 active+clean; 7.5 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 43 KiB/s wr, 10 op/s 2024-09-19T04:53:42.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:53:42 smithi116 ceph-mon[34477]: pgmap v174: 97 pgs: 97 active+clean; 7.5 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 43 KiB/s wr, 10 op/s 2024-09-19T04:53:42.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:53:42 smithi018 ceph-mon[34537]: pgmap v174: 97 pgs: 97 active+clean; 7.5 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 43 KiB/s wr, 10 op/s 2024-09-19T04:53:43.208 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:53:43.466 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:53:43.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.955+0000 7ffa61f1a640 1 -- 172.21.15.2:0/3646241462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa5c106a80 msgr2=0x7ffa5c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:43.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.955+0000 7ffa61f1a640 1 --2- 172.21.15.2:0/3646241462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa5c106a80 0x7ffa5c106e60 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c009930 tx=0x7ffa4c02a420 comp rx=0 tx=0).stop 2024-09-19T04:53:43.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.955+0000 7ffa61f1a640 1 -- 172.21.15.2:0/3646241462 shutdown_connections 2024-09-19T04:53:43.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.955+0000 7ffa61f1a640 1 --2- 172.21.15.2:0/3646241462 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa5c101420 0x7ffa5c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:43.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.955+0000 7ffa61f1a640 1 --2- 172.21.15.2:0/3646241462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa5c100a80 0x7ffa5c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:43.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.955+0000 7ffa61f1a640 1 --2- 172.21.15.2:0/3646241462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa5c106a80 0x7ffa5c106e60 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:43.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.955+0000 7ffa61f1a640 1 -- 172.21.15.2:0/3646241462 >> 172.21.15.2:0/3646241462 conn(0x7ffa5c0fc7a0 msgr2=0x7ffa5c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:53:43.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.955+0000 7ffa61f1a640 1 -- 172.21.15.2:0/3646241462 shutdown_connections 2024-09-19T04:53:43.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.955+0000 7ffa61f1a640 1 -- 172.21.15.2:0/3646241462 wait complete. 2024-09-19T04:53:43.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.956+0000 7ffa61f1a640 1 Processor -- start 2024-09-19T04:53:43.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.956+0000 7ffa61f1a640 1 -- start start 2024-09-19T04:53:43.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.956+0000 7ffa61f1a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa5c100a80 0x7ffa5c198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:43.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.956+0000 7ffa61f1a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa5c101420 0x7ffa5c198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:43.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.956+0000 7ffa61f1a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa5c106a80 0x7ffa5c19cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:43.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.956+0000 7ffa61f1a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ffa5c110d80 con 0x7ffa5c106a80 2024-09-19T04:53:43.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.956+0000 7ffa61f1a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ffa5c110c00 con 0x7ffa5c101420 2024-09-19T04:53:43.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.956+0000 7ffa61f1a640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7ffa5c110f00 con 0x7ffa5c100a80 2024-09-19T04:53:43.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.956+0000 7ffa5bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa5c106a80 0x7ffa5c19cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:43.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.956+0000 7ffa5bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa5c106a80 0x7ffa5c19cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52584/0 (socket says 172.21.15.2:52584) 2024-09-19T04:53:43.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.956+0000 7ffa5bfff640 1 -- 172.21.15.2:0/2183901403 learned_addr learned my addr 172.21.15.2:0/2183901403 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:53:43.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.956+0000 7ffa5b7fe640 1 --2- 172.21.15.2:0/2183901403 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa5c100a80 0x7ffa5c198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:43.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.956+0000 7ffa5bfff640 1 -- 172.21.15.2:0/2183901403 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa5c100a80 msgr2=0x7ffa5c198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:43.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.956+0000 7ffa5bfff640 1 --2- 172.21.15.2:0/2183901403 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa5c100a80 0x7ffa5c198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:43.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.956+0000 7ffa5bfff640 1 -- 172.21.15.2:0/2183901403 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa5c101420 msgr2=0x7ffa5c198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:43.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.956+0000 7ffa53fff640 1 --2- 172.21.15.2:0/2183901403 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa5c101420 0x7ffa5c198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:43.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.956+0000 7ffa5bfff640 1 --2- 172.21.15.2:0/2183901403 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa5c101420 0x7ffa5c198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:43.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.956+0000 7ffa5bfff640 1 -- 172.21.15.2:0/2183901403 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa5c19d2b0 con 0x7ffa5c106a80 2024-09-19T04:53:43.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.957+0000 7ffa5bfff640 1 --2- 172.21.15.2:0/2183901403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa5c106a80 0x7ffa5c19cbd0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ffa5400eaa0 tx=0x7ffa5400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:53:43.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.957+0000 7ffa597fa640 1 -- 172.21.15.2:0/2183901403 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5400cdb0 con 0x7ffa5c106a80 2024-09-19T04:53:43.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.957+0000 7ffa597fa640 1 -- 172.21.15.2:0/2183901403 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffa54005020 con 0x7ffa5c106a80 2024-09-19T04:53:43.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.957+0000 7ffa61f1a640 1 -- 172.21.15.2:0/2183901403 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa5c19d5a0 con 0x7ffa5c106a80 2024-09-19T04:53:43.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.957+0000 7ffa597fa640 1 -- 172.21.15.2:0/2183901403 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa540116d0 con 0x7ffa5c106a80 2024-09-19T04:53:43.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.957+0000 7ffa61f1a640 1 -- 172.21.15.2:0/2183901403 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa5c1a4e80 con 0x7ffa5c106a80 2024-09-19T04:53:43.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.959+0000 7ffa597fa640 1 -- 172.21.15.2:0/2183901403 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7ffa540051d0 con 0x7ffa5c106a80 2024-09-19T04:53:43.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.959+0000 7ffa642f3740 1 Processor -- start 2024-09-19T04:53:43.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.960+0000 7ffa642f3740 1 -- start start 2024-09-19T04:53:43.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.960+0000 7ffa642f3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a3abed4a0 0x557a3abed880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:43.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.960+0000 7ffa642f3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a3abeddc0 0x557a3abf8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:43.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.960+0000 7ffa642f3740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557a3abf8680 0x557a3abfaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:43.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.960+0000 7ffa642f3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557a3ab532e0 con 0x557a3abeddc0 2024-09-19T04:53:43.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.960+0000 7ffa642f3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x557a3aaface0 con 0x557a3abed4a0 2024-09-19T04:53:43.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.960+0000 7ffa642f3740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x557a3ab4f2a0 con 0x557a3abf8680 2024-09-19T04:53:43.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.960+0000 7ffa5b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a3abeddc0 0x557a3abf8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:43.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.960+0000 7ffa5b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a3abeddc0 0x557a3abf8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52590/0 (socket says 172.21.15.2:52590) 2024-09-19T04:53:43.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.960+0000 7ffa5b7fe640 1 -- 172.21.15.2:0/2615865416 learned_addr learned my addr 172.21.15.2:0/2615865416 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:53:43.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.960+0000 7ffa597fa640 1 --2- 172.21.15.2:0/2183901403 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7ffa480a33b0 0x7ffa480a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:43.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.960+0000 7ffa53fff640 1 --2- 172.21.15.2:0/2615865416 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557a3abf8680 0x557a3abfaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:43.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.960+0000 7ffa53fff640 1 --2- 172.21.15.2:0/2615865416 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a3abed4a0 0x557a3abed880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:43.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.960+0000 7ffa5b7fe640 1 -- 172.21.15.2:0/2615865416 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557a3abf8680 msgr2=0x557a3abfaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:43.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.960+0000 7ffa5b7fe640 1 --2- 172.21.15.2:0/2615865416 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557a3abf8680 0x557a3abfaa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:43.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.960+0000 7ffa5b7fe640 1 -- 172.21.15.2:0/2615865416 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a3abed4a0 msgr2=0x557a3abed880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:43.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.960+0000 7ffa5b7fe640 1 --2- 172.21.15.2:0/2615865416 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a3abed4a0 0x557a3abed880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:43.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.960+0000 7ffa5b7fe640 1 -- 172.21.15.2:0/2615865416 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a3aadf440 con 0x557a3abeddc0 2024-09-19T04:53:43.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.960+0000 7ffa53fff640 1 --2- 172.21.15.2:0/2615865416 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557a3abf8680 0x557a3abfaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:53:43.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.960+0000 7ffa5bfff640 1 --2- 172.21.15.2:0/2183901403 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7ffa480a33b0 0x7ffa480a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:43.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.961+0000 7ffa5b7fe640 1 --2- 172.21.15.2:0/2615865416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a3abeddc0 0x557a3abf8140 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c02aa10 tx=0x7ffa4c004310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e3f63a48e5151e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:53:43.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.961+0000 7ffa597fa640 1 -- 172.21.15.2:0/2183901403 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7ffa540cfe80 con 0x7ffa5c106a80 2024-09-19T04:53:43.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.961+0000 7ffa51ffb640 1 -- 172.21.15.2:0/2615865416 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c035040 con 0x557a3abeddc0 2024-09-19T04:53:43.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.961+0000 7ffa51ffb640 1 -- 172.21.15.2:0/2615865416 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffa4c004750 con 0x557a3abeddc0 2024-09-19T04:53:43.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.961+0000 7ffa51ffb640 1 -- 172.21.15.2:0/2615865416 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c003850 con 0x557a3abeddc0 2024-09-19T04:53:43.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.961+0000 7ffa642f3740 1 -- 172.21.15.2:0/2615865416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a3abeddc0 msgr2=0x557a3abf8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:43.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.961+0000 7ffa642f3740 1 --2- 172.21.15.2:0/2615865416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a3abeddc0 0x557a3abf8140 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c02aa10 tx=0x7ffa4c004310 comp rx=0 tx=0).stop 2024-09-19T04:53:43.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.961+0000 7ffa5bfff640 1 --2- 172.21.15.2:0/2183901403 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7ffa480a33b0 0x7ffa480a5870 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ffa5409be20 tx=0x7ffa540984a0 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:53:43.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.962+0000 7ffa642f3740 1 -- 172.21.15.2:0/2615865416 shutdown_connections 2024-09-19T04:53:43.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.962+0000 7ffa642f3740 1 --2- 172.21.15.2:0/2615865416 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557a3abf8680 0x557a3abfaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:43.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.962+0000 7ffa642f3740 1 --2- 172.21.15.2:0/2615865416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a3abeddc0 0x557a3abf8140 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:43.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.962+0000 7ffa642f3740 1 --2- 172.21.15.2:0/2615865416 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a3abed4a0 0x557a3abed880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:43.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.962+0000 7ffa642f3740 1 -- 172.21.15.2:0/2615865416 >> 172.21.15.2:0/2615865416 conn(0x557a3abe9a30 msgr2=0x557a3abe9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:53:43.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.962+0000 7ffa642f3740 1 -- 172.21.15.2:0/2615865416 shutdown_connections 2024-09-19T04:53:43.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.962+0000 7ffa642f3740 1 -- 172.21.15.2:0/2615865416 wait complete. 2024-09-19T04:53:43.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.962+0000 7ffa642f3740 1 -- start start 2024-09-19T04:53:43.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.962+0000 7ffa642f3740 1 Processor -- start 2024-09-19T04:53:43.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.962+0000 7ffa642f3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a3abed4a0 0x557a3abf80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:43.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.962+0000 7ffa642f3740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557a3abeddc0 0x557a3abf5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:43.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.962+0000 7ffa642f3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a3abf8680 0x557a3abf5b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:43.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.962+0000 7ffa642f3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557a3abff570 con 0x557a3abf8680 2024-09-19T04:53:43.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.962+0000 7ffa642f3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x557a3ab0e050 con 0x557a3abed4a0 2024-09-19T04:53:43.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.962+0000 7ffa642f3740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x557a3abff6f0 con 0x557a3abeddc0 2024-09-19T04:53:43.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.962+0000 7ffa642f3740 10 client.0 _ll_register_callbacks cb 0x557a3ab4e160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:53:43.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.963+0000 7ffa53fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a3abf8680 0x557a3abf5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:43.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.963+0000 7ffa53fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a3abf8680 0x557a3abf5b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52600/0 (socket says 172.21.15.2:52600) 2024-09-19T04:53:43.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.963+0000 7ffa53fff640 1 -- 172.21.15.2:0/285285143 learned_addr learned my addr 172.21.15.2:0/285285143 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:53:43.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.963+0000 7ffa53fff640 1 --2- 172.21.15.2:0/285285143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a3abed4a0 0x557a3abf80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:43.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.963+0000 7ffa5b7fe640 1 --2- 172.21.15.2:0/285285143 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557a3abeddc0 0x557a3abf5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:43.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.963+0000 7ffa53fff640 1 -- 172.21.15.2:0/285285143 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557a3abeddc0 msgr2=0x557a3abf5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:43.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.963+0000 7ffa53fff640 1 --2- 172.21.15.2:0/285285143 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557a3abeddc0 0x557a3abf5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:43.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.963+0000 7ffa53fff640 1 -- 172.21.15.2:0/285285143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a3abed4a0 msgr2=0x557a3abf80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:43.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.963+0000 7ffa53fff640 1 --2- 172.21.15.2:0/285285143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a3abed4a0 0x557a3abf80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:43.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.963+0000 7ffa53fff640 1 -- 172.21.15.2:0/285285143 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a3a8c43c0 con 0x557a3abf8680 2024-09-19T04:53:43.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.963+0000 7ffa53fff640 1 --2- 172.21.15.2:0/285285143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a3abf8680 0x557a3abf5b10 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7ffa440104a0 tx=0x7ffa44004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e247f75d3c65d220 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:53:43.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.963+0000 7ffa3affd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:53:43.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.963+0000 7ffa3affd640 1 -- 172.21.15.2:0/285285143 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa44005020 con 0x557a3abf8680 2024-09-19T04:53:43.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.963+0000 7ffa642f3740 1 -- 172.21.15.2:0/285285143 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa4c004750 con 0x557a3abf8680 2024-09-19T04:53:43.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.963+0000 7ffa3affd640 1 -- 172.21.15.2:0/285285143 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7ffa440051c0 con 0x557a3abf8680 2024-09-19T04:53:43.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.963+0000 7ffa3affd640 1 -- 172.21.15.2:0/285285143 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ffa440055d0 con 0x557a3abf8680 2024-09-19T04:53:43.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.963+0000 7ffa642f3740 10 client.16080 fetch_fsmap learned FSMap version 19 2024-09-19T04:53:43.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.963+0000 7ffa642f3740 1 -- 172.21.15.2:0/285285143 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x557a3ac0b060 con 0x557a3abf8680 2024-09-19T04:53:43.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.964+0000 7ffa3affd640 1 -- 172.21.15.2:0/285285143 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffa4c004750 con 0x557a3abf8680 2024-09-19T04:53:43.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.964+0000 7ffa3affd640 1 -- 172.21.15.2:0/285285143 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ffa44026020 con 0x557a3abf8680 2024-09-19T04:53:43.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.964+0000 7ffa642f3740 10 client.16080 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:53:43.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.964+0000 7ffa642f3740 10 client.16080 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:53:43.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.964+0000 7ffa642f3740 20 client.16080 populate_metadata read hostname 'smithi002' 2024-09-19T04:53:43.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.964+0000 7ffa642f3740 1 --2- 172.21.15.2:0/285285143 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x557a3ac0c470 0x557a3ac0e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:43.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.964+0000 7ffa642f3740 4 client.16080 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:53:43.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.964+0000 7ffa642f3740 1 -- 172.21.15.2:0/285285143 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a3ab60850 con 0x557a3ac0c470 2024-09-19T04:53:43.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.964+0000 7ffa5b7fe640 1 --2- 172.21.15.2:0/285285143 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x557a3ac0c470 0x557a3ac0e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:43.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.965+0000 7ffa3affd640 10 client.16080 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:53:43.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.965+0000 7ffa5b7fe640 1 --2- 172.21.15.2:0/285285143 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x557a3ac0c470 0x557a3ac0e880 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=396ab195b1b7d58e server_cookie=ee9dd500bda29a8a in_seq=0 out_seq=0 2024-09-19T04:53:43.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.965+0000 7ffa3affd640 1 -- 172.21.15.2:0/285285143 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557a3ab60850 con 0x557a3ac0c470 2024-09-19T04:53:43.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.965+0000 7ffa3affd640 10 client.16080 handle_command_reply: tid=0 2024-09-19T04:53:43.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.965+0000 7ffa642f3740 1 client.16080 shutdown 2024-09-19T04:53:43.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.966+0000 7ffa642f3740 1 -- 172.21.15.2:0/285285143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a3abf8680 msgr2=0x557a3abf5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:43.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.966+0000 7ffa642f3740 1 --2- 172.21.15.2:0/285285143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a3abf8680 0x557a3abf5b10 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7ffa440104a0 tx=0x7ffa44004730 comp rx=0 tx=0).stop 2024-09-19T04:53:43.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.966+0000 7ffa642f3740 1 -- 172.21.15.2:0/285285143 shutdown_connections 2024-09-19T04:53:43.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.966+0000 7ffa642f3740 1 --2- 172.21.15.2:0/285285143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a3abf8680 0x557a3abf5b10 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:43.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.966+0000 7ffa642f3740 1 --2- 172.21.15.2:0/285285143 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x557a3ac0c470 0x557a3ac0e880 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:43.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.966+0000 7ffa642f3740 1 --2- 172.21.15.2:0/285285143 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557a3abeddc0 0x557a3abf5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:43.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.966+0000 7ffa642f3740 1 --2- 172.21.15.2:0/285285143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a3abed4a0 0x557a3abf80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:43.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.966+0000 7ffa3affd640 0 client.16080 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:53:43.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.966+0000 7ffa642f3740 1 -- 172.21.15.2:0/285285143 >> 172.21.15.2:0/285285143 conn(0x557a3abe9a30 msgr2=0x557a3abef760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:53:43.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.966+0000 7ffa642f3740 1 -- 172.21.15.2:0/285285143 shutdown_connections 2024-09-19T04:53:43.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.966+0000 7ffa642f3740 1 -- 172.21.15.2:0/285285143 wait complete. 2024-09-19T04:53:43.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.966+0000 7ffa642f3740 20 client.16080 trim_cache size 0 max 16384 2024-09-19T04:53:43.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.983+0000 7ffa642f3740 1 Processor -- start 2024-09-19T04:53:43.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.983+0000 7ffa642f3740 1 -- start start 2024-09-19T04:53:43.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.983+0000 7ffa642f3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a3abed4a0 0x557a3abf4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:43.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.983+0000 7ffa642f3740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557a3abeddc0 0x557a3abf72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:43.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.984+0000 7ffa642f3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a3abf8680 0x557a3ac14150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:43.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.984+0000 7ffa642f3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ffa5c1a9540 con 0x557a3abf8680 2024-09-19T04:53:43.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.984+0000 7ffa642f3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ffa5c1abdc0 con 0x557a3abed4a0 2024-09-19T04:53:43.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.984+0000 7ffa642f3740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7ffa5c1a9bb0 con 0x557a3abeddc0 2024-09-19T04:53:43.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.984+0000 7ffa53fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a3abf8680 0x557a3ac14150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:43.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.984+0000 7ffa53fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a3abf8680 0x557a3ac14150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52610/0 (socket says 172.21.15.2:52610) 2024-09-19T04:53:43.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.984+0000 7ffa53fff640 1 -- 172.21.15.2:0/3898749299 learned_addr learned my addr 172.21.15.2:0/3898749299 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:53:43.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.984+0000 7ffa5b7fe640 1 --2- 172.21.15.2:0/3898749299 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557a3abeddc0 0x557a3abf72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:43.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.984+0000 7ffa53fff640 1 --2- 172.21.15.2:0/3898749299 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a3abed4a0 0x557a3abf4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:43.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.984+0000 7ffa53fff640 1 -- 172.21.15.2:0/3898749299 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557a3abeddc0 msgr2=0x557a3abf72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:43.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.984+0000 7ffa53fff640 1 --2- 172.21.15.2:0/3898749299 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557a3abeddc0 0x557a3abf72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:43.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.984+0000 7ffa53fff640 1 -- 172.21.15.2:0/3898749299 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a3abed4a0 msgr2=0x557a3abf4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:43.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.984+0000 7ffa53fff640 1 --2- 172.21.15.2:0/3898749299 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a3abed4a0 0x557a3abf4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:43.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.984+0000 7ffa53fff640 1 -- 172.21.15.2:0/3898749299 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a3abf8440 con 0x557a3abf8680 2024-09-19T04:53:43.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.984+0000 7ffa5b7fe640 1 --2- 172.21.15.2:0/3898749299 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557a3abeddc0 0x557a3abf72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:53:43.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.984+0000 7ffa53fff640 1 --2- 172.21.15.2:0/3898749299 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a3abf8680 0x557a3ac14150 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7ffa44001eb0 tx=0x7ffa440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54be0232ba0e1944 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:53:43.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.984+0000 7ffa517fa640 1 -- 172.21.15.2:0/3898749299 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa4402f070 con 0x557a3abf8680 2024-09-19T04:53:43.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.984+0000 7ffa517fa640 1 -- 172.21.15.2:0/3898749299 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffa44016040 con 0x557a3abf8680 2024-09-19T04:53:43.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.984+0000 7ffa517fa640 1 -- 172.21.15.2:0/3898749299 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa44011440 con 0x557a3abf8680 2024-09-19T04:53:43.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.985+0000 7ffa642f3740 1 -- 172.21.15.2:0/3898749299 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a3abf8680 msgr2=0x557a3ac14150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:43.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.985+0000 7ffa642f3740 1 --2- 172.21.15.2:0/3898749299 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a3abf8680 0x557a3ac14150 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7ffa44001eb0 tx=0x7ffa440046c0 comp rx=0 tx=0).stop 2024-09-19T04:53:43.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.985+0000 7ffa642f3740 1 -- 172.21.15.2:0/3898749299 shutdown_connections 2024-09-19T04:53:43.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.985+0000 7ffa642f3740 1 --2- 172.21.15.2:0/3898749299 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a3abf8680 0x557a3ac14150 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:43.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.985+0000 7ffa642f3740 1 --2- 172.21.15.2:0/3898749299 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557a3abeddc0 0x557a3abf72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:43.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.985+0000 7ffa642f3740 1 --2- 172.21.15.2:0/3898749299 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a3abed4a0 0x557a3abf4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:43.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.985+0000 7ffa642f3740 1 -- 172.21.15.2:0/3898749299 >> 172.21.15.2:0/3898749299 conn(0x557a3abe9a30 msgr2=0x557a3abf6be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:53:43.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.985+0000 7ffa642f3740 1 -- 172.21.15.2:0/3898749299 shutdown_connections 2024-09-19T04:53:43.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.985+0000 7ffa642f3740 1 -- 172.21.15.2:0/3898749299 wait complete. 2024-09-19T04:53:43.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.986+0000 7ffa642f3740 1 -- start start 2024-09-19T04:53:43.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.986+0000 7ffa642f3740 1 Processor -- start 2024-09-19T04:53:43.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.986+0000 7ffa642f3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a3abed4a0 0x557a3ac007c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:43.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.986+0000 7ffa642f3740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557a3abeddc0 0x557a3ac00d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:43.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.986+0000 7ffa642f3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a3abf8680 0x557a3ac01240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:43.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.986+0000 7ffa642f3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ffa5c1aa280 con 0x557a3abed4a0 2024-09-19T04:53:43.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.986+0000 7ffa642f3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ffa5c1ab6f0 con 0x557a3abf8680 2024-09-19T04:53:43.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.986+0000 7ffa642f3740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7ffa5c1aa950 con 0x557a3abeddc0 2024-09-19T04:53:43.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.986+0000 7ffa642f3740 10 client.0 _ll_register_callbacks cb 0x7ffa4400ca30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:53:43.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.986+0000 7ffa53fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a3abed4a0 0x557a3ac007c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:43.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.986+0000 7ffa53fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a3abed4a0 0x557a3ac007c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52620/0 (socket says 172.21.15.2:52620) 2024-09-19T04:53:43.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.986+0000 7ffa53fff640 1 -- 172.21.15.2:0/3687968797 learned_addr learned my addr 172.21.15.2:0/3687968797 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:53:43.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.986+0000 7ffa5b7fe640 1 --2- 172.21.15.2:0/3687968797 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557a3abeddc0 0x557a3ac00d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:43.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.987+0000 7ffa53fff640 1 -- 172.21.15.2:0/3687968797 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557a3abeddc0 msgr2=0x557a3ac00d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:43.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.987+0000 7ffa53fff640 1 --2- 172.21.15.2:0/3687968797 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557a3abeddc0 0x557a3ac00d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:43.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.987+0000 7ffa53fff640 1 -- 172.21.15.2:0/3687968797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a3abf8680 msgr2=0x557a3ac01240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:53:43.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.987+0000 7ffa53fff640 1 --2- 172.21.15.2:0/3687968797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a3abf8680 0x557a3ac01240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:43.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.987+0000 7ffa53fff640 1 -- 172.21.15.2:0/3687968797 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a3ac761f0 con 0x557a3abed4a0 2024-09-19T04:53:43.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.987+0000 7ffa5b7fe640 1 --2- 172.21.15.2:0/3687968797 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557a3abeddc0 0x557a3ac00d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:53:43.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.987+0000 7ffa53fff640 1 --2- 172.21.15.2:0/3687968797 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a3abed4a0 0x557a3ac007c0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7ffa44010460 tx=0x7ffa4400c6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e1ef5a2aca5db14 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:53:43.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.987+0000 7ffa3affd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:53:43.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.987+0000 7ffa3affd640 1 -- 172.21.15.2:0/3687968797 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa44038060 con 0x557a3abed4a0 2024-09-19T04:53:43.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.987+0000 7ffa3affd640 1 -- 172.21.15.2:0/3687968797 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7ffa44033440 con 0x557a3abed4a0 2024-09-19T04:53:43.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.987+0000 7ffa642f3740 1 -- 172.21.15.2:0/3687968797 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa44016040 con 0x557a3abed4a0 2024-09-19T04:53:43.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.987+0000 7ffa3affd640 1 -- 172.21.15.2:0/3687968797 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ffa4402f040 con 0x557a3abed4a0 2024-09-19T04:53:43.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.987+0000 7ffa642f3740 10 client.16086 fetch_fsmap learned FSMap version 19 2024-09-19T04:53:43.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.987+0000 7ffa642f3740 1 -- 172.21.15.2:0/3687968797 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x557a3ac774e0 con 0x557a3abed4a0 2024-09-19T04:53:43.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.987+0000 7ffa3affd640 1 -- 172.21.15.2:0/3687968797 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffa44016040 con 0x557a3abed4a0 2024-09-19T04:53:43.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.988+0000 7ffa3affd640 1 -- 172.21.15.2:0/3687968797 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ffa44026040 con 0x557a3abed4a0 2024-09-19T04:53:43.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.988+0000 7ffa642f3740 10 client.16086 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:53:43.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.988+0000 7ffa642f3740 10 client.16086 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:53:43.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.988+0000 7ffa642f3740 20 client.16086 populate_metadata read hostname 'smithi002' 2024-09-19T04:53:43.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.988+0000 7ffa642f3740 1 --2- 172.21.15.2:0/3687968797 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x557a3ac77b20 0x557a3ac79f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:53:43.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.988+0000 7ffa642f3740 4 client.16086 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:53:43.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.988+0000 7ffa642f3740 1 -- 172.21.15.2:0/3687968797 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557a3ab5ad60 con 0x557a3ac77b20 2024-09-19T04:53:43.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.988+0000 7ffa5b7fe640 1 --2- 172.21.15.2:0/3687968797 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x557a3ac77b20 0x557a3ac79f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:53:43.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.988+0000 7ffa3affd640 10 client.16086 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:53:43.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.988+0000 7ffa5b7fe640 1 --2- 172.21.15.2:0/3687968797 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x557a3ac77b20 0x557a3ac79f40 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9915663e3383f223 server_cookie=dcb3feb4e761b232 in_seq=0 out_seq=0 2024-09-19T04:53:43.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.988+0000 7ffa3affd640 1 -- 172.21.15.2:0/3687968797 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x557a3ab5ad60 con 0x557a3ac77b20 2024-09-19T04:53:43.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.988+0000 7ffa3affd640 10 client.16086 handle_command_reply: tid=0 2024-09-19T04:53:43.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.988+0000 7ffa642f3740 1 client.16086 shutdown 2024-09-19T04:53:43.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.989+0000 7ffa642f3740 1 -- 172.21.15.2:0/3687968797 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a3abed4a0 msgr2=0x557a3ac007c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:43.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.989+0000 7ffa642f3740 1 --2- 172.21.15.2:0/3687968797 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a3abed4a0 0x557a3ac007c0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7ffa44010460 tx=0x7ffa4400c6d0 comp rx=0 tx=0).stop 2024-09-19T04:53:43.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.989+0000 7ffa642f3740 1 -- 172.21.15.2:0/3687968797 shutdown_connections 2024-09-19T04:53:43.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.989+0000 7ffa642f3740 1 --2- 172.21.15.2:0/3687968797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a3abf8680 0x557a3ac01240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:43.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.989+0000 7ffa642f3740 1 --2- 172.21.15.2:0/3687968797 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x557a3ac77b20 0x557a3ac79f40 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:43.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.989+0000 7ffa642f3740 1 --2- 172.21.15.2:0/3687968797 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557a3abeddc0 0x557a3ac00d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:43.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.989+0000 7ffa642f3740 1 --2- 172.21.15.2:0/3687968797 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557a3abed4a0 0x557a3ac007c0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:43.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.989+0000 7ffa642f3740 1 -- 172.21.15.2:0/3687968797 >> 172.21.15.2:0/3687968797 conn(0x557a3abe9a30 msgr2=0x557a3abf7400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:53:43.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.989+0000 7ffa3affd640 0 client.16086 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:53:43.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.989+0000 7ffa642f3740 1 -- 172.21.15.2:0/3687968797 shutdown_connections 2024-09-19T04:53:43.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.989+0000 7ffa642f3740 1 -- 172.21.15.2:0/3687968797 wait complete. 2024-09-19T04:53:43.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.989+0000 7ffa642f3740 20 client.16086 trim_cache size 0 max 16384 2024-09-19T04:53:43.996 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:53:43.996 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T04:53:43.996 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-19T04:53:43.996 INFO:teuthology.orchestra.run.smithi002.stdout: "b0f9691c-3920-4d20-affb-13aa30757c34": { 2024-09-19T04:53:43.997 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-19T04:53:43.997 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "b0f9691c-3920-4d20-affb-13aa30757c34", 2024-09-19T04:53:43.997 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-19T04:53:43.997 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:53:43.997 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:53:43.997 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:53:43.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.989+0000 7ffa61f1a640 1 -- 172.21.15.2:0/2183901403 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7ffa480a33b0 msgr2=0x7ffa480a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:43.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.989+0000 7ffa61f1a640 1 --2- 172.21.15.2:0/2183901403 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7ffa480a33b0 0x7ffa480a5870 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ffa5409be20 tx=0x7ffa540984a0 comp rx=0 tx=0).stop 2024-09-19T04:53:43.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.989+0000 7ffa61f1a640 1 -- 172.21.15.2:0/2183901403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa5c106a80 msgr2=0x7ffa5c19cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:53:43.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.989+0000 7ffa61f1a640 1 --2- 172.21.15.2:0/2183901403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa5c106a80 0x7ffa5c19cbd0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ffa5400eaa0 tx=0x7ffa5400ef60 comp rx=0 tx=0).stop 2024-09-19T04:53:43.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.990+0000 7ffa61f1a640 1 -- 172.21.15.2:0/2183901403 shutdown_connections 2024-09-19T04:53:43.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.990+0000 7ffa61f1a640 1 --2- 172.21.15.2:0/2183901403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa5c106a80 0x7ffa5c19cbd0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:43.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.990+0000 7ffa61f1a640 1 --2- 172.21.15.2:0/2183901403 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa5c101420 0x7ffa5c198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:43.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.990+0000 7ffa61f1a640 1 --2- 172.21.15.2:0/2183901403 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7ffa480a33b0 0x7ffa480a5870 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:43.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.990+0000 7ffa61f1a640 1 --2- 172.21.15.2:0/2183901403 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa5c100a80 0x7ffa5c198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:53:43.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.990+0000 7ffa61f1a640 1 -- 172.21.15.2:0/2183901403 >> 172.21.15.2:0/2183901403 conn(0x7ffa5c0fc7a0 msgr2=0x7ffa5c104830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:53:43.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.990+0000 7ffa61f1a640 1 -- 172.21.15.2:0/2183901403 shutdown_connections 2024-09-19T04:53:43.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:53:43.990+0000 7ffa61f1a640 1 -- 172.21.15.2:0/2183901403 wait complete. 2024-09-19T04:53:44.609 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:53:44 smithi002 ceph-mon[30975]: scrub queued for path: / 2024-09-19T04:53:44.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:53:44 smithi002 ceph-mon[30975]: scrub summary: idle+waiting paths [/] 2024-09-19T04:53:44.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:53:44 smithi002 ceph-mon[30975]: scrub summary: active paths [/] 2024-09-19T04:53:44.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:53:44 smithi002 ceph-mon[30975]: scrub summary: idle+waiting paths [/] 2024-09-19T04:53:44.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:53:44 smithi002 ceph-mon[30975]: pgmap v175: 97 pgs: 97 active+clean; 7.5 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 30 KiB/s wr, 7 op/s 2024-09-19T04:53:44.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:53:44 smithi116 ceph-mon[34477]: scrub queued for path: / 2024-09-19T04:53:44.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:53:44 smithi116 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-19T04:53:44.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:53:44 smithi116 ceph-mon[34477]: scrub summary: active paths [/] 2024-09-19T04:53:44.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:53:44 smithi116 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-19T04:53:44.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:53:44 smithi116 ceph-mon[34477]: pgmap v175: 97 pgs: 97 active+clean; 7.5 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 30 KiB/s wr, 7 op/s 2024-09-19T04:53:44.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:53:44 smithi018 ceph-mon[34537]: scrub queued for path: / 2024-09-19T04:53:44.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:53:44 smithi018 ceph-mon[34537]: scrub summary: idle+waiting paths [/] 2024-09-19T04:53:44.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:53:44 smithi018 ceph-mon[34537]: scrub summary: active paths [/] 2024-09-19T04:53:44.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:53:44 smithi018 ceph-mon[34537]: scrub summary: idle+waiting paths [/] 2024-09-19T04:53:44.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:53:44 smithi018 ceph-mon[34537]: pgmap v175: 97 pgs: 97 active+clean; 7.5 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 30 KiB/s wr, 7 op/s 2024-09-19T04:53:45.022 INFO:tasks.cephfs.filesystem:scrub status for tag:b0f9691c-3920-4d20-affb-13aa30757c34 - {'path': '/', 'tag': 'b0f9691c-3920-4d20-affb-13aa30757c34', 'options': 'recursive,force'} 2024-09-19T04:53:46.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:53:46 smithi002 ceph-mon[30975]: pgmap v176: 97 pgs: 97 active+clean; 7.7 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 45 KiB/s wr, 11 op/s 2024-09-19T04:53:46.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:53:46 smithi002 ceph-mon[30975]: scrub summary: idle 2024-09-19T04:53:46.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:53:46 smithi116 ceph-mon[34477]: pgmap v176: 97 pgs: 97 active+clean; 7.7 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 45 KiB/s wr, 11 op/s 2024-09-19T04:53:46.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:53:46 smithi116 ceph-mon[34477]: scrub summary: idle 2024-09-19T04:53:46.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:53:46 smithi018 ceph-mon[34537]: pgmap v176: 97 pgs: 97 active+clean; 7.7 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 45 KiB/s wr, 11 op/s 2024-09-19T04:53:46.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:53:46 smithi018 ceph-mon[34537]: scrub summary: idle 2024-09-19T04:53:48.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:53:48 smithi002 ceph-mon[30975]: pgmap v177: 97 pgs: 97 active+clean; 7.7 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 29 KiB/s wr, 7 op/s 2024-09-19T04:53:48.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:53:48 smithi116 ceph-mon[34477]: pgmap v177: 97 pgs: 97 active+clean; 7.7 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 29 KiB/s wr, 7 op/s 2024-09-19T04:53:48.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:53:48 smithi018 ceph-mon[34537]: pgmap v177: 97 pgs: 97 active+clean; 7.7 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 29 KiB/s wr, 7 op/s 2024-09-19T04:53:50.609 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:53:50 smithi018 ceph-mon[34537]: pgmap v178: 97 pgs: 97 active+clean; 7.7 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 29 KiB/s wr, 7 op/s 2024-09-19T04:53:50.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:53:50 smithi002 ceph-mon[30975]: pgmap v178: 97 pgs: 97 active+clean; 7.7 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 29 KiB/s wr, 7 op/s 2024-09-19T04:53:50.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:53:50 smithi116 ceph-mon[34477]: pgmap v178: 97 pgs: 97 active+clean; 7.7 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 29 KiB/s wr, 7 op/s 2024-09-19T04:53:52.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:53:52 smithi002 ceph-mon[30975]: pgmap v179: 97 pgs: 97 active+clean; 7.8 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 43 KiB/s wr, 10 op/s 2024-09-19T04:53:52.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:53:52 smithi116 ceph-mon[34477]: pgmap v179: 97 pgs: 97 active+clean; 7.8 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 43 KiB/s wr, 10 op/s 2024-09-19T04:53:52.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:53:52 smithi018 ceph-mon[34537]: pgmap v179: 97 pgs: 97 active+clean; 7.8 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 43 KiB/s wr, 10 op/s 2024-09-19T04:53:54.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:53:54 smithi002 ceph-mon[30975]: pgmap v180: 97 pgs: 97 active+clean; 7.8 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 29 KiB/s wr, 7 op/s 2024-09-19T04:53:54.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:53:54 smithi116 ceph-mon[34477]: pgmap v180: 97 pgs: 97 active+clean; 7.8 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 29 KiB/s wr, 7 op/s 2024-09-19T04:53:54.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:53:54 smithi018 ceph-mon[34537]: pgmap v180: 97 pgs: 97 active+clean; 7.8 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 29 KiB/s wr, 7 op/s 2024-09-19T04:53:56.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:53:56 smithi002 ceph-mon[30975]: pgmap v181: 97 pgs: 97 active+clean; 8.0 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 44 KiB/s wr, 11 op/s 2024-09-19T04:53:56.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:53:56 smithi116 ceph-mon[34477]: pgmap v181: 97 pgs: 97 active+clean; 8.0 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 44 KiB/s wr, 11 op/s 2024-09-19T04:53:56.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:53:56 smithi018 ceph-mon[34537]: pgmap v181: 97 pgs: 97 active+clean; 8.0 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 44 KiB/s wr, 11 op/s 2024-09-19T04:53:58.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:53:58 smithi002 ceph-mon[30975]: pgmap v182: 97 pgs: 97 active+clean; 8.0 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 28 KiB/s wr, 7 op/s 2024-09-19T04:53:58.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:53:58 smithi116 ceph-mon[34477]: pgmap v182: 97 pgs: 97 active+clean; 8.0 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 28 KiB/s wr, 7 op/s 2024-09-19T04:53:58.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:53:58 smithi018 ceph-mon[34537]: pgmap v182: 97 pgs: 97 active+clean; 8.0 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 28 KiB/s wr, 7 op/s 2024-09-19T04:54:00.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:54:00 smithi002 ceph-mon[30975]: pgmap v183: 97 pgs: 97 active+clean; 8.0 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 28 KiB/s wr, 7 op/s 2024-09-19T04:54:00.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:54:00 smithi116 ceph-mon[34477]: pgmap v183: 97 pgs: 97 active+clean; 8.0 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 28 KiB/s wr, 7 op/s 2024-09-19T04:54:00.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:54:00 smithi018 ceph-mon[34537]: pgmap v183: 97 pgs: 97 active+clean; 8.0 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 28 KiB/s wr, 7 op/s 2024-09-19T04:54:02.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:54:02 smithi018 ceph-mon[34537]: pgmap v184: 97 pgs: 97 active+clean; 8.1 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 64 KiB/s wr, 25 op/s 2024-09-19T04:54:02.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:54:02 smithi002 ceph-mon[30975]: pgmap v184: 97 pgs: 97 active+clean; 8.1 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 64 KiB/s wr, 25 op/s 2024-09-19T04:54:02.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:54:02 smithi116 ceph-mon[34477]: pgmap v184: 97 pgs: 97 active+clean; 8.1 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 64 KiB/s wr, 25 op/s 2024-09-19T04:54:04.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:54:04 smithi018 ceph-mon[34537]: pgmap v185: 97 pgs: 97 active+clean; 8.1 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 51 KiB/s wr, 21 op/s 2024-09-19T04:54:04.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:54:04 smithi002 ceph-mon[30975]: pgmap v185: 97 pgs: 97 active+clean; 8.1 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 51 KiB/s wr, 21 op/s 2024-09-19T04:54:04.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:54:04 smithi116 ceph-mon[34477]: pgmap v185: 97 pgs: 97 active+clean; 8.1 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 51 KiB/s wr, 21 op/s 2024-09-19T04:54:06.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:54:06 smithi018 ceph-mon[34537]: pgmap v186: 97 pgs: 97 active+clean; 8.3 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 70 KiB/s wr, 25 op/s 2024-09-19T04:54:06.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:54:06 smithi002 ceph-mon[30975]: pgmap v186: 97 pgs: 97 active+clean; 8.3 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 70 KiB/s wr, 25 op/s 2024-09-19T04:54:06.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:54:06 smithi116 ceph-mon[34477]: pgmap v186: 97 pgs: 97 active+clean; 8.3 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 70 KiB/s wr, 25 op/s 2024-09-19T04:54:08.662 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:54:08 smithi002 ceph-mon[30975]: pgmap v187: 97 pgs: 97 active+clean; 8.3 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 56 KiB/s wr, 22 op/s 2024-09-19T04:54:08.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:54:08 smithi018 ceph-mon[34537]: pgmap v187: 97 pgs: 97 active+clean; 8.3 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 56 KiB/s wr, 22 op/s 2024-09-19T04:54:08.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:54:08 smithi116 ceph-mon[34477]: pgmap v187: 97 pgs: 97 active+clean; 8.3 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 56 KiB/s wr, 22 op/s 2024-09-19T04:54:10.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:54:10 smithi018 ceph-mon[34537]: pgmap v188: 97 pgs: 97 active+clean; 8.3 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 56 KiB/s wr, 22 op/s 2024-09-19T04:54:10.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:54:10 smithi002 ceph-mon[30975]: pgmap v188: 97 pgs: 97 active+clean; 8.3 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 56 KiB/s wr, 22 op/s 2024-09-19T04:54:10.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:54:10 smithi116 ceph-mon[34477]: pgmap v188: 97 pgs: 97 active+clean; 8.3 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 56 KiB/s wr, 22 op/s 2024-09-19T04:54:12.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:54:12 smithi018 ceph-mon[34537]: pgmap v189: 97 pgs: 97 active+clean; 8.5 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 71 KiB/s wr, 25 op/s 2024-09-19T04:54:12.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:54:12 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:54:12.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:54:12 smithi002 ceph-mon[30975]: pgmap v189: 97 pgs: 97 active+clean; 8.5 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 71 KiB/s wr, 25 op/s 2024-09-19T04:54:12.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:54:12 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:54:12.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:54:12 smithi116 ceph-mon[34477]: pgmap v189: 97 pgs: 97 active+clean; 8.5 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 71 KiB/s wr, 25 op/s 2024-09-19T04:54:12.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:54:12 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:54:13.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:54:13 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:54:13.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:54:13 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:54:13.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:54:13 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:54:13.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:54:13 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:54:13.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:54:13 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:54:13.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:54:13 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:54:13.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:54:13 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:54:13.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:54:13 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:54:13.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:54:13 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:54:14.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:54:14 smithi002 ceph-mon[30975]: pgmap v190: 97 pgs: 97 active+clean; 8.5 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 KiB/s wr, 7 op/s 2024-09-19T04:54:14.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:54:14 smithi116 ceph-mon[34477]: pgmap v190: 97 pgs: 97 active+clean; 8.5 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 KiB/s wr, 7 op/s 2024-09-19T04:54:15.023 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:54:15.056 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:54:14 smithi018 ceph-mon[34537]: pgmap v190: 97 pgs: 97 active+clean; 8.5 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 KiB/s wr, 7 op/s 2024-09-19T04:54:15.297 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:54:15.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.781+0000 7f37f9156640 1 -- 172.21.15.2:0/2451734932 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37f4101de0 msgr2=0x7f37f41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:15.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.781+0000 7f37f9156640 1 --2- 172.21.15.2:0/2451734932 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37f4101de0 0x7f37f41021c0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f37e4009900 tx=0x7f37e402a410 comp rx=0 tx=0).stop 2024-09-19T04:54:15.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.781+0000 7f37f9156640 1 -- 172.21.15.2:0/2451734932 shutdown_connections 2024-09-19T04:54:15.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.781+0000 7f37f9156640 1 --2- 172.21.15.2:0/2451734932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37f4106f10 0x7f37f410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:15.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.781+0000 7f37f9156640 1 --2- 172.21.15.2:0/2451734932 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f37f4102790 0x7f37f41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:15.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.781+0000 7f37f9156640 1 --2- 172.21.15.2:0/2451734932 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37f4101de0 0x7f37f41021c0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:15.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.781+0000 7f37f9156640 1 -- 172.21.15.2:0/2451734932 >> 172.21.15.2:0/2451734932 conn(0x7f37f40fd8c0 msgr2=0x7f37f40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:54:15.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.781+0000 7f37f9156640 1 -- 172.21.15.2:0/2451734932 shutdown_connections 2024-09-19T04:54:15.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.781+0000 7f37f9156640 1 -- 172.21.15.2:0/2451734932 wait complete. 2024-09-19T04:54:15.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.782+0000 7f37f9156640 1 Processor -- start 2024-09-19T04:54:15.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.782+0000 7f37f9156640 1 -- start start 2024-09-19T04:54:15.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.783+0000 7f37f9156640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37f4101de0 0x7f37f4198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:15.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.783+0000 7f37f9156640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f37f4102790 0x7f37f41988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:15.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.783+0000 7f37f9156640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37f4106f10 0x7f37f419cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:15.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.783+0000 7f37f9156640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f37f4111e20 con 0x7f37f4101de0 2024-09-19T04:54:15.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.783+0000 7f37f9156640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f37f4111ca0 con 0x7f37f4106f10 2024-09-19T04:54:15.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.783+0000 7f37f9156640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f37f4111fa0 con 0x7f37f4102790 2024-09-19T04:54:15.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.783+0000 7f37f2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37f4101de0 0x7f37f4198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:15.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.783+0000 7f37f2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37f4101de0 0x7f37f4198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50556/0 (socket says 172.21.15.2:50556) 2024-09-19T04:54:15.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.783+0000 7f37f2d9d640 1 -- 172.21.15.2:0/2069877712 learned_addr learned my addr 172.21.15.2:0/2069877712 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:54:15.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.783+0000 7f37f359e640 1 --2- 172.21.15.2:0/2069877712 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37f4106f10 0x7f37f419cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:15.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.783+0000 7f37f259c640 1 --2- 172.21.15.2:0/2069877712 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f37f4102790 0x7f37f41988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:15.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.783+0000 7f37f2d9d640 1 -- 172.21.15.2:0/2069877712 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f37f4102790 msgr2=0x7f37f41988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:15.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.783+0000 7f37f2d9d640 1 --2- 172.21.15.2:0/2069877712 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f37f4102790 0x7f37f41988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:15.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.783+0000 7f37f2d9d640 1 -- 172.21.15.2:0/2069877712 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37f4106f10 msgr2=0x7f37f419cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:15.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.783+0000 7f37f2d9d640 1 --2- 172.21.15.2:0/2069877712 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37f4106f10 0x7f37f419cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:15.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.783+0000 7f37f2d9d640 1 -- 172.21.15.2:0/2069877712 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37f419d330 con 0x7f37f4101de0 2024-09-19T04:54:15.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.783+0000 7f37f259c640 1 --2- 172.21.15.2:0/2069877712 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f37f4102790 0x7f37f41988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:54:15.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.783+0000 7f37f2d9d640 1 --2- 172.21.15.2:0/2069877712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37f4101de0 0x7f37f4198380 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f37e4005940 tx=0x7f37e4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:54:15.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.784+0000 7f37dbfff640 1 -- 172.21.15.2:0/2069877712 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e403f030 con 0x7f37f4101de0 2024-09-19T04:54:15.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.784+0000 7f37f9156640 1 -- 172.21.15.2:0/2069877712 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37f419d5c0 con 0x7f37f4101de0 2024-09-19T04:54:15.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.784+0000 7f37dbfff640 1 -- 172.21.15.2:0/2069877712 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f37e4003aa0 con 0x7f37f4101de0 2024-09-19T04:54:15.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.784+0000 7f37dbfff640 1 -- 172.21.15.2:0/2069877712 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e4035070 con 0x7f37f4101de0 2024-09-19T04:54:15.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.784+0000 7f37f9156640 1 -- 172.21.15.2:0/2069877712 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37f41a4f00 con 0x7f37f4101de0 2024-09-19T04:54:15.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.786+0000 7f37dbfff640 1 -- 172.21.15.2:0/2069877712 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f37e4042030 con 0x7f37f4101de0 2024-09-19T04:54:15.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.786+0000 7f37fb52f740 1 Processor -- start 2024-09-19T04:54:15.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.786+0000 7f37fb52f740 1 -- start start 2024-09-19T04:54:15.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.787+0000 7f37dbfff640 1 --2- 172.21.15.2:0/2069877712 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f37dc0a33b0 0x7f37dc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:15.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.787+0000 7f37fb52f740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5647f7aa38b0 0x5647f7aa3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:15.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.787+0000 7f37fb52f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647f7aa41d0 0x5647f7aae550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:15.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.787+0000 7f37fb52f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647f7aaea90 0x5647f7ab0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:15.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.787+0000 7f37fb52f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5647f7a052e0 con 0x5647f7aa41d0 2024-09-19T04:54:15.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.787+0000 7f37fb52f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5647f79acce0 con 0x5647f7aaea90 2024-09-19T04:54:15.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.787+0000 7f37fb52f740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5647f7a012a0 con 0x5647f7aa38b0 2024-09-19T04:54:15.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.787+0000 7f37f259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647f7aa41d0 0x5647f7aae550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:15.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.787+0000 7f37f259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647f7aa41d0 0x5647f7aae550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50568/0 (socket says 172.21.15.2:50568) 2024-09-19T04:54:15.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.787+0000 7f37dbfff640 1 -- 172.21.15.2:0/2069877712 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f37e40f04f0 con 0x7f37f4101de0 2024-09-19T04:54:15.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.787+0000 7f37f259c640 1 -- 172.21.15.2:0/3110083337 learned_addr learned my addr 172.21.15.2:0/3110083337 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:54:15.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.787+0000 7f37f359e640 1 --2- 172.21.15.2:0/2069877712 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f37dc0a33b0 0x7f37dc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:15.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.787+0000 7f37f359e640 1 --2- 172.21.15.2:0/3110083337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647f7aaea90 0x5647f7ab0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:15.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.787+0000 7f37f2d9d640 1 --2- 172.21.15.2:0/3110083337 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5647f7aa38b0 0x5647f7aa3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:15.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.787+0000 7f37f259c640 1 -- 172.21.15.2:0/3110083337 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5647f7aa38b0 msgr2=0x5647f7aa3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:54:15.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.787+0000 7f37f259c640 1 --2- 172.21.15.2:0/3110083337 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5647f7aa38b0 0x5647f7aa3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:15.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.787+0000 7f37f259c640 1 -- 172.21.15.2:0/3110083337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647f7aaea90 msgr2=0x5647f7ab0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:54:15.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.787+0000 7f37f259c640 1 --2- 172.21.15.2:0/3110083337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647f7aaea90 0x5647f7ab0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:15.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.787+0000 7f37f259c640 1 -- 172.21.15.2:0/3110083337 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647f7991440 con 0x5647f7aa41d0 2024-09-19T04:54:15.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.787+0000 7f37f359e640 1 --2- 172.21.15.2:0/2069877712 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f37dc0a33b0 0x7f37dc0a5870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f37ec005fd0 tx=0x7f37ec014b70 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:54:15.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.787+0000 7f37f259c640 1 --2- 172.21.15.2:0/3110083337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647f7aa41d0 0x5647f7aae550 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f37e8009c20 tx=0x7f37e800e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=885a209588bc431f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:54:15.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.788+0000 7f37d97fa640 1 -- 172.21.15.2:0/3110083337 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e8016070 con 0x5647f7aa41d0 2024-09-19T04:54:15.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.788+0000 7f37d97fa640 1 -- 172.21.15.2:0/3110083337 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f37e8011920 con 0x5647f7aa41d0 2024-09-19T04:54:15.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.788+0000 7f37d97fa640 1 -- 172.21.15.2:0/3110083337 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e8010750 con 0x5647f7aa41d0 2024-09-19T04:54:15.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.788+0000 7f37fb52f740 1 -- 172.21.15.2:0/3110083337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647f7aa41d0 msgr2=0x5647f7aae550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:15.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.788+0000 7f37fb52f740 1 --2- 172.21.15.2:0/3110083337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647f7aa41d0 0x5647f7aae550 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f37e8009c20 tx=0x7f37e800e6c0 comp rx=0 tx=0).stop 2024-09-19T04:54:15.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.788+0000 7f37fb52f740 1 -- 172.21.15.2:0/3110083337 shutdown_connections 2024-09-19T04:54:15.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.788+0000 7f37fb52f740 1 --2- 172.21.15.2:0/3110083337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647f7aaea90 0x5647f7ab0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:15.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.788+0000 7f37fb52f740 1 --2- 172.21.15.2:0/3110083337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647f7aa41d0 0x5647f7aae550 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:15.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.788+0000 7f37fb52f740 1 --2- 172.21.15.2:0/3110083337 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5647f7aa38b0 0x5647f7aa3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:15.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.788+0000 7f37fb52f740 1 -- 172.21.15.2:0/3110083337 >> 172.21.15.2:0/3110083337 conn(0x5647f7a9fe40 msgr2=0x5647f7aa0220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:54:15.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.788+0000 7f37fb52f740 1 -- 172.21.15.2:0/3110083337 shutdown_connections 2024-09-19T04:54:15.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.788+0000 7f37fb52f740 1 -- 172.21.15.2:0/3110083337 wait complete. 2024-09-19T04:54:15.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.789+0000 7f37fb52f740 1 -- start start 2024-09-19T04:54:15.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.789+0000 7f37fb52f740 1 Processor -- start 2024-09-19T04:54:15.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.789+0000 7f37fb52f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647f7aa38b0 0x5647f7aae370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:15.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.789+0000 7f37fb52f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647f7aa41d0 0x5647f7aab620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:15.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.789+0000 7f37fb52f740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5647f7aaea90 0x5647f7aabb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:15.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.789+0000 7f37fb52f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5647f7ab1660 con 0x5647f7aa41d0 2024-09-19T04:54:15.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.789+0000 7f37fb52f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5647f79c0050 con 0x5647f7aa38b0 2024-09-19T04:54:15.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.789+0000 7f37fb52f740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5647f7ab17e0 con 0x5647f7aaea90 2024-09-19T04:54:15.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.789+0000 7f37fb52f740 10 client.0 _ll_register_callbacks cb 0x5647f7a00160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:54:15.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.789+0000 7f37f259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647f7aa41d0 0x5647f7aab620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:15.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.789+0000 7f37f259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647f7aa41d0 0x5647f7aab620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50570/0 (socket says 172.21.15.2:50570) 2024-09-19T04:54:15.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.789+0000 7f37f259c640 1 -- 172.21.15.2:0/3999573462 learned_addr learned my addr 172.21.15.2:0/3999573462 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:54:15.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.789+0000 7f37f359e640 1 --2- 172.21.15.2:0/3999573462 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5647f7aaea90 0x5647f7aabb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:15.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.789+0000 7f37f2d9d640 1 --2- 172.21.15.2:0/3999573462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647f7aa38b0 0x5647f7aae370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:15.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.789+0000 7f37f259c640 1 -- 172.21.15.2:0/3999573462 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5647f7aaea90 msgr2=0x5647f7aabb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:54:15.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.789+0000 7f37f259c640 1 --2- 172.21.15.2:0/3999573462 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5647f7aaea90 0x5647f7aabb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:15.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.789+0000 7f37f259c640 1 -- 172.21.15.2:0/3999573462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647f7aa38b0 msgr2=0x5647f7aae370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:54:15.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.790+0000 7f37f259c640 1 --2- 172.21.15.2:0/3999573462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647f7aa38b0 0x5647f7aae370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:15.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.790+0000 7f37f259c640 1 -- 172.21.15.2:0/3999573462 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647f77763c0 con 0x5647f7aa41d0 2024-09-19T04:54:15.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.790+0000 7f37f2d9d640 1 --2- 172.21.15.2:0/3999573462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647f7aa38b0 0x5647f7aae370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:54:15.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.790+0000 7f37f259c640 1 --2- 172.21.15.2:0/3999573462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647f7aa41d0 0x5647f7aab620 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f37e8005940 tx=0x7f37e8009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=639cc5ee849bf0dd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:54:15.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.790+0000 7f37d6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:54:15.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.790+0000 7f37d6ff5640 1 -- 172.21.15.2:0/3999573462 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e8028060 con 0x5647f7aa41d0 2024-09-19T04:54:15.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.790+0000 7f37d6ff5640 1 -- 172.21.15.2:0/3999573462 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f37e8005040 con 0x5647f7aa41d0 2024-09-19T04:54:15.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.790+0000 7f37fb52f740 1 -- 172.21.15.2:0/3999573462 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37e8011920 con 0x5647f7aa41d0 2024-09-19T04:54:15.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.790+0000 7f37d6ff5640 1 -- 172.21.15.2:0/3999573462 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f37e8016070 con 0x5647f7aa41d0 2024-09-19T04:54:15.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.790+0000 7f37fb52f740 10 client.16098 fetch_fsmap learned FSMap version 19 2024-09-19T04:54:15.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.790+0000 7f37fb52f740 1 -- 172.21.15.2:0/3999573462 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5647f7abd030 con 0x5647f7aa41d0 2024-09-19T04:54:15.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.790+0000 7f37d6ff5640 1 -- 172.21.15.2:0/3999573462 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f37e8011920 con 0x5647f7aa41d0 2024-09-19T04:54:15.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.790+0000 7f37d6ff5640 1 -- 172.21.15.2:0/3999573462 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f37e800f040 con 0x5647f7aa41d0 2024-09-19T04:54:15.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.790+0000 7f37fb52f740 10 client.16098 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:54:15.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.790+0000 7f37fb52f740 10 client.16098 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:54:15.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.790+0000 7f37fb52f740 20 client.16098 populate_metadata read hostname 'smithi002' 2024-09-19T04:54:15.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.790+0000 7f37fb52f740 1 --2- 172.21.15.2:0/3999573462 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5647f7abe440 0x5647f7ac0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:15.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.790+0000 7f37fb52f740 4 client.16098 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:54:15.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.790+0000 7f37fb52f740 1 -- 172.21.15.2:0/3999573462 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5647f7a12850 con 0x5647f7abe440 2024-09-19T04:54:15.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.791+0000 7f37f2d9d640 1 --2- 172.21.15.2:0/3999573462 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5647f7abe440 0x5647f7ac0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:15.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.791+0000 7f37d6ff5640 10 client.16098 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:54:15.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.791+0000 7f37f2d9d640 1 --2- 172.21.15.2:0/3999573462 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5647f7abe440 0x5647f7ac0830 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2defe15507d3762 server_cookie=1dada917f1ba8908 in_seq=0 out_seq=0 2024-09-19T04:54:15.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.792+0000 7f37d6ff5640 1 -- 172.21.15.2:0/3999573462 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5647f7a12850 con 0x5647f7abe440 2024-09-19T04:54:15.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.792+0000 7f37d6ff5640 10 client.16098 handle_command_reply: tid=0 2024-09-19T04:54:15.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.792+0000 7f37fb52f740 1 client.16098 shutdown 2024-09-19T04:54:15.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.792+0000 7f37fb52f740 1 -- 172.21.15.2:0/3999573462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647f7aa41d0 msgr2=0x5647f7aab620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:15.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.792+0000 7f37fb52f740 1 --2- 172.21.15.2:0/3999573462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647f7aa41d0 0x5647f7aab620 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f37e8005940 tx=0x7f37e8009880 comp rx=0 tx=0).stop 2024-09-19T04:54:15.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.792+0000 7f37fb52f740 1 -- 172.21.15.2:0/3999573462 shutdown_connections 2024-09-19T04:54:15.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.792+0000 7f37fb52f740 1 --2- 172.21.15.2:0/3999573462 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5647f7abe440 0x5647f7ac0830 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:15.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.792+0000 7f37fb52f740 1 --2- 172.21.15.2:0/3999573462 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5647f7aaea90 0x5647f7aabb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:15.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.792+0000 7f37fb52f740 1 --2- 172.21.15.2:0/3999573462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647f7aa41d0 0x5647f7aab620 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:15.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.792+0000 7f37d6ff5640 0 client.16098 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:54:15.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.792+0000 7f37fb52f740 1 --2- 172.21.15.2:0/3999573462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647f7aa38b0 0x5647f7aae370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:15.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.792+0000 7f37fb52f740 1 -- 172.21.15.2:0/3999573462 >> 172.21.15.2:0/3999573462 conn(0x5647f7a9fe40 msgr2=0x5647f7a9ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:54:15.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.792+0000 7f37fb52f740 1 -- 172.21.15.2:0/3999573462 shutdown_connections 2024-09-19T04:54:15.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.792+0000 7f37fb52f740 1 -- 172.21.15.2:0/3999573462 wait complete. 2024-09-19T04:54:15.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.792+0000 7f37fb52f740 20 client.16098 trim_cache size 0 max 16384 2024-09-19T04:54:15.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.810+0000 7f37fb52f740 1 Processor -- start 2024-09-19T04:54:15.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.810+0000 7f37fb52f740 1 -- start start 2024-09-19T04:54:15.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.810+0000 7f37fb52f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647f7aa38b0 0x5647f7aaa5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:15.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.810+0000 7f37fb52f740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5647f7aa41d0 0x5647f7ac5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:15.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.810+0000 7f37fb52f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647f7aaea90 0x5647f7ac6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:15.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.810+0000 7f37fb52f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f37f41a9550 con 0x5647f7aaea90 2024-09-19T04:54:15.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.810+0000 7f37fb52f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f37f41abdd0 con 0x5647f7aa38b0 2024-09-19T04:54:15.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.810+0000 7f37fb52f740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f37f41a9bc0 con 0x5647f7aa41d0 2024-09-19T04:54:15.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.810+0000 7f37f359e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647f7aaea90 0x5647f7ac6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:15.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.810+0000 7f37f359e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647f7aaea90 0x5647f7ac6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50574/0 (socket says 172.21.15.2:50574) 2024-09-19T04:54:15.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.810+0000 7f37f359e640 1 -- 172.21.15.2:0/2427512337 learned_addr learned my addr 172.21.15.2:0/2427512337 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:54:15.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.810+0000 7f37f2d9d640 1 --2- 172.21.15.2:0/2427512337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647f7aa38b0 0x5647f7aaa5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:15.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.810+0000 7f37f259c640 1 --2- 172.21.15.2:0/2427512337 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5647f7aa41d0 0x5647f7ac5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:15.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.810+0000 7f37f359e640 1 -- 172.21.15.2:0/2427512337 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5647f7aa41d0 msgr2=0x5647f7ac5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:54:15.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.810+0000 7f37f359e640 1 --2- 172.21.15.2:0/2427512337 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5647f7aa41d0 0x5647f7ac5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:15.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.811+0000 7f37f359e640 1 -- 172.21.15.2:0/2427512337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647f7aa38b0 msgr2=0x5647f7aaa5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:54:15.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.811+0000 7f37f359e640 1 --2- 172.21.15.2:0/2427512337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647f7aa38b0 0x5647f7aaa5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:15.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.811+0000 7f37f359e640 1 -- 172.21.15.2:0/2427512337 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647f7a9fc70 con 0x5647f7aaea90 2024-09-19T04:54:15.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.811+0000 7f37f2d9d640 1 --2- 172.21.15.2:0/2427512337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647f7aa38b0 0x5647f7aaa5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:54:15.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.811+0000 7f37f359e640 1 --2- 172.21.15.2:0/2427512337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647f7aaea90 0x5647f7ac6460 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f37ec012cd0 tx=0x7f37ec01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2384050752bcb0c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:54:15.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.811+0000 7f37d8ff9640 1 -- 172.21.15.2:0/2427512337 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ec0045c0 con 0x5647f7aaea90 2024-09-19T04:54:15.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.811+0000 7f37d8ff9640 1 -- 172.21.15.2:0/2427512337 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f37ec026070 con 0x5647f7aaea90 2024-09-19T04:54:15.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.811+0000 7f37d8ff9640 1 -- 172.21.15.2:0/2427512337 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ec021400 con 0x5647f7aaea90 2024-09-19T04:54:15.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.812+0000 7f37fb52f740 1 -- 172.21.15.2:0/2427512337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647f7aaea90 msgr2=0x5647f7ac6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:15.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.812+0000 7f37fb52f740 1 --2- 172.21.15.2:0/2427512337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647f7aaea90 0x5647f7ac6460 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f37ec012cd0 tx=0x7f37ec01d000 comp rx=0 tx=0).stop 2024-09-19T04:54:15.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.812+0000 7f37fb52f740 1 -- 172.21.15.2:0/2427512337 shutdown_connections 2024-09-19T04:54:15.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.812+0000 7f37fb52f740 1 --2- 172.21.15.2:0/2427512337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647f7aaea90 0x5647f7ac6460 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:15.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.812+0000 7f37fb52f740 1 --2- 172.21.15.2:0/2427512337 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5647f7aa41d0 0x5647f7ac5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:15.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.812+0000 7f37fb52f740 1 --2- 172.21.15.2:0/2427512337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647f7aa38b0 0x5647f7aaa5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:15.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.812+0000 7f37fb52f740 1 -- 172.21.15.2:0/2427512337 >> 172.21.15.2:0/2427512337 conn(0x5647f7a9fe40 msgr2=0x5647f7aad720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:54:15.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.812+0000 7f37fb52f740 1 -- 172.21.15.2:0/2427512337 shutdown_connections 2024-09-19T04:54:15.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.812+0000 7f37fb52f740 1 -- 172.21.15.2:0/2427512337 wait complete. 2024-09-19T04:54:15.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.812+0000 7f37fb52f740 1 -- start start 2024-09-19T04:54:15.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.812+0000 7f37fb52f740 1 Processor -- start 2024-09-19T04:54:15.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.812+0000 7f37fb52f740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5647f7aa38b0 0x5647f7ab72b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:15.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.812+0000 7f37fb52f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647f7aa41d0 0x5647f7ab4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:15.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.812+0000 7f37fb52f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647f7aaea90 0x5647f7ab4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:15.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.813+0000 7f37fb52f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f37f41aa290 con 0x5647f7aaea90 2024-09-19T04:54:15.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.813+0000 7f37fb52f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f37f41ab700 con 0x5647f7aa41d0 2024-09-19T04:54:15.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.813+0000 7f37fb52f740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f37f41aa960 con 0x5647f7aa38b0 2024-09-19T04:54:15.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.813+0000 7f37fb52f740 10 client.0 _ll_register_callbacks cb 0x7f37e8009aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:54:15.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.813+0000 7f37f359e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647f7aaea90 0x5647f7ab4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:15.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.813+0000 7f37f259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647f7aa41d0 0x5647f7ab4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:15.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.813+0000 7f37f259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647f7aa41d0 0x5647f7ab4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.2:32882/0 (socket says 172.21.15.2:32882) 2024-09-19T04:54:15.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.813+0000 7f37f359e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647f7aaea90 0x5647f7ab4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50590/0 (socket says 172.21.15.2:50590) 2024-09-19T04:54:15.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.813+0000 7f37f259c640 1 -- 172.21.15.2:0/519832400 learned_addr learned my addr 172.21.15.2:0/519832400 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:54:15.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.813+0000 7f37f2d9d640 1 --2- 172.21.15.2:0/519832400 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5647f7aa38b0 0x5647f7ab72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:15.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.813+0000 7f37f259c640 1 -- 172.21.15.2:0/519832400 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5647f7aa38b0 msgr2=0x5647f7ab72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:54:15.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.813+0000 7f37f259c640 1 --2- 172.21.15.2:0/519832400 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5647f7aa38b0 0x5647f7ab72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:15.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.813+0000 7f37f259c640 1 -- 172.21.15.2:0/519832400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647f7aaea90 msgr2=0x5647f7ab4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:54:15.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.813+0000 7f37f259c640 1 --2- 172.21.15.2:0/519832400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647f7aaea90 0x5647f7ab4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:15.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.813+0000 7f37f259c640 1 -- 172.21.15.2:0/519832400 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647f7a9b230 con 0x5647f7aa41d0 2024-09-19T04:54:15.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.813+0000 7f37f2d9d640 1 --2- 172.21.15.2:0/519832400 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5647f7aa38b0 0x5647f7ab72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:54:15.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.813+0000 7f37f359e640 1 --2- 172.21.15.2:0/519832400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647f7aaea90 0x5647f7ab4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:54:15.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.813+0000 7f37f259c640 1 --2- 172.21.15.2:0/519832400 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647f7aa41d0 0x5647f7ab4600 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x5647f7aacc60 tx=0x7f37e8010670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7cca273584ad99c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:54:15.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.813+0000 7f37d6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T04:54:15.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.813+0000 7f37d6ff5640 1 -- 172.21.15.2:0/519832400 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e8004a90 con 0x5647f7aa41d0 2024-09-19T04:54:15.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.814+0000 7f37fb52f740 1 -- 172.21.15.2:0/519832400 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37ec026070 con 0x5647f7aa41d0 2024-09-19T04:54:15.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.814+0000 7f37d6ff5640 1 -- 172.21.15.2:0/519832400 <== mon.2 v2:172.21.15.18:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f37e8010900 con 0x5647f7aa41d0 2024-09-19T04:54:15.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.814+0000 7f37d6ff5640 1 -- 172.21.15.2:0/519832400 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f37e8042050 con 0x5647f7aa41d0 2024-09-19T04:54:15.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.814+0000 7f37fb52f740 10 client.25529 fetch_fsmap learned FSMap version 19 2024-09-19T04:54:15.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.814+0000 7f37fb52f740 1 -- 172.21.15.2:0/519832400 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5647f7b28e80 con 0x5647f7aa41d0 2024-09-19T04:54:15.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.814+0000 7f37d6ff5640 1 -- 172.21.15.2:0/519832400 <== mon.2 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f37ec026070 con 0x5647f7aa41d0 2024-09-19T04:54:15.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.814+0000 7f37d6ff5640 1 -- 172.21.15.2:0/519832400 <== mon.2 v2:172.21.15.18:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f37e80053a0 con 0x5647f7aa41d0 2024-09-19T04:54:15.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.814+0000 7f37fb52f740 10 client.25529 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:54:15.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.814+0000 7f37fb52f740 10 client.25529 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:54:15.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.814+0000 7f37fb52f740 20 client.25529 populate_metadata read hostname 'smithi002' 2024-09-19T04:54:15.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.814+0000 7f37fb52f740 1 --2- 172.21.15.2:0/519832400 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5647f7b29590 0x5647f7b2b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:15.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.814+0000 7f37fb52f740 4 client.25529 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:54:15.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.814+0000 7f37fb52f740 1 -- 172.21.15.2:0/519832400 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5647f7a0cd60 con 0x5647f7b29590 2024-09-19T04:54:15.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.815+0000 7f37f2d9d640 1 --2- 172.21.15.2:0/519832400 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5647f7b29590 0x5647f7b2b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:15.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.815+0000 7f37f2d9d640 1 --2- 172.21.15.2:0/519832400 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5647f7b29590 0x5647f7b2b9b0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85b96b0c8962abe server_cookie=fcc120eae3af9a54 in_seq=0 out_seq=0 2024-09-19T04:54:15.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.815+0000 7f37d6ff5640 10 client.25529 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:54:15.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.815+0000 7f37d6ff5640 1 -- 172.21.15.2:0/519832400 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5647f7a0cd60 con 0x5647f7b29590 2024-09-19T04:54:15.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.815+0000 7f37d6ff5640 10 client.25529 handle_command_reply: tid=0 2024-09-19T04:54:15.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.815+0000 7f37fb52f740 1 client.25529 shutdown 2024-09-19T04:54:15.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.815+0000 7f37fb52f740 1 -- 172.21.15.2:0/519832400 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647f7aa41d0 msgr2=0x5647f7ab4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:15.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.815+0000 7f37fb52f740 1 --2- 172.21.15.2:0/519832400 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647f7aa41d0 0x5647f7ab4600 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x5647f7aacc60 tx=0x7f37e8010670 comp rx=0 tx=0).stop 2024-09-19T04:54:15.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.815+0000 7f37fb52f740 1 -- 172.21.15.2:0/519832400 shutdown_connections 2024-09-19T04:54:15.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.815+0000 7f37fb52f740 1 --2- 172.21.15.2:0/519832400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5647f7aaea90 0x5647f7ab4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:15.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.815+0000 7f37fb52f740 1 --2- 172.21.15.2:0/519832400 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647f7aa41d0 0x5647f7ab4600 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:15.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.815+0000 7f37fb52f740 1 --2- 172.21.15.2:0/519832400 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5647f7b29590 0x5647f7b2b9b0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:15.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.815+0000 7f37fb52f740 1 --2- 172.21.15.2:0/519832400 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5647f7aa38b0 0x5647f7ab72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:15.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.815+0000 7f37d6ff5640 0 client.25529 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:54:15.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.815+0000 7f37fb52f740 1 -- 172.21.15.2:0/519832400 >> 172.21.15.2:0/519832400 conn(0x5647f7a9fe40 msgr2=0x5647f7a9aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:54:15.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.815+0000 7f37fb52f740 1 -- 172.21.15.2:0/519832400 shutdown_connections 2024-09-19T04:54:15.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.815+0000 7f37fb52f740 1 -- 172.21.15.2:0/519832400 wait complete. 2024-09-19T04:54:15.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.816+0000 7f37fb52f740 20 client.25529 trim_cache size 0 max 16384 2024-09-19T04:54:15.823 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:54:15.823 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T04:54:15.823 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T04:54:15.823 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:54:15.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.816+0000 7f37f9156640 1 -- 172.21.15.2:0/2069877712 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f37dc0a33b0 msgr2=0x7f37dc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:15.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.816+0000 7f37f9156640 1 --2- 172.21.15.2:0/2069877712 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f37dc0a33b0 0x7f37dc0a5870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f37ec005fd0 tx=0x7f37ec014b70 comp rx=0 tx=0).stop 2024-09-19T04:54:15.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.816+0000 7f37f9156640 1 -- 172.21.15.2:0/2069877712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37f4101de0 msgr2=0x7f37f4198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:15.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.816+0000 7f37f9156640 1 --2- 172.21.15.2:0/2069877712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37f4101de0 0x7f37f4198380 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f37e4005940 tx=0x7f37e4004270 comp rx=0 tx=0).stop 2024-09-19T04:54:15.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.816+0000 7f37f9156640 1 -- 172.21.15.2:0/2069877712 shutdown_connections 2024-09-19T04:54:15.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.816+0000 7f37f9156640 1 --2- 172.21.15.2:0/2069877712 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37f4106f10 0x7f37f419cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:15.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.816+0000 7f37f9156640 1 --2- 172.21.15.2:0/2069877712 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f37dc0a33b0 0x7f37dc0a5870 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:15.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.816+0000 7f37f9156640 1 --2- 172.21.15.2:0/2069877712 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f37f4102790 0x7f37f41988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:15.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.816+0000 7f37f9156640 1 --2- 172.21.15.2:0/2069877712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37f4101de0 0x7f37f4198380 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:15.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.816+0000 7f37f9156640 1 -- 172.21.15.2:0/2069877712 >> 172.21.15.2:0/2069877712 conn(0x7f37f40fd8c0 msgr2=0x7f37f40fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:54:15.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.816+0000 7f37f9156640 1 -- 172.21.15.2:0/2069877712 shutdown_connections 2024-09-19T04:54:15.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:15.816+0000 7f37f9156640 1 -- 172.21.15.2:0/2069877712 wait complete. 2024-09-19T04:54:16.652 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:54:16.652 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:54:16.859 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:54:16 smithi002 ceph-mon[30975]: pgmap v191: 97 pgs: 97 active+clean; 8.7 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 54 KiB/s wr, 11 op/s 2024-09-19T04:54:16.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:54:16 smithi116 ceph-mon[34477]: pgmap v191: 97 pgs: 97 active+clean; 8.7 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 54 KiB/s wr, 11 op/s 2024-09-19T04:54:16.919 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:54:17.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:54:16 smithi018 ceph-mon[34537]: pgmap v191: 97 pgs: 97 active+clean; 8.7 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 54 KiB/s wr, 11 op/s 2024-09-19T04:54:17.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.361+0000 7fe5c88f2640 1 -- 172.21.15.2:0/1298233268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5c4102db0 msgr2=0x7fe5c4103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:17.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.361+0000 7fe5c88f2640 1 --2- 172.21.15.2:0/1298233268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5c4102db0 0x7fe5c4103190 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4009cd0 tx=0x7fe5b402a8e0 comp rx=0 tx=0).stop 2024-09-19T04:54:17.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.361+0000 7fe5c88f2640 1 -- 172.21.15.2:0/1298233268 shutdown_connections 2024-09-19T04:54:17.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.361+0000 7fe5c88f2640 1 --2- 172.21.15.2:0/1298233268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5c41082e0 0x7fe5c410ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:17.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.361+0000 7fe5c88f2640 1 --2- 172.21.15.2:0/1298233268 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5c4103760 0x7fe5c4107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:17.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.361+0000 7fe5c88f2640 1 --2- 172.21.15.2:0/1298233268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5c4102db0 0x7fe5c4103190 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:17.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.361+0000 7fe5c88f2640 1 -- 172.21.15.2:0/1298233268 >> 172.21.15.2:0/1298233268 conn(0x7fe5c40fc7d0 msgr2=0x7fe5c40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:54:17.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.361+0000 7fe5c88f2640 1 -- 172.21.15.2:0/1298233268 shutdown_connections 2024-09-19T04:54:17.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.361+0000 7fe5c88f2640 1 -- 172.21.15.2:0/1298233268 wait complete. 2024-09-19T04:54:17.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.362+0000 7fe5c88f2640 1 Processor -- start 2024-09-19T04:54:17.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.362+0000 7fe5c88f2640 1 -- start start 2024-09-19T04:54:17.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.362+0000 7fe5c88f2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5c4102db0 0x7fe5c4100a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:17.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.362+0000 7fe5c88f2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5c4103760 0x7fe5c4100f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:17.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.362+0000 7fe5c88f2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5c41082e0 0x7fe5c4101490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:17.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.362+0000 7fe5c88f2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c4111f60 con 0x7fe5c41082e0 2024-09-19T04:54:17.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.362+0000 7fe5c88f2640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c4111de0 con 0x7fe5c4103760 2024-09-19T04:54:17.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.362+0000 7fe5c88f2640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c41120e0 con 0x7fe5c4102db0 2024-09-19T04:54:17.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.362+0000 7fe5c2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5c41082e0 0x7fe5c4101490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:17.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.362+0000 7fe5c2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5c41082e0 0x7fe5c4101490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50598/0 (socket says 172.21.15.2:50598) 2024-09-19T04:54:17.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.362+0000 7fe5c2d9d640 1 -- 172.21.15.2:0/1040745647 learned_addr learned my addr 172.21.15.2:0/1040745647 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:54:17.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.362+0000 7fe5c259c640 1 --2- 172.21.15.2:0/1040745647 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5c4102db0 0x7fe5c4100a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:17.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.363+0000 7fe5c1d9b640 1 --2- 172.21.15.2:0/1040745647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5c4103760 0x7fe5c4100f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:17.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.363+0000 7fe5c2d9d640 1 -- 172.21.15.2:0/1040745647 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5c4102db0 msgr2=0x7fe5c4100a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:17.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.363+0000 7fe5c2d9d640 1 --2- 172.21.15.2:0/1040745647 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5c4102db0 0x7fe5c4100a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:17.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.363+0000 7fe5c2d9d640 1 -- 172.21.15.2:0/1040745647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5c4103760 msgr2=0x7fe5c4100f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:17.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.363+0000 7fe5c2d9d640 1 --2- 172.21.15.2:0/1040745647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5c4103760 0x7fe5c4100f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:17.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.363+0000 7fe5c2d9d640 1 -- 172.21.15.2:0/1040745647 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5c41a6a90 con 0x7fe5c41082e0 2024-09-19T04:54:17.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.363+0000 7fe5c1d9b640 1 --2- 172.21.15.2:0/1040745647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5c4103760 0x7fe5c4100f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:54:17.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.363+0000 7fe5c2d9d640 1 --2- 172.21.15.2:0/1040745647 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5c41082e0 0x7fe5c4101490 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc00c970 tx=0x7fe5bc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:54:17.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.363+0000 7fe5b37fe640 1 -- 172.21.15.2:0/1040745647 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc007bb0 con 0x7fe5c41082e0 2024-09-19T04:54:17.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.363+0000 7fe5c88f2640 1 -- 172.21.15.2:0/1040745647 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5c41a6d80 con 0x7fe5c41082e0 2024-09-19T04:54:17.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.363+0000 7fe5b37fe640 1 -- 172.21.15.2:0/1040745647 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe5bc007d50 con 0x7fe5c41082e0 2024-09-19T04:54:17.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.363+0000 7fe5b37fe640 1 -- 172.21.15.2:0/1040745647 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc018700 con 0x7fe5c41082e0 2024-09-19T04:54:17.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.363+0000 7fe5c88f2640 1 -- 172.21.15.2:0/1040745647 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5c41a7270 con 0x7fe5c41082e0 2024-09-19T04:54:17.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.364+0000 7fe5c88f2640 1 -- 172.21.15.2:0/1040745647 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5c406a7d0 con 0x7fe5c41082e0 2024-09-19T04:54:17.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.365+0000 7fe5b37fe640 1 -- 172.21.15.2:0/1040745647 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fe5bc00fa20 con 0x7fe5c41082e0 2024-09-19T04:54:17.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.366+0000 7fe5b37fe640 1 --2- 172.21.15.2:0/1040745647 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fe5ac0a33b0 0x7fe5ac0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:17.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.366+0000 7fe5c259c640 1 --2- 172.21.15.2:0/1040745647 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fe5ac0a33b0 0x7fe5ac0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:17.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.366+0000 7fe5b37fe640 1 -- 172.21.15.2:0/1040745647 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7fe5bc0cfd80 con 0x7fe5c41082e0 2024-09-19T04:54:17.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.367+0000 7fe5c259c640 1 --2- 172.21.15.2:0/1040745647 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fe5ac0a33b0 0x7fe5ac0a5870 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4006010 tx=0x7fe5b4005ef0 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:54:17.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.370+0000 7fe5b37fe640 1 -- 172.21.15.2:0/1040745647 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe5bc014030 con 0x7fe5c41082e0 2024-09-19T04:54:17.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.583+0000 7fe5c88f2640 1 -- 172.21.15.2:0/1040745647 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe5c410a2c0 con 0x7fe5c41082e0 2024-09-19T04:54:17.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.584+0000 7fe5b37fe640 1 -- 172.21.15.2:0/1040745647 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11840 (secure 0 0 0) 0x7fe5bc09c720 con 0x7fe5c41082e0 2024-09-19T04:54:17.586 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:54:17.586 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":19,"btime":"2024-09-19T04:46:33:537239+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2467365137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2467365137},{"type":"v1","addr":"172.21.15.2:6835","nonce":2467365137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3162441888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3162441888},{"type":"v1","addr":"172.21.15.2:6837","nonce":3162441888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14631,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2740862966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2740862966},{"type":"v1","addr":"172.21.15.2:6839","nonce":2740862966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/2394435504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2394435504},{"type":"v1","addr":"172.21.15.2:6841","nonce":2394435504}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1630480244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1630480244},{"type":"v1","addr":"172.21.15.18:6833","nonce":1630480244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1553897465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1553897465},{"type":"v1","addr":"172.21.15.116:6833","nonce":1553897465}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3035664608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3035664608},{"type":"v1","addr":"172.21.15.18:6835","nonce":3035664608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1096622392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1096622392},{"type":"v1","addr":"172.21.15.18:6837","nonce":1096622392}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3761157675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3761157675},{"type":"v1","addr":"172.21.15.116:6835","nonce":3761157675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/1120131594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1120131594},{"type":"v1","addr":"172.21.15.116:6837","nonce":1120131594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:46:24.050115+0000","modified":"2024-09-19T04:46:33.112369+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/4207677139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":4207677139},{"type":"v1","addr":"172.21.15.18:6839","nonce":4207677139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/2346874880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":2346874880},{"type":"v1","addr":"172.21.15.116:6839","nonce":2346874880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496]},"id":1}]} 2024-09-19T04:54:17.586 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 19 2024-09-19T04:54:17.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.586+0000 7fe5c88f2640 1 -- 172.21.15.2:0/1040745647 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fe5ac0a33b0 msgr2=0x7fe5ac0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:17.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.586+0000 7fe5c88f2640 1 --2- 172.21.15.2:0/1040745647 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fe5ac0a33b0 0x7fe5ac0a5870 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4006010 tx=0x7fe5b4005ef0 comp rx=0 tx=0).stop 2024-09-19T04:54:17.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.586+0000 7fe5c88f2640 1 -- 172.21.15.2:0/1040745647 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5c41082e0 msgr2=0x7fe5c4101490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:17.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.586+0000 7fe5c88f2640 1 --2- 172.21.15.2:0/1040745647 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5c41082e0 0x7fe5c4101490 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc00c970 tx=0x7fe5bc00ce30 comp rx=0 tx=0).stop 2024-09-19T04:54:17.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.586+0000 7fe5c88f2640 1 -- 172.21.15.2:0/1040745647 shutdown_connections 2024-09-19T04:54:17.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.586+0000 7fe5c88f2640 1 --2- 172.21.15.2:0/1040745647 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5c41082e0 0x7fe5c4101490 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:17.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.586+0000 7fe5c88f2640 1 --2- 172.21.15.2:0/1040745647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5c4103760 0x7fe5c4100f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:17.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.586+0000 7fe5c88f2640 1 --2- 172.21.15.2:0/1040745647 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fe5ac0a33b0 0x7fe5ac0a5870 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:17.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.586+0000 7fe5c88f2640 1 --2- 172.21.15.2:0/1040745647 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5c4102db0 0x7fe5c4100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:17.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.586+0000 7fe5c88f2640 1 -- 172.21.15.2:0/1040745647 >> 172.21.15.2:0/1040745647 conn(0x7fe5c40fc7d0 msgr2=0x7fe5c4105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:54:17.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.586+0000 7fe5c88f2640 1 -- 172.21.15.2:0/1040745647 shutdown_connections 2024-09-19T04:54:17.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:17.586+0000 7fe5c88f2640 1 -- 172.21.15.2:0/1040745647 wait complete. 2024-09-19T04:54:18.413 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:54:18.678 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:54:18.799 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:54:18 smithi002 ceph-mon[30975]: pgmap v192: 97 pgs: 97 active+clean; 8.7 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 35 KiB/s wr, 7 op/s 2024-09-19T04:54:18.800 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:54:18 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/1040745647' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:54:18.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:54:18 smithi116 ceph-mon[34477]: pgmap v192: 97 pgs: 97 active+clean; 8.7 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 35 KiB/s wr, 7 op/s 2024-09-19T04:54:18.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:54:18 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/1040745647' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:54:19.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:54:18 smithi018 ceph-mon[34537]: pgmap v192: 97 pgs: 97 active+clean; 8.7 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 35 KiB/s wr, 7 op/s 2024-09-19T04:54:19.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:54:18 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/1040745647' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:54:19.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.272+0000 7f95fef74640 1 -- 172.21.15.2:0/3778410197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95f8101420 msgr2=0x7f95f810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:19.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.272+0000 7f95fef74640 1 --2- 172.21.15.2:0/3778410197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95f8101420 0x7f95f810d950 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f95f0009cd0 tx=0x7f95f002a8e0 comp rx=0 tx=0).stop 2024-09-19T04:54:19.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.272+0000 7f95fef74640 1 -- 172.21.15.2:0/3778410197 shutdown_connections 2024-09-19T04:54:19.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.272+0000 7f95fef74640 1 --2- 172.21.15.2:0/3778410197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95f8101420 0x7f95f810d950 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:19.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.272+0000 7f95fef74640 1 --2- 172.21.15.2:0/3778410197 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95f8100a80 0x7f95f8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:19.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.272+0000 7f95fef74640 1 --2- 172.21.15.2:0/3778410197 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95f8106a80 0x7f95f8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:19.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.272+0000 7f95fef74640 1 -- 172.21.15.2:0/3778410197 >> 172.21.15.2:0/3778410197 conn(0x7f95f80fc7a0 msgr2=0x7f95f80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:54:19.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.272+0000 7f95fef74640 1 -- 172.21.15.2:0/3778410197 shutdown_connections 2024-09-19T04:54:19.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.272+0000 7f95fef74640 1 -- 172.21.15.2:0/3778410197 wait complete. 2024-09-19T04:54:19.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.272+0000 7f95fef74640 1 Processor -- start 2024-09-19T04:54:19.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.272+0000 7f95fef74640 1 -- start start 2024-09-19T04:54:19.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.273+0000 7f95fef74640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95f8100a80 0x7f95f80fcec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:19.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.273+0000 7f95fef74640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95f8101420 0x7f95f80fd400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:19.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.273+0000 7f95fef74640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95f8106a80 0x7f95f80fd940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:19.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.273+0000 7f95fef74640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f95f8110dd0 con 0x7f95f8106a80 2024-09-19T04:54:19.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.273+0000 7f95fef74640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f95f8110c50 con 0x7f95f8101420 2024-09-19T04:54:19.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.273+0000 7f95fef74640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f95f8110f50 con 0x7f95f8100a80 2024-09-19T04:54:19.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.273+0000 7f95fd511640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95f8106a80 0x7f95f80fd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:19.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.273+0000 7f95fd511640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95f8106a80 0x7f95f80fd940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50620/0 (socket says 172.21.15.2:50620) 2024-09-19T04:54:19.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.273+0000 7f95fd511640 1 -- 172.21.15.2:0/437060554 learned_addr learned my addr 172.21.15.2:0/437060554 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:54:19.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.273+0000 7f95fcd10640 1 --2- 172.21.15.2:0/437060554 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95f8100a80 0x7f95f80fcec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:19.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.273+0000 7f95effff640 1 --2- 172.21.15.2:0/437060554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95f8101420 0x7f95f80fd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:19.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.273+0000 7f95fd511640 1 -- 172.21.15.2:0/437060554 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95f8100a80 msgr2=0x7f95f80fcec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:19.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.273+0000 7f95fd511640 1 --2- 172.21.15.2:0/437060554 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95f8100a80 0x7f95f80fcec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:19.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.273+0000 7f95fd511640 1 -- 172.21.15.2:0/437060554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95f8101420 msgr2=0x7f95f80fd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:19.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.273+0000 7f95fd511640 1 --2- 172.21.15.2:0/437060554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95f8101420 0x7f95f80fd400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:19.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.273+0000 7f95fd511640 1 -- 172.21.15.2:0/437060554 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95f81a6950 con 0x7f95f8106a80 2024-09-19T04:54:19.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.273+0000 7f95fcd10640 1 --2- 172.21.15.2:0/437060554 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95f8100a80 0x7f95f80fcec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:54:19.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.273+0000 7f95effff640 1 --2- 172.21.15.2:0/437060554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95f8101420 0x7f95f80fd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:54:19.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.273+0000 7f95fd511640 1 --2- 172.21.15.2:0/437060554 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95f8106a80 0x7f95f80fd940 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f95f0005cc0 tx=0x7f95f0003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:54:19.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.273+0000 7f95edffb640 1 -- 172.21.15.2:0/437060554 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f0004240 con 0x7f95f8106a80 2024-09-19T04:54:19.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.274+0000 7f95edffb640 1 -- 172.21.15.2:0/437060554 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f95f00305a0 con 0x7f95f8106a80 2024-09-19T04:54:19.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.274+0000 7f95fef74640 1 -- 172.21.15.2:0/437060554 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95f81a6be0 con 0x7f95f8106a80 2024-09-19T04:54:19.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.274+0000 7f95edffb640 1 -- 172.21.15.2:0/437060554 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f00466c0 con 0x7f95f8106a80 2024-09-19T04:54:19.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.274+0000 7f95fef74640 1 -- 172.21.15.2:0/437060554 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95f81a7120 con 0x7f95f8106a80 2024-09-19T04:54:19.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.276+0000 7f95edffb640 1 -- 172.21.15.2:0/437060554 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f95f0030ac0 con 0x7f95f8106a80 2024-09-19T04:54:19.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.276+0000 7f960134d740 1 Processor -- start 2024-09-19T04:54:19.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.276+0000 7f960134d740 1 -- start start 2024-09-19T04:54:19.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.277+0000 7f960134d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5631a3aa5b40 0x5631a3aa4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:19.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.277+0000 7f960134d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5631a3aa45d0 0x5631a3aa4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:19.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.277+0000 7f960134d740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5631a3aaf370 0x5631a3ab1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:19.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.277+0000 7f960134d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5631a3a0a2f0 con 0x5631a3aa5b40 2024-09-19T04:54:19.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.277+0000 7f960134d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5631a39b1cf0 con 0x5631a3aa45d0 2024-09-19T04:54:19.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.277+0000 7f960134d740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5631a3a062b0 con 0x5631a3aaf370 2024-09-19T04:54:19.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.277+0000 7f95edffb640 1 --2- 172.21.15.2:0/437060554 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f95e00a33b0 0x7f95e00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:19.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.277+0000 7f95effff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5631a3aa5b40 0x5631a3aa4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:19.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.277+0000 7f95effff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5631a3aa5b40 0x5631a3aa4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50634/0 (socket says 172.21.15.2:50634) 2024-09-19T04:54:19.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.277+0000 7f95effff640 1 -- 172.21.15.2:0/572964427 learned_addr learned my addr 172.21.15.2:0/572964427 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:54:19.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.277+0000 7f95fcd10640 1 --2- 172.21.15.2:0/572964427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5631a3aa45d0 0x5631a3aa4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:19.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.277+0000 7f95edffb640 1 -- 172.21.15.2:0/437060554 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f95f002e030 con 0x7f95f8106a80 2024-09-19T04:54:19.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.277+0000 7f95effff640 1 --2- 172.21.15.2:0/572964427 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5631a3aaf370 0x5631a3ab1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:19.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.277+0000 7f95fd511640 1 --2- 172.21.15.2:0/437060554 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f95e00a33b0 0x7f95e00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:19.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.277+0000 7f95effff640 1 -- 172.21.15.2:0/572964427 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5631a3aaf370 msgr2=0x5631a3ab1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:54:19.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.277+0000 7f95effff640 1 --2- 172.21.15.2:0/572964427 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5631a3aaf370 0x5631a3ab1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:19.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.277+0000 7f95effff640 1 -- 172.21.15.2:0/572964427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5631a3aa45d0 msgr2=0x5631a3aa4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:54:19.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.277+0000 7f95effff640 1 --2- 172.21.15.2:0/572964427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5631a3aa45d0 0x5631a3aa4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:19.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.277+0000 7f95effff640 1 -- 172.21.15.2:0/572964427 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631a39963a0 con 0x5631a3aa5b40 2024-09-19T04:54:19.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.278+0000 7f95effff640 1 --2- 172.21.15.2:0/572964427 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5631a3aa5b40 0x5631a3aa4090 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f95e800af10 tx=0x7f95e800a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17a15e2ce7d699e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:54:19.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.278+0000 7f95fd511640 1 --2- 172.21.15.2:0/437060554 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f95e00a33b0 0x7f95e00a5870 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f95f00eeb60 tx=0x7f95f008c380 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:54:19.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.278+0000 7f95deffd640 1 -- 172.21.15.2:0/572964427 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e801b070 con 0x5631a3aa5b40 2024-09-19T04:54:19.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.278+0000 7f95deffd640 1 -- 172.21.15.2:0/572964427 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f95e800ee40 con 0x5631a3aa5b40 2024-09-19T04:54:19.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.278+0000 7f95deffd640 1 -- 172.21.15.2:0/572964427 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e800f040 con 0x5631a3aa5b40 2024-09-19T04:54:19.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.279+0000 7f960134d740 1 -- 172.21.15.2:0/572964427 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5631a3aa5b40 msgr2=0x5631a3aa4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:19.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.279+0000 7f960134d740 1 --2- 172.21.15.2:0/572964427 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5631a3aa5b40 0x5631a3aa4090 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f95e800af10 tx=0x7f95e800a410 comp rx=0 tx=0).stop 2024-09-19T04:54:19.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.279+0000 7f960134d740 1 -- 172.21.15.2:0/572964427 shutdown_connections 2024-09-19T04:54:19.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.279+0000 7f960134d740 1 --2- 172.21.15.2:0/572964427 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5631a3aaf370 0x5631a3ab1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:19.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.279+0000 7f960134d740 1 --2- 172.21.15.2:0/572964427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5631a3aa45d0 0x5631a3aa4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:19.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.279+0000 7f960134d740 1 --2- 172.21.15.2:0/572964427 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5631a3aa5b40 0x5631a3aa4090 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:19.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.279+0000 7f960134d740 1 -- 172.21.15.2:0/572964427 >> 172.21.15.2:0/572964427 conn(0x5631a3a6d310 msgr2=0x5631a3aa0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:54:19.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.279+0000 7f960134d740 1 -- 172.21.15.2:0/572964427 shutdown_connections 2024-09-19T04:54:19.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.279+0000 7f960134d740 1 -- 172.21.15.2:0/572964427 wait complete. 2024-09-19T04:54:19.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.279+0000 7f960134d740 1 -- start start 2024-09-19T04:54:19.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.279+0000 7f960134d740 1 Processor -- start 2024-09-19T04:54:19.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.280+0000 7f960134d740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5631a3aa45d0 0x5631a3aaed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:19.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.280+0000 7f960134d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5631a3aa5b40 0x5631a3aac000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:19.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.280+0000 7f960134d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5631a3aaf370 0x5631a3aac5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:19.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.280+0000 7f960134d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5631a3ab2010 con 0x5631a3aa5b40 2024-09-19T04:54:19.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.280+0000 7f960134d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5631a39c5060 con 0x5631a3aaf370 2024-09-19T04:54:19.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.280+0000 7f960134d740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5631a3ab2190 con 0x5631a3aa45d0 2024-09-19T04:54:19.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.280+0000 7f960134d740 10 client.0 _ll_register_callbacks cb 0x5631a37188c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:54:19.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.280+0000 7f95fcd10640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5631a3aa5b40 0x5631a3aac000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:19.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.280+0000 7f95fcd10640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5631a3aa5b40 0x5631a3aac000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50646/0 (socket says 172.21.15.2:50646) 2024-09-19T04:54:19.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.280+0000 7f95fcd10640 1 -- 172.21.15.2:0/3675704056 learned_addr learned my addr 172.21.15.2:0/3675704056 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:54:19.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.280+0000 7f95effff640 1 --2- 172.21.15.2:0/3675704056 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5631a3aa45d0 0x5631a3aaed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:19.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.280+0000 7f95effff640 1 --2- 172.21.15.2:0/3675704056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5631a3aaf370 0x5631a3aac5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:19.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.280+0000 7f95fcd10640 1 -- 172.21.15.2:0/3675704056 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5631a3aa45d0 msgr2=0x5631a3aaed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:54:19.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.280+0000 7f95fcd10640 1 --2- 172.21.15.2:0/3675704056 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5631a3aa45d0 0x5631a3aaed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:19.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.280+0000 7f95fcd10640 1 -- 172.21.15.2:0/3675704056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5631a3aaf370 msgr2=0x5631a3aac5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:54:19.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.280+0000 7f95fcd10640 1 --2- 172.21.15.2:0/3675704056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5631a3aaf370 0x5631a3aac5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:19.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.280+0000 7f95fcd10640 1 -- 172.21.15.2:0/3675704056 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631a377b3c0 con 0x5631a3aa5b40 2024-09-19T04:54:19.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.280+0000 7f95effff640 1 --2- 172.21.15.2:0/3675704056 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5631a3aa45d0 0x5631a3aaed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:54:19.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.280+0000 7f95fcd10640 1 --2- 172.21.15.2:0/3675704056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5631a3aa5b40 0x5631a3aac000 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f95f4010500 tx=0x7f95f40109c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31282e10c530b9a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:54:19.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.280+0000 7f95d7fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:54:19.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.280+0000 7f95d7fff640 1 -- 172.21.15.2:0/3675704056 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f4018070 con 0x5631a3aa5b40 2024-09-19T04:54:19.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.280+0000 7f95d7fff640 1 -- 172.21.15.2:0/3675704056 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f95f4014640 con 0x5631a3aa5b40 2024-09-19T04:54:19.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.280+0000 7f960134d740 1 -- 172.21.15.2:0/3675704056 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5631a3a17860 con 0x5631a3aa5b40 2024-09-19T04:54:19.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.281+0000 7f95d7fff640 1 -- 172.21.15.2:0/3675704056 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f95f4024050 con 0x5631a3aa5b40 2024-09-19T04:54:19.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.281+0000 7f960134d740 10 client.16122 fetch_fsmap learned FSMap version 19 2024-09-19T04:54:19.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.281+0000 7f960134d740 1 -- 172.21.15.2:0/3675704056 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5631a3abdb70 con 0x5631a3aa5b40 2024-09-19T04:54:19.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.281+0000 7f95d7fff640 1 -- 172.21.15.2:0/3675704056 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x5631a3a17860 con 0x5631a3aa5b40 2024-09-19T04:54:19.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.281+0000 7f95d7fff640 1 -- 172.21.15.2:0/3675704056 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f95f40129c0 con 0x5631a3aa5b40 2024-09-19T04:54:19.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.281+0000 7f960134d740 10 client.16122 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:54:19.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.281+0000 7f960134d740 10 client.16122 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:54:19.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.281+0000 7f960134d740 20 client.16122 populate_metadata read hostname 'smithi002' 2024-09-19T04:54:19.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.281+0000 7f960134d740 1 --2- 172.21.15.2:0/3675704056 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5631a3abf020 0x5631a3ac1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:19.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.281+0000 7f960134d740 4 client.16122 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:54:19.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.281+0000 7f960134d740 1 -- 172.21.15.2:0/3675704056 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5631a3a11d70 con 0x5631a3abf020 2024-09-19T04:54:19.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.281+0000 7f95effff640 1 --2- 172.21.15.2:0/3675704056 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5631a3abf020 0x5631a3ac1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:19.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.282+0000 7f95d7fff640 10 client.16122 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:54:19.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.282+0000 7f95effff640 1 --2- 172.21.15.2:0/3675704056 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5631a3abf020 0x5631a3ac1440 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a770d5cc2407e9e9 server_cookie=bcbd8bf98d6e330f in_seq=0 out_seq=0 2024-09-19T04:54:19.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.282+0000 7f95d7fff640 1 -- 172.21.15.2:0/3675704056 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5631a3a11d70 con 0x5631a3abf020 2024-09-19T04:54:19.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.282+0000 7f95d7fff640 10 client.16122 handle_command_reply: tid=0 2024-09-19T04:54:19.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.282+0000 7f960134d740 1 client.16122 shutdown 2024-09-19T04:54:19.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.283+0000 7f960134d740 1 -- 172.21.15.2:0/3675704056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5631a3aa5b40 msgr2=0x5631a3aac000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:19.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.283+0000 7f960134d740 1 --2- 172.21.15.2:0/3675704056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5631a3aa5b40 0x5631a3aac000 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f95f4010500 tx=0x7f95f40109c0 comp rx=0 tx=0).stop 2024-09-19T04:54:19.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.283+0000 7f960134d740 1 -- 172.21.15.2:0/3675704056 shutdown_connections 2024-09-19T04:54:19.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.283+0000 7f960134d740 1 --2- 172.21.15.2:0/3675704056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5631a3aaf370 0x5631a3aac5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:19.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.283+0000 7f960134d740 1 --2- 172.21.15.2:0/3675704056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5631a3aa5b40 0x5631a3aac000 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:19.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.283+0000 7f960134d740 1 --2- 172.21.15.2:0/3675704056 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5631a3abf020 0x5631a3ac1440 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:19.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.283+0000 7f95d7fff640 0 client.16122 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:54:19.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.283+0000 7f960134d740 1 --2- 172.21.15.2:0/3675704056 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5631a3aa45d0 0x5631a3aaed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:19.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.283+0000 7f960134d740 1 -- 172.21.15.2:0/3675704056 >> 172.21.15.2:0/3675704056 conn(0x5631a3a6d310 msgr2=0x5631a3aa6930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:54:19.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.283+0000 7f960134d740 1 -- 172.21.15.2:0/3675704056 shutdown_connections 2024-09-19T04:54:19.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.283+0000 7f960134d740 1 -- 172.21.15.2:0/3675704056 wait complete. 2024-09-19T04:54:19.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.283+0000 7f960134d740 20 client.16122 trim_cache size 0 max 16384 2024-09-19T04:54:19.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.296+0000 7f960134d740 1 Processor -- start 2024-09-19T04:54:19.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.296+0000 7f960134d740 1 -- start start 2024-09-19T04:54:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.296+0000 7f960134d740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5631a3aa45d0 0x5631a3abb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.296+0000 7f960134d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5631a3aa5b40 0x5631a3aaafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.296+0000 7f960134d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5631a3aaf370 0x5631a3ac6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.296+0000 7f960134d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f95f81ad880 con 0x5631a3aa5b40 2024-09-19T04:54:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.296+0000 7f960134d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f95f81b0100 con 0x5631a3aaf370 2024-09-19T04:54:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.296+0000 7f960134d740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f95f81adef0 con 0x5631a3aa45d0 2024-09-19T04:54:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.296+0000 7f95fcd10640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5631a3aa5b40 0x5631a3aaafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.296+0000 7f95fcd10640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5631a3aa5b40 0x5631a3aaafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50660/0 (socket says 172.21.15.2:50660) 2024-09-19T04:54:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.296+0000 7f95fcd10640 1 -- 172.21.15.2:0/940136789 learned_addr learned my addr 172.21.15.2:0/940136789 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:54:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.297+0000 7f95effff640 1 --2- 172.21.15.2:0/940136789 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5631a3aa45d0 0x5631a3abb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.297+0000 7f95fcd10640 1 -- 172.21.15.2:0/940136789 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5631a3aa45d0 msgr2=0x5631a3abb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:54:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.297+0000 7f95fcd10640 1 --2- 172.21.15.2:0/940136789 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5631a3aa45d0 0x5631a3abb2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:19.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.297+0000 7f95fcd10640 1 -- 172.21.15.2:0/940136789 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5631a3aaf370 msgr2=0x5631a3ac6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:54:19.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.297+0000 7f95fcd10640 1 --2- 172.21.15.2:0/940136789 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5631a3aaf370 0x5631a3ac6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:19.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.297+0000 7f95fcd10640 1 -- 172.21.15.2:0/940136789 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631a3aac940 con 0x5631a3aa5b40 2024-09-19T04:54:19.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.297+0000 7f95fcd10640 1 --2- 172.21.15.2:0/940136789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5631a3aa5b40 0x5631a3aaafe0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f95f4012f80 tx=0x7f95f4007b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5cebe05d902c76a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:54:19.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.297+0000 7f95de7fc640 1 -- 172.21.15.2:0/940136789 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f4018050 con 0x5631a3aa5b40 2024-09-19T04:54:19.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.297+0000 7f95de7fc640 1 -- 172.21.15.2:0/940136789 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f95f402d070 con 0x5631a3aa5b40 2024-09-19T04:54:19.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.297+0000 7f95de7fc640 1 -- 172.21.15.2:0/940136789 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f4014a40 con 0x5631a3aa5b40 2024-09-19T04:54:19.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.298+0000 7f960134d740 1 -- 172.21.15.2:0/940136789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5631a3aa5b40 msgr2=0x5631a3aaafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:19.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.298+0000 7f960134d740 1 --2- 172.21.15.2:0/940136789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5631a3aa5b40 0x5631a3aaafe0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f95f4012f80 tx=0x7f95f4007b10 comp rx=0 tx=0).stop 2024-09-19T04:54:19.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.298+0000 7f960134d740 1 -- 172.21.15.2:0/940136789 shutdown_connections 2024-09-19T04:54:19.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.298+0000 7f960134d740 1 --2- 172.21.15.2:0/940136789 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5631a3aaf370 0x5631a3ac6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:19.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.298+0000 7f960134d740 1 --2- 172.21.15.2:0/940136789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5631a3aa5b40 0x5631a3aaafe0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:19.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.298+0000 7f960134d740 1 --2- 172.21.15.2:0/940136789 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5631a3aa45d0 0x5631a3abb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:19.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.298+0000 7f960134d740 1 -- 172.21.15.2:0/940136789 >> 172.21.15.2:0/940136789 conn(0x5631a3a6d310 msgr2=0x5631a3aaa8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:54:19.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.298+0000 7f960134d740 1 -- 172.21.15.2:0/940136789 shutdown_connections 2024-09-19T04:54:19.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.298+0000 7f960134d740 1 -- 172.21.15.2:0/940136789 wait complete. 2024-09-19T04:54:19.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.298+0000 7f960134d740 1 -- start start 2024-09-19T04:54:19.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.298+0000 7f960134d740 1 Processor -- start 2024-09-19T04:54:19.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.299+0000 7f960134d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5631a3aa45d0 0x5631a3ab2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:19.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.299+0000 7f960134d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5631a3aa5b40 0x5631a3ab30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:19.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.299+0000 7f960134d740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5631a3aaf370 0x5631a3b21d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:19.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.299+0000 7f960134d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f95f81ae5c0 con 0x5631a3aa5b40 2024-09-19T04:54:19.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.299+0000 7f960134d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f95f81afa30 con 0x5631a3aa45d0 2024-09-19T04:54:19.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.299+0000 7f960134d740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f95f81aec90 con 0x5631a3aaf370 2024-09-19T04:54:19.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.299+0000 7f960134d740 10 client.0 _ll_register_callbacks cb 0x7f95f4007520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:54:19.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.299+0000 7f95fcd10640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5631a3aa5b40 0x5631a3ab30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:19.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.299+0000 7f95fcd10640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5631a3aa5b40 0x5631a3ab30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50668/0 (socket says 172.21.15.2:50668) 2024-09-19T04:54:19.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.299+0000 7f95fcd10640 1 -- 172.21.15.2:0/1677774139 learned_addr learned my addr 172.21.15.2:0/1677774139 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:54:19.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.299+0000 7f95effff640 1 --2- 172.21.15.2:0/1677774139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5631a3aa45d0 0x5631a3ab2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:19.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.299+0000 7f95effff640 1 --2- 172.21.15.2:0/1677774139 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5631a3aaf370 0x5631a3b21d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:19.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.299+0000 7f95fcd10640 1 -- 172.21.15.2:0/1677774139 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5631a3aaf370 msgr2=0x5631a3b21d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:54:19.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.299+0000 7f95fcd10640 1 --2- 172.21.15.2:0/1677774139 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5631a3aaf370 0x5631a3b21d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:19.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.299+0000 7f95fcd10640 1 -- 172.21.15.2:0/1677774139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5631a3aa45d0 msgr2=0x5631a3ab2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:54:19.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.299+0000 7f95fcd10640 1 --2- 172.21.15.2:0/1677774139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5631a3aa45d0 0x5631a3ab2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:19.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.299+0000 7f95fcd10640 1 -- 172.21.15.2:0/1677774139 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631a3b22300 con 0x5631a3aa5b40 2024-09-19T04:54:19.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.299+0000 7f95effff640 1 --2- 172.21.15.2:0/1677774139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5631a3aa45d0 0x5631a3ab2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:54:19.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.299+0000 7f95fcd10640 1 --2- 172.21.15.2:0/1677774139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5631a3aa5b40 0x5631a3ab30d0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f95f4012e10 tx=0x7f95f4014640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b63f1d2efa32d54 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:54:19.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.299+0000 7f95d7fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:54:19.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.299+0000 7f95d7fff640 1 -- 172.21.15.2:0/1677774139 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f4018040 con 0x5631a3aa5b40 2024-09-19T04:54:19.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.299+0000 7f95d7fff640 1 -- 172.21.15.2:0/1677774139 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f95f4014d80 con 0x5631a3aa5b40 2024-09-19T04:54:19.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.299+0000 7f960134d740 1 -- 172.21.15.2:0/1677774139 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95f402d070 con 0x5631a3aa5b40 2024-09-19T04:54:19.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.300+0000 7f95d7fff640 1 -- 172.21.15.2:0/1677774139 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f95f4007e20 con 0x5631a3aa5b40 2024-09-19T04:54:19.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.300+0000 7f960134d740 10 client.16128 fetch_fsmap learned FSMap version 19 2024-09-19T04:54:19.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.300+0000 7f960134d740 1 -- 172.21.15.2:0/1677774139 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5631a3b29680 con 0x5631a3aa5b40 2024-09-19T04:54:19.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.300+0000 7f95d7fff640 1 -- 172.21.15.2:0/1677774139 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f95f402d070 con 0x5631a3aa5b40 2024-09-19T04:54:19.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.300+0000 7f95d7fff640 1 -- 172.21.15.2:0/1677774139 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f95f4006020 con 0x5631a3aa5b40 2024-09-19T04:54:19.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.300+0000 7f960134d740 10 client.16128 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:54:19.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.300+0000 7f960134d740 10 client.16128 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:54:19.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.300+0000 7f960134d740 20 client.16128 populate_metadata read hostname 'smithi002' 2024-09-19T04:54:19.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.300+0000 7f960134d740 1 --2- 172.21.15.2:0/1677774139 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5631a3abf020 0x5631a3b2bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:19.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.300+0000 7f960134d740 4 client.16128 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:54:19.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.300+0000 7f960134d740 1 -- 172.21.15.2:0/1677774139 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5631a398e170 con 0x5631a3abf020 2024-09-19T04:54:19.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.300+0000 7f95effff640 1 --2- 172.21.15.2:0/1677774139 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5631a3abf020 0x5631a3b2bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:19.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.301+0000 7f95effff640 1 --2- 172.21.15.2:0/1677774139 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5631a3abf020 0x5631a3b2bce0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1481e31964c2088f server_cookie=b7e951250dfa2d88 in_seq=0 out_seq=0 2024-09-19T04:54:19.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.301+0000 7f95d7fff640 10 client.16128 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:54:19.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.301+0000 7f95d7fff640 1 -- 172.21.15.2:0/1677774139 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5631a398e170 con 0x5631a3abf020 2024-09-19T04:54:19.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.301+0000 7f95d7fff640 10 client.16128 handle_command_reply: tid=0 2024-09-19T04:54:19.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.301+0000 7f960134d740 1 client.16128 shutdown 2024-09-19T04:54:19.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.301+0000 7f960134d740 1 -- 172.21.15.2:0/1677774139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5631a3aa5b40 msgr2=0x5631a3ab30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:19.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.301+0000 7f960134d740 1 --2- 172.21.15.2:0/1677774139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5631a3aa5b40 0x5631a3ab30d0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f95f4012e10 tx=0x7f95f4014640 comp rx=0 tx=0).stop 2024-09-19T04:54:19.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.301+0000 7f960134d740 1 -- 172.21.15.2:0/1677774139 shutdown_connections 2024-09-19T04:54:19.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.301+0000 7f960134d740 1 --2- 172.21.15.2:0/1677774139 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5631a3abf020 0x5631a3b2bce0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:19.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.301+0000 7f960134d740 1 --2- 172.21.15.2:0/1677774139 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5631a3aaf370 0x5631a3b21d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:19.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.301+0000 7f960134d740 1 --2- 172.21.15.2:0/1677774139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5631a3aa5b40 0x5631a3ab30d0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:19.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.301+0000 7f95d7fff640 0 client.16128 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:54:19.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.301+0000 7f960134d740 1 --2- 172.21.15.2:0/1677774139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5631a3aa45d0 0x5631a3ab2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:19.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.301+0000 7f960134d740 1 -- 172.21.15.2:0/1677774139 >> 172.21.15.2:0/1677774139 conn(0x5631a3a6d310 msgr2=0x5631a3aa6110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:54:19.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.301+0000 7f960134d740 1 -- 172.21.15.2:0/1677774139 shutdown_connections 2024-09-19T04:54:19.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.301+0000 7f960134d740 1 -- 172.21.15.2:0/1677774139 wait complete. 2024-09-19T04:54:19.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.301+0000 7f960134d740 20 client.16128 trim_cache size 0 max 16384 2024-09-19T04:54:19.309 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T04:54:19.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.302+0000 7f95fef74640 1 -- 172.21.15.2:0/437060554 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f95e00a33b0 msgr2=0x7f95e00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:19.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.302+0000 7f95fef74640 1 --2- 172.21.15.2:0/437060554 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f95e00a33b0 0x7f95e00a5870 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f95f00eeb60 tx=0x7f95f008c380 comp rx=0 tx=0).stop 2024-09-19T04:54:19.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.302+0000 7f95fef74640 1 -- 172.21.15.2:0/437060554 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95f8106a80 msgr2=0x7f95f80fd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:19.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.302+0000 7f95fef74640 1 --2- 172.21.15.2:0/437060554 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95f8106a80 0x7f95f80fd940 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f95f0005cc0 tx=0x7f95f0003ba0 comp rx=0 tx=0).stop 2024-09-19T04:54:19.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.302+0000 7f95fef74640 1 -- 172.21.15.2:0/437060554 shutdown_connections 2024-09-19T04:54:19.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.302+0000 7f95fef74640 1 --2- 172.21.15.2:0/437060554 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95f8106a80 0x7f95f80fd940 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:19.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.302+0000 7f95fef74640 1 --2- 172.21.15.2:0/437060554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95f8101420 0x7f95f80fd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:19.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.302+0000 7f95fef74640 1 --2- 172.21.15.2:0/437060554 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f95e00a33b0 0x7f95e00a5870 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:19.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.302+0000 7f95fef74640 1 --2- 172.21.15.2:0/437060554 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95f8100a80 0x7f95f80fcec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:19.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.302+0000 7f95fef74640 1 -- 172.21.15.2:0/437060554 >> 172.21.15.2:0/437060554 conn(0x7f95f80fc7a0 msgr2=0x7f95f806ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:54:19.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.302+0000 7f95fef74640 1 -- 172.21.15.2:0/437060554 shutdown_connections 2024-09-19T04:54:19.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:19.302+0000 7f95fef74640 1 -- 172.21.15.2:0/437060554 wait complete. 2024-09-19T04:54:20.859 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:54:20 smithi018 ceph-mon[34537]: pgmap v193: 97 pgs: 97 active+clean; 8.7 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 35 KiB/s wr, 7 op/s 2024-09-19T04:54:20.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:54:20 smithi002 ceph-mon[30975]: pgmap v193: 97 pgs: 97 active+clean; 8.7 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 35 KiB/s wr, 7 op/s 2024-09-19T04:54:20.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:54:20 smithi116 ceph-mon[34477]: pgmap v193: 97 pgs: 97 active+clean; 8.7 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 35 KiB/s wr, 7 op/s 2024-09-19T04:54:20.965 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:54:20.965 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:54:21.238 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:54:21.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.757+0000 7fa97fd88640 1 -- 172.21.15.2:0/2421336850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa978106a80 msgr2=0x7fa978106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:21.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.757+0000 7fa97fd88640 1 --2- 172.21.15.2:0/2421336850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa978106a80 0x7fa978106e60 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fa974009930 tx=0x7fa97402a420 comp rx=0 tx=0).stop 2024-09-19T04:54:21.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.757+0000 7fa97fd88640 1 -- 172.21.15.2:0/2421336850 shutdown_connections 2024-09-19T04:54:21.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.757+0000 7fa97fd88640 1 --2- 172.21.15.2:0/2421336850 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa978101420 0x7fa97810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:21.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.757+0000 7fa97fd88640 1 --2- 172.21.15.2:0/2421336850 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa978100a80 0x7fa978100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:21.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.757+0000 7fa97fd88640 1 --2- 172.21.15.2:0/2421336850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa978106a80 0x7fa978106e60 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:21.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.757+0000 7fa97fd88640 1 -- 172.21.15.2:0/2421336850 >> 172.21.15.2:0/2421336850 conn(0x7fa9780fc7a0 msgr2=0x7fa9780febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:54:21.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.757+0000 7fa97fd88640 1 -- 172.21.15.2:0/2421336850 shutdown_connections 2024-09-19T04:54:21.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.757+0000 7fa97fd88640 1 -- 172.21.15.2:0/2421336850 wait complete. 2024-09-19T04:54:21.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.758+0000 7fa97fd88640 1 Processor -- start 2024-09-19T04:54:21.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.758+0000 7fa97fd88640 1 -- start start 2024-09-19T04:54:21.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.758+0000 7fa97fd88640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa978100a80 0x7fa978198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:21.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.758+0000 7fa97fd88640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa978101420 0x7fa978198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:21.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.758+0000 7fa97fd88640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa978106a80 0x7fa97819cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:21.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.758+0000 7fa97fd88640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa978110cf0 con 0x7fa978100a80 2024-09-19T04:54:21.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.758+0000 7fa97fd88640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa978110b70 con 0x7fa978101420 2024-09-19T04:54:21.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.758+0000 7fa97fd88640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa978110e70 con 0x7fa978106a80 2024-09-19T04:54:21.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.758+0000 7fa97db24640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa978100a80 0x7fa978198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:21.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.759+0000 7fa97db24640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa978100a80 0x7fa978198350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33792/0 (socket says 172.21.15.2:33792) 2024-09-19T04:54:21.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.759+0000 7fa97db24640 1 -- 172.21.15.2:0/3001579953 learned_addr learned my addr 172.21.15.2:0/3001579953 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:54:21.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.759+0000 7fa97d323640 1 --2- 172.21.15.2:0/3001579953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa978101420 0x7fa978198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:21.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.759+0000 7fa97e325640 1 --2- 172.21.15.2:0/3001579953 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa978106a80 0x7fa97819cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:21.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.759+0000 7fa97db24640 1 -- 172.21.15.2:0/3001579953 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa978106a80 msgr2=0x7fa97819cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:21.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.759+0000 7fa97db24640 1 --2- 172.21.15.2:0/3001579953 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa978106a80 0x7fa97819cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:21.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.759+0000 7fa97db24640 1 -- 172.21.15.2:0/3001579953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa978101420 msgr2=0x7fa978198890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:21.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.759+0000 7fa97db24640 1 --2- 172.21.15.2:0/3001579953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa978101420 0x7fa978198890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:21.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.759+0000 7fa97db24640 1 -- 172.21.15.2:0/3001579953 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa97819d300 con 0x7fa978100a80 2024-09-19T04:54:21.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.759+0000 7fa97e325640 1 --2- 172.21.15.2:0/3001579953 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa978106a80 0x7fa97819cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:54:21.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.759+0000 7fa97db24640 1 --2- 172.21.15.2:0/3001579953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa978100a80 0x7fa978198350 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fa974004770 tx=0x7fa9740042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:54:21.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.759+0000 7fa96effd640 1 -- 172.21.15.2:0/3001579953 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa97403f070 con 0x7fa978100a80 2024-09-19T04:54:21.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.759+0000 7fa96effd640 1 -- 172.21.15.2:0/3001579953 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa97403b460 con 0x7fa978100a80 2024-09-19T04:54:21.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.759+0000 7fa97fd88640 1 -- 172.21.15.2:0/3001579953 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa97819d590 con 0x7fa978100a80 2024-09-19T04:54:21.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.759+0000 7fa96effd640 1 -- 172.21.15.2:0/3001579953 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa974035070 con 0x7fa978100a80 2024-09-19T04:54:21.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.759+0000 7fa97fd88640 1 -- 172.21.15.2:0/3001579953 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9781a4ed0 con 0x7fa978100a80 2024-09-19T04:54:21.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.762+0000 7fa96effd640 1 -- 172.21.15.2:0/3001579953 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fa97403b610 con 0x7fa978100a80 2024-09-19T04:54:21.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.762+0000 7fa982161740 1 Processor -- start 2024-09-19T04:54:21.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.763+0000 7fa982161740 1 -- start start 2024-09-19T04:54:21.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.763+0000 7fa96effd640 1 --2- 172.21.15.2:0/3001579953 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fa9640a3430 0x7fa9640a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:21.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.763+0000 7fa982161740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562da18dab60 0x562da18daf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:21.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.763+0000 7fa982161740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562da18db480 0x562da18e5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:21.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.763+0000 7fa97e325640 1 --2- 172.21.15.2:0/3001579953 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fa9640a3430 0x7fa9640a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:21.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.763+0000 7fa982161740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562da18e5d40 0x562da18e8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:21.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.763+0000 7fa96effd640 1 -- 172.21.15.2:0/3001579953 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7fa9740f0100 con 0x7fa978100a80 2024-09-19T04:54:21.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.763+0000 7fa982161740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562da1840280 con 0x562da18dab60 2024-09-19T04:54:21.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.763+0000 7fa982161740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562da17e7b10 con 0x562da18e5d40 2024-09-19T04:54:21.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.763+0000 7fa982161740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x562da183c240 con 0x562da18db480 2024-09-19T04:54:21.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.763+0000 7fa97d323640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562da18db480 0x562da18e5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:21.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.763+0000 7fa97d323640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562da18db480 0x562da18e5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.2:52512/0 (socket says 172.21.15.2:52512) 2024-09-19T04:54:21.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.763+0000 7fa97d323640 1 -- 172.21.15.2:0/3858421821 learned_addr learned my addr 172.21.15.2:0/3858421821 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:54:21.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.763+0000 7fa97db24640 1 --2- 172.21.15.2:0/3858421821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562da18dab60 0x562da18daf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:21.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.764+0000 7fa97e325640 1 --2- 172.21.15.2:0/3858421821 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562da18e5d40 0x562da18e8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:21.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.764+0000 7fa97db24640 1 -- 172.21.15.2:0/3858421821 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562da18db480 msgr2=0x562da18e5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:54:21.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.764+0000 7fa97db24640 1 --2- 172.21.15.2:0/3858421821 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562da18db480 0x562da18e5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:21.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.764+0000 7fa97db24640 1 -- 172.21.15.2:0/3858421821 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562da18e5d40 msgr2=0x562da18e8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:54:21.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.764+0000 7fa97db24640 1 --2- 172.21.15.2:0/3858421821 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562da18e5d40 0x562da18e8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:21.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.764+0000 7fa97db24640 1 -- 172.21.15.2:0/3858421821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562da17f41f0 con 0x562da18dab60 2024-09-19T04:54:21.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.764+0000 7fa97d323640 1 --2- 172.21.15.2:0/3858421821 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562da18db480 0x562da18e5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:54:21.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.764+0000 7fa97e325640 1 --2- 172.21.15.2:0/3858421821 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562da18e5d40 0x562da18e8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:54:21.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.764+0000 7fa97e325640 1 --2- 172.21.15.2:0/3001579953 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fa9640a3430 0x7fa9640a58f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa968005fd0 tx=0x7fa968009e50 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:54:21.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.764+0000 7fa97db24640 1 --2- 172.21.15.2:0/3858421821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562da18dab60 0x562da18daf40 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fa9740ed810 tx=0x7fa9740b8770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f460a7e419dd3bd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:54:21.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.764+0000 7fa963fff640 1 -- 172.21.15.2:0/3858421821 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa974048070 con 0x562da18dab60 2024-09-19T04:54:21.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.764+0000 7fa963fff640 1 -- 172.21.15.2:0/3858421821 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa9740c0750 con 0x562da18dab60 2024-09-19T04:54:21.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.764+0000 7fa963fff640 1 -- 172.21.15.2:0/3858421821 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9740c4b80 con 0x562da18dab60 2024-09-19T04:54:21.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.765+0000 7fa982161740 1 -- 172.21.15.2:0/3858421821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562da18dab60 msgr2=0x562da18daf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:21.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.765+0000 7fa982161740 1 --2- 172.21.15.2:0/3858421821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562da18dab60 0x562da18daf40 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fa9740ed810 tx=0x7fa9740b8770 comp rx=0 tx=0).stop 2024-09-19T04:54:21.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.765+0000 7fa982161740 1 -- 172.21.15.2:0/3858421821 shutdown_connections 2024-09-19T04:54:21.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.765+0000 7fa982161740 1 --2- 172.21.15.2:0/3858421821 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562da18e5d40 0x562da18e8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:21.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.765+0000 7fa982161740 1 --2- 172.21.15.2:0/3858421821 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562da18db480 0x562da18e5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:21.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.765+0000 7fa982161740 1 --2- 172.21.15.2:0/3858421821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562da18dab60 0x562da18daf40 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:21.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.765+0000 7fa982161740 1 -- 172.21.15.2:0/3858421821 >> 172.21.15.2:0/3858421821 conn(0x562da18d70f0 msgr2=0x562da18d74d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:54:21.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.766+0000 7fa982161740 1 -- 172.21.15.2:0/3858421821 shutdown_connections 2024-09-19T04:54:21.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.766+0000 7fa982161740 1 -- 172.21.15.2:0/3858421821 wait complete. 2024-09-19T04:54:21.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.766+0000 7fa982161740 1 -- start start 2024-09-19T04:54:21.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.766+0000 7fa982161740 1 Processor -- start 2024-09-19T04:54:21.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.766+0000 7fa982161740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562da18dab60 0x562da18e57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:21.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.766+0000 7fa982161740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562da18db480 0x562da18e2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:21.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.766+0000 7fa982161740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562da18e5d40 0x562da18e32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:21.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.766+0000 7fa982161740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562da18ecae0 con 0x562da18dab60 2024-09-19T04:54:21.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.766+0000 7fa982161740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562da17faf10 con 0x562da18db480 2024-09-19T04:54:21.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.766+0000 7fa982161740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x562da18ecc60 con 0x562da18e5d40 2024-09-19T04:54:21.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.766+0000 7fa982161740 10 client.0 _ll_register_callbacks cb 0x562da17c3a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:54:21.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.767+0000 7fa97db24640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562da18dab60 0x562da18e57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:21.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.767+0000 7fa97db24640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562da18dab60 0x562da18e57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33816/0 (socket says 172.21.15.2:33816) 2024-09-19T04:54:21.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.767+0000 7fa97db24640 1 -- 172.21.15.2:0/2429591422 learned_addr learned my addr 172.21.15.2:0/2429591422 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:54:21.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.767+0000 7fa97d323640 1 --2- 172.21.15.2:0/2429591422 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562da18db480 0x562da18e2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:21.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.767+0000 7fa97e325640 1 --2- 172.21.15.2:0/2429591422 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562da18e5d40 0x562da18e32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:21.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.767+0000 7fa97db24640 1 -- 172.21.15.2:0/2429591422 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562da18e5d40 msgr2=0x562da18e32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:54:21.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.767+0000 7fa97db24640 1 --2- 172.21.15.2:0/2429591422 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562da18e5d40 0x562da18e32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:21.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.767+0000 7fa97db24640 1 -- 172.21.15.2:0/2429591422 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562da18db480 msgr2=0x562da18e2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:54:21.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.767+0000 7fa97db24640 1 --2- 172.21.15.2:0/2429591422 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562da18db480 0x562da18e2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:21.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.767+0000 7fa97db24640 1 -- 172.21.15.2:0/2429591422 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562da15b16a0 con 0x562da18dab60 2024-09-19T04:54:21.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.767+0000 7fa97db24640 1 --2- 172.21.15.2:0/2429591422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562da18dab60 0x562da18e57f0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fa974005940 tx=0x7fa9740edcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca63bf898bdc1a56 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:54:21.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.767+0000 7fa9617fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:54:21.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.767+0000 7fa9617fa640 1 -- 172.21.15.2:0/2429591422 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9740d4020 con 0x562da18dab60 2024-09-19T04:54:21.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.767+0000 7fa9617fa640 1 -- 172.21.15.2:0/2429591422 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7fa9740d5220 con 0x562da18dab60 2024-09-19T04:54:21.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.767+0000 7fa982161740 1 -- 172.21.15.2:0/2429591422 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9740c0750 con 0x562da18dab60 2024-09-19T04:54:21.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.767+0000 7fa9617fa640 1 -- 172.21.15.2:0/2429591422 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fa974048070 con 0x562da18dab60 2024-09-19T04:54:21.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.767+0000 7fa982161740 10 client.16140 fetch_fsmap learned FSMap version 19 2024-09-19T04:54:21.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.767+0000 7fa982161740 1 -- 172.21.15.2:0/2429591422 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x562da18ecae0 con 0x562da18dab60 2024-09-19T04:54:21.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.768+0000 7fa9617fa640 1 -- 172.21.15.2:0/2429591422 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa9740c0750 con 0x562da18dab60 2024-09-19T04:54:21.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.768+0000 7fa9617fa640 1 -- 172.21.15.2:0/2429591422 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fa97404b060 con 0x562da18dab60 2024-09-19T04:54:21.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.768+0000 7fa982161740 10 client.16140 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:54:21.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.768+0000 7fa982161740 10 client.16140 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:54:21.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.768+0000 7fa982161740 20 client.16140 populate_metadata read hostname 'smithi002' 2024-09-19T04:54:21.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.768+0000 7fa982161740 1 --2- 172.21.15.2:0/2429591422 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x562da18f9680 0x562da18fba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:21.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.768+0000 7fa982161740 4 client.16140 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:54:21.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.768+0000 7fa982161740 1 -- 172.21.15.2:0/2429591422 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562da184d7f0 con 0x562da18f9680 2024-09-19T04:54:21.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.768+0000 7fa97d323640 1 --2- 172.21.15.2:0/2429591422 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x562da18f9680 0x562da18fba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:21.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.769+0000 7fa97d323640 1 --2- 172.21.15.2:0/2429591422 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x562da18f9680 0x562da18fba70 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4aa97bcb4f57fcdc server_cookie=bc53e7e65feeca7f in_seq=0 out_seq=0 2024-09-19T04:54:21.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.769+0000 7fa9617fa640 10 client.16140 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:54:21.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.769+0000 7fa9617fa640 1 -- 172.21.15.2:0/2429591422 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562da184d7f0 con 0x562da18f9680 2024-09-19T04:54:21.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.769+0000 7fa9617fa640 10 client.16140 handle_command_reply: tid=0 2024-09-19T04:54:21.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.769+0000 7fa982161740 1 client.16140 shutdown 2024-09-19T04:54:21.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.769+0000 7fa982161740 1 -- 172.21.15.2:0/2429591422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562da18dab60 msgr2=0x562da18e57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:21.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.769+0000 7fa982161740 1 --2- 172.21.15.2:0/2429591422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562da18dab60 0x562da18e57f0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fa974005940 tx=0x7fa9740edcc0 comp rx=0 tx=0).stop 2024-09-19T04:54:21.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.770+0000 7fa982161740 1 -- 172.21.15.2:0/2429591422 shutdown_connections 2024-09-19T04:54:21.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.770+0000 7fa982161740 1 --2- 172.21.15.2:0/2429591422 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x562da18f9680 0x562da18fba70 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:21.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.770+0000 7fa982161740 1 --2- 172.21.15.2:0/2429591422 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562da18e5d40 0x562da18e32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:21.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.770+0000 7fa9617fa640 0 client.16140 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:54:21.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.770+0000 7fa982161740 1 --2- 172.21.15.2:0/2429591422 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562da18db480 0x562da18e2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:21.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.770+0000 7fa982161740 1 --2- 172.21.15.2:0/2429591422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562da18dab60 0x562da18e57f0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:21.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.770+0000 7fa982161740 1 -- 172.21.15.2:0/2429591422 >> 172.21.15.2:0/2429591422 conn(0x562da18d70f0 msgr2=0x562da18dcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:54:21.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.770+0000 7fa982161740 1 -- 172.21.15.2:0/2429591422 shutdown_connections 2024-09-19T04:54:21.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.770+0000 7fa982161740 1 -- 172.21.15.2:0/2429591422 wait complete. 2024-09-19T04:54:21.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.770+0000 7fa982161740 20 client.16140 trim_cache size 0 max 16384 2024-09-19T04:54:21.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.787+0000 7fa982161740 1 Processor -- start 2024-09-19T04:54:21.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.787+0000 7fa982161740 1 -- start start 2024-09-19T04:54:21.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.787+0000 7fa982161740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562da18dab60 0x562da1901300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:21.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.787+0000 7fa982161740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562da18db480 0x562da1901840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:21.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.787+0000 7fa982161740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562da18e5d40 0x562da18dfda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:21.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.787+0000 7fa982161740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa9781a94b0 con 0x562da18dab60 2024-09-19T04:54:21.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.787+0000 7fa982161740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa9781abd30 con 0x562da18e5d40 2024-09-19T04:54:21.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.787+0000 7fa982161740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa9781a9b20 con 0x562da18db480 2024-09-19T04:54:21.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.787+0000 7fa97db24640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562da18dab60 0x562da1901300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:21.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.787+0000 7fa97db24640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562da18dab60 0x562da1901300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33832/0 (socket says 172.21.15.2:33832) 2024-09-19T04:54:21.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.787+0000 7fa97db24640 1 -- 172.21.15.2:0/4151862616 learned_addr learned my addr 172.21.15.2:0/4151862616 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:54:21.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.788+0000 7fa97d323640 1 --2- 172.21.15.2:0/4151862616 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562da18db480 0x562da1901840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:21.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.788+0000 7fa97db24640 1 -- 172.21.15.2:0/4151862616 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562da18db480 msgr2=0x562da1901840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:54:21.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.788+0000 7fa97e325640 1 --2- 172.21.15.2:0/4151862616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562da18e5d40 0x562da18dfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:21.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.788+0000 7fa97db24640 1 --2- 172.21.15.2:0/4151862616 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562da18db480 0x562da1901840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:21.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.788+0000 7fa97db24640 1 -- 172.21.15.2:0/4151862616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562da18e5d40 msgr2=0x562da18dfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:54:21.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.788+0000 7fa97db24640 1 --2- 172.21.15.2:0/4151862616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562da18e5d40 0x562da18dfda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:21.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.788+0000 7fa97db24640 1 -- 172.21.15.2:0/4151862616 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562da18fbde0 con 0x562da18dab60 2024-09-19T04:54:21.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.788+0000 7fa97d323640 1 --2- 172.21.15.2:0/4151862616 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562da18db480 0x562da1901840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:54:21.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.788+0000 7fa97e325640 1 --2- 172.21.15.2:0/4151862616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562da18e5d40 0x562da18dfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:54:21.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.788+0000 7fa97db24640 1 --2- 172.21.15.2:0/4151862616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562da18dab60 0x562da1901300 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fa9740bc330 tx=0x7fa9740b8570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb4a8d6329ea098 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:54:21.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.788+0000 7fa9637fe640 1 -- 172.21.15.2:0/4151862616 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9740d4050 con 0x562da18dab60 2024-09-19T04:54:21.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.788+0000 7fa9637fe640 1 -- 172.21.15.2:0/4151862616 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa9740c0750 con 0x562da18dab60 2024-09-19T04:54:21.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.788+0000 7fa9637fe640 1 -- 172.21.15.2:0/4151862616 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9740c4b80 con 0x562da18dab60 2024-09-19T04:54:21.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.789+0000 7fa982161740 1 -- 172.21.15.2:0/4151862616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562da18dab60 msgr2=0x562da1901300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:21.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.789+0000 7fa982161740 1 --2- 172.21.15.2:0/4151862616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562da18dab60 0x562da1901300 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fa9740bc330 tx=0x7fa9740b8570 comp rx=0 tx=0).stop 2024-09-19T04:54:21.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.789+0000 7fa982161740 1 -- 172.21.15.2:0/4151862616 shutdown_connections 2024-09-19T04:54:21.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.789+0000 7fa982161740 1 --2- 172.21.15.2:0/4151862616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562da18e5d40 0x562da18dfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:21.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.789+0000 7fa982161740 1 --2- 172.21.15.2:0/4151862616 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562da18db480 0x562da1901840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:21.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.789+0000 7fa982161740 1 --2- 172.21.15.2:0/4151862616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562da18dab60 0x562da1901300 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:21.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.789+0000 7fa982161740 1 -- 172.21.15.2:0/4151862616 >> 172.21.15.2:0/4151862616 conn(0x562da18d70f0 msgr2=0x562da18e4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:54:21.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.789+0000 7fa982161740 1 -- 172.21.15.2:0/4151862616 shutdown_connections 2024-09-19T04:54:21.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.789+0000 7fa982161740 1 -- 172.21.15.2:0/4151862616 wait complete. 2024-09-19T04:54:21.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.789+0000 7fa982161740 1 -- start start 2024-09-19T04:54:21.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.789+0000 7fa982161740 1 Processor -- start 2024-09-19T04:54:21.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.790+0000 7fa982161740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562da18dab60 0x562da18edd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:21.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.790+0000 7fa982161740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562da18db480 0x562da18ee270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:21.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.790+0000 7fa982161740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562da18e5d40 0x562da18ee7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:21.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.790+0000 7fa982161740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa9781aa1f0 con 0x562da18db480 2024-09-19T04:54:21.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.790+0000 7fa982161740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa9781ab660 con 0x562da18dab60 2024-09-19T04:54:21.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.790+0000 7fa982161740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa9781aa8c0 con 0x562da18e5d40 2024-09-19T04:54:21.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.790+0000 7fa982161740 10 client.0 _ll_register_callbacks cb 0x7fa9740bc460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:54:21.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.790+0000 7fa97d323640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562da18db480 0x562da18ee270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:21.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.790+0000 7fa97d323640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562da18db480 0x562da18ee270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33836/0 (socket says 172.21.15.2:33836) 2024-09-19T04:54:21.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.790+0000 7fa97d323640 1 -- 172.21.15.2:0/726093616 learned_addr learned my addr 172.21.15.2:0/726093616 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:54:21.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.790+0000 7fa97db24640 1 --2- 172.21.15.2:0/726093616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562da18dab60 0x562da18edd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:21.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.790+0000 7fa97e325640 1 --2- 172.21.15.2:0/726093616 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562da18e5d40 0x562da18ee7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:21.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.790+0000 7fa97d323640 1 -- 172.21.15.2:0/726093616 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562da18e5d40 msgr2=0x562da18ee7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:54:21.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.790+0000 7fa97d323640 1 --2- 172.21.15.2:0/726093616 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562da18e5d40 0x562da18ee7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:21.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.790+0000 7fa97d323640 1 -- 172.21.15.2:0/726093616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562da18dab60 msgr2=0x562da18edd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:54:21.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.790+0000 7fa97d323640 1 --2- 172.21.15.2:0/726093616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562da18dab60 0x562da18edd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:21.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.790+0000 7fa97d323640 1 -- 172.21.15.2:0/726093616 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562da1963570 con 0x562da18db480 2024-09-19T04:54:21.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.790+0000 7fa97db24640 1 --2- 172.21.15.2:0/726093616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562da18dab60 0x562da18edd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:54:21.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.790+0000 7fa97d323640 1 --2- 172.21.15.2:0/726093616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562da18db480 0x562da18ee270 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fa970007f30 tx=0x7fa970004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8afc5cc7d06f4246 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:54:21.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.790+0000 7fa9617fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:54:21.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.791+0000 7fa9617fa640 1 -- 172.21.15.2:0/726093616 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa970022030 con 0x562da18db480 2024-09-19T04:54:21.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.791+0000 7fa9617fa640 1 -- 172.21.15.2:0/726093616 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7fa970004b20 con 0x562da18db480 2024-09-19T04:54:21.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.791+0000 7fa982161740 1 -- 172.21.15.2:0/726093616 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9740c0750 con 0x562da18db480 2024-09-19T04:54:21.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.791+0000 7fa9617fa640 1 -- 172.21.15.2:0/726093616 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fa97002c050 con 0x562da18db480 2024-09-19T04:54:21.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.791+0000 7fa982161740 10 client.16146 fetch_fsmap learned FSMap version 19 2024-09-19T04:54:21.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.791+0000 7fa982161740 1 -- 172.21.15.2:0/726093616 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x562da1964890 con 0x562da18db480 2024-09-19T04:54:21.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.791+0000 7fa9617fa640 1 -- 172.21.15.2:0/726093616 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa9740c0750 con 0x562da18db480 2024-09-19T04:54:21.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.791+0000 7fa9617fa640 1 -- 172.21.15.2:0/726093616 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fa970005390 con 0x562da18db480 2024-09-19T04:54:21.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.791+0000 7fa982161740 10 client.16146 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:54:21.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.791+0000 7fa982161740 10 client.16146 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:54:21.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.791+0000 7fa982161740 20 client.16146 populate_metadata read hostname 'smithi002' 2024-09-19T04:54:21.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.791+0000 7fa982161740 1 --2- 172.21.15.2:0/726093616 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x562da1965090 0x562da19674b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:21.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.791+0000 7fa982161740 4 client.16146 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:54:21.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.791+0000 7fa982161740 1 -- 172.21.15.2:0/726093616 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562da1847d00 con 0x562da1965090 2024-09-19T04:54:21.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.792+0000 7fa97db24640 1 --2- 172.21.15.2:0/726093616 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x562da1965090 0x562da19674b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:21.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.792+0000 7fa97db24640 1 --2- 172.21.15.2:0/726093616 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x562da1965090 0x562da19674b0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=450554962dd482c1 server_cookie=c9dfcff66220a051 in_seq=0 out_seq=0 2024-09-19T04:54:21.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.792+0000 7fa9617fa640 10 client.16146 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:54:21.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.793+0000 7fa9617fa640 1 -- 172.21.15.2:0/726093616 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562da1847d00 con 0x562da1965090 2024-09-19T04:54:21.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.793+0000 7fa9617fa640 10 client.16146 handle_command_reply: tid=0 2024-09-19T04:54:21.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.793+0000 7fa982161740 1 client.16146 shutdown 2024-09-19T04:54:21.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.793+0000 7fa982161740 1 -- 172.21.15.2:0/726093616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562da18db480 msgr2=0x562da18ee270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:21.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.793+0000 7fa982161740 1 --2- 172.21.15.2:0/726093616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562da18db480 0x562da18ee270 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fa970007f30 tx=0x7fa970004410 comp rx=0 tx=0).stop 2024-09-19T04:54:21.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.793+0000 7fa982161740 1 -- 172.21.15.2:0/726093616 shutdown_connections 2024-09-19T04:54:21.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.793+0000 7fa982161740 1 --2- 172.21.15.2:0/726093616 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x562da1965090 0x562da19674b0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:21.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.793+0000 7fa982161740 1 --2- 172.21.15.2:0/726093616 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562da18e5d40 0x562da18ee7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:21.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.793+0000 7fa982161740 1 --2- 172.21.15.2:0/726093616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562da18db480 0x562da18ee270 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:21.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.793+0000 7fa9617fa640 0 client.16146 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:54:21.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.793+0000 7fa982161740 1 --2- 172.21.15.2:0/726093616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562da18dab60 0x562da18edd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:21.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.793+0000 7fa982161740 1 -- 172.21.15.2:0/726093616 >> 172.21.15.2:0/726093616 conn(0x562da18d70f0 msgr2=0x562da18e12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:54:21.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.793+0000 7fa982161740 1 -- 172.21.15.2:0/726093616 shutdown_connections 2024-09-19T04:54:21.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.793+0000 7fa982161740 1 -- 172.21.15.2:0/726093616 wait complete. 2024-09-19T04:54:21.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.793+0000 7fa982161740 20 client.16146 trim_cache size 0 max 16384 2024-09-19T04:54:21.800 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:54:21.800 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T04:54:21.800 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "c7de62df-6b0b-4d7f-a56a-905254ac67c4", 2024-09-19T04:54:21.800 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T04:54:21.800 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:54:21.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.794+0000 7fa97fd88640 1 -- 172.21.15.2:0/3001579953 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fa9640a3430 msgr2=0x7fa9640a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:21.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.794+0000 7fa97fd88640 1 --2- 172.21.15.2:0/3001579953 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fa9640a3430 0x7fa9640a58f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa968005fd0 tx=0x7fa968009e50 comp rx=0 tx=0).stop 2024-09-19T04:54:21.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.794+0000 7fa97fd88640 1 -- 172.21.15.2:0/3001579953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa978100a80 msgr2=0x7fa978198350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:21.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.794+0000 7fa97fd88640 1 --2- 172.21.15.2:0/3001579953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa978100a80 0x7fa978198350 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fa974004770 tx=0x7fa9740042f0 comp rx=0 tx=0).stop 2024-09-19T04:54:21.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.794+0000 7fa97fd88640 1 -- 172.21.15.2:0/3001579953 shutdown_connections 2024-09-19T04:54:21.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.794+0000 7fa97fd88640 1 --2- 172.21.15.2:0/3001579953 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fa9640a3430 0x7fa9640a58f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:21.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.794+0000 7fa97fd88640 1 --2- 172.21.15.2:0/3001579953 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa978106a80 0x7fa97819cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:21.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.794+0000 7fa97fd88640 1 --2- 172.21.15.2:0/3001579953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa978101420 0x7fa978198890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:21.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.794+0000 7fa97fd88640 1 --2- 172.21.15.2:0/3001579953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa978100a80 0x7fa978198350 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:21.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.794+0000 7fa97fd88640 1 -- 172.21.15.2:0/3001579953 >> 172.21.15.2:0/3001579953 conn(0x7fa9780fc7a0 msgr2=0x7fa97806aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:54:21.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.794+0000 7fa97fd88640 1 -- 172.21.15.2:0/3001579953 shutdown_connections 2024-09-19T04:54:21.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:21.794+0000 7fa97fd88640 1 -- 172.21.15.2:0/3001579953 wait complete. 2024-09-19T04:54:22.625 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:54:22.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:54:22 smithi002 ceph-mon[30975]: pgmap v194: 97 pgs: 97 active+clean; 8.9 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 50 KiB/s wr, 10 op/s 2024-09-19T04:54:22.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:54:22 smithi002 ceph-mon[30975]: scrub queued for path: / 2024-09-19T04:54:22.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:54:22 smithi002 ceph-mon[30975]: scrub summary: idle+waiting paths [/] 2024-09-19T04:54:22.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:54:22 smithi002 ceph-mon[30975]: scrub summary: active paths [/] 2024-09-19T04:54:22.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:54:22 smithi002 ceph-mon[30975]: scrub summary: idle+waiting paths [/] 2024-09-19T04:54:22.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:54:22 smithi116 ceph-mon[34477]: pgmap v194: 97 pgs: 97 active+clean; 8.9 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 50 KiB/s wr, 10 op/s 2024-09-19T04:54:22.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:54:22 smithi116 ceph-mon[34477]: scrub queued for path: / 2024-09-19T04:54:22.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:54:22 smithi116 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-19T04:54:22.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:54:22 smithi116 ceph-mon[34477]: scrub summary: active paths [/] 2024-09-19T04:54:22.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:54:22 smithi116 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-19T04:54:22.882 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:54:23.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:54:22 smithi018 ceph-mon[34537]: pgmap v194: 97 pgs: 97 active+clean; 8.9 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 50 KiB/s wr, 10 op/s 2024-09-19T04:54:23.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:54:22 smithi018 ceph-mon[34537]: scrub queued for path: / 2024-09-19T04:54:23.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:54:22 smithi018 ceph-mon[34537]: scrub summary: idle+waiting paths [/] 2024-09-19T04:54:23.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:54:22 smithi018 ceph-mon[34537]: scrub summary: active paths [/] 2024-09-19T04:54:23.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:54:22 smithi018 ceph-mon[34537]: scrub summary: idle+waiting paths [/] 2024-09-19T04:54:23.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.389+0000 7f432bd83640 1 -- 172.21.15.2:0/406140153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4324102de0 msgr2=0x7f43241031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:23.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.389+0000 7f432bd83640 1 --2- 172.21.15.2:0/406140153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4324102de0 0x7f43241031c0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f4320009900 tx=0x7f432002a480 comp rx=0 tx=0).stop 2024-09-19T04:54:23.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.389+0000 7f432bd83640 1 -- 172.21.15.2:0/406140153 shutdown_connections 2024-09-19T04:54:23.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.389+0000 7f432bd83640 1 --2- 172.21.15.2:0/406140153 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f432410c180 0x7f432410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:23.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.389+0000 7f432bd83640 1 --2- 172.21.15.2:0/406140153 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4324103700 0x7f432410bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:23.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.389+0000 7f432bd83640 1 --2- 172.21.15.2:0/406140153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4324102de0 0x7f43241031c0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:23.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.389+0000 7f432bd83640 1 -- 172.21.15.2:0/406140153 >> 172.21.15.2:0/406140153 conn(0x7f43240fc7a0 msgr2=0x7f43240febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:54:23.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.389+0000 7f432bd83640 1 -- 172.21.15.2:0/406140153 shutdown_connections 2024-09-19T04:54:23.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.389+0000 7f432bd83640 1 -- 172.21.15.2:0/406140153 wait complete. 2024-09-19T04:54:23.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.389+0000 7f432bd83640 1 Processor -- start 2024-09-19T04:54:23.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.389+0000 7f432bd83640 1 -- start start 2024-09-19T04:54:23.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.390+0000 7f432bd83640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4324102de0 0x7f4324198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:23.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.390+0000 7f432bd83640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4324103700 0x7f43241987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:23.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.390+0000 7f432bd83640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f432410c180 0x7f432419cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:23.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.390+0000 7f432bd83640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4324111de0 con 0x7f432410c180 2024-09-19T04:54:23.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.390+0000 7f432bd83640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4324111c60 con 0x7f4324103700 2024-09-19T04:54:23.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.390+0000 7f432bd83640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f4324111f60 con 0x7f4324102de0 2024-09-19T04:54:23.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.390+0000 7f432a320640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f432410c180 0x7f432419cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:23.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.390+0000 7f432a320640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f432410c180 0x7f432419cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33850/0 (socket says 172.21.15.2:33850) 2024-09-19T04:54:23.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.390+0000 7f432a320640 1 -- 172.21.15.2:0/2928002023 learned_addr learned my addr 172.21.15.2:0/2928002023 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:54:23.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.390+0000 7f4329b1f640 1 --2- 172.21.15.2:0/2928002023 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4324102de0 0x7f4324198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:23.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.390+0000 7f432931e640 1 --2- 172.21.15.2:0/2928002023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4324103700 0x7f43241987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:23.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.390+0000 7f432a320640 1 -- 172.21.15.2:0/2928002023 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4324102de0 msgr2=0x7f4324198260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:23.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.390+0000 7f432a320640 1 --2- 172.21.15.2:0/2928002023 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4324102de0 0x7f4324198260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:23.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.390+0000 7f432a320640 1 -- 172.21.15.2:0/2928002023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4324103700 msgr2=0x7f43241987a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:23.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.390+0000 7f432a320640 1 --2- 172.21.15.2:0/2928002023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4324103700 0x7f43241987a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:23.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.390+0000 7f432a320640 1 -- 172.21.15.2:0/2928002023 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f432419d210 con 0x7f432410c180 2024-09-19T04:54:23.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.390+0000 7f432931e640 1 --2- 172.21.15.2:0/2928002023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4324103700 0x7f43241987a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:54:23.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.391+0000 7f432a320640 1 --2- 172.21.15.2:0/2928002023 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f432410c180 0x7f432419cb30 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f431c00cce0 tx=0x7f431c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:54:23.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.391+0000 7f431affd640 1 -- 172.21.15.2:0/2928002023 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f431c00f450 con 0x7f432410c180 2024-09-19T04:54:23.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.391+0000 7f432bd83640 1 -- 172.21.15.2:0/2928002023 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f432419d500 con 0x7f432410c180 2024-09-19T04:54:23.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.391+0000 7f431affd640 1 -- 172.21.15.2:0/2928002023 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f431c00faa0 con 0x7f432410c180 2024-09-19T04:54:23.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.391+0000 7f431affd640 1 -- 172.21.15.2:0/2928002023 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f431c018b70 con 0x7f432410c180 2024-09-19T04:54:23.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.391+0000 7f432bd83640 1 -- 172.21.15.2:0/2928002023 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43241a4de0 con 0x7f432410c180 2024-09-19T04:54:23.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.393+0000 7f431affd640 1 -- 172.21.15.2:0/2928002023 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f431c018d10 con 0x7f432410c180 2024-09-19T04:54:23.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.393+0000 7f432e15c740 1 Processor -- start 2024-09-19T04:54:23.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.394+0000 7f432e15c740 1 -- start start 2024-09-19T04:54:23.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.394+0000 7f432e15c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c804c14a0 0x559c804c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:23.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.394+0000 7f432e15c740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559c804c1dc0 0x559c804cc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:23.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.394+0000 7f432e15c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c804cc680 0x559c804cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:23.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.394+0000 7f432e15c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559c804272e0 con 0x559c804cc680 2024-09-19T04:54:23.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.394+0000 7f432e15c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559c803cece0 con 0x559c804c14a0 2024-09-19T04:54:23.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.394+0000 7f432e15c740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x559c804232a0 con 0x559c804c1dc0 2024-09-19T04:54:23.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.394+0000 7f432931e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c804cc680 0x559c804cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:23.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.394+0000 7f432931e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c804cc680 0x559c804cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33852/0 (socket says 172.21.15.2:33852) 2024-09-19T04:54:23.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.394+0000 7f432931e640 1 -- 172.21.15.2:0/56245574 learned_addr learned my addr 172.21.15.2:0/56245574 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:54:23.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.394+0000 7f432931e640 1 --2- 172.21.15.2:0/56245574 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c804c14a0 0x559c804c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:23.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.394+0000 7f4329b1f640 1 --2- 172.21.15.2:0/56245574 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559c804c1dc0 0x559c804cc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:23.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.394+0000 7f431affd640 1 --2- 172.21.15.2:0/2928002023 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f43100a33b0 0x7f43100a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:23.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.394+0000 7f432a320640 1 --2- 172.21.15.2:0/2928002023 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f43100a33b0 0x7f43100a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:23.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.394+0000 7f432931e640 1 -- 172.21.15.2:0/56245574 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559c804c1dc0 msgr2=0x559c804cc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:54:23.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.394+0000 7f432931e640 1 --2- 172.21.15.2:0/56245574 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559c804c1dc0 0x559c804cc140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:23.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.394+0000 7f432931e640 1 -- 172.21.15.2:0/56245574 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c804c14a0 msgr2=0x559c804c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:54:23.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.394+0000 7f432931e640 1 --2- 172.21.15.2:0/56245574 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c804c14a0 0x559c804c1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:23.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.394+0000 7f432931e640 1 -- 172.21.15.2:0/56245574 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c803b3440 con 0x559c804cc680 2024-09-19T04:54:23.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.394+0000 7f4329b1f640 1 --2- 172.21.15.2:0/56245574 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559c804c1dc0 0x559c804cc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:54:23.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.395+0000 7f431affd640 1 -- 172.21.15.2:0/2928002023 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f431c0d00d0 con 0x7f432410c180 2024-09-19T04:54:23.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.395+0000 7f432931e640 1 --2- 172.21.15.2:0/56245574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c804cc680 0x559c804cea70 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f43140139d0 tx=0x7f431400b500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6537dbf3d7b4def4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:54:23.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.395+0000 7f430ffff640 1 -- 172.21.15.2:0/56245574 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4314004030 con 0x559c804cc680 2024-09-19T04:54:23.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.395+0000 7f432a320640 1 --2- 172.21.15.2:0/2928002023 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f43100a33b0 0x7f43100a5870 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f431c098830 tx=0x7f431c0671b0 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:54:23.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.395+0000 7f430ffff640 1 -- 172.21.15.2:0/56245574 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f431400e960 con 0x559c804cc680 2024-09-19T04:54:23.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.395+0000 7f430ffff640 1 -- 172.21.15.2:0/56245574 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4314003970 con 0x559c804cc680 2024-09-19T04:54:23.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.396+0000 7f432e15c740 1 -- 172.21.15.2:0/56245574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c804cc680 msgr2=0x559c804cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:23.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.396+0000 7f432e15c740 1 --2- 172.21.15.2:0/56245574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c804cc680 0x559c804cea70 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f43140139d0 tx=0x7f431400b500 comp rx=0 tx=0).stop 2024-09-19T04:54:23.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.396+0000 7f432e15c740 1 -- 172.21.15.2:0/56245574 shutdown_connections 2024-09-19T04:54:23.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.396+0000 7f432e15c740 1 --2- 172.21.15.2:0/56245574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c804cc680 0x559c804cea70 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:23.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.396+0000 7f432e15c740 1 --2- 172.21.15.2:0/56245574 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559c804c1dc0 0x559c804cc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:23.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.396+0000 7f432e15c740 1 --2- 172.21.15.2:0/56245574 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c804c14a0 0x559c804c1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:23.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.396+0000 7f432e15c740 1 -- 172.21.15.2:0/56245574 >> 172.21.15.2:0/56245574 conn(0x559c804bda30 msgr2=0x559c804bde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:54:23.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.396+0000 7f432e15c740 1 -- 172.21.15.2:0/56245574 shutdown_connections 2024-09-19T04:54:23.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.396+0000 7f432e15c740 1 -- 172.21.15.2:0/56245574 wait complete. 2024-09-19T04:54:23.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.396+0000 7f432e15c740 1 -- start start 2024-09-19T04:54:23.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.396+0000 7f432e15c740 1 Processor -- start 2024-09-19T04:54:23.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.397+0000 7f432e15c740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559c804c14a0 0x559c804cc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:23.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.397+0000 7f432e15c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c804c1dc0 0x559c804c9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:23.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.397+0000 7f432e15c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c804cc680 0x559c804c9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:23.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.397+0000 7f432e15c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559c804cf250 con 0x559c804cc680 2024-09-19T04:54:23.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.397+0000 7f432e15c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559c803e2050 con 0x559c804c1dc0 2024-09-19T04:54:23.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.397+0000 7f432e15c740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x559c804cf3d0 con 0x559c804c14a0 2024-09-19T04:54:23.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.397+0000 7f432e15c740 10 client.0 _ll_register_callbacks cb 0x559c80422160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:54:23.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.397+0000 7f432931e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c804cc680 0x559c804c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:23.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.397+0000 7f432931e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c804cc680 0x559c804c9960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33856/0 (socket says 172.21.15.2:33856) 2024-09-19T04:54:23.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.397+0000 7f432931e640 1 -- 172.21.15.2:0/1187781667 learned_addr learned my addr 172.21.15.2:0/1187781667 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:54:23.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.397+0000 7f432931e640 1 --2- 172.21.15.2:0/1187781667 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559c804c14a0 0x559c804cc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:23.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.397+0000 7f4329b1f640 1 --2- 172.21.15.2:0/1187781667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c804c1dc0 0x559c804c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:23.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.397+0000 7f432931e640 1 -- 172.21.15.2:0/1187781667 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559c804c14a0 msgr2=0x559c804cc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:54:23.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.397+0000 7f432931e640 1 --2- 172.21.15.2:0/1187781667 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559c804c14a0 0x559c804cc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:23.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.397+0000 7f432931e640 1 -- 172.21.15.2:0/1187781667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c804c1dc0 msgr2=0x559c804c9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:54:23.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.397+0000 7f432931e640 1 --2- 172.21.15.2:0/1187781667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c804c1dc0 0x559c804c9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:23.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.397+0000 7f432931e640 1 -- 172.21.15.2:0/1187781667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c801983c0 con 0x559c804cc680 2024-09-19T04:54:23.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.397+0000 7f432931e640 1 --2- 172.21.15.2:0/1187781667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c804cc680 0x559c804c9960 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f4314003650 tx=0x7f4314013370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a07d71eb95912263 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:54:23.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.397+0000 7f430d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:54:23.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.398+0000 7f430d7fa640 1 -- 172.21.15.2:0/1187781667 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4314005110 con 0x559c804cc680 2024-09-19T04:54:23.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.398+0000 7f430d7fa640 1 -- 172.21.15.2:0/1187781667 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f43140052b0 con 0x559c804cc680 2024-09-19T04:54:23.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.398+0000 7f432e15c740 1 -- 172.21.15.2:0/1187781667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f431400e960 con 0x559c804cc680 2024-09-19T04:54:23.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.398+0000 7f430d7fa640 1 -- 172.21.15.2:0/1187781667 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4314032050 con 0x559c804cc680 2024-09-19T04:54:23.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.398+0000 7f432e15c740 10 client.16158 fetch_fsmap learned FSMap version 19 2024-09-19T04:54:23.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.398+0000 7f432e15c740 1 -- 172.21.15.2:0/1187781667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x559c804dace0 con 0x559c804cc680 2024-09-19T04:54:23.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.398+0000 7f430d7fa640 1 -- 172.21.15.2:0/1187781667 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f431400e960 con 0x559c804cc680 2024-09-19T04:54:23.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.398+0000 7f430d7fa640 1 -- 172.21.15.2:0/1187781667 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f431401f480 con 0x559c804cc680 2024-09-19T04:54:23.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.398+0000 7f432e15c740 10 client.16158 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:54:23.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.398+0000 7f432e15c740 10 client.16158 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:54:23.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.398+0000 7f432e15c740 20 client.16158 populate_metadata read hostname 'smithi002' 2024-09-19T04:54:23.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.398+0000 7f432e15c740 1 --2- 172.21.15.2:0/1187781667 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x559c804dc030 0x559c804de420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:23.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.398+0000 7f432e15c740 4 client.16158 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:54:23.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.398+0000 7f432e15c740 1 -- 172.21.15.2:0/1187781667 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559c80434850 con 0x559c804dc030 2024-09-19T04:54:23.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.399+0000 7f4329b1f640 1 --2- 172.21.15.2:0/1187781667 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x559c804dc030 0x559c804de420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:23.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.399+0000 7f4329b1f640 1 --2- 172.21.15.2:0/1187781667 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x559c804dc030 0x559c804de420 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ded2e13e523ddb8 server_cookie=d3c650bcb2a7775a in_seq=0 out_seq=0 2024-09-19T04:54:23.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.399+0000 7f430d7fa640 10 client.16158 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:54:23.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.400+0000 7f430d7fa640 1 -- 172.21.15.2:0/1187781667 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559c80434850 con 0x559c804dc030 2024-09-19T04:54:23.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.400+0000 7f430d7fa640 10 client.16158 handle_command_reply: tid=0 2024-09-19T04:54:23.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.400+0000 7f432e15c740 1 client.16158 shutdown 2024-09-19T04:54:23.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.400+0000 7f432e15c740 1 -- 172.21.15.2:0/1187781667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c804cc680 msgr2=0x559c804c9960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:23.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.400+0000 7f432e15c740 1 --2- 172.21.15.2:0/1187781667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c804cc680 0x559c804c9960 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f4314003650 tx=0x7f4314013370 comp rx=0 tx=0).stop 2024-09-19T04:54:23.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.400+0000 7f432e15c740 1 -- 172.21.15.2:0/1187781667 shutdown_connections 2024-09-19T04:54:23.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.400+0000 7f432e15c740 1 --2- 172.21.15.2:0/1187781667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c804cc680 0x559c804c9960 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:23.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.400+0000 7f432e15c740 1 --2- 172.21.15.2:0/1187781667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c804c1dc0 0x559c804c9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:23.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.400+0000 7f432e15c740 1 --2- 172.21.15.2:0/1187781667 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x559c804dc030 0x559c804de420 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:23.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.400+0000 7f432e15c740 1 --2- 172.21.15.2:0/1187781667 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559c804c14a0 0x559c804cc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:23.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.400+0000 7f430d7fa640 0 client.16158 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:54:23.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.400+0000 7f432e15c740 1 -- 172.21.15.2:0/1187781667 >> 172.21.15.2:0/1187781667 conn(0x559c804bda30 msgr2=0x559c804c3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:54:23.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.400+0000 7f432e15c740 1 -- 172.21.15.2:0/1187781667 shutdown_connections 2024-09-19T04:54:23.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.400+0000 7f432e15c740 1 -- 172.21.15.2:0/1187781667 wait complete. 2024-09-19T04:54:23.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.400+0000 7f432e15c740 20 client.16158 trim_cache size 0 max 16384 2024-09-19T04:54:23.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.417+0000 7f432e15c740 1 Processor -- start 2024-09-19T04:54:23.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.417+0000 7f432e15c740 1 -- start start 2024-09-19T04:54:23.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.417+0000 7f432e15c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c804c14a0 0x559c804cb680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:23.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.417+0000 7f432e15c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c804c1dc0 0x559c804d84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:23.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.417+0000 7f432e15c740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559c804cc680 0x559c804e3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:23.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.417+0000 7f432e15c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f43241ab5a0 con 0x559c804c14a0 2024-09-19T04:54:23.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.417+0000 7f432e15c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f43241ade20 con 0x559c804c1dc0 2024-09-19T04:54:23.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.417+0000 7f432e15c740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f43241abc10 con 0x559c804cc680 2024-09-19T04:54:23.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.417+0000 7f432931e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c804c14a0 0x559c804cb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:23.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.417+0000 7f432931e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c804c14a0 0x559c804cb680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33860/0 (socket says 172.21.15.2:33860) 2024-09-19T04:54:23.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.417+0000 7f432931e640 1 -- 172.21.15.2:0/1459597438 learned_addr learned my addr 172.21.15.2:0/1459597438 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:54:23.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.418+0000 7f4329b1f640 1 --2- 172.21.15.2:0/1459597438 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c804c1dc0 0x559c804d84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:23.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.418+0000 7f432931e640 1 -- 172.21.15.2:0/1459597438 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559c804cc680 msgr2=0x559c804e3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:54:23.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.418+0000 7f432931e640 1 --2- 172.21.15.2:0/1459597438 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559c804cc680 0x559c804e3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:23.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.418+0000 7f432931e640 1 -- 172.21.15.2:0/1459597438 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c804c1dc0 msgr2=0x559c804d84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:54:23.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.418+0000 7f432931e640 1 --2- 172.21.15.2:0/1459597438 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c804c1dc0 0x559c804d84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:23.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.418+0000 7f432931e640 1 -- 172.21.15.2:0/1459597438 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c804c88b0 con 0x559c804c14a0 2024-09-19T04:54:23.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.418+0000 7f432931e640 1 --2- 172.21.15.2:0/1459597438 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c804c14a0 0x559c804cb680 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f4314013810 tx=0x7f4314005f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5c7ff32e36aabfd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:54:23.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.418+0000 7f430f7fe640 1 -- 172.21.15.2:0/1459597438 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f431400bc00 con 0x559c804c14a0 2024-09-19T04:54:23.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.418+0000 7f430f7fe640 1 -- 172.21.15.2:0/1459597438 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f431400e960 con 0x559c804c14a0 2024-09-19T04:54:23.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.418+0000 7f430f7fe640 1 -- 172.21.15.2:0/1459597438 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f431401fa90 con 0x559c804c14a0 2024-09-19T04:54:23.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.418+0000 7f432e15c740 1 -- 172.21.15.2:0/1459597438 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c804c14a0 msgr2=0x559c804cb680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:23.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.418+0000 7f432e15c740 1 --2- 172.21.15.2:0/1459597438 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c804c14a0 0x559c804cb680 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f4314013810 tx=0x7f4314005f40 comp rx=0 tx=0).stop 2024-09-19T04:54:23.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.419+0000 7f432e15c740 1 -- 172.21.15.2:0/1459597438 shutdown_connections 2024-09-19T04:54:23.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.419+0000 7f432e15c740 1 --2- 172.21.15.2:0/1459597438 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559c804cc680 0x559c804e3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:23.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.419+0000 7f432e15c740 1 --2- 172.21.15.2:0/1459597438 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c804c1dc0 0x559c804d84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:23.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.419+0000 7f432e15c740 1 --2- 172.21.15.2:0/1459597438 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c804c14a0 0x559c804cb680 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:23.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.419+0000 7f432e15c740 1 -- 172.21.15.2:0/1459597438 >> 172.21.15.2:0/1459597438 conn(0x559c804bda30 msgr2=0x559c804c48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:54:23.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.419+0000 7f432e15c740 1 -- 172.21.15.2:0/1459597438 shutdown_connections 2024-09-19T04:54:23.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.419+0000 7f432e15c740 1 -- 172.21.15.2:0/1459597438 wait complete. 2024-09-19T04:54:23.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.419+0000 7f432e15c740 1 -- start start 2024-09-19T04:54:23.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.419+0000 7f432e15c740 1 Processor -- start 2024-09-19T04:54:23.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.419+0000 7f432e15c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c804c14a0 0x559c804d0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:23.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.419+0000 7f432e15c740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559c804c1dc0 0x559c804d0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:23.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.419+0000 7f432e15c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c804cc680 0x559c804d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:23.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.419+0000 7f432e15c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f43241ac2e0 con 0x559c804c14a0 2024-09-19T04:54:23.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.419+0000 7f432e15c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f43241ad750 con 0x559c804cc680 2024-09-19T04:54:23.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.419+0000 7f432e15c740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f43241ac9b0 con 0x559c804c1dc0 2024-09-19T04:54:23.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.419+0000 7f432e15c740 10 client.0 _ll_register_callbacks cb 0x7f431400bf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:54:23.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.420+0000 7f432931e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c804c14a0 0x559c804d0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:23.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.420+0000 7f432931e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c804c14a0 0x559c804d0540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33874/0 (socket says 172.21.15.2:33874) 2024-09-19T04:54:23.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.420+0000 7f432931e640 1 -- 172.21.15.2:0/1940948100 learned_addr learned my addr 172.21.15.2:0/1940948100 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:54:23.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.420+0000 7f4329b1f640 1 --2- 172.21.15.2:0/1940948100 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559c804c1dc0 0x559c804d0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:23.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.420+0000 7f432931e640 1 --2- 172.21.15.2:0/1940948100 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c804cc680 0x559c804d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:23.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.420+0000 7f432931e640 1 -- 172.21.15.2:0/1940948100 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559c804c1dc0 msgr2=0x559c804d0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:54:23.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.420+0000 7f432931e640 1 --2- 172.21.15.2:0/1940948100 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559c804c1dc0 0x559c804d0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:23.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.420+0000 7f432931e640 1 -- 172.21.15.2:0/1940948100 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c804cc680 msgr2=0x559c804d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:54:23.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.420+0000 7f432931e640 1 --2- 172.21.15.2:0/1940948100 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c804cc680 0x559c804d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:23.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.420+0000 7f432931e640 1 -- 172.21.15.2:0/1940948100 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c8054a0f0 con 0x559c804c14a0 2024-09-19T04:54:23.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.420+0000 7f432931e640 1 --2- 172.21.15.2:0/1940948100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c804c14a0 0x559c804d0540 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f431400f010 tx=0x7f4314005b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2b96a6c0b10cbbc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:54:23.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.420+0000 7f430d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:54:23.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.420+0000 7f430d7fa640 1 -- 172.21.15.2:0/1940948100 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f431400b980 con 0x559c804c14a0 2024-09-19T04:54:23.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.420+0000 7f430d7fa640 1 -- 172.21.15.2:0/1940948100 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f4314005110 con 0x559c804c14a0 2024-09-19T04:54:23.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.420+0000 7f432e15c740 1 -- 172.21.15.2:0/1940948100 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f431400e960 con 0x559c804c14a0 2024-09-19T04:54:23.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.421+0000 7f430d7fa640 1 -- 172.21.15.2:0/1940948100 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4314005310 con 0x559c804c14a0 2024-09-19T04:54:23.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.421+0000 7f432e15c740 10 client.16164 fetch_fsmap learned FSMap version 19 2024-09-19T04:54:23.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.421+0000 7f432e15c740 1 -- 172.21.15.2:0/1940948100 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x559c8054b3a0 con 0x559c804c14a0 2024-09-19T04:54:23.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.421+0000 7f430d7fa640 1 -- 172.21.15.2:0/1940948100 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f431400e960 con 0x559c804c14a0 2024-09-19T04:54:23.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.421+0000 7f430d7fa640 1 -- 172.21.15.2:0/1940948100 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f4314045050 con 0x559c804c14a0 2024-09-19T04:54:23.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.421+0000 7f432e15c740 10 client.16164 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:54:23.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.421+0000 7f432e15c740 10 client.16164 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:54:23.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.421+0000 7f432e15c740 20 client.16164 populate_metadata read hostname 'smithi002' 2024-09-19T04:54:23.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.421+0000 7f432e15c740 1 --2- 172.21.15.2:0/1940948100 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x559c8054b900 0x559c8054dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:23.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.421+0000 7f432e15c740 4 client.16164 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:54:23.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.421+0000 7f432e15c740 1 -- 172.21.15.2:0/1940948100 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559c8042ed60 con 0x559c8054b900 2024-09-19T04:54:23.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.421+0000 7f4329b1f640 1 --2- 172.21.15.2:0/1940948100 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x559c8054b900 0x559c8054dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:23.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.422+0000 7f430d7fa640 10 client.16164 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:54:23.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.422+0000 7f4329b1f640 1 --2- 172.21.15.2:0/1940948100 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x559c8054b900 0x559c8054dcf0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d42f33cf7d2b929e server_cookie=1c0f6c8500fdcbe1 in_seq=0 out_seq=0 2024-09-19T04:54:23.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.422+0000 7f430d7fa640 1 -- 172.21.15.2:0/1940948100 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x559c8042ed60 con 0x559c8054b900 2024-09-19T04:54:23.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.422+0000 7f430d7fa640 10 client.16164 handle_command_reply: tid=0 2024-09-19T04:54:23.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.422+0000 7f432e15c740 1 client.16164 shutdown 2024-09-19T04:54:23.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.422+0000 7f432e15c740 1 -- 172.21.15.2:0/1940948100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c804c14a0 msgr2=0x559c804d0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:23.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.422+0000 7f432e15c740 1 --2- 172.21.15.2:0/1940948100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c804c14a0 0x559c804d0540 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f431400f010 tx=0x7f4314005b30 comp rx=0 tx=0).stop 2024-09-19T04:54:23.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.422+0000 7f432e15c740 1 -- 172.21.15.2:0/1940948100 shutdown_connections 2024-09-19T04:54:23.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.422+0000 7f432e15c740 1 --2- 172.21.15.2:0/1940948100 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559c804cc680 0x559c804d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:23.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.422+0000 7f432e15c740 1 --2- 172.21.15.2:0/1940948100 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x559c8054b900 0x559c8054dcf0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:23.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.422+0000 7f432e15c740 1 --2- 172.21.15.2:0/1940948100 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559c804c1dc0 0x559c804d0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:23.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.422+0000 7f430d7fa640 0 client.16164 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:54:23.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.422+0000 7f432e15c740 1 --2- 172.21.15.2:0/1940948100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c804c14a0 0x559c804d0540 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:23.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.422+0000 7f432e15c740 1 -- 172.21.15.2:0/1940948100 >> 172.21.15.2:0/1940948100 conn(0x559c804bda30 msgr2=0x559c804c78a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:54:23.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.422+0000 7f432e15c740 1 -- 172.21.15.2:0/1940948100 shutdown_connections 2024-09-19T04:54:23.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.422+0000 7f432e15c740 1 -- 172.21.15.2:0/1940948100 wait complete. 2024-09-19T04:54:23.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.422+0000 7f432e15c740 20 client.16164 trim_cache size 0 max 16384 2024-09-19T04:54:23.429 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:54:23.429 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T04:54:23.429 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-19T04:54:23.429 INFO:teuthology.orchestra.run.smithi002.stdout: "c7de62df-6b0b-4d7f-a56a-905254ac67c4": { 2024-09-19T04:54:23.430 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-19T04:54:23.430 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "c7de62df-6b0b-4d7f-a56a-905254ac67c4", 2024-09-19T04:54:23.430 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-19T04:54:23.430 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:54:23.430 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:54:23.430 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:54:23.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.423+0000 7f432bd83640 1 -- 172.21.15.2:0/2928002023 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f43100a33b0 msgr2=0x7f43100a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:23.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.423+0000 7f432bd83640 1 --2- 172.21.15.2:0/2928002023 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f43100a33b0 0x7f43100a5870 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f431c098830 tx=0x7f431c0671b0 comp rx=0 tx=0).stop 2024-09-19T04:54:23.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.423+0000 7f432bd83640 1 -- 172.21.15.2:0/2928002023 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f432410c180 msgr2=0x7f432419cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:23.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.423+0000 7f432bd83640 1 --2- 172.21.15.2:0/2928002023 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f432410c180 0x7f432419cb30 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f431c00cce0 tx=0x7f431c00a620 comp rx=0 tx=0).stop 2024-09-19T04:54:23.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.423+0000 7f432bd83640 1 -- 172.21.15.2:0/2928002023 shutdown_connections 2024-09-19T04:54:23.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.423+0000 7f432bd83640 1 --2- 172.21.15.2:0/2928002023 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f432410c180 0x7f432419cb30 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:23.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.423+0000 7f432bd83640 1 --2- 172.21.15.2:0/2928002023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4324103700 0x7f43241987a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:23.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.423+0000 7f432bd83640 1 --2- 172.21.15.2:0/2928002023 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f43100a33b0 0x7f43100a5870 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:23.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.423+0000 7f432bd83640 1 --2- 172.21.15.2:0/2928002023 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4324102de0 0x7f4324198260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:23.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.423+0000 7f432bd83640 1 -- 172.21.15.2:0/2928002023 >> 172.21.15.2:0/2928002023 conn(0x7f43240fc7a0 msgr2=0x7f43240fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:54:23.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.423+0000 7f432bd83640 1 -- 172.21.15.2:0/2928002023 shutdown_connections 2024-09-19T04:54:23.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:23.423+0000 7f432bd83640 1 -- 172.21.15.2:0/2928002023 wait complete. 2024-09-19T04:54:24.122 INFO:tasks.cephfs.filesystem:scrub status for tag:c7de62df-6b0b-4d7f-a56a-905254ac67c4 - {'path': '/', 'tag': 'c7de62df-6b0b-4d7f-a56a-905254ac67c4', 'options': 'recursive,force'} 2024-09-19T04:54:24.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:54:24 smithi002 ceph-mon[30975]: pgmap v195: 97 pgs: 97 active+clean; 8.9 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 35 KiB/s wr, 7 op/s 2024-09-19T04:54:24.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:54:24 smithi116 ceph-mon[34477]: pgmap v195: 97 pgs: 97 active+clean; 8.9 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 35 KiB/s wr, 7 op/s 2024-09-19T04:54:25.056 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:54:24 smithi018 ceph-mon[34537]: pgmap v195: 97 pgs: 97 active+clean; 8.9 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 35 KiB/s wr, 7 op/s 2024-09-19T04:54:25.830 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.830 INFO:tasks.workunit.client.0.smithi002.stdout:251/600: open fd = 3 2024-09-19T04:54:25.830 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.830 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.830 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.830 INFO:tasks.workunit.client.0.smithi002.stdout:252/600: open fd = 3 2024-09-19T04:54:25.830 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.830 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.830 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.830 INFO:tasks.workunit.client.0.smithi002.stdout:253/600: open fd = 3 2024-09-19T04:54:25.831 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.831 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.831 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.831 INFO:tasks.workunit.client.0.smithi002.stdout:254/600: open fd = 3 2024-09-19T04:54:25.831 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.831 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.831 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.831 INFO:tasks.workunit.client.0.smithi002.stdout:255/600: open fd = 3 2024-09-19T04:54:25.831 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.831 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.831 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.831 INFO:tasks.workunit.client.0.smithi002.stdout:256/600: open fd = 3 2024-09-19T04:54:25.831 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.831 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.832 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.832 INFO:tasks.workunit.client.0.smithi002.stdout:257/600: open fd = 3 2024-09-19T04:54:25.832 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.832 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.832 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.832 INFO:tasks.workunit.client.0.smithi002.stdout:258/600: open fd = 3 2024-09-19T04:54:25.832 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.832 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.832 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.832 INFO:tasks.workunit.client.0.smithi002.stdout:259/600: open fd = 3 2024-09-19T04:54:25.832 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.832 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.833 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.833 INFO:tasks.workunit.client.0.smithi002.stdout:260/600: open fd = 3 2024-09-19T04:54:25.833 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.833 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.833 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.833 INFO:tasks.workunit.client.0.smithi002.stdout:261/600: open fd = 3 2024-09-19T04:54:25.833 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.833 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.833 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.833 INFO:tasks.workunit.client.0.smithi002.stdout:262/600: open fd = 3 2024-09-19T04:54:25.833 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.833 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.833 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.834 INFO:tasks.workunit.client.0.smithi002.stdout:263/600: open fd = 3 2024-09-19T04:54:25.834 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.834 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.834 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.834 INFO:tasks.workunit.client.0.smithi002.stdout:264/600: open fd = 3 2024-09-19T04:54:25.834 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.834 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.834 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.834 INFO:tasks.workunit.client.0.smithi002.stdout:265/600: open fd = 3 2024-09-19T04:54:25.834 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.834 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.834 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.834 INFO:tasks.workunit.client.0.smithi002.stdout:266/600: open fd = 3 2024-09-19T04:54:25.834 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.835 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.835 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.835 INFO:tasks.workunit.client.0.smithi002.stdout:267/600: open fd = 3 2024-09-19T04:54:25.835 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.835 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.835 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.835 INFO:tasks.workunit.client.0.smithi002.stdout:268/600: open fd = 3 2024-09-19T04:54:25.835 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.835 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.835 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.835 INFO:tasks.workunit.client.0.smithi002.stdout:269/600: open fd = 3 2024-09-19T04:54:25.835 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.835 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.835 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.836 INFO:tasks.workunit.client.0.smithi002.stdout:270/600: open fd = 3 2024-09-19T04:54:25.836 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.836 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.836 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.836 INFO:tasks.workunit.client.0.smithi002.stdout:271/600: open fd = 3 2024-09-19T04:54:25.836 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.836 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.836 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.836 INFO:tasks.workunit.client.0.smithi002.stdout:272/600: open fd = 3 2024-09-19T04:54:25.836 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.836 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.836 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.836 INFO:tasks.workunit.client.0.smithi002.stdout:273/600: open fd = 3 2024-09-19T04:54:25.836 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.837 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.837 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.837 INFO:tasks.workunit.client.0.smithi002.stdout:274/600: open fd = 3 2024-09-19T04:54:25.837 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.837 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.837 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.837 INFO:tasks.workunit.client.0.smithi002.stdout:275/600: open fd = 3 2024-09-19T04:54:25.837 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.837 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.837 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.837 INFO:tasks.workunit.client.0.smithi002.stdout:276/600: open fd = 3 2024-09-19T04:54:25.837 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.837 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.837 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.838 INFO:tasks.workunit.client.0.smithi002.stdout:277/600: open fd = 3 2024-09-19T04:54:25.838 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.838 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.838 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.838 INFO:tasks.workunit.client.0.smithi002.stdout:278/600: open fd = 3 2024-09-19T04:54:25.838 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.838 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.838 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.838 INFO:tasks.workunit.client.0.smithi002.stdout:279/600: open fd = 3 2024-09-19T04:54:25.838 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.838 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.838 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.838 INFO:tasks.workunit.client.0.smithi002.stdout:280/600: open fd = 3 2024-09-19T04:54:25.839 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.839 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.839 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.839 INFO:tasks.workunit.client.0.smithi002.stdout:281/600: open fd = 3 2024-09-19T04:54:25.839 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.839 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.839 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.839 INFO:tasks.workunit.client.0.smithi002.stdout:282/600: open fd = 3 2024-09-19T04:54:25.839 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.839 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.839 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.839 INFO:tasks.workunit.client.0.smithi002.stdout:283/600: open fd = 3 2024-09-19T04:54:25.839 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.839 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.840 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.840 INFO:tasks.workunit.client.0.smithi002.stdout:284/600: open fd = 3 2024-09-19T04:54:25.840 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.840 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.840 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.840 INFO:tasks.workunit.client.0.smithi002.stdout:285/600: open fd = 3 2024-09-19T04:54:25.840 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.840 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.840 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.840 INFO:tasks.workunit.client.0.smithi002.stdout:286/600: open fd = 3 2024-09-19T04:54:25.840 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.840 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.840 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.841 INFO:tasks.workunit.client.0.smithi002.stdout:287/600: open fd = 3 2024-09-19T04:54:25.841 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.841 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.841 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.841 INFO:tasks.workunit.client.0.smithi002.stdout:288/600: open fd = 3 2024-09-19T04:54:25.841 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.841 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.841 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.841 INFO:tasks.workunit.client.0.smithi002.stdout:289/600: open fd = 3 2024-09-19T04:54:25.841 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.841 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.841 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.841 INFO:tasks.workunit.client.0.smithi002.stdout:290/600: open fd = 3 2024-09-19T04:54:25.842 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.842 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.842 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.842 INFO:tasks.workunit.client.0.smithi002.stdout:291/600: open fd = 3 2024-09-19T04:54:25.842 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.842 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.842 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.842 INFO:tasks.workunit.client.0.smithi002.stdout:292/600: open fd = 3 2024-09-19T04:54:25.842 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.842 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.842 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.842 INFO:tasks.workunit.client.0.smithi002.stdout:293/600: open fd = 3 2024-09-19T04:54:25.842 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.843 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.843 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.843 INFO:tasks.workunit.client.0.smithi002.stdout:294/600: open fd = 3 2024-09-19T04:54:25.843 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.843 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.843 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.843 INFO:tasks.workunit.client.0.smithi002.stdout:295/600: open fd = 3 2024-09-19T04:54:25.843 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.843 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.843 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.843 INFO:tasks.workunit.client.0.smithi002.stdout:296/600: open fd = 3 2024-09-19T04:54:25.843 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.843 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.843 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.844 INFO:tasks.workunit.client.0.smithi002.stdout:297/600: open fd = 3 2024-09-19T04:54:25.844 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.844 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.844 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.844 INFO:tasks.workunit.client.0.smithi002.stdout:298/600: open fd = 3 2024-09-19T04:54:25.844 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.844 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.844 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.844 INFO:tasks.workunit.client.0.smithi002.stdout:299/600: open fd = 3 2024-09-19T04:54:25.844 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.844 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.844 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.844 INFO:tasks.workunit.client.0.smithi002.stdout:300/600: open fd = 3 2024-09-19T04:54:25.844 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.845 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.845 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.845 INFO:tasks.workunit.client.0.smithi002.stdout:301/600: open fd = 3 2024-09-19T04:54:25.845 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.845 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.845 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.845 INFO:tasks.workunit.client.0.smithi002.stdout:302/600: open fd = 3 2024-09-19T04:54:25.845 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.845 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.845 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.845 INFO:tasks.workunit.client.0.smithi002.stdout:303/600: open fd = 3 2024-09-19T04:54:25.845 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.845 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.845 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.846 INFO:tasks.workunit.client.0.smithi002.stdout:304/600: open fd = 3 2024-09-19T04:54:25.846 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.846 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.846 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.846 INFO:tasks.workunit.client.0.smithi002.stdout:305/600: open fd = 3 2024-09-19T04:54:25.846 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.846 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.846 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.846 INFO:tasks.workunit.client.0.smithi002.stdout:306/600: open fd = 3 2024-09-19T04:54:25.846 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.846 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.846 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.847 INFO:tasks.workunit.client.0.smithi002.stdout:307/600: open fd = 3 2024-09-19T04:54:25.847 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.847 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.847 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.847 INFO:tasks.workunit.client.0.smithi002.stdout:308/600: open fd = 3 2024-09-19T04:54:25.847 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.847 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.847 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.847 INFO:tasks.workunit.client.0.smithi002.stdout:309/600: open fd = 3 2024-09-19T04:54:25.847 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.847 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.847 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.847 INFO:tasks.workunit.client.0.smithi002.stdout:310/600: open fd = 3 2024-09-19T04:54:25.847 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.848 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.848 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.848 INFO:tasks.workunit.client.0.smithi002.stdout:311/600: open fd = 3 2024-09-19T04:54:25.848 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.848 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.848 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:54:25.848 INFO:tasks.workunit.client.0.smithi002.stdout:312/600: open fd = 3 2024-09-19T04:54:25.848 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.848 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:54:25.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:54:25 smithi002 ceph-mon[30975]: scrub summary: idle 2024-09-19T04:54:25.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:54:25 smithi116 ceph-mon[34477]: scrub summary: idle 2024-09-19T04:54:26.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:54:25 smithi018 ceph-mon[34537]: scrub summary: idle 2024-09-19T04:54:26.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:54:26 smithi002 ceph-mon[30975]: pgmap v196: 97 pgs: 97 active+clean; 9.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 55 KiB/s wr, 11 op/s 2024-09-19T04:54:26.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:54:26 smithi116 ceph-mon[34477]: pgmap v196: 97 pgs: 97 active+clean; 9.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 55 KiB/s wr, 11 op/s 2024-09-19T04:54:27.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:54:26 smithi018 ceph-mon[34537]: pgmap v196: 97 pgs: 97 active+clean; 9.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 55 KiB/s wr, 11 op/s 2024-09-19T04:54:28.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:54:28 smithi002 ceph-mon[30975]: pgmap v197: 97 pgs: 97 active+clean; 9.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 KiB/s wr, 7 op/s 2024-09-19T04:54:28.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:54:28 smithi116 ceph-mon[34477]: pgmap v197: 97 pgs: 97 active+clean; 9.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 KiB/s wr, 7 op/s 2024-09-19T04:54:29.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:54:28 smithi018 ceph-mon[34537]: pgmap v197: 97 pgs: 97 active+clean; 9.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 KiB/s wr, 7 op/s 2024-09-19T04:54:30.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:54:30 smithi002 ceph-mon[30975]: pgmap v198: 97 pgs: 97 active+clean; 9.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 KiB/s wr, 7 op/s 2024-09-19T04:54:30.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:54:30 smithi116 ceph-mon[34477]: pgmap v198: 97 pgs: 97 active+clean; 9.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 KiB/s wr, 7 op/s 2024-09-19T04:54:31.056 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:54:30 smithi018 ceph-mon[34537]: pgmap v198: 97 pgs: 97 active+clean; 9.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 KiB/s wr, 7 op/s 2024-09-19T04:54:32.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:54:32 smithi002 ceph-mon[30975]: pgmap v199: 97 pgs: 97 active+clean; 9.3 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 52 KiB/s wr, 10 op/s 2024-09-19T04:54:32.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:54:32 smithi116 ceph-mon[34477]: pgmap v199: 97 pgs: 97 active+clean; 9.3 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 52 KiB/s wr, 10 op/s 2024-09-19T04:54:33.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:54:32 smithi018 ceph-mon[34537]: pgmap v199: 97 pgs: 97 active+clean; 9.3 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 52 KiB/s wr, 10 op/s 2024-09-19T04:54:34.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:54:34 smithi002 ceph-mon[30975]: pgmap v200: 97 pgs: 97 active+clean; 9.3 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 KiB/s wr, 7 op/s 2024-09-19T04:54:34.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:54:34 smithi116 ceph-mon[34477]: pgmap v200: 97 pgs: 97 active+clean; 9.3 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 KiB/s wr, 7 op/s 2024-09-19T04:54:35.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:54:34 smithi018 ceph-mon[34537]: pgmap v200: 97 pgs: 97 active+clean; 9.3 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 KiB/s wr, 7 op/s 2024-09-19T04:54:36.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:54:36 smithi002 ceph-mon[30975]: pgmap v201: 97 pgs: 97 active+clean; 9.4 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 54 KiB/s wr, 11 op/s 2024-09-19T04:54:36.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:54:36 smithi116 ceph-mon[34477]: pgmap v201: 97 pgs: 97 active+clean; 9.4 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 54 KiB/s wr, 11 op/s 2024-09-19T04:54:37.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:54:36 smithi018 ceph-mon[34537]: pgmap v201: 97 pgs: 97 active+clean; 9.4 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 54 KiB/s wr, 11 op/s 2024-09-19T04:54:38.949 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:54:38 smithi002 ceph-mon[30975]: pgmap v202: 97 pgs: 97 active+clean; 9.4 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 KiB/s wr, 7 op/s 2024-09-19T04:54:39.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:54:38 smithi018 ceph-mon[34537]: pgmap v202: 97 pgs: 97 active+clean; 9.4 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 KiB/s wr, 7 op/s 2024-09-19T04:54:39.110 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:54:38 smithi116 ceph-mon[34477]: pgmap v202: 97 pgs: 97 active+clean; 9.4 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 KiB/s wr, 7 op/s 2024-09-19T04:54:41.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:54:40 smithi018 ceph-mon[34537]: pgmap v203: 97 pgs: 97 active+clean; 9.4 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 KiB/s wr, 7 op/s 2024-09-19T04:54:41.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:54:40 smithi002 ceph-mon[30975]: pgmap v203: 97 pgs: 97 active+clean; 9.4 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 KiB/s wr, 7 op/s 2024-09-19T04:54:41.110 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:54:40 smithi116 ceph-mon[34477]: pgmap v203: 97 pgs: 97 active+clean; 9.4 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 KiB/s wr, 7 op/s 2024-09-19T04:54:43.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:54:42 smithi018 ceph-mon[34537]: pgmap v204: 97 pgs: 97 active+clean; 9.6 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 49 KiB/s wr, 11 op/s 2024-09-19T04:54:43.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:54:42 smithi002 ceph-mon[30975]: pgmap v204: 97 pgs: 97 active+clean; 9.6 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 49 KiB/s wr, 11 op/s 2024-09-19T04:54:43.110 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:54:42 smithi116 ceph-mon[34477]: pgmap v204: 97 pgs: 97 active+clean; 9.6 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 49 KiB/s wr, 11 op/s 2024-09-19T04:54:45.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:54:44 smithi018 ceph-mon[34537]: pgmap v205: 97 pgs: 97 active+clean; 9.6 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 KiB/s wr, 7 op/s 2024-09-19T04:54:45.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:54:44 smithi002 ceph-mon[30975]: pgmap v205: 97 pgs: 97 active+clean; 9.6 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 KiB/s wr, 7 op/s 2024-09-19T04:54:45.110 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:54:44 smithi116 ceph-mon[34477]: pgmap v205: 97 pgs: 97 active+clean; 9.6 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 KiB/s wr, 7 op/s 2024-09-19T04:54:46.913 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:54:46 smithi116 ceph-mon[34477]: pgmap v206: 97 pgs: 97 active+clean; 9.8 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 53 KiB/s wr, 11 op/s 2024-09-19T04:54:47.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:54:46 smithi018 ceph-mon[34537]: pgmap v206: 97 pgs: 97 active+clean; 9.8 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 53 KiB/s wr, 11 op/s 2024-09-19T04:54:47.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:54:46 smithi002 ceph-mon[30975]: pgmap v206: 97 pgs: 97 active+clean; 9.8 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 53 KiB/s wr, 11 op/s 2024-09-19T04:54:49.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:54:48 smithi018 ceph-mon[34537]: pgmap v207: 97 pgs: 97 active+clean; 9.8 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 35 KiB/s wr, 7 op/s 2024-09-19T04:54:49.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:54:48 smithi002 ceph-mon[30975]: pgmap v207: 97 pgs: 97 active+clean; 9.8 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 35 KiB/s wr, 7 op/s 2024-09-19T04:54:49.110 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:54:48 smithi116 ceph-mon[34477]: pgmap v207: 97 pgs: 97 active+clean; 9.8 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 35 KiB/s wr, 7 op/s 2024-09-19T04:54:51.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:54:50 smithi018 ceph-mon[34537]: pgmap v208: 97 pgs: 97 active+clean; 9.8 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 35 KiB/s wr, 7 op/s 2024-09-19T04:54:51.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:54:50 smithi002 ceph-mon[30975]: pgmap v208: 97 pgs: 97 active+clean; 9.8 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 35 KiB/s wr, 7 op/s 2024-09-19T04:54:51.110 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:54:50 smithi116 ceph-mon[34477]: pgmap v208: 97 pgs: 97 active+clean; 9.8 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 35 KiB/s wr, 7 op/s 2024-09-19T04:54:53.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:54:52 smithi018 ceph-mon[34537]: pgmap v209: 97 pgs: 97 active+clean; 10 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 51 KiB/s wr, 10 op/s 2024-09-19T04:54:53.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:54:52 smithi002 ceph-mon[30975]: pgmap v209: 97 pgs: 97 active+clean; 10 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 51 KiB/s wr, 10 op/s 2024-09-19T04:54:53.110 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:54:52 smithi116 ceph-mon[34477]: pgmap v209: 97 pgs: 97 active+clean; 10 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 51 KiB/s wr, 10 op/s 2024-09-19T04:54:54.123 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:54:54.398 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:54:54.788 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:54:54 smithi002 ceph-mon[30975]: pgmap v210: 97 pgs: 97 active+clean; 10 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 35 KiB/s wr, 7 op/s 2024-09-19T04:54:54.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.872+0000 7f662c035640 1 -- 172.21.15.2:0/4221943918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6624102d30 msgr2=0x7f6624103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:54.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.872+0000 7f662c035640 1 --2- 172.21.15.2:0/4221943918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6624102d30 0x7f6624103110 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f6620009930 tx=0x7f662002a420 comp rx=0 tx=0).stop 2024-09-19T04:54:54.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.872+0000 7f662c035640 1 -- 172.21.15.2:0/4221943918 shutdown_connections 2024-09-19T04:54:54.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.872+0000 7f662c035640 1 --2- 172.21.15.2:0/4221943918 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f66241082a0 0x7f662410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:54.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.872+0000 7f662c035640 1 --2- 172.21.15.2:0/4221943918 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66241036e0 0x7f6624107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:54.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.872+0000 7f662c035640 1 --2- 172.21.15.2:0/4221943918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6624102d30 0x7f6624103110 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:54.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.872+0000 7f662c035640 1 -- 172.21.15.2:0/4221943918 >> 172.21.15.2:0/4221943918 conn(0x7f66240fc7d0 msgr2=0x7f66240febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:54:54.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.873+0000 7f662c035640 1 -- 172.21.15.2:0/4221943918 shutdown_connections 2024-09-19T04:54:54.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.873+0000 7f662c035640 1 -- 172.21.15.2:0/4221943918 wait complete. 2024-09-19T04:54:54.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.873+0000 7f662c035640 1 Processor -- start 2024-09-19T04:54:54.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.873+0000 7f662c035640 1 -- start start 2024-09-19T04:54:54.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.874+0000 7f662c035640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6624102d30 0x7f66241984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:54.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.874+0000 7f662c035640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66241036e0 0x7f66241989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:54.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.874+0000 7f662c035640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66241082a0 0x7f662419cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:54.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.874+0000 7f662c035640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6624111fb0 con 0x7f66241036e0 2024-09-19T04:54:54.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.874+0000 7f662c035640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6624111e30 con 0x7f66241082a0 2024-09-19T04:54:54.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.874+0000 7f662c035640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f6624112130 con 0x7f6624102d30 2024-09-19T04:54:54.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.874+0000 7f66295d0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66241036e0 0x7f66241989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:54.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.874+0000 7f66295d0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66241036e0 0x7f66241989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56998/0 (socket says 172.21.15.2:56998) 2024-09-19T04:54:54.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.874+0000 7f66295d0640 1 -- 172.21.15.2:0/2492184181 learned_addr learned my addr 172.21.15.2:0/2492184181 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:54:54.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.874+0000 7f662a5d2640 1 --2- 172.21.15.2:0/2492184181 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66241082a0 0x7f662419cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:54.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.874+0000 7f6629dd1640 1 --2- 172.21.15.2:0/2492184181 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6624102d30 0x7f66241984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:54.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.874+0000 7f66295d0640 1 -- 172.21.15.2:0/2492184181 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6624102d30 msgr2=0x7f66241984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:54.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.874+0000 7f66295d0640 1 --2- 172.21.15.2:0/2492184181 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6624102d30 0x7f66241984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:54.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.874+0000 7f66295d0640 1 -- 172.21.15.2:0/2492184181 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66241082a0 msgr2=0x7f662419cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:54.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.874+0000 7f66295d0640 1 --2- 172.21.15.2:0/2492184181 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66241082a0 0x7f662419cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:54.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.874+0000 7f66295d0640 1 -- 172.21.15.2:0/2492184181 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f662419d460 con 0x7f66241036e0 2024-09-19T04:54:54.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.874+0000 7f66295d0640 1 --2- 172.21.15.2:0/2492184181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66241036e0 0x7f66241989f0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f661400c8c0 tx=0x7f661400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:54:54.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.875+0000 7f661affd640 1 -- 172.21.15.2:0/2492184181 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6614007bb0 con 0x7f66241036e0 2024-09-19T04:54:54.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.875+0000 7f662c035640 1 -- 172.21.15.2:0/2492184181 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f662419d750 con 0x7f66241036e0 2024-09-19T04:54:54.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.875+0000 7f661affd640 1 -- 172.21.15.2:0/2492184181 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6614007d50 con 0x7f66241036e0 2024-09-19T04:54:54.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.875+0000 7f661affd640 1 -- 172.21.15.2:0/2492184181 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66140187c0 con 0x7f66241036e0 2024-09-19T04:54:54.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.875+0000 7f662c035640 1 -- 172.21.15.2:0/2492184181 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66241a5030 con 0x7f66241036e0 2024-09-19T04:54:54.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.877+0000 7f661affd640 1 -- 172.21.15.2:0/2492184181 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f661400f450 con 0x7f66241036e0 2024-09-19T04:54:54.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.878+0000 7f662e40e740 1 Processor -- start 2024-09-19T04:54:54.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.878+0000 7f662e40e740 1 -- start start 2024-09-19T04:54:54.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.878+0000 7f662e40e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5635d26e4380 0x5635d26e4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:54.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.878+0000 7f662e40e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635d26e4ca0 0x5635d26f3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:54.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.878+0000 7f662e40e740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5635d26f3a90 0x5635d26f5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:54.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.878+0000 7f661affd640 1 --2- 172.21.15.2:0/2492184181 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f66100a33b0 0x7f66100a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:54.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.878+0000 7f662e40e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5635d264a2e0 con 0x5635d26e4ca0 2024-09-19T04:54:54.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.878+0000 7f662e40e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5635d25f1ce0 con 0x5635d26e4380 2024-09-19T04:54:54.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.878+0000 7f662e40e740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5635d26462a0 con 0x5635d26f3a90 2024-09-19T04:54:54.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.878+0000 7f661affd640 1 -- 172.21.15.2:0/2492184181 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f66140cfd50 con 0x7f66241036e0 2024-09-19T04:54:54.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.878+0000 7f6629dd1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635d26e4ca0 0x5635d26f3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:54.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.878+0000 7f6629dd1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635d26e4ca0 0x5635d26f3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57012/0 (socket says 172.21.15.2:57012) 2024-09-19T04:54:54.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.878+0000 7f6629dd1640 1 -- 172.21.15.2:0/3430619031 learned_addr learned my addr 172.21.15.2:0/3430619031 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:54:54.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.878+0000 7f66295d0640 1 --2- 172.21.15.2:0/2492184181 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f66100a33b0 0x7f66100a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:54.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.879+0000 7f662a5d2640 1 --2- 172.21.15.2:0/3430619031 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5635d26f3a90 0x5635d26f5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:54.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.879+0000 7f662a5d2640 1 --2- 172.21.15.2:0/3430619031 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5635d26e4380 0x5635d26e4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:54.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.879+0000 7f6629dd1640 1 -- 172.21.15.2:0/3430619031 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5635d26f3a90 msgr2=0x5635d26f5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:54:54.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.879+0000 7f6629dd1640 1 --2- 172.21.15.2:0/3430619031 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5635d26f3a90 0x5635d26f5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:54.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.879+0000 7f6629dd1640 1 -- 172.21.15.2:0/3430619031 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5635d26e4380 msgr2=0x5635d26e4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:54:54.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.879+0000 7f6629dd1640 1 --2- 172.21.15.2:0/3430619031 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5635d26e4380 0x5635d26e4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:54.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.879+0000 7f6629dd1640 1 -- 172.21.15.2:0/3430619031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635d25d6440 con 0x5635d26e4ca0 2024-09-19T04:54:54.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.879+0000 7f662a5d2640 1 --2- 172.21.15.2:0/3430619031 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5635d26e4380 0x5635d26e4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:54:54.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.879+0000 7f66295d0640 1 --2- 172.21.15.2:0/2492184181 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f66100a33b0 0x7f66100a5870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6614098a20 tx=0x7f661400fd60 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:54:54.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.879+0000 7f6629dd1640 1 --2- 172.21.15.2:0/3430619031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635d26e4ca0 0x5635d26f3550 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f6620009930 tx=0x7f6620032d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10c615dd3672bbbd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:54:54.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.879+0000 7f660ffff640 1 -- 172.21.15.2:0/3430619031 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6620035040 con 0x5635d26e4ca0 2024-09-19T04:54:54.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.879+0000 7f660ffff640 1 -- 172.21.15.2:0/3430619031 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f66200316a0 con 0x5635d26e4ca0 2024-09-19T04:54:54.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.879+0000 7f660ffff640 1 -- 172.21.15.2:0/3430619031 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66200047a0 con 0x5635d26e4ca0 2024-09-19T04:54:54.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.880+0000 7f662e40e740 1 -- 172.21.15.2:0/3430619031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635d26e4ca0 msgr2=0x5635d26f3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:54.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.880+0000 7f662e40e740 1 --2- 172.21.15.2:0/3430619031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635d26e4ca0 0x5635d26f3550 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f6620009930 tx=0x7f6620032d60 comp rx=0 tx=0).stop 2024-09-19T04:54:54.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.880+0000 7f662e40e740 1 -- 172.21.15.2:0/3430619031 shutdown_connections 2024-09-19T04:54:54.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.880+0000 7f662e40e740 1 --2- 172.21.15.2:0/3430619031 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5635d26f3a90 0x5635d26f5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:54.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.880+0000 7f662e40e740 1 --2- 172.21.15.2:0/3430619031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635d26e4ca0 0x5635d26f3550 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:54.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.880+0000 7f662e40e740 1 --2- 172.21.15.2:0/3430619031 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5635d26e4380 0x5635d26e4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:54.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.880+0000 7f662e40e740 1 -- 172.21.15.2:0/3430619031 >> 172.21.15.2:0/3430619031 conn(0x5635d26e0a30 msgr2=0x5635d26e0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:54:54.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.880+0000 7f662e40e740 1 -- 172.21.15.2:0/3430619031 shutdown_connections 2024-09-19T04:54:54.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.880+0000 7f662e40e740 1 -- 172.21.15.2:0/3430619031 wait complete. 2024-09-19T04:54:54.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.881+0000 7f662e40e740 1 -- start start 2024-09-19T04:54:54.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.881+0000 7f662e40e740 1 Processor -- start 2024-09-19T04:54:54.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.881+0000 7f662e40e740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5635d26e4380 0x5635d26f33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:54.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.881+0000 7f662e40e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5635d26e4ca0 0x5635d26f06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:54.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.881+0000 7f662e40e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635d26f3a90 0x5635d26f0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:54.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.881+0000 7f662e40e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5635d26f6660 con 0x5635d26f3a90 2024-09-19T04:54:54.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.881+0000 7f662e40e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5635d2605050 con 0x5635d26e4ca0 2024-09-19T04:54:54.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.881+0000 7f662e40e740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5635d26f67e0 con 0x5635d26e4380 2024-09-19T04:54:54.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.881+0000 7f662e40e740 10 client.0 _ll_register_callbacks cb 0x5635d2645160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:54:54.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.881+0000 7f662a5d2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635d26f3a90 0x5635d26f0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:54.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.881+0000 7f662a5d2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635d26f3a90 0x5635d26f0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57024/0 (socket says 172.21.15.2:57024) 2024-09-19T04:54:54.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.881+0000 7f662a5d2640 1 -- 172.21.15.2:0/3796696030 learned_addr learned my addr 172.21.15.2:0/3796696030 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:54:54.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.882+0000 7f662a5d2640 1 --2- 172.21.15.2:0/3796696030 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5635d26e4380 0x5635d26f33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:54.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.882+0000 7f6629dd1640 1 --2- 172.21.15.2:0/3796696030 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5635d26e4ca0 0x5635d26f06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:54.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.882+0000 7f662a5d2640 1 -- 172.21.15.2:0/3796696030 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5635d26e4380 msgr2=0x5635d26f33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:54:54.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.882+0000 7f662a5d2640 1 --2- 172.21.15.2:0/3796696030 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5635d26e4380 0x5635d26f33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:54.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.882+0000 7f662a5d2640 1 -- 172.21.15.2:0/3796696030 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5635d26e4ca0 msgr2=0x5635d26f06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:54:54.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.882+0000 7f662a5d2640 1 --2- 172.21.15.2:0/3796696030 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5635d26e4ca0 0x5635d26f06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:54.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.882+0000 7f662a5d2640 1 -- 172.21.15.2:0/3796696030 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635d23bb3c0 con 0x5635d26f3a90 2024-09-19T04:54:54.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.882+0000 7f662a5d2640 1 --2- 172.21.15.2:0/3796696030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635d26f3a90 0x5635d26f0c00 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f661c00be80 tx=0x7f661c009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79514446a76fd636 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:54:54.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.882+0000 7f660d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:54:54.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.882+0000 7f660d7fa640 1 -- 172.21.15.2:0/3796696030 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f661c022060 con 0x5635d26f3a90 2024-09-19T04:54:54.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.882+0000 7f660d7fa640 1 -- 172.21.15.2:0/3796696030 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f661c008740 con 0x5635d26f3a90 2024-09-19T04:54:54.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.882+0000 7f662e40e740 1 -- 172.21.15.2:0/3796696030 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66200316a0 con 0x5635d26f3a90 2024-09-19T04:54:54.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.882+0000 7f660d7fa640 1 -- 172.21.15.2:0/3796696030 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f661c014040 con 0x5635d26f3a90 2024-09-19T04:54:54.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.882+0000 7f662e40e740 10 client.16176 fetch_fsmap learned FSMap version 19 2024-09-19T04:54:54.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.882+0000 7f662e40e740 1 -- 172.21.15.2:0/3796696030 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5635d27020d0 con 0x5635d26f3a90 2024-09-19T04:54:54.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.883+0000 7f660d7fa640 1 -- 172.21.15.2:0/3796696030 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f66200316a0 con 0x5635d26f3a90 2024-09-19T04:54:54.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.883+0000 7f660d7fa640 1 -- 172.21.15.2:0/3796696030 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f661c01b860 con 0x5635d26f3a90 2024-09-19T04:54:54.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.883+0000 7f662e40e740 10 client.16176 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:54:54.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.883+0000 7f662e40e740 10 client.16176 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:54:54.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.883+0000 7f662e40e740 20 client.16176 populate_metadata read hostname 'smithi002' 2024-09-19T04:54:54.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.883+0000 7f662e40e740 1 --2- 172.21.15.2:0/3796696030 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5635d2703590 0x5635d2705980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:54.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.883+0000 7f662e40e740 4 client.16176 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:54:54.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.883+0000 7f662e40e740 1 -- 172.21.15.2:0/3796696030 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5635d2657850 con 0x5635d2703590 2024-09-19T04:54:54.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.883+0000 7f6629dd1640 1 --2- 172.21.15.2:0/3796696030 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5635d2703590 0x5635d2705980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:54.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.884+0000 7f6629dd1640 1 --2- 172.21.15.2:0/3796696030 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5635d2703590 0x5635d2705980 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9c7d013933f3e0 server_cookie=90e9220fafd4272a in_seq=0 out_seq=0 2024-09-19T04:54:54.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.884+0000 7f660d7fa640 10 client.16176 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:54:54.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.884+0000 7f660d7fa640 1 -- 172.21.15.2:0/3796696030 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5635d2657850 con 0x5635d2703590 2024-09-19T04:54:54.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.884+0000 7f660d7fa640 10 client.16176 handle_command_reply: tid=0 2024-09-19T04:54:54.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.884+0000 7f662e40e740 1 client.16176 shutdown 2024-09-19T04:54:54.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.884+0000 7f662e40e740 1 -- 172.21.15.2:0/3796696030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635d26f3a90 msgr2=0x5635d26f0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:54.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.884+0000 7f662e40e740 1 --2- 172.21.15.2:0/3796696030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635d26f3a90 0x5635d26f0c00 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f661c00be80 tx=0x7f661c009650 comp rx=0 tx=0).stop 2024-09-19T04:54:54.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.885+0000 7f662e40e740 1 -- 172.21.15.2:0/3796696030 shutdown_connections 2024-09-19T04:54:54.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.885+0000 7f662e40e740 1 --2- 172.21.15.2:0/3796696030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635d26f3a90 0x5635d26f0c00 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:54.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.885+0000 7f662e40e740 1 --2- 172.21.15.2:0/3796696030 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5635d26e4ca0 0x5635d26f06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:54.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.885+0000 7f662e40e740 1 --2- 172.21.15.2:0/3796696030 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5635d2703590 0x5635d2705980 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:54.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.885+0000 7f662e40e740 1 --2- 172.21.15.2:0/3796696030 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5635d26e4380 0x5635d26f33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:54.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.885+0000 7f660d7fa640 0 client.16176 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:54:54.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.885+0000 7f662e40e740 1 -- 172.21.15.2:0/3796696030 >> 172.21.15.2:0/3796696030 conn(0x5635d26e0a30 msgr2=0x5635d26e6790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:54:54.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.885+0000 7f662e40e740 1 -- 172.21.15.2:0/3796696030 shutdown_connections 2024-09-19T04:54:54.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.885+0000 7f662e40e740 1 -- 172.21.15.2:0/3796696030 wait complete. 2024-09-19T04:54:54.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.885+0000 7f662e40e740 20 client.16176 trim_cache size 0 max 16384 2024-09-19T04:54:54.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.902+0000 7f662e40e740 1 Processor -- start 2024-09-19T04:54:54.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.902+0000 7f662e40e740 1 -- start start 2024-09-19T04:54:54.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.902+0000 7f662e40e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5635d26e4380 0x5635d26ff900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:54.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.902+0000 7f662e40e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635d26e4ca0 0x5635d270b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:54.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.902+0000 7f662e40e740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5635d26f3a90 0x5635d270b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:54.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.902+0000 7f662e40e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f66241a9530 con 0x5635d26e4ca0 2024-09-19T04:54:54.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.902+0000 7f662e40e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f66241abdb0 con 0x5635d26e4380 2024-09-19T04:54:54.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.902+0000 7f662e40e740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f66241a9ba0 con 0x5635d26f3a90 2024-09-19T04:54:54.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.902+0000 7f6629dd1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635d26e4ca0 0x5635d270b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:54.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.902+0000 7f6629dd1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635d26e4ca0 0x5635d270b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57028/0 (socket says 172.21.15.2:57028) 2024-09-19T04:54:54.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.902+0000 7f6629dd1640 1 -- 172.21.15.2:0/4154763373 learned_addr learned my addr 172.21.15.2:0/4154763373 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:54:54.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.902+0000 7f662a5d2640 1 --2- 172.21.15.2:0/4154763373 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5635d26f3a90 0x5635d270b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:54.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.903+0000 7f662a5d2640 1 --2- 172.21.15.2:0/4154763373 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5635d26e4380 0x5635d26ff900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:54.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.903+0000 7f6629dd1640 1 -- 172.21.15.2:0/4154763373 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5635d26f3a90 msgr2=0x5635d270b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:54:54.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.903+0000 7f6629dd1640 1 --2- 172.21.15.2:0/4154763373 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5635d26f3a90 0x5635d270b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:54.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.903+0000 7f6629dd1640 1 -- 172.21.15.2:0/4154763373 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5635d26e4380 msgr2=0x5635d26ff900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:54:54.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.903+0000 7f6629dd1640 1 --2- 172.21.15.2:0/4154763373 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5635d26e4380 0x5635d26ff900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:54.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.903+0000 7f6629dd1640 1 -- 172.21.15.2:0/4154763373 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635d26eebf0 con 0x5635d26e4ca0 2024-09-19T04:54:54.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.903+0000 7f6629dd1640 1 --2- 172.21.15.2:0/4154763373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635d26e4ca0 0x5635d270b1b0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x5635d26e7090 tx=0x7f6620031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b780d862f9fbff09 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:54:54.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.903+0000 7f660f7fe640 1 -- 172.21.15.2:0/4154763373 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6620035040 con 0x5635d26e4ca0 2024-09-19T04:54:54.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.903+0000 7f660f7fe640 1 -- 172.21.15.2:0/4154763373 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6620004240 con 0x5635d26e4ca0 2024-09-19T04:54:54.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.903+0000 7f660f7fe640 1 -- 172.21.15.2:0/4154763373 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6620032050 con 0x5635d26e4ca0 2024-09-19T04:54:54.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.904+0000 7f662e40e740 1 -- 172.21.15.2:0/4154763373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635d26e4ca0 msgr2=0x5635d270b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:54.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.904+0000 7f662e40e740 1 --2- 172.21.15.2:0/4154763373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635d26e4ca0 0x5635d270b1b0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x5635d26e7090 tx=0x7f6620031400 comp rx=0 tx=0).stop 2024-09-19T04:54:54.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.904+0000 7f662e40e740 1 -- 172.21.15.2:0/4154763373 shutdown_connections 2024-09-19T04:54:54.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.904+0000 7f662e40e740 1 --2- 172.21.15.2:0/4154763373 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5635d26f3a90 0x5635d270b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:54.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.904+0000 7f662e40e740 1 --2- 172.21.15.2:0/4154763373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635d26e4ca0 0x5635d270b1b0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:54.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.904+0000 7f662e40e740 1 --2- 172.21.15.2:0/4154763373 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5635d26e4380 0x5635d26ff900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:54.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.904+0000 7f662e40e740 1 -- 172.21.15.2:0/4154763373 >> 172.21.15.2:0/4154763373 conn(0x5635d26e0a30 msgr2=0x5635d26eef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:54:54.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.904+0000 7f662e40e740 1 -- 172.21.15.2:0/4154763373 shutdown_connections 2024-09-19T04:54:54.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.904+0000 7f662e40e740 1 -- 172.21.15.2:0/4154763373 wait complete. 2024-09-19T04:54:54.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.905+0000 7f662e40e740 1 -- start start 2024-09-19T04:54:54.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.905+0000 7f662e40e740 1 Processor -- start 2024-09-19T04:54:54.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.905+0000 7f662e40e740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5635d26e4380 0x5635d26f7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:54.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.905+0000 7f662e40e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635d26e4ca0 0x5635d26f7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:54.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.905+0000 7f662e40e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5635d26f3a90 0x5635d26f8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:54.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.905+0000 7f662e40e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f66241aa270 con 0x5635d26e4ca0 2024-09-19T04:54:54.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.905+0000 7f662e40e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f66241ab6e0 con 0x5635d26f3a90 2024-09-19T04:54:54.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.905+0000 7f662e40e740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f66241aa940 con 0x5635d26e4380 2024-09-19T04:54:54.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.905+0000 7f662e40e740 10 client.0 _ll_register_callbacks cb 0x7f661c00b4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:54:54.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.905+0000 7f6629dd1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635d26e4ca0 0x5635d26f7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:54.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.905+0000 7f6629dd1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635d26e4ca0 0x5635d26f7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57044/0 (socket says 172.21.15.2:57044) 2024-09-19T04:54:54.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.905+0000 7f6629dd1640 1 -- 172.21.15.2:0/3887375304 learned_addr learned my addr 172.21.15.2:0/3887375304 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:54:54.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.905+0000 7f662a5d2640 1 --2- 172.21.15.2:0/3887375304 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5635d26e4380 0x5635d26f7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:54.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.906+0000 7f662a5d2640 1 --2- 172.21.15.2:0/3887375304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5635d26f3a90 0x5635d26f8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:54.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.906+0000 7f6629dd1640 1 -- 172.21.15.2:0/3887375304 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5635d26e4380 msgr2=0x5635d26f7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:54:54.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.906+0000 7f6629dd1640 1 --2- 172.21.15.2:0/3887375304 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5635d26e4380 0x5635d26f7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:54.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.906+0000 7f6629dd1640 1 -- 172.21.15.2:0/3887375304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5635d26f3a90 msgr2=0x5635d26f8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:54:54.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.906+0000 7f6629dd1640 1 --2- 172.21.15.2:0/3887375304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5635d26f3a90 0x5635d26f8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:54.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.906+0000 7f6629dd1640 1 -- 172.21.15.2:0/3887375304 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635d276d420 con 0x5635d26e4ca0 2024-09-19T04:54:54.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.906+0000 7f662a5d2640 1 --2- 172.21.15.2:0/3887375304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5635d26f3a90 0x5635d26f8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:54:54.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.906+0000 7f6629dd1640 1 --2- 172.21.15.2:0/3887375304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635d26e4ca0 0x5635d26f7fd0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f6620009340 tx=0x7f6620005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3a39f6487e03c30 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:54:54.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.906+0000 7f660d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:54:54.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.906+0000 7f660d7fa640 1 -- 172.21.15.2:0/3887375304 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6620035030 con 0x5635d26e4ca0 2024-09-19T04:54:54.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.906+0000 7f662e40e740 1 -- 172.21.15.2:0/3887375304 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6620004240 con 0x5635d26e4ca0 2024-09-19T04:54:54.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.906+0000 7f660d7fa640 1 -- 172.21.15.2:0/3887375304 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f66200043f0 con 0x5635d26e4ca0 2024-09-19T04:54:54.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.906+0000 7f660d7fa640 1 -- 172.21.15.2:0/3887375304 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f6620005d50 con 0x5635d26e4ca0 2024-09-19T04:54:54.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.906+0000 7f662e40e740 10 client.16182 fetch_fsmap learned FSMap version 19 2024-09-19T04:54:54.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.906+0000 7f662e40e740 1 -- 172.21.15.2:0/3887375304 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5635d276e730 con 0x5635d26e4ca0 2024-09-19T04:54:54.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.907+0000 7f660d7fa640 1 -- 172.21.15.2:0/3887375304 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6620004240 con 0x5635d26e4ca0 2024-09-19T04:54:54.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.907+0000 7f660d7fa640 1 -- 172.21.15.2:0/3887375304 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f662006b020 con 0x5635d26e4ca0 2024-09-19T04:54:54.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.907+0000 7f662e40e740 10 client.16182 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:54:54.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.907+0000 7f662e40e740 10 client.16182 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:54:54.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.907+0000 7f662e40e740 20 client.16182 populate_metadata read hostname 'smithi002' 2024-09-19T04:54:54.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.907+0000 7f662e40e740 1 --2- 172.21.15.2:0/3887375304 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5635d276e9b0 0x5635d2770da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:54.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.907+0000 7f662e40e740 4 client.16182 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:54:54.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.907+0000 7f662e40e740 1 -- 172.21.15.2:0/3887375304 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5635d2651d60 con 0x5635d276e9b0 2024-09-19T04:54:54.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.907+0000 7f662a5d2640 1 --2- 172.21.15.2:0/3887375304 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5635d276e9b0 0x5635d2770da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:54.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.908+0000 7f662a5d2640 1 --2- 172.21.15.2:0/3887375304 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5635d276e9b0 0x5635d2770da0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40fbf4af370b90d7 server_cookie=9c9605bb884f06dc in_seq=0 out_seq=0 2024-09-19T04:54:54.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.908+0000 7f660d7fa640 10 client.16182 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:54:54.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.908+0000 7f660d7fa640 1 -- 172.21.15.2:0/3887375304 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5635d2651d60 con 0x5635d276e9b0 2024-09-19T04:54:54.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.908+0000 7f660d7fa640 10 client.16182 handle_command_reply: tid=0 2024-09-19T04:54:54.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.908+0000 7f662e40e740 1 client.16182 shutdown 2024-09-19T04:54:54.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.908+0000 7f662e40e740 1 -- 172.21.15.2:0/3887375304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635d26e4ca0 msgr2=0x5635d26f7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:54.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.908+0000 7f662e40e740 1 --2- 172.21.15.2:0/3887375304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635d26e4ca0 0x5635d26f7fd0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f6620009340 tx=0x7f6620005fd0 comp rx=0 tx=0).stop 2024-09-19T04:54:54.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.908+0000 7f662e40e740 1 -- 172.21.15.2:0/3887375304 shutdown_connections 2024-09-19T04:54:54.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.908+0000 7f662e40e740 1 --2- 172.21.15.2:0/3887375304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5635d26f3a90 0x5635d26f8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:54.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.908+0000 7f662e40e740 1 --2- 172.21.15.2:0/3887375304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5635d26e4ca0 0x5635d26f7fd0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:54.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.908+0000 7f662e40e740 1 --2- 172.21.15.2:0/3887375304 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5635d276e9b0 0x5635d2770da0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:54.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.908+0000 7f662e40e740 1 --2- 172.21.15.2:0/3887375304 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5635d26e4380 0x5635d26f7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:54.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.908+0000 7f662e40e740 1 -- 172.21.15.2:0/3887375304 >> 172.21.15.2:0/3887375304 conn(0x5635d26e0a30 msgr2=0x5635d26f1f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:54:54.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.908+0000 7f660d7fa640 0 client.16182 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:54:54.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.908+0000 7f662e40e740 1 -- 172.21.15.2:0/3887375304 shutdown_connections 2024-09-19T04:54:54.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.908+0000 7f662e40e740 1 -- 172.21.15.2:0/3887375304 wait complete. 2024-09-19T04:54:54.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.908+0000 7f662e40e740 20 client.16182 trim_cache size 0 max 16384 2024-09-19T04:54:54.919 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:54:54.919 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T04:54:54.919 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T04:54:54.919 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:54:54.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.909+0000 7f662c035640 1 -- 172.21.15.2:0/2492184181 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f66100a33b0 msgr2=0x7f66100a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:54.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.909+0000 7f662c035640 1 --2- 172.21.15.2:0/2492184181 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f66100a33b0 0x7f66100a5870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6614098a20 tx=0x7f661400fd60 comp rx=0 tx=0).stop 2024-09-19T04:54:54.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.909+0000 7f662c035640 1 -- 172.21.15.2:0/2492184181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66241036e0 msgr2=0x7f66241989f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:54.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.909+0000 7f662c035640 1 --2- 172.21.15.2:0/2492184181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66241036e0 0x7f66241989f0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f661400c8c0 tx=0x7f661400cd80 comp rx=0 tx=0).stop 2024-09-19T04:54:54.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.909+0000 7f662c035640 1 -- 172.21.15.2:0/2492184181 shutdown_connections 2024-09-19T04:54:54.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.909+0000 7f662c035640 1 --2- 172.21.15.2:0/2492184181 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66241082a0 0x7f662419cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:54.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.909+0000 7f662c035640 1 --2- 172.21.15.2:0/2492184181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66241036e0 0x7f66241989f0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:54.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.909+0000 7f662c035640 1 --2- 172.21.15.2:0/2492184181 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f66100a33b0 0x7f66100a5870 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:54.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.909+0000 7f662c035640 1 --2- 172.21.15.2:0/2492184181 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6624102d30 0x7f66241984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:54.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.909+0000 7f662c035640 1 -- 172.21.15.2:0/2492184181 >> 172.21.15.2:0/2492184181 conn(0x7f66240fc7d0 msgr2=0x7f6624105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:54:54.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.909+0000 7f662c035640 1 -- 172.21.15.2:0/2492184181 shutdown_connections 2024-09-19T04:54:54.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:54.909+0000 7f662c035640 1 -- 172.21.15.2:0/2492184181 wait complete. 2024-09-19T04:54:55.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:54:54 smithi018 ceph-mon[34537]: pgmap v210: 97 pgs: 97 active+clean; 10 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 35 KiB/s wr, 7 op/s 2024-09-19T04:54:55.110 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:54:54 smithi116 ceph-mon[34477]: pgmap v210: 97 pgs: 97 active+clean; 10 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 35 KiB/s wr, 7 op/s 2024-09-19T04:54:55.698 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:54:55.698 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:54:55.965 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:54:56.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.630+0000 7fe2190c6640 1 -- 172.21.15.2:0/4080720856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe214102790 msgr2=0x7fe2141067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:56.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.630+0000 7fe2190c6640 1 --2- 172.21.15.2:0/4080720856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe214102790 0x7fe2141067e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc009900 tx=0x7fe1fc02a410 comp rx=0 tx=0).stop 2024-09-19T04:54:56.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.630+0000 7fe2190c6640 1 -- 172.21.15.2:0/4080720856 shutdown_connections 2024-09-19T04:54:56.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.630+0000 7fe2190c6640 1 --2- 172.21.15.2:0/4080720856 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe214106f10 0x7fe21410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:56.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.630+0000 7fe2190c6640 1 --2- 172.21.15.2:0/4080720856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe214102790 0x7fe2141067e0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:56.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.630+0000 7fe2190c6640 1 --2- 172.21.15.2:0/4080720856 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe214101de0 0x7fe2141021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:56.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.630+0000 7fe2190c6640 1 -- 172.21.15.2:0/4080720856 >> 172.21.15.2:0/4080720856 conn(0x7fe2140fd8c0 msgr2=0x7fe2140ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:54:56.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.630+0000 7fe2190c6640 1 -- 172.21.15.2:0/4080720856 shutdown_connections 2024-09-19T04:54:56.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.630+0000 7fe2190c6640 1 -- 172.21.15.2:0/4080720856 wait complete. 2024-09-19T04:54:56.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.631+0000 7fe2190c6640 1 Processor -- start 2024-09-19T04:54:56.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.631+0000 7fe2190c6640 1 -- start start 2024-09-19T04:54:56.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.631+0000 7fe2190c6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe214101de0 0x7fe214198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:56.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.631+0000 7fe2190c6640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe214102790 0x7fe2141988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:56.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.631+0000 7fe2190c6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe214106f10 0x7fe21419cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:56.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.631+0000 7fe2190c6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe214111e20 con 0x7fe214101de0 2024-09-19T04:54:56.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.631+0000 7fe2190c6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe214111ca0 con 0x7fe214106f10 2024-09-19T04:54:56.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.631+0000 7fe2190c6640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fe214111fa0 con 0x7fe214102790 2024-09-19T04:54:56.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.631+0000 7fe212d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe214101de0 0x7fe214198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:56.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.631+0000 7fe212d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe214101de0 0x7fe214198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57066/0 (socket says 172.21.15.2:57066) 2024-09-19T04:54:56.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.631+0000 7fe212d9d640 1 -- 172.21.15.2:0/2664818475 learned_addr learned my addr 172.21.15.2:0/2664818475 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:54:56.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.631+0000 7fe21359e640 1 --2- 172.21.15.2:0/2664818475 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe214106f10 0x7fe21419cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:56.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.631+0000 7fe20bfff640 1 --2- 172.21.15.2:0/2664818475 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe214102790 0x7fe2141988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:56.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.632+0000 7fe212d9d640 1 -- 172.21.15.2:0/2664818475 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe214102790 msgr2=0x7fe2141988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:56.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.632+0000 7fe212d9d640 1 --2- 172.21.15.2:0/2664818475 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe214102790 0x7fe2141988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:56.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.632+0000 7fe212d9d640 1 -- 172.21.15.2:0/2664818475 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe214106f10 msgr2=0x7fe21419cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:56.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.632+0000 7fe212d9d640 1 --2- 172.21.15.2:0/2664818475 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe214106f10 0x7fe21419cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:56.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.632+0000 7fe212d9d640 1 -- 172.21.15.2:0/2664818475 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe21419d310 con 0x7fe214101de0 2024-09-19T04:54:56.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.632+0000 7fe20bfff640 1 --2- 172.21.15.2:0/2664818475 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe214102790 0x7fe2141988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:54:56.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.632+0000 7fe212d9d640 1 --2- 172.21.15.2:0/2664818475 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe214101de0 0x7fe214198360 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fe20400d950 tx=0x7fe20400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:54:56.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.632+0000 7fe210d99640 1 -- 172.21.15.2:0/2664818475 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe204017030 con 0x7fe214101de0 2024-09-19T04:54:56.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.632+0000 7fe210d99640 1 -- 172.21.15.2:0/2664818475 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe204004020 con 0x7fe214101de0 2024-09-19T04:54:56.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.632+0000 7fe2190c6640 1 -- 172.21.15.2:0/2664818475 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe21419d600 con 0x7fe214101de0 2024-09-19T04:54:56.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.632+0000 7fe210d99640 1 -- 172.21.15.2:0/2664818475 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2040047a0 con 0x7fe214101de0 2024-09-19T04:54:56.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.632+0000 7fe2190c6640 1 -- 172.21.15.2:0/2664818475 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2141a4ee0 con 0x7fe214101de0 2024-09-19T04:54:56.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.633+0000 7fe2190c6640 1 -- 172.21.15.2:0/2664818475 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2141021c0 con 0x7fe214101de0 2024-09-19T04:54:56.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.635+0000 7fe210d99640 1 -- 172.21.15.2:0/2664818475 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fe2040041d0 con 0x7fe214101de0 2024-09-19T04:54:56.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.635+0000 7fe210d99640 1 --2- 172.21.15.2:0/2664818475 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fe2000a3430 0x7fe2000a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:56.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.635+0000 7fe210d99640 1 -- 172.21.15.2:0/2664818475 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7fe2040cfdc0 con 0x7fe214101de0 2024-09-19T04:54:56.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.635+0000 7fe20bfff640 1 --2- 172.21.15.2:0/2664818475 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fe2000a3430 0x7fe2000a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:56.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.636+0000 7fe20bfff640 1 --2- 172.21.15.2:0/2664818475 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fe2000a3430 0x7fe2000a58f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc031440 tx=0x7fe1fc005a20 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:54:56.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.638+0000 7fe210d99640 1 -- 172.21.15.2:0/2664818475 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe20409c840 con 0x7fe214101de0 2024-09-19T04:54:56.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.854+0000 7fe2190c6640 1 -- 172.21.15.2:0/2664818475 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe21402d7c0 con 0x7fe214101de0 2024-09-19T04:54:56.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.854+0000 7fe210d99640 1 -- 172.21.15.2:0/2664818475 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11840 (secure 0 0 0) 0x7fe20409c140 con 0x7fe214101de0 2024-09-19T04:54:56.857 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:54:56.858 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":19,"btime":"2024-09-19T04:46:33:537239+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2467365137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2467365137},{"type":"v1","addr":"172.21.15.2:6835","nonce":2467365137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3162441888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3162441888},{"type":"v1","addr":"172.21.15.2:6837","nonce":3162441888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14631,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2740862966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2740862966},{"type":"v1","addr":"172.21.15.2:6839","nonce":2740862966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/2394435504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2394435504},{"type":"v1","addr":"172.21.15.2:6841","nonce":2394435504}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1630480244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1630480244},{"type":"v1","addr":"172.21.15.18:6833","nonce":1630480244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1553897465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1553897465},{"type":"v1","addr":"172.21.15.116:6833","nonce":1553897465}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3035664608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3035664608},{"type":"v1","addr":"172.21.15.18:6835","nonce":3035664608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1096622392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1096622392},{"type":"v1","addr":"172.21.15.18:6837","nonce":1096622392}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3761157675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3761157675},{"type":"v1","addr":"172.21.15.116:6835","nonce":3761157675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/1120131594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1120131594},{"type":"v1","addr":"172.21.15.116:6837","nonce":1120131594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:46:24.050115+0000","modified":"2024-09-19T04:46:33.112369+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/4207677139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":4207677139},{"type":"v1","addr":"172.21.15.18:6839","nonce":4207677139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/2346874880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":2346874880},{"type":"v1","addr":"172.21.15.116:6839","nonce":2346874880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496]},"id":1}]} 2024-09-19T04:54:56.858 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 19 2024-09-19T04:54:56.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.857+0000 7fe2190c6640 1 -- 172.21.15.2:0/2664818475 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fe2000a3430 msgr2=0x7fe2000a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:56.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.857+0000 7fe2190c6640 1 --2- 172.21.15.2:0/2664818475 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fe2000a3430 0x7fe2000a58f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc031440 tx=0x7fe1fc005a20 comp rx=0 tx=0).stop 2024-09-19T04:54:56.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.857+0000 7fe2190c6640 1 -- 172.21.15.2:0/2664818475 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe214101de0 msgr2=0x7fe214198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:56.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.857+0000 7fe2190c6640 1 --2- 172.21.15.2:0/2664818475 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe214101de0 0x7fe214198360 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fe20400d950 tx=0x7fe20400de10 comp rx=0 tx=0).stop 2024-09-19T04:54:56.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.857+0000 7fe2190c6640 1 -- 172.21.15.2:0/2664818475 shutdown_connections 2024-09-19T04:54:56.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.857+0000 7fe2190c6640 1 --2- 172.21.15.2:0/2664818475 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe214106f10 0x7fe21419cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:56.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.857+0000 7fe2190c6640 1 --2- 172.21.15.2:0/2664818475 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fe2000a3430 0x7fe2000a58f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:56.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.857+0000 7fe2190c6640 1 --2- 172.21.15.2:0/2664818475 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe214102790 0x7fe2141988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:56.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.857+0000 7fe2190c6640 1 --2- 172.21.15.2:0/2664818475 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe214101de0 0x7fe214198360 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:56.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.857+0000 7fe2190c6640 1 -- 172.21.15.2:0/2664818475 >> 172.21.15.2:0/2664818475 conn(0x7fe2140fd8c0 msgr2=0x7fe2140fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:54:56.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.857+0000 7fe2190c6640 1 -- 172.21.15.2:0/2664818475 shutdown_connections 2024-09-19T04:54:56.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:56.857+0000 7fe2190c6640 1 -- 172.21.15.2:0/2664818475 wait complete. 2024-09-19T04:54:57.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:54:56 smithi018 ceph-mon[34537]: pgmap v211: 97 pgs: 97 active+clean; 10 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 54 KiB/s wr, 11 op/s 2024-09-19T04:54:57.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:54:56 smithi002 ceph-mon[30975]: pgmap v211: 97 pgs: 97 active+clean; 10 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 54 KiB/s wr, 11 op/s 2024-09-19T04:54:57.110 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:54:56 smithi116 ceph-mon[34477]: pgmap v211: 97 pgs: 97 active+clean; 10 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 54 KiB/s wr, 11 op/s 2024-09-19T04:54:57.531 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:54:57.795 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:54:57.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:54:57 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/2664818475' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:54:58.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:54:57 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/2664818475' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:54:58.110 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:54:57 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/2664818475' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:54:58.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.262+0000 7f59217d7640 1 -- 172.21.15.2:0/3732109083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f591c101420 msgr2=0x7f591c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:58.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.262+0000 7f59217d7640 1 --2- 172.21.15.2:0/3732109083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f591c101420 0x7f591c10d950 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f5914009cd0 tx=0x7f591402a8f0 comp rx=0 tx=0).stop 2024-09-19T04:54:58.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.262+0000 7f59217d7640 1 -- 172.21.15.2:0/3732109083 shutdown_connections 2024-09-19T04:54:58.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.262+0000 7f59217d7640 1 --2- 172.21.15.2:0/3732109083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f591c101420 0x7f591c10d950 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:58.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.262+0000 7f59217d7640 1 --2- 172.21.15.2:0/3732109083 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f591c100a80 0x7f591c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:58.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.262+0000 7f59217d7640 1 --2- 172.21.15.2:0/3732109083 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f591c106a80 0x7f591c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:58.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.262+0000 7f59217d7640 1 -- 172.21.15.2:0/3732109083 >> 172.21.15.2:0/3732109083 conn(0x7f591c0fc7a0 msgr2=0x7f591c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:54:58.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.262+0000 7f59217d7640 1 -- 172.21.15.2:0/3732109083 shutdown_connections 2024-09-19T04:54:58.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.262+0000 7f59217d7640 1 -- 172.21.15.2:0/3732109083 wait complete. 2024-09-19T04:54:58.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.263+0000 7f59217d7640 1 Processor -- start 2024-09-19T04:54:58.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.263+0000 7f59217d7640 1 -- start start 2024-09-19T04:54:58.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.263+0000 7f59217d7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f591c100a80 0x7f591c102950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:58.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.263+0000 7f59217d7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f591c101420 0x7f591c102e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:58.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.263+0000 7f59217d7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f591c106a80 0x7f591c1033d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:58.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.263+0000 7f59217d7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f591c110d30 con 0x7f591c100a80 2024-09-19T04:54:58.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.263+0000 7f59217d7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f591c110bb0 con 0x7f591c106a80 2024-09-19T04:54:58.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.263+0000 7f59217d7640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f591c110eb0 con 0x7f591c101420 2024-09-19T04:54:58.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.264+0000 7f591affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f591c100a80 0x7f591c102950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:58.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.264+0000 7f591affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f591c100a80 0x7f591c102950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57072/0 (socket says 172.21.15.2:57072) 2024-09-19T04:54:58.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.264+0000 7f591affd640 1 -- 172.21.15.2:0/225064268 learned_addr learned my addr 172.21.15.2:0/225064268 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:54:58.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.264+0000 7f591b7fe640 1 --2- 172.21.15.2:0/225064268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f591c106a80 0x7f591c1033d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:58.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.264+0000 7f5913fff640 1 --2- 172.21.15.2:0/225064268 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f591c101420 0x7f591c102e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:58.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.264+0000 7f591affd640 1 -- 172.21.15.2:0/225064268 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f591c101420 msgr2=0x7f591c102e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:58.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.264+0000 7f591affd640 1 --2- 172.21.15.2:0/225064268 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f591c101420 0x7f591c102e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:58.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.264+0000 7f591affd640 1 -- 172.21.15.2:0/225064268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f591c106a80 msgr2=0x7f591c1033d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:58.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.264+0000 7f591affd640 1 --2- 172.21.15.2:0/225064268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f591c106a80 0x7f591c1033d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:58.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.264+0000 7f591affd640 1 -- 172.21.15.2:0/225064268 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f591c1a6750 con 0x7f591c100a80 2024-09-19T04:54:58.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.264+0000 7f591affd640 1 --2- 172.21.15.2:0/225064268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f591c100a80 0x7f591c102950 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f590c00c920 tx=0x7f590c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:54:58.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.264+0000 7f5918ff9640 1 -- 172.21.15.2:0/225064268 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f590c007c70 con 0x7f591c100a80 2024-09-19T04:54:58.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.264+0000 7f59217d7640 1 -- 172.21.15.2:0/225064268 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f591c1a6a40 con 0x7f591c100a80 2024-09-19T04:54:58.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.264+0000 7f5918ff9640 1 -- 172.21.15.2:0/225064268 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f590c007e10 con 0x7f591c100a80 2024-09-19T04:54:58.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.264+0000 7f5918ff9640 1 -- 172.21.15.2:0/225064268 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f590c018820 con 0x7f591c100a80 2024-09-19T04:54:58.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.264+0000 7f59217d7640 1 -- 172.21.15.2:0/225064268 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f591c1a6fd0 con 0x7f591c100a80 2024-09-19T04:54:58.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.266+0000 7f5918ff9640 1 -- 172.21.15.2:0/225064268 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f590c0189c0 con 0x7f591c100a80 2024-09-19T04:54:58.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.267+0000 7f5923bb0740 1 Processor -- start 2024-09-19T04:54:58.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.267+0000 7f5923bb0740 1 -- start start 2024-09-19T04:54:58.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.267+0000 7f5923bb0740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564e26261b40 0x564e26260090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:58.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.267+0000 7f5923bb0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e262605d0 0x564e26260a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:58.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.267+0000 7f5923bb0740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e2626b370 0x564e2626d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:58.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.267+0000 7f5923bb0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564e261c62f0 con 0x564e262605d0 2024-09-19T04:54:58.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.267+0000 7f5923bb0740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564e2616dcf0 con 0x564e2626b370 2024-09-19T04:54:58.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.267+0000 7f5923bb0740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x564e261c22b0 con 0x564e26261b40 2024-09-19T04:54:58.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.267+0000 7f5918ff9640 1 --2- 172.21.15.2:0/225064268 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f59080a33b0 0x7f59080a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:58.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.267+0000 7f591affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e262605d0 0x564e26260a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:58.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.268+0000 7f591affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e262605d0 0x564e26260a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57088/0 (socket says 172.21.15.2:57088) 2024-09-19T04:54:58.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.268+0000 7f591affd640 1 -- 172.21.15.2:0/2213091069 learned_addr learned my addr 172.21.15.2:0/2213091069 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:54:58.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.268+0000 7f5913fff640 1 --2- 172.21.15.2:0/2213091069 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e2626b370 0x564e2626d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:58.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.268+0000 7f591b7fe640 1 --2- 172.21.15.2:0/225064268 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f59080a33b0 0x7f59080a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:58.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.268+0000 7f591b7fe640 1 --2- 172.21.15.2:0/2213091069 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564e26261b40 0x564e26260090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:58.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.268+0000 7f5918ff9640 1 -- 172.21.15.2:0/225064268 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f590c0cfe20 con 0x7f591c100a80 2024-09-19T04:54:58.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.268+0000 7f5913fff640 1 -- 172.21.15.2:0/2213091069 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564e26261b40 msgr2=0x564e26260090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:54:58.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.268+0000 7f5913fff640 1 --2- 172.21.15.2:0/2213091069 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564e26261b40 0x564e26260090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:58.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.268+0000 7f5913fff640 1 -- 172.21.15.2:0/2213091069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e262605d0 msgr2=0x564e26260a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:54:58.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.268+0000 7f5913fff640 1 --2- 172.21.15.2:0/2213091069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e262605d0 0x564e26260a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:58.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.268+0000 7f5913fff640 1 -- 172.21.15.2:0/2213091069 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e261523a0 con 0x564e2626b370 2024-09-19T04:54:58.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.268+0000 7f591affd640 1 --2- 172.21.15.2:0/2213091069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e262605d0 0x564e26260a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:54:58.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.268+0000 7f591b7fe640 1 --2- 172.21.15.2:0/225064268 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f59080a33b0 0x7f59080a5870 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5914009a60 tx=0x7f59140093d0 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:54:58.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.268+0000 7f5913fff640 1 --2- 172.21.15.2:0/2213091069 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e2626b370 0x564e2626d760 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f590400ba40 tx=0x7f590400bf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfcbe3f28698b34b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:54:58.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.268+0000 7f59117fa640 1 -- 172.21.15.2:0/2213091069 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5904017420 con 0x564e2626b370 2024-09-19T04:54:58.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.269+0000 7f59117fa640 1 -- 172.21.15.2:0/2213091069 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5904017a70 con 0x564e2626b370 2024-09-19T04:54:58.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.269+0000 7f59117fa640 1 -- 172.21.15.2:0/2213091069 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f590400f960 con 0x564e2626b370 2024-09-19T04:54:58.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.269+0000 7f5923bb0740 1 -- 172.21.15.2:0/2213091069 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e2626b370 msgr2=0x564e2626d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:58.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.269+0000 7f5923bb0740 1 --2- 172.21.15.2:0/2213091069 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e2626b370 0x564e2626d760 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f590400ba40 tx=0x7f590400bf00 comp rx=0 tx=0).stop 2024-09-19T04:54:58.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.269+0000 7f5923bb0740 1 -- 172.21.15.2:0/2213091069 shutdown_connections 2024-09-19T04:54:58.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.269+0000 7f5923bb0740 1 --2- 172.21.15.2:0/2213091069 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e2626b370 0x564e2626d760 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:58.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.269+0000 7f5923bb0740 1 --2- 172.21.15.2:0/2213091069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e262605d0 0x564e26260a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:58.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.269+0000 7f5923bb0740 1 --2- 172.21.15.2:0/2213091069 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564e26261b40 0x564e26260090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:58.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.269+0000 7f5923bb0740 1 -- 172.21.15.2:0/2213091069 >> 172.21.15.2:0/2213091069 conn(0x564e26229310 msgr2=0x564e2625cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:54:58.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.269+0000 7f5923bb0740 1 -- 172.21.15.2:0/2213091069 shutdown_connections 2024-09-19T04:54:58.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.269+0000 7f5923bb0740 1 -- 172.21.15.2:0/2213091069 wait complete. 2024-09-19T04:54:58.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.270+0000 7f5923bb0740 1 -- start start 2024-09-19T04:54:58.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.270+0000 7f5923bb0740 1 Processor -- start 2024-09-19T04:54:58.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.270+0000 7f5923bb0740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564e262605d0 0x564e2626ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:58.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.270+0000 7f5923bb0740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e26261b40 0x564e26267f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:58.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.270+0000 7f5923bb0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e2626b370 0x564e262684a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:58.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.270+0000 7f5923bb0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564e2626e070 con 0x564e2626b370 2024-09-19T04:54:58.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.270+0000 7f5923bb0740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564e26181060 con 0x564e26261b40 2024-09-19T04:54:58.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.270+0000 7f5923bb0740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x564e2626e1f0 con 0x564e262605d0 2024-09-19T04:54:58.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.270+0000 7f5923bb0740 10 client.0 _ll_register_callbacks cb 0x564e25ed48c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:54:58.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.270+0000 7f591affd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564e262605d0 0x564e2626ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:58.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.270+0000 7f591affd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564e262605d0 0x564e2626ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.2:33496/0 (socket says 172.21.15.2:33496) 2024-09-19T04:54:58.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.270+0000 7f591affd640 1 -- 172.21.15.2:0/4138280378 learned_addr learned my addr 172.21.15.2:0/4138280378 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:54:58.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.270+0000 7f591b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e2626b370 0x564e262684a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:58.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.270+0000 7f5913fff640 1 --2- 172.21.15.2:0/4138280378 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e26261b40 0x564e26267f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:58.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.271+0000 7f591affd640 1 -- 172.21.15.2:0/4138280378 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e26261b40 msgr2=0x564e26267f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:54:58.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.271+0000 7f591affd640 1 --2- 172.21.15.2:0/4138280378 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e26261b40 0x564e26267f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:58.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.271+0000 7f591affd640 1 -- 172.21.15.2:0/4138280378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e2626b370 msgr2=0x564e262684a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:54:58.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.271+0000 7f591affd640 1 --2- 172.21.15.2:0/4138280378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e2626b370 0x564e262684a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:58.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.271+0000 7f591affd640 1 -- 172.21.15.2:0/4138280378 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e25f373c0 con 0x564e262605d0 2024-09-19T04:54:58.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.271+0000 7f591affd640 1 --2- 172.21.15.2:0/4138280378 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564e262605d0 0x564e2626ac60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f590c007590 tx=0x7f590c00a630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4965e1c059f9d362 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:54:58.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.271+0000 7f59027fc640 10 client.0 ms_handle_connect on v2:172.21.15.116:3300/0 2024-09-19T04:54:58.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.271+0000 7f59027fc640 1 -- 172.21.15.2:0/4138280378 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f590c0a8020 con 0x564e262605d0 2024-09-19T04:54:58.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.271+0000 7f5923bb0740 1 -- 172.21.15.2:0/4138280378 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5904017a70 con 0x564e262605d0 2024-09-19T04:54:58.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.271+0000 7f59027fc640 1 -- 172.21.15.2:0/4138280378 <== mon.1 v2:172.21.15.116:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f590c0bc0b0 con 0x564e262605d0 2024-09-19T04:54:58.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.271+0000 7f59027fc640 1 -- 172.21.15.2:0/4138280378 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f590c09c7c0 con 0x564e262605d0 2024-09-19T04:54:58.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.271+0000 7f5923bb0740 10 client.25594 fetch_fsmap learned FSMap version 19 2024-09-19T04:54:58.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.271+0000 7f5923bb0740 1 -- 172.21.15.2:0/4138280378 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x564e26279b40 con 0x564e262605d0 2024-09-19T04:54:58.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.272+0000 7f59027fc640 1 -- 172.21.15.2:0/4138280378 <== mon.1 v2:172.21.15.116:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5904017a70 con 0x564e262605d0 2024-09-19T04:54:58.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.272+0000 7f59027fc640 1 -- 172.21.15.2:0/4138280378 <== mon.1 v2:172.21.15.116:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f590c0a48a0 con 0x564e262605d0 2024-09-19T04:54:58.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.272+0000 7f5923bb0740 10 client.25594 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:54:58.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.272+0000 7f5923bb0740 10 client.25594 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:54:58.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.272+0000 7f5923bb0740 20 client.25594 populate_metadata read hostname 'smithi002' 2024-09-19T04:54:58.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.272+0000 7f5923bb0740 1 --2- 172.21.15.2:0/4138280378 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x564e2627af50 0x564e2627d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:58.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.272+0000 7f5923bb0740 4 client.25594 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:54:58.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.272+0000 7f5923bb0740 1 -- 172.21.15.2:0/4138280378 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e261d3860 con 0x564e2627af50 2024-09-19T04:54:58.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.272+0000 7f5913fff640 1 --2- 172.21.15.2:0/4138280378 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x564e2627af50 0x564e2627d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:58.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.272+0000 7f5913fff640 1 --2- 172.21.15.2:0/4138280378 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x564e2627af50 0x564e2627d340 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a03bdfad74c6e08e server_cookie=6b45f8f4d0a0ca74 in_seq=0 out_seq=0 2024-09-19T04:54:58.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.272+0000 7f59027fc640 10 client.25594 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:54:58.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.273+0000 7f59027fc640 1 -- 172.21.15.2:0/4138280378 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564e261d3860 con 0x564e2627af50 2024-09-19T04:54:58.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.273+0000 7f59027fc640 10 client.25594 handle_command_reply: tid=0 2024-09-19T04:54:58.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.273+0000 7f5923bb0740 1 client.25594 shutdown 2024-09-19T04:54:58.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.273+0000 7f5923bb0740 1 -- 172.21.15.2:0/4138280378 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564e262605d0 msgr2=0x564e2626ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:58.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.273+0000 7f5923bb0740 1 --2- 172.21.15.2:0/4138280378 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564e262605d0 0x564e2626ac60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f590c007590 tx=0x7f590c00a630 comp rx=0 tx=0).stop 2024-09-19T04:54:58.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.273+0000 7f5923bb0740 1 -- 172.21.15.2:0/4138280378 shutdown_connections 2024-09-19T04:54:58.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.273+0000 7f5923bb0740 1 --2- 172.21.15.2:0/4138280378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e2626b370 0x564e262684a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:58.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.273+0000 7f5923bb0740 1 --2- 172.21.15.2:0/4138280378 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e26261b40 0x564e26267f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:58.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.273+0000 7f5923bb0740 1 --2- 172.21.15.2:0/4138280378 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x564e2627af50 0x564e2627d340 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:58.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.273+0000 7f5923bb0740 1 --2- 172.21.15.2:0/4138280378 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564e262605d0 0x564e2626ac60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:58.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.273+0000 7f5923bb0740 1 -- 172.21.15.2:0/4138280378 >> 172.21.15.2:0/4138280378 conn(0x564e26229310 msgr2=0x564e26262930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:54:58.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.273+0000 7f59027fc640 0 client.25594 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:54:58.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.273+0000 7f5923bb0740 1 -- 172.21.15.2:0/4138280378 shutdown_connections 2024-09-19T04:54:58.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.273+0000 7f5923bb0740 1 -- 172.21.15.2:0/4138280378 wait complete. 2024-09-19T04:54:58.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.274+0000 7f5923bb0740 20 client.25594 trim_cache size 0 max 16384 2024-09-19T04:54:58.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.286+0000 7f5923bb0740 1 Processor -- start 2024-09-19T04:54:58.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.286+0000 7f5923bb0740 1 -- start start 2024-09-19T04:54:58.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.287+0000 7f5923bb0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e262605d0 0x564e26277340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:58.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.287+0000 7f5923bb0740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564e26261b40 0x564e26282ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:58.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.287+0000 7f5923bb0740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e2626b370 0x564e262830e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:58.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.287+0000 7f5923bb0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f591c1ad810 con 0x564e262605d0 2024-09-19T04:54:58.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.287+0000 7f5923bb0740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f591c1b0090 con 0x564e2626b370 2024-09-19T04:54:58.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.287+0000 7f5923bb0740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f591c1ade80 con 0x564e26261b40 2024-09-19T04:54:58.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.287+0000 7f591affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e262605d0 0x564e26277340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:58.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.287+0000 7f591affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e262605d0 0x564e26277340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57108/0 (socket says 172.21.15.2:57108) 2024-09-19T04:54:58.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.287+0000 7f591affd640 1 -- 172.21.15.2:0/707923591 learned_addr learned my addr 172.21.15.2:0/707923591 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:54:58.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.287+0000 7f591affd640 1 -- 172.21.15.2:0/707923591 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564e26261b40 msgr2=0x564e26282ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:54:58.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.287+0000 7f591affd640 1 --2- 172.21.15.2:0/707923591 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564e26261b40 0x564e26282ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:58.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.287+0000 7f591affd640 1 -- 172.21.15.2:0/707923591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e2626b370 msgr2=0x564e262830e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:54:58.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.287+0000 7f591affd640 1 --2- 172.21.15.2:0/707923591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e2626b370 0x564e262830e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:58.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.287+0000 7f591affd640 1 -- 172.21.15.2:0/707923591 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e2627d970 con 0x564e262605d0 2024-09-19T04:54:58.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.287+0000 7f591affd640 1 --2- 172.21.15.2:0/707923591 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e262605d0 0x564e26277340 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f590c097e30 tx=0x7f590c067080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8639a23c4aecb54 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:54:58.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.287+0000 7f5910ff9640 1 -- 172.21.15.2:0/707923591 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f590c0a8030 con 0x564e262605d0 2024-09-19T04:54:58.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.288+0000 7f5910ff9640 1 -- 172.21.15.2:0/707923591 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f590c0a0470 con 0x564e262605d0 2024-09-19T04:54:58.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.288+0000 7f5910ff9640 1 -- 172.21.15.2:0/707923591 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f590c098050 con 0x564e262605d0 2024-09-19T04:54:58.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.288+0000 7f5923bb0740 1 -- 172.21.15.2:0/707923591 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e262605d0 msgr2=0x564e26277340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:58.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.288+0000 7f5923bb0740 1 --2- 172.21.15.2:0/707923591 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e262605d0 0x564e26277340 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f590c097e30 tx=0x7f590c067080 comp rx=0 tx=0).stop 2024-09-19T04:54:58.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.288+0000 7f5923bb0740 1 -- 172.21.15.2:0/707923591 shutdown_connections 2024-09-19T04:54:58.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.288+0000 7f5923bb0740 1 --2- 172.21.15.2:0/707923591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e2626b370 0x564e262830e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:58.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.288+0000 7f5923bb0740 1 --2- 172.21.15.2:0/707923591 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564e26261b40 0x564e26282ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:58.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.288+0000 7f5923bb0740 1 --2- 172.21.15.2:0/707923591 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e262605d0 0x564e26277340 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:58.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.288+0000 7f5923bb0740 1 -- 172.21.15.2:0/707923591 >> 172.21.15.2:0/707923591 conn(0x564e26229310 msgr2=0x564e26267f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:54:58.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.288+0000 7f5923bb0740 1 -- 172.21.15.2:0/707923591 shutdown_connections 2024-09-19T04:54:58.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.288+0000 7f5923bb0740 1 -- 172.21.15.2:0/707923591 wait complete. 2024-09-19T04:54:58.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.289+0000 7f5923bb0740 1 -- start start 2024-09-19T04:54:58.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.289+0000 7f5923bb0740 1 Processor -- start 2024-09-19T04:54:58.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.289+0000 7f5923bb0740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e262605d0 0x564e2626f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:58.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.289+0000 7f5923bb0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e26261b40 0x564e2626f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:58.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.289+0000 7f5923bb0740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564e2626b370 0x564e2626fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:58.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.289+0000 7f5923bb0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f591c1ae550 con 0x564e26261b40 2024-09-19T04:54:58.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.289+0000 7f5923bb0740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f591c1af9c0 con 0x564e262605d0 2024-09-19T04:54:58.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.289+0000 7f5923bb0740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f591c1aec20 con 0x564e2626b370 2024-09-19T04:54:58.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.289+0000 7f5923bb0740 10 client.0 _ll_register_callbacks cb 0x7f590c09bf80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:54:58.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.289+0000 7f5913fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e26261b40 0x564e2626f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:58.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.289+0000 7f5913fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e26261b40 0x564e2626f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57124/0 (socket says 172.21.15.2:57124) 2024-09-19T04:54:58.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.289+0000 7f5913fff640 1 -- 172.21.15.2:0/3196626945 learned_addr learned my addr 172.21.15.2:0/3196626945 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:54:58.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.289+0000 7f591b7fe640 1 --2- 172.21.15.2:0/3196626945 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564e2626b370 0x564e2626fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:58.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.289+0000 7f591affd640 1 --2- 172.21.15.2:0/3196626945 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e262605d0 0x564e2626f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:58.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.289+0000 7f5913fff640 1 -- 172.21.15.2:0/3196626945 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564e2626b370 msgr2=0x564e2626fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:54:58.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.289+0000 7f5913fff640 1 --2- 172.21.15.2:0/3196626945 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564e2626b370 0x564e2626fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:58.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.289+0000 7f5913fff640 1 -- 172.21.15.2:0/3196626945 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e262605d0 msgr2=0x564e2626f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:54:58.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.289+0000 7f5913fff640 1 --2- 172.21.15.2:0/3196626945 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e262605d0 0x564e2626f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:58.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.289+0000 7f5913fff640 1 -- 172.21.15.2:0/3196626945 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e262e4b70 con 0x564e26261b40 2024-09-19T04:54:58.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.290+0000 7f5913fff640 1 --2- 172.21.15.2:0/3196626945 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e26261b40 0x564e2626f710 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f590400ba40 tx=0x7f590400b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=687f29e2c732b667 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:54:58.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.290+0000 7f59027fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:54:58.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.290+0000 7f59027fc640 1 -- 172.21.15.2:0/3196626945 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f590400de70 con 0x564e26261b40 2024-09-19T04:54:58.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.290+0000 7f59027fc640 1 -- 172.21.15.2:0/3196626945 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f5904017630 con 0x564e26261b40 2024-09-19T04:54:58.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.290+0000 7f5923bb0740 1 -- 172.21.15.2:0/3196626945 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f590c0a0470 con 0x564e26261b40 2024-09-19T04:54:58.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.290+0000 7f59027fc640 1 -- 172.21.15.2:0/3196626945 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f5904017830 con 0x564e26261b40 2024-09-19T04:54:58.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.290+0000 7f5923bb0740 10 client.16206 fetch_fsmap learned FSMap version 19 2024-09-19T04:54:58.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.290+0000 7f5923bb0740 1 -- 172.21.15.2:0/3196626945 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x564e262e5dd0 con 0x564e26261b40 2024-09-19T04:54:58.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.290+0000 7f59027fc640 1 -- 172.21.15.2:0/3196626945 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f590c0a0470 con 0x564e26261b40 2024-09-19T04:54:58.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.290+0000 7f59027fc640 1 -- 172.21.15.2:0/3196626945 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f5904032030 con 0x564e26261b40 2024-09-19T04:54:58.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.290+0000 7f5923bb0740 10 client.16206 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:54:58.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.290+0000 7f5923bb0740 10 client.16206 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:54:58.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.290+0000 7f5923bb0740 20 client.16206 populate_metadata read hostname 'smithi002' 2024-09-19T04:54:58.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.290+0000 7f5923bb0740 1 --2- 172.21.15.2:0/3196626945 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x564e262e6430 0x564e262e8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:54:58.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.290+0000 7f5923bb0740 4 client.16206 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:54:58.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.290+0000 7f5923bb0740 1 -- 172.21.15.2:0/3196626945 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564e261cdd70 con 0x564e262e6430 2024-09-19T04:54:58.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.291+0000 7f591affd640 1 --2- 172.21.15.2:0/3196626945 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x564e262e6430 0x564e262e8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:54:58.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.291+0000 7f591affd640 1 --2- 172.21.15.2:0/3196626945 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x564e262e6430 0x564e262e8850 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=220ed7b4f0ac5de8 server_cookie=7aeed542402c7311 in_seq=0 out_seq=0 2024-09-19T04:54:58.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.291+0000 7f59027fc640 10 client.16206 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:54:58.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.291+0000 7f59027fc640 1 -- 172.21.15.2:0/3196626945 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564e261cdd70 con 0x564e262e6430 2024-09-19T04:54:58.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.292+0000 7f59027fc640 10 client.16206 handle_command_reply: tid=0 2024-09-19T04:54:58.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.292+0000 7f5923bb0740 1 client.16206 shutdown 2024-09-19T04:54:58.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.292+0000 7f5923bb0740 1 -- 172.21.15.2:0/3196626945 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e26261b40 msgr2=0x564e2626f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:58.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.292+0000 7f5923bb0740 1 --2- 172.21.15.2:0/3196626945 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e26261b40 0x564e2626f710 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f590400ba40 tx=0x7f590400b5b0 comp rx=0 tx=0).stop 2024-09-19T04:54:58.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.292+0000 7f5923bb0740 1 -- 172.21.15.2:0/3196626945 shutdown_connections 2024-09-19T04:54:58.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.292+0000 7f5923bb0740 1 --2- 172.21.15.2:0/3196626945 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x564e262e6430 0x564e262e8850 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:58.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.292+0000 7f5923bb0740 1 --2- 172.21.15.2:0/3196626945 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564e2626b370 0x564e2626fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:58.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.292+0000 7f5923bb0740 1 --2- 172.21.15.2:0/3196626945 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e26261b40 0x564e2626f710 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:58.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.292+0000 7f59027fc640 0 client.16206 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:54:58.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.292+0000 7f5923bb0740 1 --2- 172.21.15.2:0/3196626945 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e262605d0 0x564e2626f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:58.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.292+0000 7f5923bb0740 1 -- 172.21.15.2:0/3196626945 >> 172.21.15.2:0/3196626945 conn(0x564e26229310 msgr2=0x564e26262110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:54:58.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.292+0000 7f5923bb0740 1 -- 172.21.15.2:0/3196626945 shutdown_connections 2024-09-19T04:54:58.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.292+0000 7f5923bb0740 1 -- 172.21.15.2:0/3196626945 wait complete. 2024-09-19T04:54:58.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.292+0000 7f5923bb0740 20 client.16206 trim_cache size 0 max 16384 2024-09-19T04:54:58.299 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T04:54:58.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.292+0000 7f59217d7640 1 -- 172.21.15.2:0/225064268 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f59080a33b0 msgr2=0x7f59080a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:58.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.292+0000 7f59217d7640 1 --2- 172.21.15.2:0/225064268 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f59080a33b0 0x7f59080a5870 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5914009a60 tx=0x7f59140093d0 comp rx=0 tx=0).stop 2024-09-19T04:54:58.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.292+0000 7f59217d7640 1 -- 172.21.15.2:0/225064268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f591c100a80 msgr2=0x7f591c102950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:54:58.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.292+0000 7f59217d7640 1 --2- 172.21.15.2:0/225064268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f591c100a80 0x7f591c102950 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f590c00c920 tx=0x7f590c00cde0 comp rx=0 tx=0).stop 2024-09-19T04:54:58.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.292+0000 7f59217d7640 1 -- 172.21.15.2:0/225064268 shutdown_connections 2024-09-19T04:54:58.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.292+0000 7f59217d7640 1 --2- 172.21.15.2:0/225064268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f591c106a80 0x7f591c1033d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:58.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.292+0000 7f59217d7640 1 --2- 172.21.15.2:0/225064268 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f59080a33b0 0x7f59080a5870 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:58.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.292+0000 7f59217d7640 1 --2- 172.21.15.2:0/225064268 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f591c101420 0x7f591c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:58.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.292+0000 7f59217d7640 1 --2- 172.21.15.2:0/225064268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f591c100a80 0x7f591c102950 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:54:58.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.292+0000 7f59217d7640 1 -- 172.21.15.2:0/225064268 >> 172.21.15.2:0/225064268 conn(0x7f591c0fc7a0 msgr2=0x7f591c104b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:54:58.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.293+0000 7f59217d7640 1 -- 172.21.15.2:0/225064268 shutdown_connections 2024-09-19T04:54:58.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:54:58.293+0000 7f59217d7640 1 -- 172.21.15.2:0/225064268 wait complete. 2024-09-19T04:54:58.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:54:58 smithi002 ceph-mon[30975]: pgmap v212: 97 pgs: 97 active+clean; 10 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 35 KiB/s wr, 7 op/s 2024-09-19T04:54:59.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:54:58 smithi018 ceph-mon[34537]: pgmap v212: 97 pgs: 97 active+clean; 10 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 35 KiB/s wr, 7 op/s 2024-09-19T04:54:59.110 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:54:58 smithi116 ceph-mon[34477]: pgmap v212: 97 pgs: 97 active+clean; 10 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 35 KiB/s wr, 7 op/s 2024-09-19T04:55:00.015 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:55:00.015 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:55:00.305 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:55:00.688 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:00 smithi002 ceph-mon[30975]: pgmap v213: 97 pgs: 97 active+clean; 10 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 35 KiB/s wr, 7 op/s 2024-09-19T04:55:00.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.774+0000 7f253db3d640 1 -- 172.21.15.2:0/2543783154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2538106a80 msgr2=0x7f2538106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:00.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.774+0000 7f253db3d640 1 --2- 172.21.15.2:0/2543783154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2538106a80 0x7f2538106e60 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f2528009930 tx=0x7f252802a420 comp rx=0 tx=0).stop 2024-09-19T04:55:00.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.774+0000 7f253db3d640 1 -- 172.21.15.2:0/2543783154 shutdown_connections 2024-09-19T04:55:00.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.774+0000 7f253db3d640 1 --2- 172.21.15.2:0/2543783154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2538101420 0x7f253810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:00.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.774+0000 7f253db3d640 1 --2- 172.21.15.2:0/2543783154 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2538100a80 0x7f2538100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:00.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.774+0000 7f253db3d640 1 --2- 172.21.15.2:0/2543783154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2538106a80 0x7f2538106e60 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:00.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.774+0000 7f253db3d640 1 -- 172.21.15.2:0/2543783154 >> 172.21.15.2:0/2543783154 conn(0x7f25380fc7a0 msgr2=0x7f25380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:00.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.775+0000 7f253db3d640 1 -- 172.21.15.2:0/2543783154 shutdown_connections 2024-09-19T04:55:00.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.775+0000 7f253db3d640 1 -- 172.21.15.2:0/2543783154 wait complete. 2024-09-19T04:55:00.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.775+0000 7f253db3d640 1 Processor -- start 2024-09-19T04:55:00.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.775+0000 7f253db3d640 1 -- start start 2024-09-19T04:55:00.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.775+0000 7f253db3d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2538100a80 0x7f2538199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:00.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.775+0000 7f253db3d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2538101420 0x7f25381997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:00.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.775+0000 7f253db3d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2538106a80 0x7f25381a42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:00.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.775+0000 7f253db3d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2538110d30 con 0x7f2538101420 2024-09-19T04:55:00.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.775+0000 7f253db3d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2538110bb0 con 0x7f2538100a80 2024-09-19T04:55:00.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.775+0000 7f253db3d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f2538110eb0 con 0x7f2538106a80 2024-09-19T04:55:00.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.776+0000 7f252ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2538101420 0x7f25381997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:00.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.776+0000 7f252ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2538101420 0x7f25381997a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57146/0 (socket says 172.21.15.2:57146) 2024-09-19T04:55:00.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.776+0000 7f252ffff640 1 -- 172.21.15.2:0/3308598123 learned_addr learned my addr 172.21.15.2:0/3308598123 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:55:00.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.776+0000 7f25377fe640 1 --2- 172.21.15.2:0/3308598123 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2538100a80 0x7f2538199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:00.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.776+0000 7f2537fff640 1 --2- 172.21.15.2:0/3308598123 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2538106a80 0x7f25381a42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:00.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.776+0000 7f252ffff640 1 -- 172.21.15.2:0/3308598123 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2538106a80 msgr2=0x7f25381a42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:00.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.776+0000 7f252ffff640 1 --2- 172.21.15.2:0/3308598123 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2538106a80 0x7f25381a42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:00.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.776+0000 7f252ffff640 1 -- 172.21.15.2:0/3308598123 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2538100a80 msgr2=0x7f2538199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:00.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.776+0000 7f252ffff640 1 --2- 172.21.15.2:0/3308598123 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2538100a80 0x7f2538199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:00.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.776+0000 7f252ffff640 1 -- 172.21.15.2:0/3308598123 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25381a4820 con 0x7f2538101420 2024-09-19T04:55:00.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.776+0000 7f252ffff640 1 --2- 172.21.15.2:0/3308598123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2538101420 0x7f25381997a0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f252000d770 tx=0x7f252000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:00.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.776+0000 7f25357fa640 1 -- 172.21.15.2:0/3308598123 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2520017070 con 0x7f2538101420 2024-09-19T04:55:00.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.776+0000 7f253db3d640 1 -- 172.21.15.2:0/3308598123 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25381a49f0 con 0x7f2538101420 2024-09-19T04:55:00.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.776+0000 7f25357fa640 1 -- 172.21.15.2:0/3308598123 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f25200054d0 con 0x7f2538101420 2024-09-19T04:55:00.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.776+0000 7f25357fa640 1 -- 172.21.15.2:0/3308598123 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2520004cf0 con 0x7f2538101420 2024-09-19T04:55:00.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.776+0000 7f253db3d640 1 -- 172.21.15.2:0/3308598123 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25381a4eb0 con 0x7f2538101420 2024-09-19T04:55:00.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.779+0000 7f253ff16740 1 Processor -- start 2024-09-19T04:55:00.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.779+0000 7f253ff16740 1 -- start start 2024-09-19T04:55:00.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.779+0000 7f25357fa640 1 -- 172.21.15.2:0/3308598123 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f2520004e90 con 0x7f2538101420 2024-09-19T04:55:00.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.780+0000 7f253ff16740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5566d9190a40 0x5566d9190e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:00.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.780+0000 7f253ff16740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566d9191360 0x5566d919fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:00.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.780+0000 7f253ff16740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5566d91a0150 0x5566d91a2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:00.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.780+0000 7f253ff16740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5566d90f6280 con 0x5566d9191360 2024-09-19T04:55:00.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.780+0000 7f253ff16740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5566d909db10 con 0x5566d91a0150 2024-09-19T04:55:00.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.780+0000 7f253ff16740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5566d90f2240 con 0x5566d9190a40 2024-09-19T04:55:00.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.780+0000 7f25377fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566d9191360 0x5566d919fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:00.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.780+0000 7f25377fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566d9191360 0x5566d919fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57148/0 (socket says 172.21.15.2:57148) 2024-09-19T04:55:00.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.780+0000 7f25377fe640 1 -- 172.21.15.2:0/570076701 learned_addr learned my addr 172.21.15.2:0/570076701 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:55:00.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.780+0000 7f2537fff640 1 --2- 172.21.15.2:0/570076701 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5566d9190a40 0x5566d9190e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:00.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.780+0000 7f252ffff640 1 --2- 172.21.15.2:0/570076701 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5566d91a0150 0x5566d91a2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:00.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.780+0000 7f25377fe640 1 -- 172.21.15.2:0/570076701 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5566d9190a40 msgr2=0x5566d9190e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:00.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.780+0000 7f25377fe640 1 --2- 172.21.15.2:0/570076701 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5566d9190a40 0x5566d9190e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:00.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.780+0000 7f25377fe640 1 -- 172.21.15.2:0/570076701 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5566d91a0150 msgr2=0x5566d91a2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:00.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.780+0000 7f25377fe640 1 --2- 172.21.15.2:0/570076701 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5566d91a0150 0x5566d91a2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:00.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.780+0000 7f25377fe640 1 -- 172.21.15.2:0/570076701 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566d90aa1f0 con 0x5566d9191360 2024-09-19T04:55:00.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.781+0000 7f25357fa640 1 --2- 172.21.15.2:0/3308598123 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f25240a33b0 0x7f25240a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:00.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.781+0000 7f25377fe640 1 --2- 172.21.15.2:0/570076701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566d9191360 0x5566d919fc10 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f2528031440 tx=0x7f2528032b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52742b3cc7b611cf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:00.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.781+0000 7f2537fff640 1 --2- 172.21.15.2:0/3308598123 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f25240a33b0 0x7f25240a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:00.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.781+0000 7f25357fa640 1 -- 172.21.15.2:0/3308598123 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f25200cf820 con 0x7f2538101420 2024-09-19T04:55:00.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.781+0000 7f252dffb640 1 -- 172.21.15.2:0/570076701 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f252803f070 con 0x5566d9191360 2024-09-19T04:55:00.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.781+0000 7f252dffb640 1 -- 172.21.15.2:0/570076701 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2528004030 con 0x5566d9191360 2024-09-19T04:55:00.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.781+0000 7f252dffb640 1 -- 172.21.15.2:0/570076701 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2528035070 con 0x5566d9191360 2024-09-19T04:55:00.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.782+0000 7f253ff16740 1 -- 172.21.15.2:0/570076701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566d9191360 msgr2=0x5566d919fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:00.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.782+0000 7f2537fff640 1 --2- 172.21.15.2:0/3308598123 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f25240a33b0 0x7f25240a5870 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2530005fd0 tx=0x7f2530009500 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:00.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.782+0000 7f253ff16740 1 --2- 172.21.15.2:0/570076701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566d9191360 0x5566d919fc10 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f2528031440 tx=0x7f2528032b80 comp rx=0 tx=0).stop 2024-09-19T04:55:00.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.782+0000 7f253ff16740 1 -- 172.21.15.2:0/570076701 shutdown_connections 2024-09-19T04:55:00.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.782+0000 7f253ff16740 1 --2- 172.21.15.2:0/570076701 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5566d91a0150 0x5566d91a2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:00.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.782+0000 7f253ff16740 1 --2- 172.21.15.2:0/570076701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566d9191360 0x5566d919fc10 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:00.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.782+0000 7f253ff16740 1 --2- 172.21.15.2:0/570076701 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5566d9190a40 0x5566d9190e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:00.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.782+0000 7f253ff16740 1 -- 172.21.15.2:0/570076701 >> 172.21.15.2:0/570076701 conn(0x5566d918d0f0 msgr2=0x5566d918d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:00.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.782+0000 7f253ff16740 1 -- 172.21.15.2:0/570076701 shutdown_connections 2024-09-19T04:55:00.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.782+0000 7f253ff16740 1 -- 172.21.15.2:0/570076701 wait complete. 2024-09-19T04:55:00.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.782+0000 7f253ff16740 1 -- start start 2024-09-19T04:55:00.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.782+0000 7f253ff16740 1 Processor -- start 2024-09-19T04:55:00.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.783+0000 7f253ff16740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5566d9190a40 0x5566d919d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:00.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.783+0000 7f253ff16740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566d9191360 0x5566d919d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:00.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.783+0000 7f253ff16740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5566d91a0150 0x5566d919db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:00.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.783+0000 7f253ff16740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5566d91a2d20 con 0x5566d9191360 2024-09-19T04:55:00.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.783+0000 7f253ff16740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5566d90b0f10 con 0x5566d9190a40 2024-09-19T04:55:00.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.783+0000 7f253ff16740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5566d91a2ea0 con 0x5566d91a0150 2024-09-19T04:55:00.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.783+0000 7f253ff16740 10 client.0 _ll_register_callbacks cb 0x5566d9079a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:55:00.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.783+0000 7f252ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566d9191360 0x5566d919d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:00.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.783+0000 7f252ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566d9191360 0x5566d919d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57154/0 (socket says 172.21.15.2:57154) 2024-09-19T04:55:00.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.783+0000 7f252ffff640 1 -- 172.21.15.2:0/3343546166 learned_addr learned my addr 172.21.15.2:0/3343546166 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:55:00.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.783+0000 7f25377fe640 1 --2- 172.21.15.2:0/3343546166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5566d9190a40 0x5566d919d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:00.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.783+0000 7f2537fff640 1 --2- 172.21.15.2:0/3343546166 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5566d91a0150 0x5566d919db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:00.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.783+0000 7f252ffff640 1 -- 172.21.15.2:0/3343546166 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5566d91a0150 msgr2=0x5566d919db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:00.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.783+0000 7f252ffff640 1 --2- 172.21.15.2:0/3343546166 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5566d91a0150 0x5566d919db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:00.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.783+0000 7f252ffff640 1 -- 172.21.15.2:0/3343546166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5566d9190a40 msgr2=0x5566d919d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:00.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.783+0000 7f252ffff640 1 --2- 172.21.15.2:0/3343546166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5566d9190a40 0x5566d919d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:00.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.783+0000 7f252ffff640 1 -- 172.21.15.2:0/3343546166 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566d8e676a0 con 0x5566d9191360 2024-09-19T04:55:00.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.783+0000 7f252ffff640 1 --2- 172.21.15.2:0/3343546166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566d9191360 0x5566d919d630 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f252009b820 tx=0x7f252009b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b06f1dffdc83a2f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:00.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.783+0000 7f2516ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:55:00.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.783+0000 7f2516ffd640 1 -- 172.21.15.2:0/3343546166 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2520020070 con 0x5566d9191360 2024-09-19T04:55:00.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.783+0000 7f2516ffd640 1 -- 172.21.15.2:0/3343546166 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f25200860b0 con 0x5566d9191360 2024-09-19T04:55:00.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.784+0000 7f253ff16740 1 -- 172.21.15.2:0/3343546166 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2528004030 con 0x5566d9191360 2024-09-19T04:55:00.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.784+0000 7f2516ffd640 1 -- 172.21.15.2:0/3343546166 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f2520009c30 con 0x5566d9191360 2024-09-19T04:55:00.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.784+0000 7f253ff16740 10 client.16218 fetch_fsmap learned FSMap version 19 2024-09-19T04:55:00.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.784+0000 7f253ff16740 1 -- 172.21.15.2:0/3343546166 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5566d91aea70 con 0x5566d9191360 2024-09-19T04:55:00.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.784+0000 7f2516ffd640 1 -- 172.21.15.2:0/3343546166 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2528004030 con 0x5566d9191360 2024-09-19T04:55:00.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.784+0000 7f2516ffd640 1 -- 172.21.15.2:0/3343546166 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f2520097870 con 0x5566d9191360 2024-09-19T04:55:00.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.784+0000 7f253ff16740 10 client.16218 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:55:00.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.784+0000 7f253ff16740 10 client.16218 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:55:00.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.784+0000 7f253ff16740 20 client.16218 populate_metadata read hostname 'smithi002' 2024-09-19T04:55:00.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.784+0000 7f253ff16740 1 --2- 172.21.15.2:0/3343546166 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5566d91afe80 0x5566d91b2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:00.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.784+0000 7f253ff16740 4 client.16218 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:55:00.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.784+0000 7f253ff16740 1 -- 172.21.15.2:0/3343546166 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5566d91037f0 con 0x5566d91afe80 2024-09-19T04:55:00.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.784+0000 7f25377fe640 1 --2- 172.21.15.2:0/3343546166 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5566d91afe80 0x5566d91b2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:00.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.785+0000 7f2516ffd640 10 client.16218 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:55:00.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.785+0000 7f25377fe640 1 --2- 172.21.15.2:0/3343546166 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5566d91afe80 0x5566d91b2290 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=511d430bebc5df45 server_cookie=f70410267b763b6 in_seq=0 out_seq=0 2024-09-19T04:55:00.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.786+0000 7f2516ffd640 1 -- 172.21.15.2:0/3343546166 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5566d91037f0 con 0x5566d91afe80 2024-09-19T04:55:00.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.786+0000 7f2516ffd640 10 client.16218 handle_command_reply: tid=0 2024-09-19T04:55:00.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.786+0000 7f253ff16740 1 client.16218 shutdown 2024-09-19T04:55:00.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.786+0000 7f253ff16740 1 -- 172.21.15.2:0/3343546166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566d9191360 msgr2=0x5566d919d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:00.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.786+0000 7f253ff16740 1 --2- 172.21.15.2:0/3343546166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566d9191360 0x5566d919d630 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f252009b820 tx=0x7f252009b9b0 comp rx=0 tx=0).stop 2024-09-19T04:55:00.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.786+0000 7f253ff16740 1 -- 172.21.15.2:0/3343546166 shutdown_connections 2024-09-19T04:55:00.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.786+0000 7f253ff16740 1 --2- 172.21.15.2:0/3343546166 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5566d91afe80 0x5566d91b2290 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:00.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.786+0000 7f253ff16740 1 --2- 172.21.15.2:0/3343546166 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5566d91a0150 0x5566d919db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:00.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.786+0000 7f253ff16740 1 --2- 172.21.15.2:0/3343546166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566d9191360 0x5566d919d630 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:00.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.786+0000 7f253ff16740 1 --2- 172.21.15.2:0/3343546166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5566d9190a40 0x5566d919d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:00.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.786+0000 7f253ff16740 1 -- 172.21.15.2:0/3343546166 >> 172.21.15.2:0/3343546166 conn(0x5566d918d0f0 msgr2=0x5566d9192e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:00.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.786+0000 7f2516ffd640 0 client.16218 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:55:00.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.786+0000 7f253ff16740 1 -- 172.21.15.2:0/3343546166 shutdown_connections 2024-09-19T04:55:00.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.786+0000 7f253ff16740 1 -- 172.21.15.2:0/3343546166 wait complete. 2024-09-19T04:55:00.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.786+0000 7f253ff16740 20 client.16218 trim_cache size 0 max 16384 2024-09-19T04:55:00.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.804+0000 7f253ff16740 1 Processor -- start 2024-09-19T04:55:00.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.804+0000 7f253ff16740 1 -- start start 2024-09-19T04:55:00.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.804+0000 7f253ff16740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5566d9190a40 0x5566d919ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:00.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.804+0000 7f253ff16740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566d9191360 0x5566d91b7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:00.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.804+0000 7f253ff16740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5566d91a0150 0x5566d91b8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:00.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.804+0000 7f253ff16740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f25381a94e0 con 0x5566d9191360 2024-09-19T04:55:00.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.804+0000 7f253ff16740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f25381abd40 con 0x5566d91a0150 2024-09-19T04:55:00.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.804+0000 7f253ff16740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f25381a9b30 con 0x5566d9190a40 2024-09-19T04:55:00.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.804+0000 7f252ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566d9191360 0x5566d91b7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:00.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.804+0000 7f252ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566d9191360 0x5566d91b7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57156/0 (socket says 172.21.15.2:57156) 2024-09-19T04:55:00.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.804+0000 7f252ffff640 1 -- 172.21.15.2:0/3222870707 learned_addr learned my addr 172.21.15.2:0/3222870707 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:55:00.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.804+0000 7f25377fe640 1 --2- 172.21.15.2:0/3222870707 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5566d9190a40 0x5566d919ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:00.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.804+0000 7f252ffff640 1 -- 172.21.15.2:0/3222870707 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5566d9190a40 msgr2=0x5566d919ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:00.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.804+0000 7f252ffff640 1 --2- 172.21.15.2:0/3222870707 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5566d9190a40 0x5566d919ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:00.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.804+0000 7f252ffff640 1 -- 172.21.15.2:0/3222870707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5566d91a0150 msgr2=0x5566d91b8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:00.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.804+0000 7f252ffff640 1 --2- 172.21.15.2:0/3222870707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5566d91a0150 0x5566d91b8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:00.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.804+0000 7f252ffff640 1 -- 172.21.15.2:0/3222870707 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566d919c0a0 con 0x5566d9191360 2024-09-19T04:55:00.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.804+0000 7f252ffff640 1 --2- 172.21.15.2:0/3222870707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566d9191360 0x5566d91b7b30 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f25200cd590 tx=0x7f252009ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0df8e83a68fd2d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:00.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.805+0000 7f252d7fa640 1 -- 172.21.15.2:0/3222870707 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2520020070 con 0x5566d9191360 2024-09-19T04:55:00.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.805+0000 7f252d7fa640 1 -- 172.21.15.2:0/3222870707 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f252009ce50 con 0x5566d9191360 2024-09-19T04:55:00.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.805+0000 7f252d7fa640 1 -- 172.21.15.2:0/3222870707 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25200a4790 con 0x5566d9191360 2024-09-19T04:55:00.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.805+0000 7f253ff16740 1 -- 172.21.15.2:0/3222870707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566d9191360 msgr2=0x5566d91b7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:00.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.805+0000 7f253ff16740 1 --2- 172.21.15.2:0/3222870707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566d9191360 0x5566d91b7b30 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f25200cd590 tx=0x7f252009ba20 comp rx=0 tx=0).stop 2024-09-19T04:55:00.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.805+0000 7f253ff16740 1 -- 172.21.15.2:0/3222870707 shutdown_connections 2024-09-19T04:55:00.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.805+0000 7f253ff16740 1 --2- 172.21.15.2:0/3222870707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5566d91a0150 0x5566d91b8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:00.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.805+0000 7f253ff16740 1 --2- 172.21.15.2:0/3222870707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566d9191360 0x5566d91b7b30 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:00.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.805+0000 7f253ff16740 1 --2- 172.21.15.2:0/3222870707 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5566d9190a40 0x5566d919ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:00.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.805+0000 7f253ff16740 1 -- 172.21.15.2:0/3222870707 >> 172.21.15.2:0/3222870707 conn(0x5566d918d0f0 msgr2=0x5566d919e840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:00.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.805+0000 7f253ff16740 1 -- 172.21.15.2:0/3222870707 shutdown_connections 2024-09-19T04:55:00.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.805+0000 7f253ff16740 1 -- 172.21.15.2:0/3222870707 wait complete. 2024-09-19T04:55:00.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.806+0000 7f253ff16740 1 -- start start 2024-09-19T04:55:00.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.806+0000 7f253ff16740 1 Processor -- start 2024-09-19T04:55:00.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.806+0000 7f253ff16740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5566d9190a40 0x5566d91a47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:00.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.806+0000 7f253ff16740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566d9191360 0x5566d91a4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:00.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.806+0000 7f253ff16740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5566d91a0150 0x5566d9213b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:00.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.806+0000 7f253ff16740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f25381aa200 con 0x5566d9191360 2024-09-19T04:55:00.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.806+0000 7f253ff16740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f25381ab670 con 0x5566d9190a40 2024-09-19T04:55:00.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.806+0000 7f253ff16740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f25381aa8d0 con 0x5566d91a0150 2024-09-19T04:55:00.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.806+0000 7f253ff16740 10 client.0 _ll_register_callbacks cb 0x7f2520009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:55:00.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.806+0000 7f252ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566d9191360 0x5566d91a4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:00.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.806+0000 7f252ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566d9191360 0x5566d91a4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57164/0 (socket says 172.21.15.2:57164) 2024-09-19T04:55:00.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.806+0000 7f252ffff640 1 -- 172.21.15.2:0/1383003069 learned_addr learned my addr 172.21.15.2:0/1383003069 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:55:00.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.807+0000 7f2537fff640 1 --2- 172.21.15.2:0/1383003069 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5566d91a0150 0x5566d9213b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:00.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.807+0000 7f25377fe640 1 --2- 172.21.15.2:0/1383003069 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5566d9190a40 0x5566d91a47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:00.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.807+0000 7f252ffff640 1 -- 172.21.15.2:0/1383003069 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5566d91a0150 msgr2=0x5566d9213b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:00.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.807+0000 7f252ffff640 1 --2- 172.21.15.2:0/1383003069 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5566d91a0150 0x5566d9213b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:00.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.807+0000 7f252ffff640 1 -- 172.21.15.2:0/1383003069 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5566d9190a40 msgr2=0x5566d91a47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:00.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.807+0000 7f252ffff640 1 --2- 172.21.15.2:0/1383003069 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5566d9190a40 0x5566d91a47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:00.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.807+0000 7f252ffff640 1 -- 172.21.15.2:0/1383003069 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566d9214180 con 0x5566d9191360 2024-09-19T04:55:00.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.807+0000 7f252ffff640 1 --2- 172.21.15.2:0/1383003069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566d9191360 0x5566d91a4d30 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f252009b820 tx=0x7f252009b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd75d2ef0f035ddb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:00.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.807+0000 7f2516ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:55:00.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.807+0000 7f2516ffd640 1 -- 172.21.15.2:0/1383003069 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25200b8070 con 0x5566d9191360 2024-09-19T04:55:00.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.807+0000 7f2516ffd640 1 -- 172.21.15.2:0/1383003069 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f252009af70 con 0x5566d9191360 2024-09-19T04:55:00.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.807+0000 7f253ff16740 1 -- 172.21.15.2:0/1383003069 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f252009ce50 con 0x5566d9191360 2024-09-19T04:55:00.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.807+0000 7f2516ffd640 1 -- 172.21.15.2:0/1383003069 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f2520020040 con 0x5566d9191360 2024-09-19T04:55:00.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.807+0000 7f253ff16740 10 client.16224 fetch_fsmap learned FSMap version 19 2024-09-19T04:55:00.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.807+0000 7f253ff16740 1 -- 172.21.15.2:0/1383003069 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5566d921b530 con 0x5566d9191360 2024-09-19T04:55:00.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.807+0000 7f2516ffd640 1 -- 172.21.15.2:0/1383003069 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f252009ce50 con 0x5566d9191360 2024-09-19T04:55:00.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.808+0000 7f2516ffd640 1 -- 172.21.15.2:0/1383003069 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f25200a1060 con 0x5566d9191360 2024-09-19T04:55:00.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.808+0000 7f253ff16740 10 client.16224 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:55:00.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.808+0000 7f253ff16740 10 client.16224 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:55:00.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.808+0000 7f253ff16740 20 client.16224 populate_metadata read hostname 'smithi002' 2024-09-19T04:55:00.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.808+0000 7f253ff16740 1 --2- 172.21.15.2:0/1383003069 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5566d921b9b0 0x5566d921dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:00.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.808+0000 7f253ff16740 4 client.16224 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:55:00.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.808+0000 7f253ff16740 1 -- 172.21.15.2:0/1383003069 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5566d90fdd00 con 0x5566d921b9b0 2024-09-19T04:55:00.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.808+0000 7f25377fe640 1 --2- 172.21.15.2:0/1383003069 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5566d921b9b0 0x5566d921dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:00.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.808+0000 7f25377fe640 1 --2- 172.21.15.2:0/1383003069 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5566d921b9b0 0x5566d921dda0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4b01c331959aa65 server_cookie=26a477a254c325c3 in_seq=0 out_seq=0 2024-09-19T04:55:00.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.808+0000 7f2516ffd640 10 client.16224 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:55:00.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.809+0000 7f2516ffd640 1 -- 172.21.15.2:0/1383003069 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5566d90fdd00 con 0x5566d921b9b0 2024-09-19T04:55:00.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.809+0000 7f2516ffd640 10 client.16224 handle_command_reply: tid=0 2024-09-19T04:55:00.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.809+0000 7f253ff16740 1 client.16224 shutdown 2024-09-19T04:55:00.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.809+0000 7f253ff16740 1 -- 172.21.15.2:0/1383003069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566d9191360 msgr2=0x5566d91a4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:00.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.809+0000 7f253ff16740 1 --2- 172.21.15.2:0/1383003069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566d9191360 0x5566d91a4d30 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f252009b820 tx=0x7f252009b9b0 comp rx=0 tx=0).stop 2024-09-19T04:55:00.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.809+0000 7f253ff16740 1 -- 172.21.15.2:0/1383003069 shutdown_connections 2024-09-19T04:55:00.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.809+0000 7f253ff16740 1 --2- 172.21.15.2:0/1383003069 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5566d921b9b0 0x5566d921dda0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:00.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.809+0000 7f2516ffd640 0 client.16224 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:55:00.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.809+0000 7f253ff16740 1 --2- 172.21.15.2:0/1383003069 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5566d91a0150 0x5566d9213b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:00.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.809+0000 7f253ff16740 1 --2- 172.21.15.2:0/1383003069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566d9191360 0x5566d91a4d30 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:00.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.809+0000 7f253ff16740 1 --2- 172.21.15.2:0/1383003069 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5566d9190a40 0x5566d91a47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:00.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.809+0000 7f253ff16740 1 -- 172.21.15.2:0/1383003069 >> 172.21.15.2:0/1383003069 conn(0x5566d918d0f0 msgr2=0x5566d918c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:00.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.810+0000 7f253ff16740 1 -- 172.21.15.2:0/1383003069 shutdown_connections 2024-09-19T04:55:00.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.810+0000 7f253ff16740 1 -- 172.21.15.2:0/1383003069 wait complete. 2024-09-19T04:55:00.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.810+0000 7f253ff16740 20 client.16224 trim_cache size 0 max 16384 2024-09-19T04:55:00.824 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:55:00.824 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T04:55:00.824 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "fc2feb10-5fba-43fc-b9ca-c044f10be76d", 2024-09-19T04:55:00.824 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T04:55:00.824 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:55:00.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.810+0000 7f253db3d640 1 -- 172.21.15.2:0/3308598123 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f25240a33b0 msgr2=0x7f25240a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:00.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.810+0000 7f253db3d640 1 --2- 172.21.15.2:0/3308598123 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f25240a33b0 0x7f25240a5870 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2530005fd0 tx=0x7f2530009500 comp rx=0 tx=0).stop 2024-09-19T04:55:00.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.810+0000 7f253db3d640 1 -- 172.21.15.2:0/3308598123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2538101420 msgr2=0x7f25381997a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:00.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.810+0000 7f253db3d640 1 --2- 172.21.15.2:0/3308598123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2538101420 0x7f25381997a0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f252000d770 tx=0x7f252000dc30 comp rx=0 tx=0).stop 2024-09-19T04:55:00.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.810+0000 7f253db3d640 1 -- 172.21.15.2:0/3308598123 shutdown_connections 2024-09-19T04:55:00.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.810+0000 7f253db3d640 1 --2- 172.21.15.2:0/3308598123 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f25240a33b0 0x7f25240a5870 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:00.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.810+0000 7f253db3d640 1 --2- 172.21.15.2:0/3308598123 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2538106a80 0x7f25381a42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:00.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.810+0000 7f253db3d640 1 --2- 172.21.15.2:0/3308598123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2538101420 0x7f25381997a0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:00.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.810+0000 7f253db3d640 1 --2- 172.21.15.2:0/3308598123 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2538100a80 0x7f2538199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:00.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.810+0000 7f253db3d640 1 -- 172.21.15.2:0/3308598123 >> 172.21.15.2:0/3308598123 conn(0x7f25380fc7a0 msgr2=0x7f25380fd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:00.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.810+0000 7f253db3d640 1 -- 172.21.15.2:0/3308598123 shutdown_connections 2024-09-19T04:55:00.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:00.810+0000 7f253db3d640 1 -- 172.21.15.2:0/3308598123 wait complete. 2024-09-19T04:55:01.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:00 smithi018 ceph-mon[34537]: pgmap v213: 97 pgs: 97 active+clean; 10 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 35 KiB/s wr, 7 op/s 2024-09-19T04:55:01.110 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:00 smithi116 ceph-mon[34477]: pgmap v213: 97 pgs: 97 active+clean; 10 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 35 KiB/s wr, 7 op/s 2024-09-19T04:55:01.624 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:55:01.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:01 smithi002 ceph-mon[30975]: scrub queued for path: / 2024-09-19T04:55:01.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:01 smithi002 ceph-mon[30975]: scrub summary: idle+waiting paths [/] 2024-09-19T04:55:01.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:01 smithi002 ceph-mon[30975]: scrub summary: active paths [/] 2024-09-19T04:55:01.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:01 smithi002 ceph-mon[30975]: scrub summary: idle+waiting paths [/] 2024-09-19T04:55:01.882 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:55:02.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:01 smithi018 ceph-mon[34537]: scrub queued for path: / 2024-09-19T04:55:02.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:01 smithi018 ceph-mon[34537]: scrub summary: idle+waiting paths [/] 2024-09-19T04:55:02.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:01 smithi018 ceph-mon[34537]: scrub summary: active paths [/] 2024-09-19T04:55:02.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:01 smithi018 ceph-mon[34537]: scrub summary: idle+waiting paths [/] 2024-09-19T04:55:02.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:01 smithi116 ceph-mon[34477]: scrub queued for path: / 2024-09-19T04:55:02.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:01 smithi116 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-19T04:55:02.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:01 smithi116 ceph-mon[34477]: scrub summary: active paths [/] 2024-09-19T04:55:02.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:01 smithi116 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-19T04:55:02.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.339+0000 7f144d76e640 1 -- 172.21.15.2:0/3032233707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1448101420 msgr2=0x7f144810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:02.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.339+0000 7f144d76e640 1 --2- 172.21.15.2:0/3032233707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1448101420 0x7f144810d950 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f1440009cd0 tx=0x7f144002a8e0 comp rx=0 tx=0).stop 2024-09-19T04:55:02.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.339+0000 7f144d76e640 1 -- 172.21.15.2:0/3032233707 shutdown_connections 2024-09-19T04:55:02.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.339+0000 7f144d76e640 1 --2- 172.21.15.2:0/3032233707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1448101420 0x7f144810d950 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:02.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.339+0000 7f144d76e640 1 --2- 172.21.15.2:0/3032233707 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1448100a80 0x7f1448100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:02.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.339+0000 7f144d76e640 1 --2- 172.21.15.2:0/3032233707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1448106a80 0x7f1448106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:02.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.339+0000 7f144d76e640 1 -- 172.21.15.2:0/3032233707 >> 172.21.15.2:0/3032233707 conn(0x7f14480fc7a0 msgr2=0x7f14480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:02.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.339+0000 7f144d76e640 1 -- 172.21.15.2:0/3032233707 shutdown_connections 2024-09-19T04:55:02.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.339+0000 7f144d76e640 1 -- 172.21.15.2:0/3032233707 wait complete. 2024-09-19T04:55:02.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.339+0000 7f144d76e640 1 Processor -- start 2024-09-19T04:55:02.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.339+0000 7f144d76e640 1 -- start start 2024-09-19T04:55:02.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.340+0000 7f144d76e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1448100a80 0x7f1448198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:02.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.340+0000 7f144d76e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1448101420 0x7f14481988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:02.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.340+0000 7f144d76e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1448106a80 0x7f144819cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:02.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.340+0000 7f144d76e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1448110d30 con 0x7f1448101420 2024-09-19T04:55:02.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.340+0000 7f144d76e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1448110bb0 con 0x7f1448100a80 2024-09-19T04:55:02.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.340+0000 7f144d76e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f1448110eb0 con 0x7f1448106a80 2024-09-19T04:55:02.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.340+0000 7f143ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1448101420 0x7f14481988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:02.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.340+0000 7f143ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1448101420 0x7f14481988a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37672/0 (socket says 172.21.15.2:37672) 2024-09-19T04:55:02.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.340+0000 7f143ffff640 1 -- 172.21.15.2:0/3300854821 learned_addr learned my addr 172.21.15.2:0/3300854821 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:55:02.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.340+0000 7f1446ffd640 1 --2- 172.21.15.2:0/3300854821 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1448100a80 0x7f1448198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:02.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.340+0000 7f14477fe640 1 --2- 172.21.15.2:0/3300854821 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1448106a80 0x7f144819cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:02.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.340+0000 7f143ffff640 1 -- 172.21.15.2:0/3300854821 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1448106a80 msgr2=0x7f144819cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:02.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.340+0000 7f143ffff640 1 --2- 172.21.15.2:0/3300854821 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1448106a80 0x7f144819cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:02.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.340+0000 7f143ffff640 1 -- 172.21.15.2:0/3300854821 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1448100a80 msgr2=0x7f1448198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:02.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.340+0000 7f143ffff640 1 --2- 172.21.15.2:0/3300854821 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1448100a80 0x7f1448198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:02.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.340+0000 7f143ffff640 1 -- 172.21.15.2:0/3300854821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f144819d310 con 0x7f1448101420 2024-09-19T04:55:02.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.340+0000 7f143ffff640 1 --2- 172.21.15.2:0/3300854821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1448101420 0x7f14481988a0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f143000d770 tx=0x7f143000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:02.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.340+0000 7f1444ff9640 1 -- 172.21.15.2:0/3300854821 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1430017070 con 0x7f1448101420 2024-09-19T04:55:02.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.341+0000 7f144d76e640 1 -- 172.21.15.2:0/3300854821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f144819d600 con 0x7f1448101420 2024-09-19T04:55:02.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.341+0000 7f1444ff9640 1 -- 172.21.15.2:0/3300854821 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f14300054d0 con 0x7f1448101420 2024-09-19T04:55:02.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.341+0000 7f1444ff9640 1 -- 172.21.15.2:0/3300854821 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1430004cf0 con 0x7f1448101420 2024-09-19T04:55:02.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.341+0000 7f144d76e640 1 -- 172.21.15.2:0/3300854821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14481a4ee0 con 0x7f1448101420 2024-09-19T04:55:02.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.343+0000 7f1444ff9640 1 -- 172.21.15.2:0/3300854821 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f1430004e90 con 0x7f1448101420 2024-09-19T04:55:02.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.343+0000 7f144fb47740 1 Processor -- start 2024-09-19T04:55:02.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.343+0000 7f144fb47740 1 -- start start 2024-09-19T04:55:02.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.343+0000 7f144fb47740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f6d33454a0 0x55f6d3345880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:02.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.343+0000 7f144fb47740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6d3345dc0 0x55f6d3350140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:02.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.343+0000 7f144fb47740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6d3350680 0x55f6d3352a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:02.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.343+0000 7f144fb47740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f6d32ab2e0 con 0x55f6d3350680 2024-09-19T04:55:02.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.343+0000 7f144fb47740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f6d3252ce0 con 0x55f6d3345dc0 2024-09-19T04:55:02.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.343+0000 7f144fb47740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55f6d32a72a0 con 0x55f6d33454a0 2024-09-19T04:55:02.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.344+0000 7f143ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6d3350680 0x55f6d3352a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:02.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.344+0000 7f1446ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6d3345dc0 0x55f6d3350140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:02.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.344+0000 7f143ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6d3350680 0x55f6d3352a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37678/0 (socket says 172.21.15.2:37678) 2024-09-19T04:55:02.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.344+0000 7f143ffff640 1 -- 172.21.15.2:0/1708098833 learned_addr learned my addr 172.21.15.2:0/1708098833 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:55:02.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.344+0000 7f1444ff9640 1 --2- 172.21.15.2:0/3300854821 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f14340a33b0 0x7f14340a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:02.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.344+0000 7f14477fe640 1 --2- 172.21.15.2:0/1708098833 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f6d33454a0 0x55f6d3345880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:02.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.344+0000 7f14477fe640 1 --2- 172.21.15.2:0/3300854821 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f14340a33b0 0x7f14340a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:02.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.344+0000 7f1446ffd640 1 -- 172.21.15.2:0/1708098833 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f6d33454a0 msgr2=0x55f6d3345880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:02.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.344+0000 7f1446ffd640 1 --2- 172.21.15.2:0/1708098833 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f6d33454a0 0x55f6d3345880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:02.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.344+0000 7f1446ffd640 1 -- 172.21.15.2:0/1708098833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6d3350680 msgr2=0x55f6d3352a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:02.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.344+0000 7f1446ffd640 1 --2- 172.21.15.2:0/1708098833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6d3350680 0x55f6d3352a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:02.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.344+0000 7f1446ffd640 1 -- 172.21.15.2:0/1708098833 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6d3237440 con 0x55f6d3345dc0 2024-09-19T04:55:02.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.344+0000 7f1444ff9640 1 -- 172.21.15.2:0/3300854821 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f14300cf6c0 con 0x7f1448101420 2024-09-19T04:55:02.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.344+0000 7f14477fe640 1 --2- 172.21.15.2:0/1708098833 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f6d33454a0 0x55f6d3345880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:55:02.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.344+0000 7f1446ffd640 1 --2- 172.21.15.2:0/1708098833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6d3345dc0 0x55f6d3350140 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f143800bb70 tx=0x7f14380107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c14a9eca8ed6dccb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:02.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.344+0000 7f14477fe640 1 --2- 172.21.15.2:0/3300854821 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f14340a33b0 0x7f14340a5870 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1440005e10 tx=0x7f1440005da0 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:02.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.345+0000 7f143d7fa640 1 -- 172.21.15.2:0/1708098833 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1438004030 con 0x55f6d3345dc0 2024-09-19T04:55:02.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.345+0000 7f143d7fa640 1 -- 172.21.15.2:0/1708098833 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f14380035f0 con 0x55f6d3345dc0 2024-09-19T04:55:02.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.345+0000 7f143d7fa640 1 -- 172.21.15.2:0/1708098833 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1438011680 con 0x55f6d3345dc0 2024-09-19T04:55:02.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.345+0000 7f144fb47740 1 -- 172.21.15.2:0/1708098833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6d3345dc0 msgr2=0x55f6d3350140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:02.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.345+0000 7f144fb47740 1 --2- 172.21.15.2:0/1708098833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6d3345dc0 0x55f6d3350140 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f143800bb70 tx=0x7f14380107a0 comp rx=0 tx=0).stop 2024-09-19T04:55:02.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.345+0000 7f144fb47740 1 -- 172.21.15.2:0/1708098833 shutdown_connections 2024-09-19T04:55:02.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.345+0000 7f144fb47740 1 --2- 172.21.15.2:0/1708098833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6d3350680 0x55f6d3352a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:02.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.345+0000 7f144fb47740 1 --2- 172.21.15.2:0/1708098833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6d3345dc0 0x55f6d3350140 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:02.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.345+0000 7f144fb47740 1 --2- 172.21.15.2:0/1708098833 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f6d33454a0 0x55f6d3345880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:02.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.345+0000 7f144fb47740 1 -- 172.21.15.2:0/1708098833 >> 172.21.15.2:0/1708098833 conn(0x55f6d3341a30 msgr2=0x55f6d3341e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:02.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.345+0000 7f144fb47740 1 -- 172.21.15.2:0/1708098833 shutdown_connections 2024-09-19T04:55:02.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.345+0000 7f144fb47740 1 -- 172.21.15.2:0/1708098833 wait complete. 2024-09-19T04:55:02.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.346+0000 7f144fb47740 1 -- start start 2024-09-19T04:55:02.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.346+0000 7f144fb47740 1 Processor -- start 2024-09-19T04:55:02.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.346+0000 7f144fb47740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6d33454a0 0x55f6d334ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:02.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.346+0000 7f144fb47740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f6d3345dc0 0x55f6d334d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:02.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.346+0000 7f144fb47740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6d3350680 0x55f6d334d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:02.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.346+0000 7f144fb47740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f6d3353250 con 0x55f6d3350680 2024-09-19T04:55:02.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.346+0000 7f144fb47740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f6d3266050 con 0x55f6d33454a0 2024-09-19T04:55:02.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.346+0000 7f144fb47740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55f6d33533d0 con 0x55f6d3345dc0 2024-09-19T04:55:02.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.346+0000 7f144fb47740 10 client.0 _ll_register_callbacks cb 0x55f6d32a6160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:55:02.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.346+0000 7f14477fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6d3350680 0x55f6d334d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:02.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.346+0000 7f1446ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6d33454a0 0x55f6d334ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:02.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.346+0000 7f14477fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6d3350680 0x55f6d334d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37684/0 (socket says 172.21.15.2:37684) 2024-09-19T04:55:02.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.346+0000 7f14477fe640 1 -- 172.21.15.2:0/3304364468 learned_addr learned my addr 172.21.15.2:0/3304364468 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:55:02.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.346+0000 7f143ffff640 1 --2- 172.21.15.2:0/3304364468 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f6d3345dc0 0x55f6d334d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:02.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.347+0000 7f1446ffd640 1 -- 172.21.15.2:0/3304364468 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f6d3345dc0 msgr2=0x55f6d334d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:02.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.347+0000 7f1446ffd640 1 --2- 172.21.15.2:0/3304364468 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f6d3345dc0 0x55f6d334d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:02.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.347+0000 7f1446ffd640 1 -- 172.21.15.2:0/3304364468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6d3350680 msgr2=0x55f6d334d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:02.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.347+0000 7f1446ffd640 1 --2- 172.21.15.2:0/3304364468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6d3350680 0x55f6d334d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:02.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.347+0000 7f1446ffd640 1 -- 172.21.15.2:0/3304364468 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6d301c3c0 con 0x55f6d33454a0 2024-09-19T04:55:02.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.347+0000 7f14477fe640 1 --2- 172.21.15.2:0/3304364468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6d3350680 0x55f6d334d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:55:02.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.347+0000 7f1446ffd640 1 --2- 172.21.15.2:0/3304364468 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6d33454a0 0x55f6d334ff20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1438010ca0 tx=0x7f143800bf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2b871b36b83316f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:02.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.347+0000 7f142e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T04:55:02.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.347+0000 7f142e7fc640 1 -- 172.21.15.2:0/3304364468 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f143802a060 con 0x55f6d33454a0 2024-09-19T04:55:02.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.347+0000 7f144fb47740 1 -- 172.21.15.2:0/3304364468 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14380035f0 con 0x55f6d33454a0 2024-09-19T04:55:02.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.347+0000 7f142e7fc640 1 -- 172.21.15.2:0/3304364468 <== mon.2 v2:172.21.15.18:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f14380039b0 con 0x55f6d33454a0 2024-09-19T04:55:02.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.347+0000 7f142e7fc640 1 -- 172.21.15.2:0/3304364468 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1438003f70 con 0x55f6d33454a0 2024-09-19T04:55:02.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.347+0000 7f144fb47740 10 client.25619 fetch_fsmap learned FSMap version 19 2024-09-19T04:55:02.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.347+0000 7f144fb47740 1 -- 172.21.15.2:0/3304364468 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55f6d335eb40 con 0x55f6d33454a0 2024-09-19T04:55:02.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.347+0000 7f142e7fc640 1 -- 172.21.15.2:0/3304364468 <== mon.2 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f14380035f0 con 0x55f6d33454a0 2024-09-19T04:55:02.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.348+0000 7f142e7fc640 1 -- 172.21.15.2:0/3304364468 <== mon.2 v2:172.21.15.18:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f14380046c0 con 0x55f6d33454a0 2024-09-19T04:55:02.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.348+0000 7f144fb47740 10 client.25619 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:55:02.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.348+0000 7f144fb47740 10 client.25619 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:55:02.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.348+0000 7f144fb47740 20 client.25619 populate_metadata read hostname 'smithi002' 2024-09-19T04:55:02.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.348+0000 7f144fb47740 1 --2- 172.21.15.2:0/3304364468 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f6d335ff50 0x55f6d3362340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:02.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.348+0000 7f144fb47740 4 client.25619 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:55:02.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.348+0000 7f144fb47740 1 -- 172.21.15.2:0/3304364468 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f6d32b8850 con 0x55f6d335ff50 2024-09-19T04:55:02.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.348+0000 7f143ffff640 1 --2- 172.21.15.2:0/3304364468 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f6d335ff50 0x55f6d3362340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:02.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.348+0000 7f142e7fc640 10 client.25619 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:55:02.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.348+0000 7f143ffff640 1 --2- 172.21.15.2:0/3304364468 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f6d335ff50 0x55f6d3362340 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4cfa5396594a3b8 server_cookie=8482ba32b313fd90 in_seq=0 out_seq=0 2024-09-19T04:55:02.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.349+0000 7f142e7fc640 1 -- 172.21.15.2:0/3304364468 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f6d32b8850 con 0x55f6d335ff50 2024-09-19T04:55:02.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.349+0000 7f142e7fc640 10 client.25619 handle_command_reply: tid=0 2024-09-19T04:55:02.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.349+0000 7f144fb47740 1 client.25619 shutdown 2024-09-19T04:55:02.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.349+0000 7f144fb47740 1 -- 172.21.15.2:0/3304364468 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6d33454a0 msgr2=0x55f6d334ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:02.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.349+0000 7f144fb47740 1 --2- 172.21.15.2:0/3304364468 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6d33454a0 0x55f6d334ff20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1438010ca0 tx=0x7f143800bf50 comp rx=0 tx=0).stop 2024-09-19T04:55:02.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.349+0000 7f144fb47740 1 -- 172.21.15.2:0/3304364468 shutdown_connections 2024-09-19T04:55:02.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.349+0000 7f144fb47740 1 --2- 172.21.15.2:0/3304364468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6d3350680 0x55f6d334d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:02.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.349+0000 7f144fb47740 1 --2- 172.21.15.2:0/3304364468 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f6d335ff50 0x55f6d3362340 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:02.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.349+0000 7f144fb47740 1 --2- 172.21.15.2:0/3304364468 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f6d3345dc0 0x55f6d334d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:02.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.349+0000 7f144fb47740 1 --2- 172.21.15.2:0/3304364468 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6d33454a0 0x55f6d334ff20 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:02.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.349+0000 7f142e7fc640 0 client.25619 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:55:02.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.349+0000 7f144fb47740 1 -- 172.21.15.2:0/3304364468 >> 172.21.15.2:0/3304364468 conn(0x55f6d3341a30 msgr2=0x55f6d3347710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:02.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.350+0000 7f144fb47740 1 -- 172.21.15.2:0/3304364468 shutdown_connections 2024-09-19T04:55:02.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.350+0000 7f144fb47740 1 -- 172.21.15.2:0/3304364468 wait complete. 2024-09-19T04:55:02.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.350+0000 7f144fb47740 20 client.25619 trim_cache size 0 max 16384 2024-09-19T04:55:02.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.367+0000 7f144fb47740 1 Processor -- start 2024-09-19T04:55:02.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.368+0000 7f144fb47740 1 -- start start 2024-09-19T04:55:02.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.368+0000 7f144fb47740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6d33454a0 0x55f6d335c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:02.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.368+0000 7f144fb47740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f6d3345dc0 0x55f6d3367910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:02.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.368+0000 7f144fb47740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6d3350680 0x55f6d3367e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:02.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.368+0000 7f144fb47740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f14481ab800 con 0x55f6d33454a0 2024-09-19T04:55:02.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.368+0000 7f144fb47740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f14481ae080 con 0x55f6d3350680 2024-09-19T04:55:02.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.368+0000 7f144fb47740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f14481abe70 con 0x55f6d3345dc0 2024-09-19T04:55:02.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.368+0000 7f1446ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6d33454a0 0x55f6d335c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:02.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.368+0000 7f1446ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6d33454a0 0x55f6d335c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37698/0 (socket says 172.21.15.2:37698) 2024-09-19T04:55:02.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.368+0000 7f1446ffd640 1 -- 172.21.15.2:0/437490332 learned_addr learned my addr 172.21.15.2:0/437490332 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:55:02.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.368+0000 7f143ffff640 1 --2- 172.21.15.2:0/437490332 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f6d3345dc0 0x55f6d3367910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:02.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.368+0000 7f14477fe640 1 --2- 172.21.15.2:0/437490332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6d3350680 0x55f6d3367e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:02.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.369+0000 7f1446ffd640 1 -- 172.21.15.2:0/437490332 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f6d3345dc0 msgr2=0x55f6d3367910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:02.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.369+0000 7f1446ffd640 1 --2- 172.21.15.2:0/437490332 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f6d3345dc0 0x55f6d3367910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:02.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.369+0000 7f1446ffd640 1 -- 172.21.15.2:0/437490332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6d3350680 msgr2=0x55f6d3367e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:02.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.369+0000 7f1446ffd640 1 --2- 172.21.15.2:0/437490332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6d3350680 0x55f6d3367e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:02.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.369+0000 7f1446ffd640 1 -- 172.21.15.2:0/437490332 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6d3353380 con 0x55f6d33454a0 2024-09-19T04:55:02.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.369+0000 7f14477fe640 1 --2- 172.21.15.2:0/437490332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6d3350680 0x55f6d3367e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:55:02.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.369+0000 7f143ffff640 1 --2- 172.21.15.2:0/437490332 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f6d3345dc0 0x55f6d3367910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:55:02.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.369+0000 7f1446ffd640 1 --2- 172.21.15.2:0/437490332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6d33454a0 0x55f6d335c4b0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f143800b900 tx=0x7f143800b5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdf46d9efcc3e397 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:02.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.369+0000 7f143cff9640 1 -- 172.21.15.2:0/437490332 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1438004d00 con 0x55f6d33454a0 2024-09-19T04:55:02.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.369+0000 7f143cff9640 1 -- 172.21.15.2:0/437490332 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f143801f020 con 0x55f6d33454a0 2024-09-19T04:55:02.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.369+0000 7f143cff9640 1 -- 172.21.15.2:0/437490332 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1438004110 con 0x55f6d33454a0 2024-09-19T04:55:02.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.370+0000 7f144fb47740 1 -- 172.21.15.2:0/437490332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6d33454a0 msgr2=0x55f6d335c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:02.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.370+0000 7f144fb47740 1 --2- 172.21.15.2:0/437490332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6d33454a0 0x55f6d335c4b0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f143800b900 tx=0x7f143800b5e0 comp rx=0 tx=0).stop 2024-09-19T04:55:02.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.370+0000 7f144fb47740 1 -- 172.21.15.2:0/437490332 shutdown_connections 2024-09-19T04:55:02.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.370+0000 7f144fb47740 1 --2- 172.21.15.2:0/437490332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6d3350680 0x55f6d3367e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:02.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.370+0000 7f144fb47740 1 --2- 172.21.15.2:0/437490332 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f6d3345dc0 0x55f6d3367910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:02.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.370+0000 7f144fb47740 1 --2- 172.21.15.2:0/437490332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6d33454a0 0x55f6d335c4b0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:02.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.370+0000 7f144fb47740 1 -- 172.21.15.2:0/437490332 >> 172.21.15.2:0/437490332 conn(0x55f6d3341a30 msgr2=0x55f6d3340b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:02.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.370+0000 7f144fb47740 1 -- 172.21.15.2:0/437490332 shutdown_connections 2024-09-19T04:55:02.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.370+0000 7f144fb47740 1 -- 172.21.15.2:0/437490332 wait complete. 2024-09-19T04:55:02.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.370+0000 7f144fb47740 1 -- start start 2024-09-19T04:55:02.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.370+0000 7f144fb47740 1 Processor -- start 2024-09-19T04:55:02.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.370+0000 7f144fb47740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6d33454a0 0x55f6d3358dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:02.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.370+0000 7f144fb47740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f6d3345dc0 0x55f6d3354100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:02.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.370+0000 7f144fb47740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6d3350680 0x55f6d3354640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:02.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.371+0000 7f144fb47740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f14481ac540 con 0x55f6d3350680 2024-09-19T04:55:02.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.371+0000 7f144fb47740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f14481ad9b0 con 0x55f6d33454a0 2024-09-19T04:55:02.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.371+0000 7f144fb47740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f14481acc10 con 0x55f6d3345dc0 2024-09-19T04:55:02.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.371+0000 7f144fb47740 10 client.0 _ll_register_callbacks cb 0x7f1430097b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:55:02.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.371+0000 7f14477fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6d3350680 0x55f6d3354640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:02.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.371+0000 7f14477fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6d3350680 0x55f6d3354640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37700/0 (socket says 172.21.15.2:37700) 2024-09-19T04:55:02.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.371+0000 7f1446ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6d33454a0 0x55f6d3358dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:02.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.371+0000 7f14477fe640 1 -- 172.21.15.2:0/1529048808 learned_addr learned my addr 172.21.15.2:0/1529048808 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:55:02.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.371+0000 7f143ffff640 1 --2- 172.21.15.2:0/1529048808 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f6d3345dc0 0x55f6d3354100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:02.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.371+0000 7f1446ffd640 1 -- 172.21.15.2:0/1529048808 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f6d3345dc0 msgr2=0x55f6d3354100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:02.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.371+0000 7f1446ffd640 1 --2- 172.21.15.2:0/1529048808 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f6d3345dc0 0x55f6d3354100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:02.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.371+0000 7f1446ffd640 1 -- 172.21.15.2:0/1529048808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6d3350680 msgr2=0x55f6d3354640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:02.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.371+0000 7f1446ffd640 1 --2- 172.21.15.2:0/1529048808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6d3350680 0x55f6d3354640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:02.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.371+0000 7f1446ffd640 1 -- 172.21.15.2:0/1529048808 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6d3341860 con 0x55f6d33454a0 2024-09-19T04:55:02.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.371+0000 7f143ffff640 1 --2- 172.21.15.2:0/1529048808 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f6d3345dc0 0x55f6d3354100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:55:02.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.371+0000 7f1446ffd640 1 --2- 172.21.15.2:0/1529048808 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6d33454a0 0x55f6d3358dd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1438000c00 tx=0x7f1438005c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93c9cf01fd463fb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:02.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.371+0000 7f142e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T04:55:02.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.371+0000 7f142e7fc640 1 -- 172.21.15.2:0/1529048808 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f143803b020 con 0x55f6d33454a0 2024-09-19T04:55:02.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.371+0000 7f142e7fc640 1 -- 172.21.15.2:0/1529048808 <== mon.2 v2:172.21.15.18:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8483+0+0 (secure 0 0 0) 0x7f1438004110 con 0x55f6d33454a0 2024-09-19T04:55:02.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.371+0000 7f144fb47740 1 -- 172.21.15.2:0/1529048808 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f143801f020 con 0x55f6d33454a0 2024-09-19T04:55:02.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.372+0000 7f142e7fc640 1 -- 172.21.15.2:0/1529048808 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f14380035f0 con 0x55f6d33454a0 2024-09-19T04:55:02.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.372+0000 7f144fb47740 10 client.25625 fetch_fsmap learned FSMap version 19 2024-09-19T04:55:02.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.372+0000 7f144fb47740 1 -- 172.21.15.2:0/1529048808 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55f6d33ca780 con 0x55f6d33454a0 2024-09-19T04:55:02.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.372+0000 7f142e7fc640 1 -- 172.21.15.2:0/1529048808 <== mon.2 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f143801f020 con 0x55f6d33454a0 2024-09-19T04:55:02.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.372+0000 7f142e7fc640 1 -- 172.21.15.2:0/1529048808 <== mon.2 v2:172.21.15.18:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f14380054c0 con 0x55f6d33454a0 2024-09-19T04:55:02.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.372+0000 7f144fb47740 10 client.25625 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:55:02.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.372+0000 7f144fb47740 10 client.25625 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:55:02.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.372+0000 7f144fb47740 20 client.25625 populate_metadata read hostname 'smithi002' 2024-09-19T04:55:02.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.372+0000 7f144fb47740 1 --2- 172.21.15.2:0/1529048808 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f6d33cae30 0x55f6d33cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:02.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.372+0000 7f144fb47740 4 client.25625 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:55:02.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.372+0000 7f144fb47740 1 -- 172.21.15.2:0/1529048808 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f6d32b2d60 con 0x55f6d33cae30 2024-09-19T04:55:02.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.372+0000 7f143ffff640 1 --2- 172.21.15.2:0/1529048808 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f6d33cae30 0x55f6d33cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:02.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.373+0000 7f143ffff640 1 --2- 172.21.15.2:0/1529048808 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f6d33cae30 0x55f6d33cd220 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ccd253e6d5c70d2 server_cookie=adac3c5456ab6d43 in_seq=0 out_seq=0 2024-09-19T04:55:02.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.373+0000 7f142e7fc640 10 client.25625 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:55:02.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.373+0000 7f142e7fc640 1 -- 172.21.15.2:0/1529048808 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55f6d32b2d60 con 0x55f6d33cae30 2024-09-19T04:55:02.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.373+0000 7f142e7fc640 10 client.25625 handle_command_reply: tid=0 2024-09-19T04:55:02.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.373+0000 7f144fb47740 1 client.25625 shutdown 2024-09-19T04:55:02.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.373+0000 7f144fb47740 1 -- 172.21.15.2:0/1529048808 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6d33454a0 msgr2=0x55f6d3358dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:02.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.373+0000 7f144fb47740 1 --2- 172.21.15.2:0/1529048808 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6d33454a0 0x55f6d3358dd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1438000c00 tx=0x7f1438005c00 comp rx=0 tx=0).stop 2024-09-19T04:55:02.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.373+0000 7f144fb47740 1 -- 172.21.15.2:0/1529048808 shutdown_connections 2024-09-19T04:55:02.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.373+0000 7f144fb47740 1 --2- 172.21.15.2:0/1529048808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6d3350680 0x55f6d3354640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:02.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.373+0000 7f144fb47740 1 --2- 172.21.15.2:0/1529048808 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f6d33cae30 0x55f6d33cd220 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:02.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.373+0000 7f144fb47740 1 --2- 172.21.15.2:0/1529048808 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f6d3345dc0 0x55f6d3354100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:02.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.373+0000 7f144fb47740 1 --2- 172.21.15.2:0/1529048808 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6d33454a0 0x55f6d3358dd0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:02.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.373+0000 7f142e7fc640 0 client.25625 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:55:02.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.373+0000 7f144fb47740 1 -- 172.21.15.2:0/1529048808 >> 172.21.15.2:0/1529048808 conn(0x55f6d3341a30 msgr2=0x55f6d334b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:02.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.373+0000 7f144fb47740 1 -- 172.21.15.2:0/1529048808 shutdown_connections 2024-09-19T04:55:02.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.373+0000 7f144fb47740 1 -- 172.21.15.2:0/1529048808 wait complete. 2024-09-19T04:55:02.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.373+0000 7f144fb47740 20 client.25625 trim_cache size 0 max 16384 2024-09-19T04:55:02.387 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:55:02.387 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T04:55:02.387 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-19T04:55:02.387 INFO:teuthology.orchestra.run.smithi002.stdout: "fc2feb10-5fba-43fc-b9ca-c044f10be76d": { 2024-09-19T04:55:02.387 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-19T04:55:02.387 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "fc2feb10-5fba-43fc-b9ca-c044f10be76d", 2024-09-19T04:55:02.387 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-19T04:55:02.388 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:55:02.388 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:55:02.388 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:55:02.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.374+0000 7f144d76e640 1 -- 172.21.15.2:0/3300854821 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f14340a33b0 msgr2=0x7f14340a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:02.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.374+0000 7f144d76e640 1 --2- 172.21.15.2:0/3300854821 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f14340a33b0 0x7f14340a5870 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1440005e10 tx=0x7f1440005da0 comp rx=0 tx=0).stop 2024-09-19T04:55:02.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.374+0000 7f144d76e640 1 -- 172.21.15.2:0/3300854821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1448101420 msgr2=0x7f14481988a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:02.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.374+0000 7f144d76e640 1 --2- 172.21.15.2:0/3300854821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1448101420 0x7f14481988a0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f143000d770 tx=0x7f143000dc30 comp rx=0 tx=0).stop 2024-09-19T04:55:02.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.374+0000 7f144d76e640 1 -- 172.21.15.2:0/3300854821 shutdown_connections 2024-09-19T04:55:02.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.374+0000 7f144d76e640 1 --2- 172.21.15.2:0/3300854821 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f14340a33b0 0x7f14340a5870 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:02.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.374+0000 7f144d76e640 1 --2- 172.21.15.2:0/3300854821 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1448106a80 0x7f144819cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:02.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.374+0000 7f144d76e640 1 --2- 172.21.15.2:0/3300854821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1448101420 0x7f14481988a0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:02.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.374+0000 7f144d76e640 1 --2- 172.21.15.2:0/3300854821 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1448100a80 0x7f1448198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:02.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.374+0000 7f144d76e640 1 -- 172.21.15.2:0/3300854821 >> 172.21.15.2:0/3300854821 conn(0x7f14480fc7a0 msgr2=0x7f14481048d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:02.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.374+0000 7f144d76e640 1 -- 172.21.15.2:0/3300854821 shutdown_connections 2024-09-19T04:55:02.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:02.374+0000 7f144d76e640 1 -- 172.21.15.2:0/3300854821 wait complete. 2024-09-19T04:55:03.010 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:02 smithi002 ceph-mon[30975]: pgmap v214: 97 pgs: 97 active+clean; 10 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 73 KiB/s wr, 19 op/s 2024-09-19T04:55:03.044 INFO:tasks.cephfs.filesystem:scrub status for tag:fc2feb10-5fba-43fc-b9ca-c044f10be76d - {'path': '/', 'tag': 'fc2feb10-5fba-43fc-b9ca-c044f10be76d', 'options': 'recursive,force'} 2024-09-19T04:55:03.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:02 smithi018 ceph-mon[34537]: pgmap v214: 97 pgs: 97 active+clean; 10 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 73 KiB/s wr, 19 op/s 2024-09-19T04:55:03.110 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:02 smithi116 ceph-mon[34477]: pgmap v214: 97 pgs: 97 active+clean; 10 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 73 KiB/s wr, 19 op/s 2024-09-19T04:55:05.056 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:04 smithi018 ceph-mon[34537]: pgmap v215: 97 pgs: 97 active+clean; 10 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 57 KiB/s wr, 15 op/s 2024-09-19T04:55:05.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:04 smithi002 ceph-mon[30975]: pgmap v215: 97 pgs: 97 active+clean; 10 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 57 KiB/s wr, 15 op/s 2024-09-19T04:55:05.110 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:04 smithi116 ceph-mon[34477]: pgmap v215: 97 pgs: 97 active+clean; 10 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 57 KiB/s wr, 15 op/s 2024-09-19T04:55:05.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:05 smithi002 ceph-mon[30975]: scrub summary: idle 2024-09-19T04:55:06.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:05 smithi018 ceph-mon[34537]: scrub summary: idle 2024-09-19T04:55:06.112 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:05 smithi116 ceph-mon[34477]: scrub summary: idle 2024-09-19T04:55:07.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:06 smithi018 ceph-mon[34537]: pgmap v216: 97 pgs: 97 active+clean; 11 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 103 KiB/s wr, 28 op/s 2024-09-19T04:55:07.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:06 smithi018 ceph-mon[34537]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T04:55:07.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:06 smithi002 ceph-mon[30975]: pgmap v216: 97 pgs: 97 active+clean; 11 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 103 KiB/s wr, 28 op/s 2024-09-19T04:55:07.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:06 smithi002 ceph-mon[30975]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T04:55:07.110 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:06 smithi116 ceph-mon[34477]: pgmap v216: 97 pgs: 97 active+clean; 11 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 103 KiB/s wr, 28 op/s 2024-09-19T04:55:07.110 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:06 smithi116 ceph-mon[34477]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T04:55:08.927 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:08 smithi002 ceph-mon[30975]: pgmap v218: 97 pgs: 97 active+clean; 11 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 101 KiB/s wr, 29 op/s 2024-09-19T04:55:09.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:08 smithi018 ceph-mon[34537]: pgmap v218: 97 pgs: 97 active+clean; 11 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 101 KiB/s wr, 29 op/s 2024-09-19T04:55:09.110 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:08 smithi116 ceph-mon[34477]: pgmap v218: 97 pgs: 97 active+clean; 11 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 101 KiB/s wr, 29 op/s 2024-09-19T04:55:11.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:10 smithi018 ceph-mon[34537]: pgmap v219: 97 pgs: 97 active+clean; 11 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 101 KiB/s wr, 29 op/s 2024-09-19T04:55:11.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:10 smithi002 ceph-mon[30975]: pgmap v219: 97 pgs: 97 active+clean; 11 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 101 KiB/s wr, 29 op/s 2024-09-19T04:55:11.110 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:10 smithi116 ceph-mon[34477]: pgmap v219: 97 pgs: 97 active+clean; 11 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 101 KiB/s wr, 29 op/s 2024-09-19T04:55:13.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:12 smithi018 ceph-mon[34537]: pgmap v220: 97 pgs: 97 active+clean; 11 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 76 KiB/s wr, 19 op/s 2024-09-19T04:55:13.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:12 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:55:13.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:12 smithi002 ceph-mon[30975]: pgmap v220: 97 pgs: 97 active+clean; 11 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 76 KiB/s wr, 19 op/s 2024-09-19T04:55:13.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:12 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:55:13.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:12 smithi116 ceph-mon[34477]: pgmap v220: 97 pgs: 97 active+clean; 11 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 76 KiB/s wr, 19 op/s 2024-09-19T04:55:13.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:12 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:55:14.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:13 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:55:14.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:13 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:55:14.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:13 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:55:14.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:13 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:55:14.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:13 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:55:14.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:13 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:55:14.110 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:13 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:55:14.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:13 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:55:14.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:13 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:55:15.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:15 smithi018 ceph-mon[34537]: pgmap v221: 97 pgs: 97 active+clean; 11 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 76 KiB/s wr, 19 op/s 2024-09-19T04:55:15.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:15 smithi002 ceph-mon[30975]: pgmap v221: 97 pgs: 97 active+clean; 11 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 76 KiB/s wr, 19 op/s 2024-09-19T04:55:15.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:15 smithi116 ceph-mon[34477]: pgmap v221: 97 pgs: 97 active+clean; 11 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 76 KiB/s wr, 19 op/s 2024-09-19T04:55:16.512 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:16 smithi116 ceph-mon[34477]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T04:55:16.512 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:16 smithi116 ceph-mon[34477]: pgmap v223: 97 pgs: 97 active+clean; 11 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 8 op/s 2024-09-19T04:55:16.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:16 smithi018 ceph-mon[34537]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T04:55:16.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:16 smithi018 ceph-mon[34537]: pgmap v223: 97 pgs: 97 active+clean; 11 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 8 op/s 2024-09-19T04:55:16.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:16 smithi002 ceph-mon[30975]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T04:55:16.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:16 smithi002 ceph-mon[30975]: pgmap v223: 97 pgs: 97 active+clean; 11 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 8 op/s 2024-09-19T04:55:18.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:18 smithi002 ceph-mon[30975]: pgmap v224: 97 pgs: 97 active+clean; 11 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 7 op/s 2024-09-19T04:55:18.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:18 smithi116 ceph-mon[34477]: pgmap v224: 97 pgs: 97 active+clean; 11 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 7 op/s 2024-09-19T04:55:18.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:18 smithi018 ceph-mon[34537]: pgmap v224: 97 pgs: 97 active+clean; 11 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 7 op/s 2024-09-19T04:55:20.609 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:20 smithi018 ceph-mon[34537]: pgmap v225: 97 pgs: 97 active+clean; 11 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 7 op/s 2024-09-19T04:55:20.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:20 smithi002 ceph-mon[30975]: pgmap v225: 97 pgs: 97 active+clean; 11 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 7 op/s 2024-09-19T04:55:20.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:20 smithi116 ceph-mon[34477]: pgmap v225: 97 pgs: 97 active+clean; 11 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 7 op/s 2024-09-19T04:55:22.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:22 smithi002 ceph-mon[30975]: pgmap v226: 97 pgs: 97 active+clean; 11 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 8 op/s 2024-09-19T04:55:22.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:22 smithi116 ceph-mon[34477]: pgmap v226: 97 pgs: 97 active+clean; 11 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 8 op/s 2024-09-19T04:55:22.808 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:22 smithi018 ceph-mon[34537]: pgmap v226: 97 pgs: 97 active+clean; 11 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 8 op/s 2024-09-19T04:55:24.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:24 smithi002 ceph-mon[30975]: pgmap v227: 97 pgs: 97 active+clean; 11 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 8 op/s 2024-09-19T04:55:24.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:24 smithi116 ceph-mon[34477]: pgmap v227: 97 pgs: 97 active+clean; 11 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 8 op/s 2024-09-19T04:55:24.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:24 smithi018 ceph-mon[34537]: pgmap v227: 97 pgs: 97 active+clean; 11 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 8 op/s 2024-09-19T04:55:26.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:26 smithi002 ceph-mon[30975]: pgmap v228: 97 pgs: 97 active+clean; 11 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 67 KiB/s wr, 12 op/s 2024-09-19T04:55:26.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:26 smithi116 ceph-mon[34477]: pgmap v228: 97 pgs: 97 active+clean; 11 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 67 KiB/s wr, 12 op/s 2024-09-19T04:55:26.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:26 smithi018 ceph-mon[34537]: pgmap v228: 97 pgs: 97 active+clean; 11 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 67 KiB/s wr, 12 op/s 2024-09-19T04:55:28.351 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.351 INFO:tasks.workunit.client.0.smithi002.stdout:313/600: open fd = 3 2024-09-19T04:55:28.351 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.351 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.351 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.351 INFO:tasks.workunit.client.0.smithi002.stdout:314/600: open fd = 3 2024-09-19T04:55:28.351 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.351 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.351 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.351 INFO:tasks.workunit.client.0.smithi002.stdout:315/600: open fd = 3 2024-09-19T04:55:28.352 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.352 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.352 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.352 INFO:tasks.workunit.client.0.smithi002.stdout:316/600: open fd = 3 2024-09-19T04:55:28.352 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.352 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.352 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.352 INFO:tasks.workunit.client.0.smithi002.stdout:317/600: open fd = 3 2024-09-19T04:55:28.352 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.352 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.352 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.352 INFO:tasks.workunit.client.0.smithi002.stdout:318/600: open fd = 3 2024-09-19T04:55:28.353 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.353 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.353 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.353 INFO:tasks.workunit.client.0.smithi002.stdout:319/600: open fd = 3 2024-09-19T04:55:28.353 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.353 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.353 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.353 INFO:tasks.workunit.client.0.smithi002.stdout:320/600: open fd = 3 2024-09-19T04:55:28.353 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.353 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.353 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.353 INFO:tasks.workunit.client.0.smithi002.stdout:321/600: open fd = 3 2024-09-19T04:55:28.353 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.353 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.354 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.354 INFO:tasks.workunit.client.0.smithi002.stdout:322/600: open fd = 3 2024-09-19T04:55:28.354 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.354 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.354 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.354 INFO:tasks.workunit.client.0.smithi002.stdout:323/600: open fd = 3 2024-09-19T04:55:28.354 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.354 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.354 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.355 INFO:tasks.workunit.client.0.smithi002.stdout:324/600: open fd = 3 2024-09-19T04:55:28.355 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.355 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.355 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.355 INFO:tasks.workunit.client.0.smithi002.stdout:325/600: open fd = 3 2024-09-19T04:55:28.355 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.355 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.355 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.355 INFO:tasks.workunit.client.0.smithi002.stdout:326/600: open fd = 3 2024-09-19T04:55:28.355 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.355 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.355 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.355 INFO:tasks.workunit.client.0.smithi002.stdout:327/600: open fd = 3 2024-09-19T04:55:28.355 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.356 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.356 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.356 INFO:tasks.workunit.client.0.smithi002.stdout:328/600: open fd = 3 2024-09-19T04:55:28.356 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.356 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.356 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.356 INFO:tasks.workunit.client.0.smithi002.stdout:329/600: open fd = 3 2024-09-19T04:55:28.356 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.356 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.356 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.356 INFO:tasks.workunit.client.0.smithi002.stdout:330/600: open fd = 3 2024-09-19T04:55:28.356 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.356 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.357 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.357 INFO:tasks.workunit.client.0.smithi002.stdout:331/600: open fd = 3 2024-09-19T04:55:28.357 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.357 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.357 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.357 INFO:tasks.workunit.client.0.smithi002.stdout:332/600: open fd = 3 2024-09-19T04:55:28.357 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.357 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.357 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.357 INFO:tasks.workunit.client.0.smithi002.stdout:333/600: open fd = 3 2024-09-19T04:55:28.357 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.357 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.357 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.357 INFO:tasks.workunit.client.0.smithi002.stdout:334/600: open fd = 3 2024-09-19T04:55:28.358 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.358 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.358 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.358 INFO:tasks.workunit.client.0.smithi002.stdout:335/600: open fd = 3 2024-09-19T04:55:28.358 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.358 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.358 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.358 INFO:tasks.workunit.client.0.smithi002.stdout:336/600: open fd = 3 2024-09-19T04:55:28.358 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.358 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.358 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.358 INFO:tasks.workunit.client.0.smithi002.stdout:337/600: open fd = 3 2024-09-19T04:55:28.358 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.358 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.359 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.359 INFO:tasks.workunit.client.0.smithi002.stdout:338/600: open fd = 3 2024-09-19T04:55:28.359 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.359 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.359 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.359 INFO:tasks.workunit.client.0.smithi002.stdout:339/600: open fd = 3 2024-09-19T04:55:28.359 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.359 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.359 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.359 INFO:tasks.workunit.client.0.smithi002.stdout:340/600: open fd = 3 2024-09-19T04:55:28.359 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.359 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.359 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.359 INFO:tasks.workunit.client.0.smithi002.stdout:341/600: open fd = 3 2024-09-19T04:55:28.360 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.360 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.360 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.360 INFO:tasks.workunit.client.0.smithi002.stdout:342/600: open fd = 3 2024-09-19T04:55:28.360 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.360 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.360 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.360 INFO:tasks.workunit.client.0.smithi002.stdout:343/600: open fd = 3 2024-09-19T04:55:28.360 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.360 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.360 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.360 INFO:tasks.workunit.client.0.smithi002.stdout:344/600: open fd = 3 2024-09-19T04:55:28.360 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.361 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.361 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.361 INFO:tasks.workunit.client.0.smithi002.stdout:345/600: open fd = 3 2024-09-19T04:55:28.361 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.361 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.361 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.361 INFO:tasks.workunit.client.0.smithi002.stdout:346/600: open fd = 3 2024-09-19T04:55:28.361 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.361 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.361 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.361 INFO:tasks.workunit.client.0.smithi002.stdout:347/600: open fd = 3 2024-09-19T04:55:28.361 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.361 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.361 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.362 INFO:tasks.workunit.client.0.smithi002.stdout:348/600: open fd = 3 2024-09-19T04:55:28.362 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.362 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.362 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.362 INFO:tasks.workunit.client.0.smithi002.stdout:349/600: open fd = 3 2024-09-19T04:55:28.362 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.362 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.362 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.362 INFO:tasks.workunit.client.0.smithi002.stdout:350/600: open fd = 3 2024-09-19T04:55:28.362 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.362 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.362 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.362 INFO:tasks.workunit.client.0.smithi002.stdout:351/600: open fd = 3 2024-09-19T04:55:28.362 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.362 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.363 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.363 INFO:tasks.workunit.client.0.smithi002.stdout:352/600: open fd = 3 2024-09-19T04:55:28.363 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.363 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.363 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.363 INFO:tasks.workunit.client.0.smithi002.stdout:353/600: open fd = 3 2024-09-19T04:55:28.363 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.363 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.363 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.363 INFO:tasks.workunit.client.0.smithi002.stdout:354/600: open fd = 3 2024-09-19T04:55:28.363 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.363 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.363 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.363 INFO:tasks.workunit.client.0.smithi002.stdout:355/600: open fd = 3 2024-09-19T04:55:28.364 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.364 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.364 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.364 INFO:tasks.workunit.client.0.smithi002.stdout:356/600: open fd = 3 2024-09-19T04:55:28.364 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.364 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.364 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.364 INFO:tasks.workunit.client.0.smithi002.stdout:357/600: open fd = 3 2024-09-19T04:55:28.364 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.364 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.364 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.364 INFO:tasks.workunit.client.0.smithi002.stdout:358/600: open fd = 3 2024-09-19T04:55:28.364 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.365 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.365 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.365 INFO:tasks.workunit.client.0.smithi002.stdout:359/600: open fd = 3 2024-09-19T04:55:28.365 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.365 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.365 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.365 INFO:tasks.workunit.client.0.smithi002.stdout:360/600: open fd = 3 2024-09-19T04:55:28.365 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.365 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.365 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.365 INFO:tasks.workunit.client.0.smithi002.stdout:361/600: open fd = 3 2024-09-19T04:55:28.365 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.365 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.365 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.366 INFO:tasks.workunit.client.0.smithi002.stdout:362/600: open fd = 3 2024-09-19T04:55:28.366 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.366 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.366 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.366 INFO:tasks.workunit.client.0.smithi002.stdout:363/600: open fd = 3 2024-09-19T04:55:28.366 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.366 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.366 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.366 INFO:tasks.workunit.client.0.smithi002.stdout:364/600: open fd = 3 2024-09-19T04:55:28.366 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.366 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.366 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.366 INFO:tasks.workunit.client.0.smithi002.stdout:365/600: open fd = 3 2024-09-19T04:55:28.366 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.367 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.367 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.367 INFO:tasks.workunit.client.0.smithi002.stdout:366/600: open fd = 3 2024-09-19T04:55:28.367 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.367 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.367 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.367 INFO:tasks.workunit.client.0.smithi002.stdout:367/600: open fd = 3 2024-09-19T04:55:28.367 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.367 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.367 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.367 INFO:tasks.workunit.client.0.smithi002.stdout:368/600: open fd = 3 2024-09-19T04:55:28.367 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.367 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.367 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.368 INFO:tasks.workunit.client.0.smithi002.stdout:369/600: open fd = 3 2024-09-19T04:55:28.368 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.368 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.368 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.368 INFO:tasks.workunit.client.0.smithi002.stdout:370/600: open fd = 3 2024-09-19T04:55:28.368 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.368 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.368 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.368 INFO:tasks.workunit.client.0.smithi002.stdout:371/600: open fd = 3 2024-09-19T04:55:28.368 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.368 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.368 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.368 INFO:tasks.workunit.client.0.smithi002.stdout:372/600: open fd = 3 2024-09-19T04:55:28.369 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.369 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.369 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.369 INFO:tasks.workunit.client.0.smithi002.stdout:373/600: open fd = 3 2024-09-19T04:55:28.369 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.369 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.369 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.369 INFO:tasks.workunit.client.0.smithi002.stdout:374/600: open fd = 3 2024-09-19T04:55:28.369 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.369 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:55:28.369 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:55:28.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:28 smithi002 ceph-mon[30975]: pgmap v229: 97 pgs: 97 active+clean; 11 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 40 KiB/s wr, 7 op/s 2024-09-19T04:55:28.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:28 smithi116 ceph-mon[34477]: pgmap v229: 97 pgs: 97 active+clean; 11 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 40 KiB/s wr, 7 op/s 2024-09-19T04:55:28.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:28 smithi018 ceph-mon[34537]: pgmap v229: 97 pgs: 97 active+clean; 11 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 40 KiB/s wr, 7 op/s 2024-09-19T04:55:30.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:30 smithi002 ceph-mon[30975]: pgmap v230: 97 pgs: 97 active+clean; 11 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 40 KiB/s wr, 7 op/s 2024-09-19T04:55:30.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:30 smithi116 ceph-mon[34477]: pgmap v230: 97 pgs: 97 active+clean; 11 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 40 KiB/s wr, 7 op/s 2024-09-19T04:55:30.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:30 smithi018 ceph-mon[34537]: pgmap v230: 97 pgs: 97 active+clean; 11 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 40 KiB/s wr, 7 op/s 2024-09-19T04:55:32.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:32 smithi002 ceph-mon[30975]: pgmap v231: 97 pgs: 97 active+clean; 12 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 58 KiB/s wr, 10 op/s 2024-09-19T04:55:32.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:32 smithi116 ceph-mon[34477]: pgmap v231: 97 pgs: 97 active+clean; 12 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 58 KiB/s wr, 10 op/s 2024-09-19T04:55:32.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:32 smithi018 ceph-mon[34537]: pgmap v231: 97 pgs: 97 active+clean; 12 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 58 KiB/s wr, 10 op/s 2024-09-19T04:55:33.048 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:55:33.322 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:55:33.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.789+0000 7f896c7e3640 1 -- 172.21.15.2:0/2014876079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8964101de0 msgr2=0x7f89641021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:33.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.789+0000 7f896c7e3640 1 --2- 172.21.15.2:0/2014876079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8964101de0 0x7f89641021c0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f8960009900 tx=0x7f896002a400 comp rx=0 tx=0).stop 2024-09-19T04:55:33.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.789+0000 7f896c7e3640 1 -- 172.21.15.2:0/2014876079 shutdown_connections 2024-09-19T04:55:33.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.789+0000 7f896c7e3640 1 --2- 172.21.15.2:0/2014876079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8964106f10 0x7f896410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:33.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.789+0000 7f896c7e3640 1 --2- 172.21.15.2:0/2014876079 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8964102790 0x7f89641067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:33.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.789+0000 7f896c7e3640 1 --2- 172.21.15.2:0/2014876079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8964101de0 0x7f89641021c0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:33.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.789+0000 7f896c7e3640 1 -- 172.21.15.2:0/2014876079 >> 172.21.15.2:0/2014876079 conn(0x7f89640fd8c0 msgr2=0x7f89640ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:33.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.789+0000 7f896c7e3640 1 -- 172.21.15.2:0/2014876079 shutdown_connections 2024-09-19T04:55:33.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.789+0000 7f896c7e3640 1 -- 172.21.15.2:0/2014876079 wait complete. 2024-09-19T04:55:33.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.790+0000 7f896c7e3640 1 Processor -- start 2024-09-19T04:55:33.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.790+0000 7f896c7e3640 1 -- start start 2024-09-19T04:55:33.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.790+0000 7f896c7e3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8964101de0 0x7f89641983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:33.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.790+0000 7f896c7e3640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8964102790 0x7f8964198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:33.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.790+0000 7f896c7e3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8964106f10 0x7f896419ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:33.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.790+0000 7f896c7e3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8964111e40 con 0x7f8964106f10 2024-09-19T04:55:33.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.790+0000 7f896c7e3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8964111cc0 con 0x7f8964101de0 2024-09-19T04:55:33.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.790+0000 7f896c7e3640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f8964111fc0 con 0x7f8964102790 2024-09-19T04:55:33.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.790+0000 7f896ad80640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8964106f10 0x7f896419ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:33.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.790+0000 7f896ad80640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8964106f10 0x7f896419ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43222/0 (socket says 172.21.15.2:43222) 2024-09-19T04:55:33.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.790+0000 7f896ad80640 1 -- 172.21.15.2:0/3181324737 learned_addr learned my addr 172.21.15.2:0/3181324737 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:55:33.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.790+0000 7f896a57f640 1 --2- 172.21.15.2:0/3181324737 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8964101de0 0x7f89641983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:33.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.790+0000 7f8969d7e640 1 --2- 172.21.15.2:0/3181324737 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8964102790 0x7f8964198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:33.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.791+0000 7f896ad80640 1 -- 172.21.15.2:0/3181324737 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8964102790 msgr2=0x7f8964198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:33.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.791+0000 7f896ad80640 1 --2- 172.21.15.2:0/3181324737 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8964102790 0x7f8964198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:33.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.791+0000 7f896ad80640 1 -- 172.21.15.2:0/3181324737 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8964101de0 msgr2=0x7f89641983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:33.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.791+0000 7f896ad80640 1 --2- 172.21.15.2:0/3181324737 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8964101de0 0x7f89641983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:33.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.791+0000 7f896ad80640 1 -- 172.21.15.2:0/3181324737 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f896419d3a0 con 0x7f8964106f10 2024-09-19T04:55:33.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.791+0000 7f896ad80640 1 --2- 172.21.15.2:0/3181324737 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8964106f10 0x7f896419ccc0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f895c00eaa0 tx=0x7f895c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:33.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.791+0000 7f895b7fe640 1 -- 172.21.15.2:0/3181324737 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f895c004d20 con 0x7f8964106f10 2024-09-19T04:55:33.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.791+0000 7f895b7fe640 1 -- 172.21.15.2:0/3181324737 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f895c005020 con 0x7f8964106f10 2024-09-19T04:55:33.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.791+0000 7f896c7e3640 1 -- 172.21.15.2:0/3181324737 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f896419d690 con 0x7f8964106f10 2024-09-19T04:55:33.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.791+0000 7f895b7fe640 1 -- 172.21.15.2:0/3181324737 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f895c0116b0 con 0x7f8964106f10 2024-09-19T04:55:33.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.791+0000 7f896c7e3640 1 -- 172.21.15.2:0/3181324737 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89641a4f70 con 0x7f8964106f10 2024-09-19T04:55:33.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.794+0000 7f895b7fe640 1 -- 172.21.15.2:0/3181324737 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f895c0051d0 con 0x7f8964106f10 2024-09-19T04:55:33.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.794+0000 7f896ebbc740 1 Processor -- start 2024-09-19T04:55:33.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.795+0000 7f896ebbc740 1 -- start start 2024-09-19T04:55:33.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.795+0000 7f896ebbc740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a2016ce360 0x55a2016ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:33.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.795+0000 7f896ebbc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a2016cec80 0x55a2016dd550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:33.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.795+0000 7f896ebbc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2016dda90 0x55a2016dfe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:33.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.795+0000 7f896ebbc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a2016342e0 con 0x55a2016dda90 2024-09-19T04:55:33.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.795+0000 7f896ebbc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a2015dbce0 con 0x55a2016cec80 2024-09-19T04:55:33.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.795+0000 7f896ebbc740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55a2016302a0 con 0x55a2016ce360 2024-09-19T04:55:33.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.795+0000 7f8969d7e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2016dda90 0x55a2016dfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:33.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.795+0000 7f8969d7e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2016dda90 0x55a2016dfe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43226/0 (socket says 172.21.15.2:43226) 2024-09-19T04:55:33.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.795+0000 7f8969d7e640 1 -- 172.21.15.2:0/3887608652 learned_addr learned my addr 172.21.15.2:0/3887608652 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:55:33.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.795+0000 7f8969d7e640 1 --2- 172.21.15.2:0/3887608652 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a2016ce360 0x55a2016ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:33.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.795+0000 7f896a57f640 1 --2- 172.21.15.2:0/3887608652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a2016cec80 0x55a2016dd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:33.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.795+0000 7f8969d7e640 1 -- 172.21.15.2:0/3887608652 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a2016ce360 msgr2=0x55a2016ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:33.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.795+0000 7f8969d7e640 1 --2- 172.21.15.2:0/3887608652 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a2016ce360 0x55a2016ce740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:33.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.795+0000 7f8969d7e640 1 -- 172.21.15.2:0/3887608652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a2016cec80 msgr2=0x55a2016dd550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:33.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.795+0000 7f8969d7e640 1 --2- 172.21.15.2:0/3887608652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a2016cec80 0x55a2016dd550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:33.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.795+0000 7f8969d7e640 1 -- 172.21.15.2:0/3887608652 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2015c0440 con 0x55a2016dda90 2024-09-19T04:55:33.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.795+0000 7f895b7fe640 1 --2- 172.21.15.2:0/3181324737 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f89500a33b0 0x7f89500a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:33.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.796+0000 7f8969d7e640 1 --2- 172.21.15.2:0/3887608652 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2016dda90 0x55a2016dfe80 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f8954009f60 tx=0x7f89540094b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d500ce297bbe3f79 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:33.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.796+0000 7f896a57f640 1 --2- 172.21.15.2:0/3181324737 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f89500a33b0 0x7f89500a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:33.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.796+0000 7f895b7fe640 1 -- 172.21.15.2:0/3181324737 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f895c0cfeb0 con 0x7f8964106f10 2024-09-19T04:55:33.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.796+0000 7f8958ff9640 1 -- 172.21.15.2:0/3887608652 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8954017610 con 0x55a2016dda90 2024-09-19T04:55:33.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.796+0000 7f8958ff9640 1 -- 172.21.15.2:0/3887608652 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f895401c070 con 0x55a2016dda90 2024-09-19T04:55:33.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.796+0000 7f8958ff9640 1 -- 172.21.15.2:0/3887608652 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8954015a50 con 0x55a2016dda90 2024-09-19T04:55:33.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.797+0000 7f896ebbc740 1 -- 172.21.15.2:0/3887608652 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2016dda90 msgr2=0x55a2016dfe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:33.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.797+0000 7f896ebbc740 1 --2- 172.21.15.2:0/3887608652 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2016dda90 0x55a2016dfe80 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f8954009f60 tx=0x7f89540094b0 comp rx=0 tx=0).stop 2024-09-19T04:55:33.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.797+0000 7f896a57f640 1 --2- 172.21.15.2:0/3181324737 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f89500a33b0 0x7f89500a5870 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8960031440 tx=0x7f8960005e60 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:33.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.797+0000 7f896ebbc740 1 -- 172.21.15.2:0/3887608652 shutdown_connections 2024-09-19T04:55:33.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.797+0000 7f896ebbc740 1 --2- 172.21.15.2:0/3887608652 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2016dda90 0x55a2016dfe80 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:33.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.797+0000 7f896ebbc740 1 --2- 172.21.15.2:0/3887608652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a2016cec80 0x55a2016dd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:33.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.797+0000 7f896ebbc740 1 --2- 172.21.15.2:0/3887608652 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a2016ce360 0x55a2016ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:33.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.797+0000 7f896ebbc740 1 -- 172.21.15.2:0/3887608652 >> 172.21.15.2:0/3887608652 conn(0x55a2016caa30 msgr2=0x55a2016cae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:33.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.797+0000 7f896ebbc740 1 -- 172.21.15.2:0/3887608652 shutdown_connections 2024-09-19T04:55:33.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.797+0000 7f896ebbc740 1 -- 172.21.15.2:0/3887608652 wait complete. 2024-09-19T04:55:33.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.797+0000 7f896ebbc740 1 -- start start 2024-09-19T04:55:33.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.797+0000 7f896ebbc740 1 Processor -- start 2024-09-19T04:55:33.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.797+0000 7f896ebbc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2016ce360 0x55a2016dd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:33.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.797+0000 7f896ebbc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a2016cec80 0x55a2016da740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:33.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.798+0000 7f896ebbc740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a2016dda90 0x55a2016dad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:33.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.798+0000 7f896ebbc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a2016e0660 con 0x55a2016ce360 2024-09-19T04:55:33.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.798+0000 7f896ebbc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a2015ef050 con 0x55a2016cec80 2024-09-19T04:55:33.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.798+0000 7f896ebbc740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55a2016e07e0 con 0x55a2016dda90 2024-09-19T04:55:33.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.798+0000 7f896a57f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2016ce360 0x55a2016dd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:33.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.798+0000 7f896a57f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2016ce360 0x55a2016dd490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43238/0 (socket says 172.21.15.2:43238) 2024-09-19T04:55:33.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.798+0000 7f896ebbc740 10 client.0 _ll_register_callbacks cb 0x55a20162f160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:55:33.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.798+0000 7f896a57f640 1 -- 172.21.15.2:0/2233893067 learned_addr learned my addr 172.21.15.2:0/2233893067 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:55:33.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.798+0000 7f8969d7e640 1 --2- 172.21.15.2:0/2233893067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a2016cec80 0x55a2016da740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:33.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.798+0000 7f896ad80640 1 --2- 172.21.15.2:0/2233893067 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a2016dda90 0x55a2016dad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:33.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.798+0000 7f896a57f640 1 -- 172.21.15.2:0/2233893067 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a2016dda90 msgr2=0x55a2016dad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:33.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.798+0000 7f896a57f640 1 --2- 172.21.15.2:0/2233893067 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a2016dda90 0x55a2016dad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:33.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.798+0000 7f896a57f640 1 -- 172.21.15.2:0/2233893067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a2016cec80 msgr2=0x55a2016da740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:33.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.798+0000 7f896a57f640 1 --2- 172.21.15.2:0/2233893067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a2016cec80 0x55a2016da740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:33.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.798+0000 7f896a57f640 1 -- 172.21.15.2:0/2233893067 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2013a53c0 con 0x55a2016ce360 2024-09-19T04:55:33.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.798+0000 7f896a57f640 1 --2- 172.21.15.2:0/2233893067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2016ce360 0x55a2016dd490 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f8960032fd0 tx=0x7f8960009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f9f8c1148cbd3a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:33.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.798+0000 7f894dffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:55:33.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.798+0000 7f894dffb640 1 -- 172.21.15.2:0/2233893067 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896004d070 con 0x55a2016ce360 2024-09-19T04:55:33.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.798+0000 7f894dffb640 1 -- 172.21.15.2:0/2233893067 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f8960005440 con 0x55a2016ce360 2024-09-19T04:55:33.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.798+0000 7f896ebbc740 1 -- 172.21.15.2:0/2233893067 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f895401c070 con 0x55a2016ce360 2024-09-19T04:55:33.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.799+0000 7f894dffb640 1 -- 172.21.15.2:0/2233893067 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f8960059050 con 0x55a2016ce360 2024-09-19T04:55:33.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.799+0000 7f896ebbc740 10 client.16254 fetch_fsmap learned FSMap version 19 2024-09-19T04:55:33.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.799+0000 7f896ebbc740 1 -- 172.21.15.2:0/2233893067 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55a2016ec100 con 0x55a2016ce360 2024-09-19T04:55:33.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.799+0000 7f894dffb640 1 -- 172.21.15.2:0/2233893067 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f895401c070 con 0x55a2016ce360 2024-09-19T04:55:33.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.799+0000 7f894dffb640 1 -- 172.21.15.2:0/2233893067 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f8960003890 con 0x55a2016ce360 2024-09-19T04:55:33.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.799+0000 7f896ebbc740 10 client.16254 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:55:33.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.799+0000 7f896ebbc740 10 client.16254 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:55:33.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.799+0000 7f896ebbc740 20 client.16254 populate_metadata read hostname 'smithi002' 2024-09-19T04:55:33.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.799+0000 7f896ebbc740 1 --2- 172.21.15.2:0/2233893067 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55a2016ed510 0x55a2016ef920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:33.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.799+0000 7f896ebbc740 4 client.16254 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:55:33.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.799+0000 7f896ebbc740 1 -- 172.21.15.2:0/2233893067 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a201641850 con 0x55a2016ed510 2024-09-19T04:55:33.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.799+0000 7f8969d7e640 1 --2- 172.21.15.2:0/2233893067 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55a2016ed510 0x55a2016ef920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:33.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.800+0000 7f894dffb640 10 client.16254 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:55:33.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.800+0000 7f8969d7e640 1 --2- 172.21.15.2:0/2233893067 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55a2016ed510 0x55a2016ef920 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31ef4288de360d1f server_cookie=46088109987e77ae in_seq=0 out_seq=0 2024-09-19T04:55:33.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.800+0000 7f894dffb640 1 -- 172.21.15.2:0/2233893067 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a201641850 con 0x55a2016ed510 2024-09-19T04:55:33.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.800+0000 7f894dffb640 10 client.16254 handle_command_reply: tid=0 2024-09-19T04:55:33.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.800+0000 7f896ebbc740 1 client.16254 shutdown 2024-09-19T04:55:33.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.801+0000 7f896ebbc740 1 -- 172.21.15.2:0/2233893067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2016ce360 msgr2=0x55a2016dd490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:33.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.801+0000 7f896ebbc740 1 --2- 172.21.15.2:0/2233893067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2016ce360 0x55a2016dd490 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f8960032fd0 tx=0x7f8960009260 comp rx=0 tx=0).stop 2024-09-19T04:55:33.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.801+0000 7f896ebbc740 1 -- 172.21.15.2:0/2233893067 shutdown_connections 2024-09-19T04:55:33.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.801+0000 7f896ebbc740 1 --2- 172.21.15.2:0/2233893067 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55a2016ed510 0x55a2016ef920 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:33.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.801+0000 7f896ebbc740 1 --2- 172.21.15.2:0/2233893067 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a2016dda90 0x55a2016dad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:33.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.801+0000 7f896ebbc740 1 --2- 172.21.15.2:0/2233893067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a2016cec80 0x55a2016da740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:33.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.801+0000 7f896ebbc740 1 --2- 172.21.15.2:0/2233893067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2016ce360 0x55a2016dd490 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:33.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.801+0000 7f896ebbc740 1 -- 172.21.15.2:0/2233893067 >> 172.21.15.2:0/2233893067 conn(0x55a2016caa30 msgr2=0x55a2016d0790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:33.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.801+0000 7f894dffb640 0 client.16254 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:55:33.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.801+0000 7f896ebbc740 1 -- 172.21.15.2:0/2233893067 shutdown_connections 2024-09-19T04:55:33.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.801+0000 7f896ebbc740 1 -- 172.21.15.2:0/2233893067 wait complete. 2024-09-19T04:55:33.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.801+0000 7f896ebbc740 20 client.16254 trim_cache size 0 max 16384 2024-09-19T04:55:33.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.818+0000 7f896ebbc740 1 Processor -- start 2024-09-19T04:55:33.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.818+0000 7f896ebbc740 1 -- start start 2024-09-19T04:55:33.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.818+0000 7f896ebbc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2016cec80 0x55a2016e9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:33.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.818+0000 7f896ebbc740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a2016dda90 0x55a2016f5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:33.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.818+0000 7f896ebbc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a2016f5780 0x55a2016d79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:33.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.818+0000 7f896ebbc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f89641a9600 con 0x55a2016cec80 2024-09-19T04:55:33.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.818+0000 7f896ebbc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f89641abe60 con 0x55a2016f5780 2024-09-19T04:55:33.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.818+0000 7f896ebbc740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f89641a9c50 con 0x55a2016dda90 2024-09-19T04:55:33.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.818+0000 7f896a57f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2016cec80 0x55a2016e9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:33.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.818+0000 7f896a57f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2016cec80 0x55a2016e9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43250/0 (socket says 172.21.15.2:43250) 2024-09-19T04:55:33.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.819+0000 7f896a57f640 1 -- 172.21.15.2:0/704648247 learned_addr learned my addr 172.21.15.2:0/704648247 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:55:33.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.819+0000 7f896ad80640 1 --2- 172.21.15.2:0/704648247 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a2016f5780 0x55a2016d79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:33.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.819+0000 7f8969d7e640 1 --2- 172.21.15.2:0/704648247 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a2016dda90 0x55a2016f5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:33.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.819+0000 7f896a57f640 1 -- 172.21.15.2:0/704648247 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a2016dda90 msgr2=0x55a2016f5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:33.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.819+0000 7f896a57f640 1 --2- 172.21.15.2:0/704648247 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a2016dda90 0x55a2016f5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:33.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.819+0000 7f896a57f640 1 -- 172.21.15.2:0/704648247 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a2016f5780 msgr2=0x55a2016d79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:33.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.819+0000 7f896a57f640 1 --2- 172.21.15.2:0/704648247 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a2016f5780 0x55a2016d79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:33.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.819+0000 7f896a57f640 1 -- 172.21.15.2:0/704648247 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2016d8c90 con 0x55a2016cec80 2024-09-19T04:55:33.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.819+0000 7f896ad80640 1 --2- 172.21.15.2:0/704648247 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a2016f5780 0x55a2016d79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:55:33.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.819+0000 7f8969d7e640 1 --2- 172.21.15.2:0/704648247 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a2016dda90 0x55a2016f5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:55:33.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.819+0000 7f896a57f640 1 --2- 172.21.15.2:0/704648247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2016cec80 0x55a2016e9900 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f8960033000 tx=0x7f8960004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19455a3acb38a1a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:33.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.819+0000 7f894ffff640 1 -- 172.21.15.2:0/704648247 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8960061070 con 0x55a2016cec80 2024-09-19T04:55:33.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.819+0000 7f894ffff640 1 -- 172.21.15.2:0/704648247 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f89600035f0 con 0x55a2016cec80 2024-09-19T04:55:33.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.819+0000 7f894ffff640 1 -- 172.21.15.2:0/704648247 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896004d070 con 0x55a2016cec80 2024-09-19T04:55:33.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.820+0000 7f896ebbc740 1 -- 172.21.15.2:0/704648247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2016cec80 msgr2=0x55a2016e9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:33.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.820+0000 7f896ebbc740 1 --2- 172.21.15.2:0/704648247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2016cec80 0x55a2016e9900 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f8960033000 tx=0x7f8960004610 comp rx=0 tx=0).stop 2024-09-19T04:55:33.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.820+0000 7f896ebbc740 1 -- 172.21.15.2:0/704648247 shutdown_connections 2024-09-19T04:55:33.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.820+0000 7f896ebbc740 1 --2- 172.21.15.2:0/704648247 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a2016f5780 0x55a2016d79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:33.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.820+0000 7f896ebbc740 1 --2- 172.21.15.2:0/704648247 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a2016dda90 0x55a2016f5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:33.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.820+0000 7f896ebbc740 1 --2- 172.21.15.2:0/704648247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2016cec80 0x55a2016e9900 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:33.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.820+0000 7f896ebbc740 1 -- 172.21.15.2:0/704648247 >> 172.21.15.2:0/704648247 conn(0x55a2016caa30 msgr2=0x55a2016d5d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:33.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.820+0000 7f896ebbc740 1 -- 172.21.15.2:0/704648247 shutdown_connections 2024-09-19T04:55:33.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.820+0000 7f896ebbc740 1 -- 172.21.15.2:0/704648247 wait complete. 2024-09-19T04:55:33.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.820+0000 7f896ebbc740 1 -- start start 2024-09-19T04:55:33.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.820+0000 7f896ebbc740 1 Processor -- start 2024-09-19T04:55:33.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.821+0000 7f896ebbc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a2016cec80 0x55a2016e5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:33.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.821+0000 7f896ebbc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2016dda90 0x55a2016e6190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:33.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.821+0000 7f896ebbc740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a2016f5780 0x55a2016e2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:33.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.821+0000 7f896ebbc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f89641aa320 con 0x55a2016dda90 2024-09-19T04:55:33.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.821+0000 7f896ebbc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f89641ab790 con 0x55a2016cec80 2024-09-19T04:55:33.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.821+0000 7f896ebbc740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f89641aa9f0 con 0x55a2016f5780 2024-09-19T04:55:33.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.821+0000 7f896ebbc740 10 client.0 _ll_register_callbacks cb 0x7f8960032ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:55:33.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.821+0000 7f8969d7e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2016dda90 0x55a2016e6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:33.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.821+0000 7f8969d7e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2016dda90 0x55a2016e6190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43254/0 (socket says 172.21.15.2:43254) 2024-09-19T04:55:33.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.821+0000 7f8969d7e640 1 -- 172.21.15.2:0/4242447959 learned_addr learned my addr 172.21.15.2:0/4242447959 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:55:33.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.821+0000 7f896a57f640 1 --2- 172.21.15.2:0/4242447959 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a2016cec80 0x55a2016e5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:33.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.821+0000 7f8969d7e640 1 -- 172.21.15.2:0/4242447959 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a2016f5780 msgr2=0x55a2016e2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:33.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.821+0000 7f8969d7e640 1 --2- 172.21.15.2:0/4242447959 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a2016f5780 0x55a2016e2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:33.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.821+0000 7f8969d7e640 1 -- 172.21.15.2:0/4242447959 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a2016cec80 msgr2=0x55a2016e5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:33.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.821+0000 7f8969d7e640 1 --2- 172.21.15.2:0/4242447959 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a2016cec80 0x55a2016e5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:33.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.821+0000 7f8969d7e640 1 -- 172.21.15.2:0/4242447959 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2016e3150 con 0x55a2016dda90 2024-09-19T04:55:33.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.821+0000 7f8969d7e640 1 --2- 172.21.15.2:0/4242447959 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2016dda90 0x55a2016e6190 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f8954009d30 tx=0x7f89540153f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b812f98e6b32d8b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:33.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.821+0000 7f894dffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:55:33.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.821+0000 7f894dffb640 1 -- 172.21.15.2:0/4242447959 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8954015ab0 con 0x55a2016dda90 2024-09-19T04:55:33.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.821+0000 7f894dffb640 1 -- 172.21.15.2:0/4242447959 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f8954015c50 con 0x55a2016dda90 2024-09-19T04:55:33.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.821+0000 7f896ebbc740 1 -- 172.21.15.2:0/4242447959 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89600035f0 con 0x55a2016dda90 2024-09-19T04:55:33.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.822+0000 7f894dffb640 1 -- 172.21.15.2:0/4242447959 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f8954015e70 con 0x55a2016dda90 2024-09-19T04:55:33.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.822+0000 7f896ebbc740 10 client.16260 fetch_fsmap learned FSMap version 19 2024-09-19T04:55:33.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.822+0000 7f896ebbc740 1 -- 172.21.15.2:0/4242447959 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55a201758ba0 con 0x55a2016dda90 2024-09-19T04:55:33.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.822+0000 7f894dffb640 1 -- 172.21.15.2:0/4242447959 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f89600035f0 con 0x55a2016dda90 2024-09-19T04:55:33.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.822+0000 7f894dffb640 1 -- 172.21.15.2:0/4242447959 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f8954017410 con 0x55a2016dda90 2024-09-19T04:55:33.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.822+0000 7f896ebbc740 10 client.16260 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:55:33.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.822+0000 7f896ebbc740 10 client.16260 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:55:33.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.822+0000 7f896ebbc740 20 client.16260 populate_metadata read hostname 'smithi002' 2024-09-19T04:55:33.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.822+0000 7f896ebbc740 1 --2- 172.21.15.2:0/4242447959 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55a201758f30 0x55a20175b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:33.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.822+0000 7f896ebbc740 4 client.16260 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:55:33.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.822+0000 7f896ebbc740 1 -- 172.21.15.2:0/4242447959 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a20163bd60 con 0x55a201758f30 2024-09-19T04:55:33.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.822+0000 7f896a57f640 1 --2- 172.21.15.2:0/4242447959 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55a201758f30 0x55a20175b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:33.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.823+0000 7f894dffb640 10 client.16260 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:55:33.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.823+0000 7f896a57f640 1 --2- 172.21.15.2:0/4242447959 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55a201758f30 0x55a20175b350 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31f2afa9a00b3a07 server_cookie=8b13f8896bf68e73 in_seq=0 out_seq=0 2024-09-19T04:55:33.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.823+0000 7f894dffb640 1 -- 172.21.15.2:0/4242447959 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55a20163bd60 con 0x55a201758f30 2024-09-19T04:55:33.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.823+0000 7f894dffb640 10 client.16260 handle_command_reply: tid=0 2024-09-19T04:55:33.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.823+0000 7f896ebbc740 1 client.16260 shutdown 2024-09-19T04:55:33.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.823+0000 7f896ebbc740 1 -- 172.21.15.2:0/4242447959 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2016dda90 msgr2=0x55a2016e6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:33.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.823+0000 7f896ebbc740 1 --2- 172.21.15.2:0/4242447959 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2016dda90 0x55a2016e6190 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f8954009d30 tx=0x7f89540153f0 comp rx=0 tx=0).stop 2024-09-19T04:55:33.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.823+0000 7f896ebbc740 1 -- 172.21.15.2:0/4242447959 shutdown_connections 2024-09-19T04:55:33.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.823+0000 7f896ebbc740 1 --2- 172.21.15.2:0/4242447959 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55a201758f30 0x55a20175b350 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:33.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.823+0000 7f894dffb640 0 client.16260 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:55:33.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.823+0000 7f896ebbc740 1 --2- 172.21.15.2:0/4242447959 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a2016f5780 0x55a2016e2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:33.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.823+0000 7f896ebbc740 1 --2- 172.21.15.2:0/4242447959 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2016dda90 0x55a2016e6190 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:33.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.823+0000 7f896ebbc740 1 --2- 172.21.15.2:0/4242447959 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a2016cec80 0x55a2016e5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:33.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.823+0000 7f896ebbc740 1 -- 172.21.15.2:0/4242447959 >> 172.21.15.2:0/4242447959 conn(0x55a2016caa30 msgr2=0x55a2016c9350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:33.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.823+0000 7f896ebbc740 1 -- 172.21.15.2:0/4242447959 shutdown_connections 2024-09-19T04:55:33.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.823+0000 7f896ebbc740 1 -- 172.21.15.2:0/4242447959 wait complete. 2024-09-19T04:55:33.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.823+0000 7f896ebbc740 20 client.16260 trim_cache size 0 max 16384 2024-09-19T04:55:33.833 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:55:33.833 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T04:55:33.833 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T04:55:33.833 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:55:33.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.824+0000 7f896c7e3640 1 -- 172.21.15.2:0/3181324737 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f89500a33b0 msgr2=0x7f89500a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:33.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.824+0000 7f896c7e3640 1 --2- 172.21.15.2:0/3181324737 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f89500a33b0 0x7f89500a5870 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8960031440 tx=0x7f8960005e60 comp rx=0 tx=0).stop 2024-09-19T04:55:33.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.824+0000 7f896c7e3640 1 -- 172.21.15.2:0/3181324737 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8964106f10 msgr2=0x7f896419ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:33.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.824+0000 7f896c7e3640 1 --2- 172.21.15.2:0/3181324737 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8964106f10 0x7f896419ccc0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f895c00eaa0 tx=0x7f895c00eea0 comp rx=0 tx=0).stop 2024-09-19T04:55:33.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.824+0000 7f896c7e3640 1 -- 172.21.15.2:0/3181324737 shutdown_connections 2024-09-19T04:55:33.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.824+0000 7f896c7e3640 1 --2- 172.21.15.2:0/3181324737 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8964106f10 0x7f896419ccc0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:33.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.824+0000 7f896c7e3640 1 --2- 172.21.15.2:0/3181324737 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f89500a33b0 0x7f89500a5870 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:33.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.824+0000 7f896c7e3640 1 --2- 172.21.15.2:0/3181324737 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8964102790 0x7f8964198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:33.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.824+0000 7f896c7e3640 1 --2- 172.21.15.2:0/3181324737 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8964101de0 0x7f89641983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:33.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.824+0000 7f896c7e3640 1 -- 172.21.15.2:0/3181324737 >> 172.21.15.2:0/3181324737 conn(0x7f89640fd8c0 msgr2=0x7f89640fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:33.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.824+0000 7f896c7e3640 1 -- 172.21.15.2:0/3181324737 shutdown_connections 2024-09-19T04:55:33.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:33.824+0000 7f896c7e3640 1 -- 172.21.15.2:0/3181324737 wait complete. 2024-09-19T04:55:34.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:34 smithi002 ceph-mon[30975]: pgmap v232: 97 pgs: 97 active+clean; 12 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 40 KiB/s wr, 7 op/s 2024-09-19T04:55:34.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:34 smithi116 ceph-mon[34477]: pgmap v232: 97 pgs: 97 active+clean; 12 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 40 KiB/s wr, 7 op/s 2024-09-19T04:55:34.648 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:55:34.649 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:55:34.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:34 smithi018 ceph-mon[34537]: pgmap v232: 97 pgs: 97 active+clean; 12 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 40 KiB/s wr, 7 op/s 2024-09-19T04:55:34.908 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:55:35.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.385+0000 7f09d57d8640 1 -- 172.21.15.2:0/3398513547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09d0102790 msgr2=0x7f09d01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:35.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.385+0000 7f09d57d8640 1 --2- 172.21.15.2:0/3398513547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09d0102790 0x7f09d01067e0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f09b8009900 tx=0x7f09b802a410 comp rx=0 tx=0).stop 2024-09-19T04:55:35.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.385+0000 7f09d57d8640 1 -- 172.21.15.2:0/3398513547 shutdown_connections 2024-09-19T04:55:35.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.385+0000 7f09d57d8640 1 --2- 172.21.15.2:0/3398513547 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f09d0106f10 0x7f09d010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:35.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.385+0000 7f09d57d8640 1 --2- 172.21.15.2:0/3398513547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09d0102790 0x7f09d01067e0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:35.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.385+0000 7f09d57d8640 1 --2- 172.21.15.2:0/3398513547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09d0101de0 0x7f09d01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:35.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.385+0000 7f09d57d8640 1 -- 172.21.15.2:0/3398513547 >> 172.21.15.2:0/3398513547 conn(0x7f09d00fd8c0 msgr2=0x7f09d00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:35.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.385+0000 7f09d57d8640 1 -- 172.21.15.2:0/3398513547 shutdown_connections 2024-09-19T04:55:35.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.385+0000 7f09d57d8640 1 -- 172.21.15.2:0/3398513547 wait complete. 2024-09-19T04:55:35.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.386+0000 7f09d57d8640 1 Processor -- start 2024-09-19T04:55:35.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.386+0000 7f09d57d8640 1 -- start start 2024-09-19T04:55:35.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.386+0000 7f09d57d8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f09d0101de0 0x7f09d0198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:35.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.386+0000 7f09d57d8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09d0102790 0x7f09d01988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:35.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.386+0000 7f09d57d8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09d0106f10 0x7f09d019cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:35.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.386+0000 7f09d57d8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f09d0111e20 con 0x7f09d0106f10 2024-09-19T04:55:35.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.386+0000 7f09d57d8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f09d0111ca0 con 0x7f09d0102790 2024-09-19T04:55:35.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.386+0000 7f09d57d8640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f09d0111fa0 con 0x7f09d0101de0 2024-09-19T04:55:35.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.386+0000 7f09cf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09d0106f10 0x7f09d019cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:35.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.387+0000 7f09cf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09d0106f10 0x7f09d019cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43284/0 (socket says 172.21.15.2:43284) 2024-09-19T04:55:35.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.387+0000 7f09cf7fe640 1 -- 172.21.15.2:0/3479519705 learned_addr learned my addr 172.21.15.2:0/3479519705 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:55:35.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.387+0000 7f09ce7fc640 1 --2- 172.21.15.2:0/3479519705 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09d0102790 0x7f09d01988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:35.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.387+0000 7f09ceffd640 1 --2- 172.21.15.2:0/3479519705 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f09d0101de0 0x7f09d0198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:35.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.387+0000 7f09cf7fe640 1 -- 172.21.15.2:0/3479519705 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f09d0101de0 msgr2=0x7f09d0198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:35.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.387+0000 7f09cf7fe640 1 --2- 172.21.15.2:0/3479519705 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f09d0101de0 0x7f09d0198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:35.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.387+0000 7f09cf7fe640 1 -- 172.21.15.2:0/3479519705 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09d0102790 msgr2=0x7f09d01988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:35.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.387+0000 7f09cf7fe640 1 --2- 172.21.15.2:0/3479519705 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09d0102790 0x7f09d01988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:35.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.387+0000 7f09cf7fe640 1 -- 172.21.15.2:0/3479519705 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09d019d310 con 0x7f09d0106f10 2024-09-19T04:55:35.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.387+0000 7f09ceffd640 1 --2- 172.21.15.2:0/3479519705 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f09d0101de0 0x7f09d0198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:55:35.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.387+0000 7f09ce7fc640 1 --2- 172.21.15.2:0/3479519705 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09d0102790 0x7f09d01988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:55:35.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.387+0000 7f09cf7fe640 1 --2- 172.21.15.2:0/3479519705 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09d0106f10 0x7f09d019cc30 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f09c000eaa0 tx=0x7f09c000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:35.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.387+0000 7f09c7fff640 1 -- 172.21.15.2:0/3479519705 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09c000cdb0 con 0x7f09d0106f10 2024-09-19T04:55:35.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.387+0000 7f09d57d8640 1 -- 172.21.15.2:0/3479519705 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09d019d600 con 0x7f09d0106f10 2024-09-19T04:55:35.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.387+0000 7f09c7fff640 1 -- 172.21.15.2:0/3479519705 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f09c0005020 con 0x7f09d0106f10 2024-09-19T04:55:35.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.387+0000 7f09c7fff640 1 -- 172.21.15.2:0/3479519705 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09c00116d0 con 0x7f09d0106f10 2024-09-19T04:55:35.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.387+0000 7f09d57d8640 1 -- 172.21.15.2:0/3479519705 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09d01a4ee0 con 0x7f09d0106f10 2024-09-19T04:55:35.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.388+0000 7f09d57d8640 1 -- 172.21.15.2:0/3479519705 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09d01021c0 con 0x7f09d0106f10 2024-09-19T04:55:35.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.390+0000 7f09c7fff640 1 -- 172.21.15.2:0/3479519705 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f09c00051d0 con 0x7f09d0106f10 2024-09-19T04:55:35.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.390+0000 7f09c7fff640 1 --2- 172.21.15.2:0/3479519705 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f09bc0a3430 0x7f09bc0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:35.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.391+0000 7f09ceffd640 1 --2- 172.21.15.2:0/3479519705 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f09bc0a3430 0x7f09bc0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:35.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.391+0000 7f09c7fff640 1 -- 172.21.15.2:0/3479519705 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f09c00d0230 con 0x7f09d0106f10 2024-09-19T04:55:35.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.391+0000 7f09ceffd640 1 --2- 172.21.15.2:0/3479519705 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f09bc0a3430 0x7f09bc0a58f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f09c8009c20 tx=0x7f09c8005f90 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:35.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.394+0000 7f09c7fff640 1 -- 172.21.15.2:0/3479519705 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f09c0016030 con 0x7f09d0106f10 2024-09-19T04:55:35.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.607+0000 7f09d57d8640 1 -- 172.21.15.2:0/3479519705 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f09d01996c0 con 0x7f09d0106f10 2024-09-19T04:55:35.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.608+0000 7f09c7fff640 1 -- 172.21.15.2:0/3479519705 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11840 (secure 0 0 0) 0x7f09d01996c0 con 0x7f09d0106f10 2024-09-19T04:55:35.610 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:55:35.610 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":19,"btime":"2024-09-19T04:46:33:537239+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2467365137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2467365137},{"type":"v1","addr":"172.21.15.2:6835","nonce":2467365137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3162441888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3162441888},{"type":"v1","addr":"172.21.15.2:6837","nonce":3162441888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14631,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2740862966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2740862966},{"type":"v1","addr":"172.21.15.2:6839","nonce":2740862966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/2394435504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2394435504},{"type":"v1","addr":"172.21.15.2:6841","nonce":2394435504}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1630480244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1630480244},{"type":"v1","addr":"172.21.15.18:6833","nonce":1630480244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1553897465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1553897465},{"type":"v1","addr":"172.21.15.116:6833","nonce":1553897465}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3035664608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3035664608},{"type":"v1","addr":"172.21.15.18:6835","nonce":3035664608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1096622392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1096622392},{"type":"v1","addr":"172.21.15.18:6837","nonce":1096622392}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3761157675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3761157675},{"type":"v1","addr":"172.21.15.116:6835","nonce":3761157675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/1120131594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1120131594},{"type":"v1","addr":"172.21.15.116:6837","nonce":1120131594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:46:24.050115+0000","modified":"2024-09-19T04:46:33.112369+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/4207677139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":4207677139},{"type":"v1","addr":"172.21.15.18:6839","nonce":4207677139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/2346874880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":2346874880},{"type":"v1","addr":"172.21.15.116:6839","nonce":2346874880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496]},"id":1}]} 2024-09-19T04:55:35.610 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 19 2024-09-19T04:55:35.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.611+0000 7f09d57d8640 1 -- 172.21.15.2:0/3479519705 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f09bc0a3430 msgr2=0x7f09bc0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:35.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.611+0000 7f09d57d8640 1 --2- 172.21.15.2:0/3479519705 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f09bc0a3430 0x7f09bc0a58f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f09c8009c20 tx=0x7f09c8005f90 comp rx=0 tx=0).stop 2024-09-19T04:55:35.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.611+0000 7f09d57d8640 1 -- 172.21.15.2:0/3479519705 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09d0106f10 msgr2=0x7f09d019cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:35.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.611+0000 7f09d57d8640 1 --2- 172.21.15.2:0/3479519705 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09d0106f10 0x7f09d019cc30 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f09c000eaa0 tx=0x7f09c000ef60 comp rx=0 tx=0).stop 2024-09-19T04:55:35.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.611+0000 7f09d57d8640 1 -- 172.21.15.2:0/3479519705 shutdown_connections 2024-09-19T04:55:35.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.611+0000 7f09d57d8640 1 --2- 172.21.15.2:0/3479519705 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09d0106f10 0x7f09d019cc30 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:35.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.611+0000 7f09d57d8640 1 --2- 172.21.15.2:0/3479519705 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09d0102790 0x7f09d01988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:35.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.611+0000 7f09d57d8640 1 --2- 172.21.15.2:0/3479519705 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f09bc0a3430 0x7f09bc0a58f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:35.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.611+0000 7f09d57d8640 1 --2- 172.21.15.2:0/3479519705 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f09d0101de0 0x7f09d0198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:35.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.611+0000 7f09d57d8640 1 -- 172.21.15.2:0/3479519705 >> 172.21.15.2:0/3479519705 conn(0x7f09d00fd8c0 msgr2=0x7f09d00fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:35.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.611+0000 7f09d57d8640 1 -- 172.21.15.2:0/3479519705 shutdown_connections 2024-09-19T04:55:35.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:35.611+0000 7f09d57d8640 1 -- 172.21.15.2:0/3479519705 wait complete. 2024-09-19T04:55:36.294 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:55:36.556 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:55:36.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:36 smithi002 ceph-mon[30975]: pgmap v233: 97 pgs: 97 active+clean; 12 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 64 KiB/s wr, 11 op/s 2024-09-19T04:55:36.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:36 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/3479519705' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:55:36.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:36 smithi116 ceph-mon[34477]: pgmap v233: 97 pgs: 97 active+clean; 12 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 64 KiB/s wr, 11 op/s 2024-09-19T04:55:36.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:36 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/3479519705' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:55:36.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:36 smithi018 ceph-mon[34537]: pgmap v233: 97 pgs: 97 active+clean; 12 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 64 KiB/s wr, 11 op/s 2024-09-19T04:55:36.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:36 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/3479519705' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:55:37.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.038+0000 7f4719806640 1 -- 172.21.15.2:0/1394436616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4714101de0 msgr2=0x7f47141021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:37.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.038+0000 7f4719806640 1 --2- 172.21.15.2:0/1394436616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4714101de0 0x7f47141021c0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f4704009900 tx=0x7f470402a410 comp rx=0 tx=0).stop 2024-09-19T04:55:37.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.038+0000 7f4719806640 1 -- 172.21.15.2:0/1394436616 shutdown_connections 2024-09-19T04:55:37.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.038+0000 7f4719806640 1 --2- 172.21.15.2:0/1394436616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4714106f10 0x7f471410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:37.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.038+0000 7f4719806640 1 --2- 172.21.15.2:0/1394436616 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4714102790 0x7f47141067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:37.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.038+0000 7f4719806640 1 --2- 172.21.15.2:0/1394436616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4714101de0 0x7f47141021c0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:37.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.038+0000 7f4719806640 1 -- 172.21.15.2:0/1394436616 >> 172.21.15.2:0/1394436616 conn(0x7f47140fd8c0 msgr2=0x7f47140ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:37.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.038+0000 7f4719806640 1 -- 172.21.15.2:0/1394436616 shutdown_connections 2024-09-19T04:55:37.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.038+0000 7f4719806640 1 -- 172.21.15.2:0/1394436616 wait complete. 2024-09-19T04:55:37.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.038+0000 7f4719806640 1 Processor -- start 2024-09-19T04:55:37.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.039+0000 7f4719806640 1 -- start start 2024-09-19T04:55:37.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.039+0000 7f4719806640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4714101de0 0x7f47140744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:37.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.039+0000 7f4719806640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4714102790 0x7f4714074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:37.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.039+0000 7f4719806640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4714106f10 0x7f4714074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:37.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.039+0000 7f4719806640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4714111e70 con 0x7f4714106f10 2024-09-19T04:55:37.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.039+0000 7f4719806640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4714111cf0 con 0x7f4714102790 2024-09-19T04:55:37.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.039+0000 7f4719806640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f4714111ff0 con 0x7f4714101de0 2024-09-19T04:55:37.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.039+0000 7f47137fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4714106f10 0x7f4714074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:37.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.039+0000 7f47137fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4714106f10 0x7f4714074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43304/0 (socket says 172.21.15.2:43304) 2024-09-19T04:55:37.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.039+0000 7f47137fe640 1 -- 172.21.15.2:0/1530691830 learned_addr learned my addr 172.21.15.2:0/1530691830 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:55:37.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.039+0000 7f4712ffd640 1 --2- 172.21.15.2:0/1530691830 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4714101de0 0x7f47140744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:37.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.039+0000 7f47127fc640 1 --2- 172.21.15.2:0/1530691830 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4714102790 0x7f4714074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:37.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.039+0000 7f47137fe640 1 -- 172.21.15.2:0/1530691830 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4714101de0 msgr2=0x7f47140744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:37.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.039+0000 7f47137fe640 1 --2- 172.21.15.2:0/1530691830 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4714101de0 0x7f47140744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:37.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.039+0000 7f47137fe640 1 -- 172.21.15.2:0/1530691830 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4714102790 msgr2=0x7f4714074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:37.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.039+0000 7f47137fe640 1 --2- 172.21.15.2:0/1530691830 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4714102790 0x7f4714074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:37.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.039+0000 7f47137fe640 1 -- 172.21.15.2:0/1530691830 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47141a6850 con 0x7f4714106f10 2024-09-19T04:55:37.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.040+0000 7f47137fe640 1 --2- 172.21.15.2:0/1530691830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4714106f10 0x7f4714074f70 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f470c00eaa0 tx=0x7f470c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:37.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.040+0000 7f4718804640 1 -- 172.21.15.2:0/1530691830 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470c00cdb0 con 0x7f4714106f10 2024-09-19T04:55:37.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.040+0000 7f4718804640 1 -- 172.21.15.2:0/1530691830 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f470c005020 con 0x7f4714106f10 2024-09-19T04:55:37.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.040+0000 7f4719806640 1 -- 172.21.15.2:0/1530691830 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47141a6b40 con 0x7f4714106f10 2024-09-19T04:55:37.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.040+0000 7f4718804640 1 -- 172.21.15.2:0/1530691830 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470c0116d0 con 0x7f4714106f10 2024-09-19T04:55:37.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.040+0000 7f4719806640 1 -- 172.21.15.2:0/1530691830 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47141a7080 con 0x7f4714106f10 2024-09-19T04:55:37.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.043+0000 7f471bbdf740 1 Processor -- start 2024-09-19T04:55:37.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.043+0000 7f4718804640 1 -- 172.21.15.2:0/1530691830 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f470c0051d0 con 0x7f4714106f10 2024-09-19T04:55:37.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.043+0000 7f471bbdf740 1 -- start start 2024-09-19T04:55:37.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.043+0000 7f471bbdf740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c63e5ab40 0x562c63e59090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:37.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.043+0000 7f471bbdf740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562c63e595d0 0x562c63e59a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:37.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.043+0000 7f471bbdf740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c63e64370 0x562c63e66760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:37.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.043+0000 7f471bbdf740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562c63dbf2f0 con 0x562c63e64370 2024-09-19T04:55:37.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.043+0000 7f471bbdf740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562c63d66cf0 con 0x562c63e595d0 2024-09-19T04:55:37.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.043+0000 7f471bbdf740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x562c63dbb2b0 con 0x562c63e5ab40 2024-09-19T04:55:37.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.043+0000 7f47127fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c63e64370 0x562c63e66760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:37.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.043+0000 7f47127fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c63e64370 0x562c63e66760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43316/0 (socket says 172.21.15.2:43316) 2024-09-19T04:55:37.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.043+0000 7f47127fc640 1 -- 172.21.15.2:0/4092454314 learned_addr learned my addr 172.21.15.2:0/4092454314 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:55:37.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.043+0000 7f4712ffd640 1 --2- 172.21.15.2:0/4092454314 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562c63e595d0 0x562c63e59a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:37.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.043+0000 7f47127fc640 1 --2- 172.21.15.2:0/4092454314 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c63e5ab40 0x562c63e59090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:37.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.043+0000 7f4718804640 1 --2- 172.21.15.2:0/1530691830 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f46fc0a3430 0x7f46fc0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:37.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.044+0000 7f47127fc640 1 -- 172.21.15.2:0/4092454314 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c63e5ab40 msgr2=0x562c63e59090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:37.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.044+0000 7f47127fc640 1 --2- 172.21.15.2:0/4092454314 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c63e5ab40 0x562c63e59090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:37.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.044+0000 7f47127fc640 1 -- 172.21.15.2:0/4092454314 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562c63e595d0 msgr2=0x562c63e59a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:37.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.044+0000 7f47127fc640 1 --2- 172.21.15.2:0/4092454314 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562c63e595d0 0x562c63e59a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:37.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.044+0000 7f47127fc640 1 -- 172.21.15.2:0/4092454314 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c63d4b3a0 con 0x562c63e64370 2024-09-19T04:55:37.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.044+0000 7f4712ffd640 1 --2- 172.21.15.2:0/4092454314 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562c63e595d0 0x562c63e59a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:55:37.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.044+0000 7f47137fe640 1 --2- 172.21.15.2:0/1530691830 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f46fc0a3430 0x7f46fc0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:37.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.044+0000 7f4718804640 1 -- 172.21.15.2:0/1530691830 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f470c0cfe10 con 0x7f4714106f10 2024-09-19T04:55:37.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.044+0000 7f47127fc640 1 --2- 172.21.15.2:0/4092454314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c63e64370 0x562c63e66760 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f47080149c0 tx=0x7f470800c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4b7e1ef95c8486a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:37.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.044+0000 7f46f9ffb640 1 -- 172.21.15.2:0/4092454314 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47080142d0 con 0x562c63e64370 2024-09-19T04:55:37.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.044+0000 7f46f9ffb640 1 -- 172.21.15.2:0/4092454314 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f47080054d0 con 0x562c63e64370 2024-09-19T04:55:37.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.044+0000 7f46f9ffb640 1 -- 172.21.15.2:0/4092454314 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470800f760 con 0x562c63e64370 2024-09-19T04:55:37.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.045+0000 7f471bbdf740 1 -- 172.21.15.2:0/4092454314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c63e64370 msgr2=0x562c63e66760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:37.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.045+0000 7f47137fe640 1 --2- 172.21.15.2:0/1530691830 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f46fc0a3430 0x7f46fc0a58f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f470c0cd610 tx=0x7f470c06de70 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:37.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.045+0000 7f471bbdf740 1 --2- 172.21.15.2:0/4092454314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c63e64370 0x562c63e66760 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f47080149c0 tx=0x7f470800c4d0 comp rx=0 tx=0).stop 2024-09-19T04:55:37.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.045+0000 7f471bbdf740 1 -- 172.21.15.2:0/4092454314 shutdown_connections 2024-09-19T04:55:37.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.045+0000 7f471bbdf740 1 --2- 172.21.15.2:0/4092454314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c63e64370 0x562c63e66760 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:37.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.045+0000 7f471bbdf740 1 --2- 172.21.15.2:0/4092454314 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562c63e595d0 0x562c63e59a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:37.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.045+0000 7f471bbdf740 1 --2- 172.21.15.2:0/4092454314 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c63e5ab40 0x562c63e59090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:37.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.045+0000 7f471bbdf740 1 -- 172.21.15.2:0/4092454314 >> 172.21.15.2:0/4092454314 conn(0x562c63e22310 msgr2=0x562c63e55c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:37.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.045+0000 7f471bbdf740 1 -- 172.21.15.2:0/4092454314 shutdown_connections 2024-09-19T04:55:37.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.045+0000 7f471bbdf740 1 -- 172.21.15.2:0/4092454314 wait complete. 2024-09-19T04:55:37.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.045+0000 7f471bbdf740 1 -- start start 2024-09-19T04:55:37.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.046+0000 7f471bbdf740 1 Processor -- start 2024-09-19T04:55:37.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.046+0000 7f471bbdf740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c63e595d0 0x562c63e63da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:37.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.046+0000 7f471bbdf740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562c63e5ab40 0x562c63e61050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:37.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.046+0000 7f471bbdf740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c63e64370 0x562c63e617e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:37.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.046+0000 7f471bbdf740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562c63e67070 con 0x562c63e64370 2024-09-19T04:55:37.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.046+0000 7f471bbdf740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562c63d7a060 con 0x562c63e5ab40 2024-09-19T04:55:37.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.046+0000 7f471bbdf740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x562c63e671f0 con 0x562c63e595d0 2024-09-19T04:55:37.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.046+0000 7f471bbdf740 10 client.0 _ll_register_callbacks cb 0x562c63acd8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:55:37.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.046+0000 7f47127fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c63e64370 0x562c63e617e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:37.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.046+0000 7f47127fc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c63e595d0 0x562c63e63da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:37.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.046+0000 7f47127fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c63e64370 0x562c63e617e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43332/0 (socket says 172.21.15.2:43332) 2024-09-19T04:55:37.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.046+0000 7f47127fc640 1 -- 172.21.15.2:0/3084461369 learned_addr learned my addr 172.21.15.2:0/3084461369 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:55:37.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.047+0000 7f4712ffd640 1 --2- 172.21.15.2:0/3084461369 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562c63e5ab40 0x562c63e61050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:37.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.047+0000 7f47127fc640 1 -- 172.21.15.2:0/3084461369 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c63e595d0 msgr2=0x562c63e63da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:37.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.047+0000 7f47127fc640 1 --2- 172.21.15.2:0/3084461369 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c63e595d0 0x562c63e63da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:37.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.047+0000 7f47127fc640 1 -- 172.21.15.2:0/3084461369 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562c63e5ab40 msgr2=0x562c63e61050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:37.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.047+0000 7f47127fc640 1 --2- 172.21.15.2:0/3084461369 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562c63e5ab40 0x562c63e61050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:37.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.047+0000 7f47127fc640 1 -- 172.21.15.2:0/3084461369 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c63b303c0 con 0x562c63e64370 2024-09-19T04:55:37.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.047+0000 7f47127fc640 1 --2- 172.21.15.2:0/3084461369 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c63e64370 0x562c63e617e0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f4708004bf0 tx=0x7f470800cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d3135ed9ed3c6fd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:37.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.047+0000 7f46f2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:55:37.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.047+0000 7f46f2ffd640 1 -- 172.21.15.2:0/3084461369 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47080142e0 con 0x562c63e64370 2024-09-19T04:55:37.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.047+0000 7f46f2ffd640 1 -- 172.21.15.2:0/3084461369 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f4708005000 con 0x562c63e64370 2024-09-19T04:55:37.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.047+0000 7f471bbdf740 1 -- 172.21.15.2:0/3084461369 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47080054d0 con 0x562c63e64370 2024-09-19T04:55:37.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.047+0000 7f46f2ffd640 1 -- 172.21.15.2:0/3084461369 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4708005200 con 0x562c63e64370 2024-09-19T04:55:37.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.047+0000 7f471bbdf740 10 client.16278 fetch_fsmap learned FSMap version 19 2024-09-19T04:55:37.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.047+0000 7f471bbdf740 1 -- 172.21.15.2:0/3084461369 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x562c63e72b50 con 0x562c63e64370 2024-09-19T04:55:37.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.048+0000 7f46f2ffd640 1 -- 172.21.15.2:0/3084461369 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f47080054d0 con 0x562c63e64370 2024-09-19T04:55:37.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.048+0000 7f46f2ffd640 1 -- 172.21.15.2:0/3084461369 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f47080245a0 con 0x562c63e64370 2024-09-19T04:55:37.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.048+0000 7f471bbdf740 10 client.16278 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:55:37.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.048+0000 7f471bbdf740 10 client.16278 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:55:37.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.048+0000 7f471bbdf740 20 client.16278 populate_metadata read hostname 'smithi002' 2024-09-19T04:55:37.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.048+0000 7f471bbdf740 1 --2- 172.21.15.2:0/3084461369 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x562c63e73ea0 0x562c63e76290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:37.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.048+0000 7f471bbdf740 4 client.16278 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:55:37.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.048+0000 7f471bbdf740 1 -- 172.21.15.2:0/3084461369 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c63dcc860 con 0x562c63e73ea0 2024-09-19T04:55:37.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.048+0000 7f4712ffd640 1 --2- 172.21.15.2:0/3084461369 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x562c63e73ea0 0x562c63e76290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:37.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.049+0000 7f46f2ffd640 10 client.16278 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:55:37.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.049+0000 7f4712ffd640 1 --2- 172.21.15.2:0/3084461369 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x562c63e73ea0 0x562c63e76290 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8259c4419d641aa server_cookie=84cdf84749986d4a in_seq=0 out_seq=0 2024-09-19T04:55:37.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.049+0000 7f46f2ffd640 1 -- 172.21.15.2:0/3084461369 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562c63dcc860 con 0x562c63e73ea0 2024-09-19T04:55:37.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.049+0000 7f46f2ffd640 10 client.16278 handle_command_reply: tid=0 2024-09-19T04:55:37.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.049+0000 7f471bbdf740 1 client.16278 shutdown 2024-09-19T04:55:37.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.049+0000 7f471bbdf740 1 -- 172.21.15.2:0/3084461369 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c63e64370 msgr2=0x562c63e617e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:37.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.049+0000 7f471bbdf740 1 --2- 172.21.15.2:0/3084461369 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c63e64370 0x562c63e617e0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f4708004bf0 tx=0x7f470800cd00 comp rx=0 tx=0).stop 2024-09-19T04:55:37.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.049+0000 7f471bbdf740 1 -- 172.21.15.2:0/3084461369 shutdown_connections 2024-09-19T04:55:37.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.049+0000 7f471bbdf740 1 --2- 172.21.15.2:0/3084461369 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c63e64370 0x562c63e617e0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:37.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.049+0000 7f471bbdf740 1 --2- 172.21.15.2:0/3084461369 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562c63e5ab40 0x562c63e61050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:37.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.049+0000 7f471bbdf740 1 --2- 172.21.15.2:0/3084461369 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x562c63e73ea0 0x562c63e76290 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:37.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.049+0000 7f471bbdf740 1 --2- 172.21.15.2:0/3084461369 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c63e595d0 0x562c63e63da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:37.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.049+0000 7f471bbdf740 1 -- 172.21.15.2:0/3084461369 >> 172.21.15.2:0/3084461369 conn(0x562c63e22310 msgr2=0x562c63e5b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:37.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.050+0000 7f46f2ffd640 0 client.16278 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:55:37.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.050+0000 7f471bbdf740 1 -- 172.21.15.2:0/3084461369 shutdown_connections 2024-09-19T04:55:37.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.050+0000 7f471bbdf740 1 -- 172.21.15.2:0/3084461369 wait complete. 2024-09-19T04:55:37.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.050+0000 7f471bbdf740 20 client.16278 trim_cache size 0 max 16384 2024-09-19T04:55:37.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.063+0000 7f471bbdf740 1 Processor -- start 2024-09-19T04:55:37.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.063+0000 7f471bbdf740 1 -- start start 2024-09-19T04:55:37.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.063+0000 7f471bbdf740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562c63e595d0 0x562c63e55da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:37.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.063+0000 7f471bbdf740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c63e5ab40 0x562c63e60030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:37.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.063+0000 7f471bbdf740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c63e64370 0x562c63e7b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:37.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.063+0000 7f471bbdf740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f47141ad980 con 0x562c63e64370 2024-09-19T04:55:37.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.063+0000 7f471bbdf740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f47141b01e0 con 0x562c63e595d0 2024-09-19T04:55:37.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.063+0000 7f471bbdf740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f47141adfd0 con 0x562c63e5ab40 2024-09-19T04:55:37.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.063+0000 7f47127fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c63e64370 0x562c63e7b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:37.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.063+0000 7f47127fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c63e64370 0x562c63e7b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43340/0 (socket says 172.21.15.2:43340) 2024-09-19T04:55:37.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.063+0000 7f47127fc640 1 -- 172.21.15.2:0/157798487 learned_addr learned my addr 172.21.15.2:0/157798487 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:55:37.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.063+0000 7f4712ffd640 1 --2- 172.21.15.2:0/157798487 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c63e5ab40 0x562c63e60030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:37.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.063+0000 7f47127fc640 1 -- 172.21.15.2:0/157798487 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c63e5ab40 msgr2=0x562c63e60030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:37.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.063+0000 7f47127fc640 1 --2- 172.21.15.2:0/157798487 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c63e5ab40 0x562c63e60030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:37.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.063+0000 7f47127fc640 1 -- 172.21.15.2:0/157798487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562c63e595d0 msgr2=0x562c63e55da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:37.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.063+0000 7f47127fc640 1 --2- 172.21.15.2:0/157798487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562c63e595d0 0x562c63e55da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:37.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.063+0000 7f47127fc640 1 -- 172.21.15.2:0/157798487 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c63e5a300 con 0x562c63e64370 2024-09-19T04:55:37.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.063+0000 7f4712ffd640 1 --2- 172.21.15.2:0/157798487 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c63e5ab40 0x562c63e60030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:55:37.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.064+0000 7f47127fc640 1 --2- 172.21.15.2:0/157798487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c63e64370 0x562c63e7b8c0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f4708005fd0 tx=0x7f470800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6844e40564e656 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:37.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.064+0000 7f46f97fa640 1 -- 172.21.15.2:0/157798487 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470800c990 con 0x562c63e64370 2024-09-19T04:55:37.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.064+0000 7f46f97fa640 1 -- 172.21.15.2:0/157798487 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f47080142e0 con 0x562c63e64370 2024-09-19T04:55:37.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.064+0000 7f46f97fa640 1 -- 172.21.15.2:0/157798487 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4708024bd0 con 0x562c63e64370 2024-09-19T04:55:37.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.064+0000 7f471bbdf740 1 -- 172.21.15.2:0/157798487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c63e64370 msgr2=0x562c63e7b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:37.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.064+0000 7f471bbdf740 1 --2- 172.21.15.2:0/157798487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c63e64370 0x562c63e7b8c0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f4708005fd0 tx=0x7f470800cc10 comp rx=0 tx=0).stop 2024-09-19T04:55:37.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.064+0000 7f471bbdf740 1 -- 172.21.15.2:0/157798487 shutdown_connections 2024-09-19T04:55:37.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.064+0000 7f471bbdf740 1 --2- 172.21.15.2:0/157798487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c63e64370 0x562c63e7b8c0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:37.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.064+0000 7f471bbdf740 1 --2- 172.21.15.2:0/157798487 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c63e5ab40 0x562c63e60030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:37.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.064+0000 7f471bbdf740 1 --2- 172.21.15.2:0/157798487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562c63e595d0 0x562c63e55da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:37.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.064+0000 7f471bbdf740 1 -- 172.21.15.2:0/157798487 >> 172.21.15.2:0/157798487 conn(0x562c63e22310 msgr2=0x562c63e5f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:37.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.064+0000 7f471bbdf740 1 -- 172.21.15.2:0/157798487 shutdown_connections 2024-09-19T04:55:37.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.064+0000 7f471bbdf740 1 -- 172.21.15.2:0/157798487 wait complete. 2024-09-19T04:55:37.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.065+0000 7f471bbdf740 1 -- start start 2024-09-19T04:55:37.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.065+0000 7f471bbdf740 1 Processor -- start 2024-09-19T04:55:37.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.065+0000 7f471bbdf740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c63e595d0 0x562c63e6c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:37.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.065+0000 7f471bbdf740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c63e5ab40 0x562c63e5dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:37.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.065+0000 7f471bbdf740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562c63e64370 0x562c63e5e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:37.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.065+0000 7f471bbdf740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f47141ae6a0 con 0x562c63e595d0 2024-09-19T04:55:37.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.065+0000 7f471bbdf740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f47141afb10 con 0x562c63e64370 2024-09-19T04:55:37.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.065+0000 7f471bbdf740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f47141aed70 con 0x562c63e5ab40 2024-09-19T04:55:37.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.065+0000 7f471bbdf740 10 client.0 _ll_register_callbacks cb 0x7f4704005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:55:37.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.065+0000 7f47127fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c63e595d0 0x562c63e6c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:37.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.065+0000 7f47127fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c63e595d0 0x562c63e6c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43350/0 (socket says 172.21.15.2:43350) 2024-09-19T04:55:37.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.065+0000 7f47127fc640 1 -- 172.21.15.2:0/3889255802 learned_addr learned my addr 172.21.15.2:0/3889255802 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:55:37.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.066+0000 7f4712ffd640 1 --2- 172.21.15.2:0/3889255802 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c63e5ab40 0x562c63e5dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:37.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.066+0000 7f47127fc640 1 -- 172.21.15.2:0/3889255802 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c63e5ab40 msgr2=0x562c63e5dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:37.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.066+0000 7f47127fc640 1 --2- 172.21.15.2:0/3889255802 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c63e5ab40 0x562c63e5dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:37.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.066+0000 7f47127fc640 1 -- 172.21.15.2:0/3889255802 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562c63e64370 msgr2=0x562c63e5e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:37.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.066+0000 7f47127fc640 1 --2- 172.21.15.2:0/3889255802 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562c63e64370 0x562c63e5e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:37.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.066+0000 7f47127fc640 1 -- 172.21.15.2:0/3889255802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c63e5e720 con 0x562c63e595d0 2024-09-19T04:55:37.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.066+0000 7f4712ffd640 1 --2- 172.21.15.2:0/3889255802 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c63e5ab40 0x562c63e5dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:55:37.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.066+0000 7f47127fc640 1 --2- 172.21.15.2:0/3889255802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c63e595d0 0x562c63e6c9e0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f4708000c00 tx=0x7f470800c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aa2fc183a1dd5f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:37.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.066+0000 7f46f2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:55:37.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.066+0000 7f46f2ffd640 1 -- 172.21.15.2:0/3889255802 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470803d020 con 0x562c63e595d0 2024-09-19T04:55:37.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.066+0000 7f46f2ffd640 1 -- 172.21.15.2:0/3889255802 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f4708024480 con 0x562c63e595d0 2024-09-19T04:55:37.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.066+0000 7f471bbdf740 1 -- 172.21.15.2:0/3889255802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47080142e0 con 0x562c63e595d0 2024-09-19T04:55:37.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.066+0000 7f46f2ffd640 1 -- 172.21.15.2:0/3889255802 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4708024680 con 0x562c63e595d0 2024-09-19T04:55:37.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.066+0000 7f471bbdf740 10 client.16284 fetch_fsmap learned FSMap version 19 2024-09-19T04:55:37.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.066+0000 7f471bbdf740 1 -- 172.21.15.2:0/3889255802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x562c63ede6c0 con 0x562c63e595d0 2024-09-19T04:55:37.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.066+0000 7f46f2ffd640 1 -- 172.21.15.2:0/3889255802 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f47080142e0 con 0x562c63e595d0 2024-09-19T04:55:37.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.067+0000 7f46f2ffd640 1 -- 172.21.15.2:0/3889255802 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f4708022470 con 0x562c63e595d0 2024-09-19T04:55:37.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.067+0000 7f471bbdf740 10 client.16284 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:55:37.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.067+0000 7f471bbdf740 10 client.16284 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:55:37.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.067+0000 7f471bbdf740 20 client.16284 populate_metadata read hostname 'smithi002' 2024-09-19T04:55:37.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.067+0000 7f471bbdf740 1 --2- 172.21.15.2:0/3889255802 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x562c63edeb70 0x562c63ee0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:37.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.067+0000 7f471bbdf740 4 client.16284 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:55:37.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.067+0000 7f471bbdf740 1 -- 172.21.15.2:0/3889255802 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562c63dc6d70 con 0x562c63edeb70 2024-09-19T04:55:37.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.067+0000 7f4712ffd640 1 --2- 172.21.15.2:0/3889255802 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x562c63edeb70 0x562c63ee0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:37.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.068+0000 7f4712ffd640 1 --2- 172.21.15.2:0/3889255802 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x562c63edeb70 0x562c63ee0f90 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97fee204dd584be6 server_cookie=8418d87765f5ca70 in_seq=0 out_seq=0 2024-09-19T04:55:37.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.068+0000 7f46f2ffd640 10 client.16284 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:55:37.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.068+0000 7f46f2ffd640 1 -- 172.21.15.2:0/3889255802 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562c63dc6d70 con 0x562c63edeb70 2024-09-19T04:55:37.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.068+0000 7f46f2ffd640 10 client.16284 handle_command_reply: tid=0 2024-09-19T04:55:37.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.068+0000 7f471bbdf740 1 client.16284 shutdown 2024-09-19T04:55:37.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.068+0000 7f471bbdf740 1 -- 172.21.15.2:0/3889255802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c63e595d0 msgr2=0x562c63e6c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:37.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.068+0000 7f471bbdf740 1 --2- 172.21.15.2:0/3889255802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c63e595d0 0x562c63e6c9e0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f4708000c00 tx=0x7f470800c440 comp rx=0 tx=0).stop 2024-09-19T04:55:37.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.068+0000 7f471bbdf740 1 -- 172.21.15.2:0/3889255802 shutdown_connections 2024-09-19T04:55:37.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.068+0000 7f471bbdf740 1 --2- 172.21.15.2:0/3889255802 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562c63e64370 0x562c63e5e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:37.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.068+0000 7f471bbdf740 1 --2- 172.21.15.2:0/3889255802 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x562c63edeb70 0x562c63ee0f90 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:37.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.068+0000 7f471bbdf740 1 --2- 172.21.15.2:0/3889255802 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c63e5ab40 0x562c63e5dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:37.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.068+0000 7f471bbdf740 1 --2- 172.21.15.2:0/3889255802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c63e595d0 0x562c63e6c9e0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:37.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.068+0000 7f46f2ffd640 0 client.16284 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:55:37.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.068+0000 7f471bbdf740 1 -- 172.21.15.2:0/3889255802 >> 172.21.15.2:0/3889255802 conn(0x562c63e22310 msgr2=0x562c63e628b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:37.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.068+0000 7f471bbdf740 1 -- 172.21.15.2:0/3889255802 shutdown_connections 2024-09-19T04:55:37.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.068+0000 7f471bbdf740 1 -- 172.21.15.2:0/3889255802 wait complete. 2024-09-19T04:55:37.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.068+0000 7f471bbdf740 20 client.16284 trim_cache size 0 max 16384 2024-09-19T04:55:37.076 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T04:55:37.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.069+0000 7f4719806640 1 -- 172.21.15.2:0/1530691830 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f46fc0a3430 msgr2=0x7f46fc0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:37.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.069+0000 7f4719806640 1 --2- 172.21.15.2:0/1530691830 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f46fc0a3430 0x7f46fc0a58f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f470c0cd610 tx=0x7f470c06de70 comp rx=0 tx=0).stop 2024-09-19T04:55:37.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.069+0000 7f4719806640 1 -- 172.21.15.2:0/1530691830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4714106f10 msgr2=0x7f4714074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:37.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.069+0000 7f4719806640 1 --2- 172.21.15.2:0/1530691830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4714106f10 0x7f4714074f70 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f470c00eaa0 tx=0x7f470c00ef60 comp rx=0 tx=0).stop 2024-09-19T04:55:37.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.069+0000 7f4719806640 1 -- 172.21.15.2:0/1530691830 shutdown_connections 2024-09-19T04:55:37.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.069+0000 7f4719806640 1 --2- 172.21.15.2:0/1530691830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4714106f10 0x7f4714074f70 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:37.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.069+0000 7f4719806640 1 --2- 172.21.15.2:0/1530691830 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4714102790 0x7f4714074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:37.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.069+0000 7f4719806640 1 --2- 172.21.15.2:0/1530691830 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f46fc0a3430 0x7f46fc0a58f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:37.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.069+0000 7f4719806640 1 --2- 172.21.15.2:0/1530691830 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4714101de0 0x7f47140744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:37.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.069+0000 7f4719806640 1 -- 172.21.15.2:0/1530691830 >> 172.21.15.2:0/1530691830 conn(0x7f47140fd8c0 msgr2=0x7f47140fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:37.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.069+0000 7f4719806640 1 -- 172.21.15.2:0/1530691830 shutdown_connections 2024-09-19T04:55:37.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:37.069+0000 7f4719806640 1 -- 172.21.15.2:0/1530691830 wait complete. 2024-09-19T04:55:38.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:38 smithi002 ceph-mon[30975]: pgmap v234: 97 pgs: 97 active+clean; 12 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 42 KiB/s wr, 7 op/s 2024-09-19T04:55:38.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:38 smithi116 ceph-mon[34477]: pgmap v234: 97 pgs: 97 active+clean; 12 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 42 KiB/s wr, 7 op/s 2024-09-19T04:55:38.806 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:38 smithi018 ceph-mon[34537]: pgmap v234: 97 pgs: 97 active+clean; 12 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 42 KiB/s wr, 7 op/s 2024-09-19T04:55:38.822 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:55:38.822 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:55:39.095 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:55:39.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.551+0000 7fa452ea8640 1 -- 172.21.15.2:0/831431435 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa44c100a90 msgr2=0x7fa44c100ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:39.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.551+0000 7fa452ea8640 1 --2- 172.21.15.2:0/831431435 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa44c100a90 0x7fa44c100ef0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fa434009930 tx=0x7fa43402a420 comp rx=0 tx=0).stop 2024-09-19T04:55:39.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.551+0000 7fa452ea8640 1 -- 172.21.15.2:0/831431435 shutdown_connections 2024-09-19T04:55:39.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.551+0000 7fa452ea8640 1 --2- 172.21.15.2:0/831431435 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa44c101430 0x7fa44c10d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:39.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.551+0000 7fa452ea8640 1 --2- 172.21.15.2:0/831431435 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa44c100a90 0x7fa44c100ef0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:39.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.551+0000 7fa452ea8640 1 --2- 172.21.15.2:0/831431435 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa44c106a90 0x7fa44c106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:39.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.551+0000 7fa452ea8640 1 -- 172.21.15.2:0/831431435 >> 172.21.15.2:0/831431435 conn(0x7fa44c0fc7d0 msgr2=0x7fa44c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:39.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.551+0000 7fa452ea8640 1 -- 172.21.15.2:0/831431435 shutdown_connections 2024-09-19T04:55:39.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.551+0000 7fa452ea8640 1 -- 172.21.15.2:0/831431435 wait complete. 2024-09-19T04:55:39.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.552+0000 7fa452ea8640 1 Processor -- start 2024-09-19T04:55:39.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.552+0000 7fa452ea8640 1 -- start start 2024-09-19T04:55:39.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.552+0000 7fa452ea8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa44c100a90 0x7fa44c198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:39.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.552+0000 7fa452ea8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa44c101430 0x7fa44c198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:39.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.552+0000 7fa452ea8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa44c106a90 0x7fa44c19cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:39.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.552+0000 7fa452ea8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa44c110d60 con 0x7fa44c106a90 2024-09-19T04:55:39.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.552+0000 7fa452ea8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa44c110be0 con 0x7fa44c101430 2024-09-19T04:55:39.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.552+0000 7fa452ea8640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa44c110ee0 con 0x7fa44c100a90 2024-09-19T04:55:39.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.552+0000 7fa451445640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa44c106a90 0x7fa44c19cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:39.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.552+0000 7fa450c44640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa44c100a90 0x7fa44c198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:39.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.552+0000 7fa451445640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa44c106a90 0x7fa44c19cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43358/0 (socket says 172.21.15.2:43358) 2024-09-19T04:55:39.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.552+0000 7fa451445640 1 -- 172.21.15.2:0/3228493939 learned_addr learned my addr 172.21.15.2:0/3228493939 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:55:39.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.552+0000 7fa44bfff640 1 --2- 172.21.15.2:0/3228493939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa44c101430 0x7fa44c198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:39.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.552+0000 7fa451445640 1 -- 172.21.15.2:0/3228493939 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa44c100a90 msgr2=0x7fa44c198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:39.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.552+0000 7fa451445640 1 --2- 172.21.15.2:0/3228493939 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa44c100a90 0x7fa44c198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:39.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.553+0000 7fa451445640 1 -- 172.21.15.2:0/3228493939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa44c101430 msgr2=0x7fa44c198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:39.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.553+0000 7fa451445640 1 --2- 172.21.15.2:0/3228493939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa44c101430 0x7fa44c198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:39.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.553+0000 7fa451445640 1 -- 172.21.15.2:0/3228493939 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa44c19d400 con 0x7fa44c106a90 2024-09-19T04:55:39.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.553+0000 7fa44bfff640 1 --2- 172.21.15.2:0/3228493939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa44c101430 0x7fa44c198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:55:39.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.553+0000 7fa451445640 1 --2- 172.21.15.2:0/3228493939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa44c106a90 0x7fa44c19cd20 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fa44400cad0 tx=0x7fa44400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:39.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.553+0000 7fa449ffb640 1 -- 172.21.15.2:0/3228493939 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa44400ad60 con 0x7fa44c106a90 2024-09-19T04:55:39.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.553+0000 7fa452ea8640 1 -- 172.21.15.2:0/3228493939 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa44c19d6f0 con 0x7fa44c106a90 2024-09-19T04:55:39.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.553+0000 7fa449ffb640 1 -- 172.21.15.2:0/3228493939 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa444005020 con 0x7fa44c106a90 2024-09-19T04:55:39.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.553+0000 7fa449ffb640 1 -- 172.21.15.2:0/3228493939 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa44400f6b0 con 0x7fa44c106a90 2024-09-19T04:55:39.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.553+0000 7fa452ea8640 1 -- 172.21.15.2:0/3228493939 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa44c1a4fd0 con 0x7fa44c106a90 2024-09-19T04:55:39.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.555+0000 7fa449ffb640 1 -- 172.21.15.2:0/3228493939 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fa4440051d0 con 0x7fa44c106a90 2024-09-19T04:55:39.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.556+0000 7fa455281740 1 Processor -- start 2024-09-19T04:55:39.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.556+0000 7fa455281740 1 -- start start 2024-09-19T04:55:39.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.556+0000 7fa455281740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56395b6c2f70 0x56395b6c3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:39.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.556+0000 7fa455281740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56395b6c3890 0x56395b6cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:39.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.556+0000 7fa455281740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56395b6ce150 0x56395b6d0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:39.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.556+0000 7fa455281740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56395b624280 con 0x56395b6c2f70 2024-09-19T04:55:39.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.556+0000 7fa455281740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56395b5cbb10 con 0x56395b6ce150 2024-09-19T04:55:39.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.556+0000 7fa455281740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x56395b620240 con 0x56395b6c3890 2024-09-19T04:55:39.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.556+0000 7fa44bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56395b6c2f70 0x56395b6c3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:39.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.556+0000 7fa44bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56395b6c2f70 0x56395b6c3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43372/0 (socket says 172.21.15.2:43372) 2024-09-19T04:55:39.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.556+0000 7fa44bfff640 1 -- 172.21.15.2:0/3131382690 learned_addr learned my addr 172.21.15.2:0/3131382690 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:55:39.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.556+0000 7fa450c44640 1 --2- 172.21.15.2:0/3131382690 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56395b6c3890 0x56395b6cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:39.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.556+0000 7fa44bfff640 1 --2- 172.21.15.2:0/3131382690 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56395b6ce150 0x56395b6d0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:39.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.556+0000 7fa449ffb640 1 --2- 172.21.15.2:0/3228493939 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fa4380a33b0 0x7fa4380a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:39.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.556+0000 7fa44bfff640 1 -- 172.21.15.2:0/3131382690 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56395b6c3890 msgr2=0x56395b6cdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:39.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.556+0000 7fa44bfff640 1 --2- 172.21.15.2:0/3131382690 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56395b6c3890 0x56395b6cdc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:39.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.556+0000 7fa44bfff640 1 -- 172.21.15.2:0/3131382690 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56395b6ce150 msgr2=0x56395b6d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:39.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.556+0000 7fa44bfff640 1 --2- 172.21.15.2:0/3131382690 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56395b6ce150 0x56395b6d0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:39.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.556+0000 7fa44bfff640 1 -- 172.21.15.2:0/3131382690 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56395b5d81f0 con 0x56395b6c2f70 2024-09-19T04:55:39.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.557+0000 7fa451445640 1 --2- 172.21.15.2:0/3228493939 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fa4380a33b0 0x7fa4380a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:39.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.557+0000 7fa44bfff640 1 --2- 172.21.15.2:0/3131382690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56395b6c2f70 0x56395b6c3350 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fa434005ec0 tx=0x7fa434009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dd57c835e6eaf5c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:39.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.557+0000 7fa449ffb640 1 -- 172.21.15.2:0/3228493939 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7fa4440cfdc0 con 0x7fa44c106a90 2024-09-19T04:55:39.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.557+0000 7fa442ffd640 1 -- 172.21.15.2:0/3131382690 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa434045070 con 0x56395b6c2f70 2024-09-19T04:55:39.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.557+0000 7fa442ffd640 1 -- 172.21.15.2:0/3131382690 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa434005040 con 0x56395b6c2f70 2024-09-19T04:55:39.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.557+0000 7fa442ffd640 1 -- 172.21.15.2:0/3131382690 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa434035050 con 0x56395b6c2f70 2024-09-19T04:55:39.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.558+0000 7fa455281740 1 -- 172.21.15.2:0/3131382690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56395b6c2f70 msgr2=0x56395b6c3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:39.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.558+0000 7fa451445640 1 --2- 172.21.15.2:0/3228493939 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fa4380a33b0 0x7fa4380a5870 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa444098500 tx=0x7fa444098420 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:39.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.558+0000 7fa455281740 1 --2- 172.21.15.2:0/3131382690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56395b6c2f70 0x56395b6c3350 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fa434005ec0 tx=0x7fa434009560 comp rx=0 tx=0).stop 2024-09-19T04:55:39.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.558+0000 7fa455281740 1 -- 172.21.15.2:0/3131382690 shutdown_connections 2024-09-19T04:55:39.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.558+0000 7fa455281740 1 --2- 172.21.15.2:0/3131382690 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56395b6ce150 0x56395b6d0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:39.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.558+0000 7fa455281740 1 --2- 172.21.15.2:0/3131382690 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56395b6c3890 0x56395b6cdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:39.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.558+0000 7fa455281740 1 --2- 172.21.15.2:0/3131382690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56395b6c2f70 0x56395b6c3350 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:39.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.558+0000 7fa455281740 1 -- 172.21.15.2:0/3131382690 >> 172.21.15.2:0/3131382690 conn(0x56395b6bf500 msgr2=0x56395b6bf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:39.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.558+0000 7fa455281740 1 -- 172.21.15.2:0/3131382690 shutdown_connections 2024-09-19T04:55:39.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.558+0000 7fa455281740 1 -- 172.21.15.2:0/3131382690 wait complete. 2024-09-19T04:55:39.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.558+0000 7fa455281740 1 -- start start 2024-09-19T04:55:39.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.558+0000 7fa455281740 1 Processor -- start 2024-09-19T04:55:39.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.559+0000 7fa455281740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56395b6c2f70 0x56395b6cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:39.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.559+0000 7fa455281740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56395b6c3890 0x56395b6cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:39.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.559+0000 7fa455281740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56395b6ce150 0x56395b6cbb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:39.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.559+0000 7fa455281740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56395b6d0d20 con 0x56395b6c2f70 2024-09-19T04:55:39.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.559+0000 7fa455281740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56395b5def10 con 0x56395b6ce150 2024-09-19T04:55:39.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.559+0000 7fa455281740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x56395b6d0ea0 con 0x56395b6c3890 2024-09-19T04:55:39.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.559+0000 7fa455281740 10 client.0 _ll_register_callbacks cb 0x56395b5a7a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:55:39.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.559+0000 7fa44bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56395b6c2f70 0x56395b6cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:39.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.559+0000 7fa44bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56395b6c2f70 0x56395b6cb0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43384/0 (socket says 172.21.15.2:43384) 2024-09-19T04:55:39.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.559+0000 7fa44bfff640 1 -- 172.21.15.2:0/700371709 learned_addr learned my addr 172.21.15.2:0/700371709 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:55:39.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.559+0000 7fa44bfff640 1 --2- 172.21.15.2:0/700371709 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56395b6ce150 0x56395b6cbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:39.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.559+0000 7fa450c44640 1 --2- 172.21.15.2:0/700371709 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56395b6c3890 0x56395b6cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:39.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.559+0000 7fa44bfff640 1 -- 172.21.15.2:0/700371709 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56395b6c3890 msgr2=0x56395b6cb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:39.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.559+0000 7fa44bfff640 1 --2- 172.21.15.2:0/700371709 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56395b6c3890 0x56395b6cb5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:39.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.559+0000 7fa44bfff640 1 -- 172.21.15.2:0/700371709 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56395b6ce150 msgr2=0x56395b6cbb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:39.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.559+0000 7fa44bfff640 1 --2- 172.21.15.2:0/700371709 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56395b6ce150 0x56395b6cbb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:39.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.559+0000 7fa44bfff640 1 -- 172.21.15.2:0/700371709 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56395b3956a0 con 0x56395b6c2f70 2024-09-19T04:55:39.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.559+0000 7fa450c44640 1 --2- 172.21.15.2:0/700371709 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56395b6c3890 0x56395b6cb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:55:39.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.559+0000 7fa44bfff640 1 --2- 172.21.15.2:0/700371709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56395b6c2f70 0x56395b6cb0b0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fa434009a50 tx=0x7fa434004580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d75114dc3b204a97 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:39.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.559+0000 7fa42bfff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:55:39.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.559+0000 7fa42bfff640 1 -- 172.21.15.2:0/700371709 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa434035070 con 0x56395b6c2f70 2024-09-19T04:55:39.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.559+0000 7fa42bfff640 1 -- 172.21.15.2:0/700371709 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7fa4340053f0 con 0x56395b6c2f70 2024-09-19T04:55:39.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.559+0000 7fa455281740 1 -- 172.21.15.2:0/700371709 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa434005040 con 0x56395b6c2f70 2024-09-19T04:55:39.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.560+0000 7fa42bfff640 1 -- 172.21.15.2:0/700371709 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fa434045040 con 0x56395b6c2f70 2024-09-19T04:55:39.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.560+0000 7fa455281740 10 client.16296 fetch_fsmap learned FSMap version 19 2024-09-19T04:55:39.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.560+0000 7fa455281740 1 -- 172.21.15.2:0/700371709 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56395b6dc9a0 con 0x56395b6c2f70 2024-09-19T04:55:39.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.560+0000 7fa42bfff640 1 -- 172.21.15.2:0/700371709 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa434005040 con 0x56395b6c2f70 2024-09-19T04:55:39.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.560+0000 7fa42bfff640 1 -- 172.21.15.2:0/700371709 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fa43404b020 con 0x56395b6c2f70 2024-09-19T04:55:39.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.560+0000 7fa455281740 10 client.16296 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:55:39.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.560+0000 7fa455281740 10 client.16296 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:55:39.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.560+0000 7fa455281740 20 client.16296 populate_metadata read hostname 'smithi002' 2024-09-19T04:55:39.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.560+0000 7fa455281740 1 --2- 172.21.15.2:0/700371709 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56395b6ddcf0 0x56395b6e00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:39.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.560+0000 7fa455281740 4 client.16296 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:55:39.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.560+0000 7fa455281740 1 -- 172.21.15.2:0/700371709 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56395b6317f0 con 0x56395b6ddcf0 2024-09-19T04:55:39.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.560+0000 7fa450c44640 1 --2- 172.21.15.2:0/700371709 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56395b6ddcf0 0x56395b6e00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:39.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.561+0000 7fa450c44640 1 --2- 172.21.15.2:0/700371709 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56395b6ddcf0 0x56395b6e00e0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=564b4c1579b45dd4 server_cookie=fde37e124d49bf69 in_seq=0 out_seq=0 2024-09-19T04:55:39.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.561+0000 7fa42bfff640 10 client.16296 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:55:39.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.561+0000 7fa42bfff640 1 -- 172.21.15.2:0/700371709 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56395b6317f0 con 0x56395b6ddcf0 2024-09-19T04:55:39.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.561+0000 7fa42bfff640 10 client.16296 handle_command_reply: tid=0 2024-09-19T04:55:39.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.561+0000 7fa455281740 1 client.16296 shutdown 2024-09-19T04:55:39.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.562+0000 7fa455281740 1 -- 172.21.15.2:0/700371709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56395b6c2f70 msgr2=0x56395b6cb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:39.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.562+0000 7fa455281740 1 --2- 172.21.15.2:0/700371709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56395b6c2f70 0x56395b6cb0b0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fa434009a50 tx=0x7fa434004580 comp rx=0 tx=0).stop 2024-09-19T04:55:39.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.562+0000 7fa455281740 1 -- 172.21.15.2:0/700371709 shutdown_connections 2024-09-19T04:55:39.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.562+0000 7fa455281740 1 --2- 172.21.15.2:0/700371709 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56395b6ce150 0x56395b6cbb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:39.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.562+0000 7fa455281740 1 --2- 172.21.15.2:0/700371709 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56395b6ddcf0 0x56395b6e00e0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:39.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.562+0000 7fa455281740 1 --2- 172.21.15.2:0/700371709 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56395b6c3890 0x56395b6cb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:39.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.562+0000 7fa455281740 1 --2- 172.21.15.2:0/700371709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56395b6c2f70 0x56395b6cb0b0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:39.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.562+0000 7fa455281740 1 -- 172.21.15.2:0/700371709 >> 172.21.15.2:0/700371709 conn(0x56395b6bf500 msgr2=0x56395b6c5230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:39.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.562+0000 7fa42bfff640 0 client.16296 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:55:39.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.562+0000 7fa455281740 1 -- 172.21.15.2:0/700371709 shutdown_connections 2024-09-19T04:55:39.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.562+0000 7fa455281740 1 -- 172.21.15.2:0/700371709 wait complete. 2024-09-19T04:55:39.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.562+0000 7fa455281740 20 client.16296 trim_cache size 0 max 16384 2024-09-19T04:55:39.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.579+0000 7fa455281740 1 Processor -- start 2024-09-19T04:55:39.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.579+0000 7fa455281740 1 -- start start 2024-09-19T04:55:39.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.580+0000 7fa455281740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56395b6c2f70 0x56395b6ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:39.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.580+0000 7fa455281740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56395b6c3890 0x56395b6e2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:39.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.580+0000 7fa455281740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56395b6ce150 0x56395b6e3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:39.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.580+0000 7fa455281740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa44c1a9580 con 0x56395b6ce150 2024-09-19T04:55:39.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.580+0000 7fa455281740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa44c1abde0 con 0x56395b6c2f70 2024-09-19T04:55:39.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.580+0000 7fa455281740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa44c1a9bd0 con 0x56395b6c3890 2024-09-19T04:55:39.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.580+0000 7fa44bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56395b6ce150 0x56395b6e3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:39.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.580+0000 7fa44bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56395b6ce150 0x56395b6e3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43388/0 (socket says 172.21.15.2:43388) 2024-09-19T04:55:39.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.580+0000 7fa44bfff640 1 -- 172.21.15.2:0/2698864136 learned_addr learned my addr 172.21.15.2:0/2698864136 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:55:39.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.580+0000 7fa450c44640 1 --2- 172.21.15.2:0/2698864136 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56395b6c3890 0x56395b6e2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:39.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.580+0000 7fa44bfff640 1 --2- 172.21.15.2:0/2698864136 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56395b6c2f70 0x56395b6ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:39.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.580+0000 7fa44bfff640 1 -- 172.21.15.2:0/2698864136 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56395b6c3890 msgr2=0x56395b6e2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:39.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.580+0000 7fa44bfff640 1 --2- 172.21.15.2:0/2698864136 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56395b6c3890 0x56395b6e2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:39.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.580+0000 7fa44bfff640 1 -- 172.21.15.2:0/2698864136 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56395b6c2f70 msgr2=0x56395b6ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:39.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.580+0000 7fa44bfff640 1 --2- 172.21.15.2:0/2698864136 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56395b6c2f70 0x56395b6ccf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:39.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.580+0000 7fa44bfff640 1 -- 172.21.15.2:0/2698864136 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56395b6ca060 con 0x56395b6ce150 2024-09-19T04:55:39.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.580+0000 7fa44bfff640 1 --2- 172.21.15.2:0/2698864136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56395b6ce150 0x56395b6e3260 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fa434031440 tx=0x7fa434001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd11e71e50743972 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:39.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.581+0000 7fa4427fc640 1 -- 172.21.15.2:0/2698864136 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43405a070 con 0x56395b6ce150 2024-09-19T04:55:39.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.581+0000 7fa4427fc640 1 -- 172.21.15.2:0/2698864136 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa434041070 con 0x56395b6ce150 2024-09-19T04:55:39.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.581+0000 7fa4427fc640 1 -- 172.21.15.2:0/2698864136 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa434035070 con 0x56395b6ce150 2024-09-19T04:55:39.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.581+0000 7fa455281740 1 -- 172.21.15.2:0/2698864136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56395b6ce150 msgr2=0x56395b6e3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:39.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.581+0000 7fa455281740 1 --2- 172.21.15.2:0/2698864136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56395b6ce150 0x56395b6e3260 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fa434031440 tx=0x7fa434001e70 comp rx=0 tx=0).stop 2024-09-19T04:55:39.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.581+0000 7fa455281740 1 -- 172.21.15.2:0/2698864136 shutdown_connections 2024-09-19T04:55:39.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.581+0000 7fa455281740 1 --2- 172.21.15.2:0/2698864136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56395b6ce150 0x56395b6e3260 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:39.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.581+0000 7fa455281740 1 --2- 172.21.15.2:0/2698864136 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56395b6c3890 0x56395b6e2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:39.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.581+0000 7fa455281740 1 --2- 172.21.15.2:0/2698864136 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56395b6c2f70 0x56395b6ccf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:39.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.581+0000 7fa455281740 1 -- 172.21.15.2:0/2698864136 >> 172.21.15.2:0/2698864136 conn(0x56395b6bf500 msgr2=0x56395b6cc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:39.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.581+0000 7fa455281740 1 -- 172.21.15.2:0/2698864136 shutdown_connections 2024-09-19T04:55:39.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.582+0000 7fa455281740 1 -- 172.21.15.2:0/2698864136 wait complete. 2024-09-19T04:55:39.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.582+0000 7fa455281740 1 -- start start 2024-09-19T04:55:39.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.582+0000 7fa455281740 1 Processor -- start 2024-09-19T04:55:39.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.582+0000 7fa455281740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56395b6c2f70 0x56395b6e35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:39.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.582+0000 7fa455281740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56395b6c3890 0x56395b6e08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:39.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.582+0000 7fa455281740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56395b6ce150 0x56395b6e0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:39.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.582+0000 7fa455281740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa44c1aa2a0 con 0x56395b6c3890 2024-09-19T04:55:39.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.582+0000 7fa455281740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa44c1ab710 con 0x56395b6ce150 2024-09-19T04:55:39.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.582+0000 7fa455281740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa44c1aa970 con 0x56395b6c2f70 2024-09-19T04:55:39.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.582+0000 7fa455281740 10 client.0 _ll_register_callbacks cb 0x7fa434043070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:55:39.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.582+0000 7fa450c44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56395b6c3890 0x56395b6e08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:39.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.583+0000 7fa450c44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56395b6c3890 0x56395b6e08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43398/0 (socket says 172.21.15.2:43398) 2024-09-19T04:55:39.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.583+0000 7fa450c44640 1 -- 172.21.15.2:0/3144829742 learned_addr learned my addr 172.21.15.2:0/3144829742 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:55:39.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.583+0000 7fa44bfff640 1 --2- 172.21.15.2:0/3144829742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56395b6ce150 0x56395b6e0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:39.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.583+0000 7fa44bfff640 1 --2- 172.21.15.2:0/3144829742 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56395b6c2f70 0x56395b6e35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:39.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.583+0000 7fa450c44640 1 -- 172.21.15.2:0/3144829742 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56395b6c2f70 msgr2=0x56395b6e35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:39.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.583+0000 7fa450c44640 1 --2- 172.21.15.2:0/3144829742 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56395b6c2f70 0x56395b6e35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:39.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.583+0000 7fa450c44640 1 -- 172.21.15.2:0/3144829742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56395b6ce150 msgr2=0x56395b6e0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:39.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.583+0000 7fa450c44640 1 --2- 172.21.15.2:0/3144829742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56395b6ce150 0x56395b6e0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:39.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.583+0000 7fa450c44640 1 -- 172.21.15.2:0/3144829742 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56395b6e1710 con 0x56395b6c3890 2024-09-19T04:55:39.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.583+0000 7fa44bfff640 1 --2- 172.21.15.2:0/3144829742 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56395b6c2f70 0x56395b6e35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:55:39.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.583+0000 7fa450c44640 1 --2- 172.21.15.2:0/3144829742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56395b6c3890 0x56395b6e08f0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x56395b6ca940 tx=0x7fa43c0047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7118d02663dd332 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:39.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.583+0000 7fa42bfff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:55:39.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.583+0000 7fa42bfff640 1 -- 172.21.15.2:0/3144829742 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43c005bc0 con 0x56395b6c3890 2024-09-19T04:55:39.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.583+0000 7fa42bfff640 1 -- 172.21.15.2:0/3144829742 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7fa43c005d60 con 0x56395b6c3890 2024-09-19T04:55:39.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.583+0000 7fa455281740 1 -- 172.21.15.2:0/3144829742 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa434041070 con 0x56395b6c3890 2024-09-19T04:55:39.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.583+0000 7fa42bfff640 1 -- 172.21.15.2:0/3144829742 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fa43c006030 con 0x56395b6c3890 2024-09-19T04:55:39.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.583+0000 7fa455281740 10 client.16302 fetch_fsmap learned FSMap version 19 2024-09-19T04:55:39.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.584+0000 7fa455281740 1 -- 172.21.15.2:0/3144829742 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56395b7487e0 con 0x56395b6c3890 2024-09-19T04:55:39.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.584+0000 7fa42bfff640 1 -- 172.21.15.2:0/3144829742 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa434041070 con 0x56395b6c3890 2024-09-19T04:55:39.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.584+0000 7fa42bfff640 1 -- 172.21.15.2:0/3144829742 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fa43c02f980 con 0x56395b6c3890 2024-09-19T04:55:39.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.584+0000 7fa455281740 10 client.16302 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:55:39.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.584+0000 7fa455281740 10 client.16302 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:55:39.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.584+0000 7fa455281740 20 client.16302 populate_metadata read hostname 'smithi002' 2024-09-19T04:55:39.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.584+0000 7fa455281740 1 --2- 172.21.15.2:0/3144829742 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56395b748f10 0x56395b74b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:39.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.584+0000 7fa455281740 4 client.16302 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:55:39.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.584+0000 7fa455281740 1 -- 172.21.15.2:0/3144829742 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56395b62bd00 con 0x56395b748f10 2024-09-19T04:55:39.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.584+0000 7fa44bfff640 1 --2- 172.21.15.2:0/3144829742 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56395b748f10 0x56395b74b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:39.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.585+0000 7fa42bfff640 10 client.16302 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:55:39.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.585+0000 7fa44bfff640 1 --2- 172.21.15.2:0/3144829742 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56395b748f10 0x56395b74b330 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f04fe7fe5af6f3f server_cookie=718cf2fe731835c9 in_seq=0 out_seq=0 2024-09-19T04:55:39.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.585+0000 7fa42bfff640 1 -- 172.21.15.2:0/3144829742 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56395b62bd00 con 0x56395b748f10 2024-09-19T04:55:39.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.585+0000 7fa42bfff640 10 client.16302 handle_command_reply: tid=0 2024-09-19T04:55:39.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.585+0000 7fa455281740 1 client.16302 shutdown 2024-09-19T04:55:39.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.586+0000 7fa455281740 1 -- 172.21.15.2:0/3144829742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56395b6c3890 msgr2=0x56395b6e08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:39.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.586+0000 7fa455281740 1 --2- 172.21.15.2:0/3144829742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56395b6c3890 0x56395b6e08f0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x56395b6ca940 tx=0x7fa43c0047d0 comp rx=0 tx=0).stop 2024-09-19T04:55:39.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.586+0000 7fa455281740 1 -- 172.21.15.2:0/3144829742 shutdown_connections 2024-09-19T04:55:39.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.586+0000 7fa455281740 1 --2- 172.21.15.2:0/3144829742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56395b6ce150 0x56395b6e0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:39.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.586+0000 7fa455281740 1 --2- 172.21.15.2:0/3144829742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56395b6c3890 0x56395b6e08f0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:39.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.586+0000 7fa455281740 1 --2- 172.21.15.2:0/3144829742 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56395b748f10 0x56395b74b330 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:39.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.586+0000 7fa455281740 1 --2- 172.21.15.2:0/3144829742 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56395b6c2f70 0x56395b6e35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:39.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.586+0000 7fa455281740 1 -- 172.21.15.2:0/3144829742 >> 172.21.15.2:0/3144829742 conn(0x56395b6bf500 msgr2=0x56395b6d9910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:39.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.586+0000 7fa42bfff640 0 client.16302 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:55:39.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.586+0000 7fa455281740 1 -- 172.21.15.2:0/3144829742 shutdown_connections 2024-09-19T04:55:39.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.586+0000 7fa455281740 1 -- 172.21.15.2:0/3144829742 wait complete. 2024-09-19T04:55:39.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.586+0000 7fa455281740 20 client.16302 trim_cache size 0 max 16384 2024-09-19T04:55:39.595 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:55:39.596 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T04:55:39.596 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "5d737d8f-6f9c-48d2-9649-0bf0dd982ffc", 2024-09-19T04:55:39.596 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T04:55:39.596 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:55:39.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.587+0000 7fa452ea8640 1 -- 172.21.15.2:0/3228493939 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fa4380a33b0 msgr2=0x7fa4380a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:39.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.587+0000 7fa452ea8640 1 --2- 172.21.15.2:0/3228493939 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fa4380a33b0 0x7fa4380a5870 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa444098500 tx=0x7fa444098420 comp rx=0 tx=0).stop 2024-09-19T04:55:39.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.587+0000 7fa452ea8640 1 -- 172.21.15.2:0/3228493939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa44c106a90 msgr2=0x7fa44c19cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:39.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.587+0000 7fa452ea8640 1 --2- 172.21.15.2:0/3228493939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa44c106a90 0x7fa44c19cd20 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fa44400cad0 tx=0x7fa44400ced0 comp rx=0 tx=0).stop 2024-09-19T04:55:39.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.587+0000 7fa452ea8640 1 -- 172.21.15.2:0/3228493939 shutdown_connections 2024-09-19T04:55:39.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.587+0000 7fa452ea8640 1 --2- 172.21.15.2:0/3228493939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa44c106a90 0x7fa44c19cd20 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:39.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.587+0000 7fa452ea8640 1 --2- 172.21.15.2:0/3228493939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa44c101430 0x7fa44c198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:39.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.587+0000 7fa452ea8640 1 --2- 172.21.15.2:0/3228493939 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fa4380a33b0 0x7fa4380a5870 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:39.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.587+0000 7fa452ea8640 1 --2- 172.21.15.2:0/3228493939 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa44c100a90 0x7fa44c198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:39.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.587+0000 7fa452ea8640 1 -- 172.21.15.2:0/3228493939 >> 172.21.15.2:0/3228493939 conn(0x7fa44c0fc7d0 msgr2=0x7fa44c06ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:39.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.587+0000 7fa452ea8640 1 -- 172.21.15.2:0/3228493939 shutdown_connections 2024-09-19T04:55:39.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:39.587+0000 7fa452ea8640 1 -- 172.21.15.2:0/3228493939 wait complete. 2024-09-19T04:55:40.364 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:55:40.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:40 smithi002 ceph-mon[30975]: pgmap v235: 97 pgs: 97 active+clean; 12 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 42 KiB/s wr, 7 op/s 2024-09-19T04:55:40.629 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:55:40.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:40 smithi018 ceph-mon[34537]: pgmap v235: 97 pgs: 97 active+clean; 12 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 42 KiB/s wr, 7 op/s 2024-09-19T04:55:40.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:40 smithi116 ceph-mon[34477]: pgmap v235: 97 pgs: 97 active+clean; 12 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 42 KiB/s wr, 7 op/s 2024-09-19T04:55:41.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.088+0000 7f5d71618640 1 -- 172.21.15.2:0/3672544734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d6c101de0 msgr2=0x7f5d6c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:41.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.088+0000 7f5d71618640 1 --2- 172.21.15.2:0/3672544734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d6c101de0 0x7f5d6c1021c0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c009900 tx=0x7f5d5c02a410 comp rx=0 tx=0).stop 2024-09-19T04:55:41.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.089+0000 7f5d71618640 1 -- 172.21.15.2:0/3672544734 shutdown_connections 2024-09-19T04:55:41.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.089+0000 7f5d71618640 1 --2- 172.21.15.2:0/3672544734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d6c106f10 0x7f5d6c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:41.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.089+0000 7f5d71618640 1 --2- 172.21.15.2:0/3672544734 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d6c102790 0x7f5d6c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:41.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.089+0000 7f5d71618640 1 --2- 172.21.15.2:0/3672544734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d6c101de0 0x7f5d6c1021c0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:41.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.089+0000 7f5d71618640 1 -- 172.21.15.2:0/3672544734 >> 172.21.15.2:0/3672544734 conn(0x7f5d6c0fd8c0 msgr2=0x7f5d6c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:41.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.089+0000 7f5d71618640 1 -- 172.21.15.2:0/3672544734 shutdown_connections 2024-09-19T04:55:41.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.089+0000 7f5d71618640 1 -- 172.21.15.2:0/3672544734 wait complete. 2024-09-19T04:55:41.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.089+0000 7f5d71618640 1 Processor -- start 2024-09-19T04:55:41.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.089+0000 7f5d71618640 1 -- start start 2024-09-19T04:55:41.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.090+0000 7f5d71618640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d6c101de0 0x7f5d6c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:41.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.090+0000 7f5d71618640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d6c102790 0x7f5d6c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:41.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.090+0000 7f5d71618640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d6c106f10 0x7f5d6c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:41.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.090+0000 7f5d71618640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5d6c111e20 con 0x7f5d6c106f10 2024-09-19T04:55:41.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.090+0000 7f5d71618640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5d6c111ca0 con 0x7f5d6c102790 2024-09-19T04:55:41.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.090+0000 7f5d71618640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f5d6c111fa0 con 0x7f5d6c101de0 2024-09-19T04:55:41.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.090+0000 7f5d6b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d6c106f10 0x7f5d6c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:41.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.090+0000 7f5d6b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d6c106f10 0x7f5d6c074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43416/0 (socket says 172.21.15.2:43416) 2024-09-19T04:55:41.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.090+0000 7f5d6b7fe640 1 -- 172.21.15.2:0/1975808323 learned_addr learned my addr 172.21.15.2:0/1975808323 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:55:41.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.090+0000 7f5d6affd640 1 --2- 172.21.15.2:0/1975808323 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d6c101de0 0x7f5d6c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:41.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.090+0000 7f5d6a7fc640 1 --2- 172.21.15.2:0/1975808323 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d6c102790 0x7f5d6c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:41.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.090+0000 7f5d6b7fe640 1 -- 172.21.15.2:0/1975808323 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d6c101de0 msgr2=0x7f5d6c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:41.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.090+0000 7f5d6b7fe640 1 --2- 172.21.15.2:0/1975808323 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d6c101de0 0x7f5d6c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:41.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.090+0000 7f5d6b7fe640 1 -- 172.21.15.2:0/1975808323 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d6c102790 msgr2=0x7f5d6c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:41.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.090+0000 7f5d6b7fe640 1 --2- 172.21.15.2:0/1975808323 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d6c102790 0x7f5d6c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:41.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.090+0000 7f5d6b7fe640 1 -- 172.21.15.2:0/1975808323 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d6c1a6840 con 0x7f5d6c106f10 2024-09-19T04:55:41.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.090+0000 7f5d6affd640 1 --2- 172.21.15.2:0/1975808323 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d6c101de0 0x7f5d6c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:55:41.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.090+0000 7f5d6a7fc640 1 --2- 172.21.15.2:0/1975808323 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d6c102790 0x7f5d6c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:55:41.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.090+0000 7f5d6b7fe640 1 --2- 172.21.15.2:0/1975808323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d6c106f10 0x7f5d6c074f70 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f5d64009fd0 tx=0x7f5d6400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:41.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.090+0000 7f5d53fff640 1 -- 172.21.15.2:0/1975808323 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d64017070 con 0x7f5d6c106f10 2024-09-19T04:55:41.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.091+0000 7f5d71618640 1 -- 172.21.15.2:0/1975808323 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d6c1a6b30 con 0x7f5d6c106f10 2024-09-19T04:55:41.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.091+0000 7f5d53fff640 1 -- 172.21.15.2:0/1975808323 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5d64003e20 con 0x7f5d6c106f10 2024-09-19T04:55:41.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.091+0000 7f5d53fff640 1 -- 172.21.15.2:0/1975808323 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d64010460 con 0x7f5d6c106f10 2024-09-19T04:55:41.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.091+0000 7f5d71618640 1 -- 172.21.15.2:0/1975808323 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d6c1a7070 con 0x7f5d6c106f10 2024-09-19T04:55:41.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.093+0000 7f5d53fff640 1 -- 172.21.15.2:0/1975808323 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f5d64003970 con 0x7f5d6c106f10 2024-09-19T04:55:41.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.093+0000 7f5d739f1740 1 Processor -- start 2024-09-19T04:55:41.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.093+0000 7f5d739f1740 1 -- start start 2024-09-19T04:55:41.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.093+0000 7f5d739f1740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5614308334a0 0x561430833880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:41.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.093+0000 7f5d739f1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561430833dc0 0x56143083e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:41.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.093+0000 7f5d739f1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56143083e680 0x561430840a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:41.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.093+0000 7f5d739f1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5614307992e0 con 0x56143083e680 2024-09-19T04:55:41.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.093+0000 7f5d739f1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561430740ce0 con 0x561430833dc0 2024-09-19T04:55:41.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.093+0000 7f5d739f1740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5614307952a0 con 0x5614308334a0 2024-09-19T04:55:41.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.094+0000 7f5d6a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56143083e680 0x561430840a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:41.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.094+0000 7f5d6a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56143083e680 0x561430840a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43428/0 (socket says 172.21.15.2:43428) 2024-09-19T04:55:41.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.094+0000 7f5d6a7fc640 1 -- 172.21.15.2:0/4036033315 learned_addr learned my addr 172.21.15.2:0/4036033315 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:55:41.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.094+0000 7f5d53fff640 1 --2- 172.21.15.2:0/1975808323 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f5d540a33b0 0x7f5d540a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:41.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.094+0000 7f5d6affd640 1 --2- 172.21.15.2:0/4036033315 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561430833dc0 0x56143083e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:41.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.094+0000 7f5d6a7fc640 1 --2- 172.21.15.2:0/4036033315 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5614308334a0 0x561430833880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:41.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.094+0000 7f5d6b7fe640 1 --2- 172.21.15.2:0/1975808323 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f5d540a33b0 0x7f5d540a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:41.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.094+0000 7f5d6a7fc640 1 -- 172.21.15.2:0/4036033315 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5614308334a0 msgr2=0x561430833880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:41.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.094+0000 7f5d6a7fc640 1 --2- 172.21.15.2:0/4036033315 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5614308334a0 0x561430833880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:41.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.094+0000 7f5d6a7fc640 1 -- 172.21.15.2:0/4036033315 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561430833dc0 msgr2=0x56143083e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:41.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.094+0000 7f5d6a7fc640 1 --2- 172.21.15.2:0/4036033315 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561430833dc0 0x56143083e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:41.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.094+0000 7f5d6a7fc640 1 -- 172.21.15.2:0/4036033315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561430725440 con 0x56143083e680 2024-09-19T04:55:41.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.094+0000 7f5d53fff640 1 -- 172.21.15.2:0/1975808323 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f5d640cfbf0 con 0x7f5d6c106f10 2024-09-19T04:55:41.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.094+0000 7f5d6a7fc640 1 --2- 172.21.15.2:0/4036033315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56143083e680 0x561430840a70 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f5d6000de60 tx=0x7f5d6000d5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cd0a60b194a4e39 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:41.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.094+0000 7f5d6b7fe640 1 --2- 172.21.15.2:0/1975808323 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f5d540a33b0 0x7f5d540a5870 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5d6409bbd0 tx=0x7f5d6406ed00 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:41.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.094+0000 7f5d517fa640 1 -- 172.21.15.2:0/4036033315 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d60012860 con 0x56143083e680 2024-09-19T04:55:41.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.094+0000 7f5d517fa640 1 -- 172.21.15.2:0/4036033315 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5d6000fe30 con 0x56143083e680 2024-09-19T04:55:41.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.094+0000 7f5d517fa640 1 -- 172.21.15.2:0/4036033315 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d60011dc0 con 0x56143083e680 2024-09-19T04:55:41.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.095+0000 7f5d739f1740 1 -- 172.21.15.2:0/4036033315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56143083e680 msgr2=0x561430840a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:41.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.095+0000 7f5d739f1740 1 --2- 172.21.15.2:0/4036033315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56143083e680 0x561430840a70 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f5d6000de60 tx=0x7f5d6000d5a0 comp rx=0 tx=0).stop 2024-09-19T04:55:41.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.095+0000 7f5d739f1740 1 -- 172.21.15.2:0/4036033315 shutdown_connections 2024-09-19T04:55:41.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.095+0000 7f5d739f1740 1 --2- 172.21.15.2:0/4036033315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56143083e680 0x561430840a70 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:41.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.095+0000 7f5d739f1740 1 --2- 172.21.15.2:0/4036033315 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561430833dc0 0x56143083e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:41.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.095+0000 7f5d739f1740 1 --2- 172.21.15.2:0/4036033315 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5614308334a0 0x561430833880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:41.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.095+0000 7f5d739f1740 1 -- 172.21.15.2:0/4036033315 >> 172.21.15.2:0/4036033315 conn(0x56143082fa30 msgr2=0x56143082fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:41.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.095+0000 7f5d739f1740 1 -- 172.21.15.2:0/4036033315 shutdown_connections 2024-09-19T04:55:41.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.095+0000 7f5d739f1740 1 -- 172.21.15.2:0/4036033315 wait complete. 2024-09-19T04:55:41.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.096+0000 7f5d739f1740 1 -- start start 2024-09-19T04:55:41.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.096+0000 7f5d739f1740 1 Processor -- start 2024-09-19T04:55:41.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.096+0000 7f5d739f1740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5614308334a0 0x56143083e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:41.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.096+0000 7f5d739f1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561430833dc0 0x56143083b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:41.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.096+0000 7f5d739f1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56143083e680 0x56143083b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:41.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.096+0000 7f5d739f1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561430841250 con 0x561430833dc0 2024-09-19T04:55:41.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.096+0000 7f5d739f1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561430754050 con 0x56143083e680 2024-09-19T04:55:41.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.096+0000 7f5d739f1740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5614308413d0 con 0x5614308334a0 2024-09-19T04:55:41.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.096+0000 7f5d739f1740 10 client.0 _ll_register_callbacks cb 0x561430794160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:55:41.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.096+0000 7f5d6affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561430833dc0 0x56143083b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:41.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.096+0000 7f5d6affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561430833dc0 0x56143083b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43432/0 (socket says 172.21.15.2:43432) 2024-09-19T04:55:41.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.096+0000 7f5d6affd640 1 -- 172.21.15.2:0/126281687 learned_addr learned my addr 172.21.15.2:0/126281687 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:55:41.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.096+0000 7f5d6a7fc640 1 --2- 172.21.15.2:0/126281687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56143083e680 0x56143083b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:41.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.096+0000 7f5d6a7fc640 1 --2- 172.21.15.2:0/126281687 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5614308334a0 0x56143083e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:41.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.097+0000 7f5d6affd640 1 -- 172.21.15.2:0/126281687 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5614308334a0 msgr2=0x56143083e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:41.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.097+0000 7f5d6affd640 1 --2- 172.21.15.2:0/126281687 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5614308334a0 0x56143083e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:41.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.097+0000 7f5d6affd640 1 -- 172.21.15.2:0/126281687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56143083e680 msgr2=0x56143083b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:41.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.097+0000 7f5d6affd640 1 --2- 172.21.15.2:0/126281687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56143083e680 0x56143083b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:41.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.097+0000 7f5d6affd640 1 -- 172.21.15.2:0/126281687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56143050a3c0 con 0x561430833dc0 2024-09-19T04:55:41.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.097+0000 7f5d6a7fc640 1 --2- 172.21.15.2:0/126281687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56143083e680 0x56143083b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:55:41.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.097+0000 7f5d6affd640 1 --2- 172.21.15.2:0/126281687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561430833dc0 0x56143083b350 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c009230 tx=0x7f5d5c0316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9e08e40a3b8343d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:41.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.097+0000 7f5d4eff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:55:41.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.097+0000 7f5d4eff5640 1 -- 172.21.15.2:0/126281687 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c040070 con 0x561430833dc0 2024-09-19T04:55:41.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.097+0000 7f5d4eff5640 1 -- 172.21.15.2:0/126281687 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f5d5c004450 con 0x561430833dc0 2024-09-19T04:55:41.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.097+0000 7f5d739f1740 1 -- 172.21.15.2:0/126281687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d6000fe30 con 0x561430833dc0 2024-09-19T04:55:41.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.097+0000 7f5d4eff5640 1 -- 172.21.15.2:0/126281687 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f5d5c035040 con 0x561430833dc0 2024-09-19T04:55:41.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.097+0000 7f5d739f1740 10 client.16314 fetch_fsmap learned FSMap version 19 2024-09-19T04:55:41.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.097+0000 7f5d739f1740 1 -- 172.21.15.2:0/126281687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56143084cd60 con 0x561430833dc0 2024-09-19T04:55:41.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.098+0000 7f5d4eff5640 1 -- 172.21.15.2:0/126281687 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5d6000fe30 con 0x561430833dc0 2024-09-19T04:55:41.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.098+0000 7f5d4eff5640 1 -- 172.21.15.2:0/126281687 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f5d5c004920 con 0x561430833dc0 2024-09-19T04:55:41.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.098+0000 7f5d739f1740 10 client.16314 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:55:41.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.098+0000 7f5d739f1740 10 client.16314 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:55:41.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.098+0000 7f5d739f1740 20 client.16314 populate_metadata read hostname 'smithi002' 2024-09-19T04:55:41.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.098+0000 7f5d739f1740 1 --2- 172.21.15.2:0/126281687 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56143084e220 0x561430850680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:41.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.098+0000 7f5d739f1740 4 client.16314 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:55:41.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.098+0000 7f5d739f1740 1 -- 172.21.15.2:0/126281687 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5614307a6850 con 0x56143084e220 2024-09-19T04:55:41.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.098+0000 7f5d6a7fc640 1 --2- 172.21.15.2:0/126281687 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56143084e220 0x561430850680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:41.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.099+0000 7f5d4eff5640 10 client.16314 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:55:41.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.099+0000 7f5d6a7fc640 1 --2- 172.21.15.2:0/126281687 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56143084e220 0x561430850680 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ee90f43b230a434 server_cookie=5f424ef0f7918cf9 in_seq=0 out_seq=0 2024-09-19T04:55:41.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.099+0000 7f5d4eff5640 1 -- 172.21.15.2:0/126281687 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5614307a6850 con 0x56143084e220 2024-09-19T04:55:41.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.099+0000 7f5d4eff5640 10 client.16314 handle_command_reply: tid=0 2024-09-19T04:55:41.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.099+0000 7f5d739f1740 1 client.16314 shutdown 2024-09-19T04:55:41.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.099+0000 7f5d739f1740 1 -- 172.21.15.2:0/126281687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561430833dc0 msgr2=0x56143083b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:41.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.099+0000 7f5d739f1740 1 --2- 172.21.15.2:0/126281687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561430833dc0 0x56143083b350 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c009230 tx=0x7f5d5c0316d0 comp rx=0 tx=0).stop 2024-09-19T04:55:41.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.100+0000 7f5d739f1740 1 -- 172.21.15.2:0/126281687 shutdown_connections 2024-09-19T04:55:41.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.100+0000 7f5d739f1740 1 --2- 172.21.15.2:0/126281687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56143083e680 0x56143083b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:41.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.100+0000 7f5d739f1740 1 --2- 172.21.15.2:0/126281687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561430833dc0 0x56143083b350 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:41.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.100+0000 7f5d739f1740 1 --2- 172.21.15.2:0/126281687 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56143084e220 0x561430850680 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:41.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.100+0000 7f5d739f1740 1 --2- 172.21.15.2:0/126281687 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5614308334a0 0x56143083e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:41.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.100+0000 7f5d739f1740 1 -- 172.21.15.2:0/126281687 >> 172.21.15.2:0/126281687 conn(0x56143082fa30 msgr2=0x561430835710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:41.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.100+0000 7f5d4eff5640 0 client.16314 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:55:41.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.100+0000 7f5d739f1740 1 -- 172.21.15.2:0/126281687 shutdown_connections 2024-09-19T04:55:41.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.100+0000 7f5d739f1740 1 -- 172.21.15.2:0/126281687 wait complete. 2024-09-19T04:55:41.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.100+0000 7f5d739f1740 20 client.16314 trim_cache size 0 max 16384 2024-09-19T04:55:41.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.117+0000 7f5d739f1740 1 Processor -- start 2024-09-19T04:55:41.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.117+0000 7f5d739f1740 1 -- start start 2024-09-19T04:55:41.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.117+0000 7f5d739f1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5614308334a0 0x56143084a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:41.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.117+0000 7f5d739f1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561430833dc0 0x561430855f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:41.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.117+0000 7f5d739f1740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56143083e680 0x561430856490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:41.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.117+0000 7f5d739f1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5d6c1ad960 con 0x561430833dc0 2024-09-19T04:55:41.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.117+0000 7f5d739f1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5d6c1b01c0 con 0x5614308334a0 2024-09-19T04:55:41.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.117+0000 7f5d739f1740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f5d6c1adfb0 con 0x56143083e680 2024-09-19T04:55:41.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.117+0000 7f5d6affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561430833dc0 0x561430855f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:41.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.117+0000 7f5d6affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561430833dc0 0x561430855f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43434/0 (socket says 172.21.15.2:43434) 2024-09-19T04:55:41.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.117+0000 7f5d6affd640 1 -- 172.21.15.2:0/508769202 learned_addr learned my addr 172.21.15.2:0/508769202 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:55:41.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.117+0000 7f5d6a7fc640 1 --2- 172.21.15.2:0/508769202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5614308334a0 0x56143084a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:41.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.117+0000 7f5d6affd640 1 -- 172.21.15.2:0/508769202 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56143083e680 msgr2=0x561430856490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:41.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.117+0000 7f5d6affd640 1 --2- 172.21.15.2:0/508769202 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56143083e680 0x561430856490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:41.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.117+0000 7f5d6affd640 1 -- 172.21.15.2:0/508769202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5614308334a0 msgr2=0x56143084a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:41.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.117+0000 7f5d6affd640 1 --2- 172.21.15.2:0/508769202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5614308334a0 0x56143084a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:41.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.117+0000 7f5d6affd640 1 -- 172.21.15.2:0/508769202 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56143083e410 con 0x561430833dc0 2024-09-19T04:55:41.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.117+0000 7f5d6a7fc640 1 --2- 172.21.15.2:0/508769202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5614308334a0 0x56143084a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:55:41.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.118+0000 7f5d6affd640 1 --2- 172.21.15.2:0/508769202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561430833dc0 0x561430855f50 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c005ab0 tx=0x7f5d5c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2f4b0cdf1374a4d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:41.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.118+0000 7f5d50ff9640 1 -- 172.21.15.2:0/508769202 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c000e60 con 0x561430833dc0 2024-09-19T04:55:41.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.118+0000 7f5d50ff9640 1 -- 172.21.15.2:0/508769202 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5d5c004450 con 0x561430833dc0 2024-09-19T04:55:41.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.118+0000 7f5d50ff9640 1 -- 172.21.15.2:0/508769202 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c051040 con 0x561430833dc0 2024-09-19T04:55:41.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.118+0000 7f5d739f1740 1 -- 172.21.15.2:0/508769202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561430833dc0 msgr2=0x561430855f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:41.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.118+0000 7f5d739f1740 1 --2- 172.21.15.2:0/508769202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561430833dc0 0x561430855f50 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c005ab0 tx=0x7f5d5c02a410 comp rx=0 tx=0).stop 2024-09-19T04:55:41.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.118+0000 7f5d739f1740 1 -- 172.21.15.2:0/508769202 shutdown_connections 2024-09-19T04:55:41.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.118+0000 7f5d739f1740 1 --2- 172.21.15.2:0/508769202 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56143083e680 0x561430856490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:41.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.118+0000 7f5d739f1740 1 --2- 172.21.15.2:0/508769202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561430833dc0 0x561430855f50 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:41.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.118+0000 7f5d739f1740 1 --2- 172.21.15.2:0/508769202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5614308334a0 0x56143084a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:41.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.118+0000 7f5d739f1740 1 -- 172.21.15.2:0/508769202 >> 172.21.15.2:0/508769202 conn(0x56143082fa30 msgr2=0x56143083d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:41.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.118+0000 7f5d739f1740 1 -- 172.21.15.2:0/508769202 shutdown_connections 2024-09-19T04:55:41.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.118+0000 7f5d739f1740 1 -- 172.21.15.2:0/508769202 wait complete. 2024-09-19T04:55:41.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.119+0000 7f5d739f1740 1 -- start start 2024-09-19T04:55:41.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.119+0000 7f5d739f1740 1 Processor -- start 2024-09-19T04:55:41.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.119+0000 7f5d739f1740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5614308334a0 0x561430841d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:41.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.119+0000 7f5d739f1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561430833dc0 0x561430842290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:41.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.119+0000 7f5d739f1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56143083e680 0x5614308b0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:41.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.119+0000 7f5d739f1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5d6c1ae680 con 0x56143083e680 2024-09-19T04:55:41.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.119+0000 7f5d739f1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5d6c1afaf0 con 0x561430833dc0 2024-09-19T04:55:41.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.119+0000 7f5d739f1740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f5d6c1aed50 con 0x5614308334a0 2024-09-19T04:55:41.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.119+0000 7f5d739f1740 10 client.0 _ll_register_callbacks cb 0x7f5d5c005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:55:41.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.119+0000 7f5d6a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56143083e680 0x5614308b0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:41.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.119+0000 7f5d6a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56143083e680 0x5614308b0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43446/0 (socket says 172.21.15.2:43446) 2024-09-19T04:55:41.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.119+0000 7f5d6a7fc640 1 -- 172.21.15.2:0/1937591839 learned_addr learned my addr 172.21.15.2:0/1937591839 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:55:41.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.119+0000 7f5d6a7fc640 1 --2- 172.21.15.2:0/1937591839 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5614308334a0 0x561430841d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:41.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.119+0000 7f5d6affd640 1 --2- 172.21.15.2:0/1937591839 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561430833dc0 0x561430842290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:41.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.120+0000 7f5d6a7fc640 1 -- 172.21.15.2:0/1937591839 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5614308334a0 msgr2=0x561430841d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:41.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.120+0000 7f5d6a7fc640 1 --2- 172.21.15.2:0/1937591839 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5614308334a0 0x561430841d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:41.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.120+0000 7f5d6a7fc640 1 -- 172.21.15.2:0/1937591839 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561430833dc0 msgr2=0x561430842290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:41.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.120+0000 7f5d6a7fc640 1 --2- 172.21.15.2:0/1937591839 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561430833dc0 0x561430842290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:41.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.120+0000 7f5d6a7fc640 1 -- 172.21.15.2:0/1937591839 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614308b15f0 con 0x56143083e680 2024-09-19T04:55:41.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.120+0000 7f5d6a7fc640 1 --2- 172.21.15.2:0/1937591839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56143083e680 0x5614308b0f50 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f5d6000db00 tx=0x7f5d60014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3809cbcc361f4b65 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:41.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.120+0000 7f5d4eff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:55:41.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.120+0000 7f5d4eff5640 1 -- 172.21.15.2:0/1937591839 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d600115f0 con 0x56143083e680 2024-09-19T04:55:41.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.120+0000 7f5d4eff5640 1 -- 172.21.15.2:0/1937591839 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f5d60011af0 con 0x56143083e680 2024-09-19T04:55:41.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.120+0000 7f5d739f1740 1 -- 172.21.15.2:0/1937591839 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d5c004450 con 0x56143083e680 2024-09-19T04:55:41.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.120+0000 7f5d4eff5640 1 -- 172.21.15.2:0/1937591839 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f5d6003c050 con 0x56143083e680 2024-09-19T04:55:41.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.120+0000 7f5d739f1740 10 client.16320 fetch_fsmap learned FSMap version 19 2024-09-19T04:55:41.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.120+0000 7f5d739f1740 1 -- 172.21.15.2:0/1937591839 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5614308b8900 con 0x56143083e680 2024-09-19T04:55:41.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.120+0000 7f5d4eff5640 1 -- 172.21.15.2:0/1937591839 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5d5c004450 con 0x56143083e680 2024-09-19T04:55:41.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.120+0000 7f5d4eff5640 1 -- 172.21.15.2:0/1937591839 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f5d6002b3d0 con 0x56143083e680 2024-09-19T04:55:41.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.121+0000 7f5d739f1740 10 client.16320 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:55:41.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.121+0000 7f5d739f1740 10 client.16320 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:55:41.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.121+0000 7f5d739f1740 20 client.16320 populate_metadata read hostname 'smithi002' 2024-09-19T04:55:41.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.121+0000 7f5d739f1740 1 --2- 172.21.15.2:0/1937591839 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5614308b8e30 0x5614308bb220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:41.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.121+0000 7f5d739f1740 4 client.16320 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:55:41.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.121+0000 7f5d739f1740 1 -- 172.21.15.2:0/1937591839 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5614307a0d60 con 0x5614308b8e30 2024-09-19T04:55:41.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.121+0000 7f5d6affd640 1 --2- 172.21.15.2:0/1937591839 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5614308b8e30 0x5614308bb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:41.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.121+0000 7f5d6affd640 1 --2- 172.21.15.2:0/1937591839 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5614308b8e30 0x5614308bb220 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c58d4a1767c48ac6 server_cookie=e3ef9c9a0069ce75 in_seq=0 out_seq=0 2024-09-19T04:55:41.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.121+0000 7f5d4eff5640 10 client.16320 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:55:41.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.122+0000 7f5d4eff5640 1 -- 172.21.15.2:0/1937591839 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5614307a0d60 con 0x5614308b8e30 2024-09-19T04:55:41.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.122+0000 7f5d4eff5640 10 client.16320 handle_command_reply: tid=0 2024-09-19T04:55:41.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.122+0000 7f5d739f1740 1 client.16320 shutdown 2024-09-19T04:55:41.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.122+0000 7f5d739f1740 1 -- 172.21.15.2:0/1937591839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56143083e680 msgr2=0x5614308b0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:41.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.122+0000 7f5d739f1740 1 --2- 172.21.15.2:0/1937591839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56143083e680 0x5614308b0f50 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f5d6000db00 tx=0x7f5d60014040 comp rx=0 tx=0).stop 2024-09-19T04:55:41.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.122+0000 7f5d739f1740 1 -- 172.21.15.2:0/1937591839 shutdown_connections 2024-09-19T04:55:41.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.122+0000 7f5d739f1740 1 --2- 172.21.15.2:0/1937591839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56143083e680 0x5614308b0f50 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:41.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.122+0000 7f5d739f1740 1 --2- 172.21.15.2:0/1937591839 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561430833dc0 0x561430842290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:41.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.122+0000 7f5d739f1740 1 --2- 172.21.15.2:0/1937591839 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5614308b8e30 0x5614308bb220 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:41.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.122+0000 7f5d739f1740 1 --2- 172.21.15.2:0/1937591839 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5614308334a0 0x561430841d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:41.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.122+0000 7f5d4eff5640 0 client.16320 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:55:41.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.122+0000 7f5d739f1740 1 -- 172.21.15.2:0/1937591839 >> 172.21.15.2:0/1937591839 conn(0x56143082fa30 msgr2=0x561430834ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:41.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.122+0000 7f5d739f1740 1 -- 172.21.15.2:0/1937591839 shutdown_connections 2024-09-19T04:55:41.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.122+0000 7f5d739f1740 1 -- 172.21.15.2:0/1937591839 wait complete. 2024-09-19T04:55:41.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.122+0000 7f5d739f1740 20 client.16320 trim_cache size 0 max 16384 2024-09-19T04:55:41.131 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:55:41.131 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T04:55:41.131 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T04:55:41.131 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:55:41.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.122+0000 7f5d71618640 1 -- 172.21.15.2:0/1975808323 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f5d540a33b0 msgr2=0x7f5d540a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:41.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.122+0000 7f5d71618640 1 --2- 172.21.15.2:0/1975808323 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f5d540a33b0 0x7f5d540a5870 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5d6409bbd0 tx=0x7f5d6406ed00 comp rx=0 tx=0).stop 2024-09-19T04:55:41.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.122+0000 7f5d71618640 1 -- 172.21.15.2:0/1975808323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d6c106f10 msgr2=0x7f5d6c074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:41.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.122+0000 7f5d71618640 1 --2- 172.21.15.2:0/1975808323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d6c106f10 0x7f5d6c074f70 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f5d64009fd0 tx=0x7f5d6400b260 comp rx=0 tx=0).stop 2024-09-19T04:55:41.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.123+0000 7f5d71618640 1 -- 172.21.15.2:0/1975808323 shutdown_connections 2024-09-19T04:55:41.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.123+0000 7f5d71618640 1 --2- 172.21.15.2:0/1975808323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d6c106f10 0x7f5d6c074f70 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:41.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.123+0000 7f5d71618640 1 --2- 172.21.15.2:0/1975808323 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d6c102790 0x7f5d6c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:41.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.123+0000 7f5d71618640 1 --2- 172.21.15.2:0/1975808323 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f5d540a33b0 0x7f5d540a5870 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:41.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.123+0000 7f5d71618640 1 --2- 172.21.15.2:0/1975808323 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d6c101de0 0x7f5d6c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:41.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.123+0000 7f5d71618640 1 -- 172.21.15.2:0/1975808323 >> 172.21.15.2:0/1975808323 conn(0x7f5d6c0fd8c0 msgr2=0x7f5d6c0fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:41.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.123+0000 7f5d71618640 1 -- 172.21.15.2:0/1975808323 shutdown_connections 2024-09-19T04:55:41.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:41.123+0000 7f5d71618640 1 -- 172.21.15.2:0/1975808323 wait complete. 2024-09-19T04:55:41.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:41 smithi018 ceph-mon[34537]: scrub queued for path: / 2024-09-19T04:55:41.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:41 smithi018 ceph-mon[34537]: scrub summary: idle+waiting paths [/] 2024-09-19T04:55:41.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:41 smithi018 ceph-mon[34537]: scrub summary: active paths [/] 2024-09-19T04:55:41.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:41 smithi018 ceph-mon[34537]: scrub summary: idle+waiting paths [/] 2024-09-19T04:55:41.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:41 smithi018 ceph-mon[34537]: scrub summary: idle 2024-09-19T04:55:41.819 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:41 smithi002 ceph-mon[30975]: scrub queued for path: / 2024-09-19T04:55:41.819 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:41 smithi002 ceph-mon[30975]: scrub summary: idle+waiting paths [/] 2024-09-19T04:55:41.819 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:41 smithi002 ceph-mon[30975]: scrub summary: active paths [/] 2024-09-19T04:55:41.819 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:41 smithi002 ceph-mon[30975]: scrub summary: idle+waiting paths [/] 2024-09-19T04:55:41.819 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:41 smithi002 ceph-mon[30975]: scrub summary: idle 2024-09-19T04:55:41.847 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:55:41.847 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:55:41.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:41 smithi116 ceph-mon[34477]: scrub queued for path: / 2024-09-19T04:55:41.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:41 smithi116 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-19T04:55:41.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:41 smithi116 ceph-mon[34477]: scrub summary: active paths [/] 2024-09-19T04:55:41.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:41 smithi116 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-19T04:55:41.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:41 smithi116 ceph-mon[34477]: scrub summary: idle 2024-09-19T04:55:42.103 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:55:42.498 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:42 smithi002 ceph-mon[30975]: pgmap v236: 97 pgs: 97 active+clean; 12 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 60 KiB/s wr, 10 op/s 2024-09-19T04:55:42.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.577+0000 7f4ea4328640 1 -- 172.21.15.2:0/1944628831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e9c103660 msgr2=0x7f4e9c10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:42.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.577+0000 7f4ea4328640 1 --2- 172.21.15.2:0/1944628831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e9c103660 0x7f4e9c10bb50 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c009900 tx=0x7f4e8c02a480 comp rx=0 tx=0).stop 2024-09-19T04:55:42.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.577+0000 7f4ea4328640 1 -- 172.21.15.2:0/1944628831 shutdown_connections 2024-09-19T04:55:42.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.577+0000 7f4ea4328640 1 --2- 172.21.15.2:0/1944628831 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e9c10c170 0x7f4e9c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:42.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.577+0000 7f4ea4328640 1 --2- 172.21.15.2:0/1944628831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e9c103660 0x7f4e9c10bb50 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:42.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.577+0000 7f4ea4328640 1 --2- 172.21.15.2:0/1944628831 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e9c102d40 0x7f4e9c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:42.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.577+0000 7f4ea4328640 1 -- 172.21.15.2:0/1944628831 >> 172.21.15.2:0/1944628831 conn(0x7f4e9c0fc7a0 msgr2=0x7f4e9c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:42.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.577+0000 7f4ea4328640 1 -- 172.21.15.2:0/1944628831 shutdown_connections 2024-09-19T04:55:42.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.577+0000 7f4ea4328640 1 -- 172.21.15.2:0/1944628831 wait complete. 2024-09-19T04:55:42.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.578+0000 7f4ea4328640 1 Processor -- start 2024-09-19T04:55:42.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.578+0000 7f4ea4328640 1 -- start start 2024-09-19T04:55:42.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.578+0000 7f4ea4328640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e9c102d40 0x7f4e9c198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:42.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.578+0000 7f4ea4328640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e9c103660 0x7f4e9c198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:42.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.578+0000 7f4ea4328640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e9c10c170 0x7f4e9c19cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:42.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.578+0000 7f4ea4328640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4e9c111e60 con 0x7f4e9c103660 2024-09-19T04:55:42.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.578+0000 7f4ea4328640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4e9c111ce0 con 0x7f4e9c102d40 2024-09-19T04:55:42.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.578+0000 7f4ea4328640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f4e9c111fe0 con 0x7f4e9c10c170 2024-09-19T04:55:42.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.578+0000 7f4ea18c3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e9c103660 0x7f4e9c198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:42.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.578+0000 7f4ea18c3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e9c103660 0x7f4e9c198880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48774/0 (socket says 172.21.15.2:48774) 2024-09-19T04:55:42.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.578+0000 7f4ea18c3640 1 -- 172.21.15.2:0/4050788055 learned_addr learned my addr 172.21.15.2:0/4050788055 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:55:42.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.578+0000 7f4ea28c5640 1 --2- 172.21.15.2:0/4050788055 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e9c10c170 0x7f4e9c19cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:42.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.578+0000 7f4ea20c4640 1 --2- 172.21.15.2:0/4050788055 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e9c102d40 0x7f4e9c198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:42.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.579+0000 7f4ea18c3640 1 -- 172.21.15.2:0/4050788055 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e9c10c170 msgr2=0x7f4e9c19cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:42.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.579+0000 7f4ea18c3640 1 --2- 172.21.15.2:0/4050788055 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e9c10c170 0x7f4e9c19cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:42.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.579+0000 7f4ea18c3640 1 -- 172.21.15.2:0/4050788055 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e9c102d40 msgr2=0x7f4e9c198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:42.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.579+0000 7f4ea18c3640 1 --2- 172.21.15.2:0/4050788055 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e9c102d40 0x7f4e9c198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:42.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.579+0000 7f4ea18c3640 1 -- 172.21.15.2:0/4050788055 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e9c19d2f0 con 0x7f4e9c103660 2024-09-19T04:55:42.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.579+0000 7f4ea20c4640 1 --2- 172.21.15.2:0/4050788055 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e9c102d40 0x7f4e9c198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:55:42.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.579+0000 7f4ea18c3640 1 --2- 172.21.15.2:0/4050788055 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e9c103660 0x7f4e9c198880 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c006010 tx=0x7f4e8c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:42.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.579+0000 7f4e937fe640 1 -- 172.21.15.2:0/4050788055 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e8c03f030 con 0x7f4e9c103660 2024-09-19T04:55:42.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.579+0000 7f4e937fe640 1 -- 172.21.15.2:0/4050788055 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4e8c003800 con 0x7f4e9c103660 2024-09-19T04:55:42.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.579+0000 7f4ea4328640 1 -- 172.21.15.2:0/4050788055 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e9c19d580 con 0x7f4e9c103660 2024-09-19T04:55:42.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.579+0000 7f4e937fe640 1 -- 172.21.15.2:0/4050788055 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e8c035070 con 0x7f4e9c103660 2024-09-19T04:55:42.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.579+0000 7f4ea4328640 1 -- 172.21.15.2:0/4050788055 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e9c1a4ec0 con 0x7f4e9c103660 2024-09-19T04:55:42.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.580+0000 7f4ea4328640 1 -- 172.21.15.2:0/4050788055 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e9c06b070 con 0x7f4e9c103660 2024-09-19T04:55:42.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.582+0000 7f4e937fe640 1 -- 172.21.15.2:0/4050788055 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f4e8c031af0 con 0x7f4e9c103660 2024-09-19T04:55:42.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.582+0000 7f4e937fe640 1 --2- 172.21.15.2:0/4050788055 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f4e880a33b0 0x7f4e880a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:42.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.582+0000 7f4ea20c4640 1 --2- 172.21.15.2:0/4050788055 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f4e880a33b0 0x7f4e880a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:42.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.582+0000 7f4e937fe640 1 -- 172.21.15.2:0/4050788055 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f4e8c0f06d0 con 0x7f4e9c103660 2024-09-19T04:55:42.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.583+0000 7f4ea20c4640 1 --2- 172.21.15.2:0/4050788055 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f4e880a33b0 0x7f4e880a5870 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4e9800baa0 tx=0x7f4e98005d90 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:42.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.587+0000 7f4e937fe640 1 -- 172.21.15.2:0/4050788055 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4e8c0bd050 con 0x7f4e9c103660 2024-09-19T04:55:42.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.796+0000 7f4ea4328640 1 -- 172.21.15.2:0/4050788055 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4e9c1071e0 con 0x7f4e9c103660 2024-09-19T04:55:42.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.797+0000 7f4e937fe640 1 -- 172.21.15.2:0/4050788055 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11840 (secure 0 0 0) 0x7f4e8c0bc950 con 0x7f4e9c103660 2024-09-19T04:55:42.799 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:55:42.799 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":19,"btime":"2024-09-19T04:46:33:537239+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2467365137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2467365137},{"type":"v1","addr":"172.21.15.2:6835","nonce":2467365137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3162441888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3162441888},{"type":"v1","addr":"172.21.15.2:6837","nonce":3162441888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14631,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2740862966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2740862966},{"type":"v1","addr":"172.21.15.2:6839","nonce":2740862966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/2394435504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2394435504},{"type":"v1","addr":"172.21.15.2:6841","nonce":2394435504}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1630480244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1630480244},{"type":"v1","addr":"172.21.15.18:6833","nonce":1630480244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1553897465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1553897465},{"type":"v1","addr":"172.21.15.116:6833","nonce":1553897465}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3035664608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3035664608},{"type":"v1","addr":"172.21.15.18:6835","nonce":3035664608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1096622392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1096622392},{"type":"v1","addr":"172.21.15.18:6837","nonce":1096622392}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3761157675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3761157675},{"type":"v1","addr":"172.21.15.116:6835","nonce":3761157675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/1120131594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1120131594},{"type":"v1","addr":"172.21.15.116:6837","nonce":1120131594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:46:24.050115+0000","modified":"2024-09-19T04:46:33.112369+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/4207677139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":4207677139},{"type":"v1","addr":"172.21.15.18:6839","nonce":4207677139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/2346874880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":2346874880},{"type":"v1","addr":"172.21.15.116:6839","nonce":2346874880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496]},"id":1}]} 2024-09-19T04:55:42.800 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 19 2024-09-19T04:55:42.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.799+0000 7f4ea4328640 1 -- 172.21.15.2:0/4050788055 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f4e880a33b0 msgr2=0x7f4e880a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:42.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.799+0000 7f4ea4328640 1 --2- 172.21.15.2:0/4050788055 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f4e880a33b0 0x7f4e880a5870 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4e9800baa0 tx=0x7f4e98005d90 comp rx=0 tx=0).stop 2024-09-19T04:55:42.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.799+0000 7f4ea4328640 1 -- 172.21.15.2:0/4050788055 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e9c103660 msgr2=0x7f4e9c198880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:42.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.799+0000 7f4ea4328640 1 --2- 172.21.15.2:0/4050788055 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e9c103660 0x7f4e9c198880 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c006010 tx=0x7f4e8c0042f0 comp rx=0 tx=0).stop 2024-09-19T04:55:42.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.799+0000 7f4ea4328640 1 -- 172.21.15.2:0/4050788055 shutdown_connections 2024-09-19T04:55:42.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.799+0000 7f4ea4328640 1 --2- 172.21.15.2:0/4050788055 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f4e880a33b0 0x7f4e880a5870 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:42.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.799+0000 7f4ea4328640 1 --2- 172.21.15.2:0/4050788055 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e9c10c170 0x7f4e9c19cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:42.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.799+0000 7f4ea4328640 1 --2- 172.21.15.2:0/4050788055 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e9c103660 0x7f4e9c198880 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:42.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.799+0000 7f4ea4328640 1 --2- 172.21.15.2:0/4050788055 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e9c102d40 0x7f4e9c198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:42.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.799+0000 7f4ea4328640 1 -- 172.21.15.2:0/4050788055 >> 172.21.15.2:0/4050788055 conn(0x7f4e9c0fc7a0 msgr2=0x7f4e9c0fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:42.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.799+0000 7f4ea4328640 1 -- 172.21.15.2:0/4050788055 shutdown_connections 2024-09-19T04:55:42.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:42.799+0000 7f4ea4328640 1 -- 172.21.15.2:0/4050788055 wait complete. 2024-09-19T04:55:42.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:42 smithi018 ceph-mon[34537]: pgmap v236: 97 pgs: 97 active+clean; 12 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 60 KiB/s wr, 10 op/s 2024-09-19T04:55:42.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:42 smithi116 ceph-mon[34477]: pgmap v236: 97 pgs: 97 active+clean; 12 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 60 KiB/s wr, 10 op/s 2024-09-19T04:55:43.540 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:55:43.802 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:55:43.806 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:43 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/4050788055' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:55:43.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:43 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/4050788055' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:55:43.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:43 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/4050788055' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:55:44.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.264+0000 7ff15438f640 1 -- 172.21.15.2:0/2610966684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff14c103660 msgr2=0x7ff14c10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:44.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.264+0000 7ff15438f640 1 --2- 172.21.15.2:0/2610966684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff14c103660 0x7ff14c10bb50 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7ff13c009900 tx=0x7ff13c02a480 comp rx=0 tx=0).stop 2024-09-19T04:55:44.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.264+0000 7ff15438f640 1 -- 172.21.15.2:0/2610966684 shutdown_connections 2024-09-19T04:55:44.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.264+0000 7ff15438f640 1 --2- 172.21.15.2:0/2610966684 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff14c10c170 0x7ff14c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:44.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.264+0000 7ff15438f640 1 --2- 172.21.15.2:0/2610966684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff14c103660 0x7ff14c10bb50 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:44.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.264+0000 7ff15438f640 1 --2- 172.21.15.2:0/2610966684 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff14c102d40 0x7ff14c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:44.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.264+0000 7ff15438f640 1 -- 172.21.15.2:0/2610966684 >> 172.21.15.2:0/2610966684 conn(0x7ff14c0fc7a0 msgr2=0x7ff14c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:44.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.264+0000 7ff15438f640 1 -- 172.21.15.2:0/2610966684 shutdown_connections 2024-09-19T04:55:44.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.264+0000 7ff15438f640 1 -- 172.21.15.2:0/2610966684 wait complete. 2024-09-19T04:55:44.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.265+0000 7ff15438f640 1 Processor -- start 2024-09-19T04:55:44.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.265+0000 7ff15438f640 1 -- start start 2024-09-19T04:55:44.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.265+0000 7ff15438f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff14c102d40 0x7ff14c1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:44.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.265+0000 7ff15438f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff14c103660 0x7ff14c100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:44.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.265+0000 7ff15438f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff14c10c170 0x7ff14c101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:44.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.265+0000 7ff15438f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff14c111e20 con 0x7ff14c102d40 2024-09-19T04:55:44.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.265+0000 7ff15438f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff14c111ca0 con 0x7ff14c103660 2024-09-19T04:55:44.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.265+0000 7ff15438f640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7ff14c111fa0 con 0x7ff14c10c170 2024-09-19T04:55:44.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.265+0000 7ff15212b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff14c102d40 0x7ff14c1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:44.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.265+0000 7ff15212b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff14c102d40 0x7ff14c1009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48778/0 (socket says 172.21.15.2:48778) 2024-09-19T04:55:44.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.265+0000 7ff15212b640 1 -- 172.21.15.2:0/2036382058 learned_addr learned my addr 172.21.15.2:0/2036382058 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:55:44.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.265+0000 7ff15192a640 1 --2- 172.21.15.2:0/2036382058 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff14c103660 0x7ff14c100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:44.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.265+0000 7ff15292c640 1 --2- 172.21.15.2:0/2036382058 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff14c10c170 0x7ff14c101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:44.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.265+0000 7ff15212b640 1 -- 172.21.15.2:0/2036382058 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff14c10c170 msgr2=0x7ff14c101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:44.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.265+0000 7ff15212b640 1 --2- 172.21.15.2:0/2036382058 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff14c10c170 0x7ff14c101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:44.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.265+0000 7ff15212b640 1 -- 172.21.15.2:0/2036382058 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff14c103660 msgr2=0x7ff14c100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:44.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.265+0000 7ff15212b640 1 --2- 172.21.15.2:0/2036382058 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff14c103660 0x7ff14c100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:44.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.265+0000 7ff15212b640 1 -- 172.21.15.2:0/2036382058 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff14c1a6830 con 0x7ff14c102d40 2024-09-19T04:55:44.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.266+0000 7ff15192a640 1 --2- 172.21.15.2:0/2036382058 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff14c103660 0x7ff14c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:55:44.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.266+0000 7ff15292c640 1 --2- 172.21.15.2:0/2036382058 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff14c10c170 0x7ff14c101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:55:44.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.266+0000 7ff15212b640 1 --2- 172.21.15.2:0/2036382058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff14c102d40 0x7ff14c1009a0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7ff14800c970 tx=0x7ff14800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:44.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.266+0000 7ff1437fe640 1 -- 172.21.15.2:0/2036382058 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff148007bb0 con 0x7ff14c102d40 2024-09-19T04:55:44.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.266+0000 7ff1437fe640 1 -- 172.21.15.2:0/2036382058 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff148007d50 con 0x7ff14c102d40 2024-09-19T04:55:44.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.266+0000 7ff15438f640 1 -- 172.21.15.2:0/2036382058 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff14c1a6b20 con 0x7ff14c102d40 2024-09-19T04:55:44.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.266+0000 7ff1437fe640 1 -- 172.21.15.2:0/2036382058 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14800f450 con 0x7ff14c102d40 2024-09-19T04:55:44.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.266+0000 7ff15438f640 1 -- 172.21.15.2:0/2036382058 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff14c1a7030 con 0x7ff14c102d40 2024-09-19T04:55:44.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.268+0000 7ff1437fe640 1 -- 172.21.15.2:0/2036382058 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7ff148004f20 con 0x7ff14c102d40 2024-09-19T04:55:44.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.269+0000 7ff156768740 1 Processor -- start 2024-09-19T04:55:44.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.269+0000 7ff156768740 1 -- start start 2024-09-19T04:55:44.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.269+0000 7ff156768740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f5b9df9b40 0x55f5b9df8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:44.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.269+0000 7ff156768740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f5b9df85d0 0x55f5b9df8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:44.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.269+0000 7ff156768740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5b9e03370 0x55f5b9e05760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:44.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.269+0000 7ff156768740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f5b9d5e2f0 con 0x55f5b9e03370 2024-09-19T04:55:44.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.269+0000 7ff156768740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f5b9d05cf0 con 0x55f5b9df85d0 2024-09-19T04:55:44.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.269+0000 7ff156768740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55f5b9d5a2b0 con 0x55f5b9df9b40 2024-09-19T04:55:44.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.269+0000 7ff15192a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5b9e03370 0x55f5b9e05760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:44.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.269+0000 7ff15192a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5b9e03370 0x55f5b9e05760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48792/0 (socket says 172.21.15.2:48792) 2024-09-19T04:55:44.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.269+0000 7ff15192a640 1 -- 172.21.15.2:0/41043326 learned_addr learned my addr 172.21.15.2:0/41043326 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:55:44.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.269+0000 7ff15292c640 1 --2- 172.21.15.2:0/41043326 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f5b9df9b40 0x55f5b9df8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:44.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.269+0000 7ff1437fe640 1 --2- 172.21.15.2:0/2036382058 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7ff1380a3430 0x7ff1380a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:44.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.269+0000 7ff15212b640 1 --2- 172.21.15.2:0/41043326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f5b9df85d0 0x55f5b9df8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:44.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.270+0000 7ff15192a640 1 -- 172.21.15.2:0/41043326 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f5b9df9b40 msgr2=0x55f5b9df8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:44.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.270+0000 7ff15192a640 1 --2- 172.21.15.2:0/41043326 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f5b9df9b40 0x55f5b9df8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:44.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.270+0000 7ff15192a640 1 -- 172.21.15.2:0/41043326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f5b9df85d0 msgr2=0x55f5b9df8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:44.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.270+0000 7ff15292c640 1 --2- 172.21.15.2:0/2036382058 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7ff1380a3430 0x7ff1380a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:44.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.270+0000 7ff15192a640 1 --2- 172.21.15.2:0/41043326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f5b9df85d0 0x55f5b9df8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:44.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.270+0000 7ff15192a640 1 -- 172.21.15.2:0/41043326 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5b9cea3a0 con 0x55f5b9e03370 2024-09-19T04:55:44.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.270+0000 7ff15212b640 1 --2- 172.21.15.2:0/41043326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f5b9df85d0 0x55f5b9df8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:55:44.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.270+0000 7ff1437fe640 1 -- 172.21.15.2:0/2036382058 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7ff1480cfae0 con 0x7ff14c102d40 2024-09-19T04:55:44.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.270+0000 7ff15192a640 1 --2- 172.21.15.2:0/41043326 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5b9e03370 0x55f5b9e05760 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7ff13c02a9a0 tx=0x7ff13c032da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8375374efb5355 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:44.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.270+0000 7ff15292c640 1 --2- 172.21.15.2:0/2036382058 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7ff1380a3430 0x7ff1380a58f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff144005fd0 tx=0x7ff144004a40 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:44.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.270+0000 7ff140dea640 1 -- 172.21.15.2:0/41043326 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff13c03f070 con 0x55f5b9e03370 2024-09-19T04:55:44.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.270+0000 7ff140dea640 1 -- 172.21.15.2:0/41043326 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff13c0316a0 con 0x55f5b9e03370 2024-09-19T04:55:44.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.270+0000 7ff140dea640 1 -- 172.21.15.2:0/41043326 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff13c035070 con 0x55f5b9e03370 2024-09-19T04:55:44.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.271+0000 7ff156768740 1 -- 172.21.15.2:0/41043326 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5b9e03370 msgr2=0x55f5b9e05760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:44.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.271+0000 7ff156768740 1 --2- 172.21.15.2:0/41043326 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5b9e03370 0x55f5b9e05760 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7ff13c02a9a0 tx=0x7ff13c032da0 comp rx=0 tx=0).stop 2024-09-19T04:55:44.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.271+0000 7ff156768740 1 -- 172.21.15.2:0/41043326 shutdown_connections 2024-09-19T04:55:44.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.271+0000 7ff156768740 1 --2- 172.21.15.2:0/41043326 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5b9e03370 0x55f5b9e05760 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:44.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.271+0000 7ff156768740 1 --2- 172.21.15.2:0/41043326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f5b9df85d0 0x55f5b9df8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:44.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.271+0000 7ff156768740 1 --2- 172.21.15.2:0/41043326 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f5b9df9b40 0x55f5b9df8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:44.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.271+0000 7ff156768740 1 -- 172.21.15.2:0/41043326 >> 172.21.15.2:0/41043326 conn(0x55f5b9dc1310 msgr2=0x55f5b9df4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:44.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.271+0000 7ff156768740 1 -- 172.21.15.2:0/41043326 shutdown_connections 2024-09-19T04:55:44.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.271+0000 7ff156768740 1 -- 172.21.15.2:0/41043326 wait complete. 2024-09-19T04:55:44.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.271+0000 7ff156768740 1 -- start start 2024-09-19T04:55:44.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.271+0000 7ff156768740 1 Processor -- start 2024-09-19T04:55:44.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.272+0000 7ff156768740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f5b9df85d0 0x55f5b9e02d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:44.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.272+0000 7ff156768740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f5b9df9b40 0x55f5b9e00010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:44.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.272+0000 7ff156768740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5b9e03370 0x55f5b9e00600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:44.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.272+0000 7ff156768740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f5b9e06010 con 0x55f5b9e03370 2024-09-19T04:55:44.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.272+0000 7ff156768740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f5b9d19060 con 0x55f5b9df9b40 2024-09-19T04:55:44.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.272+0000 7ff156768740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55f5b9e06190 con 0x55f5b9df85d0 2024-09-19T04:55:44.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.272+0000 7ff156768740 10 client.0 _ll_register_callbacks cb 0x55f5b9a6c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:55:44.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.272+0000 7ff15292c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5b9e03370 0x55f5b9e00600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:44.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.272+0000 7ff15292c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5b9e03370 0x55f5b9e00600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48800/0 (socket says 172.21.15.2:48800) 2024-09-19T04:55:44.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.272+0000 7ff15292c640 1 -- 172.21.15.2:0/3840042587 learned_addr learned my addr 172.21.15.2:0/3840042587 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:55:44.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.272+0000 7ff15192a640 1 --2- 172.21.15.2:0/3840042587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f5b9df9b40 0x55f5b9e00010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:44.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.272+0000 7ff15212b640 1 --2- 172.21.15.2:0/3840042587 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f5b9df85d0 0x55f5b9e02d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:44.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.272+0000 7ff15292c640 1 -- 172.21.15.2:0/3840042587 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f5b9df85d0 msgr2=0x55f5b9e02d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:44.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.272+0000 7ff15292c640 1 --2- 172.21.15.2:0/3840042587 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f5b9df85d0 0x55f5b9e02d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:44.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.272+0000 7ff15292c640 1 -- 172.21.15.2:0/3840042587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f5b9df9b40 msgr2=0x55f5b9e00010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:44.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.272+0000 7ff15292c640 1 --2- 172.21.15.2:0/3840042587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f5b9df9b40 0x55f5b9e00010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:44.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.272+0000 7ff15292c640 1 -- 172.21.15.2:0/3840042587 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5b9acf3c0 con 0x55f5b9e03370 2024-09-19T04:55:44.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.272+0000 7ff15192a640 1 --2- 172.21.15.2:0/3840042587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f5b9df9b40 0x55f5b9e00010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:55:44.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.272+0000 7ff15212b640 1 --2- 172.21.15.2:0/3840042587 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f5b9df85d0 0x55f5b9e02d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:55:44.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.272+0000 7ff15292c640 1 --2- 172.21.15.2:0/3840042587 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5b9e03370 0x55f5b9e00600 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7ff14401d960 tx=0x7ff144004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c668aa26e970252 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:44.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.272+0000 7ff135ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:55:44.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.273+0000 7ff135ffb640 1 -- 172.21.15.2:0/3840042587 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14402b060 con 0x55f5b9e03370 2024-09-19T04:55:44.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.273+0000 7ff135ffb640 1 -- 172.21.15.2:0/3840042587 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7ff144018070 con 0x55f5b9e03370 2024-09-19T04:55:44.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.273+0000 7ff156768740 1 -- 172.21.15.2:0/3840042587 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff13c0316a0 con 0x55f5b9e03370 2024-09-19T04:55:44.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.273+0000 7ff135ffb640 1 -- 172.21.15.2:0/3840042587 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff14401d2e0 con 0x55f5b9e03370 2024-09-19T04:55:44.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.273+0000 7ff156768740 10 client.16338 fetch_fsmap learned FSMap version 19 2024-09-19T04:55:44.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.273+0000 7ff156768740 1 -- 172.21.15.2:0/3840042587 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55f5b9e11b90 con 0x55f5b9e03370 2024-09-19T04:55:44.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.273+0000 7ff135ffb640 1 -- 172.21.15.2:0/3840042587 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff13c0316a0 con 0x55f5b9e03370 2024-09-19T04:55:44.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.273+0000 7ff135ffb640 1 -- 172.21.15.2:0/3840042587 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ff14400f040 con 0x55f5b9e03370 2024-09-19T04:55:44.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.273+0000 7ff156768740 10 client.16338 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:55:44.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.273+0000 7ff156768740 10 client.16338 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:55:44.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.273+0000 7ff156768740 20 client.16338 populate_metadata read hostname 'smithi002' 2024-09-19T04:55:44.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.273+0000 7ff156768740 1 --2- 172.21.15.2:0/3840042587 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f5b9e13050 0x55f5b9e15480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:44.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.273+0000 7ff156768740 4 client.16338 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:55:44.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.273+0000 7ff156768740 1 -- 172.21.15.2:0/3840042587 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f5b9d6b860 con 0x55f5b9e13050 2024-09-19T04:55:44.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.274+0000 7ff15212b640 1 --2- 172.21.15.2:0/3840042587 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f5b9e13050 0x55f5b9e15480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:44.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.274+0000 7ff135ffb640 10 client.16338 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:55:44.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.274+0000 7ff15212b640 1 --2- 172.21.15.2:0/3840042587 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f5b9e13050 0x55f5b9e15480 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34f46b386185a173 server_cookie=a5963705bb966f21 in_seq=0 out_seq=0 2024-09-19T04:55:44.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.275+0000 7ff135ffb640 1 -- 172.21.15.2:0/3840042587 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f5b9d6b860 con 0x55f5b9e13050 2024-09-19T04:55:44.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.275+0000 7ff135ffb640 10 client.16338 handle_command_reply: tid=0 2024-09-19T04:55:44.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.275+0000 7ff156768740 1 client.16338 shutdown 2024-09-19T04:55:44.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.275+0000 7ff156768740 1 -- 172.21.15.2:0/3840042587 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5b9e03370 msgr2=0x55f5b9e00600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:44.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.275+0000 7ff156768740 1 --2- 172.21.15.2:0/3840042587 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5b9e03370 0x55f5b9e00600 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7ff14401d960 tx=0x7ff144004ab0 comp rx=0 tx=0).stop 2024-09-19T04:55:44.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.275+0000 7ff156768740 1 -- 172.21.15.2:0/3840042587 shutdown_connections 2024-09-19T04:55:44.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.275+0000 7ff156768740 1 --2- 172.21.15.2:0/3840042587 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5b9e03370 0x55f5b9e00600 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:44.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.275+0000 7ff156768740 1 --2- 172.21.15.2:0/3840042587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f5b9df9b40 0x55f5b9e00010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:44.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.275+0000 7ff156768740 1 --2- 172.21.15.2:0/3840042587 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f5b9e13050 0x55f5b9e15480 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:44.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.275+0000 7ff156768740 1 --2- 172.21.15.2:0/3840042587 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f5b9df85d0 0x55f5b9e02d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:44.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.275+0000 7ff156768740 1 -- 172.21.15.2:0/3840042587 >> 172.21.15.2:0/3840042587 conn(0x55f5b9dc1310 msgr2=0x55f5b9dfa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:44.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.275+0000 7ff135ffb640 0 client.16338 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:55:44.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.275+0000 7ff156768740 1 -- 172.21.15.2:0/3840042587 shutdown_connections 2024-09-19T04:55:44.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.275+0000 7ff156768740 1 -- 172.21.15.2:0/3840042587 wait complete. 2024-09-19T04:55:44.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.275+0000 7ff156768740 20 client.16338 trim_cache size 0 max 16384 2024-09-19T04:55:44.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.288+0000 7ff156768740 1 Processor -- start 2024-09-19T04:55:44.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.288+0000 7ff156768740 1 -- start start 2024-09-19T04:55:44.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.288+0000 7ff156768740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f5b9df85d0 0x55f5b9e0f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:44.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.288+0000 7ff156768740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f5b9df9b40 0x55f5b9e1ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:44.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.288+0000 7ff156768740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5b9e03370 0x55f5b9e1b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:44.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.288+0000 7ff156768740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff14c1ad870 con 0x55f5b9e03370 2024-09-19T04:55:44.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.288+0000 7ff156768740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff14c1b00d0 con 0x55f5b9df85d0 2024-09-19T04:55:44.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.288+0000 7ff156768740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7ff14c1adec0 con 0x55f5b9df9b40 2024-09-19T04:55:44.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.289+0000 7ff15292c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5b9e03370 0x55f5b9e1b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:44.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.289+0000 7ff15292c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5b9e03370 0x55f5b9e1b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48802/0 (socket says 172.21.15.2:48802) 2024-09-19T04:55:44.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.289+0000 7ff15292c640 1 -- 172.21.15.2:0/365850950 learned_addr learned my addr 172.21.15.2:0/365850950 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:55:44.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.289+0000 7ff15212b640 1 --2- 172.21.15.2:0/365850950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f5b9df85d0 0x55f5b9e0f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:44.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.289+0000 7ff15192a640 1 --2- 172.21.15.2:0/365850950 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f5b9df9b40 0x55f5b9e1ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:44.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.289+0000 7ff15292c640 1 -- 172.21.15.2:0/365850950 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f5b9df9b40 msgr2=0x55f5b9e1ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:44.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.289+0000 7ff15292c640 1 --2- 172.21.15.2:0/365850950 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f5b9df9b40 0x55f5b9e1ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:44.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.289+0000 7ff15292c640 1 -- 172.21.15.2:0/365850950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f5b9df85d0 msgr2=0x55f5b9e0f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:44.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.289+0000 7ff15292c640 1 --2- 172.21.15.2:0/365850950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f5b9df85d0 0x55f5b9e0f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:44.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.289+0000 7ff15292c640 1 -- 172.21.15.2:0/365850950 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5b9e05f50 con 0x55f5b9e03370 2024-09-19T04:55:44.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.289+0000 7ff15192a640 1 --2- 172.21.15.2:0/365850950 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f5b9df9b40 0x55f5b9e1ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:55:44.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.289+0000 7ff15292c640 1 --2- 172.21.15.2:0/365850950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5b9e03370 0x55f5b9e1b290 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7ff144009910 tx=0x7ff144013cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6947eaa8bbdfc271 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:44.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.289+0000 7ff137fff640 1 -- 172.21.15.2:0/365850950 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14401b420 con 0x55f5b9e03370 2024-09-19T04:55:44.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.289+0000 7ff137fff640 1 -- 172.21.15.2:0/365850950 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff1440117b0 con 0x55f5b9e03370 2024-09-19T04:55:44.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.289+0000 7ff137fff640 1 -- 172.21.15.2:0/365850950 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff144026830 con 0x55f5b9e03370 2024-09-19T04:55:44.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.290+0000 7ff156768740 1 -- 172.21.15.2:0/365850950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5b9e03370 msgr2=0x55f5b9e1b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:44.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.290+0000 7ff156768740 1 --2- 172.21.15.2:0/365850950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5b9e03370 0x55f5b9e1b290 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7ff144009910 tx=0x7ff144013cb0 comp rx=0 tx=0).stop 2024-09-19T04:55:44.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.290+0000 7ff156768740 1 -- 172.21.15.2:0/365850950 shutdown_connections 2024-09-19T04:55:44.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.290+0000 7ff156768740 1 --2- 172.21.15.2:0/365850950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5b9e03370 0x55f5b9e1b290 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:44.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.290+0000 7ff156768740 1 --2- 172.21.15.2:0/365850950 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f5b9df9b40 0x55f5b9e1ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:44.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.290+0000 7ff156768740 1 --2- 172.21.15.2:0/365850950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f5b9df85d0 0x55f5b9e0f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:44.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.290+0000 7ff156768740 1 -- 172.21.15.2:0/365850950 >> 172.21.15.2:0/365850950 conn(0x55f5b9dc1310 msgr2=0x55f5b9dfe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:44.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.290+0000 7ff156768740 1 -- 172.21.15.2:0/365850950 shutdown_connections 2024-09-19T04:55:44.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.290+0000 7ff156768740 1 -- 172.21.15.2:0/365850950 wait complete. 2024-09-19T04:55:44.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.290+0000 7ff156768740 1 -- start start 2024-09-19T04:55:44.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.290+0000 7ff156768740 1 Processor -- start 2024-09-19T04:55:44.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.291+0000 7ff156768740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f5b9df85d0 0x55f5b9e0b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:44.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.291+0000 7ff156768740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5b9df9b40 0x55f5b9e0ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:44.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.291+0000 7ff156768740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f5b9e03370 0x55f5b9e069b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:44.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.291+0000 7ff156768740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff14c1ae590 con 0x55f5b9df9b40 2024-09-19T04:55:44.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.291+0000 7ff156768740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff14c1afa00 con 0x55f5b9e03370 2024-09-19T04:55:44.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.291+0000 7ff156768740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7ff14c1aec60 con 0x55f5b9df85d0 2024-09-19T04:55:44.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.291+0000 7ff156768740 10 client.0 _ll_register_callbacks cb 0x7ff14401d5e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:55:44.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.291+0000 7ff15192a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5b9df9b40 0x55f5b9e0ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:44.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.291+0000 7ff15192a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5b9df9b40 0x55f5b9e0ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48818/0 (socket says 172.21.15.2:48818) 2024-09-19T04:55:44.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.291+0000 7ff15192a640 1 -- 172.21.15.2:0/942527038 learned_addr learned my addr 172.21.15.2:0/942527038 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:55:44.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.291+0000 7ff15212b640 1 --2- 172.21.15.2:0/942527038 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f5b9df85d0 0x55f5b9e0b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:44.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.291+0000 7ff15192a640 1 -- 172.21.15.2:0/942527038 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f5b9df85d0 msgr2=0x55f5b9e0b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:44.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.291+0000 7ff15292c640 1 --2- 172.21.15.2:0/942527038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f5b9e03370 0x55f5b9e069b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:44.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.291+0000 7ff15192a640 1 --2- 172.21.15.2:0/942527038 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f5b9df85d0 0x55f5b9e0b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:44.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.291+0000 7ff15192a640 1 -- 172.21.15.2:0/942527038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f5b9e03370 msgr2=0x55f5b9e069b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:44.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.291+0000 7ff15192a640 1 --2- 172.21.15.2:0/942527038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f5b9e03370 0x55f5b9e069b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:44.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.291+0000 7ff15192a640 1 -- 172.21.15.2:0/942527038 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5b9e071e0 con 0x55f5b9df9b40 2024-09-19T04:55:44.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.291+0000 7ff15192a640 1 --2- 172.21.15.2:0/942527038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5b9df9b40 0x55f5b9e0ba60 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7ff13c009900 tx=0x7ff13c0316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c1f2820528afbdd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:44.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.291+0000 7ff135ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:55:44.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.291+0000 7ff135ffb640 1 -- 172.21.15.2:0/942527038 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff13c04b060 con 0x55f5b9df9b40 2024-09-19T04:55:44.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.292+0000 7ff135ffb640 1 -- 172.21.15.2:0/942527038 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7ff13c004440 con 0x55f5b9df9b40 2024-09-19T04:55:44.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.292+0000 7ff156768740 1 -- 172.21.15.2:0/942527038 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1440117b0 con 0x55f5b9df9b40 2024-09-19T04:55:44.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.292+0000 7ff135ffb640 1 -- 172.21.15.2:0/942527038 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff13c03f070 con 0x55f5b9df9b40 2024-09-19T04:55:44.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.292+0000 7ff156768740 10 client.16344 fetch_fsmap learned FSMap version 19 2024-09-19T04:55:44.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.292+0000 7ff156768740 1 -- 172.21.15.2:0/942527038 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55f5b9e7d7a0 con 0x55f5b9df9b40 2024-09-19T04:55:44.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.292+0000 7ff135ffb640 1 -- 172.21.15.2:0/942527038 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff1440117b0 con 0x55f5b9df9b40 2024-09-19T04:55:44.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.292+0000 7ff135ffb640 1 -- 172.21.15.2:0/942527038 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ff13c004950 con 0x55f5b9df9b40 2024-09-19T04:55:44.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.292+0000 7ff156768740 10 client.16344 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:55:44.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.292+0000 7ff156768740 10 client.16344 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:55:44.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.292+0000 7ff156768740 20 client.16344 populate_metadata read hostname 'smithi002' 2024-09-19T04:55:44.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.292+0000 7ff156768740 1 --2- 172.21.15.2:0/942527038 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f5b9e7dae0 0x55f5b9e7fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:44.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.292+0000 7ff156768740 4 client.16344 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:55:44.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.292+0000 7ff156768740 1 -- 172.21.15.2:0/942527038 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f5b9d65d70 con 0x55f5b9e7dae0 2024-09-19T04:55:44.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.292+0000 7ff15212b640 1 --2- 172.21.15.2:0/942527038 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f5b9e7dae0 0x55f5b9e7fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:44.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.293+0000 7ff15212b640 1 --2- 172.21.15.2:0/942527038 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f5b9e7dae0 0x55f5b9e7fed0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bca4811935a02c90 server_cookie=ae37cead6ae7468c in_seq=0 out_seq=0 2024-09-19T04:55:44.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.293+0000 7ff135ffb640 10 client.16344 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:55:44.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.293+0000 7ff135ffb640 1 -- 172.21.15.2:0/942527038 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f5b9d65d70 con 0x55f5b9e7dae0 2024-09-19T04:55:44.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.293+0000 7ff135ffb640 10 client.16344 handle_command_reply: tid=0 2024-09-19T04:55:44.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.293+0000 7ff156768740 1 client.16344 shutdown 2024-09-19T04:55:44.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.293+0000 7ff156768740 1 -- 172.21.15.2:0/942527038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5b9df9b40 msgr2=0x55f5b9e0ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:44.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.293+0000 7ff156768740 1 --2- 172.21.15.2:0/942527038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5b9df9b40 0x55f5b9e0ba60 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7ff13c009900 tx=0x7ff13c0316d0 comp rx=0 tx=0).stop 2024-09-19T04:55:44.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.293+0000 7ff156768740 1 -- 172.21.15.2:0/942527038 shutdown_connections 2024-09-19T04:55:44.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.293+0000 7ff156768740 1 --2- 172.21.15.2:0/942527038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f5b9e03370 0x55f5b9e069b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:44.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.293+0000 7ff156768740 1 --2- 172.21.15.2:0/942527038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5b9df9b40 0x55f5b9e0ba60 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:44.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.293+0000 7ff156768740 1 --2- 172.21.15.2:0/942527038 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f5b9e7dae0 0x55f5b9e7fed0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:44.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.293+0000 7ff156768740 1 --2- 172.21.15.2:0/942527038 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f5b9df85d0 0x55f5b9e0b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:44.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.293+0000 7ff156768740 1 -- 172.21.15.2:0/942527038 >> 172.21.15.2:0/942527038 conn(0x55f5b9dc1310 msgr2=0x55f5b9e01870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:44.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.293+0000 7ff135ffb640 0 client.16344 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:55:44.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.293+0000 7ff156768740 1 -- 172.21.15.2:0/942527038 shutdown_connections 2024-09-19T04:55:44.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.293+0000 7ff156768740 1 -- 172.21.15.2:0/942527038 wait complete. 2024-09-19T04:55:44.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.293+0000 7ff156768740 20 client.16344 trim_cache size 0 max 16384 2024-09-19T04:55:44.311 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T04:55:44.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.294+0000 7ff15438f640 1 -- 172.21.15.2:0/2036382058 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7ff1380a3430 msgr2=0x7ff1380a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:44.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.294+0000 7ff15438f640 1 --2- 172.21.15.2:0/2036382058 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7ff1380a3430 0x7ff1380a58f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff144005fd0 tx=0x7ff144004a40 comp rx=0 tx=0).stop 2024-09-19T04:55:44.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.294+0000 7ff15438f640 1 -- 172.21.15.2:0/2036382058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff14c102d40 msgr2=0x7ff14c1009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:44.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.294+0000 7ff15438f640 1 --2- 172.21.15.2:0/2036382058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff14c102d40 0x7ff14c1009a0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7ff14800c970 tx=0x7ff14800ce30 comp rx=0 tx=0).stop 2024-09-19T04:55:44.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.294+0000 7ff15438f640 1 -- 172.21.15.2:0/2036382058 shutdown_connections 2024-09-19T04:55:44.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.294+0000 7ff15438f640 1 --2- 172.21.15.2:0/2036382058 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7ff1380a3430 0x7ff1380a58f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:44.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.294+0000 7ff15438f640 1 --2- 172.21.15.2:0/2036382058 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff14c10c170 0x7ff14c101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:44.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.294+0000 7ff15438f640 1 --2- 172.21.15.2:0/2036382058 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff14c103660 0x7ff14c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:44.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.294+0000 7ff15438f640 1 --2- 172.21.15.2:0/2036382058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff14c102d40 0x7ff14c1009a0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:44.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.294+0000 7ff15438f640 1 -- 172.21.15.2:0/2036382058 >> 172.21.15.2:0/2036382058 conn(0x7ff14c0fc7a0 msgr2=0x7ff14c0fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:44.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.294+0000 7ff15438f640 1 -- 172.21.15.2:0/2036382058 shutdown_connections 2024-09-19T04:55:44.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:44.294+0000 7ff15438f640 1 -- 172.21.15.2:0/2036382058 wait complete. 2024-09-19T04:55:44.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:44 smithi002 ceph-mon[30975]: pgmap v237: 97 pgs: 97 active+clean; 12 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 42 KiB/s wr, 7 op/s 2024-09-19T04:55:44.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:44 smithi018 ceph-mon[34537]: pgmap v237: 97 pgs: 97 active+clean; 12 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 42 KiB/s wr, 7 op/s 2024-09-19T04:55:44.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:44 smithi116 ceph-mon[34477]: pgmap v237: 97 pgs: 97 active+clean; 12 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 42 KiB/s wr, 7 op/s 2024-09-19T04:55:46.168 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:55:46.169 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:55:46.440 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:55:46.561 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:46 smithi002 ceph-mon[30975]: pgmap v238: 97 pgs: 97 active+clean; 12 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 62 KiB/s wr, 11 op/s 2024-09-19T04:55:46.663 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:46 smithi116 ceph-mon[34477]: pgmap v238: 97 pgs: 97 active+clean; 12 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 62 KiB/s wr, 11 op/s 2024-09-19T04:55:46.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:46 smithi018 ceph-mon[34537]: pgmap v238: 97 pgs: 97 active+clean; 12 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 62 KiB/s wr, 11 op/s 2024-09-19T04:55:46.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.917+0000 7f5f321be640 1 -- 172.21.15.2:0/721833791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f2c100e20 msgr2=0x7f5f2c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:46.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.917+0000 7f5f321be640 1 --2- 172.21.15.2:0/721833791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f2c100e20 0x7f5f2c101200 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c009900 tx=0x7f5f1c02a480 comp rx=0 tx=0).stop 2024-09-19T04:55:46.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.917+0000 7f5f321be640 1 -- 172.21.15.2:0/721833791 shutdown_connections 2024-09-19T04:55:46.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.917+0000 7f5f321be640 1 --2- 172.21.15.2:0/721833791 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f2c102ef0 0x7f5f2c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:46.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.917+0000 7f5f321be640 1 --2- 172.21.15.2:0/721833791 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5f2c102570 0x7f5f2c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:46.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.917+0000 7f5f321be640 1 --2- 172.21.15.2:0/721833791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f2c100e20 0x7f5f2c101200 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:46.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.917+0000 7f5f321be640 1 -- 172.21.15.2:0/721833791 >> 172.21.15.2:0/721833791 conn(0x7f5f2c0fc7d0 msgr2=0x7f5f2c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:46.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.917+0000 7f5f321be640 1 -- 172.21.15.2:0/721833791 shutdown_connections 2024-09-19T04:55:46.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.917+0000 7f5f321be640 1 -- 172.21.15.2:0/721833791 wait complete. 2024-09-19T04:55:46.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.918+0000 7f5f321be640 1 Processor -- start 2024-09-19T04:55:46.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.918+0000 7f5f321be640 1 -- start start 2024-09-19T04:55:46.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.918+0000 7f5f321be640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f2c100e20 0x7f5f2c19a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:46.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.918+0000 7f5f321be640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f2c102570 0x7f5f2c19ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:46.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.918+0000 7f5f321be640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5f2c102ef0 0x7f5f2c19ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:46.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.918+0000 7f5f321be640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2c110e30 con 0x7f5f2c100e20 2024-09-19T04:55:46.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.918+0000 7f5f321be640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2c110cb0 con 0x7f5f2c102570 2024-09-19T04:55:46.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.918+0000 7f5f321be640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2c110fb0 con 0x7f5f2c102ef0 2024-09-19T04:55:46.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.918+0000 7f5f2b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f2c100e20 0x7f5f2c19a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:46.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.918+0000 7f5f2b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f2c100e20 0x7f5f2c19a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48832/0 (socket says 172.21.15.2:48832) 2024-09-19T04:55:46.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.918+0000 7f5f2b7fe640 1 -- 172.21.15.2:0/1473571804 learned_addr learned my addr 172.21.15.2:0/1473571804 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:55:46.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.918+0000 7f5f2bfff640 1 --2- 172.21.15.2:0/1473571804 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5f2c102ef0 0x7f5f2c19ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:46.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.918+0000 7f5f23fff640 1 --2- 172.21.15.2:0/1473571804 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f2c102570 0x7f5f2c19ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:46.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.918+0000 7f5f2b7fe640 1 -- 172.21.15.2:0/1473571804 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5f2c102ef0 msgr2=0x7f5f2c19ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:46.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.918+0000 7f5f2b7fe640 1 --2- 172.21.15.2:0/1473571804 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5f2c102ef0 0x7f5f2c19ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:46.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.918+0000 7f5f2b7fe640 1 -- 172.21.15.2:0/1473571804 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f2c102570 msgr2=0x7f5f2c19ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:46.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.918+0000 7f5f2b7fe640 1 --2- 172.21.15.2:0/1473571804 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f2c102570 0x7f5f2c19ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:46.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.918+0000 7f5f2b7fe640 1 -- 172.21.15.2:0/1473571804 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f2c19f5e0 con 0x7f5f2c100e20 2024-09-19T04:55:46.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.918+0000 7f5f23fff640 1 --2- 172.21.15.2:0/1473571804 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f2c102570 0x7f5f2c19ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:55:46.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.919+0000 7f5f2b7fe640 1 --2- 172.21.15.2:0/1473571804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f2c100e20 0x7f5f2c19a630 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c006010 tx=0x7f5f1c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:46.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.919+0000 7f5f297fa640 1 -- 172.21.15.2:0/1473571804 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c03f030 con 0x7f5f2c100e20 2024-09-19T04:55:46.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.919+0000 7f5f297fa640 1 -- 172.21.15.2:0/1473571804 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5f1c003cb0 con 0x7f5f2c100e20 2024-09-19T04:55:46.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.919+0000 7f5f321be640 1 -- 172.21.15.2:0/1473571804 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f2c19f870 con 0x7f5f2c100e20 2024-09-19T04:55:46.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.919+0000 7f5f297fa640 1 -- 172.21.15.2:0/1473571804 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c035070 con 0x7f5f2c100e20 2024-09-19T04:55:46.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.919+0000 7f5f321be640 1 -- 172.21.15.2:0/1473571804 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f2c1a71b0 con 0x7f5f2c100e20 2024-09-19T04:55:46.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.921+0000 7f5f297fa640 1 -- 172.21.15.2:0/1473571804 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f5f1c042030 con 0x7f5f2c100e20 2024-09-19T04:55:46.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.922+0000 7f5f34597740 1 Processor -- start 2024-09-19T04:55:46.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.922+0000 7f5f34597740 1 -- start start 2024-09-19T04:55:46.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.922+0000 7f5f34597740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560ba9ae6b60 0x560ba9ae6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:46.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.922+0000 7f5f34597740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560ba9ae7480 0x560ba9af1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:46.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.922+0000 7f5f34597740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ba9af1d40 0x560ba9af4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:46.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.922+0000 7f5f34597740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560ba9a4c280 con 0x560ba9af1d40 2024-09-19T04:55:46.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.922+0000 7f5f34597740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560ba99f3b10 con 0x560ba9ae6b60 2024-09-19T04:55:46.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.922+0000 7f5f34597740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x560ba9a48240 con 0x560ba9ae7480 2024-09-19T04:55:46.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.922+0000 7f5f297fa640 1 --2- 172.21.15.2:0/1473571804 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f5f180a3430 0x7f5f180a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:46.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.922+0000 7f5f23fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ba9af1d40 0x560ba9af4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:46.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.922+0000 7f5f23fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ba9af1d40 0x560ba9af4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48848/0 (socket says 172.21.15.2:48848) 2024-09-19T04:55:46.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.922+0000 7f5f23fff640 1 -- 172.21.15.2:0/1167769884 learned_addr learned my addr 172.21.15.2:0/1167769884 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:55:46.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.922+0000 7f5f2b7fe640 1 --2- 172.21.15.2:0/1167769884 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560ba9ae7480 0x560ba9af1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:46.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.922+0000 7f5f2bfff640 1 --2- 172.21.15.2:0/1473571804 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f5f180a3430 0x7f5f180a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:46.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.923+0000 7f5f2bfff640 1 --2- 172.21.15.2:0/1167769884 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560ba9ae6b60 0x560ba9ae6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:46.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.923+0000 7f5f297fa640 1 -- 172.21.15.2:0/1473571804 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f5f1c0f00e0 con 0x7f5f2c100e20 2024-09-19T04:55:46.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.923+0000 7f5f23fff640 1 -- 172.21.15.2:0/1167769884 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560ba9ae7480 msgr2=0x560ba9af1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:46.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.923+0000 7f5f23fff640 1 --2- 172.21.15.2:0/1167769884 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560ba9ae7480 0x560ba9af1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:46.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.923+0000 7f5f23fff640 1 -- 172.21.15.2:0/1167769884 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560ba9ae6b60 msgr2=0x560ba9ae6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:46.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.923+0000 7f5f23fff640 1 --2- 172.21.15.2:0/1167769884 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560ba9ae6b60 0x560ba9ae6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:46.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.923+0000 7f5f23fff640 1 -- 172.21.15.2:0/1167769884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ba9a001f0 con 0x560ba9af1d40 2024-09-19T04:55:46.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.923+0000 7f5f23fff640 1 --2- 172.21.15.2:0/1167769884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ba9af1d40 0x560ba9af4130 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f5f14009c20 tx=0x7f5f1400e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd0035f2bdaec6e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:46.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.923+0000 7f5f2bfff640 1 --2- 172.21.15.2:0/1473571804 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f5f180a3430 0x7f5f180a58f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5f24005fd0 tx=0x7f5f24004a40 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:46.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.923+0000 7f5f21ffb640 1 -- 172.21.15.2:0/1167769884 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f14016070 con 0x560ba9af1d40 2024-09-19T04:55:46.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.923+0000 7f5f21ffb640 1 -- 172.21.15.2:0/1167769884 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5f14009e50 con 0x560ba9af1d40 2024-09-19T04:55:46.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.923+0000 7f5f21ffb640 1 -- 172.21.15.2:0/1167769884 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f140106c0 con 0x560ba9af1d40 2024-09-19T04:55:46.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.924+0000 7f5f34597740 1 -- 172.21.15.2:0/1167769884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ba9af1d40 msgr2=0x560ba9af4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:46.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.924+0000 7f5f34597740 1 --2- 172.21.15.2:0/1167769884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ba9af1d40 0x560ba9af4130 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f5f14009c20 tx=0x7f5f1400e6c0 comp rx=0 tx=0).stop 2024-09-19T04:55:46.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.924+0000 7f5f34597740 1 -- 172.21.15.2:0/1167769884 shutdown_connections 2024-09-19T04:55:46.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.924+0000 7f5f34597740 1 --2- 172.21.15.2:0/1167769884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ba9af1d40 0x560ba9af4130 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:46.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.924+0000 7f5f34597740 1 --2- 172.21.15.2:0/1167769884 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560ba9ae7480 0x560ba9af1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:46.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.924+0000 7f5f34597740 1 --2- 172.21.15.2:0/1167769884 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560ba9ae6b60 0x560ba9ae6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:46.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.924+0000 7f5f34597740 1 -- 172.21.15.2:0/1167769884 >> 172.21.15.2:0/1167769884 conn(0x560ba9ae30f0 msgr2=0x560ba9ae34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:46.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.924+0000 7f5f34597740 1 -- 172.21.15.2:0/1167769884 shutdown_connections 2024-09-19T04:55:46.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.924+0000 7f5f34597740 1 -- 172.21.15.2:0/1167769884 wait complete. 2024-09-19T04:55:46.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.924+0000 7f5f34597740 1 -- start start 2024-09-19T04:55:46.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.925+0000 7f5f34597740 1 Processor -- start 2024-09-19T04:55:46.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.925+0000 7f5f34597740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560ba9ae6b60 0x560ba9aeebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:46.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.925+0000 7f5f34597740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560ba9ae7480 0x560ba9aef130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:46.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.925+0000 7f5f34597740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ba9af1d40 0x560ba9aef670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:46.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.925+0000 7f5f34597740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560ba9af4910 con 0x560ba9af1d40 2024-09-19T04:55:46.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.925+0000 7f5f34597740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560ba9a06f10 con 0x560ba9ae6b60 2024-09-19T04:55:46.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.925+0000 7f5f34597740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x560ba9af4a90 con 0x560ba9ae7480 2024-09-19T04:55:46.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.925+0000 7f5f34597740 10 client.0 _ll_register_callbacks cb 0x560ba99cfa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:55:46.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.925+0000 7f5f2bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ba9af1d40 0x560ba9aef670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:46.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.925+0000 7f5f2bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ba9af1d40 0x560ba9aef670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48858/0 (socket says 172.21.15.2:48858) 2024-09-19T04:55:46.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.925+0000 7f5f2bfff640 1 -- 172.21.15.2:0/2014910754 learned_addr learned my addr 172.21.15.2:0/2014910754 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:55:46.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.925+0000 7f5f23fff640 1 --2- 172.21.15.2:0/2014910754 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560ba9ae7480 0x560ba9aef130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:46.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.925+0000 7f5f2b7fe640 1 --2- 172.21.15.2:0/2014910754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560ba9ae6b60 0x560ba9aeebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:46.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.925+0000 7f5f2bfff640 1 -- 172.21.15.2:0/2014910754 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560ba9ae7480 msgr2=0x560ba9aef130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:46.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.925+0000 7f5f2bfff640 1 --2- 172.21.15.2:0/2014910754 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560ba9ae7480 0x560ba9aef130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:46.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.925+0000 7f5f2bfff640 1 -- 172.21.15.2:0/2014910754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560ba9ae6b60 msgr2=0x560ba9aeebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:46.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.925+0000 7f5f2bfff640 1 --2- 172.21.15.2:0/2014910754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560ba9ae6b60 0x560ba9aeebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:46.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.925+0000 7f5f2bfff640 1 -- 172.21.15.2:0/2014910754 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ba97bd6a0 con 0x560ba9af1d40 2024-09-19T04:55:46.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.926+0000 7f5f2bfff640 1 --2- 172.21.15.2:0/2014910754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ba9af1d40 0x560ba9aef670 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f5f24011a40 tx=0x7f5f24004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1f4983b9a9d376d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:46.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.926+0000 7f5f0affd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:55:46.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.926+0000 7f5f0affd640 1 -- 172.21.15.2:0/2014910754 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f24024070 con 0x560ba9af1d40 2024-09-19T04:55:46.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.926+0000 7f5f0affd640 1 -- 172.21.15.2:0/2014910754 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f5f2400cd40 con 0x560ba9af1d40 2024-09-19T04:55:46.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.926+0000 7f5f34597740 1 -- 172.21.15.2:0/2014910754 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f14009e50 con 0x560ba9af1d40 2024-09-19T04:55:46.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.926+0000 7f5f0affd640 1 -- 172.21.15.2:0/2014910754 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f5f24030050 con 0x560ba9af1d40 2024-09-19T04:55:46.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.926+0000 7f5f34597740 10 client.16356 fetch_fsmap learned FSMap version 19 2024-09-19T04:55:46.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.926+0000 7f5f34597740 1 -- 172.21.15.2:0/2014910754 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x560ba9b00540 con 0x560ba9af1d40 2024-09-19T04:55:46.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.926+0000 7f5f0affd640 1 -- 172.21.15.2:0/2014910754 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5f14009e50 con 0x560ba9af1d40 2024-09-19T04:55:46.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.926+0000 7f5f0affd640 1 -- 172.21.15.2:0/2014910754 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f5f2401c070 con 0x560ba9af1d40 2024-09-19T04:55:46.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.926+0000 7f5f34597740 10 client.16356 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:55:46.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.926+0000 7f5f34597740 10 client.16356 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:55:46.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.926+0000 7f5f34597740 20 client.16356 populate_metadata read hostname 'smithi002' 2024-09-19T04:55:46.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.926+0000 7f5f34597740 1 --2- 172.21.15.2:0/2014910754 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560ba9b01950 0x560ba9b03df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:46.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.926+0000 7f5f34597740 4 client.16356 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:55:46.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.926+0000 7f5f34597740 1 -- 172.21.15.2:0/2014910754 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560ba9a597f0 con 0x560ba9b01950 2024-09-19T04:55:46.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.927+0000 7f5f2b7fe640 1 --2- 172.21.15.2:0/2014910754 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560ba9b01950 0x560ba9b03df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:46.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.927+0000 7f5f2b7fe640 1 --2- 172.21.15.2:0/2014910754 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560ba9b01950 0x560ba9b03df0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f24335266ba3db44 server_cookie=80b3d08337af9e6d in_seq=0 out_seq=0 2024-09-19T04:55:46.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.927+0000 7f5f0affd640 10 client.16356 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:55:46.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.928+0000 7f5f0affd640 1 -- 172.21.15.2:0/2014910754 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560ba9a597f0 con 0x560ba9b01950 2024-09-19T04:55:46.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.928+0000 7f5f0affd640 10 client.16356 handle_command_reply: tid=0 2024-09-19T04:55:46.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.928+0000 7f5f34597740 1 client.16356 shutdown 2024-09-19T04:55:46.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.928+0000 7f5f34597740 1 -- 172.21.15.2:0/2014910754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ba9af1d40 msgr2=0x560ba9aef670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:46.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.928+0000 7f5f34597740 1 --2- 172.21.15.2:0/2014910754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ba9af1d40 0x560ba9aef670 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f5f24011a40 tx=0x7f5f24004ab0 comp rx=0 tx=0).stop 2024-09-19T04:55:46.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.928+0000 7f5f34597740 1 -- 172.21.15.2:0/2014910754 shutdown_connections 2024-09-19T04:55:46.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.928+0000 7f5f34597740 1 --2- 172.21.15.2:0/2014910754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ba9af1d40 0x560ba9aef670 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:46.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.928+0000 7f5f34597740 1 --2- 172.21.15.2:0/2014910754 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560ba9b01950 0x560ba9b03df0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:46.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.928+0000 7f5f34597740 1 --2- 172.21.15.2:0/2014910754 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560ba9ae7480 0x560ba9aef130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:46.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.928+0000 7f5f34597740 1 --2- 172.21.15.2:0/2014910754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560ba9ae6b60 0x560ba9aeebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:46.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.928+0000 7f5f34597740 1 -- 172.21.15.2:0/2014910754 >> 172.21.15.2:0/2014910754 conn(0x560ba9ae30f0 msgr2=0x560ba9ae8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:46.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.928+0000 7f5f0affd640 0 client.16356 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:55:46.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.928+0000 7f5f34597740 1 -- 172.21.15.2:0/2014910754 shutdown_connections 2024-09-19T04:55:46.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.928+0000 7f5f34597740 1 -- 172.21.15.2:0/2014910754 wait complete. 2024-09-19T04:55:46.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.929+0000 7f5f34597740 20 client.16356 trim_cache size 0 max 16384 2024-09-19T04:55:46.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.946+0000 7f5f34597740 1 Processor -- start 2024-09-19T04:55:46.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.946+0000 7f5f34597740 1 -- start start 2024-09-19T04:55:46.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.946+0000 7f5f34597740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560ba9ae6b60 0x560ba9ae8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:46.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.946+0000 7f5f34597740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560ba9ae7480 0x560ba9b09710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:46.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.946+0000 7f5f34597740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ba9af1d40 0x560ba9b09c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:46.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.946+0000 7f5f34597740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2c1ad890 con 0x560ba9af1d40 2024-09-19T04:55:46.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.946+0000 7f5f34597740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2c1b00f0 con 0x560ba9ae6b60 2024-09-19T04:55:46.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.946+0000 7f5f34597740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2c1adee0 con 0x560ba9ae7480 2024-09-19T04:55:46.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.946+0000 7f5f2bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ba9af1d40 0x560ba9b09c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:46.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.946+0000 7f5f2bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ba9af1d40 0x560ba9b09c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48874/0 (socket says 172.21.15.2:48874) 2024-09-19T04:55:46.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.946+0000 7f5f2bfff640 1 -- 172.21.15.2:0/2815952865 learned_addr learned my addr 172.21.15.2:0/2815952865 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:55:46.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.946+0000 7f5f2b7fe640 1 --2- 172.21.15.2:0/2815952865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560ba9ae6b60 0x560ba9ae8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:46.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.946+0000 7f5f2bfff640 1 -- 172.21.15.2:0/2815952865 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560ba9ae7480 msgr2=0x560ba9b09710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:46.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.946+0000 7f5f2bfff640 1 --2- 172.21.15.2:0/2815952865 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560ba9ae7480 0x560ba9b09710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:46.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.946+0000 7f5f2bfff640 1 -- 172.21.15.2:0/2815952865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560ba9ae6b60 msgr2=0x560ba9ae8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:46.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.946+0000 7f5f2bfff640 1 --2- 172.21.15.2:0/2815952865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560ba9ae6b60 0x560ba9ae8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:46.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.947+0000 7f5f2bfff640 1 -- 172.21.15.2:0/2815952865 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ba9ae3ca0 con 0x560ba9af1d40 2024-09-19T04:55:46.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.947+0000 7f5f2bfff640 1 --2- 172.21.15.2:0/2815952865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ba9af1d40 0x560ba9b09c50 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f5f24028510 tx=0x7f5f2400f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b310d88361c8991 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:46.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.947+0000 7f5f217fa640 1 -- 172.21.15.2:0/2815952865 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f24039070 con 0x560ba9af1d40 2024-09-19T04:55:46.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.947+0000 7f5f217fa640 1 -- 172.21.15.2:0/2815952865 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5f240115b0 con 0x560ba9af1d40 2024-09-19T04:55:46.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.947+0000 7f5f217fa640 1 -- 172.21.15.2:0/2815952865 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f24024040 con 0x560ba9af1d40 2024-09-19T04:55:46.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.947+0000 7f5f34597740 1 -- 172.21.15.2:0/2815952865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ba9af1d40 msgr2=0x560ba9b09c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:46.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.947+0000 7f5f34597740 1 --2- 172.21.15.2:0/2815952865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ba9af1d40 0x560ba9b09c50 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f5f24028510 tx=0x7f5f2400f4a0 comp rx=0 tx=0).stop 2024-09-19T04:55:46.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.947+0000 7f5f34597740 1 -- 172.21.15.2:0/2815952865 shutdown_connections 2024-09-19T04:55:46.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.947+0000 7f5f34597740 1 --2- 172.21.15.2:0/2815952865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ba9af1d40 0x560ba9b09c50 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:46.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.947+0000 7f5f34597740 1 --2- 172.21.15.2:0/2815952865 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560ba9ae7480 0x560ba9b09710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:46.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.947+0000 7f5f34597740 1 --2- 172.21.15.2:0/2815952865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560ba9ae6b60 0x560ba9ae8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:46.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.947+0000 7f5f34597740 1 -- 172.21.15.2:0/2815952865 >> 172.21.15.2:0/2815952865 conn(0x560ba9ae30f0 msgr2=0x560ba9ae85b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:46.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.948+0000 7f5f34597740 1 -- 172.21.15.2:0/2815952865 shutdown_connections 2024-09-19T04:55:46.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.948+0000 7f5f34597740 1 -- 172.21.15.2:0/2815952865 wait complete. 2024-09-19T04:55:46.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.948+0000 7f5f34597740 1 -- start start 2024-09-19T04:55:46.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.948+0000 7f5f34597740 1 Processor -- start 2024-09-19T04:55:46.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.948+0000 7f5f34597740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560ba9ae6b60 0x560ba9afa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:46.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.948+0000 7f5f34597740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560ba9ae7480 0x560ba9af5720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:46.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.948+0000 7f5f34597740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ba9af1d40 0x560ba9af5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:46.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.948+0000 7f5f34597740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2c1ae5b0 con 0x560ba9af1d40 2024-09-19T04:55:46.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.948+0000 7f5f34597740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2c1afa20 con 0x560ba9ae6b60 2024-09-19T04:55:46.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.948+0000 7f5f34597740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2c1aec80 con 0x560ba9ae7480 2024-09-19T04:55:46.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.948+0000 7f5f34597740 10 client.0 _ll_register_callbacks cb 0x7f5f24011500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:55:46.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.949+0000 7f5f2bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ba9af1d40 0x560ba9af5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:46.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.949+0000 7f5f2bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ba9af1d40 0x560ba9af5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48890/0 (socket says 172.21.15.2:48890) 2024-09-19T04:55:46.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.949+0000 7f5f2bfff640 1 -- 172.21.15.2:0/377369270 learned_addr learned my addr 172.21.15.2:0/377369270 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:55:46.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.949+0000 7f5f23fff640 1 --2- 172.21.15.2:0/377369270 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560ba9ae7480 0x560ba9af5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:46.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.949+0000 7f5f2b7fe640 1 --2- 172.21.15.2:0/377369270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560ba9ae6b60 0x560ba9afa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:46.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.949+0000 7f5f2bfff640 1 -- 172.21.15.2:0/377369270 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560ba9ae7480 msgr2=0x560ba9af5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:46.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.949+0000 7f5f2bfff640 1 --2- 172.21.15.2:0/377369270 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560ba9ae7480 0x560ba9af5720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:46.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.949+0000 7f5f2bfff640 1 -- 172.21.15.2:0/377369270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560ba9ae6b60 msgr2=0x560ba9afa3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:46.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.949+0000 7f5f2bfff640 1 --2- 172.21.15.2:0/377369270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560ba9ae6b60 0x560ba9afa3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:46.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.949+0000 7f5f2bfff640 1 -- 172.21.15.2:0/377369270 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ba9af6460 con 0x560ba9af1d40 2024-09-19T04:55:46.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.949+0000 7f5f2bfff640 1 --2- 172.21.15.2:0/377369270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ba9af1d40 0x560ba9af5c60 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f5f24028600 tx=0x7f5f2400ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4164666547940fc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:46.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.949+0000 7f5f0affd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:55:46.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.949+0000 7f5f0affd640 1 -- 172.21.15.2:0/377369270 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f24039070 con 0x560ba9af1d40 2024-09-19T04:55:46.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.949+0000 7f5f0affd640 1 -- 172.21.15.2:0/377369270 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7f5f24028a90 con 0x560ba9af1d40 2024-09-19T04:55:46.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.949+0000 7f5f34597740 1 -- 172.21.15.2:0/377369270 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f240115b0 con 0x560ba9af1d40 2024-09-19T04:55:46.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.950+0000 7f5f0affd640 1 -- 172.21.15.2:0/377369270 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f5f24024040 con 0x560ba9af1d40 2024-09-19T04:55:46.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.950+0000 7f5f34597740 10 client.16362 fetch_fsmap learned FSMap version 19 2024-09-19T04:55:46.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.950+0000 7f5f34597740 1 -- 172.21.15.2:0/377369270 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x560ba9b6c6f0 con 0x560ba9af1d40 2024-09-19T04:55:46.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.950+0000 7f5f0affd640 1 -- 172.21.15.2:0/377369270 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5f240115b0 con 0x560ba9af1d40 2024-09-19T04:55:46.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.950+0000 7f5f0affd640 1 -- 172.21.15.2:0/377369270 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f5f2401c070 con 0x560ba9af1d40 2024-09-19T04:55:46.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.950+0000 7f5f34597740 10 client.16362 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:55:46.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.950+0000 7f5f34597740 10 client.16362 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:55:46.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.950+0000 7f5f34597740 20 client.16362 populate_metadata read hostname 'smithi002' 2024-09-19T04:55:46.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.950+0000 7f5f34597740 1 --2- 172.21.15.2:0/377369270 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560ba9b6cd60 0x560ba9b6f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:46.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.950+0000 7f5f34597740 4 client.16362 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:55:46.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.950+0000 7f5f34597740 1 -- 172.21.15.2:0/377369270 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560ba9a53d00 con 0x560ba9b6cd60 2024-09-19T04:55:46.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.950+0000 7f5f2b7fe640 1 --2- 172.21.15.2:0/377369270 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560ba9b6cd60 0x560ba9b6f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:46.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.951+0000 7f5f2b7fe640 1 --2- 172.21.15.2:0/377369270 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560ba9b6cd60 0x560ba9b6f150 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3dcaf370b77244b server_cookie=c9eb2b41b520650a in_seq=0 out_seq=0 2024-09-19T04:55:46.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.951+0000 7f5f0affd640 10 client.16362 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:55:46.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.951+0000 7f5f0affd640 1 -- 172.21.15.2:0/377369270 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560ba9a53d00 con 0x560ba9b6cd60 2024-09-19T04:55:46.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.951+0000 7f5f0affd640 10 client.16362 handle_command_reply: tid=0 2024-09-19T04:55:46.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.951+0000 7f5f34597740 1 client.16362 shutdown 2024-09-19T04:55:46.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.952+0000 7f5f34597740 1 -- 172.21.15.2:0/377369270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ba9af1d40 msgr2=0x560ba9af5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:46.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.952+0000 7f5f34597740 1 --2- 172.21.15.2:0/377369270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ba9af1d40 0x560ba9af5c60 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f5f24028600 tx=0x7f5f2400ce40 comp rx=0 tx=0).stop 2024-09-19T04:55:46.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.952+0000 7f5f34597740 1 -- 172.21.15.2:0/377369270 shutdown_connections 2024-09-19T04:55:46.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.952+0000 7f5f34597740 1 --2- 172.21.15.2:0/377369270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ba9af1d40 0x560ba9af5c60 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:46.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.952+0000 7f5f34597740 1 --2- 172.21.15.2:0/377369270 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560ba9b6cd60 0x560ba9b6f150 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:46.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.952+0000 7f5f34597740 1 --2- 172.21.15.2:0/377369270 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560ba9ae7480 0x560ba9af5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:46.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.952+0000 7f5f0affd640 0 client.16362 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:55:46.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.952+0000 7f5f34597740 1 --2- 172.21.15.2:0/377369270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560ba9ae6b60 0x560ba9afa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:46.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.952+0000 7f5f34597740 1 -- 172.21.15.2:0/377369270 >> 172.21.15.2:0/377369270 conn(0x560ba9ae30f0 msgr2=0x560ba9ae2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:46.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.952+0000 7f5f34597740 1 -- 172.21.15.2:0/377369270 shutdown_connections 2024-09-19T04:55:46.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.952+0000 7f5f34597740 1 -- 172.21.15.2:0/377369270 wait complete. 2024-09-19T04:55:46.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.952+0000 7f5f34597740 20 client.16362 trim_cache size 0 max 16384 2024-09-19T04:55:46.960 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:55:46.960 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T04:55:46.961 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "42852ae6-a330-4768-8f50-ae6cb619361f", 2024-09-19T04:55:46.961 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T04:55:46.961 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:55:46.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.953+0000 7f5f321be640 1 -- 172.21.15.2:0/1473571804 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f5f180a3430 msgr2=0x7f5f180a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:46.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.953+0000 7f5f321be640 1 --2- 172.21.15.2:0/1473571804 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f5f180a3430 0x7f5f180a58f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5f24005fd0 tx=0x7f5f24004a40 comp rx=0 tx=0).stop 2024-09-19T04:55:46.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.953+0000 7f5f321be640 1 -- 172.21.15.2:0/1473571804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f2c100e20 msgr2=0x7f5f2c19a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.953+0000 7f5f321be640 1 --2- 172.21.15.2:0/1473571804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f2c100e20 0x7f5f2c19a630 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c006010 tx=0x7f5f1c0042f0 comp rx=0 tx=0).stop 2024-09-19T04:55:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.953+0000 7f5f321be640 1 -- 172.21.15.2:0/1473571804 shutdown_connections 2024-09-19T04:55:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.953+0000 7f5f321be640 1 --2- 172.21.15.2:0/1473571804 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f5f180a3430 0x7f5f180a58f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.953+0000 7f5f321be640 1 --2- 172.21.15.2:0/1473571804 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5f2c102ef0 0x7f5f2c19ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.953+0000 7f5f321be640 1 --2- 172.21.15.2:0/1473571804 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f2c102570 0x7f5f2c19ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.953+0000 7f5f321be640 1 --2- 172.21.15.2:0/1473571804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f2c100e20 0x7f5f2c19a630 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:46.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.953+0000 7f5f321be640 1 -- 172.21.15.2:0/1473571804 >> 172.21.15.2:0/1473571804 conn(0x7f5f2c0fc7d0 msgr2=0x7f5f2c06a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:46.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.953+0000 7f5f321be640 1 -- 172.21.15.2:0/1473571804 shutdown_connections 2024-09-19T04:55:46.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:46.953+0000 7f5f321be640 1 -- 172.21.15.2:0/1473571804 wait complete. 2024-09-19T04:55:47.728 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:55:47.990 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:55:48.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.414+0000 7fad4f95b640 1 -- 172.21.15.2:0/2926584581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad4810c180 msgr2=0x7fad4810e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:48.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.414+0000 7fad4f95b640 1 --2- 172.21.15.2:0/2926584581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad4810c180 0x7fad4810e600 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fad40009ca0 tx=0x7fad4002a950 comp rx=0 tx=0).stop 2024-09-19T04:55:48.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.414+0000 7fad4f95b640 1 -- 172.21.15.2:0/2926584581 shutdown_connections 2024-09-19T04:55:48.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.414+0000 7fad4f95b640 1 --2- 172.21.15.2:0/2926584581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad4810c180 0x7fad4810e600 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:48.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.414+0000 7fad4f95b640 1 --2- 172.21.15.2:0/2926584581 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad481036c0 0x7fad4810bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:48.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.414+0000 7fad4f95b640 1 --2- 172.21.15.2:0/2926584581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad48102da0 0x7fad48103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:48.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.414+0000 7fad4f95b640 1 -- 172.21.15.2:0/2926584581 >> 172.21.15.2:0/2926584581 conn(0x7fad480fc7a0 msgr2=0x7fad480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:48.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.414+0000 7fad4f95b640 1 -- 172.21.15.2:0/2926584581 shutdown_connections 2024-09-19T04:55:48.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.414+0000 7fad4f95b640 1 -- 172.21.15.2:0/2926584581 wait complete. 2024-09-19T04:55:48.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.415+0000 7fad4f95b640 1 Processor -- start 2024-09-19T04:55:48.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.415+0000 7fad4f95b640 1 -- start start 2024-09-19T04:55:48.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.415+0000 7fad4f95b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad48102da0 0x7fad4819a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:48.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.415+0000 7fad4f95b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad481036c0 0x7fad4819aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:48.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.415+0000 7fad4f95b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad4810c180 0x7fad4819edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:48.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.415+0000 7fad4f95b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fad48111ea0 con 0x7fad481036c0 2024-09-19T04:55:48.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.415+0000 7fad4f95b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fad48111d20 con 0x7fad48102da0 2024-09-19T04:55:48.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.415+0000 7fad4f95b640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fad48112020 con 0x7fad4810c180 2024-09-19T04:55:48.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.415+0000 7fad4cef6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad481036c0 0x7fad4819aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:48.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.415+0000 7fad4cef6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad481036c0 0x7fad4819aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48908/0 (socket says 172.21.15.2:48908) 2024-09-19T04:55:48.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.415+0000 7fad4cef6640 1 -- 172.21.15.2:0/4275007191 learned_addr learned my addr 172.21.15.2:0/4275007191 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:55:48.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.415+0000 7fad4def8640 1 --2- 172.21.15.2:0/4275007191 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad4810c180 0x7fad4819edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:48.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.416+0000 7fad4d6f7640 1 --2- 172.21.15.2:0/4275007191 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad48102da0 0x7fad4819a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:48.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.416+0000 7fad4cef6640 1 -- 172.21.15.2:0/4275007191 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad4810c180 msgr2=0x7fad4819edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:48.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.416+0000 7fad4cef6640 1 --2- 172.21.15.2:0/4275007191 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad4810c180 0x7fad4819edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:48.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.416+0000 7fad4cef6640 1 -- 172.21.15.2:0/4275007191 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad48102da0 msgr2=0x7fad4819a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:48.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.416+0000 7fad4cef6640 1 --2- 172.21.15.2:0/4275007191 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad48102da0 0x7fad4819a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:48.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.416+0000 7fad4cef6640 1 -- 172.21.15.2:0/4275007191 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad4819f490 con 0x7fad481036c0 2024-09-19T04:55:48.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.416+0000 7fad4def8640 1 --2- 172.21.15.2:0/4275007191 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad4810c180 0x7fad4819edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:55:48.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.416+0000 7fad4cef6640 1 --2- 172.21.15.2:0/4275007191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad481036c0 0x7fad4819aa20 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fad3c00c920 tx=0x7fad3c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:48.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.416+0000 7fad3a7fc640 1 -- 172.21.15.2:0/4275007191 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3c007c70 con 0x7fad481036c0 2024-09-19T04:55:48.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.416+0000 7fad3a7fc640 1 -- 172.21.15.2:0/4275007191 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fad3c007e10 con 0x7fad481036c0 2024-09-19T04:55:48.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.416+0000 7fad3a7fc640 1 -- 172.21.15.2:0/4275007191 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3c018820 con 0x7fad481036c0 2024-09-19T04:55:48.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.416+0000 7fad4f95b640 1 -- 172.21.15.2:0/4275007191 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad4819f780 con 0x7fad481036c0 2024-09-19T04:55:48.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.416+0000 7fad4f95b640 1 -- 172.21.15.2:0/4275007191 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad481a7060 con 0x7fad481036c0 2024-09-19T04:55:48.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.419+0000 7fad3a7fc640 1 -- 172.21.15.2:0/4275007191 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fad3c0189c0 con 0x7fad481036c0 2024-09-19T04:55:48.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.419+0000 7fad51d34740 1 Processor -- start 2024-09-19T04:55:48.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.419+0000 7fad51d34740 1 -- start start 2024-09-19T04:55:48.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.420+0000 7fad51d34740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac79a754a0 0x55ac79a75880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:48.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.420+0000 7fad51d34740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ac79a75dc0 0x55ac79a80140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:48.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.420+0000 7fad51d34740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac79a80680 0x55ac79a82a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:48.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.420+0000 7fad51d34740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ac799db2e0 con 0x55ac79a80680 2024-09-19T04:55:48.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.420+0000 7fad51d34740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ac79982ce0 con 0x55ac79a754a0 2024-09-19T04:55:48.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.420+0000 7fad51d34740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55ac799d72a0 con 0x55ac79a75dc0 2024-09-19T04:55:48.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.420+0000 7fad4cef6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac79a80680 0x55ac79a82a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:48.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.420+0000 7fad4d6f7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ac79a75dc0 0x55ac79a80140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:48.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.420+0000 7fad4d6f7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ac79a75dc0 0x55ac79a80140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.2:49756/0 (socket says 172.21.15.2:49756) 2024-09-19T04:55:48.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.420+0000 7fad4def8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac79a754a0 0x55ac79a75880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:48.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.420+0000 7fad4d6f7640 1 -- 172.21.15.2:0/3636129555 learned_addr learned my addr 172.21.15.2:0/3636129555 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:55:48.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.420+0000 7fad4d6f7640 1 -- 172.21.15.2:0/3636129555 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac79a754a0 msgr2=0x55ac79a75880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:48.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.420+0000 7fad4d6f7640 1 --2- 172.21.15.2:0/3636129555 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac79a754a0 0x55ac79a75880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:48.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.420+0000 7fad4d6f7640 1 -- 172.21.15.2:0/3636129555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac79a80680 msgr2=0x55ac79a82a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:48.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.420+0000 7fad4d6f7640 1 --2- 172.21.15.2:0/3636129555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac79a80680 0x55ac79a82a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:48.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.420+0000 7fad4d6f7640 1 -- 172.21.15.2:0/3636129555 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac79967440 con 0x55ac79a75dc0 2024-09-19T04:55:48.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.420+0000 7fad3a7fc640 1 --2- 172.21.15.2:0/4275007191 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fad340a33b0 0x7fad340a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:48.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.420+0000 7fad4def8640 1 --2- 172.21.15.2:0/4275007191 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fad340a33b0 0x7fad340a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:48.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.420+0000 7fad4d6f7640 1 --2- 172.21.15.2:0/3636129555 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ac79a75dc0 0x55ac79a80140 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fad4400b820 tx=0x7fad4400bce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a405abfa50a759b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:48.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.420+0000 7fad3a7fc640 1 -- 172.21.15.2:0/4275007191 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7fad3c0cffa0 con 0x7fad481036c0 2024-09-19T04:55:48.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.421+0000 7fad337fe640 1 -- 172.21.15.2:0/3636129555 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad4400d950 con 0x55ac79a75dc0 2024-09-19T04:55:48.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.421+0000 7fad337fe640 1 -- 172.21.15.2:0/3636129555 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fad44019070 con 0x55ac79a75dc0 2024-09-19T04:55:48.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.421+0000 7fad337fe640 1 -- 172.21.15.2:0/3636129555 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad440123e0 con 0x55ac79a75dc0 2024-09-19T04:55:48.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.421+0000 7fad51d34740 1 -- 172.21.15.2:0/3636129555 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ac79a75dc0 msgr2=0x55ac79a80140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:48.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.421+0000 7fad4def8640 1 --2- 172.21.15.2:0/4275007191 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fad340a33b0 0x7fad340a5870 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fad40009430 tx=0x7fad40009360 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:48.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.421+0000 7fad51d34740 1 --2- 172.21.15.2:0/3636129555 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ac79a75dc0 0x55ac79a80140 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fad4400b820 tx=0x7fad4400bce0 comp rx=0 tx=0).stop 2024-09-19T04:55:48.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.421+0000 7fad51d34740 1 -- 172.21.15.2:0/3636129555 shutdown_connections 2024-09-19T04:55:48.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.421+0000 7fad51d34740 1 --2- 172.21.15.2:0/3636129555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac79a80680 0x55ac79a82a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:48.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.421+0000 7fad51d34740 1 --2- 172.21.15.2:0/3636129555 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ac79a75dc0 0x55ac79a80140 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:48.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.421+0000 7fad51d34740 1 --2- 172.21.15.2:0/3636129555 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac79a754a0 0x55ac79a75880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:48.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.421+0000 7fad51d34740 1 -- 172.21.15.2:0/3636129555 >> 172.21.15.2:0/3636129555 conn(0x55ac79a71a30 msgr2=0x55ac79a71e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:48.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.422+0000 7fad51d34740 1 -- 172.21.15.2:0/3636129555 shutdown_connections 2024-09-19T04:55:48.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.422+0000 7fad51d34740 1 -- 172.21.15.2:0/3636129555 wait complete. 2024-09-19T04:55:48.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.422+0000 7fad51d34740 1 -- start start 2024-09-19T04:55:48.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.422+0000 7fad51d34740 1 Processor -- start 2024-09-19T04:55:48.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.422+0000 7fad51d34740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac79a754a0 0x55ac79a7ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:48.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.422+0000 7fad51d34740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac79a75dc0 0x55ac79a7d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:48.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.422+0000 7fad51d34740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ac79a80680 0x55ac79a7d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:48.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.422+0000 7fad51d34740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ac79a83250 con 0x55ac79a754a0 2024-09-19T04:55:48.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.422+0000 7fad51d34740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ac79996050 con 0x55ac79a75dc0 2024-09-19T04:55:48.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.422+0000 7fad51d34740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55ac79a833d0 con 0x55ac79a80680 2024-09-19T04:55:48.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.422+0000 7fad4d6f7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac79a754a0 0x55ac79a7ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:48.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.423+0000 7fad4d6f7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac79a754a0 0x55ac79a7ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48926/0 (socket says 172.21.15.2:48926) 2024-09-19T04:55:48.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.423+0000 7fad4d6f7640 1 -- 172.21.15.2:0/2211157850 learned_addr learned my addr 172.21.15.2:0/2211157850 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:55:48.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.423+0000 7fad51d34740 10 client.0 _ll_register_callbacks cb 0x55ac799d6160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:55:48.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.423+0000 7fad4cef6640 1 --2- 172.21.15.2:0/2211157850 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac79a75dc0 0x55ac79a7d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:48.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.423+0000 7fad4def8640 1 --2- 172.21.15.2:0/2211157850 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ac79a80680 0x55ac79a7d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:48.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.423+0000 7fad4d6f7640 1 -- 172.21.15.2:0/2211157850 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ac79a80680 msgr2=0x55ac79a7d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:48.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.423+0000 7fad4d6f7640 1 --2- 172.21.15.2:0/2211157850 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ac79a80680 0x55ac79a7d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:48.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.423+0000 7fad4d6f7640 1 -- 172.21.15.2:0/2211157850 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac79a75dc0 msgr2=0x55ac79a7d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:48.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.423+0000 7fad4d6f7640 1 --2- 172.21.15.2:0/2211157850 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac79a75dc0 0x55ac79a7d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:48.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.423+0000 7fad4d6f7640 1 -- 172.21.15.2:0/2211157850 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac7974c3c0 con 0x55ac79a754a0 2024-09-19T04:55:48.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.423+0000 7fad4cef6640 1 --2- 172.21.15.2:0/2211157850 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac79a75dc0 0x55ac79a7d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:55:48.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.423+0000 7fad4def8640 1 --2- 172.21.15.2:0/2211157850 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ac79a80680 0x55ac79a7d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:55:48.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.423+0000 7fad4d6f7640 1 --2- 172.21.15.2:0/2211157850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac79a754a0 0x55ac79a7ffa0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fad44004700 tx=0x7fad44014660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cc2b0aa90b00897 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:48.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.423+0000 7fad30ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:55:48.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.423+0000 7fad30ff9640 1 -- 172.21.15.2:0/2211157850 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad44023070 con 0x55ac79a754a0 2024-09-19T04:55:48.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.423+0000 7fad30ff9640 1 -- 172.21.15.2:0/2211157850 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7fad4400dd60 con 0x55ac79a754a0 2024-09-19T04:55:48.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.423+0000 7fad51d34740 1 -- 172.21.15.2:0/2211157850 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad44019070 con 0x55ac79a754a0 2024-09-19T04:55:48.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.423+0000 7fad30ff9640 1 -- 172.21.15.2:0/2211157850 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fad4402f050 con 0x55ac79a754a0 2024-09-19T04:55:48.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.424+0000 7fad51d34740 10 client.16374 fetch_fsmap learned FSMap version 19 2024-09-19T04:55:48.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.424+0000 7fad51d34740 1 -- 172.21.15.2:0/2211157850 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55ac79a8ebb0 con 0x55ac79a754a0 2024-09-19T04:55:48.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.424+0000 7fad30ff9640 1 -- 172.21.15.2:0/2211157850 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fad44019070 con 0x55ac79a754a0 2024-09-19T04:55:48.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.424+0000 7fad30ff9640 1 -- 172.21.15.2:0/2211157850 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fad44013070 con 0x55ac79a754a0 2024-09-19T04:55:48.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.424+0000 7fad51d34740 10 client.16374 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:55:48.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.424+0000 7fad51d34740 10 client.16374 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:55:48.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.424+0000 7fad51d34740 20 client.16374 populate_metadata read hostname 'smithi002' 2024-09-19T04:55:48.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.424+0000 7fad51d34740 1 --2- 172.21.15.2:0/2211157850 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55ac79a8ff00 0x55ac79a922f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:48.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.424+0000 7fad51d34740 4 client.16374 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:55:48.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.424+0000 7fad51d34740 1 -- 172.21.15.2:0/2211157850 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ac799e8850 con 0x55ac79a8ff00 2024-09-19T04:55:48.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.424+0000 7fad4cef6640 1 --2- 172.21.15.2:0/2211157850 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55ac79a8ff00 0x55ac79a922f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:48.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.425+0000 7fad4cef6640 1 --2- 172.21.15.2:0/2211157850 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55ac79a8ff00 0x55ac79a922f0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0c46622590c941b server_cookie=6162ac17a497716e in_seq=0 out_seq=0 2024-09-19T04:55:48.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.425+0000 7fad30ff9640 10 client.16374 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:55:48.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.425+0000 7fad30ff9640 1 -- 172.21.15.2:0/2211157850 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ac799e8850 con 0x55ac79a8ff00 2024-09-19T04:55:48.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.425+0000 7fad30ff9640 10 client.16374 handle_command_reply: tid=0 2024-09-19T04:55:48.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.425+0000 7fad51d34740 1 client.16374 shutdown 2024-09-19T04:55:48.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.425+0000 7fad51d34740 1 -- 172.21.15.2:0/2211157850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac79a754a0 msgr2=0x55ac79a7ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:48.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.425+0000 7fad51d34740 1 --2- 172.21.15.2:0/2211157850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac79a754a0 0x55ac79a7ffa0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fad44004700 tx=0x7fad44014660 comp rx=0 tx=0).stop 2024-09-19T04:55:48.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.425+0000 7fad51d34740 1 -- 172.21.15.2:0/2211157850 shutdown_connections 2024-09-19T04:55:48.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.426+0000 7fad51d34740 1 --2- 172.21.15.2:0/2211157850 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55ac79a8ff00 0x55ac79a922f0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:48.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.426+0000 7fad51d34740 1 --2- 172.21.15.2:0/2211157850 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ac79a80680 0x55ac79a7d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:48.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.426+0000 7fad51d34740 1 --2- 172.21.15.2:0/2211157850 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac79a75dc0 0x55ac79a7d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:48.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.426+0000 7fad51d34740 1 --2- 172.21.15.2:0/2211157850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac79a754a0 0x55ac79a7ffa0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:48.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.426+0000 7fad30ff9640 0 client.16374 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:55:48.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.426+0000 7fad51d34740 1 -- 172.21.15.2:0/2211157850 >> 172.21.15.2:0/2211157850 conn(0x55ac79a71a30 msgr2=0x55ac79a77710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:48.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.426+0000 7fad51d34740 1 -- 172.21.15.2:0/2211157850 shutdown_connections 2024-09-19T04:55:48.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.426+0000 7fad51d34740 1 -- 172.21.15.2:0/2211157850 wait complete. 2024-09-19T04:55:48.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.426+0000 7fad51d34740 20 client.16374 trim_cache size 0 max 16384 2024-09-19T04:55:48.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.443+0000 7fad51d34740 1 Processor -- start 2024-09-19T04:55:48.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.443+0000 7fad51d34740 1 -- start start 2024-09-19T04:55:48.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.444+0000 7fad51d34740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac79a754a0 0x55ac79a8c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:48.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.444+0000 7fad51d34740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ac79a75dc0 0x55ac79a97950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:48.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.444+0000 7fad51d34740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac79a80680 0x55ac79a97e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:48.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.444+0000 7fad51d34740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fad481ad9a0 con 0x55ac79a80680 2024-09-19T04:55:48.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.444+0000 7fad51d34740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fad481b0200 con 0x55ac79a754a0 2024-09-19T04:55:48.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.444+0000 7fad51d34740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fad481adff0 con 0x55ac79a75dc0 2024-09-19T04:55:48.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.444+0000 7fad4def8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac79a80680 0x55ac79a97e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:48.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.444+0000 7fad4def8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac79a80680 0x55ac79a97e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48940/0 (socket says 172.21.15.2:48940) 2024-09-19T04:55:48.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.444+0000 7fad4def8640 1 -- 172.21.15.2:0/3215558263 learned_addr learned my addr 172.21.15.2:0/3215558263 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:55:48.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.444+0000 7fad4cef6640 1 --2- 172.21.15.2:0/3215558263 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ac79a75dc0 0x55ac79a97950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:48.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.444+0000 7fad4d6f7640 1 --2- 172.21.15.2:0/3215558263 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac79a754a0 0x55ac79a8c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:48.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.444+0000 7fad4def8640 1 -- 172.21.15.2:0/3215558263 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ac79a75dc0 msgr2=0x55ac79a97950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:48.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.444+0000 7fad4def8640 1 --2- 172.21.15.2:0/3215558263 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ac79a75dc0 0x55ac79a97950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:48.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.444+0000 7fad4def8640 1 -- 172.21.15.2:0/3215558263 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac79a754a0 msgr2=0x55ac79a8c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:48.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.444+0000 7fad4def8640 1 --2- 172.21.15.2:0/3215558263 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac79a754a0 0x55ac79a8c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:48.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.444+0000 7fad4def8640 1 -- 172.21.15.2:0/3215558263 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac79a76a20 con 0x55ac79a80680 2024-09-19T04:55:48.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.444+0000 7fad4def8640 1 --2- 172.21.15.2:0/3215558263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac79a80680 0x55ac79a97e90 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fad40035000 tx=0x7fad40040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbfb5d37f761757 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:48.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.444+0000 7fad32ffd640 1 -- 172.21.15.2:0/3215558263 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad40034040 con 0x55ac79a80680 2024-09-19T04:55:48.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.445+0000 7fad32ffd640 1 -- 172.21.15.2:0/3215558263 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fad4002fdf0 con 0x55ac79a80680 2024-09-19T04:55:48.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.445+0000 7fad32ffd640 1 -- 172.21.15.2:0/3215558263 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad400307c0 con 0x55ac79a80680 2024-09-19T04:55:48.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.445+0000 7fad51d34740 1 -- 172.21.15.2:0/3215558263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac79a80680 msgr2=0x55ac79a97e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:48.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.445+0000 7fad51d34740 1 --2- 172.21.15.2:0/3215558263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac79a80680 0x55ac79a97e90 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fad40035000 tx=0x7fad40040000 comp rx=0 tx=0).stop 2024-09-19T04:55:48.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.445+0000 7fad51d34740 1 -- 172.21.15.2:0/3215558263 shutdown_connections 2024-09-19T04:55:48.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.445+0000 7fad51d34740 1 --2- 172.21.15.2:0/3215558263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac79a80680 0x55ac79a97e90 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:48.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.445+0000 7fad51d34740 1 --2- 172.21.15.2:0/3215558263 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ac79a75dc0 0x55ac79a97950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:48.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.445+0000 7fad51d34740 1 --2- 172.21.15.2:0/3215558263 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac79a754a0 0x55ac79a8c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:48.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.445+0000 7fad51d34740 1 -- 172.21.15.2:0/3215558263 >> 172.21.15.2:0/3215558263 conn(0x55ac79a71a30 msgr2=0x55ac79a78900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:48.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.445+0000 7fad51d34740 1 -- 172.21.15.2:0/3215558263 shutdown_connections 2024-09-19T04:55:48.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.445+0000 7fad51d34740 1 -- 172.21.15.2:0/3215558263 wait complete. 2024-09-19T04:55:48.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.446+0000 7fad51d34740 1 -- start start 2024-09-19T04:55:48.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.446+0000 7fad51d34740 1 Processor -- start 2024-09-19T04:55:48.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.446+0000 7fad51d34740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ac79a754a0 0x55ac79a83b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:48.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.446+0000 7fad51d34740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac79a75dc0 0x55ac79a840c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:48.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.446+0000 7fad51d34740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac79a80680 0x55ac79af8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:48.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.446+0000 7fad51d34740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fad481ae6c0 con 0x55ac79a80680 2024-09-19T04:55:48.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.446+0000 7fad51d34740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fad481afb30 con 0x55ac79a75dc0 2024-09-19T04:55:48.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.446+0000 7fad51d34740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fad481aed90 con 0x55ac79a754a0 2024-09-19T04:55:48.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.446+0000 7fad51d34740 10 client.0 _ll_register_callbacks cb 0x7fad3c0d3920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:55:48.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.446+0000 7fad4def8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac79a80680 0x55ac79af8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:48.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.446+0000 7fad4def8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac79a80680 0x55ac79af8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48942/0 (socket says 172.21.15.2:48942) 2024-09-19T04:55:48.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.446+0000 7fad4def8640 1 -- 172.21.15.2:0/1408628720 learned_addr learned my addr 172.21.15.2:0/1408628720 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:55:48.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.447+0000 7fad4d6f7640 1 --2- 172.21.15.2:0/1408628720 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ac79a754a0 0x55ac79a83b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:48.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.447+0000 7fad4cef6640 1 --2- 172.21.15.2:0/1408628720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac79a75dc0 0x55ac79a840c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:48.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.447+0000 7fad4def8640 1 -- 172.21.15.2:0/1408628720 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ac79a754a0 msgr2=0x55ac79a83b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:48.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.447+0000 7fad4def8640 1 --2- 172.21.15.2:0/1408628720 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ac79a754a0 0x55ac79a83b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:48.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.447+0000 7fad4def8640 1 -- 172.21.15.2:0/1408628720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac79a75dc0 msgr2=0x55ac79a840c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:55:48.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.447+0000 7fad4def8640 1 --2- 172.21.15.2:0/1408628720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac79a75dc0 0x55ac79a840c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:48.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.447+0000 7fad4def8640 1 -- 172.21.15.2:0/1408628720 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac79af8e50 con 0x55ac79a80680 2024-09-19T04:55:48.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.447+0000 7fad4def8640 1 --2- 172.21.15.2:0/1408628720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac79a80680 0x55ac79af8910 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fad4002ae70 tx=0x7fad4002f4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c38b0680aa88440 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:55:48.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.447+0000 7fad30ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:55:48.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.447+0000 7fad30ff9640 1 -- 172.21.15.2:0/1408628720 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad40034050 con 0x55ac79a80680 2024-09-19T04:55:48.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.447+0000 7fad30ff9640 1 -- 172.21.15.2:0/1408628720 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8527+0+0 (secure 0 0 0) 0x7fad40004240 con 0x55ac79a80680 2024-09-19T04:55:48.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.447+0000 7fad51d34740 1 -- 172.21.15.2:0/1408628720 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad4002fdf0 con 0x55ac79a80680 2024-09-19T04:55:48.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.447+0000 7fad30ff9640 1 -- 172.21.15.2:0/1408628720 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fad40004440 con 0x55ac79a80680 2024-09-19T04:55:48.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.447+0000 7fad51d34740 10 client.16380 fetch_fsmap learned FSMap version 19 2024-09-19T04:55:48.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.447+0000 7fad51d34740 1 -- 172.21.15.2:0/1408628720 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55ac79afa0a0 con 0x55ac79a80680 2024-09-19T04:55:48.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.448+0000 7fad30ff9640 1 -- 172.21.15.2:0/1408628720 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fad4002fdf0 con 0x55ac79a80680 2024-09-19T04:55:48.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.448+0000 7fad30ff9640 1 -- 172.21.15.2:0/1408628720 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fad400495f0 con 0x55ac79a80680 2024-09-19T04:55:48.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.448+0000 7fad51d34740 10 client.16380 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:55:48.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.448+0000 7fad51d34740 10 client.16380 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:55:48.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.448+0000 7fad51d34740 20 client.16380 populate_metadata read hostname 'smithi002' 2024-09-19T04:55:48.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.448+0000 7fad51d34740 1 --2- 172.21.15.2:0/1408628720 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55ac79afa760 0x55ac79afcb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:55:48.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.448+0000 7fad51d34740 4 client.16380 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:55:48.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.448+0000 7fad51d34740 1 -- 172.21.15.2:0/1408628720 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ac799e2d60 con 0x55ac79afa760 2024-09-19T04:55:48.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.448+0000 7fad4d6f7640 1 --2- 172.21.15.2:0/1408628720 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55ac79afa760 0x55ac79afcb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:55:48.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.448+0000 7fad4d6f7640 1 --2- 172.21.15.2:0/1408628720 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55ac79afa760 0x55ac79afcb50 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=221359784060eaf0 server_cookie=687119ae90d76b51 in_seq=0 out_seq=0 2024-09-19T04:55:48.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.448+0000 7fad30ff9640 10 client.16380 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:55:48.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.449+0000 7fad30ff9640 1 -- 172.21.15.2:0/1408628720 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55ac799e2d60 con 0x55ac79afa760 2024-09-19T04:55:48.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.449+0000 7fad30ff9640 10 client.16380 handle_command_reply: tid=0 2024-09-19T04:55:48.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.449+0000 7fad51d34740 1 client.16380 shutdown 2024-09-19T04:55:48.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.449+0000 7fad51d34740 1 -- 172.21.15.2:0/1408628720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac79a80680 msgr2=0x55ac79af8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:48.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.449+0000 7fad51d34740 1 --2- 172.21.15.2:0/1408628720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac79a80680 0x55ac79af8910 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fad4002ae70 tx=0x7fad4002f4c0 comp rx=0 tx=0).stop 2024-09-19T04:55:48.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.449+0000 7fad51d34740 1 -- 172.21.15.2:0/1408628720 shutdown_connections 2024-09-19T04:55:48.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.449+0000 7fad51d34740 1 --2- 172.21.15.2:0/1408628720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac79a80680 0x55ac79af8910 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:48.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.449+0000 7fad51d34740 1 --2- 172.21.15.2:0/1408628720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac79a75dc0 0x55ac79a840c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:48.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.449+0000 7fad51d34740 1 --2- 172.21.15.2:0/1408628720 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55ac79afa760 0x55ac79afcb50 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:48.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.449+0000 7fad51d34740 1 --2- 172.21.15.2:0/1408628720 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ac79a754a0 0x55ac79a83b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:48.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.449+0000 7fad30ff9640 0 client.16380 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:55:48.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.449+0000 7fad51d34740 1 -- 172.21.15.2:0/1408628720 >> 172.21.15.2:0/1408628720 conn(0x55ac79a71a30 msgr2=0x55ac79a77f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:48.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.449+0000 7fad51d34740 1 -- 172.21.15.2:0/1408628720 shutdown_connections 2024-09-19T04:55:48.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.449+0000 7fad51d34740 1 -- 172.21.15.2:0/1408628720 wait complete. 2024-09-19T04:55:48.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.449+0000 7fad51d34740 20 client.16380 trim_cache size 0 max 16384 2024-09-19T04:55:48.468 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:55:48.468 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T04:55:48.468 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-19T04:55:48.469 INFO:teuthology.orchestra.run.smithi002.stdout: "42852ae6-a330-4768-8f50-ae6cb619361f": { 2024-09-19T04:55:48.469 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-19T04:55:48.469 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "42852ae6-a330-4768-8f50-ae6cb619361f", 2024-09-19T04:55:48.469 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-19T04:55:48.469 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:55:48.469 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:55:48.469 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:55:48.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.450+0000 7fad4f95b640 1 -- 172.21.15.2:0/4275007191 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fad340a33b0 msgr2=0x7fad340a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:48.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.450+0000 7fad4f95b640 1 --2- 172.21.15.2:0/4275007191 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fad340a33b0 0x7fad340a5870 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fad40009430 tx=0x7fad40009360 comp rx=0 tx=0).stop 2024-09-19T04:55:48.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.450+0000 7fad4f95b640 1 -- 172.21.15.2:0/4275007191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad481036c0 msgr2=0x7fad4819aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:55:48.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.450+0000 7fad4f95b640 1 --2- 172.21.15.2:0/4275007191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad481036c0 0x7fad4819aa20 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fad3c00c920 tx=0x7fad3c00cde0 comp rx=0 tx=0).stop 2024-09-19T04:55:48.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.450+0000 7fad4f95b640 1 -- 172.21.15.2:0/4275007191 shutdown_connections 2024-09-19T04:55:48.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.450+0000 7fad4f95b640 1 --2- 172.21.15.2:0/4275007191 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fad340a33b0 0x7fad340a5870 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:48.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.450+0000 7fad4f95b640 1 --2- 172.21.15.2:0/4275007191 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad4810c180 0x7fad4819edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:48.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.450+0000 7fad4f95b640 1 --2- 172.21.15.2:0/4275007191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad481036c0 0x7fad4819aa20 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:48.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.450+0000 7fad4f95b640 1 --2- 172.21.15.2:0/4275007191 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad48102da0 0x7fad4819a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:55:48.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.450+0000 7fad4f95b640 1 -- 172.21.15.2:0/4275007191 >> 172.21.15.2:0/4275007191 conn(0x7fad480fc7a0 msgr2=0x7fad4810d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:55:48.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.450+0000 7fad4f95b640 1 -- 172.21.15.2:0/4275007191 shutdown_connections 2024-09-19T04:55:48.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:55:48.450+0000 7fad4f95b640 1 -- 172.21.15.2:0/4275007191 wait complete. 2024-09-19T04:55:48.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:48 smithi018 ceph-mon[34537]: scrub queued for path: / 2024-09-19T04:55:48.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:48 smithi018 ceph-mon[34537]: scrub summary: idle+waiting paths [/] 2024-09-19T04:55:48.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:48 smithi018 ceph-mon[34537]: scrub summary: active paths [/] 2024-09-19T04:55:48.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:48 smithi018 ceph-mon[34537]: scrub summary: idle+waiting paths [/] 2024-09-19T04:55:48.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:48 smithi018 ceph-mon[34537]: pgmap v239: 97 pgs: 97 active+clean; 12 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 38 KiB/s wr, 7 op/s 2024-09-19T04:55:48.821 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:48 smithi002 ceph-mon[30975]: scrub queued for path: / 2024-09-19T04:55:48.821 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:48 smithi002 ceph-mon[30975]: scrub summary: idle+waiting paths [/] 2024-09-19T04:55:48.821 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:48 smithi002 ceph-mon[30975]: scrub summary: active paths [/] 2024-09-19T04:55:48.821 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:48 smithi002 ceph-mon[30975]: scrub summary: idle+waiting paths [/] 2024-09-19T04:55:48.822 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:48 smithi002 ceph-mon[30975]: pgmap v239: 97 pgs: 97 active+clean; 12 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 38 KiB/s wr, 7 op/s 2024-09-19T04:55:48.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:48 smithi116 ceph-mon[34477]: scrub queued for path: / 2024-09-19T04:55:48.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:48 smithi116 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-19T04:55:48.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:48 smithi116 ceph-mon[34477]: scrub summary: active paths [/] 2024-09-19T04:55:48.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:48 smithi116 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-19T04:55:48.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:48 smithi116 ceph-mon[34477]: pgmap v239: 97 pgs: 97 active+clean; 12 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 38 KiB/s wr, 7 op/s 2024-09-19T04:55:49.200 INFO:tasks.cephfs.filesystem:scrub status for tag:42852ae6-a330-4768-8f50-ae6cb619361f - {'path': '/', 'tag': '42852ae6-a330-4768-8f50-ae6cb619361f', 'options': 'recursive,force'} 2024-09-19T04:55:50.709 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:50 smithi002 ceph-mon[30975]: pgmap v240: 97 pgs: 97 active+clean; 12 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 38 KiB/s wr, 7 op/s 2024-09-19T04:55:50.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:50 smithi018 ceph-mon[34537]: pgmap v240: 97 pgs: 97 active+clean; 12 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 38 KiB/s wr, 7 op/s 2024-09-19T04:55:50.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:50 smithi116 ceph-mon[34477]: pgmap v240: 97 pgs: 97 active+clean; 12 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 38 KiB/s wr, 7 op/s 2024-09-19T04:55:51.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:51 smithi018 ceph-mon[34537]: scrub summary: idle 2024-09-19T04:55:51.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:51 smithi002 ceph-mon[30975]: scrub summary: idle 2024-09-19T04:55:51.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:51 smithi116 ceph-mon[34477]: scrub summary: idle 2024-09-19T04:55:52.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:52 smithi018 ceph-mon[34537]: pgmap v241: 97 pgs: 97 active+clean; 12 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 57 KiB/s wr, 10 op/s 2024-09-19T04:55:52.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:52 smithi002 ceph-mon[30975]: pgmap v241: 97 pgs: 97 active+clean; 12 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 57 KiB/s wr, 10 op/s 2024-09-19T04:55:52.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:52 smithi116 ceph-mon[34477]: pgmap v241: 97 pgs: 97 active+clean; 12 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 57 KiB/s wr, 10 op/s 2024-09-19T04:55:54.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:54 smithi018 ceph-mon[34537]: pgmap v242: 97 pgs: 97 active+clean; 12 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 38 KiB/s wr, 7 op/s 2024-09-19T04:55:54.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:54 smithi002 ceph-mon[30975]: pgmap v242: 97 pgs: 97 active+clean; 12 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 38 KiB/s wr, 7 op/s 2024-09-19T04:55:54.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:54 smithi116 ceph-mon[34477]: pgmap v242: 97 pgs: 97 active+clean; 12 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 38 KiB/s wr, 7 op/s 2024-09-19T04:55:56.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:56 smithi018 ceph-mon[34537]: pgmap v243: 97 pgs: 97 active+clean; 13 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 59 KiB/s wr, 11 op/s 2024-09-19T04:55:56.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:56 smithi002 ceph-mon[30975]: pgmap v243: 97 pgs: 97 active+clean; 13 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 59 KiB/s wr, 11 op/s 2024-09-19T04:55:56.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:56 smithi116 ceph-mon[34477]: pgmap v243: 97 pgs: 97 active+clean; 13 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 59 KiB/s wr, 11 op/s 2024-09-19T04:55:58.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:55:58 smithi018 ceph-mon[34537]: pgmap v244: 97 pgs: 97 active+clean; 13 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 39 KiB/s wr, 7 op/s 2024-09-19T04:55:58.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:55:58 smithi002 ceph-mon[30975]: pgmap v244: 97 pgs: 97 active+clean; 13 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 39 KiB/s wr, 7 op/s 2024-09-19T04:55:58.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:55:58 smithi116 ceph-mon[34477]: pgmap v244: 97 pgs: 97 active+clean; 13 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 39 KiB/s wr, 7 op/s 2024-09-19T04:56:00.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:56:00 smithi018 ceph-mon[34537]: pgmap v245: 97 pgs: 97 active+clean; 13 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 39 KiB/s wr, 7 op/s 2024-09-19T04:56:00.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:56:00 smithi002 ceph-mon[30975]: pgmap v245: 97 pgs: 97 active+clean; 13 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 39 KiB/s wr, 7 op/s 2024-09-19T04:56:00.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:56:00 smithi116 ceph-mon[34477]: pgmap v245: 97 pgs: 97 active+clean; 13 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 39 KiB/s wr, 7 op/s 2024-09-19T04:56:02.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:56:02 smithi018 ceph-mon[34537]: pgmap v246: 97 pgs: 97 active+clean; 13 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 57 KiB/s wr, 10 op/s 2024-09-19T04:56:02.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:56:02 smithi002 ceph-mon[30975]: pgmap v246: 97 pgs: 97 active+clean; 13 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 57 KiB/s wr, 10 op/s 2024-09-19T04:56:02.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:56:02 smithi116 ceph-mon[34477]: pgmap v246: 97 pgs: 97 active+clean; 13 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 57 KiB/s wr, 10 op/s 2024-09-19T04:56:04.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:56:04 smithi018 ceph-mon[34537]: pgmap v247: 97 pgs: 97 active+clean; 13 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 39 KiB/s wr, 7 op/s 2024-09-19T04:56:04.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:56:04 smithi002 ceph-mon[30975]: pgmap v247: 97 pgs: 97 active+clean; 13 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 39 KiB/s wr, 7 op/s 2024-09-19T04:56:04.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:56:04 smithi116 ceph-mon[34477]: pgmap v247: 97 pgs: 97 active+clean; 13 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 39 KiB/s wr, 7 op/s 2024-09-19T04:56:06.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:56:06 smithi018 ceph-mon[34537]: pgmap v248: 97 pgs: 97 active+clean; 13 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 108 KiB/s wr, 28 op/s 2024-09-19T04:56:06.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:56:06 smithi018 ceph-mon[34537]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T04:56:06.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:56:06 smithi002 ceph-mon[30975]: pgmap v248: 97 pgs: 97 active+clean; 13 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 108 KiB/s wr, 28 op/s 2024-09-19T04:56:06.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:56:06 smithi002 ceph-mon[30975]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T04:56:06.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:56:06 smithi116 ceph-mon[34477]: pgmap v248: 97 pgs: 97 active+clean; 13 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 108 KiB/s wr, 28 op/s 2024-09-19T04:56:06.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:56:06 smithi116 ceph-mon[34477]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T04:56:08.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:56:08 smithi018 ceph-mon[34537]: pgmap v250: 97 pgs: 97 active+clean; 13 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 105 KiB/s wr, 29 op/s 2024-09-19T04:56:08.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:56:08 smithi002 ceph-mon[30975]: pgmap v250: 97 pgs: 97 active+clean; 13 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 105 KiB/s wr, 29 op/s 2024-09-19T04:56:08.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:56:08 smithi116 ceph-mon[34477]: pgmap v250: 97 pgs: 97 active+clean; 13 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 105 KiB/s wr, 29 op/s 2024-09-19T04:56:10.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:56:10 smithi018 ceph-mon[34537]: pgmap v251: 97 pgs: 97 active+clean; 13 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 105 KiB/s wr, 29 op/s 2024-09-19T04:56:10.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:56:10 smithi002 ceph-mon[30975]: pgmap v251: 97 pgs: 97 active+clean; 13 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 105 KiB/s wr, 29 op/s 2024-09-19T04:56:10.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:56:10 smithi116 ceph-mon[34477]: pgmap v251: 97 pgs: 97 active+clean; 13 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 105 KiB/s wr, 29 op/s 2024-09-19T04:56:12.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:56:12 smithi018 ceph-mon[34537]: pgmap v252: 97 pgs: 97 active+clean; 13 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 107 KiB/s wr, 30 op/s 2024-09-19T04:56:12.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:56:12 smithi002 ceph-mon[30975]: pgmap v252: 97 pgs: 97 active+clean; 13 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 107 KiB/s wr, 30 op/s 2024-09-19T04:56:12.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:56:12 smithi116 ceph-mon[34477]: pgmap v252: 97 pgs: 97 active+clean; 13 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 107 KiB/s wr, 30 op/s 2024-09-19T04:56:13.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:56:13 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:56:13.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:56:13 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:56:13.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:56:13 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:56:14.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:56:14 smithi018 ceph-mon[34537]: pgmap v253: 97 pgs: 97 active+clean; 13 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 107 KiB/s wr, 30 op/s 2024-09-19T04:56:14.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:56:14 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:56:14.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:56:14 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:56:14.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:56:14 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:56:14.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:56:14 smithi002 ceph-mon[30975]: pgmap v253: 97 pgs: 97 active+clean; 13 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 107 KiB/s wr, 30 op/s 2024-09-19T04:56:14.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:56:14 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:56:14.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:56:14 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:56:14.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:56:14 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:56:14.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:56:14 smithi116 ceph-mon[34477]: pgmap v253: 97 pgs: 97 active+clean; 13 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 107 KiB/s wr, 30 op/s 2024-09-19T04:56:14.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:56:14 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:56:14.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:56:14 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:56:14.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:56:14 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:56:16.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:56:16 smithi018 ceph-mon[34537]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T04:56:16.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:56:16 smithi018 ceph-mon[34537]: pgmap v255: 97 pgs: 97 active+clean; 14 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 54 KiB/s wr, 10 op/s 2024-09-19T04:56:16.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:56:16 smithi002 ceph-mon[30975]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T04:56:16.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:56:16 smithi002 ceph-mon[30975]: pgmap v255: 97 pgs: 97 active+clean; 14 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 54 KiB/s wr, 10 op/s 2024-09-19T04:56:16.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:56:16 smithi116 ceph-mon[34477]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T04:56:16.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:56:16 smithi116 ceph-mon[34477]: pgmap v255: 97 pgs: 97 active+clean; 14 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 54 KiB/s wr, 10 op/s 2024-09-19T04:56:18.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:56:18 smithi002 ceph-mon[30975]: pgmap v256: 97 pgs: 97 active+clean; 14 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 53 KiB/s wr, 9 op/s 2024-09-19T04:56:18.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:56:18 smithi116 ceph-mon[34477]: pgmap v256: 97 pgs: 97 active+clean; 14 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 53 KiB/s wr, 9 op/s 2024-09-19T04:56:18.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:56:18 smithi018 ceph-mon[34537]: pgmap v256: 97 pgs: 97 active+clean; 14 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 53 KiB/s wr, 9 op/s 2024-09-19T04:56:19.201 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:56:19.479 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:56:20.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.991+0000 7f3c7941f640 1 -- 172.21.15.2:0/3295185829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c74102790 msgr2=0x7f3c741067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:20.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.991+0000 7f3c7941f640 1 --2- 172.21.15.2:0/3295185829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c74102790 0x7f3c741067e0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f3c68009900 tx=0x7f3c6802a410 comp rx=0 tx=0).stop 2024-09-19T04:56:20.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.991+0000 7f3c7941f640 1 -- 172.21.15.2:0/3295185829 shutdown_connections 2024-09-19T04:56:20.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.991+0000 7f3c7941f640 1 --2- 172.21.15.2:0/3295185829 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3c74106f10 0x7f3c7410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:20.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.991+0000 7f3c7941f640 1 --2- 172.21.15.2:0/3295185829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c74102790 0x7f3c741067e0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:20.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.991+0000 7f3c7941f640 1 --2- 172.21.15.2:0/3295185829 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3c74101de0 0x7f3c741021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:20.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.991+0000 7f3c7941f640 1 -- 172.21.15.2:0/3295185829 >> 172.21.15.2:0/3295185829 conn(0x7f3c740fd8c0 msgr2=0x7f3c740ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:56:20.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.991+0000 7f3c7941f640 1 -- 172.21.15.2:0/3295185829 shutdown_connections 2024-09-19T04:56:20.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.991+0000 7f3c7941f640 1 -- 172.21.15.2:0/3295185829 wait complete. 2024-09-19T04:56:20.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.992+0000 7f3c7941f640 1 Processor -- start 2024-09-19T04:56:20.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.992+0000 7f3c7941f640 1 -- start start 2024-09-19T04:56:20.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.992+0000 7f3c7941f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c74101de0 0x7f3c741983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:20.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.992+0000 7f3c7941f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3c74102790 0x7f3c74198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:20.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.992+0000 7f3c7941f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3c74106f10 0x7f3c7419cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:20.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.993+0000 7f3c7941f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3c74111e40 con 0x7f3c74101de0 2024-09-19T04:56:20.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.993+0000 7f3c7941f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3c74111cc0 con 0x7f3c74106f10 2024-09-19T04:56:20.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.993+0000 7f3c7941f640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f3c74111fc0 con 0x7f3c74102790 2024-09-19T04:56:20.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.993+0000 7f3c72ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c74101de0 0x7f3c741983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:20.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.993+0000 7f3c72ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c74101de0 0x7f3c741983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39536/0 (socket says 172.21.15.2:39536) 2024-09-19T04:56:20.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.993+0000 7f3c72ffd640 1 -- 172.21.15.2:0/2081362819 learned_addr learned my addr 172.21.15.2:0/2081362819 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:56:20.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.993+0000 7f3c737fe640 1 --2- 172.21.15.2:0/2081362819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3c74106f10 0x7f3c7419cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:20.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.993+0000 7f3c727fc640 1 --2- 172.21.15.2:0/2081362819 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3c74102790 0x7f3c74198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:20.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.993+0000 7f3c72ffd640 1 -- 172.21.15.2:0/2081362819 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3c74102790 msgr2=0x7f3c74198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:20.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.993+0000 7f3c72ffd640 1 --2- 172.21.15.2:0/2081362819 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3c74102790 0x7f3c74198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:20.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.993+0000 7f3c72ffd640 1 -- 172.21.15.2:0/2081362819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3c74106f10 msgr2=0x7f3c7419cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:20.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.993+0000 7f3c72ffd640 1 --2- 172.21.15.2:0/2081362819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3c74106f10 0x7f3c7419cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:20.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.993+0000 7f3c72ffd640 1 -- 172.21.15.2:0/2081362819 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c7419d370 con 0x7f3c74101de0 2024-09-19T04:56:20.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.993+0000 7f3c727fc640 1 --2- 172.21.15.2:0/2081362819 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3c74102790 0x7f3c74198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:56:20.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.993+0000 7f3c72ffd640 1 --2- 172.21.15.2:0/2081362819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c74101de0 0x7f3c741983c0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f3c6400b4a0 tx=0x7f3c6400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:56:20.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.993+0000 7f3c5bfff640 1 -- 172.21.15.2:0/2081362819 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c64014070 con 0x7f3c74101de0 2024-09-19T04:56:20.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.993+0000 7f3c7941f640 1 -- 172.21.15.2:0/2081362819 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c7419d660 con 0x7f3c74101de0 2024-09-19T04:56:20.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.993+0000 7f3c5bfff640 1 -- 172.21.15.2:0/2081362819 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3c64010ac0 con 0x7f3c74101de0 2024-09-19T04:56:20.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.993+0000 7f3c5bfff640 1 -- 172.21.15.2:0/2081362819 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c64017c30 con 0x7f3c74101de0 2024-09-19T04:56:20.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.994+0000 7f3c7941f640 1 -- 172.21.15.2:0/2081362819 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c741a4f40 con 0x7f3c74101de0 2024-09-19T04:56:20.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.996+0000 7f3c5bfff640 1 -- 172.21.15.2:0/2081362819 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f3c64017070 con 0x7f3c74101de0 2024-09-19T04:56:20.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.996+0000 7f3c7b7f8740 1 Processor -- start 2024-09-19T04:56:20.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.996+0000 7f3c7b7f8740 1 -- start start 2024-09-19T04:56:20.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.997+0000 7f3c7b7f8740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56021f94e4a0 0x56021f94e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:20.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.997+0000 7f3c7b7f8740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56021f94edc0 0x56021f959140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:20.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.997+0000 7f3c7b7f8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56021f959680 0x56021f95ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:20.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.997+0000 7f3c7b7f8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56021f8b42e0 con 0x56021f959680 2024-09-19T04:56:20.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.997+0000 7f3c7b7f8740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56021f85bce0 con 0x56021f94e4a0 2024-09-19T04:56:20.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.997+0000 7f3c7b7f8740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x56021f8b02a0 con 0x56021f94edc0 2024-09-19T04:56:20.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.997+0000 7f3c5bfff640 1 --2- 172.21.15.2:0/2081362819 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f3c5c0a33b0 0x7f3c5c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:20.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.997+0000 7f3c727fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56021f959680 0x56021f95ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:20.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.997+0000 7f3c727fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56021f959680 0x56021f95ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39548/0 (socket says 172.21.15.2:39548) 2024-09-19T04:56:20.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.997+0000 7f3c727fc640 1 -- 172.21.15.2:0/36072978 learned_addr learned my addr 172.21.15.2:0/36072978 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:56:20.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.997+0000 7f3c737fe640 1 --2- 172.21.15.2:0/36072978 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56021f94e4a0 0x56021f94e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:20.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.997+0000 7f3c737fe640 1 --2- 172.21.15.2:0/2081362819 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f3c5c0a33b0 0x7f3c5c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:20.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.997+0000 7f3c5bfff640 1 -- 172.21.15.2:0/2081362819 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7f3c640cf2f0 con 0x7f3c74101de0 2024-09-19T04:56:20.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.997+0000 7f3c72ffd640 1 --2- 172.21.15.2:0/36072978 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56021f94edc0 0x56021f959140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:20.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.997+0000 7f3c737fe640 1 -- 172.21.15.2:0/36072978 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56021f94edc0 msgr2=0x56021f959140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:56:20.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.997+0000 7f3c737fe640 1 --2- 172.21.15.2:0/36072978 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56021f94edc0 0x56021f959140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:20.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.997+0000 7f3c737fe640 1 -- 172.21.15.2:0/36072978 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56021f959680 msgr2=0x56021f95ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:56:20.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.997+0000 7f3c737fe640 1 --2- 172.21.15.2:0/36072978 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56021f959680 0x56021f95ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:20.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.997+0000 7f3c737fe640 1 -- 172.21.15.2:0/36072978 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56021f840440 con 0x56021f94e4a0 2024-09-19T04:56:20.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.997+0000 7f3c72ffd640 1 --2- 172.21.15.2:0/36072978 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56021f94edc0 0x56021f959140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:56:20.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.998+0000 7f3c737fe640 1 --2- 172.21.15.2:0/36072978 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56021f94e4a0 0x56021f94e880 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c013980 tx=0x7f3c6c013e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd24e12f0be83c08 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:56:20.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.998+0000 7f3c737fe640 1 --2- 172.21.15.2:0/2081362819 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f3c5c0a33b0 0x7f3c5c0a5870 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c00f000 tx=0x7f3c6c01c000 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:56:20.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.998+0000 7f3c597fa640 1 -- 172.21.15.2:0/36072978 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c00fb60 con 0x56021f94e4a0 2024-09-19T04:56:20.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.998+0000 7f3c597fa640 1 -- 172.21.15.2:0/36072978 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3c6c00fd00 con 0x56021f94e4a0 2024-09-19T04:56:20.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.998+0000 7f3c597fa640 1 -- 172.21.15.2:0/36072978 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c00e3b0 con 0x56021f94e4a0 2024-09-19T04:56:20.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.999+0000 7f3c7b7f8740 1 -- 172.21.15.2:0/36072978 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56021f94e4a0 msgr2=0x56021f94e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:20.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.999+0000 7f3c7b7f8740 1 --2- 172.21.15.2:0/36072978 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56021f94e4a0 0x56021f94e880 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c013980 tx=0x7f3c6c013e40 comp rx=0 tx=0).stop 2024-09-19T04:56:20.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.999+0000 7f3c7b7f8740 1 -- 172.21.15.2:0/36072978 shutdown_connections 2024-09-19T04:56:20.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.999+0000 7f3c7b7f8740 1 --2- 172.21.15.2:0/36072978 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56021f959680 0x56021f95ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:20.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.999+0000 7f3c7b7f8740 1 --2- 172.21.15.2:0/36072978 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56021f94edc0 0x56021f959140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:20.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.999+0000 7f3c7b7f8740 1 --2- 172.21.15.2:0/36072978 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56021f94e4a0 0x56021f94e880 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:20.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.999+0000 7f3c7b7f8740 1 -- 172.21.15.2:0/36072978 >> 172.21.15.2:0/36072978 conn(0x56021f94aa30 msgr2=0x56021f94ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:56:20.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.999+0000 7f3c7b7f8740 1 -- 172.21.15.2:0/36072978 shutdown_connections 2024-09-19T04:56:20.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.999+0000 7f3c7b7f8740 1 -- 172.21.15.2:0/36072978 wait complete. 2024-09-19T04:56:20.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.999+0000 7f3c7b7f8740 1 -- start start 2024-09-19T04:56:20.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.999+0000 7f3c7b7f8740 1 Processor -- start 2024-09-19T04:56:20.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.999+0000 7f3c7b7f8740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56021f94e4a0 0x56021f958fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:20.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.999+0000 7f3c7b7f8740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56021f94edc0 0x56021f956280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:20.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.999+0000 7f3c7b7f8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56021f959680 0x56021f9567e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:20.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.999+0000 7f3c7b7f8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56021f95c250 con 0x56021f959680 2024-09-19T04:56:20.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.999+0000 7f3c7b7f8740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56021f86f050 con 0x56021f94edc0 2024-09-19T04:56:20.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.999+0000 7f3c7b7f8740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x56021f95c3d0 con 0x56021f94e4a0 2024-09-19T04:56:20.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:19.999+0000 7f3c7b7f8740 10 client.0 _ll_register_callbacks cb 0x56021f8af160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:56:20.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.000+0000 7f3c737fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56021f959680 0x56021f9567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:20.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.000+0000 7f3c727fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56021f94edc0 0x56021f956280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:20.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.000+0000 7f3c737fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56021f959680 0x56021f9567e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39550/0 (socket says 172.21.15.2:39550) 2024-09-19T04:56:20.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.000+0000 7f3c737fe640 1 -- 172.21.15.2:0/2635917525 learned_addr learned my addr 172.21.15.2:0/2635917525 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:56:20.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.000+0000 7f3c72ffd640 1 --2- 172.21.15.2:0/2635917525 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56021f94e4a0 0x56021f958fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:20.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.000+0000 7f3c737fe640 1 -- 172.21.15.2:0/2635917525 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56021f94e4a0 msgr2=0x56021f958fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:56:20.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.000+0000 7f3c737fe640 1 --2- 172.21.15.2:0/2635917525 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56021f94e4a0 0x56021f958fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:20.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.000+0000 7f3c737fe640 1 -- 172.21.15.2:0/2635917525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56021f94edc0 msgr2=0x56021f956280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:56:20.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.000+0000 7f3c737fe640 1 --2- 172.21.15.2:0/2635917525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56021f94edc0 0x56021f956280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:20.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.000+0000 7f3c737fe640 1 -- 172.21.15.2:0/2635917525 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56021f6253c0 con 0x56021f959680 2024-09-19T04:56:20.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.000+0000 7f3c727fc640 1 --2- 172.21.15.2:0/2635917525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56021f94edc0 0x56021f956280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:56:20.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.000+0000 7f3c737fe640 1 --2- 172.21.15.2:0/2635917525 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56021f959680 0x56021f9567e0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c007b90 tx=0x7f3c6c01ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b742b30f9aeb7a26 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:56:20.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.000+0000 7f3c56ff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:56:20.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.000+0000 7f3c56ff5640 1 -- 172.21.15.2:0/2635917525 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c034060 con 0x56021f959680 2024-09-19T04:56:20.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.000+0000 7f3c56ff5640 1 -- 172.21.15.2:0/2635917525 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7f3c6c004bf0 con 0x56021f959680 2024-09-19T04:56:20.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.000+0000 7f3c7b7f8740 1 -- 172.21.15.2:0/2635917525 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c6c00fd00 con 0x56021f959680 2024-09-19T04:56:20.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.001+0000 7f3c56ff5640 1 -- 172.21.15.2:0/2635917525 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f3c6c004df0 con 0x56021f959680 2024-09-19T04:56:20.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.001+0000 7f3c7b7f8740 10 client.16392 fetch_fsmap learned FSMap version 19 2024-09-19T04:56:20.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.001+0000 7f3c7b7f8740 1 -- 172.21.15.2:0/2635917525 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56021f967c20 con 0x56021f959680 2024-09-19T04:56:20.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.001+0000 7f3c56ff5640 1 -- 172.21.15.2:0/2635917525 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3c6c00fd00 con 0x56021f959680 2024-09-19T04:56:20.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.001+0000 7f3c56ff5640 1 -- 172.21.15.2:0/2635917525 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f3c6c01d6d0 con 0x56021f959680 2024-09-19T04:56:20.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.001+0000 7f3c7b7f8740 10 client.16392 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:56:20.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.001+0000 7f3c7b7f8740 10 client.16392 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:56:20.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.001+0000 7f3c7b7f8740 20 client.16392 populate_metadata read hostname 'smithi002' 2024-09-19T04:56:20.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.001+0000 7f3c7b7f8740 1 --2- 172.21.15.2:0/2635917525 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56021f9690e0 0x56021f96b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:20.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.001+0000 7f3c7b7f8740 4 client.16392 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:56:20.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.001+0000 7f3c7b7f8740 1 -- 172.21.15.2:0/2635917525 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56021f8c1850 con 0x56021f9690e0 2024-09-19T04:56:20.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.001+0000 7f3c72ffd640 1 --2- 172.21.15.2:0/2635917525 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56021f9690e0 0x56021f96b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:20.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.002+0000 7f3c56ff5640 10 client.16392 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:56:20.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.002+0000 7f3c72ffd640 1 --2- 172.21.15.2:0/2635917525 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56021f9690e0 0x56021f96b4d0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27734700e4a8b50e server_cookie=11936509814f64ed in_seq=0 out_seq=0 2024-09-19T04:56:20.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.003+0000 7f3c56ff5640 1 -- 172.21.15.2:0/2635917525 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56021f8c1850 con 0x56021f9690e0 2024-09-19T04:56:20.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.003+0000 7f3c56ff5640 10 client.16392 handle_command_reply: tid=0 2024-09-19T04:56:20.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.003+0000 7f3c7b7f8740 1 client.16392 shutdown 2024-09-19T04:56:20.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.003+0000 7f3c7b7f8740 1 -- 172.21.15.2:0/2635917525 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56021f959680 msgr2=0x56021f9567e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:20.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.003+0000 7f3c7b7f8740 1 --2- 172.21.15.2:0/2635917525 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56021f959680 0x56021f9567e0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c007b90 tx=0x7f3c6c01ee80 comp rx=0 tx=0).stop 2024-09-19T04:56:20.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.003+0000 7f3c7b7f8740 1 -- 172.21.15.2:0/2635917525 shutdown_connections 2024-09-19T04:56:20.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.003+0000 7f3c7b7f8740 1 --2- 172.21.15.2:0/2635917525 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56021f959680 0x56021f9567e0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:20.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.003+0000 7f3c7b7f8740 1 --2- 172.21.15.2:0/2635917525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56021f94edc0 0x56021f956280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:20.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.003+0000 7f3c7b7f8740 1 --2- 172.21.15.2:0/2635917525 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56021f9690e0 0x56021f96b4d0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:20.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.003+0000 7f3c7b7f8740 1 --2- 172.21.15.2:0/2635917525 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56021f94e4a0 0x56021f958fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:20.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.003+0000 7f3c7b7f8740 1 -- 172.21.15.2:0/2635917525 >> 172.21.15.2:0/2635917525 conn(0x56021f94aa30 msgr2=0x56021f949b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:56:20.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.003+0000 7f3c56ff5640 0 client.16392 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:56:20.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.003+0000 7f3c7b7f8740 1 -- 172.21.15.2:0/2635917525 shutdown_connections 2024-09-19T04:56:20.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.003+0000 7f3c7b7f8740 1 -- 172.21.15.2:0/2635917525 wait complete. 2024-09-19T04:56:20.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.003+0000 7f3c7b7f8740 20 client.16392 trim_cache size 0 max 16384 2024-09-19T04:56:20.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.035+0000 7f3c7b7f8740 1 Processor -- start 2024-09-19T04:56:20.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.035+0000 7f3c7b7f8740 1 -- start start 2024-09-19T04:56:20.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.035+0000 7f3c7b7f8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56021f94e4a0 0x56021f9654b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:20.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.035+0000 7f3c7b7f8740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56021f94edc0 0x56021f956470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:20.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.035+0000 7f3c7b7f8740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56021f959680 0x56021f955260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:20.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.035+0000 7f3c7b7f8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3c741ab7b0 con 0x56021f94e4a0 2024-09-19T04:56:20.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.035+0000 7f3c7b7f8740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3c741ae010 con 0x56021f94edc0 2024-09-19T04:56:20.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.035+0000 7f3c7b7f8740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f3c741abe00 con 0x56021f959680 2024-09-19T04:56:20.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.035+0000 7f3c72ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56021f94e4a0 0x56021f9654b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:20.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.035+0000 7f3c72ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56021f94e4a0 0x56021f9654b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39562/0 (socket says 172.21.15.2:39562) 2024-09-19T04:56:20.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.035+0000 7f3c72ffd640 1 -- 172.21.15.2:0/2675654906 learned_addr learned my addr 172.21.15.2:0/2675654906 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:56:20.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.035+0000 7f3c727fc640 1 --2- 172.21.15.2:0/2675654906 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56021f94edc0 0x56021f956470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:20.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.035+0000 7f3c737fe640 1 --2- 172.21.15.2:0/2675654906 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56021f959680 0x56021f955260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:20.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.036+0000 7f3c72ffd640 1 -- 172.21.15.2:0/2675654906 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56021f959680 msgr2=0x56021f955260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:56:20.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.036+0000 7f3c72ffd640 1 --2- 172.21.15.2:0/2675654906 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56021f959680 0x56021f955260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:20.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.036+0000 7f3c72ffd640 1 -- 172.21.15.2:0/2675654906 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56021f94edc0 msgr2=0x56021f956470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:56:20.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.036+0000 7f3c72ffd640 1 --2- 172.21.15.2:0/2675654906 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56021f94edc0 0x56021f956470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:20.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.036+0000 7f3c72ffd640 1 -- 172.21.15.2:0/2675654906 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56021f956b50 con 0x56021f94e4a0 2024-09-19T04:56:20.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.036+0000 7f3c72ffd640 1 --2- 172.21.15.2:0/2675654906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56021f94e4a0 0x56021f9654b0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f3c6409b670 tx=0x7f3c640d1040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a73681e8ba3e3f6a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:56:20.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.036+0000 7f3c58ff9640 1 -- 172.21.15.2:0/2675654906 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c64082030 con 0x56021f94e4a0 2024-09-19T04:56:20.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.036+0000 7f3c58ff9640 1 -- 172.21.15.2:0/2675654906 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3c64084050 con 0x56021f94e4a0 2024-09-19T04:56:20.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.036+0000 7f3c58ff9640 1 -- 172.21.15.2:0/2675654906 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c6401e040 con 0x56021f94e4a0 2024-09-19T04:56:20.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.037+0000 7f3c7b7f8740 1 -- 172.21.15.2:0/2675654906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56021f94e4a0 msgr2=0x56021f9654b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:20.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.037+0000 7f3c7b7f8740 1 --2- 172.21.15.2:0/2675654906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56021f94e4a0 0x56021f9654b0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f3c6409b670 tx=0x7f3c640d1040 comp rx=0 tx=0).stop 2024-09-19T04:56:20.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.037+0000 7f3c7b7f8740 1 -- 172.21.15.2:0/2675654906 shutdown_connections 2024-09-19T04:56:20.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.037+0000 7f3c7b7f8740 1 --2- 172.21.15.2:0/2675654906 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56021f959680 0x56021f955260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:20.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.037+0000 7f3c7b7f8740 1 --2- 172.21.15.2:0/2675654906 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56021f94edc0 0x56021f956470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:20.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.037+0000 7f3c7b7f8740 1 --2- 172.21.15.2:0/2675654906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56021f94e4a0 0x56021f9654b0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:20.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.037+0000 7f3c7b7f8740 1 -- 172.21.15.2:0/2675654906 >> 172.21.15.2:0/2675654906 conn(0x56021f94aa30 msgr2=0x56021f954b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:56:20.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.037+0000 7f3c7b7f8740 1 -- 172.21.15.2:0/2675654906 shutdown_connections 2024-09-19T04:56:20.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.037+0000 7f3c7b7f8740 1 -- 172.21.15.2:0/2675654906 wait complete. 2024-09-19T04:56:20.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.037+0000 7f3c7b7f8740 1 -- start start 2024-09-19T04:56:20.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.037+0000 7f3c7b7f8740 1 Processor -- start 2024-09-19T04:56:20.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.038+0000 7f3c7b7f8740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56021f94e4a0 0x56021f961ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:20.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.038+0000 7f3c7b7f8740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56021f94edc0 0x56021f95cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:20.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.038+0000 7f3c7b7f8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56021f959680 0x56021f95d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:20.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.038+0000 7f3c7b7f8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3c741ac4d0 con 0x56021f959680 2024-09-19T04:56:20.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.038+0000 7f3c7b7f8740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3c741ad940 con 0x56021f94e4a0 2024-09-19T04:56:20.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.038+0000 7f3c7b7f8740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f3c741acba0 con 0x56021f94edc0 2024-09-19T04:56:20.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.038+0000 7f3c7b7f8740 10 client.0 _ll_register_callbacks cb 0x7f3c68009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:56:20.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.038+0000 7f3c737fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56021f959680 0x56021f95d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:20.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.038+0000 7f3c72ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56021f94e4a0 0x56021f961ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:20.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.038+0000 7f3c737fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56021f959680 0x56021f95d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39566/0 (socket says 172.21.15.2:39566) 2024-09-19T04:56:20.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.038+0000 7f3c737fe640 1 -- 172.21.15.2:0/2284998582 learned_addr learned my addr 172.21.15.2:0/2284998582 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:56:20.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.038+0000 7f3c727fc640 1 --2- 172.21.15.2:0/2284998582 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56021f94edc0 0x56021f95cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:20.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.038+0000 7f3c737fe640 1 -- 172.21.15.2:0/2284998582 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56021f94edc0 msgr2=0x56021f95cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:56:20.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.038+0000 7f3c737fe640 1 --2- 172.21.15.2:0/2284998582 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56021f94edc0 0x56021f95cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:20.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.038+0000 7f3c737fe640 1 -- 172.21.15.2:0/2284998582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56021f94e4a0 msgr2=0x56021f961ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:56:20.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.038+0000 7f3c737fe640 1 --2- 172.21.15.2:0/2284998582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56021f94e4a0 0x56021f961ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:20.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.038+0000 7f3c737fe640 1 -- 172.21.15.2:0/2284998582 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56021f95d870 con 0x56021f959680 2024-09-19T04:56:20.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.038+0000 7f3c737fe640 1 --2- 172.21.15.2:0/2284998582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56021f959680 0x56021f95d330 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c007980 tx=0x7f3c6c005f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba54ef3152f64521 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:56:20.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.038+0000 7f3c56ff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:56:20.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.038+0000 7f3c56ff5640 1 -- 172.21.15.2:0/2284998582 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c034040 con 0x56021f959680 2024-09-19T04:56:20.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.038+0000 7f3c56ff5640 1 -- 172.21.15.2:0/2284998582 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7f3c6c02b070 con 0x56021f959680 2024-09-19T04:56:20.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.038+0000 7f3c7b7f8740 1 -- 172.21.15.2:0/2284998582 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c64084050 con 0x56021f959680 2024-09-19T04:56:20.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.039+0000 7f3c56ff5640 1 -- 172.21.15.2:0/2284998582 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f3c6c004820 con 0x56021f959680 2024-09-19T04:56:20.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.039+0000 7f3c7b7f8740 10 client.16398 fetch_fsmap learned FSMap version 19 2024-09-19T04:56:20.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.039+0000 7f3c7b7f8740 1 -- 172.21.15.2:0/2284998582 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56021f9d3800 con 0x56021f959680 2024-09-19T04:56:20.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.039+0000 7f3c56ff5640 1 -- 172.21.15.2:0/2284998582 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3c64084050 con 0x56021f959680 2024-09-19T04:56:20.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.039+0000 7f3c56ff5640 1 -- 172.21.15.2:0/2284998582 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f3c6c01d5c0 con 0x56021f959680 2024-09-19T04:56:20.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.039+0000 7f3c7b7f8740 10 client.16398 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:56:20.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.039+0000 7f3c7b7f8740 10 client.16398 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:56:20.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.039+0000 7f3c7b7f8740 20 client.16398 populate_metadata read hostname 'smithi002' 2024-09-19T04:56:20.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.039+0000 7f3c7b7f8740 1 --2- 172.21.15.2:0/2284998582 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56021f9d3e50 0x56021f9d6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:20.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.039+0000 7f3c7b7f8740 4 client.16398 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:56:20.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.039+0000 7f3c7b7f8740 1 -- 172.21.15.2:0/2284998582 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56021f8bbd60 con 0x56021f9d3e50 2024-09-19T04:56:20.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.039+0000 7f3c72ffd640 1 --2- 172.21.15.2:0/2284998582 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56021f9d3e50 0x56021f9d6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:20.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.040+0000 7f3c72ffd640 1 --2- 172.21.15.2:0/2284998582 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56021f9d3e50 0x56021f9d6260 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49f4f8213bc9eeff server_cookie=354121b63914dc2e in_seq=0 out_seq=0 2024-09-19T04:56:20.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.040+0000 7f3c56ff5640 10 client.16398 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:56:20.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.040+0000 7f3c56ff5640 1 -- 172.21.15.2:0/2284998582 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56021f8bbd60 con 0x56021f9d3e50 2024-09-19T04:56:20.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.040+0000 7f3c56ff5640 10 client.16398 handle_command_reply: tid=0 2024-09-19T04:56:20.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.040+0000 7f3c7b7f8740 1 client.16398 shutdown 2024-09-19T04:56:20.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.040+0000 7f3c7b7f8740 1 -- 172.21.15.2:0/2284998582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56021f959680 msgr2=0x56021f95d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:20.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.040+0000 7f3c7b7f8740 1 --2- 172.21.15.2:0/2284998582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56021f959680 0x56021f95d330 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c007980 tx=0x7f3c6c005f20 comp rx=0 tx=0).stop 2024-09-19T04:56:20.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.040+0000 7f3c7b7f8740 1 -- 172.21.15.2:0/2284998582 shutdown_connections 2024-09-19T04:56:20.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.040+0000 7f3c7b7f8740 1 --2- 172.21.15.2:0/2284998582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56021f959680 0x56021f95d330 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:20.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.040+0000 7f3c7b7f8740 1 --2- 172.21.15.2:0/2284998582 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56021f9d3e50 0x56021f9d6260 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:20.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.040+0000 7f3c56ff5640 0 client.16398 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:56:20.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.040+0000 7f3c7b7f8740 1 --2- 172.21.15.2:0/2284998582 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56021f94edc0 0x56021f95cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:20.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.040+0000 7f3c7b7f8740 1 --2- 172.21.15.2:0/2284998582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56021f94e4a0 0x56021f961ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:20.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.040+0000 7f3c7b7f8740 1 -- 172.21.15.2:0/2284998582 >> 172.21.15.2:0/2284998582 conn(0x56021f94aa30 msgr2=0x56021f955370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:56:20.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.040+0000 7f3c7b7f8740 1 -- 172.21.15.2:0/2284998582 shutdown_connections 2024-09-19T04:56:20.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.040+0000 7f3c7b7f8740 1 -- 172.21.15.2:0/2284998582 wait complete. 2024-09-19T04:56:20.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.040+0000 7f3c7b7f8740 20 client.16398 trim_cache size 0 max 16384 2024-09-19T04:56:20.047 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:56:20.047 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T04:56:20.047 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T04:56:20.047 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:56:20.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.041+0000 7f3c7941f640 1 -- 172.21.15.2:0/2081362819 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f3c5c0a33b0 msgr2=0x7f3c5c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:20.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.041+0000 7f3c7941f640 1 --2- 172.21.15.2:0/2081362819 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f3c5c0a33b0 0x7f3c5c0a5870 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c00f000 tx=0x7f3c6c01c000 comp rx=0 tx=0).stop 2024-09-19T04:56:20.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.041+0000 7f3c7941f640 1 -- 172.21.15.2:0/2081362819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c74101de0 msgr2=0x7f3c741983c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:20.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.041+0000 7f3c7941f640 1 --2- 172.21.15.2:0/2081362819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c74101de0 0x7f3c741983c0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f3c6400b4a0 tx=0x7f3c6400b960 comp rx=0 tx=0).stop 2024-09-19T04:56:20.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.041+0000 7f3c7941f640 1 -- 172.21.15.2:0/2081362819 shutdown_connections 2024-09-19T04:56:20.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.041+0000 7f3c7941f640 1 --2- 172.21.15.2:0/2081362819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3c74106f10 0x7f3c7419cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:20.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.041+0000 7f3c7941f640 1 --2- 172.21.15.2:0/2081362819 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f3c5c0a33b0 0x7f3c5c0a5870 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:20.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.041+0000 7f3c7941f640 1 --2- 172.21.15.2:0/2081362819 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3c74102790 0x7f3c74198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:20.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.041+0000 7f3c7941f640 1 --2- 172.21.15.2:0/2081362819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c74101de0 0x7f3c741983c0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:20.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.041+0000 7f3c7941f640 1 -- 172.21.15.2:0/2081362819 >> 172.21.15.2:0/2081362819 conn(0x7f3c740fd8c0 msgr2=0x7f3c740fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:56:20.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.041+0000 7f3c7941f640 1 -- 172.21.15.2:0/2081362819 shutdown_connections 2024-09-19T04:56:20.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:20.041+0000 7f3c7941f640 1 -- 172.21.15.2:0/2081362819 wait complete. 2024-09-19T04:56:20.609 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:56:20 smithi018 ceph-mon[34537]: pgmap v257: 97 pgs: 97 active+clean; 14 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 53 KiB/s wr, 9 op/s 2024-09-19T04:56:20.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:56:20 smithi002 ceph-mon[30975]: pgmap v257: 97 pgs: 97 active+clean; 14 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 53 KiB/s wr, 9 op/s 2024-09-19T04:56:20.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:56:20 smithi116 ceph-mon[34477]: pgmap v257: 97 pgs: 97 active+clean; 14 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 53 KiB/s wr, 9 op/s 2024-09-19T04:56:20.849 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:56:20.849 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:56:21.106 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:56:21.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.541+0000 7f503737b640 1 -- 172.21.15.2:0/2561287304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5030100e20 msgr2=0x7f5030101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:21.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.541+0000 7f503737b640 1 --2- 172.21.15.2:0/2561287304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5030100e20 0x7f5030101200 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f5028009900 tx=0x7f502802a480 comp rx=0 tx=0).stop 2024-09-19T04:56:21.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.541+0000 7f503737b640 1 -- 172.21.15.2:0/2561287304 shutdown_connections 2024-09-19T04:56:21.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.541+0000 7f503737b640 1 --2- 172.21.15.2:0/2561287304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5030102ef0 0x7f503010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:21.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.541+0000 7f503737b640 1 --2- 172.21.15.2:0/2561287304 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5030102570 0x7f50301029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:21.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.541+0000 7f503737b640 1 --2- 172.21.15.2:0/2561287304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5030100e20 0x7f5030101200 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:21.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.541+0000 7f503737b640 1 -- 172.21.15.2:0/2561287304 >> 172.21.15.2:0/2561287304 conn(0x7f50300fc7d0 msgr2=0x7f50300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:56:21.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.541+0000 7f503737b640 1 -- 172.21.15.2:0/2561287304 shutdown_connections 2024-09-19T04:56:21.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.541+0000 7f503737b640 1 -- 172.21.15.2:0/2561287304 wait complete. 2024-09-19T04:56:21.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.542+0000 7f503737b640 1 Processor -- start 2024-09-19T04:56:21.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.542+0000 7f503737b640 1 -- start start 2024-09-19T04:56:21.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.542+0000 7f503737b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5030100e20 0x7f503019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:21.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.542+0000 7f503737b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5030102570 0x7f503019ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:21.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.542+0000 7f503737b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5030102ef0 0x7f503019eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:21.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.542+0000 7f503737b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5030110e30 con 0x7f5030100e20 2024-09-19T04:56:21.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.542+0000 7f503737b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5030110cb0 con 0x7f5030102570 2024-09-19T04:56:21.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.542+0000 7f503737b640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f5030110fb0 con 0x7f5030102ef0 2024-09-19T04:56:21.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.542+0000 7f5035117640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5030100e20 0x7f503019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:21.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.542+0000 7f5035117640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5030100e20 0x7f503019a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57198/0 (socket says 172.21.15.2:57198) 2024-09-19T04:56:21.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.542+0000 7f5035117640 1 -- 172.21.15.2:0/2532815836 learned_addr learned my addr 172.21.15.2:0/2532815836 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:56:21.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.542+0000 7f5035918640 1 --2- 172.21.15.2:0/2532815836 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5030102ef0 0x7f503019eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:21.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.543+0000 7f5034916640 1 --2- 172.21.15.2:0/2532815836 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5030102570 0x7f503019ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:21.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.543+0000 7f5035117640 1 -- 172.21.15.2:0/2532815836 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5030102ef0 msgr2=0x7f503019eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:21.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.543+0000 7f5035117640 1 --2- 172.21.15.2:0/2532815836 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5030102ef0 0x7f503019eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:21.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.543+0000 7f5035117640 1 -- 172.21.15.2:0/2532815836 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5030102570 msgr2=0x7f503019ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:21.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.543+0000 7f5035117640 1 --2- 172.21.15.2:0/2532815836 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5030102570 0x7f503019ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:21.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.543+0000 7f5035117640 1 -- 172.21.15.2:0/2532815836 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f503019f5d0 con 0x7f5030100e20 2024-09-19T04:56:21.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.543+0000 7f5035117640 1 --2- 172.21.15.2:0/2532815836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5030100e20 0x7f503019a620 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f5028006010 tx=0x7f50280042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:56:21.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.543+0000 7f502e7fc640 1 -- 172.21.15.2:0/2532815836 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f502803f030 con 0x7f5030100e20 2024-09-19T04:56:21.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.543+0000 7f502e7fc640 1 -- 172.21.15.2:0/2532815836 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5028003cb0 con 0x7f5030100e20 2024-09-19T04:56:21.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.543+0000 7f502e7fc640 1 -- 172.21.15.2:0/2532815836 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5028035070 con 0x7f5030100e20 2024-09-19T04:56:21.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.543+0000 7f503737b640 1 -- 172.21.15.2:0/2532815836 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f503019f860 con 0x7f5030100e20 2024-09-19T04:56:21.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.543+0000 7f503737b640 1 -- 172.21.15.2:0/2532815836 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50301a71a0 con 0x7f5030100e20 2024-09-19T04:56:21.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.544+0000 7f503737b640 1 -- 172.21.15.2:0/2532815836 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50301021b0 con 0x7f5030100e20 2024-09-19T04:56:21.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.546+0000 7f502e7fc640 1 -- 172.21.15.2:0/2532815836 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f5028042030 con 0x7f5030100e20 2024-09-19T04:56:21.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.546+0000 7f502e7fc640 1 --2- 172.21.15.2:0/2532815836 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f50180a33b0 0x7f50180a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:21.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.546+0000 7f5034916640 1 --2- 172.21.15.2:0/2532815836 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f50180a33b0 0x7f50180a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:21.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.546+0000 7f502e7fc640 1 -- 172.21.15.2:0/2532815836 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7f50280f0150 con 0x7f5030100e20 2024-09-19T04:56:21.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.547+0000 7f5034916640 1 --2- 172.21.15.2:0/2532815836 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f50180a33b0 0x7f50180a5870 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f503010ddf0 tx=0x7f502400b390 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:56:21.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.551+0000 7f502e7fc640 1 -- 172.21.15.2:0/2532815836 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f50280bc4e0 con 0x7f5030100e20 2024-09-19T04:56:21.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.764+0000 7f503737b640 1 -- 172.21.15.2:0/2532815836 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f50301a7370 con 0x7f5030100e20 2024-09-19T04:56:21.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.765+0000 7f502e7fc640 1 -- 172.21.15.2:0/2532815836 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11840 (secure 0 0 0) 0x7f50280c07e0 con 0x7f5030100e20 2024-09-19T04:56:21.766 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:56:21.766 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":19,"btime":"2024-09-19T04:46:33:537239+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2467365137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2467365137},{"type":"v1","addr":"172.21.15.2:6835","nonce":2467365137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3162441888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3162441888},{"type":"v1","addr":"172.21.15.2:6837","nonce":3162441888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14631,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2740862966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2740862966},{"type":"v1","addr":"172.21.15.2:6839","nonce":2740862966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/2394435504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2394435504},{"type":"v1","addr":"172.21.15.2:6841","nonce":2394435504}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1630480244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1630480244},{"type":"v1","addr":"172.21.15.18:6833","nonce":1630480244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1553897465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1553897465},{"type":"v1","addr":"172.21.15.116:6833","nonce":1553897465}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3035664608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3035664608},{"type":"v1","addr":"172.21.15.18:6835","nonce":3035664608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1096622392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1096622392},{"type":"v1","addr":"172.21.15.18:6837","nonce":1096622392}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3761157675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3761157675},{"type":"v1","addr":"172.21.15.116:6835","nonce":3761157675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/1120131594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1120131594},{"type":"v1","addr":"172.21.15.116:6837","nonce":1120131594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:46:24.050115+0000","modified":"2024-09-19T04:46:33.112369+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/4207677139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":4207677139},{"type":"v1","addr":"172.21.15.18:6839","nonce":4207677139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/2346874880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":2346874880},{"type":"v1","addr":"172.21.15.116:6839","nonce":2346874880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496]},"id":1}]} 2024-09-19T04:56:21.767 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 19 2024-09-19T04:56:21.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.767+0000 7f503737b640 1 -- 172.21.15.2:0/2532815836 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f50180a33b0 msgr2=0x7f50180a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:21.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.767+0000 7f503737b640 1 --2- 172.21.15.2:0/2532815836 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f50180a33b0 0x7f50180a5870 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f503010ddf0 tx=0x7f502400b390 comp rx=0 tx=0).stop 2024-09-19T04:56:21.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.767+0000 7f503737b640 1 -- 172.21.15.2:0/2532815836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5030100e20 msgr2=0x7f503019a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:21.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.767+0000 7f503737b640 1 --2- 172.21.15.2:0/2532815836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5030100e20 0x7f503019a620 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f5028006010 tx=0x7f50280042f0 comp rx=0 tx=0).stop 2024-09-19T04:56:21.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.767+0000 7f503737b640 1 -- 172.21.15.2:0/2532815836 shutdown_connections 2024-09-19T04:56:21.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.767+0000 7f503737b640 1 --2- 172.21.15.2:0/2532815836 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f50180a33b0 0x7f50180a5870 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:21.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.767+0000 7f503737b640 1 --2- 172.21.15.2:0/2532815836 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5030102ef0 0x7f503019eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:21.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.767+0000 7f503737b640 1 --2- 172.21.15.2:0/2532815836 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5030102570 0x7f503019ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:21.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.767+0000 7f503737b640 1 --2- 172.21.15.2:0/2532815836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5030100e20 0x7f503019a620 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:21.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.767+0000 7f503737b640 1 -- 172.21.15.2:0/2532815836 >> 172.21.15.2:0/2532815836 conn(0x7f50300fc7d0 msgr2=0x7f503006a030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:56:21.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.767+0000 7f503737b640 1 -- 172.21.15.2:0/2532815836 shutdown_connections 2024-09-19T04:56:21.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:21.767+0000 7f503737b640 1 -- 172.21.15.2:0/2532815836 wait complete. 2024-09-19T04:56:22.370 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:56:22.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:56:22 smithi002 ceph-mon[30975]: pgmap v258: 97 pgs: 97 active+clean; 14 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 53 KiB/s wr, 9 op/s 2024-09-19T04:56:22.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:56:22 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/2532815836' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:56:22.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:56:22 smithi116 ceph-mon[34477]: pgmap v258: 97 pgs: 97 active+clean; 14 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 53 KiB/s wr, 9 op/s 2024-09-19T04:56:22.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:56:22 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/2532815836' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:56:22.629 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:56:22.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:56:22 smithi018 ceph-mon[34537]: pgmap v258: 97 pgs: 97 active+clean; 14 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 53 KiB/s wr, 9 op/s 2024-09-19T04:56:22.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:56:22 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/2532815836' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:56:23.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.174+0000 7fcb7572a640 1 -- 172.21.15.2:0/1396803277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb70103650 msgr2=0x7fcb7010bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:23.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.174+0000 7fcb7572a640 1 --2- 172.21.15.2:0/1396803277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb70103650 0x7fcb7010bb40 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fcb64009900 tx=0x7fcb6402a480 comp rx=0 tx=0).stop 2024-09-19T04:56:23.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.174+0000 7fcb7572a640 1 -- 172.21.15.2:0/1396803277 shutdown_connections 2024-09-19T04:56:23.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.174+0000 7fcb7572a640 1 --2- 172.21.15.2:0/1396803277 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcb7010c160 0x7fcb7010e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:23.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.174+0000 7fcb7572a640 1 --2- 172.21.15.2:0/1396803277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb70103650 0x7fcb7010bb40 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:23.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.174+0000 7fcb7572a640 1 --2- 172.21.15.2:0/1396803277 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb70102d30 0x7fcb70103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:23.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.174+0000 7fcb7572a640 1 -- 172.21.15.2:0/1396803277 >> 172.21.15.2:0/1396803277 conn(0x7fcb700fc7d0 msgr2=0x7fcb700febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:56:23.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.175+0000 7fcb7572a640 1 -- 172.21.15.2:0/1396803277 shutdown_connections 2024-09-19T04:56:23.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.175+0000 7fcb7572a640 1 -- 172.21.15.2:0/1396803277 wait complete. 2024-09-19T04:56:23.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.175+0000 7fcb7572a640 1 Processor -- start 2024-09-19T04:56:23.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.175+0000 7fcb7572a640 1 -- start start 2024-09-19T04:56:23.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.175+0000 7fcb7572a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb70102d30 0x7fcb70198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:23.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.176+0000 7fcb7572a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb70103650 0x7fcb701988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:23.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.176+0000 7fcb7572a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcb7010c160 0x7fcb7019cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:23.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.176+0000 7fcb7572a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcb70111e10 con 0x7fcb70102d30 2024-09-19T04:56:23.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.176+0000 7fcb7572a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcb70111c90 con 0x7fcb70103650 2024-09-19T04:56:23.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.176+0000 7fcb7572a640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fcb70111f90 con 0x7fcb7010c160 2024-09-19T04:56:23.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.176+0000 7fcb6effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb70102d30 0x7fcb70198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:23.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.176+0000 7fcb6effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb70102d30 0x7fcb70198390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57220/0 (socket says 172.21.15.2:57220) 2024-09-19T04:56:23.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.176+0000 7fcb6effd640 1 -- 172.21.15.2:0/3445873787 learned_addr learned my addr 172.21.15.2:0/3445873787 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:56:23.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.176+0000 7fcb6e7fc640 1 --2- 172.21.15.2:0/3445873787 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb70103650 0x7fcb701988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:23.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.176+0000 7fcb6effd640 1 -- 172.21.15.2:0/3445873787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcb7010c160 msgr2=0x7fcb7019cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:23.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.176+0000 7fcb6effd640 1 --2- 172.21.15.2:0/3445873787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcb7010c160 0x7fcb7019cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:23.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.176+0000 7fcb6effd640 1 -- 172.21.15.2:0/3445873787 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb70103650 msgr2=0x7fcb701988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:23.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.176+0000 7fcb6effd640 1 --2- 172.21.15.2:0/3445873787 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb70103650 0x7fcb701988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:23.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.176+0000 7fcb6effd640 1 -- 172.21.15.2:0/3445873787 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb7019d340 con 0x7fcb70102d30 2024-09-19T04:56:23.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.176+0000 7fcb6e7fc640 1 --2- 172.21.15.2:0/3445873787 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb70103650 0x7fcb701988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:56:23.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.176+0000 7fcb6effd640 1 --2- 172.21.15.2:0/3445873787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb70102d30 0x7fcb70198390 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fcb6000eab0 tx=0x7fcb6000ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:56:23.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.176+0000 7fcb57fff640 1 -- 172.21.15.2:0/3445873787 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb6000ce40 con 0x7fcb70102d30 2024-09-19T04:56:23.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.176+0000 7fcb57fff640 1 -- 172.21.15.2:0/3445873787 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcb60011920 con 0x7fcb70102d30 2024-09-19T04:56:23.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.176+0000 7fcb7572a640 1 -- 172.21.15.2:0/3445873787 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb7019d630 con 0x7fcb70102d30 2024-09-19T04:56:23.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.176+0000 7fcb57fff640 1 -- 172.21.15.2:0/3445873787 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb60010a00 con 0x7fcb70102d30 2024-09-19T04:56:23.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.176+0000 7fcb7572a640 1 -- 172.21.15.2:0/3445873787 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb701a4f10 con 0x7fcb70102d30 2024-09-19T04:56:23.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.179+0000 7fcb57fff640 1 -- 172.21.15.2:0/3445873787 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fcb60011ad0 con 0x7fcb70102d30 2024-09-19T04:56:23.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.179+0000 7fcb77b03740 1 Processor -- start 2024-09-19T04:56:23.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.179+0000 7fcb77b03740 1 -- start start 2024-09-19T04:56:23.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.179+0000 7fcb77b03740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f49e990b40 0x55f49e98f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:23.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.179+0000 7fcb77b03740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f49e98f5d0 0x55f49e98fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:23.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.179+0000 7fcb77b03740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f49e99a370 0x55f49e99c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:23.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.179+0000 7fcb77b03740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f49e8f52f0 con 0x55f49e98f5d0 2024-09-19T04:56:23.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.179+0000 7fcb77b03740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f49e89ccf0 con 0x55f49e990b40 2024-09-19T04:56:23.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.179+0000 7fcb77b03740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55f49e8f12b0 con 0x55f49e99a370 2024-09-19T04:56:23.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.179+0000 7fcb6effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f49e98f5d0 0x55f49e98fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:23.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.179+0000 7fcb6effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f49e98f5d0 0x55f49e98fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57222/0 (socket says 172.21.15.2:57222) 2024-09-19T04:56:23.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.179+0000 7fcb6effd640 1 -- 172.21.15.2:0/2529263734 learned_addr learned my addr 172.21.15.2:0/2529263734 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:56:23.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.180+0000 7fcb6e7fc640 1 --2- 172.21.15.2:0/2529263734 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f49e99a370 0x55f49e99c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:23.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.180+0000 7fcb57fff640 1 --2- 172.21.15.2:0/3445873787 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fcb580a33b0 0x7fcb580a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:23.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.180+0000 7fcb6f7fe640 1 --2- 172.21.15.2:0/2529263734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f49e990b40 0x55f49e98f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:23.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.180+0000 7fcb6f7fe640 1 --2- 172.21.15.2:0/3445873787 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fcb580a33b0 0x7fcb580a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:23.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.180+0000 7fcb57fff640 1 -- 172.21.15.2:0/3445873787 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7fcb600d03f0 con 0x7fcb70102d30 2024-09-19T04:56:23.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.180+0000 7fcb6effd640 1 -- 172.21.15.2:0/2529263734 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f49e99a370 msgr2=0x55f49e99c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:56:23.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.180+0000 7fcb6effd640 1 --2- 172.21.15.2:0/2529263734 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f49e99a370 0x55f49e99c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:23.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.180+0000 7fcb6effd640 1 -- 172.21.15.2:0/2529263734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f49e990b40 msgr2=0x55f49e98f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:56:23.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.180+0000 7fcb6effd640 1 --2- 172.21.15.2:0/2529263734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f49e990b40 0x55f49e98f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:23.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.180+0000 7fcb6effd640 1 -- 172.21.15.2:0/2529263734 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f49e8813a0 con 0x55f49e98f5d0 2024-09-19T04:56:23.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.180+0000 7fcb6e7fc640 1 --2- 172.21.15.2:0/2529263734 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f49e99a370 0x55f49e99c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:56:23.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.180+0000 7fcb6effd640 1 --2- 172.21.15.2:0/2529263734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f49e98f5d0 0x55f49e98fa10 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fcb6009c3d0 tx=0x7fcb6001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71537ee3fc131665 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:56:23.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.180+0000 7fcb6f7fe640 1 --2- 172.21.15.2:0/3445873787 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fcb580a33b0 0x7fcb580a5870 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcb6800ae70 tx=0x7fcb68005870 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:56:23.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.180+0000 7fcb557fa640 1 -- 172.21.15.2:0/2529263734 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb6009cdd0 con 0x55f49e98f5d0 2024-09-19T04:56:23.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.180+0000 7fcb557fa640 1 -- 172.21.15.2:0/2529263734 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcb600a5340 con 0x55f49e98f5d0 2024-09-19T04:56:23.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.180+0000 7fcb557fa640 1 -- 172.21.15.2:0/2529263734 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb60098d40 con 0x55f49e98f5d0 2024-09-19T04:56:23.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.181+0000 7fcb77b03740 1 -- 172.21.15.2:0/2529263734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f49e98f5d0 msgr2=0x55f49e98fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:23.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.181+0000 7fcb77b03740 1 --2- 172.21.15.2:0/2529263734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f49e98f5d0 0x55f49e98fa10 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fcb6009c3d0 tx=0x7fcb6001e000 comp rx=0 tx=0).stop 2024-09-19T04:56:23.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.181+0000 7fcb77b03740 1 -- 172.21.15.2:0/2529263734 shutdown_connections 2024-09-19T04:56:23.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.181+0000 7fcb77b03740 1 --2- 172.21.15.2:0/2529263734 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f49e99a370 0x55f49e99c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:23.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.181+0000 7fcb77b03740 1 --2- 172.21.15.2:0/2529263734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f49e98f5d0 0x55f49e98fa10 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:23.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.181+0000 7fcb77b03740 1 --2- 172.21.15.2:0/2529263734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f49e990b40 0x55f49e98f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:23.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.181+0000 7fcb77b03740 1 -- 172.21.15.2:0/2529263734 >> 172.21.15.2:0/2529263734 conn(0x55f49e958310 msgr2=0x55f49e98bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:56:23.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.181+0000 7fcb77b03740 1 -- 172.21.15.2:0/2529263734 shutdown_connections 2024-09-19T04:56:23.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.181+0000 7fcb77b03740 1 -- 172.21.15.2:0/2529263734 wait complete. 2024-09-19T04:56:23.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.181+0000 7fcb77b03740 1 -- start start 2024-09-19T04:56:23.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.182+0000 7fcb77b03740 1 Processor -- start 2024-09-19T04:56:23.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.182+0000 7fcb77b03740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f49e98f5d0 0x55f49e999dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:23.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.182+0000 7fcb77b03740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f49e990b40 0x55f49e997080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:23.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.182+0000 7fcb77b03740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f49e99a370 0x55f49e997810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:23.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.182+0000 7fcb77b03740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f49e99d010 con 0x55f49e98f5d0 2024-09-19T04:56:23.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.182+0000 7fcb77b03740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f49e8b0060 con 0x55f49e990b40 2024-09-19T04:56:23.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.182+0000 7fcb77b03740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55f49e99d190 con 0x55f49e99a370 2024-09-19T04:56:23.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.182+0000 7fcb77b03740 10 client.0 _ll_register_callbacks cb 0x55f49e6038c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:56:23.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.182+0000 7fcb6effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f49e98f5d0 0x55f49e999dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:23.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.182+0000 7fcb6effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f49e98f5d0 0x55f49e999dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57236/0 (socket says 172.21.15.2:57236) 2024-09-19T04:56:23.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.182+0000 7fcb6effd640 1 -- 172.21.15.2:0/2815786980 learned_addr learned my addr 172.21.15.2:0/2815786980 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:56:23.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.182+0000 7fcb6e7fc640 1 --2- 172.21.15.2:0/2815786980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f49e990b40 0x55f49e997080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:23.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.182+0000 7fcb6f7fe640 1 --2- 172.21.15.2:0/2815786980 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f49e99a370 0x55f49e997810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:23.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.182+0000 7fcb6effd640 1 -- 172.21.15.2:0/2815786980 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f49e99a370 msgr2=0x55f49e997810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:56:23.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.182+0000 7fcb6effd640 1 --2- 172.21.15.2:0/2815786980 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f49e99a370 0x55f49e997810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:23.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.182+0000 7fcb6effd640 1 -- 172.21.15.2:0/2815786980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f49e990b40 msgr2=0x55f49e997080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:56:23.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.182+0000 7fcb6effd640 1 --2- 172.21.15.2:0/2815786980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f49e990b40 0x55f49e997080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:23.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.182+0000 7fcb6effd640 1 -- 172.21.15.2:0/2815786980 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f49e6663c0 con 0x55f49e98f5d0 2024-09-19T04:56:23.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.182+0000 7fcb6f7fe640 1 --2- 172.21.15.2:0/2815786980 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f49e99a370 0x55f49e997810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:56:23.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.183+0000 7fcb6effd640 1 --2- 172.21.15.2:0/2815786980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f49e98f5d0 0x55f49e999dd0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fcb6009c3d0 tx=0x7fcb600d0760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=606d64ad5a254c29 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:56:23.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.183+0000 7fcb52ff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:56:23.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.183+0000 7fcb52ff5640 1 -- 172.21.15.2:0/2815786980 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb6009c6d0 con 0x55f49e98f5d0 2024-09-19T04:56:23.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.183+0000 7fcb52ff5640 1 -- 172.21.15.2:0/2815786980 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7fcb600202b0 con 0x55f49e98f5d0 2024-09-19T04:56:23.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.183+0000 7fcb77b03740 1 -- 172.21.15.2:0/2815786980 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb600a5340 con 0x55f49e98f5d0 2024-09-19T04:56:23.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.183+0000 7fcb52ff5640 1 -- 172.21.15.2:0/2815786980 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fcb600204b0 con 0x55f49e98f5d0 2024-09-19T04:56:23.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.183+0000 7fcb77b03740 10 client.16416 fetch_fsmap learned FSMap version 19 2024-09-19T04:56:23.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.183+0000 7fcb77b03740 1 -- 172.21.15.2:0/2815786980 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55f49e9a8b30 con 0x55f49e98f5d0 2024-09-19T04:56:23.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.183+0000 7fcb52ff5640 1 -- 172.21.15.2:0/2815786980 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcb600a5340 con 0x55f49e98f5d0 2024-09-19T04:56:23.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.183+0000 7fcb52ff5640 1 -- 172.21.15.2:0/2815786980 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fcb600d0070 con 0x55f49e98f5d0 2024-09-19T04:56:23.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.183+0000 7fcb77b03740 10 client.16416 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:56:23.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.183+0000 7fcb77b03740 10 client.16416 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:56:23.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.183+0000 7fcb77b03740 20 client.16416 populate_metadata read hostname 'smithi002' 2024-09-19T04:56:23.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.183+0000 7fcb77b03740 1 --2- 172.21.15.2:0/2815786980 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f49e9a9e80 0x55f49e9ac270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:23.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.183+0000 7fcb77b03740 4 client.16416 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:56:23.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.183+0000 7fcb77b03740 1 -- 172.21.15.2:0/2815786980 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f49e902860 con 0x55f49e9a9e80 2024-09-19T04:56:23.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.184+0000 7fcb6e7fc640 1 --2- 172.21.15.2:0/2815786980 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f49e9a9e80 0x55f49e9ac270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:23.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.184+0000 7fcb6e7fc640 1 --2- 172.21.15.2:0/2815786980 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f49e9a9e80 0x55f49e9ac270 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abb963d981b32f0 server_cookie=7946a2d9b3c265a9 in_seq=0 out_seq=0 2024-09-19T04:56:23.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.184+0000 7fcb52ff5640 10 client.16416 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:56:23.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.185+0000 7fcb52ff5640 1 -- 172.21.15.2:0/2815786980 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f49e902860 con 0x55f49e9a9e80 2024-09-19T04:56:23.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.185+0000 7fcb52ff5640 10 client.16416 handle_command_reply: tid=0 2024-09-19T04:56:23.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.185+0000 7fcb77b03740 1 client.16416 shutdown 2024-09-19T04:56:23.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.185+0000 7fcb77b03740 1 -- 172.21.15.2:0/2815786980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f49e98f5d0 msgr2=0x55f49e999dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:23.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.185+0000 7fcb77b03740 1 --2- 172.21.15.2:0/2815786980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f49e98f5d0 0x55f49e999dd0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fcb6009c3d0 tx=0x7fcb600d0760 comp rx=0 tx=0).stop 2024-09-19T04:56:23.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.185+0000 7fcb77b03740 1 -- 172.21.15.2:0/2815786980 shutdown_connections 2024-09-19T04:56:23.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.185+0000 7fcb77b03740 1 --2- 172.21.15.2:0/2815786980 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f49e9a9e80 0x55f49e9ac270 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:23.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.185+0000 7fcb77b03740 1 --2- 172.21.15.2:0/2815786980 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f49e99a370 0x55f49e997810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:23.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.185+0000 7fcb77b03740 1 --2- 172.21.15.2:0/2815786980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f49e990b40 0x55f49e997080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:23.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.185+0000 7fcb77b03740 1 --2- 172.21.15.2:0/2815786980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f49e98f5d0 0x55f49e999dd0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:23.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.185+0000 7fcb77b03740 1 -- 172.21.15.2:0/2815786980 >> 172.21.15.2:0/2815786980 conn(0x55f49e958310 msgr2=0x55f49e991990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:56:23.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.185+0000 7fcb52ff5640 0 client.16416 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:56:23.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.185+0000 7fcb77b03740 1 -- 172.21.15.2:0/2815786980 shutdown_connections 2024-09-19T04:56:23.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.185+0000 7fcb77b03740 1 -- 172.21.15.2:0/2815786980 wait complete. 2024-09-19T04:56:23.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.185+0000 7fcb77b03740 20 client.16416 trim_cache size 0 max 16384 2024-09-19T04:56:23.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.198+0000 7fcb77b03740 1 Processor -- start 2024-09-19T04:56:23.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.198+0000 7fcb77b03740 1 -- start start 2024-09-19T04:56:23.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.198+0000 7fcb77b03740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f49e98f5d0 0x55f49e9aeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:23.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.198+0000 7fcb77b03740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f49e990b40 0x55f49e9af3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:23.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.198+0000 7fcb77b03740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f49e99a370 0x55f49e98b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:23.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.198+0000 7fcb77b03740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcb701ab880 con 0x55f49e98f5d0 2024-09-19T04:56:23.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.198+0000 7fcb77b03740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcb701ae0e0 con 0x55f49e990b40 2024-09-19T04:56:23.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.198+0000 7fcb77b03740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fcb701abed0 con 0x55f49e99a370 2024-09-19T04:56:23.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.199+0000 7fcb6effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f49e98f5d0 0x55f49e9aeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:23.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.199+0000 7fcb6effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f49e98f5d0 0x55f49e9aeeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57240/0 (socket says 172.21.15.2:57240) 2024-09-19T04:56:23.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.199+0000 7fcb6effd640 1 -- 172.21.15.2:0/1978690908 learned_addr learned my addr 172.21.15.2:0/1978690908 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:56:23.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.199+0000 7fcb6f7fe640 1 --2- 172.21.15.2:0/1978690908 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f49e99a370 0x55f49e98b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:23.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.199+0000 7fcb6effd640 1 -- 172.21.15.2:0/1978690908 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f49e99a370 msgr2=0x55f49e98b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:56:23.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.199+0000 7fcb6effd640 1 --2- 172.21.15.2:0/1978690908 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f49e99a370 0x55f49e98b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:23.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.199+0000 7fcb6effd640 1 -- 172.21.15.2:0/1978690908 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f49e990b40 msgr2=0x55f49e9af3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:56:23.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.199+0000 7fcb6e7fc640 1 --2- 172.21.15.2:0/1978690908 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f49e990b40 0x55f49e9af3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:23.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.199+0000 7fcb6effd640 1 --2- 172.21.15.2:0/1978690908 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f49e990b40 0x55f49e9af3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:23.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.199+0000 7fcb6effd640 1 -- 172.21.15.2:0/1978690908 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f49e997b80 con 0x55f49e98f5d0 2024-09-19T04:56:23.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.199+0000 7fcb6f7fe640 1 --2- 172.21.15.2:0/1978690908 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f49e99a370 0x55f49e98b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:56:23.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.199+0000 7fcb6effd640 1 --2- 172.21.15.2:0/1978690908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f49e98f5d0 0x55f49e9aeeb0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fcb600990a0 tx=0x7fcb6001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c879c80044b18b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:56:23.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.199+0000 7fcb54ff9640 1 -- 172.21.15.2:0/1978690908 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb6009bb20 con 0x55f49e98f5d0 2024-09-19T04:56:23.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.199+0000 7fcb54ff9640 1 -- 172.21.15.2:0/1978690908 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcb6009cdd0 con 0x55f49e98f5d0 2024-09-19T04:56:23.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.199+0000 7fcb54ff9640 1 -- 172.21.15.2:0/1978690908 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb600a4eb0 con 0x55f49e98f5d0 2024-09-19T04:56:23.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.200+0000 7fcb77b03740 1 -- 172.21.15.2:0/1978690908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f49e98f5d0 msgr2=0x55f49e9aeeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:23.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.200+0000 7fcb77b03740 1 --2- 172.21.15.2:0/1978690908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f49e98f5d0 0x55f49e9aeeb0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fcb600990a0 tx=0x7fcb6001e000 comp rx=0 tx=0).stop 2024-09-19T04:56:23.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.200+0000 7fcb77b03740 1 -- 172.21.15.2:0/1978690908 shutdown_connections 2024-09-19T04:56:23.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.200+0000 7fcb77b03740 1 --2- 172.21.15.2:0/1978690908 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f49e99a370 0x55f49e98b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:23.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.200+0000 7fcb77b03740 1 --2- 172.21.15.2:0/1978690908 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f49e990b40 0x55f49e9af3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:23.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.200+0000 7fcb77b03740 1 --2- 172.21.15.2:0/1978690908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f49e98f5d0 0x55f49e9aeeb0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:23.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.200+0000 7fcb77b03740 1 -- 172.21.15.2:0/1978690908 >> 172.21.15.2:0/1978690908 conn(0x55f49e958310 msgr2=0x55f49e992310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:56:23.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.200+0000 7fcb77b03740 1 -- 172.21.15.2:0/1978690908 shutdown_connections 2024-09-19T04:56:23.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.200+0000 7fcb77b03740 1 -- 172.21.15.2:0/1978690908 wait complete. 2024-09-19T04:56:23.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.200+0000 7fcb77b03740 1 -- start start 2024-09-19T04:56:23.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.200+0000 7fcb77b03740 1 Processor -- start 2024-09-19T04:56:23.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.201+0000 7fcb77b03740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f49e98f5d0 0x55f49e9af490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:23.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.201+0000 7fcb77b03740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f49e990b40 0x55f49e9ac7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:23.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.201+0000 7fcb77b03740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f49e99a370 0x55f49e9acd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:23.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.201+0000 7fcb77b03740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcb701ac5a0 con 0x55f49e990b40 2024-09-19T04:56:23.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.201+0000 7fcb77b03740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcb701ada10 con 0x55f49e98f5d0 2024-09-19T04:56:23.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.201+0000 7fcb77b03740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fcb701acc70 con 0x55f49e99a370 2024-09-19T04:56:23.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.201+0000 7fcb77b03740 10 client.0 _ll_register_callbacks cb 0x7fcb68005e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:56:23.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.201+0000 7fcb6e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f49e990b40 0x55f49e9ac7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:23.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.201+0000 7fcb6e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f49e990b40 0x55f49e9ac7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57250/0 (socket says 172.21.15.2:57250) 2024-09-19T04:56:23.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.201+0000 7fcb6e7fc640 1 -- 172.21.15.2:0/3714380107 learned_addr learned my addr 172.21.15.2:0/3714380107 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:56:23.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.201+0000 7fcb6effd640 1 --2- 172.21.15.2:0/3714380107 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f49e98f5d0 0x55f49e9af490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:23.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.201+0000 7fcb6f7fe640 1 --2- 172.21.15.2:0/3714380107 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f49e99a370 0x55f49e9acd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:23.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.201+0000 7fcb6e7fc640 1 -- 172.21.15.2:0/3714380107 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f49e99a370 msgr2=0x55f49e9acd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:56:23.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.201+0000 7fcb6e7fc640 1 --2- 172.21.15.2:0/3714380107 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f49e99a370 0x55f49e9acd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:23.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.201+0000 7fcb6e7fc640 1 -- 172.21.15.2:0/3714380107 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f49e98f5d0 msgr2=0x55f49e9af490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:56:23.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.201+0000 7fcb6e7fc640 1 --2- 172.21.15.2:0/3714380107 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f49e98f5d0 0x55f49e9af490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:23.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.201+0000 7fcb6e7fc640 1 -- 172.21.15.2:0/3714380107 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f49e9ad3c0 con 0x55f49e990b40 2024-09-19T04:56:23.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.201+0000 7fcb6e7fc640 1 --2- 172.21.15.2:0/3714380107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f49e990b40 0x55f49e9ac7e0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fcb64009850 tx=0x7fcb64032e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=304bc86fbd79b391 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:56:23.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.201+0000 7fcb52ff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:56:23.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.201+0000 7fcb52ff5640 1 -- 172.21.15.2:0/3714380107 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb64035040 con 0x55f49e990b40 2024-09-19T04:56:23.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.201+0000 7fcb52ff5640 1 -- 172.21.15.2:0/3714380107 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7fcb64004390 con 0x55f49e990b40 2024-09-19T04:56:23.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.202+0000 7fcb77b03740 1 -- 172.21.15.2:0/3714380107 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb6009cdd0 con 0x55f49e990b40 2024-09-19T04:56:23.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.202+0000 7fcb52ff5640 1 -- 172.21.15.2:0/3714380107 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fcb64052050 con 0x55f49e990b40 2024-09-19T04:56:23.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.202+0000 7fcb77b03740 10 client.16422 fetch_fsmap learned FSMap version 19 2024-09-19T04:56:23.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.202+0000 7fcb77b03740 1 -- 172.21.15.2:0/3714380107 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55f49ea145d0 con 0x55f49e990b40 2024-09-19T04:56:23.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.202+0000 7fcb52ff5640 1 -- 172.21.15.2:0/3714380107 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcb6009cdd0 con 0x55f49e990b40 2024-09-19T04:56:23.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.202+0000 7fcb52ff5640 1 -- 172.21.15.2:0/3714380107 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fcb64004b50 con 0x55f49e990b40 2024-09-19T04:56:23.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.202+0000 7fcb77b03740 10 client.16422 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:56:23.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.202+0000 7fcb77b03740 10 client.16422 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:56:23.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.202+0000 7fcb77b03740 20 client.16422 populate_metadata read hostname 'smithi002' 2024-09-19T04:56:23.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.202+0000 7fcb77b03740 1 --2- 172.21.15.2:0/3714380107 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f49ea14da0 0x55f49ea171c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:23.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.202+0000 7fcb77b03740 4 client.16422 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:56:23.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.202+0000 7fcb77b03740 1 -- 172.21.15.2:0/3714380107 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f49e8fcd70 con 0x55f49ea14da0 2024-09-19T04:56:23.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.202+0000 7fcb6effd640 1 --2- 172.21.15.2:0/3714380107 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f49ea14da0 0x55f49ea171c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:23.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.203+0000 7fcb6effd640 1 --2- 172.21.15.2:0/3714380107 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f49ea14da0 0x55f49ea171c0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b54478966f85785 server_cookie=f98eb3c829436394 in_seq=0 out_seq=0 2024-09-19T04:56:23.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.203+0000 7fcb52ff5640 10 client.16422 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:56:23.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.203+0000 7fcb52ff5640 1 -- 172.21.15.2:0/3714380107 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f49e8fcd70 con 0x55f49ea14da0 2024-09-19T04:56:23.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.203+0000 7fcb52ff5640 10 client.16422 handle_command_reply: tid=0 2024-09-19T04:56:23.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.203+0000 7fcb77b03740 1 client.16422 shutdown 2024-09-19T04:56:23.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.203+0000 7fcb77b03740 1 -- 172.21.15.2:0/3714380107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f49e990b40 msgr2=0x55f49e9ac7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:23.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.203+0000 7fcb77b03740 1 --2- 172.21.15.2:0/3714380107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f49e990b40 0x55f49e9ac7e0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fcb64009850 tx=0x7fcb64032e90 comp rx=0 tx=0).stop 2024-09-19T04:56:23.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.203+0000 7fcb77b03740 1 -- 172.21.15.2:0/3714380107 shutdown_connections 2024-09-19T04:56:23.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.203+0000 7fcb77b03740 1 --2- 172.21.15.2:0/3714380107 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f49ea14da0 0x55f49ea171c0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:23.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.203+0000 7fcb77b03740 1 --2- 172.21.15.2:0/3714380107 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f49e99a370 0x55f49e9acd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:23.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.203+0000 7fcb77b03740 1 --2- 172.21.15.2:0/3714380107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f49e990b40 0x55f49e9ac7e0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:23.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.203+0000 7fcb77b03740 1 --2- 172.21.15.2:0/3714380107 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f49e98f5d0 0x55f49e9af490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:23.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.203+0000 7fcb52ff5640 0 client.16422 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:56:23.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.203+0000 7fcb77b03740 1 -- 172.21.15.2:0/3714380107 >> 172.21.15.2:0/3714380107 conn(0x55f49e958310 msgr2=0x55f49e9a5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:56:23.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.203+0000 7fcb77b03740 1 -- 172.21.15.2:0/3714380107 shutdown_connections 2024-09-19T04:56:23.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.203+0000 7fcb77b03740 1 -- 172.21.15.2:0/3714380107 wait complete. 2024-09-19T04:56:23.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.203+0000 7fcb77b03740 20 client.16422 trim_cache size 0 max 16384 2024-09-19T04:56:23.214 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T04:56:23.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.204+0000 7fcb7572a640 1 -- 172.21.15.2:0/3445873787 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fcb580a33b0 msgr2=0x7fcb580a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:23.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.204+0000 7fcb7572a640 1 --2- 172.21.15.2:0/3445873787 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fcb580a33b0 0x7fcb580a5870 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcb6800ae70 tx=0x7fcb68005870 comp rx=0 tx=0).stop 2024-09-19T04:56:23.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.204+0000 7fcb7572a640 1 -- 172.21.15.2:0/3445873787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb70102d30 msgr2=0x7fcb70198390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:23.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.204+0000 7fcb7572a640 1 --2- 172.21.15.2:0/3445873787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb70102d30 0x7fcb70198390 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fcb6000eab0 tx=0x7fcb6000ef70 comp rx=0 tx=0).stop 2024-09-19T04:56:23.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.204+0000 7fcb7572a640 1 -- 172.21.15.2:0/3445873787 shutdown_connections 2024-09-19T04:56:23.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.204+0000 7fcb7572a640 1 --2- 172.21.15.2:0/3445873787 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fcb580a33b0 0x7fcb580a5870 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:23.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.204+0000 7fcb7572a640 1 --2- 172.21.15.2:0/3445873787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcb7010c160 0x7fcb7019cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:23.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.204+0000 7fcb7572a640 1 --2- 172.21.15.2:0/3445873787 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb70103650 0x7fcb701988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:23.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.204+0000 7fcb7572a640 1 --2- 172.21.15.2:0/3445873787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb70102d30 0x7fcb70198390 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:23.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.204+0000 7fcb7572a640 1 -- 172.21.15.2:0/3445873787 >> 172.21.15.2:0/3445873787 conn(0x7fcb700fc7d0 msgr2=0x7fcb700fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:56:23.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.204+0000 7fcb7572a640 1 -- 172.21.15.2:0/3445873787 shutdown_connections 2024-09-19T04:56:23.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:23.204+0000 7fcb7572a640 1 -- 172.21.15.2:0/3445873787 wait complete. 2024-09-19T04:56:24.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:56:24 smithi002 ceph-mon[30975]: pgmap v259: 97 pgs: 97 active+clean; 14 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 53 KiB/s wr, 9 op/s 2024-09-19T04:56:24.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:56:24 smithi116 ceph-mon[34477]: pgmap v259: 97 pgs: 97 active+clean; 14 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 53 KiB/s wr, 9 op/s 2024-09-19T04:56:24.806 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:56:24 smithi018 ceph-mon[34537]: pgmap v259: 97 pgs: 97 active+clean; 14 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 53 KiB/s wr, 9 op/s 2024-09-19T04:56:24.914 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:56:24.914 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:56:25.187 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:56:25.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.666+0000 7f8ac337b640 1 -- 172.21.15.2:0/2846124305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8abc106f10 msgr2=0x7f8abc10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:25.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.666+0000 7f8ac337b640 1 --2- 172.21.15.2:0/2846124305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8abc106f10 0x7f8abc10ea90 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4009ca0 tx=0x7f8ab402a8c0 comp rx=0 tx=0).stop 2024-09-19T04:56:25.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.666+0000 7f8ac337b640 1 -- 172.21.15.2:0/2846124305 shutdown_connections 2024-09-19T04:56:25.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.666+0000 7f8ac337b640 1 --2- 172.21.15.2:0/2846124305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8abc106f10 0x7f8abc10ea90 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:25.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.666+0000 7f8ac337b640 1 --2- 172.21.15.2:0/2846124305 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8abc102790 0x7f8abc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:25.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.666+0000 7f8ac337b640 1 --2- 172.21.15.2:0/2846124305 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8abc101de0 0x7f8abc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:25.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.666+0000 7f8ac337b640 1 -- 172.21.15.2:0/2846124305 >> 172.21.15.2:0/2846124305 conn(0x7f8abc0fd8c0 msgr2=0x7f8abc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:56:25.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.666+0000 7f8ac337b640 1 -- 172.21.15.2:0/2846124305 shutdown_connections 2024-09-19T04:56:25.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.666+0000 7f8ac337b640 1 -- 172.21.15.2:0/2846124305 wait complete. 2024-09-19T04:56:25.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.667+0000 7f8ac337b640 1 Processor -- start 2024-09-19T04:56:25.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.667+0000 7f8ac337b640 1 -- start start 2024-09-19T04:56:25.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.667+0000 7f8ac337b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8abc101de0 0x7f8abc198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:25.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.667+0000 7f8ac337b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8abc102790 0x7f8abc198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:25.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.667+0000 7f8ac337b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8abc106f10 0x7f8abc19ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:25.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.667+0000 7f8ac337b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8abc111e40 con 0x7f8abc101de0 2024-09-19T04:56:25.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.667+0000 7f8ac337b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8abc111cc0 con 0x7f8abc106f10 2024-09-19T04:56:25.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.667+0000 7f8ac337b640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f8abc111fc0 con 0x7f8abc102790 2024-09-19T04:56:25.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.667+0000 7f8ac1117640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8abc101de0 0x7f8abc198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:25.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.668+0000 7f8ac1117640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8abc101de0 0x7f8abc198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57278/0 (socket says 172.21.15.2:57278) 2024-09-19T04:56:25.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.668+0000 7f8ac1117640 1 -- 172.21.15.2:0/3292858710 learned_addr learned my addr 172.21.15.2:0/3292858710 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:56:25.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.668+0000 7f8ac1918640 1 --2- 172.21.15.2:0/3292858710 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8abc106f10 0x7f8abc19ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:25.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.668+0000 7f8ac0916640 1 --2- 172.21.15.2:0/3292858710 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8abc102790 0x7f8abc198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:25.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.668+0000 7f8ac1117640 1 -- 172.21.15.2:0/3292858710 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8abc102790 msgr2=0x7f8abc198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:25.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.668+0000 7f8ac1117640 1 --2- 172.21.15.2:0/3292858710 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8abc102790 0x7f8abc198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:25.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.668+0000 7f8ac1117640 1 -- 172.21.15.2:0/3292858710 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8abc106f10 msgr2=0x7f8abc19ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:25.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.668+0000 7f8ac1117640 1 --2- 172.21.15.2:0/3292858710 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8abc106f10 0x7f8abc19ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:25.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.668+0000 7f8ac1117640 1 -- 172.21.15.2:0/3292858710 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8abc19d3b0 con 0x7f8abc101de0 2024-09-19T04:56:25.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.668+0000 7f8ac1117640 1 --2- 172.21.15.2:0/3292858710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8abc101de0 0x7f8abc198400 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f8ab800b4a0 tx=0x7f8ab800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:56:25.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.668+0000 7f8aae7fc640 1 -- 172.21.15.2:0/3292858710 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab8014070 con 0x7f8abc101de0 2024-09-19T04:56:25.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.668+0000 7f8aae7fc640 1 -- 172.21.15.2:0/3292858710 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8ab8010ac0 con 0x7f8abc101de0 2024-09-19T04:56:25.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.668+0000 7f8ac337b640 1 -- 172.21.15.2:0/3292858710 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8abc19d6a0 con 0x7f8abc101de0 2024-09-19T04:56:25.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.668+0000 7f8aae7fc640 1 -- 172.21.15.2:0/3292858710 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab8017c30 con 0x7f8abc101de0 2024-09-19T04:56:25.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.668+0000 7f8ac337b640 1 -- 172.21.15.2:0/3292858710 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8abc1a4f80 con 0x7f8abc101de0 2024-09-19T04:56:25.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.670+0000 7f8aae7fc640 1 -- 172.21.15.2:0/3292858710 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f8ab8017070 con 0x7f8abc101de0 2024-09-19T04:56:25.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.671+0000 7f8ac5754740 1 Processor -- start 2024-09-19T04:56:25.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.671+0000 7f8ac5754740 1 -- start start 2024-09-19T04:56:25.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.671+0000 7f8ac5754740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563408814a20 0x563408814e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:25.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.671+0000 7f8ac5754740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563408815340 0x563408823c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:25.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.671+0000 7f8ac5754740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563408824150 0x563408826540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:25.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.671+0000 7f8ac5754740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56340877a280 con 0x563408824150 2024-09-19T04:56:25.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.671+0000 7f8ac5754740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563408721b10 con 0x563408815340 2024-09-19T04:56:25.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.671+0000 7f8ac5754740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x563408776240 con 0x563408814a20 2024-09-19T04:56:25.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.671+0000 7f8aae7fc640 1 --2- 172.21.15.2:0/3292858710 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f8aa80a33b0 0x7f8aa80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:25.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.671+0000 7f8ac0916640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563408824150 0x563408826540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:25.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.671+0000 7f8ac0916640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563408824150 0x563408826540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57290/0 (socket says 172.21.15.2:57290) 2024-09-19T04:56:25.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.671+0000 7f8ac1918640 1 --2- 172.21.15.2:0/3292858710 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f8aa80a33b0 0x7f8aa80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:25.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.671+0000 7f8ac0916640 1 -- 172.21.15.2:0/3671628008 learned_addr learned my addr 172.21.15.2:0/3671628008 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:56:25.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.671+0000 7f8ac1918640 1 --2- 172.21.15.2:0/3671628008 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563408814a20 0x563408814e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:25.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.672+0000 7f8aae7fc640 1 -- 172.21.15.2:0/3292858710 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7f8ab80cf230 con 0x7f8abc101de0 2024-09-19T04:56:25.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.672+0000 7f8ac1117640 1 --2- 172.21.15.2:0/3671628008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563408815340 0x563408823c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:25.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.672+0000 7f8ac0916640 1 -- 172.21.15.2:0/3671628008 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563408814a20 msgr2=0x563408814e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:56:25.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.672+0000 7f8ac0916640 1 --2- 172.21.15.2:0/3671628008 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563408814a20 0x563408814e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:25.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.672+0000 7f8ac0916640 1 -- 172.21.15.2:0/3671628008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563408815340 msgr2=0x563408823c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:56:25.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.672+0000 7f8ac0916640 1 --2- 172.21.15.2:0/3671628008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563408815340 0x563408823c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:25.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.672+0000 7f8ac0916640 1 -- 172.21.15.2:0/3671628008 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56340872e1f0 con 0x563408824150 2024-09-19T04:56:25.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.672+0000 7f8ac1117640 1 --2- 172.21.15.2:0/3671628008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563408815340 0x563408823c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:56:25.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.672+0000 7f8ac0916640 1 --2- 172.21.15.2:0/3671628008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563408824150 0x563408826540 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f8ab000bc90 tx=0x7f8ab00107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae9618d0c618dfb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:56:25.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.672+0000 7f8ac1918640 1 --2- 172.21.15.2:0/3292858710 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f8aa80a33b0 0x7f8aa80a5870 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4004af0 tx=0x7f8ab4009360 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:56:25.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.673+0000 7f8aa77fe640 1 -- 172.21.15.2:0/3671628008 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab0005020 con 0x563408824150 2024-09-19T04:56:25.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.673+0000 7f8aa77fe640 1 -- 172.21.15.2:0/3671628008 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8ab00047a0 con 0x563408824150 2024-09-19T04:56:25.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.673+0000 7f8aa77fe640 1 -- 172.21.15.2:0/3671628008 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab00116a0 con 0x563408824150 2024-09-19T04:56:25.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.674+0000 7f8ac5754740 1 -- 172.21.15.2:0/3671628008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563408824150 msgr2=0x563408826540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:25.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.674+0000 7f8ac5754740 1 --2- 172.21.15.2:0/3671628008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563408824150 0x563408826540 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f8ab000bc90 tx=0x7f8ab00107a0 comp rx=0 tx=0).stop 2024-09-19T04:56:25.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.674+0000 7f8ac5754740 1 -- 172.21.15.2:0/3671628008 shutdown_connections 2024-09-19T04:56:25.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.674+0000 7f8ac5754740 1 --2- 172.21.15.2:0/3671628008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563408824150 0x563408826540 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:25.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.674+0000 7f8ac5754740 1 --2- 172.21.15.2:0/3671628008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563408815340 0x563408823c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:25.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.674+0000 7f8ac5754740 1 --2- 172.21.15.2:0/3671628008 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563408814a20 0x563408814e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:25.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.674+0000 7f8ac5754740 1 -- 172.21.15.2:0/3671628008 >> 172.21.15.2:0/3671628008 conn(0x5634088110f0 msgr2=0x5634088114d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:56:25.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.674+0000 7f8ac5754740 1 -- 172.21.15.2:0/3671628008 shutdown_connections 2024-09-19T04:56:25.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.674+0000 7f8ac5754740 1 -- 172.21.15.2:0/3671628008 wait complete. 2024-09-19T04:56:25.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.674+0000 7f8ac5754740 1 -- start start 2024-09-19T04:56:25.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.674+0000 7f8ac5754740 1 Processor -- start 2024-09-19T04:56:25.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.675+0000 7f8ac5754740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563408814a20 0x563408821100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:25.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.675+0000 7f8ac5754740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563408815340 0x563408821640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:25.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.675+0000 7f8ac5754740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563408824150 0x563408821b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:25.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.675+0000 7f8ac5754740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563408826d20 con 0x563408815340 2024-09-19T04:56:25.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.675+0000 7f8ac5754740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563408734f10 con 0x563408824150 2024-09-19T04:56:25.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.675+0000 7f8ac5754740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x563408826ea0 con 0x563408814a20 2024-09-19T04:56:25.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.675+0000 7f8ac5754740 10 client.0 _ll_register_callbacks cb 0x5634086fda40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:56:25.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.675+0000 7f8ac0916640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563408815340 0x563408821640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:25.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.675+0000 7f8ac0916640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563408815340 0x563408821640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57296/0 (socket says 172.21.15.2:57296) 2024-09-19T04:56:25.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.675+0000 7f8ac0916640 1 -- 172.21.15.2:0/1451507354 learned_addr learned my addr 172.21.15.2:0/1451507354 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:56:25.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.675+0000 7f8ac1117640 1 --2- 172.21.15.2:0/1451507354 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563408814a20 0x563408821100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:25.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.675+0000 7f8ac1918640 1 --2- 172.21.15.2:0/1451507354 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563408824150 0x563408821b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:25.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.675+0000 7f8ac0916640 1 -- 172.21.15.2:0/1451507354 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563408814a20 msgr2=0x563408821100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:56:25.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.675+0000 7f8ac0916640 1 --2- 172.21.15.2:0/1451507354 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563408814a20 0x563408821100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:25.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.675+0000 7f8ac0916640 1 -- 172.21.15.2:0/1451507354 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563408824150 msgr2=0x563408821b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:56:25.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.675+0000 7f8ac0916640 1 --2- 172.21.15.2:0/1451507354 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563408824150 0x563408821b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:25.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.675+0000 7f8ac0916640 1 -- 172.21.15.2:0/1451507354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634084eb6a0 con 0x563408815340 2024-09-19T04:56:25.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.676+0000 7f8ac0916640 1 --2- 172.21.15.2:0/1451507354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563408815340 0x563408821640 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f8ab0006010 tx=0x7f8ab0004b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bda0f742af119212 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:56:25.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.676+0000 7f8aa4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:56:25.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.676+0000 7f8aa4ff9640 1 -- 172.21.15.2:0/1451507354 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab002a060 con 0x563408815340 2024-09-19T04:56:25.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.676+0000 7f8ac5754740 1 -- 172.21.15.2:0/1451507354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ab00047a0 con 0x563408815340 2024-09-19T04:56:25.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.676+0000 7f8aa4ff9640 1 -- 172.21.15.2:0/1451507354 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7f8ab000bd80 con 0x563408815340 2024-09-19T04:56:25.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.676+0000 7f8aa4ff9640 1 -- 172.21.15.2:0/1451507354 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f8ab0004c70 con 0x563408815340 2024-09-19T04:56:25.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.676+0000 7f8ac5754740 10 client.16434 fetch_fsmap learned FSMap version 19 2024-09-19T04:56:25.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.676+0000 7f8ac5754740 1 -- 172.21.15.2:0/1451507354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x563408832a70 con 0x563408815340 2024-09-19T04:56:25.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.676+0000 7f8aa4ff9640 1 -- 172.21.15.2:0/1451507354 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8ab00047a0 con 0x563408815340 2024-09-19T04:56:25.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.676+0000 7f8aa4ff9640 1 -- 172.21.15.2:0/1451507354 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f8ab0011b50 con 0x563408815340 2024-09-19T04:56:25.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.676+0000 7f8ac5754740 10 client.16434 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:56:25.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.676+0000 7f8ac5754740 10 client.16434 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:56:25.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.676+0000 7f8ac5754740 20 client.16434 populate_metadata read hostname 'smithi002' 2024-09-19T04:56:25.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.676+0000 7f8ac5754740 1 --2- 172.21.15.2:0/1451507354 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x563408833dc0 0x5634088361b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:25.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.676+0000 7f8ac5754740 4 client.16434 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:56:25.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.676+0000 7f8ac5754740 1 -- 172.21.15.2:0/1451507354 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5634087877f0 con 0x563408833dc0 2024-09-19T04:56:25.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.677+0000 7f8ac1117640 1 --2- 172.21.15.2:0/1451507354 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x563408833dc0 0x5634088361b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:25.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.677+0000 7f8aa4ff9640 10 client.16434 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:56:25.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.677+0000 7f8ac1117640 1 --2- 172.21.15.2:0/1451507354 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x563408833dc0 0x5634088361b0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a07fd4c54ed701c4 server_cookie=6f97f37a8385cb9f in_seq=0 out_seq=0 2024-09-19T04:56:25.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.678+0000 7f8aa4ff9640 1 -- 172.21.15.2:0/1451507354 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5634087877f0 con 0x563408833dc0 2024-09-19T04:56:25.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.678+0000 7f8aa4ff9640 10 client.16434 handle_command_reply: tid=0 2024-09-19T04:56:25.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.678+0000 7f8ac5754740 1 client.16434 shutdown 2024-09-19T04:56:25.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.678+0000 7f8ac5754740 1 -- 172.21.15.2:0/1451507354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563408815340 msgr2=0x563408821640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:25.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.678+0000 7f8ac5754740 1 --2- 172.21.15.2:0/1451507354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563408815340 0x563408821640 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f8ab0006010 tx=0x7f8ab0004b80 comp rx=0 tx=0).stop 2024-09-19T04:56:25.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.678+0000 7f8ac5754740 1 -- 172.21.15.2:0/1451507354 shutdown_connections 2024-09-19T04:56:25.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.678+0000 7f8ac5754740 1 --2- 172.21.15.2:0/1451507354 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563408824150 0x563408821b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:25.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.678+0000 7f8ac5754740 1 --2- 172.21.15.2:0/1451507354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563408815340 0x563408821640 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:25.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.678+0000 7f8ac5754740 1 --2- 172.21.15.2:0/1451507354 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x563408833dc0 0x5634088361b0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:25.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.678+0000 7f8ac5754740 1 --2- 172.21.15.2:0/1451507354 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563408814a20 0x563408821100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:25.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.678+0000 7f8ac5754740 1 -- 172.21.15.2:0/1451507354 >> 172.21.15.2:0/1451507354 conn(0x5634088110f0 msgr2=0x563408816e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:56:25.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.678+0000 7f8aa4ff9640 0 client.16434 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:56:25.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.678+0000 7f8ac5754740 1 -- 172.21.15.2:0/1451507354 shutdown_connections 2024-09-19T04:56:25.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.678+0000 7f8ac5754740 1 -- 172.21.15.2:0/1451507354 wait complete. 2024-09-19T04:56:25.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.678+0000 7f8ac5754740 20 client.16434 trim_cache size 0 max 16384 2024-09-19T04:56:25.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.696+0000 7f8ac5754740 1 Processor -- start 2024-09-19T04:56:25.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.696+0000 7f8ac5754740 1 -- start start 2024-09-19T04:56:25.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.696+0000 7f8ac5754740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563408814a20 0x563408822f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:25.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.696+0000 7f8ac5754740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563408815340 0x563408838df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:25.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.696+0000 7f8ac5754740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563408824150 0x563408839330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:25.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.696+0000 7f8ac5754740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8abc1a9620 con 0x563408815340 2024-09-19T04:56:25.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.696+0000 7f8ac5754740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8abc1abe80 con 0x563408814a20 2024-09-19T04:56:25.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.696+0000 7f8ac5754740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f8abc1a9c70 con 0x563408824150 2024-09-19T04:56:25.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.696+0000 7f8ac0916640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563408815340 0x563408838df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:25.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.696+0000 7f8ac0916640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563408815340 0x563408838df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57308/0 (socket says 172.21.15.2:57308) 2024-09-19T04:56:25.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.696+0000 7f8ac0916640 1 -- 172.21.15.2:0/1285038960 learned_addr learned my addr 172.21.15.2:0/1285038960 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:56:25.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.696+0000 7f8ac1117640 1 --2- 172.21.15.2:0/1285038960 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563408814a20 0x563408822f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:25.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.696+0000 7f8ac0916640 1 -- 172.21.15.2:0/1285038960 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563408824150 msgr2=0x563408839330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:56:25.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.696+0000 7f8ac0916640 1 --2- 172.21.15.2:0/1285038960 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563408824150 0x563408839330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:25.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.696+0000 7f8ac0916640 1 -- 172.21.15.2:0/1285038960 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563408814a20 msgr2=0x563408822f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:56:25.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.696+0000 7f8ac0916640 1 --2- 172.21.15.2:0/1285038960 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563408814a20 0x563408822f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:25.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.696+0000 7f8ac0916640 1 -- 172.21.15.2:0/1285038960 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563408810b90 con 0x563408815340 2024-09-19T04:56:25.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.696+0000 7f8ac1117640 1 --2- 172.21.15.2:0/1285038960 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563408814a20 0x563408822f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:56:25.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.696+0000 7f8ac0916640 1 --2- 172.21.15.2:0/1285038960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563408815340 0x563408838df0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f8ab0000c00 tx=0x7f8ab0010fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ba54e5b94e31f33 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:56:25.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.697+0000 7f8aa6ffd640 1 -- 172.21.15.2:0/1285038960 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab002a070 con 0x563408815340 2024-09-19T04:56:25.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.697+0000 7f8aa6ffd640 1 -- 172.21.15.2:0/1285038960 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8ab0010ca0 con 0x563408815340 2024-09-19T04:56:25.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.697+0000 7f8aa6ffd640 1 -- 172.21.15.2:0/1285038960 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab001b9c0 con 0x563408815340 2024-09-19T04:56:25.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.697+0000 7f8ac5754740 1 -- 172.21.15.2:0/1285038960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563408815340 msgr2=0x563408838df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:25.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.697+0000 7f8ac5754740 1 --2- 172.21.15.2:0/1285038960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563408815340 0x563408838df0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f8ab0000c00 tx=0x7f8ab0010fd0 comp rx=0 tx=0).stop 2024-09-19T04:56:25.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.697+0000 7f8ac5754740 1 -- 172.21.15.2:0/1285038960 shutdown_connections 2024-09-19T04:56:25.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.697+0000 7f8ac5754740 1 --2- 172.21.15.2:0/1285038960 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563408824150 0x563408839330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:25.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.697+0000 7f8ac5754740 1 --2- 172.21.15.2:0/1285038960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563408815340 0x563408838df0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:25.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.697+0000 7f8ac5754740 1 --2- 172.21.15.2:0/1285038960 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563408814a20 0x563408822f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:25.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.697+0000 7f8ac5754740 1 -- 172.21.15.2:0/1285038960 >> 172.21.15.2:0/1285038960 conn(0x5634088110f0 msgr2=0x563408822850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:56:25.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.697+0000 7f8ac5754740 1 -- 172.21.15.2:0/1285038960 shutdown_connections 2024-09-19T04:56:25.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.697+0000 7f8ac5754740 1 -- 172.21.15.2:0/1285038960 wait complete. 2024-09-19T04:56:25.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.698+0000 7f8ac5754740 1 -- start start 2024-09-19T04:56:25.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.698+0000 7f8ac5754740 1 Processor -- start 2024-09-19T04:56:25.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.698+0000 7f8ac5754740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563408814a20 0x5634088396a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:25.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.698+0000 7f8ac5754740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563408815340 0x563408836a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:25.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.698+0000 7f8ac5754740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563408824150 0x563408837220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:25.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.698+0000 7f8ac5754740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8abc1aa340 con 0x563408815340 2024-09-19T04:56:25.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.698+0000 7f8ac5754740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8abc1ab7b0 con 0x563408814a20 2024-09-19T04:56:25.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.698+0000 7f8ac5754740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f8abc1aaa10 con 0x563408824150 2024-09-19T04:56:25.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.698+0000 7f8ac5754740 10 client.0 _ll_register_callbacks cb 0x7f8ab4031470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:56:25.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.698+0000 7f8ac0916640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563408815340 0x563408836a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:25.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.698+0000 7f8ac0916640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563408815340 0x563408836a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57318/0 (socket says 172.21.15.2:57318) 2024-09-19T04:56:25.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.698+0000 7f8ac0916640 1 -- 172.21.15.2:0/1392353449 learned_addr learned my addr 172.21.15.2:0/1392353449 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:56:25.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.699+0000 7f8ac1117640 1 --2- 172.21.15.2:0/1392353449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563408814a20 0x5634088396a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:25.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.699+0000 7f8ac0916640 1 -- 172.21.15.2:0/1392353449 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563408824150 msgr2=0x563408837220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:56:25.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.699+0000 7f8ac0916640 1 --2- 172.21.15.2:0/1392353449 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563408824150 0x563408837220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:25.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.699+0000 7f8ac0916640 1 -- 172.21.15.2:0/1392353449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563408814a20 msgr2=0x5634088396a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:56:25.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.699+0000 7f8ac0916640 1 --2- 172.21.15.2:0/1392353449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563408814a20 0x5634088396a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:25.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.699+0000 7f8ac0916640 1 -- 172.21.15.2:0/1392353449 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56340889d700 con 0x563408815340 2024-09-19T04:56:25.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.699+0000 7f8ac0916640 1 --2- 172.21.15.2:0/1392353449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563408815340 0x563408836a90 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f8ab00107e0 tx=0x7f8ab0005a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=902656f449969f95 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:56:25.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.699+0000 7f8aa4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:56:25.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.699+0000 7f8aa4ff9640 1 -- 172.21.15.2:0/1392353449 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab002a030 con 0x563408815340 2024-09-19T04:56:25.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.699+0000 7f8aa4ff9640 1 -- 172.21.15.2:0/1392353449 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7f8ab000bd80 con 0x563408815340 2024-09-19T04:56:25.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.699+0000 7f8ac5754740 1 -- 172.21.15.2:0/1392353449 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ab0010ca0 con 0x563408815340 2024-09-19T04:56:25.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.699+0000 7f8aa4ff9640 1 -- 172.21.15.2:0/1392353449 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f8ab001b9c0 con 0x563408815340 2024-09-19T04:56:25.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.699+0000 7f8ac5754740 10 client.16440 fetch_fsmap learned FSMap version 19 2024-09-19T04:56:25.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.699+0000 7f8ac5754740 1 -- 172.21.15.2:0/1392353449 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56340889e800 con 0x563408815340 2024-09-19T04:56:25.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.699+0000 7f8aa4ff9640 1 -- 172.21.15.2:0/1392353449 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8ab0010ca0 con 0x563408815340 2024-09-19T04:56:25.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.700+0000 7f8aa4ff9640 1 -- 172.21.15.2:0/1392353449 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f8ab0036070 con 0x563408815340 2024-09-19T04:56:25.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.700+0000 7f8ac5754740 10 client.16440 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:56:25.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.700+0000 7f8ac5754740 10 client.16440 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:56:25.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.700+0000 7f8ac5754740 20 client.16440 populate_metadata read hostname 'smithi002' 2024-09-19T04:56:25.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.700+0000 7f8ac5754740 1 --2- 172.21.15.2:0/1392353449 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56340889ee10 0x5634088a1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:25.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.700+0000 7f8ac5754740 4 client.16440 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:56:25.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.700+0000 7f8ac5754740 1 -- 172.21.15.2:0/1392353449 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563408781d00 con 0x56340889ee10 2024-09-19T04:56:25.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.700+0000 7f8ac1117640 1 --2- 172.21.15.2:0/1392353449 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56340889ee10 0x5634088a1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:25.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.700+0000 7f8ac1117640 1 --2- 172.21.15.2:0/1392353449 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56340889ee10 0x5634088a1230 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5aebf5e4070a23c4 server_cookie=b212797d6d851aa0 in_seq=0 out_seq=0 2024-09-19T04:56:25.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.700+0000 7f8aa4ff9640 10 client.16440 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:56:25.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.701+0000 7f8aa4ff9640 1 -- 172.21.15.2:0/1392353449 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563408781d00 con 0x56340889ee10 2024-09-19T04:56:25.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.701+0000 7f8aa4ff9640 10 client.16440 handle_command_reply: tid=0 2024-09-19T04:56:25.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.701+0000 7f8ac5754740 1 client.16440 shutdown 2024-09-19T04:56:25.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.702+0000 7f8ac5754740 1 -- 172.21.15.2:0/1392353449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563408815340 msgr2=0x563408836a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:25.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.702+0000 7f8ac5754740 1 --2- 172.21.15.2:0/1392353449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563408815340 0x563408836a90 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f8ab00107e0 tx=0x7f8ab0005a70 comp rx=0 tx=0).stop 2024-09-19T04:56:25.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.702+0000 7f8ac5754740 1 -- 172.21.15.2:0/1392353449 shutdown_connections 2024-09-19T04:56:25.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.702+0000 7f8ac5754740 1 --2- 172.21.15.2:0/1392353449 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56340889ee10 0x5634088a1230 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:25.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.702+0000 7f8ac5754740 1 --2- 172.21.15.2:0/1392353449 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563408824150 0x563408837220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:25.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.702+0000 7f8ac5754740 1 --2- 172.21.15.2:0/1392353449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563408815340 0x563408836a90 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:25.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.702+0000 7f8ac5754740 1 --2- 172.21.15.2:0/1392353449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563408814a20 0x5634088396a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:25.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.702+0000 7f8ac5754740 1 -- 172.21.15.2:0/1392353449 >> 172.21.15.2:0/1392353449 conn(0x5634088110f0 msgr2=0x563408810270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:56:25.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.702+0000 7f8aa4ff9640 0 client.16440 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:56:25.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.702+0000 7f8ac5754740 1 -- 172.21.15.2:0/1392353449 shutdown_connections 2024-09-19T04:56:25.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.702+0000 7f8ac5754740 1 -- 172.21.15.2:0/1392353449 wait complete. 2024-09-19T04:56:25.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.702+0000 7f8ac5754740 20 client.16440 trim_cache size 0 max 16384 2024-09-19T04:56:25.718 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:56:25.718 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T04:56:25.718 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "0a4a192a-9431-4986-b3dc-e9f275691c66", 2024-09-19T04:56:25.718 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T04:56:25.718 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:56:25.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.702+0000 7f8ac337b640 1 -- 172.21.15.2:0/3292858710 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f8aa80a33b0 msgr2=0x7f8aa80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:25.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.703+0000 7f8ac337b640 1 --2- 172.21.15.2:0/3292858710 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f8aa80a33b0 0x7f8aa80a5870 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4004af0 tx=0x7f8ab4009360 comp rx=0 tx=0).stop 2024-09-19T04:56:25.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.703+0000 7f8ac337b640 1 -- 172.21.15.2:0/3292858710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8abc101de0 msgr2=0x7f8abc198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:25.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.703+0000 7f8ac337b640 1 --2- 172.21.15.2:0/3292858710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8abc101de0 0x7f8abc198400 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f8ab800b4a0 tx=0x7f8ab800b960 comp rx=0 tx=0).stop 2024-09-19T04:56:25.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.703+0000 7f8ac337b640 1 -- 172.21.15.2:0/3292858710 shutdown_connections 2024-09-19T04:56:25.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.703+0000 7f8ac337b640 1 --2- 172.21.15.2:0/3292858710 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8abc106f10 0x7f8abc19ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:25.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.703+0000 7f8ac337b640 1 --2- 172.21.15.2:0/3292858710 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f8aa80a33b0 0x7f8aa80a5870 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:25.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.703+0000 7f8ac337b640 1 --2- 172.21.15.2:0/3292858710 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8abc102790 0x7f8abc198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:25.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.703+0000 7f8ac337b640 1 --2- 172.21.15.2:0/3292858710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8abc101de0 0x7f8abc198400 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:25.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.703+0000 7f8ac337b640 1 -- 172.21.15.2:0/3292858710 >> 172.21.15.2:0/3292858710 conn(0x7f8abc0fd8c0 msgr2=0x7f8abc0fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:56:25.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.703+0000 7f8ac337b640 1 -- 172.21.15.2:0/3292858710 shutdown_connections 2024-09-19T04:56:25.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:25.703+0000 7f8ac337b640 1 -- 172.21.15.2:0/3292858710 wait complete. 2024-09-19T04:56:26.444 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:56:26.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:56:26 smithi002 ceph-mon[30975]: pgmap v260: 97 pgs: 97 active+clean; 14 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 80 KiB/s wr, 14 op/s 2024-09-19T04:56:26.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:56:26 smithi116 ceph-mon[34477]: pgmap v260: 97 pgs: 97 active+clean; 14 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 80 KiB/s wr, 14 op/s 2024-09-19T04:56:26.702 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:56:26.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:56:26 smithi018 ceph-mon[34537]: pgmap v260: 97 pgs: 97 active+clean; 14 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 80 KiB/s wr, 14 op/s 2024-09-19T04:56:27.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.207+0000 7f7c5bd6c640 1 -- 172.21.15.2:0/1941713411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c54102790 msgr2=0x7f7c541067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:27.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.207+0000 7f7c5bd6c640 1 --2- 172.21.15.2:0/1941713411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c54102790 0x7f7c541067e0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f7c44009900 tx=0x7f7c4402a410 comp rx=0 tx=0).stop 2024-09-19T04:56:27.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.207+0000 7f7c5bd6c640 1 -- 172.21.15.2:0/1941713411 shutdown_connections 2024-09-19T04:56:27.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.207+0000 7f7c5bd6c640 1 --2- 172.21.15.2:0/1941713411 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7c54106f10 0x7f7c5410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:27.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.207+0000 7f7c5bd6c640 1 --2- 172.21.15.2:0/1941713411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c54102790 0x7f7c541067e0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:27.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.207+0000 7f7c5bd6c640 1 --2- 172.21.15.2:0/1941713411 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c54101de0 0x7f7c541021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:27.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.207+0000 7f7c5bd6c640 1 -- 172.21.15.2:0/1941713411 >> 172.21.15.2:0/1941713411 conn(0x7f7c540fd8c0 msgr2=0x7f7c540ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:56:27.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.208+0000 7f7c5bd6c640 1 -- 172.21.15.2:0/1941713411 shutdown_connections 2024-09-19T04:56:27.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.208+0000 7f7c5bd6c640 1 -- 172.21.15.2:0/1941713411 wait complete. 2024-09-19T04:56:27.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.208+0000 7f7c5bd6c640 1 Processor -- start 2024-09-19T04:56:27.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.208+0000 7f7c5bd6c640 1 -- start start 2024-09-19T04:56:27.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.208+0000 7f7c5bd6c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c54101de0 0x7f7c541983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:27.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.208+0000 7f7c5bd6c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7c54102790 0x7f7c541988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:27.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.208+0000 7f7c5bd6c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c54106f10 0x7f7c5419cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:27.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.208+0000 7f7c5bd6c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7c54111e20 con 0x7f7c54106f10 2024-09-19T04:56:27.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.208+0000 7f7c5bd6c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7c54111ca0 con 0x7f7c54101de0 2024-09-19T04:56:27.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.208+0000 7f7c5bd6c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f7c54111fa0 con 0x7f7c54102790 2024-09-19T04:56:27.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.209+0000 7f7c5a309640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c54106f10 0x7f7c5419cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:27.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.209+0000 7f7c5a309640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c54106f10 0x7f7c5419cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57338/0 (socket says 172.21.15.2:57338) 2024-09-19T04:56:27.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.209+0000 7f7c59b08640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c54101de0 0x7f7c541983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:27.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.209+0000 7f7c5a309640 1 -- 172.21.15.2:0/2314733787 learned_addr learned my addr 172.21.15.2:0/2314733787 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:56:27.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.209+0000 7f7c59307640 1 --2- 172.21.15.2:0/2314733787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7c54102790 0x7f7c541988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:27.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.209+0000 7f7c5a309640 1 -- 172.21.15.2:0/2314733787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7c54102790 msgr2=0x7f7c541988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:27.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.209+0000 7f7c5a309640 1 --2- 172.21.15.2:0/2314733787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7c54102790 0x7f7c541988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:27.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.209+0000 7f7c5a309640 1 -- 172.21.15.2:0/2314733787 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c54101de0 msgr2=0x7f7c541983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:27.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.209+0000 7f7c5a309640 1 --2- 172.21.15.2:0/2314733787 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c54101de0 0x7f7c541983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:27.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.209+0000 7f7c5a309640 1 -- 172.21.15.2:0/2314733787 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c5419d350 con 0x7f7c54106f10 2024-09-19T04:56:27.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.209+0000 7f7c59307640 1 --2- 172.21.15.2:0/2314733787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7c54102790 0x7f7c541988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:56:27.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.209+0000 7f7c5a309640 1 --2- 172.21.15.2:0/2314733787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c54106f10 0x7f7c5419cc70 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c00cad0 tx=0x7f7c4c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:56:27.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.209+0000 7f7c4affd640 1 -- 172.21.15.2:0/2314733787 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c00ae20 con 0x7f7c54106f10 2024-09-19T04:56:27.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.209+0000 7f7c4affd640 1 -- 172.21.15.2:0/2314733787 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7c4c005020 con 0x7f7c54106f10 2024-09-19T04:56:27.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.209+0000 7f7c5bd6c640 1 -- 172.21.15.2:0/2314733787 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c5419d640 con 0x7f7c54106f10 2024-09-19T04:56:27.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.209+0000 7f7c4affd640 1 -- 172.21.15.2:0/2314733787 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c00f6b0 con 0x7f7c54106f10 2024-09-19T04:56:27.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.209+0000 7f7c5bd6c640 1 -- 172.21.15.2:0/2314733787 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c541a4f20 con 0x7f7c54106f10 2024-09-19T04:56:27.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.212+0000 7f7c4affd640 1 -- 172.21.15.2:0/2314733787 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f7c4c0051d0 con 0x7f7c54106f10 2024-09-19T04:56:27.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.212+0000 7f7c5e145740 1 Processor -- start 2024-09-19T04:56:27.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.212+0000 7f7c5e145740 1 -- start start 2024-09-19T04:56:27.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.212+0000 7f7c5e145740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1a91863a0 0x55d1a9186780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:27.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.212+0000 7f7c5e145740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1a9186cc0 0x55d1a9195550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:27.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.212+0000 7f7c5e145740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1a9195a90 0x55d1a9197e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:27.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.212+0000 7f7c5e145740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d1a90ec2e0 con 0x55d1a9195a90 2024-09-19T04:56:27.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.212+0000 7f7c5e145740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d1a9093ce0 con 0x55d1a9186cc0 2024-09-19T04:56:27.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.212+0000 7f7c5e145740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55d1a90e82a0 con 0x55d1a91863a0 2024-09-19T04:56:27.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.213+0000 7f7c59307640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1a9195a90 0x55d1a9197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:27.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.213+0000 7f7c59307640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1a9195a90 0x55d1a9197e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57350/0 (socket says 172.21.15.2:57350) 2024-09-19T04:56:27.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.213+0000 7f7c59307640 1 -- 172.21.15.2:0/2108726225 learned_addr learned my addr 172.21.15.2:0/2108726225 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:56:27.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.213+0000 7f7c59b08640 1 --2- 172.21.15.2:0/2108726225 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1a9186cc0 0x55d1a9195550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:27.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.213+0000 7f7c59307640 1 --2- 172.21.15.2:0/2108726225 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1a91863a0 0x55d1a9186780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:27.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.213+0000 7f7c4affd640 1 --2- 172.21.15.2:0/2314733787 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f7c400a3430 0x7f7c400a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:27.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.213+0000 7f7c59b08640 1 -- 172.21.15.2:0/2108726225 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1a91863a0 msgr2=0x55d1a9186780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:56:27.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.213+0000 7f7c59b08640 1 --2- 172.21.15.2:0/2108726225 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1a91863a0 0x55d1a9186780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:27.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.213+0000 7f7c59b08640 1 -- 172.21.15.2:0/2108726225 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1a9195a90 msgr2=0x55d1a9197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:56:27.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.213+0000 7f7c59b08640 1 --2- 172.21.15.2:0/2108726225 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1a9195a90 0x55d1a9197e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:27.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.213+0000 7f7c59b08640 1 -- 172.21.15.2:0/2108726225 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1a9078440 con 0x55d1a9186cc0 2024-09-19T04:56:27.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.213+0000 7f7c59307640 1 --2- 172.21.15.2:0/2108726225 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1a9195a90 0x55d1a9197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:56:27.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.213+0000 7f7c5a309640 1 --2- 172.21.15.2:0/2314733787 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f7c400a3430 0x7f7c400a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:27.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.213+0000 7f7c59b08640 1 --2- 172.21.15.2:0/2108726225 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1a9186cc0 0x55d1a9195550 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7c50005fd0 tx=0x7f7c500107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3772fbc95e15a0ec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:56:27.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.213+0000 7f7c4affd640 1 -- 172.21.15.2:0/2314733787 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7f7c4c0cf900 con 0x7f7c54106f10 2024-09-19T04:56:27.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.214+0000 7f7c5a309640 1 --2- 172.21.15.2:0/2314733787 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f7c400a3430 0x7f7c400a58f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c0cd0b0 tx=0x7f7c4c0cfc00 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:56:27.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.214+0000 7f7c3ffff640 1 -- 172.21.15.2:0/2108726225 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c5001c480 con 0x55d1a9186cc0 2024-09-19T04:56:27.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.214+0000 7f7c3ffff640 1 -- 172.21.15.2:0/2108726225 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7c5001cad0 con 0x55d1a9186cc0 2024-09-19T04:56:27.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.214+0000 7f7c3ffff640 1 -- 172.21.15.2:0/2108726225 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c50011b50 con 0x55d1a9186cc0 2024-09-19T04:56:27.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.215+0000 7f7c5e145740 1 -- 172.21.15.2:0/2108726225 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1a9186cc0 msgr2=0x55d1a9195550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:27.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.215+0000 7f7c5e145740 1 --2- 172.21.15.2:0/2108726225 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1a9186cc0 0x55d1a9195550 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7c50005fd0 tx=0x7f7c500107a0 comp rx=0 tx=0).stop 2024-09-19T04:56:27.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.215+0000 7f7c5e145740 1 -- 172.21.15.2:0/2108726225 shutdown_connections 2024-09-19T04:56:27.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.215+0000 7f7c5e145740 1 --2- 172.21.15.2:0/2108726225 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1a9195a90 0x55d1a9197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:27.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.215+0000 7f7c5e145740 1 --2- 172.21.15.2:0/2108726225 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1a9186cc0 0x55d1a9195550 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:27.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.215+0000 7f7c5e145740 1 --2- 172.21.15.2:0/2108726225 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1a91863a0 0x55d1a9186780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:27.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.215+0000 7f7c5e145740 1 -- 172.21.15.2:0/2108726225 >> 172.21.15.2:0/2108726225 conn(0x55d1a9182a30 msgr2=0x55d1a9182e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:56:27.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.215+0000 7f7c5e145740 1 -- 172.21.15.2:0/2108726225 shutdown_connections 2024-09-19T04:56:27.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.215+0000 7f7c5e145740 1 -- 172.21.15.2:0/2108726225 wait complete. 2024-09-19T04:56:27.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.215+0000 7f7c5e145740 1 -- start start 2024-09-19T04:56:27.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.215+0000 7f7c5e145740 1 Processor -- start 2024-09-19T04:56:27.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.216+0000 7f7c5e145740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1a91863a0 0x55d1a9195430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:27.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.216+0000 7f7c5e145740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1a9186cc0 0x55d1a91926e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:27.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.216+0000 7f7c5e145740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1a9195a90 0x55d1a9192c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:27.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.216+0000 7f7c5e145740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d1a91986c0 con 0x55d1a91863a0 2024-09-19T04:56:27.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.216+0000 7f7c5e145740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d1a90a7050 con 0x55d1a9195a90 2024-09-19T04:56:27.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.216+0000 7f7c5e145740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55d1a9198840 con 0x55d1a9186cc0 2024-09-19T04:56:27.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.216+0000 7f7c5e145740 10 client.0 _ll_register_callbacks cb 0x55d1a90e7160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:56:27.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.216+0000 7f7c59307640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1a91863a0 0x55d1a9195430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:27.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.216+0000 7f7c59307640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1a91863a0 0x55d1a9195430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57362/0 (socket says 172.21.15.2:57362) 2024-09-19T04:56:27.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.216+0000 7f7c59307640 1 -- 172.21.15.2:0/276186159 learned_addr learned my addr 172.21.15.2:0/276186159 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:56:27.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.216+0000 7f7c59b08640 1 --2- 172.21.15.2:0/276186159 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1a9186cc0 0x55d1a91926e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:27.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.216+0000 7f7c59307640 1 -- 172.21.15.2:0/276186159 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1a9186cc0 msgr2=0x55d1a91926e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:56:27.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.216+0000 7f7c59307640 1 --2- 172.21.15.2:0/276186159 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1a9186cc0 0x55d1a91926e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:27.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.216+0000 7f7c59307640 1 -- 172.21.15.2:0/276186159 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1a9195a90 msgr2=0x55d1a9192c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:56:27.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.216+0000 7f7c59307640 1 --2- 172.21.15.2:0/276186159 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1a9195a90 0x55d1a9192c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:27.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.216+0000 7f7c59307640 1 -- 172.21.15.2:0/276186159 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1a8e5d3c0 con 0x55d1a91863a0 2024-09-19T04:56:27.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.216+0000 7f7c59b08640 1 --2- 172.21.15.2:0/276186159 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1a9186cc0 0x55d1a91926e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:56:27.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.216+0000 7f7c59307640 1 --2- 172.21.15.2:0/276186159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1a91863a0 0x55d1a9195430 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f7c44006010 tx=0x7f7c44032ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79821b30b38a02f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:56:27.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.216+0000 7f7c3d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:56:27.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.216+0000 7f7c3d7fa640 1 -- 172.21.15.2:0/276186159 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c44043070 con 0x55d1a91863a0 2024-09-19T04:56:27.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.216+0000 7f7c3d7fa640 1 -- 172.21.15.2:0/276186159 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7f7c44004240 con 0x55d1a91863a0 2024-09-19T04:56:27.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.217+0000 7f7c5e145740 1 -- 172.21.15.2:0/276186159 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c5001cad0 con 0x55d1a91863a0 2024-09-19T04:56:27.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.217+0000 7f7c3d7fa640 1 -- 172.21.15.2:0/276186159 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f7c44035040 con 0x55d1a91863a0 2024-09-19T04:56:27.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.217+0000 7f7c5e145740 10 client.16452 fetch_fsmap learned FSMap version 19 2024-09-19T04:56:27.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.217+0000 7f7c5e145740 1 -- 172.21.15.2:0/276186159 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55d1a91a4140 con 0x55d1a91863a0 2024-09-19T04:56:27.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.217+0000 7f7c3d7fa640 1 -- 172.21.15.2:0/276186159 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7c5001cad0 con 0x55d1a91863a0 2024-09-19T04:56:27.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.217+0000 7f7c3d7fa640 1 -- 172.21.15.2:0/276186159 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f7c4403a040 con 0x55d1a91863a0 2024-09-19T04:56:27.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.217+0000 7f7c5e145740 10 client.16452 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:56:27.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.217+0000 7f7c5e145740 10 client.16452 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:56:27.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.217+0000 7f7c5e145740 20 client.16452 populate_metadata read hostname 'smithi002' 2024-09-19T04:56:27.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.217+0000 7f7c5e145740 1 --2- 172.21.15.2:0/276186159 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55d1a91a5550 0x55d1a91a7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:27.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.217+0000 7f7c5e145740 4 client.16452 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:56:27.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.217+0000 7f7c5e145740 1 -- 172.21.15.2:0/276186159 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d1a90f9850 con 0x55d1a91a5550 2024-09-19T04:56:27.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.218+0000 7f7c59b08640 1 --2- 172.21.15.2:0/276186159 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55d1a91a5550 0x55d1a91a7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:27.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.218+0000 7f7c59b08640 1 --2- 172.21.15.2:0/276186159 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55d1a91a5550 0x55d1a91a7960 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d94acabc95607f5d server_cookie=4d6be2c5963bf39a in_seq=0 out_seq=0 2024-09-19T04:56:27.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.218+0000 7f7c3d7fa640 10 client.16452 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:56:27.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.219+0000 7f7c3d7fa640 1 -- 172.21.15.2:0/276186159 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d1a90f9850 con 0x55d1a91a5550 2024-09-19T04:56:27.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.219+0000 7f7c3d7fa640 10 client.16452 handle_command_reply: tid=0 2024-09-19T04:56:27.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.219+0000 7f7c5e145740 1 client.16452 shutdown 2024-09-19T04:56:27.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.219+0000 7f7c5e145740 1 -- 172.21.15.2:0/276186159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1a91863a0 msgr2=0x55d1a9195430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:27.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.219+0000 7f7c5e145740 1 --2- 172.21.15.2:0/276186159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1a91863a0 0x55d1a9195430 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f7c44006010 tx=0x7f7c44032ef0 comp rx=0 tx=0).stop 2024-09-19T04:56:27.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.219+0000 7f7c5e145740 1 -- 172.21.15.2:0/276186159 shutdown_connections 2024-09-19T04:56:27.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.219+0000 7f7c5e145740 1 --2- 172.21.15.2:0/276186159 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1a9195a90 0x55d1a9192c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:27.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.219+0000 7f7c5e145740 1 --2- 172.21.15.2:0/276186159 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55d1a91a5550 0x55d1a91a7960 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:27.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.219+0000 7f7c5e145740 1 --2- 172.21.15.2:0/276186159 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1a9186cc0 0x55d1a91926e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:27.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.219+0000 7f7c5e145740 1 --2- 172.21.15.2:0/276186159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1a91863a0 0x55d1a9195430 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:27.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.219+0000 7f7c3d7fa640 0 client.16452 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:56:27.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.219+0000 7f7c5e145740 1 -- 172.21.15.2:0/276186159 >> 172.21.15.2:0/276186159 conn(0x55d1a9182a30 msgr2=0x55d1a9188790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:56:27.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.219+0000 7f7c5e145740 1 -- 172.21.15.2:0/276186159 shutdown_connections 2024-09-19T04:56:27.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.219+0000 7f7c5e145740 1 -- 172.21.15.2:0/276186159 wait complete. 2024-09-19T04:56:27.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.219+0000 7f7c5e145740 20 client.16452 trim_cache size 0 max 16384 2024-09-19T04:56:27.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.236+0000 7f7c5e145740 1 Processor -- start 2024-09-19T04:56:27.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.236+0000 7f7c5e145740 1 -- start start 2024-09-19T04:56:27.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.237+0000 7f7c5e145740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1a91863a0 0x55d1a91a1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:27.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.237+0000 7f7c5e145740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1a9186cc0 0x55d1a91ad230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:27.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.237+0000 7f7c5e145740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1a9195a90 0x55d1a91ad770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:27.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.237+0000 7f7c5e145740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7c541a9660 con 0x55d1a9195a90 2024-09-19T04:56:27.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.237+0000 7f7c5e145740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7c541abec0 con 0x55d1a9186cc0 2024-09-19T04:56:27.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.237+0000 7f7c5e145740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f7c541a9cb0 con 0x55d1a91863a0 2024-09-19T04:56:27.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.237+0000 7f7c59307640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1a9195a90 0x55d1a91ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:27.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.237+0000 7f7c59307640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1a9195a90 0x55d1a91ad770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57366/0 (socket says 172.21.15.2:57366) 2024-09-19T04:56:27.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.237+0000 7f7c59307640 1 -- 172.21.15.2:0/2364273098 learned_addr learned my addr 172.21.15.2:0/2364273098 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:56:27.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.237+0000 7f7c59b08640 1 --2- 172.21.15.2:0/2364273098 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1a9186cc0 0x55d1a91ad230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:27.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.237+0000 7f7c59307640 1 --2- 172.21.15.2:0/2364273098 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1a91863a0 0x55d1a91a1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:27.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.237+0000 7f7c59307640 1 -- 172.21.15.2:0/2364273098 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1a91863a0 msgr2=0x55d1a91a1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:56:27.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.237+0000 7f7c59307640 1 --2- 172.21.15.2:0/2364273098 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1a91863a0 0x55d1a91a1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:27.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.237+0000 7f7c59307640 1 -- 172.21.15.2:0/2364273098 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1a9186cc0 msgr2=0x55d1a91ad230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:56:27.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.237+0000 7f7c59307640 1 --2- 172.21.15.2:0/2364273098 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1a9186cc0 0x55d1a91ad230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:27.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.237+0000 7f7c59307640 1 -- 172.21.15.2:0/2364273098 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1a9187230 con 0x55d1a9195a90 2024-09-19T04:56:27.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.237+0000 7f7c59307640 1 --2- 172.21.15.2:0/2364273098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1a9195a90 0x55d1a91ad770 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f7c4402a930 tx=0x7f7c44032e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=296bdeb6ac26720a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:56:27.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.237+0000 7f7c3f7fe640 1 -- 172.21.15.2:0/2364273098 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c44043070 con 0x55d1a9195a90 2024-09-19T04:56:27.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.238+0000 7f7c3f7fe640 1 -- 172.21.15.2:0/2364273098 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7c44032030 con 0x55d1a9195a90 2024-09-19T04:56:27.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.238+0000 7f7c3f7fe640 1 -- 172.21.15.2:0/2364273098 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c440516e0 con 0x55d1a9195a90 2024-09-19T04:56:27.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.238+0000 7f7c5e145740 1 -- 172.21.15.2:0/2364273098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1a9195a90 msgr2=0x55d1a91ad770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:27.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.238+0000 7f7c5e145740 1 --2- 172.21.15.2:0/2364273098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1a9195a90 0x55d1a91ad770 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f7c4402a930 tx=0x7f7c44032e80 comp rx=0 tx=0).stop 2024-09-19T04:56:27.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.238+0000 7f7c5e145740 1 -- 172.21.15.2:0/2364273098 shutdown_connections 2024-09-19T04:56:27.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.238+0000 7f7c5e145740 1 --2- 172.21.15.2:0/2364273098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1a9195a90 0x55d1a91ad770 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:27.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.238+0000 7f7c5e145740 1 --2- 172.21.15.2:0/2364273098 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1a9186cc0 0x55d1a91ad230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:27.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.238+0000 7f7c5e145740 1 --2- 172.21.15.2:0/2364273098 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1a91863a0 0x55d1a91a1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:27.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.238+0000 7f7c5e145740 1 -- 172.21.15.2:0/2364273098 >> 172.21.15.2:0/2364273098 conn(0x55d1a9182a30 msgr2=0x55d1a918dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:56:27.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.238+0000 7f7c5e145740 1 -- 172.21.15.2:0/2364273098 shutdown_connections 2024-09-19T04:56:27.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.238+0000 7f7c5e145740 1 -- 172.21.15.2:0/2364273098 wait complete. 2024-09-19T04:56:27.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.238+0000 7f7c5e145740 1 -- start start 2024-09-19T04:56:27.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.239+0000 7f7c5e145740 1 Processor -- start 2024-09-19T04:56:27.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.239+0000 7f7c5e145740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1a91863a0 0x55d1a9199eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:27.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.239+0000 7f7c5e145740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1a9186cc0 0x55d1a919a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:27.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.239+0000 7f7c5e145740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1a9195a90 0x55d1a920f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:27.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.239+0000 7f7c5e145740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7c541aa380 con 0x55d1a91863a0 2024-09-19T04:56:27.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.239+0000 7f7c5e145740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7c541ab7f0 con 0x55d1a9186cc0 2024-09-19T04:56:27.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.239+0000 7f7c5e145740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f7c541aaa50 con 0x55d1a9195a90 2024-09-19T04:56:27.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.239+0000 7f7c5e145740 10 client.0 _ll_register_callbacks cb 0x7f7c44032db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:56:27.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.239+0000 7f7c59307640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1a91863a0 0x55d1a9199eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:27.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.239+0000 7f7c59307640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1a91863a0 0x55d1a9199eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57372/0 (socket says 172.21.15.2:57372) 2024-09-19T04:56:27.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.239+0000 7f7c59b08640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1a9186cc0 0x55d1a919a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:27.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.239+0000 7f7c59307640 1 -- 172.21.15.2:0/988118923 learned_addr learned my addr 172.21.15.2:0/988118923 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:56:27.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.239+0000 7f7c59307640 1 --2- 172.21.15.2:0/988118923 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1a9195a90 0x55d1a920f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:27.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.240+0000 7f7c59b08640 1 -- 172.21.15.2:0/988118923 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1a9195a90 msgr2=0x55d1a920f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:56:27.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.240+0000 7f7c59b08640 1 --2- 172.21.15.2:0/988118923 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1a9195a90 0x55d1a920f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:27.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.240+0000 7f7c59b08640 1 -- 172.21.15.2:0/988118923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1a91863a0 msgr2=0x55d1a9199eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:56:27.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.240+0000 7f7c59b08640 1 --2- 172.21.15.2:0/988118923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1a91863a0 0x55d1a9199eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:27.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.240+0000 7f7c59b08640 1 -- 172.21.15.2:0/988118923 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1a920f740 con 0x55d1a9186cc0 2024-09-19T04:56:27.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.240+0000 7f7c59b08640 1 --2- 172.21.15.2:0/988118923 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1a9186cc0 0x55d1a919a3f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x55d1a9193d20 tx=0x7f7c5000b4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc54697a226401e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:56:27.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.240+0000 7f7c3d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T04:56:27.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.240+0000 7f7c3d7fa640 1 -- 172.21.15.2:0/988118923 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c50005240 con 0x55d1a9186cc0 2024-09-19T04:56:27.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.240+0000 7f7c5e145740 1 -- 172.21.15.2:0/988118923 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c44032030 con 0x55d1a9186cc0 2024-09-19T04:56:27.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.240+0000 7f7c3d7fa640 1 -- 172.21.15.2:0/988118923 <== mon.2 v2:172.21.15.18:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7f7c500053e0 con 0x55d1a9186cc0 2024-09-19T04:56:27.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.240+0000 7f7c3d7fa640 1 -- 172.21.15.2:0/988118923 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f7c50039050 con 0x55d1a9186cc0 2024-09-19T04:56:27.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.240+0000 7f7c5e145740 10 client.25784 fetch_fsmap learned FSMap version 19 2024-09-19T04:56:27.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.240+0000 7f7c5e145740 1 -- 172.21.15.2:0/988118923 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55d1a9210960 con 0x55d1a9186cc0 2024-09-19T04:56:27.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.240+0000 7f7c3d7fa640 1 -- 172.21.15.2:0/988118923 <== mon.2 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7c44032030 con 0x55d1a9186cc0 2024-09-19T04:56:27.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.241+0000 7f7c3d7fa640 1 -- 172.21.15.2:0/988118923 <== mon.2 v2:172.21.15.18:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f7c500046f0 con 0x55d1a9186cc0 2024-09-19T04:56:27.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.241+0000 7f7c5e145740 10 client.25784 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:56:27.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.241+0000 7f7c5e145740 10 client.25784 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:56:27.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.241+0000 7f7c5e145740 20 client.25784 populate_metadata read hostname 'smithi002' 2024-09-19T04:56:27.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.241+0000 7f7c5e145740 1 --2- 172.21.15.2:0/988118923 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55d1a9210da0 0x55d1a9213190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:27.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.241+0000 7f7c5e145740 4 client.25784 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:56:27.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.241+0000 7f7c5e145740 1 -- 172.21.15.2:0/988118923 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d1a90f3d60 con 0x55d1a9210da0 2024-09-19T04:56:27.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.241+0000 7f7c59307640 1 --2- 172.21.15.2:0/988118923 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55d1a9210da0 0x55d1a9213190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:27.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.241+0000 7f7c59307640 1 --2- 172.21.15.2:0/988118923 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55d1a9210da0 0x55d1a9213190 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e70a63951a1d6c6 server_cookie=c3edc7f5d011c6ed in_seq=0 out_seq=0 2024-09-19T04:56:27.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.241+0000 7f7c3d7fa640 10 client.25784 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:56:27.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.242+0000 7f7c3d7fa640 1 -- 172.21.15.2:0/988118923 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55d1a90f3d60 con 0x55d1a9210da0 2024-09-19T04:56:27.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.242+0000 7f7c3d7fa640 10 client.25784 handle_command_reply: tid=0 2024-09-19T04:56:27.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.242+0000 7f7c5e145740 1 client.25784 shutdown 2024-09-19T04:56:27.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.242+0000 7f7c5e145740 1 -- 172.21.15.2:0/988118923 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1a9186cc0 msgr2=0x55d1a919a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:27.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.242+0000 7f7c5e145740 1 --2- 172.21.15.2:0/988118923 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1a9186cc0 0x55d1a919a3f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x55d1a9193d20 tx=0x7f7c5000b4a0 comp rx=0 tx=0).stop 2024-09-19T04:56:27.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.242+0000 7f7c5e145740 1 -- 172.21.15.2:0/988118923 shutdown_connections 2024-09-19T04:56:27.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.242+0000 7f7c5e145740 1 --2- 172.21.15.2:0/988118923 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55d1a9210da0 0x55d1a9213190 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:27.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.242+0000 7f7c5e145740 1 --2- 172.21.15.2:0/988118923 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1a9195a90 0x55d1a920f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:27.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.242+0000 7f7c5e145740 1 --2- 172.21.15.2:0/988118923 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1a9186cc0 0x55d1a919a3f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:27.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.242+0000 7f7c3d7fa640 0 client.25784 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:56:27.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.242+0000 7f7c5e145740 1 --2- 172.21.15.2:0/988118923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1a91863a0 0x55d1a9199eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:27.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.242+0000 7f7c5e145740 1 -- 172.21.15.2:0/988118923 >> 172.21.15.2:0/988118923 conn(0x55d1a9182a30 msgr2=0x55d1a9187ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:56:27.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.242+0000 7f7c5e145740 1 -- 172.21.15.2:0/988118923 shutdown_connections 2024-09-19T04:56:27.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.242+0000 7f7c5e145740 1 -- 172.21.15.2:0/988118923 wait complete. 2024-09-19T04:56:27.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.242+0000 7f7c5e145740 20 client.25784 trim_cache size 0 max 16384 2024-09-19T04:56:27.251 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:56:27.252 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T04:56:27.252 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-19T04:56:27.252 INFO:teuthology.orchestra.run.smithi002.stdout: "0a4a192a-9431-4986-b3dc-e9f275691c66": { 2024-09-19T04:56:27.252 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-19T04:56:27.252 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "0a4a192a-9431-4986-b3dc-e9f275691c66", 2024-09-19T04:56:27.252 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-19T04:56:27.252 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:56:27.252 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:56:27.252 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:56:27.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.242+0000 7f7c5bd6c640 1 -- 172.21.15.2:0/2314733787 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f7c400a3430 msgr2=0x7f7c400a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:27.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.242+0000 7f7c5bd6c640 1 --2- 172.21.15.2:0/2314733787 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f7c400a3430 0x7f7c400a58f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c0cd0b0 tx=0x7f7c4c0cfc00 comp rx=0 tx=0).stop 2024-09-19T04:56:27.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.242+0000 7f7c5bd6c640 1 -- 172.21.15.2:0/2314733787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c54106f10 msgr2=0x7f7c5419cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:27.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.242+0000 7f7c5bd6c640 1 --2- 172.21.15.2:0/2314733787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c54106f10 0x7f7c5419cc70 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c00cad0 tx=0x7f7c4c00cf90 comp rx=0 tx=0).stop 2024-09-19T04:56:27.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.243+0000 7f7c5bd6c640 1 -- 172.21.15.2:0/2314733787 shutdown_connections 2024-09-19T04:56:27.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.243+0000 7f7c5bd6c640 1 --2- 172.21.15.2:0/2314733787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c54106f10 0x7f7c5419cc70 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:27.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.243+0000 7f7c5bd6c640 1 --2- 172.21.15.2:0/2314733787 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f7c400a3430 0x7f7c400a58f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:27.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.243+0000 7f7c5bd6c640 1 --2- 172.21.15.2:0/2314733787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7c54102790 0x7f7c541988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:27.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.243+0000 7f7c5bd6c640 1 --2- 172.21.15.2:0/2314733787 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c54101de0 0x7f7c541983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:27.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.243+0000 7f7c5bd6c640 1 -- 172.21.15.2:0/2314733787 >> 172.21.15.2:0/2314733787 conn(0x7f7c540fd8c0 msgr2=0x7f7c540fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:56:27.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.243+0000 7f7c5bd6c640 1 -- 172.21.15.2:0/2314733787 shutdown_connections 2024-09-19T04:56:27.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:27.243+0000 7f7c5bd6c640 1 -- 172.21.15.2:0/2314733787 wait complete. 2024-09-19T04:56:27.604 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:56:27 smithi002 ceph-mon[30975]: scrub queued for path: / 2024-09-19T04:56:27.604 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:56:27 smithi002 ceph-mon[30975]: scrub summary: idle+waiting paths [/] 2024-09-19T04:56:27.604 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:56:27 smithi002 ceph-mon[30975]: scrub summary: active paths [/] 2024-09-19T04:56:27.604 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:56:27 smithi002 ceph-mon[30975]: scrub summary: idle+waiting paths [/] 2024-09-19T04:56:27.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:56:27 smithi018 ceph-mon[34537]: scrub queued for path: / 2024-09-19T04:56:27.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:56:27 smithi018 ceph-mon[34537]: scrub summary: idle+waiting paths [/] 2024-09-19T04:56:27.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:56:27 smithi018 ceph-mon[34537]: scrub summary: active paths [/] 2024-09-19T04:56:27.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:56:27 smithi018 ceph-mon[34537]: scrub summary: idle+waiting paths [/] 2024-09-19T04:56:27.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:56:27 smithi116 ceph-mon[34477]: scrub queued for path: / 2024-09-19T04:56:27.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:56:27 smithi116 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-19T04:56:27.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:56:27 smithi116 ceph-mon[34477]: scrub summary: active paths [/] 2024-09-19T04:56:27.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:56:27 smithi116 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-19T04:56:28.024 INFO:tasks.cephfs.filesystem:scrub status for tag:0a4a192a-9431-4986-b3dc-e9f275691c66 - {'path': '/', 'tag': '0a4a192a-9431-4986-b3dc-e9f275691c66', 'options': 'recursive,force'} 2024-09-19T04:56:28.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:56:28 smithi018 ceph-mon[34537]: pgmap v261: 97 pgs: 97 active+clean; 14 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 44 KiB/s wr, 7 op/s 2024-09-19T04:56:28.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:56:28 smithi002 ceph-mon[30975]: pgmap v261: 97 pgs: 97 active+clean; 14 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 44 KiB/s wr, 7 op/s 2024-09-19T04:56:28.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:56:28 smithi116 ceph-mon[34477]: pgmap v261: 97 pgs: 97 active+clean; 14 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 44 KiB/s wr, 7 op/s 2024-09-19T04:56:30.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:56:30 smithi002 ceph-mon[30975]: pgmap v262: 97 pgs: 97 active+clean; 14 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 44 KiB/s wr, 7 op/s 2024-09-19T04:56:30.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:56:30 smithi018 ceph-mon[34537]: pgmap v262: 97 pgs: 97 active+clean; 14 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 44 KiB/s wr, 7 op/s 2024-09-19T04:56:30.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:56:30 smithi116 ceph-mon[34477]: pgmap v262: 97 pgs: 97 active+clean; 14 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 44 KiB/s wr, 7 op/s 2024-09-19T04:56:30.889 INFO:tasks.workunit.client.0.smithi002.stdout:375/600: open fd = 3 2024-09-19T04:56:30.889 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.889 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.890 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.890 INFO:tasks.workunit.client.0.smithi002.stdout:376/600: open fd = 3 2024-09-19T04:56:30.890 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.890 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.890 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.890 INFO:tasks.workunit.client.0.smithi002.stdout:377/600: open fd = 3 2024-09-19T04:56:30.890 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.890 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.891 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.891 INFO:tasks.workunit.client.0.smithi002.stdout:378/600: open fd = 3 2024-09-19T04:56:30.891 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.891 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.891 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.891 INFO:tasks.workunit.client.0.smithi002.stdout:379/600: open fd = 3 2024-09-19T04:56:30.891 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.891 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.891 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.892 INFO:tasks.workunit.client.0.smithi002.stdout:380/600: open fd = 3 2024-09-19T04:56:30.892 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.892 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.892 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.892 INFO:tasks.workunit.client.0.smithi002.stdout:381/600: open fd = 3 2024-09-19T04:56:30.892 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.892 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.892 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.893 INFO:tasks.workunit.client.0.smithi002.stdout:382/600: open fd = 3 2024-09-19T04:56:30.893 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.893 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.893 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.893 INFO:tasks.workunit.client.0.smithi002.stdout:383/600: open fd = 3 2024-09-19T04:56:30.893 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.893 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.893 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.894 INFO:tasks.workunit.client.0.smithi002.stdout:384/600: open fd = 3 2024-09-19T04:56:30.894 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.894 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.894 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.894 INFO:tasks.workunit.client.0.smithi002.stdout:385/600: open fd = 3 2024-09-19T04:56:30.894 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.894 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.894 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.894 INFO:tasks.workunit.client.0.smithi002.stdout:386/600: open fd = 3 2024-09-19T04:56:30.895 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.895 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.895 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.895 INFO:tasks.workunit.client.0.smithi002.stdout:387/600: open fd = 3 2024-09-19T04:56:30.895 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.895 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.895 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.895 INFO:tasks.workunit.client.0.smithi002.stdout:388/600: open fd = 3 2024-09-19T04:56:30.895 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.895 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.895 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.895 INFO:tasks.workunit.client.0.smithi002.stdout:389/600: open fd = 3 2024-09-19T04:56:30.895 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.896 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.896 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.896 INFO:tasks.workunit.client.0.smithi002.stdout:390/600: open fd = 3 2024-09-19T04:56:30.896 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.896 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.896 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.896 INFO:tasks.workunit.client.0.smithi002.stdout:391/600: open fd = 3 2024-09-19T04:56:30.896 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.896 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.896 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.896 INFO:tasks.workunit.client.0.smithi002.stdout:392/600: open fd = 3 2024-09-19T04:56:30.896 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.896 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.896 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.897 INFO:tasks.workunit.client.0.smithi002.stdout:393/600: open fd = 3 2024-09-19T04:56:30.897 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.897 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.897 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.897 INFO:tasks.workunit.client.0.smithi002.stdout:394/600: open fd = 3 2024-09-19T04:56:30.897 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.897 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.897 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.897 INFO:tasks.workunit.client.0.smithi002.stdout:395/600: open fd = 3 2024-09-19T04:56:30.897 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.897 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.897 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.897 INFO:tasks.workunit.client.0.smithi002.stdout:396/600: open fd = 3 2024-09-19T04:56:30.898 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.898 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.898 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.898 INFO:tasks.workunit.client.0.smithi002.stdout:397/600: open fd = 3 2024-09-19T04:56:30.898 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.898 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.898 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.898 INFO:tasks.workunit.client.0.smithi002.stdout:398/600: open fd = 3 2024-09-19T04:56:30.898 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.899 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.899 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.899 INFO:tasks.workunit.client.0.smithi002.stdout:399/600: open fd = 3 2024-09-19T04:56:30.899 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.899 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.899 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.899 INFO:tasks.workunit.client.0.smithi002.stdout:400/600: open fd = 3 2024-09-19T04:56:30.900 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.900 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.900 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.900 INFO:tasks.workunit.client.0.smithi002.stdout:401/600: open fd = 3 2024-09-19T04:56:30.900 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.900 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.901 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.901 INFO:tasks.workunit.client.0.smithi002.stdout:402/600: open fd = 3 2024-09-19T04:56:30.901 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.901 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.901 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.901 INFO:tasks.workunit.client.0.smithi002.stdout:403/600: open fd = 3 2024-09-19T04:56:30.902 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.902 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.902 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.902 INFO:tasks.workunit.client.0.smithi002.stdout:404/600: open fd = 3 2024-09-19T04:56:30.902 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.902 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.903 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.903 INFO:tasks.workunit.client.0.smithi002.stdout:405/600: open fd = 3 2024-09-19T04:56:30.903 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.903 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.903 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.903 INFO:tasks.workunit.client.0.smithi002.stdout:406/600: open fd = 3 2024-09-19T04:56:30.903 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.903 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.903 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.903 INFO:tasks.workunit.client.0.smithi002.stdout:407/600: open fd = 3 2024-09-19T04:56:30.903 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.903 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.903 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.903 INFO:tasks.workunit.client.0.smithi002.stdout:408/600: open fd = 3 2024-09-19T04:56:30.903 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.904 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.904 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.904 INFO:tasks.workunit.client.0.smithi002.stdout:409/600: open fd = 3 2024-09-19T04:56:30.904 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.904 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.904 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.904 INFO:tasks.workunit.client.0.smithi002.stdout:410/600: open fd = 3 2024-09-19T04:56:30.904 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.904 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.904 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.904 INFO:tasks.workunit.client.0.smithi002.stdout:411/600: open fd = 3 2024-09-19T04:56:30.904 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.904 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.904 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.905 INFO:tasks.workunit.client.0.smithi002.stdout:412/600: open fd = 3 2024-09-19T04:56:30.905 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.905 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.905 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.905 INFO:tasks.workunit.client.0.smithi002.stdout:413/600: open fd = 3 2024-09-19T04:56:30.905 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.905 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.905 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.905 INFO:tasks.workunit.client.0.smithi002.stdout:414/600: open fd = 3 2024-09-19T04:56:30.905 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.905 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.905 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.905 INFO:tasks.workunit.client.0.smithi002.stdout:415/600: open fd = 3 2024-09-19T04:56:30.906 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.906 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.906 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.906 INFO:tasks.workunit.client.0.smithi002.stdout:416/600: open fd = 3 2024-09-19T04:56:30.906 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.906 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.906 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.906 INFO:tasks.workunit.client.0.smithi002.stdout:417/600: open fd = 3 2024-09-19T04:56:30.906 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.906 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.906 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.906 INFO:tasks.workunit.client.0.smithi002.stdout:418/600: open fd = 3 2024-09-19T04:56:30.906 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.906 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.906 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.907 INFO:tasks.workunit.client.0.smithi002.stdout:419/600: open fd = 3 2024-09-19T04:56:30.907 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.907 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.907 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.907 INFO:tasks.workunit.client.0.smithi002.stdout:420/600: open fd = 3 2024-09-19T04:56:30.907 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.907 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.907 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.907 INFO:tasks.workunit.client.0.smithi002.stdout:421/600: open fd = 3 2024-09-19T04:56:30.907 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.907 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.907 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.907 INFO:tasks.workunit.client.0.smithi002.stdout:422/600: open fd = 3 2024-09-19T04:56:30.907 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.908 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.908 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.908 INFO:tasks.workunit.client.0.smithi002.stdout:423/600: open fd = 3 2024-09-19T04:56:30.908 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.908 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.908 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.908 INFO:tasks.workunit.client.0.smithi002.stdout:424/600: open fd = 3 2024-09-19T04:56:30.908 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.908 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.908 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.908 INFO:tasks.workunit.client.0.smithi002.stdout:425/600: open fd = 3 2024-09-19T04:56:30.908 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.908 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.909 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.909 INFO:tasks.workunit.client.0.smithi002.stdout:426/600: open fd = 3 2024-09-19T04:56:30.909 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.909 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.909 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.909 INFO:tasks.workunit.client.0.smithi002.stdout:427/600: open fd = 3 2024-09-19T04:56:30.909 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.909 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.909 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.909 INFO:tasks.workunit.client.0.smithi002.stdout:428/600: open fd = 3 2024-09-19T04:56:30.909 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.909 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.909 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.909 INFO:tasks.workunit.client.0.smithi002.stdout:429/600: open fd = 3 2024-09-19T04:56:30.910 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.910 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.910 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.910 INFO:tasks.workunit.client.0.smithi002.stdout:430/600: open fd = 3 2024-09-19T04:56:30.910 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.910 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.910 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.910 INFO:tasks.workunit.client.0.smithi002.stdout:431/600: open fd = 3 2024-09-19T04:56:30.910 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.910 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.910 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.910 INFO:tasks.workunit.client.0.smithi002.stdout:432/600: open fd = 3 2024-09-19T04:56:30.910 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.910 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.911 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.911 INFO:tasks.workunit.client.0.smithi002.stdout:433/600: open fd = 3 2024-09-19T04:56:30.911 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.911 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.911 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.911 INFO:tasks.workunit.client.0.smithi002.stdout:434/600: open fd = 3 2024-09-19T04:56:30.911 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.911 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.911 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.911 INFO:tasks.workunit.client.0.smithi002.stdout:435/600: open fd = 3 2024-09-19T04:56:30.911 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.911 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.911 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:30.911 INFO:tasks.workunit.client.0.smithi002.stdout:436/600: open fd = 3 2024-09-19T04:56:30.911 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.912 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:56:30.912 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:56:31.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:56:31 smithi018 ceph-mon[34537]: scrub summary: idle 2024-09-19T04:56:31.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:56:31 smithi002 ceph-mon[30975]: scrub summary: idle 2024-09-19T04:56:31.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:56:31 smithi116 ceph-mon[34477]: scrub summary: idle 2024-09-19T04:56:32.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:56:32 smithi018 ceph-mon[34537]: pgmap v263: 97 pgs: 97 active+clean; 14 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 64 KiB/s wr, 11 op/s 2024-09-19T04:56:32.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:56:32 smithi002 ceph-mon[30975]: pgmap v263: 97 pgs: 97 active+clean; 14 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 64 KiB/s wr, 11 op/s 2024-09-19T04:56:32.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:56:32 smithi116 ceph-mon[34477]: pgmap v263: 97 pgs: 97 active+clean; 14 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 64 KiB/s wr, 11 op/s 2024-09-19T04:56:34.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:56:34 smithi018 ceph-mon[34537]: pgmap v264: 97 pgs: 97 active+clean; 14 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 44 KiB/s wr, 7 op/s 2024-09-19T04:56:34.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:56:34 smithi002 ceph-mon[30975]: pgmap v264: 97 pgs: 97 active+clean; 14 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 44 KiB/s wr, 7 op/s 2024-09-19T04:56:34.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:56:34 smithi116 ceph-mon[34477]: pgmap v264: 97 pgs: 97 active+clean; 14 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 44 KiB/s wr, 7 op/s 2024-09-19T04:56:36.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:56:36 smithi018 ceph-mon[34537]: pgmap v265: 97 pgs: 97 active+clean; 15 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 67 KiB/s wr, 11 op/s 2024-09-19T04:56:36.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:56:36 smithi002 ceph-mon[30975]: pgmap v265: 97 pgs: 97 active+clean; 15 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 67 KiB/s wr, 11 op/s 2024-09-19T04:56:36.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:56:36 smithi116 ceph-mon[34477]: pgmap v265: 97 pgs: 97 active+clean; 15 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 67 KiB/s wr, 11 op/s 2024-09-19T04:56:38.662 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:56:38 smithi002 ceph-mon[30975]: pgmap v266: 97 pgs: 97 active+clean; 15 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 44 KiB/s wr, 7 op/s 2024-09-19T04:56:38.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:56:38 smithi018 ceph-mon[34537]: pgmap v266: 97 pgs: 97 active+clean; 15 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 44 KiB/s wr, 7 op/s 2024-09-19T04:56:38.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:56:38 smithi116 ceph-mon[34477]: pgmap v266: 97 pgs: 97 active+clean; 15 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 44 KiB/s wr, 7 op/s 2024-09-19T04:56:40.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:56:40 smithi018 ceph-mon[34537]: pgmap v267: 97 pgs: 97 active+clean; 15 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 44 KiB/s wr, 7 op/s 2024-09-19T04:56:40.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:56:40 smithi002 ceph-mon[30975]: pgmap v267: 97 pgs: 97 active+clean; 15 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 44 KiB/s wr, 7 op/s 2024-09-19T04:56:40.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:56:40 smithi116 ceph-mon[34477]: pgmap v267: 97 pgs: 97 active+clean; 15 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 44 KiB/s wr, 7 op/s 2024-09-19T04:56:42.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:56:42 smithi018 ceph-mon[34537]: pgmap v268: 97 pgs: 97 active+clean; 15 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 64 KiB/s wr, 10 op/s 2024-09-19T04:56:42.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:56:42 smithi002 ceph-mon[30975]: pgmap v268: 97 pgs: 97 active+clean; 15 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 64 KiB/s wr, 10 op/s 2024-09-19T04:56:42.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:56:42 smithi116 ceph-mon[34477]: pgmap v268: 97 pgs: 97 active+clean; 15 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 64 KiB/s wr, 10 op/s 2024-09-19T04:56:44.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:56:44 smithi018 ceph-mon[34537]: pgmap v269: 97 pgs: 97 active+clean; 15 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 43 KiB/s wr, 7 op/s 2024-09-19T04:56:44.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:56:44 smithi002 ceph-mon[30975]: pgmap v269: 97 pgs: 97 active+clean; 15 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 43 KiB/s wr, 7 op/s 2024-09-19T04:56:44.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:56:44 smithi116 ceph-mon[34477]: pgmap v269: 97 pgs: 97 active+clean; 15 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 43 KiB/s wr, 7 op/s 2024-09-19T04:56:46.663 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:56:46 smithi116 ceph-mon[34477]: pgmap v270: 97 pgs: 97 active+clean; 15 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 67 KiB/s wr, 11 op/s 2024-09-19T04:56:46.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:56:46 smithi018 ceph-mon[34537]: pgmap v270: 97 pgs: 97 active+clean; 15 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 67 KiB/s wr, 11 op/s 2024-09-19T04:56:46.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:56:46 smithi002 ceph-mon[30975]: pgmap v270: 97 pgs: 97 active+clean; 15 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 67 KiB/s wr, 11 op/s 2024-09-19T04:56:48.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:56:48 smithi018 ceph-mon[34537]: pgmap v271: 97 pgs: 97 active+clean; 15 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 43 KiB/s wr, 7 op/s 2024-09-19T04:56:48.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:56:48 smithi002 ceph-mon[30975]: pgmap v271: 97 pgs: 97 active+clean; 15 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 43 KiB/s wr, 7 op/s 2024-09-19T04:56:48.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:56:48 smithi116 ceph-mon[34477]: pgmap v271: 97 pgs: 97 active+clean; 15 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 43 KiB/s wr, 7 op/s 2024-09-19T04:56:50.806 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:56:50 smithi018 ceph-mon[34537]: pgmap v272: 97 pgs: 97 active+clean; 15 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 43 KiB/s wr, 7 op/s 2024-09-19T04:56:50.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:56:50 smithi002 ceph-mon[30975]: pgmap v272: 97 pgs: 97 active+clean; 15 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 43 KiB/s wr, 7 op/s 2024-09-19T04:56:50.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:56:50 smithi116 ceph-mon[34477]: pgmap v272: 97 pgs: 97 active+clean; 15 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 43 KiB/s wr, 7 op/s 2024-09-19T04:56:52.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:56:52 smithi018 ceph-mon[34537]: pgmap v273: 97 pgs: 97 active+clean; 15 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 64 KiB/s wr, 10 op/s 2024-09-19T04:56:52.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:56:52 smithi002 ceph-mon[30975]: pgmap v273: 97 pgs: 97 active+clean; 15 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 64 KiB/s wr, 10 op/s 2024-09-19T04:56:52.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:56:52 smithi116 ceph-mon[34477]: pgmap v273: 97 pgs: 97 active+clean; 15 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 64 KiB/s wr, 10 op/s 2024-09-19T04:56:54.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:56:54 smithi018 ceph-mon[34537]: pgmap v274: 97 pgs: 97 active+clean; 15 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 44 KiB/s wr, 7 op/s 2024-09-19T04:56:54.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:56:54 smithi002 ceph-mon[30975]: pgmap v274: 97 pgs: 97 active+clean; 15 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 44 KiB/s wr, 7 op/s 2024-09-19T04:56:54.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:56:54 smithi116 ceph-mon[34477]: pgmap v274: 97 pgs: 97 active+clean; 15 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 44 KiB/s wr, 7 op/s 2024-09-19T04:56:56.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:56:56 smithi018 ceph-mon[34537]: pgmap v275: 97 pgs: 97 active+clean; 16 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 68 KiB/s wr, 11 op/s 2024-09-19T04:56:56.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:56:56 smithi002 ceph-mon[30975]: pgmap v275: 97 pgs: 97 active+clean; 16 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 68 KiB/s wr, 11 op/s 2024-09-19T04:56:56.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:56:56 smithi116 ceph-mon[34477]: pgmap v275: 97 pgs: 97 active+clean; 16 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 68 KiB/s wr, 11 op/s 2024-09-19T04:56:58.025 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:56:58.301 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:56:58.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:56:58 smithi002 ceph-mon[30975]: pgmap v276: 97 pgs: 97 active+clean; 16 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 44 KiB/s wr, 7 op/s 2024-09-19T04:56:58.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:56:58 smithi116 ceph-mon[34477]: pgmap v276: 97 pgs: 97 active+clean; 16 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 44 KiB/s wr, 7 op/s 2024-09-19T04:56:58.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:56:58 smithi018 ceph-mon[34537]: pgmap v276: 97 pgs: 97 active+clean; 16 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 44 KiB/s wr, 7 op/s 2024-09-19T04:56:58.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.929+0000 7f2ab6e1a640 1 -- 172.21.15.2:0/2105536142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ab01011e0 msgr2=0x7f2ab0105980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:58.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.929+0000 7f2ab6e1a640 1 --2- 172.21.15.2:0/2105536142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ab01011e0 0x7f2ab0105980 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0009ca0 tx=0x7f2aa002a8c0 comp rx=0 tx=0).stop 2024-09-19T04:56:58.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.929+0000 7f2ab6e1a640 1 -- 172.21.15.2:0/2105536142 shutdown_connections 2024-09-19T04:56:58.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.929+0000 7f2ab6e1a640 1 --2- 172.21.15.2:0/2105536142 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ab0105ec0 0x7f2ab0106340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:58.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.929+0000 7f2ab6e1a640 1 --2- 172.21.15.2:0/2105536142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ab01011e0 0x7f2ab0105980 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:58.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.929+0000 7f2ab6e1a640 1 --2- 172.21.15.2:0/2105536142 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ab01008c0 0x7f2ab0100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:58.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.929+0000 7f2ab6e1a640 1 -- 172.21.15.2:0/2105536142 >> 172.21.15.2:0/2105536142 conn(0x7f2ab00fc7d0 msgr2=0x7f2ab00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:56:58.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.929+0000 7f2ab6e1a640 1 -- 172.21.15.2:0/2105536142 shutdown_connections 2024-09-19T04:56:58.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.929+0000 7f2ab6e1a640 1 -- 172.21.15.2:0/2105536142 wait complete. 2024-09-19T04:56:58.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.930+0000 7f2ab6e1a640 1 Processor -- start 2024-09-19T04:56:58.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.930+0000 7f2ab6e1a640 1 -- start start 2024-09-19T04:56:58.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.930+0000 7f2ab6e1a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ab01008c0 0x7f2ab01a4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:58.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.930+0000 7f2ab6e1a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ab01011e0 0x7f2ab01a4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:58.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.930+0000 7f2ab6e1a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ab0105ec0 0x7f2ab019e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:58.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.930+0000 7f2ab6e1a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab01184e0 con 0x7f2ab01011e0 2024-09-19T04:56:58.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.930+0000 7f2ab6e1a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab0118360 con 0x7f2ab0105ec0 2024-09-19T04:56:58.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.930+0000 7f2ab6e1a640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab0118660 con 0x7f2ab01008c0 2024-09-19T04:56:58.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.930+0000 7f2aaffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ab01011e0 0x7f2ab01a4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:58.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.930+0000 7f2aaffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ab01011e0 0x7f2ab01a4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55306/0 (socket says 172.21.15.2:55306) 2024-09-19T04:56:58.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.930+0000 7f2aaffff640 1 -- 172.21.15.2:0/3034703670 learned_addr learned my addr 172.21.15.2:0/3034703670 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:56:58.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.930+0000 7f2ab4bb6640 1 --2- 172.21.15.2:0/3034703670 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ab01008c0 0x7f2ab01a4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:58.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.930+0000 7f2ab53b7640 1 --2- 172.21.15.2:0/3034703670 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ab0105ec0 0x7f2ab019e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:58.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.931+0000 7f2aaffff640 1 -- 172.21.15.2:0/3034703670 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ab01008c0 msgr2=0x7f2ab01a4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:58.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.931+0000 7f2aaffff640 1 --2- 172.21.15.2:0/3034703670 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ab01008c0 0x7f2ab01a4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:58.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.931+0000 7f2aaffff640 1 -- 172.21.15.2:0/3034703670 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ab0105ec0 msgr2=0x7f2ab019e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:58.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.931+0000 7f2aaffff640 1 --2- 172.21.15.2:0/3034703670 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ab0105ec0 0x7f2ab019e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:58.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.931+0000 7f2aaffff640 1 -- 172.21.15.2:0/3034703670 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ab019ef90 con 0x7f2ab01011e0 2024-09-19T04:56:58.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.931+0000 7f2aaffff640 1 --2- 172.21.15.2:0/3034703670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ab01011e0 0x7f2ab01a4bb0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f2aa002ade0 tx=0x7f2aa00093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:56:58.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.931+0000 7f2aadffb640 1 -- 172.21.15.2:0/3034703670 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa0003c70 con 0x7f2ab01011e0 2024-09-19T04:56:58.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.931+0000 7f2aadffb640 1 -- 172.21.15.2:0/3034703670 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2aa0003e10 con 0x7f2ab01011e0 2024-09-19T04:56:58.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.931+0000 7f2ab6e1a640 1 -- 172.21.15.2:0/3034703670 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ab019f220 con 0x7f2ab01011e0 2024-09-19T04:56:58.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.931+0000 7f2aadffb640 1 -- 172.21.15.2:0/3034703670 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa0030b50 con 0x7f2ab01011e0 2024-09-19T04:56:58.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.931+0000 7f2ab6e1a640 1 -- 172.21.15.2:0/3034703670 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ab01ab4d0 con 0x7f2ab01011e0 2024-09-19T04:56:58.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.933+0000 7f2aadffb640 1 -- 172.21.15.2:0/3034703670 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f2aa0004710 con 0x7f2ab01011e0 2024-09-19T04:56:58.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.934+0000 7f2aadffb640 1 --2- 172.21.15.2:0/3034703670 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f2a9c0a3430 0x7f2a9c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:58.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.934+0000 7f2aadffb640 1 -- 172.21.15.2:0/3034703670 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7f2aa00f0f70 con 0x7f2ab01011e0 2024-09-19T04:56:58.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.934+0000 7f2ab4bb6640 1 --2- 172.21.15.2:0/3034703670 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f2a9c0a3430 0x7f2a9c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:58.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.935+0000 7f2ab4bb6640 1 --2- 172.21.15.2:0/3034703670 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f2a9c0a3430 0x7f2a9c0a58f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2a9800abe0 tx=0x7f2a9800a2d0 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:56:58.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.935+0000 7f2ab91f3740 1 Processor -- start 2024-09-19T04:56:58.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.935+0000 7f2ab91f3740 1 -- start start 2024-09-19T04:56:58.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.935+0000 7f2ab91f3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56424efd94a0 0x56424efd9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:58.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.935+0000 7f2ab91f3740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56424efd9dc0 0x56424efe4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:58.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.935+0000 7f2ab91f3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56424efe4680 0x56424efe6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:58.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.935+0000 7f2ab91f3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56424ef3f2e0 con 0x56424efe4680 2024-09-19T04:56:58.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.935+0000 7f2ab91f3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56424eee6ce0 con 0x56424efd94a0 2024-09-19T04:56:58.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.935+0000 7f2ab91f3740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x56424ef3b2a0 con 0x56424efd9dc0 2024-09-19T04:56:58.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.935+0000 7f2ab53b7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56424efe4680 0x56424efe6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:58.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.935+0000 7f2ab53b7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56424efe4680 0x56424efe6a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55312/0 (socket says 172.21.15.2:55312) 2024-09-19T04:56:58.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.935+0000 7f2ab53b7640 1 -- 172.21.15.2:0/4109945448 learned_addr learned my addr 172.21.15.2:0/4109945448 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:56:58.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.935+0000 7f2aaffff640 1 --2- 172.21.15.2:0/4109945448 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56424efd9dc0 0x56424efe4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:58.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.936+0000 7f2ab4bb6640 1 --2- 172.21.15.2:0/4109945448 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56424efd94a0 0x56424efd9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:58.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.936+0000 7f2ab53b7640 1 -- 172.21.15.2:0/4109945448 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56424efd9dc0 msgr2=0x56424efe4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:56:58.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.936+0000 7f2ab53b7640 1 --2- 172.21.15.2:0/4109945448 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56424efd9dc0 0x56424efe4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:58.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.936+0000 7f2ab53b7640 1 -- 172.21.15.2:0/4109945448 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56424efd94a0 msgr2=0x56424efd9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:56:58.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.936+0000 7f2ab53b7640 1 --2- 172.21.15.2:0/4109945448 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56424efd94a0 0x56424efd9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:58.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.936+0000 7f2ab53b7640 1 -- 172.21.15.2:0/4109945448 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56424eecb440 con 0x56424efe4680 2024-09-19T04:56:58.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.936+0000 7f2ab53b7640 1 --2- 172.21.15.2:0/4109945448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56424efe4680 0x56424efe6a70 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8009c20 tx=0x7f2aa8011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5df54ed43040ede7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:56:58.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.936+0000 7f2aa6ffd640 1 -- 172.21.15.2:0/4109945448 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa801e070 con 0x56424efe4680 2024-09-19T04:56:58.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.936+0000 7f2aa6ffd640 1 -- 172.21.15.2:0/4109945448 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2aa8019ae0 con 0x56424efe4680 2024-09-19T04:56:58.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.936+0000 7f2aa6ffd640 1 -- 172.21.15.2:0/4109945448 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa800e950 con 0x56424efe4680 2024-09-19T04:56:58.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.937+0000 7f2ab91f3740 1 -- 172.21.15.2:0/4109945448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56424efe4680 msgr2=0x56424efe6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:58.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.937+0000 7f2ab91f3740 1 --2- 172.21.15.2:0/4109945448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56424efe4680 0x56424efe6a70 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8009c20 tx=0x7f2aa8011810 comp rx=0 tx=0).stop 2024-09-19T04:56:58.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.937+0000 7f2ab91f3740 1 -- 172.21.15.2:0/4109945448 shutdown_connections 2024-09-19T04:56:58.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.937+0000 7f2ab91f3740 1 --2- 172.21.15.2:0/4109945448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56424efe4680 0x56424efe6a70 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:58.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.937+0000 7f2ab91f3740 1 --2- 172.21.15.2:0/4109945448 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56424efd9dc0 0x56424efe4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:58.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.937+0000 7f2ab91f3740 1 --2- 172.21.15.2:0/4109945448 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56424efd94a0 0x56424efd9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:58.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.937+0000 7f2ab91f3740 1 -- 172.21.15.2:0/4109945448 >> 172.21.15.2:0/4109945448 conn(0x56424efd5a30 msgr2=0x56424efd5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:56:58.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.937+0000 7f2ab91f3740 1 -- 172.21.15.2:0/4109945448 shutdown_connections 2024-09-19T04:56:58.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.937+0000 7f2ab91f3740 1 -- 172.21.15.2:0/4109945448 wait complete. 2024-09-19T04:56:58.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.937+0000 7f2ab91f3740 1 -- start start 2024-09-19T04:56:58.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.937+0000 7f2ab91f3740 1 Processor -- start 2024-09-19T04:56:58.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.938+0000 7f2ab91f3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56424efd94a0 0x56424efe3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:58.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.938+0000 7f2ab91f3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56424efd9dc0 0x56424efe1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:58.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.938+0000 7f2ab91f3740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56424efe4680 0x56424efe1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:58.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.938+0000 7f2ab91f3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56424efe7250 con 0x56424efd94a0 2024-09-19T04:56:58.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.938+0000 7f2ab91f3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56424eefa050 con 0x56424efd9dc0 2024-09-19T04:56:58.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.938+0000 7f2ab91f3740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x56424efe73d0 con 0x56424efe4680 2024-09-19T04:56:58.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.938+0000 7f2ab4bb6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56424efd94a0 0x56424efe3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:58.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.938+0000 7f2ab4bb6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56424efd94a0 0x56424efe3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55328/0 (socket says 172.21.15.2:55328) 2024-09-19T04:56:58.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.938+0000 7f2ab4bb6640 1 -- 172.21.15.2:0/2948036172 learned_addr learned my addr 172.21.15.2:0/2948036172 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:56:58.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.938+0000 7f2ab91f3740 10 client.0 _ll_register_callbacks cb 0x56424ef3a160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:56:58.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.938+0000 7f2aaffff640 1 --2- 172.21.15.2:0/2948036172 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56424efd9dc0 0x56424efe1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:58.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.938+0000 7f2ab53b7640 1 --2- 172.21.15.2:0/2948036172 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56424efe4680 0x56424efe1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:58.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.938+0000 7f2ab4bb6640 1 -- 172.21.15.2:0/2948036172 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56424efe4680 msgr2=0x56424efe1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:56:58.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.938+0000 7f2ab4bb6640 1 --2- 172.21.15.2:0/2948036172 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56424efe4680 0x56424efe1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:58.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.938+0000 7f2ab4bb6640 1 -- 172.21.15.2:0/2948036172 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56424efd9dc0 msgr2=0x56424efe1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:56:58.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.938+0000 7f2ab4bb6640 1 --2- 172.21.15.2:0/2948036172 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56424efd9dc0 0x56424efe1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:58.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.938+0000 7f2ab4bb6640 1 -- 172.21.15.2:0/2948036172 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56424ecb03c0 con 0x56424efd94a0 2024-09-19T04:56:58.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.939+0000 7f2ab4bb6640 1 --2- 172.21.15.2:0/2948036172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56424efd94a0 0x56424efe3f50 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f2a9800a5c0 tx=0x7f2a98004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50704e37b87e5ba6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:56:58.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.939+0000 7f2a8ffff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:56:58.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.939+0000 7f2a8ffff640 1 -- 172.21.15.2:0/2948036172 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9802a060 con 0x56424efd94a0 2024-09-19T04:56:58.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.939+0000 7f2a8ffff640 1 -- 172.21.15.2:0/2948036172 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7f2a9801b440 con 0x56424efd94a0 2024-09-19T04:56:58.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.939+0000 7f2ab91f3740 1 -- 172.21.15.2:0/2948036172 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2aa8019ae0 con 0x56424efd94a0 2024-09-19T04:56:58.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.939+0000 7f2a8ffff640 1 -- 172.21.15.2:0/2948036172 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f2a98016070 con 0x56424efd94a0 2024-09-19T04:56:58.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.939+0000 7f2ab91f3740 10 client.16470 fetch_fsmap learned FSMap version 19 2024-09-19T04:56:58.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.939+0000 7f2ab91f3740 1 -- 172.21.15.2:0/2948036172 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56424eff2c30 con 0x56424efd94a0 2024-09-19T04:56:58.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.939+0000 7f2a8ffff640 1 -- 172.21.15.2:0/2948036172 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2aa8019ae0 con 0x56424efd94a0 2024-09-19T04:56:58.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.939+0000 7f2a8ffff640 1 -- 172.21.15.2:0/2948036172 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f2a98024030 con 0x56424efd94a0 2024-09-19T04:56:58.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.940+0000 7f2ab91f3740 10 client.16470 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:56:58.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.940+0000 7f2ab91f3740 10 client.16470 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:56:58.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.940+0000 7f2ab91f3740 20 client.16470 populate_metadata read hostname 'smithi002' 2024-09-19T04:56:58.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.940+0000 7f2ab91f3740 1 --2- 172.21.15.2:0/2948036172 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56424eff40f0 0x56424eff6520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:58.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.940+0000 7f2ab91f3740 4 client.16470 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:56:58.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.940+0000 7f2ab91f3740 1 -- 172.21.15.2:0/2948036172 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56424ef4c850 con 0x56424eff40f0 2024-09-19T04:56:58.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.940+0000 7f2aaffff640 1 --2- 172.21.15.2:0/2948036172 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56424eff40f0 0x56424eff6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:58.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.940+0000 7f2aaffff640 1 --2- 172.21.15.2:0/2948036172 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56424eff40f0 0x56424eff6520 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a30a1921cbca1c9c server_cookie=32088adcd587f181 in_seq=0 out_seq=0 2024-09-19T04:56:58.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.940+0000 7f2a8ffff640 10 client.16470 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:56:58.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.941+0000 7f2a8ffff640 1 -- 172.21.15.2:0/2948036172 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56424ef4c850 con 0x56424eff40f0 2024-09-19T04:56:58.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.941+0000 7f2a8ffff640 10 client.16470 handle_command_reply: tid=0 2024-09-19T04:56:58.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.941+0000 7f2ab91f3740 1 client.16470 shutdown 2024-09-19T04:56:58.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.941+0000 7f2ab91f3740 1 -- 172.21.15.2:0/2948036172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56424efd94a0 msgr2=0x56424efe3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:58.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.941+0000 7f2ab91f3740 1 --2- 172.21.15.2:0/2948036172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56424efd94a0 0x56424efe3f50 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f2a9800a5c0 tx=0x7f2a98004730 comp rx=0 tx=0).stop 2024-09-19T04:56:58.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.941+0000 7f2ab91f3740 1 -- 172.21.15.2:0/2948036172 shutdown_connections 2024-09-19T04:56:58.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.941+0000 7f2ab91f3740 1 --2- 172.21.15.2:0/2948036172 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56424eff40f0 0x56424eff6520 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:58.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.941+0000 7f2ab91f3740 1 --2- 172.21.15.2:0/2948036172 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56424efe4680 0x56424efe1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:58.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.941+0000 7f2a8ffff640 0 client.16470 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:56:58.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.941+0000 7f2ab91f3740 1 --2- 172.21.15.2:0/2948036172 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56424efd9dc0 0x56424efe1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:58.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.941+0000 7f2ab91f3740 1 --2- 172.21.15.2:0/2948036172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56424efd94a0 0x56424efe3f50 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:58.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.941+0000 7f2ab91f3740 1 -- 172.21.15.2:0/2948036172 >> 172.21.15.2:0/2948036172 conn(0x56424efd5a30 msgr2=0x56424efdb710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:56:58.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.942+0000 7f2ab91f3740 1 -- 172.21.15.2:0/2948036172 shutdown_connections 2024-09-19T04:56:58.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.942+0000 7f2ab91f3740 1 -- 172.21.15.2:0/2948036172 wait complete. 2024-09-19T04:56:58.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.942+0000 7f2ab91f3740 20 client.16470 trim_cache size 0 max 16384 2024-09-19T04:56:58.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.976+0000 7f2ab91f3740 1 Processor -- start 2024-09-19T04:56:58.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.976+0000 7f2ab91f3740 1 -- start start 2024-09-19T04:56:58.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.976+0000 7f2ab91f3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56424efd94a0 0x56424eff04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:58.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.976+0000 7f2ab91f3740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56424efd9dc0 0x56424effbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:58.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.976+0000 7f2ab91f3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56424efe4680 0x56424effc330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:58.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.977+0000 7f2ab91f3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab01b1c50 con 0x56424efe4680 2024-09-19T04:56:58.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.977+0000 7f2ab91f3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab01b44b0 con 0x56424efd94a0 2024-09-19T04:56:58.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.977+0000 7f2ab91f3740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab01b22a0 con 0x56424efd9dc0 2024-09-19T04:56:58.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.977+0000 7f2ab53b7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56424efe4680 0x56424effc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:58.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.977+0000 7f2ab53b7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56424efe4680 0x56424effc330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55342/0 (socket says 172.21.15.2:55342) 2024-09-19T04:56:58.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.977+0000 7f2ab53b7640 1 -- 172.21.15.2:0/1620018043 learned_addr learned my addr 172.21.15.2:0/1620018043 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:56:58.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.977+0000 7f2ab4bb6640 1 --2- 172.21.15.2:0/1620018043 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56424efd94a0 0x56424eff04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:58.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.977+0000 7f2aaffff640 1 --2- 172.21.15.2:0/1620018043 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56424efd9dc0 0x56424effbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:58.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.977+0000 7f2ab53b7640 1 -- 172.21.15.2:0/1620018043 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56424efd9dc0 msgr2=0x56424effbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:56:58.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.977+0000 7f2ab53b7640 1 --2- 172.21.15.2:0/1620018043 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56424efd9dc0 0x56424effbdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:58.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.977+0000 7f2ab53b7640 1 -- 172.21.15.2:0/1620018043 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56424efd94a0 msgr2=0x56424eff04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:56:58.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.977+0000 7f2ab53b7640 1 --2- 172.21.15.2:0/1620018043 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56424efd94a0 0x56424eff04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:58.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.977+0000 7f2ab53b7640 1 -- 172.21.15.2:0/1620018043 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56424efd66c0 con 0x56424efe4680 2024-09-19T04:56:58.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.977+0000 7f2ab4bb6640 1 --2- 172.21.15.2:0/1620018043 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56424efd94a0 0x56424eff04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:56:58.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.977+0000 7f2ab53b7640 1 --2- 172.21.15.2:0/1620018043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56424efe4680 0x56424effc330 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8009bc0 tx=0x7f2aa800e5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c51bd6fab911ae95 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:56:58.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.977+0000 7f2aa67fc640 1 -- 172.21.15.2:0/1620018043 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa801e040 con 0x56424efe4680 2024-09-19T04:56:58.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.978+0000 7f2aa67fc640 1 -- 172.21.15.2:0/1620018043 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2aa801f040 con 0x56424efe4680 2024-09-19T04:56:58.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.978+0000 7f2aa67fc640 1 -- 172.21.15.2:0/1620018043 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa80035f0 con 0x56424efe4680 2024-09-19T04:56:58.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.978+0000 7f2ab91f3740 1 -- 172.21.15.2:0/1620018043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56424efe4680 msgr2=0x56424effc330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:58.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.978+0000 7f2ab91f3740 1 --2- 172.21.15.2:0/1620018043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56424efe4680 0x56424effc330 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8009bc0 tx=0x7f2aa800e5d0 comp rx=0 tx=0).stop 2024-09-19T04:56:58.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.978+0000 7f2ab91f3740 1 -- 172.21.15.2:0/1620018043 shutdown_connections 2024-09-19T04:56:58.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.978+0000 7f2ab91f3740 1 --2- 172.21.15.2:0/1620018043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56424efe4680 0x56424effc330 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:58.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.978+0000 7f2ab91f3740 1 --2- 172.21.15.2:0/1620018043 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56424efd9dc0 0x56424effbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:58.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.978+0000 7f2ab91f3740 1 --2- 172.21.15.2:0/1620018043 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56424efd94a0 0x56424eff04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:58.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.978+0000 7f2ab91f3740 1 -- 172.21.15.2:0/1620018043 >> 172.21.15.2:0/1620018043 conn(0x56424efd5a30 msgr2=0x56424efdfad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:56:58.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.978+0000 7f2ab91f3740 1 -- 172.21.15.2:0/1620018043 shutdown_connections 2024-09-19T04:56:58.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.978+0000 7f2ab91f3740 1 -- 172.21.15.2:0/1620018043 wait complete. 2024-09-19T04:56:58.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.979+0000 7f2ab91f3740 1 -- start start 2024-09-19T04:56:58.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.979+0000 7f2ab91f3740 1 Processor -- start 2024-09-19T04:56:58.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.979+0000 7f2ab91f3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56424efd94a0 0x56424efecf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:58.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.979+0000 7f2ab91f3740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56424efd9dc0 0x56424efe8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:58.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.979+0000 7f2ab91f3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56424efe4680 0x56424efe89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:58.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.979+0000 7f2ab91f3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab01b2970 con 0x56424efe4680 2024-09-19T04:56:58.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.979+0000 7f2ab91f3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab01b3de0 con 0x56424efd94a0 2024-09-19T04:56:58.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.979+0000 7f2ab91f3740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab01b3040 con 0x56424efd9dc0 2024-09-19T04:56:58.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.979+0000 7f2ab91f3740 10 client.0 _ll_register_callbacks cb 0x7f2a9800a8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:56:58.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.979+0000 7f2aaffff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56424efd9dc0 0x56424efe8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:58.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.979+0000 7f2ab53b7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56424efe4680 0x56424efe89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:58.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.979+0000 7f2aaffff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56424efd9dc0 0x56424efe8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.2:55566/0 (socket says 172.21.15.2:55566) 2024-09-19T04:56:58.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.979+0000 7f2aaffff640 1 -- 172.21.15.2:0/4192626897 learned_addr learned my addr 172.21.15.2:0/4192626897 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:56:58.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.980+0000 7f2ab4bb6640 1 --2- 172.21.15.2:0/4192626897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56424efd94a0 0x56424efecf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:58.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.980+0000 7f2ab53b7640 1 -- 172.21.15.2:0/4192626897 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56424efd9dc0 msgr2=0x56424efe8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:56:58.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.980+0000 7f2ab53b7640 1 --2- 172.21.15.2:0/4192626897 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56424efd9dc0 0x56424efe8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:58.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.980+0000 7f2ab53b7640 1 -- 172.21.15.2:0/4192626897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56424efd94a0 msgr2=0x56424efecf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:56:58.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.980+0000 7f2ab53b7640 1 --2- 172.21.15.2:0/4192626897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56424efd94a0 0x56424efecf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:58.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.980+0000 7f2ab53b7640 1 -- 172.21.15.2:0/4192626897 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56424efdaa20 con 0x56424efe4680 2024-09-19T04:56:58.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.980+0000 7f2ab4bb6640 1 --2- 172.21.15.2:0/4192626897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56424efd94a0 0x56424efecf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:56:58.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.980+0000 7f2aaffff640 1 --2- 172.21.15.2:0/4192626897 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56424efd9dc0 0x56424efe8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:56:58.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.980+0000 7f2ab53b7640 1 --2- 172.21.15.2:0/4192626897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56424efe4680 0x56424efe89f0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8009a30 tx=0x7f2aa800eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9fb2fd30c183c13 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:56:58.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.980+0000 7f2a8ffff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:56:58.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.980+0000 7f2a8ffff640 1 -- 172.21.15.2:0/4192626897 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa8035060 con 0x56424efe4680 2024-09-19T04:56:58.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.980+0000 7f2a8ffff640 1 -- 172.21.15.2:0/4192626897 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7f2aa8005040 con 0x56424efe4680 2024-09-19T04:56:58.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.980+0000 7f2ab91f3740 1 -- 172.21.15.2:0/4192626897 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2aa801f040 con 0x56424efe4680 2024-09-19T04:56:58.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.980+0000 7f2a8ffff640 1 -- 172.21.15.2:0/4192626897 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f2aa801e040 con 0x56424efe4680 2024-09-19T04:56:58.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.980+0000 7f2ab91f3740 10 client.16476 fetch_fsmap learned FSMap version 19 2024-09-19T04:56:58.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.980+0000 7f2ab91f3740 1 -- 172.21.15.2:0/4192626897 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56424f05edc0 con 0x56424efe4680 2024-09-19T04:56:58.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.981+0000 7f2a8ffff640 1 -- 172.21.15.2:0/4192626897 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2aa801f040 con 0x56424efe4680 2024-09-19T04:56:58.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.981+0000 7f2a8ffff640 1 -- 172.21.15.2:0/4192626897 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f2aa8004b50 con 0x56424efe4680 2024-09-19T04:56:58.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.981+0000 7f2ab91f3740 10 client.16476 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:56:58.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.981+0000 7f2ab91f3740 10 client.16476 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:56:58.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.981+0000 7f2ab91f3740 20 client.16476 populate_metadata read hostname 'smithi002' 2024-09-19T04:56:58.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.981+0000 7f2ab91f3740 1 --2- 172.21.15.2:0/4192626897 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56424eff40f0 0x56424f061240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:56:58.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.981+0000 7f2ab91f3740 4 client.16476 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:56:58.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.981+0000 7f2ab91f3740 1 -- 172.21.15.2:0/4192626897 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56424efe1ad0 con 0x56424eff40f0 2024-09-19T04:56:58.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.981+0000 7f2ab4bb6640 1 --2- 172.21.15.2:0/4192626897 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56424eff40f0 0x56424f061240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:56:58.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.982+0000 7f2ab4bb6640 1 --2- 172.21.15.2:0/4192626897 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56424eff40f0 0x56424f061240 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dba3189172bb0057 server_cookie=110b121b17775ff0 in_seq=0 out_seq=0 2024-09-19T04:56:58.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.982+0000 7f2a8ffff640 10 client.16476 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:56:58.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.982+0000 7f2a8ffff640 1 -- 172.21.15.2:0/4192626897 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56424efe1ad0 con 0x56424eff40f0 2024-09-19T04:56:58.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.982+0000 7f2a8ffff640 10 client.16476 handle_command_reply: tid=0 2024-09-19T04:56:58.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.982+0000 7f2ab91f3740 1 client.16476 shutdown 2024-09-19T04:56:58.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.982+0000 7f2ab91f3740 1 -- 172.21.15.2:0/4192626897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56424efe4680 msgr2=0x56424efe89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:58.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.982+0000 7f2ab91f3740 1 --2- 172.21.15.2:0/4192626897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56424efe4680 0x56424efe89f0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8009a30 tx=0x7f2aa800eee0 comp rx=0 tx=0).stop 2024-09-19T04:56:58.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.982+0000 7f2ab91f3740 1 -- 172.21.15.2:0/4192626897 shutdown_connections 2024-09-19T04:56:58.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.982+0000 7f2ab91f3740 1 --2- 172.21.15.2:0/4192626897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56424efe4680 0x56424efe89f0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:58.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.982+0000 7f2ab91f3740 1 --2- 172.21.15.2:0/4192626897 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56424eff40f0 0x56424f061240 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:58.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.982+0000 7f2ab91f3740 1 --2- 172.21.15.2:0/4192626897 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56424efd9dc0 0x56424efe8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:58.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.982+0000 7f2a8ffff640 0 client.16476 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:56:58.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.982+0000 7f2ab91f3740 1 --2- 172.21.15.2:0/4192626897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56424efd94a0 0x56424efecf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:58.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.982+0000 7f2ab91f3740 1 -- 172.21.15.2:0/4192626897 >> 172.21.15.2:0/4192626897 conn(0x56424efd5a30 msgr2=0x56424efd4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:56:58.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.982+0000 7f2ab91f3740 1 -- 172.21.15.2:0/4192626897 shutdown_connections 2024-09-19T04:56:58.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.982+0000 7f2ab91f3740 1 -- 172.21.15.2:0/4192626897 wait complete. 2024-09-19T04:56:58.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.982+0000 7f2ab91f3740 20 client.16476 trim_cache size 0 max 16384 2024-09-19T04:56:58.994 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:56:58.994 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T04:56:58.994 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T04:56:58.994 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:56:58.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.983+0000 7f2ab6e1a640 1 -- 172.21.15.2:0/3034703670 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f2a9c0a3430 msgr2=0x7f2a9c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:58.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.983+0000 7f2ab6e1a640 1 --2- 172.21.15.2:0/3034703670 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f2a9c0a3430 0x7f2a9c0a58f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2a9800abe0 tx=0x7f2a9800a2d0 comp rx=0 tx=0).stop 2024-09-19T04:56:58.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.983+0000 7f2ab6e1a640 1 -- 172.21.15.2:0/3034703670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ab01011e0 msgr2=0x7f2ab01a4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:56:58.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.983+0000 7f2ab6e1a640 1 --2- 172.21.15.2:0/3034703670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ab01011e0 0x7f2ab01a4bb0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f2aa002ade0 tx=0x7f2aa00093d0 comp rx=0 tx=0).stop 2024-09-19T04:56:58.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.983+0000 7f2ab6e1a640 1 -- 172.21.15.2:0/3034703670 shutdown_connections 2024-09-19T04:56:58.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.983+0000 7f2ab6e1a640 1 --2- 172.21.15.2:0/3034703670 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ab0105ec0 0x7f2ab019e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:58.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.983+0000 7f2ab6e1a640 1 --2- 172.21.15.2:0/3034703670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ab01011e0 0x7f2ab01a4bb0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:58.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.983+0000 7f2ab6e1a640 1 --2- 172.21.15.2:0/3034703670 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f2a9c0a3430 0x7f2a9c0a58f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:58.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.983+0000 7f2ab6e1a640 1 --2- 172.21.15.2:0/3034703670 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ab01008c0 0x7f2ab01a4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:56:58.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.983+0000 7f2ab6e1a640 1 -- 172.21.15.2:0/3034703670 >> 172.21.15.2:0/3034703670 conn(0x7f2ab00fc7d0 msgr2=0x7f2ab0103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:56:58.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.983+0000 7f2ab6e1a640 1 -- 172.21.15.2:0/3034703670 shutdown_connections 2024-09-19T04:56:58.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:56:58.983+0000 7f2ab6e1a640 1 -- 172.21.15.2:0/3034703670 wait complete. 2024-09-19T04:56:59.901 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:56:59.901 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:57:00.163 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:57:00.567 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:00 smithi002 ceph-mon[30975]: pgmap v277: 97 pgs: 97 active+clean; 16 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 44 KiB/s wr, 7 op/s 2024-09-19T04:57:00.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.650+0000 7f0b9f149640 1 -- 172.21.15.2:0/707848955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b98101420 msgr2=0x7f0b9810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:00.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.650+0000 7f0b9f149640 1 --2- 172.21.15.2:0/707848955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b98101420 0x7f0b9810d950 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f0b90009cd0 tx=0x7f0b9002a8e0 comp rx=0 tx=0).stop 2024-09-19T04:57:00.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.650+0000 7f0b9f149640 1 -- 172.21.15.2:0/707848955 shutdown_connections 2024-09-19T04:57:00.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.650+0000 7f0b9f149640 1 --2- 172.21.15.2:0/707848955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b98101420 0x7f0b9810d950 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:00.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.650+0000 7f0b9f149640 1 --2- 172.21.15.2:0/707848955 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0b98100a80 0x7f0b98100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:00.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.650+0000 7f0b9f149640 1 --2- 172.21.15.2:0/707848955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b98106a80 0x7f0b98106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:00.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.650+0000 7f0b9f149640 1 -- 172.21.15.2:0/707848955 >> 172.21.15.2:0/707848955 conn(0x7f0b980fc7a0 msgr2=0x7f0b980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:00.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.650+0000 7f0b9f149640 1 -- 172.21.15.2:0/707848955 shutdown_connections 2024-09-19T04:57:00.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.650+0000 7f0b9f149640 1 -- 172.21.15.2:0/707848955 wait complete. 2024-09-19T04:57:00.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.651+0000 7f0b9f149640 1 Processor -- start 2024-09-19T04:57:00.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.651+0000 7f0b9f149640 1 -- start start 2024-09-19T04:57:00.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.651+0000 7f0b9f149640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0b98100a80 0x7f0b981991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:00.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.651+0000 7f0b9f149640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b98101420 0x7f0b98199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:00.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.651+0000 7f0b9f149640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b98106a80 0x7f0b981a4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:00.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.651+0000 7f0b9f149640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0b98110d30 con 0x7f0b98101420 2024-09-19T04:57:00.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.651+0000 7f0b9f149640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0b98110bb0 con 0x7f0b98106a80 2024-09-19T04:57:00.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.651+0000 7f0b9f149640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f0b98110eb0 con 0x7f0b98100a80 2024-09-19T04:57:00.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.651+0000 7f0b97fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b98101420 0x7f0b98199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:00.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.651+0000 7f0b97fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b98101420 0x7f0b98199720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55376/0 (socket says 172.21.15.2:55376) 2024-09-19T04:57:00.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.651+0000 7f0b97fff640 1 -- 172.21.15.2:0/1949366862 learned_addr learned my addr 172.21.15.2:0/1949366862 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:00.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.651+0000 7f0b9cee5640 1 --2- 172.21.15.2:0/1949366862 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0b98100a80 0x7f0b981991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:00.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.651+0000 7f0b9d6e6640 1 --2- 172.21.15.2:0/1949366862 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b98106a80 0x7f0b981a4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:00.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.651+0000 7f0b97fff640 1 -- 172.21.15.2:0/1949366862 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0b98100a80 msgr2=0x7f0b981991e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:00.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.651+0000 7f0b97fff640 1 --2- 172.21.15.2:0/1949366862 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0b98100a80 0x7f0b981991e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:00.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.651+0000 7f0b97fff640 1 -- 172.21.15.2:0/1949366862 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b98106a80 msgr2=0x7f0b981a4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:00.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.651+0000 7f0b97fff640 1 --2- 172.21.15.2:0/1949366862 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b98106a80 0x7f0b981a4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:00.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.651+0000 7f0b97fff640 1 -- 172.21.15.2:0/1949366862 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b981a47a0 con 0x7f0b98101420 2024-09-19T04:57:00.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.652+0000 7f0b97fff640 1 --2- 172.21.15.2:0/1949366862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b98101420 0x7f0b98199720 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f0b8800d770 tx=0x7f0b8800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:00.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.652+0000 7f0b95ffb640 1 -- 172.21.15.2:0/1949366862 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b88017070 con 0x7f0b98101420 2024-09-19T04:57:00.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.652+0000 7f0b95ffb640 1 -- 172.21.15.2:0/1949366862 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0b880054d0 con 0x7f0b98101420 2024-09-19T04:57:00.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.652+0000 7f0b9f149640 1 -- 172.21.15.2:0/1949366862 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b981a4970 con 0x7f0b98101420 2024-09-19T04:57:00.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.652+0000 7f0b95ffb640 1 -- 172.21.15.2:0/1949366862 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b88004cf0 con 0x7f0b98101420 2024-09-19T04:57:00.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.652+0000 7f0b9f149640 1 -- 172.21.15.2:0/1949366862 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b981a4e80 con 0x7f0b98101420 2024-09-19T04:57:00.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.653+0000 7f0b9f149640 1 -- 172.21.15.2:0/1949366862 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b98100ee0 con 0x7f0b98101420 2024-09-19T04:57:00.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.654+0000 7f0b95ffb640 1 -- 172.21.15.2:0/1949366862 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f0b88004e90 con 0x7f0b98101420 2024-09-19T04:57:00.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.655+0000 7f0b95ffb640 1 --2- 172.21.15.2:0/1949366862 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f0b840a3430 0x7f0b840a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:00.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.655+0000 7f0b95ffb640 1 -- 172.21.15.2:0/1949366862 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7f0b880cf710 con 0x7f0b98101420 2024-09-19T04:57:00.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.655+0000 7f0b9cee5640 1 --2- 172.21.15.2:0/1949366862 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f0b840a3430 0x7f0b840a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:00.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.655+0000 7f0b9cee5640 1 --2- 172.21.15.2:0/1949366862 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f0b840a3430 0x7f0b840a58f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0b80009b50 tx=0x7f0b80005f90 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:00.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.659+0000 7f0b95ffb640 1 -- 172.21.15.2:0/1949366862 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0b8809c0f0 con 0x7f0b98101420 2024-09-19T04:57:00.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:00 smithi018 ceph-mon[34537]: pgmap v277: 97 pgs: 97 active+clean; 16 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 44 KiB/s wr, 7 op/s 2024-09-19T04:57:00.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:00 smithi116 ceph-mon[34477]: pgmap v277: 97 pgs: 97 active+clean; 16 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 44 KiB/s wr, 7 op/s 2024-09-19T04:57:00.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.871+0000 7f0b9f149640 1 -- 172.21.15.2:0/1949366862 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0b98108ff0 con 0x7f0b98101420 2024-09-19T04:57:00.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.872+0000 7f0b95ffb640 1 -- 172.21.15.2:0/1949366862 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11840 (secure 0 0 0) 0x7f0b8809b9f0 con 0x7f0b98101420 2024-09-19T04:57:00.873 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:57:00.873 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":19,"btime":"2024-09-19T04:46:33:537239+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2467365137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2467365137},{"type":"v1","addr":"172.21.15.2:6835","nonce":2467365137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3162441888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3162441888},{"type":"v1","addr":"172.21.15.2:6837","nonce":3162441888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14631,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2740862966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2740862966},{"type":"v1","addr":"172.21.15.2:6839","nonce":2740862966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/2394435504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2394435504},{"type":"v1","addr":"172.21.15.2:6841","nonce":2394435504}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1630480244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1630480244},{"type":"v1","addr":"172.21.15.18:6833","nonce":1630480244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1553897465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1553897465},{"type":"v1","addr":"172.21.15.116:6833","nonce":1553897465}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3035664608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3035664608},{"type":"v1","addr":"172.21.15.18:6835","nonce":3035664608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1096622392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1096622392},{"type":"v1","addr":"172.21.15.18:6837","nonce":1096622392}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3761157675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3761157675},{"type":"v1","addr":"172.21.15.116:6835","nonce":3761157675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/1120131594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1120131594},{"type":"v1","addr":"172.21.15.116:6837","nonce":1120131594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:46:24.050115+0000","modified":"2024-09-19T04:46:33.112369+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/4207677139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":4207677139},{"type":"v1","addr":"172.21.15.18:6839","nonce":4207677139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/2346874880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":2346874880},{"type":"v1","addr":"172.21.15.116:6839","nonce":2346874880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496]},"id":1}]} 2024-09-19T04:57:00.874 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 19 2024-09-19T04:57:00.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.874+0000 7f0b9f149640 1 -- 172.21.15.2:0/1949366862 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f0b840a3430 msgr2=0x7f0b840a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:00.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.874+0000 7f0b9f149640 1 --2- 172.21.15.2:0/1949366862 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f0b840a3430 0x7f0b840a58f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0b80009b50 tx=0x7f0b80005f90 comp rx=0 tx=0).stop 2024-09-19T04:57:00.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.874+0000 7f0b9f149640 1 -- 172.21.15.2:0/1949366862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b98101420 msgr2=0x7f0b98199720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:00.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.874+0000 7f0b9f149640 1 --2- 172.21.15.2:0/1949366862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b98101420 0x7f0b98199720 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f0b8800d770 tx=0x7f0b8800dc30 comp rx=0 tx=0).stop 2024-09-19T04:57:00.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.874+0000 7f0b9f149640 1 -- 172.21.15.2:0/1949366862 shutdown_connections 2024-09-19T04:57:00.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.874+0000 7f0b9f149640 1 --2- 172.21.15.2:0/1949366862 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b98106a80 0x7f0b981a4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:00.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.874+0000 7f0b9f149640 1 --2- 172.21.15.2:0/1949366862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b98101420 0x7f0b98199720 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:00.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.874+0000 7f0b9f149640 1 --2- 172.21.15.2:0/1949366862 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f0b840a3430 0x7f0b840a58f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:00.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.874+0000 7f0b9f149640 1 --2- 172.21.15.2:0/1949366862 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0b98100a80 0x7f0b981991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:00.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.874+0000 7f0b9f149640 1 -- 172.21.15.2:0/1949366862 >> 172.21.15.2:0/1949366862 conn(0x7f0b980fc7a0 msgr2=0x7f0b980fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:00.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.874+0000 7f0b9f149640 1 -- 172.21.15.2:0/1949366862 shutdown_connections 2024-09-19T04:57:00.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:00.874+0000 7f0b9f149640 1 -- 172.21.15.2:0/1949366862 wait complete. 2024-09-19T04:57:01.513 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:01 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/1949366862' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:57:01.544 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:57:01.804 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:57:01.806 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:01 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/1949366862' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:57:01.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:01 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/1949366862' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:57:02.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.258+0000 7ff4a45fc640 1 -- 172.21.15.2:0/833955154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff49c103660 msgr2=0x7ff49c10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:02.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.258+0000 7ff4a45fc640 1 --2- 172.21.15.2:0/833955154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff49c103660 0x7ff49c10bb50 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7ff48c009900 tx=0x7ff48c02a480 comp rx=0 tx=0).stop 2024-09-19T04:57:02.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.259+0000 7ff4a45fc640 1 -- 172.21.15.2:0/833955154 shutdown_connections 2024-09-19T04:57:02.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.259+0000 7ff4a45fc640 1 --2- 172.21.15.2:0/833955154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff49c10c170 0x7ff49c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:02.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.259+0000 7ff4a45fc640 1 --2- 172.21.15.2:0/833955154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff49c103660 0x7ff49c10bb50 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:02.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.259+0000 7ff4a45fc640 1 --2- 172.21.15.2:0/833955154 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff49c102d40 0x7ff49c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:02.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.259+0000 7ff4a45fc640 1 -- 172.21.15.2:0/833955154 >> 172.21.15.2:0/833955154 conn(0x7ff49c0fc7a0 msgr2=0x7ff49c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:02.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.259+0000 7ff4a45fc640 1 -- 172.21.15.2:0/833955154 shutdown_connections 2024-09-19T04:57:02.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.259+0000 7ff4a45fc640 1 -- 172.21.15.2:0/833955154 wait complete. 2024-09-19T04:57:02.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.259+0000 7ff4a45fc640 1 Processor -- start 2024-09-19T04:57:02.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.259+0000 7ff4a45fc640 1 -- start start 2024-09-19T04:57:02.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.259+0000 7ff4a45fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff49c102d40 0x7ff49c1984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:02.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.259+0000 7ff4a45fc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff49c103660 0x7ff49c198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:02.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.259+0000 7ff4a45fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff49c10c170 0x7ff49c19cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:02.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.259+0000 7ff4a45fc640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff49c111ee0 con 0x7ff49c10c170 2024-09-19T04:57:02.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.259+0000 7ff4a45fc640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff49c111d60 con 0x7ff49c102d40 2024-09-19T04:57:02.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.259+0000 7ff4a45fc640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7ff49c112060 con 0x7ff49c103660 2024-09-19T04:57:02.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.260+0000 7ff4a2b99640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff49c10c170 0x7ff49c19cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:02.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.260+0000 7ff4a2b99640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff49c10c170 0x7ff49c19cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47530/0 (socket says 172.21.15.2:47530) 2024-09-19T04:57:02.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.260+0000 7ff4a2b99640 1 -- 172.21.15.2:0/1421162876 learned_addr learned my addr 172.21.15.2:0/1421162876 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:02.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.260+0000 7ff4a2398640 1 --2- 172.21.15.2:0/1421162876 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff49c102d40 0x7ff49c1984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:02.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.260+0000 7ff4a1b97640 1 --2- 172.21.15.2:0/1421162876 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff49c103660 0x7ff49c198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:02.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.260+0000 7ff4a2b99640 1 -- 172.21.15.2:0/1421162876 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff49c103660 msgr2=0x7ff49c198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:02.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.260+0000 7ff4a2b99640 1 --2- 172.21.15.2:0/1421162876 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff49c103660 0x7ff49c198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:02.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.260+0000 7ff4a2b99640 1 -- 172.21.15.2:0/1421162876 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff49c102d40 msgr2=0x7ff49c1984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:02.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.260+0000 7ff4a2b99640 1 --2- 172.21.15.2:0/1421162876 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff49c102d40 0x7ff49c1984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:02.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.260+0000 7ff4a2b99640 1 -- 172.21.15.2:0/1421162876 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff49c19d490 con 0x7ff49c10c170 2024-09-19T04:57:02.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.260+0000 7ff4a2b99640 1 --2- 172.21.15.2:0/1421162876 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff49c10c170 0x7ff49c19cdb0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7ff49400b970 tx=0x7ff49400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:02.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.260+0000 7ff4937fe640 1 -- 172.21.15.2:0/1421162876 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff494019070 con 0x7ff49c10c170 2024-09-19T04:57:02.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.260+0000 7ff4937fe640 1 -- 172.21.15.2:0/1421162876 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff494014440 con 0x7ff49c10c170 2024-09-19T04:57:02.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.260+0000 7ff4a45fc640 1 -- 172.21.15.2:0/1421162876 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff49c19d780 con 0x7ff49c10c170 2024-09-19T04:57:02.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.260+0000 7ff4937fe640 1 -- 172.21.15.2:0/1421162876 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4940075d0 con 0x7ff49c10c170 2024-09-19T04:57:02.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.260+0000 7ff4a45fc640 1 -- 172.21.15.2:0/1421162876 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff49c1a5060 con 0x7ff49c10c170 2024-09-19T04:57:02.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.263+0000 7ff4937fe640 1 -- 172.21.15.2:0/1421162876 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7ff49401c070 con 0x7ff49c10c170 2024-09-19T04:57:02.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.263+0000 7ff4a69d5740 1 Processor -- start 2024-09-19T04:57:02.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.263+0000 7ff4a69d5740 1 -- start start 2024-09-19T04:57:02.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.263+0000 7ff4a69d5740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558550559b40 0x558550558090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:02.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.263+0000 7ff4a69d5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585505585d0 0x558550558a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:02.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.263+0000 7ff4a69d5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558550563370 0x558550565760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:02.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.263+0000 7ff4a69d5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5585504be2f0 con 0x558550563370 2024-09-19T04:57:02.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.263+0000 7ff4a69d5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558550465cf0 con 0x5585505585d0 2024-09-19T04:57:02.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.263+0000 7ff4a69d5740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5585504ba2b0 con 0x558550559b40 2024-09-19T04:57:02.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.264+0000 7ff4a1b97640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558550563370 0x558550565760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:02.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.264+0000 7ff4937fe640 1 --2- 172.21.15.2:0/1421162876 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7ff4880a33b0 0x7ff4880a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:02.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.264+0000 7ff4a1b97640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558550563370 0x558550565760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47534/0 (socket says 172.21.15.2:47534) 2024-09-19T04:57:02.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.264+0000 7ff4a1b97640 1 -- 172.21.15.2:0/3548599090 learned_addr learned my addr 172.21.15.2:0/3548599090 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:02.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.264+0000 7ff4a2398640 1 --2- 172.21.15.2:0/3548599090 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585505585d0 0x558550558a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:02.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.264+0000 7ff4a2b99640 1 --2- 172.21.15.2:0/1421162876 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7ff4880a33b0 0x7ff4880a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:02.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.264+0000 7ff4a1b97640 1 --2- 172.21.15.2:0/3548599090 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558550559b40 0x558550558090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:02.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.264+0000 7ff4937fe640 1 -- 172.21.15.2:0/1421162876 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7ff4940cf1d0 con 0x7ff49c10c170 2024-09-19T04:57:02.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.264+0000 7ff4a1b97640 1 -- 172.21.15.2:0/3548599090 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558550559b40 msgr2=0x558550558090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:02.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.264+0000 7ff4a1b97640 1 --2- 172.21.15.2:0/3548599090 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558550559b40 0x558550558090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:02.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.264+0000 7ff4a1b97640 1 -- 172.21.15.2:0/3548599090 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585505585d0 msgr2=0x558550558a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:02.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.264+0000 7ff4a1b97640 1 --2- 172.21.15.2:0/3548599090 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585505585d0 0x558550558a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:02.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.264+0000 7ff4a1b97640 1 -- 172.21.15.2:0/3548599090 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55855044a3a0 con 0x558550563370 2024-09-19T04:57:02.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.264+0000 7ff4a1b97640 1 --2- 172.21.15.2:0/3548599090 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558550563370 0x558550565760 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7ff48c005940 tx=0x7ff48c0058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18829b906b5c4410 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:02.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.264+0000 7ff4a2b99640 1 --2- 172.21.15.2:0/1421162876 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7ff4880a33b0 0x7ff4880a5870 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff4940ccae0 tx=0x7ff49400e040 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:02.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.264+0000 7ff490ff9640 1 -- 172.21.15.2:0/3548599090 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff48c035040 con 0x558550563370 2024-09-19T04:57:02.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.264+0000 7ff490ff9640 1 -- 172.21.15.2:0/3548599090 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff48c004030 con 0x558550563370 2024-09-19T04:57:02.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.264+0000 7ff490ff9640 1 -- 172.21.15.2:0/3548599090 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff48c0047a0 con 0x558550563370 2024-09-19T04:57:02.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.265+0000 7ff4a69d5740 1 -- 172.21.15.2:0/3548599090 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558550563370 msgr2=0x558550565760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:02.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.265+0000 7ff4a69d5740 1 --2- 172.21.15.2:0/3548599090 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558550563370 0x558550565760 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7ff48c005940 tx=0x7ff48c0058b0 comp rx=0 tx=0).stop 2024-09-19T04:57:02.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.265+0000 7ff4a69d5740 1 -- 172.21.15.2:0/3548599090 shutdown_connections 2024-09-19T04:57:02.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.265+0000 7ff4a69d5740 1 --2- 172.21.15.2:0/3548599090 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558550563370 0x558550565760 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:02.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.265+0000 7ff4a69d5740 1 --2- 172.21.15.2:0/3548599090 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585505585d0 0x558550558a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:02.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.265+0000 7ff4a69d5740 1 --2- 172.21.15.2:0/3548599090 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558550559b40 0x558550558090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:02.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.265+0000 7ff4a69d5740 1 -- 172.21.15.2:0/3548599090 >> 172.21.15.2:0/3548599090 conn(0x558550521310 msgr2=0x558550554c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:02.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.265+0000 7ff4a69d5740 1 -- 172.21.15.2:0/3548599090 shutdown_connections 2024-09-19T04:57:02.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.265+0000 7ff4a69d5740 1 -- 172.21.15.2:0/3548599090 wait complete. 2024-09-19T04:57:02.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.266+0000 7ff4a69d5740 1 -- start start 2024-09-19T04:57:02.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.266+0000 7ff4a69d5740 1 Processor -- start 2024-09-19T04:57:02.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.266+0000 7ff4a69d5740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5585505585d0 0x558550562dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:02.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.266+0000 7ff4a69d5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558550559b40 0x558550560070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:02.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.266+0000 7ff4a69d5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558550563370 0x558550560800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:02.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.266+0000 7ff4a69d5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558550566010 con 0x558550559b40 2024-09-19T04:57:02.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.266+0000 7ff4a69d5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558550479060 con 0x558550563370 2024-09-19T04:57:02.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.266+0000 7ff4a69d5740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x558550566190 con 0x5585505585d0 2024-09-19T04:57:02.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.266+0000 7ff4a69d5740 10 client.0 _ll_register_callbacks cb 0x5585501cc8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:57:02.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.266+0000 7ff4a2398640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558550559b40 0x558550560070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:02.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.266+0000 7ff4a2398640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558550559b40 0x558550560070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47536/0 (socket says 172.21.15.2:47536) 2024-09-19T04:57:02.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.266+0000 7ff4a2398640 1 -- 172.21.15.2:0/395992749 learned_addr learned my addr 172.21.15.2:0/395992749 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:02.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.266+0000 7ff4a1b97640 1 --2- 172.21.15.2:0/395992749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558550563370 0x558550560800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:02.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.266+0000 7ff4a1b97640 1 --2- 172.21.15.2:0/395992749 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5585505585d0 0x558550562dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:02.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.267+0000 7ff4a2398640 1 -- 172.21.15.2:0/395992749 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5585505585d0 msgr2=0x558550562dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:02.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.267+0000 7ff4a2398640 1 --2- 172.21.15.2:0/395992749 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5585505585d0 0x558550562dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:02.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.267+0000 7ff4a2398640 1 -- 172.21.15.2:0/395992749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558550563370 msgr2=0x558550560800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:02.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.267+0000 7ff4a2398640 1 --2- 172.21.15.2:0/395992749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558550563370 0x558550560800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:02.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.267+0000 7ff4a2398640 1 -- 172.21.15.2:0/395992749 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55855022f3c0 con 0x558550559b40 2024-09-19T04:57:02.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.267+0000 7ff4a2398640 1 --2- 172.21.15.2:0/395992749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558550559b40 0x558550560070 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7ff498011540 tx=0x7ff498011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2708be34c1ddcc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:02.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.267+0000 7ff485ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:57:02.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.267+0000 7ff485ffb640 1 -- 172.21.15.2:0/395992749 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff49800f6d0 con 0x558550559b40 2024-09-19T04:57:02.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.267+0000 7ff485ffb640 1 -- 172.21.15.2:0/395992749 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7ff49800f870 con 0x558550559b40 2024-09-19T04:57:02.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.267+0000 7ff4a69d5740 1 -- 172.21.15.2:0/395992749 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff48c004030 con 0x558550559b40 2024-09-19T04:57:02.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.267+0000 7ff485ffb640 1 -- 172.21.15.2:0/395992749 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff49800fab0 con 0x558550559b40 2024-09-19T04:57:02.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.267+0000 7ff4a69d5740 10 client.16494 fetch_fsmap learned FSMap version 19 2024-09-19T04:57:02.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.267+0000 7ff4a69d5740 1 -- 172.21.15.2:0/395992749 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x558550571b80 con 0x558550559b40 2024-09-19T04:57:02.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.267+0000 7ff485ffb640 1 -- 172.21.15.2:0/395992749 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff48c004030 con 0x558550559b40 2024-09-19T04:57:02.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.267+0000 7ff485ffb640 1 -- 172.21.15.2:0/395992749 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ff49801d400 con 0x558550559b40 2024-09-19T04:57:02.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.268+0000 7ff4a69d5740 10 client.16494 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:57:02.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.268+0000 7ff4a69d5740 10 client.16494 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:57:02.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.268+0000 7ff4a69d5740 20 client.16494 populate_metadata read hostname 'smithi002' 2024-09-19T04:57:02.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.268+0000 7ff4a69d5740 1 --2- 172.21.15.2:0/395992749 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558550573090 0x5585505754b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:02.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.268+0000 7ff4a69d5740 4 client.16494 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:57:02.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.268+0000 7ff4a69d5740 1 -- 172.21.15.2:0/395992749 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5585504cb860 con 0x558550573090 2024-09-19T04:57:02.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.268+0000 7ff4a1b97640 1 --2- 172.21.15.2:0/395992749 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558550573090 0x5585505754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:02.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.268+0000 7ff4a1b97640 1 --2- 172.21.15.2:0/395992749 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558550573090 0x5585505754b0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e546e54c8dd82aee server_cookie=f11615b47d816d1b in_seq=0 out_seq=0 2024-09-19T04:57:02.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.268+0000 7ff485ffb640 10 client.16494 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:57:02.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.269+0000 7ff485ffb640 1 -- 172.21.15.2:0/395992749 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5585504cb860 con 0x558550573090 2024-09-19T04:57:02.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.269+0000 7ff485ffb640 10 client.16494 handle_command_reply: tid=0 2024-09-19T04:57:02.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.269+0000 7ff4a69d5740 1 client.16494 shutdown 2024-09-19T04:57:02.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.269+0000 7ff4a69d5740 1 -- 172.21.15.2:0/395992749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558550559b40 msgr2=0x558550560070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:02.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.269+0000 7ff4a69d5740 1 --2- 172.21.15.2:0/395992749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558550559b40 0x558550560070 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7ff498011540 tx=0x7ff498011a00 comp rx=0 tx=0).stop 2024-09-19T04:57:02.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.269+0000 7ff4a69d5740 1 -- 172.21.15.2:0/395992749 shutdown_connections 2024-09-19T04:57:02.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.269+0000 7ff4a69d5740 1 --2- 172.21.15.2:0/395992749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558550563370 0x558550560800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:02.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.269+0000 7ff4a69d5740 1 --2- 172.21.15.2:0/395992749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558550559b40 0x558550560070 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:02.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.269+0000 7ff4a69d5740 1 --2- 172.21.15.2:0/395992749 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558550573090 0x5585505754b0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:02.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.269+0000 7ff4a69d5740 1 --2- 172.21.15.2:0/395992749 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5585505585d0 0x558550562dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:02.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.269+0000 7ff485ffb640 0 client.16494 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:57:02.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.269+0000 7ff4a69d5740 1 -- 172.21.15.2:0/395992749 >> 172.21.15.2:0/395992749 conn(0x558550521310 msgr2=0x55855055a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:02.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.269+0000 7ff4a69d5740 1 -- 172.21.15.2:0/395992749 shutdown_connections 2024-09-19T04:57:02.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.269+0000 7ff4a69d5740 1 -- 172.21.15.2:0/395992749 wait complete. 2024-09-19T04:57:02.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.269+0000 7ff4a69d5740 20 client.16494 trim_cache size 0 max 16384 2024-09-19T04:57:02.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.282+0000 7ff4a69d5740 1 Processor -- start 2024-09-19T04:57:02.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.282+0000 7ff4a69d5740 1 -- start start 2024-09-19T04:57:02.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.282+0000 7ff4a69d5740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5585505585d0 0x558550559300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:02.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.282+0000 7ff4a69d5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558550559b40 0x55855055f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:02.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.282+0000 7ff4a69d5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558550563370 0x55855057ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:02.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.282+0000 7ff4a69d5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff49c1ab7d0 con 0x558550563370 2024-09-19T04:57:02.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.282+0000 7ff4a69d5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff49c1ae030 con 0x558550559b40 2024-09-19T04:57:02.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.282+0000 7ff4a69d5740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7ff49c1abe20 con 0x5585505585d0 2024-09-19T04:57:02.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.282+0000 7ff4a1b97640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558550563370 0x55855057ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:02.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.283+0000 7ff4a1b97640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558550563370 0x55855057ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47538/0 (socket says 172.21.15.2:47538) 2024-09-19T04:57:02.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.283+0000 7ff4a1b97640 1 -- 172.21.15.2:0/346625313 learned_addr learned my addr 172.21.15.2:0/346625313 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:02.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.283+0000 7ff4a2398640 1 --2- 172.21.15.2:0/346625313 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558550559b40 0x55855055f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:02.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.283+0000 7ff4a1b97640 1 --2- 172.21.15.2:0/346625313 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5585505585d0 0x558550559300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:02.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.283+0000 7ff4a1b97640 1 -- 172.21.15.2:0/346625313 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5585505585d0 msgr2=0x558550559300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:02.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.283+0000 7ff4a1b97640 1 --2- 172.21.15.2:0/346625313 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5585505585d0 0x558550559300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:02.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.283+0000 7ff4a1b97640 1 -- 172.21.15.2:0/346625313 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558550559b40 msgr2=0x55855055f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:02.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.283+0000 7ff4a1b97640 1 --2- 172.21.15.2:0/346625313 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558550559b40 0x55855055f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:02.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.283+0000 7ff4a1b97640 1 -- 172.21.15.2:0/346625313 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558550563130 con 0x558550563370 2024-09-19T04:57:02.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.283+0000 7ff4a1b97640 1 --2- 172.21.15.2:0/346625313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558550563370 0x55855057ad60 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7ff48c009850 tx=0x7ff48c03f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cac56fcda56b66 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:02.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.283+0000 7ff487fff640 1 -- 172.21.15.2:0/346625313 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff48c035040 con 0x558550563370 2024-09-19T04:57:02.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.283+0000 7ff487fff640 1 -- 172.21.15.2:0/346625313 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff48c004c50 con 0x558550563370 2024-09-19T04:57:02.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.283+0000 7ff487fff640 1 -- 172.21.15.2:0/346625313 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff48c0035f0 con 0x558550563370 2024-09-19T04:57:02.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.284+0000 7ff4a69d5740 1 -- 172.21.15.2:0/346625313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558550563370 msgr2=0x55855057ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:02.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.284+0000 7ff4a69d5740 1 --2- 172.21.15.2:0/346625313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558550563370 0x55855057ad60 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7ff48c009850 tx=0x7ff48c03f040 comp rx=0 tx=0).stop 2024-09-19T04:57:02.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.284+0000 7ff4a69d5740 1 -- 172.21.15.2:0/346625313 shutdown_connections 2024-09-19T04:57:02.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.284+0000 7ff4a69d5740 1 --2- 172.21.15.2:0/346625313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558550563370 0x55855057ad60 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:02.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.284+0000 7ff4a69d5740 1 --2- 172.21.15.2:0/346625313 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558550559b40 0x55855055f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:02.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.284+0000 7ff4a69d5740 1 --2- 172.21.15.2:0/346625313 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5585505585d0 0x558550559300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:02.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.284+0000 7ff4a69d5740 1 -- 172.21.15.2:0/346625313 >> 172.21.15.2:0/346625313 conn(0x558550521310 msgr2=0x55855055e940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:02.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.284+0000 7ff4a69d5740 1 -- 172.21.15.2:0/346625313 shutdown_connections 2024-09-19T04:57:02.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.284+0000 7ff4a69d5740 1 -- 172.21.15.2:0/346625313 wait complete. 2024-09-19T04:57:02.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.284+0000 7ff4a69d5740 1 -- start start 2024-09-19T04:57:02.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.284+0000 7ff4a69d5740 1 Processor -- start 2024-09-19T04:57:02.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.284+0000 7ff4a69d5740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5585505585d0 0x55855056bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:02.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.285+0000 7ff4a69d5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558550559b40 0x55855055ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:02.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.285+0000 7ff4a69d5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558550563370 0x55855055d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:02.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.285+0000 7ff4a69d5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff49c1ac4f0 con 0x558550563370 2024-09-19T04:57:02.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.285+0000 7ff4a69d5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff49c1ad960 con 0x558550559b40 2024-09-19T04:57:02.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.285+0000 7ff4a69d5740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7ff49c1acbc0 con 0x5585505585d0 2024-09-19T04:57:02.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.285+0000 7ff4a69d5740 10 client.0 _ll_register_callbacks cb 0x7ff498009590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:57:02.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.285+0000 7ff4a1b97640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558550563370 0x55855055d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:02.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.285+0000 7ff4a1b97640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558550563370 0x55855055d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47540/0 (socket says 172.21.15.2:47540) 2024-09-19T04:57:02.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.285+0000 7ff4a1b97640 1 -- 172.21.15.2:0/1716072646 learned_addr learned my addr 172.21.15.2:0/1716072646 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:02.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.285+0000 7ff4a2398640 1 --2- 172.21.15.2:0/1716072646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558550559b40 0x55855055ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:02.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.285+0000 7ff4a1b97640 1 --2- 172.21.15.2:0/1716072646 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5585505585d0 0x55855056bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:02.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.285+0000 7ff4a1b97640 1 -- 172.21.15.2:0/1716072646 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5585505585d0 msgr2=0x55855056bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:02.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.285+0000 7ff4a1b97640 1 --2- 172.21.15.2:0/1716072646 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5585505585d0 0x55855056bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:02.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.285+0000 7ff4a1b97640 1 -- 172.21.15.2:0/1716072646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558550559b40 msgr2=0x55855055ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:02.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.285+0000 7ff4a1b97640 1 --2- 172.21.15.2:0/1716072646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558550559b40 0x55855055ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:02.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.285+0000 7ff4a1b97640 1 -- 172.21.15.2:0/1716072646 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55855055db80 con 0x558550563370 2024-09-19T04:57:02.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.285+0000 7ff4a2398640 1 --2- 172.21.15.2:0/1716072646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558550559b40 0x55855055ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:57:02.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.285+0000 7ff4a1b97640 1 --2- 172.21.15.2:0/1716072646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558550563370 0x55855055d380 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7ff48c0059d0 tx=0x7ff48c05b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=889ee765ce5a2b85 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:02.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.285+0000 7ff485ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:57:02.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.285+0000 7ff485ffb640 1 -- 172.21.15.2:0/1716072646 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff48c04c070 con 0x558550563370 2024-09-19T04:57:02.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.285+0000 7ff485ffb640 1 -- 172.21.15.2:0/1716072646 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7ff48c05f070 con 0x558550563370 2024-09-19T04:57:02.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.285+0000 7ff4a69d5740 1 -- 172.21.15.2:0/1716072646 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff48c004c50 con 0x558550563370 2024-09-19T04:57:02.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.286+0000 7ff485ffb640 1 -- 172.21.15.2:0/1716072646 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff48c035070 con 0x558550563370 2024-09-19T04:57:02.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.286+0000 7ff4a69d5740 10 client.16500 fetch_fsmap learned FSMap version 19 2024-09-19T04:57:02.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.286+0000 7ff4a69d5740 1 -- 172.21.15.2:0/1716072646 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5585505e2170 con 0x558550563370 2024-09-19T04:57:02.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.286+0000 7ff485ffb640 1 -- 172.21.15.2:0/1716072646 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff48c004c50 con 0x558550563370 2024-09-19T04:57:02.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.286+0000 7ff485ffb640 1 -- 172.21.15.2:0/1716072646 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ff48c065040 con 0x558550563370 2024-09-19T04:57:02.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.286+0000 7ff4a69d5740 10 client.16500 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:57:02.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.286+0000 7ff4a69d5740 10 client.16500 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:57:02.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.286+0000 7ff4a69d5740 20 client.16500 populate_metadata read hostname 'smithi002' 2024-09-19T04:57:02.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.286+0000 7ff4a69d5740 1 --2- 172.21.15.2:0/1716072646 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5585505e23a0 0x5585505e4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:02.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.286+0000 7ff4a69d5740 4 client.16500 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:57:02.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.286+0000 7ff4a69d5740 1 -- 172.21.15.2:0/1716072646 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5585504c5d70 con 0x5585505e23a0 2024-09-19T04:57:02.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.286+0000 7ff4a2398640 1 --2- 172.21.15.2:0/1716072646 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5585505e23a0 0x5585505e4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:02.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.287+0000 7ff4a2398640 1 --2- 172.21.15.2:0/1716072646 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5585505e23a0 0x5585505e4790 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97dea6dcd5c1ba35 server_cookie=b071e612c9aafcac in_seq=0 out_seq=0 2024-09-19T04:57:02.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.287+0000 7ff485ffb640 10 client.16500 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:57:02.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.287+0000 7ff485ffb640 1 -- 172.21.15.2:0/1716072646 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5585504c5d70 con 0x5585505e23a0 2024-09-19T04:57:02.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.287+0000 7ff485ffb640 10 client.16500 handle_command_reply: tid=0 2024-09-19T04:57:02.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.287+0000 7ff4a69d5740 1 client.16500 shutdown 2024-09-19T04:57:02.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.287+0000 7ff4a69d5740 1 -- 172.21.15.2:0/1716072646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558550563370 msgr2=0x55855055d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:02.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.287+0000 7ff4a69d5740 1 --2- 172.21.15.2:0/1716072646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558550563370 0x55855055d380 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7ff48c0059d0 tx=0x7ff48c05b040 comp rx=0 tx=0).stop 2024-09-19T04:57:02.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.287+0000 7ff4a69d5740 1 -- 172.21.15.2:0/1716072646 shutdown_connections 2024-09-19T04:57:02.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.287+0000 7ff4a69d5740 1 --2- 172.21.15.2:0/1716072646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558550563370 0x55855055d380 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:02.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.287+0000 7ff4a69d5740 1 --2- 172.21.15.2:0/1716072646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558550559b40 0x55855055ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:02.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.287+0000 7ff4a69d5740 1 --2- 172.21.15.2:0/1716072646 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5585505e23a0 0x5585505e4790 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:02.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.287+0000 7ff4a69d5740 1 --2- 172.21.15.2:0/1716072646 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5585505585d0 0x55855056bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:02.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.287+0000 7ff485ffb640 0 client.16500 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:57:02.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.287+0000 7ff4a69d5740 1 -- 172.21.15.2:0/1716072646 >> 172.21.15.2:0/1716072646 conn(0x558550521310 msgr2=0x55855055f160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:02.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.287+0000 7ff4a69d5740 1 -- 172.21.15.2:0/1716072646 shutdown_connections 2024-09-19T04:57:02.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.287+0000 7ff4a69d5740 1 -- 172.21.15.2:0/1716072646 wait complete. 2024-09-19T04:57:02.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.287+0000 7ff4a69d5740 20 client.16500 trim_cache size 0 max 16384 2024-09-19T04:57:02.305 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T04:57:02.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.288+0000 7ff4a45fc640 1 -- 172.21.15.2:0/1421162876 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7ff4880a33b0 msgr2=0x7ff4880a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:02.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.288+0000 7ff4a45fc640 1 --2- 172.21.15.2:0/1421162876 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7ff4880a33b0 0x7ff4880a5870 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff4940ccae0 tx=0x7ff49400e040 comp rx=0 tx=0).stop 2024-09-19T04:57:02.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.288+0000 7ff4a45fc640 1 -- 172.21.15.2:0/1421162876 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff49c10c170 msgr2=0x7ff49c19cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:02.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.288+0000 7ff4a45fc640 1 --2- 172.21.15.2:0/1421162876 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff49c10c170 0x7ff49c19cdb0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7ff49400b970 tx=0x7ff49400bd70 comp rx=0 tx=0).stop 2024-09-19T04:57:02.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.288+0000 7ff4a45fc640 1 -- 172.21.15.2:0/1421162876 shutdown_connections 2024-09-19T04:57:02.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.288+0000 7ff4a45fc640 1 --2- 172.21.15.2:0/1421162876 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff49c10c170 0x7ff49c19cdb0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:02.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.288+0000 7ff4a45fc640 1 --2- 172.21.15.2:0/1421162876 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7ff4880a33b0 0x7ff4880a5870 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:02.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.288+0000 7ff4a45fc640 1 --2- 172.21.15.2:0/1421162876 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff49c103660 0x7ff49c198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:02.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.288+0000 7ff4a45fc640 1 --2- 172.21.15.2:0/1421162876 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff49c102d40 0x7ff49c1984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:02.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.288+0000 7ff4a45fc640 1 -- 172.21.15.2:0/1421162876 >> 172.21.15.2:0/1421162876 conn(0x7ff49c0fc7a0 msgr2=0x7ff49c0fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:02.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.288+0000 7ff4a45fc640 1 -- 172.21.15.2:0/1421162876 shutdown_connections 2024-09-19T04:57:02.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:02.288+0000 7ff4a45fc640 1 -- 172.21.15.2:0/1421162876 wait complete. 2024-09-19T04:57:02.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:02 smithi002 ceph-mon[30975]: pgmap v278: 97 pgs: 97 active+clean; 16 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 64 KiB/s wr, 10 op/s 2024-09-19T04:57:02.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:02 smithi018 ceph-mon[34537]: pgmap v278: 97 pgs: 97 active+clean; 16 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 64 KiB/s wr, 10 op/s 2024-09-19T04:57:02.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:02 smithi116 ceph-mon[34477]: pgmap v278: 97 pgs: 97 active+clean; 16 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 64 KiB/s wr, 10 op/s 2024-09-19T04:57:04.038 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:57:04.039 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:57:04.311 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:57:04.699 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:04 smithi002 ceph-mon[30975]: pgmap v279: 97 pgs: 97 active+clean; 16 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 44 KiB/s wr, 7 op/s 2024-09-19T04:57:04.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:04 smithi018 ceph-mon[34537]: pgmap v279: 97 pgs: 97 active+clean; 16 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 44 KiB/s wr, 7 op/s 2024-09-19T04:57:04.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.784+0000 7fd87f10f640 1 -- 172.21.15.2:0/3782483261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd878100e20 msgr2=0x7fd878101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:04.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.784+0000 7fd87f10f640 1 --2- 172.21.15.2:0/3782483261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd878100e20 0x7fd878101200 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fd868009900 tx=0x7fd86802a480 comp rx=0 tx=0).stop 2024-09-19T04:57:04.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.784+0000 7fd87f10f640 1 -- 172.21.15.2:0/3782483261 shutdown_connections 2024-09-19T04:57:04.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.784+0000 7fd87f10f640 1 --2- 172.21.15.2:0/3782483261 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd878102ef0 0x7fd87810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:04.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.784+0000 7fd87f10f640 1 --2- 172.21.15.2:0/3782483261 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd878102570 0x7fd8781029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:04.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.784+0000 7fd87f10f640 1 --2- 172.21.15.2:0/3782483261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd878100e20 0x7fd878101200 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:04.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.784+0000 7fd87f10f640 1 -- 172.21.15.2:0/3782483261 >> 172.21.15.2:0/3782483261 conn(0x7fd8780fc7d0 msgr2=0x7fd8780febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:04.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.784+0000 7fd87f10f640 1 -- 172.21.15.2:0/3782483261 shutdown_connections 2024-09-19T04:57:04.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.784+0000 7fd87f10f640 1 -- 172.21.15.2:0/3782483261 wait complete. 2024-09-19T04:57:04.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.784+0000 7fd87f10f640 1 Processor -- start 2024-09-19T04:57:04.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.784+0000 7fd87f10f640 1 -- start start 2024-09-19T04:57:04.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.785+0000 7fd87f10f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd878100e20 0x7fd878103d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:04.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.785+0000 7fd87f10f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd878102570 0x7fd878104250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:04.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.785+0000 7fd87f10f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd878102ef0 0x7fd878104790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:04.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.785+0000 7fd87f10f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd878110e30 con 0x7fd878102570 2024-09-19T04:57:04.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.785+0000 7fd87f10f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd878110cb0 con 0x7fd878100e20 2024-09-19T04:57:04.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.785+0000 7fd87f10f640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fd878110fb0 con 0x7fd878102ef0 2024-09-19T04:57:04.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.785+0000 7fd877fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd878102570 0x7fd878104250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:04.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.785+0000 7fd877fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd878102570 0x7fd878104250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47550/0 (socket says 172.21.15.2:47550) 2024-09-19T04:57:04.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.785+0000 7fd877fff640 1 -- 172.21.15.2:0/124470513 learned_addr learned my addr 172.21.15.2:0/124470513 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:04.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.785+0000 7fd87ceab640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd878100e20 0x7fd878103d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:04.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.785+0000 7fd87d6ac640 1 --2- 172.21.15.2:0/124470513 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd878102ef0 0x7fd878104790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:04.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.785+0000 7fd877fff640 1 -- 172.21.15.2:0/124470513 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd878102ef0 msgr2=0x7fd878104790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:04.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.785+0000 7fd877fff640 1 --2- 172.21.15.2:0/124470513 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd878102ef0 0x7fd878104790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:04.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.785+0000 7fd877fff640 1 -- 172.21.15.2:0/124470513 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd878100e20 msgr2=0x7fd878103d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:04.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.785+0000 7fd877fff640 1 --2- 172.21.15.2:0/124470513 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd878100e20 0x7fd878103d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:04.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.785+0000 7fd877fff640 1 -- 172.21.15.2:0/124470513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8781a68f0 con 0x7fd878102570 2024-09-19T04:57:04.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.785+0000 7fd877fff640 1 --2- 172.21.15.2:0/124470513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd878102570 0x7fd878104250 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fd86000d950 tx=0x7fd86000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:04.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.785+0000 7fd875ffb640 1 -- 172.21.15.2:0/124470513 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd860017070 con 0x7fd878102570 2024-09-19T04:57:04.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.785+0000 7fd875ffb640 1 -- 172.21.15.2:0/124470513 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd860009c30 con 0x7fd878102570 2024-09-19T04:57:04.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.785+0000 7fd875ffb640 1 -- 172.21.15.2:0/124470513 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd86000f620 con 0x7fd878102570 2024-09-19T04:57:04.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.785+0000 7fd87f10f640 1 -- 172.21.15.2:0/124470513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8781a6be0 con 0x7fd878102570 2024-09-19T04:57:04.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.786+0000 7fd87f10f640 1 -- 172.21.15.2:0/124470513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8781a7170 con 0x7fd878102570 2024-09-19T04:57:04.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.788+0000 7fd875ffb640 1 -- 172.21.15.2:0/124470513 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fd8600109a0 con 0x7fd878102570 2024-09-19T04:57:04.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.788+0000 7fd8814e8740 1 Processor -- start 2024-09-19T04:57:04.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.788+0000 7fd8814e8740 1 -- start start 2024-09-19T04:57:04.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.788+0000 7fd8814e8740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f3eb101b60 0x55f3eb101f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:04.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.788+0000 7fd8814e8740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f3eb102480 0x55f3eb10c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:04.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.788+0000 7fd875ffb640 1 --2- 172.21.15.2:0/124470513 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fd8640a3430 0x7fd8640a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:04.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.788+0000 7fd8814e8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3eb10cd40 0x55f3eb10f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:04.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.788+0000 7fd8814e8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f3eb067280 con 0x55f3eb10cd40 2024-09-19T04:57:04.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.788+0000 7fd8814e8740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f3eb00eb10 con 0x55f3eb101b60 2024-09-19T04:57:04.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.788+0000 7fd8814e8740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55f3eb063240 con 0x55f3eb102480 2024-09-19T04:57:04.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.789+0000 7fd87d6ac640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3eb10cd40 0x55f3eb10f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:04.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.789+0000 7fd877fff640 1 --2- 172.21.15.2:0/124470513 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fd8640a3430 0x7fd8640a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:04.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.789+0000 7fd87d6ac640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3eb10cd40 0x55f3eb10f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47556/0 (socket says 172.21.15.2:47556) 2024-09-19T04:57:04.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.789+0000 7fd87d6ac640 1 -- 172.21.15.2:0/3166929480 learned_addr learned my addr 172.21.15.2:0/3166929480 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:04.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.789+0000 7fd875ffb640 1 -- 172.21.15.2:0/124470513 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7fd8600cf890 con 0x7fd878102570 2024-09-19T04:57:04.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.789+0000 7fd87d6ac640 1 --2- 172.21.15.2:0/3166929480 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f3eb101b60 0x55f3eb101f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:04.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.789+0000 7fd87ceab640 1 --2- 172.21.15.2:0/3166929480 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f3eb102480 0x55f3eb10c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:04.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.789+0000 7fd87d6ac640 1 -- 172.21.15.2:0/3166929480 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f3eb102480 msgr2=0x55f3eb10c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:04.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.789+0000 7fd87d6ac640 1 --2- 172.21.15.2:0/3166929480 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f3eb102480 0x55f3eb10c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:04.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.789+0000 7fd87d6ac640 1 -- 172.21.15.2:0/3166929480 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f3eb101b60 msgr2=0x55f3eb101f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:04.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.789+0000 7fd87d6ac640 1 --2- 172.21.15.2:0/3166929480 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f3eb101b60 0x55f3eb101f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:04.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.789+0000 7fd87d6ac640 1 -- 172.21.15.2:0/3166929480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3eb01b1f0 con 0x55f3eb10cd40 2024-09-19T04:57:04.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.789+0000 7fd87ceab640 1 --2- 172.21.15.2:0/3166929480 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f3eb102480 0x55f3eb10c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:57:04.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.789+0000 7fd87d6ac640 1 --2- 172.21.15.2:0/3166929480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3eb10cd40 0x55f3eb10f130 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fd870012a20 tx=0x7fd870009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=babfe7a42f04efcd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:04.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.789+0000 7fd877fff640 1 --2- 172.21.15.2:0/124470513 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fd8640a3430 0x7fd8640a58f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd86009bb50 tx=0x7fd8600665b0 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:04.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.789+0000 7fd86effd640 1 -- 172.21.15.2:0/3166929480 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd870004b20 con 0x55f3eb10cd40 2024-09-19T04:57:04.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.789+0000 7fd86effd640 1 -- 172.21.15.2:0/3166929480 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd870003e20 con 0x55f3eb10cd40 2024-09-19T04:57:04.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.789+0000 7fd86effd640 1 -- 172.21.15.2:0/3166929480 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd870004030 con 0x55f3eb10cd40 2024-09-19T04:57:04.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.790+0000 7fd8814e8740 1 -- 172.21.15.2:0/3166929480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3eb10cd40 msgr2=0x55f3eb10f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:04.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.790+0000 7fd8814e8740 1 --2- 172.21.15.2:0/3166929480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3eb10cd40 0x55f3eb10f130 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fd870012a20 tx=0x7fd870009a50 comp rx=0 tx=0).stop 2024-09-19T04:57:04.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.790+0000 7fd8814e8740 1 -- 172.21.15.2:0/3166929480 shutdown_connections 2024-09-19T04:57:04.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.790+0000 7fd8814e8740 1 --2- 172.21.15.2:0/3166929480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3eb10cd40 0x55f3eb10f130 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:04.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.790+0000 7fd8814e8740 1 --2- 172.21.15.2:0/3166929480 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f3eb102480 0x55f3eb10c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:04.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.790+0000 7fd8814e8740 1 --2- 172.21.15.2:0/3166929480 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f3eb101b60 0x55f3eb101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:04.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.790+0000 7fd8814e8740 1 -- 172.21.15.2:0/3166929480 >> 172.21.15.2:0/3166929480 conn(0x55f3eb0fe0f0 msgr2=0x55f3eb0fe4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:04.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.790+0000 7fd8814e8740 1 -- 172.21.15.2:0/3166929480 shutdown_connections 2024-09-19T04:57:04.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.790+0000 7fd8814e8740 1 -- 172.21.15.2:0/3166929480 wait complete. 2024-09-19T04:57:04.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.791+0000 7fd8814e8740 1 -- start start 2024-09-19T04:57:04.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.791+0000 7fd8814e8740 1 Processor -- start 2024-09-19T04:57:04.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.791+0000 7fd8814e8740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f3eb101b60 0x55f3eb109bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:04.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.791+0000 7fd8814e8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3eb102480 0x55f3eb10a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:04.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.791+0000 7fd8814e8740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f3eb10cd40 0x55f3eb10a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:04.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.791+0000 7fd8814e8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f3eb10f910 con 0x55f3eb102480 2024-09-19T04:57:04.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.791+0000 7fd8814e8740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f3eb021f10 con 0x55f3eb101b60 2024-09-19T04:57:04.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.791+0000 7fd8814e8740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55f3eb10fa90 con 0x55f3eb10cd40 2024-09-19T04:57:04.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.791+0000 7fd8814e8740 10 client.0 _ll_register_callbacks cb 0x55f3eafeaa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:57:04.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.791+0000 7fd87ceab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3eb102480 0x55f3eb10a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:04.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.791+0000 7fd87ceab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3eb102480 0x55f3eb10a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47568/0 (socket says 172.21.15.2:47568) 2024-09-19T04:57:04.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.791+0000 7fd87ceab640 1 -- 172.21.15.2:0/2323422161 learned_addr learned my addr 172.21.15.2:0/2323422161 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:04.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.791+0000 7fd87d6ac640 1 --2- 172.21.15.2:0/2323422161 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f3eb101b60 0x55f3eb109bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:04.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.791+0000 7fd87d6ac640 1 --2- 172.21.15.2:0/2323422161 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f3eb10cd40 0x55f3eb10a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:04.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.792+0000 7fd87ceab640 1 -- 172.21.15.2:0/2323422161 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f3eb10cd40 msgr2=0x55f3eb10a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:04.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.792+0000 7fd87ceab640 1 --2- 172.21.15.2:0/2323422161 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f3eb10cd40 0x55f3eb10a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:04.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.792+0000 7fd87ceab640 1 -- 172.21.15.2:0/2323422161 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f3eb101b60 msgr2=0x55f3eb109bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:04.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.792+0000 7fd87ceab640 1 --2- 172.21.15.2:0/2323422161 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f3eb101b60 0x55f3eb109bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:04.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.792+0000 7fd87ceab640 1 -- 172.21.15.2:0/2323422161 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3eadd86a0 con 0x55f3eb102480 2024-09-19T04:57:04.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.792+0000 7fd87ceab640 1 --2- 172.21.15.2:0/2323422161 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3eb102480 0x55f3eb10a130 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fd86802a9a0 tx=0x7fd868031f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fa00345c5ee88cc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:04.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.792+0000 7fd857fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:57:04.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.792+0000 7fd857fff640 1 -- 172.21.15.2:0/2323422161 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd868035040 con 0x55f3eb102480 2024-09-19T04:57:04.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.792+0000 7fd857fff640 1 -- 172.21.15.2:0/2323422161 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7fd868004040 con 0x55f3eb102480 2024-09-19T04:57:04.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.792+0000 7fd8814e8740 1 -- 172.21.15.2:0/2323422161 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd870003e20 con 0x55f3eb102480 2024-09-19T04:57:04.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.792+0000 7fd857fff640 1 -- 172.21.15.2:0/2323422161 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fd868031870 con 0x55f3eb102480 2024-09-19T04:57:04.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.792+0000 7fd8814e8740 10 client.16512 fetch_fsmap learned FSMap version 19 2024-09-19T04:57:04.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.792+0000 7fd8814e8740 1 -- 172.21.15.2:0/2323422161 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55f3eb11b510 con 0x55f3eb102480 2024-09-19T04:57:04.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.792+0000 7fd857fff640 1 -- 172.21.15.2:0/2323422161 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd870003e20 con 0x55f3eb102480 2024-09-19T04:57:04.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.792+0000 7fd857fff640 1 -- 172.21.15.2:0/2323422161 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fd8680048c0 con 0x55f3eb102480 2024-09-19T04:57:04.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.793+0000 7fd8814e8740 10 client.16512 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:57:04.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.793+0000 7fd8814e8740 10 client.16512 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:57:04.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.793+0000 7fd8814e8740 20 client.16512 populate_metadata read hostname 'smithi002' 2024-09-19T04:57:04.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.793+0000 7fd8814e8740 1 --2- 172.21.15.2:0/2323422161 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f3eb11c920 0x55f3eb11ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:04.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.793+0000 7fd8814e8740 4 client.16512 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:57:04.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.793+0000 7fd8814e8740 1 -- 172.21.15.2:0/2323422161 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f3eb0747f0 con 0x55f3eb11c920 2024-09-19T04:57:04.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.793+0000 7fd87d6ac640 1 --2- 172.21.15.2:0/2323422161 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f3eb11c920 0x55f3eb11ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:04.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.793+0000 7fd87d6ac640 1 --2- 172.21.15.2:0/2323422161 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f3eb11c920 0x55f3eb11ed50 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16097381b4d741d6 server_cookie=36e71b2b21b5970b in_seq=0 out_seq=0 2024-09-19T04:57:04.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.793+0000 7fd857fff640 10 client.16512 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:57:04.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.794+0000 7fd857fff640 1 -- 172.21.15.2:0/2323422161 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f3eb0747f0 con 0x55f3eb11c920 2024-09-19T04:57:04.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.794+0000 7fd857fff640 10 client.16512 handle_command_reply: tid=0 2024-09-19T04:57:04.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.794+0000 7fd8814e8740 1 client.16512 shutdown 2024-09-19T04:57:04.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.794+0000 7fd8814e8740 1 -- 172.21.15.2:0/2323422161 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3eb102480 msgr2=0x55f3eb10a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:04.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.794+0000 7fd8814e8740 1 --2- 172.21.15.2:0/2323422161 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3eb102480 0x55f3eb10a130 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fd86802a9a0 tx=0x7fd868031f20 comp rx=0 tx=0).stop 2024-09-19T04:57:04.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.794+0000 7fd8814e8740 1 -- 172.21.15.2:0/2323422161 shutdown_connections 2024-09-19T04:57:04.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.794+0000 7fd8814e8740 1 --2- 172.21.15.2:0/2323422161 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f3eb11c920 0x55f3eb11ed50 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:04.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.794+0000 7fd8814e8740 1 --2- 172.21.15.2:0/2323422161 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f3eb10cd40 0x55f3eb10a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:04.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.794+0000 7fd8814e8740 1 --2- 172.21.15.2:0/2323422161 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3eb102480 0x55f3eb10a130 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:04.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.794+0000 7fd857fff640 0 client.16512 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:57:04.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.794+0000 7fd8814e8740 1 --2- 172.21.15.2:0/2323422161 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f3eb101b60 0x55f3eb109bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:04.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.794+0000 7fd8814e8740 1 -- 172.21.15.2:0/2323422161 >> 172.21.15.2:0/2323422161 conn(0x55f3eb0fe0f0 msgr2=0x55f3eb103dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:04.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.794+0000 7fd8814e8740 1 -- 172.21.15.2:0/2323422161 shutdown_connections 2024-09-19T04:57:04.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.794+0000 7fd8814e8740 1 -- 172.21.15.2:0/2323422161 wait complete. 2024-09-19T04:57:04.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.794+0000 7fd8814e8740 20 client.16512 trim_cache size 0 max 16384 2024-09-19T04:57:04.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.812+0000 7fd8814e8740 1 Processor -- start 2024-09-19T04:57:04.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.812+0000 7fd8814e8740 1 -- start start 2024-09-19T04:57:04.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.812+0000 7fd8814e8740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f3eb101b60 0x55f3eb103cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:04.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.812+0000 7fd8814e8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3eb102480 0x55f3eb124620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:04.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.812+0000 7fd8814e8740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f3eb10cd40 0x55f3eb124b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:04.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.812+0000 7fd8814e8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd8781ada60 con 0x55f3eb102480 2024-09-19T04:57:04.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.812+0000 7fd8814e8740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd8781b02c0 con 0x55f3eb101b60 2024-09-19T04:57:04.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.812+0000 7fd8814e8740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fd8781ae0b0 con 0x55f3eb10cd40 2024-09-19T04:57:04.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.812+0000 7fd87ceab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3eb102480 0x55f3eb124620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:04.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.812+0000 7fd87ceab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3eb102480 0x55f3eb124620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47584/0 (socket says 172.21.15.2:47584) 2024-09-19T04:57:04.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.812+0000 7fd87ceab640 1 -- 172.21.15.2:0/2188260897 learned_addr learned my addr 172.21.15.2:0/2188260897 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:04.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.812+0000 7fd87d6ac640 1 --2- 172.21.15.2:0/2188260897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f3eb101b60 0x55f3eb103cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:04.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.812+0000 7fd87d6ac640 1 --2- 172.21.15.2:0/2188260897 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f3eb10cd40 0x55f3eb124b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:04.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.812+0000 7fd87ceab640 1 -- 172.21.15.2:0/2188260897 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f3eb10cd40 msgr2=0x55f3eb124b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:04.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.812+0000 7fd87ceab640 1 --2- 172.21.15.2:0/2188260897 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f3eb10cd40 0x55f3eb124b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:04.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.812+0000 7fd87ceab640 1 -- 172.21.15.2:0/2188260897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f3eb101b60 msgr2=0x55f3eb103cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:04.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.812+0000 7fd87ceab640 1 --2- 172.21.15.2:0/2188260897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f3eb101b60 0x55f3eb103cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:04.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.812+0000 7fd87ceab640 1 -- 172.21.15.2:0/2188260897 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3eb0fdb90 con 0x55f3eb102480 2024-09-19T04:57:04.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.812+0000 7fd87d6ac640 1 --2- 172.21.15.2:0/2188260897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f3eb101b60 0x55f3eb103cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:57:04.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.813+0000 7fd87ceab640 1 --2- 172.21.15.2:0/2188260897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3eb102480 0x55f3eb124620 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fd868006010 tx=0x7fd868031f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d656e6ce6d518e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:04.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.813+0000 7fd86e7fc640 1 -- 172.21.15.2:0/2188260897 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd868035020 con 0x55f3eb102480 2024-09-19T04:57:04.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.813+0000 7fd86e7fc640 1 -- 172.21.15.2:0/2188260897 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd868004e80 con 0x55f3eb102480 2024-09-19T04:57:04.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.813+0000 7fd86e7fc640 1 -- 172.21.15.2:0/2188260897 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd86804d6e0 con 0x55f3eb102480 2024-09-19T04:57:04.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.813+0000 7fd8814e8740 1 -- 172.21.15.2:0/2188260897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3eb102480 msgr2=0x55f3eb124620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:04.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.813+0000 7fd8814e8740 1 --2- 172.21.15.2:0/2188260897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3eb102480 0x55f3eb124620 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fd868006010 tx=0x7fd868031f90 comp rx=0 tx=0).stop 2024-09-19T04:57:04.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.813+0000 7fd8814e8740 1 -- 172.21.15.2:0/2188260897 shutdown_connections 2024-09-19T04:57:04.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.813+0000 7fd8814e8740 1 --2- 172.21.15.2:0/2188260897 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f3eb10cd40 0x55f3eb124b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:04.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.813+0000 7fd8814e8740 1 --2- 172.21.15.2:0/2188260897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3eb102480 0x55f3eb124620 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:04.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.813+0000 7fd8814e8740 1 --2- 172.21.15.2:0/2188260897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f3eb101b60 0x55f3eb103cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:04.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.813+0000 7fd8814e8740 1 -- 172.21.15.2:0/2188260897 >> 172.21.15.2:0/2188260897 conn(0x55f3eb0fe0f0 msgr2=0x55f3eb1035b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:04.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.814+0000 7fd8814e8740 1 -- 172.21.15.2:0/2188260897 shutdown_connections 2024-09-19T04:57:04.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.814+0000 7fd8814e8740 1 -- 172.21.15.2:0/2188260897 wait complete. 2024-09-19T04:57:04.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.814+0000 7fd8814e8740 1 -- start start 2024-09-19T04:57:04.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.814+0000 7fd8814e8740 1 Processor -- start 2024-09-19T04:57:04.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.814+0000 7fd8814e8740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f3eb101b60 0x55f3eb110a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:04.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.814+0000 7fd8814e8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3eb102480 0x55f3eb110fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:04.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.814+0000 7fd8814e8740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f3eb10cd40 0x55f3eb1114e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:04.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.814+0000 7fd8814e8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd8781ae780 con 0x55f3eb102480 2024-09-19T04:57:04.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.814+0000 7fd8814e8740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd8781afbf0 con 0x55f3eb10cd40 2024-09-19T04:57:04.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.814+0000 7fd8814e8740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fd8781aee50 con 0x55f3eb101b60 2024-09-19T04:57:04.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.814+0000 7fd8814e8740 10 client.0 _ll_register_callbacks cb 0x7fd868031b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:57:04.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.814+0000 7fd87ceab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3eb102480 0x55f3eb110fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:04.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.815+0000 7fd87ceab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3eb102480 0x55f3eb110fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47590/0 (socket says 172.21.15.2:47590) 2024-09-19T04:57:04.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.815+0000 7fd87ceab640 1 -- 172.21.15.2:0/1841813949 learned_addr learned my addr 172.21.15.2:0/1841813949 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:04.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.815+0000 7fd87d6ac640 1 --2- 172.21.15.2:0/1841813949 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f3eb101b60 0x55f3eb110a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:04.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.815+0000 7fd87d6ac640 1 --2- 172.21.15.2:0/1841813949 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f3eb10cd40 0x55f3eb1114e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:04.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.815+0000 7fd87ceab640 1 -- 172.21.15.2:0/1841813949 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f3eb101b60 msgr2=0x55f3eb110a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:04.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.815+0000 7fd87ceab640 1 --2- 172.21.15.2:0/1841813949 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f3eb101b60 0x55f3eb110a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:04.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.815+0000 7fd87ceab640 1 -- 172.21.15.2:0/1841813949 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f3eb10cd40 msgr2=0x55f3eb1114e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:04.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.815+0000 7fd87ceab640 1 --2- 172.21.15.2:0/1841813949 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f3eb10cd40 0x55f3eb1114e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:04.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.815+0000 7fd87ceab640 1 -- 172.21.15.2:0/1841813949 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3eb1865f0 con 0x55f3eb102480 2024-09-19T04:57:04.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.815+0000 7fd87d6ac640 1 --2- 172.21.15.2:0/1841813949 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f3eb101b60 0x55f3eb110a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:57:04.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.815+0000 7fd87ceab640 1 --2- 172.21.15.2:0/1841813949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3eb102480 0x55f3eb110fa0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fd868004c90 tx=0x7fd8680042d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dca3ed20a9bde15a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:04.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.815+0000 7fd857fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:57:04.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.815+0000 7fd857fff640 1 -- 172.21.15.2:0/1841813949 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8680044c0 con 0x55f3eb102480 2024-09-19T04:57:04.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.815+0000 7fd857fff640 1 -- 172.21.15.2:0/1841813949 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8527+0+0 (secure 0 0 0) 0x7fd868005240 con 0x55f3eb102480 2024-09-19T04:57:04.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.815+0000 7fd8814e8740 1 -- 172.21.15.2:0/1841813949 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd868004e80 con 0x55f3eb102480 2024-09-19T04:57:04.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.815+0000 7fd857fff640 1 -- 172.21.15.2:0/1841813949 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fd868005440 con 0x55f3eb102480 2024-09-19T04:57:04.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.815+0000 7fd8814e8740 10 client.16518 fetch_fsmap learned FSMap version 19 2024-09-19T04:57:04.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.815+0000 7fd8814e8740 1 -- 172.21.15.2:0/1841813949 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55f3eb187910 con 0x55f3eb102480 2024-09-19T04:57:04.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.816+0000 7fd857fff640 1 -- 172.21.15.2:0/1841813949 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd868004e80 con 0x55f3eb102480 2024-09-19T04:57:04.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.816+0000 7fd857fff640 1 -- 172.21.15.2:0/1841813949 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fd86804d480 con 0x55f3eb102480 2024-09-19T04:57:04.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.816+0000 7fd8814e8740 10 client.16518 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:57:04.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.816+0000 7fd8814e8740 10 client.16518 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:57:04.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.816+0000 7fd8814e8740 20 client.16518 populate_metadata read hostname 'smithi002' 2024-09-19T04:57:04.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.816+0000 7fd8814e8740 1 --2- 172.21.15.2:0/1841813949 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f3eb187fa0 0x55f3eb18a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:04.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.816+0000 7fd8814e8740 4 client.16518 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:57:04.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.816+0000 7fd8814e8740 1 -- 172.21.15.2:0/1841813949 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f3eb06ed00 con 0x55f3eb187fa0 2024-09-19T04:57:04.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.816+0000 7fd87d6ac640 1 --2- 172.21.15.2:0/1841813949 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f3eb187fa0 0x55f3eb18a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:04.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.817+0000 7fd87d6ac640 1 --2- 172.21.15.2:0/1841813949 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f3eb187fa0 0x55f3eb18a3c0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a8ecd80c072d45f server_cookie=2617b538a496f634 in_seq=0 out_seq=0 2024-09-19T04:57:04.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.817+0000 7fd857fff640 10 client.16518 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:57:04.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.817+0000 7fd857fff640 1 -- 172.21.15.2:0/1841813949 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f3eb06ed00 con 0x55f3eb187fa0 2024-09-19T04:57:04.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.817+0000 7fd857fff640 10 client.16518 handle_command_reply: tid=0 2024-09-19T04:57:04.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.817+0000 7fd8814e8740 1 client.16518 shutdown 2024-09-19T04:57:04.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.818+0000 7fd8814e8740 1 -- 172.21.15.2:0/1841813949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3eb102480 msgr2=0x55f3eb110fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:04.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.818+0000 7fd8814e8740 1 --2- 172.21.15.2:0/1841813949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3eb102480 0x55f3eb110fa0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fd868004c90 tx=0x7fd8680042d0 comp rx=0 tx=0).stop 2024-09-19T04:57:04.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.818+0000 7fd8814e8740 1 -- 172.21.15.2:0/1841813949 shutdown_connections 2024-09-19T04:57:04.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.818+0000 7fd8814e8740 1 --2- 172.21.15.2:0/1841813949 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f3eb10cd40 0x55f3eb1114e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:04.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.818+0000 7fd8814e8740 1 --2- 172.21.15.2:0/1841813949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3eb102480 0x55f3eb110fa0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:04.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.818+0000 7fd8814e8740 1 --2- 172.21.15.2:0/1841813949 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f3eb187fa0 0x55f3eb18a3c0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:04.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.818+0000 7fd8814e8740 1 --2- 172.21.15.2:0/1841813949 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f3eb101b60 0x55f3eb110a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:04.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.818+0000 7fd857fff640 0 client.16518 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:57:04.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.818+0000 7fd8814e8740 1 -- 172.21.15.2:0/1841813949 >> 172.21.15.2:0/1841813949 conn(0x55f3eb0fe0f0 msgr2=0x55f3eb10a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:04.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.818+0000 7fd8814e8740 1 -- 172.21.15.2:0/1841813949 shutdown_connections 2024-09-19T04:57:04.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.818+0000 7fd8814e8740 1 -- 172.21.15.2:0/1841813949 wait complete. 2024-09-19T04:57:04.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.818+0000 7fd8814e8740 20 client.16518 trim_cache size 0 max 16384 2024-09-19T04:57:04.840 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:57:04.840 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T04:57:04.840 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "9dc7ccda-14e8-4293-ba70-75765cb6f965", 2024-09-19T04:57:04.840 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T04:57:04.840 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:57:04.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.819+0000 7fd87f10f640 1 -- 172.21.15.2:0/124470513 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fd8640a3430 msgr2=0x7fd8640a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:04.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.819+0000 7fd87f10f640 1 --2- 172.21.15.2:0/124470513 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fd8640a3430 0x7fd8640a58f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd86009bb50 tx=0x7fd8600665b0 comp rx=0 tx=0).stop 2024-09-19T04:57:04.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.819+0000 7fd87f10f640 1 -- 172.21.15.2:0/124470513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd878102570 msgr2=0x7fd878104250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:04.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.819+0000 7fd87f10f640 1 --2- 172.21.15.2:0/124470513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd878102570 0x7fd878104250 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fd86000d950 tx=0x7fd86000de10 comp rx=0 tx=0).stop 2024-09-19T04:57:04.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.819+0000 7fd87f10f640 1 -- 172.21.15.2:0/124470513 shutdown_connections 2024-09-19T04:57:04.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.819+0000 7fd87f10f640 1 --2- 172.21.15.2:0/124470513 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fd8640a3430 0x7fd8640a58f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:04.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.819+0000 7fd87f10f640 1 --2- 172.21.15.2:0/124470513 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd878102ef0 0x7fd878104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:04.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.819+0000 7fd87f10f640 1 --2- 172.21.15.2:0/124470513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd878102570 0x7fd878104250 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:04.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.819+0000 7fd87f10f640 1 --2- 172.21.15.2:0/124470513 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd878100e20 0x7fd878103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:04.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.819+0000 7fd87f10f640 1 -- 172.21.15.2:0/124470513 >> 172.21.15.2:0/124470513 conn(0x7fd8780fc7d0 msgr2=0x7fd878105f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:04.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.819+0000 7fd87f10f640 1 -- 172.21.15.2:0/124470513 shutdown_connections 2024-09-19T04:57:04.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:04.819+0000 7fd87f10f640 1 -- 172.21.15.2:0/124470513 wait complete. 2024-09-19T04:57:04.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:04 smithi116 ceph-mon[34477]: pgmap v279: 97 pgs: 97 active+clean; 16 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 44 KiB/s wr, 7 op/s 2024-09-19T04:57:05.716 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:57:05.988 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:57:06.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.435+0000 7fccfd108640 1 -- 172.21.15.2:0/218008254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccf8102790 msgr2=0x7fccf81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:06.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.435+0000 7fccfd108640 1 --2- 172.21.15.2:0/218008254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccf8102790 0x7fccf81067e0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fccec009900 tx=0x7fccec02a410 comp rx=0 tx=0).stop 2024-09-19T04:57:06.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.435+0000 7fccfd108640 1 -- 172.21.15.2:0/218008254 shutdown_connections 2024-09-19T04:57:06.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.435+0000 7fccfd108640 1 --2- 172.21.15.2:0/218008254 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fccf8106f10 0x7fccf810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:06.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.435+0000 7fccfd108640 1 --2- 172.21.15.2:0/218008254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccf8102790 0x7fccf81067e0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:06.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.435+0000 7fccfd108640 1 --2- 172.21.15.2:0/218008254 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fccf8101de0 0x7fccf81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:06.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.435+0000 7fccfd108640 1 -- 172.21.15.2:0/218008254 >> 172.21.15.2:0/218008254 conn(0x7fccf80fd8c0 msgr2=0x7fccf80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:06.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.435+0000 7fccfd108640 1 -- 172.21.15.2:0/218008254 shutdown_connections 2024-09-19T04:57:06.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.435+0000 7fccfd108640 1 -- 172.21.15.2:0/218008254 wait complete. 2024-09-19T04:57:06.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.436+0000 7fccfd108640 1 Processor -- start 2024-09-19T04:57:06.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.436+0000 7fccfd108640 1 -- start start 2024-09-19T04:57:06.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.437+0000 7fccfd108640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fccf8101de0 0x7fccf81983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:06.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.437+0000 7fccfd108640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fccf8102790 0x7fccf81988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:06.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.437+0000 7fccfd108640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccf8106f10 0x7fccf819cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:06.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.437+0000 7fccfd108640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fccf8111e20 con 0x7fccf8106f10 2024-09-19T04:57:06.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.437+0000 7fccfd108640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fccf8111ca0 con 0x7fccf8102790 2024-09-19T04:57:06.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.437+0000 7fccfd108640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fccf8111fa0 con 0x7fccf8101de0 2024-09-19T04:57:06.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.437+0000 7fccf759e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccf8106f10 0x7fccf819cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:06.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.437+0000 7fccf759e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccf8106f10 0x7fccf819cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47604/0 (socket says 172.21.15.2:47604) 2024-09-19T04:57:06.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.437+0000 7fccf759e640 1 -- 172.21.15.2:0/3334600388 learned_addr learned my addr 172.21.15.2:0/3334600388 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:06.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.437+0000 7fccf659c640 1 --2- 172.21.15.2:0/3334600388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fccf8102790 0x7fccf81988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:06.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.437+0000 7fccf6d9d640 1 --2- 172.21.15.2:0/3334600388 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fccf8101de0 0x7fccf81983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:06.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.437+0000 7fccf759e640 1 -- 172.21.15.2:0/3334600388 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fccf8101de0 msgr2=0x7fccf81983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:06.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.437+0000 7fccf759e640 1 --2- 172.21.15.2:0/3334600388 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fccf8101de0 0x7fccf81983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:06.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.437+0000 7fccf759e640 1 -- 172.21.15.2:0/3334600388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fccf8102790 msgr2=0x7fccf81988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:06.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.437+0000 7fccf759e640 1 --2- 172.21.15.2:0/3334600388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fccf8102790 0x7fccf81988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:06.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.437+0000 7fccf759e640 1 -- 172.21.15.2:0/3334600388 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccf819d350 con 0x7fccf8106f10 2024-09-19T04:57:06.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.437+0000 7fccf6d9d640 1 --2- 172.21.15.2:0/3334600388 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fccf8101de0 0x7fccf81983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:57:06.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.437+0000 7fccf759e640 1 --2- 172.21.15.2:0/3334600388 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccf8106f10 0x7fccf819cc70 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fccf000cad0 tx=0x7fccf000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:06.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.437+0000 7fccdffff640 1 -- 172.21.15.2:0/3334600388 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf000ae20 con 0x7fccf8106f10 2024-09-19T04:57:06.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.437+0000 7fccfd108640 1 -- 172.21.15.2:0/3334600388 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccf819d640 con 0x7fccf8106f10 2024-09-19T04:57:06.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.437+0000 7fccdffff640 1 -- 172.21.15.2:0/3334600388 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fccf0005020 con 0x7fccf8106f10 2024-09-19T04:57:06.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.437+0000 7fccdffff640 1 -- 172.21.15.2:0/3334600388 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf000f6b0 con 0x7fccf8106f10 2024-09-19T04:57:06.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.438+0000 7fccfd108640 1 -- 172.21.15.2:0/3334600388 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccf81a4f20 con 0x7fccf8106f10 2024-09-19T04:57:06.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.440+0000 7fccdffff640 1 -- 172.21.15.2:0/3334600388 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fccf00051d0 con 0x7fccf8106f10 2024-09-19T04:57:06.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.440+0000 7fccff4e1740 1 Processor -- start 2024-09-19T04:57:06.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.440+0000 7fccff4e1740 1 -- start start 2024-09-19T04:57:06.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.440+0000 7fccff4e1740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f1e027a4a0 0x55f1e027a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:06.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.440+0000 7fccff4e1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1e027adc0 0x55f1e0285140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:06.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.440+0000 7fccff4e1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1e0285680 0x55f1e0287a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:06.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.440+0000 7fccff4e1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f1e01e02e0 con 0x55f1e0285680 2024-09-19T04:57:06.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.440+0000 7fccff4e1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f1e0187ce0 con 0x55f1e027adc0 2024-09-19T04:57:06.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.440+0000 7fccff4e1740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55f1e01dc2a0 con 0x55f1e027a4a0 2024-09-19T04:57:06.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.440+0000 7fccf659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1e0285680 0x55f1e0287a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:06.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.440+0000 7fccf659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1e0285680 0x55f1e0287a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47612/0 (socket says 172.21.15.2:47612) 2024-09-19T04:57:06.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.440+0000 7fccf659c640 1 -- 172.21.15.2:0/1168352639 learned_addr learned my addr 172.21.15.2:0/1168352639 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:06.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.440+0000 7fccf659c640 1 --2- 172.21.15.2:0/1168352639 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f1e027a4a0 0x55f1e027a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:06.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.441+0000 7fccf6d9d640 1 --2- 172.21.15.2:0/1168352639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1e027adc0 0x55f1e0285140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:06.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.441+0000 7fccdffff640 1 --2- 172.21.15.2:0/3334600388 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fcce00a33b0 0x7fcce00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:06.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.441+0000 7fccf659c640 1 -- 172.21.15.2:0/1168352639 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f1e027a4a0 msgr2=0x55f1e027a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:06.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.441+0000 7fccf659c640 1 --2- 172.21.15.2:0/1168352639 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f1e027a4a0 0x55f1e027a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:06.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.441+0000 7fccf659c640 1 -- 172.21.15.2:0/1168352639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1e027adc0 msgr2=0x55f1e0285140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:06.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.441+0000 7fccf659c640 1 --2- 172.21.15.2:0/1168352639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1e027adc0 0x55f1e0285140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:06.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.441+0000 7fccf659c640 1 -- 172.21.15.2:0/1168352639 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1e016c440 con 0x55f1e0285680 2024-09-19T04:57:06.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.441+0000 7fccf6d9d640 1 --2- 172.21.15.2:0/1168352639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1e027adc0 0x55f1e0285140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:57:06.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.441+0000 7fccf759e640 1 --2- 172.21.15.2:0/3334600388 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fcce00a33b0 0x7fcce00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:06.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.441+0000 7fccdffff640 1 -- 172.21.15.2:0/3334600388 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8571+0+0 (secure 0 0 0) 0x7fccf00cfe10 con 0x7fccf8106f10 2024-09-19T04:57:06.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.441+0000 7fccf659c640 1 --2- 172.21.15.2:0/1168352639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1e0285680 0x55f1e0287a70 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fccec0057c0 tx=0x7fccec0058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d079ae5787669220 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:06.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.441+0000 7fccdd7fa640 1 -- 172.21.15.2:0/1168352639 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccec035040 con 0x55f1e0285680 2024-09-19T04:57:06.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.441+0000 7fccdd7fa640 1 -- 172.21.15.2:0/1168352639 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fccec0035f0 con 0x55f1e0285680 2024-09-19T04:57:06.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.441+0000 7fccdd7fa640 1 -- 172.21.15.2:0/1168352639 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccec0044e0 con 0x55f1e0285680 2024-09-19T04:57:06.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.442+0000 7fccff4e1740 1 -- 172.21.15.2:0/1168352639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1e0285680 msgr2=0x55f1e0287a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:06.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.442+0000 7fccf759e640 1 --2- 172.21.15.2:0/3334600388 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fcce00a33b0 0x7fcce00a5870 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fccf00cd5e0 tx=0x7fccf00bc040 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:06.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.442+0000 7fccff4e1740 1 --2- 172.21.15.2:0/1168352639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1e0285680 0x55f1e0287a70 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fccec0057c0 tx=0x7fccec0058d0 comp rx=0 tx=0).stop 2024-09-19T04:57:06.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.442+0000 7fccff4e1740 1 -- 172.21.15.2:0/1168352639 shutdown_connections 2024-09-19T04:57:06.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.442+0000 7fccff4e1740 1 --2- 172.21.15.2:0/1168352639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1e0285680 0x55f1e0287a70 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:06.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.442+0000 7fccff4e1740 1 --2- 172.21.15.2:0/1168352639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1e027adc0 0x55f1e0285140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:06.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.442+0000 7fccff4e1740 1 --2- 172.21.15.2:0/1168352639 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f1e027a4a0 0x55f1e027a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:06.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.442+0000 7fccff4e1740 1 -- 172.21.15.2:0/1168352639 >> 172.21.15.2:0/1168352639 conn(0x55f1e0276a30 msgr2=0x55f1e0276e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:06.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.442+0000 7fccff4e1740 1 -- 172.21.15.2:0/1168352639 shutdown_connections 2024-09-19T04:57:06.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.442+0000 7fccff4e1740 1 -- 172.21.15.2:0/1168352639 wait complete. 2024-09-19T04:57:06.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.442+0000 7fccff4e1740 1 -- start start 2024-09-19T04:57:06.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.442+0000 7fccff4e1740 1 Processor -- start 2024-09-19T04:57:06.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.443+0000 7fccff4e1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1e027a4a0 0x55f1e0285000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:06.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.443+0000 7fccff4e1740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f1e027adc0 0x55f1e02822b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:06.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.443+0000 7fccff4e1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1e0285680 0x55f1e0282830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:06.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.443+0000 7fccff4e1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f1e0288250 con 0x55f1e0285680 2024-09-19T04:57:06.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.443+0000 7fccff4e1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f1e019b050 con 0x55f1e027a4a0 2024-09-19T04:57:06.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.443+0000 7fccff4e1740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55f1e02883d0 con 0x55f1e027adc0 2024-09-19T04:57:06.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.443+0000 7fccff4e1740 10 client.0 _ll_register_callbacks cb 0x55f1e01db160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:57:06.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.443+0000 7fccf659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1e0285680 0x55f1e0282830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:06.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.443+0000 7fccf659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1e0285680 0x55f1e0282830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47628/0 (socket says 172.21.15.2:47628) 2024-09-19T04:57:06.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.443+0000 7fccf659c640 1 -- 172.21.15.2:0/872185793 learned_addr learned my addr 172.21.15.2:0/872185793 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:06.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.443+0000 7fccf659c640 1 --2- 172.21.15.2:0/872185793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1e027a4a0 0x55f1e0285000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:06.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.443+0000 7fccf6d9d640 1 --2- 172.21.15.2:0/872185793 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f1e027adc0 0x55f1e02822b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:06.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.443+0000 7fccf659c640 1 -- 172.21.15.2:0/872185793 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f1e027adc0 msgr2=0x55f1e02822b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:06.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.443+0000 7fccf659c640 1 --2- 172.21.15.2:0/872185793 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f1e027adc0 0x55f1e02822b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:06.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.443+0000 7fccf659c640 1 -- 172.21.15.2:0/872185793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1e027a4a0 msgr2=0x55f1e0285000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:06.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.443+0000 7fccf659c640 1 --2- 172.21.15.2:0/872185793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1e027a4a0 0x55f1e0285000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:06.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.443+0000 7fccf659c640 1 -- 172.21.15.2:0/872185793 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1dff513c0 con 0x55f1e0285680 2024-09-19T04:57:06.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.443+0000 7fccf6d9d640 1 --2- 172.21.15.2:0/872185793 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f1e027adc0 0x55f1e02822b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:57:06.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.443+0000 7fccf659c640 1 --2- 172.21.15.2:0/872185793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1e0285680 0x55f1e0282830 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fccec031a50 tx=0x7fccec003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=482cd51bce03fd14 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:06.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.443+0000 7fccdaff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:57:06.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.444+0000 7fccdaff5640 1 -- 172.21.15.2:0/872185793 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccec04d070 con 0x55f1e0285680 2024-09-19T04:57:06.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.444+0000 7fccdaff5640 1 -- 172.21.15.2:0/872185793 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8571+0+0 (secure 0 0 0) 0x7fccec004420 con 0x55f1e0285680 2024-09-19T04:57:06.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.444+0000 7fccff4e1740 1 -- 172.21.15.2:0/872185793 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fccec0035f0 con 0x55f1e0285680 2024-09-19T04:57:06.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.444+0000 7fccdaff5640 1 -- 172.21.15.2:0/872185793 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fccec035030 con 0x55f1e0285680 2024-09-19T04:57:06.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.444+0000 7fccff4e1740 10 client.16530 fetch_fsmap learned FSMap version 19 2024-09-19T04:57:06.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.444+0000 7fccff4e1740 1 -- 172.21.15.2:0/872185793 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55f1e0293c70 con 0x55f1e0285680 2024-09-19T04:57:06.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.444+0000 7fccdaff5640 1 -- 172.21.15.2:0/872185793 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fccec0035f0 con 0x55f1e0285680 2024-09-19T04:57:06.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.444+0000 7fccdaff5640 1 -- 172.21.15.2:0/872185793 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fccec03a040 con 0x55f1e0285680 2024-09-19T04:57:06.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.444+0000 7fccff4e1740 10 client.16530 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:57:06.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.444+0000 7fccff4e1740 10 client.16530 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:57:06.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.444+0000 7fccff4e1740 20 client.16530 populate_metadata read hostname 'smithi002' 2024-09-19T04:57:06.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.444+0000 7fccff4e1740 1 --2- 172.21.15.2:0/872185793 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f1e0294fc0 0x55f1e02973b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:06.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.444+0000 7fccff4e1740 4 client.16530 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:57:06.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.444+0000 7fccff4e1740 1 -- 172.21.15.2:0/872185793 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1e01ed850 con 0x55f1e0294fc0 2024-09-19T04:57:06.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.444+0000 7fccf6d9d640 1 --2- 172.21.15.2:0/872185793 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f1e0294fc0 0x55f1e02973b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:06.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.445+0000 7fccf6d9d640 1 --2- 172.21.15.2:0/872185793 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f1e0294fc0 0x55f1e02973b0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a49c4ac98f82019 server_cookie=70be30faea0c5572 in_seq=0 out_seq=0 2024-09-19T04:57:06.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.445+0000 7fccdaff5640 10 client.16530 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:57:06.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.446+0000 7fccdaff5640 1 -- 172.21.15.2:0/872185793 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f1e01ed850 con 0x55f1e0294fc0 2024-09-19T04:57:06.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.446+0000 7fccdaff5640 10 client.16530 handle_command_reply: tid=0 2024-09-19T04:57:06.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.446+0000 7fccff4e1740 1 client.16530 shutdown 2024-09-19T04:57:06.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.446+0000 7fccff4e1740 1 -- 172.21.15.2:0/872185793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1e0285680 msgr2=0x55f1e0282830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:06.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.446+0000 7fccff4e1740 1 --2- 172.21.15.2:0/872185793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1e0285680 0x55f1e0282830 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fccec031a50 tx=0x7fccec003f10 comp rx=0 tx=0).stop 2024-09-19T04:57:06.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.446+0000 7fccff4e1740 1 -- 172.21.15.2:0/872185793 shutdown_connections 2024-09-19T04:57:06.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.446+0000 7fccff4e1740 1 --2- 172.21.15.2:0/872185793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1e0285680 0x55f1e0282830 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:06.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.446+0000 7fccff4e1740 1 --2- 172.21.15.2:0/872185793 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f1e0294fc0 0x55f1e02973b0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:06.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.446+0000 7fccdaff5640 0 client.16530 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:57:06.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.446+0000 7fccff4e1740 1 --2- 172.21.15.2:0/872185793 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f1e027adc0 0x55f1e02822b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:06.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.446+0000 7fccff4e1740 1 --2- 172.21.15.2:0/872185793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1e027a4a0 0x55f1e0285000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:06.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.446+0000 7fccff4e1740 1 -- 172.21.15.2:0/872185793 >> 172.21.15.2:0/872185793 conn(0x55f1e0276a30 msgr2=0x55f1e027c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:06.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.446+0000 7fccff4e1740 1 -- 172.21.15.2:0/872185793 shutdown_connections 2024-09-19T04:57:06.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.446+0000 7fccff4e1740 1 -- 172.21.15.2:0/872185793 wait complete. 2024-09-19T04:57:06.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.446+0000 7fccff4e1740 20 client.16530 trim_cache size 0 max 16384 2024-09-19T04:57:06.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.464+0000 7fccff4e1740 1 Processor -- start 2024-09-19T04:57:06.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.464+0000 7fccff4e1740 1 -- start start 2024-09-19T04:57:06.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.464+0000 7fccff4e1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1e027a4a0 0x55f1e027f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:06.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.464+0000 7fccff4e1740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f1e027adc0 0x55f1e027fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:06.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.464+0000 7fccff4e1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1e0285680 0x55f1e0283b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:06.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.464+0000 7fccff4e1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fccf81ab900 con 0x55f1e027a4a0 2024-09-19T04:57:06.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.464+0000 7fccff4e1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fccf81ae160 con 0x55f1e0285680 2024-09-19T04:57:06.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.464+0000 7fccff4e1740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fccf81abf50 con 0x55f1e027adc0 2024-09-19T04:57:06.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.464+0000 7fccf659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1e027a4a0 0x55f1e027f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:06.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.464+0000 7fccf659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1e027a4a0 0x55f1e027f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47638/0 (socket says 172.21.15.2:47638) 2024-09-19T04:57:06.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.464+0000 7fccf659c640 1 -- 172.21.15.2:0/2863127546 learned_addr learned my addr 172.21.15.2:0/2863127546 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:06.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.464+0000 7fccf6d9d640 1 --2- 172.21.15.2:0/2863127546 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f1e027adc0 0x55f1e027fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:06.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.464+0000 7fccf659c640 1 -- 172.21.15.2:0/2863127546 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f1e027adc0 msgr2=0x55f1e027fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:06.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.464+0000 7fccf659c640 1 --2- 172.21.15.2:0/2863127546 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f1e027adc0 0x55f1e027fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:06.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.464+0000 7fccf659c640 1 -- 172.21.15.2:0/2863127546 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1e0285680 msgr2=0x55f1e0283b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:06.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.464+0000 7fccf659c640 1 --2- 172.21.15.2:0/2863127546 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1e0285680 0x55f1e0283b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:06.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.464+0000 7fccf659c640 1 -- 172.21.15.2:0/2863127546 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1e027a2d0 con 0x55f1e027a4a0 2024-09-19T04:57:06.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.464+0000 7fccf659c640 1 --2- 172.21.15.2:0/2863127546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1e027a4a0 0x55f1e027f510 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fccec0096c0 tx=0x7fccec000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad5c41c75256d92f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:06.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.465+0000 7fccdcff9640 1 -- 172.21.15.2:0/2863127546 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccec04d040 con 0x55f1e027a4a0 2024-09-19T04:57:06.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.465+0000 7fccdcff9640 1 -- 172.21.15.2:0/2863127546 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fccec004420 con 0x55f1e027a4a0 2024-09-19T04:57:06.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.465+0000 7fccdcff9640 1 -- 172.21.15.2:0/2863127546 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccec03d6e0 con 0x55f1e027a4a0 2024-09-19T04:57:06.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.465+0000 7fccff4e1740 1 -- 172.21.15.2:0/2863127546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1e027a4a0 msgr2=0x55f1e027f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:06.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.465+0000 7fccff4e1740 1 --2- 172.21.15.2:0/2863127546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1e027a4a0 0x55f1e027f510 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fccec0096c0 tx=0x7fccec000bc0 comp rx=0 tx=0).stop 2024-09-19T04:57:06.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.465+0000 7fccff4e1740 1 -- 172.21.15.2:0/2863127546 shutdown_connections 2024-09-19T04:57:06.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.465+0000 7fccff4e1740 1 --2- 172.21.15.2:0/2863127546 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1e0285680 0x55f1e0283b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:06.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.465+0000 7fccff4e1740 1 --2- 172.21.15.2:0/2863127546 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f1e027adc0 0x55f1e027fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:06.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.465+0000 7fccff4e1740 1 --2- 172.21.15.2:0/2863127546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1e027a4a0 0x55f1e027f510 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:06.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.465+0000 7fccff4e1740 1 -- 172.21.15.2:0/2863127546 >> 172.21.15.2:0/2863127546 conn(0x55f1e0276a30 msgr2=0x55f1e027d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:06.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.466+0000 7fccff4e1740 1 -- 172.21.15.2:0/2863127546 shutdown_connections 2024-09-19T04:57:06.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.466+0000 7fccff4e1740 1 -- 172.21.15.2:0/2863127546 wait complete. 2024-09-19T04:57:06.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.466+0000 7fccff4e1740 1 -- start start 2024-09-19T04:57:06.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.466+0000 7fccff4e1740 1 Processor -- start 2024-09-19T04:57:06.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.466+0000 7fccff4e1740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f1e027a4a0 0x55f1e0297c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:06.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.466+0000 7fccff4e1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1e027adc0 0x55f1e0298150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:06.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.466+0000 7fccff4e1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1e0285680 0x55f1e02f68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:06.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.466+0000 7fccff4e1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fccf81ac620 con 0x55f1e027adc0 2024-09-19T04:57:06.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.466+0000 7fccff4e1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fccf81ada90 con 0x55f1e0285680 2024-09-19T04:57:06.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.466+0000 7fccff4e1740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fccf81accf0 con 0x55f1e027a4a0 2024-09-19T04:57:06.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.466+0000 7fccff4e1740 10 client.0 _ll_register_callbacks cb 0x7fccec032dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:57:06.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.466+0000 7fccf6d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1e027adc0 0x55f1e0298150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:06.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.466+0000 7fccf6d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1e027adc0 0x55f1e0298150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47646/0 (socket says 172.21.15.2:47646) 2024-09-19T04:57:06.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.466+0000 7fccf6d9d640 1 -- 172.21.15.2:0/3417865316 learned_addr learned my addr 172.21.15.2:0/3417865316 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:06.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.466+0000 7fccf659c640 1 --2- 172.21.15.2:0/3417865316 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f1e027a4a0 0x55f1e0297c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:06.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.466+0000 7fccf659c640 1 --2- 172.21.15.2:0/3417865316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1e0285680 0x55f1e02f68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:06.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.467+0000 7fccf6d9d640 1 -- 172.21.15.2:0/3417865316 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f1e027a4a0 msgr2=0x55f1e0297c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:06.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.467+0000 7fccf6d9d640 1 --2- 172.21.15.2:0/3417865316 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f1e027a4a0 0x55f1e0297c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:06.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.467+0000 7fccf6d9d640 1 -- 172.21.15.2:0/3417865316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1e0285680 msgr2=0x55f1e02f68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:06.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.467+0000 7fccf6d9d640 1 --2- 172.21.15.2:0/3417865316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1e0285680 0x55f1e02f68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:06.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.467+0000 7fccf6d9d640 1 -- 172.21.15.2:0/3417865316 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1e02f6ef0 con 0x55f1e027adc0 2024-09-19T04:57:06.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.467+0000 7fccf6d9d640 1 --2- 172.21.15.2:0/3417865316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1e027adc0 0x55f1e0298150 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x55f1e0277890 tx=0x7fcce80127c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bf516095f208fc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:06.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.467+0000 7fccdaff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:57:06.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.467+0000 7fccdaff5640 1 -- 172.21.15.2:0/3417865316 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce8005220 con 0x55f1e027adc0 2024-09-19T04:57:06.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.467+0000 7fccdaff5640 1 -- 172.21.15.2:0/3417865316 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8571+0+0 (secure 0 0 0) 0x7fcce80053c0 con 0x55f1e027adc0 2024-09-19T04:57:06.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.467+0000 7fccff4e1740 1 -- 172.21.15.2:0/3417865316 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fccec004420 con 0x55f1e027adc0 2024-09-19T04:57:06.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.467+0000 7fccdaff5640 1 -- 172.21.15.2:0/3417865316 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fcce8012e20 con 0x55f1e027adc0 2024-09-19T04:57:06.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.467+0000 7fccff4e1740 10 client.16536 fetch_fsmap learned FSMap version 19 2024-09-19T04:57:06.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.467+0000 7fccff4e1740 1 -- 172.21.15.2:0/3417865316 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55f1e02ff4b0 con 0x55f1e027adc0 2024-09-19T04:57:06.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.468+0000 7fccdaff5640 1 -- 172.21.15.2:0/3417865316 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fccec004420 con 0x55f1e027adc0 2024-09-19T04:57:06.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.468+0000 7fccdaff5640 1 -- 172.21.15.2:0/3417865316 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fcce800f040 con 0x55f1e027adc0 2024-09-19T04:57:06.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.468+0000 7fccff4e1740 10 client.16536 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:57:06.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.468+0000 7fccff4e1740 10 client.16536 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:57:06.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.468+0000 7fccff4e1740 20 client.16536 populate_metadata read hostname 'smithi002' 2024-09-19T04:57:06.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.468+0000 7fccff4e1740 1 --2- 172.21.15.2:0/3417865316 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f1e0294fc0 0x55f1e0301ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:06.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.468+0000 7fccff4e1740 4 client.16536 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:57:06.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.468+0000 7fccff4e1740 1 -- 172.21.15.2:0/3417865316 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f1e01e7d60 con 0x55f1e0294fc0 2024-09-19T04:57:06.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.468+0000 7fccf659c640 1 --2- 172.21.15.2:0/3417865316 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f1e0294fc0 0x55f1e0301ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:06.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.468+0000 7fccf659c640 1 --2- 172.21.15.2:0/3417865316 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f1e0294fc0 0x55f1e0301ca0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85103ee9c6e60007 server_cookie=4488c5c6ccbf0bc6 in_seq=0 out_seq=0 2024-09-19T04:57:06.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.468+0000 7fccdaff5640 10 client.16536 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:57:06.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.469+0000 7fccdaff5640 1 -- 172.21.15.2:0/3417865316 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55f1e01e7d60 con 0x55f1e0294fc0 2024-09-19T04:57:06.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.469+0000 7fccdaff5640 10 client.16536 handle_command_reply: tid=0 2024-09-19T04:57:06.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.469+0000 7fccff4e1740 1 client.16536 shutdown 2024-09-19T04:57:06.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.469+0000 7fccff4e1740 1 -- 172.21.15.2:0/3417865316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1e027adc0 msgr2=0x55f1e0298150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:06.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.469+0000 7fccff4e1740 1 --2- 172.21.15.2:0/3417865316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1e027adc0 0x55f1e0298150 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x55f1e0277890 tx=0x7fcce80127c0 comp rx=0 tx=0).stop 2024-09-19T04:57:06.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.469+0000 7fccff4e1740 1 -- 172.21.15.2:0/3417865316 shutdown_connections 2024-09-19T04:57:06.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.469+0000 7fccff4e1740 1 --2- 172.21.15.2:0/3417865316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1e0285680 0x55f1e02f68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:06.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.469+0000 7fccff4e1740 1 --2- 172.21.15.2:0/3417865316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1e027adc0 0x55f1e0298150 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:06.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.469+0000 7fccff4e1740 1 --2- 172.21.15.2:0/3417865316 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f1e0294fc0 0x55f1e0301ca0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:06.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.469+0000 7fccff4e1740 1 --2- 172.21.15.2:0/3417865316 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f1e027a4a0 0x55f1e0297c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:06.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.469+0000 7fccff4e1740 1 -- 172.21.15.2:0/3417865316 >> 172.21.15.2:0/3417865316 conn(0x55f1e0276a30 msgr2=0x55f1e0275220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:06.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.469+0000 7fccdaff5640 0 client.16536 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:57:06.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.469+0000 7fccff4e1740 1 -- 172.21.15.2:0/3417865316 shutdown_connections 2024-09-19T04:57:06.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.469+0000 7fccff4e1740 1 -- 172.21.15.2:0/3417865316 wait complete. 2024-09-19T04:57:06.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.469+0000 7fccff4e1740 20 client.16536 trim_cache size 0 max 16384 2024-09-19T04:57:06.480 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:57:06.480 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T04:57:06.480 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T04:57:06.480 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:57:06.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.470+0000 7fccfd108640 1 -- 172.21.15.2:0/3334600388 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fcce00a33b0 msgr2=0x7fcce00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:06.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.470+0000 7fccfd108640 1 --2- 172.21.15.2:0/3334600388 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fcce00a33b0 0x7fcce00a5870 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fccf00cd5e0 tx=0x7fccf00bc040 comp rx=0 tx=0).stop 2024-09-19T04:57:06.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.470+0000 7fccfd108640 1 -- 172.21.15.2:0/3334600388 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccf8106f10 msgr2=0x7fccf819cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:06.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.470+0000 7fccfd108640 1 --2- 172.21.15.2:0/3334600388 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccf8106f10 0x7fccf819cc70 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fccf000cad0 tx=0x7fccf000cf90 comp rx=0 tx=0).stop 2024-09-19T04:57:06.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.470+0000 7fccfd108640 1 -- 172.21.15.2:0/3334600388 shutdown_connections 2024-09-19T04:57:06.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.470+0000 7fccfd108640 1 --2- 172.21.15.2:0/3334600388 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccf8106f10 0x7fccf819cc70 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:06.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.470+0000 7fccfd108640 1 --2- 172.21.15.2:0/3334600388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fccf8102790 0x7fccf81988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:06.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.470+0000 7fccfd108640 1 --2- 172.21.15.2:0/3334600388 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fcce00a33b0 0x7fcce00a5870 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:06.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.470+0000 7fccfd108640 1 --2- 172.21.15.2:0/3334600388 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fccf8101de0 0x7fccf81983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:06.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.470+0000 7fccfd108640 1 -- 172.21.15.2:0/3334600388 >> 172.21.15.2:0/3334600388 conn(0x7fccf80fd8c0 msgr2=0x7fccf80fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:06.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.470+0000 7fccfd108640 1 -- 172.21.15.2:0/3334600388 shutdown_connections 2024-09-19T04:57:06.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:06.470+0000 7fccfd108640 1 -- 172.21.15.2:0/3334600388 wait complete. 2024-09-19T04:57:06.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:06 smithi002 ceph-mon[30975]: scrub queued for path: / 2024-09-19T04:57:06.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:06 smithi002 ceph-mon[30975]: scrub summary: idle+waiting paths [/] 2024-09-19T04:57:06.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:06 smithi002 ceph-mon[30975]: scrub summary: active paths [/] 2024-09-19T04:57:06.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:06 smithi002 ceph-mon[30975]: scrub summary: idle+waiting paths [/] 2024-09-19T04:57:06.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:06 smithi002 ceph-mon[30975]: pgmap v280: 97 pgs: 97 active+clean; 16 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 117 KiB/s wr, 28 op/s 2024-09-19T04:57:06.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:06 smithi002 ceph-mon[30975]: scrub summary: idle 2024-09-19T04:57:06.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:06 smithi002 ceph-mon[30975]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T04:57:06.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:06 smithi018 ceph-mon[34537]: scrub queued for path: / 2024-09-19T04:57:06.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:06 smithi018 ceph-mon[34537]: scrub summary: idle+waiting paths [/] 2024-09-19T04:57:06.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:06 smithi018 ceph-mon[34537]: scrub summary: active paths [/] 2024-09-19T04:57:06.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:06 smithi018 ceph-mon[34537]: scrub summary: idle+waiting paths [/] 2024-09-19T04:57:06.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:06 smithi018 ceph-mon[34537]: pgmap v280: 97 pgs: 97 active+clean; 16 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 117 KiB/s wr, 28 op/s 2024-09-19T04:57:06.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:06 smithi018 ceph-mon[34537]: scrub summary: idle 2024-09-19T04:57:06.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:06 smithi018 ceph-mon[34537]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T04:57:06.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:06 smithi116 ceph-mon[34477]: scrub queued for path: / 2024-09-19T04:57:06.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:06 smithi116 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-19T04:57:06.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:06 smithi116 ceph-mon[34477]: scrub summary: active paths [/] 2024-09-19T04:57:06.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:06 smithi116 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-19T04:57:06.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:06 smithi116 ceph-mon[34477]: pgmap v280: 97 pgs: 97 active+clean; 16 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 117 KiB/s wr, 28 op/s 2024-09-19T04:57:06.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:06 smithi116 ceph-mon[34477]: scrub summary: idle 2024-09-19T04:57:06.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:06 smithi116 ceph-mon[34477]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T04:57:07.223 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:57:07.224 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:57:07.487 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:57:07.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:07.956+0000 7fab7b180640 1 -- 172.21.15.2:0/1896689852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab74101df0 msgr2=0x7fab741021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:07.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:07.957+0000 7fab7b180640 1 --2- 172.21.15.2:0/1896689852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab74101df0 0x7fab741021d0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fab68009900 tx=0x7fab6802a410 comp rx=0 tx=0).stop 2024-09-19T04:57:07.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:07.957+0000 7fab7b180640 1 -- 172.21.15.2:0/1896689852 shutdown_connections 2024-09-19T04:57:07.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:07.957+0000 7fab7b180640 1 --2- 172.21.15.2:0/1896689852 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab74106f20 0x7fab7410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:07.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:07.957+0000 7fab7b180640 1 --2- 172.21.15.2:0/1896689852 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab741027a0 0x7fab741067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:07.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:07.957+0000 7fab7b180640 1 --2- 172.21.15.2:0/1896689852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab74101df0 0x7fab741021d0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:07.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:07.957+0000 7fab7b180640 1 -- 172.21.15.2:0/1896689852 >> 172.21.15.2:0/1896689852 conn(0x7fab740fd8f0 msgr2=0x7fab740ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:07.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:07.957+0000 7fab7b180640 1 -- 172.21.15.2:0/1896689852 shutdown_connections 2024-09-19T04:57:07.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:07.957+0000 7fab7b180640 1 -- 172.21.15.2:0/1896689852 wait complete. 2024-09-19T04:57:07.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:07.957+0000 7fab7b180640 1 Processor -- start 2024-09-19T04:57:07.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:07.957+0000 7fab7b180640 1 -- start start 2024-09-19T04:57:07.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:07.958+0000 7fab7b180640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab74101df0 0x7fab74198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:07.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:07.958+0000 7fab7b180640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab741027a0 0x7fab74198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:07.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:07.958+0000 7fab7b180640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab74106f20 0x7fab7419cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:07.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:07.958+0000 7fab7b180640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fab74111e50 con 0x7fab74101df0 2024-09-19T04:57:07.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:07.958+0000 7fab7b180640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fab74111cd0 con 0x7fab741027a0 2024-09-19T04:57:07.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:07.958+0000 7fab7b180640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fab74111fd0 con 0x7fab74106f20 2024-09-19T04:57:07.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:07.958+0000 7fab78f1c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab74101df0 0x7fab74198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:07.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:07.958+0000 7fab78f1c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab74101df0 0x7fab74198350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47656/0 (socket says 172.21.15.2:47656) 2024-09-19T04:57:07.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:07.958+0000 7fab78f1c640 1 -- 172.21.15.2:0/3082224520 learned_addr learned my addr 172.21.15.2:0/3082224520 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:07.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:07.958+0000 7fab7971d640 1 --2- 172.21.15.2:0/3082224520 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab74106f20 0x7fab7419cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:07.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:07.958+0000 7fab73fff640 1 --2- 172.21.15.2:0/3082224520 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab741027a0 0x7fab74198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:07.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:07.958+0000 7fab78f1c640 1 -- 172.21.15.2:0/3082224520 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab74106f20 msgr2=0x7fab7419cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:07.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:07.958+0000 7fab78f1c640 1 --2- 172.21.15.2:0/3082224520 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab74106f20 0x7fab7419cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:07.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:07.958+0000 7fab78f1c640 1 -- 172.21.15.2:0/3082224520 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab741027a0 msgr2=0x7fab74198890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:07.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:07.958+0000 7fab78f1c640 1 --2- 172.21.15.2:0/3082224520 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab741027a0 0x7fab74198890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:07.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:07.958+0000 7fab78f1c640 1 -- 172.21.15.2:0/3082224520 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab7419d300 con 0x7fab74101df0 2024-09-19T04:57:07.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:07.958+0000 7fab7971d640 1 --2- 172.21.15.2:0/3082224520 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab74106f20 0x7fab7419cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:57:07.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:07.958+0000 7fab73fff640 1 --2- 172.21.15.2:0/3082224520 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab741027a0 0x7fab74198890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:57:07.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:07.958+0000 7fab78f1c640 1 --2- 172.21.15.2:0/3082224520 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab74101df0 0x7fab74198350 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fab68006010 tx=0x7fab68004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:07.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:07.958+0000 7fab71ffb640 1 -- 172.21.15.2:0/3082224520 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab6803f030 con 0x7fab74101df0 2024-09-19T04:57:07.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:07.959+0000 7fab71ffb640 1 -- 172.21.15.2:0/3082224520 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fab680035f0 con 0x7fab74101df0 2024-09-19T04:57:07.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:07.959+0000 7fab7b180640 1 -- 172.21.15.2:0/3082224520 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab7419d590 con 0x7fab74101df0 2024-09-19T04:57:07.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:07.959+0000 7fab71ffb640 1 -- 172.21.15.2:0/3082224520 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab68035070 con 0x7fab74101df0 2024-09-19T04:57:07.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:07.959+0000 7fab7b180640 1 -- 172.21.15.2:0/3082224520 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab741a4ed0 con 0x7fab74101df0 2024-09-19T04:57:07.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:07.960+0000 7fab7b180640 1 -- 172.21.15.2:0/3082224520 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab741032d0 con 0x7fab74101df0 2024-09-19T04:57:07.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:07.961+0000 7fab71ffb640 1 -- 172.21.15.2:0/3082224520 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fab68003b10 con 0x7fab74101df0 2024-09-19T04:57:07.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:07.962+0000 7fab71ffb640 1 --2- 172.21.15.2:0/3082224520 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fab640a33b0 0x7fab640a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:07.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:07.962+0000 7fab73fff640 1 --2- 172.21.15.2:0/3082224520 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fab640a33b0 0x7fab640a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:07.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:07.962+0000 7fab71ffb640 1 -- 172.21.15.2:0/3082224520 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8571+0+0 (secure 0 0 0) 0x7fab680f0980 con 0x7fab74101df0 2024-09-19T04:57:07.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:07.963+0000 7fab73fff640 1 --2- 172.21.15.2:0/3082224520 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fab640a33b0 0x7fab640a5870 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fab740ffde0 tx=0x7fab60005ec0 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:07.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:07.967+0000 7fab71ffb640 1 -- 172.21.15.2:0/3082224520 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fab680bd330 con 0x7fab74101df0 2024-09-19T04:57:08.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:08.178+0000 7fab7b180640 1 -- 172.21.15.2:0/3082224520 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fab741021d0 con 0x7fab74101df0 2024-09-19T04:57:08.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:08.179+0000 7fab71ffb640 1 -- 172.21.15.2:0/3082224520 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11840 (secure 0 0 0) 0x7fab680bcc30 con 0x7fab74101df0 2024-09-19T04:57:08.181 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:57:08.181 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":19,"btime":"2024-09-19T04:46:33:537239+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2467365137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2467365137},{"type":"v1","addr":"172.21.15.2:6835","nonce":2467365137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3162441888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3162441888},{"type":"v1","addr":"172.21.15.2:6837","nonce":3162441888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14631,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2740862966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2740862966},{"type":"v1","addr":"172.21.15.2:6839","nonce":2740862966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/2394435504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2394435504},{"type":"v1","addr":"172.21.15.2:6841","nonce":2394435504}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1630480244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1630480244},{"type":"v1","addr":"172.21.15.18:6833","nonce":1630480244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1553897465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1553897465},{"type":"v1","addr":"172.21.15.116:6833","nonce":1553897465}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3035664608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3035664608},{"type":"v1","addr":"172.21.15.18:6835","nonce":3035664608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1096622392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1096622392},{"type":"v1","addr":"172.21.15.18:6837","nonce":1096622392}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3761157675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3761157675},{"type":"v1","addr":"172.21.15.116:6835","nonce":3761157675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/1120131594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1120131594},{"type":"v1","addr":"172.21.15.116:6837","nonce":1120131594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:46:24.050115+0000","modified":"2024-09-19T04:46:33.112369+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/4207677139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":4207677139},{"type":"v1","addr":"172.21.15.18:6839","nonce":4207677139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/2346874880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":2346874880},{"type":"v1","addr":"172.21.15.116:6839","nonce":2346874880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496]},"id":1}]} 2024-09-19T04:57:08.181 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 19 2024-09-19T04:57:08.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:08.181+0000 7fab7b180640 1 -- 172.21.15.2:0/3082224520 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fab640a33b0 msgr2=0x7fab640a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:08.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:08.181+0000 7fab7b180640 1 --2- 172.21.15.2:0/3082224520 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fab640a33b0 0x7fab640a5870 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fab740ffde0 tx=0x7fab60005ec0 comp rx=0 tx=0).stop 2024-09-19T04:57:08.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:08.181+0000 7fab7b180640 1 -- 172.21.15.2:0/3082224520 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab74101df0 msgr2=0x7fab74198350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:08.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:08.181+0000 7fab7b180640 1 --2- 172.21.15.2:0/3082224520 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab74101df0 0x7fab74198350 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fab68006010 tx=0x7fab68004270 comp rx=0 tx=0).stop 2024-09-19T04:57:08.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:08.181+0000 7fab7b180640 1 -- 172.21.15.2:0/3082224520 shutdown_connections 2024-09-19T04:57:08.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:08.181+0000 7fab7b180640 1 --2- 172.21.15.2:0/3082224520 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fab640a33b0 0x7fab640a5870 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:08.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:08.181+0000 7fab7b180640 1 --2- 172.21.15.2:0/3082224520 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab74106f20 0x7fab7419cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:08.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:08.181+0000 7fab7b180640 1 --2- 172.21.15.2:0/3082224520 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab741027a0 0x7fab74198890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:08.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:08.181+0000 7fab7b180640 1 --2- 172.21.15.2:0/3082224520 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab74101df0 0x7fab74198350 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:08.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:08.181+0000 7fab7b180640 1 -- 172.21.15.2:0/3082224520 >> 172.21.15.2:0/3082224520 conn(0x7fab740fd8f0 msgr2=0x7fab740fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:08.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:08.182+0000 7fab7b180640 1 -- 172.21.15.2:0/3082224520 shutdown_connections 2024-09-19T04:57:08.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:08.182+0000 7fab7b180640 1 -- 172.21.15.2:0/3082224520 wait complete. 2024-09-19T04:57:08.488 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:08 smithi002 ceph-mon[30975]: pgmap v282: 97 pgs: 97 active+clean; 16 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 112 KiB/s wr, 29 op/s 2024-09-19T04:57:08.488 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:08 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/3082224520' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:57:08.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:08 smithi018 ceph-mon[34537]: pgmap v282: 97 pgs: 97 active+clean; 16 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 112 KiB/s wr, 29 op/s 2024-09-19T04:57:08.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:08 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/3082224520' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:57:08.810 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:57:08.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:08 smithi116 ceph-mon[34477]: pgmap v282: 97 pgs: 97 active+clean; 16 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 112 KiB/s wr, 29 op/s 2024-09-19T04:57:08.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:08 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/3082224520' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:57:09.068 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:57:09.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.599+0000 7f2c15e71640 1 -- 172.21.15.2:0/834332127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c10101420 msgr2=0x7f2c1010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:09.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.599+0000 7f2c15e71640 1 --2- 172.21.15.2:0/834332127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c10101420 0x7f2c1010d950 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f2c08009cd0 tx=0x7f2c0802a8e0 comp rx=0 tx=0).stop 2024-09-19T04:57:09.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.599+0000 7f2c15e71640 1 -- 172.21.15.2:0/834332127 shutdown_connections 2024-09-19T04:57:09.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.599+0000 7f2c15e71640 1 --2- 172.21.15.2:0/834332127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c10101420 0x7f2c1010d950 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:09.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.599+0000 7f2c15e71640 1 --2- 172.21.15.2:0/834332127 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2c10100a80 0x7f2c10100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:09.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.599+0000 7f2c15e71640 1 --2- 172.21.15.2:0/834332127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c10106a80 0x7f2c10106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:09.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.599+0000 7f2c15e71640 1 -- 172.21.15.2:0/834332127 >> 172.21.15.2:0/834332127 conn(0x7f2c100fc7a0 msgr2=0x7f2c100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:09.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.599+0000 7f2c15e71640 1 -- 172.21.15.2:0/834332127 shutdown_connections 2024-09-19T04:57:09.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.599+0000 7f2c15e71640 1 -- 172.21.15.2:0/834332127 wait complete. 2024-09-19T04:57:09.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.600+0000 7f2c15e71640 1 Processor -- start 2024-09-19T04:57:09.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.600+0000 7f2c15e71640 1 -- start start 2024-09-19T04:57:09.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.600+0000 7f2c15e71640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c10100a80 0x7f2c1019a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:09.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.600+0000 7f2c15e71640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c10101420 0x7f2c1019aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:09.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.600+0000 7f2c15e71640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2c10106a80 0x7f2c1019ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:09.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.600+0000 7f2c15e71640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2c10111e50 con 0x7f2c10101420 2024-09-19T04:57:09.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.600+0000 7f2c15e71640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2c10111cd0 con 0x7f2c10100a80 2024-09-19T04:57:09.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.600+0000 7f2c15e71640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f2c10111fd0 con 0x7f2c10106a80 2024-09-19T04:57:09.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.600+0000 7f2c0effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c10101420 0x7f2c1019aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:09.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.600+0000 7f2c0effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c10101420 0x7f2c1019aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47678/0 (socket says 172.21.15.2:47678) 2024-09-19T04:57:09.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.600+0000 7f2c0effd640 1 -- 172.21.15.2:0/1801855788 learned_addr learned my addr 172.21.15.2:0/1801855788 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:09.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.601+0000 7f2c0ffff640 1 --2- 172.21.15.2:0/1801855788 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2c10106a80 0x7f2c1019ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:09.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.601+0000 7f2c0effd640 1 -- 172.21.15.2:0/1801855788 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2c10106a80 msgr2=0x7f2c1019ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:09.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.601+0000 7f2c0f7fe640 1 --2- 172.21.15.2:0/1801855788 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c10100a80 0x7f2c1019a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:09.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.601+0000 7f2c0effd640 1 --2- 172.21.15.2:0/1801855788 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2c10106a80 0x7f2c1019ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:09.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.601+0000 7f2c0effd640 1 -- 172.21.15.2:0/1801855788 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c10100a80 msgr2=0x7f2c1019a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:09.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.601+0000 7f2c0effd640 1 --2- 172.21.15.2:0/1801855788 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c10100a80 0x7f2c1019a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:09.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.601+0000 7f2c0effd640 1 -- 172.21.15.2:0/1801855788 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c1019f500 con 0x7f2c10101420 2024-09-19T04:57:09.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.601+0000 7f2c0ffff640 1 --2- 172.21.15.2:0/1801855788 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2c10106a80 0x7f2c1019ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:57:09.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.601+0000 7f2c0effd640 1 --2- 172.21.15.2:0/1801855788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c10101420 0x7f2c1019aa90 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f2c0400d770 tx=0x7f2c0400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:09.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.601+0000 7f2c0cff9640 1 -- 172.21.15.2:0/1801855788 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c04017070 con 0x7f2c10101420 2024-09-19T04:57:09.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.601+0000 7f2c15e71640 1 -- 172.21.15.2:0/1801855788 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c1019f7f0 con 0x7f2c10101420 2024-09-19T04:57:09.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.601+0000 7f2c0cff9640 1 -- 172.21.15.2:0/1801855788 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2c040054d0 con 0x7f2c10101420 2024-09-19T04:57:09.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.601+0000 7f2c0cff9640 1 -- 172.21.15.2:0/1801855788 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c04004cf0 con 0x7f2c10101420 2024-09-19T04:57:09.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.601+0000 7f2c15e71640 1 -- 172.21.15.2:0/1801855788 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c101a70d0 con 0x7f2c10101420 2024-09-19T04:57:09.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.603+0000 7f2c0cff9640 1 -- 172.21.15.2:0/1801855788 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f2c04004e90 con 0x7f2c10101420 2024-09-19T04:57:09.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.604+0000 7f2c1824a740 1 Processor -- start 2024-09-19T04:57:09.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.604+0000 7f2c1824a740 1 -- start start 2024-09-19T04:57:09.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.604+0000 7f2c0cff9640 1 --2- 172.21.15.2:0/1801855788 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f2bf80a33b0 0x7f2bf80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:09.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.604+0000 7f2c1824a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bbf0efb40 0x560bbf0ee090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:09.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.604+0000 7f2c1824a740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560bbf0ee5d0 0x560bbf0eea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:09.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.604+0000 7f2c1824a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560bbf0f9370 0x560bbf0fb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:09.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.604+0000 7f2c1824a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560bbf0542f0 con 0x560bbf0f9370 2024-09-19T04:57:09.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.604+0000 7f2c1824a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560bbeffbcf0 con 0x560bbf0efb40 2024-09-19T04:57:09.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.604+0000 7f2c1824a740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x560bbf0502b0 con 0x560bbf0ee5d0 2024-09-19T04:57:09.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.604+0000 7f2c0ffff640 1 --2- 172.21.15.2:0/1801855788 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f2bf80a33b0 0x7f2bf80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:09.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.604+0000 7f2c0cff9640 1 -- 172.21.15.2:0/1801855788 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8571+0+0 (secure 0 0 0) 0x7f2c040cf8d0 con 0x7f2c10101420 2024-09-19T04:57:09.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.604+0000 7f2c0ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560bbf0f9370 0x560bbf0fb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:09.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.604+0000 7f2c0ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560bbf0f9370 0x560bbf0fb760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47680/0 (socket says 172.21.15.2:47680) 2024-09-19T04:57:09.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.604+0000 7f2c0ffff640 1 -- 172.21.15.2:0/2623071889 learned_addr learned my addr 172.21.15.2:0/2623071889 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:09.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.604+0000 7f2c0f7fe640 1 --2- 172.21.15.2:0/2623071889 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bbf0efb40 0x560bbf0ee090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:09.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.604+0000 7f2c0effd640 1 --2- 172.21.15.2:0/2623071889 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560bbf0ee5d0 0x560bbf0eea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:09.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.605+0000 7f2c0f7fe640 1 -- 172.21.15.2:0/2623071889 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560bbf0ee5d0 msgr2=0x560bbf0eea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:09.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.605+0000 7f2c0f7fe640 1 --2- 172.21.15.2:0/2623071889 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560bbf0ee5d0 0x560bbf0eea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:09.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.605+0000 7f2c0f7fe640 1 -- 172.21.15.2:0/2623071889 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560bbf0f9370 msgr2=0x560bbf0fb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:09.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.605+0000 7f2c0f7fe640 1 --2- 172.21.15.2:0/2623071889 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560bbf0f9370 0x560bbf0fb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:09.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.605+0000 7f2c0f7fe640 1 -- 172.21.15.2:0/2623071889 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bbefe03a0 con 0x560bbf0efb40 2024-09-19T04:57:09.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.605+0000 7f2c0ffff640 1 --2- 172.21.15.2:0/2623071889 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560bbf0f9370 0x560bbf0fb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:57:09.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.605+0000 7f2c0ffff640 1 --2- 172.21.15.2:0/1801855788 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f2bf80a33b0 0x7f2bf80a5870 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2c08031920 tx=0x7f2c08009910 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:09.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.605+0000 7f2c0f7fe640 1 --2- 172.21.15.2:0/2623071889 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bbf0efb40 0x560bbf0ee090 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2c00009a30 tx=0x7f2c00009ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ab3055fd3811162 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:09.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.605+0000 7f2bf5ffb640 1 -- 172.21.15.2:0/2623071889 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c00016070 con 0x560bbf0efb40 2024-09-19T04:57:09.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.605+0000 7f2bf5ffb640 1 -- 172.21.15.2:0/2623071889 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2c000054d0 con 0x560bbf0efb40 2024-09-19T04:57:09.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.605+0000 7f2bf5ffb640 1 -- 172.21.15.2:0/2623071889 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c00004c60 con 0x560bbf0efb40 2024-09-19T04:57:09.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.606+0000 7f2c1824a740 1 -- 172.21.15.2:0/2623071889 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bbf0efb40 msgr2=0x560bbf0ee090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:09.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.606+0000 7f2c1824a740 1 --2- 172.21.15.2:0/2623071889 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bbf0efb40 0x560bbf0ee090 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2c00009a30 tx=0x7f2c00009ef0 comp rx=0 tx=0).stop 2024-09-19T04:57:09.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.606+0000 7f2c1824a740 1 -- 172.21.15.2:0/2623071889 shutdown_connections 2024-09-19T04:57:09.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.606+0000 7f2c1824a740 1 --2- 172.21.15.2:0/2623071889 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560bbf0f9370 0x560bbf0fb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:09.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.606+0000 7f2c1824a740 1 --2- 172.21.15.2:0/2623071889 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560bbf0ee5d0 0x560bbf0eea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:09.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.606+0000 7f2c1824a740 1 --2- 172.21.15.2:0/2623071889 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bbf0efb40 0x560bbf0ee090 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:09.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.606+0000 7f2c1824a740 1 -- 172.21.15.2:0/2623071889 >> 172.21.15.2:0/2623071889 conn(0x560bbf0b7310 msgr2=0x560bbf0eac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:09.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.606+0000 7f2c1824a740 1 -- 172.21.15.2:0/2623071889 shutdown_connections 2024-09-19T04:57:09.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.606+0000 7f2c1824a740 1 -- 172.21.15.2:0/2623071889 wait complete. 2024-09-19T04:57:09.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.606+0000 7f2c1824a740 1 -- start start 2024-09-19T04:57:09.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.607+0000 7f2c1824a740 1 Processor -- start 2024-09-19T04:57:09.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.607+0000 7f2c1824a740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560bbf0ee5d0 0x560bbf0f8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:09.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.607+0000 7f2c1824a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bbf0efb40 0x560bbf0f5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:09.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.607+0000 7f2c1824a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560bbf0f9370 0x560bbf0f63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:09.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.607+0000 7f2c1824a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560bbf0fc070 con 0x560bbf0f9370 2024-09-19T04:57:09.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.607+0000 7f2c1824a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560bbf00f060 con 0x560bbf0efb40 2024-09-19T04:57:09.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.607+0000 7f2c1824a740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x560bbf0fc1f0 con 0x560bbf0ee5d0 2024-09-19T04:57:09.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.607+0000 7f2c1824a740 10 client.0 _ll_register_callbacks cb 0x560bbed628c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:57:09.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.608+0000 7f2c0ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560bbf0f9370 0x560bbf0f63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:09.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.608+0000 7f2c0ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560bbf0f9370 0x560bbf0f63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47694/0 (socket says 172.21.15.2:47694) 2024-09-19T04:57:09.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.608+0000 7f2c0ffff640 1 -- 172.21.15.2:0/1813639342 learned_addr learned my addr 172.21.15.2:0/1813639342 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:09.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.608+0000 7f2c0effd640 1 --2- 172.21.15.2:0/1813639342 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bbf0efb40 0x560bbf0f5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:09.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.608+0000 7f2c0f7fe640 1 --2- 172.21.15.2:0/1813639342 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560bbf0ee5d0 0x560bbf0f8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:09.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.608+0000 7f2c0ffff640 1 -- 172.21.15.2:0/1813639342 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560bbf0ee5d0 msgr2=0x560bbf0f8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:09.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.608+0000 7f2c0ffff640 1 --2- 172.21.15.2:0/1813639342 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560bbf0ee5d0 0x560bbf0f8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:09.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.608+0000 7f2c0ffff640 1 -- 172.21.15.2:0/1813639342 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bbf0efb40 msgr2=0x560bbf0f5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:09.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.608+0000 7f2c0ffff640 1 --2- 172.21.15.2:0/1813639342 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bbf0efb40 0x560bbf0f5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:09.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.608+0000 7f2c0ffff640 1 -- 172.21.15.2:0/1813639342 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560bbedc53c0 con 0x560bbf0f9370 2024-09-19T04:57:09.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.608+0000 7f2c0ffff640 1 --2- 172.21.15.2:0/1813639342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560bbf0f9370 0x560bbf0f63d0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f2c08031db0 tx=0x7f2c08049000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0656d54c44aa41 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:09.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.608+0000 7f2beeffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:57:09.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.609+0000 7f2beeffd640 1 -- 172.21.15.2:0/1813639342 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c08051070 con 0x560bbf0f9370 2024-09-19T04:57:09.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.609+0000 7f2beeffd640 1 -- 172.21.15.2:0/1813639342 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8571+0+0 (secure 0 0 0) 0x7f2c080305a0 con 0x560bbf0f9370 2024-09-19T04:57:09.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.609+0000 7f2c1824a740 1 -- 172.21.15.2:0/1813639342 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c000054d0 con 0x560bbf0f9370 2024-09-19T04:57:09.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.609+0000 7f2beeffd640 1 -- 172.21.15.2:0/1813639342 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f2c0805d050 con 0x560bbf0f9370 2024-09-19T04:57:09.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.609+0000 7f2c1824a740 10 client.16554 fetch_fsmap learned FSMap version 19 2024-09-19T04:57:09.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.609+0000 7f2c1824a740 1 -- 172.21.15.2:0/1813639342 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x560bbf1079f0 con 0x560bbf0f9370 2024-09-19T04:57:09.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.609+0000 7f2beeffd640 1 -- 172.21.15.2:0/1813639342 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2c000054d0 con 0x560bbf0f9370 2024-09-19T04:57:09.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.609+0000 7f2beeffd640 1 -- 172.21.15.2:0/1813639342 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f2c08030070 con 0x560bbf0f9370 2024-09-19T04:57:09.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.609+0000 7f2c1824a740 10 client.16554 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:57:09.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.609+0000 7f2c1824a740 10 client.16554 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:57:09.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.609+0000 7f2c1824a740 20 client.16554 populate_metadata read hostname 'smithi002' 2024-09-19T04:57:09.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.609+0000 7f2c1824a740 1 --2- 172.21.15.2:0/1813639342 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560bbf108e00 0x560bbf10b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:09.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.609+0000 7f2c1824a740 4 client.16554 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:57:09.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.609+0000 7f2c1824a740 1 -- 172.21.15.2:0/1813639342 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560bbf061860 con 0x560bbf108e00 2024-09-19T04:57:09.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.610+0000 7f2c0f7fe640 1 --2- 172.21.15.2:0/1813639342 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560bbf108e00 0x560bbf10b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:09.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.610+0000 7f2c0f7fe640 1 --2- 172.21.15.2:0/1813639342 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560bbf108e00 0x560bbf10b270 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86f3d283c7367a7b server_cookie=c2eec95b8a135f64 in_seq=0 out_seq=0 2024-09-19T04:57:09.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.610+0000 7f2beeffd640 10 client.16554 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:57:09.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.611+0000 7f2beeffd640 1 -- 172.21.15.2:0/1813639342 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560bbf061860 con 0x560bbf108e00 2024-09-19T04:57:09.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.611+0000 7f2beeffd640 10 client.16554 handle_command_reply: tid=0 2024-09-19T04:57:09.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.611+0000 7f2c1824a740 1 client.16554 shutdown 2024-09-19T04:57:09.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.611+0000 7f2c1824a740 1 -- 172.21.15.2:0/1813639342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560bbf0f9370 msgr2=0x560bbf0f63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:09.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.611+0000 7f2c1824a740 1 --2- 172.21.15.2:0/1813639342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560bbf0f9370 0x560bbf0f63d0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f2c08031db0 tx=0x7f2c08049000 comp rx=0 tx=0).stop 2024-09-19T04:57:09.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.611+0000 7f2c1824a740 1 -- 172.21.15.2:0/1813639342 shutdown_connections 2024-09-19T04:57:09.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.611+0000 7f2c1824a740 1 --2- 172.21.15.2:0/1813639342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560bbf0f9370 0x560bbf0f63d0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:09.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.611+0000 7f2c1824a740 1 --2- 172.21.15.2:0/1813639342 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bbf0efb40 0x560bbf0f5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:09.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.611+0000 7f2c1824a740 1 --2- 172.21.15.2:0/1813639342 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560bbf108e00 0x560bbf10b270 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:09.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.611+0000 7f2c1824a740 1 --2- 172.21.15.2:0/1813639342 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560bbf0ee5d0 0x560bbf0f8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:09.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.611+0000 7f2c1824a740 1 -- 172.21.15.2:0/1813639342 >> 172.21.15.2:0/1813639342 conn(0x560bbf0b7310 msgr2=0x560bbf0f0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:09.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.611+0000 7f2beeffd640 0 client.16554 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:57:09.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.611+0000 7f2c1824a740 1 -- 172.21.15.2:0/1813639342 shutdown_connections 2024-09-19T04:57:09.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.611+0000 7f2c1824a740 1 -- 172.21.15.2:0/1813639342 wait complete. 2024-09-19T04:57:09.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.611+0000 7f2c1824a740 20 client.16554 trim_cache size 0 max 16384 2024-09-19T04:57:09.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.624+0000 7f2c1824a740 1 Processor -- start 2024-09-19T04:57:09.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.624+0000 7f2c1824a740 1 -- start start 2024-09-19T04:57:09.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.624+0000 7f2c1824a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bbf0ee5d0 0x560bbf0f1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:09.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.624+0000 7f2c1824a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560bbf0efb40 0x560bbf0f1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:09.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.624+0000 7f2c1824a740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560bbf0f9370 0x560bbf110b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:09.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.624+0000 7f2c1824a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2c101ad9d0 con 0x560bbf0efb40 2024-09-19T04:57:09.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.624+0000 7f2c1824a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2c101b0230 con 0x560bbf0ee5d0 2024-09-19T04:57:09.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.624+0000 7f2c1824a740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f2c101ae020 con 0x560bbf0f9370 2024-09-19T04:57:09.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.624+0000 7f2c0effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560bbf0efb40 0x560bbf0f1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:09.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.624+0000 7f2c0effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560bbf0efb40 0x560bbf0f1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47710/0 (socket says 172.21.15.2:47710) 2024-09-19T04:57:09.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.624+0000 7f2c0effd640 1 -- 172.21.15.2:0/2512542353 learned_addr learned my addr 172.21.15.2:0/2512542353 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:09.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.624+0000 7f2c0f7fe640 1 --2- 172.21.15.2:0/2512542353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bbf0ee5d0 0x560bbf0f1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:09.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.625+0000 7f2c0effd640 1 -- 172.21.15.2:0/2512542353 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560bbf0f9370 msgr2=0x560bbf110b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:09.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.625+0000 7f2c0ffff640 1 --2- 172.21.15.2:0/2512542353 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560bbf0f9370 0x560bbf110b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:09.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.625+0000 7f2c0effd640 1 --2- 172.21.15.2:0/2512542353 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560bbf0f9370 0x560bbf110b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:09.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.625+0000 7f2c0effd640 1 -- 172.21.15.2:0/2512542353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bbf0ee5d0 msgr2=0x560bbf0f1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:09.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.625+0000 7f2c0effd640 1 --2- 172.21.15.2:0/2512542353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bbf0ee5d0 0x560bbf0f1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:09.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.625+0000 7f2c0effd640 1 -- 172.21.15.2:0/2512542353 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bbf0f43e0 con 0x560bbf0efb40 2024-09-19T04:57:09.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.625+0000 7f2c0ffff640 1 --2- 172.21.15.2:0/2512542353 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560bbf0f9370 0x560bbf110b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:57:09.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.625+0000 7f2c0effd640 1 --2- 172.21.15.2:0/2512542353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560bbf0efb40 0x560bbf0f1660 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f2c0409b820 tx=0x7f2c040bd040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=230f9a839e949bc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:09.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.625+0000 7f2bf57fa640 1 -- 172.21.15.2:0/2512542353 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c04020040 con 0x560bbf0efb40 2024-09-19T04:57:09.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.625+0000 7f2bf57fa640 1 -- 172.21.15.2:0/2512542353 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2c0409ce50 con 0x560bbf0efb40 2024-09-19T04:57:09.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.625+0000 7f2bf57fa640 1 -- 172.21.15.2:0/2512542353 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c04098190 con 0x560bbf0efb40 2024-09-19T04:57:09.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.626+0000 7f2c1824a740 1 -- 172.21.15.2:0/2512542353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560bbf0efb40 msgr2=0x560bbf0f1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:09.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.626+0000 7f2c1824a740 1 --2- 172.21.15.2:0/2512542353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560bbf0efb40 0x560bbf0f1660 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f2c0409b820 tx=0x7f2c040bd040 comp rx=0 tx=0).stop 2024-09-19T04:57:09.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.626+0000 7f2c1824a740 1 -- 172.21.15.2:0/2512542353 shutdown_connections 2024-09-19T04:57:09.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.626+0000 7f2c1824a740 1 --2- 172.21.15.2:0/2512542353 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560bbf0f9370 0x560bbf110b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:09.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.626+0000 7f2c1824a740 1 --2- 172.21.15.2:0/2512542353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560bbf0efb40 0x560bbf0f1660 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:09.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.626+0000 7f2c1824a740 1 --2- 172.21.15.2:0/2512542353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bbf0ee5d0 0x560bbf0f1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:09.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.626+0000 7f2c1824a740 1 -- 172.21.15.2:0/2512542353 >> 172.21.15.2:0/2512542353 conn(0x560bbf0b7310 msgr2=0x560bbf0f5e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:09.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.626+0000 7f2c1824a740 1 -- 172.21.15.2:0/2512542353 shutdown_connections 2024-09-19T04:57:09.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.626+0000 7f2c1824a740 1 -- 172.21.15.2:0/2512542353 wait complete. 2024-09-19T04:57:09.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.626+0000 7f2c1824a740 1 -- start start 2024-09-19T04:57:09.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.626+0000 7f2c1824a740 1 Processor -- start 2024-09-19T04:57:09.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.627+0000 7f2c1824a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560bbf0ee5d0 0x560bbf0f3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:09.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.627+0000 7f2c1824a740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560bbf0efb40 0x560bbf0f3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:09.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.627+0000 7f2c1824a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bbf0f9370 0x560bbf0f3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:09.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.627+0000 7f2c1824a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2c101ae6f0 con 0x560bbf0ee5d0 2024-09-19T04:57:09.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.627+0000 7f2c1824a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2c101afb60 con 0x560bbf0f9370 2024-09-19T04:57:09.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.627+0000 7f2c1824a740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f2c101aedc0 con 0x560bbf0efb40 2024-09-19T04:57:09.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.627+0000 7f2c1824a740 10 client.0 _ll_register_callbacks cb 0x7f2c08003d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:57:09.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.627+0000 7f2c0f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560bbf0ee5d0 0x560bbf0f3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:09.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.627+0000 7f2c0f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560bbf0ee5d0 0x560bbf0f3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47714/0 (socket says 172.21.15.2:47714) 2024-09-19T04:57:09.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.627+0000 7f2c0f7fe640 1 -- 172.21.15.2:0/1408794941 learned_addr learned my addr 172.21.15.2:0/1408794941 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:09.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.627+0000 7f2c0effd640 1 --2- 172.21.15.2:0/1408794941 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560bbf0efb40 0x560bbf0f3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:09.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.627+0000 7f2c0ffff640 1 --2- 172.21.15.2:0/1408794941 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bbf0f9370 0x560bbf0f3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:09.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.627+0000 7f2c0f7fe640 1 -- 172.21.15.2:0/1408794941 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560bbf0efb40 msgr2=0x560bbf0f3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:09.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.627+0000 7f2c0f7fe640 1 --2- 172.21.15.2:0/1408794941 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560bbf0efb40 0x560bbf0f3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:09.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.627+0000 7f2c0f7fe640 1 -- 172.21.15.2:0/1408794941 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bbf0f9370 msgr2=0x560bbf0f3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:09.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.627+0000 7f2c0f7fe640 1 --2- 172.21.15.2:0/1408794941 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bbf0f9370 0x560bbf0f3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:09.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.627+0000 7f2c0f7fe640 1 -- 172.21.15.2:0/1408794941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560bbf172cc0 con 0x560bbf0ee5d0 2024-09-19T04:57:09.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.627+0000 7f2c0ffff640 1 --2- 172.21.15.2:0/1408794941 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bbf0f9370 0x560bbf0f3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:57:09.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.627+0000 7f2c0f7fe640 1 --2- 172.21.15.2:0/1408794941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560bbf0ee5d0 0x560bbf0f3050 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f2c00009a30 tx=0x7f2c00009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2148187d035fb092 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:09.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.627+0000 7f2beeffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:57:09.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.628+0000 7f2beeffd640 1 -- 172.21.15.2:0/1408794941 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c00016040 con 0x560bbf0ee5d0 2024-09-19T04:57:09.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.628+0000 7f2beeffd640 1 -- 172.21.15.2:0/1408794941 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8571+0+0 (secure 0 0 0) 0x7f2c00011670 con 0x560bbf0ee5d0 2024-09-19T04:57:09.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.628+0000 7f2c1824a740 1 -- 172.21.15.2:0/1408794941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c0409ce50 con 0x560bbf0ee5d0 2024-09-19T04:57:09.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.628+0000 7f2beeffd640 1 -- 172.21.15.2:0/1408794941 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f2c00037050 con 0x560bbf0ee5d0 2024-09-19T04:57:09.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.628+0000 7f2c1824a740 10 client.16560 fetch_fsmap learned FSMap version 19 2024-09-19T04:57:09.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.628+0000 7f2c1824a740 1 -- 172.21.15.2:0/1408794941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x560bbf173f70 con 0x560bbf0ee5d0 2024-09-19T04:57:09.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.628+0000 7f2beeffd640 1 -- 172.21.15.2:0/1408794941 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2c0409ce50 con 0x560bbf0ee5d0 2024-09-19T04:57:09.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.628+0000 7f2beeffd640 1 -- 172.21.15.2:0/1408794941 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f2c0000f040 con 0x560bbf0ee5d0 2024-09-19T04:57:09.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.628+0000 7f2c1824a740 10 client.16560 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:57:09.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.628+0000 7f2c1824a740 10 client.16560 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:57:09.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.628+0000 7f2c1824a740 20 client.16560 populate_metadata read hostname 'smithi002' 2024-09-19T04:57:09.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.628+0000 7f2c1824a740 1 --2- 172.21.15.2:0/1408794941 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560bbf174640 0x560bbf176a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:09.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.628+0000 7f2c1824a740 4 client.16560 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:57:09.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.628+0000 7f2c1824a740 1 -- 172.21.15.2:0/1408794941 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560bbf05bd70 con 0x560bbf174640 2024-09-19T04:57:09.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.629+0000 7f2c0effd640 1 --2- 172.21.15.2:0/1408794941 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560bbf174640 0x560bbf176a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:09.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.629+0000 7f2c0effd640 1 --2- 172.21.15.2:0/1408794941 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560bbf174640 0x560bbf176a30 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=528dd6f6f201e3ad server_cookie=62fbd871fc9094bb in_seq=0 out_seq=0 2024-09-19T04:57:09.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.629+0000 7f2beeffd640 10 client.16560 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:57:09.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.629+0000 7f2beeffd640 1 -- 172.21.15.2:0/1408794941 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560bbf05bd70 con 0x560bbf174640 2024-09-19T04:57:09.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.629+0000 7f2beeffd640 10 client.16560 handle_command_reply: tid=0 2024-09-19T04:57:09.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.629+0000 7f2c1824a740 1 client.16560 shutdown 2024-09-19T04:57:09.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.629+0000 7f2c1824a740 1 -- 172.21.15.2:0/1408794941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560bbf0ee5d0 msgr2=0x560bbf0f3050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:09.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.629+0000 7f2c1824a740 1 --2- 172.21.15.2:0/1408794941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560bbf0ee5d0 0x560bbf0f3050 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f2c00009a30 tx=0x7f2c00009360 comp rx=0 tx=0).stop 2024-09-19T04:57:09.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.629+0000 7f2c1824a740 1 -- 172.21.15.2:0/1408794941 shutdown_connections 2024-09-19T04:57:09.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.629+0000 7f2c1824a740 1 --2- 172.21.15.2:0/1408794941 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bbf0f9370 0x560bbf0f3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:09.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.629+0000 7f2c1824a740 1 --2- 172.21.15.2:0/1408794941 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x560bbf174640 0x560bbf176a30 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:09.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.629+0000 7f2c1824a740 1 --2- 172.21.15.2:0/1408794941 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560bbf0efb40 0x560bbf0f3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:09.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.629+0000 7f2c1824a740 1 --2- 172.21.15.2:0/1408794941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560bbf0ee5d0 0x560bbf0f3050 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:09.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.629+0000 7f2c1824a740 1 -- 172.21.15.2:0/1408794941 >> 172.21.15.2:0/1408794941 conn(0x560bbf0b7310 msgr2=0x560bbf0f76f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:09.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.629+0000 7f2beeffd640 0 client.16560 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:57:09.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.629+0000 7f2c1824a740 1 -- 172.21.15.2:0/1408794941 shutdown_connections 2024-09-19T04:57:09.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.630+0000 7f2c1824a740 1 -- 172.21.15.2:0/1408794941 wait complete. 2024-09-19T04:57:09.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.630+0000 7f2c1824a740 20 client.16560 trim_cache size 0 max 16384 2024-09-19T04:57:09.638 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T04:57:09.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.630+0000 7f2c15e71640 1 -- 172.21.15.2:0/1801855788 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f2bf80a33b0 msgr2=0x7f2bf80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:09.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.630+0000 7f2c15e71640 1 --2- 172.21.15.2:0/1801855788 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f2bf80a33b0 0x7f2bf80a5870 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2c08031920 tx=0x7f2c08009910 comp rx=0 tx=0).stop 2024-09-19T04:57:09.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.630+0000 7f2c15e71640 1 -- 172.21.15.2:0/1801855788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c10101420 msgr2=0x7f2c1019aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:09.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.630+0000 7f2c15e71640 1 --2- 172.21.15.2:0/1801855788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c10101420 0x7f2c1019aa90 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f2c0400d770 tx=0x7f2c0400dc30 comp rx=0 tx=0).stop 2024-09-19T04:57:09.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.630+0000 7f2c15e71640 1 -- 172.21.15.2:0/1801855788 shutdown_connections 2024-09-19T04:57:09.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.630+0000 7f2c15e71640 1 --2- 172.21.15.2:0/1801855788 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f2bf80a33b0 0x7f2bf80a5870 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:09.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.630+0000 7f2c15e71640 1 --2- 172.21.15.2:0/1801855788 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2c10106a80 0x7f2c1019ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:09.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.630+0000 7f2c15e71640 1 --2- 172.21.15.2:0/1801855788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c10101420 0x7f2c1019aa90 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:09.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.630+0000 7f2c15e71640 1 --2- 172.21.15.2:0/1801855788 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c10100a80 0x7f2c1019a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:09.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.630+0000 7f2c15e71640 1 -- 172.21.15.2:0/1801855788 >> 172.21.15.2:0/1801855788 conn(0x7f2c100fc7a0 msgr2=0x7f2c100fcd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:09.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.630+0000 7f2c15e71640 1 -- 172.21.15.2:0/1801855788 shutdown_connections 2024-09-19T04:57:09.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:09.630+0000 7f2c15e71640 1 -- 172.21.15.2:0/1801855788 wait complete. 2024-09-19T04:57:10.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:10 smithi002 ceph-mon[30975]: pgmap v283: 97 pgs: 97 active+clean; 16 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 112 KiB/s wr, 29 op/s 2024-09-19T04:57:10.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:10 smithi018 ceph-mon[34537]: pgmap v283: 97 pgs: 97 active+clean; 16 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 112 KiB/s wr, 29 op/s 2024-09-19T04:57:10.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:10 smithi116 ceph-mon[34477]: pgmap v283: 97 pgs: 97 active+clean; 16 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 112 KiB/s wr, 29 op/s 2024-09-19T04:57:11.453 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:57:11.454 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:57:11.728 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:57:12.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.187+0000 7f2a9d088640 1 -- 172.21.15.2:0/4033427810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a981002f0 msgr2=0x7f2a981006d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:12.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.187+0000 7f2a9d088640 1 --2- 172.21.15.2:0/4033427810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a981002f0 0x7f2a981006d0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f2a88009930 tx=0x7f2a8802a420 comp rx=0 tx=0).stop 2024-09-19T04:57:12.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.187+0000 7f2a9d088640 1 -- 172.21.15.2:0/4033427810 shutdown_connections 2024-09-19T04:57:12.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.187+0000 7f2a9d088640 1 --2- 172.21.15.2:0/4033427810 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2a98106f50 0x7f2a9810eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:12.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.187+0000 7f2a9d088640 1 --2- 172.21.15.2:0/4033427810 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2a98100ca0 0x7f2a98106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:12.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.187+0000 7f2a9d088640 1 --2- 172.21.15.2:0/4033427810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a981002f0 0x7f2a981006d0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:12.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.187+0000 7f2a9d088640 1 -- 172.21.15.2:0/4033427810 >> 172.21.15.2:0/4033427810 conn(0x7f2a98077210 msgr2=0x7f2a980fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:12.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.187+0000 7f2a9d088640 1 -- 172.21.15.2:0/4033427810 shutdown_connections 2024-09-19T04:57:12.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.187+0000 7f2a9d088640 1 -- 172.21.15.2:0/4033427810 wait complete. 2024-09-19T04:57:12.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.187+0000 7f2a9d088640 1 Processor -- start 2024-09-19T04:57:12.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.188+0000 7f2a9d088640 1 -- start start 2024-09-19T04:57:12.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.188+0000 7f2a9d088640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2a981002f0 0x7f2a98198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:12.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.188+0000 7f2a9d088640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2a98100ca0 0x7f2a98198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:12.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.188+0000 7f2a9d088640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a98106f50 0x7f2a9819ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:12.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.188+0000 7f2a9d088640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2a98111f80 con 0x7f2a98106f50 2024-09-19T04:57:12.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.188+0000 7f2a9d088640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2a98111e00 con 0x7f2a981002f0 2024-09-19T04:57:12.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.188+0000 7f2a9d088640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f2a98112100 con 0x7f2a98100ca0 2024-09-19T04:57:12.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.188+0000 7f2a9759e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a98106f50 0x7f2a9819ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:12.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.188+0000 7f2a9759e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a98106f50 0x7f2a9819ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44930/0 (socket says 172.21.15.2:44930) 2024-09-19T04:57:12.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.188+0000 7f2a9759e640 1 -- 172.21.15.2:0/2226541233 learned_addr learned my addr 172.21.15.2:0/2226541233 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:12.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.188+0000 7f2a9659c640 1 --2- 172.21.15.2:0/2226541233 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2a98100ca0 0x7f2a98198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:12.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.188+0000 7f2a96d9d640 1 --2- 172.21.15.2:0/2226541233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2a981002f0 0x7f2a98198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:12.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.188+0000 7f2a9759e640 1 -- 172.21.15.2:0/2226541233 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2a98100ca0 msgr2=0x7f2a98198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:12.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.188+0000 7f2a9759e640 1 --2- 172.21.15.2:0/2226541233 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2a98100ca0 0x7f2a98198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:12.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.188+0000 7f2a9759e640 1 -- 172.21.15.2:0/2226541233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2a981002f0 msgr2=0x7f2a98198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:12.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.188+0000 7f2a9759e640 1 --2- 172.21.15.2:0/2226541233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2a981002f0 0x7f2a98198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:12.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.188+0000 7f2a9759e640 1 -- 172.21.15.2:0/2226541233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a9819d510 con 0x7f2a98106f50 2024-09-19T04:57:12.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.189+0000 7f2a9759e640 1 --2- 172.21.15.2:0/2226541233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a98106f50 0x7f2a9819ce30 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f2a9000b970 tx=0x7f2a9000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:12.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.189+0000 7f2a7ffff640 1 -- 172.21.15.2:0/2226541233 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a90019070 con 0x7f2a98106f50 2024-09-19T04:57:12.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.189+0000 7f2a7ffff640 1 -- 172.21.15.2:0/2226541233 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2a90014440 con 0x7f2a98106f50 2024-09-19T04:57:12.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.189+0000 7f2a9d088640 1 -- 172.21.15.2:0/2226541233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a9819d800 con 0x7f2a98106f50 2024-09-19T04:57:12.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.189+0000 7f2a7ffff640 1 -- 172.21.15.2:0/2226541233 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a900075d0 con 0x7f2a98106f50 2024-09-19T04:57:12.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.189+0000 7f2a9d088640 1 -- 172.21.15.2:0/2226541233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a981a50e0 con 0x7f2a98106f50 2024-09-19T04:57:12.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.191+0000 7f2a7ffff640 1 -- 172.21.15.2:0/2226541233 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f2a9001c070 con 0x7f2a98106f50 2024-09-19T04:57:12.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.191+0000 7f2a9f461740 1 Processor -- start 2024-09-19T04:57:12.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.191+0000 7f2a9f461740 1 -- start start 2024-09-19T04:57:12.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.192+0000 7f2a9f461740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f50415eb60 0x55f50415ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:12.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.192+0000 7f2a9f461740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f50415f480 0x55f504169800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:12.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.192+0000 7f2a9f461740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f504169d40 0x55f50416c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:12.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.192+0000 7f2a9f461740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f5040c4280 con 0x55f50415eb60 2024-09-19T04:57:12.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.192+0000 7f2a9f461740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f50406bb10 con 0x55f50415f480 2024-09-19T04:57:12.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.192+0000 7f2a9f461740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55f5040c0240 con 0x55f504169d40 2024-09-19T04:57:12.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.192+0000 7f2a9659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f50415eb60 0x55f50415ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:12.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.192+0000 7f2a9659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f50415eb60 0x55f50415ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44936/0 (socket says 172.21.15.2:44936) 2024-09-19T04:57:12.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.192+0000 7f2a9659c640 1 -- 172.21.15.2:0/2433308855 learned_addr learned my addr 172.21.15.2:0/2433308855 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:12.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.192+0000 7f2a7ffff640 1 --2- 172.21.15.2:0/2226541233 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f2a800a33b0 0x7f2a800a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:12.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.192+0000 7f2a96d9d640 1 --2- 172.21.15.2:0/2433308855 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f50415f480 0x55f504169800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:12.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.192+0000 7f2a9759e640 1 --2- 172.21.15.2:0/2226541233 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f2a800a33b0 0x7f2a800a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:12.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.192+0000 7f2a9659c640 1 -- 172.21.15.2:0/2433308855 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f504169d40 msgr2=0x55f50416c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:12.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.192+0000 7f2a9659c640 1 --2- 172.21.15.2:0/2433308855 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f504169d40 0x55f50416c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:12.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.192+0000 7f2a9659c640 1 -- 172.21.15.2:0/2433308855 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f50415f480 msgr2=0x55f504169800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:12.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.192+0000 7f2a9659c640 1 --2- 172.21.15.2:0/2433308855 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f50415f480 0x55f504169800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:12.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.192+0000 7f2a9659c640 1 -- 172.21.15.2:0/2433308855 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5040781f0 con 0x55f50415eb60 2024-09-19T04:57:12.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.192+0000 7f2a7ffff640 1 -- 172.21.15.2:0/2226541233 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8571+0+0 (secure 0 0 0) 0x7f2a900cf200 con 0x7f2a98106f50 2024-09-19T04:57:12.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.192+0000 7f2a9659c640 1 --2- 172.21.15.2:0/2433308855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f50415eb60 0x55f50415ef40 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c006a70 tx=0x7f2a8c009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8f65641a55bd20f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:12.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.193+0000 7f2a7d7fa640 1 -- 172.21.15.2:0/2433308855 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c020070 con 0x55f50415eb60 2024-09-19T04:57:12.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.193+0000 7f2a9759e640 1 --2- 172.21.15.2:0/2226541233 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f2a800a33b0 0x7f2a800a5870 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2a900a3d00 tx=0x7f2a9006e3f0 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:12.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.193+0000 7f2a7d7fa640 1 -- 172.21.15.2:0/2433308855 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2a8c00eba0 con 0x55f50415eb60 2024-09-19T04:57:12.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.193+0000 7f2a7d7fa640 1 -- 172.21.15.2:0/2433308855 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c01b760 con 0x55f50415eb60 2024-09-19T04:57:12.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.193+0000 7f2a9f461740 1 -- 172.21.15.2:0/2433308855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f50415eb60 msgr2=0x55f50415ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:12.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.193+0000 7f2a9f461740 1 --2- 172.21.15.2:0/2433308855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f50415eb60 0x55f50415ef40 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c006a70 tx=0x7f2a8c009f70 comp rx=0 tx=0).stop 2024-09-19T04:57:12.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.193+0000 7f2a9f461740 1 -- 172.21.15.2:0/2433308855 shutdown_connections 2024-09-19T04:57:12.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.193+0000 7f2a9f461740 1 --2- 172.21.15.2:0/2433308855 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f504169d40 0x55f50416c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:12.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.193+0000 7f2a9f461740 1 --2- 172.21.15.2:0/2433308855 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f50415f480 0x55f504169800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:12.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.193+0000 7f2a9f461740 1 --2- 172.21.15.2:0/2433308855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f50415eb60 0x55f50415ef40 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:12.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.193+0000 7f2a9f461740 1 -- 172.21.15.2:0/2433308855 >> 172.21.15.2:0/2433308855 conn(0x55f50415b0f0 msgr2=0x55f50415b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:12.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.193+0000 7f2a9f461740 1 -- 172.21.15.2:0/2433308855 shutdown_connections 2024-09-19T04:57:12.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.193+0000 7f2a9f461740 1 -- 172.21.15.2:0/2433308855 wait complete. 2024-09-19T04:57:12.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.194+0000 7f2a9f461740 1 -- start start 2024-09-19T04:57:12.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.194+0000 7f2a9f461740 1 Processor -- start 2024-09-19T04:57:12.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.194+0000 7f2a9f461740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f50415eb60 0x55f504166bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:12.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.194+0000 7f2a9f461740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f50415f480 0x55f504167130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:12.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.194+0000 7f2a9f461740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f504169d40 0x55f504167670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:12.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.194+0000 7f2a9f461740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f50416c910 con 0x55f50415f480 2024-09-19T04:57:12.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.194+0000 7f2a9f461740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f50407ef10 con 0x55f50415eb60 2024-09-19T04:57:12.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.194+0000 7f2a9f461740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55f50416ca90 con 0x55f504169d40 2024-09-19T04:57:12.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.194+0000 7f2a9f461740 10 client.0 _ll_register_callbacks cb 0x55f504047a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:57:12.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.194+0000 7f2a96d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f50415f480 0x55f504167130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:12.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.194+0000 7f2a96d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f50415f480 0x55f504167130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44946/0 (socket says 172.21.15.2:44946) 2024-09-19T04:57:12.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.194+0000 7f2a96d9d640 1 -- 172.21.15.2:0/1774356579 learned_addr learned my addr 172.21.15.2:0/1774356579 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:12.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.194+0000 7f2a9659c640 1 --2- 172.21.15.2:0/1774356579 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f504169d40 0x55f504167670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:12.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.194+0000 7f2a9659c640 1 --2- 172.21.15.2:0/1774356579 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f50415eb60 0x55f504166bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:12.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.194+0000 7f2a96d9d640 1 -- 172.21.15.2:0/1774356579 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f504169d40 msgr2=0x55f504167670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:12.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.194+0000 7f2a96d9d640 1 --2- 172.21.15.2:0/1774356579 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f504169d40 0x55f504167670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:12.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.194+0000 7f2a96d9d640 1 -- 172.21.15.2:0/1774356579 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f50415eb60 msgr2=0x55f504166bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:12.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.194+0000 7f2a96d9d640 1 --2- 172.21.15.2:0/1774356579 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f50415eb60 0x55f504166bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:12.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.194+0000 7f2a96d9d640 1 -- 172.21.15.2:0/1774356579 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f503e356a0 con 0x55f50415f480 2024-09-19T04:57:12.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.194+0000 7f2a9659c640 1 --2- 172.21.15.2:0/1774356579 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f50415eb60 0x55f504166bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:57:12.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.195+0000 7f2a96d9d640 1 --2- 172.21.15.2:0/1774356579 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f50415f480 0x55f504167130 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f2a88000c00 tx=0x7f2a88003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ab187ff6feb682a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:12.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.195+0000 7f2a7aff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:57:12.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.195+0000 7f2a7aff5640 1 -- 172.21.15.2:0/1774356579 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a88035040 con 0x55f50415f480 2024-09-19T04:57:12.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.195+0000 7f2a7aff5640 1 -- 172.21.15.2:0/1774356579 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8571+0+0 (secure 0 0 0) 0x7f2a88003c10 con 0x55f50415f480 2024-09-19T04:57:12.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.195+0000 7f2a9f461740 1 -- 172.21.15.2:0/1774356579 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a8c00eba0 con 0x55f50415f480 2024-09-19T04:57:12.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.195+0000 7f2a7aff5640 1 -- 172.21.15.2:0/1774356579 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f2a88003e10 con 0x55f50415f480 2024-09-19T04:57:12.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.195+0000 7f2a9f461740 10 client.16572 fetch_fsmap learned FSMap version 19 2024-09-19T04:57:12.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.195+0000 7f2a9f461740 1 -- 172.21.15.2:0/1774356579 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55f5041784e0 con 0x55f50415f480 2024-09-19T04:57:12.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.195+0000 7f2a7aff5640 1 -- 172.21.15.2:0/1774356579 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2a8c00eba0 con 0x55f50415f480 2024-09-19T04:57:12.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.195+0000 7f2a7aff5640 1 -- 172.21.15.2:0/1774356579 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f2a8803c730 con 0x55f50415f480 2024-09-19T04:57:12.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.195+0000 7f2a9f461740 10 client.16572 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:57:12.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.195+0000 7f2a9f461740 10 client.16572 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:57:12.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.195+0000 7f2a9f461740 20 client.16572 populate_metadata read hostname 'smithi002' 2024-09-19T04:57:12.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.195+0000 7f2a9f461740 1 --2- 172.21.15.2:0/1774356579 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f5041799a0 0x55f50417bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:12.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.195+0000 7f2a9f461740 4 client.16572 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:57:12.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.195+0000 7f2a9f461740 1 -- 172.21.15.2:0/1774356579 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f5040d17f0 con 0x55f5041799a0 2024-09-19T04:57:12.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.196+0000 7f2a9659c640 1 --2- 172.21.15.2:0/1774356579 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f5041799a0 0x55f50417bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:12.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.196+0000 7f2a7aff5640 10 client.16572 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:57:12.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.196+0000 7f2a9659c640 1 --2- 172.21.15.2:0/1774356579 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f5041799a0 0x55f50417bdb0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d9315f9f0c500e8 server_cookie=12fb2cd1848a7e2e in_seq=0 out_seq=0 2024-09-19T04:57:12.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.197+0000 7f2a7aff5640 1 -- 172.21.15.2:0/1774356579 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f5040d17f0 con 0x55f5041799a0 2024-09-19T04:57:12.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.197+0000 7f2a7aff5640 10 client.16572 handle_command_reply: tid=0 2024-09-19T04:57:12.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.197+0000 7f2a9f461740 1 client.16572 shutdown 2024-09-19T04:57:12.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.197+0000 7f2a9f461740 1 -- 172.21.15.2:0/1774356579 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f50415f480 msgr2=0x55f504167130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:12.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.197+0000 7f2a9f461740 1 --2- 172.21.15.2:0/1774356579 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f50415f480 0x55f504167130 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f2a88000c00 tx=0x7f2a88003820 comp rx=0 tx=0).stop 2024-09-19T04:57:12.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.197+0000 7f2a9f461740 1 -- 172.21.15.2:0/1774356579 shutdown_connections 2024-09-19T04:57:12.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.197+0000 7f2a9f461740 1 --2- 172.21.15.2:0/1774356579 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f5041799a0 0x55f50417bdb0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:12.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.197+0000 7f2a9f461740 1 --2- 172.21.15.2:0/1774356579 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f504169d40 0x55f504167670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:12.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.197+0000 7f2a9f461740 1 --2- 172.21.15.2:0/1774356579 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f50415f480 0x55f504167130 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:12.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.197+0000 7f2a9f461740 1 --2- 172.21.15.2:0/1774356579 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f50415eb60 0x55f504166bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:12.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.197+0000 7f2a7aff5640 0 client.16572 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:57:12.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.197+0000 7f2a9f461740 1 -- 172.21.15.2:0/1774356579 >> 172.21.15.2:0/1774356579 conn(0x55f50415b0f0 msgr2=0x55f504160e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:12.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.197+0000 7f2a9f461740 1 -- 172.21.15.2:0/1774356579 shutdown_connections 2024-09-19T04:57:12.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.197+0000 7f2a9f461740 1 -- 172.21.15.2:0/1774356579 wait complete. 2024-09-19T04:57:12.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.197+0000 7f2a9f461740 20 client.16572 trim_cache size 0 max 16384 2024-09-19T04:57:12.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.214+0000 7f2a9f461740 1 Processor -- start 2024-09-19T04:57:12.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.214+0000 7f2a9f461740 1 -- start start 2024-09-19T04:57:12.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.215+0000 7f2a9f461740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f50415eb60 0x55f5041615c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:12.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.215+0000 7f2a9f461740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f50415f480 0x55f504168a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:12.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.215+0000 7f2a9f461740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f504169d40 0x55f504181680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:12.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.215+0000 7f2a9f461740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2a981a9790 con 0x55f504169d40 2024-09-19T04:57:12.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.215+0000 7f2a9f461740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2a981abfd0 con 0x55f50415eb60 2024-09-19T04:57:12.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.215+0000 7f2a9f461740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f2a981a9de0 con 0x55f50415f480 2024-09-19T04:57:12.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.215+0000 7f2a9659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f504169d40 0x55f504181680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:12.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.215+0000 7f2a9659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f504169d40 0x55f504181680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44956/0 (socket says 172.21.15.2:44956) 2024-09-19T04:57:12.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.215+0000 7f2a9659c640 1 -- 172.21.15.2:0/1688234226 learned_addr learned my addr 172.21.15.2:0/1688234226 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:12.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.215+0000 7f2a9659c640 1 --2- 172.21.15.2:0/1688234226 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f50415eb60 0x55f5041615c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:12.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.215+0000 7f2a96d9d640 1 --2- 172.21.15.2:0/1688234226 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f50415f480 0x55f504168a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:12.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.215+0000 7f2a9659c640 1 -- 172.21.15.2:0/1688234226 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f50415f480 msgr2=0x55f504168a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:12.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.215+0000 7f2a9659c640 1 --2- 172.21.15.2:0/1688234226 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f50415f480 0x55f504168a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:12.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.215+0000 7f2a9659c640 1 -- 172.21.15.2:0/1688234226 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f50415eb60 msgr2=0x55f5041615c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:12.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.215+0000 7f2a9659c640 1 --2- 172.21.15.2:0/1688234226 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f50415eb60 0x55f5041615c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:12.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.215+0000 7f2a9659c640 1 -- 172.21.15.2:0/1688234226 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f50415f2b0 con 0x55f504169d40 2024-09-19T04:57:12.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.215+0000 7f2a96d9d640 1 --2- 172.21.15.2:0/1688234226 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f50415f480 0x55f504168a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:57:12.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.215+0000 7f2a9659c640 1 --2- 172.21.15.2:0/1688234226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f504169d40 0x55f504181680 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c009ab0 tx=0x7f2a8c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaa49d058ff2f6e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:12.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.215+0000 7f2a7cff9640 1 -- 172.21.15.2:0/1688234226 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c038070 con 0x55f504169d40 2024-09-19T04:57:12.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.216+0000 7f2a7cff9640 1 -- 172.21.15.2:0/1688234226 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2a8c009180 con 0x55f504169d40 2024-09-19T04:57:12.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.216+0000 7f2a7cff9640 1 -- 172.21.15.2:0/1688234226 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c020040 con 0x55f504169d40 2024-09-19T04:57:12.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.216+0000 7f2a9f461740 1 -- 172.21.15.2:0/1688234226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f504169d40 msgr2=0x55f504181680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:12.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.216+0000 7f2a9f461740 1 --2- 172.21.15.2:0/1688234226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f504169d40 0x55f504181680 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c009ab0 tx=0x7f2a8c008040 comp rx=0 tx=0).stop 2024-09-19T04:57:12.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.216+0000 7f2a9f461740 1 -- 172.21.15.2:0/1688234226 shutdown_connections 2024-09-19T04:57:12.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.216+0000 7f2a9f461740 1 --2- 172.21.15.2:0/1688234226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f504169d40 0x55f504181680 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:12.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.216+0000 7f2a9f461740 1 --2- 172.21.15.2:0/1688234226 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f50415f480 0x55f504168a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:12.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.216+0000 7f2a9f461740 1 --2- 172.21.15.2:0/1688234226 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f50415eb60 0x55f5041615c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:12.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.216+0000 7f2a9f461740 1 -- 172.21.15.2:0/1688234226 >> 172.21.15.2:0/1688234226 conn(0x55f50415b0f0 msgr2=0x55f504168340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:12.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.216+0000 7f2a9f461740 1 -- 172.21.15.2:0/1688234226 shutdown_connections 2024-09-19T04:57:12.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.216+0000 7f2a9f461740 1 -- 172.21.15.2:0/1688234226 wait complete. 2024-09-19T04:57:12.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.217+0000 7f2a9f461740 1 -- start start 2024-09-19T04:57:12.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.217+0000 7f2a9f461740 1 Processor -- start 2024-09-19T04:57:12.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.217+0000 7f2a9f461740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f50415eb60 0x55f504163b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:12.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.217+0000 7f2a9f461740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f50415f480 0x55f504164090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:12.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.217+0000 7f2a9f461740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f504169d40 0x55f5041645d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:12.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.217+0000 7f2a9f461740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2a981aa490 con 0x55f504169d40 2024-09-19T04:57:12.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.217+0000 7f2a9f461740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2a981ab900 con 0x55f50415f480 2024-09-19T04:57:12.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.217+0000 7f2a9f461740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f2a981aab60 con 0x55f50415eb60 2024-09-19T04:57:12.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.217+0000 7f2a9f461740 10 client.0 _ll_register_callbacks cb 0x7f2a88004540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:57:12.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.217+0000 7f2a9659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f504169d40 0x55f5041645d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:12.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.217+0000 7f2a9659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f504169d40 0x55f5041645d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44972/0 (socket says 172.21.15.2:44972) 2024-09-19T04:57:12.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.217+0000 7f2a9659c640 1 -- 172.21.15.2:0/3648441646 learned_addr learned my addr 172.21.15.2:0/3648441646 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:12.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.217+0000 7f2a9659c640 1 --2- 172.21.15.2:0/3648441646 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f50415eb60 0x55f504163b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:12.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.217+0000 7f2a96d9d640 1 --2- 172.21.15.2:0/3648441646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f50415f480 0x55f504164090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:12.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.217+0000 7f2a9659c640 1 -- 172.21.15.2:0/3648441646 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f50415eb60 msgr2=0x55f504163b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:12.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.217+0000 7f2a9659c640 1 --2- 172.21.15.2:0/3648441646 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f50415eb60 0x55f504163b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:12.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.217+0000 7f2a9659c640 1 -- 172.21.15.2:0/3648441646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f50415f480 msgr2=0x55f504164090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:12.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.217+0000 7f2a9659c640 1 --2- 172.21.15.2:0/3648441646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f50415f480 0x55f504164090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:12.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.217+0000 7f2a9659c640 1 -- 172.21.15.2:0/3648441646 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5041e3650 con 0x55f504169d40 2024-09-19T04:57:12.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.217+0000 7f2a96d9d640 1 --2- 172.21.15.2:0/3648441646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f50415f480 0x55f504164090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:57:12.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.218+0000 7f2a9659c640 1 --2- 172.21.15.2:0/3648441646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f504169d40 0x55f5041645d0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c013dd0 tx=0x7f2a8c02e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84bf8386dfac2c16 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:12.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.218+0000 7f2a7aff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:57:12.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.218+0000 7f2a7aff5640 1 -- 172.21.15.2:0/3648441646 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c020070 con 0x55f504169d40 2024-09-19T04:57:12.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.218+0000 7f2a7aff5640 1 -- 172.21.15.2:0/3648441646 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8571+0+0 (secure 0 0 0) 0x7f2a8c00eba0 con 0x55f504169d40 2024-09-19T04:57:12.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.218+0000 7f2a9f461740 1 -- 172.21.15.2:0/3648441646 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a8c009180 con 0x55f504169d40 2024-09-19T04:57:12.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.218+0000 7f2a7aff5640 1 -- 172.21.15.2:0/3648441646 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f2a8c045050 con 0x55f504169d40 2024-09-19T04:57:12.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.218+0000 7f2a9f461740 10 client.16578 fetch_fsmap learned FSMap version 19 2024-09-19T04:57:12.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.218+0000 7f2a9f461740 1 -- 172.21.15.2:0/3648441646 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55f5041e48d0 con 0x55f504169d40 2024-09-19T04:57:12.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.218+0000 7f2a7aff5640 1 -- 172.21.15.2:0/3648441646 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2a8c009180 con 0x55f504169d40 2024-09-19T04:57:12.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.218+0000 7f2a7aff5640 1 -- 172.21.15.2:0/3648441646 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f2a8c031070 con 0x55f504169d40 2024-09-19T04:57:12.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.218+0000 7f2a9f461740 10 client.16578 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:57:12.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.218+0000 7f2a9f461740 10 client.16578 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:57:12.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.218+0000 7f2a9f461740 20 client.16578 populate_metadata read hostname 'smithi002' 2024-09-19T04:57:12.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.218+0000 7f2a9f461740 1 --2- 172.21.15.2:0/3648441646 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f5041e4cb0 0x55f5041e70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:12.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.218+0000 7f2a9f461740 4 client.16578 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:57:12.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.218+0000 7f2a9f461740 1 -- 172.21.15.2:0/3648441646 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f5040cbd00 con 0x55f5041e4cb0 2024-09-19T04:57:12.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.219+0000 7f2a96d9d640 1 --2- 172.21.15.2:0/3648441646 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f5041e4cb0 0x55f5041e70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:12.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.219+0000 7f2a96d9d640 1 --2- 172.21.15.2:0/3648441646 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f5041e4cb0 0x55f5041e70a0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4d8658d828890b0 server_cookie=b17bb4561b0ce61a in_seq=0 out_seq=0 2024-09-19T04:57:12.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.219+0000 7f2a7aff5640 10 client.16578 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:57:12.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.220+0000 7f2a7aff5640 1 -- 172.21.15.2:0/3648441646 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f5040cbd00 con 0x55f5041e4cb0 2024-09-19T04:57:12.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.220+0000 7f2a7aff5640 10 client.16578 handle_command_reply: tid=0 2024-09-19T04:57:12.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.220+0000 7f2a9f461740 1 client.16578 shutdown 2024-09-19T04:57:12.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.220+0000 7f2a9f461740 1 -- 172.21.15.2:0/3648441646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f504169d40 msgr2=0x55f5041645d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:12.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.220+0000 7f2a9f461740 1 --2- 172.21.15.2:0/3648441646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f504169d40 0x55f5041645d0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c013dd0 tx=0x7f2a8c02e040 comp rx=0 tx=0).stop 2024-09-19T04:57:12.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.220+0000 7f2a9f461740 1 -- 172.21.15.2:0/3648441646 shutdown_connections 2024-09-19T04:57:12.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.220+0000 7f2a9f461740 1 --2- 172.21.15.2:0/3648441646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f504169d40 0x55f5041645d0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:12.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.220+0000 7f2a9f461740 1 --2- 172.21.15.2:0/3648441646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f50415f480 0x55f504164090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:12.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.220+0000 7f2a9f461740 1 --2- 172.21.15.2:0/3648441646 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55f5041e4cb0 0x55f5041e70a0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:12.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.220+0000 7f2a9f461740 1 --2- 172.21.15.2:0/3648441646 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f50415eb60 0x55f504163b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:12.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.220+0000 7f2a9f461740 1 -- 172.21.15.2:0/3648441646 >> 172.21.15.2:0/3648441646 conn(0x55f50415b0f0 msgr2=0x55f50415a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:12.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.220+0000 7f2a7aff5640 0 client.16578 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:57:12.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.220+0000 7f2a9f461740 1 -- 172.21.15.2:0/3648441646 shutdown_connections 2024-09-19T04:57:12.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.221+0000 7f2a9f461740 1 -- 172.21.15.2:0/3648441646 wait complete. 2024-09-19T04:57:12.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.221+0000 7f2a9f461740 20 client.16578 trim_cache size 0 max 16384 2024-09-19T04:57:12.238 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:57:12.238 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T04:57:12.238 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "8a7eb22b-0229-4d22-b3e8-3d074fd4ba40", 2024-09-19T04:57:12.238 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T04:57:12.239 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:57:12.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.221+0000 7f2a9d088640 1 -- 172.21.15.2:0/2226541233 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f2a800a33b0 msgr2=0x7f2a800a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:12.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.221+0000 7f2a9d088640 1 --2- 172.21.15.2:0/2226541233 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f2a800a33b0 0x7f2a800a5870 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2a900a3d00 tx=0x7f2a9006e3f0 comp rx=0 tx=0).stop 2024-09-19T04:57:12.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.221+0000 7f2a9d088640 1 -- 172.21.15.2:0/2226541233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a98106f50 msgr2=0x7f2a9819ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:12.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.221+0000 7f2a9d088640 1 --2- 172.21.15.2:0/2226541233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a98106f50 0x7f2a9819ce30 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f2a9000b970 tx=0x7f2a9000bd70 comp rx=0 tx=0).stop 2024-09-19T04:57:12.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.221+0000 7f2a9d088640 1 -- 172.21.15.2:0/2226541233 shutdown_connections 2024-09-19T04:57:12.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.221+0000 7f2a9d088640 1 --2- 172.21.15.2:0/2226541233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a98106f50 0x7f2a9819ce30 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:12.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.221+0000 7f2a9d088640 1 --2- 172.21.15.2:0/2226541233 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f2a800a33b0 0x7f2a800a5870 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:12.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.221+0000 7f2a9d088640 1 --2- 172.21.15.2:0/2226541233 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2a98100ca0 0x7f2a98198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:12.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.221+0000 7f2a9d088640 1 --2- 172.21.15.2:0/2226541233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2a981002f0 0x7f2a98198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:12.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.221+0000 7f2a9d088640 1 -- 172.21.15.2:0/2226541233 >> 172.21.15.2:0/2226541233 conn(0x7f2a98077210 msgr2=0x7f2a98105320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:12.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.222+0000 7f2a9d088640 1 -- 172.21.15.2:0/2226541233 shutdown_connections 2024-09-19T04:57:12.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:12.222+0000 7f2a9d088640 1 -- 172.21.15.2:0/2226541233 wait complete. 2024-09-19T04:57:12.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:12 smithi018 ceph-mon[34537]: pgmap v284: 97 pgs: 97 active+clean; 16 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 110 KiB/s wr, 29 op/s 2024-09-19T04:57:12.851 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:12 smithi002 ceph-mon[30975]: pgmap v284: 97 pgs: 97 active+clean; 16 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 110 KiB/s wr, 29 op/s 2024-09-19T04:57:12.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:12 smithi116 ceph-mon[34477]: pgmap v284: 97 pgs: 97 active+clean; 16 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 110 KiB/s wr, 29 op/s 2024-09-19T04:57:13.070 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:57:13.329 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:57:13.655 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:13 smithi002 ceph-mon[30975]: scrub queued for path: / 2024-09-19T04:57:13.655 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:13 smithi002 ceph-mon[30975]: scrub summary: idle+waiting paths [/] 2024-09-19T04:57:13.655 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:13 smithi002 ceph-mon[30975]: scrub summary: active paths [/] 2024-09-19T04:57:13.655 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:13 smithi002 ceph-mon[30975]: scrub summary: idle+waiting paths [/] 2024-09-19T04:57:13.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:13 smithi018 ceph-mon[34537]: scrub queued for path: / 2024-09-19T04:57:13.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:13 smithi018 ceph-mon[34537]: scrub summary: idle+waiting paths [/] 2024-09-19T04:57:13.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:13 smithi018 ceph-mon[34537]: scrub summary: active paths [/] 2024-09-19T04:57:13.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:13 smithi018 ceph-mon[34537]: scrub summary: idle+waiting paths [/] 2024-09-19T04:57:13.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:13 smithi116 ceph-mon[34477]: scrub queued for path: / 2024-09-19T04:57:13.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:13 smithi116 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-19T04:57:13.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:13 smithi116 ceph-mon[34477]: scrub summary: active paths [/] 2024-09-19T04:57:13.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:13 smithi116 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-19T04:57:13.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.854+0000 7f1a306c2640 1 -- 172.21.15.2:0/1176982307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a28102570 msgr2=0x7f1a281029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:13.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.854+0000 7f1a306c2640 1 --2- 172.21.15.2:0/1176982307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a28102570 0x7f1a281029b0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f1a18009900 tx=0x7f1a1802a480 comp rx=0 tx=0).stop 2024-09-19T04:57:13.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.854+0000 7f1a306c2640 1 -- 172.21.15.2:0/1176982307 shutdown_connections 2024-09-19T04:57:13.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.854+0000 7f1a306c2640 1 --2- 172.21.15.2:0/1176982307 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a28102ef0 0x7f1a2810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:13.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.854+0000 7f1a306c2640 1 --2- 172.21.15.2:0/1176982307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a28102570 0x7f1a281029b0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:13.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.854+0000 7f1a306c2640 1 --2- 172.21.15.2:0/1176982307 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a28100e20 0x7f1a28101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:13.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.854+0000 7f1a306c2640 1 -- 172.21.15.2:0/1176982307 >> 172.21.15.2:0/1176982307 conn(0x7f1a280fc7d0 msgr2=0x7f1a280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:13.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.854+0000 7f1a306c2640 1 -- 172.21.15.2:0/1176982307 shutdown_connections 2024-09-19T04:57:13.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.854+0000 7f1a306c2640 1 -- 172.21.15.2:0/1176982307 wait complete. 2024-09-19T04:57:13.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.855+0000 7f1a306c2640 1 Processor -- start 2024-09-19T04:57:13.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.855+0000 7f1a306c2640 1 -- start start 2024-09-19T04:57:13.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.855+0000 7f1a306c2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a28100e20 0x7f1a28198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:13.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.855+0000 7f1a306c2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a28102570 0x7f1a281989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:13.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.855+0000 7f1a306c2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a28102ef0 0x7f1a2819cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:13.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.855+0000 7f1a306c2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1a28110e30 con 0x7f1a28102570 2024-09-19T04:57:13.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.855+0000 7f1a306c2640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1a28110cb0 con 0x7f1a28102ef0 2024-09-19T04:57:13.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.855+0000 7f1a306c2640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f1a28110fb0 con 0x7f1a28100e20 2024-09-19T04:57:13.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.855+0000 7f1a2dc5d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a28102570 0x7f1a281989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:13.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.855+0000 7f1a2dc5d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a28102570 0x7f1a281989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44984/0 (socket says 172.21.15.2:44984) 2024-09-19T04:57:13.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.855+0000 7f1a2dc5d640 1 -- 172.21.15.2:0/253096346 learned_addr learned my addr 172.21.15.2:0/253096346 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:13.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.855+0000 7f1a2e45e640 1 --2- 172.21.15.2:0/253096346 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a28100e20 0x7f1a28198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:13.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.855+0000 7f1a2ec5f640 1 --2- 172.21.15.2:0/253096346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a28102ef0 0x7f1a2819cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:13.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.855+0000 7f1a2dc5d640 1 -- 172.21.15.2:0/253096346 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a28100e20 msgr2=0x7f1a28198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:13.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.855+0000 7f1a2dc5d640 1 --2- 172.21.15.2:0/253096346 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a28100e20 0x7f1a28198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:13.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.855+0000 7f1a2dc5d640 1 -- 172.21.15.2:0/253096346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a28102ef0 msgr2=0x7f1a2819cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:13.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.855+0000 7f1a2dc5d640 1 --2- 172.21.15.2:0/253096346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a28102ef0 0x7f1a2819cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:13.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.855+0000 7f1a2dc5d640 1 -- 172.21.15.2:0/253096346 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a2819d420 con 0x7f1a28102570 2024-09-19T04:57:13.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.856+0000 7f1a2dc5d640 1 --2- 172.21.15.2:0/253096346 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a28102570 0x7f1a281989b0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f1a18006010 tx=0x7f1a180040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:13.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.856+0000 7f1a1f7fe640 1 -- 172.21.15.2:0/253096346 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1803f030 con 0x7f1a28102570 2024-09-19T04:57:13.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.856+0000 7f1a306c2640 1 -- 172.21.15.2:0/253096346 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a2819d6b0 con 0x7f1a28102570 2024-09-19T04:57:13.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.856+0000 7f1a306c2640 1 -- 172.21.15.2:0/253096346 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a281a4ff0 con 0x7f1a28102570 2024-09-19T04:57:13.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.856+0000 7f1a1f7fe640 1 -- 172.21.15.2:0/253096346 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1a180044c0 con 0x7f1a28102570 2024-09-19T04:57:13.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.856+0000 7f1a1f7fe640 1 -- 172.21.15.2:0/253096346 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a18035070 con 0x7f1a28102570 2024-09-19T04:57:13.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.860+0000 7f1a32a9b740 1 Processor -- start 2024-09-19T04:57:13.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.860+0000 7f1a1f7fe640 1 -- 172.21.15.2:0/253096346 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f1a18042030 con 0x7f1a28102570 2024-09-19T04:57:13.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.860+0000 7f1a32a9b740 1 -- start start 2024-09-19T04:57:13.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.860+0000 7f1a32a9b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608934dc4a0 0x5608934dc880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:13.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.860+0000 7f1a32a9b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608934dcdc0 0x5608934e7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:13.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.860+0000 7f1a32a9b740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5608934e7680 0x5608934e9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:13.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.860+0000 7f1a32a9b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5608934422e0 con 0x5608934dcdc0 2024-09-19T04:57:13.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.860+0000 7f1a32a9b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5608933e9ce0 con 0x5608934dc4a0 2024-09-19T04:57:13.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.860+0000 7f1a32a9b740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x56089343e2a0 con 0x5608934e7680 2024-09-19T04:57:13.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.860+0000 7f1a2e45e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608934dcdc0 0x5608934e7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:13.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.860+0000 7f1a2ec5f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608934dc4a0 0x5608934dc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:13.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.860+0000 7f1a2e45e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608934dcdc0 0x5608934e7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44994/0 (socket says 172.21.15.2:44994) 2024-09-19T04:57:13.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.860+0000 7f1a2ec5f640 1 --2- 172.21.15.2:0/3513905765 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608934dc4a0 0x5608934dc880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.2:57670/0 (socket says 172.21.15.2:57670) 2024-09-19T04:57:13.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.860+0000 7f1a2e45e640 1 -- 172.21.15.2:0/3513905765 learned_addr learned my addr 172.21.15.2:0/3513905765 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:13.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.860+0000 7f1a2dc5d640 1 --2- 172.21.15.2:0/3513905765 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5608934e7680 0x5608934e9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:13.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.861+0000 7f1a2ec5f640 1 -- 172.21.15.2:0/3513905765 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5608934e7680 msgr2=0x5608934e9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:13.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.861+0000 7f1a2ec5f640 1 --2- 172.21.15.2:0/3513905765 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5608934e7680 0x5608934e9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:13.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.861+0000 7f1a2ec5f640 1 -- 172.21.15.2:0/3513905765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608934dcdc0 msgr2=0x5608934e7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:13.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.861+0000 7f1a2ec5f640 1 --2- 172.21.15.2:0/3513905765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608934dcdc0 0x5608934e7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:13.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.861+0000 7f1a2ec5f640 1 -- 172.21.15.2:0/3513905765 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608933ce440 con 0x5608934dc4a0 2024-09-19T04:57:13.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.861+0000 7f1a2e45e640 1 --2- 172.21.15.2:0/3513905765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608934dcdc0 0x5608934e7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:57:13.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.861+0000 7f1a2ec5f640 1 --2- 172.21.15.2:0/3513905765 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608934dc4a0 0x5608934dc880 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1a20009f00 tx=0x7f1a20011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e80a24ccc3c708c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:13.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.861+0000 7f1a1f7fe640 1 --2- 172.21.15.2:0/253096346 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f1a140a3430 0x7f1a140a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:13.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.861+0000 7f1a1cff9640 1 -- 172.21.15.2:0/3513905765 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a20004d20 con 0x5608934dc4a0 2024-09-19T04:57:13.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.861+0000 7f1a2e45e640 1 --2- 172.21.15.2:0/253096346 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f1a140a3430 0x7f1a140a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:13.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.861+0000 7f1a1cff9640 1 -- 172.21.15.2:0/3513905765 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1a20004050 con 0x5608934dc4a0 2024-09-19T04:57:13.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.861+0000 7f1a1cff9640 1 -- 172.21.15.2:0/3513905765 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a20005280 con 0x5608934dc4a0 2024-09-19T04:57:13.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.861+0000 7f1a1f7fe640 1 -- 172.21.15.2:0/253096346 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8571+0+0 (secure 0 0 0) 0x7f1a180eff70 con 0x7f1a28102570 2024-09-19T04:57:13.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.862+0000 7f1a32a9b740 1 -- 172.21.15.2:0/3513905765 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608934dc4a0 msgr2=0x5608934dc880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:13.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.862+0000 7f1a2e45e640 1 --2- 172.21.15.2:0/253096346 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f1a140a3430 0x7f1a140a58f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x5608934d9890 tx=0x7f1a24005f90 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:13.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.862+0000 7f1a32a9b740 1 --2- 172.21.15.2:0/3513905765 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608934dc4a0 0x5608934dc880 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1a20009f00 tx=0x7f1a20011810 comp rx=0 tx=0).stop 2024-09-19T04:57:13.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.862+0000 7f1a32a9b740 1 -- 172.21.15.2:0/3513905765 shutdown_connections 2024-09-19T04:57:13.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.862+0000 7f1a32a9b740 1 --2- 172.21.15.2:0/3513905765 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5608934e7680 0x5608934e9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:13.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.862+0000 7f1a32a9b740 1 --2- 172.21.15.2:0/3513905765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608934dcdc0 0x5608934e7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:13.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.862+0000 7f1a32a9b740 1 --2- 172.21.15.2:0/3513905765 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608934dc4a0 0x5608934dc880 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:13.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.862+0000 7f1a32a9b740 1 -- 172.21.15.2:0/3513905765 >> 172.21.15.2:0/3513905765 conn(0x5608934d8a30 msgr2=0x5608934d8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:13.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.862+0000 7f1a32a9b740 1 -- 172.21.15.2:0/3513905765 shutdown_connections 2024-09-19T04:57:13.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.862+0000 7f1a32a9b740 1 -- 172.21.15.2:0/3513905765 wait complete. 2024-09-19T04:57:13.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.863+0000 7f1a32a9b740 1 -- start start 2024-09-19T04:57:13.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.863+0000 7f1a32a9b740 1 Processor -- start 2024-09-19T04:57:13.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.863+0000 7f1a32a9b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608934dc4a0 0x5608934e6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:13.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.863+0000 7f1a32a9b740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5608934dcdc0 0x5608934e4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:13.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.863+0000 7f1a32a9b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608934e7680 0x5608934e47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:13.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.863+0000 7f1a32a9b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5608934ea250 con 0x5608934dc4a0 2024-09-19T04:57:13.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.863+0000 7f1a32a9b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5608933fd050 con 0x5608934e7680 2024-09-19T04:57:13.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.863+0000 7f1a32a9b740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5608934ea3d0 con 0x5608934dcdc0 2024-09-19T04:57:13.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.863+0000 7f1a32a9b740 10 client.0 _ll_register_callbacks cb 0x56089343d160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:57:13.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.863+0000 7f1a2e45e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608934dc4a0 0x5608934e6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:13.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.863+0000 7f1a2e45e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608934dc4a0 0x5608934e6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44996/0 (socket says 172.21.15.2:44996) 2024-09-19T04:57:13.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.863+0000 7f1a2e45e640 1 -- 172.21.15.2:0/889382864 learned_addr learned my addr 172.21.15.2:0/889382864 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:13.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.863+0000 7f1a2ec5f640 1 --2- 172.21.15.2:0/889382864 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608934e7680 0x5608934e47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:13.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.863+0000 7f1a2dc5d640 1 --2- 172.21.15.2:0/889382864 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5608934dcdc0 0x5608934e4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:13.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.863+0000 7f1a2e45e640 1 -- 172.21.15.2:0/889382864 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5608934dcdc0 msgr2=0x5608934e4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:13.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.863+0000 7f1a2e45e640 1 --2- 172.21.15.2:0/889382864 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5608934dcdc0 0x5608934e4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:13.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.863+0000 7f1a2e45e640 1 -- 172.21.15.2:0/889382864 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608934e7680 msgr2=0x5608934e47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:13.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.863+0000 7f1a2e45e640 1 --2- 172.21.15.2:0/889382864 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608934e7680 0x5608934e47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:13.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.863+0000 7f1a2e45e640 1 -- 172.21.15.2:0/889382864 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608931b33c0 con 0x5608934dc4a0 2024-09-19T04:57:13.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.863+0000 7f1a2ec5f640 1 --2- 172.21.15.2:0/889382864 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608934e7680 0x5608934e47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:57:13.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.864+0000 7f1a2e45e640 1 --2- 172.21.15.2:0/889382864 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608934dc4a0 0x5608934e6fc0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f1a2400fa50 tx=0x7f1a24004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=254704a91dea7d63 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:13.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.864+0000 7f1a11ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:57:13.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.864+0000 7f1a11ffb640 1 -- 172.21.15.2:0/889382864 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a2402d060 con 0x5608934dc4a0 2024-09-19T04:57:13.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.864+0000 7f1a11ffb640 1 -- 172.21.15.2:0/889382864 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8571+0+0 (secure 0 0 0) 0x7f1a24018030 con 0x5608934dc4a0 2024-09-19T04:57:13.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.864+0000 7f1a32a9b740 1 -- 172.21.15.2:0/889382864 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a20004050 con 0x5608934dc4a0 2024-09-19T04:57:13.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.864+0000 7f1a11ffb640 1 -- 172.21.15.2:0/889382864 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1a24009d20 con 0x5608934dc4a0 2024-09-19T04:57:13.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.864+0000 7f1a32a9b740 10 client.16590 fetch_fsmap learned FSMap version 19 2024-09-19T04:57:13.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.864+0000 7f1a32a9b740 1 -- 172.21.15.2:0/889382864 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5608934f5c60 con 0x5608934dc4a0 2024-09-19T04:57:13.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.864+0000 7f1a11ffb640 1 -- 172.21.15.2:0/889382864 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1a20004050 con 0x5608934dc4a0 2024-09-19T04:57:13.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.865+0000 7f1a11ffb640 1 -- 172.21.15.2:0/889382864 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f1a240306d0 con 0x5608934dc4a0 2024-09-19T04:57:13.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.865+0000 7f1a32a9b740 10 client.16590 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:57:13.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.865+0000 7f1a32a9b740 10 client.16590 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:57:13.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.865+0000 7f1a32a9b740 20 client.16590 populate_metadata read hostname 'smithi002' 2024-09-19T04:57:13.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.865+0000 7f1a32a9b740 1 --2- 172.21.15.2:0/889382864 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5608934f7120 0x5608934f9510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:13.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.865+0000 7f1a32a9b740 4 client.16590 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:57:13.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.865+0000 7f1a32a9b740 1 -- 172.21.15.2:0/889382864 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56089344f850 con 0x5608934f7120 2024-09-19T04:57:13.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.865+0000 7f1a2dc5d640 1 --2- 172.21.15.2:0/889382864 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5608934f7120 0x5608934f9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:13.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.865+0000 7f1a11ffb640 10 client.16590 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:57:13.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.865+0000 7f1a2dc5d640 1 --2- 172.21.15.2:0/889382864 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5608934f7120 0x5608934f9510 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66d4a2718898bb08 server_cookie=4179ce1341aa9440 in_seq=0 out_seq=0 2024-09-19T04:57:13.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.866+0000 7f1a11ffb640 1 -- 172.21.15.2:0/889382864 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56089344f850 con 0x5608934f7120 2024-09-19T04:57:13.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.866+0000 7f1a11ffb640 10 client.16590 handle_command_reply: tid=0 2024-09-19T04:57:13.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.866+0000 7f1a32a9b740 1 client.16590 shutdown 2024-09-19T04:57:13.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.866+0000 7f1a32a9b740 1 -- 172.21.15.2:0/889382864 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608934dc4a0 msgr2=0x5608934e6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:13.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.866+0000 7f1a32a9b740 1 --2- 172.21.15.2:0/889382864 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608934dc4a0 0x5608934e6fc0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f1a2400fa50 tx=0x7f1a24004730 comp rx=0 tx=0).stop 2024-09-19T04:57:13.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.866+0000 7f1a32a9b740 1 -- 172.21.15.2:0/889382864 shutdown_connections 2024-09-19T04:57:13.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.866+0000 7f1a32a9b740 1 --2- 172.21.15.2:0/889382864 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608934e7680 0x5608934e47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:13.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.866+0000 7f1a32a9b740 1 --2- 172.21.15.2:0/889382864 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5608934f7120 0x5608934f9510 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:13.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.866+0000 7f1a11ffb640 0 client.16590 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:57:13.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.866+0000 7f1a32a9b740 1 --2- 172.21.15.2:0/889382864 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5608934dcdc0 0x5608934e4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:13.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.866+0000 7f1a32a9b740 1 --2- 172.21.15.2:0/889382864 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608934dc4a0 0x5608934e6fc0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:13.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.866+0000 7f1a32a9b740 1 -- 172.21.15.2:0/889382864 >> 172.21.15.2:0/889382864 conn(0x5608934d8a30 msgr2=0x5608934d7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:13.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.866+0000 7f1a32a9b740 1 -- 172.21.15.2:0/889382864 shutdown_connections 2024-09-19T04:57:13.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.866+0000 7f1a32a9b740 1 -- 172.21.15.2:0/889382864 wait complete. 2024-09-19T04:57:13.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.867+0000 7f1a32a9b740 20 client.16590 trim_cache size 0 max 16384 2024-09-19T04:57:13.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.884+0000 7f1a32a9b740 1 Processor -- start 2024-09-19T04:57:13.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.884+0000 7f1a32a9b740 1 -- start start 2024-09-19T04:57:13.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.884+0000 7f1a32a9b740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5608934d8a30 0x5608934f34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:13.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.884+0000 7f1a32a9b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608934dc4a0 0x5608934de650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:13.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.884+0000 7f1a32a9b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608934dcdc0 0x5608934fedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:13.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.884+0000 7f1a32a9b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1a281ab820 con 0x5608934dc4a0 2024-09-19T04:57:13.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.884+0000 7f1a32a9b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1a281ae080 con 0x5608934dcdc0 2024-09-19T04:57:13.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.884+0000 7f1a32a9b740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f1a281abe70 con 0x5608934d8a30 2024-09-19T04:57:13.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.884+0000 7f1a2dc5d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608934dc4a0 0x5608934de650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:13.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.884+0000 7f1a2e45e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5608934d8a30 0x5608934f34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:13.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.884+0000 7f1a2dc5d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608934dc4a0 0x5608934de650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45000/0 (socket says 172.21.15.2:45000) 2024-09-19T04:57:13.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.884+0000 7f1a2dc5d640 1 -- 172.21.15.2:0/1566449334 learned_addr learned my addr 172.21.15.2:0/1566449334 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:13.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.884+0000 7f1a2ec5f640 1 --2- 172.21.15.2:0/1566449334 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608934dcdc0 0x5608934fedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:13.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.884+0000 7f1a2dc5d640 1 -- 172.21.15.2:0/1566449334 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5608934d8a30 msgr2=0x5608934f34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:13.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.884+0000 7f1a2dc5d640 1 --2- 172.21.15.2:0/1566449334 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5608934d8a30 0x5608934f34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:13.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.884+0000 7f1a2dc5d640 1 -- 172.21.15.2:0/1566449334 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608934dcdc0 msgr2=0x5608934fedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:13.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.884+0000 7f1a2dc5d640 1 --2- 172.21.15.2:0/1566449334 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608934dcdc0 0x5608934fedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:13.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.884+0000 7f1a2dc5d640 1 -- 172.21.15.2:0/1566449334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608934dc2d0 con 0x5608934dc4a0 2024-09-19T04:57:13.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.885+0000 7f1a2e45e640 1 --2- 172.21.15.2:0/1566449334 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5608934d8a30 0x5608934f34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:57:13.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.885+0000 7f1a2dc5d640 1 --2- 172.21.15.2:0/1566449334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608934dc4a0 0x5608934de650 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f1a180edc90 tx=0x7f1a180dc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7db1b7e04678d192 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:13.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.885+0000 7f1a13fff640 1 -- 172.21.15.2:0/1566449334 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a180d5070 con 0x5608934dc4a0 2024-09-19T04:57:13.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.885+0000 7f1a13fff640 1 -- 172.21.15.2:0/1566449334 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1a180d5210 con 0x5608934dc4a0 2024-09-19T04:57:13.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.885+0000 7f1a13fff640 1 -- 172.21.15.2:0/1566449334 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a18049040 con 0x5608934dc4a0 2024-09-19T04:57:13.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.886+0000 7f1a32a9b740 1 -- 172.21.15.2:0/1566449334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608934dc4a0 msgr2=0x5608934de650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:13.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.886+0000 7f1a32a9b740 1 --2- 172.21.15.2:0/1566449334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608934dc4a0 0x5608934de650 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f1a180edc90 tx=0x7f1a180dc040 comp rx=0 tx=0).stop 2024-09-19T04:57:13.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.886+0000 7f1a32a9b740 1 -- 172.21.15.2:0/1566449334 shutdown_connections 2024-09-19T04:57:13.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.886+0000 7f1a32a9b740 1 --2- 172.21.15.2:0/1566449334 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608934dcdc0 0x5608934fedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:13.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.886+0000 7f1a32a9b740 1 --2- 172.21.15.2:0/1566449334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608934dc4a0 0x5608934de650 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:13.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.886+0000 7f1a32a9b740 1 --2- 172.21.15.2:0/1566449334 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5608934d8a30 0x5608934f34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:13.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.886+0000 7f1a32a9b740 1 -- 172.21.15.2:0/1566449334 >> 172.21.15.2:0/1566449334 conn(0x5608934e4910 msgr2=0x5608934ddf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:13.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.886+0000 7f1a32a9b740 1 -- 172.21.15.2:0/1566449334 shutdown_connections 2024-09-19T04:57:13.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.886+0000 7f1a32a9b740 1 -- 172.21.15.2:0/1566449334 wait complete. 2024-09-19T04:57:13.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.886+0000 7f1a32a9b740 1 -- start start 2024-09-19T04:57:13.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.886+0000 7f1a32a9b740 1 Processor -- start 2024-09-19T04:57:13.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.886+0000 7f1a32a9b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608934d8a30 0x5608934efd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:13.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.887+0000 7f1a32a9b740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5608934dc4a0 0x5608934eb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:13.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.887+0000 7f1a32a9b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608934dcdc0 0x5608934eb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:13.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.887+0000 7f1a32a9b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1a281ac540 con 0x5608934d8a30 2024-09-19T04:57:13.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.887+0000 7f1a32a9b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1a281ad9b0 con 0x5608934dcdc0 2024-09-19T04:57:13.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.887+0000 7f1a32a9b740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f1a281acc10 con 0x5608934dc4a0 2024-09-19T04:57:13.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.887+0000 7f1a32a9b740 10 client.0 _ll_register_callbacks cb 0x7f1a2400f910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:57:13.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.887+0000 7f1a2e45e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608934d8a30 0x5608934efd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:13.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.887+0000 7f1a2e45e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608934d8a30 0x5608934efd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45016/0 (socket says 172.21.15.2:45016) 2024-09-19T04:57:13.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.887+0000 7f1a2dc5d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5608934dc4a0 0x5608934eb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:13.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.887+0000 7f1a2ec5f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608934dcdc0 0x5608934eb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:13.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.887+0000 7f1a2e45e640 1 -- 172.21.15.2:0/3785092491 learned_addr learned my addr 172.21.15.2:0/3785092491 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:13.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.887+0000 7f1a2e45e640 1 -- 172.21.15.2:0/3785092491 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5608934dc4a0 msgr2=0x5608934eb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:13.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.887+0000 7f1a2e45e640 1 --2- 172.21.15.2:0/3785092491 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5608934dc4a0 0x5608934eb090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:13.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.887+0000 7f1a2e45e640 1 -- 172.21.15.2:0/3785092491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608934dcdc0 msgr2=0x5608934eb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:13.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.887+0000 7f1a2e45e640 1 --2- 172.21.15.2:0/3785092491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608934dcdc0 0x5608934eb5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:13.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.887+0000 7f1a2e45e640 1 -- 172.21.15.2:0/3785092491 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608934ebe00 con 0x5608934d8a30 2024-09-19T04:57:13.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.887+0000 7f1a2ec5f640 1 --2- 172.21.15.2:0/3785092491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608934dcdc0 0x5608934eb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:57:13.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.887+0000 7f1a2e45e640 1 --2- 172.21.15.2:0/3785092491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608934d8a30 0x5608934efd60 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f1a24030ce0 tx=0x7f1a24009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5e66bce3dc94117 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:13.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.887+0000 7f1a11ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:57:13.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.887+0000 7f1a11ffb640 1 -- 172.21.15.2:0/3785092491 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a2400fe50 con 0x5608934d8a30 2024-09-19T04:57:13.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.887+0000 7f1a11ffb640 1 -- 172.21.15.2:0/3785092491 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8571+0+0 (secure 0 0 0) 0x7f1a2401d830 con 0x5608934d8a30 2024-09-19T04:57:13.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.887+0000 7f1a32a9b740 1 -- 172.21.15.2:0/3785092491 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a180d5210 con 0x5608934d8a30 2024-09-19T04:57:13.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.888+0000 7f1a11ffb640 1 -- 172.21.15.2:0/3785092491 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1a2401da30 con 0x5608934d8a30 2024-09-19T04:57:13.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.888+0000 7f1a32a9b740 10 client.16596 fetch_fsmap learned FSMap version 19 2024-09-19T04:57:13.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.888+0000 7f1a32a9b740 1 -- 172.21.15.2:0/3785092491 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x560893561d80 con 0x5608934d8a30 2024-09-19T04:57:13.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.888+0000 7f1a11ffb640 1 -- 172.21.15.2:0/3785092491 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1a180d5210 con 0x5608934d8a30 2024-09-19T04:57:13.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.888+0000 7f1a11ffb640 1 -- 172.21.15.2:0/3785092491 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f1a24041070 con 0x5608934d8a30 2024-09-19T04:57:13.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.888+0000 7f1a32a9b740 10 client.16596 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:57:13.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.888+0000 7f1a32a9b740 10 client.16596 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:57:13.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.888+0000 7f1a32a9b740 20 client.16596 populate_metadata read hostname 'smithi002' 2024-09-19T04:57:13.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.888+0000 7f1a32a9b740 1 --2- 172.21.15.2:0/3785092491 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5608934e7680 0x5608935644e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:13.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.888+0000 7f1a32a9b740 4 client.16596 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:57:13.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.888+0000 7f1a32a9b740 1 -- 172.21.15.2:0/3785092491 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560893449d60 con 0x5608934e7680 2024-09-19T04:57:13.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.888+0000 7f1a2dc5d640 1 --2- 172.21.15.2:0/3785092491 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5608934e7680 0x5608935644e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:13.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.889+0000 7f1a11ffb640 10 client.16596 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:57:13.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.889+0000 7f1a2dc5d640 1 --2- 172.21.15.2:0/3785092491 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5608934e7680 0x5608935644e0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=884692b9017d6bce server_cookie=b9321ae6ac42c6ee in_seq=0 out_seq=0 2024-09-19T04:57:13.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.889+0000 7f1a11ffb640 1 -- 172.21.15.2:0/3785092491 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x560893449d60 con 0x5608934e7680 2024-09-19T04:57:13.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.889+0000 7f1a11ffb640 10 client.16596 handle_command_reply: tid=0 2024-09-19T04:57:13.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.889+0000 7f1a32a9b740 1 client.16596 shutdown 2024-09-19T04:57:13.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.889+0000 7f1a32a9b740 1 -- 172.21.15.2:0/3785092491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608934d8a30 msgr2=0x5608934efd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:13.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.889+0000 7f1a32a9b740 1 --2- 172.21.15.2:0/3785092491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608934d8a30 0x5608934efd60 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f1a24030ce0 tx=0x7f1a24009ee0 comp rx=0 tx=0).stop 2024-09-19T04:57:13.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.889+0000 7f1a32a9b740 1 -- 172.21.15.2:0/3785092491 shutdown_connections 2024-09-19T04:57:13.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.889+0000 7f1a32a9b740 1 --2- 172.21.15.2:0/3785092491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608934dcdc0 0x5608934eb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:13.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.889+0000 7f1a32a9b740 1 --2- 172.21.15.2:0/3785092491 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5608934e7680 0x5608935644e0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:13.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.889+0000 7f1a32a9b740 1 --2- 172.21.15.2:0/3785092491 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5608934dc4a0 0x5608934eb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:13.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.889+0000 7f1a32a9b740 1 --2- 172.21.15.2:0/3785092491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5608934d8a30 0x5608934efd60 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:13.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.889+0000 7f1a32a9b740 1 -- 172.21.15.2:0/3785092491 >> 172.21.15.2:0/3785092491 conn(0x5608934e4910 msgr2=0x5608934df850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:13.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.889+0000 7f1a11ffb640 0 client.16596 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:57:13.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.889+0000 7f1a32a9b740 1 -- 172.21.15.2:0/3785092491 shutdown_connections 2024-09-19T04:57:13.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.889+0000 7f1a32a9b740 1 -- 172.21.15.2:0/3785092491 wait complete. 2024-09-19T04:57:13.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.890+0000 7f1a32a9b740 20 client.16596 trim_cache size 0 max 16384 2024-09-19T04:57:13.897 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:57:13.898 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T04:57:13.898 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-19T04:57:13.898 INFO:teuthology.orchestra.run.smithi002.stdout: "8a7eb22b-0229-4d22-b3e8-3d074fd4ba40": { 2024-09-19T04:57:13.898 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-19T04:57:13.898 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "8a7eb22b-0229-4d22-b3e8-3d074fd4ba40", 2024-09-19T04:57:13.898 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-19T04:57:13.898 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:57:13.898 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:57:13.898 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:57:13.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.890+0000 7f1a306c2640 1 -- 172.21.15.2:0/253096346 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f1a140a3430 msgr2=0x7f1a140a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:13.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.890+0000 7f1a306c2640 1 --2- 172.21.15.2:0/253096346 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f1a140a3430 0x7f1a140a58f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x5608934d9890 tx=0x7f1a24005f90 comp rx=0 tx=0).stop 2024-09-19T04:57:13.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.890+0000 7f1a306c2640 1 -- 172.21.15.2:0/253096346 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a28102570 msgr2=0x7f1a281989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:13.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.890+0000 7f1a306c2640 1 --2- 172.21.15.2:0/253096346 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a28102570 0x7f1a281989b0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f1a18006010 tx=0x7f1a180040c0 comp rx=0 tx=0).stop 2024-09-19T04:57:13.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.890+0000 7f1a306c2640 1 -- 172.21.15.2:0/253096346 shutdown_connections 2024-09-19T04:57:13.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.890+0000 7f1a306c2640 1 --2- 172.21.15.2:0/253096346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a28102ef0 0x7f1a2819cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:13.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.890+0000 7f1a306c2640 1 --2- 172.21.15.2:0/253096346 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a28102570 0x7f1a281989b0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:13.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.890+0000 7f1a306c2640 1 --2- 172.21.15.2:0/253096346 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f1a140a3430 0x7f1a140a58f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:13.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.890+0000 7f1a306c2640 1 --2- 172.21.15.2:0/253096346 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a28100e20 0x7f1a28198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:13.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.890+0000 7f1a306c2640 1 -- 172.21.15.2:0/253096346 >> 172.21.15.2:0/253096346 conn(0x7f1a280fc7d0 msgr2=0x7f1a2806a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:13.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.890+0000 7f1a306c2640 1 -- 172.21.15.2:0/253096346 shutdown_connections 2024-09-19T04:57:13.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:13.890+0000 7f1a306c2640 1 -- 172.21.15.2:0/253096346 wait complete. 2024-09-19T04:57:14.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:14 smithi002 ceph-mon[30975]: pgmap v285: 97 pgs: 97 active+clean; 16 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 110 KiB/s wr, 29 op/s 2024-09-19T04:57:14.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:14 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:57:14.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:14 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:57:14.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:14 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:57:14.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:14 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:57:14.686 INFO:tasks.cephfs.filesystem:scrub status for tag:8a7eb22b-0229-4d22-b3e8-3d074fd4ba40 - {'path': '/', 'tag': '8a7eb22b-0229-4d22-b3e8-3d074fd4ba40', 'options': 'recursive,force'} 2024-09-19T04:57:14.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:14 smithi018 ceph-mon[34537]: pgmap v285: 97 pgs: 97 active+clean; 16 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 110 KiB/s wr, 29 op/s 2024-09-19T04:57:14.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:14 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:57:14.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:14 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:57:14.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:14 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:57:14.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:14 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:57:14.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:14 smithi116 ceph-mon[34477]: pgmap v285: 97 pgs: 97 active+clean; 16 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 110 KiB/s wr, 29 op/s 2024-09-19T04:57:14.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:14 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:57:14.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:14 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:57:14.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:14 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:57:14.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:14 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:57:16.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:16 smithi018 ceph-mon[34537]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T04:57:16.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:16 smithi018 ceph-mon[34537]: pgmap v287: 97 pgs: 97 active+clean; 17 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 55 KiB/s wr, 8 op/s 2024-09-19T04:57:16.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:16 smithi018 ceph-mon[34537]: scrub summary: idle 2024-09-19T04:57:16.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:16 smithi002 ceph-mon[30975]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T04:57:16.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:16 smithi002 ceph-mon[30975]: pgmap v287: 97 pgs: 97 active+clean; 17 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 55 KiB/s wr, 8 op/s 2024-09-19T04:57:16.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:16 smithi002 ceph-mon[30975]: scrub summary: idle 2024-09-19T04:57:16.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:16 smithi116 ceph-mon[34477]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T04:57:16.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:16 smithi116 ceph-mon[34477]: pgmap v287: 97 pgs: 97 active+clean; 17 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 55 KiB/s wr, 8 op/s 2024-09-19T04:57:16.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:16 smithi116 ceph-mon[34477]: scrub summary: idle 2024-09-19T04:57:18.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:18 smithi002 ceph-mon[30975]: pgmap v288: 97 pgs: 97 active+clean; 17 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 54 KiB/s wr, 8 op/s 2024-09-19T04:57:18.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:18 smithi018 ceph-mon[34537]: pgmap v288: 97 pgs: 97 active+clean; 17 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 54 KiB/s wr, 8 op/s 2024-09-19T04:57:18.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:18 smithi116 ceph-mon[34477]: pgmap v288: 97 pgs: 97 active+clean; 17 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 54 KiB/s wr, 8 op/s 2024-09-19T04:57:20.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:20 smithi018 ceph-mon[34537]: pgmap v289: 97 pgs: 97 active+clean; 17 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 54 KiB/s wr, 8 op/s 2024-09-19T04:57:20.859 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:20 smithi002 ceph-mon[30975]: pgmap v289: 97 pgs: 97 active+clean; 17 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 54 KiB/s wr, 8 op/s 2024-09-19T04:57:20.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:20 smithi116 ceph-mon[34477]: pgmap v289: 97 pgs: 97 active+clean; 17 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 54 KiB/s wr, 8 op/s 2024-09-19T04:57:22.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:22 smithi018 ceph-mon[34537]: pgmap v290: 97 pgs: 97 active+clean; 17 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 60 KiB/s wr, 8 op/s 2024-09-19T04:57:22.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:22 smithi002 ceph-mon[30975]: pgmap v290: 97 pgs: 97 active+clean; 17 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 60 KiB/s wr, 8 op/s 2024-09-19T04:57:22.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:22 smithi116 ceph-mon[34477]: pgmap v290: 97 pgs: 97 active+clean; 17 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 60 KiB/s wr, 8 op/s 2024-09-19T04:57:24.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:24 smithi018 ceph-mon[34537]: pgmap v291: 97 pgs: 97 active+clean; 17 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 60 KiB/s wr, 8 op/s 2024-09-19T04:57:24.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:24 smithi002 ceph-mon[30975]: pgmap v291: 97 pgs: 97 active+clean; 17 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 60 KiB/s wr, 8 op/s 2024-09-19T04:57:24.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:24 smithi116 ceph-mon[34477]: pgmap v291: 97 pgs: 97 active+clean; 17 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 60 KiB/s wr, 8 op/s 2024-09-19T04:57:26.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:26 smithi018 ceph-mon[34537]: pgmap v292: 97 pgs: 97 active+clean; 17 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 90 KiB/s wr, 13 op/s 2024-09-19T04:57:26.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:26 smithi002 ceph-mon[30975]: pgmap v292: 97 pgs: 97 active+clean; 17 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 90 KiB/s wr, 13 op/s 2024-09-19T04:57:26.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:26 smithi116 ceph-mon[34477]: pgmap v292: 97 pgs: 97 active+clean; 17 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 90 KiB/s wr, 13 op/s 2024-09-19T04:57:28.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:28 smithi018 ceph-mon[34537]: pgmap v293: 97 pgs: 97 active+clean; 17 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 49 KiB/s wr, 7 op/s 2024-09-19T04:57:28.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:28 smithi002 ceph-mon[30975]: pgmap v293: 97 pgs: 97 active+clean; 17 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 49 KiB/s wr, 7 op/s 2024-09-19T04:57:28.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:28 smithi116 ceph-mon[34477]: pgmap v293: 97 pgs: 97 active+clean; 17 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 49 KiB/s wr, 7 op/s 2024-09-19T04:57:30.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:30 smithi018 ceph-mon[34537]: pgmap v294: 97 pgs: 97 active+clean; 17 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 49 KiB/s wr, 7 op/s 2024-09-19T04:57:30.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:30 smithi002 ceph-mon[30975]: pgmap v294: 97 pgs: 97 active+clean; 17 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 49 KiB/s wr, 7 op/s 2024-09-19T04:57:30.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:30 smithi116 ceph-mon[34477]: pgmap v294: 97 pgs: 97 active+clean; 17 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 49 KiB/s wr, 7 op/s 2024-09-19T04:57:32.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:32 smithi018 ceph-mon[34537]: pgmap v295: 97 pgs: 97 active+clean; 17 MiB data, 486 MiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 72 KiB/s wr, 11 op/s 2024-09-19T04:57:32.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:32 smithi002 ceph-mon[30975]: pgmap v295: 97 pgs: 97 active+clean; 17 MiB data, 486 MiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 72 KiB/s wr, 11 op/s 2024-09-19T04:57:32.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:32 smithi116 ceph-mon[34477]: pgmap v295: 97 pgs: 97 active+clean; 17 MiB data, 486 MiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 72 KiB/s wr, 11 op/s 2024-09-19T04:57:33.445 INFO:tasks.workunit.client.0.smithi002.stdout:437/600: open fd = 3 2024-09-19T04:57:33.445 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.445 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.445 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.445 INFO:tasks.workunit.client.0.smithi002.stdout:438/600: open fd = 3 2024-09-19T04:57:33.445 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.445 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.445 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.446 INFO:tasks.workunit.client.0.smithi002.stdout:439/600: open fd = 3 2024-09-19T04:57:33.446 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.446 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.446 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.446 INFO:tasks.workunit.client.0.smithi002.stdout:440/600: open fd = 3 2024-09-19T04:57:33.446 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.446 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.446 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.446 INFO:tasks.workunit.client.0.smithi002.stdout:441/600: open fd = 3 2024-09-19T04:57:33.446 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.446 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.446 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.446 INFO:tasks.workunit.client.0.smithi002.stdout:442/600: open fd = 3 2024-09-19T04:57:33.446 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.447 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.447 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.447 INFO:tasks.workunit.client.0.smithi002.stdout:443/600: open fd = 3 2024-09-19T04:57:33.447 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.447 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.447 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.447 INFO:tasks.workunit.client.0.smithi002.stdout:444/600: open fd = 3 2024-09-19T04:57:33.447 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.447 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.447 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.447 INFO:tasks.workunit.client.0.smithi002.stdout:445/600: open fd = 3 2024-09-19T04:57:33.447 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.447 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.448 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.448 INFO:tasks.workunit.client.0.smithi002.stdout:446/600: open fd = 3 2024-09-19T04:57:33.448 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.448 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.448 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.448 INFO:tasks.workunit.client.0.smithi002.stdout:447/600: open fd = 3 2024-09-19T04:57:33.448 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.448 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.448 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.448 INFO:tasks.workunit.client.0.smithi002.stdout:448/600: open fd = 3 2024-09-19T04:57:33.448 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.448 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.448 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.448 INFO:tasks.workunit.client.0.smithi002.stdout:449/600: open fd = 3 2024-09-19T04:57:33.449 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.449 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.449 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.449 INFO:tasks.workunit.client.0.smithi002.stdout:450/600: open fd = 3 2024-09-19T04:57:33.449 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.449 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.449 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.449 INFO:tasks.workunit.client.0.smithi002.stdout:451/600: open fd = 3 2024-09-19T04:57:33.449 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.449 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.449 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.449 INFO:tasks.workunit.client.0.smithi002.stdout:452/600: open fd = 3 2024-09-19T04:57:33.449 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.449 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.450 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.450 INFO:tasks.workunit.client.0.smithi002.stdout:453/600: open fd = 3 2024-09-19T04:57:33.450 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.450 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.450 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.450 INFO:tasks.workunit.client.0.smithi002.stdout:454/600: open fd = 3 2024-09-19T04:57:33.450 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.450 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.450 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.450 INFO:tasks.workunit.client.0.smithi002.stdout:455/600: open fd = 3 2024-09-19T04:57:33.450 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.450 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.450 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.450 INFO:tasks.workunit.client.0.smithi002.stdout:456/600: open fd = 3 2024-09-19T04:57:33.450 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.451 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.451 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.451 INFO:tasks.workunit.client.0.smithi002.stdout:457/600: open fd = 3 2024-09-19T04:57:33.451 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.451 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.451 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.451 INFO:tasks.workunit.client.0.smithi002.stdout:458/600: open fd = 3 2024-09-19T04:57:33.451 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.451 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.451 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.451 INFO:tasks.workunit.client.0.smithi002.stdout:459/600: open fd = 3 2024-09-19T04:57:33.451 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.451 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.451 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.451 INFO:tasks.workunit.client.0.smithi002.stdout:460/600: open fd = 3 2024-09-19T04:57:33.451 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.452 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.452 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.452 INFO:tasks.workunit.client.0.smithi002.stdout:461/600: open fd = 3 2024-09-19T04:57:33.452 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.452 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.452 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.452 INFO:tasks.workunit.client.0.smithi002.stdout:462/600: open fd = 3 2024-09-19T04:57:33.452 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.452 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.452 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.452 INFO:tasks.workunit.client.0.smithi002.stdout:463/600: open fd = 3 2024-09-19T04:57:33.452 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.452 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.452 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.453 INFO:tasks.workunit.client.0.smithi002.stdout:464/600: open fd = 3 2024-09-19T04:57:33.453 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.453 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.453 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.453 INFO:tasks.workunit.client.0.smithi002.stdout:465/600: open fd = 3 2024-09-19T04:57:33.453 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.453 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.453 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.453 INFO:tasks.workunit.client.0.smithi002.stdout:466/600: open fd = 3 2024-09-19T04:57:33.453 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.453 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.453 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.453 INFO:tasks.workunit.client.0.smithi002.stdout:467/600: open fd = 3 2024-09-19T04:57:33.453 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.454 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.454 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.454 INFO:tasks.workunit.client.0.smithi002.stdout:468/600: open fd = 3 2024-09-19T04:57:33.454 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.454 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.454 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.454 INFO:tasks.workunit.client.0.smithi002.stdout:469/600: open fd = 3 2024-09-19T04:57:33.454 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.454 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.454 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.454 INFO:tasks.workunit.client.0.smithi002.stdout:470/600: open fd = 3 2024-09-19T04:57:33.454 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.454 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.454 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.454 INFO:tasks.workunit.client.0.smithi002.stdout:471/600: open fd = 3 2024-09-19T04:57:33.455 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.455 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.455 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.455 INFO:tasks.workunit.client.0.smithi002.stdout:472/600: open fd = 3 2024-09-19T04:57:33.455 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.455 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.455 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.455 INFO:tasks.workunit.client.0.smithi002.stdout:473/600: open fd = 3 2024-09-19T04:57:33.455 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.455 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.455 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.455 INFO:tasks.workunit.client.0.smithi002.stdout:474/600: open fd = 3 2024-09-19T04:57:33.455 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.455 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.456 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.456 INFO:tasks.workunit.client.0.smithi002.stdout:475/600: open fd = 3 2024-09-19T04:57:33.456 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.456 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.456 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.456 INFO:tasks.workunit.client.0.smithi002.stdout:476/600: open fd = 3 2024-09-19T04:57:33.456 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.456 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.456 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.456 INFO:tasks.workunit.client.0.smithi002.stdout:477/600: open fd = 3 2024-09-19T04:57:33.456 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.456 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.456 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.457 INFO:tasks.workunit.client.0.smithi002.stdout:478/600: open fd = 3 2024-09-19T04:57:33.457 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.457 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.457 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.457 INFO:tasks.workunit.client.0.smithi002.stdout:479/600: open fd = 3 2024-09-19T04:57:33.457 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.457 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.457 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.457 INFO:tasks.workunit.client.0.smithi002.stdout:480/600: open fd = 3 2024-09-19T04:57:33.457 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.457 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.457 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.457 INFO:tasks.workunit.client.0.smithi002.stdout:481/600: open fd = 3 2024-09-19T04:57:33.457 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.458 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.458 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.458 INFO:tasks.workunit.client.0.smithi002.stdout:482/600: open fd = 3 2024-09-19T04:57:33.458 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.458 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.458 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.458 INFO:tasks.workunit.client.0.smithi002.stdout:483/600: open fd = 3 2024-09-19T04:57:33.458 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.458 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.458 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.458 INFO:tasks.workunit.client.0.smithi002.stdout:484/600: open fd = 3 2024-09-19T04:57:33.458 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.458 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.458 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.458 INFO:tasks.workunit.client.0.smithi002.stdout:485/600: open fd = 3 2024-09-19T04:57:33.459 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.459 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.459 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.459 INFO:tasks.workunit.client.0.smithi002.stdout:486/600: open fd = 3 2024-09-19T04:57:33.459 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.459 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.459 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.459 INFO:tasks.workunit.client.0.smithi002.stdout:487/600: open fd = 3 2024-09-19T04:57:33.459 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.459 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.459 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.459 INFO:tasks.workunit.client.0.smithi002.stdout:488/600: open fd = 3 2024-09-19T04:57:33.459 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.459 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.459 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.460 INFO:tasks.workunit.client.0.smithi002.stdout:489/600: open fd = 3 2024-09-19T04:57:33.460 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.460 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.460 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.460 INFO:tasks.workunit.client.0.smithi002.stdout:490/600: open fd = 3 2024-09-19T04:57:33.460 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.460 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.460 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.460 INFO:tasks.workunit.client.0.smithi002.stdout:491/600: open fd = 3 2024-09-19T04:57:33.460 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.460 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.460 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.460 INFO:tasks.workunit.client.0.smithi002.stdout:492/600: open fd = 3 2024-09-19T04:57:33.460 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.460 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.461 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.461 INFO:tasks.workunit.client.0.smithi002.stdout:493/600: open fd = 3 2024-09-19T04:57:33.461 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.461 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.461 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.461 INFO:tasks.workunit.client.0.smithi002.stdout:494/600: open fd = 3 2024-09-19T04:57:33.461 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.461 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.461 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.461 INFO:tasks.workunit.client.0.smithi002.stdout:495/600: open fd = 3 2024-09-19T04:57:33.461 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.461 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.461 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.461 INFO:tasks.workunit.client.0.smithi002.stdout:496/600: open fd = 3 2024-09-19T04:57:33.462 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.462 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.462 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.462 INFO:tasks.workunit.client.0.smithi002.stdout:497/600: open fd = 3 2024-09-19T04:57:33.462 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.462 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.462 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:33.462 INFO:tasks.workunit.client.0.smithi002.stdout:498/600: open fd = 3 2024-09-19T04:57:33.462 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.462 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:57:33.462 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:57:34.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:34 smithi018 ceph-mon[34537]: pgmap v296: 97 pgs: 97 active+clean; 17 MiB data, 486 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 49 KiB/s wr, 7 op/s 2024-09-19T04:57:34.859 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:34 smithi002 ceph-mon[30975]: pgmap v296: 97 pgs: 97 active+clean; 17 MiB data, 486 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 49 KiB/s wr, 7 op/s 2024-09-19T04:57:34.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:34 smithi116 ceph-mon[34477]: pgmap v296: 97 pgs: 97 active+clean; 17 MiB data, 486 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 49 KiB/s wr, 7 op/s 2024-09-19T04:57:36.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:36 smithi018 ceph-mon[34537]: pgmap v297: 97 pgs: 97 active+clean; 18 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 76 KiB/s wr, 11 op/s 2024-09-19T04:57:36.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:36 smithi002 ceph-mon[30975]: pgmap v297: 97 pgs: 97 active+clean; 18 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 76 KiB/s wr, 11 op/s 2024-09-19T04:57:36.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:36 smithi116 ceph-mon[34477]: pgmap v297: 97 pgs: 97 active+clean; 18 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 76 KiB/s wr, 11 op/s 2024-09-19T04:57:38.662 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:38 smithi002 ceph-mon[30975]: pgmap v298: 97 pgs: 97 active+clean; 18 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 50 KiB/s wr, 8 op/s 2024-09-19T04:57:38.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:38 smithi018 ceph-mon[34537]: pgmap v298: 97 pgs: 97 active+clean; 18 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 50 KiB/s wr, 8 op/s 2024-09-19T04:57:38.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:38 smithi116 ceph-mon[34477]: pgmap v298: 97 pgs: 97 active+clean; 18 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 50 KiB/s wr, 8 op/s 2024-09-19T04:57:40.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:40 smithi018 ceph-mon[34537]: pgmap v299: 97 pgs: 97 active+clean; 18 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 50 KiB/s wr, 8 op/s 2024-09-19T04:57:40.859 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:40 smithi002 ceph-mon[30975]: pgmap v299: 97 pgs: 97 active+clean; 18 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 50 KiB/s wr, 8 op/s 2024-09-19T04:57:40.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:40 smithi116 ceph-mon[34477]: pgmap v299: 97 pgs: 97 active+clean; 18 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 50 KiB/s wr, 8 op/s 2024-09-19T04:57:42.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:42 smithi018 ceph-mon[34537]: pgmap v300: 97 pgs: 97 active+clean; 18 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 73 KiB/s wr, 11 op/s 2024-09-19T04:57:42.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:42 smithi002 ceph-mon[30975]: pgmap v300: 97 pgs: 97 active+clean; 18 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 73 KiB/s wr, 11 op/s 2024-09-19T04:57:42.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:42 smithi116 ceph-mon[34477]: pgmap v300: 97 pgs: 97 active+clean; 18 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 73 KiB/s wr, 11 op/s 2024-09-19T04:57:44.687 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:57:44.718 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:44 smithi002 ceph-mon[30975]: pgmap v301: 97 pgs: 97 active+clean; 18 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 49 KiB/s wr, 7 op/s 2024-09-19T04:57:44.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:44 smithi018 ceph-mon[34537]: pgmap v301: 97 pgs: 97 active+clean; 18 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 49 KiB/s wr, 7 op/s 2024-09-19T04:57:44.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:44 smithi116 ceph-mon[34477]: pgmap v301: 97 pgs: 97 active+clean; 18 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 49 KiB/s wr, 7 op/s 2024-09-19T04:57:44.962 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:57:45.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.487+0000 7f31ac19a640 1 -- 172.21.15.2:0/1533414899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31a4101420 msgr2=0x7f31a410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:45.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.487+0000 7f31ac19a640 1 --2- 172.21.15.2:0/1533414899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31a4101420 0x7f31a410d950 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f319c009cd0 tx=0x7f319c02a8e0 comp rx=0 tx=0).stop 2024-09-19T04:57:45.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.487+0000 7f31ac19a640 1 -- 172.21.15.2:0/1533414899 shutdown_connections 2024-09-19T04:57:45.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.487+0000 7f31ac19a640 1 --2- 172.21.15.2:0/1533414899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31a4101420 0x7f31a410d950 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:45.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.487+0000 7f31ac19a640 1 --2- 172.21.15.2:0/1533414899 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f31a4100a80 0x7f31a4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:45.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.487+0000 7f31ac19a640 1 --2- 172.21.15.2:0/1533414899 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31a4106a80 0x7f31a4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:45.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.487+0000 7f31ac19a640 1 -- 172.21.15.2:0/1533414899 >> 172.21.15.2:0/1533414899 conn(0x7f31a40fc7a0 msgr2=0x7f31a40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:45.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.487+0000 7f31ac19a640 1 -- 172.21.15.2:0/1533414899 shutdown_connections 2024-09-19T04:57:45.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.487+0000 7f31ac19a640 1 -- 172.21.15.2:0/1533414899 wait complete. 2024-09-19T04:57:45.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.488+0000 7f31ac19a640 1 Processor -- start 2024-09-19T04:57:45.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.488+0000 7f31ac19a640 1 -- start start 2024-09-19T04:57:45.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.488+0000 7f31ac19a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31a4100a80 0x7f31a419a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:45.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.488+0000 7f31ac19a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31a4101420 0x7f31a419aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:45.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.488+0000 7f31ac19a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f31a4106a80 0x7f31a419edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:45.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.488+0000 7f31ac19a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f31a4110d30 con 0x7f31a4100a80 2024-09-19T04:57:45.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.488+0000 7f31ac19a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f31a4110bb0 con 0x7f31a4101420 2024-09-19T04:57:45.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.488+0000 7f31ac19a640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f31a4110eb0 con 0x7f31a4106a80 2024-09-19T04:57:45.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.488+0000 7f31a9f36640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31a4100a80 0x7f31a419a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:45.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.488+0000 7f31a9f36640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31a4100a80 0x7f31a419a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58732/0 (socket says 172.21.15.2:58732) 2024-09-19T04:57:45.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.488+0000 7f31a9f36640 1 -- 172.21.15.2:0/3282046675 learned_addr learned my addr 172.21.15.2:0/3282046675 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:45.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.488+0000 7f31a9735640 1 --2- 172.21.15.2:0/3282046675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31a4101420 0x7f31a419aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:45.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.488+0000 7f31aa737640 1 --2- 172.21.15.2:0/3282046675 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f31a4106a80 0x7f31a419edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:45.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.488+0000 7f31a9f36640 1 -- 172.21.15.2:0/3282046675 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f31a4106a80 msgr2=0x7f31a419edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:45.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.488+0000 7f31a9f36640 1 --2- 172.21.15.2:0/3282046675 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f31a4106a80 0x7f31a419edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:45.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.488+0000 7f31a9f36640 1 -- 172.21.15.2:0/3282046675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31a4101420 msgr2=0x7f31a419aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:45.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.488+0000 7f31a9f36640 1 --2- 172.21.15.2:0/3282046675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31a4101420 0x7f31a419aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:45.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.488+0000 7f31a9f36640 1 -- 172.21.15.2:0/3282046675 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31a419f4d0 con 0x7f31a4100a80 2024-09-19T04:57:45.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.488+0000 7f31a9735640 1 --2- 172.21.15.2:0/3282046675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31a4101420 0x7f31a419aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:57:45.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.488+0000 7f31aa737640 1 --2- 172.21.15.2:0/3282046675 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f31a4106a80 0x7f31a419edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:57:45.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.489+0000 7f31a9f36640 1 --2- 172.21.15.2:0/3282046675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31a4100a80 0x7f31a419a520 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f31a000d950 tx=0x7f31a000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:45.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.489+0000 7f319affd640 1 -- 172.21.15.2:0/3282046675 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a0017070 con 0x7f31a4100a80 2024-09-19T04:57:45.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.489+0000 7f319affd640 1 -- 172.21.15.2:0/3282046675 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f31a0009c30 con 0x7f31a4100a80 2024-09-19T04:57:45.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.489+0000 7f31ac19a640 1 -- 172.21.15.2:0/3282046675 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31a419f7c0 con 0x7f31a4100a80 2024-09-19T04:57:45.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.489+0000 7f319affd640 1 -- 172.21.15.2:0/3282046675 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a000f620 con 0x7f31a4100a80 2024-09-19T04:57:45.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.489+0000 7f31ac19a640 1 -- 172.21.15.2:0/3282046675 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31a41a70a0 con 0x7f31a4100a80 2024-09-19T04:57:45.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.491+0000 7f319affd640 1 -- 172.21.15.2:0/3282046675 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f31a00109a0 con 0x7f31a4100a80 2024-09-19T04:57:45.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.491+0000 7f31ae573740 1 Processor -- start 2024-09-19T04:57:45.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.492+0000 7f31ae573740 1 -- start start 2024-09-19T04:57:45.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.492+0000 7f31ae573740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fb2ebb84a0 0x55fb2ebb8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:45.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.492+0000 7f31ae573740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fb2ebb8dc0 0x55fb2ebc3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:45.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.492+0000 7f31ae573740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb2ebc3680 0x55fb2ebc5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:45.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.492+0000 7f31ae573740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fb2eb1e2e0 con 0x55fb2ebc3680 2024-09-19T04:57:45.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.492+0000 7f31ae573740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55fb2eac5ce0 con 0x55fb2ebb84a0 2024-09-19T04:57:45.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.492+0000 7f31ae573740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55fb2eb1a2a0 con 0x55fb2ebb8dc0 2024-09-19T04:57:45.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.492+0000 7f31a9735640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb2ebc3680 0x55fb2ebc5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:45.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.492+0000 7f31a9735640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb2ebc3680 0x55fb2ebc5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58734/0 (socket says 172.21.15.2:58734) 2024-09-19T04:57:45.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.492+0000 7f31a9735640 1 -- 172.21.15.2:0/4022869667 learned_addr learned my addr 172.21.15.2:0/4022869667 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:45.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.492+0000 7f31aa737640 1 --2- 172.21.15.2:0/4022869667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fb2ebb84a0 0x55fb2ebb8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:45.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.492+0000 7f31a9f36640 1 --2- 172.21.15.2:0/4022869667 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fb2ebb8dc0 0x55fb2ebc3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:45.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.492+0000 7f319affd640 1 --2- 172.21.15.2:0/3282046675 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f31900a3430 0x7f31900a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:45.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.492+0000 7f31a9735640 1 -- 172.21.15.2:0/4022869667 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fb2ebb8dc0 msgr2=0x55fb2ebc3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:45.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.492+0000 7f31a9735640 1 --2- 172.21.15.2:0/4022869667 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fb2ebb8dc0 0x55fb2ebc3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:45.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.493+0000 7f31a9735640 1 -- 172.21.15.2:0/4022869667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fb2ebb84a0 msgr2=0x55fb2ebb8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:45.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.493+0000 7f31a9735640 1 --2- 172.21.15.2:0/4022869667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fb2ebb84a0 0x55fb2ebb8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:45.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.493+0000 7f31a9735640 1 -- 172.21.15.2:0/4022869667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb2eaaa440 con 0x55fb2ebc3680 2024-09-19T04:57:45.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.493+0000 7f31aa737640 1 --2- 172.21.15.2:0/3282046675 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f31900a3430 0x7f31900a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:45.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.493+0000 7f319affd640 1 -- 172.21.15.2:0/3282046675 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8527+0+0 (secure 0 0 0) 0x7f31a00cf960 con 0x7f31a4100a80 2024-09-19T04:57:45.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.493+0000 7f31a9735640 1 --2- 172.21.15.2:0/4022869667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb2ebc3680 0x55fb2ebc5a70 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f3194009cf0 tx=0x7f31940117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0bb3ebf873f780a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:45.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.493+0000 7f318ffff640 1 -- 172.21.15.2:0/4022869667 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3194012450 con 0x55fb2ebc3680 2024-09-19T04:57:45.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.493+0000 7f318ffff640 1 -- 172.21.15.2:0/4022869667 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3194012aa0 con 0x55fb2ebc3680 2024-09-19T04:57:45.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.493+0000 7f318ffff640 1 -- 172.21.15.2:0/4022869667 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f319400fbf0 con 0x55fb2ebc3680 2024-09-19T04:57:45.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.494+0000 7f31ae573740 1 -- 172.21.15.2:0/4022869667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb2ebc3680 msgr2=0x55fb2ebc5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:45.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.494+0000 7f31ae573740 1 --2- 172.21.15.2:0/4022869667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb2ebc3680 0x55fb2ebc5a70 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f3194009cf0 tx=0x7f31940117b0 comp rx=0 tx=0).stop 2024-09-19T04:57:45.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.494+0000 7f31aa737640 1 --2- 172.21.15.2:0/3282046675 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f31900a3430 0x7f31900a58f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f319c004af0 tx=0x7f319c0095c0 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:45.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.494+0000 7f31ae573740 1 -- 172.21.15.2:0/4022869667 shutdown_connections 2024-09-19T04:57:45.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.494+0000 7f31ae573740 1 --2- 172.21.15.2:0/4022869667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb2ebc3680 0x55fb2ebc5a70 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:45.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.494+0000 7f31ae573740 1 --2- 172.21.15.2:0/4022869667 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fb2ebb8dc0 0x55fb2ebc3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:45.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.494+0000 7f31ae573740 1 --2- 172.21.15.2:0/4022869667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fb2ebb84a0 0x55fb2ebb8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:45.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.494+0000 7f31ae573740 1 -- 172.21.15.2:0/4022869667 >> 172.21.15.2:0/4022869667 conn(0x55fb2ebb4a30 msgr2=0x55fb2ebb4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:45.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.494+0000 7f31ae573740 1 -- 172.21.15.2:0/4022869667 shutdown_connections 2024-09-19T04:57:45.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.494+0000 7f31ae573740 1 -- 172.21.15.2:0/4022869667 wait complete. 2024-09-19T04:57:45.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.494+0000 7f31ae573740 1 -- start start 2024-09-19T04:57:45.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.494+0000 7f31ae573740 1 Processor -- start 2024-09-19T04:57:45.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.495+0000 7f31ae573740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fb2ebb84a0 0x55fb2ebc2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:45.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.495+0000 7f31ae573740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb2ebb8dc0 0x55fb2ebc0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:45.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.495+0000 7f31ae573740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fb2ebc3680 0x55fb2ebc06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:45.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.495+0000 7f31ae573740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fb2ebc6250 con 0x55fb2ebb8dc0 2024-09-19T04:57:45.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.495+0000 7f31ae573740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55fb2ead9050 con 0x55fb2ebc3680 2024-09-19T04:57:45.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.495+0000 7f31ae573740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55fb2ebc63d0 con 0x55fb2ebb84a0 2024-09-19T04:57:45.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.495+0000 7f31ae573740 10 client.0 _ll_register_callbacks cb 0x55fb2eb19160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:57:45.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.495+0000 7f31a9735640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb2ebb8dc0 0x55fb2ebc0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:45.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.495+0000 7f31a9735640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb2ebb8dc0 0x55fb2ebc0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58748/0 (socket says 172.21.15.2:58748) 2024-09-19T04:57:45.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.495+0000 7f31a9735640 1 -- 172.21.15.2:0/769875943 learned_addr learned my addr 172.21.15.2:0/769875943 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:45.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.495+0000 7f31a9f36640 1 --2- 172.21.15.2:0/769875943 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fb2ebb84a0 0x55fb2ebc2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:45.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.495+0000 7f31aa737640 1 --2- 172.21.15.2:0/769875943 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fb2ebc3680 0x55fb2ebc06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:45.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.495+0000 7f31a9735640 1 -- 172.21.15.2:0/769875943 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fb2ebb84a0 msgr2=0x55fb2ebc2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:45.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.495+0000 7f31a9735640 1 --2- 172.21.15.2:0/769875943 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fb2ebb84a0 0x55fb2ebc2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:45.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.495+0000 7f31a9735640 1 -- 172.21.15.2:0/769875943 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fb2ebc3680 msgr2=0x55fb2ebc06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:45.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.495+0000 7f31a9735640 1 --2- 172.21.15.2:0/769875943 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fb2ebc3680 0x55fb2ebc06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:45.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.495+0000 7f31a9735640 1 -- 172.21.15.2:0/769875943 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb2e88f3c0 con 0x55fb2ebb8dc0 2024-09-19T04:57:45.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.495+0000 7f31aa737640 1 --2- 172.21.15.2:0/769875943 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fb2ebc3680 0x55fb2ebc06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:57:45.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.495+0000 7f31a9735640 1 --2- 172.21.15.2:0/769875943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb2ebb8dc0 0x55fb2ebc0190 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f319401c040 tx=0x7f319400f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a9a5baa6d8884ca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:45.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.495+0000 7f318d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:57:45.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.496+0000 7f318d7fa640 1 -- 172.21.15.2:0/769875943 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3194029020 con 0x55fb2ebb8dc0 2024-09-19T04:57:45.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.496+0000 7f318d7fa640 1 -- 172.21.15.2:0/769875943 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8527+0+0 (secure 0 0 0) 0x7f3194004040 con 0x55fb2ebb8dc0 2024-09-19T04:57:45.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.496+0000 7f31ae573740 1 -- 172.21.15.2:0/769875943 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3194012aa0 con 0x55fb2ebb8dc0 2024-09-19T04:57:45.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.496+0000 7f318d7fa640 1 -- 172.21.15.2:0/769875943 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f3194034050 con 0x55fb2ebb8dc0 2024-09-19T04:57:45.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.496+0000 7f31ae573740 10 client.16608 fetch_fsmap learned FSMap version 19 2024-09-19T04:57:45.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.496+0000 7f31ae573740 1 -- 172.21.15.2:0/769875943 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55fb2ebd1b40 con 0x55fb2ebb8dc0 2024-09-19T04:57:45.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.496+0000 7f318d7fa640 1 -- 172.21.15.2:0/769875943 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3194012aa0 con 0x55fb2ebb8dc0 2024-09-19T04:57:45.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.496+0000 7f318d7fa640 1 -- 172.21.15.2:0/769875943 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f319400fd10 con 0x55fb2ebb8dc0 2024-09-19T04:57:45.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.496+0000 7f31ae573740 10 client.16608 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:57:45.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.496+0000 7f31ae573740 10 client.16608 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:57:45.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.496+0000 7f31ae573740 20 client.16608 populate_metadata read hostname 'smithi002' 2024-09-19T04:57:45.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.496+0000 7f31ae573740 1 --2- 172.21.15.2:0/769875943 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55fb2ebd3000 0x55fb2ebd53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:45.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.496+0000 7f31ae573740 4 client.16608 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:57:45.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.496+0000 7f31ae573740 1 -- 172.21.15.2:0/769875943 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fb2eb2b850 con 0x55fb2ebd3000 2024-09-19T04:57:45.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.497+0000 7f31a9f36640 1 --2- 172.21.15.2:0/769875943 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55fb2ebd3000 0x55fb2ebd53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:45.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.497+0000 7f31a9f36640 1 --2- 172.21.15.2:0/769875943 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55fb2ebd3000 0x55fb2ebd53f0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=484dfa554da52c55 server_cookie=52553550e6eb3777 in_seq=0 out_seq=0 2024-09-19T04:57:45.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.497+0000 7f318d7fa640 10 client.16608 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:57:45.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.498+0000 7f318d7fa640 1 -- 172.21.15.2:0/769875943 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fb2eb2b850 con 0x55fb2ebd3000 2024-09-19T04:57:45.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.498+0000 7f318d7fa640 10 client.16608 handle_command_reply: tid=0 2024-09-19T04:57:45.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.498+0000 7f31ae573740 1 client.16608 shutdown 2024-09-19T04:57:45.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.498+0000 7f31ae573740 1 -- 172.21.15.2:0/769875943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb2ebb8dc0 msgr2=0x55fb2ebc0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:45.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.498+0000 7f31ae573740 1 --2- 172.21.15.2:0/769875943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb2ebb8dc0 0x55fb2ebc0190 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f319401c040 tx=0x7f319400f5f0 comp rx=0 tx=0).stop 2024-09-19T04:57:45.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.498+0000 7f31ae573740 1 -- 172.21.15.2:0/769875943 shutdown_connections 2024-09-19T04:57:45.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.498+0000 7f31ae573740 1 --2- 172.21.15.2:0/769875943 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fb2ebc3680 0x55fb2ebc06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:45.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.498+0000 7f31ae573740 1 --2- 172.21.15.2:0/769875943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb2ebb8dc0 0x55fb2ebc0190 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:45.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.498+0000 7f31ae573740 1 --2- 172.21.15.2:0/769875943 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55fb2ebd3000 0x55fb2ebd53f0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:45.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.498+0000 7f31ae573740 1 --2- 172.21.15.2:0/769875943 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fb2ebb84a0 0x55fb2ebc2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:45.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.498+0000 7f31ae573740 1 -- 172.21.15.2:0/769875943 >> 172.21.15.2:0/769875943 conn(0x55fb2ebb4a30 msgr2=0x55fb2ebba710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:45.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.498+0000 7f318d7fa640 0 client.16608 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:57:45.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.498+0000 7f31ae573740 1 -- 172.21.15.2:0/769875943 shutdown_connections 2024-09-19T04:57:45.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.498+0000 7f31ae573740 1 -- 172.21.15.2:0/769875943 wait complete. 2024-09-19T04:57:45.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.498+0000 7f31ae573740 20 client.16608 trim_cache size 0 max 16384 2024-09-19T04:57:45.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.515+0000 7f31ae573740 1 Processor -- start 2024-09-19T04:57:45.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.515+0000 7f31ae573740 1 -- start start 2024-09-19T04:57:45.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.516+0000 7f31ae573740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb2ebb84a0 0x55fb2ebbb900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:45.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.516+0000 7f31ae573740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fb2ebb8dc0 0x55fb2ebc2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:45.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.516+0000 7f31ae573740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fb2ebc3680 0x55fb2ebdaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:45.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.516+0000 7f31ae573740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f31a41ad9b0 con 0x55fb2ebb84a0 2024-09-19T04:57:45.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.516+0000 7f31ae573740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f31a41b0210 con 0x55fb2ebc3680 2024-09-19T04:57:45.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.516+0000 7f31ae573740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f31a41ae000 con 0x55fb2ebb8dc0 2024-09-19T04:57:45.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.516+0000 7f31a9f36640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb2ebb84a0 0x55fb2ebbb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:45.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.516+0000 7f31a9f36640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb2ebb84a0 0x55fb2ebbb900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58758/0 (socket says 172.21.15.2:58758) 2024-09-19T04:57:45.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.516+0000 7f31a9f36640 1 -- 172.21.15.2:0/508232477 learned_addr learned my addr 172.21.15.2:0/508232477 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:45.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.516+0000 7f31a9735640 1 --2- 172.21.15.2:0/508232477 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fb2ebb8dc0 0x55fb2ebc2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:45.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.516+0000 7f31aa737640 1 --2- 172.21.15.2:0/508232477 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fb2ebc3680 0x55fb2ebdaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:45.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.516+0000 7f31a9f36640 1 -- 172.21.15.2:0/508232477 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fb2ebb8dc0 msgr2=0x55fb2ebc2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:45.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.516+0000 7f31a9f36640 1 --2- 172.21.15.2:0/508232477 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fb2ebb8dc0 0x55fb2ebc2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:45.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.516+0000 7f31a9f36640 1 -- 172.21.15.2:0/508232477 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fb2ebc3680 msgr2=0x55fb2ebdaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:45.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.516+0000 7f31a9f36640 1 --2- 172.21.15.2:0/508232477 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fb2ebc3680 0x55fb2ebdaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:45.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.516+0000 7f31a9f36640 1 -- 172.21.15.2:0/508232477 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb2ebb4860 con 0x55fb2ebb84a0 2024-09-19T04:57:45.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.516+0000 7f31aa737640 1 --2- 172.21.15.2:0/508232477 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fb2ebc3680 0x55fb2ebdaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:57:45.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.516+0000 7f31a9f36640 1 --2- 172.21.15.2:0/508232477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb2ebb84a0 0x55fb2ebbb900 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f31a00cd6b0 tx=0x7f31a00d1e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baecd3e538e9d34 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:45.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.517+0000 7f318f7fe640 1 -- 172.21.15.2:0/508232477 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a0020040 con 0x55fb2ebb84a0 2024-09-19T04:57:45.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.517+0000 7f318f7fe640 1 -- 172.21.15.2:0/508232477 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f31a009c340 con 0x55fb2ebb84a0 2024-09-19T04:57:45.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.517+0000 7f318f7fe640 1 -- 172.21.15.2:0/508232477 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a00cd330 con 0x55fb2ebb84a0 2024-09-19T04:57:45.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.517+0000 7f31ae573740 1 -- 172.21.15.2:0/508232477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb2ebb84a0 msgr2=0x55fb2ebbb900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:45.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.517+0000 7f31ae573740 1 --2- 172.21.15.2:0/508232477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb2ebb84a0 0x55fb2ebbb900 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f31a00cd6b0 tx=0x7f31a00d1e70 comp rx=0 tx=0).stop 2024-09-19T04:57:45.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.517+0000 7f31ae573740 1 -- 172.21.15.2:0/508232477 shutdown_connections 2024-09-19T04:57:45.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.517+0000 7f31ae573740 1 --2- 172.21.15.2:0/508232477 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fb2ebc3680 0x55fb2ebdaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:45.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.517+0000 7f31ae573740 1 --2- 172.21.15.2:0/508232477 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fb2ebb8dc0 0x55fb2ebc2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:45.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.517+0000 7f31ae573740 1 --2- 172.21.15.2:0/508232477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb2ebb84a0 0x55fb2ebbb900 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:45.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.517+0000 7f31ae573740 1 -- 172.21.15.2:0/508232477 >> 172.21.15.2:0/508232477 conn(0x55fb2ebb4a30 msgr2=0x55fb2ebc19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:45.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.517+0000 7f31ae573740 1 -- 172.21.15.2:0/508232477 shutdown_connections 2024-09-19T04:57:45.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.517+0000 7f31ae573740 1 -- 172.21.15.2:0/508232477 wait complete. 2024-09-19T04:57:45.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.518+0000 7f31ae573740 1 -- start start 2024-09-19T04:57:45.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.518+0000 7f31ae573740 1 Processor -- start 2024-09-19T04:57:45.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.518+0000 7f31ae573740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fb2ebb84a0 0x55fb2ebcba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:45.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.518+0000 7f31ae573740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb2ebb8dc0 0x55fb2ebbcb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:45.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.518+0000 7f31ae573740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fb2ebc3680 0x55fb2ebbd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:45.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.518+0000 7f31ae573740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f31a41ae6d0 con 0x55fb2ebb8dc0 2024-09-19T04:57:45.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.518+0000 7f31ae573740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f31a41afb40 con 0x55fb2ebb84a0 2024-09-19T04:57:45.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.518+0000 7f31ae573740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f31a41aeda0 con 0x55fb2ebc3680 2024-09-19T04:57:45.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.518+0000 7f31ae573740 10 client.0 _ll_register_callbacks cb 0x7f3194005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:57:45.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.518+0000 7f31a9735640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb2ebb8dc0 0x55fb2ebbcb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:45.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.518+0000 7f31a9735640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb2ebb8dc0 0x55fb2ebbcb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58768/0 (socket says 172.21.15.2:58768) 2024-09-19T04:57:45.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.518+0000 7f31a9735640 1 -- 172.21.15.2:0/3673690893 learned_addr learned my addr 172.21.15.2:0/3673690893 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:45.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.519+0000 7f31aa737640 1 --2- 172.21.15.2:0/3673690893 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fb2ebc3680 0x55fb2ebbd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:45.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.519+0000 7f31a9f36640 1 --2- 172.21.15.2:0/3673690893 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fb2ebb84a0 0x55fb2ebcba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:45.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.519+0000 7f31a9735640 1 -- 172.21.15.2:0/3673690893 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fb2ebc3680 msgr2=0x55fb2ebbd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:45.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.519+0000 7f31a9735640 1 --2- 172.21.15.2:0/3673690893 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fb2ebc3680 0x55fb2ebbd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:45.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.519+0000 7f31a9735640 1 -- 172.21.15.2:0/3673690893 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fb2ebb84a0 msgr2=0x55fb2ebcba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:45.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.519+0000 7f31a9735640 1 --2- 172.21.15.2:0/3673690893 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fb2ebb84a0 0x55fb2ebcba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:45.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.519+0000 7f31a9735640 1 -- 172.21.15.2:0/3673690893 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb2ebbd5d0 con 0x55fb2ebb8dc0 2024-09-19T04:57:45.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.519+0000 7f31a9f36640 1 --2- 172.21.15.2:0/3673690893 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fb2ebb84a0 0x55fb2ebcba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:57:45.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.519+0000 7f31a9735640 1 --2- 172.21.15.2:0/3673690893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb2ebb8dc0 0x55fb2ebbcb50 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f3194003690 tx=0x7f3194003f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a78f45fbc03ca643 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:45.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.519+0000 7f318d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:57:45.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.519+0000 7f318d7fa640 1 -- 172.21.15.2:0/3673690893 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f319403e060 con 0x55fb2ebb8dc0 2024-09-19T04:57:45.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.519+0000 7f318d7fa640 1 -- 172.21.15.2:0/3673690893 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8527+0+0 (secure 0 0 0) 0x7f31940050b0 con 0x55fb2ebb8dc0 2024-09-19T04:57:45.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.519+0000 7f31ae573740 1 -- 172.21.15.2:0/3673690893 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31a009c340 con 0x55fb2ebb8dc0 2024-09-19T04:57:45.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.519+0000 7f318d7fa640 1 -- 172.21.15.2:0/3673690893 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f3194029040 con 0x55fb2ebb8dc0 2024-09-19T04:57:45.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.519+0000 7f31ae573740 10 client.16614 fetch_fsmap learned FSMap version 19 2024-09-19T04:57:45.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.519+0000 7f31ae573740 1 -- 172.21.15.2:0/3673690893 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55fb2ec3d680 con 0x55fb2ebb8dc0 2024-09-19T04:57:45.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.520+0000 7f318d7fa640 1 -- 172.21.15.2:0/3673690893 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f31a009c340 con 0x55fb2ebb8dc0 2024-09-19T04:57:45.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.520+0000 7f318d7fa640 1 -- 172.21.15.2:0/3673690893 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f31940124c0 con 0x55fb2ebb8dc0 2024-09-19T04:57:45.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.520+0000 7f31ae573740 10 client.16614 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:57:45.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.520+0000 7f31ae573740 10 client.16614 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:57:45.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.520+0000 7f31ae573740 20 client.16614 populate_metadata read hostname 'smithi002' 2024-09-19T04:57:45.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.520+0000 7f31ae573740 1 --2- 172.21.15.2:0/3673690893 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55fb2ec3dd10 0x55fb2ec40130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:45.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.520+0000 7f31ae573740 4 client.16614 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:57:45.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.520+0000 7f31ae573740 1 -- 172.21.15.2:0/3673690893 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fb2eb25d60 con 0x55fb2ec3dd10 2024-09-19T04:57:45.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.520+0000 7f31a9f36640 1 --2- 172.21.15.2:0/3673690893 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55fb2ec3dd10 0x55fb2ec40130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:45.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.521+0000 7f318d7fa640 10 client.16614 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:57:45.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.521+0000 7f31a9f36640 1 --2- 172.21.15.2:0/3673690893 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55fb2ec3dd10 0x55fb2ec40130 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9ef2c00a2aa0734 server_cookie=86990455b57556d2 in_seq=0 out_seq=0 2024-09-19T04:57:45.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.521+0000 7f318d7fa640 1 -- 172.21.15.2:0/3673690893 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55fb2eb25d60 con 0x55fb2ec3dd10 2024-09-19T04:57:45.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.521+0000 7f318d7fa640 10 client.16614 handle_command_reply: tid=0 2024-09-19T04:57:45.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.521+0000 7f31ae573740 1 client.16614 shutdown 2024-09-19T04:57:45.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.521+0000 7f31ae573740 1 -- 172.21.15.2:0/3673690893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb2ebb8dc0 msgr2=0x55fb2ebbcb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:45.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.521+0000 7f31ae573740 1 --2- 172.21.15.2:0/3673690893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb2ebb8dc0 0x55fb2ebbcb50 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f3194003690 tx=0x7f3194003f30 comp rx=0 tx=0).stop 2024-09-19T04:57:45.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.521+0000 7f31ae573740 1 -- 172.21.15.2:0/3673690893 shutdown_connections 2024-09-19T04:57:45.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.521+0000 7f31ae573740 1 --2- 172.21.15.2:0/3673690893 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55fb2ec3dd10 0x55fb2ec40130 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:45.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.521+0000 7f31ae573740 1 --2- 172.21.15.2:0/3673690893 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fb2ebc3680 0x55fb2ebbd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:45.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.521+0000 7f31ae573740 1 --2- 172.21.15.2:0/3673690893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb2ebb8dc0 0x55fb2ebbcb50 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:45.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.521+0000 7f31ae573740 1 --2- 172.21.15.2:0/3673690893 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fb2ebb84a0 0x55fb2ebcba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:45.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.521+0000 7f318d7fa640 0 client.16614 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:57:45.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.521+0000 7f31ae573740 1 -- 172.21.15.2:0/3673690893 >> 172.21.15.2:0/3673690893 conn(0x55fb2ebb4a30 msgr2=0x55fb2ebbe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:45.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.521+0000 7f31ae573740 1 -- 172.21.15.2:0/3673690893 shutdown_connections 2024-09-19T04:57:45.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.521+0000 7f31ae573740 1 -- 172.21.15.2:0/3673690893 wait complete. 2024-09-19T04:57:45.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.521+0000 7f31ae573740 20 client.16614 trim_cache size 0 max 16384 2024-09-19T04:57:45.530 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:57:45.530 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T04:57:45.530 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T04:57:45.530 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:57:45.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.522+0000 7f31ac19a640 1 -- 172.21.15.2:0/3282046675 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f31900a3430 msgr2=0x7f31900a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:45.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.522+0000 7f31ac19a640 1 --2- 172.21.15.2:0/3282046675 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f31900a3430 0x7f31900a58f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f319c004af0 tx=0x7f319c0095c0 comp rx=0 tx=0).stop 2024-09-19T04:57:45.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.522+0000 7f31ac19a640 1 -- 172.21.15.2:0/3282046675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31a4100a80 msgr2=0x7f31a419a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:45.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.522+0000 7f31ac19a640 1 --2- 172.21.15.2:0/3282046675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31a4100a80 0x7f31a419a520 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f31a000d950 tx=0x7f31a000de10 comp rx=0 tx=0).stop 2024-09-19T04:57:45.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.522+0000 7f31ac19a640 1 -- 172.21.15.2:0/3282046675 shutdown_connections 2024-09-19T04:57:45.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.522+0000 7f31ac19a640 1 --2- 172.21.15.2:0/3282046675 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f31900a3430 0x7f31900a58f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:45.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.522+0000 7f31ac19a640 1 --2- 172.21.15.2:0/3282046675 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f31a4106a80 0x7f31a419edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:45.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.522+0000 7f31ac19a640 1 --2- 172.21.15.2:0/3282046675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31a4101420 0x7f31a419aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:45.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.522+0000 7f31ac19a640 1 --2- 172.21.15.2:0/3282046675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31a4100a80 0x7f31a419a520 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:45.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.522+0000 7f31ac19a640 1 -- 172.21.15.2:0/3282046675 >> 172.21.15.2:0/3282046675 conn(0x7f31a40fc7a0 msgr2=0x7f31a406a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:45.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.522+0000 7f31ac19a640 1 -- 172.21.15.2:0/3282046675 shutdown_connections 2024-09-19T04:57:45.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:45.522+0000 7f31ac19a640 1 -- 172.21.15.2:0/3282046675 wait complete. 2024-09-19T04:57:46.357 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:57:46.357 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:57:46.660 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:57:46.663 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:46 smithi116 ceph-mon[34477]: pgmap v302: 97 pgs: 97 active+clean; 18 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 76 KiB/s wr, 11 op/s 2024-09-19T04:57:46.782 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:46 smithi002 ceph-mon[30975]: pgmap v302: 97 pgs: 97 active+clean; 18 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 76 KiB/s wr, 11 op/s 2024-09-19T04:57:46.806 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:46 smithi018 ceph-mon[34537]: pgmap v302: 97 pgs: 97 active+clean; 18 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 76 KiB/s wr, 11 op/s 2024-09-19T04:57:47.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.151+0000 7f9d7ad19640 1 -- 172.21.15.2:0/2964750806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d74103660 msgr2=0x7f9d7410bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:47.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.151+0000 7f9d7ad19640 1 --2- 172.21.15.2:0/2964750806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d74103660 0x7f9d7410bb50 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f9d68009900 tx=0x7f9d6802a480 comp rx=0 tx=0).stop 2024-09-19T04:57:47.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.151+0000 7f9d7ad19640 1 -- 172.21.15.2:0/2964750806 shutdown_connections 2024-09-19T04:57:47.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.151+0000 7f9d7ad19640 1 --2- 172.21.15.2:0/2964750806 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d7410c170 0x7f9d7410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:47.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.151+0000 7f9d7ad19640 1 --2- 172.21.15.2:0/2964750806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d74103660 0x7f9d7410bb50 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:47.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.151+0000 7f9d7ad19640 1 --2- 172.21.15.2:0/2964750806 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d74102d40 0x7f9d74103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:47.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.151+0000 7f9d7ad19640 1 -- 172.21.15.2:0/2964750806 >> 172.21.15.2:0/2964750806 conn(0x7f9d740fc7a0 msgr2=0x7f9d740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:47.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.151+0000 7f9d7ad19640 1 -- 172.21.15.2:0/2964750806 shutdown_connections 2024-09-19T04:57:47.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.151+0000 7f9d7ad19640 1 -- 172.21.15.2:0/2964750806 wait complete. 2024-09-19T04:57:47.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.151+0000 7f9d7ad19640 1 Processor -- start 2024-09-19T04:57:47.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.151+0000 7f9d7ad19640 1 -- start start 2024-09-19T04:57:47.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.152+0000 7f9d7ad19640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d74102d40 0x7f9d741983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:47.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.152+0000 7f9d7ad19640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d74103660 0x7f9d74198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:47.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.152+0000 7f9d7ad19640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d7410c170 0x7f9d7419ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:47.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.152+0000 7f9d7ad19640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9d74111e60 con 0x7f9d74102d40 2024-09-19T04:57:47.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.152+0000 7f9d7ad19640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9d74111ce0 con 0x7f9d7410c170 2024-09-19T04:57:47.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.152+0000 7f9d7ad19640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f9d74111fe0 con 0x7f9d74103660 2024-09-19T04:57:47.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.152+0000 7f9d78ab5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d74102d40 0x7f9d741983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:47.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.152+0000 7f9d78ab5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d74102d40 0x7f9d741983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58784/0 (socket says 172.21.15.2:58784) 2024-09-19T04:57:47.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.152+0000 7f9d78ab5640 1 -- 172.21.15.2:0/4141101355 learned_addr learned my addr 172.21.15.2:0/4141101355 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:47.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.152+0000 7f9d792b6640 1 --2- 172.21.15.2:0/4141101355 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d7410c170 0x7f9d7419ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:47.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.152+0000 7f9d78ab5640 1 -- 172.21.15.2:0/4141101355 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d74103660 msgr2=0x7f9d74198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:47.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.152+0000 7f9d78ab5640 1 --2- 172.21.15.2:0/4141101355 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d74103660 0x7f9d74198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:47.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.152+0000 7f9d78ab5640 1 -- 172.21.15.2:0/4141101355 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d7410c170 msgr2=0x7f9d7419ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:47.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.152+0000 7f9d78ab5640 1 --2- 172.21.15.2:0/4141101355 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d7410c170 0x7f9d7419ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:47.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.152+0000 7f9d78ab5640 1 -- 172.21.15.2:0/4141101355 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d7419d3a0 con 0x7f9d74102d40 2024-09-19T04:57:47.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.152+0000 7f9d78ab5640 1 --2- 172.21.15.2:0/4141101355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d74102d40 0x7f9d741983f0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f9d6400e9f0 tx=0x7f9d6400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:47.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.152+0000 7f9d71ffb640 1 -- 172.21.15.2:0/4141101355 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d6400cd80 con 0x7f9d74102d40 2024-09-19T04:57:47.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.152+0000 7f9d71ffb640 1 -- 172.21.15.2:0/4141101355 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9d640108e0 con 0x7f9d74102d40 2024-09-19T04:57:47.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.152+0000 7f9d7ad19640 1 -- 172.21.15.2:0/4141101355 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d7419d690 con 0x7f9d74102d40 2024-09-19T04:57:47.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.152+0000 7f9d71ffb640 1 -- 172.21.15.2:0/4141101355 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d64018920 con 0x7f9d74102d40 2024-09-19T04:57:47.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.153+0000 7f9d7ad19640 1 -- 172.21.15.2:0/4141101355 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d741a4f70 con 0x7f9d74102d40 2024-09-19T04:57:47.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.154+0000 7f9d7ad19640 1 -- 172.21.15.2:0/4141101355 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d74103120 con 0x7f9d74102d40 2024-09-19T04:57:47.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.155+0000 7f9d71ffb640 1 -- 172.21.15.2:0/4141101355 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f9d64010a90 con 0x7f9d74102d40 2024-09-19T04:57:47.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.156+0000 7f9d71ffb640 1 --2- 172.21.15.2:0/4141101355 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f9d5c0a33b0 0x7f9d5c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:47.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.156+0000 7f9d73fff640 1 --2- 172.21.15.2:0/4141101355 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f9d5c0a33b0 0x7f9d5c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:47.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.156+0000 7f9d71ffb640 1 -- 172.21.15.2:0/4141101355 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8527+0+0 (secure 0 0 0) 0x7f9d640d01b0 con 0x7f9d74102d40 2024-09-19T04:57:47.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.156+0000 7f9d73fff640 1 --2- 172.21.15.2:0/4141101355 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f9d5c0a33b0 0x7f9d5c0a5870 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9d680096c0 tx=0x7f9d68031400 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:47.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.160+0000 7f9d71ffb640 1 -- 172.21.15.2:0/4141101355 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9d6409cb30 con 0x7f9d74102d40 2024-09-19T04:57:47.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.374+0000 7f9d7ad19640 1 -- 172.21.15.2:0/4141101355 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9d74199750 con 0x7f9d74102d40 2024-09-19T04:57:47.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.375+0000 7f9d71ffb640 1 -- 172.21.15.2:0/4141101355 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11840 (secure 0 0 0) 0x7f9d6409c430 con 0x7f9d74102d40 2024-09-19T04:57:47.376 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:57:47.376 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":19,"btime":"2024-09-19T04:46:33:537239+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2467365137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2467365137},{"type":"v1","addr":"172.21.15.2:6835","nonce":2467365137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3162441888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3162441888},{"type":"v1","addr":"172.21.15.2:6837","nonce":3162441888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14631,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2740862966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2740862966},{"type":"v1","addr":"172.21.15.2:6839","nonce":2740862966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/2394435504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2394435504},{"type":"v1","addr":"172.21.15.2:6841","nonce":2394435504}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1630480244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1630480244},{"type":"v1","addr":"172.21.15.18:6833","nonce":1630480244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1553897465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1553897465},{"type":"v1","addr":"172.21.15.116:6833","nonce":1553897465}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3035664608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3035664608},{"type":"v1","addr":"172.21.15.18:6835","nonce":3035664608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1096622392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1096622392},{"type":"v1","addr":"172.21.15.18:6837","nonce":1096622392}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3761157675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3761157675},{"type":"v1","addr":"172.21.15.116:6835","nonce":3761157675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/1120131594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1120131594},{"type":"v1","addr":"172.21.15.116:6837","nonce":1120131594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:46:24.050115+0000","modified":"2024-09-19T04:46:33.112369+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/4207677139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":4207677139},{"type":"v1","addr":"172.21.15.18:6839","nonce":4207677139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/2346874880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":2346874880},{"type":"v1","addr":"172.21.15.116:6839","nonce":2346874880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496]},"id":1}]} 2024-09-19T04:57:47.377 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 19 2024-09-19T04:57:47.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.377+0000 7f9d7ad19640 1 -- 172.21.15.2:0/4141101355 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f9d5c0a33b0 msgr2=0x7f9d5c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:47.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.377+0000 7f9d7ad19640 1 --2- 172.21.15.2:0/4141101355 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f9d5c0a33b0 0x7f9d5c0a5870 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9d680096c0 tx=0x7f9d68031400 comp rx=0 tx=0).stop 2024-09-19T04:57:47.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.377+0000 7f9d7ad19640 1 -- 172.21.15.2:0/4141101355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d74102d40 msgr2=0x7f9d741983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:47.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.377+0000 7f9d7ad19640 1 --2- 172.21.15.2:0/4141101355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d74102d40 0x7f9d741983f0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f9d6400e9f0 tx=0x7f9d6400eeb0 comp rx=0 tx=0).stop 2024-09-19T04:57:47.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.377+0000 7f9d7ad19640 1 -- 172.21.15.2:0/4141101355 shutdown_connections 2024-09-19T04:57:47.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.377+0000 7f9d7ad19640 1 --2- 172.21.15.2:0/4141101355 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d7410c170 0x7f9d7419ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:47.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.377+0000 7f9d7ad19640 1 --2- 172.21.15.2:0/4141101355 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f9d5c0a33b0 0x7f9d5c0a5870 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:47.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.377+0000 7f9d7ad19640 1 --2- 172.21.15.2:0/4141101355 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d74103660 0x7f9d74198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:47.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.377+0000 7f9d7ad19640 1 --2- 172.21.15.2:0/4141101355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d74102d40 0x7f9d741983f0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:47.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.377+0000 7f9d7ad19640 1 -- 172.21.15.2:0/4141101355 >> 172.21.15.2:0/4141101355 conn(0x7f9d740fc7a0 msgr2=0x7f9d740fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:47.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.377+0000 7f9d7ad19640 1 -- 172.21.15.2:0/4141101355 shutdown_connections 2024-09-19T04:57:47.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:47.377+0000 7f9d7ad19640 1 -- 172.21.15.2:0/4141101355 wait complete. 2024-09-19T04:57:47.699 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:47 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/4141101355' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:57:47.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:47 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/4141101355' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:57:47.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:47 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/4141101355' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:57:48.030 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:57:48.287 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:57:48.670 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:48 smithi002 ceph-mon[30975]: pgmap v303: 97 pgs: 97 active+clean; 18 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 50 KiB/s wr, 7 op/s 2024-09-19T04:57:48.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.754+0000 7ff0272f4640 1 -- 172.21.15.2:0/824695340 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff02010c170 msgr2=0x7ff02010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:48.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.754+0000 7ff0272f4640 1 --2- 172.21.15.2:0/824695340 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff02010c170 0x7ff02010e610 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7ff018009ca0 tx=0x7ff01802a950 comp rx=0 tx=0).stop 2024-09-19T04:57:48.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.754+0000 7ff0272f4640 1 -- 172.21.15.2:0/824695340 shutdown_connections 2024-09-19T04:57:48.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.754+0000 7ff0272f4640 1 --2- 172.21.15.2:0/824695340 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff02010c170 0x7ff02010e610 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:48.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.754+0000 7ff0272f4640 1 --2- 172.21.15.2:0/824695340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff020103660 0x7ff02010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:48.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.754+0000 7ff0272f4640 1 --2- 172.21.15.2:0/824695340 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff020102d40 0x7ff020103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:48.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.754+0000 7ff0272f4640 1 -- 172.21.15.2:0/824695340 >> 172.21.15.2:0/824695340 conn(0x7ff0200fc7a0 msgr2=0x7ff0200febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:48.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.754+0000 7ff0272f4640 1 -- 172.21.15.2:0/824695340 shutdown_connections 2024-09-19T04:57:48.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.754+0000 7ff0272f4640 1 -- 172.21.15.2:0/824695340 wait complete. 2024-09-19T04:57:48.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.755+0000 7ff0272f4640 1 Processor -- start 2024-09-19T04:57:48.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.755+0000 7ff0272f4640 1 -- start start 2024-09-19T04:57:48.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.755+0000 7ff0272f4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff020102d40 0x7ff020198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:48.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.755+0000 7ff0272f4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff020103660 0x7ff020198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:48.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.755+0000 7ff0272f4640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff02010c170 0x7ff02019cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:48.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.755+0000 7ff0272f4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff020111e20 con 0x7ff020102d40 2024-09-19T04:57:48.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.755+0000 7ff0272f4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff020111ca0 con 0x7ff020103660 2024-09-19T04:57:48.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.755+0000 7ff0272f4640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7ff020111fa0 con 0x7ff02010c170 2024-09-19T04:57:48.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.755+0000 7ff025090640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff020102d40 0x7ff020198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:48.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.755+0000 7ff025090640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff020102d40 0x7ff020198320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58804/0 (socket says 172.21.15.2:58804) 2024-09-19T04:57:48.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.755+0000 7ff025090640 1 -- 172.21.15.2:0/1250333343 learned_addr learned my addr 172.21.15.2:0/1250333343 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:48.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.755+0000 7ff02488f640 1 --2- 172.21.15.2:0/1250333343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff020103660 0x7ff020198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:48.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.756+0000 7ff025891640 1 --2- 172.21.15.2:0/1250333343 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff02010c170 0x7ff02019cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:48.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.756+0000 7ff025090640 1 -- 172.21.15.2:0/1250333343 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff02010c170 msgr2=0x7ff02019cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:48.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.756+0000 7ff025090640 1 --2- 172.21.15.2:0/1250333343 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff02010c170 0x7ff02019cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:48.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.756+0000 7ff025090640 1 -- 172.21.15.2:0/1250333343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff020103660 msgr2=0x7ff020198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:48.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.756+0000 7ff025090640 1 --2- 172.21.15.2:0/1250333343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff020103660 0x7ff020198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:48.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.756+0000 7ff025090640 1 -- 172.21.15.2:0/1250333343 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff02019d2d0 con 0x7ff020102d40 2024-09-19T04:57:48.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.756+0000 7ff025090640 1 --2- 172.21.15.2:0/1250333343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff020102d40 0x7ff020198320 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7ff01c00d770 tx=0x7ff01c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:48.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.756+0000 7ff0127fc640 1 -- 172.21.15.2:0/1250333343 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff01c017070 con 0x7ff020102d40 2024-09-19T04:57:48.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.756+0000 7ff0127fc640 1 -- 172.21.15.2:0/1250333343 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff01c0054d0 con 0x7ff020102d40 2024-09-19T04:57:48.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.756+0000 7ff0272f4640 1 -- 172.21.15.2:0/1250333343 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff02019d5c0 con 0x7ff020102d40 2024-09-19T04:57:48.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.756+0000 7ff0127fc640 1 -- 172.21.15.2:0/1250333343 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff01c004cf0 con 0x7ff020102d40 2024-09-19T04:57:48.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.756+0000 7ff0272f4640 1 -- 172.21.15.2:0/1250333343 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0201a4ea0 con 0x7ff020102d40 2024-09-19T04:57:48.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.758+0000 7ff0127fc640 1 -- 172.21.15.2:0/1250333343 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7ff01c004e90 con 0x7ff020102d40 2024-09-19T04:57:48.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.759+0000 7ff0296cd740 1 Processor -- start 2024-09-19T04:57:48.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.759+0000 7ff0296cd740 1 -- start start 2024-09-19T04:57:48.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.759+0000 7ff0296cd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557b8f1ffb40 0x557b8f1fe090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:48.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.759+0000 7ff0296cd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b8f1fe5d0 0x557b8f1fea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:48.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.759+0000 7ff0296cd740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557b8f20d780 0x557b8f20fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:48.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.759+0000 7ff0296cd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557b8f1642f0 con 0x557b8f1fe5d0 2024-09-19T04:57:48.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.759+0000 7ff0296cd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x557b8f10bcf0 con 0x557b8f1ffb40 2024-09-19T04:57:48.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.759+0000 7ff0296cd740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x557b8f1602b0 con 0x557b8f20d780 2024-09-19T04:57:48.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.759+0000 7ff0127fc640 1 --2- 172.21.15.2:0/1250333343 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7ff00c0a33b0 0x7ff00c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:48.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.759+0000 7ff025090640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b8f1fe5d0 0x557b8f1fea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:48.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.759+0000 7ff025090640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b8f1fe5d0 0x557b8f1fea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58810/0 (socket says 172.21.15.2:58810) 2024-09-19T04:57:48.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.759+0000 7ff025090640 1 -- 172.21.15.2:0/3691773269 learned_addr learned my addr 172.21.15.2:0/3691773269 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:48.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.759+0000 7ff025891640 1 --2- 172.21.15.2:0/1250333343 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7ff00c0a33b0 0x7ff00c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:48.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.759+0000 7ff02488f640 1 --2- 172.21.15.2:0/3691773269 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557b8f20d780 0x557b8f20fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:48.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.760+0000 7ff0127fc640 1 -- 172.21.15.2:0/1250333343 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8527+0+0 (secure 0 0 0) 0x7ff01c0cf790 con 0x7ff020102d40 2024-09-19T04:57:48.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.760+0000 7ff025891640 1 --2- 172.21.15.2:0/3691773269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557b8f1ffb40 0x557b8f1fe090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:48.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.760+0000 7ff025090640 1 -- 172.21.15.2:0/3691773269 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557b8f20d780 msgr2=0x557b8f20fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:48.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.760+0000 7ff025090640 1 --2- 172.21.15.2:0/3691773269 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557b8f20d780 0x557b8f20fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:48.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.760+0000 7ff025090640 1 -- 172.21.15.2:0/3691773269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557b8f1ffb40 msgr2=0x557b8f1fe090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:48.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.760+0000 7ff025090640 1 --2- 172.21.15.2:0/3691773269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557b8f1ffb40 0x557b8f1fe090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:48.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.760+0000 7ff025090640 1 -- 172.21.15.2:0/3691773269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b8f0f03a0 con 0x557b8f1fe5d0 2024-09-19T04:57:48.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.760+0000 7ff025090640 1 --2- 172.21.15.2:0/3691773269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b8f1fe5d0 0x557b8f1fea10 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7ff01c0a41b0 tx=0x7ff01c06e8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b31669c3bc9ca38c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:48.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.760+0000 7ff025891640 1 --2- 172.21.15.2:0/1250333343 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7ff00c0a33b0 0x7ff00c0a5870 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff018005e30 tx=0x7ff018009800 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:48.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.760+0000 7ff00b7fe640 1 -- 172.21.15.2:0/3691773269 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff01c020070 con 0x557b8f1fe5d0 2024-09-19T04:57:48.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.760+0000 7ff00b7fe640 1 -- 172.21.15.2:0/3691773269 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff01c009c30 con 0x557b8f1fe5d0 2024-09-19T04:57:48.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.760+0000 7ff00b7fe640 1 -- 172.21.15.2:0/3691773269 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff01c09fe20 con 0x557b8f1fe5d0 2024-09-19T04:57:48.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.761+0000 7ff0296cd740 1 -- 172.21.15.2:0/3691773269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b8f1fe5d0 msgr2=0x557b8f1fea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:48.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.761+0000 7ff0296cd740 1 --2- 172.21.15.2:0/3691773269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b8f1fe5d0 0x557b8f1fea10 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7ff01c0a41b0 tx=0x7ff01c06e8a0 comp rx=0 tx=0).stop 2024-09-19T04:57:48.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.761+0000 7ff0296cd740 1 -- 172.21.15.2:0/3691773269 shutdown_connections 2024-09-19T04:57:48.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.761+0000 7ff0296cd740 1 --2- 172.21.15.2:0/3691773269 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557b8f20d780 0x557b8f20fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:48.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.761+0000 7ff0296cd740 1 --2- 172.21.15.2:0/3691773269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b8f1fe5d0 0x557b8f1fea10 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:48.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.761+0000 7ff0296cd740 1 --2- 172.21.15.2:0/3691773269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557b8f1ffb40 0x557b8f1fe090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:48.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.761+0000 7ff0296cd740 1 -- 172.21.15.2:0/3691773269 >> 172.21.15.2:0/3691773269 conn(0x557b8f1c7310 msgr2=0x557b8f1fac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:48.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.761+0000 7ff0296cd740 1 -- 172.21.15.2:0/3691773269 shutdown_connections 2024-09-19T04:57:48.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.761+0000 7ff0296cd740 1 -- 172.21.15.2:0/3691773269 wait complete. 2024-09-19T04:57:48.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.761+0000 7ff0296cd740 1 -- start start 2024-09-19T04:57:48.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.762+0000 7ff0296cd740 1 Processor -- start 2024-09-19T04:57:48.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.762+0000 7ff0296cd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b8f1fe5d0 0x557b8f20d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:48.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.762+0000 7ff0296cd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557b8f1ffb40 0x557b8f20a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:48.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.762+0000 7ff0296cd740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557b8f20d780 0x557b8f20aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:48.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.762+0000 7ff0296cd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557b8f210420 con 0x557b8f1fe5d0 2024-09-19T04:57:48.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.762+0000 7ff0296cd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x557b8f11f060 con 0x557b8f1ffb40 2024-09-19T04:57:48.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.762+0000 7ff0296cd740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x557b8f2105a0 con 0x557b8f20d780 2024-09-19T04:57:48.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.762+0000 7ff0296cd740 10 client.0 _ll_register_callbacks cb 0x557b8ee728c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:57:48.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.762+0000 7ff025090640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b8f1fe5d0 0x557b8f20d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:48.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.762+0000 7ff025090640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b8f1fe5d0 0x557b8f20d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58826/0 (socket says 172.21.15.2:58826) 2024-09-19T04:57:48.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.762+0000 7ff025090640 1 -- 172.21.15.2:0/176303115 learned_addr learned my addr 172.21.15.2:0/176303115 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:48.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.762+0000 7ff025891640 1 --2- 172.21.15.2:0/176303115 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557b8f20d780 0x557b8f20aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:48.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.762+0000 7ff02488f640 1 --2- 172.21.15.2:0/176303115 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557b8f1ffb40 0x557b8f20a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:48.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.762+0000 7ff025090640 1 -- 172.21.15.2:0/176303115 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557b8f20d780 msgr2=0x557b8f20aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:48.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.762+0000 7ff025090640 1 --2- 172.21.15.2:0/176303115 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557b8f20d780 0x557b8f20aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:48.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.762+0000 7ff025090640 1 -- 172.21.15.2:0/176303115 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557b8f1ffb40 msgr2=0x557b8f20a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:48.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.762+0000 7ff025090640 1 --2- 172.21.15.2:0/176303115 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557b8f1ffb40 0x557b8f20a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:48.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.762+0000 7ff025090640 1 -- 172.21.15.2:0/176303115 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b8eed53c0 con 0x557b8f1fe5d0 2024-09-19T04:57:48.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.763+0000 7ff025090640 1 --2- 172.21.15.2:0/176303115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b8f1fe5d0 0x557b8f20d190 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7ff01c0cfb40 tx=0x7ff01c0097b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43707f950fcf6bd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:48.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.763+0000 7ff008ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:57:48.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.763+0000 7ff008ff9640 1 -- 172.21.15.2:0/176303115 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff01c0b3020 con 0x557b8f1fe5d0 2024-09-19T04:57:48.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.763+0000 7ff008ff9640 1 -- 172.21.15.2:0/176303115 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8527+0+0 (secure 0 0 0) 0x7ff01c0980e0 con 0x557b8f1fe5d0 2024-09-19T04:57:48.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.763+0000 7ff0296cd740 1 -- 172.21.15.2:0/176303115 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557b8f171860 con 0x557b8f1fe5d0 2024-09-19T04:57:48.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.763+0000 7ff008ff9640 1 -- 172.21.15.2:0/176303115 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff01c020040 con 0x557b8f1fe5d0 2024-09-19T04:57:48.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.763+0000 7ff0296cd740 10 client.16632 fetch_fsmap learned FSMap version 19 2024-09-19T04:57:48.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.763+0000 7ff0296cd740 1 -- 172.21.15.2:0/176303115 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x557b8f21bef0 con 0x557b8f1fe5d0 2024-09-19T04:57:48.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.763+0000 7ff008ff9640 1 -- 172.21.15.2:0/176303115 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x557b8f171860 con 0x557b8f1fe5d0 2024-09-19T04:57:48.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.763+0000 7ff008ff9640 1 -- 172.21.15.2:0/176303115 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ff01c066300 con 0x557b8f1fe5d0 2024-09-19T04:57:48.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.763+0000 7ff0296cd740 10 client.16632 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:57:48.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.763+0000 7ff0296cd740 10 client.16632 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:57:48.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.763+0000 7ff0296cd740 20 client.16632 populate_metadata read hostname 'smithi002' 2024-09-19T04:57:48.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.763+0000 7ff0296cd740 1 --2- 172.21.15.2:0/176303115 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x557b8f21d240 0x557b8f21f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:48.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.763+0000 7ff0296cd740 4 client.16632 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:57:48.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.763+0000 7ff0296cd740 1 -- 172.21.15.2:0/176303115 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557b8f16bd70 con 0x557b8f21d240 2024-09-19T04:57:48.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.764+0000 7ff02488f640 1 --2- 172.21.15.2:0/176303115 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x557b8f21d240 0x557b8f21f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:48.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.764+0000 7ff02488f640 1 --2- 172.21.15.2:0/176303115 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x557b8f21d240 0x557b8f21f630 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcfbdecbc3d43e22 server_cookie=87f363365821a69a in_seq=0 out_seq=0 2024-09-19T04:57:48.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.764+0000 7ff008ff9640 10 client.16632 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:57:48.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.765+0000 7ff008ff9640 1 -- 172.21.15.2:0/176303115 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557b8f16bd70 con 0x557b8f21d240 2024-09-19T04:57:48.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.765+0000 7ff008ff9640 10 client.16632 handle_command_reply: tid=0 2024-09-19T04:57:48.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.765+0000 7ff0296cd740 1 client.16632 shutdown 2024-09-19T04:57:48.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.765+0000 7ff0296cd740 1 -- 172.21.15.2:0/176303115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b8f1fe5d0 msgr2=0x557b8f20d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:48.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.765+0000 7ff0296cd740 1 --2- 172.21.15.2:0/176303115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b8f1fe5d0 0x557b8f20d190 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7ff01c0cfb40 tx=0x7ff01c0097b0 comp rx=0 tx=0).stop 2024-09-19T04:57:48.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.765+0000 7ff0296cd740 1 -- 172.21.15.2:0/176303115 shutdown_connections 2024-09-19T04:57:48.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.765+0000 7ff0296cd740 1 --2- 172.21.15.2:0/176303115 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x557b8f21d240 0x557b8f21f630 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:48.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.765+0000 7ff0296cd740 1 --2- 172.21.15.2:0/176303115 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557b8f20d780 0x557b8f20aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:48.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.765+0000 7ff0296cd740 1 --2- 172.21.15.2:0/176303115 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557b8f1ffb40 0x557b8f20a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:48.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.765+0000 7ff0296cd740 1 --2- 172.21.15.2:0/176303115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b8f1fe5d0 0x557b8f20d190 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:48.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.765+0000 7ff008ff9640 0 client.16632 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:57:48.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.765+0000 7ff0296cd740 1 -- 172.21.15.2:0/176303115 >> 172.21.15.2:0/176303115 conn(0x557b8f1c7310 msgr2=0x557b8f200990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:48.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.765+0000 7ff0296cd740 1 -- 172.21.15.2:0/176303115 shutdown_connections 2024-09-19T04:57:48.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.765+0000 7ff0296cd740 1 -- 172.21.15.2:0/176303115 wait complete. 2024-09-19T04:57:48.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.766+0000 7ff0296cd740 20 client.16632 trim_cache size 0 max 16384 2024-09-19T04:57:48.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.778+0000 7ff0296cd740 1 Processor -- start 2024-09-19T04:57:48.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.779+0000 7ff0296cd740 1 -- start start 2024-09-19T04:57:48.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.779+0000 7ff0296cd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557b8f1fe5d0 0x557b8f219840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:48.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.779+0000 7ff0296cd740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557b8f1ffb40 0x557b8f1f9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:48.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.779+0000 7ff0296cd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b8f20d780 0x557b8f2076a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:48.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.779+0000 7ff0296cd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff0201a9580 con 0x557b8f20d780 2024-09-19T04:57:48.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.779+0000 7ff0296cd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff0201abde0 con 0x557b8f1fe5d0 2024-09-19T04:57:48.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.779+0000 7ff0296cd740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7ff0201a9bd0 con 0x557b8f1ffb40 2024-09-19T04:57:48.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.779+0000 7ff025891640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b8f20d780 0x557b8f2076a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:48.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.779+0000 7ff025891640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b8f20d780 0x557b8f2076a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58834/0 (socket says 172.21.15.2:58834) 2024-09-19T04:57:48.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.779+0000 7ff025891640 1 -- 172.21.15.2:0/1453683590 learned_addr learned my addr 172.21.15.2:0/1453683590 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:48.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.779+0000 7ff025090640 1 --2- 172.21.15.2:0/1453683590 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557b8f1fe5d0 0x557b8f219840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:48.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.779+0000 7ff025891640 1 -- 172.21.15.2:0/1453683590 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557b8f1ffb40 msgr2=0x557b8f1f9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:48.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.779+0000 7ff025891640 1 --2- 172.21.15.2:0/1453683590 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557b8f1ffb40 0x557b8f1f9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:48.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.779+0000 7ff025891640 1 -- 172.21.15.2:0/1453683590 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557b8f1fe5d0 msgr2=0x557b8f219840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:48.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.779+0000 7ff025891640 1 --2- 172.21.15.2:0/1453683590 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557b8f1fe5d0 0x557b8f219840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:48.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.779+0000 7ff025891640 1 -- 172.21.15.2:0/1453683590 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b8f2093f0 con 0x557b8f20d780 2024-09-19T04:57:48.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.779+0000 7ff025090640 1 --2- 172.21.15.2:0/1453683590 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557b8f1fe5d0 0x557b8f219840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:57:48.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.779+0000 7ff025891640 1 --2- 172.21.15.2:0/1453683590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b8f20d780 0x557b8f2076a0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7ff0180093e0 tx=0x7ff01802a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb6500d1faa113d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:48.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.780+0000 7ff00affd640 1 -- 172.21.15.2:0/1453683590 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff018034040 con 0x557b8f20d780 2024-09-19T04:57:48.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.780+0000 7ff00affd640 1 -- 172.21.15.2:0/1453683590 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff018004040 con 0x557b8f20d780 2024-09-19T04:57:48.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.780+0000 7ff00affd640 1 -- 172.21.15.2:0/1453683590 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff018049440 con 0x557b8f20d780 2024-09-19T04:57:48.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.780+0000 7ff0296cd740 1 -- 172.21.15.2:0/1453683590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b8f20d780 msgr2=0x557b8f2076a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:48.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.780+0000 7ff0296cd740 1 --2- 172.21.15.2:0/1453683590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b8f20d780 0x557b8f2076a0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7ff0180093e0 tx=0x7ff01802a950 comp rx=0 tx=0).stop 2024-09-19T04:57:48.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.780+0000 7ff0296cd740 1 -- 172.21.15.2:0/1453683590 shutdown_connections 2024-09-19T04:57:48.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.780+0000 7ff0296cd740 1 --2- 172.21.15.2:0/1453683590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b8f20d780 0x557b8f2076a0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:48.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.780+0000 7ff0296cd740 1 --2- 172.21.15.2:0/1453683590 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557b8f1ffb40 0x557b8f1f9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:48.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.780+0000 7ff0296cd740 1 --2- 172.21.15.2:0/1453683590 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557b8f1fe5d0 0x557b8f219840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:48.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.780+0000 7ff0296cd740 1 -- 172.21.15.2:0/1453683590 >> 172.21.15.2:0/1453683590 conn(0x557b8f1c7310 msgr2=0x557b8f1f94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:48.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.780+0000 7ff0296cd740 1 -- 172.21.15.2:0/1453683590 shutdown_connections 2024-09-19T04:57:48.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.780+0000 7ff0296cd740 1 -- 172.21.15.2:0/1453683590 wait complete. 2024-09-19T04:57:48.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.780+0000 7ff0296cd740 1 -- start start 2024-09-19T04:57:48.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.781+0000 7ff0296cd740 1 Processor -- start 2024-09-19T04:57:48.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.781+0000 7ff0296cd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557b8f1fe5d0 0x557b8f2205b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:48.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.781+0000 7ff0296cd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b8f1ffb40 0x557b8f220af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:48.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.781+0000 7ff0296cd740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557b8f20d780 0x557b8f221030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:48.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.781+0000 7ff0296cd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff0201aa2a0 con 0x557b8f1ffb40 2024-09-19T04:57:48.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.781+0000 7ff0296cd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff0201ab710 con 0x557b8f1fe5d0 2024-09-19T04:57:48.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.781+0000 7ff0296cd740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7ff0201aa970 con 0x557b8f20d780 2024-09-19T04:57:48.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.781+0000 7ff0296cd740 10 client.0 _ll_register_callbacks cb 0x7ff01400b680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:57:48.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.781+0000 7ff02488f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b8f1ffb40 0x557b8f220af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:48.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.781+0000 7ff02488f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b8f1ffb40 0x557b8f220af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58842/0 (socket says 172.21.15.2:58842) 2024-09-19T04:57:48.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.781+0000 7ff02488f640 1 -- 172.21.15.2:0/219784921 learned_addr learned my addr 172.21.15.2:0/219784921 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:48.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.781+0000 7ff025891640 1 --2- 172.21.15.2:0/219784921 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557b8f20d780 0x557b8f221030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:48.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.781+0000 7ff025090640 1 --2- 172.21.15.2:0/219784921 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557b8f1fe5d0 0x557b8f2205b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:48.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.781+0000 7ff02488f640 1 -- 172.21.15.2:0/219784921 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557b8f20d780 msgr2=0x557b8f221030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:48.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.781+0000 7ff02488f640 1 --2- 172.21.15.2:0/219784921 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557b8f20d780 0x557b8f221030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:48.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.781+0000 7ff02488f640 1 -- 172.21.15.2:0/219784921 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557b8f1fe5d0 msgr2=0x557b8f2205b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:48.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.781+0000 7ff02488f640 1 --2- 172.21.15.2:0/219784921 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557b8f1fe5d0 0x557b8f2205b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:48.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.781+0000 7ff02488f640 1 -- 172.21.15.2:0/219784921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b8f286c00 con 0x557b8f1ffb40 2024-09-19T04:57:48.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.782+0000 7ff02488f640 1 --2- 172.21.15.2:0/219784921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b8f1ffb40 0x557b8f220af0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7ff0200feda0 tx=0x7ff01400bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5ccfb85d1f8bc59 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:48.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.782+0000 7ff008ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:57:48.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.782+0000 7ff008ff9640 1 -- 172.21.15.2:0/219784921 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff014015070 con 0x557b8f1ffb40 2024-09-19T04:57:48.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.782+0000 7ff008ff9640 1 -- 172.21.15.2:0/219784921 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8527+0+0 (secure 0 0 0) 0x7ff014005020 con 0x557b8f1ffb40 2024-09-19T04:57:48.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.782+0000 7ff0296cd740 1 -- 172.21.15.2:0/219784921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff018004040 con 0x557b8f1ffb40 2024-09-19T04:57:48.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.782+0000 7ff008ff9640 1 -- 172.21.15.2:0/219784921 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff01402a050 con 0x557b8f1ffb40 2024-09-19T04:57:48.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.782+0000 7ff0296cd740 10 client.16638 fetch_fsmap learned FSMap version 19 2024-09-19T04:57:48.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.782+0000 7ff0296cd740 1 -- 172.21.15.2:0/219784921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x557b8f287f20 con 0x557b8f1ffb40 2024-09-19T04:57:48.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.782+0000 7ff008ff9640 1 -- 172.21.15.2:0/219784921 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff018004040 con 0x557b8f1ffb40 2024-09-19T04:57:48.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.782+0000 7ff008ff9640 1 -- 172.21.15.2:0/219784921 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ff014025030 con 0x557b8f1ffb40 2024-09-19T04:57:48.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.782+0000 7ff0296cd740 10 client.16638 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:57:48.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.782+0000 7ff0296cd740 10 client.16638 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:57:48.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.782+0000 7ff0296cd740 20 client.16638 populate_metadata read hostname 'smithi002' 2024-09-19T04:57:48.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.782+0000 7ff0296cd740 1 --2- 172.21.15.2:0/219784921 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x557b8f288720 0x557b8f28ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:48.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.782+0000 7ff0296cd740 4 client.16638 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:57:48.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.782+0000 7ff0296cd740 1 -- 172.21.15.2:0/219784921 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557b8f0e8170 con 0x557b8f288720 2024-09-19T04:57:48.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.783+0000 7ff025090640 1 --2- 172.21.15.2:0/219784921 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x557b8f288720 0x557b8f28ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:48.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.783+0000 7ff008ff9640 10 client.16638 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:57:48.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.783+0000 7ff025090640 1 --2- 172.21.15.2:0/219784921 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x557b8f288720 0x557b8f28ab40 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87fbc0942253bdcf server_cookie=91f618799faba0e2 in_seq=0 out_seq=0 2024-09-19T04:57:48.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.783+0000 7ff008ff9640 1 -- 172.21.15.2:0/219784921 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557b8f0e8170 con 0x557b8f288720 2024-09-19T04:57:48.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.783+0000 7ff008ff9640 10 client.16638 handle_command_reply: tid=0 2024-09-19T04:57:48.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.783+0000 7ff0296cd740 1 client.16638 shutdown 2024-09-19T04:57:48.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.783+0000 7ff0296cd740 1 -- 172.21.15.2:0/219784921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b8f1ffb40 msgr2=0x557b8f220af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:48.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.783+0000 7ff0296cd740 1 --2- 172.21.15.2:0/219784921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b8f1ffb40 0x557b8f220af0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7ff0200feda0 tx=0x7ff01400bda0 comp rx=0 tx=0).stop 2024-09-19T04:57:48.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.784+0000 7ff0296cd740 1 -- 172.21.15.2:0/219784921 shutdown_connections 2024-09-19T04:57:48.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.784+0000 7ff0296cd740 1 --2- 172.21.15.2:0/219784921 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x557b8f288720 0x557b8f28ab40 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:48.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.784+0000 7ff0296cd740 1 --2- 172.21.15.2:0/219784921 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557b8f20d780 0x557b8f221030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:48.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.784+0000 7ff0296cd740 1 --2- 172.21.15.2:0/219784921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b8f1ffb40 0x557b8f220af0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:48.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.784+0000 7ff0296cd740 1 --2- 172.21.15.2:0/219784921 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557b8f1fe5d0 0x557b8f2205b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:48.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.784+0000 7ff0296cd740 1 -- 172.21.15.2:0/219784921 >> 172.21.15.2:0/219784921 conn(0x557b8f1c7310 msgr2=0x557b8f1f9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:48.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.784+0000 7ff008ff9640 0 client.16638 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:57:48.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.784+0000 7ff0296cd740 1 -- 172.21.15.2:0/219784921 shutdown_connections 2024-09-19T04:57:48.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.784+0000 7ff0296cd740 1 -- 172.21.15.2:0/219784921 wait complete. 2024-09-19T04:57:48.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.784+0000 7ff0296cd740 20 client.16638 trim_cache size 0 max 16384 2024-09-19T04:57:48.791 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T04:57:48.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.784+0000 7ff0272f4640 1 -- 172.21.15.2:0/1250333343 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7ff00c0a33b0 msgr2=0x7ff00c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:48.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.784+0000 7ff0272f4640 1 --2- 172.21.15.2:0/1250333343 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7ff00c0a33b0 0x7ff00c0a5870 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff018005e30 tx=0x7ff018009800 comp rx=0 tx=0).stop 2024-09-19T04:57:48.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.784+0000 7ff0272f4640 1 -- 172.21.15.2:0/1250333343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff020102d40 msgr2=0x7ff020198320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:48.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.784+0000 7ff0272f4640 1 --2- 172.21.15.2:0/1250333343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff020102d40 0x7ff020198320 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7ff01c00d770 tx=0x7ff01c00dc30 comp rx=0 tx=0).stop 2024-09-19T04:57:48.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.784+0000 7ff0272f4640 1 -- 172.21.15.2:0/1250333343 shutdown_connections 2024-09-19T04:57:48.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.784+0000 7ff0272f4640 1 --2- 172.21.15.2:0/1250333343 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7ff00c0a33b0 0x7ff00c0a5870 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:48.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.784+0000 7ff0272f4640 1 --2- 172.21.15.2:0/1250333343 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff02010c170 0x7ff02019cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:48.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.784+0000 7ff0272f4640 1 --2- 172.21.15.2:0/1250333343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff020103660 0x7ff020198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:48.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.784+0000 7ff0272f4640 1 --2- 172.21.15.2:0/1250333343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff020102d40 0x7ff020198320 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:48.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.784+0000 7ff0272f4640 1 -- 172.21.15.2:0/1250333343 >> 172.21.15.2:0/1250333343 conn(0x7ff0200fc7a0 msgr2=0x7ff0200fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:48.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.785+0000 7ff0272f4640 1 -- 172.21.15.2:0/1250333343 shutdown_connections 2024-09-19T04:57:48.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:48.785+0000 7ff0272f4640 1 -- 172.21.15.2:0/1250333343 wait complete. 2024-09-19T04:57:48.806 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:48 smithi018 ceph-mon[34537]: pgmap v303: 97 pgs: 97 active+clean; 18 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 50 KiB/s wr, 7 op/s 2024-09-19T04:57:48.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:48 smithi116 ceph-mon[34477]: pgmap v303: 97 pgs: 97 active+clean; 18 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 50 KiB/s wr, 7 op/s 2024-09-19T04:57:50.514 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:57:50.514 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:57:50.787 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:57:50.806 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:50 smithi018 ceph-mon[34537]: pgmap v304: 97 pgs: 97 active+clean; 18 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 50 KiB/s wr, 7 op/s 2024-09-19T04:57:50.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:50 smithi002 ceph-mon[30975]: pgmap v304: 97 pgs: 97 active+clean; 18 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 50 KiB/s wr, 7 op/s 2024-09-19T04:57:50.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:50 smithi116 ceph-mon[34477]: pgmap v304: 97 pgs: 97 active+clean; 18 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 50 KiB/s wr, 7 op/s 2024-09-19T04:57:51.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.246+0000 7fcadd53a640 1 -- 172.21.15.2:0/2126191532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcad8102d40 msgr2=0x7fcad8103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:51.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.246+0000 7fcadd53a640 1 --2- 172.21.15.2:0/2126191532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcad8102d40 0x7fcad8103120 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fcac8009900 tx=0x7fcac802a480 comp rx=0 tx=0).stop 2024-09-19T04:57:51.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.247+0000 7fcadd53a640 1 -- 172.21.15.2:0/2126191532 shutdown_connections 2024-09-19T04:57:51.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.247+0000 7fcadd53a640 1 --2- 172.21.15.2:0/2126191532 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcad810c170 0x7fcad810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:51.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.247+0000 7fcadd53a640 1 --2- 172.21.15.2:0/2126191532 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcad8103660 0x7fcad810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:51.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.247+0000 7fcadd53a640 1 --2- 172.21.15.2:0/2126191532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcad8102d40 0x7fcad8103120 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:51.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.247+0000 7fcadd53a640 1 -- 172.21.15.2:0/2126191532 >> 172.21.15.2:0/2126191532 conn(0x7fcad80fc7a0 msgr2=0x7fcad80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:51.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.247+0000 7fcadd53a640 1 -- 172.21.15.2:0/2126191532 shutdown_connections 2024-09-19T04:57:51.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.247+0000 7fcadd53a640 1 -- 172.21.15.2:0/2126191532 wait complete. 2024-09-19T04:57:51.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.247+0000 7fcadd53a640 1 Processor -- start 2024-09-19T04:57:51.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.248+0000 7fcadd53a640 1 -- start start 2024-09-19T04:57:51.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.248+0000 7fcadd53a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcad8102d40 0x7fcad81983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:51.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.248+0000 7fcadd53a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcad8103660 0x7fcad8198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:51.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.248+0000 7fcadd53a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcad810c170 0x7fcad819cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:51.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.248+0000 7fcadd53a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcad8111e60 con 0x7fcad8103660 2024-09-19T04:57:51.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.248+0000 7fcadd53a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcad8111ce0 con 0x7fcad8102d40 2024-09-19T04:57:51.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.248+0000 7fcadd53a640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fcad8111fe0 con 0x7fcad810c170 2024-09-19T04:57:51.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.248+0000 7fcad67fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcad8103660 0x7fcad8198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:51.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.248+0000 7fcad67fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcad8103660 0x7fcad8198910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58856/0 (socket says 172.21.15.2:58856) 2024-09-19T04:57:51.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.248+0000 7fcad67fc640 1 -- 172.21.15.2:0/2161950795 learned_addr learned my addr 172.21.15.2:0/2161950795 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:51.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.248+0000 7fcad77fe640 1 --2- 172.21.15.2:0/2161950795 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcad810c170 0x7fcad819cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:51.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.248+0000 7fcad6ffd640 1 --2- 172.21.15.2:0/2161950795 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcad8102d40 0x7fcad81983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:51.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.248+0000 7fcad67fc640 1 -- 172.21.15.2:0/2161950795 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcad810c170 msgr2=0x7fcad819cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:51.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.248+0000 7fcad67fc640 1 --2- 172.21.15.2:0/2161950795 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcad810c170 0x7fcad819cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:51.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.248+0000 7fcad67fc640 1 -- 172.21.15.2:0/2161950795 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcad8102d40 msgr2=0x7fcad81983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:51.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.248+0000 7fcad67fc640 1 --2- 172.21.15.2:0/2161950795 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcad8102d40 0x7fcad81983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:51.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.248+0000 7fcad67fc640 1 -- 172.21.15.2:0/2161950795 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcad819d380 con 0x7fcad8103660 2024-09-19T04:57:51.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.249+0000 7fcad67fc640 1 --2- 172.21.15.2:0/2161950795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcad8103660 0x7fcad8198910 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fcac000b3f0 tx=0x7fcac000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:51.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.249+0000 7fcacffff640 1 -- 172.21.15.2:0/2161950795 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac0015020 con 0x7fcad8103660 2024-09-19T04:57:51.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.249+0000 7fcacffff640 1 -- 172.21.15.2:0/2161950795 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcac0011ce0 con 0x7fcad8103660 2024-09-19T04:57:51.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.249+0000 7fcadd53a640 1 -- 172.21.15.2:0/2161950795 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcad819d670 con 0x7fcad8103660 2024-09-19T04:57:51.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.249+0000 7fcacffff640 1 -- 172.21.15.2:0/2161950795 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac0010d80 con 0x7fcad8103660 2024-09-19T04:57:51.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.249+0000 7fcadd53a640 1 -- 172.21.15.2:0/2161950795 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcad81a4f50 con 0x7fcad8103660 2024-09-19T04:57:51.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.251+0000 7fcacffff640 1 -- 172.21.15.2:0/2161950795 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fcac0018020 con 0x7fcad8103660 2024-09-19T04:57:51.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.251+0000 7fcadf913740 1 Processor -- start 2024-09-19T04:57:51.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.251+0000 7fcadf913740 1 -- start start 2024-09-19T04:57:51.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.252+0000 7fcadf913740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562eef787a60 0x562eef787e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:51.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.252+0000 7fcadf913740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562eef788380 0x562eef796c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:51.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.252+0000 7fcadf913740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562eef797150 0x562eef799540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:51.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.252+0000 7fcadf913740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562eef6ed280 con 0x562eef788380 2024-09-19T04:57:51.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.252+0000 7fcadf913740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562eef694b10 con 0x562eef797150 2024-09-19T04:57:51.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.252+0000 7fcadf913740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x562eef6e9240 con 0x562eef787a60 2024-09-19T04:57:51.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.252+0000 7fcad6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562eef788380 0x562eef796c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:51.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.252+0000 7fcad6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562eef788380 0x562eef796c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58868/0 (socket says 172.21.15.2:58868) 2024-09-19T04:57:51.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.252+0000 7fcad6ffd640 1 -- 172.21.15.2:0/381627807 learned_addr learned my addr 172.21.15.2:0/381627807 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:51.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.252+0000 7fcad77fe640 1 --2- 172.21.15.2:0/381627807 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562eef787a60 0x562eef787e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:51.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.252+0000 7fcacffff640 1 --2- 172.21.15.2:0/2161950795 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fcac40a3430 0x7fcac40a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:51.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.252+0000 7fcad67fc640 1 --2- 172.21.15.2:0/381627807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562eef797150 0x562eef799540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:51.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.252+0000 7fcad77fe640 1 --2- 172.21.15.2:0/2161950795 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fcac40a3430 0x7fcac40a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:51.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.252+0000 7fcad6ffd640 1 -- 172.21.15.2:0/381627807 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562eef787a60 msgr2=0x562eef787e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:51.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.252+0000 7fcad6ffd640 1 --2- 172.21.15.2:0/381627807 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562eef787a60 0x562eef787e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:51.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.252+0000 7fcad6ffd640 1 -- 172.21.15.2:0/381627807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562eef797150 msgr2=0x562eef799540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:51.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.252+0000 7fcad6ffd640 1 --2- 172.21.15.2:0/381627807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562eef797150 0x562eef799540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:51.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.252+0000 7fcad6ffd640 1 -- 172.21.15.2:0/381627807 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562eef6a11f0 con 0x562eef788380 2024-09-19T04:57:51.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.252+0000 7fcacffff640 1 -- 172.21.15.2:0/2161950795 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8527+0+0 (secure 0 0 0) 0x7fcac00cf470 con 0x7fcad8103660 2024-09-19T04:57:51.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.253+0000 7fcad6ffd640 1 --2- 172.21.15.2:0/381627807 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562eef788380 0x562eef796c10 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fcac802a9a0 tx=0x7fcac8032cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e690f716d45dbbe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:51.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.253+0000 7fcad77fe640 1 --2- 172.21.15.2:0/2161950795 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fcac40a3430 0x7fcac40a58f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcad00098b0 tx=0x7fcad0004ab0 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:51.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.253+0000 7fcacd7fa640 1 -- 172.21.15.2:0/381627807 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac803f070 con 0x562eef788380 2024-09-19T04:57:51.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.253+0000 7fcacd7fa640 1 -- 172.21.15.2:0/381627807 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcac80316a0 con 0x562eef788380 2024-09-19T04:57:51.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.253+0000 7fcacd7fa640 1 -- 172.21.15.2:0/381627807 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac8035070 con 0x562eef788380 2024-09-19T04:57:51.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.254+0000 7fcadf913740 1 -- 172.21.15.2:0/381627807 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562eef788380 msgr2=0x562eef796c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:51.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.254+0000 7fcadf913740 1 --2- 172.21.15.2:0/381627807 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562eef788380 0x562eef796c10 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fcac802a9a0 tx=0x7fcac8032cc0 comp rx=0 tx=0).stop 2024-09-19T04:57:51.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.254+0000 7fcadf913740 1 -- 172.21.15.2:0/381627807 shutdown_connections 2024-09-19T04:57:51.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.254+0000 7fcadf913740 1 --2- 172.21.15.2:0/381627807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562eef797150 0x562eef799540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:51.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.254+0000 7fcadf913740 1 --2- 172.21.15.2:0/381627807 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562eef788380 0x562eef796c10 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:51.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.254+0000 7fcadf913740 1 --2- 172.21.15.2:0/381627807 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562eef787a60 0x562eef787e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:51.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.254+0000 7fcadf913740 1 -- 172.21.15.2:0/381627807 >> 172.21.15.2:0/381627807 conn(0x562eef7840f0 msgr2=0x562eef7844d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:51.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.254+0000 7fcadf913740 1 -- 172.21.15.2:0/381627807 shutdown_connections 2024-09-19T04:57:51.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.254+0000 7fcadf913740 1 -- 172.21.15.2:0/381627807 wait complete. 2024-09-19T04:57:51.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.254+0000 7fcadf913740 1 -- start start 2024-09-19T04:57:51.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.254+0000 7fcadf913740 1 Processor -- start 2024-09-19T04:57:51.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.255+0000 7fcadf913740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562eef787a60 0x562eef794060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:51.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.255+0000 7fcadf913740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562eef788380 0x562eef7945a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:51.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.255+0000 7fcadf913740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562eef797150 0x562eef794ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:51.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.255+0000 7fcadf913740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562eef799d20 con 0x562eef787a60 2024-09-19T04:57:51.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.255+0000 7fcadf913740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562eef6a7f10 con 0x562eef797150 2024-09-19T04:57:51.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.255+0000 7fcadf913740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x562eef799ea0 con 0x562eef788380 2024-09-19T04:57:51.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.255+0000 7fcadf913740 10 client.0 _ll_register_callbacks cb 0x562eef670a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:57:51.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.255+0000 7fcad6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562eef787a60 0x562eef794060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:51.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.255+0000 7fcad6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562eef787a60 0x562eef794060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58878/0 (socket says 172.21.15.2:58878) 2024-09-19T04:57:51.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.255+0000 7fcad6ffd640 1 -- 172.21.15.2:0/3196195366 learned_addr learned my addr 172.21.15.2:0/3196195366 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:51.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.255+0000 7fcad77fe640 1 --2- 172.21.15.2:0/3196195366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562eef797150 0x562eef794ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:51.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.255+0000 7fcad67fc640 1 --2- 172.21.15.2:0/3196195366 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562eef788380 0x562eef7945a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:51.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.255+0000 7fcad6ffd640 1 -- 172.21.15.2:0/3196195366 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562eef788380 msgr2=0x562eef7945a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:51.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.255+0000 7fcad6ffd640 1 --2- 172.21.15.2:0/3196195366 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562eef788380 0x562eef7945a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:51.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.255+0000 7fcad6ffd640 1 -- 172.21.15.2:0/3196195366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562eef797150 msgr2=0x562eef794ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:51.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.255+0000 7fcad6ffd640 1 --2- 172.21.15.2:0/3196195366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562eef797150 0x562eef794ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:51.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.255+0000 7fcad6ffd640 1 -- 172.21.15.2:0/3196195366 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562eef45e6a0 con 0x562eef787a60 2024-09-19T04:57:51.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.255+0000 7fcad6ffd640 1 --2- 172.21.15.2:0/3196195366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562eef787a60 0x562eef794060 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fcac8006010 tx=0x7fcac80050e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d10ee5f88e000a43 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:51.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.255+0000 7fcabe7fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:57:51.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.255+0000 7fcabe7fc640 1 -- 172.21.15.2:0/3196195366 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac804b060 con 0x562eef787a60 2024-09-19T04:57:51.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.255+0000 7fcabe7fc640 1 -- 172.21.15.2:0/3196195366 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8527+0+0 (secure 0 0 0) 0x7fcac8004230 con 0x562eef787a60 2024-09-19T04:57:51.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.255+0000 7fcadf913740 1 -- 172.21.15.2:0/3196195366 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcac80316a0 con 0x562eef787a60 2024-09-19T04:57:51.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.255+0000 7fcabe7fc640 1 -- 172.21.15.2:0/3196195366 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fcac803f070 con 0x562eef787a60 2024-09-19T04:57:51.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.256+0000 7fcadf913740 10 client.16650 fetch_fsmap learned FSMap version 19 2024-09-19T04:57:51.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.256+0000 7fcadf913740 1 -- 172.21.15.2:0/3196195366 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x562eef7a5990 con 0x562eef787a60 2024-09-19T04:57:51.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.256+0000 7fcabe7fc640 1 -- 172.21.15.2:0/3196195366 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcac80316a0 con 0x562eef787a60 2024-09-19T04:57:51.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.256+0000 7fcabe7fc640 1 -- 172.21.15.2:0/3196195366 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fcac8003930 con 0x562eef787a60 2024-09-19T04:57:51.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.256+0000 7fcadf913740 10 client.16650 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:57:51.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.256+0000 7fcadf913740 10 client.16650 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:57:51.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.256+0000 7fcadf913740 20 client.16650 populate_metadata read hostname 'smithi002' 2024-09-19T04:57:51.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.256+0000 7fcadf913740 1 --2- 172.21.15.2:0/3196195366 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x562eef7a6ce0 0x562eef7a90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:51.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.256+0000 7fcadf913740 4 client.16650 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:57:51.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.256+0000 7fcadf913740 1 -- 172.21.15.2:0/3196195366 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562eef6fa7f0 con 0x562eef7a6ce0 2024-09-19T04:57:51.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.256+0000 7fcad67fc640 1 --2- 172.21.15.2:0/3196195366 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x562eef7a6ce0 0x562eef7a90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:51.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.257+0000 7fcad67fc640 1 --2- 172.21.15.2:0/3196195366 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x562eef7a6ce0 0x562eef7a90d0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf36b358c399340e server_cookie=21b3c343bae2a1e1 in_seq=0 out_seq=0 2024-09-19T04:57:51.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.257+0000 7fcabe7fc640 10 client.16650 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:57:51.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.257+0000 7fcabe7fc640 1 -- 172.21.15.2:0/3196195366 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562eef6fa7f0 con 0x562eef7a6ce0 2024-09-19T04:57:51.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.257+0000 7fcabe7fc640 10 client.16650 handle_command_reply: tid=0 2024-09-19T04:57:51.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.258+0000 7fcadf913740 1 client.16650 shutdown 2024-09-19T04:57:51.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.258+0000 7fcadf913740 1 -- 172.21.15.2:0/3196195366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562eef787a60 msgr2=0x562eef794060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:51.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.258+0000 7fcadf913740 1 --2- 172.21.15.2:0/3196195366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562eef787a60 0x562eef794060 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fcac8006010 tx=0x7fcac80050e0 comp rx=0 tx=0).stop 2024-09-19T04:57:51.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.258+0000 7fcadf913740 1 -- 172.21.15.2:0/3196195366 shutdown_connections 2024-09-19T04:57:51.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.258+0000 7fcadf913740 1 --2- 172.21.15.2:0/3196195366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562eef797150 0x562eef794ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:51.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.258+0000 7fcadf913740 1 --2- 172.21.15.2:0/3196195366 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x562eef7a6ce0 0x562eef7a90d0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:51.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.258+0000 7fcadf913740 1 --2- 172.21.15.2:0/3196195366 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562eef788380 0x562eef7945a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:51.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.258+0000 7fcadf913740 1 --2- 172.21.15.2:0/3196195366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562eef787a60 0x562eef794060 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:51.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.258+0000 7fcabe7fc640 0 client.16650 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:57:51.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.258+0000 7fcadf913740 1 -- 172.21.15.2:0/3196195366 >> 172.21.15.2:0/3196195366 conn(0x562eef7840f0 msgr2=0x562eef789e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:51.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.258+0000 7fcadf913740 1 -- 172.21.15.2:0/3196195366 shutdown_connections 2024-09-19T04:57:51.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.258+0000 7fcadf913740 1 -- 172.21.15.2:0/3196195366 wait complete. 2024-09-19T04:57:51.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.258+0000 7fcadf913740 20 client.16650 trim_cache size 0 max 16384 2024-09-19T04:57:51.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.276+0000 7fcadf913740 1 Processor -- start 2024-09-19T04:57:51.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.276+0000 7fcadf913740 1 -- start start 2024-09-19T04:57:51.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.276+0000 7fcadf913740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562eef787a60 0x562eef783160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:51.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.276+0000 7fcadf913740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562eef788380 0x562eef7935c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:51.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.276+0000 7fcadf913740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562eef797150 0x562eef7ae670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:51.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.276+0000 7fcadf913740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcad81a9500 con 0x562eef787a60 2024-09-19T04:57:51.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.276+0000 7fcadf913740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcad81abd60 con 0x562eef797150 2024-09-19T04:57:51.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.276+0000 7fcadf913740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fcad81a9b50 con 0x562eef788380 2024-09-19T04:57:51.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.276+0000 7fcad6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562eef787a60 0x562eef783160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:51.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.276+0000 7fcad6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562eef787a60 0x562eef783160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58884/0 (socket says 172.21.15.2:58884) 2024-09-19T04:57:51.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.276+0000 7fcad6ffd640 1 -- 172.21.15.2:0/1383036240 learned_addr learned my addr 172.21.15.2:0/1383036240 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:51.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.276+0000 7fcad67fc640 1 --2- 172.21.15.2:0/1383036240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562eef788380 0x562eef7935c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:51.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.276+0000 7fcad77fe640 1 --2- 172.21.15.2:0/1383036240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562eef797150 0x562eef7ae670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:51.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.276+0000 7fcad6ffd640 1 -- 172.21.15.2:0/1383036240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562eef788380 msgr2=0x562eef7935c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:51.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.276+0000 7fcad6ffd640 1 --2- 172.21.15.2:0/1383036240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562eef788380 0x562eef7935c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:51.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.276+0000 7fcad6ffd640 1 -- 172.21.15.2:0/1383036240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562eef797150 msgr2=0x562eef7ae670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:51.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.276+0000 7fcad6ffd640 1 --2- 172.21.15.2:0/1383036240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562eef797150 0x562eef7ae670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:51.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.276+0000 7fcad6ffd640 1 -- 172.21.15.2:0/1383036240 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562eef796930 con 0x562eef787a60 2024-09-19T04:57:51.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.277+0000 7fcad6ffd640 1 --2- 172.21.15.2:0/1383036240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562eef787a60 0x562eef783160 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fcac8031440 tx=0x7fcac8005370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f35015e0507dd9c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:51.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.277+0000 7fcaccff9640 1 -- 172.21.15.2:0/1383036240 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac8035040 con 0x562eef787a60 2024-09-19T04:57:51.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.277+0000 7fcaccff9640 1 -- 172.21.15.2:0/1383036240 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcac803b430 con 0x562eef787a60 2024-09-19T04:57:51.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.277+0000 7fcaccff9640 1 -- 172.21.15.2:0/1383036240 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac8003850 con 0x562eef787a60 2024-09-19T04:57:51.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.278+0000 7fcadf913740 1 -- 172.21.15.2:0/1383036240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562eef787a60 msgr2=0x562eef783160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:51.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.278+0000 7fcadf913740 1 --2- 172.21.15.2:0/1383036240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562eef787a60 0x562eef783160 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fcac8031440 tx=0x7fcac8005370 comp rx=0 tx=0).stop 2024-09-19T04:57:51.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.278+0000 7fcadf913740 1 -- 172.21.15.2:0/1383036240 shutdown_connections 2024-09-19T04:57:51.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.278+0000 7fcadf913740 1 --2- 172.21.15.2:0/1383036240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562eef797150 0x562eef7ae670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:51.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.278+0000 7fcadf913740 1 --2- 172.21.15.2:0/1383036240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562eef788380 0x562eef7935c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:51.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.278+0000 7fcadf913740 1 --2- 172.21.15.2:0/1383036240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562eef787a60 0x562eef783160 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:51.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.278+0000 7fcadf913740 1 -- 172.21.15.2:0/1383036240 >> 172.21.15.2:0/1383036240 conn(0x562eef7840f0 msgr2=0x562eef782a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:51.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.278+0000 7fcadf913740 1 -- 172.21.15.2:0/1383036240 shutdown_connections 2024-09-19T04:57:51.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.278+0000 7fcadf913740 1 -- 172.21.15.2:0/1383036240 wait complete. 2024-09-19T04:57:51.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.278+0000 7fcadf913740 1 -- start start 2024-09-19T04:57:51.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.278+0000 7fcadf913740 1 Processor -- start 2024-09-19T04:57:51.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.278+0000 7fcadf913740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562eef787a60 0x562eef79b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:51.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.278+0000 7fcadf913740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562eef788380 0x562eef79b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:51.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.278+0000 7fcadf913740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562eef797150 0x562eef79bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:51.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.278+0000 7fcadf913740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcad81aa220 con 0x562eef787a60 2024-09-19T04:57:51.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.278+0000 7fcadf913740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcad81ab690 con 0x562eef788380 2024-09-19T04:57:51.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.278+0000 7fcadf913740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fcad81aa8f0 con 0x562eef797150 2024-09-19T04:57:51.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.278+0000 7fcadf913740 10 client.0 _ll_register_callbacks cb 0x7fcad0009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:57:51.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.278+0000 7fcad6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562eef787a60 0x562eef79b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:51.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.279+0000 7fcad6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562eef787a60 0x562eef79b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58890/0 (socket says 172.21.15.2:58890) 2024-09-19T04:57:51.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.279+0000 7fcad6ffd640 1 -- 172.21.15.2:0/3099613582 learned_addr learned my addr 172.21.15.2:0/3099613582 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:51.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.279+0000 7fcad77fe640 1 --2- 172.21.15.2:0/3099613582 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562eef797150 0x562eef79bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:51.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.279+0000 7fcad67fc640 1 --2- 172.21.15.2:0/3099613582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562eef788380 0x562eef79b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:51.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.279+0000 7fcad6ffd640 1 -- 172.21.15.2:0/3099613582 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562eef797150 msgr2=0x562eef79bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:51.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.279+0000 7fcad6ffd640 1 --2- 172.21.15.2:0/3099613582 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562eef797150 0x562eef79bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:51.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.279+0000 7fcad6ffd640 1 -- 172.21.15.2:0/3099613582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562eef788380 msgr2=0x562eef79b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:51.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.279+0000 7fcad6ffd640 1 --2- 172.21.15.2:0/3099613582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562eef788380 0x562eef79b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:51.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.279+0000 7fcad6ffd640 1 -- 172.21.15.2:0/3099613582 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562eef810890 con 0x562eef787a60 2024-09-19T04:57:51.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.279+0000 7fcad77fe640 1 --2- 172.21.15.2:0/3099613582 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562eef797150 0x562eef79bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:57:51.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.279+0000 7fcad6ffd640 1 --2- 172.21.15.2:0/3099613582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562eef787a60 0x562eef79b0d0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fcac8003dd0 tx=0x7fcac8005260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=563a5eb8cb596b86 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:51.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.279+0000 7fcabe7fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:57:51.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.279+0000 7fcabe7fc640 1 -- 172.21.15.2:0/3099613582 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac8035040 con 0x562eef787a60 2024-09-19T04:57:51.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.279+0000 7fcabe7fc640 1 -- 172.21.15.2:0/3099613582 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8527+0+0 (secure 0 0 0) 0x7fcac8031c60 con 0x562eef787a60 2024-09-19T04:57:51.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.279+0000 7fcadf913740 1 -- 172.21.15.2:0/3099613582 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcac803b430 con 0x562eef787a60 2024-09-19T04:57:51.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.279+0000 7fcabe7fc640 1 -- 172.21.15.2:0/3099613582 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fcac8068050 con 0x562eef787a60 2024-09-19T04:57:51.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.279+0000 7fcadf913740 10 client.16656 fetch_fsmap learned FSMap version 19 2024-09-19T04:57:51.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.280+0000 7fcadf913740 1 -- 172.21.15.2:0/3099613582 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x562eef811bb0 con 0x562eef787a60 2024-09-19T04:57:51.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.280+0000 7fcabe7fc640 1 -- 172.21.15.2:0/3099613582 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcac803b430 con 0x562eef787a60 2024-09-19T04:57:51.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.280+0000 7fcabe7fc640 1 -- 172.21.15.2:0/3099613582 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fcac8004960 con 0x562eef787a60 2024-09-19T04:57:51.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.280+0000 7fcadf913740 10 client.16656 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:57:51.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.280+0000 7fcadf913740 10 client.16656 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:57:51.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.280+0000 7fcadf913740 20 client.16656 populate_metadata read hostname 'smithi002' 2024-09-19T04:57:51.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.280+0000 7fcadf913740 1 --2- 172.21.15.2:0/3099613582 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x562eef812210 0x562eef814650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:51.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.280+0000 7fcadf913740 4 client.16656 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:57:51.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.280+0000 7fcadf913740 1 -- 172.21.15.2:0/3099613582 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562eef6f4d00 con 0x562eef812210 2024-09-19T04:57:51.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.280+0000 7fcad67fc640 1 --2- 172.21.15.2:0/3099613582 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x562eef812210 0x562eef814650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:51.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.281+0000 7fcad67fc640 1 --2- 172.21.15.2:0/3099613582 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x562eef812210 0x562eef814650 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3dd6eec45c505508 server_cookie=41f03724fba929ee in_seq=0 out_seq=0 2024-09-19T04:57:51.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.281+0000 7fcabe7fc640 10 client.16656 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:57:51.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.281+0000 7fcabe7fc640 1 -- 172.21.15.2:0/3099613582 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562eef6f4d00 con 0x562eef812210 2024-09-19T04:57:51.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.281+0000 7fcabe7fc640 10 client.16656 handle_command_reply: tid=0 2024-09-19T04:57:51.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.281+0000 7fcadf913740 1 client.16656 shutdown 2024-09-19T04:57:51.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.282+0000 7fcadf913740 1 -- 172.21.15.2:0/3099613582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562eef787a60 msgr2=0x562eef79b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:51.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.282+0000 7fcadf913740 1 --2- 172.21.15.2:0/3099613582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562eef787a60 0x562eef79b0d0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fcac8003dd0 tx=0x7fcac8005260 comp rx=0 tx=0).stop 2024-09-19T04:57:51.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.282+0000 7fcadf913740 1 -- 172.21.15.2:0/3099613582 shutdown_connections 2024-09-19T04:57:51.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.282+0000 7fcadf913740 1 --2- 172.21.15.2:0/3099613582 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x562eef812210 0x562eef814650 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:51.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.282+0000 7fcadf913740 1 --2- 172.21.15.2:0/3099613582 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562eef797150 0x562eef79bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:51.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.282+0000 7fcadf913740 1 --2- 172.21.15.2:0/3099613582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562eef788380 0x562eef79b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:51.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.282+0000 7fcadf913740 1 --2- 172.21.15.2:0/3099613582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562eef787a60 0x562eef79b0d0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:51.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.282+0000 7fcadf913740 1 -- 172.21.15.2:0/3099613582 >> 172.21.15.2:0/3099613582 conn(0x562eef7840f0 msgr2=0x562eef789d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:51.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.282+0000 7fcabe7fc640 0 client.16656 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:57:51.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.282+0000 7fcadf913740 1 -- 172.21.15.2:0/3099613582 shutdown_connections 2024-09-19T04:57:51.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.282+0000 7fcadf913740 1 -- 172.21.15.2:0/3099613582 wait complete. 2024-09-19T04:57:51.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.282+0000 7fcadf913740 20 client.16656 trim_cache size 0 max 16384 2024-09-19T04:57:51.291 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:57:51.292 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T04:57:51.292 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "c9b869b1-5e08-406a-b57b-da6542470350", 2024-09-19T04:57:51.292 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T04:57:51.292 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:57:51.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.283+0000 7fcadd53a640 1 -- 172.21.15.2:0/2161950795 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fcac40a3430 msgr2=0x7fcac40a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:51.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.283+0000 7fcadd53a640 1 --2- 172.21.15.2:0/2161950795 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fcac40a3430 0x7fcac40a58f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcad00098b0 tx=0x7fcad0004ab0 comp rx=0 tx=0).stop 2024-09-19T04:57:51.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.283+0000 7fcadd53a640 1 -- 172.21.15.2:0/2161950795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcad8103660 msgr2=0x7fcad8198910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:51.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.283+0000 7fcadd53a640 1 --2- 172.21.15.2:0/2161950795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcad8103660 0x7fcad8198910 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fcac000b3f0 tx=0x7fcac000b8b0 comp rx=0 tx=0).stop 2024-09-19T04:57:51.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.283+0000 7fcadd53a640 1 -- 172.21.15.2:0/2161950795 shutdown_connections 2024-09-19T04:57:51.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.283+0000 7fcadd53a640 1 --2- 172.21.15.2:0/2161950795 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fcac40a3430 0x7fcac40a58f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:51.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.283+0000 7fcadd53a640 1 --2- 172.21.15.2:0/2161950795 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcad810c170 0x7fcad819cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:51.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.283+0000 7fcadd53a640 1 --2- 172.21.15.2:0/2161950795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcad8103660 0x7fcad8198910 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:51.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.283+0000 7fcadd53a640 1 --2- 172.21.15.2:0/2161950795 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcad8102d40 0x7fcad81983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:51.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.283+0000 7fcadd53a640 1 -- 172.21.15.2:0/2161950795 >> 172.21.15.2:0/2161950795 conn(0x7fcad80fc7a0 msgr2=0x7fcad80fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:51.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.283+0000 7fcadd53a640 1 -- 172.21.15.2:0/2161950795 shutdown_connections 2024-09-19T04:57:51.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:51.283+0000 7fcadd53a640 1 -- 172.21.15.2:0/2161950795 wait complete. 2024-09-19T04:57:52.063 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:57:52.319 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:57:52.721 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:52 smithi002 ceph-mon[30975]: scrub queued for path: / 2024-09-19T04:57:52.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:52 smithi002 ceph-mon[30975]: scrub summary: idle+waiting paths [/] 2024-09-19T04:57:52.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:52 smithi002 ceph-mon[30975]: scrub summary: active paths [/] 2024-09-19T04:57:52.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:52 smithi002 ceph-mon[30975]: scrub summary: idle+waiting paths [/] 2024-09-19T04:57:52.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:52 smithi002 ceph-mon[30975]: pgmap v305: 97 pgs: 97 active+clean; 19 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 73 KiB/s wr, 10 op/s 2024-09-19T04:57:52.806 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:52 smithi018 ceph-mon[34537]: scrub queued for path: / 2024-09-19T04:57:52.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:52 smithi018 ceph-mon[34537]: scrub summary: idle+waiting paths [/] 2024-09-19T04:57:52.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:52 smithi018 ceph-mon[34537]: scrub summary: active paths [/] 2024-09-19T04:57:52.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:52 smithi018 ceph-mon[34537]: scrub summary: idle+waiting paths [/] 2024-09-19T04:57:52.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:52 smithi018 ceph-mon[34537]: pgmap v305: 97 pgs: 97 active+clean; 19 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 73 KiB/s wr, 10 op/s 2024-09-19T04:57:52.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.804+0000 7fb40eaeb640 1 -- 172.21.15.2:0/1501017084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb408102790 msgr2=0x7fb4081067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:52.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.804+0000 7fb40eaeb640 1 --2- 172.21.15.2:0/1501017084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb408102790 0x7fb4081067e0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8009900 tx=0x7fb3f802a410 comp rx=0 tx=0).stop 2024-09-19T04:57:52.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.804+0000 7fb40eaeb640 1 -- 172.21.15.2:0/1501017084 shutdown_connections 2024-09-19T04:57:52.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.804+0000 7fb40eaeb640 1 --2- 172.21.15.2:0/1501017084 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb408106f10 0x7fb40810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:52.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.804+0000 7fb40eaeb640 1 --2- 172.21.15.2:0/1501017084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb408102790 0x7fb4081067e0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:52.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.804+0000 7fb40eaeb640 1 --2- 172.21.15.2:0/1501017084 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb408101de0 0x7fb4081021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:52.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.804+0000 7fb40eaeb640 1 -- 172.21.15.2:0/1501017084 >> 172.21.15.2:0/1501017084 conn(0x7fb4080fd8c0 msgr2=0x7fb4080ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:52.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.804+0000 7fb40eaeb640 1 -- 172.21.15.2:0/1501017084 shutdown_connections 2024-09-19T04:57:52.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.804+0000 7fb40eaeb640 1 -- 172.21.15.2:0/1501017084 wait complete. 2024-09-19T04:57:52.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.805+0000 7fb40eaeb640 1 Processor -- start 2024-09-19T04:57:52.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.805+0000 7fb40eaeb640 1 -- start start 2024-09-19T04:57:52.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.805+0000 7fb40eaeb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb408101de0 0x7fb408198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:52.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.805+0000 7fb40eaeb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb408102790 0x7fb408198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:52.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.805+0000 7fb40eaeb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb408106f10 0x7fb40819cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:52.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.805+0000 7fb40eaeb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb408111ec0 con 0x7fb408102790 2024-09-19T04:57:52.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.805+0000 7fb40eaeb640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb408111d40 con 0x7fb408101de0 2024-09-19T04:57:52.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.805+0000 7fb40eaeb640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fb408112040 con 0x7fb408106f10 2024-09-19T04:57:52.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.805+0000 7fb3fffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb408102790 0x7fb408198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:52.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.805+0000 7fb3fffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb408102790 0x7fb408198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37244/0 (socket says 172.21.15.2:37244) 2024-09-19T04:57:52.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.805+0000 7fb3fffff640 1 -- 172.21.15.2:0/3956604024 learned_addr learned my addr 172.21.15.2:0/3956604024 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:52.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.805+0000 7fb40c887640 1 --2- 172.21.15.2:0/3956604024 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb408101de0 0x7fb408198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:52.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.805+0000 7fb40d088640 1 --2- 172.21.15.2:0/3956604024 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb408106f10 0x7fb40819cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:52.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.805+0000 7fb3fffff640 1 -- 172.21.15.2:0/3956604024 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb408106f10 msgr2=0x7fb40819cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:52.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.805+0000 7fb3fffff640 1 --2- 172.21.15.2:0/3956604024 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb408106f10 0x7fb40819cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:52.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.805+0000 7fb3fffff640 1 -- 172.21.15.2:0/3956604024 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb408101de0 msgr2=0x7fb408198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:52.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.805+0000 7fb3fffff640 1 --2- 172.21.15.2:0/3956604024 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb408101de0 0x7fb408198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:52.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.805+0000 7fb3fffff640 1 -- 172.21.15.2:0/3956604024 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb40819d4d0 con 0x7fb408102790 2024-09-19T04:57:52.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.805+0000 7fb40d088640 1 --2- 172.21.15.2:0/3956604024 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb408106f10 0x7fb40819cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:57:52.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.806+0000 7fb3fffff640 1 --2- 172.21.15.2:0/3956604024 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb408102790 0x7fb408198a60 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8006010 tx=0x7fb3f8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:52.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.806+0000 7fb3fdffb640 1 -- 172.21.15.2:0/3956604024 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f803f030 con 0x7fb408102790 2024-09-19T04:57:52.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.806+0000 7fb3fdffb640 1 -- 172.21.15.2:0/3956604024 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb3f80035f0 con 0x7fb408102790 2024-09-19T04:57:52.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.806+0000 7fb3fdffb640 1 -- 172.21.15.2:0/3956604024 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f8035070 con 0x7fb408102790 2024-09-19T04:57:52.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.806+0000 7fb40eaeb640 1 -- 172.21.15.2:0/3956604024 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb40819d760 con 0x7fb408102790 2024-09-19T04:57:52.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.806+0000 7fb40eaeb640 1 -- 172.21.15.2:0/3956604024 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb40819dbf0 con 0x7fb408102790 2024-09-19T04:57:52.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.808+0000 7fb3fdffb640 1 -- 172.21.15.2:0/3956604024 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fb3f8003b10 con 0x7fb408102790 2024-09-19T04:57:52.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.809+0000 7fb410ec4740 1 Processor -- start 2024-09-19T04:57:52.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.809+0000 7fb410ec4740 1 -- start start 2024-09-19T04:57:52.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.809+0000 7fb410ec4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f7387c4a0 0x557f7387c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:52.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.809+0000 7fb410ec4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f7387cdc0 0x557f73887140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:52.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.809+0000 7fb410ec4740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557f73887680 0x557f73889a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:52.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.809+0000 7fb410ec4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557f737e22e0 con 0x557f7387cdc0 2024-09-19T04:57:52.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.809+0000 7fb410ec4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x557f73789ce0 con 0x557f7387c4a0 2024-09-19T04:57:52.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.809+0000 7fb410ec4740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x557f737de2a0 con 0x557f73887680 2024-09-19T04:57:52.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.809+0000 7fb40c887640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f7387cdc0 0x557f73887140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:52.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.809+0000 7fb40c887640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f7387cdc0 0x557f73887140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37252/0 (socket says 172.21.15.2:37252) 2024-09-19T04:57:52.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.809+0000 7fb40c887640 1 -- 172.21.15.2:0/245741215 learned_addr learned my addr 172.21.15.2:0/245741215 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:52.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.809+0000 7fb40d088640 1 --2- 172.21.15.2:0/245741215 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f7387c4a0 0x557f7387c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:52.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.809+0000 7fb3fffff640 1 --2- 172.21.15.2:0/245741215 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557f73887680 0x557f73889a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:52.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.809+0000 7fb40c887640 1 -- 172.21.15.2:0/245741215 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557f73887680 msgr2=0x557f73889a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:52.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.809+0000 7fb40c887640 1 --2- 172.21.15.2:0/245741215 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557f73887680 0x557f73889a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:52.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.809+0000 7fb40c887640 1 -- 172.21.15.2:0/245741215 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f7387c4a0 msgr2=0x557f7387c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:52.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.809+0000 7fb40c887640 1 --2- 172.21.15.2:0/245741215 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f7387c4a0 0x557f7387c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:52.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.809+0000 7fb40c887640 1 -- 172.21.15.2:0/245741215 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f7376e440 con 0x557f7387cdc0 2024-09-19T04:57:52.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.809+0000 7fb3fffff640 1 --2- 172.21.15.2:0/245741215 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557f73887680 0x557f73889a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:57:52.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.809+0000 7fb3fdffb640 1 --2- 172.21.15.2:0/3956604024 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fb3f00a33b0 0x7fb3f00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:52.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.810+0000 7fb40d088640 1 --2- 172.21.15.2:0/3956604024 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fb3f00a33b0 0x7fb3f00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:52.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.810+0000 7fb40c887640 1 --2- 172.21.15.2:0/245741215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f7387cdc0 0x557f73887140 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fb40400b820 tx=0x7fb40400bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54fa285112f2782d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:52.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.810+0000 7fb3fdffb640 1 -- 172.21.15.2:0/3956604024 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8527+0+0 (secure 0 0 0) 0x7fb3f80f0950 con 0x7fb408102790 2024-09-19T04:57:52.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.810+0000 7fb3eeffd640 1 -- 172.21.15.2:0/245741215 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb40400d950 con 0x557f7387cdc0 2024-09-19T04:57:52.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.810+0000 7fb3eeffd640 1 -- 172.21.15.2:0/245741215 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb404019070 con 0x557f7387cdc0 2024-09-19T04:57:52.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.810+0000 7fb3eeffd640 1 -- 172.21.15.2:0/245741215 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4040123e0 con 0x557f7387cdc0 2024-09-19T04:57:52.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.811+0000 7fb410ec4740 1 -- 172.21.15.2:0/245741215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f7387cdc0 msgr2=0x557f73887140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:52.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.811+0000 7fb40d088640 1 --2- 172.21.15.2:0/3956604024 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fb3f00a33b0 0x7fb3f00a5870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb40000f4c0 tx=0x7fb400007740 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:52.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.811+0000 7fb410ec4740 1 --2- 172.21.15.2:0/245741215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f7387cdc0 0x557f73887140 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fb40400b820 tx=0x7fb40400bce0 comp rx=0 tx=0).stop 2024-09-19T04:57:52.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.811+0000 7fb410ec4740 1 -- 172.21.15.2:0/245741215 shutdown_connections 2024-09-19T04:57:52.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.811+0000 7fb410ec4740 1 --2- 172.21.15.2:0/245741215 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557f73887680 0x557f73889a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:52.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.811+0000 7fb410ec4740 1 --2- 172.21.15.2:0/245741215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f7387cdc0 0x557f73887140 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:52.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.811+0000 7fb410ec4740 1 --2- 172.21.15.2:0/245741215 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f7387c4a0 0x557f7387c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:52.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.811+0000 7fb410ec4740 1 -- 172.21.15.2:0/245741215 >> 172.21.15.2:0/245741215 conn(0x557f73878a30 msgr2=0x557f73878e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:52.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.811+0000 7fb410ec4740 1 -- 172.21.15.2:0/245741215 shutdown_connections 2024-09-19T04:57:52.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.811+0000 7fb410ec4740 1 -- 172.21.15.2:0/245741215 wait complete. 2024-09-19T04:57:52.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.811+0000 7fb410ec4740 1 -- start start 2024-09-19T04:57:52.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.811+0000 7fb410ec4740 1 Processor -- start 2024-09-19T04:57:52.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.811+0000 7fb410ec4740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557f7387c4a0 0x557f73886f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:52.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.812+0000 7fb410ec4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f7387cdc0 0x557f738841e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:52.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.812+0000 7fb410ec4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f73887680 0x557f73884720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:52.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.812+0000 7fb410ec4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557f7388a250 con 0x557f73887680 2024-09-19T04:57:52.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.812+0000 7fb410ec4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x557f7379d050 con 0x557f7387cdc0 2024-09-19T04:57:52.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.812+0000 7fb410ec4740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x557f7388a3d0 con 0x557f7387c4a0 2024-09-19T04:57:52.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.812+0000 7fb410ec4740 10 client.0 _ll_register_callbacks cb 0x557f737dd160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:57:52.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.812+0000 7fb40d088640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f73887680 0x557f73884720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:52.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.812+0000 7fb40d088640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f73887680 0x557f73884720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37260/0 (socket says 172.21.15.2:37260) 2024-09-19T04:57:52.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.812+0000 7fb40d088640 1 -- 172.21.15.2:0/2916711061 learned_addr learned my addr 172.21.15.2:0/2916711061 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:52.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.812+0000 7fb3fffff640 1 --2- 172.21.15.2:0/2916711061 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f7387cdc0 0x557f738841e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:52.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.812+0000 7fb40c887640 1 --2- 172.21.15.2:0/2916711061 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557f7387c4a0 0x557f73886f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:52.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.812+0000 7fb40d088640 1 -- 172.21.15.2:0/2916711061 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557f7387c4a0 msgr2=0x557f73886f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:52.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.812+0000 7fb40d088640 1 --2- 172.21.15.2:0/2916711061 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557f7387c4a0 0x557f73886f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:52.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.812+0000 7fb40d088640 1 -- 172.21.15.2:0/2916711061 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f7387cdc0 msgr2=0x557f738841e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:52.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.812+0000 7fb40d088640 1 --2- 172.21.15.2:0/2916711061 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f7387cdc0 0x557f738841e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:52.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.812+0000 7fb40d088640 1 -- 172.21.15.2:0/2916711061 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f735533c0 con 0x557f73887680 2024-09-19T04:57:52.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.812+0000 7fb3fffff640 1 --2- 172.21.15.2:0/2916711061 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f7387cdc0 0x557f738841e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:57:52.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.812+0000 7fb40d088640 1 --2- 172.21.15.2:0/2916711061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f73887680 0x557f73884720 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fb400010ee0 tx=0x7fb400004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a8fc9a9c1c4b33a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:52.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.812+0000 7fb3e7fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:57:52.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.812+0000 7fb3e7fff640 1 -- 172.21.15.2:0/2916711061 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb400026680 con 0x557f73887680 2024-09-19T04:57:52.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.812+0000 7fb3e7fff640 1 -- 172.21.15.2:0/2916711061 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8527+0+0 (secure 0 0 0) 0x7fb40001d420 con 0x557f73887680 2024-09-19T04:57:52.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.812+0000 7fb410ec4740 1 -- 172.21.15.2:0/2916711061 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb404019070 con 0x557f73887680 2024-09-19T04:57:52.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.813+0000 7fb3e7fff640 1 -- 172.21.15.2:0/2916711061 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb400026820 con 0x557f73887680 2024-09-19T04:57:52.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.813+0000 7fb410ec4740 10 client.16668 fetch_fsmap learned FSMap version 19 2024-09-19T04:57:52.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.813+0000 7fb410ec4740 1 -- 172.21.15.2:0/2916711061 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x557f73895bd0 con 0x557f73887680 2024-09-19T04:57:52.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.813+0000 7fb3e7fff640 1 -- 172.21.15.2:0/2916711061 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb404019070 con 0x557f73887680 2024-09-19T04:57:52.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.813+0000 7fb3e7fff640 1 -- 172.21.15.2:0/2916711061 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fb40001dc20 con 0x557f73887680 2024-09-19T04:57:52.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.813+0000 7fb410ec4740 10 client.16668 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:57:52.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.813+0000 7fb410ec4740 10 client.16668 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:57:52.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.813+0000 7fb410ec4740 20 client.16668 populate_metadata read hostname 'smithi002' 2024-09-19T04:57:52.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.813+0000 7fb410ec4740 1 --2- 172.21.15.2:0/2916711061 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x557f73896fe0 0x557f73899430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:52.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.813+0000 7fb410ec4740 4 client.16668 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:57:52.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.813+0000 7fb410ec4740 1 -- 172.21.15.2:0/2916711061 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557f737ef850 con 0x557f73896fe0 2024-09-19T04:57:52.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.813+0000 7fb40c887640 1 --2- 172.21.15.2:0/2916711061 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x557f73896fe0 0x557f73899430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:52.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.814+0000 7fb3e7fff640 10 client.16668 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:57:52.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.814+0000 7fb40c887640 1 --2- 172.21.15.2:0/2916711061 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x557f73896fe0 0x557f73899430 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8eae80fb0a741774 server_cookie=4860bbe36c1d0b1a in_seq=0 out_seq=0 2024-09-19T04:57:52.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.814+0000 7fb3e7fff640 1 -- 172.21.15.2:0/2916711061 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557f737ef850 con 0x557f73896fe0 2024-09-19T04:57:52.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.814+0000 7fb3e7fff640 10 client.16668 handle_command_reply: tid=0 2024-09-19T04:57:52.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.815+0000 7fb410ec4740 1 client.16668 shutdown 2024-09-19T04:57:52.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.815+0000 7fb410ec4740 1 -- 172.21.15.2:0/2916711061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f73887680 msgr2=0x557f73884720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:52.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.815+0000 7fb410ec4740 1 --2- 172.21.15.2:0/2916711061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f73887680 0x557f73884720 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fb400010ee0 tx=0x7fb400004b50 comp rx=0 tx=0).stop 2024-09-19T04:57:52.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.815+0000 7fb410ec4740 1 -- 172.21.15.2:0/2916711061 shutdown_connections 2024-09-19T04:57:52.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.815+0000 7fb410ec4740 1 --2- 172.21.15.2:0/2916711061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f73887680 0x557f73884720 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:52.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.815+0000 7fb410ec4740 1 --2- 172.21.15.2:0/2916711061 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f7387cdc0 0x557f738841e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:52.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.815+0000 7fb410ec4740 1 --2- 172.21.15.2:0/2916711061 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x557f73896fe0 0x557f73899430 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:52.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.815+0000 7fb410ec4740 1 --2- 172.21.15.2:0/2916711061 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557f7387c4a0 0x557f73886f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:52.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.815+0000 7fb410ec4740 1 -- 172.21.15.2:0/2916711061 >> 172.21.15.2:0/2916711061 conn(0x557f73878a30 msgr2=0x557f7387e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:52.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.815+0000 7fb3e7fff640 0 client.16668 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:57:52.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.815+0000 7fb410ec4740 1 -- 172.21.15.2:0/2916711061 shutdown_connections 2024-09-19T04:57:52.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.815+0000 7fb410ec4740 1 -- 172.21.15.2:0/2916711061 wait complete. 2024-09-19T04:57:52.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.815+0000 7fb410ec4740 20 client.16668 trim_cache size 0 max 16384 2024-09-19T04:57:52.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.832+0000 7fb410ec4740 1 Processor -- start 2024-09-19T04:57:52.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.833+0000 7fb410ec4740 1 -- start start 2024-09-19T04:57:52.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.833+0000 7fb410ec4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f73878a30 0x557f738934b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:52.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.833+0000 7fb410ec4740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557f7387c4a0 0x557f7387f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:52.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.833+0000 7fb410ec4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f7387cdc0 0x557f7389ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:52.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.833+0000 7fb410ec4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb4081ab8c0 con 0x557f73878a30 2024-09-19T04:57:52.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.833+0000 7fb410ec4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb4081ae120 con 0x557f7387cdc0 2024-09-19T04:57:52.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.833+0000 7fb410ec4740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fb4081abf10 con 0x557f7387c4a0 2024-09-19T04:57:52.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.833+0000 7fb40c887640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f73878a30 0x557f738934b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:52.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.833+0000 7fb40c887640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f73878a30 0x557f738934b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37262/0 (socket says 172.21.15.2:37262) 2024-09-19T04:57:52.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.833+0000 7fb40c887640 1 -- 172.21.15.2:0/898180102 learned_addr learned my addr 172.21.15.2:0/898180102 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:52.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.833+0000 7fb40d088640 1 --2- 172.21.15.2:0/898180102 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f7387cdc0 0x557f7389ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:52.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.833+0000 7fb40c887640 1 -- 172.21.15.2:0/898180102 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557f7387c4a0 msgr2=0x557f7387f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:52.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.833+0000 7fb40c887640 1 --2- 172.21.15.2:0/898180102 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557f7387c4a0 0x557f7387f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:52.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.833+0000 7fb40c887640 1 -- 172.21.15.2:0/898180102 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f7387cdc0 msgr2=0x557f7389ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:52.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.833+0000 7fb40c887640 1 --2- 172.21.15.2:0/898180102 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f7387cdc0 0x557f7389ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:52.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.833+0000 7fb40c887640 1 -- 172.21.15.2:0/898180102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f73878860 con 0x557f73878a30 2024-09-19T04:57:52.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.833+0000 7fb40d088640 1 --2- 172.21.15.2:0/898180102 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f7387cdc0 0x557f7389ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:57:52.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.833+0000 7fb40c887640 1 --2- 172.21.15.2:0/898180102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f73878a30 0x557f738934b0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x557f73879890 tx=0x7fb40400f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d625019ad688340 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:52.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.834+0000 7fb3ee7fc640 1 -- 172.21.15.2:0/898180102 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb40402a070 con 0x557f73878a30 2024-09-19T04:57:52.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.834+0000 7fb3ee7fc640 1 -- 172.21.15.2:0/898180102 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb404019040 con 0x557f73878a30 2024-09-19T04:57:52.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.834+0000 7fb3ee7fc640 1 -- 172.21.15.2:0/898180102 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb404024730 con 0x557f73878a30 2024-09-19T04:57:52.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.834+0000 7fb410ec4740 1 -- 172.21.15.2:0/898180102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f73878a30 msgr2=0x557f738934b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:52.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.834+0000 7fb410ec4740 1 --2- 172.21.15.2:0/898180102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f73878a30 0x557f738934b0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x557f73879890 tx=0x7fb40400f040 comp rx=0 tx=0).stop 2024-09-19T04:57:52.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.834+0000 7fb410ec4740 1 -- 172.21.15.2:0/898180102 shutdown_connections 2024-09-19T04:57:52.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.834+0000 7fb410ec4740 1 --2- 172.21.15.2:0/898180102 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f7387cdc0 0x557f7389ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:52.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.834+0000 7fb410ec4740 1 --2- 172.21.15.2:0/898180102 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557f7387c4a0 0x557f7387f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:52.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.834+0000 7fb410ec4740 1 --2- 172.21.15.2:0/898180102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f73878a30 0x557f738934b0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:52.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.834+0000 7fb410ec4740 1 -- 172.21.15.2:0/898180102 >> 172.21.15.2:0/898180102 conn(0x557f73884880 msgr2=0x557f7387f030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:52.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.834+0000 7fb410ec4740 1 -- 172.21.15.2:0/898180102 shutdown_connections 2024-09-19T04:57:52.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.834+0000 7fb410ec4740 1 -- 172.21.15.2:0/898180102 wait complete. 2024-09-19T04:57:52.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.835+0000 7fb410ec4740 1 -- start start 2024-09-19T04:57:52.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.835+0000 7fb410ec4740 1 Processor -- start 2024-09-19T04:57:52.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.835+0000 7fb410ec4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f73878a30 0x557f7388fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:52.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.835+0000 7fb410ec4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f7387c4a0 0x557f7388b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:52.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.835+0000 7fb410ec4740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557f7387cdc0 0x557f7388b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:52.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.835+0000 7fb410ec4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb4081ac5e0 con 0x557f73878a30 2024-09-19T04:57:52.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.835+0000 7fb410ec4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb4081ada50 con 0x557f7387c4a0 2024-09-19T04:57:52.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.835+0000 7fb410ec4740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fb4081accb0 con 0x557f7387cdc0 2024-09-19T04:57:52.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.835+0000 7fb410ec4740 10 client.0 _ll_register_callbacks cb 0x7fb400010b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:57:52.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.835+0000 7fb40c887640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f73878a30 0x557f7388fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:52.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.835+0000 7fb40c887640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f73878a30 0x557f7388fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37270/0 (socket says 172.21.15.2:37270) 2024-09-19T04:57:52.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.835+0000 7fb40c887640 1 -- 172.21.15.2:0/1299812779 learned_addr learned my addr 172.21.15.2:0/1299812779 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:57:52.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.836+0000 7fb40d088640 1 --2- 172.21.15.2:0/1299812779 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557f7387cdc0 0x557f7388b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:52.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.836+0000 7fb3fffff640 1 --2- 172.21.15.2:0/1299812779 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f7387c4a0 0x557f7388b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:52.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.836+0000 7fb40c887640 1 -- 172.21.15.2:0/1299812779 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557f7387cdc0 msgr2=0x557f7388b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:52.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.836+0000 7fb40c887640 1 --2- 172.21.15.2:0/1299812779 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557f7387cdc0 0x557f7388b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:52.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.836+0000 7fb40c887640 1 -- 172.21.15.2:0/1299812779 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f7387c4a0 msgr2=0x557f7388b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:57:52.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.836+0000 7fb40c887640 1 --2- 172.21.15.2:0/1299812779 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f7387c4a0 0x557f7388b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:52.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.836+0000 7fb40c887640 1 -- 172.21.15.2:0/1299812779 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f7388bd90 con 0x557f73878a30 2024-09-19T04:57:52.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.836+0000 7fb3fffff640 1 --2- 172.21.15.2:0/1299812779 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f7387c4a0 0x557f7388b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:57:52.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.836+0000 7fb40c887640 1 --2- 172.21.15.2:0/1299812779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f73878a30 0x557f7388fcf0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fb404004700 tx=0x7fb40400bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28b4648b1398de3b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:57:52.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.836+0000 7fb3e7fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:57:52.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.836+0000 7fb3e7fff640 1 -- 172.21.15.2:0/1299812779 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb404035060 con 0x557f73878a30 2024-09-19T04:57:52.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.836+0000 7fb410ec4740 1 -- 172.21.15.2:0/1299812779 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb404019040 con 0x557f73878a30 2024-09-19T04:57:52.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.836+0000 7fb3e7fff640 1 -- 172.21.15.2:0/1299812779 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8527+0+0 (secure 0 0 0) 0x7fb40400db60 con 0x557f73878a30 2024-09-19T04:57:52.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.836+0000 7fb3e7fff640 1 -- 172.21.15.2:0/1299812779 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb40402a030 con 0x557f73878a30 2024-09-19T04:57:52.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.836+0000 7fb410ec4740 10 client.16674 fetch_fsmap learned FSMap version 19 2024-09-19T04:57:52.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.836+0000 7fb410ec4740 1 -- 172.21.15.2:0/1299812779 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x557f73906080 con 0x557f73878a30 2024-09-19T04:57:52.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.837+0000 7fb3e7fff640 1 -- 172.21.15.2:0/1299812779 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb404019040 con 0x557f73878a30 2024-09-19T04:57:52.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.837+0000 7fb3e7fff640 1 -- 172.21.15.2:0/1299812779 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fb404013070 con 0x557f73878a30 2024-09-19T04:57:52.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.837+0000 7fb410ec4740 10 client.16674 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:57:52.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.837+0000 7fb410ec4740 10 client.16674 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:57:52.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.837+0000 7fb410ec4740 20 client.16674 populate_metadata read hostname 'smithi002' 2024-09-19T04:57:52.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.837+0000 7fb410ec4740 1 --2- 172.21.15.2:0/1299812779 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x557f73887680 0x557f73908560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:57:52.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.837+0000 7fb410ec4740 4 client.16674 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:57:52.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.837+0000 7fb410ec4740 1 -- 172.21.15.2:0/1299812779 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557f737e9d60 con 0x557f73887680 2024-09-19T04:57:52.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.837+0000 7fb3fffff640 1 --2- 172.21.15.2:0/1299812779 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x557f73887680 0x557f73908560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:57:52.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.838+0000 7fb3fffff640 1 --2- 172.21.15.2:0/1299812779 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x557f73887680 0x557f73908560 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a6659b921839ec server_cookie=2ffc607e045512f1 in_seq=0 out_seq=0 2024-09-19T04:57:52.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.838+0000 7fb3e7fff640 10 client.16674 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:57:52.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.838+0000 7fb3e7fff640 1 -- 172.21.15.2:0/1299812779 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x557f737e9d60 con 0x557f73887680 2024-09-19T04:57:52.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.838+0000 7fb3e7fff640 10 client.16674 handle_command_reply: tid=0 2024-09-19T04:57:52.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.838+0000 7fb410ec4740 1 client.16674 shutdown 2024-09-19T04:57:52.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.838+0000 7fb410ec4740 1 -- 172.21.15.2:0/1299812779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f73878a30 msgr2=0x557f7388fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:52.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.838+0000 7fb410ec4740 1 --2- 172.21.15.2:0/1299812779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f73878a30 0x557f7388fcf0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fb404004700 tx=0x7fb40400bf30 comp rx=0 tx=0).stop 2024-09-19T04:57:52.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.838+0000 7fb410ec4740 1 -- 172.21.15.2:0/1299812779 shutdown_connections 2024-09-19T04:57:52.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.838+0000 7fb410ec4740 1 --2- 172.21.15.2:0/1299812779 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x557f73887680 0x557f73908560 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:52.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.838+0000 7fb410ec4740 1 --2- 172.21.15.2:0/1299812779 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557f7387cdc0 0x557f7388b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:52.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.838+0000 7fb410ec4740 1 --2- 172.21.15.2:0/1299812779 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f7387c4a0 0x557f7388b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:52.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.838+0000 7fb3e7fff640 0 client.16674 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:57:52.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.838+0000 7fb410ec4740 1 --2- 172.21.15.2:0/1299812779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557f73878a30 0x557f7388fcf0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:52.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.838+0000 7fb410ec4740 1 -- 172.21.15.2:0/1299812779 >> 172.21.15.2:0/1299812779 conn(0x557f73884880 msgr2=0x557f73882670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:52.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.838+0000 7fb410ec4740 1 -- 172.21.15.2:0/1299812779 shutdown_connections 2024-09-19T04:57:52.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.838+0000 7fb410ec4740 1 -- 172.21.15.2:0/1299812779 wait complete. 2024-09-19T04:57:52.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.838+0000 7fb410ec4740 20 client.16674 trim_cache size 0 max 16384 2024-09-19T04:57:52.845 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:57:52.845 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T04:57:52.845 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-19T04:57:52.845 INFO:teuthology.orchestra.run.smithi002.stdout: "c9b869b1-5e08-406a-b57b-da6542470350": { 2024-09-19T04:57:52.845 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-19T04:57:52.845 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "c9b869b1-5e08-406a-b57b-da6542470350", 2024-09-19T04:57:52.845 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-19T04:57:52.845 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:57:52.845 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:57:52.845 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:57:52.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.839+0000 7fb40eaeb640 1 -- 172.21.15.2:0/3956604024 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fb3f00a33b0 msgr2=0x7fb3f00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:52.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.839+0000 7fb40eaeb640 1 --2- 172.21.15.2:0/3956604024 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fb3f00a33b0 0x7fb3f00a5870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb40000f4c0 tx=0x7fb400007740 comp rx=0 tx=0).stop 2024-09-19T04:57:52.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.839+0000 7fb40eaeb640 1 -- 172.21.15.2:0/3956604024 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb408102790 msgr2=0x7fb408198a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:57:52.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.839+0000 7fb40eaeb640 1 --2- 172.21.15.2:0/3956604024 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb408102790 0x7fb408198a60 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8006010 tx=0x7fb3f8004270 comp rx=0 tx=0).stop 2024-09-19T04:57:52.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.839+0000 7fb40eaeb640 1 -- 172.21.15.2:0/3956604024 shutdown_connections 2024-09-19T04:57:52.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.839+0000 7fb40eaeb640 1 --2- 172.21.15.2:0/3956604024 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fb3f00a33b0 0x7fb3f00a5870 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:52.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.839+0000 7fb40eaeb640 1 --2- 172.21.15.2:0/3956604024 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb408106f10 0x7fb40819cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:52.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.839+0000 7fb40eaeb640 1 --2- 172.21.15.2:0/3956604024 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb408102790 0x7fb408198a60 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:52.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.839+0000 7fb40eaeb640 1 --2- 172.21.15.2:0/3956604024 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb408101de0 0x7fb408198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:57:52.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.839+0000 7fb40eaeb640 1 -- 172.21.15.2:0/3956604024 >> 172.21.15.2:0/3956604024 conn(0x7fb4080fd8c0 msgr2=0x7fb4080fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:57:52.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.839+0000 7fb40eaeb640 1 -- 172.21.15.2:0/3956604024 shutdown_connections 2024-09-19T04:57:52.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:57:52.839+0000 7fb40eaeb640 1 -- 172.21.15.2:0/3956604024 wait complete. 2024-09-19T04:57:52.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:52 smithi116 ceph-mon[34477]: scrub queued for path: / 2024-09-19T04:57:52.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:52 smithi116 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-19T04:57:52.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:52 smithi116 ceph-mon[34477]: scrub summary: active paths [/] 2024-09-19T04:57:52.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:52 smithi116 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-19T04:57:52.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:52 smithi116 ceph-mon[34477]: pgmap v305: 97 pgs: 97 active+clean; 19 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 73 KiB/s wr, 10 op/s 2024-09-19T04:57:53.645 INFO:tasks.cephfs.filesystem:scrub status for tag:c9b869b1-5e08-406a-b57b-da6542470350 - {'path': '/', 'tag': 'c9b869b1-5e08-406a-b57b-da6542470350', 'options': 'recursive,force'} 2024-09-19T04:57:54.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:54 smithi018 ceph-mon[34537]: pgmap v306: 97 pgs: 97 active+clean; 19 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 50 KiB/s wr, 7 op/s 2024-09-19T04:57:54.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:54 smithi002 ceph-mon[30975]: pgmap v306: 97 pgs: 97 active+clean; 19 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 50 KiB/s wr, 7 op/s 2024-09-19T04:57:54.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:54 smithi116 ceph-mon[34477]: pgmap v306: 97 pgs: 97 active+clean; 19 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 50 KiB/s wr, 7 op/s 2024-09-19T04:57:56.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:56 smithi018 ceph-mon[34537]: pgmap v307: 97 pgs: 97 active+clean; 19 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 79 KiB/s wr, 11 op/s 2024-09-19T04:57:56.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:56 smithi018 ceph-mon[34537]: scrub summary: idle 2024-09-19T04:57:56.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:56 smithi002 ceph-mon[30975]: pgmap v307: 97 pgs: 97 active+clean; 19 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 79 KiB/s wr, 11 op/s 2024-09-19T04:57:56.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:56 smithi002 ceph-mon[30975]: scrub summary: idle 2024-09-19T04:57:56.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:56 smithi116 ceph-mon[34477]: pgmap v307: 97 pgs: 97 active+clean; 19 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 79 KiB/s wr, 11 op/s 2024-09-19T04:57:56.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:56 smithi116 ceph-mon[34477]: scrub summary: idle 2024-09-19T04:57:58.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:57:58 smithi018 ceph-mon[34537]: pgmap v308: 97 pgs: 97 active+clean; 19 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 52 KiB/s wr, 7 op/s 2024-09-19T04:57:58.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:57:58 smithi002 ceph-mon[30975]: pgmap v308: 97 pgs: 97 active+clean; 19 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 52 KiB/s wr, 7 op/s 2024-09-19T04:57:58.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:57:58 smithi116 ceph-mon[34477]: pgmap v308: 97 pgs: 97 active+clean; 19 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 52 KiB/s wr, 7 op/s 2024-09-19T04:58:00.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:00 smithi018 ceph-mon[34537]: pgmap v309: 97 pgs: 97 active+clean; 19 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 52 KiB/s wr, 7 op/s 2024-09-19T04:58:00.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:00 smithi002 ceph-mon[30975]: pgmap v309: 97 pgs: 97 active+clean; 19 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 52 KiB/s wr, 7 op/s 2024-09-19T04:58:00.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:00 smithi116 ceph-mon[34477]: pgmap v309: 97 pgs: 97 active+clean; 19 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 52 KiB/s wr, 7 op/s 2024-09-19T04:58:02.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:02 smithi018 ceph-mon[34537]: pgmap v310: 97 pgs: 97 active+clean; 19 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 74 KiB/s wr, 10 op/s 2024-09-19T04:58:02.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:02 smithi002 ceph-mon[30975]: pgmap v310: 97 pgs: 97 active+clean; 19 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 74 KiB/s wr, 10 op/s 2024-09-19T04:58:02.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:02 smithi116 ceph-mon[34477]: pgmap v310: 97 pgs: 97 active+clean; 19 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 74 KiB/s wr, 10 op/s 2024-09-19T04:58:04.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:04 smithi018 ceph-mon[34537]: pgmap v311: 97 pgs: 97 active+clean; 19 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 52 KiB/s wr, 7 op/s 2024-09-19T04:58:04.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:04 smithi002 ceph-mon[30975]: pgmap v311: 97 pgs: 97 active+clean; 19 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 52 KiB/s wr, 7 op/s 2024-09-19T04:58:04.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:04 smithi116 ceph-mon[34477]: pgmap v311: 97 pgs: 97 active+clean; 19 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 52 KiB/s wr, 7 op/s 2024-09-19T04:58:06.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:06 smithi018 ceph-mon[34537]: pgmap v312: 97 pgs: 97 active+clean; 19 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 125 KiB/s wr, 28 op/s 2024-09-19T04:58:06.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:06 smithi018 ceph-mon[34537]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T04:58:06.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:06 smithi002 ceph-mon[30975]: pgmap v312: 97 pgs: 97 active+clean; 19 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 125 KiB/s wr, 28 op/s 2024-09-19T04:58:06.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:06 smithi002 ceph-mon[30975]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T04:58:06.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:06 smithi116 ceph-mon[34477]: pgmap v312: 97 pgs: 97 active+clean; 19 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 125 KiB/s wr, 28 op/s 2024-09-19T04:58:06.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:06 smithi116 ceph-mon[34477]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T04:58:08.806 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:08 smithi018 ceph-mon[34537]: pgmap v314: 97 pgs: 97 active+clean; 19 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 115 KiB/s wr, 28 op/s 2024-09-19T04:58:08.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:08 smithi002 ceph-mon[30975]: pgmap v314: 97 pgs: 97 active+clean; 19 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 115 KiB/s wr, 28 op/s 2024-09-19T04:58:08.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:08 smithi116 ceph-mon[34477]: pgmap v314: 97 pgs: 97 active+clean; 19 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 115 KiB/s wr, 28 op/s 2024-09-19T04:58:10.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:10 smithi018 ceph-mon[34537]: pgmap v315: 97 pgs: 97 active+clean; 19 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 115 KiB/s wr, 28 op/s 2024-09-19T04:58:10.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:10 smithi002 ceph-mon[30975]: pgmap v315: 97 pgs: 97 active+clean; 19 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 115 KiB/s wr, 28 op/s 2024-09-19T04:58:10.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:10 smithi116 ceph-mon[34477]: pgmap v315: 97 pgs: 97 active+clean; 19 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 115 KiB/s wr, 28 op/s 2024-09-19T04:58:12.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:12 smithi018 ceph-mon[34537]: pgmap v316: 97 pgs: 97 active+clean; 20 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 118 KiB/s wr, 28 op/s 2024-09-19T04:58:12.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:12 smithi002 ceph-mon[30975]: pgmap v316: 97 pgs: 97 active+clean; 20 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 118 KiB/s wr, 28 op/s 2024-09-19T04:58:12.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:12 smithi116 ceph-mon[34477]: pgmap v316: 97 pgs: 97 active+clean; 20 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 118 KiB/s wr, 28 op/s 2024-09-19T04:58:14.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:14 smithi018 ceph-mon[34537]: pgmap v317: 97 pgs: 97 active+clean; 20 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 118 KiB/s wr, 28 op/s 2024-09-19T04:58:14.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:14 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:58:14.859 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:14 smithi002 ceph-mon[30975]: pgmap v317: 97 pgs: 97 active+clean; 20 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 118 KiB/s wr, 28 op/s 2024-09-19T04:58:14.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:14 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:58:14.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:14 smithi116 ceph-mon[34477]: pgmap v317: 97 pgs: 97 active+clean; 20 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 118 KiB/s wr, 28 op/s 2024-09-19T04:58:14.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:14 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:58:16.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:16 smithi018 ceph-mon[34537]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T04:58:16.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:16 smithi018 ceph-mon[34537]: pgmap v319: 97 pgs: 97 active+clean; 20 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 62 KiB/s wr, 8 op/s 2024-09-19T04:58:16.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:16 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:58:16.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:16 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:58:16.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:16 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:58:16.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:16 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:58:16.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:16 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:58:16.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:16 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:58:16.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:16 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:58:16.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:16 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:58:16.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:16 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:58:16.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:16 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:58:16.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:16 smithi002 ceph-mon[30975]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T04:58:16.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:16 smithi002 ceph-mon[30975]: pgmap v319: 97 pgs: 97 active+clean; 20 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 62 KiB/s wr, 8 op/s 2024-09-19T04:58:16.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:16 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:58:16.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:16 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:58:16.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:16 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:58:16.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:16 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:58:16.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:16 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:58:16.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:16 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:58:16.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:16 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:58:16.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:16 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:58:16.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:16 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:58:16.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:16 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:58:16.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:16 smithi116 ceph-mon[34477]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T04:58:16.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:16 smithi116 ceph-mon[34477]: pgmap v319: 97 pgs: 97 active+clean; 20 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 62 KiB/s wr, 8 op/s 2024-09-19T04:58:16.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:16 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:58:16.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:16 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:58:16.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:16 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:58:16.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:16 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:58:16.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:16 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:58:16.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:16 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:58:16.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:16 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:58:16.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:16 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:58:16.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:16 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:58:16.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:16 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:58:17.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:17 smithi018 ceph-mon[34537]: Adjusting osd_memory_target on smithi018 to 177.0M 2024-09-19T04:58:17.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:17 smithi018 ceph-mon[34537]: Unable to set osd_memory_target on smithi018 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-19T04:58:17.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:17 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:58:17.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:17 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:58:17.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:17 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:58:17.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:17 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:58:17.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:17 smithi018 ceph-mon[34537]: Adjusting osd_memory_target on smithi116 to 176.0M 2024-09-19T04:58:17.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:17 smithi018 ceph-mon[34537]: Unable to set osd_memory_target on smithi116 to 184578150: error parsing value: Value '184578150' is below minimum 939524096 2024-09-19T04:58:17.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:17 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:58:17.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:17 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:58:17.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:17 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:58:17.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:17 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:58:17.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:17 smithi018 ceph-mon[34537]: Adjusting osd_memory_target on smithi002 to 177.0M 2024-09-19T04:58:17.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:17 smithi018 ceph-mon[34537]: Unable to set osd_memory_target on smithi002 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-19T04:58:17.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:17 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:58:17.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:17 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:58:17.558 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:17 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:58:17.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:17 smithi002 ceph-mon[30975]: Adjusting osd_memory_target on smithi018 to 177.0M 2024-09-19T04:58:17.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:17 smithi002 ceph-mon[30975]: Unable to set osd_memory_target on smithi018 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-19T04:58:17.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:17 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:58:17.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:17 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:58:17.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:17 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:58:17.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:17 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:58:17.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:17 smithi002 ceph-mon[30975]: Adjusting osd_memory_target on smithi116 to 176.0M 2024-09-19T04:58:17.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:17 smithi002 ceph-mon[30975]: Unable to set osd_memory_target on smithi116 to 184578150: error parsing value: Value '184578150' is below minimum 939524096 2024-09-19T04:58:17.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:17 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:58:17.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:17 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:58:17.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:17 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:58:17.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:17 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:58:17.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:17 smithi002 ceph-mon[30975]: Adjusting osd_memory_target on smithi002 to 177.0M 2024-09-19T04:58:17.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:17 smithi002 ceph-mon[30975]: Unable to set osd_memory_target on smithi002 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-19T04:58:17.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:17 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:58:17.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:17 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:58:17.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:17 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:58:17.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:17 smithi116 ceph-mon[34477]: Adjusting osd_memory_target on smithi018 to 177.0M 2024-09-19T04:58:17.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:17 smithi116 ceph-mon[34477]: Unable to set osd_memory_target on smithi018 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-19T04:58:17.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:17 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:58:17.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:17 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:58:17.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:17 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:58:17.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:17 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:58:17.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:17 smithi116 ceph-mon[34477]: Adjusting osd_memory_target on smithi116 to 176.0M 2024-09-19T04:58:17.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:17 smithi116 ceph-mon[34477]: Unable to set osd_memory_target on smithi116 to 184578150: error parsing value: Value '184578150' is below minimum 939524096 2024-09-19T04:58:17.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:17 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:58:17.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:17 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:58:17.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:17 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:58:17.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:17 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:58:17.612 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:17 smithi116 ceph-mon[34477]: Adjusting osd_memory_target on smithi002 to 177.0M 2024-09-19T04:58:17.613 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:17 smithi116 ceph-mon[34477]: Unable to set osd_memory_target on smithi002 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-19T04:58:17.613 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:17 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:58:17.613 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:17 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:58:17.613 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:17 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:58:18.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:18 smithi018 ceph-mon[34537]: pgmap v320: 97 pgs: 97 active+clean; 20 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 62 KiB/s wr, 8 op/s 2024-09-19T04:58:18.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:18 smithi002 ceph-mon[30975]: pgmap v320: 97 pgs: 97 active+clean; 20 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 62 KiB/s wr, 8 op/s 2024-09-19T04:58:18.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:18 smithi116 ceph-mon[34477]: pgmap v320: 97 pgs: 97 active+clean; 20 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 62 KiB/s wr, 8 op/s 2024-09-19T04:58:20.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:20 smithi018 ceph-mon[34537]: pgmap v321: 97 pgs: 97 active+clean; 20 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 62 KiB/s wr, 8 op/s 2024-09-19T04:58:20.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:20 smithi002 ceph-mon[30975]: pgmap v321: 97 pgs: 97 active+clean; 20 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 62 KiB/s wr, 8 op/s 2024-09-19T04:58:20.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:20 smithi116 ceph-mon[34477]: pgmap v321: 97 pgs: 97 active+clean; 20 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 62 KiB/s wr, 8 op/s 2024-09-19T04:58:22.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:22 smithi018 ceph-mon[34537]: pgmap v322: 97 pgs: 97 active+clean; 20 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 62 KiB/s wr, 8 op/s 2024-09-19T04:58:22.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:22 smithi002 ceph-mon[30975]: pgmap v322: 97 pgs: 97 active+clean; 20 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 62 KiB/s wr, 8 op/s 2024-09-19T04:58:22.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:22 smithi116 ceph-mon[34477]: pgmap v322: 97 pgs: 97 active+clean; 20 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 62 KiB/s wr, 8 op/s 2024-09-19T04:58:23.646 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:58:23.919 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:58:24.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.435+0000 7ff26cadb640 1 -- 172.21.15.2:0/2740650115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff268102790 msgr2=0x7ff2681067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:24.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.435+0000 7ff26cadb640 1 --2- 172.21.15.2:0/2740650115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff268102790 0x7ff2681067e0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7ff250009900 tx=0x7ff25002a410 comp rx=0 tx=0).stop 2024-09-19T04:58:24.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.435+0000 7ff26cadb640 1 -- 172.21.15.2:0/2740650115 shutdown_connections 2024-09-19T04:58:24.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.435+0000 7ff26cadb640 1 --2- 172.21.15.2:0/2740650115 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff268106f10 0x7ff26810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:24.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.435+0000 7ff26cadb640 1 --2- 172.21.15.2:0/2740650115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff268102790 0x7ff2681067e0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:24.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.435+0000 7ff26cadb640 1 --2- 172.21.15.2:0/2740650115 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff268101de0 0x7ff2681021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:24.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.435+0000 7ff26cadb640 1 -- 172.21.15.2:0/2740650115 >> 172.21.15.2:0/2740650115 conn(0x7ff2680fd8c0 msgr2=0x7ff2680ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:58:24.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.435+0000 7ff26cadb640 1 -- 172.21.15.2:0/2740650115 shutdown_connections 2024-09-19T04:58:24.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.435+0000 7ff26cadb640 1 -- 172.21.15.2:0/2740650115 wait complete. 2024-09-19T04:58:24.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.436+0000 7ff26cadb640 1 Processor -- start 2024-09-19T04:58:24.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.436+0000 7ff26cadb640 1 -- start start 2024-09-19T04:58:24.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.436+0000 7ff26cadb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff268101de0 0x7ff268198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:24.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.436+0000 7ff26cadb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff268102790 0x7ff268198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:24.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.436+0000 7ff26cadb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff268106f10 0x7ff26819cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:24.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.436+0000 7ff26cadb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff268111ec0 con 0x7ff268106f10 2024-09-19T04:58:24.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.436+0000 7ff26cadb640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff268111d40 con 0x7ff268102790 2024-09-19T04:58:24.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.436+0000 7ff26cadb640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7ff268112040 con 0x7ff268101de0 2024-09-19T04:58:24.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.437+0000 7ff266d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff268106f10 0x7ff26819cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:24.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.437+0000 7ff266d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff268106f10 0x7ff26819cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54778/0 (socket says 172.21.15.2:54778) 2024-09-19T04:58:24.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.437+0000 7ff266d9d640 1 -- 172.21.15.2:0/2478671817 learned_addr learned my addr 172.21.15.2:0/2478671817 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:58:24.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.437+0000 7ff25ffff640 1 --2- 172.21.15.2:0/2478671817 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff268102790 0x7ff268198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:24.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.437+0000 7ff26659c640 1 --2- 172.21.15.2:0/2478671817 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff268101de0 0x7ff268198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:24.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.437+0000 7ff266d9d640 1 -- 172.21.15.2:0/2478671817 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff268101de0 msgr2=0x7ff268198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:24.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.437+0000 7ff266d9d640 1 --2- 172.21.15.2:0/2478671817 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff268101de0 0x7ff268198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:24.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.437+0000 7ff266d9d640 1 -- 172.21.15.2:0/2478671817 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff268102790 msgr2=0x7ff268198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:24.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.437+0000 7ff266d9d640 1 --2- 172.21.15.2:0/2478671817 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff268102790 0x7ff268198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:24.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.437+0000 7ff266d9d640 1 -- 172.21.15.2:0/2478671817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff26819d4d0 con 0x7ff268106f10 2024-09-19T04:58:24.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.437+0000 7ff25ffff640 1 --2- 172.21.15.2:0/2478671817 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff268102790 0x7ff268198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:58:24.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.437+0000 7ff26659c640 1 --2- 172.21.15.2:0/2478671817 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff268101de0 0x7ff268198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:58:24.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.437+0000 7ff266d9d640 1 --2- 172.21.15.2:0/2478671817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff268106f10 0x7ff26819cdf0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7ff26000b970 tx=0x7ff26000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:58:24.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.437+0000 7ff25f7fe640 1 -- 172.21.15.2:0/2478671817 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff260019070 con 0x7ff268106f10 2024-09-19T04:58:24.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.437+0000 7ff25f7fe640 1 -- 172.21.15.2:0/2478671817 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff260014440 con 0x7ff268106f10 2024-09-19T04:58:24.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.437+0000 7ff26cadb640 1 -- 172.21.15.2:0/2478671817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff26819d7c0 con 0x7ff268106f10 2024-09-19T04:58:24.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.437+0000 7ff25f7fe640 1 -- 172.21.15.2:0/2478671817 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2600075d0 con 0x7ff268106f10 2024-09-19T04:58:24.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.437+0000 7ff26cadb640 1 -- 172.21.15.2:0/2478671817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2681a50a0 con 0x7ff268106f10 2024-09-19T04:58:24.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.440+0000 7ff25f7fe640 1 -- 172.21.15.2:0/2478671817 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7ff26001c070 con 0x7ff268106f10 2024-09-19T04:58:24.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.440+0000 7ff26eeb4740 1 Processor -- start 2024-09-19T04:58:24.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.440+0000 7ff26eeb4740 1 -- start start 2024-09-19T04:58:24.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.440+0000 7ff26eeb4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d9b9b04a0 0x558d9b9b0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:24.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.440+0000 7ff26eeb4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d9b9b0dc0 0x558d9b9bb140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:24.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.440+0000 7ff26eeb4740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558d9b9bb680 0x558d9b9bda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:24.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.440+0000 7ff26eeb4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558d9b9162e0 con 0x558d9b9b0dc0 2024-09-19T04:58:24.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.440+0000 7ff26eeb4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558d9b8bdce0 con 0x558d9b9b04a0 2024-09-19T04:58:24.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.440+0000 7ff26eeb4740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x558d9b9122a0 con 0x558d9b9bb680 2024-09-19T04:58:24.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.440+0000 7ff26659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d9b9b0dc0 0x558d9b9bb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:24.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.441+0000 7ff26659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d9b9b0dc0 0x558d9b9bb140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54788/0 (socket says 172.21.15.2:54788) 2024-09-19T04:58:24.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.441+0000 7ff26659c640 1 -- 172.21.15.2:0/3265734976 learned_addr learned my addr 172.21.15.2:0/3265734976 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:58:24.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.441+0000 7ff25f7fe640 1 --2- 172.21.15.2:0/2478671817 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7ff2540a33b0 0x7ff2540a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:24.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.441+0000 7ff25ffff640 1 --2- 172.21.15.2:0/3265734976 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d9b9b04a0 0x558d9b9b0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:24.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.441+0000 7ff25ffff640 1 --2- 172.21.15.2:0/3265734976 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558d9b9bb680 0x558d9b9bda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:24.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.441+0000 7ff25f7fe640 1 -- 172.21.15.2:0/2478671817 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7ff2600cf280 con 0x7ff268106f10 2024-09-19T04:58:24.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.441+0000 7ff26659c640 1 -- 172.21.15.2:0/3265734976 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558d9b9bb680 msgr2=0x558d9b9bda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:24.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.441+0000 7ff26659c640 1 --2- 172.21.15.2:0/3265734976 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558d9b9bb680 0x558d9b9bda70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:24.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.441+0000 7ff26659c640 1 -- 172.21.15.2:0/3265734976 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d9b9b04a0 msgr2=0x558d9b9b0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:24.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.441+0000 7ff26659c640 1 --2- 172.21.15.2:0/3265734976 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d9b9b04a0 0x558d9b9b0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:24.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.441+0000 7ff266d9d640 1 --2- 172.21.15.2:0/2478671817 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7ff2540a33b0 0x7ff2540a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:24.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.441+0000 7ff26659c640 1 -- 172.21.15.2:0/3265734976 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d9b8a2440 con 0x558d9b9b0dc0 2024-09-19T04:58:24.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.441+0000 7ff26659c640 1 --2- 172.21.15.2:0/3265734976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d9b9b0dc0 0x558d9b9bb140 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7ff258007850 tx=0x7ff258007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a481b3daec898297 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:58:24.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.441+0000 7ff25cff9640 1 -- 172.21.15.2:0/3265734976 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff25800d950 con 0x558d9b9b0dc0 2024-09-19T04:58:24.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.441+0000 7ff266d9d640 1 --2- 172.21.15.2:0/2478671817 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7ff2540a33b0 0x7ff2540a5870 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff2600a3db0 tx=0x7ff260004a40 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:58:24.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.441+0000 7ff25cff9640 1 -- 172.21.15.2:0/3265734976 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff258018070 con 0x558d9b9b0dc0 2024-09-19T04:58:24.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.441+0000 7ff25cff9640 1 -- 172.21.15.2:0/3265734976 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2580123e0 con 0x558d9b9b0dc0 2024-09-19T04:58:24.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.442+0000 7ff26eeb4740 1 -- 172.21.15.2:0/3265734976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d9b9b0dc0 msgr2=0x558d9b9bb140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:24.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.442+0000 7ff26eeb4740 1 --2- 172.21.15.2:0/3265734976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d9b9b0dc0 0x558d9b9bb140 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7ff258007850 tx=0x7ff258007d10 comp rx=0 tx=0).stop 2024-09-19T04:58:24.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.442+0000 7ff26eeb4740 1 -- 172.21.15.2:0/3265734976 shutdown_connections 2024-09-19T04:58:24.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.442+0000 7ff26eeb4740 1 --2- 172.21.15.2:0/3265734976 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558d9b9bb680 0x558d9b9bda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:24.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.442+0000 7ff26eeb4740 1 --2- 172.21.15.2:0/3265734976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d9b9b0dc0 0x558d9b9bb140 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:24.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.442+0000 7ff26eeb4740 1 --2- 172.21.15.2:0/3265734976 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d9b9b04a0 0x558d9b9b0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:24.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.442+0000 7ff26eeb4740 1 -- 172.21.15.2:0/3265734976 >> 172.21.15.2:0/3265734976 conn(0x558d9b9aca30 msgr2=0x558d9b9ace10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:58:24.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.442+0000 7ff26eeb4740 1 -- 172.21.15.2:0/3265734976 shutdown_connections 2024-09-19T04:58:24.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.442+0000 7ff26eeb4740 1 -- 172.21.15.2:0/3265734976 wait complete. 2024-09-19T04:58:24.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.443+0000 7ff26eeb4740 1 -- start start 2024-09-19T04:58:24.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.443+0000 7ff26eeb4740 1 Processor -- start 2024-09-19T04:58:24.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.443+0000 7ff26eeb4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d9b9b04a0 0x558d9b9baf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:24.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.443+0000 7ff26eeb4740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558d9b9b0dc0 0x558d9b9b8210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:24.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.443+0000 7ff26eeb4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d9b9bb680 0x558d9b9b8750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:24.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.443+0000 7ff26eeb4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558d9b9be250 con 0x558d9b9bb680 2024-09-19T04:58:24.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.443+0000 7ff26eeb4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558d9b8d1050 con 0x558d9b9b04a0 2024-09-19T04:58:24.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.443+0000 7ff26eeb4740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x558d9b9be3d0 con 0x558d9b9b0dc0 2024-09-19T04:58:24.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.443+0000 7ff26eeb4740 10 client.0 _ll_register_callbacks cb 0x558d9b911160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:58:24.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.443+0000 7ff25ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d9b9bb680 0x558d9b9b8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:24.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.443+0000 7ff25ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d9b9bb680 0x558d9b9b8750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54802/0 (socket says 172.21.15.2:54802) 2024-09-19T04:58:24.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.443+0000 7ff25ffff640 1 -- 172.21.15.2:0/1549726895 learned_addr learned my addr 172.21.15.2:0/1549726895 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:58:24.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.443+0000 7ff26659c640 1 --2- 172.21.15.2:0/1549726895 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558d9b9b0dc0 0x558d9b9b8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:24.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.443+0000 7ff25ffff640 1 --2- 172.21.15.2:0/1549726895 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d9b9b04a0 0x558d9b9baf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:24.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.444+0000 7ff25ffff640 1 -- 172.21.15.2:0/1549726895 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558d9b9b0dc0 msgr2=0x558d9b9b8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:24.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.444+0000 7ff25ffff640 1 --2- 172.21.15.2:0/1549726895 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558d9b9b0dc0 0x558d9b9b8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:24.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.444+0000 7ff25ffff640 1 -- 172.21.15.2:0/1549726895 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d9b9b04a0 msgr2=0x558d9b9baf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:24.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.444+0000 7ff25ffff640 1 --2- 172.21.15.2:0/1549726895 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d9b9b04a0 0x558d9b9baf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:24.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.444+0000 7ff25ffff640 1 -- 172.21.15.2:0/1549726895 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d9b6873c0 con 0x558d9b9bb680 2024-09-19T04:58:24.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.444+0000 7ff25ffff640 1 --2- 172.21.15.2:0/1549726895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d9b9bb680 0x558d9b9b8750 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7ff25002a930 tx=0x7ff250032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0ed61051d465d1e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:58:24.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.444+0000 7ff24dffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:58:24.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.444+0000 7ff24dffb640 1 -- 172.21.15.2:0/1549726895 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff250035040 con 0x558d9b9bb680 2024-09-19T04:58:24.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.444+0000 7ff24dffb640 1 -- 172.21.15.2:0/1549726895 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7ff250005020 con 0x558d9b9bb680 2024-09-19T04:58:24.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.444+0000 7ff26eeb4740 1 -- 172.21.15.2:0/1549726895 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff258018070 con 0x558d9b9bb680 2024-09-19T04:58:24.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.444+0000 7ff24dffb640 1 -- 172.21.15.2:0/1549726895 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff250050050 con 0x558d9b9bb680 2024-09-19T04:58:24.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.444+0000 7ff26eeb4740 10 client.16686 fetch_fsmap learned FSMap version 19 2024-09-19T04:58:24.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.444+0000 7ff26eeb4740 1 -- 172.21.15.2:0/1549726895 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x558d9b9c9bc0 con 0x558d9b9bb680 2024-09-19T04:58:24.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.444+0000 7ff24dffb640 1 -- 172.21.15.2:0/1549726895 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff258018070 con 0x558d9b9bb680 2024-09-19T04:58:24.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.445+0000 7ff24dffb640 1 -- 172.21.15.2:0/1549726895 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ff250048020 con 0x558d9b9bb680 2024-09-19T04:58:24.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.445+0000 7ff26eeb4740 10 client.16686 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:58:24.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.445+0000 7ff26eeb4740 10 client.16686 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:58:24.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.445+0000 7ff26eeb4740 20 client.16686 populate_metadata read hostname 'smithi002' 2024-09-19T04:58:24.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.445+0000 7ff26eeb4740 1 --2- 172.21.15.2:0/1549726895 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558d9b9cb080 0x558d9b9cd470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:24.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.445+0000 7ff26eeb4740 4 client.16686 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:58:24.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.445+0000 7ff26eeb4740 1 -- 172.21.15.2:0/1549726895 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558d9b923850 con 0x558d9b9cb080 2024-09-19T04:58:24.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.445+0000 7ff26659c640 1 --2- 172.21.15.2:0/1549726895 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558d9b9cb080 0x558d9b9cd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:24.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.445+0000 7ff26659c640 1 --2- 172.21.15.2:0/1549726895 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558d9b9cb080 0x558d9b9cd470 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9bc2d69dba519f0 server_cookie=150380295d989fb4 in_seq=0 out_seq=0 2024-09-19T04:58:24.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.445+0000 7ff24dffb640 10 client.16686 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:58:24.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.446+0000 7ff24dffb640 1 -- 172.21.15.2:0/1549726895 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558d9b923850 con 0x558d9b9cb080 2024-09-19T04:58:24.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.446+0000 7ff24dffb640 10 client.16686 handle_command_reply: tid=0 2024-09-19T04:58:24.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.446+0000 7ff26eeb4740 1 client.16686 shutdown 2024-09-19T04:58:24.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.446+0000 7ff26eeb4740 1 -- 172.21.15.2:0/1549726895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d9b9bb680 msgr2=0x558d9b9b8750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:24.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.446+0000 7ff26eeb4740 1 --2- 172.21.15.2:0/1549726895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d9b9bb680 0x558d9b9b8750 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7ff25002a930 tx=0x7ff250032c60 comp rx=0 tx=0).stop 2024-09-19T04:58:24.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.446+0000 7ff26eeb4740 1 -- 172.21.15.2:0/1549726895 shutdown_connections 2024-09-19T04:58:24.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.446+0000 7ff26eeb4740 1 --2- 172.21.15.2:0/1549726895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d9b9bb680 0x558d9b9b8750 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:24.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.446+0000 7ff26eeb4740 1 --2- 172.21.15.2:0/1549726895 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558d9b9cb080 0x558d9b9cd470 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:24.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.446+0000 7ff26eeb4740 1 --2- 172.21.15.2:0/1549726895 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558d9b9b0dc0 0x558d9b9b8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:24.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.446+0000 7ff26eeb4740 1 --2- 172.21.15.2:0/1549726895 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d9b9b04a0 0x558d9b9baf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:24.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.446+0000 7ff26eeb4740 1 -- 172.21.15.2:0/1549726895 >> 172.21.15.2:0/1549726895 conn(0x558d9b9aca30 msgr2=0x558d9b9abb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:58:24.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.446+0000 7ff24dffb640 0 client.16686 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:58:24.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.446+0000 7ff26eeb4740 1 -- 172.21.15.2:0/1549726895 shutdown_connections 2024-09-19T04:58:24.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.446+0000 7ff26eeb4740 1 -- 172.21.15.2:0/1549726895 wait complete. 2024-09-19T04:58:24.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.446+0000 7ff26eeb4740 20 client.16686 trim_cache size 0 max 16384 2024-09-19T04:58:24.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.463+0000 7ff26eeb4740 1 Processor -- start 2024-09-19T04:58:24.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.463+0000 7ff26eeb4740 1 -- start start 2024-09-19T04:58:24.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.464+0000 7ff26eeb4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d9b9aca30 0x558d9b9ba180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:24.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.464+0000 7ff26eeb4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d9b9b04a0 0x558d9b9d2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:24.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.464+0000 7ff26eeb4740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558d9b9b0dc0 0x558d9b9d3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:24.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.464+0000 7ff26eeb4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff2681ab930 con 0x558d9b9aca30 2024-09-19T04:58:24.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.464+0000 7ff26eeb4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff2681ae190 con 0x558d9b9b04a0 2024-09-19T04:58:24.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.464+0000 7ff26eeb4740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7ff2681abf80 con 0x558d9b9b0dc0 2024-09-19T04:58:24.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.464+0000 7ff25ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d9b9aca30 0x558d9b9ba180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:24.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.464+0000 7ff25ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d9b9aca30 0x558d9b9ba180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54806/0 (socket says 172.21.15.2:54806) 2024-09-19T04:58:24.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.464+0000 7ff25ffff640 1 -- 172.21.15.2:0/498879601 learned_addr learned my addr 172.21.15.2:0/498879601 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:58:24.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.464+0000 7ff26659c640 1 --2- 172.21.15.2:0/498879601 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d9b9b04a0 0x558d9b9d2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:24.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.464+0000 7ff25ffff640 1 -- 172.21.15.2:0/498879601 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558d9b9b0dc0 msgr2=0x558d9b9d3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:24.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.464+0000 7ff25ffff640 1 --2- 172.21.15.2:0/498879601 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558d9b9b0dc0 0x558d9b9d3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:24.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.464+0000 7ff25ffff640 1 -- 172.21.15.2:0/498879601 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d9b9b04a0 msgr2=0x558d9b9d2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:24.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.464+0000 7ff25ffff640 1 --2- 172.21.15.2:0/498879601 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d9b9b04a0 0x558d9b9d2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:24.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.464+0000 7ff25ffff640 1 -- 172.21.15.2:0/498879601 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d9b9b0bf0 con 0x558d9b9aca30 2024-09-19T04:58:24.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.464+0000 7ff25ffff640 1 --2- 172.21.15.2:0/498879601 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d9b9aca30 0x558d9b9ba180 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7ff2500035f0 tx=0x7ff2500058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8708dfc71315da94 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:58:24.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.465+0000 7ff24ffff640 1 -- 172.21.15.2:0/498879601 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff250035070 con 0x558d9b9aca30 2024-09-19T04:58:24.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.465+0000 7ff24ffff640 1 -- 172.21.15.2:0/498879601 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff250009520 con 0x558d9b9aca30 2024-09-19T04:58:24.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.465+0000 7ff24ffff640 1 -- 172.21.15.2:0/498879601 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff250003950 con 0x558d9b9aca30 2024-09-19T04:58:24.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.465+0000 7ff26eeb4740 1 -- 172.21.15.2:0/498879601 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d9b9aca30 msgr2=0x558d9b9ba180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:24.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.465+0000 7ff26eeb4740 1 --2- 172.21.15.2:0/498879601 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d9b9aca30 0x558d9b9ba180 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7ff2500035f0 tx=0x7ff2500058b0 comp rx=0 tx=0).stop 2024-09-19T04:58:24.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.465+0000 7ff26eeb4740 1 -- 172.21.15.2:0/498879601 shutdown_connections 2024-09-19T04:58:24.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.465+0000 7ff26eeb4740 1 --2- 172.21.15.2:0/498879601 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558d9b9b0dc0 0x558d9b9d3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:24.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.465+0000 7ff26eeb4740 1 --2- 172.21.15.2:0/498879601 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d9b9b04a0 0x558d9b9d2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:24.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.465+0000 7ff26eeb4740 1 --2- 172.21.15.2:0/498879601 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d9b9aca30 0x558d9b9ba180 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:24.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.465+0000 7ff26eeb4740 1 -- 172.21.15.2:0/498879601 >> 172.21.15.2:0/498879601 conn(0x558d9b9b88b0 msgr2=0x558d9b9b9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:58:24.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.465+0000 7ff26eeb4740 1 -- 172.21.15.2:0/498879601 shutdown_connections 2024-09-19T04:58:24.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.465+0000 7ff26eeb4740 1 -- 172.21.15.2:0/498879601 wait complete. 2024-09-19T04:58:24.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.465+0000 7ff26eeb4740 1 -- start start 2024-09-19T04:58:24.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.466+0000 7ff26eeb4740 1 Processor -- start 2024-09-19T04:58:24.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.466+0000 7ff26eeb4740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558d9b9aca30 0x558d9b9c3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:24.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.466+0000 7ff26eeb4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d9b9b04a0 0x558d9b9c10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:24.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.466+0000 7ff26eeb4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d9b9b0dc0 0x558d9b9c1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:24.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.466+0000 7ff26eeb4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff2681ac650 con 0x558d9b9b04a0 2024-09-19T04:58:24.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.466+0000 7ff26eeb4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff2681adac0 con 0x558d9b9b0dc0 2024-09-19T04:58:24.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.466+0000 7ff26eeb4740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7ff2681acd20 con 0x558d9b9aca30 2024-09-19T04:58:24.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.466+0000 7ff26eeb4740 10 client.0 _ll_register_callbacks cb 0x7ff250009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:58:24.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.466+0000 7ff26659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d9b9b04a0 0x558d9b9c10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:24.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.466+0000 7ff26659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d9b9b04a0 0x558d9b9c10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54814/0 (socket says 172.21.15.2:54814) 2024-09-19T04:58:24.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.466+0000 7ff26659c640 1 -- 172.21.15.2:0/1920987047 learned_addr learned my addr 172.21.15.2:0/1920987047 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:58:24.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.466+0000 7ff25ffff640 1 --2- 172.21.15.2:0/1920987047 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558d9b9aca30 0x558d9b9c3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:24.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.466+0000 7ff26659c640 1 -- 172.21.15.2:0/1920987047 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558d9b9aca30 msgr2=0x558d9b9c3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:24.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.466+0000 7ff26659c640 1 --2- 172.21.15.2:0/1920987047 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558d9b9aca30 0x558d9b9c3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:24.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.466+0000 7ff25ffff640 1 --2- 172.21.15.2:0/1920987047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d9b9b0dc0 0x558d9b9c1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:24.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.466+0000 7ff26659c640 1 -- 172.21.15.2:0/1920987047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d9b9b0dc0 msgr2=0x558d9b9c1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:24.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.466+0000 7ff26659c640 1 --2- 172.21.15.2:0/1920987047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d9b9b0dc0 0x558d9b9c1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:24.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.466+0000 7ff26659c640 1 -- 172.21.15.2:0/1920987047 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d9b9c1e20 con 0x558d9b9b04a0 2024-09-19T04:58:24.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.466+0000 7ff25ffff640 1 --2- 172.21.15.2:0/1920987047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d9b9b0dc0 0x558d9b9c1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:58:24.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.466+0000 7ff26659c640 1 --2- 172.21.15.2:0/1920987047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d9b9b04a0 0x558d9b9c10e0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7ff258004810 tx=0x7ff258007f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ee1791bae39e2b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:58:24.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.466+0000 7ff24dffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:58:24.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.467+0000 7ff24dffb640 1 -- 172.21.15.2:0/1920987047 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff25800db50 con 0x558d9b9b04a0 2024-09-19T04:58:24.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.467+0000 7ff26eeb4740 1 -- 172.21.15.2:0/1920987047 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff250009520 con 0x558d9b9b04a0 2024-09-19T04:58:24.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.467+0000 7ff24dffb640 1 -- 172.21.15.2:0/1920987047 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7ff25800dcf0 con 0x558d9b9b04a0 2024-09-19T04:58:24.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.467+0000 7ff24dffb640 1 -- 172.21.15.2:0/1920987047 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff258013a50 con 0x558d9b9b04a0 2024-09-19T04:58:24.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.467+0000 7ff26eeb4740 10 client.16692 fetch_fsmap learned FSMap version 19 2024-09-19T04:58:24.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.467+0000 7ff26eeb4740 1 -- 172.21.15.2:0/1920987047 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x558d9ba35ce0 con 0x558d9b9b04a0 2024-09-19T04:58:24.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.467+0000 7ff24dffb640 1 -- 172.21.15.2:0/1920987047 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff250009520 con 0x558d9b9b04a0 2024-09-19T04:58:24.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.467+0000 7ff24dffb640 1 -- 172.21.15.2:0/1920987047 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ff25801d490 con 0x558d9b9b04a0 2024-09-19T04:58:24.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.467+0000 7ff26eeb4740 10 client.16692 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:58:24.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.467+0000 7ff26eeb4740 10 client.16692 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:58:24.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.467+0000 7ff26eeb4740 20 client.16692 populate_metadata read hostname 'smithi002' 2024-09-19T04:58:24.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.467+0000 7ff26eeb4740 1 --2- 172.21.15.2:0/1920987047 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558d9b9bb680 0x558d9ba38210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:24.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.467+0000 7ff26eeb4740 4 client.16692 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:58:24.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.467+0000 7ff26eeb4740 1 -- 172.21.15.2:0/1920987047 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558d9b91dd60 con 0x558d9b9bb680 2024-09-19T04:58:24.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.468+0000 7ff25ffff640 1 --2- 172.21.15.2:0/1920987047 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558d9b9bb680 0x558d9ba38210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:24.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.468+0000 7ff25ffff640 1 --2- 172.21.15.2:0/1920987047 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558d9b9bb680 0x558d9ba38210 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fcabad80636cbdf5 server_cookie=57faa3182fea0f6d in_seq=0 out_seq=0 2024-09-19T04:58:24.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.468+0000 7ff24dffb640 10 client.16692 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:58:24.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.468+0000 7ff24dffb640 1 -- 172.21.15.2:0/1920987047 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x558d9b91dd60 con 0x558d9b9bb680 2024-09-19T04:58:24.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.468+0000 7ff24dffb640 10 client.16692 handle_command_reply: tid=0 2024-09-19T04:58:24.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.468+0000 7ff26eeb4740 1 client.16692 shutdown 2024-09-19T04:58:24.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.468+0000 7ff26eeb4740 1 -- 172.21.15.2:0/1920987047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d9b9b04a0 msgr2=0x558d9b9c10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:24.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.468+0000 7ff26eeb4740 1 --2- 172.21.15.2:0/1920987047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d9b9b04a0 0x558d9b9c10e0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7ff258004810 tx=0x7ff258007f80 comp rx=0 tx=0).stop 2024-09-19T04:58:24.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.468+0000 7ff26eeb4740 1 -- 172.21.15.2:0/1920987047 shutdown_connections 2024-09-19T04:58:24.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.468+0000 7ff26eeb4740 1 --2- 172.21.15.2:0/1920987047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d9b9b0dc0 0x558d9b9c1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:24.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.468+0000 7ff26eeb4740 1 --2- 172.21.15.2:0/1920987047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d9b9b04a0 0x558d9b9c10e0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:24.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.468+0000 7ff26eeb4740 1 --2- 172.21.15.2:0/1920987047 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558d9b9bb680 0x558d9ba38210 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:24.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.468+0000 7ff26eeb4740 1 --2- 172.21.15.2:0/1920987047 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558d9b9aca30 0x558d9b9c3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:24.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.468+0000 7ff26eeb4740 1 -- 172.21.15.2:0/1920987047 >> 172.21.15.2:0/1920987047 conn(0x558d9b9b88b0 msgr2=0x558d9b9b66a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:58:24.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.468+0000 7ff24dffb640 0 client.16692 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:58:24.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.469+0000 7ff26eeb4740 1 -- 172.21.15.2:0/1920987047 shutdown_connections 2024-09-19T04:58:24.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.469+0000 7ff26eeb4740 1 -- 172.21.15.2:0/1920987047 wait complete. 2024-09-19T04:58:24.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.469+0000 7ff26eeb4740 20 client.16692 trim_cache size 0 max 16384 2024-09-19T04:58:24.476 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:58:24.476 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T04:58:24.476 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T04:58:24.477 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:58:24.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.469+0000 7ff26cadb640 1 -- 172.21.15.2:0/2478671817 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7ff2540a33b0 msgr2=0x7ff2540a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:24.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.469+0000 7ff26cadb640 1 --2- 172.21.15.2:0/2478671817 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7ff2540a33b0 0x7ff2540a5870 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff2600a3db0 tx=0x7ff260004a40 comp rx=0 tx=0).stop 2024-09-19T04:58:24.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.469+0000 7ff26cadb640 1 -- 172.21.15.2:0/2478671817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff268106f10 msgr2=0x7ff26819cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:24.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.469+0000 7ff26cadb640 1 --2- 172.21.15.2:0/2478671817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff268106f10 0x7ff26819cdf0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7ff26000b970 tx=0x7ff26000be30 comp rx=0 tx=0).stop 2024-09-19T04:58:24.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.469+0000 7ff26cadb640 1 -- 172.21.15.2:0/2478671817 shutdown_connections 2024-09-19T04:58:24.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.469+0000 7ff26cadb640 1 --2- 172.21.15.2:0/2478671817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff268106f10 0x7ff26819cdf0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:24.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.469+0000 7ff26cadb640 1 --2- 172.21.15.2:0/2478671817 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff268102790 0x7ff268198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:24.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.469+0000 7ff26cadb640 1 --2- 172.21.15.2:0/2478671817 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7ff2540a33b0 0x7ff2540a5870 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:24.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.469+0000 7ff26cadb640 1 --2- 172.21.15.2:0/2478671817 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff268101de0 0x7ff268198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:24.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.469+0000 7ff26cadb640 1 -- 172.21.15.2:0/2478671817 >> 172.21.15.2:0/2478671817 conn(0x7ff2680fd8c0 msgr2=0x7ff2680fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:58:24.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.469+0000 7ff26cadb640 1 -- 172.21.15.2:0/2478671817 shutdown_connections 2024-09-19T04:58:24.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:24.469+0000 7ff26cadb640 1 -- 172.21.15.2:0/2478671817 wait complete. 2024-09-19T04:58:24.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:24 smithi002 ceph-mon[30975]: pgmap v323: 97 pgs: 97 active+clean; 20 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 62 KiB/s wr, 8 op/s 2024-09-19T04:58:24.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:24 smithi018 ceph-mon[34537]: pgmap v323: 97 pgs: 97 active+clean; 20 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 62 KiB/s wr, 8 op/s 2024-09-19T04:58:24.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:24 smithi116 ceph-mon[34477]: pgmap v323: 97 pgs: 97 active+clean; 20 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 62 KiB/s wr, 8 op/s 2024-09-19T04:58:25.253 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:58:25.254 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:58:25.516 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:58:25.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:25.985+0000 7fcc3a049640 1 -- 172.21.15.2:0/331749500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc34101de0 msgr2=0x7fcc341021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:25.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:25.985+0000 7fcc3a049640 1 --2- 172.21.15.2:0/331749500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc34101de0 0x7fcc341021c0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fcc24009900 tx=0x7fcc2402a410 comp rx=0 tx=0).stop 2024-09-19T04:58:25.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:25.985+0000 7fcc3a049640 1 -- 172.21.15.2:0/331749500 shutdown_connections 2024-09-19T04:58:25.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:25.985+0000 7fcc3a049640 1 --2- 172.21.15.2:0/331749500 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc34106f10 0x7fcc3410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:25.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:25.985+0000 7fcc3a049640 1 --2- 172.21.15.2:0/331749500 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc34102790 0x7fcc341067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:25.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:25.985+0000 7fcc3a049640 1 --2- 172.21.15.2:0/331749500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc34101de0 0x7fcc341021c0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:25.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:25.985+0000 7fcc3a049640 1 -- 172.21.15.2:0/331749500 >> 172.21.15.2:0/331749500 conn(0x7fcc340fd8c0 msgr2=0x7fcc340ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:58:25.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:25.985+0000 7fcc3a049640 1 -- 172.21.15.2:0/331749500 shutdown_connections 2024-09-19T04:58:25.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:25.985+0000 7fcc3a049640 1 -- 172.21.15.2:0/331749500 wait complete. 2024-09-19T04:58:25.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:25.985+0000 7fcc3a049640 1 Processor -- start 2024-09-19T04:58:25.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:25.985+0000 7fcc3a049640 1 -- start start 2024-09-19T04:58:25.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:25.986+0000 7fcc3a049640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc34101de0 0x7fcc341a4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:25.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:25.986+0000 7fcc3a049640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc34102790 0x7fcc341a4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:25.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:25.986+0000 7fcc3a049640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc34106f10 0x7fcc3419e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:25.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:25.986+0000 7fcc3a049640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcc34076490 con 0x7fcc34101de0 2024-09-19T04:58:25.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:25.986+0000 7fcc3a049640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcc34076310 con 0x7fcc34102790 2024-09-19T04:58:25.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:25.986+0000 7fcc3a049640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fcc34118580 con 0x7fcc34106f10 2024-09-19T04:58:25.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:25.986+0000 7fcc337fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc34101de0 0x7fcc341a4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:25.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:25.986+0000 7fcc337fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc34101de0 0x7fcc341a4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54844/0 (socket says 172.21.15.2:54844) 2024-09-19T04:58:25.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:25.986+0000 7fcc337fe640 1 -- 172.21.15.2:0/3272513041 learned_addr learned my addr 172.21.15.2:0/3272513041 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:58:25.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:25.986+0000 7fcc32ffd640 1 --2- 172.21.15.2:0/3272513041 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc34102790 0x7fcc341a4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:25.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:25.986+0000 7fcc33fff640 1 --2- 172.21.15.2:0/3272513041 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc34106f10 0x7fcc3419e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:25.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:25.986+0000 7fcc337fe640 1 -- 172.21.15.2:0/3272513041 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc34106f10 msgr2=0x7fcc3419e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:25.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:25.986+0000 7fcc337fe640 1 --2- 172.21.15.2:0/3272513041 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc34106f10 0x7fcc3419e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:25.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:25.986+0000 7fcc337fe640 1 -- 172.21.15.2:0/3272513041 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc34102790 msgr2=0x7fcc341a4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:25.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:25.986+0000 7fcc337fe640 1 --2- 172.21.15.2:0/3272513041 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc34102790 0x7fcc341a4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:25.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:25.986+0000 7fcc337fe640 1 -- 172.21.15.2:0/3272513041 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc3419ef60 con 0x7fcc34101de0 2024-09-19T04:58:25.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:25.986+0000 7fcc32ffd640 1 --2- 172.21.15.2:0/3272513041 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc34102790 0x7fcc341a4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:58:25.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:25.987+0000 7fcc337fe640 1 --2- 172.21.15.2:0/3272513041 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc34101de0 0x7fcc341a4620 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fcc24006010 tx=0x7fcc24004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:58:25.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:25.987+0000 7fcc30ff9640 1 -- 172.21.15.2:0/3272513041 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2403f030 con 0x7fcc34101de0 2024-09-19T04:58:25.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:25.987+0000 7fcc30ff9640 1 -- 172.21.15.2:0/3272513041 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcc240035f0 con 0x7fcc34101de0 2024-09-19T04:58:25.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:25.987+0000 7fcc3a049640 1 -- 172.21.15.2:0/3272513041 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc3419f1f0 con 0x7fcc34101de0 2024-09-19T04:58:25.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:25.987+0000 7fcc30ff9640 1 -- 172.21.15.2:0/3272513041 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc24035070 con 0x7fcc34101de0 2024-09-19T04:58:25.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:25.987+0000 7fcc3a049640 1 -- 172.21.15.2:0/3272513041 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc341ab3d0 con 0x7fcc34101de0 2024-09-19T04:58:25.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:25.988+0000 7fcc3a049640 1 -- 172.21.15.2:0/3272513041 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc341032c0 con 0x7fcc34101de0 2024-09-19T04:58:25.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:25.989+0000 7fcc30ff9640 1 -- 172.21.15.2:0/3272513041 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fcc24003b10 con 0x7fcc34101de0 2024-09-19T04:58:25.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:25.990+0000 7fcc30ff9640 1 --2- 172.21.15.2:0/3272513041 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fcc1c0a33b0 0x7fcc1c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:25.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:25.990+0000 7fcc32ffd640 1 --2- 172.21.15.2:0/3272513041 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fcc1c0a33b0 0x7fcc1c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:25.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:25.990+0000 7fcc30ff9640 1 -- 172.21.15.2:0/3272513041 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fcc240f09b0 con 0x7fcc34101de0 2024-09-19T04:58:25.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:25.991+0000 7fcc32ffd640 1 --2- 172.21.15.2:0/3272513041 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fcc1c0a33b0 0x7fcc1c0a5870 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcc3419ff40 tx=0x7fcc2800a5c0 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:58:25.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:25.994+0000 7fcc30ff9640 1 -- 172.21.15.2:0/3272513041 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcc240bd330 con 0x7fcc34101de0 2024-09-19T04:58:26.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:26.206+0000 7fcc3a049640 1 -- 172.21.15.2:0/3272513041 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcc3410a0f0 con 0x7fcc34101de0 2024-09-19T04:58:26.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:26.207+0000 7fcc30ff9640 1 -- 172.21.15.2:0/3272513041 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11840 (secure 0 0 0) 0x7fcc240bcc30 con 0x7fcc34101de0 2024-09-19T04:58:26.209 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:58:26.209 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":19,"btime":"2024-09-19T04:46:33:537239+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2467365137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2467365137},{"type":"v1","addr":"172.21.15.2:6835","nonce":2467365137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3162441888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3162441888},{"type":"v1","addr":"172.21.15.2:6837","nonce":3162441888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14631,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2740862966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2740862966},{"type":"v1","addr":"172.21.15.2:6839","nonce":2740862966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/2394435504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2394435504},{"type":"v1","addr":"172.21.15.2:6841","nonce":2394435504}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1630480244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1630480244},{"type":"v1","addr":"172.21.15.18:6833","nonce":1630480244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1553897465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1553897465},{"type":"v1","addr":"172.21.15.116:6833","nonce":1553897465}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3035664608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3035664608},{"type":"v1","addr":"172.21.15.18:6835","nonce":3035664608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1096622392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1096622392},{"type":"v1","addr":"172.21.15.18:6837","nonce":1096622392}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3761157675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3761157675},{"type":"v1","addr":"172.21.15.116:6835","nonce":3761157675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/1120131594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1120131594},{"type":"v1","addr":"172.21.15.116:6837","nonce":1120131594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:46:24.050115+0000","modified":"2024-09-19T04:46:33.112369+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/4207677139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":4207677139},{"type":"v1","addr":"172.21.15.18:6839","nonce":4207677139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/2346874880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":2346874880},{"type":"v1","addr":"172.21.15.116:6839","nonce":2346874880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496]},"id":1}]} 2024-09-19T04:58:26.209 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 19 2024-09-19T04:58:26.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:26.210+0000 7fcc3a049640 1 -- 172.21.15.2:0/3272513041 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fcc1c0a33b0 msgr2=0x7fcc1c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:26.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:26.210+0000 7fcc3a049640 1 --2- 172.21.15.2:0/3272513041 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fcc1c0a33b0 0x7fcc1c0a5870 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcc3419ff40 tx=0x7fcc2800a5c0 comp rx=0 tx=0).stop 2024-09-19T04:58:26.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:26.210+0000 7fcc3a049640 1 -- 172.21.15.2:0/3272513041 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc34101de0 msgr2=0x7fcc341a4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:26.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:26.210+0000 7fcc3a049640 1 --2- 172.21.15.2:0/3272513041 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc34101de0 0x7fcc341a4620 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fcc24006010 tx=0x7fcc24004270 comp rx=0 tx=0).stop 2024-09-19T04:58:26.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:26.210+0000 7fcc3a049640 1 -- 172.21.15.2:0/3272513041 shutdown_connections 2024-09-19T04:58:26.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:26.210+0000 7fcc3a049640 1 --2- 172.21.15.2:0/3272513041 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fcc1c0a33b0 0x7fcc1c0a5870 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:26.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:26.210+0000 7fcc3a049640 1 --2- 172.21.15.2:0/3272513041 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc34106f10 0x7fcc3419e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:26.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:26.210+0000 7fcc3a049640 1 --2- 172.21.15.2:0/3272513041 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc34102790 0x7fcc341a4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:26.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:26.210+0000 7fcc3a049640 1 --2- 172.21.15.2:0/3272513041 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc34101de0 0x7fcc341a4620 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:26.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:26.210+0000 7fcc3a049640 1 -- 172.21.15.2:0/3272513041 >> 172.21.15.2:0/3272513041 conn(0x7fcc340fd8c0 msgr2=0x7fcc340fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:58:26.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:26.210+0000 7fcc3a049640 1 -- 172.21.15.2:0/3272513041 shutdown_connections 2024-09-19T04:58:26.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:26.210+0000 7fcc3a049640 1 -- 172.21.15.2:0/3272513041 wait complete. 2024-09-19T04:58:26.563 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:26 smithi002 ceph-mon[30975]: pgmap v324: 97 pgs: 97 active+clean; 21 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 97 KiB/s wr, 13 op/s 2024-09-19T04:58:26.563 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:26 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/3272513041' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:58:26.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:26 smithi018 ceph-mon[34537]: pgmap v324: 97 pgs: 97 active+clean; 21 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 97 KiB/s wr, 13 op/s 2024-09-19T04:58:26.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:26 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/3272513041' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:58:26.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:26 smithi116 ceph-mon[34477]: pgmap v324: 97 pgs: 97 active+clean; 21 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 97 KiB/s wr, 13 op/s 2024-09-19T04:58:26.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:26 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/3272513041' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:58:26.869 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:58:27.127 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:58:27.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.641+0000 7f09a24b4640 1 -- 172.21.15.2:0/2808147112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f099c102790 msgr2=0x7f099c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:27.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.641+0000 7f09a24b4640 1 --2- 172.21.15.2:0/2808147112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f099c102790 0x7f099c1067e0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f0990009900 tx=0x7f099002a410 comp rx=0 tx=0).stop 2024-09-19T04:58:27.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.641+0000 7f09a24b4640 1 -- 172.21.15.2:0/2808147112 shutdown_connections 2024-09-19T04:58:27.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.641+0000 7f09a24b4640 1 --2- 172.21.15.2:0/2808147112 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f099c106f10 0x7f099c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:27.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.641+0000 7f09a24b4640 1 --2- 172.21.15.2:0/2808147112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f099c102790 0x7f099c1067e0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:27.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.641+0000 7f09a24b4640 1 --2- 172.21.15.2:0/2808147112 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f099c101de0 0x7f099c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:27.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.641+0000 7f09a24b4640 1 -- 172.21.15.2:0/2808147112 >> 172.21.15.2:0/2808147112 conn(0x7f099c0fd8c0 msgr2=0x7f099c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:58:27.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.641+0000 7f09a24b4640 1 -- 172.21.15.2:0/2808147112 shutdown_connections 2024-09-19T04:58:27.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.641+0000 7f09a24b4640 1 -- 172.21.15.2:0/2808147112 wait complete. 2024-09-19T04:58:27.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.642+0000 7f09a24b4640 1 Processor -- start 2024-09-19T04:58:27.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.642+0000 7f09a24b4640 1 -- start start 2024-09-19T04:58:27.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.642+0000 7f09a24b4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f099c101de0 0x7f099c19a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:27.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.642+0000 7f09a24b4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f099c102790 0x7f099c19aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:27.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.642+0000 7f09a24b4640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f099c106f10 0x7f099c19ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:27.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.642+0000 7f09a24b4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f099c111e20 con 0x7f099c101de0 2024-09-19T04:58:27.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.642+0000 7f09a24b4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f099c111ca0 con 0x7f099c102790 2024-09-19T04:58:27.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.642+0000 7f09a24b4640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f099c111fa0 con 0x7f099c106f10 2024-09-19T04:58:27.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.642+0000 7f099bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f099c101de0 0x7f099c19a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:27.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.642+0000 7f099bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f099c101de0 0x7f099c19a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54876/0 (socket says 172.21.15.2:54876) 2024-09-19T04:58:27.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.642+0000 7f099bfff640 1 -- 172.21.15.2:0/3914006742 learned_addr learned my addr 172.21.15.2:0/3914006742 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:58:27.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.642+0000 7f09a0a51640 1 --2- 172.21.15.2:0/3914006742 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f099c106f10 0x7f099c19ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:27.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.643+0000 7f099b7fe640 1 --2- 172.21.15.2:0/3914006742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f099c102790 0x7f099c19aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:27.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.643+0000 7f099bfff640 1 -- 172.21.15.2:0/3914006742 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f099c106f10 msgr2=0x7f099c19ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:27.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.643+0000 7f099bfff640 1 --2- 172.21.15.2:0/3914006742 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f099c106f10 0x7f099c19ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:27.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.643+0000 7f099bfff640 1 -- 172.21.15.2:0/3914006742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f099c102790 msgr2=0x7f099c19aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:27.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.643+0000 7f099bfff640 1 --2- 172.21.15.2:0/3914006742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f099c102790 0x7f099c19aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:27.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.643+0000 7f099bfff640 1 -- 172.21.15.2:0/3914006742 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f099c19f520 con 0x7f099c101de0 2024-09-19T04:58:27.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.643+0000 7f09a0a51640 1 --2- 172.21.15.2:0/3914006742 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f099c106f10 0x7f099c19ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:58:27.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.643+0000 7f099bfff640 1 --2- 172.21.15.2:0/3914006742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f099c101de0 0x7f099c19a570 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f098c00d950 tx=0x7f098c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:58:27.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.643+0000 7f09997fa640 1 -- 172.21.15.2:0/3914006742 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f098c017030 con 0x7f099c101de0 2024-09-19T04:58:27.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.643+0000 7f09a24b4640 1 -- 172.21.15.2:0/3914006742 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f099c19f810 con 0x7f099c101de0 2024-09-19T04:58:27.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.643+0000 7f09997fa640 1 -- 172.21.15.2:0/3914006742 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f098c004020 con 0x7f099c101de0 2024-09-19T04:58:27.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.643+0000 7f09997fa640 1 -- 172.21.15.2:0/3914006742 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f098c0047a0 con 0x7f099c101de0 2024-09-19T04:58:27.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.643+0000 7f09a24b4640 1 -- 172.21.15.2:0/3914006742 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f099c1a70f0 con 0x7f099c101de0 2024-09-19T04:58:27.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.645+0000 7f09997fa640 1 -- 172.21.15.2:0/3914006742 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f098c0041d0 con 0x7f099c101de0 2024-09-19T04:58:27.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.646+0000 7f09a488d740 1 Processor -- start 2024-09-19T04:58:27.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.646+0000 7f09a488d740 1 -- start start 2024-09-19T04:58:27.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.646+0000 7f09a488d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cb1f80b40 0x561cb1f7f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:27.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.646+0000 7f09a488d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561cb1f7f5d0 0x561cb1f7fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:27.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.646+0000 7f09a488d740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561cb1f8a370 0x561cb1f8c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:27.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.646+0000 7f09a488d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561cb1ee52f0 con 0x561cb1f80b40 2024-09-19T04:58:27.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.646+0000 7f09a488d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561cb1e8ccf0 con 0x561cb1f7f5d0 2024-09-19T04:58:27.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.646+0000 7f09997fa640 1 --2- 172.21.15.2:0/3914006742 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f09840a33b0 0x7f09840a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:27.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.646+0000 7f09a488d740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x561cb1ee12b0 con 0x561cb1f8a370 2024-09-19T04:58:27.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.646+0000 7f09a0a51640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cb1f80b40 0x561cb1f7f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:27.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.646+0000 7f09a0a51640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cb1f80b40 0x561cb1f7f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54888/0 (socket says 172.21.15.2:54888) 2024-09-19T04:58:27.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.646+0000 7f09a0a51640 1 -- 172.21.15.2:0/2792943955 learned_addr learned my addr 172.21.15.2:0/2792943955 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:58:27.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.646+0000 7f099b7fe640 1 --2- 172.21.15.2:0/2792943955 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561cb1f8a370 0x561cb1f8c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:27.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.646+0000 7f09997fa640 1 -- 172.21.15.2:0/3914006742 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f098c0cf8c0 con 0x7f099c101de0 2024-09-19T04:58:27.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.646+0000 7f099bfff640 1 --2- 172.21.15.2:0/2792943955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561cb1f7f5d0 0x561cb1f7fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:27.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.646+0000 7f09a0a51640 1 --2- 172.21.15.2:0/3914006742 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f09840a33b0 0x7f09840a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:27.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.647+0000 7f099b7fe640 1 -- 172.21.15.2:0/2792943955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561cb1f7f5d0 msgr2=0x561cb1f7fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:27.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.647+0000 7f099b7fe640 1 --2- 172.21.15.2:0/2792943955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561cb1f7f5d0 0x561cb1f7fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:27.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.647+0000 7f099b7fe640 1 -- 172.21.15.2:0/2792943955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cb1f80b40 msgr2=0x561cb1f7f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:27.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.647+0000 7f099b7fe640 1 --2- 172.21.15.2:0/2792943955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cb1f80b40 0x561cb1f7f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:27.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.647+0000 7f099b7fe640 1 -- 172.21.15.2:0/2792943955 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cb1e713a0 con 0x561cb1f8a370 2024-09-19T04:58:27.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.647+0000 7f09a0a51640 1 --2- 172.21.15.2:0/3914006742 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f09840a33b0 0x7f09840a5870 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0994013c50 tx=0x7f09940072a0 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:58:27.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.647+0000 7f099b7fe640 1 --2- 172.21.15.2:0/2792943955 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561cb1f8a370 0x561cb1f8c760 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0990009230 tx=0x7f0990032cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c668d326fe76ff2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:58:27.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.647+0000 7f09827fc640 1 -- 172.21.15.2:0/2792943955 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099003f070 con 0x561cb1f8a370 2024-09-19T04:58:27.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.647+0000 7f09827fc640 1 -- 172.21.15.2:0/2792943955 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f09900316a0 con 0x561cb1f8a370 2024-09-19T04:58:27.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.647+0000 7f09827fc640 1 -- 172.21.15.2:0/2792943955 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0990035070 con 0x561cb1f8a370 2024-09-19T04:58:27.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.648+0000 7f09a488d740 1 -- 172.21.15.2:0/2792943955 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561cb1f8a370 msgr2=0x561cb1f8c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:27.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.648+0000 7f09a488d740 1 --2- 172.21.15.2:0/2792943955 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561cb1f8a370 0x561cb1f8c760 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0990009230 tx=0x7f0990032cc0 comp rx=0 tx=0).stop 2024-09-19T04:58:27.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.648+0000 7f09a488d740 1 -- 172.21.15.2:0/2792943955 shutdown_connections 2024-09-19T04:58:27.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.648+0000 7f09a488d740 1 --2- 172.21.15.2:0/2792943955 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561cb1f8a370 0x561cb1f8c760 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:27.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.648+0000 7f09a488d740 1 --2- 172.21.15.2:0/2792943955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561cb1f7f5d0 0x561cb1f7fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:27.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.648+0000 7f09a488d740 1 --2- 172.21.15.2:0/2792943955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cb1f80b40 0x561cb1f7f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:27.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.648+0000 7f09a488d740 1 -- 172.21.15.2:0/2792943955 >> 172.21.15.2:0/2792943955 conn(0x561cb1f48310 msgr2=0x561cb1f7bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:58:27.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.648+0000 7f09a488d740 1 -- 172.21.15.2:0/2792943955 shutdown_connections 2024-09-19T04:58:27.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.648+0000 7f09a488d740 1 -- 172.21.15.2:0/2792943955 wait complete. 2024-09-19T04:58:27.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.648+0000 7f09a488d740 1 -- start start 2024-09-19T04:58:27.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.649+0000 7f09a488d740 1 Processor -- start 2024-09-19T04:58:27.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.649+0000 7f09a488d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561cb1f7f5d0 0x561cb1f89d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:27.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.649+0000 7f09a488d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cb1f80b40 0x561cb1f86ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:27.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.649+0000 7f09a488d740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561cb1f8a370 0x561cb1f875e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:27.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.649+0000 7f09a488d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561cb1f8d010 con 0x561cb1f80b40 2024-09-19T04:58:27.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.649+0000 7f09a488d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561cb1ea0060 con 0x561cb1f7f5d0 2024-09-19T04:58:27.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.649+0000 7f09a488d740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x561cb1f8d190 con 0x561cb1f8a370 2024-09-19T04:58:27.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.649+0000 7f09a488d740 10 client.0 _ll_register_callbacks cb 0x561cb1bf38c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:58:27.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.649+0000 7f099b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cb1f80b40 0x561cb1f86ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:27.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.649+0000 7f099b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cb1f80b40 0x561cb1f86ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54902/0 (socket says 172.21.15.2:54902) 2024-09-19T04:58:27.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.649+0000 7f099b7fe640 1 -- 172.21.15.2:0/1553982344 learned_addr learned my addr 172.21.15.2:0/1553982344 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:58:27.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.649+0000 7f09a0a51640 1 --2- 172.21.15.2:0/1553982344 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561cb1f8a370 0x561cb1f875e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:27.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.649+0000 7f099bfff640 1 --2- 172.21.15.2:0/1553982344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561cb1f7f5d0 0x561cb1f89d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:27.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.649+0000 7f099b7fe640 1 -- 172.21.15.2:0/1553982344 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561cb1f8a370 msgr2=0x561cb1f875e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:27.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.649+0000 7f099b7fe640 1 --2- 172.21.15.2:0/1553982344 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561cb1f8a370 0x561cb1f875e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:27.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.649+0000 7f099b7fe640 1 -- 172.21.15.2:0/1553982344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561cb1f7f5d0 msgr2=0x561cb1f89d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:27.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.649+0000 7f099b7fe640 1 --2- 172.21.15.2:0/1553982344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561cb1f7f5d0 0x561cb1f89d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:27.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.649+0000 7f099b7fe640 1 -- 172.21.15.2:0/1553982344 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cb1c563c0 con 0x561cb1f80b40 2024-09-19T04:58:27.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.650+0000 7f099b7fe640 1 --2- 172.21.15.2:0/1553982344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cb1f80b40 0x561cb1f86ff0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f09900092a0 tx=0x7f09900314a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ad88bb7d2195171 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:58:27.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.650+0000 7f097b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:58:27.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.650+0000 7f097b7fe640 1 -- 172.21.15.2:0/1553982344 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099004a020 con 0x561cb1f80b40 2024-09-19T04:58:27.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.650+0000 7f09a488d740 1 -- 172.21.15.2:0/1553982344 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f09900316a0 con 0x561cb1f80b40 2024-09-19T04:58:27.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.650+0000 7f097b7fe640 1 -- 172.21.15.2:0/1553982344 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f09900035f0 con 0x561cb1f80b40 2024-09-19T04:58:27.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.650+0000 7f097b7fe640 1 -- 172.21.15.2:0/1553982344 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f0990055050 con 0x561cb1f80b40 2024-09-19T04:58:27.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.650+0000 7f09a488d740 10 client.16710 fetch_fsmap learned FSMap version 19 2024-09-19T04:58:27.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.650+0000 7f09a488d740 1 -- 172.21.15.2:0/1553982344 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x561cb1f98a80 con 0x561cb1f80b40 2024-09-19T04:58:27.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.650+0000 7f097b7fe640 1 -- 172.21.15.2:0/1553982344 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f09900316a0 con 0x561cb1f80b40 2024-09-19T04:58:27.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.650+0000 7f097b7fe640 1 -- 172.21.15.2:0/1553982344 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f0990004990 con 0x561cb1f80b40 2024-09-19T04:58:27.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.650+0000 7f09a488d740 10 client.16710 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:58:27.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.651+0000 7f09a488d740 10 client.16710 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:58:27.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.651+0000 7f09a488d740 20 client.16710 populate_metadata read hostname 'smithi002' 2024-09-19T04:58:27.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.651+0000 7f09a488d740 1 --2- 172.21.15.2:0/1553982344 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x561cb1f99dd0 0x561cb1f9c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:27.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.651+0000 7f09a488d740 4 client.16710 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:58:27.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.651+0000 7f09a488d740 1 -- 172.21.15.2:0/1553982344 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561cb1ef2860 con 0x561cb1f99dd0 2024-09-19T04:58:27.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.651+0000 7f099bfff640 1 --2- 172.21.15.2:0/1553982344 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x561cb1f99dd0 0x561cb1f9c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:27.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.651+0000 7f097b7fe640 10 client.16710 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:58:27.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.651+0000 7f099bfff640 1 --2- 172.21.15.2:0/1553982344 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x561cb1f99dd0 0x561cb1f9c1c0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff14cbdae057d617 server_cookie=c375c8e7c5dde266 in_seq=0 out_seq=0 2024-09-19T04:58:27.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.652+0000 7f097b7fe640 1 -- 172.21.15.2:0/1553982344 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561cb1ef2860 con 0x561cb1f99dd0 2024-09-19T04:58:27.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.652+0000 7f097b7fe640 10 client.16710 handle_command_reply: tid=0 2024-09-19T04:58:27.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.652+0000 7f09a488d740 1 client.16710 shutdown 2024-09-19T04:58:27.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.652+0000 7f09a488d740 1 -- 172.21.15.2:0/1553982344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cb1f80b40 msgr2=0x561cb1f86ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:27.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.652+0000 7f09a488d740 1 --2- 172.21.15.2:0/1553982344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cb1f80b40 0x561cb1f86ff0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f09900092a0 tx=0x7f09900314a0 comp rx=0 tx=0).stop 2024-09-19T04:58:27.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.652+0000 7f09a488d740 1 -- 172.21.15.2:0/1553982344 shutdown_connections 2024-09-19T04:58:27.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.652+0000 7f09a488d740 1 --2- 172.21.15.2:0/1553982344 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x561cb1f99dd0 0x561cb1f9c1c0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:27.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.652+0000 7f097b7fe640 0 client.16710 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:58:27.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.652+0000 7f09a488d740 1 --2- 172.21.15.2:0/1553982344 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561cb1f8a370 0x561cb1f875e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:27.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.652+0000 7f09a488d740 1 --2- 172.21.15.2:0/1553982344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cb1f80b40 0x561cb1f86ff0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:27.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.652+0000 7f09a488d740 1 --2- 172.21.15.2:0/1553982344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561cb1f7f5d0 0x561cb1f89d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:27.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.652+0000 7f09a488d740 1 -- 172.21.15.2:0/1553982344 >> 172.21.15.2:0/1553982344 conn(0x561cb1f48310 msgr2=0x561cb1f81960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:58:27.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.652+0000 7f09a488d740 1 -- 172.21.15.2:0/1553982344 shutdown_connections 2024-09-19T04:58:27.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.652+0000 7f09a488d740 1 -- 172.21.15.2:0/1553982344 wait complete. 2024-09-19T04:58:27.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.653+0000 7f09a488d740 20 client.16710 trim_cache size 0 max 16384 2024-09-19T04:58:27.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.665+0000 7f09a488d740 1 Processor -- start 2024-09-19T04:58:27.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.665+0000 7f09a488d740 1 -- start start 2024-09-19T04:58:27.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.666+0000 7f09a488d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561cb1f7f5d0 0x561cb1f868b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:27.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.666+0000 7f09a488d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cb1f80b40 0x561cb1f88f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:27.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.666+0000 7f09a488d740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561cb1f8a370 0x561cb1f82120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:27.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.666+0000 7f09a488d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f099c1ad9c0 con 0x561cb1f80b40 2024-09-19T04:58:27.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.666+0000 7f09a488d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f099c1b0220 con 0x561cb1f7f5d0 2024-09-19T04:58:27.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.666+0000 7f09a488d740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f099c1ae010 con 0x561cb1f8a370 2024-09-19T04:58:27.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.666+0000 7f099b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cb1f80b40 0x561cb1f88f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:27.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.666+0000 7f099b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cb1f80b40 0x561cb1f88f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54918/0 (socket says 172.21.15.2:54918) 2024-09-19T04:58:27.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.666+0000 7f099b7fe640 1 -- 172.21.15.2:0/2555250049 learned_addr learned my addr 172.21.15.2:0/2555250049 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:58:27.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.666+0000 7f099bfff640 1 --2- 172.21.15.2:0/2555250049 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561cb1f7f5d0 0x561cb1f868b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:27.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.666+0000 7f09a0a51640 1 --2- 172.21.15.2:0/2555250049 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561cb1f8a370 0x561cb1f82120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:27.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.666+0000 7f099b7fe640 1 -- 172.21.15.2:0/2555250049 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561cb1f8a370 msgr2=0x561cb1f82120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:27.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.666+0000 7f099b7fe640 1 --2- 172.21.15.2:0/2555250049 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561cb1f8a370 0x561cb1f82120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:27.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.666+0000 7f099b7fe640 1 -- 172.21.15.2:0/2555250049 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561cb1f7f5d0 msgr2=0x561cb1f868b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:27.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.666+0000 7f099b7fe640 1 --2- 172.21.15.2:0/2555250049 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561cb1f7f5d0 0x561cb1f868b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:27.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.666+0000 7f099b7fe640 1 -- 172.21.15.2:0/2555250049 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cb1f85540 con 0x561cb1f80b40 2024-09-19T04:58:27.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.666+0000 7f099bfff640 1 --2- 172.21.15.2:0/2555250049 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561cb1f7f5d0 0x561cb1f868b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:58:27.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.666+0000 7f099b7fe640 1 --2- 172.21.15.2:0/2555250049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cb1f80b40 0x561cb1f88f60 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f0990000c00 tx=0x7f0990009230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7fe006829a461a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:58:27.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.666+0000 7f0981ffb640 1 -- 172.21.15.2:0/2555250049 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099004a070 con 0x561cb1f80b40 2024-09-19T04:58:27.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.667+0000 7f0981ffb640 1 -- 172.21.15.2:0/2555250049 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0990031510 con 0x561cb1f80b40 2024-09-19T04:58:27.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.667+0000 7f0981ffb640 1 -- 172.21.15.2:0/2555250049 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099003f070 con 0x561cb1f80b40 2024-09-19T04:58:27.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.667+0000 7f09a488d740 1 -- 172.21.15.2:0/2555250049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cb1f80b40 msgr2=0x561cb1f88f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:27.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.667+0000 7f09a488d740 1 --2- 172.21.15.2:0/2555250049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cb1f80b40 0x561cb1f88f60 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f0990000c00 tx=0x7f0990009230 comp rx=0 tx=0).stop 2024-09-19T04:58:27.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.667+0000 7f09a488d740 1 -- 172.21.15.2:0/2555250049 shutdown_connections 2024-09-19T04:58:27.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.667+0000 7f09a488d740 1 --2- 172.21.15.2:0/2555250049 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561cb1f8a370 0x561cb1f82120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:27.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.667+0000 7f09a488d740 1 --2- 172.21.15.2:0/2555250049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cb1f80b40 0x561cb1f88f60 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:27.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.667+0000 7f09a488d740 1 --2- 172.21.15.2:0/2555250049 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561cb1f7f5d0 0x561cb1f868b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:27.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.667+0000 7f09a488d740 1 -- 172.21.15.2:0/2555250049 >> 172.21.15.2:0/2555250049 conn(0x561cb1f48310 msgr2=0x561cb1f88850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:58:27.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.667+0000 7f09a488d740 1 -- 172.21.15.2:0/2555250049 shutdown_connections 2024-09-19T04:58:27.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.667+0000 7f09a488d740 1 -- 172.21.15.2:0/2555250049 wait complete. 2024-09-19T04:58:27.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.668+0000 7f09a488d740 1 -- start start 2024-09-19T04:58:27.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.668+0000 7f09a488d740 1 Processor -- start 2024-09-19T04:58:27.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.668+0000 7f09a488d740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561cb1f7f5d0 0x561cb1f9f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:27.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.668+0000 7f09a488d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cb1f80b40 0x561cb1f9cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:27.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.668+0000 7f09a488d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561cb1f8a370 0x561cb1f9d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:27.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.668+0000 7f09a488d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f099c1ae6e0 con 0x561cb1f80b40 2024-09-19T04:58:27.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.668+0000 7f09a488d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f099c1afb50 con 0x561cb1f8a370 2024-09-19T04:58:27.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.668+0000 7f09a488d740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f099c1aedb0 con 0x561cb1f7f5d0 2024-09-19T04:58:27.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.668+0000 7f09a488d740 10 client.0 _ll_register_callbacks cb 0x7f0994007e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:58:27.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.668+0000 7f099b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cb1f80b40 0x561cb1f9cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:27.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.668+0000 7f099b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cb1f80b40 0x561cb1f9cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54934/0 (socket says 172.21.15.2:54934) 2024-09-19T04:58:27.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.668+0000 7f099b7fe640 1 -- 172.21.15.2:0/637165874 learned_addr learned my addr 172.21.15.2:0/637165874 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:58:27.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.668+0000 7f099bfff640 1 --2- 172.21.15.2:0/637165874 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561cb1f7f5d0 0x561cb1f9f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:27.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.668+0000 7f09a0a51640 1 --2- 172.21.15.2:0/637165874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561cb1f8a370 0x561cb1f9d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:27.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.668+0000 7f099b7fe640 1 -- 172.21.15.2:0/637165874 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561cb1f7f5d0 msgr2=0x561cb1f9f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:27.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.668+0000 7f099b7fe640 1 --2- 172.21.15.2:0/637165874 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561cb1f7f5d0 0x561cb1f9f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:27.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.668+0000 7f099b7fe640 1 -- 172.21.15.2:0/637165874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561cb1f8a370 msgr2=0x561cb1f9d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:27.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.668+0000 7f099b7fe640 1 --2- 172.21.15.2:0/637165874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561cb1f8a370 0x561cb1f9d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:27.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.669+0000 7f099b7fe640 1 -- 172.21.15.2:0/637165874 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cb1f9d960 con 0x561cb1f80b40 2024-09-19T04:58:27.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.669+0000 7f099bfff640 1 --2- 172.21.15.2:0/637165874 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561cb1f7f5d0 0x561cb1f9f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:58:27.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.669+0000 7f099b7fe640 1 --2- 172.21.15.2:0/637165874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cb1f80b40 0x561cb1f9cc40 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f09900053c0 tx=0x7f0990032db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b063baa28557dc98 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:58:27.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.669+0000 7f097b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:58:27.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.669+0000 7f097b7fe640 1 -- 172.21.15.2:0/637165874 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099003f070 con 0x561cb1f80b40 2024-09-19T04:58:27.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.669+0000 7f097b7fe640 1 -- 172.21.15.2:0/637165874 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f0990031c60 con 0x561cb1f80b40 2024-09-19T04:58:27.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.669+0000 7f09a488d740 1 -- 172.21.15.2:0/637165874 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0990031510 con 0x561cb1f80b40 2024-09-19T04:58:27.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.669+0000 7f097b7fe640 1 -- 172.21.15.2:0/637165874 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f099004a040 con 0x561cb1f80b40 2024-09-19T04:58:27.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.669+0000 7f09a488d740 10 client.16716 fetch_fsmap learned FSMap version 19 2024-09-19T04:58:27.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.669+0000 7f09a488d740 1 -- 172.21.15.2:0/637165874 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x561cb20046c0 con 0x561cb1f80b40 2024-09-19T04:58:27.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.669+0000 7f097b7fe640 1 -- 172.21.15.2:0/637165874 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0990031510 con 0x561cb1f80b40 2024-09-19T04:58:27.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.670+0000 7f097b7fe640 1 -- 172.21.15.2:0/637165874 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f0990003a20 con 0x561cb1f80b40 2024-09-19T04:58:27.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.670+0000 7f09a488d740 10 client.16716 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:58:27.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.670+0000 7f09a488d740 10 client.16716 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:58:27.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.670+0000 7f09a488d740 20 client.16716 populate_metadata read hostname 'smithi002' 2024-09-19T04:58:27.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.670+0000 7f09a488d740 1 --2- 172.21.15.2:0/637165874 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x561cb2004dd0 0x561cb20071f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:27.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.670+0000 7f09a488d740 4 client.16716 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:58:27.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.670+0000 7f09a488d740 1 -- 172.21.15.2:0/637165874 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561cb1eecd70 con 0x561cb2004dd0 2024-09-19T04:58:27.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.670+0000 7f099bfff640 1 --2- 172.21.15.2:0/637165874 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x561cb2004dd0 0x561cb20071f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:27.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.670+0000 7f099bfff640 1 --2- 172.21.15.2:0/637165874 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x561cb2004dd0 0x561cb20071f0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfd4c85f160e4031 server_cookie=369687804edaa7f0 in_seq=0 out_seq=0 2024-09-19T04:58:27.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.670+0000 7f097b7fe640 10 client.16716 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:58:27.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.670+0000 7f097b7fe640 1 -- 172.21.15.2:0/637165874 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561cb1eecd70 con 0x561cb2004dd0 2024-09-19T04:58:27.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.670+0000 7f097b7fe640 10 client.16716 handle_command_reply: tid=0 2024-09-19T04:58:27.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.671+0000 7f09a488d740 1 client.16716 shutdown 2024-09-19T04:58:27.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.671+0000 7f09a488d740 1 -- 172.21.15.2:0/637165874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cb1f80b40 msgr2=0x561cb1f9cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:27.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.671+0000 7f09a488d740 1 --2- 172.21.15.2:0/637165874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cb1f80b40 0x561cb1f9cc40 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f09900053c0 tx=0x7f0990032db0 comp rx=0 tx=0).stop 2024-09-19T04:58:27.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.671+0000 7f09a488d740 1 -- 172.21.15.2:0/637165874 shutdown_connections 2024-09-19T04:58:27.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.671+0000 7f09a488d740 1 --2- 172.21.15.2:0/637165874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561cb1f8a370 0x561cb1f9d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:27.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.671+0000 7f09a488d740 1 --2- 172.21.15.2:0/637165874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cb1f80b40 0x561cb1f9cc40 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:27.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.671+0000 7f09a488d740 1 --2- 172.21.15.2:0/637165874 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x561cb2004dd0 0x561cb20071f0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:27.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.671+0000 7f097b7fe640 0 client.16716 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:58:27.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.671+0000 7f09a488d740 1 --2- 172.21.15.2:0/637165874 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561cb1f7f5d0 0x561cb1f9f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:27.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.671+0000 7f09a488d740 1 -- 172.21.15.2:0/637165874 >> 172.21.15.2:0/637165874 conn(0x561cb1f48310 msgr2=0x561cb1f7a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:58:27.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.671+0000 7f09a488d740 1 -- 172.21.15.2:0/637165874 shutdown_connections 2024-09-19T04:58:27.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.671+0000 7f09a488d740 1 -- 172.21.15.2:0/637165874 wait complete. 2024-09-19T04:58:27.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.671+0000 7f09a488d740 20 client.16716 trim_cache size 0 max 16384 2024-09-19T04:58:27.678 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T04:58:27.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.671+0000 7f09a24b4640 1 -- 172.21.15.2:0/3914006742 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f09840a33b0 msgr2=0x7f09840a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:27.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.671+0000 7f09a24b4640 1 --2- 172.21.15.2:0/3914006742 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f09840a33b0 0x7f09840a5870 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0994013c50 tx=0x7f09940072a0 comp rx=0 tx=0).stop 2024-09-19T04:58:27.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.671+0000 7f09a24b4640 1 -- 172.21.15.2:0/3914006742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f099c101de0 msgr2=0x7f099c19a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:27.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.671+0000 7f09a24b4640 1 --2- 172.21.15.2:0/3914006742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f099c101de0 0x7f099c19a570 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f098c00d950 tx=0x7f098c00de10 comp rx=0 tx=0).stop 2024-09-19T04:58:27.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.672+0000 7f09a24b4640 1 -- 172.21.15.2:0/3914006742 shutdown_connections 2024-09-19T04:58:27.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.672+0000 7f09a24b4640 1 --2- 172.21.15.2:0/3914006742 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f09840a33b0 0x7f09840a5870 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:27.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.672+0000 7f09a24b4640 1 --2- 172.21.15.2:0/3914006742 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f099c106f10 0x7f099c19ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:27.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.672+0000 7f09a24b4640 1 --2- 172.21.15.2:0/3914006742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f099c102790 0x7f099c19aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:27.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.672+0000 7f09a24b4640 1 --2- 172.21.15.2:0/3914006742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f099c101de0 0x7f099c19a570 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:27.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.672+0000 7f09a24b4640 1 -- 172.21.15.2:0/3914006742 >> 172.21.15.2:0/3914006742 conn(0x7f099c0fd8c0 msgr2=0x7f099c0fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:58:27.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.672+0000 7f09a24b4640 1 -- 172.21.15.2:0/3914006742 shutdown_connections 2024-09-19T04:58:27.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:27.672+0000 7f09a24b4640 1 -- 172.21.15.2:0/3914006742 wait complete. 2024-09-19T04:58:28.609 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:28 smithi002 ceph-mon[30975]: pgmap v325: 97 pgs: 97 active+clean; 21 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 55 KiB/s wr, 7 op/s 2024-09-19T04:58:28.806 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:28 smithi018 ceph-mon[34537]: pgmap v325: 97 pgs: 97 active+clean; 21 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 55 KiB/s wr, 7 op/s 2024-09-19T04:58:28.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:28 smithi116 ceph-mon[34477]: pgmap v325: 97 pgs: 97 active+clean; 21 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 55 KiB/s wr, 7 op/s 2024-09-19T04:58:29.301 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:58:29.301 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:58:29.575 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:58:30.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.051+0000 7f4325cb6640 1 -- 172.21.15.2:0/3071705132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4320106f10 msgr2=0x7f432010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:30.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.051+0000 7f4325cb6640 1 --2- 172.21.15.2:0/3071705132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4320106f10 0x7f432010ea90 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f4318009ca0 tx=0x7f431802a8c0 comp rx=0 tx=0).stop 2024-09-19T04:58:30.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.051+0000 7f4325cb6640 1 -- 172.21.15.2:0/3071705132 shutdown_connections 2024-09-19T04:58:30.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.051+0000 7f4325cb6640 1 --2- 172.21.15.2:0/3071705132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4320106f10 0x7f432010ea90 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:30.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.051+0000 7f4325cb6640 1 --2- 172.21.15.2:0/3071705132 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4320102790 0x7f43201067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:30.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.051+0000 7f4325cb6640 1 --2- 172.21.15.2:0/3071705132 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4320101de0 0x7f43201021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:30.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.051+0000 7f4325cb6640 1 -- 172.21.15.2:0/3071705132 >> 172.21.15.2:0/3071705132 conn(0x7f43200fd8c0 msgr2=0x7f43200ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:58:30.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.051+0000 7f4325cb6640 1 -- 172.21.15.2:0/3071705132 shutdown_connections 2024-09-19T04:58:30.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.051+0000 7f4325cb6640 1 -- 172.21.15.2:0/3071705132 wait complete. 2024-09-19T04:58:30.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.052+0000 7f4325cb6640 1 Processor -- start 2024-09-19T04:58:30.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.052+0000 7f4325cb6640 1 -- start start 2024-09-19T04:58:30.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.052+0000 7f4325cb6640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4320101de0 0x7f4320198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:30.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.052+0000 7f4325cb6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4320102790 0x7f4320198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:30.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.052+0000 7f4325cb6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4320106f10 0x7f432019cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:30.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.053+0000 7f4325cb6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4320111e20 con 0x7f4320102790 2024-09-19T04:58:30.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.053+0000 7f4325cb6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4320111ca0 con 0x7f4320106f10 2024-09-19T04:58:30.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.053+0000 7f4325cb6640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f4320111fa0 con 0x7f4320101de0 2024-09-19T04:58:30.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.053+0000 7f431effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4320102790 0x7f4320198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:30.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.053+0000 7f431effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4320102790 0x7f4320198880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54940/0 (socket says 172.21.15.2:54940) 2024-09-19T04:58:30.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.053+0000 7f431effd640 1 -- 172.21.15.2:0/804281083 learned_addr learned my addr 172.21.15.2:0/804281083 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:58:30.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.053+0000 7f431ffff640 1 --2- 172.21.15.2:0/804281083 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4320106f10 0x7f432019cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:30.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.053+0000 7f431f7fe640 1 --2- 172.21.15.2:0/804281083 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4320101de0 0x7f4320198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:30.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.053+0000 7f431effd640 1 -- 172.21.15.2:0/804281083 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4320101de0 msgr2=0x7f4320198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:30.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.053+0000 7f431effd640 1 --2- 172.21.15.2:0/804281083 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4320101de0 0x7f4320198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:30.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.053+0000 7f431effd640 1 -- 172.21.15.2:0/804281083 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4320106f10 msgr2=0x7f432019cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:30.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.053+0000 7f431effd640 1 --2- 172.21.15.2:0/804281083 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4320106f10 0x7f432019cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:30.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.053+0000 7f431effd640 1 -- 172.21.15.2:0/804281083 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f432019d2f0 con 0x7f4320102790 2024-09-19T04:58:30.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.053+0000 7f431effd640 1 --2- 172.21.15.2:0/804281083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4320102790 0x7f4320198880 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f431400d770 tx=0x7f431400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:58:30.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.053+0000 7f431cff9640 1 -- 172.21.15.2:0/804281083 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4314017070 con 0x7f4320102790 2024-09-19T04:58:30.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.053+0000 7f431cff9640 1 -- 172.21.15.2:0/804281083 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f43140054d0 con 0x7f4320102790 2024-09-19T04:58:30.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.053+0000 7f4325cb6640 1 -- 172.21.15.2:0/804281083 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f432019d5e0 con 0x7f4320102790 2024-09-19T04:58:30.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.053+0000 7f431cff9640 1 -- 172.21.15.2:0/804281083 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4314004cf0 con 0x7f4320102790 2024-09-19T04:58:30.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.053+0000 7f4325cb6640 1 -- 172.21.15.2:0/804281083 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43201a4ec0 con 0x7f4320102790 2024-09-19T04:58:30.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.056+0000 7f431cff9640 1 -- 172.21.15.2:0/804281083 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f4314004e90 con 0x7f4320102790 2024-09-19T04:58:30.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.056+0000 7f432808f740 1 Processor -- start 2024-09-19T04:58:30.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.056+0000 7f432808f740 1 -- start start 2024-09-19T04:58:30.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.057+0000 7f432808f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56182d124b60 0x56182d124f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:30.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.057+0000 7f432808f740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56182d125480 0x56182d12f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:30.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.057+0000 7f432808f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56182d12fd40 0x56182d132130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:30.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.057+0000 7f432808f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56182d08a280 con 0x56182d124b60 2024-09-19T04:58:30.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.057+0000 7f432808f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56182d031b10 con 0x56182d12fd40 2024-09-19T04:58:30.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.057+0000 7f432808f740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x56182d086240 con 0x56182d125480 2024-09-19T04:58:30.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.057+0000 7f431cff9640 1 --2- 172.21.15.2:0/804281083 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f43080a3430 0x7f43080a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:30.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.057+0000 7f431f7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56182d125480 0x56182d12f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:30.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.057+0000 7f431ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56182d124b60 0x56182d124f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:30.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.057+0000 7f431f7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56182d125480 0x56182d12f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.2:56036/0 (socket says 172.21.15.2:56036) 2024-09-19T04:58:30.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.057+0000 7f431f7fe640 1 -- 172.21.15.2:0/1601302747 learned_addr learned my addr 172.21.15.2:0/1601302747 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:58:30.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.057+0000 7f431effd640 1 --2- 172.21.15.2:0/1601302747 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56182d12fd40 0x56182d132130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:30.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.057+0000 7f431ffff640 1 --2- 172.21.15.2:0/804281083 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f43080a3430 0x7f43080a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:30.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.057+0000 7f431cff9640 1 -- 172.21.15.2:0/804281083 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f43140cf6f0 con 0x7f4320102790 2024-09-19T04:58:30.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.057+0000 7f431f7fe640 1 -- 172.21.15.2:0/1601302747 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56182d12fd40 msgr2=0x56182d132130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:30.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.057+0000 7f431f7fe640 1 --2- 172.21.15.2:0/1601302747 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56182d12fd40 0x56182d132130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:30.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.057+0000 7f431f7fe640 1 -- 172.21.15.2:0/1601302747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56182d124b60 msgr2=0x56182d124f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:30.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.057+0000 7f431f7fe640 1 --2- 172.21.15.2:0/1601302747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56182d124b60 0x56182d124f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:30.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.057+0000 7f431f7fe640 1 -- 172.21.15.2:0/1601302747 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56182d03e1f0 con 0x56182d125480 2024-09-19T04:58:30.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.057+0000 7f431ffff640 1 --2- 172.21.15.2:0/1601302747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56182d124b60 0x56182d124f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:58:30.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.057+0000 7f431effd640 1 --2- 172.21.15.2:0/1601302747 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56182d12fd40 0x56182d132130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:58:30.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.057+0000 7f431ffff640 1 --2- 172.21.15.2:0/804281083 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f43080a3430 0x7f43080a58f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4318004af0 tx=0x7f4318004a60 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:58:30.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.057+0000 7f431f7fe640 1 --2- 172.21.15.2:0/1601302747 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56182d125480 0x56182d12f800 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f431000bcb0 tx=0x7f431000f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c6ff70603c6df26 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:58:30.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.058+0000 7f4305ffb640 1 -- 172.21.15.2:0/1601302747 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4310015070 con 0x56182d125480 2024-09-19T04:58:30.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.058+0000 7f4305ffb640 1 -- 172.21.15.2:0/1601302747 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f431001a910 con 0x56182d125480 2024-09-19T04:58:30.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.058+0000 7f4305ffb640 1 -- 172.21.15.2:0/1601302747 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4310011930 con 0x56182d125480 2024-09-19T04:58:30.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.058+0000 7f432808f740 1 -- 172.21.15.2:0/1601302747 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56182d125480 msgr2=0x56182d12f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:30.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.058+0000 7f432808f740 1 --2- 172.21.15.2:0/1601302747 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56182d125480 0x56182d12f800 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f431000bcb0 tx=0x7f431000f730 comp rx=0 tx=0).stop 2024-09-19T04:58:30.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.058+0000 7f432808f740 1 -- 172.21.15.2:0/1601302747 shutdown_connections 2024-09-19T04:58:30.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.058+0000 7f432808f740 1 --2- 172.21.15.2:0/1601302747 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56182d12fd40 0x56182d132130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:30.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.058+0000 7f432808f740 1 --2- 172.21.15.2:0/1601302747 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56182d125480 0x56182d12f800 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:30.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.058+0000 7f432808f740 1 --2- 172.21.15.2:0/1601302747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56182d124b60 0x56182d124f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:30.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.058+0000 7f432808f740 1 -- 172.21.15.2:0/1601302747 >> 172.21.15.2:0/1601302747 conn(0x56182d1210f0 msgr2=0x56182d1214d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:58:30.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.058+0000 7f432808f740 1 -- 172.21.15.2:0/1601302747 shutdown_connections 2024-09-19T04:58:30.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.059+0000 7f432808f740 1 -- 172.21.15.2:0/1601302747 wait complete. 2024-09-19T04:58:30.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.059+0000 7f432808f740 1 -- start start 2024-09-19T04:58:30.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.059+0000 7f432808f740 1 Processor -- start 2024-09-19T04:58:30.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.059+0000 7f432808f740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56182d124b60 0x56182d12cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:30.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.059+0000 7f432808f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56182d125480 0x56182d12d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:30.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.059+0000 7f432808f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56182d12fd40 0x56182d12d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:30.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.059+0000 7f432808f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56182d132910 con 0x56182d125480 2024-09-19T04:58:30.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.059+0000 7f432808f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56182d044f10 con 0x56182d12fd40 2024-09-19T04:58:30.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.059+0000 7f432808f740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x56182d132a90 con 0x56182d124b60 2024-09-19T04:58:30.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.059+0000 7f432808f740 10 client.0 _ll_register_callbacks cb 0x56182d00da40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:58:30.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.059+0000 7f431effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56182d125480 0x56182d12d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:30.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.059+0000 7f431effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56182d125480 0x56182d12d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54954/0 (socket says 172.21.15.2:54954) 2024-09-19T04:58:30.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.059+0000 7f431effd640 1 -- 172.21.15.2:0/3746600787 learned_addr learned my addr 172.21.15.2:0/3746600787 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:58:30.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.060+0000 7f431f7fe640 1 --2- 172.21.15.2:0/3746600787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56182d124b60 0x56182d12cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:30.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.060+0000 7f431ffff640 1 --2- 172.21.15.2:0/3746600787 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56182d12fd40 0x56182d12d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:30.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.060+0000 7f431effd640 1 -- 172.21.15.2:0/3746600787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56182d124b60 msgr2=0x56182d12cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:30.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.060+0000 7f431effd640 1 --2- 172.21.15.2:0/3746600787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56182d124b60 0x56182d12cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:30.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.060+0000 7f431effd640 1 -- 172.21.15.2:0/3746600787 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56182d12fd40 msgr2=0x56182d12d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:30.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.060+0000 7f431effd640 1 --2- 172.21.15.2:0/3746600787 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56182d12fd40 0x56182d12d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:30.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.060+0000 7f431effd640 1 -- 172.21.15.2:0/3746600787 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56182cdfb6a0 con 0x56182d125480 2024-09-19T04:58:30.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.060+0000 7f431effd640 1 --2- 172.21.15.2:0/3746600787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56182d125480 0x56182d12d100 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f4314009610 tx=0x7f43140209b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=547eadcb3f8ebc98 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:58:30.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.060+0000 7f42feffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:58:30.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.060+0000 7f42feffd640 1 -- 172.21.15.2:0/3746600787 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4314009c30 con 0x56182d125480 2024-09-19T04:58:30.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.060+0000 7f42feffd640 1 -- 172.21.15.2:0/3746600787 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f43140cd060 con 0x56182d125480 2024-09-19T04:58:30.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.060+0000 7f432808f740 1 -- 172.21.15.2:0/3746600787 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f431001a910 con 0x56182d125480 2024-09-19T04:58:30.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.060+0000 7f42feffd640 1 -- 172.21.15.2:0/3746600787 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f43140cd260 con 0x56182d125480 2024-09-19T04:58:30.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.060+0000 7f432808f740 10 client.16728 fetch_fsmap learned FSMap version 19 2024-09-19T04:58:30.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.060+0000 7f432808f740 1 -- 172.21.15.2:0/3746600787 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56182d13e4c0 con 0x56182d125480 2024-09-19T04:58:30.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.060+0000 7f42feffd640 1 -- 172.21.15.2:0/3746600787 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f431001a910 con 0x56182d125480 2024-09-19T04:58:30.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.061+0000 7f42feffd640 1 -- 172.21.15.2:0/3746600787 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f431409a830 con 0x56182d125480 2024-09-19T04:58:30.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.061+0000 7f432808f740 10 client.16728 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:58:30.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.061+0000 7f432808f740 10 client.16728 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:58:30.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.061+0000 7f432808f740 20 client.16728 populate_metadata read hostname 'smithi002' 2024-09-19T04:58:30.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.061+0000 7f432808f740 1 --2- 172.21.15.2:0/3746600787 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56182d13fa10 0x56182d141e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:30.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.061+0000 7f432808f740 4 client.16728 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:58:30.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.061+0000 7f432808f740 1 -- 172.21.15.2:0/3746600787 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56182d0977f0 con 0x56182d13fa10 2024-09-19T04:58:30.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.061+0000 7f431f7fe640 1 --2- 172.21.15.2:0/3746600787 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56182d13fa10 0x56182d141e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:30.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.061+0000 7f431f7fe640 1 --2- 172.21.15.2:0/3746600787 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56182d13fa10 0x56182d141e00 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e433f8608f3459c server_cookie=bf75994d85740c21 in_seq=0 out_seq=0 2024-09-19T04:58:30.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.061+0000 7f42feffd640 10 client.16728 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:58:30.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.062+0000 7f42feffd640 1 -- 172.21.15.2:0/3746600787 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56182d0977f0 con 0x56182d13fa10 2024-09-19T04:58:30.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.062+0000 7f42feffd640 10 client.16728 handle_command_reply: tid=0 2024-09-19T04:58:30.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.062+0000 7f432808f740 1 client.16728 shutdown 2024-09-19T04:58:30.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.062+0000 7f432808f740 1 -- 172.21.15.2:0/3746600787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56182d125480 msgr2=0x56182d12d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:30.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.062+0000 7f432808f740 1 --2- 172.21.15.2:0/3746600787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56182d125480 0x56182d12d100 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f4314009610 tx=0x7f43140209b0 comp rx=0 tx=0).stop 2024-09-19T04:58:30.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.063+0000 7f432808f740 1 -- 172.21.15.2:0/3746600787 shutdown_connections 2024-09-19T04:58:30.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.063+0000 7f432808f740 1 --2- 172.21.15.2:0/3746600787 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56182d12fd40 0x56182d12d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:30.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.063+0000 7f432808f740 1 --2- 172.21.15.2:0/3746600787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56182d125480 0x56182d12d100 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:30.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.063+0000 7f432808f740 1 --2- 172.21.15.2:0/3746600787 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56182d13fa10 0x56182d141e00 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:30.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.063+0000 7f432808f740 1 --2- 172.21.15.2:0/3746600787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56182d124b60 0x56182d12cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:30.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.063+0000 7f432808f740 1 -- 172.21.15.2:0/3746600787 >> 172.21.15.2:0/3746600787 conn(0x56182d1210f0 msgr2=0x56182d126e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:58:30.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.063+0000 7f42feffd640 0 client.16728 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:58:30.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.063+0000 7f432808f740 1 -- 172.21.15.2:0/3746600787 shutdown_connections 2024-09-19T04:58:30.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.063+0000 7f432808f740 1 -- 172.21.15.2:0/3746600787 wait complete. 2024-09-19T04:58:30.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.063+0000 7f432808f740 20 client.16728 trim_cache size 0 max 16384 2024-09-19T04:58:30.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.080+0000 7f432808f740 1 Processor -- start 2024-09-19T04:58:30.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.080+0000 7f432808f740 1 -- start start 2024-09-19T04:58:30.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.081+0000 7f432808f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56182d124b60 0x56182d12ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:30.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.081+0000 7f432808f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56182d125480 0x56182d147610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:30.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.081+0000 7f432808f740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56182d12fd40 0x56182d147b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:30.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.081+0000 7f432808f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f43201ab780 con 0x56182d125480 2024-09-19T04:58:30.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.081+0000 7f432808f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f43201adfe0 con 0x56182d124b60 2024-09-19T04:58:30.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.081+0000 7f432808f740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f43201abdd0 con 0x56182d12fd40 2024-09-19T04:58:30.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.081+0000 7f431effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56182d125480 0x56182d147610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:30.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.081+0000 7f431effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56182d125480 0x56182d147610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54964/0 (socket says 172.21.15.2:54964) 2024-09-19T04:58:30.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.081+0000 7f431effd640 1 -- 172.21.15.2:0/3821759882 learned_addr learned my addr 172.21.15.2:0/3821759882 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:58:30.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.081+0000 7f431f7fe640 1 --2- 172.21.15.2:0/3821759882 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56182d124b60 0x56182d12ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:30.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.081+0000 7f431ffff640 1 --2- 172.21.15.2:0/3821759882 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56182d12fd40 0x56182d147b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:30.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.081+0000 7f431effd640 1 -- 172.21.15.2:0/3821759882 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56182d12fd40 msgr2=0x56182d147b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:30.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.081+0000 7f431effd640 1 --2- 172.21.15.2:0/3821759882 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56182d12fd40 0x56182d147b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:30.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.081+0000 7f431effd640 1 -- 172.21.15.2:0/3821759882 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56182d124b60 msgr2=0x56182d12ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:30.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.081+0000 7f431effd640 1 --2- 172.21.15.2:0/3821759882 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56182d124b60 0x56182d12ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:30.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.081+0000 7f431effd640 1 -- 172.21.15.2:0/3821759882 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56182d120f20 con 0x56182d125480 2024-09-19T04:58:30.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.081+0000 7f431effd640 1 --2- 172.21.15.2:0/3821759882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56182d125480 0x56182d147610 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f4314098340 tx=0x7f43140ccec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fc7966a31ad1e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:58:30.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.082+0000 7f43057fa640 1 -- 172.21.15.2:0/3821759882 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43140962a0 con 0x56182d125480 2024-09-19T04:58:30.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.082+0000 7f43057fa640 1 -- 172.21.15.2:0/3821759882 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f431409b970 con 0x56182d125480 2024-09-19T04:58:30.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.082+0000 7f43057fa640 1 -- 172.21.15.2:0/3821759882 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43140cd060 con 0x56182d125480 2024-09-19T04:58:30.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.082+0000 7f432808f740 1 -- 172.21.15.2:0/3821759882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56182d125480 msgr2=0x56182d147610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:30.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.082+0000 7f432808f740 1 --2- 172.21.15.2:0/3821759882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56182d125480 0x56182d147610 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f4314098340 tx=0x7f43140ccec0 comp rx=0 tx=0).stop 2024-09-19T04:58:30.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.082+0000 7f432808f740 1 -- 172.21.15.2:0/3821759882 shutdown_connections 2024-09-19T04:58:30.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.082+0000 7f432808f740 1 --2- 172.21.15.2:0/3821759882 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56182d12fd40 0x56182d147b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:30.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.082+0000 7f432808f740 1 --2- 172.21.15.2:0/3821759882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56182d125480 0x56182d147610 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:30.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.082+0000 7f432808f740 1 --2- 172.21.15.2:0/3821759882 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56182d124b60 0x56182d12ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:30.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.082+0000 7f432808f740 1 -- 172.21.15.2:0/3821759882 >> 172.21.15.2:0/3821759882 conn(0x56182d1210f0 msgr2=0x56182d12b360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:58:30.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.082+0000 7f432808f740 1 -- 172.21.15.2:0/3821759882 shutdown_connections 2024-09-19T04:58:30.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.082+0000 7f432808f740 1 -- 172.21.15.2:0/3821759882 wait complete. 2024-09-19T04:58:30.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.083+0000 7f432808f740 1 -- start start 2024-09-19T04:58:30.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.083+0000 7f432808f740 1 Processor -- start 2024-09-19T04:58:30.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.083+0000 7f432808f740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56182d124b60 0x56182d137ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:30.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.083+0000 7f432808f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56182d125480 0x56182d138400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:30.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.083+0000 7f432808f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56182d12fd40 0x56182d134cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:30.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.083+0000 7f432808f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f43201ac4a0 con 0x56182d12fd40 2024-09-19T04:58:30.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.083+0000 7f432808f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f43201ad910 con 0x56182d125480 2024-09-19T04:58:30.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.083+0000 7f432808f740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f43201acb70 con 0x56182d124b60 2024-09-19T04:58:30.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.083+0000 7f432808f740 10 client.0 _ll_register_callbacks cb 0x7f4314005680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:58:30.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.083+0000 7f431f7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56182d124b60 0x56182d137ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:30.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.083+0000 7f431f7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56182d124b60 0x56182d137ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.2:56052/0 (socket says 172.21.15.2:56052) 2024-09-19T04:58:30.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.083+0000 7f431f7fe640 1 -- 172.21.15.2:0/885166258 learned_addr learned my addr 172.21.15.2:0/885166258 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:58:30.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.083+0000 7f431ffff640 1 --2- 172.21.15.2:0/885166258 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56182d12fd40 0x56182d134cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:30.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.083+0000 7f431effd640 1 --2- 172.21.15.2:0/885166258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56182d125480 0x56182d138400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:30.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.084+0000 7f431f7fe640 1 -- 172.21.15.2:0/885166258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56182d125480 msgr2=0x56182d138400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:30.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.084+0000 7f431f7fe640 1 --2- 172.21.15.2:0/885166258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56182d125480 0x56182d138400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:30.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.084+0000 7f431f7fe640 1 -- 172.21.15.2:0/885166258 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56182d12fd40 msgr2=0x56182d134cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:30.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.084+0000 7f431f7fe640 1 --2- 172.21.15.2:0/885166258 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56182d12fd40 0x56182d134cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:30.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.084+0000 7f431f7fe640 1 -- 172.21.15.2:0/885166258 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56182d135480 con 0x56182d124b60 2024-09-19T04:58:30.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.084+0000 7f431f7fe640 1 --2- 172.21.15.2:0/885166258 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56182d124b60 0x56182d137ec0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f431000bcb0 tx=0x7f4310005c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15a07edf6151630 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:58:30.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.084+0000 7f42feffd640 10 client.0 ms_handle_connect on v2:172.21.15.116:3300/0 2024-09-19T04:58:30.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.084+0000 7f42feffd640 1 -- 172.21.15.2:0/885166258 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4310015040 con 0x56182d124b60 2024-09-19T04:58:30.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.084+0000 7f42feffd640 1 -- 172.21.15.2:0/885166258 <== mon.1 v2:172.21.15.116:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f4310005240 con 0x56182d124b60 2024-09-19T04:58:30.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.084+0000 7f432808f740 1 -- 172.21.15.2:0/885166258 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f431409b970 con 0x56182d124b60 2024-09-19T04:58:30.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.084+0000 7f42feffd640 1 -- 172.21.15.2:0/885166258 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4310005e50 con 0x56182d124b60 2024-09-19T04:58:30.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.084+0000 7f432808f740 10 client.25969 fetch_fsmap learned FSMap version 19 2024-09-19T04:58:30.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.084+0000 7f432808f740 1 -- 172.21.15.2:0/885166258 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56182d1ab070 con 0x56182d124b60 2024-09-19T04:58:30.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.085+0000 7f42feffd640 1 -- 172.21.15.2:0/885166258 <== mon.1 v2:172.21.15.116:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f431409b970 con 0x56182d124b60 2024-09-19T04:58:30.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.085+0000 7f42feffd640 1 -- 172.21.15.2:0/885166258 <== mon.1 v2:172.21.15.116:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f4310004680 con 0x56182d124b60 2024-09-19T04:58:30.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.085+0000 7f432808f740 10 client.25969 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:58:30.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.085+0000 7f432808f740 10 client.25969 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:58:30.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.085+0000 7f432808f740 20 client.25969 populate_metadata read hostname 'smithi002' 2024-09-19T04:58:30.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.085+0000 7f432808f740 1 --2- 172.21.15.2:0/885166258 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56182d1ab4c0 0x56182d1ad8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:30.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.085+0000 7f432808f740 4 client.25969 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:58:30.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.085+0000 7f432808f740 1 -- 172.21.15.2:0/885166258 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56182d091d00 con 0x56182d1ab4c0 2024-09-19T04:58:30.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.085+0000 7f431effd640 1 --2- 172.21.15.2:0/885166258 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56182d1ab4c0 0x56182d1ad8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:30.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.085+0000 7f431effd640 1 --2- 172.21.15.2:0/885166258 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56182d1ab4c0 0x56182d1ad8e0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47f99f0b0a8bea9b server_cookie=37fafe2b1e9e3626 in_seq=0 out_seq=0 2024-09-19T04:58:30.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.085+0000 7f42feffd640 10 client.25969 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:58:30.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.086+0000 7f42feffd640 1 -- 172.21.15.2:0/885166258 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56182d091d00 con 0x56182d1ab4c0 2024-09-19T04:58:30.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.086+0000 7f42feffd640 10 client.25969 handle_command_reply: tid=0 2024-09-19T04:58:30.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.086+0000 7f432808f740 1 client.25969 shutdown 2024-09-19T04:58:30.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.087+0000 7f432808f740 1 -- 172.21.15.2:0/885166258 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56182d124b60 msgr2=0x56182d137ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:30.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.087+0000 7f432808f740 1 --2- 172.21.15.2:0/885166258 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56182d124b60 0x56182d137ec0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f431000bcb0 tx=0x7f4310005c50 comp rx=0 tx=0).stop 2024-09-19T04:58:30.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.087+0000 7f432808f740 1 -- 172.21.15.2:0/885166258 shutdown_connections 2024-09-19T04:58:30.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.087+0000 7f432808f740 1 --2- 172.21.15.2:0/885166258 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56182d12fd40 0x56182d134cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:30.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.087+0000 7f432808f740 1 --2- 172.21.15.2:0/885166258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56182d125480 0x56182d138400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:30.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.087+0000 7f432808f740 1 --2- 172.21.15.2:0/885166258 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56182d1ab4c0 0x56182d1ad8e0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:30.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.087+0000 7f432808f740 1 --2- 172.21.15.2:0/885166258 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56182d124b60 0x56182d137ec0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:30.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.087+0000 7f432808f740 1 -- 172.21.15.2:0/885166258 >> 172.21.15.2:0/885166258 conn(0x56182d1210f0 msgr2=0x56182d126dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:58:30.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.087+0000 7f42feffd640 0 client.25969 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:58:30.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.087+0000 7f432808f740 1 -- 172.21.15.2:0/885166258 shutdown_connections 2024-09-19T04:58:30.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.087+0000 7f432808f740 1 -- 172.21.15.2:0/885166258 wait complete. 2024-09-19T04:58:30.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.087+0000 7f432808f740 20 client.25969 trim_cache size 0 max 16384 2024-09-19T04:58:30.103 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:58:30.103 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T04:58:30.103 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "532aeffa-2c10-4315-8239-d69140e66799", 2024-09-19T04:58:30.103 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T04:58:30.103 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:58:30.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.087+0000 7f4325cb6640 1 -- 172.21.15.2:0/804281083 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f43080a3430 msgr2=0x7f43080a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:30.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.087+0000 7f4325cb6640 1 --2- 172.21.15.2:0/804281083 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f43080a3430 0x7f43080a58f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4318004af0 tx=0x7f4318004a60 comp rx=0 tx=0).stop 2024-09-19T04:58:30.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.087+0000 7f4325cb6640 1 -- 172.21.15.2:0/804281083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4320102790 msgr2=0x7f4320198880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:30.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.087+0000 7f4325cb6640 1 --2- 172.21.15.2:0/804281083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4320102790 0x7f4320198880 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f431400d770 tx=0x7f431400dc30 comp rx=0 tx=0).stop 2024-09-19T04:58:30.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.087+0000 7f4325cb6640 1 -- 172.21.15.2:0/804281083 shutdown_connections 2024-09-19T04:58:30.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.088+0000 7f4325cb6640 1 --2- 172.21.15.2:0/804281083 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4320106f10 0x7f432019cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:30.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.088+0000 7f4325cb6640 1 --2- 172.21.15.2:0/804281083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4320102790 0x7f4320198880 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:30.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.088+0000 7f4325cb6640 1 --2- 172.21.15.2:0/804281083 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f43080a3430 0x7f43080a58f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:30.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.088+0000 7f4325cb6640 1 --2- 172.21.15.2:0/804281083 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4320101de0 0x7f4320198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:30.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.088+0000 7f4325cb6640 1 -- 172.21.15.2:0/804281083 >> 172.21.15.2:0/804281083 conn(0x7f43200fd8c0 msgr2=0x7f43200fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:58:30.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.088+0000 7f4325cb6640 1 -- 172.21.15.2:0/804281083 shutdown_connections 2024-09-19T04:58:30.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:30.088+0000 7f4325cb6640 1 -- 172.21.15.2:0/804281083 wait complete. 2024-09-19T04:58:30.733 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:30 smithi002 ceph-mon[30975]: pgmap v326: 97 pgs: 97 active+clean; 21 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 55 KiB/s wr, 7 op/s 2024-09-19T04:58:30.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:30 smithi018 ceph-mon[34537]: pgmap v326: 97 pgs: 97 active+clean; 21 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 55 KiB/s wr, 7 op/s 2024-09-19T04:58:30.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:30 smithi116 ceph-mon[34477]: pgmap v326: 97 pgs: 97 active+clean; 21 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 55 KiB/s wr, 7 op/s 2024-09-19T04:58:31.045 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:58:31.305 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:58:31.692 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:31 smithi002 ceph-mon[30975]: scrub queued for path: / 2024-09-19T04:58:31.692 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:31 smithi002 ceph-mon[30975]: scrub summary: idle+waiting paths [/] 2024-09-19T04:58:31.692 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:31 smithi002 ceph-mon[30975]: scrub summary: active paths [/] 2024-09-19T04:58:31.692 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:31 smithi002 ceph-mon[30975]: scrub summary: idle+waiting paths [/] 2024-09-19T04:58:31.693 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:31 smithi002 ceph-mon[30975]: scrub summary: idle 2024-09-19T04:58:31.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.775+0000 7efebca3e640 1 -- 172.21.15.2:0/2010817357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efeb81008d0 msgr2=0x7efeb8100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:31.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.775+0000 7efebca3e640 1 --2- 172.21.15.2:0/2010817357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efeb81008d0 0x7efeb8100cb0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7efea8009900 tx=0x7efea802a410 comp rx=0 tx=0).stop 2024-09-19T04:58:31.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.775+0000 7efebca3e640 1 -- 172.21.15.2:0/2010817357 shutdown_connections 2024-09-19T04:58:31.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.775+0000 7efebca3e640 1 --2- 172.21.15.2:0/2010817357 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efeb810e480 0x7efeb8110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:31.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.775+0000 7efebca3e640 1 --2- 172.21.15.2:0/2010817357 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efeb8101280 0x7efeb810df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:31.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.775+0000 7efebca3e640 1 --2- 172.21.15.2:0/2010817357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efeb81008d0 0x7efeb8100cb0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:31.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.775+0000 7efebca3e640 1 -- 172.21.15.2:0/2010817357 >> 172.21.15.2:0/2010817357 conn(0x7efeb80fc7a0 msgr2=0x7efeb80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:58:31.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.775+0000 7efebca3e640 1 -- 172.21.15.2:0/2010817357 shutdown_connections 2024-09-19T04:58:31.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.775+0000 7efebca3e640 1 -- 172.21.15.2:0/2010817357 wait complete. 2024-09-19T04:58:31.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.776+0000 7efebca3e640 1 Processor -- start 2024-09-19T04:58:31.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.776+0000 7efebca3e640 1 -- start start 2024-09-19T04:58:31.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.776+0000 7efebca3e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efeb81008d0 0x7efeb819a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:31.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.776+0000 7efebca3e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efeb8101280 0x7efeb819aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:31.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.776+0000 7efebca3e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efeb810e480 0x7efeb819ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:31.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.776+0000 7efebca3e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efeb81140a0 con 0x7efeb8101280 2024-09-19T04:58:31.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.776+0000 7efebca3e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efeb8113f20 con 0x7efeb81008d0 2024-09-19T04:58:31.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.776+0000 7efebca3e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7efeb8114220 con 0x7efeb810e480 2024-09-19T04:58:31.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.776+0000 7efeaffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efeb8101280 0x7efeb819aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:31.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.776+0000 7efeaffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efeb8101280 0x7efeb819aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44272/0 (socket says 172.21.15.2:44272) 2024-09-19T04:58:31.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.776+0000 7efeaffff640 1 -- 172.21.15.2:0/1384126631 learned_addr learned my addr 172.21.15.2:0/1384126631 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:58:31.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.777+0000 7efeb6d9d640 1 --2- 172.21.15.2:0/1384126631 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efeb810e480 0x7efeb819ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:31.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.777+0000 7efeb659c640 1 --2- 172.21.15.2:0/1384126631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efeb81008d0 0x7efeb819a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:31.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.777+0000 7efeaffff640 1 -- 172.21.15.2:0/1384126631 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efeb810e480 msgr2=0x7efeb819ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:31.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.777+0000 7efeaffff640 1 --2- 172.21.15.2:0/1384126631 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efeb810e480 0x7efeb819ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:31.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.777+0000 7efeaffff640 1 -- 172.21.15.2:0/1384126631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efeb81008d0 msgr2=0x7efeb819a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:31.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.777+0000 7efeaffff640 1 --2- 172.21.15.2:0/1384126631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efeb81008d0 0x7efeb819a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:31.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.777+0000 7efeaffff640 1 -- 172.21.15.2:0/1384126631 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeb819f530 con 0x7efeb8101280 2024-09-19T04:58:31.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.777+0000 7efeaffff640 1 --2- 172.21.15.2:0/1384126631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efeb8101280 0x7efeb819aac0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7efea000c920 tx=0x7efea000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:58:31.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.777+0000 7efeaf7fe640 1 -- 172.21.15.2:0/1384126631 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea0007c70 con 0x7efeb8101280 2024-09-19T04:58:31.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.777+0000 7efebca3e640 1 -- 172.21.15.2:0/1384126631 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efeb819f820 con 0x7efeb8101280 2024-09-19T04:58:31.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.777+0000 7efeaf7fe640 1 -- 172.21.15.2:0/1384126631 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efea0007e10 con 0x7efeb8101280 2024-09-19T04:58:31.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.777+0000 7efeaf7fe640 1 -- 172.21.15.2:0/1384126631 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea0018820 con 0x7efeb8101280 2024-09-19T04:58:31.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.777+0000 7efebca3e640 1 -- 172.21.15.2:0/1384126631 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efeb81a7100 con 0x7efeb8101280 2024-09-19T04:58:31.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.779+0000 7efeaf7fe640 1 -- 172.21.15.2:0/1384126631 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7efea00189c0 con 0x7efeb8101280 2024-09-19T04:58:31.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.780+0000 7efebee17740 1 Processor -- start 2024-09-19T04:58:31.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.780+0000 7efebee17740 1 -- start start 2024-09-19T04:58:31.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.780+0000 7efebee17740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c52ef3f4a0 0x55c52ef3f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:31.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.780+0000 7efebee17740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c52ef3fdc0 0x55c52ef4a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:31.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.780+0000 7efebee17740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c52ef4a680 0x55c52ef4ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:31.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.780+0000 7efebee17740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c52eea52e0 con 0x55c52ef4a680 2024-09-19T04:58:31.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.780+0000 7efebee17740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c52ee4cce0 con 0x55c52ef3fdc0 2024-09-19T04:58:31.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.780+0000 7efebee17740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55c52eea12a0 con 0x55c52ef3f4a0 2024-09-19T04:58:31.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.780+0000 7efeaf7fe640 1 --2- 172.21.15.2:0/1384126631 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7efea40a33b0 0x7efea40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:31.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.780+0000 7efeaffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c52ef4a680 0x55c52ef4ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:31.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.781+0000 7efeb6d9d640 1 --2- 172.21.15.2:0/1384126631 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7efea40a33b0 0x7efea40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:31.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.781+0000 7efeaffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c52ef4a680 0x55c52ef4ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44286/0 (socket says 172.21.15.2:44286) 2024-09-19T04:58:31.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.781+0000 7efeaffff640 1 -- 172.21.15.2:0/3412837212 learned_addr learned my addr 172.21.15.2:0/3412837212 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:58:31.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.781+0000 7efeb6d9d640 1 --2- 172.21.15.2:0/3412837212 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c52ef3f4a0 0x55c52ef3f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:31.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.781+0000 7efeb659c640 1 --2- 172.21.15.2:0/3412837212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c52ef3fdc0 0x55c52ef4a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:31.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.781+0000 7efeaf7fe640 1 -- 172.21.15.2:0/1384126631 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7efea00cffa0 con 0x7efeb8101280 2024-09-19T04:58:31.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.781+0000 7efeaffff640 1 -- 172.21.15.2:0/3412837212 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c52ef3f4a0 msgr2=0x55c52ef3f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:31.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.781+0000 7efeaffff640 1 --2- 172.21.15.2:0/3412837212 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c52ef3f4a0 0x55c52ef3f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:31.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.781+0000 7efeaffff640 1 -- 172.21.15.2:0/3412837212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c52ef3fdc0 msgr2=0x55c52ef4a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:31.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.781+0000 7efeaffff640 1 --2- 172.21.15.2:0/3412837212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c52ef3fdc0 0x55c52ef4a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:31.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.781+0000 7efeaffff640 1 -- 172.21.15.2:0/3412837212 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c52ee31440 con 0x55c52ef4a680 2024-09-19T04:58:31.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.781+0000 7efeb659c640 1 --2- 172.21.15.2:0/3412837212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c52ef3fdc0 0x55c52ef4a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:58:31.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.781+0000 7efeb6d9d640 1 --2- 172.21.15.2:0/1384126631 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7efea40a33b0 0x7efea40a5870 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efeb0009fd0 tx=0x7efeb0009d60 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:58:31.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.781+0000 7efeaffff640 1 --2- 172.21.15.2:0/3412837212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c52ef4a680 0x55c52ef4ca70 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7efea0098680 tx=0x7efea009be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58b1c0bf1904d5c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:58:31.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.781+0000 7efeacff9640 1 -- 172.21.15.2:0/3412837212 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea00bae60 con 0x55c52ef4a680 2024-09-19T04:58:31.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.781+0000 7efeacff9640 1 -- 172.21.15.2:0/3412837212 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efea009c920 con 0x55c52ef4a680 2024-09-19T04:58:31.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.781+0000 7efeacff9640 1 -- 172.21.15.2:0/3412837212 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea0098890 con 0x55c52ef4a680 2024-09-19T04:58:31.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.782+0000 7efebee17740 1 -- 172.21.15.2:0/3412837212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c52ef4a680 msgr2=0x55c52ef4ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:31.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.782+0000 7efebee17740 1 --2- 172.21.15.2:0/3412837212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c52ef4a680 0x55c52ef4ca70 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7efea0098680 tx=0x7efea009be90 comp rx=0 tx=0).stop 2024-09-19T04:58:31.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.782+0000 7efebee17740 1 -- 172.21.15.2:0/3412837212 shutdown_connections 2024-09-19T04:58:31.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.782+0000 7efebee17740 1 --2- 172.21.15.2:0/3412837212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c52ef4a680 0x55c52ef4ca70 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:31.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.782+0000 7efebee17740 1 --2- 172.21.15.2:0/3412837212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c52ef3fdc0 0x55c52ef4a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:31.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.782+0000 7efebee17740 1 --2- 172.21.15.2:0/3412837212 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c52ef3f4a0 0x55c52ef3f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:31.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.782+0000 7efebee17740 1 -- 172.21.15.2:0/3412837212 >> 172.21.15.2:0/3412837212 conn(0x55c52ef3ba30 msgr2=0x55c52ef3be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:58:31.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.782+0000 7efebee17740 1 -- 172.21.15.2:0/3412837212 shutdown_connections 2024-09-19T04:58:31.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.782+0000 7efebee17740 1 -- 172.21.15.2:0/3412837212 wait complete. 2024-09-19T04:58:31.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.783+0000 7efebee17740 1 -- start start 2024-09-19T04:58:31.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.783+0000 7efebee17740 1 Processor -- start 2024-09-19T04:58:31.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.783+0000 7efebee17740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c52ef3f4a0 0x55c52ef4a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:31.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.783+0000 7efebee17740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c52ef3fdc0 0x55c52ef47340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:31.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.783+0000 7efebee17740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c52ef4a680 0x55c52ef479a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:31.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.783+0000 7efebee17740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c52ef4d250 con 0x55c52ef3f4a0 2024-09-19T04:58:31.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.783+0000 7efebee17740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c52ee60050 con 0x55c52ef4a680 2024-09-19T04:58:31.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.783+0000 7efebee17740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55c52ef4d3d0 con 0x55c52ef3fdc0 2024-09-19T04:58:31.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.783+0000 7efebee17740 10 client.0 _ll_register_callbacks cb 0x55c52eea0160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:58:31.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.783+0000 7efeb659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c52ef3f4a0 0x55c52ef4a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:31.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.783+0000 7efeb659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c52ef3f4a0 0x55c52ef4a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44292/0 (socket says 172.21.15.2:44292) 2024-09-19T04:58:31.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.783+0000 7efeb659c640 1 -- 172.21.15.2:0/3996038388 learned_addr learned my addr 172.21.15.2:0/3996038388 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:58:31.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.783+0000 7efeaffff640 1 --2- 172.21.15.2:0/3996038388 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c52ef3fdc0 0x55c52ef47340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:31.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.783+0000 7efeb6d9d640 1 --2- 172.21.15.2:0/3996038388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c52ef4a680 0x55c52ef479a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:31.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.783+0000 7efeb659c640 1 -- 172.21.15.2:0/3996038388 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c52ef3fdc0 msgr2=0x55c52ef47340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:31.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.783+0000 7efeb659c640 1 --2- 172.21.15.2:0/3996038388 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c52ef3fdc0 0x55c52ef47340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:31.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.783+0000 7efeb659c640 1 -- 172.21.15.2:0/3996038388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c52ef4a680 msgr2=0x55c52ef479a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:31.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.783+0000 7efeb659c640 1 --2- 172.21.15.2:0/3996038388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c52ef4a680 0x55c52ef479a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:31.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.783+0000 7efeb659c640 1 -- 172.21.15.2:0/3996038388 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c52ec163c0 con 0x55c52ef3f4a0 2024-09-19T04:58:31.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.783+0000 7efeaffff640 1 --2- 172.21.15.2:0/3996038388 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c52ef3fdc0 0x55c52ef47340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:58:31.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.784+0000 7efeb659c640 1 --2- 172.21.15.2:0/3996038388 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c52ef3f4a0 0x55c52ef4a040 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7efea8006010 tx=0x7efea8031750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9780363be6d2c84a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:58:31.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.784+0000 7efe9dffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:58:31.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.784+0000 7efe9dffb640 1 -- 172.21.15.2:0/3996038388 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea8035070 con 0x55c52ef3f4a0 2024-09-19T04:58:31.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.784+0000 7efe9dffb640 1 -- 172.21.15.2:0/3996038388 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7efea8004240 con 0x55c52ef3f4a0 2024-09-19T04:58:31.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.784+0000 7efebee17740 1 -- 172.21.15.2:0/3996038388 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efea009c920 con 0x55c52ef3f4a0 2024-09-19T04:58:31.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.784+0000 7efe9dffb640 1 -- 172.21.15.2:0/3996038388 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7efea8004440 con 0x55c52ef3f4a0 2024-09-19T04:58:31.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.784+0000 7efebee17740 10 client.16746 fetch_fsmap learned FSMap version 19 2024-09-19T04:58:31.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.784+0000 7efebee17740 1 -- 172.21.15.2:0/3996038388 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55c52ef58cb0 con 0x55c52ef3f4a0 2024-09-19T04:58:31.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.784+0000 7efe9dffb640 1 -- 172.21.15.2:0/3996038388 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efea009c920 con 0x55c52ef3f4a0 2024-09-19T04:58:31.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.784+0000 7efe9dffb640 1 -- 172.21.15.2:0/3996038388 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7efea8004bf0 con 0x55c52ef3f4a0 2024-09-19T04:58:31.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.784+0000 7efebee17740 10 client.16746 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:58:31.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.784+0000 7efebee17740 10 client.16746 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:58:31.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.785+0000 7efebee17740 20 client.16746 populate_metadata read hostname 'smithi002' 2024-09-19T04:58:31.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.785+0000 7efebee17740 1 --2- 172.21.15.2:0/3996038388 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55c52ef5a0c0 0x55c52ef5c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:31.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.785+0000 7efebee17740 4 client.16746 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:58:31.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.785+0000 7efebee17740 1 -- 172.21.15.2:0/3996038388 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c52eeb2850 con 0x55c52ef5a0c0 2024-09-19T04:58:31.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.785+0000 7efeaffff640 1 --2- 172.21.15.2:0/3996038388 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55c52ef5a0c0 0x55c52ef5c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:31.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.785+0000 7efeaffff640 1 --2- 172.21.15.2:0/3996038388 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55c52ef5a0c0 0x55c52ef5c510 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba04e5f54719e577 server_cookie=72479659aaa2ffd6 in_seq=0 out_seq=0 2024-09-19T04:58:31.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.785+0000 7efe9dffb640 10 client.16746 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:58:31.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.786+0000 7efe9dffb640 1 -- 172.21.15.2:0/3996038388 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c52eeb2850 con 0x55c52ef5a0c0 2024-09-19T04:58:31.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.786+0000 7efe9dffb640 10 client.16746 handle_command_reply: tid=0 2024-09-19T04:58:31.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.786+0000 7efebee17740 1 client.16746 shutdown 2024-09-19T04:58:31.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.786+0000 7efebee17740 1 -- 172.21.15.2:0/3996038388 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c52ef3f4a0 msgr2=0x55c52ef4a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:31.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.786+0000 7efebee17740 1 --2- 172.21.15.2:0/3996038388 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c52ef3f4a0 0x55c52ef4a040 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7efea8006010 tx=0x7efea8031750 comp rx=0 tx=0).stop 2024-09-19T04:58:31.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.786+0000 7efebee17740 1 -- 172.21.15.2:0/3996038388 shutdown_connections 2024-09-19T04:58:31.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.786+0000 7efebee17740 1 --2- 172.21.15.2:0/3996038388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c52ef4a680 0x55c52ef479a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:31.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.786+0000 7efebee17740 1 --2- 172.21.15.2:0/3996038388 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55c52ef5a0c0 0x55c52ef5c510 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:31.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.786+0000 7efebee17740 1 --2- 172.21.15.2:0/3996038388 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c52ef3fdc0 0x55c52ef47340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:31.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.786+0000 7efebee17740 1 --2- 172.21.15.2:0/3996038388 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c52ef3f4a0 0x55c52ef4a040 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:31.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.786+0000 7efe9dffb640 0 client.16746 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:58:31.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.786+0000 7efebee17740 1 -- 172.21.15.2:0/3996038388 >> 172.21.15.2:0/3996038388 conn(0x55c52ef3ba30 msgr2=0x55c52ef41760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:58:31.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.786+0000 7efebee17740 1 -- 172.21.15.2:0/3996038388 shutdown_connections 2024-09-19T04:58:31.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.787+0000 7efebee17740 1 -- 172.21.15.2:0/3996038388 wait complete. 2024-09-19T04:58:31.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.787+0000 7efebee17740 20 client.16746 trim_cache size 0 max 16384 2024-09-19T04:58:31.813 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:31 smithi018 ceph-mon[34537]: scrub queued for path: / 2024-09-19T04:58:31.814 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:31 smithi018 ceph-mon[34537]: scrub summary: idle+waiting paths [/] 2024-09-19T04:58:31.814 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:31 smithi018 ceph-mon[34537]: scrub summary: active paths [/] 2024-09-19T04:58:31.814 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:31 smithi018 ceph-mon[34537]: scrub summary: idle+waiting paths [/] 2024-09-19T04:58:31.814 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:31 smithi018 ceph-mon[34537]: scrub summary: idle 2024-09-19T04:58:31.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.804+0000 7efebee17740 1 Processor -- start 2024-09-19T04:58:31.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.804+0000 7efebee17740 1 -- start start 2024-09-19T04:58:31.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.804+0000 7efebee17740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c52ef3f4a0 0x55c52ef564b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:31.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.804+0000 7efebee17740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c52ef3fdc0 0x55c52ef61de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:31.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.804+0000 7efebee17740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c52ef4a680 0x55c52ef62320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:31.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.804+0000 7efebee17740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efeb81ad960 con 0x55c52ef4a680 2024-09-19T04:58:31.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.804+0000 7efebee17740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efeb81b01c0 con 0x55c52ef3fdc0 2024-09-19T04:58:31.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.804+0000 7efebee17740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7efeb81adfb0 con 0x55c52ef3f4a0 2024-09-19T04:58:31.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.804+0000 7efeb6d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c52ef4a680 0x55c52ef62320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:31.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.804+0000 7efeb6d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c52ef4a680 0x55c52ef62320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44300/0 (socket says 172.21.15.2:44300) 2024-09-19T04:58:31.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.804+0000 7efeb6d9d640 1 -- 172.21.15.2:0/3438545093 learned_addr learned my addr 172.21.15.2:0/3438545093 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:58:31.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.804+0000 7efeb6d9d640 1 -- 172.21.15.2:0/3438545093 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c52ef3f4a0 msgr2=0x55c52ef564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:31.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.804+0000 7efeb659c640 1 --2- 172.21.15.2:0/3438545093 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c52ef3f4a0 0x55c52ef564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:31.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.804+0000 7efeaffff640 1 --2- 172.21.15.2:0/3438545093 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c52ef3fdc0 0x55c52ef61de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:31.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.804+0000 7efeb6d9d640 1 --2- 172.21.15.2:0/3438545093 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c52ef3f4a0 0x55c52ef564b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:31.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.804+0000 7efeb6d9d640 1 -- 172.21.15.2:0/3438545093 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c52ef3fdc0 msgr2=0x55c52ef61de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:31.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.804+0000 7efeb6d9d640 1 --2- 172.21.15.2:0/3438545093 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c52ef3fdc0 0x55c52ef61de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:31.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.804+0000 7efeb6d9d640 1 -- 172.21.15.2:0/3438545093 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c52ef47d10 con 0x55c52ef4a680 2024-09-19T04:58:31.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.804+0000 7efeb6d9d640 1 --2- 172.21.15.2:0/3438545093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c52ef4a680 0x55c52ef62320 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7efeb000a5f0 tx=0x7efeb001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae6b378d48a3d01 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:58:31.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.805+0000 7efe9ffff640 1 -- 172.21.15.2:0/3438545093 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb001f050 con 0x55c52ef4a680 2024-09-19T04:58:31.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.805+0000 7efe9ffff640 1 -- 172.21.15.2:0/3438545093 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efeb0029070 con 0x55c52ef4a680 2024-09-19T04:58:31.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.805+0000 7efe9ffff640 1 -- 172.21.15.2:0/3438545093 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb0013040 con 0x55c52ef4a680 2024-09-19T04:58:31.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.805+0000 7efebee17740 1 -- 172.21.15.2:0/3438545093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c52ef4a680 msgr2=0x55c52ef62320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:31.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.805+0000 7efebee17740 1 --2- 172.21.15.2:0/3438545093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c52ef4a680 0x55c52ef62320 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7efeb000a5f0 tx=0x7efeb001a000 comp rx=0 tx=0).stop 2024-09-19T04:58:31.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.805+0000 7efebee17740 1 -- 172.21.15.2:0/3438545093 shutdown_connections 2024-09-19T04:58:31.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.805+0000 7efebee17740 1 --2- 172.21.15.2:0/3438545093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c52ef4a680 0x55c52ef62320 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:31.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.805+0000 7efebee17740 1 --2- 172.21.15.2:0/3438545093 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c52ef3fdc0 0x55c52ef61de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:31.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.805+0000 7efebee17740 1 --2- 172.21.15.2:0/3438545093 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c52ef3f4a0 0x55c52ef564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:31.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.805+0000 7efebee17740 1 -- 172.21.15.2:0/3438545093 >> 172.21.15.2:0/3438545093 conn(0x55c52ef3ba30 msgr2=0x55c52ef46430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:58:31.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.805+0000 7efebee17740 1 -- 172.21.15.2:0/3438545093 shutdown_connections 2024-09-19T04:58:31.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.805+0000 7efebee17740 1 -- 172.21.15.2:0/3438545093 wait complete. 2024-09-19T04:58:31.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.806+0000 7efebee17740 1 -- start start 2024-09-19T04:58:31.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.806+0000 7efebee17740 1 Processor -- start 2024-09-19T04:58:31.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.806+0000 7efebee17740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c52ef3f4a0 0x55c52ef52dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:31.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.806+0000 7efebee17740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c52ef3fdc0 0x55c52ef44070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:31.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.806+0000 7efebee17740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c52ef4a680 0x55c52ef445b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:31.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.806+0000 7efebee17740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efeb81ae680 con 0x55c52ef3f4a0 2024-09-19T04:58:31.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.806+0000 7efebee17740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efeb81afaf0 con 0x55c52ef3fdc0 2024-09-19T04:58:31.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.806+0000 7efebee17740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7efeb81aed50 con 0x55c52ef4a680 2024-09-19T04:58:31.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.806+0000 7efebee17740 10 client.0 _ll_register_callbacks cb 0x7efea8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:58:31.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.806+0000 7efeb659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c52ef3f4a0 0x55c52ef52dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:31.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.806+0000 7efeb659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c52ef3f4a0 0x55c52ef52dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44306/0 (socket says 172.21.15.2:44306) 2024-09-19T04:58:31.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.806+0000 7efeb659c640 1 -- 172.21.15.2:0/1542273514 learned_addr learned my addr 172.21.15.2:0/1542273514 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:58:31.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.807+0000 7efeb6d9d640 1 --2- 172.21.15.2:0/1542273514 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c52ef4a680 0x55c52ef445b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:31.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.807+0000 7efeaffff640 1 --2- 172.21.15.2:0/1542273514 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c52ef3fdc0 0x55c52ef44070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:31.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.807+0000 7efeb659c640 1 -- 172.21.15.2:0/1542273514 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c52ef4a680 msgr2=0x55c52ef445b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:31.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.807+0000 7efeb659c640 1 --2- 172.21.15.2:0/1542273514 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c52ef4a680 0x55c52ef445b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:31.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.807+0000 7efeb659c640 1 -- 172.21.15.2:0/1542273514 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c52ef3fdc0 msgr2=0x55c52ef44070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:31.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.807+0000 7efeb659c640 1 --2- 172.21.15.2:0/1542273514 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c52ef3fdc0 0x55c52ef44070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:31.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.807+0000 7efeb659c640 1 -- 172.21.15.2:0/1542273514 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c52ef3fbf0 con 0x55c52ef3f4a0 2024-09-19T04:58:31.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.807+0000 7efeb659c640 1 --2- 172.21.15.2:0/1542273514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c52ef3f4a0 0x55c52ef52dc0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7efea8031440 tx=0x7efea80095b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3059d687f2fb4b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:58:31.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.807+0000 7efe9dffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:58:31.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.807+0000 7efe9dffb640 1 -- 172.21.15.2:0/1542273514 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea8035050 con 0x55c52ef3f4a0 2024-09-19T04:58:31.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.807+0000 7efe9dffb640 1 -- 172.21.15.2:0/1542273514 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7efea8005cb0 con 0x55c52ef3f4a0 2024-09-19T04:58:31.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.807+0000 7efebee17740 1 -- 172.21.15.2:0/1542273514 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efeb0029070 con 0x55c52ef3f4a0 2024-09-19T04:58:31.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.807+0000 7efe9dffb640 1 -- 172.21.15.2:0/1542273514 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7efea805e050 con 0x55c52ef3f4a0 2024-09-19T04:58:31.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.807+0000 7efebee17740 10 client.16752 fetch_fsmap learned FSMap version 19 2024-09-19T04:58:31.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.807+0000 7efebee17740 1 -- 172.21.15.2:0/1542273514 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55c52efc4bc0 con 0x55c52ef3f4a0 2024-09-19T04:58:31.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.807+0000 7efe9dffb640 1 -- 172.21.15.2:0/1542273514 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efeb0029070 con 0x55c52ef3f4a0 2024-09-19T04:58:31.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.808+0000 7efe9dffb640 1 -- 172.21.15.2:0/1542273514 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7efea80047a0 con 0x55c52ef3f4a0 2024-09-19T04:58:31.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.808+0000 7efebee17740 10 client.16752 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:58:31.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.808+0000 7efebee17740 10 client.16752 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:58:31.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.808+0000 7efebee17740 20 client.16752 populate_metadata read hostname 'smithi002' 2024-09-19T04:58:31.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.808+0000 7efebee17740 1 --2- 172.21.15.2:0/1542273514 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55c52efc5310 0x55c52efc7730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:31.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.808+0000 7efebee17740 4 client.16752 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:58:31.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.808+0000 7efebee17740 1 -- 172.21.15.2:0/1542273514 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c52eeacd60 con 0x55c52efc5310 2024-09-19T04:58:31.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.808+0000 7efeaffff640 1 --2- 172.21.15.2:0/1542273514 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55c52efc5310 0x55c52efc7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:31.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.808+0000 7efeaffff640 1 --2- 172.21.15.2:0/1542273514 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55c52efc5310 0x55c52efc7730 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa93ad25004dcedc server_cookie=49d1f16a453a58f5 in_seq=0 out_seq=0 2024-09-19T04:58:31.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.808+0000 7efe9dffb640 10 client.16752 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:58:31.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.809+0000 7efe9dffb640 1 -- 172.21.15.2:0/1542273514 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55c52eeacd60 con 0x55c52efc5310 2024-09-19T04:58:31.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.809+0000 7efe9dffb640 10 client.16752 handle_command_reply: tid=0 2024-09-19T04:58:31.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.809+0000 7efebee17740 1 client.16752 shutdown 2024-09-19T04:58:31.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.809+0000 7efebee17740 1 -- 172.21.15.2:0/1542273514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c52ef3f4a0 msgr2=0x55c52ef52dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:31.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.809+0000 7efebee17740 1 --2- 172.21.15.2:0/1542273514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c52ef3f4a0 0x55c52ef52dc0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7efea8031440 tx=0x7efea80095b0 comp rx=0 tx=0).stop 2024-09-19T04:58:31.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.809+0000 7efebee17740 1 -- 172.21.15.2:0/1542273514 shutdown_connections 2024-09-19T04:58:31.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.809+0000 7efebee17740 1 --2- 172.21.15.2:0/1542273514 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55c52efc5310 0x55c52efc7730 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:31.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.809+0000 7efebee17740 1 --2- 172.21.15.2:0/1542273514 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c52ef4a680 0x55c52ef445b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:31.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.809+0000 7efebee17740 1 --2- 172.21.15.2:0/1542273514 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c52ef3fdc0 0x55c52ef44070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:31.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.809+0000 7efebee17740 1 --2- 172.21.15.2:0/1542273514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c52ef3f4a0 0x55c52ef52dc0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:31.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.809+0000 7efebee17740 1 -- 172.21.15.2:0/1542273514 >> 172.21.15.2:0/1542273514 conn(0x55c52ef3ba30 msgr2=0x55c52ef40ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:58:31.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.809+0000 7efe9dffb640 0 client.16752 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:58:31.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.809+0000 7efebee17740 1 -- 172.21.15.2:0/1542273514 shutdown_connections 2024-09-19T04:58:31.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.809+0000 7efebee17740 1 -- 172.21.15.2:0/1542273514 wait complete. 2024-09-19T04:58:31.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.809+0000 7efebee17740 20 client.16752 trim_cache size 0 max 16384 2024-09-19T04:58:31.829 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:58:31.829 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T04:58:31.829 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T04:58:31.829 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:58:31.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.809+0000 7efebca3e640 1 -- 172.21.15.2:0/1384126631 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7efea40a33b0 msgr2=0x7efea40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:31.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.809+0000 7efebca3e640 1 --2- 172.21.15.2:0/1384126631 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7efea40a33b0 0x7efea40a5870 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efeb0009fd0 tx=0x7efeb0009d60 comp rx=0 tx=0).stop 2024-09-19T04:58:31.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.809+0000 7efebca3e640 1 -- 172.21.15.2:0/1384126631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efeb8101280 msgr2=0x7efeb819aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:31.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.809+0000 7efebca3e640 1 --2- 172.21.15.2:0/1384126631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efeb8101280 0x7efeb819aac0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7efea000c920 tx=0x7efea000cde0 comp rx=0 tx=0).stop 2024-09-19T04:58:31.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.810+0000 7efebca3e640 1 -- 172.21.15.2:0/1384126631 shutdown_connections 2024-09-19T04:58:31.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.810+0000 7efebca3e640 1 --2- 172.21.15.2:0/1384126631 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7efea40a33b0 0x7efea40a5870 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:31.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.810+0000 7efebca3e640 1 --2- 172.21.15.2:0/1384126631 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efeb810e480 0x7efeb819ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:31.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.810+0000 7efebca3e640 1 --2- 172.21.15.2:0/1384126631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efeb8101280 0x7efeb819aac0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:31.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.810+0000 7efebca3e640 1 --2- 172.21.15.2:0/1384126631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efeb81008d0 0x7efeb819a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:31.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.810+0000 7efebca3e640 1 -- 172.21.15.2:0/1384126631 >> 172.21.15.2:0/1384126631 conn(0x7efeb80fc7a0 msgr2=0x7efeb80feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:58:31.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.810+0000 7efebca3e640 1 -- 172.21.15.2:0/1384126631 shutdown_connections 2024-09-19T04:58:31.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:31.810+0000 7efebca3e640 1 -- 172.21.15.2:0/1384126631 wait complete. 2024-09-19T04:58:31.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:31 smithi116 ceph-mon[34477]: scrub queued for path: / 2024-09-19T04:58:31.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:31 smithi116 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-19T04:58:31.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:31 smithi116 ceph-mon[34477]: scrub summary: active paths [/] 2024-09-19T04:58:31.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:31 smithi116 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-19T04:58:31.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:31 smithi116 ceph-mon[34477]: scrub summary: idle 2024-09-19T04:58:32.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:32 smithi018 ceph-mon[34537]: pgmap v327: 97 pgs: 97 active+clean; 21 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 80 KiB/s wr, 10 op/s 2024-09-19T04:58:32.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:32 smithi002 ceph-mon[30975]: pgmap v327: 97 pgs: 97 active+clean; 21 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 80 KiB/s wr, 10 op/s 2024-09-19T04:58:32.801 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:58:32.801 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:58:32.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:32 smithi116 ceph-mon[34477]: pgmap v327: 97 pgs: 97 active+clean; 21 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 80 KiB/s wr, 10 op/s 2024-09-19T04:58:33.066 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:58:33.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.641+0000 7f31c334a640 1 -- 172.21.15.2:0/2072260677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31bc1037a0 msgr2=0x7f31bc10bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:33.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.641+0000 7f31c334a640 1 --2- 172.21.15.2:0/2072260677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31bc1037a0 0x7f31bc10bc00 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f31ac009900 tx=0x7f31ac02a410 comp rx=0 tx=0).stop 2024-09-19T04:58:33.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.641+0000 7f31c334a640 1 -- 172.21.15.2:0/2072260677 shutdown_connections 2024-09-19T04:58:33.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.641+0000 7f31c334a640 1 --2- 172.21.15.2:0/2072260677 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f31bc10c2f0 0x7f31bc10e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:33.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.641+0000 7f31c334a640 1 --2- 172.21.15.2:0/2072260677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31bc1037a0 0x7f31bc10bc00 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:33.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.641+0000 7f31c334a640 1 --2- 172.21.15.2:0/2072260677 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31bc102df0 0x7f31bc1031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:33.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.641+0000 7f31c334a640 1 -- 172.21.15.2:0/2072260677 >> 172.21.15.2:0/2072260677 conn(0x7f31bc0fc7d0 msgr2=0x7f31bc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:58:33.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.641+0000 7f31c334a640 1 -- 172.21.15.2:0/2072260677 shutdown_connections 2024-09-19T04:58:33.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.641+0000 7f31c334a640 1 -- 172.21.15.2:0/2072260677 wait complete. 2024-09-19T04:58:33.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.642+0000 7f31c334a640 1 Processor -- start 2024-09-19T04:58:33.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.642+0000 7f31c334a640 1 -- start start 2024-09-19T04:58:33.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.642+0000 7f31c334a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31bc102df0 0x7f31bc100a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:33.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.642+0000 7f31c334a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31bc1037a0 0x7f31bc100f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:33.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.642+0000 7f31c334a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f31bc10c2f0 0x7f31bc1014d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:33.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.642+0000 7f31c334a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f31bc111f80 con 0x7f31bc1037a0 2024-09-19T04:58:33.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.642+0000 7f31c334a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f31bc111e00 con 0x7f31bc102df0 2024-09-19T04:58:33.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.642+0000 7f31c334a640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f31bc112100 con 0x7f31bc10c2f0 2024-09-19T04:58:33.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.642+0000 7f31c08e5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31bc1037a0 0x7f31bc100f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:33.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.642+0000 7f31c08e5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31bc1037a0 0x7f31bc100f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44324/0 (socket says 172.21.15.2:44324) 2024-09-19T04:58:33.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.642+0000 7f31c08e5640 1 -- 172.21.15.2:0/2014786714 learned_addr learned my addr 172.21.15.2:0/2014786714 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:58:33.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.642+0000 7f31c10e6640 1 --2- 172.21.15.2:0/2014786714 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31bc102df0 0x7f31bc100a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:33.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.642+0000 7f31c18e7640 1 --2- 172.21.15.2:0/2014786714 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f31bc10c2f0 0x7f31bc1014d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:33.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.643+0000 7f31c08e5640 1 -- 172.21.15.2:0/2014786714 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f31bc10c2f0 msgr2=0x7f31bc1014d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:33.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.643+0000 7f31c08e5640 1 --2- 172.21.15.2:0/2014786714 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f31bc10c2f0 0x7f31bc1014d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:33.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.643+0000 7f31c08e5640 1 -- 172.21.15.2:0/2014786714 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31bc102df0 msgr2=0x7f31bc100a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:33.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.643+0000 7f31c08e5640 1 --2- 172.21.15.2:0/2014786714 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31bc102df0 0x7f31bc100a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:33.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.643+0000 7f31c08e5640 1 -- 172.21.15.2:0/2014786714 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31bc1a6a40 con 0x7f31bc1037a0 2024-09-19T04:58:33.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.643+0000 7f31c08e5640 1 --2- 172.21.15.2:0/2014786714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31bc1037a0 0x7f31bc100f90 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f31ac02a930 tx=0x7f31ac004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:58:33.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.643+0000 7f31b27fc640 1 -- 172.21.15.2:0/2014786714 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31ac03f030 con 0x7f31bc1037a0 2024-09-19T04:58:33.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.643+0000 7f31b27fc640 1 -- 172.21.15.2:0/2014786714 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f31ac003aa0 con 0x7f31bc1037a0 2024-09-19T04:58:33.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.643+0000 7f31c334a640 1 -- 172.21.15.2:0/2014786714 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31bc1a6cd0 con 0x7f31bc1037a0 2024-09-19T04:58:33.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.643+0000 7f31b27fc640 1 -- 172.21.15.2:0/2014786714 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31ac035070 con 0x7f31bc1037a0 2024-09-19T04:58:33.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.643+0000 7f31c334a640 1 -- 172.21.15.2:0/2014786714 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31bc1a71b0 con 0x7f31bc1037a0 2024-09-19T04:58:33.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.644+0000 7f31c334a640 1 -- 172.21.15.2:0/2014786714 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31bc1031d0 con 0x7f31bc1037a0 2024-09-19T04:58:33.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.645+0000 7f31b27fc640 1 -- 172.21.15.2:0/2014786714 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f31ac042030 con 0x7f31bc1037a0 2024-09-19T04:58:33.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.646+0000 7f31b27fc640 1 --2- 172.21.15.2:0/2014786714 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f31a80a33b0 0x7f31a80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:33.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.646+0000 7f31c10e6640 1 --2- 172.21.15.2:0/2014786714 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f31a80a33b0 0x7f31a80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:33.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.646+0000 7f31b27fc640 1 -- 172.21.15.2:0/2014786714 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f31ac0f0450 con 0x7f31bc1037a0 2024-09-19T04:58:33.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.646+0000 7f31c10e6640 1 --2- 172.21.15.2:0/2014786714 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f31a80a33b0 0x7f31a80a5870 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f31b800bbe0 tx=0x7f31b800b390 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:58:33.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.649+0000 7f31b27fc640 1 -- 172.21.15.2:0/2014786714 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f31ac0bc7e0 con 0x7f31bc1037a0 2024-09-19T04:58:33.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.858+0000 7f31c334a640 1 -- 172.21.15.2:0/2014786714 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f31bc1072c0 con 0x7f31bc1037a0 2024-09-19T04:58:33.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.859+0000 7f31b27fc640 1 -- 172.21.15.2:0/2014786714 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11840 (secure 0 0 0) 0x7f31ac0c0ae0 con 0x7f31bc1037a0 2024-09-19T04:58:33.861 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:58:33.861 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":19,"btime":"2024-09-19T04:46:33:537239+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2467365137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2467365137},{"type":"v1","addr":"172.21.15.2:6835","nonce":2467365137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3162441888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3162441888},{"type":"v1","addr":"172.21.15.2:6837","nonce":3162441888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14631,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2740862966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2740862966},{"type":"v1","addr":"172.21.15.2:6839","nonce":2740862966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/2394435504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2394435504},{"type":"v1","addr":"172.21.15.2:6841","nonce":2394435504}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1630480244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1630480244},{"type":"v1","addr":"172.21.15.18:6833","nonce":1630480244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1553897465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1553897465},{"type":"v1","addr":"172.21.15.116:6833","nonce":1553897465}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3035664608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3035664608},{"type":"v1","addr":"172.21.15.18:6835","nonce":3035664608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1096622392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1096622392},{"type":"v1","addr":"172.21.15.18:6837","nonce":1096622392}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3761157675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3761157675},{"type":"v1","addr":"172.21.15.116:6835","nonce":3761157675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/1120131594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1120131594},{"type":"v1","addr":"172.21.15.116:6837","nonce":1120131594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:46:24.050115+0000","modified":"2024-09-19T04:46:33.112369+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/4207677139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":4207677139},{"type":"v1","addr":"172.21.15.18:6839","nonce":4207677139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/2346874880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":2346874880},{"type":"v1","addr":"172.21.15.116:6839","nonce":2346874880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496]},"id":1}]} 2024-09-19T04:58:33.861 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 19 2024-09-19T04:58:33.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.861+0000 7f31c334a640 1 -- 172.21.15.2:0/2014786714 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f31a80a33b0 msgr2=0x7f31a80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:33.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.861+0000 7f31c334a640 1 --2- 172.21.15.2:0/2014786714 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f31a80a33b0 0x7f31a80a5870 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f31b800bbe0 tx=0x7f31b800b390 comp rx=0 tx=0).stop 2024-09-19T04:58:33.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.861+0000 7f31c334a640 1 -- 172.21.15.2:0/2014786714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31bc1037a0 msgr2=0x7f31bc100f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:33.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.861+0000 7f31c334a640 1 --2- 172.21.15.2:0/2014786714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31bc1037a0 0x7f31bc100f90 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f31ac02a930 tx=0x7f31ac004040 comp rx=0 tx=0).stop 2024-09-19T04:58:33.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.861+0000 7f31c334a640 1 -- 172.21.15.2:0/2014786714 shutdown_connections 2024-09-19T04:58:33.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.861+0000 7f31c334a640 1 --2- 172.21.15.2:0/2014786714 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f31a80a33b0 0x7f31a80a5870 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:33.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.861+0000 7f31c334a640 1 --2- 172.21.15.2:0/2014786714 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f31bc10c2f0 0x7f31bc1014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:33.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.861+0000 7f31c334a640 1 --2- 172.21.15.2:0/2014786714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31bc1037a0 0x7f31bc100f90 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:33.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.861+0000 7f31c334a640 1 --2- 172.21.15.2:0/2014786714 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31bc102df0 0x7f31bc100a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:33.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.861+0000 7f31c334a640 1 -- 172.21.15.2:0/2014786714 >> 172.21.15.2:0/2014786714 conn(0x7f31bc0fc7d0 msgr2=0x7f31bc0fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:58:33.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.861+0000 7f31c334a640 1 -- 172.21.15.2:0/2014786714 shutdown_connections 2024-09-19T04:58:33.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:33.861+0000 7f31c334a640 1 -- 172.21.15.2:0/2014786714 wait complete. 2024-09-19T04:58:34.461 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:58:34.485 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:34 smithi002 ceph-mon[30975]: pgmap v328: 97 pgs: 97 active+clean; 21 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 55 KiB/s wr, 7 op/s 2024-09-19T04:58:34.485 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:34 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/2014786714' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:58:34.717 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:58:34.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:34 smithi018 ceph-mon[34537]: pgmap v328: 97 pgs: 97 active+clean; 21 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 55 KiB/s wr, 7 op/s 2024-09-19T04:58:34.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:34 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/2014786714' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:58:34.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:34 smithi116 ceph-mon[34477]: pgmap v328: 97 pgs: 97 active+clean; 21 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 55 KiB/s wr, 7 op/s 2024-09-19T04:58:34.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:34 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/2014786714' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:58:35.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.295+0000 7f3bca9ac640 1 -- 172.21.15.2:0/1459476554 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bc4106f10 msgr2=0x7f3bc410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:35.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.295+0000 7f3bca9ac640 1 --2- 172.21.15.2:0/1459476554 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bc4106f10 0x7f3bc410ea90 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc009ca0 tx=0x7f3bbc02a8c0 comp rx=0 tx=0).stop 2024-09-19T04:58:35.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.295+0000 7f3bca9ac640 1 -- 172.21.15.2:0/1459476554 shutdown_connections 2024-09-19T04:58:35.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.295+0000 7f3bca9ac640 1 --2- 172.21.15.2:0/1459476554 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bc4106f10 0x7f3bc410ea90 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:35.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.295+0000 7f3bca9ac640 1 --2- 172.21.15.2:0/1459476554 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bc4102790 0x7f3bc41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:35.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.295+0000 7f3bca9ac640 1 --2- 172.21.15.2:0/1459476554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3bc4101de0 0x7f3bc41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:35.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.295+0000 7f3bca9ac640 1 -- 172.21.15.2:0/1459476554 >> 172.21.15.2:0/1459476554 conn(0x7f3bc40fd8c0 msgr2=0x7f3bc40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:58:35.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.295+0000 7f3bca9ac640 1 -- 172.21.15.2:0/1459476554 shutdown_connections 2024-09-19T04:58:35.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.295+0000 7f3bca9ac640 1 -- 172.21.15.2:0/1459476554 wait complete. 2024-09-19T04:58:35.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.296+0000 7f3bca9ac640 1 Processor -- start 2024-09-19T04:58:35.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.296+0000 7f3bca9ac640 1 -- start start 2024-09-19T04:58:35.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.296+0000 7f3bca9ac640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3bc4101de0 0x7f3bc4198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:35.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.296+0000 7f3bca9ac640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bc4102790 0x7f3bc4198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:35.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.296+0000 7f3bca9ac640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bc4106f10 0x7f3bc419cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:35.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.296+0000 7f3bca9ac640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc4111e20 con 0x7f3bc4106f10 2024-09-19T04:58:35.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.296+0000 7f3bca9ac640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc4111ca0 con 0x7f3bc4101de0 2024-09-19T04:58:35.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.296+0000 7f3bca9ac640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc4111fa0 con 0x7f3bc4102790 2024-09-19T04:58:35.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.297+0000 7f3bc8f49640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bc4106f10 0x7f3bc419cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:35.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.297+0000 7f3bc8f49640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bc4106f10 0x7f3bc419cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44346/0 (socket says 172.21.15.2:44346) 2024-09-19T04:58:35.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.297+0000 7f3bc8f49640 1 -- 172.21.15.2:0/1142524782 learned_addr learned my addr 172.21.15.2:0/1142524782 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:58:35.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.297+0000 7f3bc3fff640 1 --2- 172.21.15.2:0/1142524782 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3bc4101de0 0x7f3bc4198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:35.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.297+0000 7f3bc37fe640 1 --2- 172.21.15.2:0/1142524782 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bc4102790 0x7f3bc4198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:35.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.297+0000 7f3bc8f49640 1 -- 172.21.15.2:0/1142524782 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bc4102790 msgr2=0x7f3bc4198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:35.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.297+0000 7f3bc8f49640 1 --2- 172.21.15.2:0/1142524782 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bc4102790 0x7f3bc4198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:35.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.297+0000 7f3bc8f49640 1 -- 172.21.15.2:0/1142524782 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3bc4101de0 msgr2=0x7f3bc4198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:35.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.297+0000 7f3bc8f49640 1 --2- 172.21.15.2:0/1142524782 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3bc4101de0 0x7f3bc4198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:35.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.297+0000 7f3bc8f49640 1 -- 172.21.15.2:0/1142524782 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bc419d2f0 con 0x7f3bc4106f10 2024-09-19T04:58:35.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.297+0000 7f3bc37fe640 1 --2- 172.21.15.2:0/1142524782 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bc4102790 0x7f3bc4198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:58:35.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.297+0000 7f3bc8f49640 1 --2- 172.21.15.2:0/1142524782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bc4106f10 0x7f3bc419cc10 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc009dc0 tx=0x7f3bbc032ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:58:35.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.297+0000 7f3bc17fa640 1 -- 172.21.15.2:0/1142524782 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc003cf0 con 0x7f3bc4106f10 2024-09-19T04:58:35.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.297+0000 7f3bc17fa640 1 -- 172.21.15.2:0/1142524782 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3bbc0044f0 con 0x7f3bc4106f10 2024-09-19T04:58:35.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.297+0000 7f3bca9ac640 1 -- 172.21.15.2:0/1142524782 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bc419d580 con 0x7f3bc4106f10 2024-09-19T04:58:35.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.297+0000 7f3bc17fa640 1 -- 172.21.15.2:0/1142524782 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc030bf0 con 0x7f3bc4106f10 2024-09-19T04:58:35.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.297+0000 7f3bca9ac640 1 -- 172.21.15.2:0/1142524782 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bc41a4ec0 con 0x7f3bc4106f10 2024-09-19T04:58:35.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.300+0000 7f3bccd85740 1 Processor -- start 2024-09-19T04:58:35.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.300+0000 7f3bc17fa640 1 -- 172.21.15.2:0/1142524782 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f3bbc004040 con 0x7f3bc4106f10 2024-09-19T04:58:35.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.301+0000 7f3bccd85740 1 -- start start 2024-09-19T04:58:35.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.301+0000 7f3bccd85740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56164ce42b40 0x56164ce41090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:35.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.301+0000 7f3bccd85740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56164ce415d0 0x56164ce41a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:35.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.301+0000 7f3bccd85740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56164ce50780 0x56164ce52b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:35.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.301+0000 7f3bccd85740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56164cda72f0 con 0x56164ce50780 2024-09-19T04:58:35.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.301+0000 7f3bccd85740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56164cd4ecf0 con 0x56164ce415d0 2024-09-19T04:58:35.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.301+0000 7f3bccd85740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x56164cda32b0 con 0x56164ce42b40 2024-09-19T04:58:35.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.301+0000 7f3bc37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56164ce50780 0x56164ce52b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:35.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.301+0000 7f3bc37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56164ce50780 0x56164ce52b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44350/0 (socket says 172.21.15.2:44350) 2024-09-19T04:58:35.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.301+0000 7f3bc37fe640 1 -- 172.21.15.2:0/3803869517 learned_addr learned my addr 172.21.15.2:0/3803869517 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:58:35.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.301+0000 7f3bc3fff640 1 --2- 172.21.15.2:0/3803869517 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56164ce415d0 0x56164ce41a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:35.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.301+0000 7f3bc37fe640 1 --2- 172.21.15.2:0/3803869517 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56164ce42b40 0x56164ce41090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:35.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.301+0000 7f3bc37fe640 1 -- 172.21.15.2:0/3803869517 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56164ce42b40 msgr2=0x56164ce41090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:35.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.301+0000 7f3bc37fe640 1 --2- 172.21.15.2:0/3803869517 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56164ce42b40 0x56164ce41090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:35.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.301+0000 7f3bc37fe640 1 -- 172.21.15.2:0/3803869517 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56164ce415d0 msgr2=0x56164ce41a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:35.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.301+0000 7f3bc37fe640 1 --2- 172.21.15.2:0/3803869517 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56164ce415d0 0x56164ce41a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:35.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.301+0000 7f3bc37fe640 1 -- 172.21.15.2:0/3803869517 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56164cd333a0 con 0x56164ce50780 2024-09-19T04:58:35.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.301+0000 7f3bc17fa640 1 --2- 172.21.15.2:0/1142524782 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f3bac0a3430 0x7f3bac0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:35.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.301+0000 7f3bc37fe640 1 --2- 172.21.15.2:0/3803869517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56164ce50780 0x56164ce52b70 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f3bb800f390 tx=0x7f3bb800d540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0bc5137f402eb42 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:58:35.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.302+0000 7f3bc3fff640 1 --2- 172.21.15.2:0/1142524782 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f3bac0a3430 0x7f3bac0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:35.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.302+0000 7f3bc17fa640 1 -- 172.21.15.2:0/1142524782 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f3bbc0f11f0 con 0x7f3bc4106f10 2024-09-19T04:58:35.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.302+0000 7f3baa7fc640 1 -- 172.21.15.2:0/3803869517 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb8012860 con 0x56164ce50780 2024-09-19T04:58:35.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.302+0000 7f3baa7fc640 1 -- 172.21.15.2:0/3803869517 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3bb8011440 con 0x56164ce50780 2024-09-19T04:58:35.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.302+0000 7f3baa7fc640 1 -- 172.21.15.2:0/3803869517 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb8010630 con 0x56164ce50780 2024-09-19T04:58:35.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.302+0000 7f3bccd85740 1 -- 172.21.15.2:0/3803869517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56164ce50780 msgr2=0x56164ce52b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:35.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.302+0000 7f3bc3fff640 1 --2- 172.21.15.2:0/1142524782 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f3bac0a3430 0x7f3bac0a58f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x56164ce3eac0 tx=0x7f3bb400b410 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:58:35.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.302+0000 7f3bccd85740 1 --2- 172.21.15.2:0/3803869517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56164ce50780 0x56164ce52b70 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f3bb800f390 tx=0x7f3bb800d540 comp rx=0 tx=0).stop 2024-09-19T04:58:35.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.302+0000 7f3bccd85740 1 -- 172.21.15.2:0/3803869517 shutdown_connections 2024-09-19T04:58:35.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.303+0000 7f3bccd85740 1 --2- 172.21.15.2:0/3803869517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56164ce50780 0x56164ce52b70 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:35.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.303+0000 7f3bccd85740 1 --2- 172.21.15.2:0/3803869517 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56164ce415d0 0x56164ce41a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:35.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.303+0000 7f3bccd85740 1 --2- 172.21.15.2:0/3803869517 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56164ce42b40 0x56164ce41090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:35.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.303+0000 7f3bccd85740 1 -- 172.21.15.2:0/3803869517 >> 172.21.15.2:0/3803869517 conn(0x56164ce0a310 msgr2=0x56164ce3dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:58:35.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.303+0000 7f3bccd85740 1 -- 172.21.15.2:0/3803869517 shutdown_connections 2024-09-19T04:58:35.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.303+0000 7f3bccd85740 1 -- 172.21.15.2:0/3803869517 wait complete. 2024-09-19T04:58:35.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.303+0000 7f3bccd85740 1 -- start start 2024-09-19T04:58:35.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.303+0000 7f3bccd85740 1 Processor -- start 2024-09-19T04:58:35.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.304+0000 7f3bccd85740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56164ce415d0 0x56164ce501d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:35.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.304+0000 7f3bccd85740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56164ce42b40 0x56164ce4d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:35.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.304+0000 7f3bccd85740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56164ce50780 0x56164ce4dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:35.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.304+0000 7f3bccd85740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56164ce53480 con 0x56164ce42b40 2024-09-19T04:58:35.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.304+0000 7f3bccd85740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56164cd62060 con 0x56164ce50780 2024-09-19T04:58:35.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.304+0000 7f3bccd85740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x56164ce53600 con 0x56164ce415d0 2024-09-19T04:58:35.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.304+0000 7f3bccd85740 10 client.0 _ll_register_callbacks cb 0x56164cab58c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:58:35.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.304+0000 7f3bc37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56164ce42b40 0x56164ce4d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:35.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.304+0000 7f3bc37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56164ce42b40 0x56164ce4d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44360/0 (socket says 172.21.15.2:44360) 2024-09-19T04:58:35.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.304+0000 7f3bc37fe640 1 -- 172.21.15.2:0/1532947821 learned_addr learned my addr 172.21.15.2:0/1532947821 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:58:35.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.304+0000 7f3bc8f49640 1 --2- 172.21.15.2:0/1532947821 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56164ce50780 0x56164ce4dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:35.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.304+0000 7f3bc3fff640 1 --2- 172.21.15.2:0/1532947821 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56164ce415d0 0x56164ce501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:35.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.304+0000 7f3bc37fe640 1 -- 172.21.15.2:0/1532947821 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56164ce415d0 msgr2=0x56164ce501d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:35.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.304+0000 7f3bc37fe640 1 --2- 172.21.15.2:0/1532947821 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56164ce415d0 0x56164ce501d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:35.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.304+0000 7f3bc37fe640 1 -- 172.21.15.2:0/1532947821 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56164ce50780 msgr2=0x56164ce4dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:35.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.304+0000 7f3bc37fe640 1 --2- 172.21.15.2:0/1532947821 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56164ce50780 0x56164ce4dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:35.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.304+0000 7f3bc37fe640 1 -- 172.21.15.2:0/1532947821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56164cb183c0 con 0x56164ce42b40 2024-09-19T04:58:35.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.304+0000 7f3bc37fe640 1 --2- 172.21.15.2:0/1532947821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56164ce42b40 0x56164ce4d480 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f3bb800ffe0 tx=0x7f3bb800d720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=674ed1e33232cf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:58:35.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.304+0000 7f3ba37fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:58:35.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.304+0000 7f3ba37fe640 1 -- 172.21.15.2:0/1532947821 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb8012660 con 0x56164ce42b40 2024-09-19T04:58:35.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.304+0000 7f3ba37fe640 1 -- 172.21.15.2:0/1532947821 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f3bb8012800 con 0x56164ce42b40 2024-09-19T04:58:35.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.304+0000 7f3bccd85740 1 -- 172.21.15.2:0/1532947821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3bb8011440 con 0x56164ce42b40 2024-09-19T04:58:35.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.305+0000 7f3ba37fe640 1 -- 172.21.15.2:0/1532947821 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f3bb8012a20 con 0x56164ce42b40 2024-09-19T04:58:35.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.305+0000 7f3bccd85740 10 client.16770 fetch_fsmap learned FSMap version 19 2024-09-19T04:58:35.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.305+0000 7f3bccd85740 1 -- 172.21.15.2:0/1532947821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56164ce5ef90 con 0x56164ce42b40 2024-09-19T04:58:35.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.305+0000 7f3ba37fe640 1 -- 172.21.15.2:0/1532947821 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3bb8011440 con 0x56164ce42b40 2024-09-19T04:58:35.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.305+0000 7f3ba37fe640 1 -- 172.21.15.2:0/1532947821 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f3bb8025020 con 0x56164ce42b40 2024-09-19T04:58:35.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.305+0000 7f3bccd85740 10 client.16770 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:58:35.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.305+0000 7f3bccd85740 10 client.16770 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:58:35.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.305+0000 7f3bccd85740 20 client.16770 populate_metadata read hostname 'smithi002' 2024-09-19T04:58:35.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.305+0000 7f3bccd85740 1 --2- 172.21.15.2:0/1532947821 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56164ce60390 0x56164ce62780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:35.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.305+0000 7f3bccd85740 4 client.16770 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:58:35.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.305+0000 7f3bccd85740 1 -- 172.21.15.2:0/1532947821 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56164cdb4860 con 0x56164ce60390 2024-09-19T04:58:35.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.305+0000 7f3bc3fff640 1 --2- 172.21.15.2:0/1532947821 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56164ce60390 0x56164ce62780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:35.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.306+0000 7f3bc3fff640 1 --2- 172.21.15.2:0/1532947821 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56164ce60390 0x56164ce62780 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2341266287b4e0f server_cookie=ed25976cc95e1040 in_seq=0 out_seq=0 2024-09-19T04:58:35.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.306+0000 7f3ba37fe640 10 client.16770 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:58:35.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.306+0000 7f3ba37fe640 1 -- 172.21.15.2:0/1532947821 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56164cdb4860 con 0x56164ce60390 2024-09-19T04:58:35.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.306+0000 7f3ba37fe640 10 client.16770 handle_command_reply: tid=0 2024-09-19T04:58:35.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.306+0000 7f3bccd85740 1 client.16770 shutdown 2024-09-19T04:58:35.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.307+0000 7f3bccd85740 1 -- 172.21.15.2:0/1532947821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56164ce42b40 msgr2=0x56164ce4d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:35.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.307+0000 7f3bccd85740 1 --2- 172.21.15.2:0/1532947821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56164ce42b40 0x56164ce4d480 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f3bb800ffe0 tx=0x7f3bb800d720 comp rx=0 tx=0).stop 2024-09-19T04:58:35.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.307+0000 7f3bccd85740 1 -- 172.21.15.2:0/1532947821 shutdown_connections 2024-09-19T04:58:35.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.307+0000 7f3bccd85740 1 --2- 172.21.15.2:0/1532947821 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56164ce50780 0x56164ce4dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:35.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.307+0000 7f3bccd85740 1 --2- 172.21.15.2:0/1532947821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56164ce42b40 0x56164ce4d480 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:35.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.307+0000 7f3bccd85740 1 --2- 172.21.15.2:0/1532947821 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56164ce60390 0x56164ce62780 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:35.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.307+0000 7f3bccd85740 1 --2- 172.21.15.2:0/1532947821 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56164ce415d0 0x56164ce501d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:35.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.307+0000 7f3bccd85740 1 -- 172.21.15.2:0/1532947821 >> 172.21.15.2:0/1532947821 conn(0x56164ce0a310 msgr2=0x56164ce43960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:58:35.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.307+0000 7f3ba37fe640 0 client.16770 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:58:35.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.307+0000 7f3bccd85740 1 -- 172.21.15.2:0/1532947821 shutdown_connections 2024-09-19T04:58:35.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.307+0000 7f3bccd85740 1 -- 172.21.15.2:0/1532947821 wait complete. 2024-09-19T04:58:35.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.307+0000 7f3bccd85740 20 client.16770 trim_cache size 0 max 16384 2024-09-19T04:58:35.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.320+0000 7f3bccd85740 1 Processor -- start 2024-09-19T04:58:35.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.320+0000 7f3bccd85740 1 -- start start 2024-09-19T04:58:35.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.320+0000 7f3bccd85740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56164ce415d0 0x56164ce3de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:35.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.320+0000 7f3bccd85740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56164ce42b40 0x56164ce67e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:35.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.320+0000 7f3bccd85740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56164ce50780 0x56164ce683b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:35.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.320+0000 7f3bccd85740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc41a9540 con 0x56164ce42b40 2024-09-19T04:58:35.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.320+0000 7f3bccd85740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc41abda0 con 0x56164ce415d0 2024-09-19T04:58:35.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.320+0000 7f3bccd85740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc41a9b90 con 0x56164ce50780 2024-09-19T04:58:35.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.320+0000 7f3bc37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56164ce42b40 0x56164ce67e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:35.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.320+0000 7f3bc37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56164ce42b40 0x56164ce67e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44374/0 (socket says 172.21.15.2:44374) 2024-09-19T04:58:35.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.320+0000 7f3bc37fe640 1 -- 172.21.15.2:0/1343551695 learned_addr learned my addr 172.21.15.2:0/1343551695 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:58:35.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.320+0000 7f3bc3fff640 1 --2- 172.21.15.2:0/1343551695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56164ce415d0 0x56164ce3de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:35.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.320+0000 7f3bc37fe640 1 -- 172.21.15.2:0/1343551695 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56164ce50780 msgr2=0x56164ce683b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:35.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.320+0000 7f3bc8f49640 1 --2- 172.21.15.2:0/1343551695 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56164ce50780 0x56164ce683b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:35.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.320+0000 7f3bc37fe640 1 --2- 172.21.15.2:0/1343551695 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56164ce50780 0x56164ce683b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:35.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.320+0000 7f3bc37fe640 1 -- 172.21.15.2:0/1343551695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56164ce415d0 msgr2=0x56164ce3de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:35.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.320+0000 7f3bc37fe640 1 --2- 172.21.15.2:0/1343551695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56164ce415d0 0x56164ce3de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:35.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.320+0000 7f3bc37fe640 1 -- 172.21.15.2:0/1343551695 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56164ce4df80 con 0x56164ce42b40 2024-09-19T04:58:35.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.321+0000 7f3bc37fe640 1 --2- 172.21.15.2:0/1343551695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56164ce42b40 0x56164ce67e70 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f3bb8012010 tx=0x7f3bb8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83662532c091ea6c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:58:35.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.321+0000 7f3ba9ffb640 1 -- 172.21.15.2:0/1343551695 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb8034070 con 0x56164ce42b40 2024-09-19T04:58:35.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.321+0000 7f3ba9ffb640 1 -- 172.21.15.2:0/1343551695 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3bb800de30 con 0x56164ce42b40 2024-09-19T04:58:35.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.321+0000 7f3ba9ffb640 1 -- 172.21.15.2:0/1343551695 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb8011800 con 0x56164ce42b40 2024-09-19T04:58:35.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.321+0000 7f3bccd85740 1 -- 172.21.15.2:0/1343551695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56164ce42b40 msgr2=0x56164ce67e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:35.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.321+0000 7f3bccd85740 1 --2- 172.21.15.2:0/1343551695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56164ce42b40 0x56164ce67e70 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f3bb8012010 tx=0x7f3bb8015000 comp rx=0 tx=0).stop 2024-09-19T04:58:35.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.321+0000 7f3bccd85740 1 -- 172.21.15.2:0/1343551695 shutdown_connections 2024-09-19T04:58:35.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.321+0000 7f3bccd85740 1 --2- 172.21.15.2:0/1343551695 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56164ce50780 0x56164ce683b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:35.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.321+0000 7f3bccd85740 1 --2- 172.21.15.2:0/1343551695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56164ce42b40 0x56164ce67e70 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:35.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.321+0000 7f3bccd85740 1 --2- 172.21.15.2:0/1343551695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56164ce415d0 0x56164ce3de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:35.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.321+0000 7f3bccd85740 1 -- 172.21.15.2:0/1343551695 >> 172.21.15.2:0/1343551695 conn(0x56164ce0a310 msgr2=0x56164ce3d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:58:35.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.321+0000 7f3bccd85740 1 -- 172.21.15.2:0/1343551695 shutdown_connections 2024-09-19T04:58:35.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.321+0000 7f3bccd85740 1 -- 172.21.15.2:0/1343551695 wait complete. 2024-09-19T04:58:35.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.322+0000 7f3bccd85740 1 -- start start 2024-09-19T04:58:35.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.322+0000 7f3bccd85740 1 Processor -- start 2024-09-19T04:58:35.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.322+0000 7f3bccd85740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56164ce415d0 0x56164ce59170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:35.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.322+0000 7f3bccd85740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56164ce42b40 0x56164ce4a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:35.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.322+0000 7f3bccd85740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56164ce50780 0x56164ce4aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:35.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.322+0000 7f3bccd85740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc41aa260 con 0x56164ce415d0 2024-09-19T04:58:35.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.322+0000 7f3bccd85740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc41ab6d0 con 0x56164ce50780 2024-09-19T04:58:35.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.322+0000 7f3bccd85740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc41aa930 con 0x56164ce42b40 2024-09-19T04:58:35.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.322+0000 7f3bccd85740 10 client.0 _ll_register_callbacks cb 0x7f3bb400b810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:58:35.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.322+0000 7f3bc3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56164ce415d0 0x56164ce59170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:35.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.322+0000 7f3bc3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56164ce415d0 0x56164ce59170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44380/0 (socket says 172.21.15.2:44380) 2024-09-19T04:58:35.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.322+0000 7f3bc3fff640 1 -- 172.21.15.2:0/256285099 learned_addr learned my addr 172.21.15.2:0/256285099 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:58:35.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.323+0000 7f3bc8f49640 1 --2- 172.21.15.2:0/256285099 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56164ce50780 0x56164ce4aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:35.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.323+0000 7f3bc37fe640 1 --2- 172.21.15.2:0/256285099 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56164ce42b40 0x56164ce4a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:35.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.323+0000 7f3bc3fff640 1 -- 172.21.15.2:0/256285099 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56164ce42b40 msgr2=0x56164ce4a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:35.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.323+0000 7f3bc3fff640 1 --2- 172.21.15.2:0/256285099 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56164ce42b40 0x56164ce4a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:35.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.323+0000 7f3bc3fff640 1 -- 172.21.15.2:0/256285099 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56164ce50780 msgr2=0x56164ce4aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:35.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.323+0000 7f3bc3fff640 1 --2- 172.21.15.2:0/256285099 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56164ce50780 0x56164ce4aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:35.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.323+0000 7f3bc3fff640 1 -- 172.21.15.2:0/256285099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56164cec9e40 con 0x56164ce415d0 2024-09-19T04:58:35.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.323+0000 7f3bc3fff640 1 --2- 172.21.15.2:0/256285099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56164ce415d0 0x56164ce59170 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4005fd0 tx=0x7f3bb40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b094334761172b7c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:58:35.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.323+0000 7f3ba37fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:58:35.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.323+0000 7f3ba37fe640 1 -- 172.21.15.2:0/256285099 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb402f070 con 0x56164ce415d0 2024-09-19T04:58:35.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.323+0000 7f3ba37fe640 1 -- 172.21.15.2:0/256285099 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f3bb401fc50 con 0x56164ce415d0 2024-09-19T04:58:35.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.323+0000 7f3bccd85740 1 -- 172.21.15.2:0/256285099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3bb800de30 con 0x56164ce415d0 2024-09-19T04:58:35.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.323+0000 7f3ba37fe640 1 -- 172.21.15.2:0/256285099 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f3bb401fe50 con 0x56164ce415d0 2024-09-19T04:58:35.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.323+0000 7f3bccd85740 10 client.16776 fetch_fsmap learned FSMap version 19 2024-09-19T04:58:35.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.323+0000 7f3bccd85740 1 -- 172.21.15.2:0/256285099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56164cecb040 con 0x56164ce415d0 2024-09-19T04:58:35.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.324+0000 7f3ba37fe640 1 -- 172.21.15.2:0/256285099 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3bb800de30 con 0x56164ce415d0 2024-09-19T04:58:35.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.324+0000 7f3ba37fe640 1 -- 172.21.15.2:0/256285099 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f3bb40335a0 con 0x56164ce415d0 2024-09-19T04:58:35.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.324+0000 7f3bccd85740 10 client.16776 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:58:35.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.324+0000 7f3bccd85740 10 client.16776 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:58:35.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.324+0000 7f3bccd85740 20 client.16776 populate_metadata read hostname 'smithi002' 2024-09-19T04:58:35.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.324+0000 7f3bccd85740 1 --2- 172.21.15.2:0/256285099 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56164cecb7c0 0x56164cecdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:35.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.324+0000 7f3bccd85740 4 client.16776 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:58:35.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.324+0000 7f3bccd85740 1 -- 172.21.15.2:0/256285099 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56164cdaed70 con 0x56164cecb7c0 2024-09-19T04:58:35.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.324+0000 7f3bc37fe640 1 --2- 172.21.15.2:0/256285099 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56164cecb7c0 0x56164cecdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:35.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.325+0000 7f3bc37fe640 1 --2- 172.21.15.2:0/256285099 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56164cecb7c0 0x56164cecdbe0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d299193f38392d1 server_cookie=bc4c752e8e137947 in_seq=0 out_seq=0 2024-09-19T04:58:35.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.325+0000 7f3ba37fe640 10 client.16776 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:58:35.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.325+0000 7f3ba37fe640 1 -- 172.21.15.2:0/256285099 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56164cdaed70 con 0x56164cecb7c0 2024-09-19T04:58:35.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.325+0000 7f3ba37fe640 10 client.16776 handle_command_reply: tid=0 2024-09-19T04:58:35.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.325+0000 7f3bccd85740 1 client.16776 shutdown 2024-09-19T04:58:35.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.325+0000 7f3bccd85740 1 -- 172.21.15.2:0/256285099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56164ce415d0 msgr2=0x56164ce59170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:35.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.325+0000 7f3bccd85740 1 --2- 172.21.15.2:0/256285099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56164ce415d0 0x56164ce59170 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4005fd0 tx=0x7f3bb40046c0 comp rx=0 tx=0).stop 2024-09-19T04:58:35.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.325+0000 7f3bccd85740 1 -- 172.21.15.2:0/256285099 shutdown_connections 2024-09-19T04:58:35.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.325+0000 7f3bccd85740 1 --2- 172.21.15.2:0/256285099 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56164ce50780 0x56164ce4aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:35.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.325+0000 7f3bccd85740 1 --2- 172.21.15.2:0/256285099 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56164cecb7c0 0x56164cecdbe0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:35.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.325+0000 7f3bccd85740 1 --2- 172.21.15.2:0/256285099 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56164ce42b40 0x56164ce4a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:35.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.325+0000 7f3bccd85740 1 --2- 172.21.15.2:0/256285099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56164ce415d0 0x56164ce59170 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:35.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.325+0000 7f3bccd85740 1 -- 172.21.15.2:0/256285099 >> 172.21.15.2:0/256285099 conn(0x56164ce0a310 msgr2=0x56164ce4f500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:58:35.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.325+0000 7f3ba37fe640 0 client.16776 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:58:35.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.325+0000 7f3bccd85740 1 -- 172.21.15.2:0/256285099 shutdown_connections 2024-09-19T04:58:35.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.325+0000 7f3bccd85740 1 -- 172.21.15.2:0/256285099 wait complete. 2024-09-19T04:58:35.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.325+0000 7f3bccd85740 20 client.16776 trim_cache size 0 max 16384 2024-09-19T04:58:35.331 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T04:58:35.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.326+0000 7f3bca9ac640 1 -- 172.21.15.2:0/1142524782 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f3bac0a3430 msgr2=0x7f3bac0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:35.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.326+0000 7f3bca9ac640 1 --2- 172.21.15.2:0/1142524782 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f3bac0a3430 0x7f3bac0a58f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x56164ce3eac0 tx=0x7f3bb400b410 comp rx=0 tx=0).stop 2024-09-19T04:58:35.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.326+0000 7f3bca9ac640 1 -- 172.21.15.2:0/1142524782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bc4106f10 msgr2=0x7f3bc419cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:35.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.326+0000 7f3bca9ac640 1 --2- 172.21.15.2:0/1142524782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bc4106f10 0x7f3bc419cc10 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc009dc0 tx=0x7f3bbc032ff0 comp rx=0 tx=0).stop 2024-09-19T04:58:35.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.326+0000 7f3bca9ac640 1 -- 172.21.15.2:0/1142524782 shutdown_connections 2024-09-19T04:58:35.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.326+0000 7f3bca9ac640 1 --2- 172.21.15.2:0/1142524782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bc4106f10 0x7f3bc419cc10 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:35.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.326+0000 7f3bca9ac640 1 --2- 172.21.15.2:0/1142524782 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f3bac0a3430 0x7f3bac0a58f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:35.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.326+0000 7f3bca9ac640 1 --2- 172.21.15.2:0/1142524782 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bc4102790 0x7f3bc4198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:35.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.326+0000 7f3bca9ac640 1 --2- 172.21.15.2:0/1142524782 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3bc4101de0 0x7f3bc4198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:35.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.326+0000 7f3bca9ac640 1 -- 172.21.15.2:0/1142524782 >> 172.21.15.2:0/1142524782 conn(0x7f3bc40fd8c0 msgr2=0x7f3bc40fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:58:35.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.326+0000 7f3bca9ac640 1 -- 172.21.15.2:0/1142524782 shutdown_connections 2024-09-19T04:58:35.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:35.326+0000 7f3bca9ac640 1 -- 172.21.15.2:0/1142524782 wait complete. 2024-09-19T04:58:36.044 INFO:tasks.workunit.client.0.smithi002.stdout:499/600: open fd = 3 2024-09-19T04:58:36.044 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.044 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.044 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.044 INFO:tasks.workunit.client.0.smithi002.stdout:500/600: open fd = 3 2024-09-19T04:58:36.044 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.044 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.044 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.045 INFO:tasks.workunit.client.0.smithi002.stdout:501/600: open fd = 3 2024-09-19T04:58:36.045 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.045 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.045 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.045 INFO:tasks.workunit.client.0.smithi002.stdout:502/600: open fd = 3 2024-09-19T04:58:36.045 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.045 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.045 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.045 INFO:tasks.workunit.client.0.smithi002.stdout:503/600: open fd = 3 2024-09-19T04:58:36.045 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.045 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.045 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.045 INFO:tasks.workunit.client.0.smithi002.stdout:504/600: open fd = 3 2024-09-19T04:58:36.046 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.046 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.046 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.046 INFO:tasks.workunit.client.0.smithi002.stdout:505/600: open fd = 3 2024-09-19T04:58:36.046 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.046 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.046 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.046 INFO:tasks.workunit.client.0.smithi002.stdout:506/600: open fd = 3 2024-09-19T04:58:36.046 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.046 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.046 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.046 INFO:tasks.workunit.client.0.smithi002.stdout:507/600: open fd = 3 2024-09-19T04:58:36.046 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.046 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.046 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.047 INFO:tasks.workunit.client.0.smithi002.stdout:508/600: open fd = 3 2024-09-19T04:58:36.047 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.047 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.047 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.047 INFO:tasks.workunit.client.0.smithi002.stdout:509/600: open fd = 3 2024-09-19T04:58:36.047 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.047 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.047 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.047 INFO:tasks.workunit.client.0.smithi002.stdout:510/600: open fd = 3 2024-09-19T04:58:36.047 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.047 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.047 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.047 INFO:tasks.workunit.client.0.smithi002.stdout:511/600: open fd = 3 2024-09-19T04:58:36.047 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.048 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.048 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.048 INFO:tasks.workunit.client.0.smithi002.stdout:512/600: open fd = 3 2024-09-19T04:58:36.048 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.048 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.048 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.048 INFO:tasks.workunit.client.0.smithi002.stdout:513/600: open fd = 3 2024-09-19T04:58:36.048 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.048 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.048 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.048 INFO:tasks.workunit.client.0.smithi002.stdout:514/600: open fd = 3 2024-09-19T04:58:36.048 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.048 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.049 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.049 INFO:tasks.workunit.client.0.smithi002.stdout:515/600: open fd = 3 2024-09-19T04:58:36.049 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.049 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.049 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.049 INFO:tasks.workunit.client.0.smithi002.stdout:516/600: open fd = 3 2024-09-19T04:58:36.049 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.049 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.049 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.049 INFO:tasks.workunit.client.0.smithi002.stdout:517/600: open fd = 3 2024-09-19T04:58:36.049 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.049 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.049 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.049 INFO:tasks.workunit.client.0.smithi002.stdout:518/600: open fd = 3 2024-09-19T04:58:36.049 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.050 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.050 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.050 INFO:tasks.workunit.client.0.smithi002.stdout:519/600: open fd = 3 2024-09-19T04:58:36.050 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.050 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.050 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.050 INFO:tasks.workunit.client.0.smithi002.stdout:520/600: open fd = 3 2024-09-19T04:58:36.050 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.050 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.050 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.050 INFO:tasks.workunit.client.0.smithi002.stdout:521/600: open fd = 3 2024-09-19T04:58:36.050 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.050 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.050 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.051 INFO:tasks.workunit.client.0.smithi002.stdout:522/600: open fd = 3 2024-09-19T04:58:36.051 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.051 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.051 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.051 INFO:tasks.workunit.client.0.smithi002.stdout:523/600: open fd = 3 2024-09-19T04:58:36.051 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.051 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.051 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.051 INFO:tasks.workunit.client.0.smithi002.stdout:524/600: open fd = 3 2024-09-19T04:58:36.051 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.051 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.051 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.051 INFO:tasks.workunit.client.0.smithi002.stdout:525/600: open fd = 3 2024-09-19T04:58:36.051 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.051 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.052 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.052 INFO:tasks.workunit.client.0.smithi002.stdout:526/600: open fd = 3 2024-09-19T04:58:36.052 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.052 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.052 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.052 INFO:tasks.workunit.client.0.smithi002.stdout:527/600: open fd = 3 2024-09-19T04:58:36.052 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.052 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.052 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.052 INFO:tasks.workunit.client.0.smithi002.stdout:528/600: open fd = 3 2024-09-19T04:58:36.052 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.052 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.052 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.052 INFO:tasks.workunit.client.0.smithi002.stdout:529/600: open fd = 3 2024-09-19T04:58:36.053 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.053 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.053 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.053 INFO:tasks.workunit.client.0.smithi002.stdout:530/600: open fd = 3 2024-09-19T04:58:36.053 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.053 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.053 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.053 INFO:tasks.workunit.client.0.smithi002.stdout:531/600: open fd = 3 2024-09-19T04:58:36.053 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.053 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.053 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.053 INFO:tasks.workunit.client.0.smithi002.stdout:532/600: open fd = 3 2024-09-19T04:58:36.053 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.053 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.054 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.054 INFO:tasks.workunit.client.0.smithi002.stdout:533/600: open fd = 3 2024-09-19T04:58:36.054 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.054 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.054 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.054 INFO:tasks.workunit.client.0.smithi002.stdout:534/600: open fd = 3 2024-09-19T04:58:36.054 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.054 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.054 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.054 INFO:tasks.workunit.client.0.smithi002.stdout:535/600: open fd = 3 2024-09-19T04:58:36.054 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.054 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.054 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.054 INFO:tasks.workunit.client.0.smithi002.stdout:536/600: open fd = 3 2024-09-19T04:58:36.055 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.055 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.055 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.055 INFO:tasks.workunit.client.0.smithi002.stdout:537/600: open fd = 3 2024-09-19T04:58:36.055 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.055 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.055 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.055 INFO:tasks.workunit.client.0.smithi002.stdout:538/600: open fd = 3 2024-09-19T04:58:36.055 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.055 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.055 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.055 INFO:tasks.workunit.client.0.smithi002.stdout:539/600: open fd = 3 2024-09-19T04:58:36.055 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.056 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.056 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.056 INFO:tasks.workunit.client.0.smithi002.stdout:540/600: open fd = 3 2024-09-19T04:58:36.056 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.056 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.056 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.056 INFO:tasks.workunit.client.0.smithi002.stdout:541/600: open fd = 3 2024-09-19T04:58:36.056 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.056 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.056 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.056 INFO:tasks.workunit.client.0.smithi002.stdout:542/600: open fd = 3 2024-09-19T04:58:36.056 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.056 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.057 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.057 INFO:tasks.workunit.client.0.smithi002.stdout:543/600: open fd = 3 2024-09-19T04:58:36.057 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.057 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.057 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.057 INFO:tasks.workunit.client.0.smithi002.stdout:544/600: open fd = 3 2024-09-19T04:58:36.057 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.057 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.057 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.057 INFO:tasks.workunit.client.0.smithi002.stdout:545/600: open fd = 3 2024-09-19T04:58:36.057 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.057 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.057 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.057 INFO:tasks.workunit.client.0.smithi002.stdout:546/600: open fd = 3 2024-09-19T04:58:36.058 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.058 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.058 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.058 INFO:tasks.workunit.client.0.smithi002.stdout:547/600: open fd = 3 2024-09-19T04:58:36.058 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.058 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.058 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.058 INFO:tasks.workunit.client.0.smithi002.stdout:548/600: open fd = 3 2024-09-19T04:58:36.058 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.058 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.058 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.058 INFO:tasks.workunit.client.0.smithi002.stdout:549/600: open fd = 3 2024-09-19T04:58:36.058 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.058 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.059 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.059 INFO:tasks.workunit.client.0.smithi002.stdout:550/600: open fd = 3 2024-09-19T04:58:36.059 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.059 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.059 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.059 INFO:tasks.workunit.client.0.smithi002.stdout:551/600: open fd = 3 2024-09-19T04:58:36.059 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.059 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.059 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.059 INFO:tasks.workunit.client.0.smithi002.stdout:552/600: open fd = 3 2024-09-19T04:58:36.059 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.059 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.059 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.059 INFO:tasks.workunit.client.0.smithi002.stdout:553/600: open fd = 3 2024-09-19T04:58:36.060 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.060 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.060 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.060 INFO:tasks.workunit.client.0.smithi002.stdout:554/600: open fd = 3 2024-09-19T04:58:36.060 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.060 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.060 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.060 INFO:tasks.workunit.client.0.smithi002.stdout:555/600: open fd = 3 2024-09-19T04:58:36.060 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.060 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.060 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.060 INFO:tasks.workunit.client.0.smithi002.stdout:556/600: open fd = 3 2024-09-19T04:58:36.060 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.061 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.061 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.061 INFO:tasks.workunit.client.0.smithi002.stdout:557/600: open fd = 3 2024-09-19T04:58:36.061 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.061 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.061 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.061 INFO:tasks.workunit.client.0.smithi002.stdout:558/600: open fd = 3 2024-09-19T04:58:36.061 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.061 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.061 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.061 INFO:tasks.workunit.client.0.smithi002.stdout:559/600: open fd = 3 2024-09-19T04:58:36.061 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.061 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.061 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.062 INFO:tasks.workunit.client.0.smithi002.stdout:560/600: open fd = 3 2024-09-19T04:58:36.062 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.062 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:58:36.062 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:58:36.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:36 smithi002 ceph-mon[30975]: pgmap v329: 97 pgs: 97 active+clean; 21 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 85 KiB/s wr, 11 op/s 2024-09-19T04:58:36.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:36 smithi018 ceph-mon[34537]: pgmap v329: 97 pgs: 97 active+clean; 21 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 85 KiB/s wr, 11 op/s 2024-09-19T04:58:36.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:36 smithi116 ceph-mon[34477]: pgmap v329: 97 pgs: 97 active+clean; 21 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 85 KiB/s wr, 11 op/s 2024-09-19T04:58:37.227 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:58:37.228 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:58:37.503 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:58:38.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.047+0000 7f8ae94fe640 1 -- 172.21.15.2:0/316314599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ae4102790 msgr2=0x7f8ae41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:38.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.047+0000 7f8ae94fe640 1 --2- 172.21.15.2:0/316314599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ae4102790 0x7f8ae41067e0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f8acc009900 tx=0x7f8acc02a410 comp rx=0 tx=0).stop 2024-09-19T04:58:38.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.047+0000 7f8ae94fe640 1 -- 172.21.15.2:0/316314599 shutdown_connections 2024-09-19T04:58:38.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.047+0000 7f8ae94fe640 1 --2- 172.21.15.2:0/316314599 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ae4106f10 0x7f8ae410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:38.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.047+0000 7f8ae94fe640 1 --2- 172.21.15.2:0/316314599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ae4102790 0x7f8ae41067e0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:38.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.047+0000 7f8ae94fe640 1 --2- 172.21.15.2:0/316314599 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ae4101de0 0x7f8ae41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:38.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.047+0000 7f8ae94fe640 1 -- 172.21.15.2:0/316314599 >> 172.21.15.2:0/316314599 conn(0x7f8ae40fd8c0 msgr2=0x7f8ae40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:58:38.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.047+0000 7f8ae94fe640 1 -- 172.21.15.2:0/316314599 shutdown_connections 2024-09-19T04:58:38.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.047+0000 7f8ae94fe640 1 -- 172.21.15.2:0/316314599 wait complete. 2024-09-19T04:58:38.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.048+0000 7f8ae94fe640 1 Processor -- start 2024-09-19T04:58:38.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.048+0000 7f8ae94fe640 1 -- start start 2024-09-19T04:58:38.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.048+0000 7f8ae94fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ae4101de0 0x7f8ae40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:38.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.048+0000 7f8ae94fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ae4102790 0x7f8ae4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:38.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.048+0000 7f8ae94fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ae4106f10 0x7f8ae4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:38.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.048+0000 7f8ae94fe640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae4111de0 con 0x7f8ae4101de0 2024-09-19T04:58:38.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.048+0000 7f8ae94fe640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae4111c60 con 0x7f8ae4106f10 2024-09-19T04:58:38.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.048+0000 7f8ae94fe640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae4111f60 con 0x7f8ae4102790 2024-09-19T04:58:38.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.048+0000 7f8ae2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ae4101de0 0x7f8ae40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:38.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.048+0000 7f8ae2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ae4101de0 0x7f8ae40744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44392/0 (socket says 172.21.15.2:44392) 2024-09-19T04:58:38.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.048+0000 7f8ae2ffd640 1 -- 172.21.15.2:0/1437780131 learned_addr learned my addr 172.21.15.2:0/1437780131 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:58:38.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.048+0000 7f8ada7fc640 1 --2- 172.21.15.2:0/1437780131 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ae4102790 0x7f8ae4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:38.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.048+0000 7f8ae37fe640 1 --2- 172.21.15.2:0/1437780131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ae4106f10 0x7f8ae4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:38.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.048+0000 7f8ae2ffd640 1 -- 172.21.15.2:0/1437780131 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ae4102790 msgr2=0x7f8ae4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:38.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.048+0000 7f8ae2ffd640 1 --2- 172.21.15.2:0/1437780131 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ae4102790 0x7f8ae4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:38.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.048+0000 7f8ae2ffd640 1 -- 172.21.15.2:0/1437780131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ae4106f10 msgr2=0x7f8ae4074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:38.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.048+0000 7f8ae2ffd640 1 --2- 172.21.15.2:0/1437780131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ae4106f10 0x7f8ae4074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:38.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.048+0000 7f8ae2ffd640 1 -- 172.21.15.2:0/1437780131 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ae41a68a0 con 0x7f8ae4101de0 2024-09-19T04:58:38.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.048+0000 7f8ae37fe640 1 --2- 172.21.15.2:0/1437780131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ae4106f10 0x7f8ae4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:58:38.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.049+0000 7f8ae2ffd640 1 --2- 172.21.15.2:0/1437780131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ae4101de0 0x7f8ae40744f0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f8ad400d950 tx=0x7f8ad400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:58:38.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.049+0000 7f8ae0ff9640 1 -- 172.21.15.2:0/1437780131 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad4017070 con 0x7f8ae4101de0 2024-09-19T04:58:38.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.049+0000 7f8ae94fe640 1 -- 172.21.15.2:0/1437780131 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ae41a6b90 con 0x7f8ae4101de0 2024-09-19T04:58:38.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.049+0000 7f8ae0ff9640 1 -- 172.21.15.2:0/1437780131 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8ad4009c30 con 0x7f8ae4101de0 2024-09-19T04:58:38.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.049+0000 7f8ae0ff9640 1 -- 172.21.15.2:0/1437780131 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad400f620 con 0x7f8ae4101de0 2024-09-19T04:58:38.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.049+0000 7f8ae94fe640 1 -- 172.21.15.2:0/1437780131 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ae41a70f0 con 0x7f8ae4101de0 2024-09-19T04:58:38.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.051+0000 7f8ae0ff9640 1 -- 172.21.15.2:0/1437780131 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f8ad40109a0 con 0x7f8ae4101de0 2024-09-19T04:58:38.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.051+0000 7f8aeb8d7740 1 Processor -- start 2024-09-19T04:58:38.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.051+0000 7f8aeb8d7740 1 -- start start 2024-09-19T04:58:38.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.052+0000 7f8aeb8d7740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558166db8b60 0x558166db8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:38.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.052+0000 7f8aeb8d7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558166db9480 0x558166dc3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:38.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.052+0000 7f8aeb8d7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558166dc3d40 0x558166dc6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:38.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.052+0000 7f8aeb8d7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558166d1e280 con 0x558166db9480 2024-09-19T04:58:38.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.052+0000 7f8aeb8d7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558166cc5b10 con 0x558166dc3d40 2024-09-19T04:58:38.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.052+0000 7f8aeb8d7740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x558166d1a240 con 0x558166db8b60 2024-09-19T04:58:38.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.052+0000 7f8ae2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558166db9480 0x558166dc3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:38.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.052+0000 7f8ae2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558166db9480 0x558166dc3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44396/0 (socket says 172.21.15.2:44396) 2024-09-19T04:58:38.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.052+0000 7f8ae2ffd640 1 -- 172.21.15.2:0/427561827 learned_addr learned my addr 172.21.15.2:0/427561827 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:58:38.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.052+0000 7f8ae37fe640 1 --2- 172.21.15.2:0/427561827 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558166db8b60 0x558166db8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:38.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.052+0000 7f8ada7fc640 1 --2- 172.21.15.2:0/427561827 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558166dc3d40 0x558166dc6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:38.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.052+0000 7f8ae0ff9640 1 --2- 172.21.15.2:0/1437780131 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f8ad00a33b0 0x7f8ad00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:38.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.052+0000 7f8ae2ffd640 1 -- 172.21.15.2:0/427561827 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558166db8b60 msgr2=0x558166db8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:38.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.052+0000 7f8ae2ffd640 1 --2- 172.21.15.2:0/427561827 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558166db8b60 0x558166db8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:38.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.053+0000 7f8ae2ffd640 1 -- 172.21.15.2:0/427561827 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558166dc3d40 msgr2=0x558166dc6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:38.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.053+0000 7f8ae2ffd640 1 --2- 172.21.15.2:0/427561827 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558166dc3d40 0x558166dc6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:38.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.053+0000 7f8ae2ffd640 1 -- 172.21.15.2:0/427561827 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558166cd21f0 con 0x558166db9480 2024-09-19T04:58:38.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.053+0000 7f8ae37fe640 1 --2- 172.21.15.2:0/427561827 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558166db8b60 0x558166db8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:58:38.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.053+0000 7f8ae37fe640 1 --2- 172.21.15.2:0/1437780131 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f8ad00a33b0 0x7f8ad00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:38.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.053+0000 7f8ae0ff9640 1 -- 172.21.15.2:0/1437780131 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f8ad40cfa00 con 0x7f8ae4101de0 2024-09-19T04:58:38.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.053+0000 7f8ae2ffd640 1 --2- 172.21.15.2:0/427561827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558166db9480 0x558166dc3800 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f8ad40cd0c0 tx=0x7f8ad400bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e178662d491a496b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:58:38.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.053+0000 7f8ad97fa640 1 -- 172.21.15.2:0/427561827 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad4020020 con 0x558166db9480 2024-09-19T04:58:38.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.053+0000 7f8ae37fe640 1 --2- 172.21.15.2:0/1437780131 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f8ad00a33b0 0x7f8ad00a5870 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8adc005fd0 tx=0x7f8adc004a40 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:58:38.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.053+0000 7f8ad97fa640 1 -- 172.21.15.2:0/427561827 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8ad4009de0 con 0x558166db9480 2024-09-19T04:58:38.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.053+0000 7f8ad97fa640 1 -- 172.21.15.2:0/427561827 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad409bce0 con 0x558166db9480 2024-09-19T04:58:38.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.054+0000 7f8aeb8d7740 1 -- 172.21.15.2:0/427561827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558166db9480 msgr2=0x558166dc3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:38.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.054+0000 7f8aeb8d7740 1 --2- 172.21.15.2:0/427561827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558166db9480 0x558166dc3800 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f8ad40cd0c0 tx=0x7f8ad400bf60 comp rx=0 tx=0).stop 2024-09-19T04:58:38.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.054+0000 7f8aeb8d7740 1 -- 172.21.15.2:0/427561827 shutdown_connections 2024-09-19T04:58:38.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.054+0000 7f8aeb8d7740 1 --2- 172.21.15.2:0/427561827 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558166dc3d40 0x558166dc6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:38.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.054+0000 7f8aeb8d7740 1 --2- 172.21.15.2:0/427561827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558166db9480 0x558166dc3800 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:38.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.054+0000 7f8aeb8d7740 1 --2- 172.21.15.2:0/427561827 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558166db8b60 0x558166db8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:38.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.054+0000 7f8aeb8d7740 1 -- 172.21.15.2:0/427561827 >> 172.21.15.2:0/427561827 conn(0x558166db50f0 msgr2=0x558166db54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:58:38.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.054+0000 7f8aeb8d7740 1 -- 172.21.15.2:0/427561827 shutdown_connections 2024-09-19T04:58:38.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.054+0000 7f8aeb8d7740 1 -- 172.21.15.2:0/427561827 wait complete. 2024-09-19T04:58:38.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.054+0000 7f8aeb8d7740 1 -- start start 2024-09-19T04:58:38.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.054+0000 7f8aeb8d7740 1 Processor -- start 2024-09-19T04:58:38.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.055+0000 7f8aeb8d7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558166db8b60 0x558166dc37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:38.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.055+0000 7f8aeb8d7740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558166db9480 0x558166dc0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:38.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.055+0000 7f8aeb8d7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558166dc3d40 0x558166dc1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:38.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.055+0000 7f8aeb8d7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558166dc68b0 con 0x558166dc3d40 2024-09-19T04:58:38.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.055+0000 7f8aeb8d7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558166cd8f10 con 0x558166db8b60 2024-09-19T04:58:38.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.055+0000 7f8aeb8d7740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x558166dc6a30 con 0x558166db9480 2024-09-19T04:58:38.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.055+0000 7f8aeb8d7740 10 client.0 _ll_register_callbacks cb 0x558166ca1a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:58:38.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.055+0000 7f8ae37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558166dc3d40 0x558166dc1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:38.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.055+0000 7f8ae2ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558166db8b60 0x558166dc37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:38.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.055+0000 7f8ae2ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558166db8b60 0x558166dc37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.2:35640/0 (socket says 172.21.15.2:35640) 2024-09-19T04:58:38.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.055+0000 7f8ae2ffd640 1 -- 172.21.15.2:0/532971425 learned_addr learned my addr 172.21.15.2:0/532971425 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:58:38.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.055+0000 7f8ae37fe640 1 --2- 172.21.15.2:0/532971425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558166dc3d40 0x558166dc1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44406/0 (socket says 172.21.15.2:44406) 2024-09-19T04:58:38.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.055+0000 7f8ada7fc640 1 --2- 172.21.15.2:0/532971425 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558166db9480 0x558166dc0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:38.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.055+0000 7f8ae37fe640 1 -- 172.21.15.2:0/532971425 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558166db9480 msgr2=0x558166dc0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:38.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.055+0000 7f8ae37fe640 1 --2- 172.21.15.2:0/532971425 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558166db9480 0x558166dc0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:38.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.055+0000 7f8ae37fe640 1 -- 172.21.15.2:0/532971425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558166db8b60 msgr2=0x558166dc37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:38.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.055+0000 7f8ae37fe640 1 --2- 172.21.15.2:0/532971425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558166db8b60 0x558166dc37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:38.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.055+0000 7f8ae37fe640 1 -- 172.21.15.2:0/532971425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558166a8f6a0 con 0x558166dc3d40 2024-09-19T04:58:38.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.055+0000 7f8ae2ffd640 1 --2- 172.21.15.2:0/532971425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558166db8b60 0x558166dc37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:58:38.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.055+0000 7f8ae37fe640 1 --2- 172.21.15.2:0/532971425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558166dc3d40 0x558166dc1240 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f8adc011d00 tx=0x7f8adc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d6bdbc992a6fac2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:58:38.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.055+0000 7f8aca7fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:58:38.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.056+0000 7f8aca7fc640 1 -- 172.21.15.2:0/532971425 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8adc022070 con 0x558166dc3d40 2024-09-19T04:58:38.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.056+0000 7f8aca7fc640 1 -- 172.21.15.2:0/532971425 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f8adc010d60 con 0x558166dc3d40 2024-09-19T04:58:38.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.056+0000 7f8aeb8d7740 1 -- 172.21.15.2:0/532971425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ad4009de0 con 0x558166dc3d40 2024-09-19T04:58:38.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.056+0000 7f8aca7fc640 1 -- 172.21.15.2:0/532971425 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f8adc02e050 con 0x558166dc3d40 2024-09-19T04:58:38.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.056+0000 7f8aeb8d7740 10 client.16788 fetch_fsmap learned FSMap version 19 2024-09-19T04:58:38.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.056+0000 7f8aeb8d7740 1 -- 172.21.15.2:0/532971425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x558166dd2480 con 0x558166dc3d40 2024-09-19T04:58:38.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.056+0000 7f8aca7fc640 1 -- 172.21.15.2:0/532971425 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8ad4009de0 con 0x558166dc3d40 2024-09-19T04:58:38.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.056+0000 7f8aca7fc640 1 -- 172.21.15.2:0/532971425 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f8adc01d3b0 con 0x558166dc3d40 2024-09-19T04:58:38.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.056+0000 7f8aeb8d7740 10 client.16788 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:58:38.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.056+0000 7f8aeb8d7740 10 client.16788 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:58:38.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.056+0000 7f8aeb8d7740 20 client.16788 populate_metadata read hostname 'smithi002' 2024-09-19T04:58:38.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.056+0000 7f8aeb8d7740 1 --2- 172.21.15.2:0/532971425 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558166dd3890 0x558166dd5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:38.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.056+0000 7f8aeb8d7740 4 client.16788 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:58:38.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.056+0000 7f8aeb8d7740 1 -- 172.21.15.2:0/532971425 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558166d2b7f0 con 0x558166dd3890 2024-09-19T04:58:38.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.057+0000 7f8ae2ffd640 1 --2- 172.21.15.2:0/532971425 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558166dd3890 0x558166dd5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:38.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.057+0000 7f8ae2ffd640 1 --2- 172.21.15.2:0/532971425 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558166dd3890 0x558166dd5cc0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7686003ed519d12 server_cookie=40ee5148b87ce1a8 in_seq=0 out_seq=0 2024-09-19T04:58:38.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.057+0000 7f8aca7fc640 10 client.16788 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:58:38.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.058+0000 7f8aca7fc640 1 -- 172.21.15.2:0/532971425 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558166d2b7f0 con 0x558166dd3890 2024-09-19T04:58:38.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.058+0000 7f8aca7fc640 10 client.16788 handle_command_reply: tid=0 2024-09-19T04:58:38.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.058+0000 7f8aeb8d7740 1 client.16788 shutdown 2024-09-19T04:58:38.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.058+0000 7f8aeb8d7740 1 -- 172.21.15.2:0/532971425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558166dc3d40 msgr2=0x558166dc1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:38.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.058+0000 7f8aeb8d7740 1 --2- 172.21.15.2:0/532971425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558166dc3d40 0x558166dc1240 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f8adc011d00 tx=0x7f8adc004ab0 comp rx=0 tx=0).stop 2024-09-19T04:58:38.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.059+0000 7f8aeb8d7740 1 -- 172.21.15.2:0/532971425 shutdown_connections 2024-09-19T04:58:38.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.059+0000 7f8aeb8d7740 1 --2- 172.21.15.2:0/532971425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558166dc3d40 0x558166dc1240 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:38.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.059+0000 7f8aeb8d7740 1 --2- 172.21.15.2:0/532971425 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558166dd3890 0x558166dd5cc0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:38.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.059+0000 7f8aeb8d7740 1 --2- 172.21.15.2:0/532971425 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558166db9480 0x558166dc0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:38.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.059+0000 7f8aeb8d7740 1 --2- 172.21.15.2:0/532971425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558166db8b60 0x558166dc37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:38.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.059+0000 7f8aeb8d7740 1 -- 172.21.15.2:0/532971425 >> 172.21.15.2:0/532971425 conn(0x558166db50f0 msgr2=0x558166dbae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:58:38.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.059+0000 7f8aca7fc640 0 client.16788 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:58:38.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.059+0000 7f8aeb8d7740 1 -- 172.21.15.2:0/532971425 shutdown_connections 2024-09-19T04:58:38.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.059+0000 7f8aeb8d7740 1 -- 172.21.15.2:0/532971425 wait complete. 2024-09-19T04:58:38.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.059+0000 7f8aeb8d7740 20 client.16788 trim_cache size 0 max 16384 2024-09-19T04:58:38.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.078+0000 7f8aeb8d7740 1 Processor -- start 2024-09-19T04:58:38.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.078+0000 7f8aeb8d7740 1 -- start start 2024-09-19T04:58:38.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.079+0000 7f8aeb8d7740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558166db8b60 0x558166dbb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:38.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.079+0000 7f8aeb8d7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558166db9480 0x558166dcfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:38.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.079+0000 7f8aeb8d7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558166dc3d40 0x558166ddb590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:38.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.079+0000 7f8aeb8d7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae41ad9a0 con 0x558166db9480 2024-09-19T04:58:38.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.079+0000 7f8aeb8d7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae41b0200 con 0x558166dc3d40 2024-09-19T04:58:38.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.079+0000 7f8aeb8d7740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae41adff0 con 0x558166db8b60 2024-09-19T04:58:38.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.079+0000 7f8ada7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558166db9480 0x558166dcfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:38.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.079+0000 7f8ada7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558166db9480 0x558166dcfb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44416/0 (socket says 172.21.15.2:44416) 2024-09-19T04:58:38.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.079+0000 7f8ada7fc640 1 -- 172.21.15.2:0/1662665718 learned_addr learned my addr 172.21.15.2:0/1662665718 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:58:38.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.079+0000 7f8ae37fe640 1 --2- 172.21.15.2:0/1662665718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558166dc3d40 0x558166ddb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:38.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.079+0000 7f8ae2ffd640 1 --2- 172.21.15.2:0/1662665718 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558166db8b60 0x558166dbb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:38.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.079+0000 7f8ada7fc640 1 -- 172.21.15.2:0/1662665718 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558166db8b60 msgr2=0x558166dbb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:38.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.079+0000 7f8ada7fc640 1 --2- 172.21.15.2:0/1662665718 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558166db8b60 0x558166dbb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:38.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.079+0000 7f8ada7fc640 1 -- 172.21.15.2:0/1662665718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558166dc3d40 msgr2=0x558166ddb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:38.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.079+0000 7f8ada7fc640 1 --2- 172.21.15.2:0/1662665718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558166dc3d40 0x558166ddb590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:38.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.079+0000 7f8ada7fc640 1 -- 172.21.15.2:0/1662665718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558166db4f20 con 0x558166db9480 2024-09-19T04:58:38.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.079+0000 7f8ada7fc640 1 --2- 172.21.15.2:0/1662665718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558166db9480 0x558166dcfb40 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f8acc005c40 tx=0x7f8acc032e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32114ce3d3599c90 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:58:38.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.080+0000 7f8ad8ff9640 1 -- 172.21.15.2:0/1662665718 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8acc035040 con 0x558166db9480 2024-09-19T04:58:38.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.080+0000 7f8ad8ff9640 1 -- 172.21.15.2:0/1662665718 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8acc031db0 con 0x558166db9480 2024-09-19T04:58:38.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.080+0000 7f8ad8ff9640 1 -- 172.21.15.2:0/1662665718 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8acc0053c0 con 0x558166db9480 2024-09-19T04:58:38.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.080+0000 7f8aeb8d7740 1 -- 172.21.15.2:0/1662665718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558166db9480 msgr2=0x558166dcfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:38.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.080+0000 7f8aeb8d7740 1 --2- 172.21.15.2:0/1662665718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558166db9480 0x558166dcfb40 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f8acc005c40 tx=0x7f8acc032e70 comp rx=0 tx=0).stop 2024-09-19T04:58:38.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.080+0000 7f8aeb8d7740 1 -- 172.21.15.2:0/1662665718 shutdown_connections 2024-09-19T04:58:38.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.080+0000 7f8aeb8d7740 1 --2- 172.21.15.2:0/1662665718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558166dc3d40 0x558166ddb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:38.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.080+0000 7f8aeb8d7740 1 --2- 172.21.15.2:0/1662665718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558166db9480 0x558166dcfb40 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:38.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.080+0000 7f8aeb8d7740 1 --2- 172.21.15.2:0/1662665718 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558166db8b60 0x558166dbb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:38.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.080+0000 7f8aeb8d7740 1 -- 172.21.15.2:0/1662665718 >> 172.21.15.2:0/1662665718 conn(0x558166db50f0 msgr2=0x558166dbfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:58:38.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.081+0000 7f8aeb8d7740 1 -- 172.21.15.2:0/1662665718 shutdown_connections 2024-09-19T04:58:38.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.081+0000 7f8aeb8d7740 1 -- 172.21.15.2:0/1662665718 wait complete. 2024-09-19T04:58:38.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.081+0000 7f8aeb8d7740 1 -- start start 2024-09-19T04:58:38.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.081+0000 7f8aeb8d7740 1 Processor -- start 2024-09-19T04:58:38.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.081+0000 7f8aeb8d7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558166db8b60 0x558166dbdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:38.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.081+0000 7f8aeb8d7740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558166db9480 0x558166dbe250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:38.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.081+0000 7f8aeb8d7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558166dc3d40 0x558166dbe790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:38.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.081+0000 7f8aeb8d7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae41ae6c0 con 0x558166dc3d40 2024-09-19T04:58:38.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.081+0000 7f8aeb8d7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae41afb30 con 0x558166db8b60 2024-09-19T04:58:38.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.081+0000 7f8aeb8d7740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae41aed90 con 0x558166db9480 2024-09-19T04:58:38.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.081+0000 7f8aeb8d7740 10 client.0 _ll_register_callbacks cb 0x7f8adc012510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:58:38.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.081+0000 7f8ae37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558166dc3d40 0x558166dbe790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:38.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.081+0000 7f8ae37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558166dc3d40 0x558166dbe790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44426/0 (socket says 172.21.15.2:44426) 2024-09-19T04:58:38.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.081+0000 7f8ae37fe640 1 -- 172.21.15.2:0/4022000033 learned_addr learned my addr 172.21.15.2:0/4022000033 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:58:38.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.081+0000 7f8ada7fc640 1 --2- 172.21.15.2:0/4022000033 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558166db9480 0x558166dbe250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:38.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.082+0000 7f8ae2ffd640 1 --2- 172.21.15.2:0/4022000033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558166db8b60 0x558166dbdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:38.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.082+0000 7f8ae37fe640 1 -- 172.21.15.2:0/4022000033 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558166db9480 msgr2=0x558166dbe250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:38.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.082+0000 7f8ae37fe640 1 --2- 172.21.15.2:0/4022000033 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558166db9480 0x558166dbe250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:38.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.082+0000 7f8ae37fe640 1 -- 172.21.15.2:0/4022000033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558166db8b60 msgr2=0x558166dbdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:38.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.082+0000 7f8ae37fe640 1 --2- 172.21.15.2:0/4022000033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558166db8b60 0x558166dbdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:38.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.082+0000 7f8ae37fe640 1 -- 172.21.15.2:0/4022000033 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558166e3d760 con 0x558166dc3d40 2024-09-19T04:58:38.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.082+0000 7f8ae2ffd640 1 --2- 172.21.15.2:0/4022000033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558166db8b60 0x558166dbdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:58:38.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.082+0000 7f8ae37fe640 1 --2- 172.21.15.2:0/4022000033 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558166dc3d40 0x558166dbe790 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f8adc011d00 tx=0x7f8adc01d660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=281bc557ce037e3b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:58:38.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.082+0000 7f8aca7fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:58:38.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.082+0000 7f8aca7fc640 1 -- 172.21.15.2:0/4022000033 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8adc022050 con 0x558166dc3d40 2024-09-19T04:58:38.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.082+0000 7f8aca7fc640 1 -- 172.21.15.2:0/4022000033 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f8adc01de00 con 0x558166dc3d40 2024-09-19T04:58:38.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.082+0000 7f8aeb8d7740 1 -- 172.21.15.2:0/4022000033 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8acc031db0 con 0x558166dc3d40 2024-09-19T04:58:38.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.082+0000 7f8aca7fc640 1 -- 172.21.15.2:0/4022000033 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f8adc009d70 con 0x558166dc3d40 2024-09-19T04:58:38.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.082+0000 7f8aeb8d7740 10 client.16794 fetch_fsmap learned FSMap version 19 2024-09-19T04:58:38.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.082+0000 7f8aeb8d7740 1 -- 172.21.15.2:0/4022000033 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x558166e3ea80 con 0x558166dc3d40 2024-09-19T04:58:38.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.082+0000 7f8aca7fc640 1 -- 172.21.15.2:0/4022000033 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8acc031db0 con 0x558166dc3d40 2024-09-19T04:58:38.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.083+0000 7f8aca7fc640 1 -- 172.21.15.2:0/4022000033 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f8adc03b9a0 con 0x558166dc3d40 2024-09-19T04:58:38.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.083+0000 7f8aeb8d7740 10 client.16794 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:58:38.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.083+0000 7f8aeb8d7740 10 client.16794 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:58:38.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.083+0000 7f8aeb8d7740 20 client.16794 populate_metadata read hostname 'smithi002' 2024-09-19T04:58:38.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.083+0000 7f8aeb8d7740 1 --2- 172.21.15.2:0/4022000033 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558166e3f1a0 0x558166e41590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:38.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.083+0000 7f8aeb8d7740 4 client.16794 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:58:38.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.083+0000 7f8aeb8d7740 1 -- 172.21.15.2:0/4022000033 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x558166d25d00 con 0x558166e3f1a0 2024-09-19T04:58:38.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.083+0000 7f8ae2ffd640 1 --2- 172.21.15.2:0/4022000033 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558166e3f1a0 0x558166e41590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:38.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.083+0000 7f8ae2ffd640 1 --2- 172.21.15.2:0/4022000033 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558166e3f1a0 0x558166e41590 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49bb9764ceb382c7 server_cookie=25f25f83fef0d261 in_seq=0 out_seq=0 2024-09-19T04:58:38.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.083+0000 7f8aca7fc640 10 client.16794 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:58:38.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.084+0000 7f8aca7fc640 1 -- 172.21.15.2:0/4022000033 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x558166d25d00 con 0x558166e3f1a0 2024-09-19T04:58:38.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.084+0000 7f8aca7fc640 10 client.16794 handle_command_reply: tid=0 2024-09-19T04:58:38.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.084+0000 7f8aeb8d7740 1 client.16794 shutdown 2024-09-19T04:58:38.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.084+0000 7f8aeb8d7740 1 -- 172.21.15.2:0/4022000033 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558166dc3d40 msgr2=0x558166dbe790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:38.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.084+0000 7f8aeb8d7740 1 --2- 172.21.15.2:0/4022000033 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558166dc3d40 0x558166dbe790 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f8adc011d00 tx=0x7f8adc01d660 comp rx=0 tx=0).stop 2024-09-19T04:58:38.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.085+0000 7f8aeb8d7740 1 -- 172.21.15.2:0/4022000033 shutdown_connections 2024-09-19T04:58:38.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.085+0000 7f8aeb8d7740 1 --2- 172.21.15.2:0/4022000033 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558166dc3d40 0x558166dbe790 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:38.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.085+0000 7f8aeb8d7740 1 --2- 172.21.15.2:0/4022000033 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558166e3f1a0 0x558166e41590 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:38.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.085+0000 7f8aeb8d7740 1 --2- 172.21.15.2:0/4022000033 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558166db9480 0x558166dbe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:38.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.085+0000 7f8aeb8d7740 1 --2- 172.21.15.2:0/4022000033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558166db8b60 0x558166dbdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:38.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.085+0000 7f8aeb8d7740 1 -- 172.21.15.2:0/4022000033 >> 172.21.15.2:0/4022000033 conn(0x558166db50f0 msgr2=0x558166db3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:58:38.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.085+0000 7f8aca7fc640 0 client.16794 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:58:38.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.085+0000 7f8aeb8d7740 1 -- 172.21.15.2:0/4022000033 shutdown_connections 2024-09-19T04:58:38.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.085+0000 7f8aeb8d7740 1 -- 172.21.15.2:0/4022000033 wait complete. 2024-09-19T04:58:38.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.085+0000 7f8aeb8d7740 20 client.16794 trim_cache size 0 max 16384 2024-09-19T04:58:38.093 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:58:38.093 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T04:58:38.093 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "d01a58aa-ba23-435e-b009-dbf0893cc08d", 2024-09-19T04:58:38.093 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T04:58:38.093 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:58:38.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.085+0000 7f8ae94fe640 1 -- 172.21.15.2:0/1437780131 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f8ad00a33b0 msgr2=0x7f8ad00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:38.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.085+0000 7f8ae94fe640 1 --2- 172.21.15.2:0/1437780131 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f8ad00a33b0 0x7f8ad00a5870 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8adc005fd0 tx=0x7f8adc004a40 comp rx=0 tx=0).stop 2024-09-19T04:58:38.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.085+0000 7f8ae94fe640 1 -- 172.21.15.2:0/1437780131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ae4101de0 msgr2=0x7f8ae40744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:38.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.085+0000 7f8ae94fe640 1 --2- 172.21.15.2:0/1437780131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ae4101de0 0x7f8ae40744f0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f8ad400d950 tx=0x7f8ad400de10 comp rx=0 tx=0).stop 2024-09-19T04:58:38.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.085+0000 7f8ae94fe640 1 -- 172.21.15.2:0/1437780131 shutdown_connections 2024-09-19T04:58:38.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.085+0000 7f8ae94fe640 1 --2- 172.21.15.2:0/1437780131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ae4106f10 0x7f8ae4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:38.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.085+0000 7f8ae94fe640 1 --2- 172.21.15.2:0/1437780131 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f8ad00a33b0 0x7f8ad00a5870 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:38.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.085+0000 7f8ae94fe640 1 --2- 172.21.15.2:0/1437780131 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ae4102790 0x7f8ae4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:38.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.085+0000 7f8ae94fe640 1 --2- 172.21.15.2:0/1437780131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ae4101de0 0x7f8ae40744f0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:38.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.085+0000 7f8ae94fe640 1 -- 172.21.15.2:0/1437780131 >> 172.21.15.2:0/1437780131 conn(0x7f8ae40fd8c0 msgr2=0x7f8ae40fed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:58:38.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.086+0000 7f8ae94fe640 1 -- 172.21.15.2:0/1437780131 shutdown_connections 2024-09-19T04:58:38.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:38.086+0000 7f8ae94fe640 1 -- 172.21.15.2:0/1437780131 wait complete. 2024-09-19T04:58:38.619 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:38 smithi002 ceph-mon[30975]: pgmap v330: 97 pgs: 97 active+clean; 21 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 55 KiB/s wr, 7 op/s 2024-09-19T04:58:38.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:38 smithi018 ceph-mon[34537]: pgmap v330: 97 pgs: 97 active+clean; 21 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 55 KiB/s wr, 7 op/s 2024-09-19T04:58:38.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:38 smithi116 ceph-mon[34477]: pgmap v330: 97 pgs: 97 active+clean; 21 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 55 KiB/s wr, 7 op/s 2024-09-19T04:58:38.904 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:58:39.162 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:58:39.608 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:39 smithi002 ceph-mon[30975]: scrub queued for path: / 2024-09-19T04:58:39.608 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:39 smithi002 ceph-mon[30975]: scrub summary: idle+waiting paths [/] 2024-09-19T04:58:39.608 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:39 smithi002 ceph-mon[30975]: scrub summary: active paths [/] 2024-09-19T04:58:39.608 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:39 smithi002 ceph-mon[30975]: scrub summary: idle+waiting paths [/] 2024-09-19T04:58:39.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.689+0000 7f558414e640 1 -- 172.21.15.2:0/2900903568 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f557c100a90 msgr2=0x7f557c100ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:39.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.689+0000 7f558414e640 1 --2- 172.21.15.2:0/2900903568 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f557c100a90 0x7f557c100ef0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f556c009930 tx=0x7f556c02a420 comp rx=0 tx=0).stop 2024-09-19T04:58:39.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.689+0000 7f558414e640 1 -- 172.21.15.2:0/2900903568 shutdown_connections 2024-09-19T04:58:39.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.689+0000 7f558414e640 1 --2- 172.21.15.2:0/2900903568 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f557c101430 0x7f557c10d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:39.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.689+0000 7f558414e640 1 --2- 172.21.15.2:0/2900903568 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f557c100a90 0x7f557c100ef0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:39.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.689+0000 7f558414e640 1 --2- 172.21.15.2:0/2900903568 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f557c106a90 0x7f557c106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:39.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.690+0000 7f558414e640 1 -- 172.21.15.2:0/2900903568 >> 172.21.15.2:0/2900903568 conn(0x7f557c0fc7d0 msgr2=0x7f557c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:58:39.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.690+0000 7f558414e640 1 -- 172.21.15.2:0/2900903568 shutdown_connections 2024-09-19T04:58:39.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.690+0000 7f558414e640 1 -- 172.21.15.2:0/2900903568 wait complete. 2024-09-19T04:58:39.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.690+0000 7f558414e640 1 Processor -- start 2024-09-19T04:58:39.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.690+0000 7f558414e640 1 -- start start 2024-09-19T04:58:39.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.690+0000 7f558414e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f557c100a90 0x7f557c197060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:39.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.690+0000 7f558414e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f557c101430 0x7f557c1975a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:39.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.690+0000 7f558414e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f557c106a90 0x7f557c197ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:39.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.690+0000 7f558414e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f557c110d60 con 0x7f557c106a90 2024-09-19T04:58:39.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.690+0000 7f558414e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f557c110be0 con 0x7f557c101430 2024-09-19T04:58:39.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.690+0000 7f558414e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f557c110ee0 con 0x7f557c100a90 2024-09-19T04:58:39.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.691+0000 7f55826eb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f557c106a90 0x7f557c197ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:39.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.691+0000 7f55826eb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f557c106a90 0x7f557c197ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44442/0 (socket says 172.21.15.2:44442) 2024-09-19T04:58:39.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.691+0000 7f55826eb640 1 -- 172.21.15.2:0/3284056410 learned_addr learned my addr 172.21.15.2:0/3284056410 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:58:39.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.691+0000 7f55816e9640 1 --2- 172.21.15.2:0/3284056410 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f557c101430 0x7f557c1975a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:39.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.691+0000 7f5581eea640 1 --2- 172.21.15.2:0/3284056410 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f557c100a90 0x7f557c197060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:39.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.691+0000 7f55826eb640 1 -- 172.21.15.2:0/3284056410 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f557c100a90 msgr2=0x7f557c197060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:39.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.691+0000 7f55826eb640 1 --2- 172.21.15.2:0/3284056410 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f557c100a90 0x7f557c197060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:39.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.691+0000 7f55826eb640 1 -- 172.21.15.2:0/3284056410 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f557c101430 msgr2=0x7f557c1975a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:39.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.691+0000 7f55826eb640 1 --2- 172.21.15.2:0/3284056410 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f557c101430 0x7f557c1975a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:39.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.691+0000 7f55826eb640 1 -- 172.21.15.2:0/3284056410 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f557c1a68d0 con 0x7f557c106a90 2024-09-19T04:58:39.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.691+0000 7f5581eea640 1 --2- 172.21.15.2:0/3284056410 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f557c100a90 0x7f557c197060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:58:39.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.691+0000 7f55826eb640 1 --2- 172.21.15.2:0/3284056410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f557c106a90 0x7f557c197ae0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f557400b970 tx=0x7f557400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:58:39.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.691+0000 7f5572ffd640 1 -- 172.21.15.2:0/3284056410 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5574019070 con 0x7f557c106a90 2024-09-19T04:58:39.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.691+0000 7f558414e640 1 -- 172.21.15.2:0/3284056410 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f557c1a6bc0 con 0x7f557c106a90 2024-09-19T04:58:39.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.691+0000 7f5572ffd640 1 -- 172.21.15.2:0/3284056410 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5574014440 con 0x7f557c106a90 2024-09-19T04:58:39.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.691+0000 7f5572ffd640 1 -- 172.21.15.2:0/3284056410 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55740075d0 con 0x7f557c106a90 2024-09-19T04:58:39.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.691+0000 7f558414e640 1 -- 172.21.15.2:0/3284056410 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f557c1a7080 con 0x7f557c106a90 2024-09-19T04:58:39.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.694+0000 7f5572ffd640 1 -- 172.21.15.2:0/3284056410 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f557401c070 con 0x7f557c106a90 2024-09-19T04:58:39.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.694+0000 7f5586527740 1 Processor -- start 2024-09-19T04:58:39.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.694+0000 7f5586527740 1 -- start start 2024-09-19T04:58:39.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.694+0000 7f5586527740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5641703544a0 0x564170354880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:39.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.694+0000 7f5586527740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564170354dc0 0x56417035f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:39.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.694+0000 7f5586527740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56417035f680 0x564170361a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:39.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.694+0000 7f5586527740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5641702ba2e0 con 0x56417035f680 2024-09-19T04:58:39.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.694+0000 7f5586527740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564170261ce0 con 0x564170354dc0 2024-09-19T04:58:39.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.694+0000 7f5586527740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5641702b62a0 con 0x5641703544a0 2024-09-19T04:58:39.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.694+0000 7f55816e9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56417035f680 0x564170361a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:39.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.695+0000 7f55816e9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56417035f680 0x564170361a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44450/0 (socket says 172.21.15.2:44450) 2024-09-19T04:58:39.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.695+0000 7f55816e9640 1 -- 172.21.15.2:0/154856559 learned_addr learned my addr 172.21.15.2:0/154856559 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:58:39.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.695+0000 7f5581eea640 1 --2- 172.21.15.2:0/154856559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564170354dc0 0x56417035f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:39.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.695+0000 7f5572ffd640 1 --2- 172.21.15.2:0/3284056410 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f55680a33b0 0x7f55680a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:39.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.695+0000 7f55816e9640 1 --2- 172.21.15.2:0/154856559 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5641703544a0 0x564170354880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:39.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.695+0000 7f55816e9640 1 -- 172.21.15.2:0/154856559 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5641703544a0 msgr2=0x564170354880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:39.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.695+0000 7f55816e9640 1 --2- 172.21.15.2:0/154856559 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5641703544a0 0x564170354880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:39.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.695+0000 7f55816e9640 1 -- 172.21.15.2:0/154856559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564170354dc0 msgr2=0x56417035f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:39.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.695+0000 7f55816e9640 1 --2- 172.21.15.2:0/154856559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564170354dc0 0x56417035f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:39.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.695+0000 7f55816e9640 1 -- 172.21.15.2:0/154856559 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564170246440 con 0x56417035f680 2024-09-19T04:58:39.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.695+0000 7f55826eb640 1 --2- 172.21.15.2:0/3284056410 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f55680a33b0 0x7f55680a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:39.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.695+0000 7f5572ffd640 1 -- 172.21.15.2:0/3284056410 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f55740cf1e0 con 0x7f557c106a90 2024-09-19T04:58:39.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.695+0000 7f55816e9640 1 --2- 172.21.15.2:0/154856559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56417035f680 0x564170361a70 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f556c009930 tx=0x7f556c009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e179c0a77acb2056 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:58:39.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.695+0000 7f5567fff640 1 -- 172.21.15.2:0/154856559 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f556c035070 con 0x56417035f680 2024-09-19T04:58:39.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.695+0000 7f55826eb640 1 --2- 172.21.15.2:0/3284056410 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f55680a33b0 0x7f55680a5870 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f55740ccaa0 tx=0x7f5574090b10 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:58:39.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.695+0000 7f5567fff640 1 -- 172.21.15.2:0/154856559 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f556c031710 con 0x56417035f680 2024-09-19T04:58:39.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.695+0000 7f5567fff640 1 -- 172.21.15.2:0/154856559 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f556c0047a0 con 0x56417035f680 2024-09-19T04:58:39.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.696+0000 7f5586527740 1 -- 172.21.15.2:0/154856559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56417035f680 msgr2=0x564170361a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:39.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.696+0000 7f5586527740 1 --2- 172.21.15.2:0/154856559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56417035f680 0x564170361a70 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f556c009930 tx=0x7f556c009560 comp rx=0 tx=0).stop 2024-09-19T04:58:39.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.696+0000 7f5586527740 1 -- 172.21.15.2:0/154856559 shutdown_connections 2024-09-19T04:58:39.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.696+0000 7f5586527740 1 --2- 172.21.15.2:0/154856559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56417035f680 0x564170361a70 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:39.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.696+0000 7f5586527740 1 --2- 172.21.15.2:0/154856559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564170354dc0 0x56417035f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:39.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.696+0000 7f5586527740 1 --2- 172.21.15.2:0/154856559 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5641703544a0 0x564170354880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:39.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.696+0000 7f5586527740 1 -- 172.21.15.2:0/154856559 >> 172.21.15.2:0/154856559 conn(0x564170350a30 msgr2=0x564170350e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:58:39.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.696+0000 7f5586527740 1 -- 172.21.15.2:0/154856559 shutdown_connections 2024-09-19T04:58:39.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.696+0000 7f5586527740 1 -- 172.21.15.2:0/154856559 wait complete. 2024-09-19T04:58:39.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.697+0000 7f5586527740 1 -- start start 2024-09-19T04:58:39.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.697+0000 7f5586527740 1 Processor -- start 2024-09-19T04:58:39.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.697+0000 7f5586527740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641703544a0 0x56417035ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:39.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.697+0000 7f5586527740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564170354dc0 0x56417035c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:39.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.697+0000 7f5586527740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56417035f680 0x56417035c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:39.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.697+0000 7f5586527740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564170362250 con 0x5641703544a0 2024-09-19T04:58:39.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.697+0000 7f5586527740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564170275050 con 0x56417035f680 2024-09-19T04:58:39.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.697+0000 7f5586527740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5641703623d0 con 0x564170354dc0 2024-09-19T04:58:39.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.697+0000 7f5586527740 10 client.0 _ll_register_callbacks cb 0x5641702b5160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:58:39.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.697+0000 7f55816e9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641703544a0 0x56417035ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:39.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.697+0000 7f55816e9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641703544a0 0x56417035ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44464/0 (socket says 172.21.15.2:44464) 2024-09-19T04:58:39.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.697+0000 7f55816e9640 1 -- 172.21.15.2:0/1242823224 learned_addr learned my addr 172.21.15.2:0/1242823224 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:58:39.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.698+0000 7f5581eea640 1 --2- 172.21.15.2:0/1242823224 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564170354dc0 0x56417035c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:39.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.698+0000 7f55816e9640 1 --2- 172.21.15.2:0/1242823224 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56417035f680 0x56417035c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:39.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.698+0000 7f55816e9640 1 -- 172.21.15.2:0/1242823224 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564170354dc0 msgr2=0x56417035c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:39.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.698+0000 7f55816e9640 1 --2- 172.21.15.2:0/1242823224 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564170354dc0 0x56417035c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:39.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.698+0000 7f55816e9640 1 -- 172.21.15.2:0/1242823224 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56417035f680 msgr2=0x56417035c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:39.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.698+0000 7f55816e9640 1 --2- 172.21.15.2:0/1242823224 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56417035f680 0x56417035c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:39.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.698+0000 7f55816e9640 1 -- 172.21.15.2:0/1242823224 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56417002b3c0 con 0x5641703544a0 2024-09-19T04:58:39.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.698+0000 7f55816e9640 1 --2- 172.21.15.2:0/1242823224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641703544a0 0x56417035ef60 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f556c02a940 tx=0x7f556c005510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=769e8e636cb3d52e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:58:39.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.698+0000 7f55657fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:58:39.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.698+0000 7f55657fa640 1 -- 172.21.15.2:0/1242823224 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f556c035070 con 0x5641703544a0 2024-09-19T04:58:39.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.698+0000 7f55657fa640 1 -- 172.21.15.2:0/1242823224 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f556c0055f0 con 0x5641703544a0 2024-09-19T04:58:39.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.698+0000 7f5586527740 1 -- 172.21.15.2:0/1242823224 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f556c031710 con 0x5641703544a0 2024-09-19T04:58:39.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.698+0000 7f55657fa640 1 -- 172.21.15.2:0/1242823224 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f556c004260 con 0x5641703544a0 2024-09-19T04:58:39.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.698+0000 7f5586527740 10 client.16806 fetch_fsmap learned FSMap version 19 2024-09-19T04:58:39.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.698+0000 7f5586527740 1 -- 172.21.15.2:0/1242823224 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56417036dbf0 con 0x5641703544a0 2024-09-19T04:58:39.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.699+0000 7f55657fa640 1 -- 172.21.15.2:0/1242823224 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f556c031710 con 0x5641703544a0 2024-09-19T04:58:39.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.699+0000 7f55657fa640 1 -- 172.21.15.2:0/1242823224 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f556c0035f0 con 0x5641703544a0 2024-09-19T04:58:39.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.699+0000 7f5586527740 10 client.16806 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:58:39.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.699+0000 7f5586527740 10 client.16806 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:58:39.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.699+0000 7f5586527740 20 client.16806 populate_metadata read hostname 'smithi002' 2024-09-19T04:58:39.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.699+0000 7f5586527740 1 --2- 172.21.15.2:0/1242823224 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56417036ef40 0x564170371330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:39.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.699+0000 7f5586527740 4 client.16806 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:58:39.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.699+0000 7f5586527740 1 -- 172.21.15.2:0/1242823224 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5641702c7850 con 0x56417036ef40 2024-09-19T04:58:39.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.699+0000 7f5581eea640 1 --2- 172.21.15.2:0/1242823224 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56417036ef40 0x564170371330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:39.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.699+0000 7f5581eea640 1 --2- 172.21.15.2:0/1242823224 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56417036ef40 0x564170371330 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ab8da255112a997 server_cookie=475f8f2107de9259 in_seq=0 out_seq=0 2024-09-19T04:58:39.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.699+0000 7f55657fa640 10 client.16806 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:58:39.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.700+0000 7f55657fa640 1 -- 172.21.15.2:0/1242823224 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5641702c7850 con 0x56417036ef40 2024-09-19T04:58:39.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.700+0000 7f55657fa640 10 client.16806 handle_command_reply: tid=0 2024-09-19T04:58:39.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.700+0000 7f5586527740 1 client.16806 shutdown 2024-09-19T04:58:39.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.700+0000 7f5586527740 1 -- 172.21.15.2:0/1242823224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641703544a0 msgr2=0x56417035ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:39.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.700+0000 7f5586527740 1 --2- 172.21.15.2:0/1242823224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641703544a0 0x56417035ef60 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f556c02a940 tx=0x7f556c005510 comp rx=0 tx=0).stop 2024-09-19T04:58:39.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.700+0000 7f5586527740 1 -- 172.21.15.2:0/1242823224 shutdown_connections 2024-09-19T04:58:39.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.700+0000 7f5586527740 1 --2- 172.21.15.2:0/1242823224 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56417035f680 0x56417035c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:39.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.700+0000 7f5586527740 1 --2- 172.21.15.2:0/1242823224 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x56417036ef40 0x564170371330 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:39.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.700+0000 7f5586527740 1 --2- 172.21.15.2:0/1242823224 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564170354dc0 0x56417035c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:39.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.700+0000 7f5586527740 1 --2- 172.21.15.2:0/1242823224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641703544a0 0x56417035ef60 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:39.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.700+0000 7f55657fa640 0 client.16806 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:58:39.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.700+0000 7f5586527740 1 -- 172.21.15.2:0/1242823224 >> 172.21.15.2:0/1242823224 conn(0x564170350a30 msgr2=0x564170356760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:58:39.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.700+0000 7f5586527740 1 -- 172.21.15.2:0/1242823224 shutdown_connections 2024-09-19T04:58:39.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.700+0000 7f5586527740 1 -- 172.21.15.2:0/1242823224 wait complete. 2024-09-19T04:58:39.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.700+0000 7f5586527740 20 client.16806 trim_cache size 0 max 16384 2024-09-19T04:58:39.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.717+0000 7f5586527740 1 Processor -- start 2024-09-19T04:58:39.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.718+0000 7f5586527740 1 -- start start 2024-09-19T04:58:39.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.718+0000 7f5586527740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641703544a0 0x564170374350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:39.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.718+0000 7f5586527740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564170354dc0 0x564170374890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:39.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.718+0000 7f5586527740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56417035f680 0x564170359470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:39.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.718+0000 7f5586527740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f557c1ad910 con 0x5641703544a0 2024-09-19T04:58:39.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.718+0000 7f5586527740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f557c1b0170 con 0x56417035f680 2024-09-19T04:58:39.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.718+0000 7f5586527740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f557c1adf60 con 0x564170354dc0 2024-09-19T04:58:39.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.718+0000 7f55816e9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641703544a0 0x564170374350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:39.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.718+0000 7f55816e9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641703544a0 0x564170374350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44470/0 (socket says 172.21.15.2:44470) 2024-09-19T04:58:39.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.718+0000 7f55816e9640 1 -- 172.21.15.2:0/2342430742 learned_addr learned my addr 172.21.15.2:0/2342430742 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:58:39.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.718+0000 7f55816e9640 1 -- 172.21.15.2:0/2342430742 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564170354dc0 msgr2=0x564170374890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:39.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.718+0000 7f55816e9640 1 --2- 172.21.15.2:0/2342430742 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564170354dc0 0x564170374890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:39.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.718+0000 7f55816e9640 1 -- 172.21.15.2:0/2342430742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56417035f680 msgr2=0x564170359470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:39.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.718+0000 7f55816e9640 1 --2- 172.21.15.2:0/2342430742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56417035f680 0x564170359470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:39.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.718+0000 7f55816e9640 1 -- 172.21.15.2:0/2342430742 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56417035a760 con 0x5641703544a0 2024-09-19T04:58:39.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.718+0000 7f55816e9640 1 --2- 172.21.15.2:0/2342430742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641703544a0 0x564170374350 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f556c032ad0 tx=0x7f556c0095a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c97f24fe4eb20a98 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:58:39.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.718+0000 7f55677fe640 1 -- 172.21.15.2:0/2342430742 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f556c035070 con 0x5641703544a0 2024-09-19T04:58:39.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.718+0000 7f55677fe640 1 -- 172.21.15.2:0/2342430742 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f556c0314a0 con 0x5641703544a0 2024-09-19T04:58:39.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.718+0000 7f55677fe640 1 -- 172.21.15.2:0/2342430742 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f556c031710 con 0x5641703544a0 2024-09-19T04:58:39.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.719+0000 7f5586527740 1 -- 172.21.15.2:0/2342430742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641703544a0 msgr2=0x564170374350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:39.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.719+0000 7f5586527740 1 --2- 172.21.15.2:0/2342430742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641703544a0 0x564170374350 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f556c032ad0 tx=0x7f556c0095a0 comp rx=0 tx=0).stop 2024-09-19T04:58:39.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.719+0000 7f5586527740 1 -- 172.21.15.2:0/2342430742 shutdown_connections 2024-09-19T04:58:39.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.719+0000 7f5586527740 1 --2- 172.21.15.2:0/2342430742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56417035f680 0x564170359470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:39.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.719+0000 7f5586527740 1 --2- 172.21.15.2:0/2342430742 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564170354dc0 0x564170374890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:39.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.719+0000 7f5586527740 1 --2- 172.21.15.2:0/2342430742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641703544a0 0x564170374350 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:39.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.719+0000 7f5586527740 1 -- 172.21.15.2:0/2342430742 >> 172.21.15.2:0/2342430742 conn(0x564170350a30 msgr2=0x56417035b300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:58:39.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.719+0000 7f5586527740 1 -- 172.21.15.2:0/2342430742 shutdown_connections 2024-09-19T04:58:39.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.719+0000 7f5586527740 1 -- 172.21.15.2:0/2342430742 wait complete. 2024-09-19T04:58:39.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.719+0000 7f5586527740 1 -- start start 2024-09-19T04:58:39.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.719+0000 7f5586527740 1 Processor -- start 2024-09-19T04:58:39.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.720+0000 7f5586527740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641703544a0 0x564170374bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:39.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.720+0000 7f5586527740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564170354dc0 0x564170371f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:39.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.720+0000 7f5586527740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56417035f680 0x564170372500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:39.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.720+0000 7f5586527740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f557c1ae630 con 0x564170354dc0 2024-09-19T04:58:39.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.720+0000 7f5586527740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f557c1afaa0 con 0x5641703544a0 2024-09-19T04:58:39.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.720+0000 7f5586527740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f557c1aed00 con 0x56417035f680 2024-09-19T04:58:39.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.720+0000 7f5586527740 10 client.0 _ll_register_callbacks cb 0x7f557800b2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:58:39.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.720+0000 7f5581eea640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564170354dc0 0x564170371f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:39.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.720+0000 7f5581eea640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564170354dc0 0x564170371f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44472/0 (socket says 172.21.15.2:44472) 2024-09-19T04:58:39.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.720+0000 7f5581eea640 1 -- 172.21.15.2:0/1547051321 learned_addr learned my addr 172.21.15.2:0/1547051321 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:58:39.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.720+0000 7f5581eea640 1 -- 172.21.15.2:0/1547051321 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56417035f680 msgr2=0x564170372500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:39.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.720+0000 7f55816e9640 1 --2- 172.21.15.2:0/1547051321 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56417035f680 0x564170372500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:39.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.720+0000 7f5581eea640 1 --2- 172.21.15.2:0/1547051321 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56417035f680 0x564170372500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:39.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.720+0000 7f55816e9640 1 --2- 172.21.15.2:0/1547051321 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641703544a0 0x564170374bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:39.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.720+0000 7f5581eea640 1 -- 172.21.15.2:0/1547051321 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641703544a0 msgr2=0x564170374bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:58:39.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.720+0000 7f5581eea640 1 --2- 172.21.15.2:0/1547051321 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641703544a0 0x564170374bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:39.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.720+0000 7f5581eea640 1 -- 172.21.15.2:0/1547051321 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564170372d30 con 0x564170354dc0 2024-09-19T04:58:39.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.721+0000 7f5581eea640 1 --2- 172.21.15.2:0/1547051321 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564170354dc0 0x564170371f10 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x56417035baa0 tx=0x7f557800fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c50812d995fe19f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:58:39.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.721+0000 7f55657fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:58:39.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.721+0000 7f55657fa640 1 -- 172.21.15.2:0/1547051321 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f557801b830 con 0x564170354dc0 2024-09-19T04:58:39.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.721+0000 7f55657fa640 1 -- 172.21.15.2:0/1547051321 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f557801b9d0 con 0x564170354dc0 2024-09-19T04:58:39.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.721+0000 7f5586527740 1 -- 172.21.15.2:0/1547051321 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f556c0314a0 con 0x564170354dc0 2024-09-19T04:58:39.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.721+0000 7f55657fa640 1 -- 172.21.15.2:0/1547051321 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f557802b050 con 0x564170354dc0 2024-09-19T04:58:39.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.721+0000 7f5586527740 10 client.16812 fetch_fsmap learned FSMap version 19 2024-09-19T04:58:39.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.721+0000 7f5586527740 1 -- 172.21.15.2:0/1547051321 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5641703d9a30 con 0x564170354dc0 2024-09-19T04:58:39.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.721+0000 7f55657fa640 1 -- 172.21.15.2:0/1547051321 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f556c0314a0 con 0x564170354dc0 2024-09-19T04:58:39.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.721+0000 7f55657fa640 1 -- 172.21.15.2:0/1547051321 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f557801a3c0 con 0x564170354dc0 2024-09-19T04:58:39.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.721+0000 7f5586527740 10 client.16812 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:58:39.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.721+0000 7f5586527740 10 client.16812 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:58:39.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.721+0000 7f5586527740 20 client.16812 populate_metadata read hostname 'smithi002' 2024-09-19T04:58:39.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.721+0000 7f5586527740 1 --2- 172.21.15.2:0/1547051321 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5641703da1e0 0x5641703dc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:58:39.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.721+0000 7f5586527740 4 client.16812 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:58:39.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.721+0000 7f5586527740 1 -- 172.21.15.2:0/1547051321 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5641702c1d60 con 0x5641703da1e0 2024-09-19T04:58:39.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.722+0000 7f55816e9640 1 --2- 172.21.15.2:0/1547051321 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5641703da1e0 0x5641703dc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:58:39.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.723+0000 7f55816e9640 1 --2- 172.21.15.2:0/1547051321 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5641703da1e0 0x5641703dc600 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e589a159c7733bc server_cookie=e59231b1abb3ef6d in_seq=0 out_seq=0 2024-09-19T04:58:39.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.723+0000 7f55657fa640 10 client.16812 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:58:39.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.723+0000 7f55657fa640 1 -- 172.21.15.2:0/1547051321 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5641702c1d60 con 0x5641703da1e0 2024-09-19T04:58:39.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.723+0000 7f55657fa640 10 client.16812 handle_command_reply: tid=0 2024-09-19T04:58:39.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.723+0000 7f5586527740 1 client.16812 shutdown 2024-09-19T04:58:39.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.723+0000 7f5586527740 1 -- 172.21.15.2:0/1547051321 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564170354dc0 msgr2=0x564170371f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:39.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.723+0000 7f5586527740 1 --2- 172.21.15.2:0/1547051321 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564170354dc0 0x564170371f10 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x56417035baa0 tx=0x7f557800fae0 comp rx=0 tx=0).stop 2024-09-19T04:58:39.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.723+0000 7f5586527740 1 -- 172.21.15.2:0/1547051321 shutdown_connections 2024-09-19T04:58:39.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.723+0000 7f5586527740 1 --2- 172.21.15.2:0/1547051321 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5641703da1e0 0x5641703dc600 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:39.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.723+0000 7f5586527740 1 --2- 172.21.15.2:0/1547051321 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56417035f680 0x564170372500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:39.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.723+0000 7f5586527740 1 --2- 172.21.15.2:0/1547051321 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564170354dc0 0x564170371f10 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:39.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.723+0000 7f5586527740 1 --2- 172.21.15.2:0/1547051321 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641703544a0 0x564170374bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:39.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.723+0000 7f55657fa640 0 client.16812 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:58:39.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.723+0000 7f5586527740 1 -- 172.21.15.2:0/1547051321 >> 172.21.15.2:0/1547051321 conn(0x564170350a30 msgr2=0x564170355ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:58:39.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.723+0000 7f5586527740 1 -- 172.21.15.2:0/1547051321 shutdown_connections 2024-09-19T04:58:39.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.723+0000 7f5586527740 1 -- 172.21.15.2:0/1547051321 wait complete. 2024-09-19T04:58:39.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.723+0000 7f5586527740 20 client.16812 trim_cache size 0 max 16384 2024-09-19T04:58:39.741 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:58:39.741 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T04:58:39.741 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-19T04:58:39.741 INFO:teuthology.orchestra.run.smithi002.stdout: "d01a58aa-ba23-435e-b009-dbf0893cc08d": { 2024-09-19T04:58:39.741 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-19T04:58:39.741 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "d01a58aa-ba23-435e-b009-dbf0893cc08d", 2024-09-19T04:58:39.741 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-19T04:58:39.741 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:58:39.741 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:58:39.741 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:58:39.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.724+0000 7f558414e640 1 -- 172.21.15.2:0/3284056410 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f55680a33b0 msgr2=0x7f55680a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:39.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.724+0000 7f558414e640 1 --2- 172.21.15.2:0/3284056410 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f55680a33b0 0x7f55680a5870 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f55740ccaa0 tx=0x7f5574090b10 comp rx=0 tx=0).stop 2024-09-19T04:58:39.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.724+0000 7f558414e640 1 -- 172.21.15.2:0/3284056410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f557c106a90 msgr2=0x7f557c197ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:58:39.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.724+0000 7f558414e640 1 --2- 172.21.15.2:0/3284056410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f557c106a90 0x7f557c197ae0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f557400b970 tx=0x7f557400be30 comp rx=0 tx=0).stop 2024-09-19T04:58:39.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.724+0000 7f558414e640 1 -- 172.21.15.2:0/3284056410 shutdown_connections 2024-09-19T04:58:39.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.724+0000 7f558414e640 1 --2- 172.21.15.2:0/3284056410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f557c106a90 0x7f557c197ae0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:39.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.724+0000 7f558414e640 1 --2- 172.21.15.2:0/3284056410 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f557c101430 0x7f557c1975a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:39.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.724+0000 7f558414e640 1 --2- 172.21.15.2:0/3284056410 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f55680a33b0 0x7f55680a5870 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:39.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.724+0000 7f558414e640 1 --2- 172.21.15.2:0/3284056410 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f557c100a90 0x7f557c197060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:58:39.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.724+0000 7f558414e640 1 -- 172.21.15.2:0/3284056410 >> 172.21.15.2:0/3284056410 conn(0x7f557c0fc7d0 msgr2=0x7f557c0fd030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:58:39.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.724+0000 7f558414e640 1 -- 172.21.15.2:0/3284056410 shutdown_connections 2024-09-19T04:58:39.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:58:39.724+0000 7f558414e640 1 -- 172.21.15.2:0/3284056410 wait complete. 2024-09-19T04:58:39.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:39 smithi018 ceph-mon[34537]: scrub queued for path: / 2024-09-19T04:58:39.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:39 smithi018 ceph-mon[34537]: scrub summary: idle+waiting paths [/] 2024-09-19T04:58:39.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:39 smithi018 ceph-mon[34537]: scrub summary: active paths [/] 2024-09-19T04:58:39.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:39 smithi018 ceph-mon[34537]: scrub summary: idle+waiting paths [/] 2024-09-19T04:58:39.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:39 smithi116 ceph-mon[34477]: scrub queued for path: / 2024-09-19T04:58:39.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:39 smithi116 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-19T04:58:39.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:39 smithi116 ceph-mon[34477]: scrub summary: active paths [/] 2024-09-19T04:58:39.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:39 smithi116 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-19T04:58:40.407 INFO:tasks.cephfs.filesystem:scrub status for tag:d01a58aa-ba23-435e-b009-dbf0893cc08d - {'path': '/', 'tag': 'd01a58aa-ba23-435e-b009-dbf0893cc08d', 'options': 'recursive,force'} 2024-09-19T04:58:40.685 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:40 smithi002 ceph-mon[30975]: pgmap v331: 97 pgs: 97 active+clean; 21 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 55 KiB/s wr, 7 op/s 2024-09-19T04:58:40.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:40 smithi018 ceph-mon[34537]: pgmap v331: 97 pgs: 97 active+clean; 21 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 55 KiB/s wr, 7 op/s 2024-09-19T04:58:40.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:40 smithi116 ceph-mon[34477]: pgmap v331: 97 pgs: 97 active+clean; 21 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 55 KiB/s wr, 7 op/s 2024-09-19T04:58:41.696 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:41 smithi002 ceph-mon[30975]: scrub summary: idle 2024-09-19T04:58:41.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:41 smithi018 ceph-mon[34537]: scrub summary: idle 2024-09-19T04:58:41.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:41 smithi116 ceph-mon[34477]: scrub summary: idle 2024-09-19T04:58:42.806 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:42 smithi018 ceph-mon[34537]: pgmap v332: 97 pgs: 97 active+clean; 22 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 80 KiB/s wr, 11 op/s 2024-09-19T04:58:42.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:42 smithi002 ceph-mon[30975]: pgmap v332: 97 pgs: 97 active+clean; 22 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 80 KiB/s wr, 11 op/s 2024-09-19T04:58:42.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:42 smithi116 ceph-mon[34477]: pgmap v332: 97 pgs: 97 active+clean; 22 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 80 KiB/s wr, 11 op/s 2024-09-19T04:58:44.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:44 smithi018 ceph-mon[34537]: pgmap v333: 97 pgs: 97 active+clean; 22 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 55 KiB/s wr, 7 op/s 2024-09-19T04:58:44.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:44 smithi002 ceph-mon[30975]: pgmap v333: 97 pgs: 97 active+clean; 22 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 55 KiB/s wr, 7 op/s 2024-09-19T04:58:44.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:44 smithi116 ceph-mon[34477]: pgmap v333: 97 pgs: 97 active+clean; 22 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 55 KiB/s wr, 7 op/s 2024-09-19T04:58:46.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:46 smithi018 ceph-mon[34537]: pgmap v334: 97 pgs: 97 active+clean; 22 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 82 KiB/s wr, 11 op/s 2024-09-19T04:58:46.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:46 smithi002 ceph-mon[30975]: pgmap v334: 97 pgs: 97 active+clean; 22 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 82 KiB/s wr, 11 op/s 2024-09-19T04:58:46.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:46 smithi116 ceph-mon[34477]: pgmap v334: 97 pgs: 97 active+clean; 22 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 82 KiB/s wr, 11 op/s 2024-09-19T04:58:48.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:48 smithi018 ceph-mon[34537]: pgmap v335: 97 pgs: 97 active+clean; 22 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 52 KiB/s wr, 7 op/s 2024-09-19T04:58:48.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:48 smithi002 ceph-mon[30975]: pgmap v335: 97 pgs: 97 active+clean; 22 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 52 KiB/s wr, 7 op/s 2024-09-19T04:58:48.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:48 smithi116 ceph-mon[34477]: pgmap v335: 97 pgs: 97 active+clean; 22 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 52 KiB/s wr, 7 op/s 2024-09-19T04:58:50.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:50 smithi018 ceph-mon[34537]: pgmap v336: 97 pgs: 97 active+clean; 22 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 52 KiB/s wr, 7 op/s 2024-09-19T04:58:50.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:50 smithi002 ceph-mon[30975]: pgmap v336: 97 pgs: 97 active+clean; 22 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 52 KiB/s wr, 7 op/s 2024-09-19T04:58:50.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:50 smithi116 ceph-mon[34477]: pgmap v336: 97 pgs: 97 active+clean; 22 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 52 KiB/s wr, 7 op/s 2024-09-19T04:58:52.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:52 smithi018 ceph-mon[34537]: pgmap v337: 97 pgs: 97 active+clean; 22 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 77 KiB/s wr, 10 op/s 2024-09-19T04:58:52.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:52 smithi002 ceph-mon[30975]: pgmap v337: 97 pgs: 97 active+clean; 22 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 77 KiB/s wr, 10 op/s 2024-09-19T04:58:52.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:52 smithi116 ceph-mon[34477]: pgmap v337: 97 pgs: 97 active+clean; 22 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 77 KiB/s wr, 10 op/s 2024-09-19T04:58:54.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:54 smithi018 ceph-mon[34537]: pgmap v338: 97 pgs: 97 active+clean; 22 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 51 KiB/s wr, 6 op/s 2024-09-19T04:58:54.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:54 smithi002 ceph-mon[30975]: pgmap v338: 97 pgs: 97 active+clean; 22 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 51 KiB/s wr, 6 op/s 2024-09-19T04:58:54.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:54 smithi116 ceph-mon[34477]: pgmap v338: 97 pgs: 97 active+clean; 22 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 51 KiB/s wr, 6 op/s 2024-09-19T04:58:56.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:56 smithi018 ceph-mon[34537]: pgmap v339: 97 pgs: 97 active+clean; 22 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 79 KiB/s wr, 10 op/s 2024-09-19T04:58:56.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:56 smithi002 ceph-mon[30975]: pgmap v339: 97 pgs: 97 active+clean; 22 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 79 KiB/s wr, 10 op/s 2024-09-19T04:58:56.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:56 smithi116 ceph-mon[34477]: pgmap v339: 97 pgs: 97 active+clean; 22 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 79 KiB/s wr, 10 op/s 2024-09-19T04:58:58.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:58:58 smithi018 ceph-mon[34537]: pgmap v340: 97 pgs: 97 active+clean; 22 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 52 KiB/s wr, 7 op/s 2024-09-19T04:58:58.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:58:58 smithi002 ceph-mon[30975]: pgmap v340: 97 pgs: 97 active+clean; 22 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 52 KiB/s wr, 7 op/s 2024-09-19T04:58:58.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:58:58 smithi116 ceph-mon[34477]: pgmap v340: 97 pgs: 97 active+clean; 22 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 52 KiB/s wr, 7 op/s 2024-09-19T04:59:00.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:00 smithi018 ceph-mon[34537]: pgmap v341: 97 pgs: 97 active+clean; 22 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 52 KiB/s wr, 7 op/s 2024-09-19T04:59:00.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:00 smithi002 ceph-mon[30975]: pgmap v341: 97 pgs: 97 active+clean; 22 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 52 KiB/s wr, 7 op/s 2024-09-19T04:59:00.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:00 smithi116 ceph-mon[34477]: pgmap v341: 97 pgs: 97 active+clean; 22 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 52 KiB/s wr, 7 op/s 2024-09-19T04:59:02.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:02 smithi018 ceph-mon[34537]: pgmap v342: 97 pgs: 97 active+clean; 23 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 72 KiB/s wr, 10 op/s 2024-09-19T04:59:02.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:02 smithi002 ceph-mon[30975]: pgmap v342: 97 pgs: 97 active+clean; 23 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 72 KiB/s wr, 10 op/s 2024-09-19T04:59:02.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:02 smithi116 ceph-mon[34477]: pgmap v342: 97 pgs: 97 active+clean; 23 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 72 KiB/s wr, 10 op/s 2024-09-19T04:59:04.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:04 smithi018 ceph-mon[34537]: pgmap v343: 97 pgs: 97 active+clean; 23 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 47 KiB/s wr, 6 op/s 2024-09-19T04:59:04.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:04 smithi002 ceph-mon[30975]: pgmap v343: 97 pgs: 97 active+clean; 23 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 47 KiB/s wr, 6 op/s 2024-09-19T04:59:04.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:04 smithi116 ceph-mon[34477]: pgmap v343: 97 pgs: 97 active+clean; 23 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 47 KiB/s wr, 6 op/s 2024-09-19T04:59:06.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:06 smithi018 ceph-mon[34537]: pgmap v344: 97 pgs: 97 active+clean; 23 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 125 KiB/s wr, 27 op/s 2024-09-19T04:59:06.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:06 smithi018 ceph-mon[34537]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T04:59:06.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:06 smithi002 ceph-mon[30975]: pgmap v344: 97 pgs: 97 active+clean; 23 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 125 KiB/s wr, 27 op/s 2024-09-19T04:59:06.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:06 smithi002 ceph-mon[30975]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T04:59:06.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:06 smithi116 ceph-mon[34477]: pgmap v344: 97 pgs: 97 active+clean; 23 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 125 KiB/s wr, 27 op/s 2024-09-19T04:59:06.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:06 smithi116 ceph-mon[34477]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T04:59:08.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:08 smithi018 ceph-mon[34537]: pgmap v346: 97 pgs: 97 active+clean; 23 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 117 KiB/s wr, 28 op/s 2024-09-19T04:59:08.859 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:08 smithi002 ceph-mon[30975]: pgmap v346: 97 pgs: 97 active+clean; 23 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 117 KiB/s wr, 28 op/s 2024-09-19T04:59:08.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:08 smithi116 ceph-mon[34477]: pgmap v346: 97 pgs: 97 active+clean; 23 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 117 KiB/s wr, 28 op/s 2024-09-19T04:59:10.408 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:59:10.672 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:59:10.793 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:10 smithi002 ceph-mon[30975]: pgmap v347: 97 pgs: 97 active+clean; 23 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 117 KiB/s wr, 28 op/s 2024-09-19T04:59:10.806 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:10 smithi018 ceph-mon[34537]: pgmap v347: 97 pgs: 97 active+clean; 23 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 117 KiB/s wr, 28 op/s 2024-09-19T04:59:10.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:10 smithi116 ceph-mon[34477]: pgmap v347: 97 pgs: 97 active+clean; 23 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 117 KiB/s wr, 28 op/s 2024-09-19T04:59:11.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.289+0000 7f6ee7c22640 1 -- 172.21.15.2:0/2331787442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ee01036c0 msgr2=0x7f6ee010bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:11.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.289+0000 7f6ee7c22640 1 --2- 172.21.15.2:0/2331787442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ee01036c0 0x7f6ee010bbb0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0009900 tx=0x7f6ed002a480 comp rx=0 tx=0).stop 2024-09-19T04:59:11.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.289+0000 7f6ee7c22640 1 -- 172.21.15.2:0/2331787442 shutdown_connections 2024-09-19T04:59:11.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.289+0000 7f6ee7c22640 1 --2- 172.21.15.2:0/2331787442 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6ee010c180 0x7f6ee010e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:11.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.289+0000 7f6ee7c22640 1 --2- 172.21.15.2:0/2331787442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ee01036c0 0x7f6ee010bbb0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:11.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.289+0000 7f6ee7c22640 1 --2- 172.21.15.2:0/2331787442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ee0102da0 0x7f6ee0103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:11.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.289+0000 7f6ee7c22640 1 -- 172.21.15.2:0/2331787442 >> 172.21.15.2:0/2331787442 conn(0x7f6ee00fc7a0 msgr2=0x7f6ee00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:11.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.289+0000 7f6ee7c22640 1 -- 172.21.15.2:0/2331787442 shutdown_connections 2024-09-19T04:59:11.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.289+0000 7f6ee7c22640 1 -- 172.21.15.2:0/2331787442 wait complete. 2024-09-19T04:59:11.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.290+0000 7f6ee7c22640 1 Processor -- start 2024-09-19T04:59:11.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.290+0000 7f6ee7c22640 1 -- start start 2024-09-19T04:59:11.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.290+0000 7f6ee7c22640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ee0102da0 0x7f6ee0100a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:11.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.290+0000 7f6ee7c22640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6ee01036c0 0x7f6ee0100f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:11.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.290+0000 7f6ee7c22640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ee010c180 0x7f6ee0101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:11.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.290+0000 7f6ee7c22640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee0111e10 con 0x7f6ee0102da0 2024-09-19T04:59:11.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.290+0000 7f6ee7c22640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee0111c90 con 0x7f6ee010c180 2024-09-19T04:59:11.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.290+0000 7f6ee7c22640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee0111f90 con 0x7f6ee01036c0 2024-09-19T04:59:11.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.290+0000 7f6ee59be640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ee0102da0 0x7f6ee0100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:11.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.290+0000 7f6ee59be640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ee0102da0 0x7f6ee0100a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38788/0 (socket says 172.21.15.2:38788) 2024-09-19T04:59:11.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.290+0000 7f6ee59be640 1 -- 172.21.15.2:0/243750348 learned_addr learned my addr 172.21.15.2:0/243750348 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:59:11.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.290+0000 7f6ee51bd640 1 --2- 172.21.15.2:0/243750348 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6ee01036c0 0x7f6ee0100f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:11.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.291+0000 7f6ee61bf640 1 --2- 172.21.15.2:0/243750348 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ee010c180 0x7f6ee0101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:11.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.291+0000 7f6ee59be640 1 -- 172.21.15.2:0/243750348 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6ee01036c0 msgr2=0x7f6ee0100f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:11.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.291+0000 7f6ee59be640 1 --2- 172.21.15.2:0/243750348 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6ee01036c0 0x7f6ee0100f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:11.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.291+0000 7f6ee59be640 1 -- 172.21.15.2:0/243750348 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ee010c180 msgr2=0x7f6ee0101480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:11.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.291+0000 7f6ee59be640 1 --2- 172.21.15.2:0/243750348 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ee010c180 0x7f6ee0101480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:11.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.291+0000 7f6ee59be640 1 -- 172.21.15.2:0/243750348 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ee01a6790 con 0x7f6ee0102da0 2024-09-19T04:59:11.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.291+0000 7f6ee59be640 1 --2- 172.21.15.2:0/243750348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ee0102da0 0x7f6ee0100a00 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f6edc00c920 tx=0x7f6edc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:11.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.291+0000 7f6ed6ffd640 1 -- 172.21.15.2:0/243750348 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6edc007c70 con 0x7f6ee0102da0 2024-09-19T04:59:11.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.291+0000 7f6ed6ffd640 1 -- 172.21.15.2:0/243750348 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6edc007e10 con 0x7f6ee0102da0 2024-09-19T04:59:11.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.291+0000 7f6ee7c22640 1 -- 172.21.15.2:0/243750348 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ee01a6a80 con 0x7f6ee0102da0 2024-09-19T04:59:11.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.291+0000 7f6ed6ffd640 1 -- 172.21.15.2:0/243750348 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6edc018820 con 0x7f6ee0102da0 2024-09-19T04:59:11.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.291+0000 7f6ee7c22640 1 -- 172.21.15.2:0/243750348 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ee01a6f90 con 0x7f6ee0102da0 2024-09-19T04:59:11.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.293+0000 7f6ed6ffd640 1 -- 172.21.15.2:0/243750348 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f6edc0189c0 con 0x7f6ee0102da0 2024-09-19T04:59:11.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.294+0000 7f6ee9ffb740 1 Processor -- start 2024-09-19T04:59:11.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.294+0000 7f6ee9ffb740 1 -- start start 2024-09-19T04:59:11.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.294+0000 7f6ee9ffb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c6bbc34a0 0x558c6bbc3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:11.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.294+0000 7f6ee9ffb740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558c6bbc3dc0 0x558c6bbce140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:11.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.294+0000 7f6ee9ffb740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c6bbce680 0x558c6bbd0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:11.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.294+0000 7f6ee9ffb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558c6bb292e0 con 0x558c6bbc34a0 2024-09-19T04:59:11.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.294+0000 7f6ee9ffb740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558c6bad0ce0 con 0x558c6bbce680 2024-09-19T04:59:11.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.294+0000 7f6ee9ffb740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x558c6bb252a0 con 0x558c6bbc3dc0 2024-09-19T04:59:11.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.294+0000 7f6ee61bf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c6bbc34a0 0x558c6bbc3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:11.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.294+0000 7f6ee59be640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558c6bbc3dc0 0x558c6bbce140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:11.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.294+0000 7f6ee61bf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c6bbc34a0 0x558c6bbc3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38798/0 (socket says 172.21.15.2:38798) 2024-09-19T04:59:11.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.294+0000 7f6ee61bf640 1 -- 172.21.15.2:0/1092973541 learned_addr learned my addr 172.21.15.2:0/1092973541 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:59:11.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.294+0000 7f6ed6ffd640 1 --2- 172.21.15.2:0/243750348 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f6ecc0a33b0 0x7f6ecc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:11.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.294+0000 7f6ee51bd640 1 --2- 172.21.15.2:0/1092973541 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c6bbce680 0x558c6bbd0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:11.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.295+0000 7f6ee61bf640 1 --2- 172.21.15.2:0/243750348 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f6ecc0a33b0 0x7f6ecc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:11.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.295+0000 7f6ee61bf640 1 -- 172.21.15.2:0/1092973541 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558c6bbc3dc0 msgr2=0x558c6bbce140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:59:11.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.295+0000 7f6ed6ffd640 1 -- 172.21.15.2:0/243750348 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7f6edc0cfee0 con 0x7f6ee0102da0 2024-09-19T04:59:11.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.295+0000 7f6ee61bf640 1 --2- 172.21.15.2:0/1092973541 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558c6bbc3dc0 0x558c6bbce140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:11.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.295+0000 7f6ee61bf640 1 -- 172.21.15.2:0/1092973541 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c6bbce680 msgr2=0x558c6bbd0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:59:11.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.295+0000 7f6ee61bf640 1 --2- 172.21.15.2:0/1092973541 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c6bbce680 0x558c6bbd0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:11.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.295+0000 7f6ee61bf640 1 -- 172.21.15.2:0/1092973541 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c6bab5440 con 0x558c6bbc34a0 2024-09-19T04:59:11.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.295+0000 7f6ee51bd640 1 --2- 172.21.15.2:0/1092973541 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c6bbce680 0x558c6bbd0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:59:11.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.295+0000 7f6ee61bf640 1 --2- 172.21.15.2:0/1092973541 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c6bbc34a0 0x558c6bbc3880 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8013840 tx=0x7f6ed8013d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e5c948c86c933af server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:11.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.295+0000 7f6ecbfff640 1 -- 172.21.15.2:0/1092973541 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed8013250 con 0x558c6bbc34a0 2024-09-19T04:59:11.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.295+0000 7f6ecbfff640 1 -- 172.21.15.2:0/1092973541 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6ed8003e20 con 0x558c6bbc34a0 2024-09-19T04:59:11.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.295+0000 7f6ecbfff640 1 -- 172.21.15.2:0/1092973541 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed8004730 con 0x558c6bbc34a0 2024-09-19T04:59:11.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.295+0000 7f6ee61bf640 1 --2- 172.21.15.2:0/243750348 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f6ecc0a33b0 0x7f6ecc0a5870 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8020000 tx=0x7f6ed801e000 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:11.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.296+0000 7f6ee9ffb740 1 -- 172.21.15.2:0/1092973541 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c6bbc34a0 msgr2=0x558c6bbc3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:11.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.296+0000 7f6ee9ffb740 1 --2- 172.21.15.2:0/1092973541 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c6bbc34a0 0x558c6bbc3880 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8013840 tx=0x7f6ed8013d00 comp rx=0 tx=0).stop 2024-09-19T04:59:11.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.296+0000 7f6ee9ffb740 1 -- 172.21.15.2:0/1092973541 shutdown_connections 2024-09-19T04:59:11.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.296+0000 7f6ee9ffb740 1 --2- 172.21.15.2:0/1092973541 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c6bbce680 0x558c6bbd0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:11.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.296+0000 7f6ee9ffb740 1 --2- 172.21.15.2:0/1092973541 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558c6bbc3dc0 0x558c6bbce140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:11.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.296+0000 7f6ee9ffb740 1 --2- 172.21.15.2:0/1092973541 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c6bbc34a0 0x558c6bbc3880 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:11.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.296+0000 7f6ee9ffb740 1 -- 172.21.15.2:0/1092973541 >> 172.21.15.2:0/1092973541 conn(0x558c6bbbfa30 msgr2=0x558c6bbbfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:11.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.296+0000 7f6ee9ffb740 1 -- 172.21.15.2:0/1092973541 shutdown_connections 2024-09-19T04:59:11.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.296+0000 7f6ee9ffb740 1 -- 172.21.15.2:0/1092973541 wait complete. 2024-09-19T04:59:11.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.296+0000 7f6ee9ffb740 1 -- start start 2024-09-19T04:59:11.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.297+0000 7f6ee9ffb740 1 Processor -- start 2024-09-19T04:59:11.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.297+0000 7f6ee9ffb740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c6bbc34a0 0x558c6bbcdf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:11.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.297+0000 7f6ee9ffb740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558c6bbc3dc0 0x558c6bbcb220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:11.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.297+0000 7f6ee9ffb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c6bbce680 0x558c6bbcb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:11.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.297+0000 7f6ee9ffb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558c6bbd1250 con 0x558c6bbce680 2024-09-19T04:59:11.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.297+0000 7f6ee9ffb740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558c6bae4050 con 0x558c6bbc34a0 2024-09-19T04:59:11.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.297+0000 7f6ee9ffb740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x558c6bbd13d0 con 0x558c6bbc3dc0 2024-09-19T04:59:11.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.297+0000 7f6ee9ffb740 10 client.0 _ll_register_callbacks cb 0x558c6bb24160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:59:11.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.297+0000 7f6ee61bf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c6bbce680 0x558c6bbcb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:11.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.297+0000 7f6ee61bf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c6bbce680 0x558c6bbcb760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38808/0 (socket says 172.21.15.2:38808) 2024-09-19T04:59:11.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.297+0000 7f6ee61bf640 1 -- 172.21.15.2:0/2189309867 learned_addr learned my addr 172.21.15.2:0/2189309867 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:59:11.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.297+0000 7f6ee51bd640 1 --2- 172.21.15.2:0/2189309867 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558c6bbc3dc0 0x558c6bbcb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:11.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.297+0000 7f6ee59be640 1 --2- 172.21.15.2:0/2189309867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c6bbc34a0 0x558c6bbcdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:11.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.298+0000 7f6ee61bf640 1 -- 172.21.15.2:0/2189309867 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558c6bbc3dc0 msgr2=0x558c6bbcb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:59:11.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.298+0000 7f6ee61bf640 1 --2- 172.21.15.2:0/2189309867 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558c6bbc3dc0 0x558c6bbcb220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:11.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.298+0000 7f6ee61bf640 1 -- 172.21.15.2:0/2189309867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c6bbc34a0 msgr2=0x558c6bbcdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:59:11.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.298+0000 7f6ee61bf640 1 --2- 172.21.15.2:0/2189309867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c6bbc34a0 0x558c6bbcdf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:11.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.298+0000 7f6ee61bf640 1 -- 172.21.15.2:0/2189309867 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c6b89a3c0 con 0x558c6bbce680 2024-09-19T04:59:11.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.298+0000 7f6ee59be640 1 --2- 172.21.15.2:0/2189309867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c6bbc34a0 0x558c6bbcdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:59:11.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.298+0000 7f6ee61bf640 1 --2- 172.21.15.2:0/2189309867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c6bbce680 0x558c6bbcb760 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8009d60 tx=0x7f6ed80096c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2689676ef3a65dea server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:11.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.298+0000 7f6ec97fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:59:11.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.298+0000 7f6ec97fa640 1 -- 172.21.15.2:0/2189309867 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed8004000 con 0x558c6bbce680 2024-09-19T04:59:11.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.298+0000 7f6ec97fa640 1 -- 172.21.15.2:0/2189309867 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7f6ed80041a0 con 0x558c6bbce680 2024-09-19T04:59:11.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.298+0000 7f6ee9ffb740 1 -- 172.21.15.2:0/2189309867 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ed8003e20 con 0x558c6bbce680 2024-09-19T04:59:11.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.298+0000 7f6ec97fa640 1 -- 172.21.15.2:0/2189309867 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f6ed8004530 con 0x558c6bbce680 2024-09-19T04:59:11.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.298+0000 7f6ee9ffb740 10 client.16824 fetch_fsmap learned FSMap version 19 2024-09-19T04:59:11.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.298+0000 7f6ee9ffb740 1 -- 172.21.15.2:0/2189309867 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x558c6bbdcbc0 con 0x558c6bbce680 2024-09-19T04:59:11.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.298+0000 7f6ec97fa640 1 -- 172.21.15.2:0/2189309867 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6ed8003e20 con 0x558c6bbce680 2024-09-19T04:59:11.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.298+0000 7f6ec97fa640 1 -- 172.21.15.2:0/2189309867 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f6ed803b070 con 0x558c6bbce680 2024-09-19T04:59:11.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.299+0000 7f6ee9ffb740 10 client.16824 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:59:11.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.299+0000 7f6ee9ffb740 10 client.16824 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:59:11.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.299+0000 7f6ee9ffb740 20 client.16824 populate_metadata read hostname 'smithi002' 2024-09-19T04:59:11.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.299+0000 7f6ee9ffb740 1 --2- 172.21.15.2:0/2189309867 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558c6bbde020 0x558c6bbe0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:11.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.299+0000 7f6ee9ffb740 4 client.16824 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:59:11.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.299+0000 7f6ee9ffb740 1 -- 172.21.15.2:0/2189309867 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c6bb36850 con 0x558c6bbde020 2024-09-19T04:59:11.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.299+0000 7f6ee59be640 1 --2- 172.21.15.2:0/2189309867 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558c6bbde020 0x558c6bbe0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:11.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.299+0000 7f6ee59be640 1 --2- 172.21.15.2:0/2189309867 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558c6bbde020 0x558c6bbe0410 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fc6a78457259c0c server_cookie=a99b2a68ed90b884 in_seq=0 out_seq=0 2024-09-19T04:59:11.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.299+0000 7f6ec97fa640 10 client.16824 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:59:11.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.300+0000 7f6ec97fa640 1 -- 172.21.15.2:0/2189309867 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558c6bb36850 con 0x558c6bbde020 2024-09-19T04:59:11.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.300+0000 7f6ec97fa640 10 client.16824 handle_command_reply: tid=0 2024-09-19T04:59:11.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.300+0000 7f6ee9ffb740 1 client.16824 shutdown 2024-09-19T04:59:11.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.300+0000 7f6ee9ffb740 1 -- 172.21.15.2:0/2189309867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c6bbce680 msgr2=0x558c6bbcb760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:11.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.300+0000 7f6ee9ffb740 1 --2- 172.21.15.2:0/2189309867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c6bbce680 0x558c6bbcb760 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8009d60 tx=0x7f6ed80096c0 comp rx=0 tx=0).stop 2024-09-19T04:59:11.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.300+0000 7f6ee9ffb740 1 -- 172.21.15.2:0/2189309867 shutdown_connections 2024-09-19T04:59:11.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.300+0000 7f6ee9ffb740 1 --2- 172.21.15.2:0/2189309867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c6bbce680 0x558c6bbcb760 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:11.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.300+0000 7f6ee9ffb740 1 --2- 172.21.15.2:0/2189309867 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558c6bbde020 0x558c6bbe0410 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:11.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.300+0000 7f6ee9ffb740 1 --2- 172.21.15.2:0/2189309867 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558c6bbc3dc0 0x558c6bbcb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:11.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.300+0000 7f6ee9ffb740 1 --2- 172.21.15.2:0/2189309867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c6bbc34a0 0x558c6bbcdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:11.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.300+0000 7f6ee9ffb740 1 -- 172.21.15.2:0/2189309867 >> 172.21.15.2:0/2189309867 conn(0x558c6bbbfa30 msgr2=0x558c6bbc5710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:11.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.300+0000 7f6ec97fa640 0 client.16824 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:59:11.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.300+0000 7f6ee9ffb740 1 -- 172.21.15.2:0/2189309867 shutdown_connections 2024-09-19T04:59:11.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.300+0000 7f6ee9ffb740 1 -- 172.21.15.2:0/2189309867 wait complete. 2024-09-19T04:59:11.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.300+0000 7f6ee9ffb740 20 client.16824 trim_cache size 0 max 16384 2024-09-19T04:59:11.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.317+0000 7f6ee9ffb740 1 Processor -- start 2024-09-19T04:59:11.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.318+0000 7f6ee9ffb740 1 -- start start 2024-09-19T04:59:11.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.318+0000 7f6ee9ffb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c6bbc34a0 0x558c6bbda4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:11.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.318+0000 7f6ee9ffb740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c6bbc3dc0 0x558c6bbe5a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:11.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.318+0000 7f6ee9ffb740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558c6bbce680 0x558c6bbe5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:11.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.318+0000 7f6ee9ffb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee01ad990 con 0x558c6bbc34a0 2024-09-19T04:59:11.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.318+0000 7f6ee9ffb740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee01b01f0 con 0x558c6bbc3dc0 2024-09-19T04:59:11.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.318+0000 7f6ee9ffb740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee01adfe0 con 0x558c6bbce680 2024-09-19T04:59:11.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.318+0000 7f6ee59be640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c6bbc34a0 0x558c6bbda4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:11.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.318+0000 7f6ee59be640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c6bbc34a0 0x558c6bbda4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38816/0 (socket says 172.21.15.2:38816) 2024-09-19T04:59:11.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.318+0000 7f6ee59be640 1 -- 172.21.15.2:0/322258028 learned_addr learned my addr 172.21.15.2:0/322258028 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:59:11.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.318+0000 7f6ee51bd640 1 --2- 172.21.15.2:0/322258028 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c6bbc3dc0 0x558c6bbe5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:11.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.318+0000 7f6ee61bf640 1 --2- 172.21.15.2:0/322258028 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558c6bbce680 0x558c6bbe5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:11.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.318+0000 7f6ee59be640 1 -- 172.21.15.2:0/322258028 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558c6bbce680 msgr2=0x558c6bbe5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:59:11.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.318+0000 7f6ee59be640 1 --2- 172.21.15.2:0/322258028 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558c6bbce680 0x558c6bbe5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:11.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.318+0000 7f6ee59be640 1 -- 172.21.15.2:0/322258028 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c6bbc3dc0 msgr2=0x558c6bbe5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:59:11.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.318+0000 7f6ee59be640 1 --2- 172.21.15.2:0/322258028 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c6bbc3dc0 0x558c6bbe5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:11.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.318+0000 7f6ee59be640 1 -- 172.21.15.2:0/322258028 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c6bbc3bf0 con 0x558c6bbc34a0 2024-09-19T04:59:11.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.318+0000 7f6ee61bf640 1 --2- 172.21.15.2:0/322258028 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558c6bbce680 0x558c6bbe5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:59:11.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.319+0000 7f6ee59be640 1 --2- 172.21.15.2:0/322258028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c6bbc34a0 0x558c6bbda4b0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f6edc098590 tx=0x7f6edc0cf040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bded4a27538c75ed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:11.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.319+0000 7f6ecb7fe640 1 -- 172.21.15.2:0/322258028 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6edc0a4da0 con 0x558c6bbc34a0 2024-09-19T04:59:11.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.319+0000 7f6ecb7fe640 1 -- 172.21.15.2:0/322258028 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6edc09c130 con 0x558c6bbc34a0 2024-09-19T04:59:11.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.319+0000 7f6ecb7fe640 1 -- 172.21.15.2:0/322258028 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6edc0987a0 con 0x558c6bbc34a0 2024-09-19T04:59:11.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.320+0000 7f6ee9ffb740 1 -- 172.21.15.2:0/322258028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c6bbc34a0 msgr2=0x558c6bbda4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:11.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.320+0000 7f6ee9ffb740 1 --2- 172.21.15.2:0/322258028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c6bbc34a0 0x558c6bbda4b0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f6edc098590 tx=0x7f6edc0cf040 comp rx=0 tx=0).stop 2024-09-19T04:59:11.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.320+0000 7f6ee9ffb740 1 -- 172.21.15.2:0/322258028 shutdown_connections 2024-09-19T04:59:11.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.320+0000 7f6ee9ffb740 1 --2- 172.21.15.2:0/322258028 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558c6bbce680 0x558c6bbe5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:11.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.320+0000 7f6ee9ffb740 1 --2- 172.21.15.2:0/322258028 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c6bbc3dc0 0x558c6bbe5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:11.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.320+0000 7f6ee9ffb740 1 --2- 172.21.15.2:0/322258028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c6bbc34a0 0x558c6bbda4b0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:11.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.320+0000 7f6ee9ffb740 1 -- 172.21.15.2:0/322258028 >> 172.21.15.2:0/322258028 conn(0x558c6bbbfa30 msgr2=0x558c6bbca310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:11.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.320+0000 7f6ee9ffb740 1 -- 172.21.15.2:0/322258028 shutdown_connections 2024-09-19T04:59:11.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.320+0000 7f6ee9ffb740 1 -- 172.21.15.2:0/322258028 wait complete. 2024-09-19T04:59:11.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.320+0000 7f6ee9ffb740 1 -- start start 2024-09-19T04:59:11.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.321+0000 7f6ee9ffb740 1 Processor -- start 2024-09-19T04:59:11.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.321+0000 7f6ee9ffb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c6bbc34a0 0x558c6bbd69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:11.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.321+0000 7f6ee9ffb740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c6bbc3dc0 0x558c6bbd6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:11.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.321+0000 7f6ee9ffb740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558c6bbce680 0x558c6bbd3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:11.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.321+0000 7f6ee9ffb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee01ae6b0 con 0x558c6bbc34a0 2024-09-19T04:59:11.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.321+0000 7f6ee9ffb740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee01afb20 con 0x558c6bbc3dc0 2024-09-19T04:59:11.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.321+0000 7f6ee9ffb740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee01aed80 con 0x558c6bbce680 2024-09-19T04:59:11.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.321+0000 7f6ee59be640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c6bbc34a0 0x558c6bbd69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:11.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.321+0000 7f6ee59be640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c6bbc34a0 0x558c6bbd69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38828/0 (socket says 172.21.15.2:38828) 2024-09-19T04:59:11.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.321+0000 7f6ee59be640 1 -- 172.21.15.2:0/3362240834 learned_addr learned my addr 172.21.15.2:0/3362240834 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:59:11.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.321+0000 7f6ee9ffb740 10 client.0 _ll_register_callbacks cb 0x7f6edc09bf00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:59:11.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.321+0000 7f6ee51bd640 1 --2- 172.21.15.2:0/3362240834 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c6bbc3dc0 0x558c6bbd6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:11.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.321+0000 7f6ee61bf640 1 --2- 172.21.15.2:0/3362240834 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558c6bbce680 0x558c6bbd3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:11.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.322+0000 7f6ee59be640 1 -- 172.21.15.2:0/3362240834 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558c6bbce680 msgr2=0x558c6bbd3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:59:11.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.322+0000 7f6ee59be640 1 --2- 172.21.15.2:0/3362240834 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558c6bbce680 0x558c6bbd3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:11.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.322+0000 7f6ee59be640 1 -- 172.21.15.2:0/3362240834 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c6bbc3dc0 msgr2=0x558c6bbd6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:59:11.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.322+0000 7f6ee59be640 1 --2- 172.21.15.2:0/3362240834 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c6bbc3dc0 0x558c6bbd6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:11.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.322+0000 7f6ee59be640 1 -- 172.21.15.2:0/3362240834 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c6bbd47a0 con 0x558c6bbc34a0 2024-09-19T04:59:11.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.322+0000 7f6ee51bd640 1 --2- 172.21.15.2:0/3362240834 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c6bbc3dc0 0x558c6bbd6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:59:11.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.322+0000 7f6ee59be640 1 --2- 172.21.15.2:0/3362240834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c6bbc34a0 0x558c6bbd69f0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f6edc09bb60 tx=0x7f6edc09c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfe3e5d3967ebd4e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:11.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.322+0000 7f6ec97fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:59:11.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.322+0000 7f6ec97fa640 1 -- 172.21.15.2:0/3362240834 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6edc0a4da0 con 0x558c6bbc34a0 2024-09-19T04:59:11.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.322+0000 7f6ec97fa640 1 -- 172.21.15.2:0/3362240834 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7f6edc0bc0b0 con 0x558c6bbc34a0 2024-09-19T04:59:11.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.322+0000 7f6ee9ffb740 1 -- 172.21.15.2:0/3362240834 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6edc09c130 con 0x558c6bbc34a0 2024-09-19T04:59:11.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.322+0000 7f6ec97fa640 1 -- 172.21.15.2:0/3362240834 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f6edc0987a0 con 0x558c6bbc34a0 2024-09-19T04:59:11.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.322+0000 7f6ee9ffb740 10 client.16830 fetch_fsmap learned FSMap version 19 2024-09-19T04:59:11.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.322+0000 7f6ee9ffb740 1 -- 172.21.15.2:0/3362240834 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x558c6bc48610 con 0x558c6bbc34a0 2024-09-19T04:59:11.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.323+0000 7f6ec97fa640 1 -- 172.21.15.2:0/3362240834 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6edc09c130 con 0x558c6bbc34a0 2024-09-19T04:59:11.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.323+0000 7f6ec97fa640 1 -- 172.21.15.2:0/3362240834 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f6edc097e80 con 0x558c6bbc34a0 2024-09-19T04:59:11.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.323+0000 7f6ee9ffb740 10 client.16830 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:59:11.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.323+0000 7f6ee9ffb740 10 client.16830 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:59:11.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.323+0000 7f6ee9ffb740 20 client.16830 populate_metadata read hostname 'smithi002' 2024-09-19T04:59:11.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.323+0000 7f6ee9ffb740 1 --2- 172.21.15.2:0/3362240834 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558c6bc48c80 0x558c6bc4b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:11.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.323+0000 7f6ee9ffb740 4 client.16830 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:59:11.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.323+0000 7f6ee9ffb740 1 -- 172.21.15.2:0/3362240834 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558c6bb30d60 con 0x558c6bc48c80 2024-09-19T04:59:11.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.323+0000 7f6ee51bd640 1 --2- 172.21.15.2:0/3362240834 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558c6bc48c80 0x558c6bc4b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:11.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.324+0000 7f6ee51bd640 1 --2- 172.21.15.2:0/3362240834 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558c6bc48c80 0x558c6bc4b070 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1000e00712e4a917 server_cookie=f91af30ecc2ec0fe in_seq=0 out_seq=0 2024-09-19T04:59:11.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.324+0000 7f6ec97fa640 10 client.16830 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:59:11.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.324+0000 7f6ec97fa640 1 -- 172.21.15.2:0/3362240834 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x558c6bb30d60 con 0x558c6bc48c80 2024-09-19T04:59:11.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.324+0000 7f6ec97fa640 10 client.16830 handle_command_reply: tid=0 2024-09-19T04:59:11.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.324+0000 7f6ee9ffb740 1 client.16830 shutdown 2024-09-19T04:59:11.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.324+0000 7f6ee9ffb740 1 -- 172.21.15.2:0/3362240834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c6bbc34a0 msgr2=0x558c6bbd69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:11.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.324+0000 7f6ee9ffb740 1 --2- 172.21.15.2:0/3362240834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c6bbc34a0 0x558c6bbd69f0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f6edc09bb60 tx=0x7f6edc09c8b0 comp rx=0 tx=0).stop 2024-09-19T04:59:11.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.324+0000 7f6ee9ffb740 1 -- 172.21.15.2:0/3362240834 shutdown_connections 2024-09-19T04:59:11.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.324+0000 7f6ee9ffb740 1 --2- 172.21.15.2:0/3362240834 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558c6bc48c80 0x558c6bc4b070 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:11.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.324+0000 7f6ee9ffb740 1 --2- 172.21.15.2:0/3362240834 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558c6bbce680 0x558c6bbd3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:11.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.324+0000 7f6ee9ffb740 1 --2- 172.21.15.2:0/3362240834 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558c6bbc3dc0 0x558c6bbd6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:11.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.324+0000 7f6ee9ffb740 1 --2- 172.21.15.2:0/3362240834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c6bbc34a0 0x558c6bbd69f0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:11.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.324+0000 7f6ec97fa640 0 client.16830 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:59:11.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.324+0000 7f6ee9ffb740 1 -- 172.21.15.2:0/3362240834 >> 172.21.15.2:0/3362240834 conn(0x558c6bbbfa30 msgr2=0x558c6bbcca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:11.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.324+0000 7f6ee9ffb740 1 -- 172.21.15.2:0/3362240834 shutdown_connections 2024-09-19T04:59:11.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.324+0000 7f6ee9ffb740 1 -- 172.21.15.2:0/3362240834 wait complete. 2024-09-19T04:59:11.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.324+0000 7f6ee9ffb740 20 client.16830 trim_cache size 0 max 16384 2024-09-19T04:59:11.332 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:59:11.332 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T04:59:11.332 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T04:59:11.332 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:59:11.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.325+0000 7f6ee7c22640 1 -- 172.21.15.2:0/243750348 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f6ecc0a33b0 msgr2=0x7f6ecc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:11.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.325+0000 7f6ee7c22640 1 --2- 172.21.15.2:0/243750348 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f6ecc0a33b0 0x7f6ecc0a5870 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8020000 tx=0x7f6ed801e000 comp rx=0 tx=0).stop 2024-09-19T04:59:11.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.325+0000 7f6ee7c22640 1 -- 172.21.15.2:0/243750348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ee0102da0 msgr2=0x7f6ee0100a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:11.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.325+0000 7f6ee7c22640 1 --2- 172.21.15.2:0/243750348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ee0102da0 0x7f6ee0100a00 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f6edc00c920 tx=0x7f6edc00cde0 comp rx=0 tx=0).stop 2024-09-19T04:59:11.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.325+0000 7f6ee7c22640 1 -- 172.21.15.2:0/243750348 shutdown_connections 2024-09-19T04:59:11.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.325+0000 7f6ee7c22640 1 --2- 172.21.15.2:0/243750348 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ee010c180 0x7f6ee0101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:11.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.325+0000 7f6ee7c22640 1 --2- 172.21.15.2:0/243750348 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f6ecc0a33b0 0x7f6ecc0a5870 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:11.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.325+0000 7f6ee7c22640 1 --2- 172.21.15.2:0/243750348 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6ee01036c0 0x7f6ee0100f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:11.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.325+0000 7f6ee7c22640 1 --2- 172.21.15.2:0/243750348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ee0102da0 0x7f6ee0100a00 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:11.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.325+0000 7f6ee7c22640 1 -- 172.21.15.2:0/243750348 >> 172.21.15.2:0/243750348 conn(0x7f6ee00fc7a0 msgr2=0x7f6ee00fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:11.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.325+0000 7f6ee7c22640 1 -- 172.21.15.2:0/243750348 shutdown_connections 2024-09-19T04:59:11.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:11.325+0000 7f6ee7c22640 1 -- 172.21.15.2:0/243750348 wait complete. 2024-09-19T04:59:12.111 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:59:12.112 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:59:12.376 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:59:12.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:12 smithi018 ceph-mon[34537]: pgmap v348: 97 pgs: 97 active+clean; 23 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 125 KiB/s wr, 29 op/s 2024-09-19T04:59:12.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:12 smithi002 ceph-mon[30975]: pgmap v348: 97 pgs: 97 active+clean; 23 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 125 KiB/s wr, 29 op/s 2024-09-19T04:59:12.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:12 smithi116 ceph-mon[34477]: pgmap v348: 97 pgs: 97 active+clean; 23 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 125 KiB/s wr, 29 op/s 2024-09-19T04:59:12.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:12.978+0000 7f9d69ae0640 1 -- 172.21.15.2:0/2185754102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d64101240 msgr2=0x7f9d64101680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:12.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:12.978+0000 7f9d69ae0640 1 --2- 172.21.15.2:0/2185754102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d64101240 0x7f9d64101680 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f9d58009900 tx=0x7f9d5802a410 comp rx=0 tx=0).stop 2024-09-19T04:59:12.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:12.978+0000 7f9d69ae0640 1 -- 172.21.15.2:0/2185754102 shutdown_connections 2024-09-19T04:59:12.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:12.978+0000 7f9d69ae0640 1 --2- 172.21.15.2:0/2185754102 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d64101bc0 0x7f9d6410d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:12.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:12.978+0000 7f9d69ae0640 1 --2- 172.21.15.2:0/2185754102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d64101240 0x7f9d64101680 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:12.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:12.978+0000 7f9d69ae0640 1 --2- 172.21.15.2:0/2185754102 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d64105a90 0x7f9d64105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:12.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:12.978+0000 7f9d69ae0640 1 -- 172.21.15.2:0/2185754102 >> 172.21.15.2:0/2185754102 conn(0x7f9d64077210 msgr2=0x7f9d640fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:12.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:12.978+0000 7f9d69ae0640 1 -- 172.21.15.2:0/2185754102 shutdown_connections 2024-09-19T04:59:12.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:12.978+0000 7f9d69ae0640 1 -- 172.21.15.2:0/2185754102 wait complete. 2024-09-19T04:59:12.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:12.979+0000 7f9d69ae0640 1 Processor -- start 2024-09-19T04:59:12.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:12.979+0000 7f9d69ae0640 1 -- start start 2024-09-19T04:59:12.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:12.979+0000 7f9d69ae0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d64101240 0x7f9d64199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:12.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:12.980+0000 7f9d69ae0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d64101bc0 0x7f9d64199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:12.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:12.980+0000 7f9d69ae0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d64105a90 0x7f9d641a4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:12.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:12.980+0000 7f9d69ae0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9d64110eb0 con 0x7f9d64105a90 2024-09-19T04:59:12.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:12.980+0000 7f9d69ae0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9d64110d30 con 0x7f9d64101240 2024-09-19T04:59:12.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:12.980+0000 7f9d69ae0640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f9d64111030 con 0x7f9d64101bc0 2024-09-19T04:59:12.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:12.980+0000 7f9d63fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d64105a90 0x7f9d641a4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:12.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:12.980+0000 7f9d63fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d64105a90 0x7f9d641a4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49600/0 (socket says 172.21.15.2:49600) 2024-09-19T04:59:12.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:12.980+0000 7f9d63fff640 1 -- 172.21.15.2:0/833767648 learned_addr learned my addr 172.21.15.2:0/833767648 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:59:12.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:12.980+0000 7f9d637fe640 1 --2- 172.21.15.2:0/833767648 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d64101240 0x7f9d64199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:12.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:12.980+0000 7f9d62ffd640 1 --2- 172.21.15.2:0/833767648 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d64101bc0 0x7f9d64199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:12.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:12.980+0000 7f9d63fff640 1 -- 172.21.15.2:0/833767648 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d64101bc0 msgr2=0x7f9d64199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:12.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:12.980+0000 7f9d63fff640 1 --2- 172.21.15.2:0/833767648 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d64101bc0 0x7f9d64199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:12.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:12.980+0000 7f9d63fff640 1 -- 172.21.15.2:0/833767648 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d64101240 msgr2=0x7f9d64199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:12.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:12.980+0000 7f9d63fff640 1 --2- 172.21.15.2:0/833767648 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d64101240 0x7f9d64199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:12.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:12.980+0000 7f9d63fff640 1 -- 172.21.15.2:0/833767648 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d641a48c0 con 0x7f9d64105a90 2024-09-19T04:59:12.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:12.980+0000 7f9d62ffd640 1 --2- 172.21.15.2:0/833767648 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d64101bc0 0x7f9d64199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:59:12.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:12.980+0000 7f9d63fff640 1 --2- 172.21.15.2:0/833767648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d64105a90 0x7f9d641a4380 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c00cad0 tx=0x7f9d5c00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:12.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:12.980+0000 7f9d60ff9640 1 -- 172.21.15.2:0/833767648 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c00ad60 con 0x7f9d64105a90 2024-09-19T04:59:12.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:12.980+0000 7f9d69ae0640 1 -- 172.21.15.2:0/833767648 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d641a4a90 con 0x7f9d64105a90 2024-09-19T04:59:12.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:12.981+0000 7f9d60ff9640 1 -- 172.21.15.2:0/833767648 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9d5c005020 con 0x7f9d64105a90 2024-09-19T04:59:12.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:12.981+0000 7f9d60ff9640 1 -- 172.21.15.2:0/833767648 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c00f6b0 con 0x7f9d64105a90 2024-09-19T04:59:12.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:12.981+0000 7f9d69ae0640 1 -- 172.21.15.2:0/833767648 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d641a4fa0 con 0x7f9d64105a90 2024-09-19T04:59:12.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:12.982+0000 7f9d69ae0640 1 -- 172.21.15.2:0/833767648 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d64101680 con 0x7f9d64105a90 2024-09-19T04:59:12.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:12.983+0000 7f9d60ff9640 1 -- 172.21.15.2:0/833767648 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f9d5c0051d0 con 0x7f9d64105a90 2024-09-19T04:59:12.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:12.983+0000 7f9d60ff9640 1 --2- 172.21.15.2:0/833767648 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f9d4c0a3430 0x7f9d4c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:12.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:12.984+0000 7f9d637fe640 1 --2- 172.21.15.2:0/833767648 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f9d4c0a3430 0x7f9d4c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:12.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:12.984+0000 7f9d60ff9640 1 -- 172.21.15.2:0/833767648 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7f9d5c0cfd40 con 0x7f9d64105a90 2024-09-19T04:59:12.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:12.984+0000 7f9d637fe640 1 --2- 172.21.15.2:0/833767648 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f9d4c0a3430 0x7f9d4c0a58f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9d54009990 tx=0x7f9d54009110 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:12.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:12.988+0000 7f9d60ff9640 1 -- 172.21.15.2:0/833767648 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9d5c014030 con 0x7f9d64105a90 2024-09-19T04:59:13.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:13.202+0000 7f9d69ae0640 1 -- 172.21.15.2:0/833767648 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9d64108fb0 con 0x7f9d64105a90 2024-09-19T04:59:13.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:13.203+0000 7f9d60ff9640 1 -- 172.21.15.2:0/833767648 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11840 (secure 0 0 0) 0x7f9d5c09c6f0 con 0x7f9d64105a90 2024-09-19T04:59:13.204 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:59:13.205 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":19,"btime":"2024-09-19T04:46:33:537239+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2467365137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2467365137},{"type":"v1","addr":"172.21.15.2:6835","nonce":2467365137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3162441888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3162441888},{"type":"v1","addr":"172.21.15.2:6837","nonce":3162441888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14631,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2740862966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2740862966},{"type":"v1","addr":"172.21.15.2:6839","nonce":2740862966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/2394435504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2394435504},{"type":"v1","addr":"172.21.15.2:6841","nonce":2394435504}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1630480244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1630480244},{"type":"v1","addr":"172.21.15.18:6833","nonce":1630480244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1553897465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1553897465},{"type":"v1","addr":"172.21.15.116:6833","nonce":1553897465}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3035664608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3035664608},{"type":"v1","addr":"172.21.15.18:6835","nonce":3035664608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1096622392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1096622392},{"type":"v1","addr":"172.21.15.18:6837","nonce":1096622392}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3761157675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3761157675},{"type":"v1","addr":"172.21.15.116:6835","nonce":3761157675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/1120131594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1120131594},{"type":"v1","addr":"172.21.15.116:6837","nonce":1120131594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:46:24.050115+0000","modified":"2024-09-19T04:46:33.112369+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/4207677139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":4207677139},{"type":"v1","addr":"172.21.15.18:6839","nonce":4207677139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/2346874880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":2346874880},{"type":"v1","addr":"172.21.15.116:6839","nonce":2346874880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496]},"id":1}]} 2024-09-19T04:59:13.205 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 19 2024-09-19T04:59:13.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:13.205+0000 7f9d69ae0640 1 -- 172.21.15.2:0/833767648 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f9d4c0a3430 msgr2=0x7f9d4c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:13.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:13.205+0000 7f9d69ae0640 1 --2- 172.21.15.2:0/833767648 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f9d4c0a3430 0x7f9d4c0a58f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9d54009990 tx=0x7f9d54009110 comp rx=0 tx=0).stop 2024-09-19T04:59:13.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:13.205+0000 7f9d69ae0640 1 -- 172.21.15.2:0/833767648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d64105a90 msgr2=0x7f9d641a4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:13.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:13.205+0000 7f9d69ae0640 1 --2- 172.21.15.2:0/833767648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d64105a90 0x7f9d641a4380 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c00cad0 tx=0x7f9d5c00ced0 comp rx=0 tx=0).stop 2024-09-19T04:59:13.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:13.205+0000 7f9d69ae0640 1 -- 172.21.15.2:0/833767648 shutdown_connections 2024-09-19T04:59:13.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:13.205+0000 7f9d69ae0640 1 --2- 172.21.15.2:0/833767648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d64105a90 0x7f9d641a4380 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:13.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:13.205+0000 7f9d69ae0640 1 --2- 172.21.15.2:0/833767648 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f9d4c0a3430 0x7f9d4c0a58f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:13.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:13.205+0000 7f9d69ae0640 1 --2- 172.21.15.2:0/833767648 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d64101bc0 0x7f9d64199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:13.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:13.205+0000 7f9d69ae0640 1 --2- 172.21.15.2:0/833767648 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d64101240 0x7f9d64199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:13.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:13.205+0000 7f9d69ae0640 1 -- 172.21.15.2:0/833767648 >> 172.21.15.2:0/833767648 conn(0x7f9d64077210 msgr2=0x7f9d64103b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:13.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:13.205+0000 7f9d69ae0640 1 -- 172.21.15.2:0/833767648 shutdown_connections 2024-09-19T04:59:13.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:13.205+0000 7f9d69ae0640 1 -- 172.21.15.2:0/833767648 wait complete. 2024-09-19T04:59:13.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:13 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/833767648' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:59:13.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:13 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/833767648' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:59:13.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:13 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/833767648' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:59:13.918 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:59:14.178 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:59:14.567 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:14 smithi002 ceph-mon[30975]: pgmap v349: 97 pgs: 97 active+clean; 23 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 125 KiB/s wr, 29 op/s 2024-09-19T04:59:14.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.796+0000 7efcc8bb3640 1 -- 172.21.15.2:0/2860940607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcc4101de0 msgr2=0x7efcc41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:14.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.796+0000 7efcc8bb3640 1 --2- 172.21.15.2:0/2860940607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcc4101de0 0x7efcc41021c0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7efcb4009900 tx=0x7efcb402a3f0 comp rx=0 tx=0).stop 2024-09-19T04:59:14.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.796+0000 7efcc8bb3640 1 -- 172.21.15.2:0/2860940607 shutdown_connections 2024-09-19T04:59:14.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.796+0000 7efcc8bb3640 1 --2- 172.21.15.2:0/2860940607 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efcc4106f10 0x7efcc410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:14.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.796+0000 7efcc8bb3640 1 --2- 172.21.15.2:0/2860940607 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcc4102790 0x7efcc41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:14.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.796+0000 7efcc8bb3640 1 --2- 172.21.15.2:0/2860940607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcc4101de0 0x7efcc41021c0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:14.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.796+0000 7efcc8bb3640 1 -- 172.21.15.2:0/2860940607 >> 172.21.15.2:0/2860940607 conn(0x7efcc40fd8c0 msgr2=0x7efcc40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:14.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.796+0000 7efcc8bb3640 1 -- 172.21.15.2:0/2860940607 shutdown_connections 2024-09-19T04:59:14.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.796+0000 7efcc8bb3640 1 -- 172.21.15.2:0/2860940607 wait complete. 2024-09-19T04:59:14.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.797+0000 7efcc8bb3640 1 Processor -- start 2024-09-19T04:59:14.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.797+0000 7efcc8bb3640 1 -- start start 2024-09-19T04:59:14.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.797+0000 7efcc8bb3640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efcc4101de0 0x7efcc41983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:14.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.797+0000 7efcc8bb3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcc4102790 0x7efcc4198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:14.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.798+0000 7efcc8bb3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcc4106f10 0x7efcc419ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:14.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.798+0000 7efcc8bb3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efcc4111e40 con 0x7efcc4102790 2024-09-19T04:59:14.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.798+0000 7efcc8bb3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efcc4111cc0 con 0x7efcc4106f10 2024-09-19T04:59:14.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.798+0000 7efcc8bb3640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7efcc4111fc0 con 0x7efcc4101de0 2024-09-19T04:59:14.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.798+0000 7efcc1d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcc4102790 0x7efcc4198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:14.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.798+0000 7efcc1d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcc4102790 0x7efcc4198920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49616/0 (socket says 172.21.15.2:49616) 2024-09-19T04:59:14.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.798+0000 7efcc1d9b640 1 -- 172.21.15.2:0/1860307044 learned_addr learned my addr 172.21.15.2:0/1860307044 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:59:14.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.798+0000 7efcc2d9d640 1 --2- 172.21.15.2:0/1860307044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcc4106f10 0x7efcc419ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:14.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.798+0000 7efcc259c640 1 --2- 172.21.15.2:0/1860307044 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efcc4101de0 0x7efcc41983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:14.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.798+0000 7efcc1d9b640 1 -- 172.21.15.2:0/1860307044 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efcc4101de0 msgr2=0x7efcc41983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:14.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.798+0000 7efcc1d9b640 1 --2- 172.21.15.2:0/1860307044 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efcc4101de0 0x7efcc41983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:14.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.798+0000 7efcc1d9b640 1 -- 172.21.15.2:0/1860307044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcc4106f10 msgr2=0x7efcc419ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:14.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.798+0000 7efcc1d9b640 1 --2- 172.21.15.2:0/1860307044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcc4106f10 0x7efcc419ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:14.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.798+0000 7efcc1d9b640 1 -- 172.21.15.2:0/1860307044 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc419d390 con 0x7efcc4102790 2024-09-19T04:59:14.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.798+0000 7efcc2d9d640 1 --2- 172.21.15.2:0/1860307044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcc4106f10 0x7efcc419ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:59:14.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.798+0000 7efcc1d9b640 1 --2- 172.21.15.2:0/1860307044 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcc4102790 0x7efcc4198920 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7efcb800d950 tx=0x7efcb800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:14.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.798+0000 7efcb37fe640 1 -- 172.21.15.2:0/1860307044 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb8017070 con 0x7efcc4102790 2024-09-19T04:59:14.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.798+0000 7efcb37fe640 1 -- 172.21.15.2:0/1860307044 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efcb8009c30 con 0x7efcc4102790 2024-09-19T04:59:14.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.798+0000 7efcc8bb3640 1 -- 172.21.15.2:0/1860307044 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcc419d680 con 0x7efcc4102790 2024-09-19T04:59:14.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.798+0000 7efcb37fe640 1 -- 172.21.15.2:0/1860307044 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb800f620 con 0x7efcc4102790 2024-09-19T04:59:14.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.799+0000 7efcc8bb3640 1 -- 172.21.15.2:0/1860307044 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcc41a4f60 con 0x7efcc4102790 2024-09-19T04:59:14.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.801+0000 7efcb37fe640 1 -- 172.21.15.2:0/1860307044 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7efcb80109a0 con 0x7efcc4102790 2024-09-19T04:59:14.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.801+0000 7efccaf8c740 1 Processor -- start 2024-09-19T04:59:14.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.801+0000 7efccaf8c740 1 -- start start 2024-09-19T04:59:14.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.802+0000 7efccaf8c740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564e4ae8eb40 0x564e4ae8d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:14.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.802+0000 7efccaf8c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4ae8d5d0 0x564e4ae8da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:14.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.802+0000 7efccaf8c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e4ae98370 0x564e4ae9a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:14.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.802+0000 7efccaf8c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564e4adf32f0 con 0x564e4ae8d5d0 2024-09-19T04:59:14.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.802+0000 7efccaf8c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564e4ad9acf0 con 0x564e4ae98370 2024-09-19T04:59:14.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.802+0000 7efccaf8c740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x564e4adef2b0 con 0x564e4ae8eb40 2024-09-19T04:59:14.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.802+0000 7efcc259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4ae8d5d0 0x564e4ae8da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:14.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.802+0000 7efcc259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4ae8d5d0 0x564e4ae8da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49626/0 (socket says 172.21.15.2:49626) 2024-09-19T04:59:14.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.802+0000 7efcc259c640 1 -- 172.21.15.2:0/3745417164 learned_addr learned my addr 172.21.15.2:0/3745417164 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:59:14.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.802+0000 7efcb37fe640 1 --2- 172.21.15.2:0/1860307044 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7efcac0a33b0 0x7efcac0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:14.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.802+0000 7efcc2d9d640 1 --2- 172.21.15.2:0/3745417164 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564e4ae8eb40 0x564e4ae8d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:14.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.802+0000 7efcc2d9d640 1 --2- 172.21.15.2:0/1860307044 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7efcac0a33b0 0x7efcac0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:14.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.802+0000 7efcb37fe640 1 -- 172.21.15.2:0/1860307044 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7efcb80cfa50 con 0x7efcc4102790 2024-09-19T04:59:14.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.802+0000 7efcc259c640 1 -- 172.21.15.2:0/3745417164 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564e4ae8eb40 msgr2=0x564e4ae8d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:59:14.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.802+0000 7efcc259c640 1 --2- 172.21.15.2:0/3745417164 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564e4ae8eb40 0x564e4ae8d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:14.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.802+0000 7efcc259c640 1 -- 172.21.15.2:0/3745417164 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e4ae98370 msgr2=0x564e4ae9a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:59:14.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.802+0000 7efcc1d9b640 1 --2- 172.21.15.2:0/3745417164 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e4ae98370 0x564e4ae9a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:14.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.802+0000 7efcc259c640 1 --2- 172.21.15.2:0/3745417164 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e4ae98370 0x564e4ae9a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:14.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.802+0000 7efcc259c640 1 -- 172.21.15.2:0/3745417164 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e4ad7f3a0 con 0x564e4ae8d5d0 2024-09-19T04:59:14.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.802+0000 7efcc1d9b640 1 --2- 172.21.15.2:0/3745417164 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e4ae98370 0x564e4ae9a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:59:14.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.803+0000 7efcc2d9d640 1 --2- 172.21.15.2:0/1860307044 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7efcac0a33b0 0x7efcac0a5870 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7efcbc009440 tx=0x7efcbc0093d0 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:14.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.803+0000 7efcc259c640 1 --2- 172.21.15.2:0/3745417164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4ae8d5d0 0x564e4ae8da10 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7efcb402a910 tx=0x7efcb4032cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79b74402f6c8f6f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:14.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.803+0000 7efcb0ff9640 1 -- 172.21.15.2:0/3745417164 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb403f070 con 0x564e4ae8d5d0 2024-09-19T04:59:14.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.803+0000 7efcb0ff9640 1 -- 172.21.15.2:0/3745417164 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efcb40316a0 con 0x564e4ae8d5d0 2024-09-19T04:59:14.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.803+0000 7efcb0ff9640 1 -- 172.21.15.2:0/3745417164 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb4035070 con 0x564e4ae8d5d0 2024-09-19T04:59:14.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.804+0000 7efccaf8c740 1 -- 172.21.15.2:0/3745417164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4ae8d5d0 msgr2=0x564e4ae8da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:14.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.804+0000 7efccaf8c740 1 --2- 172.21.15.2:0/3745417164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4ae8d5d0 0x564e4ae8da10 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7efcb402a910 tx=0x7efcb4032cc0 comp rx=0 tx=0).stop 2024-09-19T04:59:14.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.804+0000 7efccaf8c740 1 -- 172.21.15.2:0/3745417164 shutdown_connections 2024-09-19T04:59:14.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.804+0000 7efccaf8c740 1 --2- 172.21.15.2:0/3745417164 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e4ae98370 0x564e4ae9a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:14.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.804+0000 7efccaf8c740 1 --2- 172.21.15.2:0/3745417164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4ae8d5d0 0x564e4ae8da10 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:14.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.804+0000 7efccaf8c740 1 --2- 172.21.15.2:0/3745417164 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564e4ae8eb40 0x564e4ae8d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:14.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.804+0000 7efccaf8c740 1 -- 172.21.15.2:0/3745417164 >> 172.21.15.2:0/3745417164 conn(0x564e4ae56310 msgr2=0x564e4ae89c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:14.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.804+0000 7efccaf8c740 1 -- 172.21.15.2:0/3745417164 shutdown_connections 2024-09-19T04:59:14.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.804+0000 7efccaf8c740 1 -- 172.21.15.2:0/3745417164 wait complete. 2024-09-19T04:59:14.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.804+0000 7efccaf8c740 1 -- start start 2024-09-19T04:59:14.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.804+0000 7efccaf8c740 1 Processor -- start 2024-09-19T04:59:14.809 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:14 smithi018 ceph-mon[34537]: pgmap v349: 97 pgs: 97 active+clean; 23 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 125 KiB/s wr, 29 op/s 2024-09-19T04:59:14.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.804+0000 7efccaf8c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e4ae8d5d0 0x564e4ae97dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:14.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.804+0000 7efccaf8c740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564e4ae8eb40 0x564e4ae95080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:14.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.804+0000 7efccaf8c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4ae98370 0x564e4ae95810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:14.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.804+0000 7efccaf8c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564e4ae9b010 con 0x564e4ae98370 2024-09-19T04:59:14.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.804+0000 7efccaf8c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564e4adae060 con 0x564e4ae8d5d0 2024-09-19T04:59:14.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.804+0000 7efccaf8c740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x564e4ae9b190 con 0x564e4ae8eb40 2024-09-19T04:59:14.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.805+0000 7efccaf8c740 10 client.0 _ll_register_callbacks cb 0x564e4ab018c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:59:14.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.805+0000 7efcc2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4ae98370 0x564e4ae95810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:14.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.805+0000 7efcc2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4ae98370 0x564e4ae95810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49640/0 (socket says 172.21.15.2:49640) 2024-09-19T04:59:14.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.805+0000 7efcc2d9d640 1 -- 172.21.15.2:0/4062531707 learned_addr learned my addr 172.21.15.2:0/4062531707 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:59:14.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.805+0000 7efcc259c640 1 --2- 172.21.15.2:0/4062531707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e4ae8d5d0 0x564e4ae97dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:14.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.805+0000 7efcc1d9b640 1 --2- 172.21.15.2:0/4062531707 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564e4ae8eb40 0x564e4ae95080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:14.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.805+0000 7efcc2d9d640 1 -- 172.21.15.2:0/4062531707 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564e4ae8eb40 msgr2=0x564e4ae95080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:59:14.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.805+0000 7efcc2d9d640 1 --2- 172.21.15.2:0/4062531707 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564e4ae8eb40 0x564e4ae95080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:14.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.805+0000 7efcc2d9d640 1 -- 172.21.15.2:0/4062531707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e4ae8d5d0 msgr2=0x564e4ae97dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:59:14.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.805+0000 7efcc2d9d640 1 --2- 172.21.15.2:0/4062531707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e4ae8d5d0 0x564e4ae97dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:14.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.805+0000 7efcc2d9d640 1 -- 172.21.15.2:0/4062531707 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e4ab643c0 con 0x564e4ae98370 2024-09-19T04:59:14.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.805+0000 7efcc2d9d640 1 --2- 172.21.15.2:0/4062531707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4ae98370 0x564e4ae95810 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7efcbc016e20 tx=0x7efcbc004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77658c6afa371aa5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:14.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.805+0000 7efca9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:59:14.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.805+0000 7efca9ffb640 1 -- 172.21.15.2:0/4062531707 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcbc029060 con 0x564e4ae98370 2024-09-19T04:59:14.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.805+0000 7efca9ffb640 1 -- 172.21.15.2:0/4062531707 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7efcbc01b0d0 con 0x564e4ae98370 2024-09-19T04:59:14.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.805+0000 7efccaf8c740 1 -- 172.21.15.2:0/4062531707 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efcb40316a0 con 0x564e4ae98370 2024-09-19T04:59:14.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.806+0000 7efca9ffb640 1 -- 172.21.15.2:0/4062531707 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7efcbc013040 con 0x564e4ae98370 2024-09-19T04:59:14.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.806+0000 7efccaf8c740 10 client.16848 fetch_fsmap learned FSMap version 19 2024-09-19T04:59:14.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.806+0000 7efccaf8c740 1 -- 172.21.15.2:0/4062531707 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x564e4aea6aa0 con 0x564e4ae98370 2024-09-19T04:59:14.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.806+0000 7efca9ffb640 1 -- 172.21.15.2:0/4062531707 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efcb40316a0 con 0x564e4ae98370 2024-09-19T04:59:14.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.806+0000 7efca9ffb640 1 -- 172.21.15.2:0/4062531707 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7efcbc019c40 con 0x564e4ae98370 2024-09-19T04:59:14.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.806+0000 7efccaf8c740 10 client.16848 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:59:14.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.806+0000 7efccaf8c740 10 client.16848 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:59:14.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.806+0000 7efccaf8c740 20 client.16848 populate_metadata read hostname 'smithi002' 2024-09-19T04:59:14.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.806+0000 7efccaf8c740 1 --2- 172.21.15.2:0/4062531707 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x564e4aea7f60 0x564e4aeaa390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:14.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.806+0000 7efccaf8c740 4 client.16848 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:59:14.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.806+0000 7efccaf8c740 1 -- 172.21.15.2:0/4062531707 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e4ae00860 con 0x564e4aea7f60 2024-09-19T04:59:14.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.806+0000 7efcc259c640 1 --2- 172.21.15.2:0/4062531707 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x564e4aea7f60 0x564e4aeaa390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:14.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.807+0000 7efcc259c640 1 --2- 172.21.15.2:0/4062531707 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x564e4aea7f60 0x564e4aeaa390 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33e16ecd5adde86b server_cookie=4116aa7d69cc887e in_seq=0 out_seq=0 2024-09-19T04:59:14.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.807+0000 7efca9ffb640 10 client.16848 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:59:14.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.807+0000 7efca9ffb640 1 -- 172.21.15.2:0/4062531707 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564e4ae00860 con 0x564e4aea7f60 2024-09-19T04:59:14.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.807+0000 7efca9ffb640 10 client.16848 handle_command_reply: tid=0 2024-09-19T04:59:14.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.808+0000 7efccaf8c740 1 client.16848 shutdown 2024-09-19T04:59:14.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.808+0000 7efccaf8c740 1 -- 172.21.15.2:0/4062531707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4ae98370 msgr2=0x564e4ae95810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:14.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.808+0000 7efccaf8c740 1 --2- 172.21.15.2:0/4062531707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4ae98370 0x564e4ae95810 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7efcbc016e20 tx=0x7efcbc004b50 comp rx=0 tx=0).stop 2024-09-19T04:59:14.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.808+0000 7efccaf8c740 1 -- 172.21.15.2:0/4062531707 shutdown_connections 2024-09-19T04:59:14.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.808+0000 7efccaf8c740 1 --2- 172.21.15.2:0/4062531707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4ae98370 0x564e4ae95810 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:14.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.808+0000 7efccaf8c740 1 --2- 172.21.15.2:0/4062531707 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x564e4aea7f60 0x564e4aeaa390 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:14.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.808+0000 7efccaf8c740 1 --2- 172.21.15.2:0/4062531707 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564e4ae8eb40 0x564e4ae95080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:14.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.808+0000 7efccaf8c740 1 --2- 172.21.15.2:0/4062531707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e4ae8d5d0 0x564e4ae97dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:14.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.808+0000 7efccaf8c740 1 -- 172.21.15.2:0/4062531707 >> 172.21.15.2:0/4062531707 conn(0x564e4ae56310 msgr2=0x564e4ae8f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:14.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.808+0000 7efca9ffb640 0 client.16848 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:59:14.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.808+0000 7efccaf8c740 1 -- 172.21.15.2:0/4062531707 shutdown_connections 2024-09-19T04:59:14.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.808+0000 7efccaf8c740 1 -- 172.21.15.2:0/4062531707 wait complete. 2024-09-19T04:59:14.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.808+0000 7efccaf8c740 20 client.16848 trim_cache size 0 max 16384 2024-09-19T04:59:14.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.821+0000 7efccaf8c740 1 Processor -- start 2024-09-19T04:59:14.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.821+0000 7efccaf8c740 1 -- start start 2024-09-19T04:59:14.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.821+0000 7efccaf8c740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564e4ae8d5d0 0x564e4ae89e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:14.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.821+0000 7efccaf8c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e4ae8eb40 0x564e4ae94940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:14.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.821+0000 7efccaf8c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4ae98370 0x564e4ae90120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:14.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.821+0000 7efccaf8c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efcc41ab820 con 0x564e4ae98370 2024-09-19T04:59:14.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.821+0000 7efccaf8c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efcc41ae080 con 0x564e4ae8eb40 2024-09-19T04:59:14.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.821+0000 7efccaf8c740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7efcc41abe70 con 0x564e4ae8d5d0 2024-09-19T04:59:14.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.821+0000 7efcc2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4ae98370 0x564e4ae90120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:14.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.821+0000 7efcc2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4ae98370 0x564e4ae90120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49646/0 (socket says 172.21.15.2:49646) 2024-09-19T04:59:14.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.821+0000 7efcc2d9d640 1 -- 172.21.15.2:0/2278895681 learned_addr learned my addr 172.21.15.2:0/2278895681 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:59:14.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.821+0000 7efcc259c640 1 --2- 172.21.15.2:0/2278895681 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564e4ae8d5d0 0x564e4ae89e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:14.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.821+0000 7efcc1d9b640 1 --2- 172.21.15.2:0/2278895681 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e4ae8eb40 0x564e4ae94940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:14.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.821+0000 7efcc2d9d640 1 -- 172.21.15.2:0/2278895681 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564e4ae8d5d0 msgr2=0x564e4ae89e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:59:14.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.821+0000 7efcc2d9d640 1 --2- 172.21.15.2:0/2278895681 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564e4ae8d5d0 0x564e4ae89e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:14.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.821+0000 7efcc2d9d640 1 -- 172.21.15.2:0/2278895681 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e4ae8eb40 msgr2=0x564e4ae94940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:59:14.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.821+0000 7efcc2d9d640 1 --2- 172.21.15.2:0/2278895681 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e4ae8eb40 0x564e4ae94940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:14.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.822+0000 7efcc2d9d640 1 -- 172.21.15.2:0/2278895681 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e4ae8acf0 con 0x564e4ae98370 2024-09-19T04:59:14.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.822+0000 7efcc2d9d640 1 --2- 172.21.15.2:0/2278895681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4ae98370 0x564e4ae90120 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7efcbc000f80 tx=0x7efcbc01bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80b28d7a1204a2d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:14.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.822+0000 7efcabfff640 1 -- 172.21.15.2:0/2278895681 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcbc029040 con 0x564e4ae98370 2024-09-19T04:59:14.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.822+0000 7efcabfff640 1 -- 172.21.15.2:0/2278895681 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efcbc00e070 con 0x564e4ae98370 2024-09-19T04:59:14.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.822+0000 7efcabfff640 1 -- 172.21.15.2:0/2278895681 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcbc02cd60 con 0x564e4ae98370 2024-09-19T04:59:14.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.823+0000 7efccaf8c740 1 -- 172.21.15.2:0/2278895681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4ae98370 msgr2=0x564e4ae90120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:14.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.823+0000 7efccaf8c740 1 --2- 172.21.15.2:0/2278895681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4ae98370 0x564e4ae90120 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7efcbc000f80 tx=0x7efcbc01bf70 comp rx=0 tx=0).stop 2024-09-19T04:59:14.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.823+0000 7efccaf8c740 1 -- 172.21.15.2:0/2278895681 shutdown_connections 2024-09-19T04:59:14.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.823+0000 7efccaf8c740 1 --2- 172.21.15.2:0/2278895681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4ae98370 0x564e4ae90120 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:14.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.823+0000 7efccaf8c740 1 --2- 172.21.15.2:0/2278895681 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e4ae8eb40 0x564e4ae94940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:14.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.823+0000 7efccaf8c740 1 --2- 172.21.15.2:0/2278895681 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564e4ae8d5d0 0x564e4ae89e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:14.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.823+0000 7efccaf8c740 1 -- 172.21.15.2:0/2278895681 >> 172.21.15.2:0/2278895681 conn(0x564e4ae56310 msgr2=0x564e4ae89700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:14.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.823+0000 7efccaf8c740 1 -- 172.21.15.2:0/2278895681 shutdown_connections 2024-09-19T04:59:14.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.823+0000 7efccaf8c740 1 -- 172.21.15.2:0/2278895681 wait complete. 2024-09-19T04:59:14.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.823+0000 7efccaf8c740 1 -- start start 2024-09-19T04:59:14.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.823+0000 7efccaf8c740 1 Processor -- start 2024-09-19T04:59:14.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.824+0000 7efccaf8c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e4ae8d5d0 0x564e4aea0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:14.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.824+0000 7efccaf8c740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564e4ae8eb40 0x564e4aea0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:14.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.824+0000 7efccaf8c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4ae98370 0x564e4ae91720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:14.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.824+0000 7efccaf8c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efcc41ac540 con 0x564e4ae98370 2024-09-19T04:59:14.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.824+0000 7efccaf8c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efcc41ad9b0 con 0x564e4ae8d5d0 2024-09-19T04:59:14.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.824+0000 7efccaf8c740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7efcc41acc10 con 0x564e4ae8eb40 2024-09-19T04:59:14.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.824+0000 7efccaf8c740 10 client.0 _ll_register_callbacks cb 0x7efcbc00adc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:59:14.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.824+0000 7efcc2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4ae98370 0x564e4ae91720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:14.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.824+0000 7efcc2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4ae98370 0x564e4ae91720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49662/0 (socket says 172.21.15.2:49662) 2024-09-19T04:59:14.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.824+0000 7efcc2d9d640 1 -- 172.21.15.2:0/3677351331 learned_addr learned my addr 172.21.15.2:0/3677351331 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:59:14.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.824+0000 7efcc259c640 1 --2- 172.21.15.2:0/3677351331 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e4ae8d5d0 0x564e4aea0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:14.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.824+0000 7efcc1d9b640 1 --2- 172.21.15.2:0/3677351331 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564e4ae8eb40 0x564e4aea0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:14.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.824+0000 7efcc2d9d640 1 -- 172.21.15.2:0/3677351331 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564e4ae8eb40 msgr2=0x564e4aea0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:59:14.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.824+0000 7efcc2d9d640 1 --2- 172.21.15.2:0/3677351331 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564e4ae8eb40 0x564e4aea0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:14.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.824+0000 7efcc2d9d640 1 -- 172.21.15.2:0/3677351331 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e4ae8d5d0 msgr2=0x564e4aea0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:59:14.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.824+0000 7efcc2d9d640 1 --2- 172.21.15.2:0/3677351331 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e4ae8d5d0 0x564e4aea0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:14.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.824+0000 7efcc2d9d640 1 -- 172.21.15.2:0/3677351331 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e4ae91c60 con 0x564e4ae98370 2024-09-19T04:59:14.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.825+0000 7efcc2d9d640 1 --2- 172.21.15.2:0/3677351331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4ae98370 0x564e4ae91720 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7efcbc00a590 tx=0x7efcbc02c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff1a5c4fbadf76ef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:14.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.825+0000 7efca9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:59:14.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.825+0000 7efca9ffb640 1 -- 172.21.15.2:0/3677351331 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcbc029070 con 0x564e4ae98370 2024-09-19T04:59:14.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.825+0000 7efca9ffb640 1 -- 172.21.15.2:0/3677351331 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7efcbc02c7e0 con 0x564e4ae98370 2024-09-19T04:59:14.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.825+0000 7efccaf8c740 1 -- 172.21.15.2:0/3677351331 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efcbc00e070 con 0x564e4ae98370 2024-09-19T04:59:14.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.825+0000 7efca9ffb640 1 -- 172.21.15.2:0/3677351331 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7efcbc02ca60 con 0x564e4ae98370 2024-09-19T04:59:14.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.825+0000 7efccaf8c740 10 client.16854 fetch_fsmap learned FSMap version 19 2024-09-19T04:59:14.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.825+0000 7efccaf8c740 1 -- 172.21.15.2:0/3677351331 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x564e4af123d0 con 0x564e4ae98370 2024-09-19T04:59:14.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.825+0000 7efca9ffb640 1 -- 172.21.15.2:0/3677351331 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efcbc00e070 con 0x564e4ae98370 2024-09-19T04:59:14.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.825+0000 7efca9ffb640 1 -- 172.21.15.2:0/3677351331 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7efcbc019c10 con 0x564e4ae98370 2024-09-19T04:59:14.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.825+0000 7efccaf8c740 10 client.16854 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:59:14.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.826+0000 7efccaf8c740 10 client.16854 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:59:14.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.826+0000 7efccaf8c740 20 client.16854 populate_metadata read hostname 'smithi002' 2024-09-19T04:59:14.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.826+0000 7efccaf8c740 1 --2- 172.21.15.2:0/3677351331 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x564e4af129d0 0x564e4af14df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:14.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.826+0000 7efccaf8c740 4 client.16854 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:59:14.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.826+0000 7efccaf8c740 1 -- 172.21.15.2:0/3677351331 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564e4adfad70 con 0x564e4af129d0 2024-09-19T04:59:14.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.826+0000 7efcc259c640 1 --2- 172.21.15.2:0/3677351331 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x564e4af129d0 0x564e4af14df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:14.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.826+0000 7efca9ffb640 10 client.16854 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:59:14.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.826+0000 7efcc259c640 1 --2- 172.21.15.2:0/3677351331 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x564e4af129d0 0x564e4af14df0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c8db9f08722299 server_cookie=d8bb3fcc77c9856a in_seq=0 out_seq=0 2024-09-19T04:59:14.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.826+0000 7efca9ffb640 1 -- 172.21.15.2:0/3677351331 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564e4adfad70 con 0x564e4af129d0 2024-09-19T04:59:14.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.826+0000 7efca9ffb640 10 client.16854 handle_command_reply: tid=0 2024-09-19T04:59:14.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.827+0000 7efccaf8c740 1 client.16854 shutdown 2024-09-19T04:59:14.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.827+0000 7efccaf8c740 1 -- 172.21.15.2:0/3677351331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4ae98370 msgr2=0x564e4ae91720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:14.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.827+0000 7efccaf8c740 1 --2- 172.21.15.2:0/3677351331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4ae98370 0x564e4ae91720 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7efcbc00a590 tx=0x7efcbc02c4f0 comp rx=0 tx=0).stop 2024-09-19T04:59:14.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.827+0000 7efccaf8c740 1 -- 172.21.15.2:0/3677351331 shutdown_connections 2024-09-19T04:59:14.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.827+0000 7efccaf8c740 1 --2- 172.21.15.2:0/3677351331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564e4ae98370 0x564e4ae91720 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:14.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.827+0000 7efccaf8c740 1 --2- 172.21.15.2:0/3677351331 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x564e4af129d0 0x564e4af14df0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:14.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.827+0000 7efccaf8c740 1 --2- 172.21.15.2:0/3677351331 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564e4ae8eb40 0x564e4aea0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:14.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.827+0000 7efccaf8c740 1 --2- 172.21.15.2:0/3677351331 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e4ae8d5d0 0x564e4aea0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:14.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.827+0000 7efca9ffb640 0 client.16854 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:59:14.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.827+0000 7efccaf8c740 1 -- 172.21.15.2:0/3677351331 >> 172.21.15.2:0/3677351331 conn(0x564e4ae56310 msgr2=0x564e4ae968e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:14.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.827+0000 7efccaf8c740 1 -- 172.21.15.2:0/3677351331 shutdown_connections 2024-09-19T04:59:14.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.827+0000 7efccaf8c740 1 -- 172.21.15.2:0/3677351331 wait complete. 2024-09-19T04:59:14.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.827+0000 7efccaf8c740 20 client.16854 trim_cache size 0 max 16384 2024-09-19T04:59:14.834 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T04:59:14.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.827+0000 7efcc8bb3640 1 -- 172.21.15.2:0/1860307044 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7efcac0a33b0 msgr2=0x7efcac0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:14.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.827+0000 7efcc8bb3640 1 --2- 172.21.15.2:0/1860307044 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7efcac0a33b0 0x7efcac0a5870 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7efcbc009440 tx=0x7efcbc0093d0 comp rx=0 tx=0).stop 2024-09-19T04:59:14.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.827+0000 7efcc8bb3640 1 -- 172.21.15.2:0/1860307044 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcc4102790 msgr2=0x7efcc4198920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:14.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.827+0000 7efcc8bb3640 1 --2- 172.21.15.2:0/1860307044 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcc4102790 0x7efcc4198920 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7efcb800d950 tx=0x7efcb800de10 comp rx=0 tx=0).stop 2024-09-19T04:59:14.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.828+0000 7efcc8bb3640 1 -- 172.21.15.2:0/1860307044 shutdown_connections 2024-09-19T04:59:14.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.828+0000 7efcc8bb3640 1 --2- 172.21.15.2:0/1860307044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcc4106f10 0x7efcc419ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:14.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.828+0000 7efcc8bb3640 1 --2- 172.21.15.2:0/1860307044 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcc4102790 0x7efcc4198920 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:14.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.828+0000 7efcc8bb3640 1 --2- 172.21.15.2:0/1860307044 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7efcac0a33b0 0x7efcac0a5870 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:14.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.828+0000 7efcc8bb3640 1 --2- 172.21.15.2:0/1860307044 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efcc4101de0 0x7efcc41983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:14.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.828+0000 7efcc8bb3640 1 -- 172.21.15.2:0/1860307044 >> 172.21.15.2:0/1860307044 conn(0x7efcc40fd8c0 msgr2=0x7efcc40fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:14.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.828+0000 7efcc8bb3640 1 -- 172.21.15.2:0/1860307044 shutdown_connections 2024-09-19T04:59:14.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:14.828+0000 7efcc8bb3640 1 -- 172.21.15.2:0/1860307044 wait complete. 2024-09-19T04:59:14.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:14 smithi116 ceph-mon[34477]: pgmap v349: 97 pgs: 97 active+clean; 23 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 125 KiB/s wr, 29 op/s 2024-09-19T04:59:16.397 INFO:tasks.workunit.client.0.smithi002.stdout:561/600: open fd = 3 2024-09-19T04:59:16.397 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.397 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.397 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:59:16.397 INFO:tasks.workunit.client.0.smithi002.stdout:562/600: open fd = 3 2024-09-19T04:59:16.397 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.397 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.397 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:59:16.398 INFO:tasks.workunit.client.0.smithi002.stdout:563/600: open fd = 3 2024-09-19T04:59:16.398 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.398 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.398 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:59:16.398 INFO:tasks.workunit.client.0.smithi002.stdout:564/600: open fd = 3 2024-09-19T04:59:16.398 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.398 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.398 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:59:16.398 INFO:tasks.workunit.client.0.smithi002.stdout:565/600: open fd = 3 2024-09-19T04:59:16.398 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.398 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.398 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:59:16.399 INFO:tasks.workunit.client.0.smithi002.stdout:566/600: open fd = 3 2024-09-19T04:59:16.399 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.399 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.399 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:59:16.399 INFO:tasks.workunit.client.0.smithi002.stdout:567/600: open fd = 3 2024-09-19T04:59:16.399 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.399 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.399 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:59:16.399 INFO:tasks.workunit.client.0.smithi002.stdout:568/600: open fd = 3 2024-09-19T04:59:16.399 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.399 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.400 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:59:16.400 INFO:tasks.workunit.client.0.smithi002.stdout:569/600: open fd = 3 2024-09-19T04:59:16.400 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.400 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.400 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:59:16.400 INFO:tasks.workunit.client.0.smithi002.stdout:570/600: open fd = 3 2024-09-19T04:59:16.400 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.400 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.400 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:59:16.400 INFO:tasks.workunit.client.0.smithi002.stdout:571/600: open fd = 3 2024-09-19T04:59:16.400 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.401 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.401 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:59:16.401 INFO:tasks.workunit.client.0.smithi002.stdout:572/600: open fd = 3 2024-09-19T04:59:16.401 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.401 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.401 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:59:16.401 INFO:tasks.workunit.client.0.smithi002.stdout:573/600: open fd = 3 2024-09-19T04:59:16.401 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.401 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.401 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:59:16.401 INFO:tasks.workunit.client.0.smithi002.stdout:574/600: open fd = 3 2024-09-19T04:59:16.401 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.401 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.401 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:59:16.401 INFO:tasks.workunit.client.0.smithi002.stdout:575/600: open fd = 3 2024-09-19T04:59:16.401 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.402 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.402 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:59:16.402 INFO:tasks.workunit.client.0.smithi002.stdout:576/600: open fd = 3 2024-09-19T04:59:16.402 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.402 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.402 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:59:16.402 INFO:tasks.workunit.client.0.smithi002.stdout:577/600: open fd = 3 2024-09-19T04:59:16.402 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.402 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.402 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:59:16.402 INFO:tasks.workunit.client.0.smithi002.stdout:578/600: open fd = 3 2024-09-19T04:59:16.402 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.402 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.402 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:59:16.403 INFO:tasks.workunit.client.0.smithi002.stdout:579/600: open fd = 3 2024-09-19T04:59:16.403 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.403 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.403 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:59:16.403 INFO:tasks.workunit.client.0.smithi002.stdout:580/600: open fd = 3 2024-09-19T04:59:16.403 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.403 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.403 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:59:16.403 INFO:tasks.workunit.client.0.smithi002.stdout:581/600: open fd = 3 2024-09-19T04:59:16.403 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.403 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.403 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:59:16.403 INFO:tasks.workunit.client.0.smithi002.stdout:582/600: open fd = 3 2024-09-19T04:59:16.404 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.404 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.404 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:59:16.404 INFO:tasks.workunit.client.0.smithi002.stdout:583/600: open fd = 3 2024-09-19T04:59:16.404 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.404 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.404 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:59:16.404 INFO:tasks.workunit.client.0.smithi002.stdout:584/600: open fd = 3 2024-09-19T04:59:16.404 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.404 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.404 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:59:16.404 INFO:tasks.workunit.client.0.smithi002.stdout:585/600: open fd = 3 2024-09-19T04:59:16.404 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.405 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.405 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:59:16.405 INFO:tasks.workunit.client.0.smithi002.stdout:586/600: open fd = 3 2024-09-19T04:59:16.405 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.405 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.405 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:59:16.405 INFO:tasks.workunit.client.0.smithi002.stdout:587/600: open fd = 3 2024-09-19T04:59:16.405 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.405 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.405 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:59:16.405 INFO:tasks.workunit.client.0.smithi002.stdout:588/600: open fd = 3 2024-09-19T04:59:16.405 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.405 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.406 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:59:16.406 INFO:tasks.workunit.client.0.smithi002.stdout:589/600: open fd = 3 2024-09-19T04:59:16.406 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.406 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.406 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:59:16.406 INFO:tasks.workunit.client.0.smithi002.stdout:590/600: open fd = 3 2024-09-19T04:59:16.406 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.406 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.406 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:59:16.406 INFO:tasks.workunit.client.0.smithi002.stdout:591/600: open fd = 3 2024-09-19T04:59:16.406 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.406 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.406 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:59:16.406 INFO:tasks.workunit.client.0.smithi002.stdout:592/600: open fd = 3 2024-09-19T04:59:16.407 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.407 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.407 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:59:16.407 INFO:tasks.workunit.client.0.smithi002.stdout:593/600: open fd = 3 2024-09-19T04:59:16.407 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.407 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.407 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:59:16.407 INFO:tasks.workunit.client.0.smithi002.stdout:594/600: open fd = 3 2024-09-19T04:59:16.407 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.407 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.407 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:59:16.408 INFO:tasks.workunit.client.0.smithi002.stdout:595/600: open fd = 3 2024-09-19T04:59:16.408 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.408 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.408 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:59:16.408 INFO:tasks.workunit.client.0.smithi002.stdout:596/600: open fd = 3 2024-09-19T04:59:16.408 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.408 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.408 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:59:16.408 INFO:tasks.workunit.client.0.smithi002.stdout:597/600: open fd = 3 2024-09-19T04:59:16.408 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.408 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.408 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:59:16.408 INFO:tasks.workunit.client.0.smithi002.stdout:598/600: open fd = 3 2024-09-19T04:59:16.408 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.409 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.409 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:59:16.409 INFO:tasks.workunit.client.0.smithi002.stdout:599/600: open fd = 3 2024-09-19T04:59:16.409 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.409 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.409 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:59:16.409 INFO:tasks.workunit.client.0.smithi002.stdout:600/600: open fd = 3 2024-09-19T04:59:16.409 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.409 INFO:tasks.workunit.client.0.smithi002.stdout:write ret = 32 2024-09-19T04:59:16.409 INFO:tasks.workunit.client.0.smithi002.stdout:pread ret = 64 2024-09-19T04:59:16.410 INFO:tasks.workunit.client.0.smithi002.stderr:+ echo OK 2024-09-19T04:59:16.410 INFO:tasks.workunit.client.0.smithi002.stdout:OK 2024-09-19T04:59:16.411 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T04:59:16.411 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T04:59:16.459 INFO:tasks.workunit:Stopping ['fs/test_o_trunc.sh'] on client.0... 2024-09-19T04:59:16.459 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-19T04:59:16.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:16 smithi002 ceph-mon[30975]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T04:59:16.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:16 smithi002 ceph-mon[30975]: pgmap v351: 97 pgs: 97 active+clean; 24 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 68 KiB/s wr, 8 op/s 2024-09-19T04:59:16.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:16 smithi018 ceph-mon[34537]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T04:59:16.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:16 smithi018 ceph-mon[34537]: pgmap v351: 97 pgs: 97 active+clean; 24 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 68 KiB/s wr, 8 op/s 2024-09-19T04:59:16.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:16 smithi116 ceph-mon[34477]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T04:59:16.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:16 smithi116 ceph-mon[34477]: pgmap v351: 97 pgs: 97 active+clean; 24 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 68 KiB/s wr, 8 op/s 2024-09-19T04:59:16.651 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:59:16.651 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:59:16.785 DEBUG:teuthology.parallel:result is None 2024-09-19T04:59:16.786 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T04:59:16.821 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T04:59:16.821 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-19T04:59:16.833 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-19T04:59:16.833 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T04:59:16.833 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-19T04:59:16.834 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-19T04:59:16.893 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-19T04:59:16.929 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:59:16.959 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-19T04:59:17.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.102+0000 7fb0f21a6640 1 -- 172.21.15.2:0/2656908848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0ec1069b0 msgr2=0x7fb0ec106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:17.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.102+0000 7fb0f21a6640 1 --2- 172.21.15.2:0/2656908848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0ec1069b0 0x7fb0ec106d90 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc009930 tx=0x7fb0dc02a420 comp rx=0 tx=0).stop 2024-09-19T04:59:17.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.102+0000 7fb0f21a6640 1 -- 172.21.15.2:0/2656908848 shutdown_connections 2024-09-19T04:59:17.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.102+0000 7fb0f21a6640 1 --2- 172.21.15.2:0/2656908848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0ec101340 0x7fb0ec10d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.102+0000 7fb0f21a6640 1 --2- 172.21.15.2:0/2656908848 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb0ec1009a0 0x7fb0ec100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.102+0000 7fb0f21a6640 1 --2- 172.21.15.2:0/2656908848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0ec1069b0 0x7fb0ec106d90 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.102+0000 7fb0f21a6640 1 -- 172.21.15.2:0/2656908848 >> 172.21.15.2:0/2656908848 conn(0x7fb0ec0779a0 msgr2=0x7fb0ec0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:17.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.102+0000 7fb0f21a6640 1 -- 172.21.15.2:0/2656908848 shutdown_connections 2024-09-19T04:59:17.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.103+0000 7fb0f21a6640 1 -- 172.21.15.2:0/2656908848 wait complete. 2024-09-19T04:59:17.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.103+0000 7fb0f21a6640 1 Processor -- start 2024-09-19T04:59:17.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.103+0000 7fb0f21a6640 1 -- start start 2024-09-19T04:59:17.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.104+0000 7fb0f21a6640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb0ec1009a0 0x7fb0ec0fcde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:17.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.104+0000 7fb0f21a6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0ec101340 0x7fb0ec0fd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:17.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.104+0000 7fb0f21a6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0ec1069b0 0x7fb0ec0fd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:17.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.104+0000 7fb0f21a6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ec110c70 con 0x7fb0ec101340 2024-09-19T04:59:17.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.104+0000 7fb0f21a6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ec110af0 con 0x7fb0ec1069b0 2024-09-19T04:59:17.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.104+0000 7fb0f21a6640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ec110df0 con 0x7fb0ec1009a0 2024-09-19T04:59:17.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.104+0000 7fb0eaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0ec101340 0x7fb0ec0fd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:17.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.104+0000 7fb0eaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0ec101340 0x7fb0ec0fd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49678/0 (socket says 172.21.15.2:49678) 2024-09-19T04:59:17.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.104+0000 7fb0eaffd640 1 -- 172.21.15.2:0/1245156854 learned_addr learned my addr 172.21.15.2:0/1245156854 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:59:17.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.104+0000 7fb0eb7fe640 1 --2- 172.21.15.2:0/1245156854 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb0ec1009a0 0x7fb0ec0fcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:17.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.104+0000 7fb0ebfff640 1 --2- 172.21.15.2:0/1245156854 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0ec1069b0 0x7fb0ec0fd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:17.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.104+0000 7fb0eaffd640 1 -- 172.21.15.2:0/1245156854 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb0ec1009a0 msgr2=0x7fb0ec0fcde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:17.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.104+0000 7fb0eaffd640 1 --2- 172.21.15.2:0/1245156854 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb0ec1009a0 0x7fb0ec0fcde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.104+0000 7fb0eaffd640 1 -- 172.21.15.2:0/1245156854 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0ec1069b0 msgr2=0x7fb0ec0fd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:17.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.104+0000 7fb0eaffd640 1 --2- 172.21.15.2:0/1245156854 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0ec1069b0 0x7fb0ec0fd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.104+0000 7fb0eaffd640 1 -- 172.21.15.2:0/1245156854 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0ec1a6800 con 0x7fb0ec101340 2024-09-19T04:59:17.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.104+0000 7fb0eb7fe640 1 --2- 172.21.15.2:0/1245156854 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb0ec1009a0 0x7fb0ec0fcde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:59:17.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.104+0000 7fb0eaffd640 1 --2- 172.21.15.2:0/1245156854 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0ec101340 0x7fb0ec0fd320 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fb0e000d950 tx=0x7fb0e000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:17.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.105+0000 7fb0e8ff9640 1 -- 172.21.15.2:0/1245156854 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e0017030 con 0x7fb0ec101340 2024-09-19T04:59:17.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.105+0000 7fb0e8ff9640 1 -- 172.21.15.2:0/1245156854 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb0e0004020 con 0x7fb0ec101340 2024-09-19T04:59:17.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.105+0000 7fb0f21a6640 1 -- 172.21.15.2:0/1245156854 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0ec1a6af0 con 0x7fb0ec101340 2024-09-19T04:59:17.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.105+0000 7fb0e8ff9640 1 -- 172.21.15.2:0/1245156854 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e00047a0 con 0x7fb0ec101340 2024-09-19T04:59:17.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.105+0000 7fb0f21a6640 1 -- 172.21.15.2:0/1245156854 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0ec1a7040 con 0x7fb0ec101340 2024-09-19T04:59:17.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.106+0000 7fb0f21a6640 1 -- 172.21.15.2:0/1245156854 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0ec1020e0 con 0x7fb0ec101340 2024-09-19T04:59:17.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.107+0000 7fb0e8ff9640 1 -- 172.21.15.2:0/1245156854 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fb0e00041d0 con 0x7fb0ec101340 2024-09-19T04:59:17.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.107+0000 7fb0e8ff9640 1 --2- 172.21.15.2:0/1245156854 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fb0d40a33b0 0x7fb0d40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:17.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.108+0000 7fb0eb7fe640 1 --2- 172.21.15.2:0/1245156854 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fb0d40a33b0 0x7fb0d40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:17.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.108+0000 7fb0e8ff9640 1 -- 172.21.15.2:0/1245156854 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8527+0+0 (secure 0 0 0) 0x7fb0e00cf850 con 0x7fb0ec101340 2024-09-19T04:59:17.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.108+0000 7fb0eb7fe640 1 --2- 172.21.15.2:0/1245156854 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fb0d40a33b0 0x7fb0d40a5870 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc000c00 tx=0x7fb0dc009610 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:17.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.112+0000 7fb0e8ff9640 1 -- 172.21.15.2:0/1245156854 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb0e009c230 con 0x7fb0ec101340 2024-09-19T04:59:17.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.312+0000 7fb0f21a6640 1 -- 172.21.15.2:0/1245156854 --> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7fb0ec062630 con 0x7fb0d40a33b0 2024-09-19T04:59:17.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.320+0000 7fb0e8ff9640 1 -- 172.21.15.2:0/1245156854 <== mgr.15096 v2:172.21.15.2:6800/852329670 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7fb0ec062630 con 0x7fb0d40a33b0 2024-09-19T04:59:17.321 INFO:teuthology.orchestra.run.smithi002.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-19T00:00:00", "created": "2024-09-19T04:48:09", "first": "2024-09-19T04:49:00", "last": "2024-09-19T04:59:00", "last_pruned": "2024-09-19T04:59:00", "created_count": 11, "pruned_count": 5, "active": true} 2024-09-19T04:59:17.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.322+0000 7fb0f21a6640 1 -- 172.21.15.2:0/1245156854 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fb0d40a33b0 msgr2=0x7fb0d40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:17.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.322+0000 7fb0f21a6640 1 --2- 172.21.15.2:0/1245156854 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fb0d40a33b0 0x7fb0d40a5870 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc000c00 tx=0x7fb0dc009610 comp rx=0 tx=0).stop 2024-09-19T04:59:17.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.322+0000 7fb0f21a6640 1 -- 172.21.15.2:0/1245156854 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0ec101340 msgr2=0x7fb0ec0fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:17.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.322+0000 7fb0f21a6640 1 --2- 172.21.15.2:0/1245156854 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0ec101340 0x7fb0ec0fd320 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fb0e000d950 tx=0x7fb0e000de10 comp rx=0 tx=0).stop 2024-09-19T04:59:17.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.322+0000 7fb0f21a6640 1 -- 172.21.15.2:0/1245156854 shutdown_connections 2024-09-19T04:59:17.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.322+0000 7fb0f21a6640 1 --2- 172.21.15.2:0/1245156854 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0ec1069b0 0x7fb0ec0fd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.322+0000 7fb0f21a6640 1 --2- 172.21.15.2:0/1245156854 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0ec101340 0x7fb0ec0fd320 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.322+0000 7fb0f21a6640 1 --2- 172.21.15.2:0/1245156854 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fb0d40a33b0 0x7fb0d40a5870 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.322+0000 7fb0f21a6640 1 --2- 172.21.15.2:0/1245156854 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb0ec1009a0 0x7fb0ec0fcde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.322+0000 7fb0f21a6640 1 -- 172.21.15.2:0/1245156854 >> 172.21.15.2:0/1245156854 conn(0x7fb0ec0779a0 msgr2=0x7fb0ec069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:17.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.322+0000 7fb0f21a6640 1 -- 172.21.15.2:0/1245156854 shutdown_connections 2024-09-19T04:59:17.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.322+0000 7fb0f21a6640 1 -- 172.21.15.2:0/1245156854 wait complete. 2024-09-19T04:59:17.333 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:17 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:59:17.334 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:17 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:59:17.334 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:17 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:59:17.334 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:17 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:59:17.335 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-19T04:59:17.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.442+0000 7fd55d67b640 1 -- 172.21.15.2:0/3463274056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd55810c130 msgr2=0x7fd55810e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:17.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.442+0000 7fd55d67b640 1 --2- 172.21.15.2:0/3463274056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd55810c130 0x7fd55810e580 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fd550009ca0 tx=0x7fd55002a8c0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.442+0000 7fd55d67b640 1 -- 172.21.15.2:0/3463274056 shutdown_connections 2024-09-19T04:59:17.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.442+0000 7fd55d67b640 1 --2- 172.21.15.2:0/3463274056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd55810c130 0x7fd55810e580 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.442+0000 7fd55d67b640 1 --2- 172.21.15.2:0/3463274056 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd5581035e0 0x7fd55810bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.442+0000 7fd55d67b640 1 --2- 172.21.15.2:0/3463274056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd558102c30 0x7fd558103010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.442+0000 7fd55d67b640 1 -- 172.21.15.2:0/3463274056 >> 172.21.15.2:0/3463274056 conn(0x7fd5580fc6f0 msgr2=0x7fd5580feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:17.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.442+0000 7fd55d67b640 1 -- 172.21.15.2:0/3463274056 shutdown_connections 2024-09-19T04:59:17.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.442+0000 7fd55d67b640 1 -- 172.21.15.2:0/3463274056 wait complete. 2024-09-19T04:59:17.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.442+0000 7fd55d67b640 1 Processor -- start 2024-09-19T04:59:17.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.443+0000 7fd55d67b640 1 -- start start 2024-09-19T04:59:17.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.443+0000 7fd55d67b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd558102c30 0x7fd55819a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:17.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.443+0000 7fd55d67b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5581035e0 0x7fd55819aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:17.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.443+0000 7fd55d67b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd55810c130 0x7fd55819ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:17.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.443+0000 7fd55d67b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd558111d90 con 0x7fd5581035e0 2024-09-19T04:59:17.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.443+0000 7fd55d67b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd558111c10 con 0x7fd55810c130 2024-09-19T04:59:17.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.443+0000 7fd55d67b640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fd558111f10 con 0x7fd558102c30 2024-09-19T04:59:17.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.443+0000 7fd54e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5581035e0 0x7fd55819aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:17.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.443+0000 7fd54e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5581035e0 0x7fd55819aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49694/0 (socket says 172.21.15.2:49694) 2024-09-19T04:59:17.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.443+0000 7fd54e7fc640 1 -- 172.21.15.2:0/3006364617 learned_addr learned my addr 172.21.15.2:0/3006364617 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:59:17.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.443+0000 7fd5577fe640 1 --2- 172.21.15.2:0/3006364617 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd55810c130 0x7fd55819ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:17.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.443+0000 7fd556ffd640 1 --2- 172.21.15.2:0/3006364617 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd558102c30 0x7fd55819a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:17.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.443+0000 7fd54e7fc640 1 -- 172.21.15.2:0/3006364617 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd558102c30 msgr2=0x7fd55819a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:17.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.443+0000 7fd54e7fc640 1 --2- 172.21.15.2:0/3006364617 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd558102c30 0x7fd55819a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.443+0000 7fd54e7fc640 1 -- 172.21.15.2:0/3006364617 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd55810c130 msgr2=0x7fd55819ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:17.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.443+0000 7fd54e7fc640 1 --2- 172.21.15.2:0/3006364617 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd55810c130 0x7fd55819ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.443+0000 7fd54e7fc640 1 -- 172.21.15.2:0/3006364617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd55819f4b0 con 0x7fd5581035e0 2024-09-19T04:59:17.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.443+0000 7fd556ffd640 1 --2- 172.21.15.2:0/3006364617 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd558102c30 0x7fd55819a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:59:17.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.444+0000 7fd54e7fc640 1 --2- 172.21.15.2:0/3006364617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5581035e0 0x7fd55819aa00 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fd54000e9f0 tx=0x7fd54000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:17.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.444+0000 7fd554ff9640 1 -- 172.21.15.2:0/3006364617 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd54000cd80 con 0x7fd5581035e0 2024-09-19T04:59:17.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.444+0000 7fd554ff9640 1 -- 172.21.15.2:0/3006364617 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd5400054d0 con 0x7fd5581035e0 2024-09-19T04:59:17.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.444+0000 7fd55d67b640 1 -- 172.21.15.2:0/3006364617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd55819f7a0 con 0x7fd5581035e0 2024-09-19T04:59:17.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.444+0000 7fd554ff9640 1 -- 172.21.15.2:0/3006364617 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd540010490 con 0x7fd5581035e0 2024-09-19T04:59:17.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.444+0000 7fd55d67b640 1 -- 172.21.15.2:0/3006364617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5581a7030 con 0x7fd5581035e0 2024-09-19T04:59:17.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.445+0000 7fd55d67b640 1 -- 172.21.15.2:0/3006364617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd558103010 con 0x7fd5581035e0 2024-09-19T04:59:17.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.447+0000 7fd554ff9640 1 -- 172.21.15.2:0/3006364617 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fd540005000 con 0x7fd5581035e0 2024-09-19T04:59:17.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.448+0000 7fd554ff9640 1 --2- 172.21.15.2:0/3006364617 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fd5440a33b0 0x7fd5440a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:17.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.448+0000 7fd554ff9640 1 -- 172.21.15.2:0/3006364617 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8527+0+0 (secure 0 0 0) 0x7fd5400d02a0 con 0x7fd5581035e0 2024-09-19T04:59:17.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.448+0000 7fd556ffd640 1 --2- 172.21.15.2:0/3006364617 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fd5440a33b0 0x7fd5440a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:17.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.448+0000 7fd556ffd640 1 --2- 172.21.15.2:0/3006364617 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fd5440a33b0 0x7fd5440a5870 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd5480058c0 tx=0x7fd548005850 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:17.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.451+0000 7fd554ff9640 1 -- 172.21.15.2:0/3006364617 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd540054210 con 0x7fd5581035e0 2024-09-19T04:59:17.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.466+0000 7f9d96a89640 1 -- 172.21.15.2:0/2945896619 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d90102570 msgr2=0x7f9d901029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:17.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.466+0000 7f9d96a89640 1 --2- 172.21.15.2:0/2945896619 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d90102570 0x7f9d901029b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9d80009890 tx=0x7f9d8002a410 comp rx=0 tx=0).stop 2024-09-19T04:59:17.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.466+0000 7f9d96a89640 1 -- 172.21.15.2:0/2945896619 shutdown_connections 2024-09-19T04:59:17.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.466+0000 7f9d96a89640 1 --2- 172.21.15.2:0/2945896619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d90102ef0 0x7f9d9010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.466+0000 7f9d96a89640 1 --2- 172.21.15.2:0/2945896619 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d90102570 0x7f9d901029b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.466+0000 7f9d96a89640 1 --2- 172.21.15.2:0/2945896619 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d90100e20 0x7f9d90101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.466+0000 7f9d96a89640 1 -- 172.21.15.2:0/2945896619 >> 172.21.15.2:0/2945896619 conn(0x7f9d900fc7d0 msgr2=0x7f9d900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:17.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.466+0000 7f9d96a89640 1 -- 172.21.15.2:0/2945896619 shutdown_connections 2024-09-19T04:59:17.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.466+0000 7f9d96a89640 1 -- 172.21.15.2:0/2945896619 wait complete. 2024-09-19T04:59:17.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.467+0000 7f9d96a89640 1 Processor -- start 2024-09-19T04:59:17.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.467+0000 7f9d96a89640 1 -- start start 2024-09-19T04:59:17.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.467+0000 7f9d96a89640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d90100e20 0x7f9d900fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:17.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.467+0000 7f9d96a89640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d90102570 0x7f9d900fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:17.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.467+0000 7f9d96a89640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d90102ef0 0x7f9d900fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:17.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.467+0000 7f9d96a89640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9d90110e30 con 0x7f9d90102570 2024-09-19T04:59:17.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.467+0000 7f9d96a89640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9d90110cb0 con 0x7f9d90102ef0 2024-09-19T04:59:17.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.467+0000 7f9d96a89640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f9d90110fb0 con 0x7f9d90100e20 2024-09-19T04:59:17.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.467+0000 7f9d8ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d90102570 0x7f9d900fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:17.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.467+0000 7f9d8ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d90102570 0x7f9d900fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49716/0 (socket says 172.21.15.2:49716) 2024-09-19T04:59:17.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.467+0000 7f9d8ffff640 1 -- 172.21.15.2:0/3620524458 learned_addr learned my addr 172.21.15.2:0/3620524458 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:59:17.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.467+0000 7f9d94825640 1 --2- 172.21.15.2:0/3620524458 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d90100e20 0x7f9d900fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:17.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.467+0000 7f9d95026640 1 --2- 172.21.15.2:0/3620524458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d90102ef0 0x7f9d900fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:17.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.467+0000 7f9d8ffff640 1 -- 172.21.15.2:0/3620524458 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d90100e20 msgr2=0x7f9d900fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:17.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.467+0000 7f9d8ffff640 1 --2- 172.21.15.2:0/3620524458 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d90100e20 0x7f9d900fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.467+0000 7f9d8ffff640 1 -- 172.21.15.2:0/3620524458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d90102ef0 msgr2=0x7f9d900fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:17.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.467+0000 7f9d8ffff640 1 --2- 172.21.15.2:0/3620524458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d90102ef0 0x7f9d900fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.467+0000 7f9d8ffff640 1 -- 172.21.15.2:0/3620524458 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d901a6930 con 0x7f9d90102570 2024-09-19T04:59:17.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.468+0000 7f9d8ffff640 1 --2- 172.21.15.2:0/3620524458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d90102570 0x7f9d900fd1c0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f9d80000c00 tx=0x7f9d80030ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:17.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.468+0000 7f9d8dffb640 1 -- 172.21.15.2:0/3620524458 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d80005460 con 0x7f9d90102570 2024-09-19T04:59:17.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.468+0000 7f9d96a89640 1 -- 172.21.15.2:0/3620524458 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d901a6bc0 con 0x7f9d90102570 2024-09-19T04:59:17.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.468+0000 7f9d8dffb640 1 -- 172.21.15.2:0/3620524458 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9d80005600 con 0x7f9d90102570 2024-09-19T04:59:17.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.468+0000 7f9d8dffb640 1 -- 172.21.15.2:0/3620524458 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d80004e10 con 0x7f9d90102570 2024-09-19T04:59:17.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.468+0000 7f9d96a89640 1 -- 172.21.15.2:0/3620524458 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d901a70f0 con 0x7f9d90102570 2024-09-19T04:59:17.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.470+0000 7f9d8dffb640 1 -- 172.21.15.2:0/3620524458 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f9d80039040 con 0x7f9d90102570 2024-09-19T04:59:17.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.471+0000 7f9d8dffb640 1 --2- 172.21.15.2:0/3620524458 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f9d7c0a33b0 0x7f9d7c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:17.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.471+0000 7f9d94825640 1 --2- 172.21.15.2:0/3620524458 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f9d7c0a33b0 0x7f9d7c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:17.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.471+0000 7f9d8dffb640 1 -- 172.21.15.2:0/3620524458 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8527+0+0 (secure 0 0 0) 0x7f9d800f0b20 con 0x7f9d90102570 2024-09-19T04:59:17.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.472+0000 7f9d98e62740 1 Processor -- start 2024-09-19T04:59:17.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.472+0000 7f9d94825640 1 --2- 172.21.15.2:0/3620524458 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f9d7c0a33b0 0x7f9d7c0a5870 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9d78009bd0 tx=0x7f9d78005f90 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:17.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.472+0000 7f9d98e62740 1 -- start start 2024-09-19T04:59:17.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.472+0000 7f9d98e62740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562ab12eb60 0x5562ab12ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:17.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.472+0000 7f9d98e62740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ab12f480 0x5562ab139800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:17.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.472+0000 7f9d98e62740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5562ab139d40 0x5562ab13c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:17.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.472+0000 7f9d98e62740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5562ab094280 con 0x5562ab12f480 2024-09-19T04:59:17.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.472+0000 7f9d98e62740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5562ab03bb10 con 0x5562ab12eb60 2024-09-19T04:59:17.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.472+0000 7f9d98e62740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5562ab090240 con 0x5562ab139d40 2024-09-19T04:59:17.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.472+0000 7f9d8ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ab12f480 0x5562ab139800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:17.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.472+0000 7f9d8ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ab12f480 0x5562ab139800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49724/0 (socket says 172.21.15.2:49724) 2024-09-19T04:59:17.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.472+0000 7f9d8ffff640 1 -- 172.21.15.2:0/3780855512 learned_addr learned my addr 172.21.15.2:0/3780855512 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:59:17.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.472+0000 7f9d95026640 1 --2- 172.21.15.2:0/3780855512 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5562ab139d40 0x5562ab13c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:17.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.472+0000 7f9d94825640 1 --2- 172.21.15.2:0/3780855512 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562ab12eb60 0x5562ab12ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:17.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.473+0000 7f9d8ffff640 1 -- 172.21.15.2:0/3780855512 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5562ab139d40 msgr2=0x5562ab13c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:59:17.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.473+0000 7f9d8ffff640 1 --2- 172.21.15.2:0/3780855512 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5562ab139d40 0x5562ab13c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.473+0000 7f9d8ffff640 1 -- 172.21.15.2:0/3780855512 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562ab12eb60 msgr2=0x5562ab12ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:59:17.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.473+0000 7f9d8ffff640 1 --2- 172.21.15.2:0/3780855512 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562ab12eb60 0x5562ab12ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.473+0000 7f9d8ffff640 1 -- 172.21.15.2:0/3780855512 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562ab0481f0 con 0x5562ab12f480 2024-09-19T04:59:17.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.473+0000 7f9d8ffff640 1 --2- 172.21.15.2:0/3780855512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ab12f480 0x5562ab139800 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f9d800b97d0 tx=0x7f9d80032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec713e624babf2fe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:17.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.473+0000 7f9d86ffd640 1 -- 172.21.15.2:0/3780855512 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d800c11b0 con 0x5562ab12f480 2024-09-19T04:59:17.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.473+0000 7f9d86ffd640 1 -- 172.21.15.2:0/3780855512 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9d800c5a70 con 0x5562ab12f480 2024-09-19T04:59:17.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.473+0000 7f9d86ffd640 1 -- 172.21.15.2:0/3780855512 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d800bd060 con 0x5562ab12f480 2024-09-19T04:59:17.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.474+0000 7f9d98e62740 1 -- 172.21.15.2:0/3780855512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ab12f480 msgr2=0x5562ab139800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:17.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.474+0000 7f9d98e62740 1 --2- 172.21.15.2:0/3780855512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ab12f480 0x5562ab139800 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f9d800b97d0 tx=0x7f9d80032c60 comp rx=0 tx=0).stop 2024-09-19T04:59:17.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.474+0000 7f9d98e62740 1 -- 172.21.15.2:0/3780855512 shutdown_connections 2024-09-19T04:59:17.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.474+0000 7f9d98e62740 1 --2- 172.21.15.2:0/3780855512 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5562ab139d40 0x5562ab13c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.474+0000 7f9d98e62740 1 --2- 172.21.15.2:0/3780855512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ab12f480 0x5562ab139800 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.474+0000 7f9d98e62740 1 --2- 172.21.15.2:0/3780855512 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562ab12eb60 0x5562ab12ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.474+0000 7f9d98e62740 1 -- 172.21.15.2:0/3780855512 >> 172.21.15.2:0/3780855512 conn(0x5562ab12b0f0 msgr2=0x5562ab12b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:17.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.474+0000 7f9d98e62740 1 -- 172.21.15.2:0/3780855512 shutdown_connections 2024-09-19T04:59:17.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.474+0000 7f9d98e62740 1 -- 172.21.15.2:0/3780855512 wait complete. 2024-09-19T04:59:17.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.474+0000 7f9d98e62740 1 -- start start 2024-09-19T04:59:17.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.474+0000 7f9d98e62740 1 Processor -- start 2024-09-19T04:59:17.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.475+0000 7f9d98e62740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562ab12eb60 0x5562ab136cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:17.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.475+0000 7f9d98e62740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ab12f480 0x5562ab1371f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:17.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.475+0000 7f9d98e62740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5562ab139d40 0x5562ab137730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:17.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.475+0000 7f9d98e62740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5562ab13c6d0 con 0x5562ab12f480 2024-09-19T04:59:17.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.475+0000 7f9d8ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ab12f480 0x5562ab1371f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:17.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.475+0000 7f9d98e62740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5562ab04ef10 con 0x5562ab12eb60 2024-09-19T04:59:17.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.475+0000 7f9d98e62740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5562ab13c850 con 0x5562ab139d40 2024-09-19T04:59:17.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.475+0000 7f9d8ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ab12f480 0x5562ab1371f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49740/0 (socket says 172.21.15.2:49740) 2024-09-19T04:59:17.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.475+0000 7f9d8ffff640 1 -- 172.21.15.2:0/1255227611 learned_addr learned my addr 172.21.15.2:0/1255227611 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:59:17.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.475+0000 7f9d98e62740 10 client.0 _ll_register_callbacks cb 0x5562ab017a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:59:17.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.475+0000 7f9d95026640 1 --2- 172.21.15.2:0/1255227611 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5562ab139d40 0x5562ab137730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:17.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.475+0000 7f9d94825640 1 --2- 172.21.15.2:0/1255227611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562ab12eb60 0x5562ab136cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:17.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.475+0000 7f9d8ffff640 1 -- 172.21.15.2:0/1255227611 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5562ab139d40 msgr2=0x5562ab137730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:59:17.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.475+0000 7f9d8ffff640 1 --2- 172.21.15.2:0/1255227611 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5562ab139d40 0x5562ab137730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.475+0000 7f9d8ffff640 1 -- 172.21.15.2:0/1255227611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562ab12eb60 msgr2=0x5562ab136cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:59:17.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.475+0000 7f9d8ffff640 1 --2- 172.21.15.2:0/1255227611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562ab12eb60 0x5562ab136cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.475+0000 7f9d8ffff640 1 -- 172.21.15.2:0/1255227611 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562aae056a0 con 0x5562ab12f480 2024-09-19T04:59:17.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.476+0000 7f9d8ffff640 1 --2- 172.21.15.2:0/1255227611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ab12f480 0x5562ab1371f0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f9d800ee870 tx=0x7f9d800b91d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3cf52ecf160fb52 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:17.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.476+0000 7f9d6ffff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:59:17.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.476+0000 7f9d6ffff640 1 -- 172.21.15.2:0/1255227611 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d800d9030 con 0x5562ab12f480 2024-09-19T04:59:17.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.476+0000 7f9d6ffff640 1 -- 172.21.15.2:0/1255227611 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8527+0+0 (secure 0 0 0) 0x7f9d800bb100 con 0x5562ab12f480 2024-09-19T04:59:17.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.476+0000 7f9d98e62740 1 -- 172.21.15.2:0/1255227611 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d800c5a70 con 0x5562ab12f480 2024-09-19T04:59:17.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.476+0000 7f9d6ffff640 1 -- 172.21.15.2:0/1255227611 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f9d800bd060 con 0x5562ab12f480 2024-09-19T04:59:17.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.476+0000 7f9d98e62740 10 client.16878 fetch_fsmap learned FSMap version 19 2024-09-19T04:59:17.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.476+0000 7f9d98e62740 1 -- 172.21.15.2:0/1255227611 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5562ab13c6d0 con 0x5562ab12f480 2024-09-19T04:59:17.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.476+0000 7f9d6ffff640 1 -- 172.21.15.2:0/1255227611 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9d800bd200 con 0x5562ab12f480 2024-09-19T04:59:17.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.476+0000 7f9d6ffff640 1 -- 172.21.15.2:0/1255227611 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f9d800bbcc0 con 0x5562ab12f480 2024-09-19T04:59:17.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.476+0000 7f9d98e62740 10 client.16878 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:59:17.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.476+0000 7f9d98e62740 10 client.16878 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:59:17.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.476+0000 7f9d98e62740 20 client.16878 populate_metadata read hostname 'smithi002' 2024-09-19T04:59:17.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.476+0000 7f9d98e62740 1 --2- 172.21.15.2:0/1255227611 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5562ab149560 0x5562ab14b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:17.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.477+0000 7f9d98e62740 4 client.16878 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:59:17.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.477+0000 7f9d98e62740 1 -- 172.21.15.2:0/1255227611 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f9d800c5a70 con 0x5562ab149560 2024-09-19T04:59:17.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.477+0000 7f9d94825640 1 --2- 172.21.15.2:0/1255227611 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5562ab149560 0x5562ab14b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:17.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.477+0000 7f9d94825640 1 --2- 172.21.15.2:0/1255227611 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5562ab149560 0x5562ab14b980 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e41e612f7c87225c server_cookie=181fcad33dfb3609 in_seq=0 out_seq=0 2024-09-19T04:59:17.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.477+0000 7f9d6ffff640 10 client.16878 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:59:17.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.478+0000 7f9d6ffff640 1 -- 172.21.15.2:0/1255227611 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f9d800c5a70 con 0x5562ab149560 2024-09-19T04:59:17.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.478+0000 7f9d6ffff640 10 client.16878 handle_command_reply: tid=0 2024-09-19T04:59:17.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.478+0000 7f9d98e62740 1 client.16878 shutdown 2024-09-19T04:59:17.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.478+0000 7f9d98e62740 1 -- 172.21.15.2:0/1255227611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ab12f480 msgr2=0x5562ab1371f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:17.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.478+0000 7f9d98e62740 1 --2- 172.21.15.2:0/1255227611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ab12f480 0x5562ab1371f0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f9d800ee870 tx=0x7f9d800b91d0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.478+0000 7f9d98e62740 1 -- 172.21.15.2:0/1255227611 shutdown_connections 2024-09-19T04:59:17.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.478+0000 7f9d98e62740 1 --2- 172.21.15.2:0/1255227611 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5562ab149560 0x5562ab14b980 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.478+0000 7f9d98e62740 1 --2- 172.21.15.2:0/1255227611 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5562ab139d40 0x5562ab137730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.478+0000 7f9d98e62740 1 --2- 172.21.15.2:0/1255227611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ab12f480 0x5562ab1371f0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.478+0000 7f9d98e62740 1 --2- 172.21.15.2:0/1255227611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562ab12eb60 0x5562ab136cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.478+0000 7f9d98e62740 1 -- 172.21.15.2:0/1255227611 >> 172.21.15.2:0/1255227611 conn(0x5562ab12b0f0 msgr2=0x5562ab12a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:17.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.478+0000 7f9d6ffff640 0 client.16878 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:59:17.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.478+0000 7f9d98e62740 1 -- 172.21.15.2:0/1255227611 shutdown_connections 2024-09-19T04:59:17.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.478+0000 7f9d98e62740 1 -- 172.21.15.2:0/1255227611 wait complete. 2024-09-19T04:59:17.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.478+0000 7f9d98e62740 20 client.16878 trim_cache size 0 max 16384 2024-09-19T04:59:17.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.496+0000 7f9d98e62740 1 Processor -- start 2024-09-19T04:59:17.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.496+0000 7f9d98e62740 1 -- start start 2024-09-19T04:59:17.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.496+0000 7f9d98e62740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5562ab12eb60 0x5562ab138ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:17.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.496+0000 7f9d98e62740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562ab12f480 0x5562ab1315c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:17.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.496+0000 7f9d98e62740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ab139d40 0x5562ab151210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:17.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.496+0000 7f9d98e62740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9d901ad930 con 0x5562ab139d40 2024-09-19T04:59:17.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.496+0000 7f9d98e62740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9d901b0190 con 0x5562ab12f480 2024-09-19T04:59:17.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.496+0000 7f9d98e62740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f9d901adf80 con 0x5562ab12eb60 2024-09-19T04:59:17.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.497+0000 7f9d95026640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ab139d40 0x5562ab151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:17.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.497+0000 7f9d95026640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ab139d40 0x5562ab151210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49754/0 (socket says 172.21.15.2:49754) 2024-09-19T04:59:17.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.497+0000 7f9d95026640 1 -- 172.21.15.2:0/3516094165 learned_addr learned my addr 172.21.15.2:0/3516094165 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:59:17.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.497+0000 7f9d8ffff640 1 --2- 172.21.15.2:0/3516094165 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562ab12f480 0x5562ab1315c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:17.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.497+0000 7f9d94825640 1 --2- 172.21.15.2:0/3516094165 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5562ab12eb60 0x5562ab138ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:17.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.497+0000 7f9d95026640 1 -- 172.21.15.2:0/3516094165 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5562ab12eb60 msgr2=0x5562ab138ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:59:17.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.497+0000 7f9d95026640 1 --2- 172.21.15.2:0/3516094165 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5562ab12eb60 0x5562ab138ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.497+0000 7f9d95026640 1 -- 172.21.15.2:0/3516094165 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562ab12f480 msgr2=0x5562ab1315c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:59:17.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.497+0000 7f9d95026640 1 --2- 172.21.15.2:0/3516094165 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562ab12f480 0x5562ab1315c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.497+0000 7f9d95026640 1 -- 172.21.15.2:0/3516094165 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562ab14bf60 con 0x5562ab139d40 2024-09-19T04:59:17.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.497+0000 7f9d95026640 1 --2- 172.21.15.2:0/3516094165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ab139d40 0x5562ab151210 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f9d8800e580 tx=0x7f9d880095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91a356c6aea109cf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:17.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.497+0000 7f9d867fc640 1 -- 172.21.15.2:0/3516094165 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d8801d070 con 0x5562ab139d40 2024-09-19T04:59:17.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.497+0000 7f9d867fc640 1 -- 172.21.15.2:0/3516094165 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9d88003e40 con 0x5562ab139d40 2024-09-19T04:59:17.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.497+0000 7f9d867fc640 1 -- 172.21.15.2:0/3516094165 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d8800d760 con 0x5562ab139d40 2024-09-19T04:59:17.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.498+0000 7f9d98e62740 1 -- 172.21.15.2:0/3516094165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ab139d40 msgr2=0x5562ab151210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:17.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.498+0000 7f9d98e62740 1 --2- 172.21.15.2:0/3516094165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ab139d40 0x5562ab151210 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f9d8800e580 tx=0x7f9d880095c0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.498+0000 7f9d98e62740 1 -- 172.21.15.2:0/3516094165 shutdown_connections 2024-09-19T04:59:17.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.498+0000 7f9d98e62740 1 --2- 172.21.15.2:0/3516094165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ab139d40 0x5562ab151210 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.498+0000 7f9d98e62740 1 --2- 172.21.15.2:0/3516094165 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562ab12f480 0x5562ab1315c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.498+0000 7f9d98e62740 1 --2- 172.21.15.2:0/3516094165 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5562ab12eb60 0x5562ab138ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.499+0000 7f9d98e62740 1 -- 172.21.15.2:0/3516094165 >> 172.21.15.2:0/3516094165 conn(0x5562ab12b0f0 msgr2=0x5562ab135c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:17.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.499+0000 7f9d98e62740 1 -- 172.21.15.2:0/3516094165 shutdown_connections 2024-09-19T04:59:17.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.499+0000 7f9d98e62740 1 -- 172.21.15.2:0/3516094165 wait complete. 2024-09-19T04:59:17.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.499+0000 7f9d98e62740 1 -- start start 2024-09-19T04:59:17.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.499+0000 7f9d98e62740 1 Processor -- start 2024-09-19T04:59:17.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.500+0000 7f9d98e62740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562ab12eb60 0x5562ab13d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:17.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.500+0000 7f9d98e62740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ab12f480 0x5562ab13dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:17.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.500+0000 7f9d98e62740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5562ab139d40 0x5562ab13e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:17.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.500+0000 7f9d98e62740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9d901ae650 con 0x5562ab12f480 2024-09-19T04:59:17.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.500+0000 7f9d98e62740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9d901afac0 con 0x5562ab12eb60 2024-09-19T04:59:17.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.500+0000 7f9d98e62740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f9d901aed20 con 0x5562ab139d40 2024-09-19T04:59:17.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.500+0000 7f9d98e62740 10 client.0 _ll_register_callbacks cb 0x7f9d88009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:59:17.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.500+0000 7f9d8ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ab12f480 0x5562ab13dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:17.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.500+0000 7f9d8ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ab12f480 0x5562ab13dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49768/0 (socket says 172.21.15.2:49768) 2024-09-19T04:59:17.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.500+0000 7f9d8ffff640 1 -- 172.21.15.2:0/2986033145 learned_addr learned my addr 172.21.15.2:0/2986033145 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:59:17.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.500+0000 7f9d94825640 1 --2- 172.21.15.2:0/2986033145 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562ab12eb60 0x5562ab13d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:17.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.500+0000 7f9d95026640 1 --2- 172.21.15.2:0/2986033145 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5562ab139d40 0x5562ab13e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:17.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.500+0000 7f9d8ffff640 1 -- 172.21.15.2:0/2986033145 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5562ab139d40 msgr2=0x5562ab13e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:59:17.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.500+0000 7f9d8ffff640 1 --2- 172.21.15.2:0/2986033145 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5562ab139d40 0x5562ab13e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.500+0000 7f9d8ffff640 1 -- 172.21.15.2:0/2986033145 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562ab12eb60 msgr2=0x5562ab13d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:59:17.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.500+0000 7f9d8ffff640 1 --2- 172.21.15.2:0/2986033145 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562ab12eb60 0x5562ab13d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.500+0000 7f9d8ffff640 1 -- 172.21.15.2:0/2986033145 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562ab1b3290 con 0x5562ab12f480 2024-09-19T04:59:17.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.500+0000 7f9d94825640 1 --2- 172.21.15.2:0/2986033145 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562ab12eb60 0x5562ab13d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:59:17.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.500+0000 7f9d8ffff640 1 --2- 172.21.15.2:0/2986033145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ab12f480 0x5562ab13dd20 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f9d800bcd90 tx=0x7f9d800bd410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d6cd664f32d7118 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:17.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.500+0000 7f9d6ffff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:59:17.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.501+0000 7f9d6ffff640 1 -- 172.21.15.2:0/2986033145 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d800d9060 con 0x5562ab12f480 2024-09-19T04:59:17.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.501+0000 7f9d98e62740 1 -- 172.21.15.2:0/2986033145 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5562ab0a17f0 con 0x5562ab12f480 2024-09-19T04:59:17.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.501+0000 7f9d6ffff640 1 -- 172.21.15.2:0/2986033145 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8527+0+0 (secure 0 0 0) 0x7f9d800c24b0 con 0x5562ab12f480 2024-09-19T04:59:17.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.501+0000 7f9d6ffff640 1 -- 172.21.15.2:0/2986033145 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f9d800c5a70 con 0x5562ab12f480 2024-09-19T04:59:17.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.501+0000 7f9d98e62740 10 client.16884 fetch_fsmap learned FSMap version 19 2024-09-19T04:59:17.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.501+0000 7f9d98e62740 1 -- 172.21.15.2:0/2986033145 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5562ab1b3290 con 0x5562ab12f480 2024-09-19T04:59:17.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.501+0000 7f9d6ffff640 1 -- 172.21.15.2:0/2986033145 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x5562ab0a17f0 con 0x5562ab12f480 2024-09-19T04:59:17.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.502+0000 7f9d6ffff640 1 -- 172.21.15.2:0/2986033145 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f9d800c55e0 con 0x5562ab12f480 2024-09-19T04:59:17.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.502+0000 7f9d98e62740 10 client.16884 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:59:17.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.502+0000 7f9d98e62740 10 client.16884 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:59:17.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.502+0000 7f9d98e62740 20 client.16884 populate_metadata read hostname 'smithi002' 2024-09-19T04:59:17.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.502+0000 7f9d98e62740 1 --2- 172.21.15.2:0/2986033145 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5562ab1b4900 0x5562ab1b6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:17.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.502+0000 7f9d98e62740 4 client.16884 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:59:17.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.502+0000 7f9d98e62740 1 -- 172.21.15.2:0/2986033145 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5562ab09bd00 con 0x5562ab1b4900 2024-09-19T04:59:17.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.502+0000 7f9d94825640 1 --2- 172.21.15.2:0/2986033145 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5562ab1b4900 0x5562ab1b6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:17.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.502+0000 7f9d94825640 1 --2- 172.21.15.2:0/2986033145 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5562ab1b4900 0x5562ab1b6d20 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d4e90f58ce51f1 server_cookie=e990ce231d5b40d5 in_seq=0 out_seq=0 2024-09-19T04:59:17.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.502+0000 7f9d6ffff640 10 client.16884 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:59:17.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.503+0000 7f9d6ffff640 1 -- 172.21.15.2:0/2986033145 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5562ab09bd00 con 0x5562ab1b4900 2024-09-19T04:59:17.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.503+0000 7f9d6ffff640 10 client.16884 handle_command_reply: tid=0 2024-09-19T04:59:17.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.503+0000 7f9d98e62740 1 client.16884 shutdown 2024-09-19T04:59:17.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.503+0000 7f9d98e62740 1 -- 172.21.15.2:0/2986033145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ab12f480 msgr2=0x5562ab13dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:17.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.503+0000 7f9d98e62740 1 --2- 172.21.15.2:0/2986033145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ab12f480 0x5562ab13dd20 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f9d800bcd90 tx=0x7f9d800bd410 comp rx=0 tx=0).stop 2024-09-19T04:59:17.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.504+0000 7f9d98e62740 1 -- 172.21.15.2:0/2986033145 shutdown_connections 2024-09-19T04:59:17.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.504+0000 7f9d98e62740 1 --2- 172.21.15.2:0/2986033145 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5562ab1b4900 0x5562ab1b6d20 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.504+0000 7f9d98e62740 1 --2- 172.21.15.2:0/2986033145 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5562ab139d40 0x5562ab13e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.504+0000 7f9d98e62740 1 --2- 172.21.15.2:0/2986033145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5562ab12f480 0x5562ab13dd20 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.504+0000 7f9d6ffff640 0 client.16884 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:59:17.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.504+0000 7f9d98e62740 1 --2- 172.21.15.2:0/2986033145 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562ab12eb60 0x5562ab13d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.504+0000 7f9d98e62740 1 -- 172.21.15.2:0/2986033145 >> 172.21.15.2:0/2986033145 conn(0x5562ab12b0f0 msgr2=0x5562ab135c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:17.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.504+0000 7f9d98e62740 1 -- 172.21.15.2:0/2986033145 shutdown_connections 2024-09-19T04:59:17.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.504+0000 7f9d98e62740 1 -- 172.21.15.2:0/2986033145 wait complete. 2024-09-19T04:59:17.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.504+0000 7f9d98e62740 20 client.16884 trim_cache size 0 max 16384 2024-09-19T04:59:17.509 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:59:17.509 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T04:59:17.509 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "e09c494d-4a2e-4f15-817e-baadbdc3dcac", 2024-09-19T04:59:17.509 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T04:59:17.510 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:59:17.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.505+0000 7f9d96a89640 1 -- 172.21.15.2:0/3620524458 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f9d7c0a33b0 msgr2=0x7f9d7c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:17.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.505+0000 7f9d96a89640 1 --2- 172.21.15.2:0/3620524458 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f9d7c0a33b0 0x7f9d7c0a5870 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9d78009bd0 tx=0x7f9d78005f90 comp rx=0 tx=0).stop 2024-09-19T04:59:17.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.505+0000 7f9d96a89640 1 -- 172.21.15.2:0/3620524458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d90102570 msgr2=0x7f9d900fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:17.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.505+0000 7f9d96a89640 1 --2- 172.21.15.2:0/3620524458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d90102570 0x7f9d900fd1c0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f9d80000c00 tx=0x7f9d80030ef0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.505+0000 7f9d96a89640 1 -- 172.21.15.2:0/3620524458 shutdown_connections 2024-09-19T04:59:17.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.505+0000 7f9d96a89640 1 --2- 172.21.15.2:0/3620524458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d90102ef0 0x7f9d900fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.505+0000 7f9d96a89640 1 --2- 172.21.15.2:0/3620524458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d90102570 0x7f9d900fd1c0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.505+0000 7f9d96a89640 1 --2- 172.21.15.2:0/3620524458 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f9d7c0a33b0 0x7f9d7c0a5870 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.505+0000 7f9d96a89640 1 --2- 172.21.15.2:0/3620524458 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d90100e20 0x7f9d900fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.505+0000 7f9d96a89640 1 -- 172.21.15.2:0/3620524458 >> 172.21.15.2:0/3620524458 conn(0x7f9d900fc7d0 msgr2=0x7f9d9006a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:17.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.505+0000 7f9d96a89640 1 -- 172.21.15.2:0/3620524458 shutdown_connections 2024-09-19T04:59:17.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.505+0000 7f9d96a89640 1 -- 172.21.15.2:0/3620524458 wait complete. 2024-09-19T04:59:17.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:17 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:59:17.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:17 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:59:17.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:17 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:59:17.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:17 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:59:17.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:17 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:59:17.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:17 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:59:17.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:17 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:59:17.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:17 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T04:59:17.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.662+0000 7fd55d67b640 1 -- 172.21.15.2:0/3006364617 --> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7fd558101f60 con 0x7fd5440a33b0 2024-09-19T04:59:17.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.669+0000 7fd554ff9640 1 -- 172.21.15.2:0/3006364617 <== mgr.15096 v2:172.21.15.2:6800/852329670 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7fd558101f60 con 0x7fd5440a33b0 2024-09-19T04:59:17.670 INFO:teuthology.orchestra.run.smithi002.stdout:/ 1m 6m3h 2024-09-19T04:59:17.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.671+0000 7fd55d67b640 1 -- 172.21.15.2:0/3006364617 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fd5440a33b0 msgr2=0x7fd5440a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:17.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.671+0000 7fd55d67b640 1 --2- 172.21.15.2:0/3006364617 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fd5440a33b0 0x7fd5440a5870 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd5480058c0 tx=0x7fd548005850 comp rx=0 tx=0).stop 2024-09-19T04:59:17.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.671+0000 7fd55d67b640 1 -- 172.21.15.2:0/3006364617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5581035e0 msgr2=0x7fd55819aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:17.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.671+0000 7fd55d67b640 1 --2- 172.21.15.2:0/3006364617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5581035e0 0x7fd55819aa00 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fd54000e9f0 tx=0x7fd54000edf0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.671+0000 7fd55d67b640 1 -- 172.21.15.2:0/3006364617 shutdown_connections 2024-09-19T04:59:17.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.671+0000 7fd55d67b640 1 --2- 172.21.15.2:0/3006364617 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd55810c130 0x7fd55819ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.671+0000 7fd55d67b640 1 --2- 172.21.15.2:0/3006364617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5581035e0 0x7fd55819aa00 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.671+0000 7fd55d67b640 1 --2- 172.21.15.2:0/3006364617 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fd5440a33b0 0x7fd5440a5870 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.671+0000 7fd55d67b640 1 --2- 172.21.15.2:0/3006364617 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd558102c30 0x7fd55819a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:17.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.671+0000 7fd55d67b640 1 -- 172.21.15.2:0/3006364617 >> 172.21.15.2:0/3006364617 conn(0x7fd5580fc6f0 msgr2=0x7fd558100840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:17.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.671+0000 7fd55d67b640 1 -- 172.21.15.2:0/3006364617 shutdown_connections 2024-09-19T04:59:17.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:17.671+0000 7fd55d67b640 1 -- 172.21.15.2:0/3006364617 wait complete. 2024-09-19T04:59:17.683 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-19T04:59:17.694 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-19T04:59:18.288 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:59:18.544 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:59:18.556 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:18 smithi018 ceph-mon[34537]: from='client.16860 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:59:18.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:18 smithi018 ceph-mon[34537]: pgmap v352: 97 pgs: 97 active+clean; 24 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 67 KiB/s wr, 8 op/s 2024-09-19T04:59:18.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:18 smithi018 ceph-mon[34537]: from='client.16866 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:59:18.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:18 smithi002 ceph-mon[30975]: from='client.16860 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:59:18.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:18 smithi002 ceph-mon[30975]: pgmap v352: 97 pgs: 97 active+clean; 24 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 67 KiB/s wr, 8 op/s 2024-09-19T04:59:18.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:18 smithi002 ceph-mon[30975]: from='client.16866 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:59:18.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:18 smithi116 ceph-mon[34477]: from='client.16860 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:59:18.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:18 smithi116 ceph-mon[34477]: pgmap v352: 97 pgs: 97 active+clean; 24 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 67 KiB/s wr, 8 op/s 2024-09-19T04:59:18.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:18 smithi116 ceph-mon[34477]: from='client.16866 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:59:19.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.020+0000 7f0442321640 1 -- 172.21.15.2:0/2189008564 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f043c103660 msgr2=0x7f043c10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:19.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.020+0000 7f0442321640 1 --2- 172.21.15.2:0/2189008564 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f043c103660 0x7f043c10bb50 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f0430009900 tx=0x7f043002a480 comp rx=0 tx=0).stop 2024-09-19T04:59:19.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.020+0000 7f0442321640 1 -- 172.21.15.2:0/2189008564 shutdown_connections 2024-09-19T04:59:19.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.020+0000 7f0442321640 1 --2- 172.21.15.2:0/2189008564 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f043c10c170 0x7f043c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:19.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.020+0000 7f0442321640 1 --2- 172.21.15.2:0/2189008564 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f043c103660 0x7f043c10bb50 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:19.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.020+0000 7f0442321640 1 --2- 172.21.15.2:0/2189008564 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f043c102d40 0x7f043c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:19.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.020+0000 7f0442321640 1 -- 172.21.15.2:0/2189008564 >> 172.21.15.2:0/2189008564 conn(0x7f043c0fc7a0 msgr2=0x7f043c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:19.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.020+0000 7f0442321640 1 -- 172.21.15.2:0/2189008564 shutdown_connections 2024-09-19T04:59:19.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.021+0000 7f0442321640 1 -- 172.21.15.2:0/2189008564 wait complete. 2024-09-19T04:59:19.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.021+0000 7f0442321640 1 Processor -- start 2024-09-19T04:59:19.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.021+0000 7f0442321640 1 -- start start 2024-09-19T04:59:19.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.022+0000 7f0442321640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f043c102d40 0x7f043c198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:19.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.022+0000 7f0442321640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f043c103660 0x7f043c198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:19.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.022+0000 7f0442321640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f043c10c170 0x7f043c19cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:19.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.022+0000 7f0442321640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f043c111e20 con 0x7f043c103660 2024-09-19T04:59:19.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.022+0000 7f0442321640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f043c111ca0 con 0x7f043c102d40 2024-09-19T04:59:19.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.022+0000 7f0442321640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f043c111fa0 con 0x7f043c10c170 2024-09-19T04:59:19.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.022+0000 7f043b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f043c103660 0x7f043c198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:19.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.022+0000 7f043b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f043c103660 0x7f043c198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49776/0 (socket says 172.21.15.2:49776) 2024-09-19T04:59:19.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.022+0000 7f043b7fe640 1 -- 172.21.15.2:0/4294258110 learned_addr learned my addr 172.21.15.2:0/4294258110 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:59:19.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.022+0000 7f043bfff640 1 --2- 172.21.15.2:0/4294258110 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f043c102d40 0x7f043c198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:19.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.022+0000 7f04408be640 1 --2- 172.21.15.2:0/4294258110 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f043c10c170 0x7f043c19cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:19.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.022+0000 7f043b7fe640 1 -- 172.21.15.2:0/4294258110 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f043c10c170 msgr2=0x7f043c19cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:19.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.022+0000 7f043b7fe640 1 --2- 172.21.15.2:0/4294258110 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f043c10c170 0x7f043c19cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:19.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.022+0000 7f043b7fe640 1 -- 172.21.15.2:0/4294258110 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f043c102d40 msgr2=0x7f043c198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:19.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.022+0000 7f043b7fe640 1 --2- 172.21.15.2:0/4294258110 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f043c102d40 0x7f043c198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:19.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.022+0000 7f043b7fe640 1 -- 172.21.15.2:0/4294258110 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f043c19d2b0 con 0x7f043c103660 2024-09-19T04:59:19.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.022+0000 7f043b7fe640 1 --2- 172.21.15.2:0/4294258110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f043c103660 0x7f043c198840 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f0430005940 tx=0x7f04300042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:19.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.022+0000 7f04397fa640 1 -- 172.21.15.2:0/4294258110 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043003f030 con 0x7f043c103660 2024-09-19T04:59:19.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.023+0000 7f0442321640 1 -- 172.21.15.2:0/4294258110 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f043c19d540 con 0x7f043c103660 2024-09-19T04:59:19.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.023+0000 7f04397fa640 1 -- 172.21.15.2:0/4294258110 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0430003cb0 con 0x7f043c103660 2024-09-19T04:59:19.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.023+0000 7f04397fa640 1 -- 172.21.15.2:0/4294258110 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0430035070 con 0x7f043c103660 2024-09-19T04:59:19.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.023+0000 7f0442321640 1 -- 172.21.15.2:0/4294258110 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f043c1a4e80 con 0x7f043c103660 2024-09-19T04:59:19.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.025+0000 7f04397fa640 1 -- 172.21.15.2:0/4294258110 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f0430042030 con 0x7f043c103660 2024-09-19T04:59:19.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.025+0000 7f04446fa740 1 Processor -- start 2024-09-19T04:59:19.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.025+0000 7f04446fa740 1 -- start start 2024-09-19T04:59:19.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.025+0000 7f04446fa740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55669f2204a0 0x55669f220880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:19.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.025+0000 7f04446fa740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55669f220dc0 0x55669f22b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:19.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.025+0000 7f04446fa740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55669f22b680 0x55669f22da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:19.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.025+0000 7f04446fa740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55669f1862e0 con 0x55669f22b680 2024-09-19T04:59:19.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.025+0000 7f04446fa740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55669f12dce0 con 0x55669f2204a0 2024-09-19T04:59:19.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.025+0000 7f04446fa740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55669f1822a0 con 0x55669f220dc0 2024-09-19T04:59:19.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.026+0000 7f043b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55669f22b680 0x55669f22da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:19.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.026+0000 7f04397fa640 1 --2- 172.21.15.2:0/4294258110 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f04240a33b0 0x7f04240a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:19.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.026+0000 7f043b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55669f22b680 0x55669f22da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49780/0 (socket says 172.21.15.2:49780) 2024-09-19T04:59:19.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.026+0000 7f043b7fe640 1 -- 172.21.15.2:0/3215907208 learned_addr learned my addr 172.21.15.2:0/3215907208 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:59:19.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.026+0000 7f04408be640 1 --2- 172.21.15.2:0/3215907208 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55669f2204a0 0x55669f220880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:19.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.026+0000 7f04408be640 1 --2- 172.21.15.2:0/4294258110 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f04240a33b0 0x7f04240a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:19.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.026+0000 7f043bfff640 1 --2- 172.21.15.2:0/3215907208 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55669f220dc0 0x55669f22b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:19.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.026+0000 7f04397fa640 1 -- 172.21.15.2:0/4294258110 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8527+0+0 (secure 0 0 0) 0x7f04300f0530 con 0x7f043c103660 2024-09-19T04:59:19.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.026+0000 7f043b7fe640 1 -- 172.21.15.2:0/3215907208 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55669f220dc0 msgr2=0x55669f22b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:59:19.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.026+0000 7f043b7fe640 1 --2- 172.21.15.2:0/3215907208 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55669f220dc0 0x55669f22b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:19.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.026+0000 7f043b7fe640 1 -- 172.21.15.2:0/3215907208 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55669f2204a0 msgr2=0x55669f220880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:59:19.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.026+0000 7f043b7fe640 1 --2- 172.21.15.2:0/3215907208 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55669f2204a0 0x55669f220880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:19.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.026+0000 7f043b7fe640 1 -- 172.21.15.2:0/3215907208 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55669f112440 con 0x55669f22b680 2024-09-19T04:59:19.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.026+0000 7f043b7fe640 1 --2- 172.21.15.2:0/3215907208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55669f22b680 0x55669f22da70 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f04300edc20 tx=0x7f043002a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4028645a3708586c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:19.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.026+0000 7f04408be640 1 --2- 172.21.15.2:0/4294258110 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f04240a33b0 0x7f04240a5870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0434005c40 tx=0x7f0434005bd0 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:19.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.026+0000 7f04227fc640 1 -- 172.21.15.2:0/3215907208 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0430049070 con 0x55669f22b680 2024-09-19T04:59:19.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.026+0000 7f04227fc640 1 -- 172.21.15.2:0/3215907208 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f04300c0bc0 con 0x55669f22b680 2024-09-19T04:59:19.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.026+0000 7f04227fc640 1 -- 172.21.15.2:0/3215907208 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04300b8e80 con 0x55669f22b680 2024-09-19T04:59:19.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.027+0000 7f04446fa740 1 -- 172.21.15.2:0/3215907208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55669f22b680 msgr2=0x55669f22da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:19.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.027+0000 7f04446fa740 1 --2- 172.21.15.2:0/3215907208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55669f22b680 0x55669f22da70 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f04300edc20 tx=0x7f043002a480 comp rx=0 tx=0).stop 2024-09-19T04:59:19.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.027+0000 7f04446fa740 1 -- 172.21.15.2:0/3215907208 shutdown_connections 2024-09-19T04:59:19.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.027+0000 7f04446fa740 1 --2- 172.21.15.2:0/3215907208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55669f22b680 0x55669f22da70 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:19.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.027+0000 7f04446fa740 1 --2- 172.21.15.2:0/3215907208 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55669f220dc0 0x55669f22b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:19.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.027+0000 7f04446fa740 1 --2- 172.21.15.2:0/3215907208 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55669f2204a0 0x55669f220880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:19.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.027+0000 7f04446fa740 1 -- 172.21.15.2:0/3215907208 >> 172.21.15.2:0/3215907208 conn(0x55669f21ca30 msgr2=0x55669f21ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:19.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.027+0000 7f04446fa740 1 -- 172.21.15.2:0/3215907208 shutdown_connections 2024-09-19T04:59:19.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.027+0000 7f04446fa740 1 -- 172.21.15.2:0/3215907208 wait complete. 2024-09-19T04:59:19.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.028+0000 7f04446fa740 1 -- start start 2024-09-19T04:59:19.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.028+0000 7f04446fa740 1 Processor -- start 2024-09-19T04:59:19.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.028+0000 7f04446fa740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55669f2204a0 0x55669f22af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:19.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.028+0000 7f04446fa740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55669f220dc0 0x55669f2281d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:19.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.028+0000 7f04446fa740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55669f22b680 0x55669f228710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:19.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.028+0000 7f04446fa740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55669f22e010 con 0x55669f22b680 2024-09-19T04:59:19.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.028+0000 7f04446fa740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55669f141050 con 0x55669f220dc0 2024-09-19T04:59:19.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.028+0000 7f04446fa740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55669f22e190 con 0x55669f2204a0 2024-09-19T04:59:19.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.028+0000 7f04446fa740 10 client.0 _ll_register_callbacks cb 0x55669f181160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:59:19.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.029+0000 7f04408be640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55669f22b680 0x55669f228710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:19.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.029+0000 7f04408be640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55669f22b680 0x55669f228710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49786/0 (socket says 172.21.15.2:49786) 2024-09-19T04:59:19.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.029+0000 7f04408be640 1 -- 172.21.15.2:0/1157405839 learned_addr learned my addr 172.21.15.2:0/1157405839 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:59:19.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.029+0000 7f043b7fe640 1 --2- 172.21.15.2:0/1157405839 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55669f220dc0 0x55669f2281d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:19.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.029+0000 7f043bfff640 1 --2- 172.21.15.2:0/1157405839 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55669f2204a0 0x55669f22af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:19.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.029+0000 7f04408be640 1 -- 172.21.15.2:0/1157405839 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55669f2204a0 msgr2=0x55669f22af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:59:19.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.029+0000 7f04408be640 1 --2- 172.21.15.2:0/1157405839 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55669f2204a0 0x55669f22af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:19.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.029+0000 7f04408be640 1 -- 172.21.15.2:0/1157405839 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55669f220dc0 msgr2=0x55669f2281d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:59:19.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.029+0000 7f04408be640 1 --2- 172.21.15.2:0/1157405839 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55669f220dc0 0x55669f2281d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:19.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.029+0000 7f04408be640 1 -- 172.21.15.2:0/1157405839 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55669eef73c0 con 0x55669f22b680 2024-09-19T04:59:19.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.029+0000 7f04408be640 1 --2- 172.21.15.2:0/1157405839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55669f22b680 0x55669f228710 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f043400dac0 tx=0x7f0434004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a02c5540fc7b4ac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:19.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.029+0000 7f041b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:59:19.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.029+0000 7f041b7fe640 1 -- 172.21.15.2:0/1157405839 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0434010ca0 con 0x55669f22b680 2024-09-19T04:59:19.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.029+0000 7f041b7fe640 1 -- 172.21.15.2:0/1157405839 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8527+0+0 (secure 0 0 0) 0x7f0434020440 con 0x55669f22b680 2024-09-19T04:59:19.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.029+0000 7f04446fa740 1 -- 172.21.15.2:0/1157405839 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55669f193850 con 0x55669f22b680 2024-09-19T04:59:19.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.029+0000 7f041b7fe640 1 -- 172.21.15.2:0/1157405839 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f0434010e40 con 0x55669f22b680 2024-09-19T04:59:19.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.030+0000 7f04446fa740 10 client.16896 fetch_fsmap learned FSMap version 19 2024-09-19T04:59:19.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.030+0000 7f04446fa740 1 -- 172.21.15.2:0/1157405839 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55669f239900 con 0x55669f22b680 2024-09-19T04:59:19.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.030+0000 7f041b7fe640 1 -- 172.21.15.2:0/1157405839 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55669f193850 con 0x55669f22b680 2024-09-19T04:59:19.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.030+0000 7f041b7fe640 1 -- 172.21.15.2:0/1157405839 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f04340336e0 con 0x55669f22b680 2024-09-19T04:59:19.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.030+0000 7f04446fa740 10 client.16896 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:59:19.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.030+0000 7f04446fa740 10 client.16896 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:59:19.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.030+0000 7f04446fa740 20 client.16896 populate_metadata read hostname 'smithi002' 2024-09-19T04:59:19.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.030+0000 7f04446fa740 1 --2- 172.21.15.2:0/1157405839 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55669f23ad10 0x55669f23d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:19.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.030+0000 7f04446fa740 4 client.16896 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:59:19.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.030+0000 7f04446fa740 1 -- 172.21.15.2:0/1157405839 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55669f18dd60 con 0x55669f23ad10 2024-09-19T04:59:19.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.030+0000 7f043bfff640 1 --2- 172.21.15.2:0/1157405839 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55669f23ad10 0x55669f23d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:19.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.031+0000 7f043bfff640 1 --2- 172.21.15.2:0/1157405839 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55669f23ad10 0x55669f23d190 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=733d6ebe3f6f3d05 server_cookie=c5b1395b55978093 in_seq=0 out_seq=0 2024-09-19T04:59:19.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.031+0000 7f041b7fe640 10 client.16896 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:59:19.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.031+0000 7f041b7fe640 1 -- 172.21.15.2:0/1157405839 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55669f18dd60 con 0x55669f23ad10 2024-09-19T04:59:19.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.031+0000 7f041b7fe640 10 client.16896 handle_command_reply: tid=0 2024-09-19T04:59:19.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.032+0000 7f04446fa740 1 client.16896 shutdown 2024-09-19T04:59:19.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.032+0000 7f04446fa740 1 -- 172.21.15.2:0/1157405839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55669f22b680 msgr2=0x55669f228710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:19.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.032+0000 7f04446fa740 1 --2- 172.21.15.2:0/1157405839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55669f22b680 0x55669f228710 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f043400dac0 tx=0x7f0434004a40 comp rx=0 tx=0).stop 2024-09-19T04:59:19.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.032+0000 7f04446fa740 1 -- 172.21.15.2:0/1157405839 shutdown_connections 2024-09-19T04:59:19.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.032+0000 7f04446fa740 1 --2- 172.21.15.2:0/1157405839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55669f22b680 0x55669f228710 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:19.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.032+0000 7f04446fa740 1 --2- 172.21.15.2:0/1157405839 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55669f220dc0 0x55669f2281d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:19.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.032+0000 7f04446fa740 1 --2- 172.21.15.2:0/1157405839 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55669f23ad10 0x55669f23d190 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:19.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.032+0000 7f04446fa740 1 --2- 172.21.15.2:0/1157405839 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55669f2204a0 0x55669f22af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:19.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.032+0000 7f04446fa740 1 -- 172.21.15.2:0/1157405839 >> 172.21.15.2:0/1157405839 conn(0x55669f21ca30 msgr2=0x55669f222710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:19.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.032+0000 7f041b7fe640 0 client.16896 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:59:19.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.032+0000 7f04446fa740 1 -- 172.21.15.2:0/1157405839 shutdown_connections 2024-09-19T04:59:19.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.032+0000 7f04446fa740 1 -- 172.21.15.2:0/1157405839 wait complete. 2024-09-19T04:59:19.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.032+0000 7f04446fa740 20 client.16896 trim_cache size 0 max 16384 2024-09-19T04:59:19.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.049+0000 7f04446fa740 1 Processor -- start 2024-09-19T04:59:19.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.049+0000 7f04446fa740 1 -- start start 2024-09-19T04:59:19.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.049+0000 7f04446fa740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55669f2204a0 0x55669f2371e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:19.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.049+0000 7f04446fa740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55669f220dc0 0x55669f2283c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:19.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.049+0000 7f04446fa740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55669f22b680 0x55669f2237a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:19.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.050+0000 7f04446fa740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f043c1a9590 con 0x55669f2204a0 2024-09-19T04:59:19.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.050+0000 7f04446fa740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f043c1abdd0 con 0x55669f22b680 2024-09-19T04:59:19.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.050+0000 7f04446fa740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f043c1a9be0 con 0x55669f220dc0 2024-09-19T04:59:19.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.050+0000 7f043bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55669f2204a0 0x55669f2371e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:19.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.050+0000 7f043bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55669f2204a0 0x55669f2371e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49794/0 (socket says 172.21.15.2:49794) 2024-09-19T04:59:19.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.050+0000 7f043bfff640 1 -- 172.21.15.2:0/4028629228 learned_addr learned my addr 172.21.15.2:0/4028629228 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:59:19.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.050+0000 7f043b7fe640 1 --2- 172.21.15.2:0/4028629228 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55669f220dc0 0x55669f2283c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:19.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.050+0000 7f04408be640 1 --2- 172.21.15.2:0/4028629228 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55669f22b680 0x55669f2237a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:19.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.050+0000 7f043bfff640 1 -- 172.21.15.2:0/4028629228 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55669f220dc0 msgr2=0x55669f2283c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:59:19.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.050+0000 7f043bfff640 1 --2- 172.21.15.2:0/4028629228 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55669f220dc0 0x55669f2283c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:19.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.050+0000 7f043bfff640 1 -- 172.21.15.2:0/4028629228 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55669f22b680 msgr2=0x55669f2237a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:59:19.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.050+0000 7f043bfff640 1 --2- 172.21.15.2:0/4028629228 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55669f22b680 0x55669f2237a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:19.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.050+0000 7f043bfff640 1 -- 172.21.15.2:0/4028629228 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55669f227180 con 0x55669f2204a0 2024-09-19T04:59:19.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.051+0000 7f043bfff640 1 --2- 172.21.15.2:0/4028629228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55669f2204a0 0x55669f2371e0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f042c004700 tx=0x7f042c013830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6107cd6f0a8d2ae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:19.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.051+0000 7f0421ffb640 1 -- 172.21.15.2:0/4028629228 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042c01c460 con 0x55669f2204a0 2024-09-19T04:59:19.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.051+0000 7f0421ffb640 1 -- 172.21.15.2:0/4028629228 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f042c01cab0 con 0x55669f2204a0 2024-09-19T04:59:19.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.051+0000 7f0421ffb640 1 -- 172.21.15.2:0/4028629228 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042c0118b0 con 0x55669f2204a0 2024-09-19T04:59:19.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.051+0000 7f04446fa740 1 -- 172.21.15.2:0/4028629228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55669f2204a0 msgr2=0x55669f2371e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:19.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.051+0000 7f04446fa740 1 --2- 172.21.15.2:0/4028629228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55669f2204a0 0x55669f2371e0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f042c004700 tx=0x7f042c013830 comp rx=0 tx=0).stop 2024-09-19T04:59:19.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.051+0000 7f04446fa740 1 -- 172.21.15.2:0/4028629228 shutdown_connections 2024-09-19T04:59:19.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.051+0000 7f04446fa740 1 --2- 172.21.15.2:0/4028629228 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55669f22b680 0x55669f2237a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:19.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.051+0000 7f04446fa740 1 --2- 172.21.15.2:0/4028629228 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55669f220dc0 0x55669f2283c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:19.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.051+0000 7f04446fa740 1 --2- 172.21.15.2:0/4028629228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55669f2204a0 0x55669f2371e0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:19.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.051+0000 7f04446fa740 1 -- 172.21.15.2:0/4028629228 >> 172.21.15.2:0/4028629228 conn(0x55669f21ca30 msgr2=0x55669f223090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:19.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.052+0000 7f04446fa740 1 -- 172.21.15.2:0/4028629228 shutdown_connections 2024-09-19T04:59:19.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.052+0000 7f04446fa740 1 -- 172.21.15.2:0/4028629228 wait complete. 2024-09-19T04:59:19.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.052+0000 7f04446fa740 1 -- start start 2024-09-19T04:59:19.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.052+0000 7f04446fa740 1 Processor -- start 2024-09-19T04:59:19.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.052+0000 7f04446fa740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55669f2204a0 0x55669f2337b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:19.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.052+0000 7f04446fa740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55669f220dc0 0x55669f22eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:19.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.052+0000 7f04446fa740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55669f22b680 0x55669f22f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:19.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.053+0000 7f04446fa740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f043c1aa290 con 0x55669f220dc0 2024-09-19T04:59:19.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.053+0000 7f04446fa740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f043c1ab700 con 0x55669f2204a0 2024-09-19T04:59:19.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.053+0000 7f04446fa740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f043c1aa960 con 0x55669f22b680 2024-09-19T04:59:19.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.053+0000 7f04446fa740 10 client.0 _ll_register_callbacks cb 0x7f0434009c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:59:19.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.053+0000 7f043b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55669f220dc0 0x55669f22eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:19.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.053+0000 7f043b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55669f220dc0 0x55669f22eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49808/0 (socket says 172.21.15.2:49808) 2024-09-19T04:59:19.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.053+0000 7f043b7fe640 1 -- 172.21.15.2:0/1107262832 learned_addr learned my addr 172.21.15.2:0/1107262832 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:59:19.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.053+0000 7f043bfff640 1 --2- 172.21.15.2:0/1107262832 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55669f2204a0 0x55669f2337b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:19.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.053+0000 7f04408be640 1 --2- 172.21.15.2:0/1107262832 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55669f22b680 0x55669f22f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:19.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.053+0000 7f043b7fe640 1 -- 172.21.15.2:0/1107262832 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55669f22b680 msgr2=0x55669f22f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:59:19.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.053+0000 7f043b7fe640 1 --2- 172.21.15.2:0/1107262832 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55669f22b680 0x55669f22f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:19.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.053+0000 7f043b7fe640 1 -- 172.21.15.2:0/1107262832 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55669f2204a0 msgr2=0x55669f2337b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:59:19.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.053+0000 7f043b7fe640 1 --2- 172.21.15.2:0/1107262832 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55669f2204a0 0x55669f2337b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:19.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.053+0000 7f043b7fe640 1 -- 172.21.15.2:0/1107262832 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55669f22f560 con 0x55669f220dc0 2024-09-19T04:59:19.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.053+0000 7f043bfff640 1 --2- 172.21.15.2:0/1107262832 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55669f2204a0 0x55669f2337b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:59:19.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.053+0000 7f043b7fe640 1 --2- 172.21.15.2:0/1107262832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55669f220dc0 0x55669f22eae0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f04300bc4c0 tx=0x7f0430004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=213102052c33c9ca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:19.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.053+0000 7f041b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:59:19.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.053+0000 7f041b7fe640 1 -- 172.21.15.2:0/1107262832 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0430049040 con 0x55669f220dc0 2024-09-19T04:59:19.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.053+0000 7f041b7fe640 1 -- 172.21.15.2:0/1107262832 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8527+0+0 (secure 0 0 0) 0x7f04300bca70 con 0x55669f220dc0 2024-09-19T04:59:19.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.053+0000 7f04446fa740 1 -- 172.21.15.2:0/1107262832 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f042c01cab0 con 0x55669f220dc0 2024-09-19T04:59:19.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.054+0000 7f041b7fe640 1 -- 172.21.15.2:0/1107262832 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f04300bcf10 con 0x55669f220dc0 2024-09-19T04:59:19.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.054+0000 7f04446fa740 10 client.16902 fetch_fsmap learned FSMap version 19 2024-09-19T04:59:19.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.054+0000 7f04446fa740 1 -- 172.21.15.2:0/1107262832 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55669f2a57a0 con 0x55669f220dc0 2024-09-19T04:59:19.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.054+0000 7f041b7fe640 1 -- 172.21.15.2:0/1107262832 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f042c01cab0 con 0x55669f220dc0 2024-09-19T04:59:19.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.054+0000 7f041b7fe640 1 -- 172.21.15.2:0/1107262832 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f04300bdb40 con 0x55669f220dc0 2024-09-19T04:59:19.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.054+0000 7f04446fa740 10 client.16902 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:59:19.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.054+0000 7f04446fa740 10 client.16902 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:59:19.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.054+0000 7f04446fa740 20 client.16902 populate_metadata read hostname 'smithi002' 2024-09-19T04:59:19.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.054+0000 7f04446fa740 1 --2- 172.21.15.2:0/1107262832 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55669f2a5e30 0x55669f2a8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:19.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.054+0000 7f04446fa740 4 client.16902 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:59:19.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.054+0000 7f04446fa740 1 -- 172.21.15.2:0/1107262832 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55669f228aa0 con 0x55669f2a5e30 2024-09-19T04:59:19.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.054+0000 7f043bfff640 1 --2- 172.21.15.2:0/1107262832 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55669f2a5e30 0x55669f2a8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:19.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.055+0000 7f043bfff640 1 --2- 172.21.15.2:0/1107262832 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55669f2a5e30 0x55669f2a8250 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=196d18a72d2732a7 server_cookie=7ec6bbbad784bf57 in_seq=0 out_seq=0 2024-09-19T04:59:19.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.055+0000 7f041b7fe640 10 client.16902 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:59:19.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.055+0000 7f041b7fe640 1 -- 172.21.15.2:0/1107262832 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55669f228aa0 con 0x55669f2a5e30 2024-09-19T04:59:19.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.055+0000 7f041b7fe640 10 client.16902 handle_command_reply: tid=0 2024-09-19T04:59:19.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.055+0000 7f04446fa740 1 client.16902 shutdown 2024-09-19T04:59:19.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.055+0000 7f04446fa740 1 -- 172.21.15.2:0/1107262832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55669f220dc0 msgr2=0x55669f22eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:19.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.055+0000 7f04446fa740 1 --2- 172.21.15.2:0/1107262832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55669f220dc0 0x55669f22eae0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f04300bc4c0 tx=0x7f0430004270 comp rx=0 tx=0).stop 2024-09-19T04:59:19.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.055+0000 7f04446fa740 1 -- 172.21.15.2:0/1107262832 shutdown_connections 2024-09-19T04:59:19.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.055+0000 7f04446fa740 1 --2- 172.21.15.2:0/1107262832 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x55669f2a5e30 0x55669f2a8250 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:19.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.055+0000 7f041b7fe640 0 client.16902 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:59:19.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.055+0000 7f04446fa740 1 --2- 172.21.15.2:0/1107262832 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55669f22b680 0x55669f22f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:19.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.055+0000 7f04446fa740 1 --2- 172.21.15.2:0/1107262832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55669f220dc0 0x55669f22eae0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:19.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.055+0000 7f04446fa740 1 --2- 172.21.15.2:0/1107262832 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55669f2204a0 0x55669f2337b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:19.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.055+0000 7f04446fa740 1 -- 172.21.15.2:0/1107262832 >> 172.21.15.2:0/1107262832 conn(0x55669f21ca30 msgr2=0x55669f22a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:19.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.055+0000 7f04446fa740 1 -- 172.21.15.2:0/1107262832 shutdown_connections 2024-09-19T04:59:19.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.055+0000 7f04446fa740 1 -- 172.21.15.2:0/1107262832 wait complete. 2024-09-19T04:59:19.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.055+0000 7f04446fa740 20 client.16902 trim_cache size 0 max 16384 2024-09-19T04:59:19.063 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:59:19.063 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T04:59:19.063 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-19T04:59:19.063 INFO:teuthology.orchestra.run.smithi002.stdout: "e09c494d-4a2e-4f15-817e-baadbdc3dcac": { 2024-09-19T04:59:19.063 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-19T04:59:19.063 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "e09c494d-4a2e-4f15-817e-baadbdc3dcac", 2024-09-19T04:59:19.063 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-19T04:59:19.063 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:19.063 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:19.063 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:59:19.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.056+0000 7f0442321640 1 -- 172.21.15.2:0/4294258110 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f04240a33b0 msgr2=0x7f04240a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:19.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.056+0000 7f0442321640 1 --2- 172.21.15.2:0/4294258110 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f04240a33b0 0x7f04240a5870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0434005c40 tx=0x7f0434005bd0 comp rx=0 tx=0).stop 2024-09-19T04:59:19.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.056+0000 7f0442321640 1 -- 172.21.15.2:0/4294258110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f043c103660 msgr2=0x7f043c198840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:19.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.056+0000 7f0442321640 1 --2- 172.21.15.2:0/4294258110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f043c103660 0x7f043c198840 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f0430005940 tx=0x7f04300042f0 comp rx=0 tx=0).stop 2024-09-19T04:59:19.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.056+0000 7f0442321640 1 -- 172.21.15.2:0/4294258110 shutdown_connections 2024-09-19T04:59:19.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.056+0000 7f0442321640 1 --2- 172.21.15.2:0/4294258110 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f04240a33b0 0x7f04240a5870 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:19.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.056+0000 7f0442321640 1 --2- 172.21.15.2:0/4294258110 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f043c10c170 0x7f043c19cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:19.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.056+0000 7f0442321640 1 --2- 172.21.15.2:0/4294258110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f043c103660 0x7f043c198840 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:19.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.056+0000 7f0442321640 1 --2- 172.21.15.2:0/4294258110 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f043c102d40 0x7f043c198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:19.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.056+0000 7f0442321640 1 -- 172.21.15.2:0/4294258110 >> 172.21.15.2:0/4294258110 conn(0x7f043c0fc7a0 msgr2=0x7f043c0fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:19.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.056+0000 7f0442321640 1 -- 172.21.15.2:0/4294258110 shutdown_connections 2024-09-19T04:59:19.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:19.056+0000 7f0442321640 1 -- 172.21.15.2:0/4294258110 wait complete. 2024-09-19T04:59:19.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:19 smithi018 ceph-mon[34537]: scrub queued for path: / 2024-09-19T04:59:19.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:19 smithi018 ceph-mon[34537]: scrub summary: idle+waiting paths [/] 2024-09-19T04:59:19.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:19 smithi018 ceph-mon[34537]: scrub summary: active paths [/] 2024-09-19T04:59:19.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:19 smithi018 ceph-mon[34537]: scrub summary: idle+waiting paths [/] 2024-09-19T04:59:19.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:19 smithi002 ceph-mon[30975]: scrub queued for path: / 2024-09-19T04:59:19.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:19 smithi002 ceph-mon[30975]: scrub summary: idle+waiting paths [/] 2024-09-19T04:59:19.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:19 smithi002 ceph-mon[30975]: scrub summary: active paths [/] 2024-09-19T04:59:19.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:19 smithi002 ceph-mon[30975]: scrub summary: idle+waiting paths [/] 2024-09-19T04:59:19.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:19 smithi116 ceph-mon[34477]: scrub queued for path: / 2024-09-19T04:59:19.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:19 smithi116 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-19T04:59:19.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:19 smithi116 ceph-mon[34477]: scrub summary: active paths [/] 2024-09-19T04:59:19.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:19 smithi116 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-19T04:59:19.789 INFO:tasks.cephfs.filesystem:scrub status for tag:e09c494d-4a2e-4f15-817e-baadbdc3dcac - {'path': '/', 'tag': 'e09c494d-4a2e-4f15-817e-baadbdc3dcac', 'options': 'recursive,force'} 2024-09-19T04:59:20.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:20 smithi002 ceph-mon[30975]: pgmap v353: 97 pgs: 97 active+clean; 24 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 67 KiB/s wr, 8 op/s 2024-09-19T04:59:20.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:20 smithi018 ceph-mon[34537]: pgmap v353: 97 pgs: 97 active+clean; 24 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 67 KiB/s wr, 8 op/s 2024-09-19T04:59:20.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:20 smithi116 ceph-mon[34477]: pgmap v353: 97 pgs: 97 active+clean; 24 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 67 KiB/s wr, 8 op/s 2024-09-19T04:59:21.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:21 smithi018 ceph-mon[34537]: scrub summary: idle 2024-09-19T04:59:21.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:21 smithi002 ceph-mon[30975]: scrub summary: idle 2024-09-19T04:59:21.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:21 smithi116 ceph-mon[34477]: scrub summary: idle 2024-09-19T04:59:22.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:22 smithi018 ceph-mon[34537]: pgmap v354: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 51 KiB/s wr, 11 op/s 2024-09-19T04:59:22.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:22 smithi002 ceph-mon[30975]: pgmap v354: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 51 KiB/s wr, 11 op/s 2024-09-19T04:59:22.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:22 smithi116 ceph-mon[34477]: pgmap v354: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 51 KiB/s wr, 11 op/s 2024-09-19T04:59:24.806 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:24 smithi018 ceph-mon[34537]: pgmap v355: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 51 KiB/s wr, 11 op/s 2024-09-19T04:59:24.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:24 smithi002 ceph-mon[30975]: pgmap v355: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 51 KiB/s wr, 11 op/s 2024-09-19T04:59:24.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:24 smithi116 ceph-mon[34477]: pgmap v355: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 51 KiB/s wr, 11 op/s 2024-09-19T04:59:26.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:26 smithi018 ceph-mon[34537]: pgmap v356: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 8 op/s 2024-09-19T04:59:26.859 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:26 smithi002 ceph-mon[30975]: pgmap v356: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 8 op/s 2024-09-19T04:59:26.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:26 smithi116 ceph-mon[34477]: pgmap v356: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 8 op/s 2024-09-19T04:59:28.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:28 smithi018 ceph-mon[34537]: pgmap v357: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 6 op/s 2024-09-19T04:59:28.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:28 smithi002 ceph-mon[30975]: pgmap v357: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 6 op/s 2024-09-19T04:59:28.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:28 smithi116 ceph-mon[34477]: pgmap v357: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 6 op/s 2024-09-19T04:59:30.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:30 smithi018 ceph-mon[34537]: pgmap v358: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 6 op/s 2024-09-19T04:59:30.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:30 smithi002 ceph-mon[30975]: pgmap v358: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 6 op/s 2024-09-19T04:59:30.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:30 smithi116 ceph-mon[34477]: pgmap v358: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 6 op/s 2024-09-19T04:59:32.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:32 smithi018 ceph-mon[34537]: pgmap v359: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 8 op/s 2024-09-19T04:59:32.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:32 smithi002 ceph-mon[30975]: pgmap v359: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 8 op/s 2024-09-19T04:59:32.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:32 smithi116 ceph-mon[34477]: pgmap v359: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 8 op/s 2024-09-19T04:59:34.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:34 smithi018 ceph-mon[34537]: pgmap v360: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 6.9 KiB/s wr, 2 op/s 2024-09-19T04:59:34.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:34 smithi002 ceph-mon[30975]: pgmap v360: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 6.9 KiB/s wr, 2 op/s 2024-09-19T04:59:34.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:34 smithi116 ceph-mon[34477]: pgmap v360: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 6.9 KiB/s wr, 2 op/s 2024-09-19T04:59:36.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:36 smithi018 ceph-mon[34537]: pgmap v361: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 6.9 KiB/s wr, 3 op/s 2024-09-19T04:59:36.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:36 smithi002 ceph-mon[30975]: pgmap v361: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 6.9 KiB/s wr, 3 op/s 2024-09-19T04:59:36.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:36 smithi116 ceph-mon[34477]: pgmap v361: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 6.9 KiB/s wr, 3 op/s 2024-09-19T04:59:38.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:38 smithi018 ceph-mon[34537]: pgmap v362: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.3 KiB/s wr, 1 op/s 2024-09-19T04:59:38.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:38 smithi002 ceph-mon[30975]: pgmap v362: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.3 KiB/s wr, 1 op/s 2024-09-19T04:59:38.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:38 smithi116 ceph-mon[34477]: pgmap v362: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.3 KiB/s wr, 1 op/s 2024-09-19T04:59:40.806 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:40 smithi018 ceph-mon[34537]: pgmap v363: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.3 KiB/s wr, 1 op/s 2024-09-19T04:59:40.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:40 smithi002 ceph-mon[30975]: pgmap v363: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.3 KiB/s wr, 1 op/s 2024-09-19T04:59:40.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:40 smithi116 ceph-mon[34477]: pgmap v363: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.3 KiB/s wr, 1 op/s 2024-09-19T04:59:42.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:42 smithi018 ceph-mon[34537]: pgmap v364: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.3 KiB/s wr, 2 op/s 2024-09-19T04:59:42.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:42 smithi002 ceph-mon[30975]: pgmap v364: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.3 KiB/s wr, 2 op/s 2024-09-19T04:59:42.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:42 smithi116 ceph-mon[34477]: pgmap v364: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.3 KiB/s wr, 2 op/s 2024-09-19T04:59:44.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:44 smithi018 ceph-mon[34537]: pgmap v365: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:59:44.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:44 smithi002 ceph-mon[30975]: pgmap v365: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:59:44.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:44 smithi116 ceph-mon[34477]: pgmap v365: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:59:46.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:46 smithi018 ceph-mon[34537]: pgmap v366: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T04:59:46.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:46 smithi002 ceph-mon[30975]: pgmap v366: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T04:59:46.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:46 smithi116 ceph-mon[34477]: pgmap v366: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T04:59:48.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:48 smithi018 ceph-mon[34537]: pgmap v367: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:59:48.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:48 smithi002 ceph-mon[30975]: pgmap v367: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:59:48.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:48 smithi116 ceph-mon[34477]: pgmap v367: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:59:49.790 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:59:50.066 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:59:50.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.587+0000 7f1f07cc7640 1 -- 172.21.15.2:0/859049242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f00102da0 msgr2=0x7f1f00103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:50.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.587+0000 7f1f07cc7640 1 --2- 172.21.15.2:0/859049242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f00102da0 0x7f1f00103180 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f1efc009900 tx=0x7f1efc02a480 comp rx=0 tx=0).stop 2024-09-19T04:59:50.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.587+0000 7f1f07cc7640 1 -- 172.21.15.2:0/859049242 shutdown_connections 2024-09-19T04:59:50.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.587+0000 7f1f07cc7640 1 --2- 172.21.15.2:0/859049242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f0010c180 0x7f1f0010e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:50.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.587+0000 7f1f07cc7640 1 --2- 172.21.15.2:0/859049242 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f001036c0 0x7f1f0010bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:50.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.587+0000 7f1f07cc7640 1 --2- 172.21.15.2:0/859049242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f00102da0 0x7f1f00103180 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:50.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.587+0000 7f1f07cc7640 1 -- 172.21.15.2:0/859049242 >> 172.21.15.2:0/859049242 conn(0x7f1f000fc7a0 msgr2=0x7f1f000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:50.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.587+0000 7f1f07cc7640 1 -- 172.21.15.2:0/859049242 shutdown_connections 2024-09-19T04:59:50.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.587+0000 7f1f07cc7640 1 -- 172.21.15.2:0/859049242 wait complete. 2024-09-19T04:59:50.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.588+0000 7f1f07cc7640 1 Processor -- start 2024-09-19T04:59:50.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.588+0000 7f1f07cc7640 1 -- start start 2024-09-19T04:59:50.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.588+0000 7f1f07cc7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f00102da0 0x7f1f001983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:50.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.588+0000 7f1f07cc7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f001036c0 0x7f1f00198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:50.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.588+0000 7f1f07cc7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f0010c180 0x7f1f0019cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:50.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.588+0000 7f1f07cc7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1f00111e50 con 0x7f1f0010c180 2024-09-19T04:59:50.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.588+0000 7f1f07cc7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1f00111cd0 con 0x7f1f001036c0 2024-09-19T04:59:50.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.588+0000 7f1f07cc7640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f1f00111fd0 con 0x7f1f00102da0 2024-09-19T04:59:50.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.589+0000 7f1f06264640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f0010c180 0x7f1f0019cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:50.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.589+0000 7f1f06264640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f0010c180 0x7f1f0019cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47618/0 (socket says 172.21.15.2:47618) 2024-09-19T04:59:50.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.589+0000 7f1f06264640 1 -- 172.21.15.2:0/3708179958 learned_addr learned my addr 172.21.15.2:0/3708179958 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:59:50.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.589+0000 7f1f05262640 1 --2- 172.21.15.2:0/3708179958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f001036c0 0x7f1f00198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:50.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.589+0000 7f1f05a63640 1 --2- 172.21.15.2:0/3708179958 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f00102da0 0x7f1f001983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:50.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.589+0000 7f1f06264640 1 -- 172.21.15.2:0/3708179958 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f00102da0 msgr2=0x7f1f001983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:50.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.589+0000 7f1f06264640 1 --2- 172.21.15.2:0/3708179958 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f00102da0 0x7f1f001983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:50.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.589+0000 7f1f06264640 1 -- 172.21.15.2:0/3708179958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f001036c0 msgr2=0x7f1f00198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:50.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.589+0000 7f1f06264640 1 --2- 172.21.15.2:0/3708179958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f001036c0 0x7f1f00198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:50.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.589+0000 7f1f06264640 1 -- 172.21.15.2:0/3708179958 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f0019d380 con 0x7f1f0010c180 2024-09-19T04:59:50.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.589+0000 7f1f06264640 1 --2- 172.21.15.2:0/3708179958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f0010c180 0x7f1f0019cca0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f1ef800eaa0 tx=0x7f1ef800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:50.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.589+0000 7f1ef6ffd640 1 -- 172.21.15.2:0/3708179958 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef800cdb0 con 0x7f1f0010c180 2024-09-19T04:59:50.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.589+0000 7f1ef6ffd640 1 -- 172.21.15.2:0/3708179958 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1ef8005020 con 0x7f1f0010c180 2024-09-19T04:59:50.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.589+0000 7f1f07cc7640 1 -- 172.21.15.2:0/3708179958 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f0019d670 con 0x7f1f0010c180 2024-09-19T04:59:50.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.589+0000 7f1ef6ffd640 1 -- 172.21.15.2:0/3708179958 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef80116d0 con 0x7f1f0010c180 2024-09-19T04:59:50.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.589+0000 7f1f07cc7640 1 -- 172.21.15.2:0/3708179958 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f001a4f50 con 0x7f1f0010c180 2024-09-19T04:59:50.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.592+0000 7f1ef6ffd640 1 -- 172.21.15.2:0/3708179958 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f1ef80051d0 con 0x7f1f0010c180 2024-09-19T04:59:50.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.592+0000 7f1f0a0a0740 1 Processor -- start 2024-09-19T04:59:50.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.592+0000 7f1f0a0a0740 1 -- start start 2024-09-19T04:59:50.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.592+0000 7f1f0a0a0740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558b68a363a0 0x558b68a36780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:50.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.592+0000 7f1f0a0a0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b68a36cc0 0x558b68a45550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:50.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.592+0000 7f1f0a0a0740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558b68a45a90 0x558b68a47e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:50.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.592+0000 7f1f0a0a0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558b6899c2e0 con 0x558b68a36cc0 2024-09-19T04:59:50.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.592+0000 7f1f0a0a0740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558b68943ce0 con 0x558b68a45a90 2024-09-19T04:59:50.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.592+0000 7f1f0a0a0740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x558b689982a0 con 0x558b68a363a0 2024-09-19T04:59:50.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.592+0000 7f1f05a63640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b68a36cc0 0x558b68a45550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:50.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.592+0000 7f1f05a63640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b68a36cc0 0x558b68a45550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47632/0 (socket says 172.21.15.2:47632) 2024-09-19T04:59:50.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.592+0000 7f1f05a63640 1 -- 172.21.15.2:0/4209455074 learned_addr learned my addr 172.21.15.2:0/4209455074 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:59:50.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.593+0000 7f1f05262640 1 --2- 172.21.15.2:0/4209455074 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558b68a45a90 0x558b68a47e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:50.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.593+0000 7f1ef6ffd640 1 --2- 172.21.15.2:0/3708179958 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f1eec0a3430 0x7f1eec0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:50.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.593+0000 7f1f05262640 1 --2- 172.21.15.2:0/4209455074 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558b68a363a0 0x558b68a36780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:50.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.593+0000 7f1f05a63640 1 -- 172.21.15.2:0/4209455074 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558b68a363a0 msgr2=0x558b68a36780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:59:50.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.593+0000 7f1f05a63640 1 --2- 172.21.15.2:0/4209455074 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558b68a363a0 0x558b68a36780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:50.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.593+0000 7f1f05a63640 1 -- 172.21.15.2:0/4209455074 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558b68a45a90 msgr2=0x558b68a47e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:59:50.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.593+0000 7f1f05a63640 1 --2- 172.21.15.2:0/4209455074 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558b68a45a90 0x558b68a47e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:50.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.593+0000 7f1f05a63640 1 -- 172.21.15.2:0/4209455074 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b68928440 con 0x558b68a36cc0 2024-09-19T04:59:50.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.593+0000 7f1f05262640 1 --2- 172.21.15.2:0/4209455074 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558b68a45a90 0x558b68a47e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:59:50.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.593+0000 7f1f06264640 1 --2- 172.21.15.2:0/3708179958 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f1eec0a3430 0x7f1eec0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:50.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.593+0000 7f1ef6ffd640 1 -- 172.21.15.2:0/3708179958 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8527+0+0 (secure 0 0 0) 0x7f1ef80cff70 con 0x7f1f0010c180 2024-09-19T04:59:50.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.593+0000 7f1f05a63640 1 --2- 172.21.15.2:0/4209455074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b68a36cc0 0x558b68a45550 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f1efc02a9a0 tx=0x7f1efc032cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adeb9976d5a500fd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:50.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.593+0000 7f1eebfff640 1 -- 172.21.15.2:0/4209455074 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1efc03f070 con 0x558b68a36cc0 2024-09-19T04:59:50.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.593+0000 7f1f06264640 1 --2- 172.21.15.2:0/3708179958 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f1eec0a3430 0x7f1eec0a58f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1ef80cd770 tx=0x7f1ef806dfd0 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:50.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.593+0000 7f1eebfff640 1 -- 172.21.15.2:0/4209455074 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1efc0316a0 con 0x558b68a36cc0 2024-09-19T04:59:50.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.593+0000 7f1eebfff640 1 -- 172.21.15.2:0/4209455074 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1efc035070 con 0x558b68a36cc0 2024-09-19T04:59:50.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.594+0000 7f1f0a0a0740 1 -- 172.21.15.2:0/4209455074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b68a36cc0 msgr2=0x558b68a45550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:50.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.594+0000 7f1f0a0a0740 1 --2- 172.21.15.2:0/4209455074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b68a36cc0 0x558b68a45550 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f1efc02a9a0 tx=0x7f1efc032cc0 comp rx=0 tx=0).stop 2024-09-19T04:59:50.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.594+0000 7f1f0a0a0740 1 -- 172.21.15.2:0/4209455074 shutdown_connections 2024-09-19T04:59:50.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.594+0000 7f1f0a0a0740 1 --2- 172.21.15.2:0/4209455074 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558b68a45a90 0x558b68a47e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:50.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.594+0000 7f1f0a0a0740 1 --2- 172.21.15.2:0/4209455074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b68a36cc0 0x558b68a45550 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:50.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.594+0000 7f1f0a0a0740 1 --2- 172.21.15.2:0/4209455074 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558b68a363a0 0x558b68a36780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:50.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.594+0000 7f1f0a0a0740 1 -- 172.21.15.2:0/4209455074 >> 172.21.15.2:0/4209455074 conn(0x558b68a32a30 msgr2=0x558b68a32e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:50.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.594+0000 7f1f0a0a0740 1 -- 172.21.15.2:0/4209455074 shutdown_connections 2024-09-19T04:59:50.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.594+0000 7f1f0a0a0740 1 -- 172.21.15.2:0/4209455074 wait complete. 2024-09-19T04:59:50.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.595+0000 7f1f0a0a0740 1 -- start start 2024-09-19T04:59:50.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.595+0000 7f1f0a0a0740 1 Processor -- start 2024-09-19T04:59:50.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.595+0000 7f1f0a0a0740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558b68a363a0 0x558b68a45440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:50.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.595+0000 7f1f0a0a0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b68a36cc0 0x558b68a426f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:50.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.595+0000 7f1f0a0a0740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558b68a45a90 0x558b68a42c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:50.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.595+0000 7f1f0a0a0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558b68a48660 con 0x558b68a36cc0 2024-09-19T04:59:50.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.595+0000 7f1f0a0a0740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558b68957050 con 0x558b68a363a0 2024-09-19T04:59:50.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.595+0000 7f1f0a0a0740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x558b68a487e0 con 0x558b68a45a90 2024-09-19T04:59:50.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.595+0000 7f1f0a0a0740 10 client.0 _ll_register_callbacks cb 0x558b68997160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:59:50.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.595+0000 7f1f05a63640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b68a36cc0 0x558b68a426f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:50.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.595+0000 7f1f05a63640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b68a36cc0 0x558b68a426f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47638/0 (socket says 172.21.15.2:47638) 2024-09-19T04:59:50.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.595+0000 7f1f05a63640 1 -- 172.21.15.2:0/404739407 learned_addr learned my addr 172.21.15.2:0/404739407 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:59:50.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.595+0000 7f1f05262640 1 --2- 172.21.15.2:0/404739407 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558b68a45a90 0x558b68a42c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:50.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.596+0000 7f1f05a63640 1 -- 172.21.15.2:0/404739407 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558b68a45a90 msgr2=0x558b68a42c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:59:50.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.596+0000 7f1f05a63640 1 --2- 172.21.15.2:0/404739407 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558b68a45a90 0x558b68a42c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:50.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.596+0000 7f1f05a63640 1 -- 172.21.15.2:0/404739407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558b68a363a0 msgr2=0x558b68a45440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:59:50.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.596+0000 7f1f05a63640 1 --2- 172.21.15.2:0/404739407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558b68a363a0 0x558b68a45440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:50.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.596+0000 7f1f05a63640 1 -- 172.21.15.2:0/404739407 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b6870d3c0 con 0x558b68a36cc0 2024-09-19T04:59:50.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.596+0000 7f1f05a63640 1 --2- 172.21.15.2:0/404739407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b68a36cc0 0x558b68a426f0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f1efc031440 tx=0x7f1efc005160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3b97ff5e01ca4a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:50.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.596+0000 7f1ee97fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:59:50.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.596+0000 7f1ee97fa640 1 -- 172.21.15.2:0/404739407 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1efc04b060 con 0x558b68a36cc0 2024-09-19T04:59:50.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.596+0000 7f1ee97fa640 1 -- 172.21.15.2:0/404739407 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8527+0+0 (secure 0 0 0) 0x7f1efc004230 con 0x558b68a36cc0 2024-09-19T04:59:50.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.596+0000 7f1f0a0a0740 1 -- 172.21.15.2:0/404739407 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1efc0316a0 con 0x558b68a36cc0 2024-09-19T04:59:50.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.596+0000 7f1ee97fa640 1 -- 172.21.15.2:0/404739407 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1efc03f070 con 0x558b68a36cc0 2024-09-19T04:59:50.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.596+0000 7f1f0a0a0740 10 client.16914 fetch_fsmap learned FSMap version 19 2024-09-19T04:59:50.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.596+0000 7f1f0a0a0740 1 -- 172.21.15.2:0/404739407 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x558b68a540b0 con 0x558b68a36cc0 2024-09-19T04:59:50.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.596+0000 7f1ee97fa640 1 -- 172.21.15.2:0/404739407 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1efc0316a0 con 0x558b68a36cc0 2024-09-19T04:59:50.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.596+0000 7f1ee97fa640 1 -- 172.21.15.2:0/404739407 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f1efc0039c0 con 0x558b68a36cc0 2024-09-19T04:59:50.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.597+0000 7f1f0a0a0740 10 client.16914 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:59:50.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.597+0000 7f1f0a0a0740 10 client.16914 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:59:50.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.597+0000 7f1f0a0a0740 20 client.16914 populate_metadata read hostname 'smithi002' 2024-09-19T04:59:50.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.597+0000 7f1f0a0a0740 1 --2- 172.21.15.2:0/404739407 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558b68a55400 0x558b68a577f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:50.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.597+0000 7f1f0a0a0740 4 client.16914 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:59:50.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.597+0000 7f1f0a0a0740 1 -- 172.21.15.2:0/404739407 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558b689a9850 con 0x558b68a55400 2024-09-19T04:59:50.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.597+0000 7f1f05262640 1 --2- 172.21.15.2:0/404739407 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558b68a55400 0x558b68a577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:50.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.597+0000 7f1f05262640 1 --2- 172.21.15.2:0/404739407 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558b68a55400 0x558b68a577f0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9126458a0aa81852 server_cookie=39f01e4b1eea230e in_seq=0 out_seq=0 2024-09-19T04:59:50.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.597+0000 7f1ee97fa640 10 client.16914 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:59:50.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.598+0000 7f1ee97fa640 1 -- 172.21.15.2:0/404739407 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558b689a9850 con 0x558b68a55400 2024-09-19T04:59:50.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.598+0000 7f1ee97fa640 10 client.16914 handle_command_reply: tid=0 2024-09-19T04:59:50.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.598+0000 7f1f0a0a0740 1 client.16914 shutdown 2024-09-19T04:59:50.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.598+0000 7f1f0a0a0740 1 -- 172.21.15.2:0/404739407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b68a36cc0 msgr2=0x558b68a426f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:50.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.598+0000 7f1f0a0a0740 1 --2- 172.21.15.2:0/404739407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b68a36cc0 0x558b68a426f0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f1efc031440 tx=0x7f1efc005160 comp rx=0 tx=0).stop 2024-09-19T04:59:50.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.598+0000 7f1f0a0a0740 1 -- 172.21.15.2:0/404739407 shutdown_connections 2024-09-19T04:59:50.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.598+0000 7f1f0a0a0740 1 --2- 172.21.15.2:0/404739407 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558b68a55400 0x558b68a577f0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:50.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.598+0000 7f1f0a0a0740 1 --2- 172.21.15.2:0/404739407 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558b68a45a90 0x558b68a42c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:50.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.598+0000 7f1f0a0a0740 1 --2- 172.21.15.2:0/404739407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b68a36cc0 0x558b68a426f0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:50.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.598+0000 7f1f0a0a0740 1 --2- 172.21.15.2:0/404739407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558b68a363a0 0x558b68a45440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:50.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.598+0000 7f1f0a0a0740 1 -- 172.21.15.2:0/404739407 >> 172.21.15.2:0/404739407 conn(0x558b68a32a30 msgr2=0x558b68a38790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:50.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.598+0000 7f1ee97fa640 0 client.16914 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:59:50.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.598+0000 7f1f0a0a0740 1 -- 172.21.15.2:0/404739407 shutdown_connections 2024-09-19T04:59:50.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.598+0000 7f1f0a0a0740 1 -- 172.21.15.2:0/404739407 wait complete. 2024-09-19T04:59:50.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.598+0000 7f1f0a0a0740 20 client.16914 trim_cache size 0 max 16384 2024-09-19T04:59:50.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.616+0000 7f1f0a0a0740 1 Processor -- start 2024-09-19T04:59:50.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.616+0000 7f1f0a0a0740 1 -- start start 2024-09-19T04:59:50.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.616+0000 7f1f0a0a0740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558b68a363a0 0x558b68a51900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:50.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.616+0000 7f1f0a0a0740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558b68a36cc0 0x558b68a44660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:50.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.616+0000 7f1f0a0a0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b68a45a90 0x558b68a5cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:50.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.616+0000 7f1f0a0a0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1f001a9490 con 0x558b68a45a90 2024-09-19T04:59:50.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.616+0000 7f1f0a0a0740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1f001abcf0 con 0x558b68a363a0 2024-09-19T04:59:50.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.616+0000 7f1f0a0a0740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f1f001a9ae0 con 0x558b68a36cc0 2024-09-19T04:59:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.616+0000 7f1f05262640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b68a45a90 0x558b68a5cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.616+0000 7f1f05262640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b68a45a90 0x558b68a5cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47646/0 (socket says 172.21.15.2:47646) 2024-09-19T04:59:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.616+0000 7f1f05262640 1 -- 172.21.15.2:0/495668847 learned_addr learned my addr 172.21.15.2:0/495668847 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:59:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.616+0000 7f1f05262640 1 -- 172.21.15.2:0/495668847 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558b68a36cc0 msgr2=0x558b68a44660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:59:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.616+0000 7f1f05262640 1 --2- 172.21.15.2:0/495668847 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558b68a36cc0 0x558b68a44660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.616+0000 7f1f05262640 1 -- 172.21.15.2:0/495668847 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558b68a363a0 msgr2=0x558b68a51900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:59:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.616+0000 7f1f05262640 1 --2- 172.21.15.2:0/495668847 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558b68a363a0 0x558b68a51900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.616+0000 7f1f05262640 1 -- 172.21.15.2:0/495668847 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b68a457b0 con 0x558b68a45a90 2024-09-19T04:59:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.616+0000 7f1f05262640 1 --2- 172.21.15.2:0/495668847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b68a45a90 0x558b68a5cdc0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0000c00 tx=0x7f1ef0015420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3839faa4ec059fab server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.617+0000 7f1eeb7fe640 1 -- 172.21.15.2:0/495668847 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef0015b80 con 0x558b68a45a90 2024-09-19T04:59:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.617+0000 7f1eeb7fe640 1 -- 172.21.15.2:0/495668847 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1ef001c070 con 0x558b68a45a90 2024-09-19T04:59:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.617+0000 7f1eeb7fe640 1 -- 172.21.15.2:0/495668847 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef0014610 con 0x558b68a45a90 2024-09-19T04:59:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.617+0000 7f1f0a0a0740 1 -- 172.21.15.2:0/495668847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b68a45a90 msgr2=0x558b68a5cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.617+0000 7f1f0a0a0740 1 --2- 172.21.15.2:0/495668847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b68a45a90 0x558b68a5cdc0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0000c00 tx=0x7f1ef0015420 comp rx=0 tx=0).stop 2024-09-19T04:59:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.617+0000 7f1f0a0a0740 1 -- 172.21.15.2:0/495668847 shutdown_connections 2024-09-19T04:59:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.617+0000 7f1f0a0a0740 1 --2- 172.21.15.2:0/495668847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b68a45a90 0x558b68a5cdc0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.617+0000 7f1f0a0a0740 1 --2- 172.21.15.2:0/495668847 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558b68a36cc0 0x558b68a44660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.617+0000 7f1f0a0a0740 1 --2- 172.21.15.2:0/495668847 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558b68a363a0 0x558b68a51900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.617+0000 7f1f0a0a0740 1 -- 172.21.15.2:0/495668847 >> 172.21.15.2:0/495668847 conn(0x558b68a32a30 msgr2=0x558b68a43f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.617+0000 7f1f0a0a0740 1 -- 172.21.15.2:0/495668847 shutdown_connections 2024-09-19T04:59:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.617+0000 7f1f0a0a0740 1 -- 172.21.15.2:0/495668847 wait complete. 2024-09-19T04:59:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.618+0000 7f1f0a0a0740 1 -- start start 2024-09-19T04:59:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.618+0000 7f1f0a0a0740 1 Processor -- start 2024-09-19T04:59:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.618+0000 7f1f0a0a0740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558b68a363a0 0x558b68a49b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.618+0000 7f1f0a0a0740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558b68a36cc0 0x558b68a4a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.618+0000 7f1f0a0a0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b68a45a90 0x558b68abed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:50.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.618+0000 7f1f0a0a0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1f001aa1b0 con 0x558b68a45a90 2024-09-19T04:59:50.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.618+0000 7f1f0a0a0740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1f001ab620 con 0x558b68a36cc0 2024-09-19T04:59:50.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.618+0000 7f1f0a0a0740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f1f001aa880 con 0x558b68a363a0 2024-09-19T04:59:50.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.618+0000 7f1f0a0a0740 10 client.0 _ll_register_callbacks cb 0x7f1efc032b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:59:50.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.618+0000 7f1f05262640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b68a45a90 0x558b68abed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:50.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.618+0000 7f1f05262640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b68a45a90 0x558b68abed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47648/0 (socket says 172.21.15.2:47648) 2024-09-19T04:59:50.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.618+0000 7f1f05262640 1 -- 172.21.15.2:0/2707979287 learned_addr learned my addr 172.21.15.2:0/2707979287 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:59:50.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.618+0000 7f1f05262640 1 --2- 172.21.15.2:0/2707979287 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558b68a363a0 0x558b68a49b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:50.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.618+0000 7f1f05a63640 1 --2- 172.21.15.2:0/2707979287 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558b68a36cc0 0x558b68a4a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:50.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.619+0000 7f1f05262640 1 -- 172.21.15.2:0/2707979287 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558b68a363a0 msgr2=0x558b68a49b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:59:50.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.619+0000 7f1f05262640 1 --2- 172.21.15.2:0/2707979287 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558b68a363a0 0x558b68a49b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:50.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.619+0000 7f1f05262640 1 -- 172.21.15.2:0/2707979287 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558b68a36cc0 msgr2=0x558b68a4a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:59:50.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.619+0000 7f1f05262640 1 --2- 172.21.15.2:0/2707979287 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558b68a36cc0 0x558b68a4a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.619+0000 7f1f05262640 1 -- 172.21.15.2:0/2707979287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b68a4a910 con 0x558b68a45a90 2024-09-19T04:59:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.619+0000 7f1f05262640 1 --2- 172.21.15.2:0/2707979287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b68a45a90 0x558b68abed90 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0021e30 tx=0x7f1ef00047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b400173493e95880 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.619+0000 7f1ee97fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:59:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.619+0000 7f1ee97fa640 1 -- 172.21.15.2:0/2707979287 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef0015c80 con 0x558b68a45a90 2024-09-19T04:59:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.619+0000 7f1ee97fa640 1 -- 172.21.15.2:0/2707979287 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8527+0+0 (secure 0 0 0) 0x7f1ef000f040 con 0x558b68a45a90 2024-09-19T04:59:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.619+0000 7f1f0a0a0740 1 -- 172.21.15.2:0/2707979287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ef001c070 con 0x558b68a45a90 2024-09-19T04:59:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.619+0000 7f1ee97fa640 1 -- 172.21.15.2:0/2707979287 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1ef0037050 con 0x558b68a45a90 2024-09-19T04:59:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.619+0000 7f1f0a0a0740 10 client.16920 fetch_fsmap learned FSMap version 19 2024-09-19T04:59:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.619+0000 7f1f0a0a0740 1 -- 172.21.15.2:0/2707979287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x558b68ac03c0 con 0x558b68a45a90 2024-09-19T04:59:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.619+0000 7f1ee97fa640 1 -- 172.21.15.2:0/2707979287 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1ef001c070 con 0x558b68a45a90 2024-09-19T04:59:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.620+0000 7f1ee97fa640 1 -- 172.21.15.2:0/2707979287 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f1ef00216a0 con 0x558b68a45a90 2024-09-19T04:59:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.620+0000 7f1f0a0a0740 10 client.16920 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:59:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.620+0000 7f1f0a0a0740 10 client.16920 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:59:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.620+0000 7f1f0a0a0740 20 client.16920 populate_metadata read hostname 'smithi002' 2024-09-19T04:59:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.620+0000 7f1f0a0a0740 1 --2- 172.21.15.2:0/2707979287 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558b68ac0a10 0x558b68ac2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.620+0000 7f1f0a0a0740 4 client.16920 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:59:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.620+0000 7f1f0a0a0740 1 -- 172.21.15.2:0/2707979287 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558b689a3d60 con 0x558b68ac0a10 2024-09-19T04:59:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.620+0000 7f1f05a63640 1 --2- 172.21.15.2:0/2707979287 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558b68ac0a10 0x558b68ac2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.620+0000 7f1f05a63640 1 --2- 172.21.15.2:0/2707979287 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558b68ac0a10 0x558b68ac2e30 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f1d132cdf3a00c3 server_cookie=755bcf16e7846246 in_seq=0 out_seq=0 2024-09-19T04:59:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.620+0000 7f1ee97fa640 10 client.16920 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:59:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.621+0000 7f1ee97fa640 1 -- 172.21.15.2:0/2707979287 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x558b689a3d60 con 0x558b68ac0a10 2024-09-19T04:59:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.621+0000 7f1ee97fa640 10 client.16920 handle_command_reply: tid=0 2024-09-19T04:59:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.621+0000 7f1f0a0a0740 1 client.16920 shutdown 2024-09-19T04:59:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.621+0000 7f1f0a0a0740 1 -- 172.21.15.2:0/2707979287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b68a45a90 msgr2=0x558b68abed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.621+0000 7f1f0a0a0740 1 --2- 172.21.15.2:0/2707979287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b68a45a90 0x558b68abed90 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0021e30 tx=0x7f1ef00047d0 comp rx=0 tx=0).stop 2024-09-19T04:59:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.621+0000 7f1f0a0a0740 1 -- 172.21.15.2:0/2707979287 shutdown_connections 2024-09-19T04:59:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.621+0000 7f1f0a0a0740 1 --2- 172.21.15.2:0/2707979287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558b68a45a90 0x558b68abed90 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:50.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.621+0000 7f1f0a0a0740 1 --2- 172.21.15.2:0/2707979287 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558b68a36cc0 0x558b68a4a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:50.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.621+0000 7f1f0a0a0740 1 --2- 172.21.15.2:0/2707979287 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x558b68ac0a10 0x558b68ac2e30 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:50.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.621+0000 7f1f0a0a0740 1 --2- 172.21.15.2:0/2707979287 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558b68a363a0 0x558b68a49b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:50.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.621+0000 7f1f0a0a0740 1 -- 172.21.15.2:0/2707979287 >> 172.21.15.2:0/2707979287 conn(0x558b68a32a30 msgr2=0x558b68a44770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:50.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.621+0000 7f1ee97fa640 0 client.16920 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:59:50.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.621+0000 7f1f0a0a0740 1 -- 172.21.15.2:0/2707979287 shutdown_connections 2024-09-19T04:59:50.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.621+0000 7f1f0a0a0740 1 -- 172.21.15.2:0/2707979287 wait complete. 2024-09-19T04:59:50.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.621+0000 7f1f0a0a0740 20 client.16920 trim_cache size 0 max 16384 2024-09-19T04:59:50.632 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:59:50.632 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T04:59:50.632 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T04:59:50.633 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:59:50.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.622+0000 7f1f07cc7640 1 -- 172.21.15.2:0/3708179958 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f1eec0a3430 msgr2=0x7f1eec0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:50.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.622+0000 7f1f07cc7640 1 --2- 172.21.15.2:0/3708179958 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f1eec0a3430 0x7f1eec0a58f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1ef80cd770 tx=0x7f1ef806dfd0 comp rx=0 tx=0).stop 2024-09-19T04:59:50.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.622+0000 7f1f07cc7640 1 -- 172.21.15.2:0/3708179958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f0010c180 msgr2=0x7f1f0019cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:50.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.622+0000 7f1f07cc7640 1 --2- 172.21.15.2:0/3708179958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f0010c180 0x7f1f0019cca0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f1ef800eaa0 tx=0x7f1ef800ef60 comp rx=0 tx=0).stop 2024-09-19T04:59:50.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.622+0000 7f1f07cc7640 1 -- 172.21.15.2:0/3708179958 shutdown_connections 2024-09-19T04:59:50.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.622+0000 7f1f07cc7640 1 --2- 172.21.15.2:0/3708179958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f0010c180 0x7f1f0019cca0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:50.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.622+0000 7f1f07cc7640 1 --2- 172.21.15.2:0/3708179958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f001036c0 0x7f1f00198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:50.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.622+0000 7f1f07cc7640 1 --2- 172.21.15.2:0/3708179958 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f1eec0a3430 0x7f1eec0a58f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:50.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.622+0000 7f1f07cc7640 1 --2- 172.21.15.2:0/3708179958 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f00102da0 0x7f1f001983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:50.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.622+0000 7f1f07cc7640 1 -- 172.21.15.2:0/3708179958 >> 172.21.15.2:0/3708179958 conn(0x7f1f000fc7a0 msgr2=0x7f1f000fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:50.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.622+0000 7f1f07cc7640 1 -- 172.21.15.2:0/3708179958 shutdown_connections 2024-09-19T04:59:50.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:50.622+0000 7f1f07cc7640 1 -- 172.21.15.2:0/3708179958 wait complete. 2024-09-19T04:59:50.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:50 smithi018 ceph-mon[34537]: pgmap v368: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:59:50.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:50 smithi002 ceph-mon[30975]: pgmap v368: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:59:50.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:50 smithi116 ceph-mon[34477]: pgmap v368: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:59:51.405 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:59:51.406 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:59:51.668 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:59:52.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.126+0000 7f9ec039c640 1 -- 172.21.15.2:0/31490842 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9eb81027c0 msgr2=0x7f9eb8106810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:52.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.126+0000 7f9ec039c640 1 --2- 172.21.15.2:0/31490842 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9eb81027c0 0x7f9eb8106810 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f9eac009900 tx=0x7f9eac02a410 comp rx=0 tx=0).stop 2024-09-19T04:59:52.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.126+0000 7f9ec039c640 1 -- 172.21.15.2:0/31490842 shutdown_connections 2024-09-19T04:59:52.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.126+0000 7f9ec039c640 1 --2- 172.21.15.2:0/31490842 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9eb8106f40 0x7f9eb810eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:52.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.126+0000 7f9ec039c640 1 --2- 172.21.15.2:0/31490842 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9eb81027c0 0x7f9eb8106810 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:52.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.126+0000 7f9ec039c640 1 --2- 172.21.15.2:0/31490842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9eb8101e10 0x7f9eb81021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:52.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.126+0000 7f9ec039c640 1 -- 172.21.15.2:0/31490842 >> 172.21.15.2:0/31490842 conn(0x7f9eb80fd8d0 msgr2=0x7f9eb80ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:52.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.126+0000 7f9ec039c640 1 -- 172.21.15.2:0/31490842 shutdown_connections 2024-09-19T04:59:52.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.127+0000 7f9ec039c640 1 -- 172.21.15.2:0/31490842 wait complete. 2024-09-19T04:59:52.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.127+0000 7f9ec039c640 1 Processor -- start 2024-09-19T04:59:52.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.127+0000 7f9ec039c640 1 -- start start 2024-09-19T04:59:52.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.127+0000 7f9ec039c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9eb8101e10 0x7f9eb80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:52.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.127+0000 7f9ec039c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9eb81027c0 0x7f9eb8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:52.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.127+0000 7f9ec039c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9eb8106f40 0x7f9eb8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:52.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.127+0000 7f9ec039c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb8111e90 con 0x7f9eb81027c0 2024-09-19T04:59:52.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.127+0000 7f9ec039c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb8111d10 con 0x7f9eb8106f40 2024-09-19T04:59:52.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.127+0000 7f9ec039c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb8112010 con 0x7f9eb8101e10 2024-09-19T04:59:52.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.127+0000 7f9ebd937640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9eb81027c0 0x7f9eb8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:52.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.128+0000 7f9ebd937640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9eb81027c0 0x7f9eb8074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42726/0 (socket says 172.21.15.2:42726) 2024-09-19T04:59:52.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.128+0000 7f9ebd937640 1 -- 172.21.15.2:0/2083379177 learned_addr learned my addr 172.21.15.2:0/2083379177 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:59:52.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.128+0000 7f9ebe939640 1 --2- 172.21.15.2:0/2083379177 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9eb8106f40 0x7f9eb8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:52.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.128+0000 7f9ebe138640 1 --2- 172.21.15.2:0/2083379177 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9eb8101e10 0x7f9eb80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:52.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.128+0000 7f9ebd937640 1 -- 172.21.15.2:0/2083379177 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9eb8101e10 msgr2=0x7f9eb80744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:52.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.128+0000 7f9ebd937640 1 --2- 172.21.15.2:0/2083379177 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9eb8101e10 0x7f9eb80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:52.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.128+0000 7f9ebd937640 1 -- 172.21.15.2:0/2083379177 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9eb8106f40 msgr2=0x7f9eb8074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:52.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.128+0000 7f9ebd937640 1 --2- 172.21.15.2:0/2083379177 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9eb8106f40 0x7f9eb8074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:52.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.128+0000 7f9ebd937640 1 -- 172.21.15.2:0/2083379177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eb81a68d0 con 0x7f9eb81027c0 2024-09-19T04:59:52.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.128+0000 7f9ebd937640 1 --2- 172.21.15.2:0/2083379177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9eb81027c0 0x7f9eb8074a30 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f9eac006010 tx=0x7f9eac004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:52.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.128+0000 7f9eb77fe640 1 -- 172.21.15.2:0/2083379177 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eac03f030 con 0x7f9eb81027c0 2024-09-19T04:59:52.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.128+0000 7f9eb77fe640 1 -- 172.21.15.2:0/2083379177 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9eac0035f0 con 0x7f9eb81027c0 2024-09-19T04:59:52.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.128+0000 7f9eb77fe640 1 -- 172.21.15.2:0/2083379177 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eac035070 con 0x7f9eb81027c0 2024-09-19T04:59:52.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.128+0000 7f9ec039c640 1 -- 172.21.15.2:0/2083379177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9eb81a6b60 con 0x7f9eb81027c0 2024-09-19T04:59:52.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.128+0000 7f9ec039c640 1 -- 172.21.15.2:0/2083379177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9eb81a6ff0 con 0x7f9eb81027c0 2024-09-19T04:59:52.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.129+0000 7f9ec039c640 1 -- 172.21.15.2:0/2083379177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9eb81021f0 con 0x7f9eb81027c0 2024-09-19T04:59:52.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.130+0000 7f9eb77fe640 1 -- 172.21.15.2:0/2083379177 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f9eac003b10 con 0x7f9eb81027c0 2024-09-19T04:59:52.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.131+0000 7f9eb77fe640 1 --2- 172.21.15.2:0/2083379177 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f9ea00a3430 0x7f9ea00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:52.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.131+0000 7f9ebe138640 1 --2- 172.21.15.2:0/2083379177 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f9ea00a3430 0x7f9ea00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:52.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.131+0000 7f9eb77fe640 1 -- 172.21.15.2:0/2083379177 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8527+0+0 (secure 0 0 0) 0x7f9eac0f08d0 con 0x7f9eb81027c0 2024-09-19T04:59:52.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.132+0000 7f9ebe138640 1 --2- 172.21.15.2:0/2083379177 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f9ea00a3430 0x7f9ea00a58f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9eb00058c0 tx=0x7f9eb0005c60 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:52.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.135+0000 7f9eb77fe640 1 -- 172.21.15.2:0/2083379177 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9eac0bd2b0 con 0x7f9eb81027c0 2024-09-19T04:59:52.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.345+0000 7f9ec039c640 1 -- 172.21.15.2:0/2083379177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9eb802d7c0 con 0x7f9eb81027c0 2024-09-19T04:59:52.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.346+0000 7f9eb77fe640 1 -- 172.21.15.2:0/2083379177 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11840 (secure 0 0 0) 0x7f9eac0bcbb0 con 0x7f9eb81027c0 2024-09-19T04:59:52.347 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:59:52.347 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":19,"btime":"2024-09-19T04:46:33:537239+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2467365137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2467365137},{"type":"v1","addr":"172.21.15.2:6835","nonce":2467365137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3162441888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3162441888},{"type":"v1","addr":"172.21.15.2:6837","nonce":3162441888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14631,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2740862966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2740862966},{"type":"v1","addr":"172.21.15.2:6839","nonce":2740862966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/2394435504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2394435504},{"type":"v1","addr":"172.21.15.2:6841","nonce":2394435504}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1630480244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1630480244},{"type":"v1","addr":"172.21.15.18:6833","nonce":1630480244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1553897465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1553897465},{"type":"v1","addr":"172.21.15.116:6833","nonce":1553897465}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3035664608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3035664608},{"type":"v1","addr":"172.21.15.18:6835","nonce":3035664608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1096622392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1096622392},{"type":"v1","addr":"172.21.15.18:6837","nonce":1096622392}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3761157675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3761157675},{"type":"v1","addr":"172.21.15.116:6835","nonce":3761157675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/1120131594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1120131594},{"type":"v1","addr":"172.21.15.116:6837","nonce":1120131594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:46:24.050115+0000","modified":"2024-09-19T04:46:33.112369+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/4207677139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":4207677139},{"type":"v1","addr":"172.21.15.18:6839","nonce":4207677139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/2346874880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":2346874880},{"type":"v1","addr":"172.21.15.116:6839","nonce":2346874880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496]},"id":1}]} 2024-09-19T04:59:52.348 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 19 2024-09-19T04:59:52.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.348+0000 7f9ec039c640 1 -- 172.21.15.2:0/2083379177 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f9ea00a3430 msgr2=0x7f9ea00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:52.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.348+0000 7f9ec039c640 1 --2- 172.21.15.2:0/2083379177 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f9ea00a3430 0x7f9ea00a58f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9eb00058c0 tx=0x7f9eb0005c60 comp rx=0 tx=0).stop 2024-09-19T04:59:52.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.348+0000 7f9ec039c640 1 -- 172.21.15.2:0/2083379177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9eb81027c0 msgr2=0x7f9eb8074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:52.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.348+0000 7f9ec039c640 1 --2- 172.21.15.2:0/2083379177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9eb81027c0 0x7f9eb8074a30 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f9eac006010 tx=0x7f9eac004270 comp rx=0 tx=0).stop 2024-09-19T04:59:52.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.348+0000 7f9ec039c640 1 -- 172.21.15.2:0/2083379177 shutdown_connections 2024-09-19T04:59:52.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.348+0000 7f9ec039c640 1 --2- 172.21.15.2:0/2083379177 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9eb8106f40 0x7f9eb8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:52.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.348+0000 7f9ec039c640 1 --2- 172.21.15.2:0/2083379177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9eb81027c0 0x7f9eb8074a30 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:52.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.348+0000 7f9ec039c640 1 --2- 172.21.15.2:0/2083379177 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f9ea00a3430 0x7f9ea00a58f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:52.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.348+0000 7f9ec039c640 1 --2- 172.21.15.2:0/2083379177 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9eb8101e10 0x7f9eb80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:52.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.348+0000 7f9ec039c640 1 -- 172.21.15.2:0/2083379177 >> 172.21.15.2:0/2083379177 conn(0x7f9eb80fd8d0 msgr2=0x7f9eb80fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:52.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.348+0000 7f9ec039c640 1 -- 172.21.15.2:0/2083379177 shutdown_connections 2024-09-19T04:59:52.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:52.348+0000 7f9ec039c640 1 -- 172.21.15.2:0/2083379177 wait complete. 2024-09-19T04:59:52.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:52 smithi002 ceph-mon[30975]: pgmap v369: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T04:59:52.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:52 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/2083379177' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:59:52.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:52 smithi018 ceph-mon[34537]: pgmap v369: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T04:59:52.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:52 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/2083379177' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:59:52.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:52 smithi116 ceph-mon[34477]: pgmap v369: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T04:59:52.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:52 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/2083379177' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:59:52.977 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:59:53.240 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:59:53.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.736+0000 7f6b877f1640 1 -- 172.21.15.2:0/1678555614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b80102790 msgr2=0x7f6b801067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:53.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.736+0000 7f6b877f1640 1 --2- 172.21.15.2:0/1678555614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b80102790 0x7f6b801067e0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f6b70009900 tx=0x7f6b7002a410 comp rx=0 tx=0).stop 2024-09-19T04:59:53.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.736+0000 7f6b877f1640 1 -- 172.21.15.2:0/1678555614 shutdown_connections 2024-09-19T04:59:53.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.736+0000 7f6b877f1640 1 --2- 172.21.15.2:0/1678555614 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b80106f10 0x7f6b8010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:53.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.736+0000 7f6b877f1640 1 --2- 172.21.15.2:0/1678555614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b80102790 0x7f6b801067e0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:53.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.736+0000 7f6b877f1640 1 --2- 172.21.15.2:0/1678555614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b80101de0 0x7f6b801021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:53.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.736+0000 7f6b877f1640 1 -- 172.21.15.2:0/1678555614 >> 172.21.15.2:0/1678555614 conn(0x7f6b800fd8c0 msgr2=0x7f6b800ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:53.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.736+0000 7f6b877f1640 1 -- 172.21.15.2:0/1678555614 shutdown_connections 2024-09-19T04:59:53.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.736+0000 7f6b877f1640 1 -- 172.21.15.2:0/1678555614 wait complete. 2024-09-19T04:59:53.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.737+0000 7f6b877f1640 1 Processor -- start 2024-09-19T04:59:53.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.737+0000 7f6b877f1640 1 -- start start 2024-09-19T04:59:53.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.737+0000 7f6b877f1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b80101de0 0x7f6b801982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:53.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.737+0000 7f6b877f1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b80102790 0x7f6b80198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:53.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.737+0000 7f6b877f1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b80106f10 0x7f6b8019cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:53.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.737+0000 7f6b877f1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6b80111de0 con 0x7f6b80106f10 2024-09-19T04:59:53.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.737+0000 7f6b877f1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6b80111c60 con 0x7f6b80102790 2024-09-19T04:59:53.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.737+0000 7f6b877f1640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f6b80111f60 con 0x7f6b80101de0 2024-09-19T04:59:53.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.737+0000 7f6b85d8e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b80106f10 0x7f6b8019cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:53.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.737+0000 7f6b85d8e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b80106f10 0x7f6b8019cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42746/0 (socket says 172.21.15.2:42746) 2024-09-19T04:59:53.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.737+0000 7f6b85d8e640 1 -- 172.21.15.2:0/532432079 learned_addr learned my addr 172.21.15.2:0/532432079 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:59:53.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.737+0000 7f6b8558d640 1 --2- 172.21.15.2:0/532432079 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b80101de0 0x7f6b801982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:53.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.738+0000 7f6b84d8c640 1 --2- 172.21.15.2:0/532432079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b80102790 0x7f6b80198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:53.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.738+0000 7f6b85d8e640 1 -- 172.21.15.2:0/532432079 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b80101de0 msgr2=0x7f6b801982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:53.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.738+0000 7f6b85d8e640 1 --2- 172.21.15.2:0/532432079 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b80101de0 0x7f6b801982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:53.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.738+0000 7f6b85d8e640 1 -- 172.21.15.2:0/532432079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b80102790 msgr2=0x7f6b80198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:53.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.738+0000 7f6b85d8e640 1 --2- 172.21.15.2:0/532432079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b80102790 0x7f6b80198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:53.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.738+0000 7f6b85d8e640 1 -- 172.21.15.2:0/532432079 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b8019d290 con 0x7f6b80106f10 2024-09-19T04:59:53.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.738+0000 7f6b8558d640 1 --2- 172.21.15.2:0/532432079 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b80101de0 0x7f6b801982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:59:53.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.738+0000 7f6b85d8e640 1 --2- 172.21.15.2:0/532432079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b80106f10 0x7f6b8019cbb0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f6b7800eaa0 tx=0x7f6b7800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:53.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.738+0000 7f6b767fc640 1 -- 172.21.15.2:0/532432079 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b7800cdb0 con 0x7f6b80106f10 2024-09-19T04:59:53.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.738+0000 7f6b877f1640 1 -- 172.21.15.2:0/532432079 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b8019d580 con 0x7f6b80106f10 2024-09-19T04:59:53.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.738+0000 7f6b767fc640 1 -- 172.21.15.2:0/532432079 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6b78005020 con 0x7f6b80106f10 2024-09-19T04:59:53.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.738+0000 7f6b767fc640 1 -- 172.21.15.2:0/532432079 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b780116d0 con 0x7f6b80106f10 2024-09-19T04:59:53.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.738+0000 7f6b877f1640 1 -- 172.21.15.2:0/532432079 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b801a4e60 con 0x7f6b80106f10 2024-09-19T04:59:53.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.740+0000 7f6b767fc640 1 -- 172.21.15.2:0/532432079 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f6b780051d0 con 0x7f6b80106f10 2024-09-19T04:59:53.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.741+0000 7f6b89bca740 1 Processor -- start 2024-09-19T04:59:53.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.741+0000 7f6b89bca740 1 -- start start 2024-09-19T04:59:53.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.741+0000 7f6b89bca740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632aecfeb40 0x5632aecfd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:53.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.741+0000 7f6b89bca740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632aecfd5d0 0x5632aecfda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:53.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.741+0000 7f6b89bca740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632aed08370 0x5632aed0a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:53.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.741+0000 7f6b89bca740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5632aec632f0 con 0x5632aed08370 2024-09-19T04:59:53.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.741+0000 7f6b89bca740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5632aec0acf0 con 0x5632aecfeb40 2024-09-19T04:59:53.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.741+0000 7f6b89bca740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5632aec5f2b0 con 0x5632aecfd5d0 2024-09-19T04:59:53.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.741+0000 7f6b767fc640 1 --2- 172.21.15.2:0/532432079 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f6b6c0a33b0 0x7f6b6c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:53.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.741+0000 7f6b84d8c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632aed08370 0x5632aed0a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:53.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.741+0000 7f6b84d8c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632aed08370 0x5632aed0a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42750/0 (socket says 172.21.15.2:42750) 2024-09-19T04:59:53.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.741+0000 7f6b84d8c640 1 -- 172.21.15.2:0/2229187948 learned_addr learned my addr 172.21.15.2:0/2229187948 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:59:53.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.741+0000 7f6b85d8e640 1 --2- 172.21.15.2:0/532432079 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f6b6c0a33b0 0x7f6b6c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:53.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.741+0000 7f6b8558d640 1 --2- 172.21.15.2:0/2229187948 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632aecfd5d0 0x5632aecfda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:53.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.741+0000 7f6b84d8c640 1 --2- 172.21.15.2:0/2229187948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632aecfeb40 0x5632aecfd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:53.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.741+0000 7f6b767fc640 1 -- 172.21.15.2:0/532432079 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8527+0+0 (secure 0 0 0) 0x7f6b780cff60 con 0x7f6b80106f10 2024-09-19T04:59:53.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.742+0000 7f6b84d8c640 1 -- 172.21.15.2:0/2229187948 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632aecfd5d0 msgr2=0x5632aecfda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:59:53.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.742+0000 7f6b84d8c640 1 --2- 172.21.15.2:0/2229187948 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632aecfd5d0 0x5632aecfda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:53.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.742+0000 7f6b84d8c640 1 -- 172.21.15.2:0/2229187948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632aecfeb40 msgr2=0x5632aecfd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:59:53.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.742+0000 7f6b84d8c640 1 --2- 172.21.15.2:0/2229187948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632aecfeb40 0x5632aecfd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:53.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.742+0000 7f6b84d8c640 1 -- 172.21.15.2:0/2229187948 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632aebef3a0 con 0x5632aed08370 2024-09-19T04:59:53.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.742+0000 7f6b84d8c640 1 --2- 172.21.15.2:0/2229187948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632aed08370 0x5632aed0a760 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f6b7002a930 tx=0x7f6b700058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6acfcecb36e55d7c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:53.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.742+0000 7f6b85d8e640 1 --2- 172.21.15.2:0/532432079 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f6b6c0a33b0 0x7f6b6c0a5870 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6b7809bf40 tx=0x7f6b7801d000 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:53.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.742+0000 7f6b6b7fe640 1 -- 172.21.15.2:0/2229187948 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b70043020 con 0x5632aed08370 2024-09-19T04:59:53.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.742+0000 7f6b6b7fe640 1 -- 172.21.15.2:0/2229187948 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6b700317a0 con 0x5632aed08370 2024-09-19T04:59:53.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.742+0000 7f6b6b7fe640 1 -- 172.21.15.2:0/2229187948 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b70035040 con 0x5632aed08370 2024-09-19T04:59:53.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.743+0000 7f6b89bca740 1 -- 172.21.15.2:0/2229187948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632aed08370 msgr2=0x5632aed0a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:53.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.743+0000 7f6b89bca740 1 --2- 172.21.15.2:0/2229187948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632aed08370 0x5632aed0a760 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f6b7002a930 tx=0x7f6b700058d0 comp rx=0 tx=0).stop 2024-09-19T04:59:53.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.743+0000 7f6b89bca740 1 -- 172.21.15.2:0/2229187948 shutdown_connections 2024-09-19T04:59:53.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.743+0000 7f6b89bca740 1 --2- 172.21.15.2:0/2229187948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632aed08370 0x5632aed0a760 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:53.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.743+0000 7f6b89bca740 1 --2- 172.21.15.2:0/2229187948 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632aecfd5d0 0x5632aecfda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:53.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.743+0000 7f6b89bca740 1 --2- 172.21.15.2:0/2229187948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632aecfeb40 0x5632aecfd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:53.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.743+0000 7f6b89bca740 1 -- 172.21.15.2:0/2229187948 >> 172.21.15.2:0/2229187948 conn(0x5632aecc6310 msgr2=0x5632aecf9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:53.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.743+0000 7f6b89bca740 1 -- 172.21.15.2:0/2229187948 shutdown_connections 2024-09-19T04:59:53.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.743+0000 7f6b89bca740 1 -- 172.21.15.2:0/2229187948 wait complete. 2024-09-19T04:59:53.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.743+0000 7f6b89bca740 1 -- start start 2024-09-19T04:59:53.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.743+0000 7f6b89bca740 1 Processor -- start 2024-09-19T04:59:53.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.744+0000 7f6b89bca740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632aecfd5d0 0x5632aed07d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:53.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.744+0000 7f6b89bca740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632aecfeb40 0x5632aed05020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:53.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.744+0000 7f6b89bca740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632aed08370 0x5632aed05610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:53.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.744+0000 7f6b89bca740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5632aed0b010 con 0x5632aed08370 2024-09-19T04:59:53.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.744+0000 7f6b89bca740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5632aec1e060 con 0x5632aecfd5d0 2024-09-19T04:59:53.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.744+0000 7f6b89bca740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5632aed0b190 con 0x5632aecfeb40 2024-09-19T04:59:53.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.744+0000 7f6b89bca740 10 client.0 _ll_register_callbacks cb 0x5632ae9718c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:59:53.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.744+0000 7f6b84d8c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632aed08370 0x5632aed05610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:53.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.744+0000 7f6b84d8c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632aed08370 0x5632aed05610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42758/0 (socket says 172.21.15.2:42758) 2024-09-19T04:59:53.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.744+0000 7f6b84d8c640 1 -- 172.21.15.2:0/318242149 learned_addr learned my addr 172.21.15.2:0/318242149 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:59:53.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.744+0000 7f6b8558d640 1 --2- 172.21.15.2:0/318242149 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632aecfeb40 0x5632aed05020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:53.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.744+0000 7f6b84d8c640 1 --2- 172.21.15.2:0/318242149 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632aecfd5d0 0x5632aed07d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:53.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.744+0000 7f6b84d8c640 1 -- 172.21.15.2:0/318242149 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632aecfeb40 msgr2=0x5632aed05020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:59:53.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.744+0000 7f6b84d8c640 1 --2- 172.21.15.2:0/318242149 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632aecfeb40 0x5632aed05020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:53.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.744+0000 7f6b84d8c640 1 -- 172.21.15.2:0/318242149 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632aecfd5d0 msgr2=0x5632aed07d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:59:53.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.744+0000 7f6b84d8c640 1 --2- 172.21.15.2:0/318242149 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632aecfd5d0 0x5632aed07d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:53.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.744+0000 7f6b84d8c640 1 -- 172.21.15.2:0/318242149 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632ae9d43c0 con 0x5632aed08370 2024-09-19T04:59:53.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.744+0000 7f6b84d8c640 1 --2- 172.21.15.2:0/318242149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632aed08370 0x5632aed05610 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f6b70004490 tx=0x7f6b700044f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79f9e72a23895726 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:53.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.744+0000 7f6b68ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:59:53.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.745+0000 7f6b68ff9640 1 -- 172.21.15.2:0/318242149 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b70043070 con 0x5632aed08370 2024-09-19T04:59:53.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.745+0000 7f6b68ff9640 1 -- 172.21.15.2:0/318242149 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8527+0+0 (secure 0 0 0) 0x7f6b70032480 con 0x5632aed08370 2024-09-19T04:59:53.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.745+0000 7f6b89bca740 1 -- 172.21.15.2:0/318242149 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b700317a0 con 0x5632aed08370 2024-09-19T04:59:53.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.745+0000 7f6b68ff9640 1 -- 172.21.15.2:0/318242149 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f6b7005b050 con 0x5632aed08370 2024-09-19T04:59:53.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.745+0000 7f6b89bca740 10 client.16938 fetch_fsmap learned FSMap version 19 2024-09-19T04:59:53.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.745+0000 7f6b89bca740 1 -- 172.21.15.2:0/318242149 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5632aed16ab0 con 0x5632aed08370 2024-09-19T04:59:53.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.745+0000 7f6b68ff9640 1 -- 172.21.15.2:0/318242149 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6b700317a0 con 0x5632aed08370 2024-09-19T04:59:53.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.745+0000 7f6b68ff9640 1 -- 172.21.15.2:0/318242149 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f6b7003a040 con 0x5632aed08370 2024-09-19T04:59:53.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.745+0000 7f6b89bca740 10 client.16938 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:59:53.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.745+0000 7f6b89bca740 10 client.16938 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:59:53.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.745+0000 7f6b89bca740 20 client.16938 populate_metadata read hostname 'smithi002' 2024-09-19T04:59:53.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.745+0000 7f6b89bca740 1 --2- 172.21.15.2:0/318242149 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5632aed17e00 0x5632aed1a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:53.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.745+0000 7f6b89bca740 4 client.16938 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:59:53.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.745+0000 7f6b89bca740 1 -- 172.21.15.2:0/318242149 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5632aec70860 con 0x5632aed17e00 2024-09-19T04:59:53.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.745+0000 7f6b8558d640 1 --2- 172.21.15.2:0/318242149 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5632aed17e00 0x5632aed1a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:53.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.746+0000 7f6b68ff9640 10 client.16938 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:59:53.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.746+0000 7f6b8558d640 1 --2- 172.21.15.2:0/318242149 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5632aed17e00 0x5632aed1a1f0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b15d2931f11cd94 server_cookie=5ddf71aaf9c2c351 in_seq=0 out_seq=0 2024-09-19T04:59:53.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.746+0000 7f6b68ff9640 1 -- 172.21.15.2:0/318242149 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5632aec70860 con 0x5632aed17e00 2024-09-19T04:59:53.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.746+0000 7f6b68ff9640 10 client.16938 handle_command_reply: tid=0 2024-09-19T04:59:53.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.747+0000 7f6b89bca740 1 client.16938 shutdown 2024-09-19T04:59:53.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.747+0000 7f6b89bca740 1 -- 172.21.15.2:0/318242149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632aed08370 msgr2=0x5632aed05610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:53.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.747+0000 7f6b89bca740 1 --2- 172.21.15.2:0/318242149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632aed08370 0x5632aed05610 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f6b70004490 tx=0x7f6b700044f0 comp rx=0 tx=0).stop 2024-09-19T04:59:53.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.747+0000 7f6b89bca740 1 -- 172.21.15.2:0/318242149 shutdown_connections 2024-09-19T04:59:53.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.747+0000 7f6b89bca740 1 --2- 172.21.15.2:0/318242149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632aed08370 0x5632aed05610 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:53.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.747+0000 7f6b89bca740 1 --2- 172.21.15.2:0/318242149 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5632aed17e00 0x5632aed1a1f0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:53.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.747+0000 7f6b89bca740 1 --2- 172.21.15.2:0/318242149 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632aecfeb40 0x5632aed05020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:53.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.747+0000 7f6b68ff9640 0 client.16938 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:59:53.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.747+0000 7f6b89bca740 1 --2- 172.21.15.2:0/318242149 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632aecfd5d0 0x5632aed07d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:53.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.747+0000 7f6b89bca740 1 -- 172.21.15.2:0/318242149 >> 172.21.15.2:0/318242149 conn(0x5632aecc6310 msgr2=0x5632aecff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:53.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.747+0000 7f6b89bca740 1 -- 172.21.15.2:0/318242149 shutdown_connections 2024-09-19T04:59:53.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.747+0000 7f6b89bca740 1 -- 172.21.15.2:0/318242149 wait complete. 2024-09-19T04:59:53.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.747+0000 7f6b89bca740 20 client.16938 trim_cache size 0 max 16384 2024-09-19T04:59:53.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.760+0000 7f6b89bca740 1 Processor -- start 2024-09-19T04:59:53.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.760+0000 7f6b89bca740 1 -- start start 2024-09-19T04:59:53.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.760+0000 7f6b89bca740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632aecfd5d0 0x5632aecf8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:53.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.760+0000 7f6b89bca740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632aecfeb40 0x5632aed00120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:53.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.760+0000 7f6b89bca740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632aed08370 0x5632aed00660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:53.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.760+0000 7f6b89bca740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6b801ab670 con 0x5632aecfd5d0 2024-09-19T04:59:53.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.760+0000 7f6b89bca740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6b801aded0 con 0x5632aed08370 2024-09-19T04:59:53.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.760+0000 7f6b89bca740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f6b801abcc0 con 0x5632aecfeb40 2024-09-19T04:59:53.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.760+0000 7f6b84d8c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632aecfd5d0 0x5632aecf8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:53.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.760+0000 7f6b84d8c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632aecfd5d0 0x5632aecf8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42760/0 (socket says 172.21.15.2:42760) 2024-09-19T04:59:53.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.760+0000 7f6b84d8c640 1 -- 172.21.15.2:0/4193413364 learned_addr learned my addr 172.21.15.2:0/4193413364 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:59:53.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.761+0000 7f6b8558d640 1 --2- 172.21.15.2:0/4193413364 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632aecfeb40 0x5632aed00120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:53.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.761+0000 7f6b84d8c640 1 -- 172.21.15.2:0/4193413364 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632aecfeb40 msgr2=0x5632aed00120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:59:53.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.761+0000 7f6b84d8c640 1 --2- 172.21.15.2:0/4193413364 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632aecfeb40 0x5632aed00120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:53.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.761+0000 7f6b84d8c640 1 -- 172.21.15.2:0/4193413364 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632aed08370 msgr2=0x5632aed00660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:59:53.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.761+0000 7f6b84d8c640 1 --2- 172.21.15.2:0/4193413364 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632aed08370 0x5632aed00660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:53.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.761+0000 7f6b84d8c640 1 -- 172.21.15.2:0/4193413364 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632aed03ff0 con 0x5632aecfd5d0 2024-09-19T04:59:53.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.761+0000 7f6b84d8c640 1 --2- 172.21.15.2:0/4193413364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632aecfd5d0 0x5632aecf8bf0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f6b70000c00 tx=0x7f6b70009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc1fec91f78dae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:53.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.761+0000 7f6b6affd640 1 -- 172.21.15.2:0/4193413364 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b70035030 con 0x5632aecfd5d0 2024-09-19T04:59:53.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.761+0000 7f6b6affd640 1 -- 172.21.15.2:0/4193413364 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6b70032c40 con 0x5632aecfd5d0 2024-09-19T04:59:53.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.761+0000 7f6b6affd640 1 -- 172.21.15.2:0/4193413364 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b70043070 con 0x5632aecfd5d0 2024-09-19T04:59:53.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.762+0000 7f6b89bca740 1 -- 172.21.15.2:0/4193413364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632aecfd5d0 msgr2=0x5632aecf8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:53.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.762+0000 7f6b89bca740 1 --2- 172.21.15.2:0/4193413364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632aecfd5d0 0x5632aecf8bf0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f6b70000c00 tx=0x7f6b70009780 comp rx=0 tx=0).stop 2024-09-19T04:59:53.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.762+0000 7f6b89bca740 1 -- 172.21.15.2:0/4193413364 shutdown_connections 2024-09-19T04:59:53.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.762+0000 7f6b89bca740 1 --2- 172.21.15.2:0/4193413364 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632aed08370 0x5632aed00660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:53.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.762+0000 7f6b89bca740 1 --2- 172.21.15.2:0/4193413364 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632aecfeb40 0x5632aed00120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:53.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.762+0000 7f6b89bca740 1 --2- 172.21.15.2:0/4193413364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632aecfd5d0 0x5632aecf8bf0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:53.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.762+0000 7f6b89bca740 1 -- 172.21.15.2:0/4193413364 >> 172.21.15.2:0/4193413364 conn(0x5632aecc6310 msgr2=0x5632aecf84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:53.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.762+0000 7f6b89bca740 1 -- 172.21.15.2:0/4193413364 shutdown_connections 2024-09-19T04:59:53.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.762+0000 7f6b89bca740 1 -- 172.21.15.2:0/4193413364 wait complete. 2024-09-19T04:59:53.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.762+0000 7f6b89bca740 1 -- start start 2024-09-19T04:59:53.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.762+0000 7f6b89bca740 1 Processor -- start 2024-09-19T04:59:53.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.763+0000 7f6b89bca740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632aecfd5d0 0x5632aed1d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:53.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.763+0000 7f6b89bca740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632aecfeb40 0x5632aed1ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:53.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.763+0000 7f6b89bca740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632aed08370 0x5632aed1b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:53.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.763+0000 7f6b89bca740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6b801ac390 con 0x5632aecfeb40 2024-09-19T04:59:53.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.763+0000 7f6b89bca740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6b801ad800 con 0x5632aecfd5d0 2024-09-19T04:59:53.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.763+0000 7f6b89bca740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f6b801aca60 con 0x5632aed08370 2024-09-19T04:59:53.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.763+0000 7f6b89bca740 10 client.0 _ll_register_callbacks cb 0x7f6b7c008390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:59:53.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.763+0000 7f6b8558d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632aecfeb40 0x5632aed1ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:53.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.763+0000 7f6b84d8c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632aecfd5d0 0x5632aed1d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:53.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.763+0000 7f6b8558d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632aecfeb40 0x5632aed1ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42776/0 (socket says 172.21.15.2:42776) 2024-09-19T04:59:53.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.763+0000 7f6b8558d640 1 -- 172.21.15.2:0/2007713144 learned_addr learned my addr 172.21.15.2:0/2007713144 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:59:53.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.763+0000 7f6b84d8c640 1 --2- 172.21.15.2:0/2007713144 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632aed08370 0x5632aed1b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:53.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.763+0000 7f6b8558d640 1 -- 172.21.15.2:0/2007713144 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632aed08370 msgr2=0x5632aed1b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:59:53.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.763+0000 7f6b8558d640 1 --2- 172.21.15.2:0/2007713144 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632aed08370 0x5632aed1b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:53.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.763+0000 7f6b8558d640 1 -- 172.21.15.2:0/2007713144 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632aecfd5d0 msgr2=0x5632aed1d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:59:53.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.763+0000 7f6b8558d640 1 --2- 172.21.15.2:0/2007713144 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632aecfd5d0 0x5632aed1d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:53.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.763+0000 7f6b8558d640 1 -- 172.21.15.2:0/2007713144 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632aed1b680 con 0x5632aecfeb40 2024-09-19T04:59:53.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.763+0000 7f6b84d8c640 1 --2- 172.21.15.2:0/2007713144 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632aecfd5d0 0x5632aed1d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:59:53.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.763+0000 7f6b8558d640 1 --2- 172.21.15.2:0/2007713144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632aecfeb40 0x5632aed1ab00 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c000c00 tx=0x7f6b7c0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=657bf8b5c61c754e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:53.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.763+0000 7f6b68ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T04:59:53.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.763+0000 7f6b68ff9640 1 -- 172.21.15.2:0/2007713144 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c01c790 con 0x5632aecfeb40 2024-09-19T04:59:53.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.763+0000 7f6b68ff9640 1 -- 172.21.15.2:0/2007713144 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8527+0+0 (secure 0 0 0) 0x7f6b7c01c930 con 0x5632aecfeb40 2024-09-19T04:59:53.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.764+0000 7f6b89bca740 1 -- 172.21.15.2:0/2007713144 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b70032c40 con 0x5632aecfeb40 2024-09-19T04:59:53.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.764+0000 7f6b68ff9640 1 -- 172.21.15.2:0/2007713144 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f6b7c01cb30 con 0x5632aecfeb40 2024-09-19T04:59:53.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.764+0000 7f6b89bca740 10 client.16944 fetch_fsmap learned FSMap version 19 2024-09-19T04:59:53.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.764+0000 7f6b89bca740 1 -- 172.21.15.2:0/2007713144 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5632aed869a0 con 0x5632aecfeb40 2024-09-19T04:59:53.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.764+0000 7f6b68ff9640 1 -- 172.21.15.2:0/2007713144 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6b70032c40 con 0x5632aecfeb40 2024-09-19T04:59:53.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.764+0000 7f6b68ff9640 1 -- 172.21.15.2:0/2007713144 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f6b7c025430 con 0x5632aecfeb40 2024-09-19T04:59:53.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.764+0000 7f6b89bca740 10 client.16944 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T04:59:53.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.764+0000 7f6b89bca740 10 client.16944 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T04:59:53.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.764+0000 7f6b89bca740 20 client.16944 populate_metadata read hostname 'smithi002' 2024-09-19T04:59:53.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.764+0000 7f6b89bca740 1 --2- 172.21.15.2:0/2007713144 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5632aed87150 0x5632aed89570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:53.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.764+0000 7f6b89bca740 4 client.16944 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:59:53.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.764+0000 7f6b89bca740 1 -- 172.21.15.2:0/2007713144 --> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5632aec6ad70 con 0x5632aed87150 2024-09-19T04:59:53.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.764+0000 7f6b84d8c640 1 --2- 172.21.15.2:0/2007713144 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5632aed87150 0x5632aed89570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:53.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.765+0000 7f6b84d8c640 1 --2- 172.21.15.2:0/2007713144 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5632aed87150 0x5632aed89570 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd9208e2c6c62e62 server_cookie=9c60e11a47340d1c in_seq=0 out_seq=0 2024-09-19T04:59:53.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.765+0000 7f6b68ff9640 10 client.16944 ms_handle_connect on v2:172.21.15.116:6838/2346874880 2024-09-19T04:59:53.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.765+0000 7f6b68ff9640 1 -- 172.21.15.2:0/2007713144 <== mds.0 v2:172.21.15.116:6838/2346874880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5632aec6ad70 con 0x5632aed87150 2024-09-19T04:59:53.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.765+0000 7f6b68ff9640 10 client.16944 handle_command_reply: tid=0 2024-09-19T04:59:53.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.765+0000 7f6b89bca740 1 client.16944 shutdown 2024-09-19T04:59:53.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.765+0000 7f6b89bca740 1 -- 172.21.15.2:0/2007713144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632aecfeb40 msgr2=0x5632aed1ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:53.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.765+0000 7f6b89bca740 1 --2- 172.21.15.2:0/2007713144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632aecfeb40 0x5632aed1ab00 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c000c00 tx=0x7f6b7c0039c0 comp rx=0 tx=0).stop 2024-09-19T04:59:53.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.765+0000 7f6b89bca740 1 -- 172.21.15.2:0/2007713144 shutdown_connections 2024-09-19T04:59:53.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.765+0000 7f6b89bca740 1 --2- 172.21.15.2:0/2007713144 >> [v2:172.21.15.116:6838/2346874880,v1:172.21.15.116:6839/2346874880] conn(0x5632aed87150 0x5632aed89570 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:53.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.765+0000 7f6b89bca740 1 --2- 172.21.15.2:0/2007713144 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632aed08370 0x5632aed1b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:53.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.765+0000 7f6b89bca740 1 --2- 172.21.15.2:0/2007713144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5632aecfeb40 0x5632aed1ab00 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:53.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.765+0000 7f6b68ff9640 0 client.16944 ms_handle_reset on v2:172.21.15.116:6838/2346874880 2024-09-19T04:59:53.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.765+0000 7f6b89bca740 1 --2- 172.21.15.2:0/2007713144 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5632aecfd5d0 0x5632aed1d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:53.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.765+0000 7f6b89bca740 1 -- 172.21.15.2:0/2007713144 >> 172.21.15.2:0/2007713144 conn(0x5632aecc6310 msgr2=0x5632aed070a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:53.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.765+0000 7f6b89bca740 1 -- 172.21.15.2:0/2007713144 shutdown_connections 2024-09-19T04:59:53.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.765+0000 7f6b89bca740 1 -- 172.21.15.2:0/2007713144 wait complete. 2024-09-19T04:59:53.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.765+0000 7f6b89bca740 20 client.16944 trim_cache size 0 max 16384 2024-09-19T04:59:53.787 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T04:59:53.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.766+0000 7f6b877f1640 1 -- 172.21.15.2:0/532432079 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f6b6c0a33b0 msgr2=0x7f6b6c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:53.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.766+0000 7f6b877f1640 1 --2- 172.21.15.2:0/532432079 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f6b6c0a33b0 0x7f6b6c0a5870 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6b7809bf40 tx=0x7f6b7801d000 comp rx=0 tx=0).stop 2024-09-19T04:59:53.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.766+0000 7f6b877f1640 1 -- 172.21.15.2:0/532432079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b80106f10 msgr2=0x7f6b8019cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:53.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.766+0000 7f6b877f1640 1 --2- 172.21.15.2:0/532432079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b80106f10 0x7f6b8019cbb0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f6b7800eaa0 tx=0x7f6b7800ef60 comp rx=0 tx=0).stop 2024-09-19T04:59:53.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.766+0000 7f6b877f1640 1 -- 172.21.15.2:0/532432079 shutdown_connections 2024-09-19T04:59:53.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.766+0000 7f6b877f1640 1 --2- 172.21.15.2:0/532432079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b80106f10 0x7f6b8019cbb0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:53.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.766+0000 7f6b877f1640 1 --2- 172.21.15.2:0/532432079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b80102790 0x7f6b80198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:53.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.766+0000 7f6b877f1640 1 --2- 172.21.15.2:0/532432079 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f6b6c0a33b0 0x7f6b6c0a5870 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:53.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.766+0000 7f6b877f1640 1 --2- 172.21.15.2:0/532432079 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b80101de0 0x7f6b801982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:53.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.766+0000 7f6b877f1640 1 -- 172.21.15.2:0/532432079 >> 172.21.15.2:0/532432079 conn(0x7f6b800fd8c0 msgr2=0x7f6b800fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:53.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.766+0000 7f6b877f1640 1 -- 172.21.15.2:0/532432079 shutdown_connections 2024-09-19T04:59:53.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:53.766+0000 7f6b877f1640 1 -- 172.21.15.2:0/532432079 wait complete. 2024-09-19T04:59:54.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:54 smithi002 ceph-mon[30975]: pgmap v370: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:59:54.695 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/thrasher.py", line 47, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-19T04:59:54.696 INFO:tasks.fwd_scrub:done joining 2024-09-19T04:59:54.696 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-19T04:59:54.706 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T04:59:54.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:54 smithi018 ceph-mon[34537]: pgmap v370: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:59:54.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:54.818+0000 7f980e0c0640 1 -- 172.21.15.2:0/83927461 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9808102ca0 msgr2=0x7f9808103080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:54.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:54.818+0000 7f980e0c0640 1 --2- 172.21.15.2:0/83927461 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9808102ca0 0x7f9808103080 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f97f8009900 tx=0x7f97f802a480 comp rx=0 tx=0).stop 2024-09-19T04:59:54.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:54.818+0000 7f980e0c0640 1 -- 172.21.15.2:0/83927461 shutdown_connections 2024-09-19T04:59:54.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:54.818+0000 7f980e0c0640 1 --2- 172.21.15.2:0/83927461 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f980810c0f0 0x7f980810e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:54.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:54.818+0000 7f980e0c0640 1 --2- 172.21.15.2:0/83927461 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98081035c0 0x7f980810baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:54.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:54.818+0000 7f980e0c0640 1 --2- 172.21.15.2:0/83927461 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9808102ca0 0x7f9808103080 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:54.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:54.818+0000 7f980e0c0640 1 -- 172.21.15.2:0/83927461 >> 172.21.15.2:0/83927461 conn(0x7f98080fc6b0 msgr2=0x7f98080fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:54.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:54.818+0000 7f980e0c0640 1 -- 172.21.15.2:0/83927461 shutdown_connections 2024-09-19T04:59:54.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:54.818+0000 7f980e0c0640 1 -- 172.21.15.2:0/83927461 wait complete. 2024-09-19T04:59:54.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:54.819+0000 7f980e0c0640 1 Processor -- start 2024-09-19T04:59:54.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:54.819+0000 7f980e0c0640 1 -- start start 2024-09-19T04:59:54.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:54.819+0000 7f980e0c0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9808102ca0 0x7f9808198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:54.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:54.819+0000 7f980e0c0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98081035c0 0x7f98081988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:54.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:54.819+0000 7f980e0c0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f980810c0f0 0x7f980819cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:54.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:54.819+0000 7f980e0c0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9808111d80 con 0x7f980810c0f0 2024-09-19T04:59:54.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:54.819+0000 7f980e0c0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9808111c00 con 0x7f98081035c0 2024-09-19T04:59:54.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:54.819+0000 7f980e0c0640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f9808111f00 con 0x7f9808102ca0 2024-09-19T04:59:54.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:54.820+0000 7f9807fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f980810c0f0 0x7f980819cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:54.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:54.820+0000 7f9807fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f980810c0f0 0x7f980819cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42796/0 (socket says 172.21.15.2:42796) 2024-09-19T04:59:54.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:54.820+0000 7f9807fff640 1 -- 172.21.15.2:0/1404159809 learned_addr learned my addr 172.21.15.2:0/1404159809 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:59:54.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:54.820+0000 7f9806ffd640 1 --2- 172.21.15.2:0/1404159809 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98081035c0 0x7f98081988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:54.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:54.820+0000 7f98077fe640 1 --2- 172.21.15.2:0/1404159809 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9808102ca0 0x7f9808198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:54.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:54.820+0000 7f9807fff640 1 -- 172.21.15.2:0/1404159809 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9808102ca0 msgr2=0x7f9808198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:54.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:54.820+0000 7f9807fff640 1 --2- 172.21.15.2:0/1404159809 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9808102ca0 0x7f9808198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:54.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:54.820+0000 7f9807fff640 1 -- 172.21.15.2:0/1404159809 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98081035c0 msgr2=0x7f98081988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:54.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:54.820+0000 7f9807fff640 1 --2- 172.21.15.2:0/1404159809 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98081035c0 0x7f98081988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:54.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:54.820+0000 7f9807fff640 1 -- 172.21.15.2:0/1404159809 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f980819d360 con 0x7f980810c0f0 2024-09-19T04:59:54.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:54.820+0000 7f9807fff640 1 --2- 172.21.15.2:0/1404159809 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f980810c0f0 0x7f980819cc30 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f9800009fd0 tx=0x7f980000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:54.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:54.820+0000 7f9804ff9640 1 -- 172.21.15.2:0/1404159809 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9800017070 con 0x7f980810c0f0 2024-09-19T04:59:54.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:54.820+0000 7f980e0c0640 1 -- 172.21.15.2:0/1404159809 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f980819d650 con 0x7f980810c0f0 2024-09-19T04:59:54.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:54.820+0000 7f9804ff9640 1 -- 172.21.15.2:0/1404159809 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9800003e20 con 0x7f980810c0f0 2024-09-19T04:59:54.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:54.820+0000 7f9804ff9640 1 -- 172.21.15.2:0/1404159809 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9800010460 con 0x7f980810c0f0 2024-09-19T04:59:54.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:54.820+0000 7f980e0c0640 1 -- 172.21.15.2:0/1404159809 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98081a4ee0 con 0x7f980810c0f0 2024-09-19T04:59:54.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:54.821+0000 7f980e0c0640 1 -- 172.21.15.2:0/1404159809 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9808103080 con 0x7f980810c0f0 2024-09-19T04:59:54.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:54.823+0000 7f9804ff9640 1 -- 172.21.15.2:0/1404159809 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f9800003970 con 0x7f980810c0f0 2024-09-19T04:59:54.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:54.824+0000 7f9804ff9640 1 --2- 172.21.15.2:0/1404159809 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f97f00a33c0 0x7f97f00a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:54.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:54.824+0000 7f9804ff9640 1 -- 172.21.15.2:0/1404159809 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8527+0+0 (secure 0 0 0) 0x7f98000cfa00 con 0x7f980810c0f0 2024-09-19T04:59:54.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:54.824+0000 7f98077fe640 1 --2- 172.21.15.2:0/1404159809 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f97f00a33c0 0x7f97f00a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:54.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:54.824+0000 7f98077fe640 1 --2- 172.21.15.2:0/1404159809 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f97f00a33c0 0x7f97f00a5880 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f97f8031440 tx=0x7f97f8005b50 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:54.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:54.827+0000 7f9804ff9640 1 -- 172.21.15.2:0/1404159809 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f980009bd90 con 0x7f980810c0f0 2024-09-19T04:59:54.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:54 smithi116 ceph-mon[34477]: pgmap v370: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:59:55.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.004+0000 7f980e0c0640 1 -- 172.21.15.2:0/1404159809 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f98081996c0 con 0x7f980810c0f0 2024-09-19T04:59:55.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.005+0000 7f9804ff9640 1 -- 172.21.15.2:0/1404159809 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+23013 (secure 0 0 0) 0x7f98081996c0 con 0x7f980810c0f0 2024-09-19T04:59:55.007 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:59:55.007 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":91,"fsid":"d46630c4-7640-11ef-bceb-c7b262605968","created":"2024-09-19T04:38:39.698488+0000","modified":"2024-09-19T04:59:15.228791+0000","last_up_change":"2024-09-19T04:45:33.839647+0000","last_in_change":"2024-09-19T04:45:09.816808+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T04:41:51.960734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T04:46:20.031485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T04:46:22.484767+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":90,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7a7dc9b9-8d5d-4dd3-93a3-0d5efced07d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":611702745},{"type":"v1","addr":"172.21.15.2:6803","nonce":611702745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":611702745},{"type":"v1","addr":"172.21.15.2:6805","nonce":611702745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":611702745},{"type":"v1","addr":"172.21.15.2:6809","nonce":611702745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":611702745},{"type":"v1","addr":"172.21.15.2:6807","nonce":611702745}]},"public_addr":"172.21.15.2:6803/611702745","cluster_addr":"172.21.15.2:6805/611702745","heartbeat_back_addr":"172.21.15.2:6809/611702745","heartbeat_front_addr":"172.21.15.2:6807/611702745","state":["exists","up"]},{"osd":1,"uuid":"bea40dec-7d9c-497f-bf16-4bf6d3b839f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":58390709},{"type":"v1","addr":"172.21.15.18:6801","nonce":58390709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":58390709},{"type":"v1","addr":"172.21.15.18:6803","nonce":58390709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":58390709},{"type":"v1","addr":"172.21.15.18:6807","nonce":58390709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":58390709},{"type":"v1","addr":"172.21.15.18:6805","nonce":58390709}]},"public_addr":"172.21.15.18:6801/58390709","cluster_addr":"172.21.15.18:6803/58390709","heartbeat_back_addr":"172.21.15.18:6807/58390709","heartbeat_front_addr":"172.21.15.18:6805/58390709","state":["exists","up"]},{"osd":2,"uuid":"97716304-a31e-48c9-83de-84eed10a7a4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":627735759},{"type":"v1","addr":"172.21.15.116:6801","nonce":627735759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":627735759},{"type":"v1","addr":"172.21.15.116:6803","nonce":627735759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":627735759},{"type":"v1","addr":"172.21.15.116:6807","nonce":627735759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":627735759},{"type":"v1","addr":"172.21.15.116:6805","nonce":627735759}]},"public_addr":"172.21.15.116:6801/627735759","cluster_addr":"172.21.15.116:6803/627735759","heartbeat_back_addr":"172.21.15.116:6807/627735759","heartbeat_front_addr":"172.21.15.116:6805/627735759","state":["exists","up"]},{"osd":3,"uuid":"8d79514e-16cf-4bd0-a2eb-e9148b91183d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1936071687},{"type":"v1","addr":"172.21.15.2:6811","nonce":1936071687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1936071687},{"type":"v1","addr":"172.21.15.2:6813","nonce":1936071687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1936071687},{"type":"v1","addr":"172.21.15.2:6817","nonce":1936071687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1936071687},{"type":"v1","addr":"172.21.15.2:6815","nonce":1936071687}]},"public_addr":"172.21.15.2:6811/1936071687","cluster_addr":"172.21.15.2:6813/1936071687","heartbeat_back_addr":"172.21.15.2:6817/1936071687","heartbeat_front_addr":"172.21.15.2:6815/1936071687","state":["exists","up"]},{"osd":4,"uuid":"5136f03c-94a3-42a0-9bfc-020397836037","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1333533784},{"type":"v1","addr":"172.21.15.18:6809","nonce":1333533784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1333533784},{"type":"v1","addr":"172.21.15.18:6811","nonce":1333533784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1333533784},{"type":"v1","addr":"172.21.15.18:6815","nonce":1333533784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1333533784},{"type":"v1","addr":"172.21.15.18:6813","nonce":1333533784}]},"public_addr":"172.21.15.18:6809/1333533784","cluster_addr":"172.21.15.18:6811/1333533784","heartbeat_back_addr":"172.21.15.18:6815/1333533784","heartbeat_front_addr":"172.21.15.18:6813/1333533784","state":["exists","up"]},{"osd":5,"uuid":"9d3384b0-f87d-4513-b151-4cca21c339b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":316360741},{"type":"v1","addr":"172.21.15.116:6809","nonce":316360741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":316360741},{"type":"v1","addr":"172.21.15.116:6811","nonce":316360741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":316360741},{"type":"v1","addr":"172.21.15.116:6815","nonce":316360741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":316360741},{"type":"v1","addr":"172.21.15.116:6813","nonce":316360741}]},"public_addr":"172.21.15.116:6809/316360741","cluster_addr":"172.21.15.116:6811/316360741","heartbeat_back_addr":"172.21.15.116:6815/316360741","heartbeat_front_addr":"172.21.15.116:6813/316360741","state":["exists","up"]},{"osd":6,"uuid":"e54f44b5-a693-4b31-83b2-2bcf10ab9a75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1185564560},{"type":"v1","addr":"172.21.15.2:6819","nonce":1185564560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1185564560},{"type":"v1","addr":"172.21.15.2:6821","nonce":1185564560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1185564560},{"type":"v1","addr":"172.21.15.2:6825","nonce":1185564560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":1185564560},{"type":"v1","addr":"172.21.15.2:6823","nonce":1185564560}]},"public_addr":"172.21.15.2:6819/1185564560","cluster_addr":"172.21.15.2:6821/1185564560","heartbeat_back_addr":"172.21.15.2:6825/1185564560","heartbeat_front_addr":"172.21.15.2:6823/1185564560","state":["exists","up"]},{"osd":7,"uuid":"96a444c3-429a-48b6-9823-95c9e171341a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3691801363},{"type":"v1","addr":"172.21.15.18:6817","nonce":3691801363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3691801363},{"type":"v1","addr":"172.21.15.18:6819","nonce":3691801363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3691801363},{"type":"v1","addr":"172.21.15.18:6823","nonce":3691801363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3691801363},{"type":"v1","addr":"172.21.15.18:6821","nonce":3691801363}]},"public_addr":"172.21.15.18:6817/3691801363","cluster_addr":"172.21.15.18:6819/3691801363","heartbeat_back_addr":"172.21.15.18:6823/3691801363","heartbeat_front_addr":"172.21.15.18:6821/3691801363","state":["exists","up"]},{"osd":8,"uuid":"c3f696aa-be7d-4f67-9147-3751406e394d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":3709586119},{"type":"v1","addr":"172.21.15.116:6817","nonce":3709586119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":3709586119},{"type":"v1","addr":"172.21.15.116:6819","nonce":3709586119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":3709586119},{"type":"v1","addr":"172.21.15.116:6823","nonce":3709586119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":3709586119},{"type":"v1","addr":"172.21.15.116:6821","nonce":3709586119}]},"public_addr":"172.21.15.116:6817/3709586119","cluster_addr":"172.21.15.116:6819/3709586119","heartbeat_back_addr":"172.21.15.116:6823/3709586119","heartbeat_front_addr":"172.21.15.116:6821/3709586119","state":["exists","up"]},{"osd":9,"uuid":"4892549d-f050-48c5-b695-5924b612a581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1054791011},{"type":"v1","addr":"172.21.15.2:6827","nonce":1054791011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1054791011},{"type":"v1","addr":"172.21.15.2:6829","nonce":1054791011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1054791011},{"type":"v1","addr":"172.21.15.2:6833","nonce":1054791011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":1054791011},{"type":"v1","addr":"172.21.15.2:6831","nonce":1054791011}]},"public_addr":"172.21.15.2:6827/1054791011","cluster_addr":"172.21.15.2:6829/1054791011","heartbeat_back_addr":"172.21.15.2:6833/1054791011","heartbeat_front_addr":"172.21.15.2:6831/1054791011","state":["exists","up"]},{"osd":10,"uuid":"12b60238-6a35-4d48-bacd-ee5ddd8fdb0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1958683776},{"type":"v1","addr":"172.21.15.18:6825","nonce":1958683776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":1958683776},{"type":"v1","addr":"172.21.15.18:6827","nonce":1958683776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":1958683776},{"type":"v1","addr":"172.21.15.18:6831","nonce":1958683776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":1958683776},{"type":"v1","addr":"172.21.15.18:6829","nonce":1958683776}]},"public_addr":"172.21.15.18:6825/1958683776","cluster_addr":"172.21.15.18:6827/1958683776","heartbeat_back_addr":"172.21.15.18:6831/1958683776","heartbeat_front_addr":"172.21.15.18:6829/1958683776","state":["exists","up"]},{"osd":11,"uuid":"99b3e553-b42c-4b2f-817f-3900ad8bd223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3456789654},{"type":"v1","addr":"172.21.15.116:6825","nonce":3456789654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3456789654},{"type":"v1","addr":"172.21.15.116:6827","nonce":3456789654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3456789654},{"type":"v1","addr":"172.21.15.116:6831","nonce":3456789654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3456789654},{"type":"v1","addr":"172.21.15.116:6829","nonce":3456789654}]},"public_addr":"172.21.15.116:6825/3456789654","cluster_addr":"172.21.15.116:6827/3456789654","heartbeat_back_addr":"172.21.15.116:6831/3456789654","heartbeat_front_addr":"172.21.15.116:6829/3456789654","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:40:58.216702+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:41:22.852350+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:41:47.265084+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:42:12.785128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:42:38.475008+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:43:02.924009+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:43:28.050646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:43:52.715369+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:44:16.905066+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:44:42.071128+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:45:06.434525+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:45:31.569086+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":1}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/3848778984":"2024-09-20T04:47:59.140869+0000","172.21.15.2:0/2044166064":"2024-09-20T04:47:59.140869+0000","172.21.15.2:0/1092443021":"2024-09-20T04:47:59.140869+0000","172.21.15.2:0/2432243496":"2024-09-20T04:39:11.086431+0000","172.21.15.2:6800/3782987318":"2024-09-20T04:39:35.461329+0000","172.21.15.2:6801/1825825090":"2024-09-20T04:39:11.086431+0000","172.21.15.2:6800/1825825090":"2024-09-20T04:39:11.086431+0000","172.21.15.2:6800/3171525177":"2024-09-20T04:47:59.140869+0000","172.21.15.2:0/3064319092":"2024-09-20T04:39:11.086431+0000","172.21.15.2:6801/3782987318":"2024-09-20T04:39:35.461329+0000","172.21.15.2:0/256825166":"2024-09-20T04:39:35.461329+0000","172.21.15.2:0/1528097642":"2024-09-20T04:39:11.086431+0000","172.21.15.2:0/2801870985":"2024-09-20T04:39:35.461329+0000","172.21.15.2:6801/3171525177":"2024-09-20T04:47:59.140869+0000","172.21.15.2:0/4263572944":"2024-09-20T04:47:59.140869+0000","172.21.15.2:0/870383845":"2024-09-20T04:39:35.461329+0000","172.21.15.2:0/3466359926":"2024-09-20T04:47:59.140869+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T04:59:55.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.008+0000 7f980e0c0640 1 -- 172.21.15.2:0/1404159809 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f97f00a33c0 msgr2=0x7f97f00a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:55.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.008+0000 7f980e0c0640 1 --2- 172.21.15.2:0/1404159809 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f97f00a33c0 0x7f97f00a5880 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f97f8031440 tx=0x7f97f8005b50 comp rx=0 tx=0).stop 2024-09-19T04:59:55.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.008+0000 7f980e0c0640 1 -- 172.21.15.2:0/1404159809 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f980810c0f0 msgr2=0x7f980819cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:55.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.008+0000 7f980e0c0640 1 --2- 172.21.15.2:0/1404159809 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f980810c0f0 0x7f980819cc30 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f9800009fd0 tx=0x7f980000b260 comp rx=0 tx=0).stop 2024-09-19T04:59:55.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.008+0000 7f980e0c0640 1 -- 172.21.15.2:0/1404159809 shutdown_connections 2024-09-19T04:59:55.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.008+0000 7f980e0c0640 1 --2- 172.21.15.2:0/1404159809 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f980810c0f0 0x7f980819cc30 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:55.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.008+0000 7f980e0c0640 1 --2- 172.21.15.2:0/1404159809 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98081035c0 0x7f98081988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:55.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.008+0000 7f980e0c0640 1 --2- 172.21.15.2:0/1404159809 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f97f00a33c0 0x7f97f00a5880 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:55.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.008+0000 7f980e0c0640 1 --2- 172.21.15.2:0/1404159809 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9808102ca0 0x7f9808198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:55.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.008+0000 7f980e0c0640 1 -- 172.21.15.2:0/1404159809 >> 172.21.15.2:0/1404159809 conn(0x7f98080fc6b0 msgr2=0x7f98080fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:55.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.008+0000 7f980e0c0640 1 -- 172.21.15.2:0/1404159809 shutdown_connections 2024-09-19T04:59:55.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.008+0000 7f980e0c0640 1 -- 172.21.15.2:0/1404159809 wait complete. 2024-09-19T04:59:55.021 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T04:41:51.960734+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T04:46:20.031485+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T04:46:22.484767+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 17, 'snap_epoch': 90, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T04:59:55.021 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T04:59:55.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.127+0000 7fec1bb98640 1 -- 172.21.15.2:0/1335842138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec14101110 msgr2=0x7fec1410de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:55.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.127+0000 7fec1bb98640 1 --2- 172.21.15.2:0/1335842138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec14101110 0x7fec1410de60 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fec04009900 tx=0x7fec0402a410 comp rx=0 tx=0).stop 2024-09-19T04:59:55.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.127+0000 7fec1bb98640 1 -- 172.21.15.2:0/1335842138 shutdown_connections 2024-09-19T04:59:55.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.127+0000 7fec1bb98640 1 --2- 172.21.15.2:0/1335842138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec1410e3a0 0x7fec14110790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:55.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.127+0000 7fec1bb98640 1 --2- 172.21.15.2:0/1335842138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec14101110 0x7fec1410de60 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:55.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.127+0000 7fec1bb98640 1 --2- 172.21.15.2:0/1335842138 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec141007f0 0x7fec14100bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:55.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.127+0000 7fec1bb98640 1 -- 172.21.15.2:0/1335842138 >> 172.21.15.2:0/1335842138 conn(0x7fec140fc6a0 msgr2=0x7fec140feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:55.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.127+0000 7fec1bb98640 1 -- 172.21.15.2:0/1335842138 shutdown_connections 2024-09-19T04:59:55.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.127+0000 7fec1bb98640 1 -- 172.21.15.2:0/1335842138 wait complete. 2024-09-19T04:59:55.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.128+0000 7fec1bb98640 1 Processor -- start 2024-09-19T04:59:55.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.128+0000 7fec1bb98640 1 -- start start 2024-09-19T04:59:55.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.128+0000 7fec1bb98640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec141007f0 0x7fec1419a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:55.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.128+0000 7fec1bb98640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec14101110 0x7fec1419ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:55.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.128+0000 7fec1bb98640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec1410e3a0 0x7fec1419eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:55.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.128+0000 7fec1bb98640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fec14113f50 con 0x7fec141007f0 2024-09-19T04:59:55.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.128+0000 7fec1bb98640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fec14113dd0 con 0x7fec14101110 2024-09-19T04:59:55.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.128+0000 7fec1bb98640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fec141140d0 con 0x7fec1410e3a0 2024-09-19T04:59:55.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.128+0000 7fec19934640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec141007f0 0x7fec1419a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:55.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.128+0000 7fec19934640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec141007f0 0x7fec1419a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42808/0 (socket says 172.21.15.2:42808) 2024-09-19T04:59:55.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.128+0000 7fec19934640 1 -- 172.21.15.2:0/3904932887 learned_addr learned my addr 172.21.15.2:0/3904932887 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:59:55.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.128+0000 7fec1a135640 1 --2- 172.21.15.2:0/3904932887 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec1410e3a0 0x7fec1419eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:55.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.129+0000 7fec19133640 1 --2- 172.21.15.2:0/3904932887 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec14101110 0x7fec1419ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:55.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.129+0000 7fec19934640 1 -- 172.21.15.2:0/3904932887 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec1410e3a0 msgr2=0x7fec1419eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:55.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.129+0000 7fec19934640 1 --2- 172.21.15.2:0/3904932887 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec1410e3a0 0x7fec1419eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:55.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.129+0000 7fec19934640 1 -- 172.21.15.2:0/3904932887 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec14101110 msgr2=0x7fec1419ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:55.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.129+0000 7fec19934640 1 --2- 172.21.15.2:0/3904932887 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec14101110 0x7fec1419ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:55.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.129+0000 7fec19934640 1 -- 172.21.15.2:0/3904932887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec1419f610 con 0x7fec141007f0 2024-09-19T04:59:55.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.129+0000 7fec19133640 1 --2- 172.21.15.2:0/3904932887 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec14101110 0x7fec1419ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:59:55.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.129+0000 7fec19934640 1 --2- 172.21.15.2:0/3904932887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec141007f0 0x7fec1419a620 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fec1000d770 tx=0x7fec1000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:55.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.129+0000 7fec0affd640 1 -- 172.21.15.2:0/3904932887 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec10017070 con 0x7fec141007f0 2024-09-19T04:59:55.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.129+0000 7fec0affd640 1 -- 172.21.15.2:0/3904932887 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fec100054d0 con 0x7fec141007f0 2024-09-19T04:59:55.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.129+0000 7fec1bb98640 1 -- 172.21.15.2:0/3904932887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec1419f900 con 0x7fec141007f0 2024-09-19T04:59:55.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.129+0000 7fec0affd640 1 -- 172.21.15.2:0/3904932887 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec10004cf0 con 0x7fec141007f0 2024-09-19T04:59:55.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.129+0000 7fec1bb98640 1 -- 172.21.15.2:0/3904932887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec141a7190 con 0x7fec141007f0 2024-09-19T04:59:55.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.130+0000 7fec1bb98640 1 -- 172.21.15.2:0/3904932887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec14100bd0 con 0x7fec141007f0 2024-09-19T04:59:55.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.131+0000 7fec0affd640 1 -- 172.21.15.2:0/3904932887 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fec10004e90 con 0x7fec141007f0 2024-09-19T04:59:55.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.132+0000 7fec0affd640 1 --2- 172.21.15.2:0/3904932887 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fec000a3440 0x7fec000a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:55.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.132+0000 7fec19133640 1 --2- 172.21.15.2:0/3904932887 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fec000a3440 0x7fec000a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:55.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.132+0000 7fec0affd640 1 -- 172.21.15.2:0/3904932887 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8527+0+0 (secure 0 0 0) 0x7fec100cf7c0 con 0x7fec141007f0 2024-09-19T04:59:55.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.132+0000 7fec19133640 1 --2- 172.21.15.2:0/3904932887 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fec000a3440 0x7fec000a5900 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fec04000c00 tx=0x7fec04031400 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:55.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.136+0000 7fec0affd640 1 -- 172.21.15.2:0/3904932887 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fec1009c1a0 con 0x7fec141007f0 2024-09-19T04:59:55.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.313+0000 7fec1bb98640 1 -- 172.21.15.2:0/3904932887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fec14109530 con 0x7fec141007f0 2024-09-19T04:59:55.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.314+0000 7fec0affd640 1 -- 172.21.15.2:0/3904932887 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) ==== 93+0+10 (secure 0 0 0) 0x7fec1009baa0 con 0x7fec141007f0 2024-09-19T04:59:55.315 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-09-19T04:59:55.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.316+0000 7fec1bb98640 1 -- 172.21.15.2:0/3904932887 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fec000a3440 msgr2=0x7fec000a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:55.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.316+0000 7fec1bb98640 1 --2- 172.21.15.2:0/3904932887 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fec000a3440 0x7fec000a5900 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fec04000c00 tx=0x7fec04031400 comp rx=0 tx=0).stop 2024-09-19T04:59:55.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.316+0000 7fec1bb98640 1 -- 172.21.15.2:0/3904932887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec141007f0 msgr2=0x7fec1419a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:55.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.316+0000 7fec1bb98640 1 --2- 172.21.15.2:0/3904932887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec141007f0 0x7fec1419a620 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fec1000d770 tx=0x7fec1000dc30 comp rx=0 tx=0).stop 2024-09-19T04:59:55.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.316+0000 7fec1bb98640 1 -- 172.21.15.2:0/3904932887 shutdown_connections 2024-09-19T04:59:55.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.316+0000 7fec1bb98640 1 --2- 172.21.15.2:0/3904932887 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fec000a3440 0x7fec000a5900 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:55.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.316+0000 7fec1bb98640 1 --2- 172.21.15.2:0/3904932887 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec1410e3a0 0x7fec1419eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:55.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.316+0000 7fec1bb98640 1 --2- 172.21.15.2:0/3904932887 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec14101110 0x7fec1419ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:55.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.316+0000 7fec1bb98640 1 --2- 172.21.15.2:0/3904932887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec141007f0 0x7fec1419a620 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:55.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.316+0000 7fec1bb98640 1 -- 172.21.15.2:0/3904932887 >> 172.21.15.2:0/3904932887 conn(0x7fec140fc6a0 msgr2=0x7fec140fea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:55.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.316+0000 7fec1bb98640 1 -- 172.21.15.2:0/3904932887 shutdown_connections 2024-09-19T04:59:55.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.316+0000 7fec1bb98640 1 -- 172.21.15.2:0/3904932887 wait complete. 2024-09-19T04:59:55.328 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T04:59:55.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.434+0000 7fde15e06640 1 -- 172.21.15.2:0/3730634455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde10101aa0 msgr2=0x7fde10101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:55.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.434+0000 7fde15e06640 1 --2- 172.21.15.2:0/3730634455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde10101aa0 0x7fde10101f00 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fddf8009930 tx=0x7fddf802a420 comp rx=0 tx=0).stop 2024-09-19T04:59:55.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.434+0000 7fde15e06640 1 -- 172.21.15.2:0/3730634455 shutdown_connections 2024-09-19T04:59:55.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.434+0000 7fde15e06640 1 --2- 172.21.15.2:0/3730634455 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde10102440 0x7fde1010e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:55.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.434+0000 7fde15e06640 1 --2- 172.21.15.2:0/3730634455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde10101aa0 0x7fde10101f00 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:55.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.434+0000 7fde15e06640 1 --2- 172.21.15.2:0/3730634455 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde10107ab0 0x7fde10107e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:55.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.434+0000 7fde15e06640 1 -- 172.21.15.2:0/3730634455 >> 172.21.15.2:0/3730634455 conn(0x7fde100fd7a0 msgr2=0x7fde100ffbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:55.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.434+0000 7fde15e06640 1 -- 172.21.15.2:0/3730634455 shutdown_connections 2024-09-19T04:59:55.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.434+0000 7fde15e06640 1 -- 172.21.15.2:0/3730634455 wait complete. 2024-09-19T04:59:55.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.435+0000 7fde15e06640 1 Processor -- start 2024-09-19T04:59:55.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.435+0000 7fde15e06640 1 -- start start 2024-09-19T04:59:55.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.435+0000 7fde15e06640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde10101aa0 0x7fde10198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:55.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.435+0000 7fde15e06640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde10102440 0x7fde101988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:55.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.435+0000 7fde15e06640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde10107ab0 0x7fde1019cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:55.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.435+0000 7fde15e06640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fde10111da0 con 0x7fde10102440 2024-09-19T04:59:55.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.435+0000 7fde15e06640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fde10111c20 con 0x7fde10101aa0 2024-09-19T04:59:55.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.435+0000 7fde15e06640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fde10111f20 con 0x7fde10107ab0 2024-09-19T04:59:55.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.435+0000 7fde0effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde10102440 0x7fde101988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:55.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.435+0000 7fde0effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde10102440 0x7fde101988b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42832/0 (socket says 172.21.15.2:42832) 2024-09-19T04:59:55.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.435+0000 7fde0effd640 1 -- 172.21.15.2:0/585150721 learned_addr learned my addr 172.21.15.2:0/585150721 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:59:55.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.435+0000 7fde0f7fe640 1 --2- 172.21.15.2:0/585150721 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde10101aa0 0x7fde10198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:55.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.435+0000 7fde0ffff640 1 --2- 172.21.15.2:0/585150721 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde10107ab0 0x7fde1019cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:55.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.435+0000 7fde0effd640 1 -- 172.21.15.2:0/585150721 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde10107ab0 msgr2=0x7fde1019cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:55.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.435+0000 7fde0effd640 1 --2- 172.21.15.2:0/585150721 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde10107ab0 0x7fde1019cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:55.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.435+0000 7fde0effd640 1 -- 172.21.15.2:0/585150721 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde10101aa0 msgr2=0x7fde10198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:55.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.435+0000 7fde0effd640 1 --2- 172.21.15.2:0/585150721 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde10101aa0 0x7fde10198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:55.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.435+0000 7fde0effd640 1 -- 172.21.15.2:0/585150721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde1019d360 con 0x7fde10102440 2024-09-19T04:59:55.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.436+0000 7fde0effd640 1 --2- 172.21.15.2:0/585150721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde10102440 0x7fde101988b0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fddf8005940 tx=0x7fddf80040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:55.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.436+0000 7fde0cff9640 1 -- 172.21.15.2:0/585150721 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf803f030 con 0x7fde10102440 2024-09-19T04:59:55.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.436+0000 7fde15e06640 1 -- 172.21.15.2:0/585150721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde1019d5f0 con 0x7fde10102440 2024-09-19T04:59:55.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.436+0000 7fde0cff9640 1 -- 172.21.15.2:0/585150721 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fddf80044c0 con 0x7fde10102440 2024-09-19T04:59:55.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.436+0000 7fde0cff9640 1 -- 172.21.15.2:0/585150721 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf8035070 con 0x7fde10102440 2024-09-19T04:59:55.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.436+0000 7fde15e06640 1 -- 172.21.15.2:0/585150721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde101a4ee0 con 0x7fde10102440 2024-09-19T04:59:55.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.437+0000 7fde15e06640 1 -- 172.21.15.2:0/585150721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde10101f00 con 0x7fde10102440 2024-09-19T04:59:55.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.438+0000 7fde0cff9640 1 -- 172.21.15.2:0/585150721 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fddf8042030 con 0x7fde10102440 2024-09-19T04:59:55.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.439+0000 7fde0cff9640 1 --2- 172.21.15.2:0/585150721 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fddfc0a33c0 0x7fddfc0a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:55.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.439+0000 7fde0f7fe640 1 --2- 172.21.15.2:0/585150721 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fddfc0a33c0 0x7fddfc0a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:55.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.440+0000 7fde0cff9640 1 -- 172.21.15.2:0/585150721 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8527+0+0 (secure 0 0 0) 0x7fddf80f0280 con 0x7fde10102440 2024-09-19T04:59:55.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.440+0000 7fde0f7fe640 1 --2- 172.21.15.2:0/585150721 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fddfc0a33c0 0x7fddfc0a5880 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fde00009b50 tx=0x7fde00005f90 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:55.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.443+0000 7fde0cff9640 1 -- 172.21.15.2:0/585150721 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fddf80bcc40 con 0x7fde10102440 2024-09-19T04:59:55.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:55 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/1404159809' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:59:55.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:55 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/3904932887' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T04:59:55.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.618+0000 7fde15e06640 1 -- 172.21.15.2:0/585150721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fde101996c0 con 0x7fde10102440 2024-09-19T04:59:55.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.619+0000 7fde0cff9640 1 -- 172.21.15.2:0/585150721 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) ==== 104+0+11 (secure 0 0 0) 0x7fddf80bc540 con 0x7fde10102440 2024-09-19T04:59:55.620 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2024-09-19T04:59:55.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.620+0000 7fde15e06640 1 -- 172.21.15.2:0/585150721 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fddfc0a33c0 msgr2=0x7fddfc0a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:55.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.620+0000 7fde15e06640 1 --2- 172.21.15.2:0/585150721 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fddfc0a33c0 0x7fddfc0a5880 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fde00009b50 tx=0x7fde00005f90 comp rx=0 tx=0).stop 2024-09-19T04:59:55.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.620+0000 7fde15e06640 1 -- 172.21.15.2:0/585150721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde10102440 msgr2=0x7fde101988b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:55.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.620+0000 7fde15e06640 1 --2- 172.21.15.2:0/585150721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde10102440 0x7fde101988b0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fddf8005940 tx=0x7fddf80040c0 comp rx=0 tx=0).stop 2024-09-19T04:59:55.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.621+0000 7fde15e06640 1 -- 172.21.15.2:0/585150721 shutdown_connections 2024-09-19T04:59:55.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.621+0000 7fde15e06640 1 --2- 172.21.15.2:0/585150721 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fddfc0a33c0 0x7fddfc0a5880 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:55.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.621+0000 7fde15e06640 1 --2- 172.21.15.2:0/585150721 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde10107ab0 0x7fde1019cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:55.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.621+0000 7fde15e06640 1 --2- 172.21.15.2:0/585150721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde10102440 0x7fde101988b0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:55.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.621+0000 7fde15e06640 1 --2- 172.21.15.2:0/585150721 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde10101aa0 0x7fde10198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:55.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.621+0000 7fde15e06640 1 -- 172.21.15.2:0/585150721 >> 172.21.15.2:0/585150721 conn(0x7fde100fd7a0 msgr2=0x7fde100fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:55.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.621+0000 7fde15e06640 1 -- 172.21.15.2:0/585150721 shutdown_connections 2024-09-19T04:59:55.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.621+0000 7fde15e06640 1 -- 172.21.15.2:0/585150721 wait complete. 2024-09-19T04:59:55.633 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T04:59:55.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.738+0000 7fb36a20e640 1 -- 172.21.15.2:0/2924576453 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3641009a0 msgr2=0x7fb364100e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:55.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.738+0000 7fb36a20e640 1 --2- 172.21.15.2:0/2924576453 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3641009a0 0x7fb364100e00 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fb34c009930 tx=0x7fb34c02a420 comp rx=0 tx=0).stop 2024-09-19T04:59:55.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.738+0000 7fb36a20e640 1 -- 172.21.15.2:0/2924576453 shutdown_connections 2024-09-19T04:59:55.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.738+0000 7fb36a20e640 1 --2- 172.21.15.2:0/2924576453 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb364101340 0x7fb36410d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:55.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.738+0000 7fb36a20e640 1 --2- 172.21.15.2:0/2924576453 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3641009a0 0x7fb364100e00 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:55.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.738+0000 7fb36a20e640 1 --2- 172.21.15.2:0/2924576453 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3641069b0 0x7fb364106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:55.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.738+0000 7fb36a20e640 1 -- 172.21.15.2:0/2924576453 >> 172.21.15.2:0/2924576453 conn(0x7fb3640fc6a0 msgr2=0x7fb3640feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:55.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.738+0000 7fb36a20e640 1 -- 172.21.15.2:0/2924576453 shutdown_connections 2024-09-19T04:59:55.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.738+0000 7fb36a20e640 1 -- 172.21.15.2:0/2924576453 wait complete. 2024-09-19T04:59:55.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.738+0000 7fb36a20e640 1 Processor -- start 2024-09-19T04:59:55.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.739+0000 7fb36a20e640 1 -- start start 2024-09-19T04:59:55.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.739+0000 7fb36a20e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb3641009a0 0x7fb3641991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:55.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.739+0000 7fb36a20e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb364101340 0x7fb3641996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:55.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.739+0000 7fb36a20e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3641069b0 0x7fb3641a4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:55.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.739+0000 7fb36a20e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb364110ca0 con 0x7fb364101340 2024-09-19T04:59:55.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.739+0000 7fb36a20e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb364110b20 con 0x7fb3641069b0 2024-09-19T04:59:55.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.739+0000 7fb36a20e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fb364110e20 con 0x7fb3641009a0 2024-09-19T04:59:55.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.739+0000 7fb362ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb364101340 0x7fb3641996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:55.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.739+0000 7fb3637fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb3641009a0 0x7fb3641991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:55.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.739+0000 7fb362ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb364101340 0x7fb3641996f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42846/0 (socket says 172.21.15.2:42846) 2024-09-19T04:59:55.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.739+0000 7fb362ffd640 1 -- 172.21.15.2:0/3739657896 learned_addr learned my addr 172.21.15.2:0/3739657896 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:59:55.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.739+0000 7fb363fff640 1 --2- 172.21.15.2:0/3739657896 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3641069b0 0x7fb3641a4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:55.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.739+0000 7fb362ffd640 1 -- 172.21.15.2:0/3739657896 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb3641009a0 msgr2=0x7fb3641991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:55.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.739+0000 7fb362ffd640 1 --2- 172.21.15.2:0/3739657896 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb3641009a0 0x7fb3641991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:55.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.739+0000 7fb362ffd640 1 -- 172.21.15.2:0/3739657896 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3641069b0 msgr2=0x7fb3641a4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:55.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.739+0000 7fb362ffd640 1 --2- 172.21.15.2:0/3739657896 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3641069b0 0x7fb3641a4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:55.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.739+0000 7fb362ffd640 1 -- 172.21.15.2:0/3739657896 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3641a4770 con 0x7fb364101340 2024-09-19T04:59:55.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.739+0000 7fb3637fe640 1 --2- 172.21.15.2:0/3739657896 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb3641009a0 0x7fb3641991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:59:55.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.740+0000 7fb362ffd640 1 --2- 172.21.15.2:0/3739657896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb364101340 0x7fb3641996f0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fb34c004770 tx=0x7fb34c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:55.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.740+0000 7fb360ff9640 1 -- 172.21.15.2:0/3739657896 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb34c03f070 con 0x7fb364101340 2024-09-19T04:59:55.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.740+0000 7fb360ff9640 1 -- 172.21.15.2:0/3739657896 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb34c03b460 con 0x7fb364101340 2024-09-19T04:59:55.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.740+0000 7fb360ff9640 1 -- 172.21.15.2:0/3739657896 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb34c035070 con 0x7fb364101340 2024-09-19T04:59:55.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.740+0000 7fb36a20e640 1 -- 172.21.15.2:0/3739657896 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3641a4940 con 0x7fb364101340 2024-09-19T04:59:55.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.740+0000 7fb36a20e640 1 -- 172.21.15.2:0/3739657896 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3641a4d50 con 0x7fb364101340 2024-09-19T04:59:55.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.741+0000 7fb36a20e640 1 -- 172.21.15.2:0/3739657896 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb364100e00 con 0x7fb364101340 2024-09-19T04:59:55.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.742+0000 7fb360ff9640 1 -- 172.21.15.2:0/3739657896 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fb34c03b610 con 0x7fb364101340 2024-09-19T04:59:55.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.743+0000 7fb360ff9640 1 --2- 172.21.15.2:0/3739657896 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fb3500a33c0 0x7fb3500a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:55.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.743+0000 7fb360ff9640 1 -- 172.21.15.2:0/3739657896 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8527+0+0 (secure 0 0 0) 0x7fb34c0f0000 con 0x7fb364101340 2024-09-19T04:59:55.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.743+0000 7fb3637fe640 1 --2- 172.21.15.2:0/3739657896 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fb3500a33c0 0x7fb3500a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:55.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.743+0000 7fb3637fe640 1 --2- 172.21.15.2:0/3739657896 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fb3500a33c0 0x7fb3500a5880 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb35400bf50 tx=0x7fb35400b390 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:55.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.747+0000 7fb360ff9640 1 -- 172.21.15.2:0/3739657896 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb34c0bc390 con 0x7fb364101340 2024-09-19T04:59:55.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:55 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/1404159809' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:59:55.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:55 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/3904932887' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T04:59:55.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:55 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/1404159809' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:59:55.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:55 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/3904932887' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T04:59:55.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.924+0000 7fb36a20e640 1 -- 172.21.15.2:0/3739657896 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb36402d7c0 con 0x7fb364101340 2024-09-19T04:59:55.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.924+0000 7fb360ff9640 1 -- 172.21.15.2:0/3739657896 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) ==== 100+0+11 (secure 0 0 0) 0x7fb34c0c0690 con 0x7fb364101340 2024-09-19T04:59:55.926 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2024-09-19T04:59:55.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.926+0000 7fb36a20e640 1 -- 172.21.15.2:0/3739657896 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fb3500a33c0 msgr2=0x7fb3500a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:55.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.926+0000 7fb36a20e640 1 --2- 172.21.15.2:0/3739657896 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fb3500a33c0 0x7fb3500a5880 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb35400bf50 tx=0x7fb35400b390 comp rx=0 tx=0).stop 2024-09-19T04:59:55.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.926+0000 7fb36a20e640 1 -- 172.21.15.2:0/3739657896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb364101340 msgr2=0x7fb3641996f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:55.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.926+0000 7fb36a20e640 1 --2- 172.21.15.2:0/3739657896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb364101340 0x7fb3641996f0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fb34c004770 tx=0x7fb34c0042f0 comp rx=0 tx=0).stop 2024-09-19T04:59:55.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.926+0000 7fb36a20e640 1 -- 172.21.15.2:0/3739657896 shutdown_connections 2024-09-19T04:59:55.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.926+0000 7fb36a20e640 1 --2- 172.21.15.2:0/3739657896 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3641069b0 0x7fb3641a4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:55.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.926+0000 7fb36a20e640 1 --2- 172.21.15.2:0/3739657896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb364101340 0x7fb3641996f0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:55.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.926+0000 7fb36a20e640 1 --2- 172.21.15.2:0/3739657896 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fb3500a33c0 0x7fb3500a5880 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:55.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.926+0000 7fb36a20e640 1 --2- 172.21.15.2:0/3739657896 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb3641009a0 0x7fb3641991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:55.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.927+0000 7fb36a20e640 1 -- 172.21.15.2:0/3739657896 >> 172.21.15.2:0/3739657896 conn(0x7fb3640fc6a0 msgr2=0x7fb3640fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:55.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.927+0000 7fb36a20e640 1 -- 172.21.15.2:0/3739657896 shutdown_connections 2024-09-19T04:59:55.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:55.927+0000 7fb36a20e640 1 -- 172.21.15.2:0/3739657896 wait complete. 2024-09-19T04:59:55.939 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-19T04:59:56.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.041+0000 7f47a773b640 1 -- 172.21.15.2:0/3315764526 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47a0101990 msgr2=0x7f47a0101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:56.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.041+0000 7f47a773b640 1 --2- 172.21.15.2:0/3315764526 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47a0101990 0x7f47a0101d70 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f479c009900 tx=0x7f479c02a410 comp rx=0 tx=0).stop 2024-09-19T04:59:56.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.041+0000 7f47a773b640 1 -- 172.21.15.2:0/3315764526 shutdown_connections 2024-09-19T04:59:56.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.041+0000 7f47a773b640 1 --2- 172.21.15.2:0/3315764526 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47a0106f40 0x7f47a010d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:56.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.041+0000 7f47a773b640 1 --2- 172.21.15.2:0/3315764526 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47a0102340 0x7f47a01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:56.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.041+0000 7f47a773b640 1 --2- 172.21.15.2:0/3315764526 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47a0101990 0x7f47a0101d70 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:56.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.041+0000 7f47a773b640 1 -- 172.21.15.2:0/3315764526 >> 172.21.15.2:0/3315764526 conn(0x7f47a0075ec0 msgr2=0x7f47a00762d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:56.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.041+0000 7f47a773b640 1 -- 172.21.15.2:0/3315764526 shutdown_connections 2024-09-19T04:59:56.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.041+0000 7f47a773b640 1 -- 172.21.15.2:0/3315764526 wait complete. 2024-09-19T04:59:56.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.042+0000 7f47a773b640 1 Processor -- start 2024-09-19T04:59:56.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.042+0000 7f47a773b640 1 -- start start 2024-09-19T04:59:56.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.042+0000 7f47a773b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47a0101990 0x7f47a01991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:56.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.042+0000 7f47a773b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47a0106f40 0x7f47a01996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:56.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.042+0000 7f47a773b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47a0199c70 0x7f47a01a4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:56.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.042+0000 7f47a773b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f47a0110cb0 con 0x7f47a0199c70 2024-09-19T04:59:56.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.042+0000 7f47a773b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f47a0110b30 con 0x7f47a0106f40 2024-09-19T04:59:56.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.042+0000 7f47a773b640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f47a0110e30 con 0x7f47a0101990 2024-09-19T04:59:56.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.042+0000 7f47a5cd8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47a0199c70 0x7f47a01a4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:56.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.042+0000 7f47a5cd8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47a0199c70 0x7f47a01a4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42872/0 (socket says 172.21.15.2:42872) 2024-09-19T04:59:56.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.042+0000 7f47a5cd8640 1 -- 172.21.15.2:0/3081721521 learned_addr learned my addr 172.21.15.2:0/3081721521 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T04:59:56.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.043+0000 7f47a54d7640 1 --2- 172.21.15.2:0/3081721521 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47a0101990 0x7f47a01991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:56.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.043+0000 7f47a4cd6640 1 --2- 172.21.15.2:0/3081721521 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47a0106f40 0x7f47a01996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:56.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.043+0000 7f47a5cd8640 1 -- 172.21.15.2:0/3081721521 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47a0101990 msgr2=0x7f47a01991a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:56.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.043+0000 7f47a5cd8640 1 --2- 172.21.15.2:0/3081721521 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47a0101990 0x7f47a01991a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:56.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.043+0000 7f47a5cd8640 1 -- 172.21.15.2:0/3081721521 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47a0106f40 msgr2=0x7f47a01996e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:56.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.043+0000 7f47a5cd8640 1 --2- 172.21.15.2:0/3081721521 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47a0106f40 0x7f47a01996e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:56.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.043+0000 7f47a5cd8640 1 -- 172.21.15.2:0/3081721521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47a01a49f0 con 0x7f47a0199c70 2024-09-19T04:59:56.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.043+0000 7f47a54d7640 1 --2- 172.21.15.2:0/3081721521 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47a0101990 0x7f47a01991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:59:56.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.043+0000 7f47a4cd6640 1 --2- 172.21.15.2:0/3081721521 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47a0106f40 0x7f47a01996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:59:56.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.043+0000 7f47a5cd8640 1 --2- 172.21.15.2:0/3081721521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47a0199c70 0x7f47a01a4220 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f479800cad0 tx=0x7f479800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:56.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.043+0000 7f47967fc640 1 -- 172.21.15.2:0/3081721521 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f479800ae20 con 0x7f47a0199c70 2024-09-19T04:59:56.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.043+0000 7f47967fc640 1 -- 172.21.15.2:0/3081721521 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4798005020 con 0x7f47a0199c70 2024-09-19T04:59:56.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.043+0000 7f47a773b640 1 -- 172.21.15.2:0/3081721521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47a01a4ce0 con 0x7f47a0199c70 2024-09-19T04:59:56.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.043+0000 7f47967fc640 1 -- 172.21.15.2:0/3081721521 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f479800f6b0 con 0x7f47a0199c70 2024-09-19T04:59:56.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.043+0000 7f47a773b640 1 -- 172.21.15.2:0/3081721521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47a01a5230 con 0x7f47a0199c70 2024-09-19T04:59:56.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.044+0000 7f47a773b640 1 -- 172.21.15.2:0/3081721521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47a0101d70 con 0x7f47a0199c70 2024-09-19T04:59:56.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.045+0000 7f47967fc640 1 -- 172.21.15.2:0/3081721521 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f47980051d0 con 0x7f47a0199c70 2024-09-19T04:59:56.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.046+0000 7f47967fc640 1 --2- 172.21.15.2:0/3081721521 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f478c0a3440 0x7f478c0a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:59:56.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.046+0000 7f47a54d7640 1 --2- 172.21.15.2:0/3081721521 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f478c0a3440 0x7f478c0a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:59:56.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.046+0000 7f47967fc640 1 -- 172.21.15.2:0/3081721521 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8527+0+0 (secure 0 0 0) 0x7f47980cfdf0 con 0x7f47a0199c70 2024-09-19T04:59:56.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.047+0000 7f47a54d7640 1 --2- 172.21.15.2:0/3081721521 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f478c0a3440 0x7f478c0a5900 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f479c031440 tx=0x7f479c005a20 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:59:56.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.050+0000 7f47967fc640 1 -- 172.21.15.2:0/3081721521 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4798014030 con 0x7f47a0199c70 2024-09-19T04:59:56.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.277+0000 7f47a773b640 1 -- 172.21.15.2:0/3081721521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f47a0108ed0 con 0x7f47a0199c70 2024-09-19T04:59:56.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.285+0000 7f47967fc640 1 -- 172.21.15.2:0/3081721521 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v25) ==== 81+0+742859 (secure 0 0 0) 0x7f479809c770 con 0x7f47a0199c70 2024-09-19T04:59:56.296 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T04:59:56.297 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:59:56.297 INFO:teuthology.orchestra.run.smithi002.stdout: "epoch": 25, 2024-09-19T04:59:56.297 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.297 INFO:teuthology.orchestra.run.smithi002.stdout: "active_gid": 15096, 2024-09-19T04:59:56.297 INFO:teuthology.orchestra.run.smithi002.stdout: "active_name": "x", 2024-09-19T04:59:56.297 INFO:teuthology.orchestra.run.smithi002.stdout: "active_addrs": { 2024-09-19T04:59:56.297 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-09-19T04:59:56.297 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.297 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-09-19T04:59:56.297 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6800", 2024-09-19T04:59:56.297 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 852329670 2024-09-19T04:59:56.298 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.298 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.298 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2024-09-19T04:59:56.298 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6801", 2024-09-19T04:59:56.298 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 852329670 2024-09-19T04:59:56.298 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.298 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-19T04:59:56.298 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.298 INFO:teuthology.orchestra.run.smithi002.stdout: "active_addr": "172.21.15.2:6801/852329670", 2024-09-19T04:59:56.298 INFO:teuthology.orchestra.run.smithi002.stdout: "active_change": "2024-09-19T04:47:59.141090+0000", 2024-09-19T04:59:56.298 INFO:teuthology.orchestra.run.smithi002.stdout: "active_mgr_features": 4540701547738038271, 2024-09-19T04:59:56.298 INFO:teuthology.orchestra.run.smithi002.stdout: "available": true, 2024-09-19T04:59:56.298 INFO:teuthology.orchestra.run.smithi002.stdout: "standbys": [ 2024-09-19T04:59:56.299 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.299 INFO:teuthology.orchestra.run.smithi002.stdout: "gid": 24764, 2024-09-19T04:59:56.299 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "y", 2024-09-19T04:59:56.299 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_features": 4540701547738038271, 2024-09-19T04:59:56.299 INFO:teuthology.orchestra.run.smithi002.stdout: "available_modules": [ 2024-09-19T04:59:56.299 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.299 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "alerts", 2024-09-19T04:59:56.299 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:56.299 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:56.299 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:56.299 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-19T04:59:56.299 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-19T04:59:56.299 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:56.299 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.300 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.300 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-19T04:59:56.300 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.300 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.300 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.300 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T04:59:56.300 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.300 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.300 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.300 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.300 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:56.300 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:56.301 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.301 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.301 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.301 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.301 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.301 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.301 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.301 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.301 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.301 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.301 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.301 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.301 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.302 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.302 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.302 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.302 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.302 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.302 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.302 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:56.302 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:56.302 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.302 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.302 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.302 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.303 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.303 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.303 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.303 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.303 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.303 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.303 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.303 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.303 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:56.303 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:56.303 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.303 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.303 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.304 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:56.304 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.304 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.304 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.304 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.304 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.304 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.304 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.304 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.304 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.304 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.304 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.304 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.305 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.305 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.305 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.305 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:56.305 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:56.305 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.305 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.305 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.305 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.305 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.305 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.305 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.305 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.306 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.306 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.306 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.306 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.306 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_destination": { 2024-09-19T04:59:56.306 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_destination", 2024-09-19T04:59:56.306 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.306 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.306 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.306 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.306 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.306 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.306 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.306 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Email address to send alerts to", 2024-09-19T04:59:56.307 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.307 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.307 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.307 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.307 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_from_name": { 2024-09-19T04:59:56.307 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_from_name", 2024-09-19T04:59:56.307 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.307 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.307 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.307 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "Ceph", 2024-09-19T04:59:56.307 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.307 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.307 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.308 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Email From: name", 2024-09-19T04:59:56.308 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.308 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.308 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.308 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.308 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_host": { 2024-09-19T04:59:56.308 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_host", 2024-09-19T04:59:56.308 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.308 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.308 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.308 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.308 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.308 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.309 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.309 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP server", 2024-09-19T04:59:56.309 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.309 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.309 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.309 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.309 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_password": { 2024-09-19T04:59:56.309 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_password", 2024-09-19T04:59:56.309 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.309 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.309 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.309 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.309 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.309 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.310 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.310 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Password to authenticate with", 2024-09-19T04:59:56.310 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.310 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.310 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.310 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.310 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_port": { 2024-09-19T04:59:56.310 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_port", 2024-09-19T04:59:56.310 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.310 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.310 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.310 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "465", 2024-09-19T04:59:56.310 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.311 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.311 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.311 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP port", 2024-09-19T04:59:56.311 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.311 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.311 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.311 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.311 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_sender": { 2024-09-19T04:59:56.311 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_sender", 2024-09-19T04:59:56.311 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.311 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.311 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.311 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.311 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.312 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.312 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.312 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP envelope sender", 2024-09-19T04:59:56.312 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.312 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.312 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.312 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.312 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_ssl": { 2024-09-19T04:59:56.312 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_ssl", 2024-09-19T04:59:56.312 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.312 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.312 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.313 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.313 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.313 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.313 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.313 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T04:59:56.313 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.313 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.313 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.313 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.313 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_user": { 2024-09-19T04:59:56.313 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_user", 2024-09-19T04:59:56.313 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.313 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.314 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.314 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.314 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.314 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.314 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.314 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "User to authenticate as", 2024-09-19T04:59:56.314 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.314 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.314 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.314 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.314 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.314 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.315 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.315 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "balancer", 2024-09-19T04:59:56.315 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:56.315 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:56.315 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:56.315 INFO:teuthology.orchestra.run.smithi002.stdout: "active": { 2024-09-19T04:59:56.315 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "active", 2024-09-19T04:59:56.315 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.315 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.315 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.315 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.315 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.315 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.316 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.316 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T04:59:56.316 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.316 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.316 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.316 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.316 INFO:teuthology.orchestra.run.smithi002.stdout: "begin_time": { 2024-09-19T04:59:56.316 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "begin_time", 2024-09-19T04:59:56.316 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.316 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.316 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.316 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0000", 2024-09-19T04:59:56.317 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.317 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.317 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.317 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T04:59:56.317 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T04:59:56.317 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.317 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.317 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.317 INFO:teuthology.orchestra.run.smithi002.stdout: "begin_weekday": { 2024-09-19T04:59:56.317 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "begin_weekday", 2024-09-19T04:59:56.317 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-19T04:59:56.317 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.317 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.318 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-19T04:59:56.318 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0", 2024-09-19T04:59:56.318 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "6", 2024-09-19T04:59:56.318 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.318 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T04:59:56.318 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T04:59:56.318 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.318 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.318 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.318 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_max_iterations": { 2024-09-19T04:59:56.318 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_max_iterations", 2024-09-19T04:59:56.318 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-19T04:59:56.318 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.319 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.319 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "25", 2024-09-19T04:59:56.319 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-19T04:59:56.319 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "250", 2024-09-19T04:59:56.319 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.319 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T04:59:56.319 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.319 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.319 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.319 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.319 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_metrics": { 2024-09-19T04:59:56.319 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_metrics", 2024-09-19T04:59:56.319 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.319 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.320 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.320 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T04:59:56.320 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.320 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.320 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.320 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T04:59:56.320 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T04:59:56.320 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.320 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.320 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.320 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_step": { 2024-09-19T04:59:56.320 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_step", 2024-09-19T04:59:56.320 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-19T04:59:56.321 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.321 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.321 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0.5", 2024-09-19T04:59:56.321 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0.001", 2024-09-19T04:59:56.321 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "0.999", 2024-09-19T04:59:56.321 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.321 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "aggressiveness of optimization", 2024-09-19T04:59:56.321 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T04:59:56.321 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.321 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.321 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.321 INFO:teuthology.orchestra.run.smithi002.stdout: "end_time": { 2024-09-19T04:59:56.321 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "end_time", 2024-09-19T04:59:56.322 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.322 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.322 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.322 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "2359", 2024-09-19T04:59:56.322 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.322 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.322 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.322 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T04:59:56.322 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T04:59:56.322 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.322 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.322 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.322 INFO:teuthology.orchestra.run.smithi002.stdout: "end_weekday": { 2024-09-19T04:59:56.323 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "end_weekday", 2024-09-19T04:59:56.323 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-19T04:59:56.323 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.323 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.323 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-19T04:59:56.323 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0", 2024-09-19T04:59:56.323 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "6", 2024-09-19T04:59:56.323 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.323 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T04:59:56.323 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T04:59:56.323 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.323 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.323 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.324 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:56.324 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:56.324 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.324 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.324 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.324 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.324 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.324 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.324 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.324 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.324 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.324 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.324 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.325 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.325 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.325 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.325 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.325 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.325 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.325 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.325 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.325 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:56.325 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:56.325 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.325 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.325 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.325 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.326 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.326 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.326 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.326 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.326 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.326 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.326 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.326 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.326 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:56.326 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:56.326 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.326 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.327 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.327 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:56.327 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.327 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.327 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.327 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.327 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.327 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.327 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.327 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.327 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.327 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.327 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.328 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.328 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.328 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.328 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.328 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:56.328 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:56.328 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.328 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.328 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.328 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.328 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.328 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.329 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.329 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.329 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.329 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.329 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.329 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.329 INFO:teuthology.orchestra.run.smithi002.stdout: "min_score": { 2024-09-19T04:59:56.329 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "min_score", 2024-09-19T04:59:56.329 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-19T04:59:56.329 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.329 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.329 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-19T04:59:56.329 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.329 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.330 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.330 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T04:59:56.330 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.330 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.330 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.330 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.330 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": { 2024-09-19T04:59:56.330 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mode", 2024-09-19T04:59:56.330 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.330 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.330 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.330 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "upmap", 2024-09-19T04:59:56.330 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.331 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.331 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.331 INFO:teuthology.orchestra.run.smithi002.stdout: "crush-compat", 2024-09-19T04:59:56.331 INFO:teuthology.orchestra.run.smithi002.stdout: "none", 2024-09-19T04:59:56.331 INFO:teuthology.orchestra.run.smithi002.stdout: "read", 2024-09-19T04:59:56.331 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap", 2024-09-19T04:59:56.331 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap-read" 2024-09-19T04:59:56.331 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.331 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Balancer mode", 2024-09-19T04:59:56.331 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.331 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.331 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.331 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.331 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_ids": { 2024-09-19T04:59:56.332 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pool_ids", 2024-09-19T04:59:56.332 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.332 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.332 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.332 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.332 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.332 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.332 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.332 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T04:59:56.332 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.332 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.332 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.332 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.333 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-19T04:59:56.333 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-19T04:59:56.333 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:56.333 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.333 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.333 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-19T04:59:56.333 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.333 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.333 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.333 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T04:59:56.333 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.333 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.333 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.334 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.334 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap_max_deviation": { 2024-09-19T04:59:56.334 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "upmap_max_deviation", 2024-09-19T04:59:56.334 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.334 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.334 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.334 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-19T04:59:56.334 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-19T04:59:56.334 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.334 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.334 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T04:59:56.334 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T04:59:56.334 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.335 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.335 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.335 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap_max_optimizations": { 2024-09-19T04:59:56.335 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "upmap_max_optimizations", 2024-09-19T04:59:56.335 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-19T04:59:56.335 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.335 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.335 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-19T04:59:56.335 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.335 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.335 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.335 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T04:59:56.335 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.336 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.336 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.336 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.336 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.336 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.336 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.336 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephadm", 2024-09-19T04:59:56.336 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:56.336 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:56.336 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:56.336 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_down_multiplier": { 2024-09-19T04:59:56.336 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_down_multiplier", 2024-09-19T04:59:56.336 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-19T04:59:56.337 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.337 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.337 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3.0", 2024-09-19T04:59:56.337 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.337 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.337 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.337 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T04:59:56.337 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.337 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.337 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.337 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.337 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_refresh_rate": { 2024-09-19T04:59:56.337 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_refresh_rate", 2024-09-19T04:59:56.337 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:56.338 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.338 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.338 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "20", 2024-09-19T04:59:56.338 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.338 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.338 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.338 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T04:59:56.338 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.338 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.338 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.338 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.338 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_starting_port": { 2024-09-19T04:59:56.338 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_starting_port", 2024-09-19T04:59:56.339 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.339 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.339 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.339 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "4721", 2024-09-19T04:59:56.339 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.339 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.339 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.339 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T04:59:56.339 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.339 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.339 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.339 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.340 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_ptrace": { 2024-09-19T04:59:56.340 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_ptrace", 2024-09-19T04:59:56.340 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.340 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.340 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.340 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.340 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.340 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.340 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.340 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T04:59:56.340 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T04:59:56.340 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.340 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.341 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.341 INFO:teuthology.orchestra.run.smithi002.stdout: "autotune_interval": { 2024-09-19T04:59:56.341 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "autotune_interval", 2024-09-19T04:59:56.341 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:56.341 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.341 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.341 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-19T04:59:56.341 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.341 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.341 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.341 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T04:59:56.341 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.341 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.342 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.342 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.342 INFO:teuthology.orchestra.run.smithi002.stdout: "autotune_memory_target_ratio": { 2024-09-19T04:59:56.342 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T04:59:56.342 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-19T04:59:56.342 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.342 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.342 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0.7", 2024-09-19T04:59:56.342 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.342 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.342 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.342 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T04:59:56.343 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.343 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.343 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.343 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.343 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm_log_destination": { 2024-09-19T04:59:56.343 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephadm_log_destination", 2024-09-19T04:59:56.343 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.343 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.343 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.343 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.343 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.343 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.343 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.344 INFO:teuthology.orchestra.run.smithi002.stdout: "file", 2024-09-19T04:59:56.344 INFO:teuthology.orchestra.run.smithi002.stdout: "file,syslog", 2024-09-19T04:59:56.344 INFO:teuthology.orchestra.run.smithi002.stdout: "syslog" 2024-09-19T04:59:56.344 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.344 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T04:59:56.344 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.344 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.344 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.344 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.344 INFO:teuthology.orchestra.run.smithi002.stdout: "cgroups_split": { 2024-09-19T04:59:56.344 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cgroups_split", 2024-09-19T04:59:56.344 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.344 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.345 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.345 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.345 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.345 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.345 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.345 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T04:59:56.345 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.345 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.345 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.345 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.345 INFO:teuthology.orchestra.run.smithi002.stdout: "config_checks_enabled": { 2024-09-19T04:59:56.345 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_checks_enabled", 2024-09-19T04:59:56.346 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.346 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.346 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.346 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.346 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.346 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.346 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.346 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T04:59:56.346 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.346 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.346 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.346 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.346 INFO:teuthology.orchestra.run.smithi002.stdout: "config_dashboard": { 2024-09-19T04:59:56.347 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_dashboard", 2024-09-19T04:59:56.347 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.347 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.347 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.347 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.347 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.347 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.347 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.347 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T04:59:56.347 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.347 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.347 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.347 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.347 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_alertmanager": { 2024-09-19T04:59:56.348 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_alertmanager", 2024-09-19T04:59:56.348 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.348 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.348 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.348 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T04:59:56.348 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.348 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.348 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.348 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-19T04:59:56.348 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.348 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.348 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.348 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.349 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_base": { 2024-09-19T04:59:56.349 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_base", 2024-09-19T04:59:56.349 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.349 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.349 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.349 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T04:59:56.349 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.349 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.349 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.349 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Container image name, without the tag", 2024-09-19T04:59:56.349 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.349 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.349 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.350 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.350 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_elasticsearch": { 2024-09-19T04:59:56.350 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_elasticsearch", 2024-09-19T04:59:56.350 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.350 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.350 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.350 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T04:59:56.350 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.350 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.350 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.350 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "elasticsearch container image", 2024-09-19T04:59:56.350 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.350 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.350 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.351 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.351 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_grafana": { 2024-09-19T04:59:56.351 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_grafana", 2024-09-19T04:59:56.351 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.351 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.351 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.351 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T04:59:56.351 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.351 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.351 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.351 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-19T04:59:56.351 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.351 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.352 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.352 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.352 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_haproxy": { 2024-09-19T04:59:56.352 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_haproxy", 2024-09-19T04:59:56.352 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.352 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.352 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.352 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T04:59:56.352 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.352 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.352 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.353 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "HAproxy container image", 2024-09-19T04:59:56.353 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.353 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.353 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.353 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.353 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_agent": { 2024-09-19T04:59:56.353 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_agent", 2024-09-19T04:59:56.353 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.353 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.353 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.353 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T04:59:56.353 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.353 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.354 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.354 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger agent container image", 2024-09-19T04:59:56.354 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.354 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.354 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.354 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.354 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_collector": { 2024-09-19T04:59:56.354 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_collector", 2024-09-19T04:59:56.354 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.354 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.354 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.354 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T04:59:56.355 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.355 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.355 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.355 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger collector container image", 2024-09-19T04:59:56.355 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.355 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.355 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.355 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.355 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_query": { 2024-09-19T04:59:56.355 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_query", 2024-09-19T04:59:56.355 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.355 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.355 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.356 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T04:59:56.356 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.356 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.356 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.356 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger query container image", 2024-09-19T04:59:56.356 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.356 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.356 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.356 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.356 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_keepalived": { 2024-09-19T04:59:56.356 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_keepalived", 2024-09-19T04:59:56.356 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.357 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.357 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.357 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T04:59:56.357 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.357 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.357 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.357 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Keepalived container image", 2024-09-19T04:59:56.357 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.357 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.357 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.357 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.357 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_loki": { 2024-09-19T04:59:56.358 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_loki", 2024-09-19T04:59:56.358 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.358 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.358 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.358 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T04:59:56.358 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.358 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.358 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.358 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Loki container image", 2024-09-19T04:59:56.358 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.358 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.358 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.358 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.359 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_node_exporter": { 2024-09-19T04:59:56.359 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_node_exporter", 2024-09-19T04:59:56.359 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.359 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.359 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.359 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T04:59:56.359 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.359 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.359 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.359 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-19T04:59:56.359 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.359 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.359 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.360 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.360 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_nvmeof": { 2024-09-19T04:59:56.360 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_nvmeof", 2024-09-19T04:59:56.360 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.360 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.360 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.360 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T04:59:56.360 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.360 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.360 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.360 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Nvme-of container image", 2024-09-19T04:59:56.360 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.360 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.360 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.361 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.361 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_prometheus": { 2024-09-19T04:59:56.361 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_prometheus", 2024-09-19T04:59:56.361 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.361 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.361 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.361 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T04:59:56.361 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.361 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.361 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.361 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-19T04:59:56.362 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.362 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.362 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.362 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.362 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_promtail": { 2024-09-19T04:59:56.362 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_promtail", 2024-09-19T04:59:56.362 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.362 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.362 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.362 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T04:59:56.362 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.362 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.362 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.363 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Promtail container image", 2024-09-19T04:59:56.363 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.363 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.363 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.363 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.363 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_samba": { 2024-09-19T04:59:56.363 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_samba", 2024-09-19T04:59:56.363 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.363 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.363 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.363 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T04:59:56.363 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.363 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.364 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.364 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Samba/SMB container image", 2024-09-19T04:59:56.364 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.364 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.364 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.364 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.364 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_snmp_gateway": { 2024-09-19T04:59:56.364 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_snmp_gateway", 2024-09-19T04:59:56.364 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.364 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.364 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.364 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T04:59:56.364 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.365 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.365 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.365 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SNMP Gateway container image", 2024-09-19T04:59:56.365 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.365 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.365 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.365 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.365 INFO:teuthology.orchestra.run.smithi002.stdout: "container_init": { 2024-09-19T04:59:56.365 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_init", 2024-09-19T04:59:56.365 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.365 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.365 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.365 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.365 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.366 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.366 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.366 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T04:59:56.366 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.366 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.366 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.366 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.366 INFO:teuthology.orchestra.run.smithi002.stdout: "daemon_cache_timeout": { 2024-09-19T04:59:56.366 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "daemon_cache_timeout", 2024-09-19T04:59:56.366 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:56.366 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.366 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.366 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-19T04:59:56.367 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.367 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.367 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.367 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T04:59:56.367 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.367 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.367 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.367 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.367 INFO:teuthology.orchestra.run.smithi002.stdout: "default_cephadm_command_timeout": { 2024-09-19T04:59:56.367 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T04:59:56.367 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.367 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.367 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.368 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "900", 2024-09-19T04:59:56.368 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.368 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.368 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.368 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T04:59:56.368 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.368 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.368 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.368 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.368 INFO:teuthology.orchestra.run.smithi002.stdout: "default_registry": { 2024-09-19T04:59:56.368 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "default_registry", 2024-09-19T04:59:56.368 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.368 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.369 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.369 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io", 2024-09-19T04:59:56.369 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.369 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.369 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.369 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T04:59:56.369 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.369 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.369 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.369 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.369 INFO:teuthology.orchestra.run.smithi002.stdout: "device_cache_timeout": { 2024-09-19T04:59:56.369 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_cache_timeout", 2024-09-19T04:59:56.369 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:56.369 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.370 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.370 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1800", 2024-09-19T04:59:56.370 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.370 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.370 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.370 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache device inventory", 2024-09-19T04:59:56.370 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.370 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.370 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.370 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.371 INFO:teuthology.orchestra.run.smithi002.stdout: "device_enhanced_scan": { 2024-09-19T04:59:56.371 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_enhanced_scan", 2024-09-19T04:59:56.371 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.371 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.371 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.371 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.371 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.371 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.371 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.371 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T04:59:56.371 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.371 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.371 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.371 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.372 INFO:teuthology.orchestra.run.smithi002.stdout: "facts_cache_timeout": { 2024-09-19T04:59:56.372 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "facts_cache_timeout", 2024-09-19T04:59:56.372 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:56.372 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.372 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.372 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-19T04:59:56.372 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.372 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.372 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.372 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache host facts data", 2024-09-19T04:59:56.372 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.372 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.372 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.373 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.373 INFO:teuthology.orchestra.run.smithi002.stdout: "grafana_dashboards_path": { 2024-09-19T04:59:56.373 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "grafana_dashboards_path", 2024-09-19T04:59:56.373 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.373 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.373 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.373 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T04:59:56.373 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.373 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.373 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.373 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T04:59:56.373 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.373 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.374 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.374 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.374 INFO:teuthology.orchestra.run.smithi002.stdout: "host_check_interval": { 2024-09-19T04:59:56.374 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "host_check_interval", 2024-09-19T04:59:56.374 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:56.374 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.374 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.374 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-19T04:59:56.374 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.374 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.374 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.374 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to perform a host check", 2024-09-19T04:59:56.374 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.374 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.375 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.375 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.375 INFO:teuthology.orchestra.run.smithi002.stdout: "hw_monitoring": { 2024-09-19T04:59:56.375 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "hw_monitoring", 2024-09-19T04:59:56.375 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.375 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.375 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.375 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.375 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.375 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.375 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.375 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T04:59:56.375 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.375 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.376 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.376 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.376 INFO:teuthology.orchestra.run.smithi002.stdout: "inventory_list_all": { 2024-09-19T04:59:56.376 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "inventory_list_all", 2024-09-19T04:59:56.376 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.376 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.376 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.376 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.376 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.376 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.376 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.376 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T04:59:56.376 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.377 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.377 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.377 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.377 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:56.377 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:56.377 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.377 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.377 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.377 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.377 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.377 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.377 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.377 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.378 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.378 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.378 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.378 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.378 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.378 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.378 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.378 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.378 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.378 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.378 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.378 INFO:teuthology.orchestra.run.smithi002.stdout: "log_refresh_metadata": { 2024-09-19T04:59:56.378 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_refresh_metadata", 2024-09-19T04:59:56.379 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.379 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.379 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.379 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.379 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.379 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.379 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.379 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T04:59:56.379 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.379 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.379 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.379 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.380 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:56.380 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:56.380 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.380 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.380 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.380 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.380 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.380 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.380 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.380 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T04:59:56.380 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.380 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.380 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.381 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.381 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:56.381 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:56.381 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.381 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.381 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.381 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:56.381 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.381 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.381 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.381 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.381 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.381 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.382 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.382 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.382 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.382 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.382 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.382 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.382 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.382 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.382 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.382 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:56.382 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:56.382 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.383 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.383 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.383 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.383 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.383 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.383 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.383 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.383 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.383 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.383 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.383 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.383 INFO:teuthology.orchestra.run.smithi002.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T04:59:56.383 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T04:59:56.384 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.384 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.384 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.384 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.384 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.384 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.384 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.384 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T04:59:56.384 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.384 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.384 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.384 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.384 INFO:teuthology.orchestra.run.smithi002.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T04:59:56.385 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T04:59:56.385 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.385 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.385 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.385 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "*", 2024-09-19T04:59:56.385 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.385 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.385 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.385 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T04:59:56.385 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.385 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.385 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.385 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.386 INFO:teuthology.orchestra.run.smithi002.stdout: "max_count_per_host": { 2024-09-19T04:59:56.386 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_count_per_host", 2024-09-19T04:59:56.386 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.386 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.386 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.386 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-19T04:59:56.386 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.386 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.386 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.386 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "max number of daemons per service per host", 2024-09-19T04:59:56.386 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.386 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.386 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.386 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.387 INFO:teuthology.orchestra.run.smithi002.stdout: "max_osd_draining_count": { 2024-09-19T04:59:56.387 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_osd_draining_count", 2024-09-19T04:59:56.387 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.387 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.387 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.387 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-19T04:59:56.387 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.387 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.387 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.387 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T04:59:56.387 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.387 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.387 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.387 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.387 INFO:teuthology.orchestra.run.smithi002.stdout: "migration_current": { 2024-09-19T04:59:56.388 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "migration_current", 2024-09-19T04:59:56.388 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.388 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.388 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.388 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.388 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.388 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.388 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.388 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "internal - do not modify", 2024-09-19T04:59:56.388 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.388 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.388 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.388 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.389 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": { 2024-09-19T04:59:56.389 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mode", 2024-09-19T04:59:56.389 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.389 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.389 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.389 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "root", 2024-09-19T04:59:56.389 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.389 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.389 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.389 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm-package", 2024-09-19T04:59:56.389 INFO:teuthology.orchestra.run.smithi002.stdout: "root" 2024-09-19T04:59:56.389 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.389 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T04:59:56.390 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.390 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.390 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.390 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.390 INFO:teuthology.orchestra.run.smithi002.stdout: "oob_default_addr": { 2024-09-19T04:59:56.390 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "oob_default_addr", 2024-09-19T04:59:56.390 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.390 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.390 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.390 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "169.254.1.1", 2024-09-19T04:59:56.390 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.390 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.390 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.391 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T04:59:56.391 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.391 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.391 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.391 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.391 INFO:teuthology.orchestra.run.smithi002.stdout: "prometheus_alerts_path": { 2024-09-19T04:59:56.391 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prometheus_alerts_path", 2024-09-19T04:59:56.391 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.391 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.391 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.391 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T04:59:56.391 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.391 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.391 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.392 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T04:59:56.392 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.392 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.392 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.392 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.392 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_insecure": { 2024-09-19T04:59:56.392 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_insecure", 2024-09-19T04:59:56.392 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.392 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.392 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.392 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.392 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.393 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.393 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.393 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T04:59:56.393 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.393 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.393 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.393 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.393 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_password": { 2024-09-19T04:59:56.393 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_password", 2024-09-19T04:59:56.393 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.393 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.393 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.393 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.394 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.394 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.394 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.394 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T04:59:56.394 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.394 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.394 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.394 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.394 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_url": { 2024-09-19T04:59:56.394 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_url", 2024-09-19T04:59:56.394 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.394 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.394 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.394 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.395 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.395 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.395 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.395 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T04:59:56.395 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.395 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.395 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.395 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.395 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_username": { 2024-09-19T04:59:56.395 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_username", 2024-09-19T04:59:56.395 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.395 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.395 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.396 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.396 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.396 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.396 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.396 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T04:59:56.396 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.396 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.396 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.396 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.396 INFO:teuthology.orchestra.run.smithi002.stdout: "secure_monitoring_stack": { 2024-09-19T04:59:56.396 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "secure_monitoring_stack", 2024-09-19T04:59:56.396 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.396 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.396 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.397 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.397 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.397 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.397 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.397 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T04:59:56.397 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.397 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.397 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.397 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.397 INFO:teuthology.orchestra.run.smithi002.stdout: "service_discovery_port": { 2024-09-19T04:59:56.397 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "service_discovery_port", 2024-09-19T04:59:56.397 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.397 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.398 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.398 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8765", 2024-09-19T04:59:56.398 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.398 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.398 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.398 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "cephadm service discovery port", 2024-09-19T04:59:56.398 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.398 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.398 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.398 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.398 INFO:teuthology.orchestra.run.smithi002.stdout: "ssh_config_file": { 2024-09-19T04:59:56.398 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssh_config_file", 2024-09-19T04:59:56.398 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.399 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.399 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.399 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.399 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.399 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.399 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.399 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T04:59:56.399 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.399 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.399 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.399 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.399 INFO:teuthology.orchestra.run.smithi002.stdout: "use_agent": { 2024-09-19T04:59:56.399 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "use_agent", 2024-09-19T04:59:56.399 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.400 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.400 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.400 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.400 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.400 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.400 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.400 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T04:59:56.400 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.400 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.400 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.400 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.400 INFO:teuthology.orchestra.run.smithi002.stdout: "use_repo_digest": { 2024-09-19T04:59:56.400 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "use_repo_digest", 2024-09-19T04:59:56.400 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.401 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.401 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.401 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.401 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.401 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.401 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.401 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T04:59:56.401 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.401 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.401 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.401 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.401 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_failed_host_check": { 2024-09-19T04:59:56.401 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_failed_host_check", 2024-09-19T04:59:56.402 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.402 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.402 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.402 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.402 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.402 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.402 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.402 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T04:59:56.402 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.402 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.402 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.402 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.402 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_stray_daemons": { 2024-09-19T04:59:56.402 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_stray_daemons", 2024-09-19T04:59:56.403 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.403 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.403 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.403 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.403 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.403 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.403 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.403 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T04:59:56.403 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.403 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.403 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.403 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.403 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_stray_hosts": { 2024-09-19T04:59:56.403 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_stray_hosts", 2024-09-19T04:59:56.404 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.404 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.404 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.404 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.404 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.404 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.404 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.404 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T04:59:56.404 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.404 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.404 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.404 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.404 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.405 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.405 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.405 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crash", 2024-09-19T04:59:56.405 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:56.405 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:56.405 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:56.405 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:56.405 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:56.405 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.405 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.405 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.405 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.406 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.406 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.406 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.406 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.406 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.406 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.406 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.406 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.406 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.406 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.406 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.406 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.406 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.406 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.407 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.407 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:56.407 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:56.407 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.407 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.407 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.407 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.407 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.407 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.407 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.407 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.407 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.407 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.408 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.408 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.408 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:56.408 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:56.408 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.408 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.408 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.408 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:56.408 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.408 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.408 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.408 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.408 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.408 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.409 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.409 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.409 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.409 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.409 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.409 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.409 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.409 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.409 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.409 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:56.409 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:56.409 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.409 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.410 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.410 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.410 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.410 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.410 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.410 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.410 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.410 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.410 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.410 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.410 INFO:teuthology.orchestra.run.smithi002.stdout: "retain_interval": { 2024-09-19T04:59:56.410 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "retain_interval", 2024-09-19T04:59:56.410 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:56.411 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.411 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.411 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "31536000", 2024-09-19T04:59:56.411 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.411 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.411 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.411 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T04:59:56.411 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.411 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.411 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.411 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.411 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_recent_interval": { 2024-09-19T04:59:56.411 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_recent_interval", 2024-09-19T04:59:56.411 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:56.412 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.412 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.412 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1209600", 2024-09-19T04:59:56.412 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.412 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.412 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.412 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T04:59:56.412 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.412 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.412 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.412 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.412 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.412 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.413 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.413 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "dashboard", 2024-09-19T04:59:56.413 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:56.413 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:56.413 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:56.413 INFO:teuthology.orchestra.run.smithi002.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T04:59:56.413 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T04:59:56.413 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.413 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.413 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.413 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-19T04:59:56.413 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.413 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.414 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.414 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.414 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.414 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.414 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.414 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.414 INFO:teuthology.orchestra.run.smithi002.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T04:59:56.414 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T04:59:56.414 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.414 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.414 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.414 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.414 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.415 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.415 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.415 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.415 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.415 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.415 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.415 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.415 INFO:teuthology.orchestra.run.smithi002.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T04:59:56.415 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T04:59:56.415 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.415 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.415 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.415 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.415 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.416 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.416 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.416 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.416 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.416 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.416 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.416 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.416 INFO:teuthology.orchestra.run.smithi002.stdout: "AUDIT_API_ENABLED": { 2024-09-19T04:59:56.416 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T04:59:56.416 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.416 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.416 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.416 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.417 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.417 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.417 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.417 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.417 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.417 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.417 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.417 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.417 INFO:teuthology.orchestra.run.smithi002.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T04:59:56.417 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T04:59:56.417 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.417 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.417 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.418 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.418 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.418 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.418 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.418 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.418 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.418 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.418 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.418 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.418 INFO:teuthology.orchestra.run.smithi002.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T04:59:56.418 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T04:59:56.418 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.418 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.418 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.419 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.419 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.419 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.419 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.419 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.419 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.419 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.419 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.419 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.419 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T04:59:56.419 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T04:59:56.419 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.419 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.420 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.420 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.420 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.420 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.420 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.420 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.420 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.420 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.420 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.420 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.420 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T04:59:56.420 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T04:59:56.420 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.421 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.421 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.421 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.421 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.421 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.421 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.421 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.421 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.421 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.421 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.421 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.421 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T04:59:56.421 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T04:59:56.422 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.422 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.422 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.422 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.422 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.422 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.422 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.422 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.422 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.422 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.422 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.422 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.422 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T04:59:56.422 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T04:59:56.423 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.423 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.423 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.423 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.423 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.423 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.423 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.423 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.423 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.423 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.423 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.423 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.423 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T04:59:56.423 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T04:59:56.424 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.424 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.424 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.424 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.424 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.424 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.424 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.424 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.424 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.424 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.424 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.424 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.424 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T04:59:56.425 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T04:59:56.425 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.425 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.425 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.425 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.425 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.425 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.425 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.425 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.425 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.425 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.425 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.425 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.426 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T04:59:56.426 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T04:59:56.426 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.426 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.426 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.426 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.426 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.426 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.426 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.426 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.426 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.426 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.426 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.427 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.427 INFO:teuthology.orchestra.run.smithi002.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T04:59:56.427 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T04:59:56.427 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.427 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.427 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.427 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.427 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.427 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.427 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.427 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.427 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.427 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.428 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.428 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.428 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T04:59:56.428 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T04:59:56.428 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.428 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.428 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.428 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-09-19T04:59:56.428 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.428 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.428 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.428 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.428 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.428 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.429 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.429 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.429 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T04:59:56.429 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T04:59:56.429 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.429 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.429 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.429 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.429 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.429 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.429 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.429 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.429 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.430 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.430 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.430 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.430 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_URL": { 2024-09-19T04:59:56.430 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_URL", 2024-09-19T04:59:56.430 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.430 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.430 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.430 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.430 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.430 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.430 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.430 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.430 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.431 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.431 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.431 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.431 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T04:59:56.431 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T04:59:56.431 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.431 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.431 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.431 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-09-19T04:59:56.431 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.431 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.431 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.431 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.431 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.432 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.432 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.432 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.432 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T04:59:56.432 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T04:59:56.432 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.432 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.432 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.432 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.432 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.432 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.432 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.432 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.433 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.433 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.433 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.433 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.433 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T04:59:56.433 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T04:59:56.433 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.433 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.433 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.433 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.433 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.433 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.434 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.434 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.434 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.434 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.434 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.434 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.434 INFO:teuthology.orchestra.run.smithi002.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T04:59:56.434 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T04:59:56.434 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.434 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.434 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.434 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.434 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.435 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.435 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.435 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.435 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.435 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.435 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.435 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.435 INFO:teuthology.orchestra.run.smithi002.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T04:59:56.435 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T04:59:56.435 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.435 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.435 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.435 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.436 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.436 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.436 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.436 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.436 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.436 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.436 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.436 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.436 INFO:teuthology.orchestra.run.smithi002.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T04:59:56.436 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T04:59:56.436 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.436 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.436 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.437 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.437 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.437 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.437 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.437 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.437 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.437 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.437 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.437 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.437 INFO:teuthology.orchestra.run.smithi002.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T04:59:56.437 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T04:59:56.437 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.437 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.438 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.438 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.438 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.438 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.438 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.438 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.438 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.438 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.438 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.438 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.438 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T04:59:56.438 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T04:59:56.438 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.438 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.439 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.439 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.439 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.439 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.439 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.439 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.439 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.439 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.439 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.439 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.439 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T04:59:56.439 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T04:59:56.439 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.440 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.440 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.440 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.440 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.440 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.440 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.440 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.440 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.440 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.440 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.440 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.440 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T04:59:56.440 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T04:59:56.441 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.441 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.441 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.441 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.441 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.441 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.441 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.441 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.441 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.441 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.441 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.441 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.441 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T04:59:56.442 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T04:59:56.442 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.442 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.442 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.442 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.442 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.442 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.442 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.442 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.442 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.442 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.442 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.443 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.443 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T04:59:56.443 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T04:59:56.443 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.443 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.443 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.443 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.443 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.443 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.443 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.443 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.443 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.443 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.444 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.444 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.444 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T04:59:56.444 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T04:59:56.444 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.444 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.444 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.444 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.444 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.444 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.444 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.444 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.444 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.445 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.445 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.445 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.445 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T04:59:56.445 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T04:59:56.445 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.445 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.445 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.445 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.445 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.445 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.445 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.445 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.446 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.446 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.446 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.446 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.446 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T04:59:56.446 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T04:59:56.446 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.446 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.446 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.446 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.446 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.446 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.446 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.446 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.447 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.447 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.447 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.447 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.447 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T04:59:56.447 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T04:59:56.447 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.447 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.447 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.447 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T04:59:56.447 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.447 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.448 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.448 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.448 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.448 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.448 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.448 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.448 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T04:59:56.448 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T04:59:56.448 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.448 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.448 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.448 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-19T04:59:56.448 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.448 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.449 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.449 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.449 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.449 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.449 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.449 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.449 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T04:59:56.449 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T04:59:56.449 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.449 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.449 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.449 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8", 2024-09-19T04:59:56.449 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.449 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.450 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.450 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.450 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.450 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.450 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.450 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.450 INFO:teuthology.orchestra.run.smithi002.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T04:59:56.450 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T04:59:56.450 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.450 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.450 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.450 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "45", 2024-09-19T04:59:56.450 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.450 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.451 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.451 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.451 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.451 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.451 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.451 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.451 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T04:59:56.451 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T04:59:56.451 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.451 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.451 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.451 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.451 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.451 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.452 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.452 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.452 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.452 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.452 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.452 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.452 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T04:59:56.452 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T04:59:56.452 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.452 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.452 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.452 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-09-19T04:59:56.452 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.453 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.453 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.453 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.453 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.453 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.453 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.453 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.453 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T04:59:56.453 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T04:59:56.453 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.453 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.453 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.453 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.454 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.454 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.454 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.454 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.454 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.454 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.454 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.454 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.454 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T04:59:56.454 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T04:59:56.454 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.454 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.454 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.454 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.455 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.455 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.455 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.455 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.455 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.455 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.455 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.455 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.455 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T04:59:56.455 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T04:59:56.455 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.455 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.455 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.455 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-19T04:59:56.456 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.456 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.456 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.456 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.456 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.456 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.456 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.456 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.456 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T04:59:56.456 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T04:59:56.456 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.456 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.456 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.457 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-19T04:59:56.457 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.457 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.457 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.457 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.457 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.457 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.457 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.457 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.457 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T04:59:56.457 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T04:59:56.457 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.457 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.458 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.458 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-19T04:59:56.458 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.458 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.458 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.458 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.458 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.458 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.458 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.458 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.458 INFO:teuthology.orchestra.run.smithi002.stdout: "cross_origin_url": { 2024-09-19T04:59:56.458 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cross_origin_url", 2024-09-19T04:59:56.458 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.458 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.459 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.459 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.459 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.459 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.459 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.459 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.459 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.459 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.459 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.459 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.459 INFO:teuthology.orchestra.run.smithi002.stdout: "crt_file": { 2024-09-19T04:59:56.459 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crt_file", 2024-09-19T04:59:56.459 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.459 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.459 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.460 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.460 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.460 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.460 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.460 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.460 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.460 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.460 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.460 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.460 INFO:teuthology.orchestra.run.smithi002.stdout: "debug": { 2024-09-19T04:59:56.460 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "debug", 2024-09-19T04:59:56.460 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.461 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.461 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.461 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.461 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.461 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.461 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.461 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable/disable debug options", 2024-09-19T04:59:56.461 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.461 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.461 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.461 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.461 INFO:teuthology.orchestra.run.smithi002.stdout: "jwt_token_ttl": { 2024-09-19T04:59:56.461 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "jwt_token_ttl", 2024-09-19T04:59:56.462 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.462 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.462 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.462 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "28800", 2024-09-19T04:59:56.462 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.462 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.462 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.462 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.462 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.462 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.462 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.462 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.462 INFO:teuthology.orchestra.run.smithi002.stdout: "key_file": { 2024-09-19T04:59:56.463 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "key_file", 2024-09-19T04:59:56.463 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.463 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.463 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.463 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.463 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.463 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.463 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.463 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.463 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.463 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.463 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.463 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.463 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:56.464 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:56.464 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.464 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.464 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.464 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.464 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.464 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.464 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.464 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.464 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.464 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.464 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.464 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.465 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.465 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.465 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.465 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.465 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.465 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.465 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.465 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:56.465 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:56.465 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.465 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.465 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.465 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.465 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.466 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.466 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.466 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.466 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.466 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.466 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.466 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.466 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:56.466 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:56.466 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.466 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.466 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.466 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:56.466 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.467 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.467 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.467 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.467 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.467 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.467 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.467 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.467 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.467 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.467 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.467 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.467 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.467 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.468 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.468 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:56.468 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:56.468 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.468 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.468 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.468 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.468 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.468 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.468 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.468 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.468 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.468 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.468 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.469 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.469 INFO:teuthology.orchestra.run.smithi002.stdout: "motd": { 2024-09-19T04:59:56.469 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "motd", 2024-09-19T04:59:56.469 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.469 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.469 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.469 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.469 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.469 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.469 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.469 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "The message of the day", 2024-09-19T04:59:56.469 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.469 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.470 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.470 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.470 INFO:teuthology.orchestra.run.smithi002.stdout: "redirect_resolve_ip_addr": { 2024-09-19T04:59:56.470 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T04:59:56.470 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.470 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.470 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.470 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.470 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.470 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.470 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.470 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.470 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.471 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.471 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.471 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.471 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-09-19T04:59:56.471 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-09-19T04:59:56.471 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.471 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.471 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.471 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "::", 2024-09-19T04:59:56.471 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.471 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.471 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.471 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.471 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.472 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.472 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.472 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.472 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-09-19T04:59:56.472 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-09-19T04:59:56.472 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.472 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.472 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.472 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8080", 2024-09-19T04:59:56.472 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.472 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.472 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.472 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.472 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.473 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.473 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.473 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.473 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl": { 2024-09-19T04:59:56.473 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl", 2024-09-19T04:59:56.473 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.473 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.473 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.473 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.473 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.473 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.473 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.474 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.474 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.474 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.474 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.474 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.474 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl_server_port": { 2024-09-19T04:59:56.474 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl_server_port", 2024-09-19T04:59:56.474 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.474 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.474 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.474 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8443", 2024-09-19T04:59:56.474 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.474 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.474 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.475 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.475 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.475 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.475 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.475 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.475 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_behaviour": { 2024-09-19T04:59:56.475 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_behaviour", 2024-09-19T04:59:56.475 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.475 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.475 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.475 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "redirect", 2024-09-19T04:59:56.475 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.475 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.476 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.476 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.476 INFO:teuthology.orchestra.run.smithi002.stdout: "redirect" 2024-09-19T04:59:56.476 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.476 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.476 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.476 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.476 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.476 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.476 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_error_status_code": { 2024-09-19T04:59:56.476 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_error_status_code", 2024-09-19T04:59:56.476 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.476 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.476 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.477 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-09-19T04:59:56.477 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "400", 2024-09-19T04:59:56.477 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "599", 2024-09-19T04:59:56.477 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.477 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.477 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.477 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.477 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.477 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.477 INFO:teuthology.orchestra.run.smithi002.stdout: "url_prefix": { 2024-09-19T04:59:56.477 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "url_prefix", 2024-09-19T04:59:56.477 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.477 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.478 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.478 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.478 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.478 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.478 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.478 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.478 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.478 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.478 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.478 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.478 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.478 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.478 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.478 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "devicehealth", 2024-09-19T04:59:56.479 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:56.479 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:56.479 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:56.479 INFO:teuthology.orchestra.run.smithi002.stdout: "enable_monitoring": { 2024-09-19T04:59:56.479 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enable_monitoring", 2024-09-19T04:59:56.479 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.479 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.479 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.479 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.479 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.479 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.479 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.479 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "monitor device health metrics", 2024-09-19T04:59:56.480 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.480 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.480 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.480 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.480 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:56.480 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:56.480 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.480 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.480 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.480 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.480 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.480 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.480 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.481 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.481 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.481 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.481 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.481 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.481 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.481 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.481 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.481 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.481 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.481 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.481 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.481 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:56.482 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:56.482 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.482 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.482 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.482 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.482 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.482 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.482 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.482 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.482 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.482 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.482 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.482 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.483 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:56.483 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:56.483 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.483 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.483 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.483 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:56.483 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.483 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.483 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.483 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.483 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.483 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.483 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.483 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.484 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.484 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.484 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.484 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.484 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.484 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.484 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.484 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:56.484 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:56.484 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.484 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.484 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.485 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.485 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.485 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.485 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.485 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.485 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.485 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.485 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.485 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.485 INFO:teuthology.orchestra.run.smithi002.stdout: "mark_out_threshold": { 2024-09-19T04:59:56.485 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mark_out_threshold", 2024-09-19T04:59:56.485 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:56.485 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.485 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.486 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "2419200", 2024-09-19T04:59:56.486 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.486 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.486 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.486 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T04:59:56.486 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.486 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.486 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.486 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.486 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": { 2024-09-19T04:59:56.486 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pool_name", 2024-09-19T04:59:56.486 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.486 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.487 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.487 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "device_health_metrics", 2024-09-19T04:59:56.487 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.487 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.487 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.487 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T04:59:56.487 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.487 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.487 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.487 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.487 INFO:teuthology.orchestra.run.smithi002.stdout: "retention_period": { 2024-09-19T04:59:56.487 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "retention_period", 2024-09-19T04:59:56.487 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:56.487 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.488 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.488 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15552000", 2024-09-19T04:59:56.488 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.488 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.488 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.488 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long to retain device health metrics", 2024-09-19T04:59:56.488 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.488 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.488 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.488 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.488 INFO:teuthology.orchestra.run.smithi002.stdout: "scrape_frequency": { 2024-09-19T04:59:56.488 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "scrape_frequency", 2024-09-19T04:59:56.488 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:56.488 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.489 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.489 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "86400", 2024-09-19T04:59:56.489 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.489 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.489 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.489 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T04:59:56.489 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.489 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.489 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.489 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.489 INFO:teuthology.orchestra.run.smithi002.stdout: "self_heal": { 2024-09-19T04:59:56.489 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "self_heal", 2024-09-19T04:59:56.490 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.490 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.490 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.490 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.490 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.490 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.490 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.490 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T04:59:56.490 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.490 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.490 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.490 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.490 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-19T04:59:56.491 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-19T04:59:56.491 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:56.491 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.491 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.491 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-19T04:59:56.491 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.491 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.491 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.491 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T04:59:56.491 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.491 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.491 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.491 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.491 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_threshold": { 2024-09-19T04:59:56.492 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_threshold", 2024-09-19T04:59:56.492 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:56.492 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.492 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.492 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "7257600", 2024-09-19T04:59:56.492 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.492 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.492 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.492 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T04:59:56.492 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.492 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.492 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.492 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.492 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.493 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.493 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.493 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "diskprediction_local", 2024-09-19T04:59:56.493 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:56.493 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:56.493 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:56.493 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:56.493 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:56.493 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.493 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.493 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.493 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.493 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.494 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.494 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.494 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.494 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.494 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.494 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.494 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.494 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.494 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.494 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.494 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.494 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.494 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.494 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.495 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:56.495 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:56.495 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.495 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.495 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.495 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.495 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.495 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.495 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.495 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.495 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.495 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.495 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.496 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.496 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:56.496 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:56.496 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.496 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.496 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.496 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:56.496 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.496 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.496 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.496 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.496 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.496 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.497 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.497 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.497 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.497 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.497 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.497 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.497 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.497 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.497 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.497 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:56.497 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:56.497 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.497 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.497 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.498 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.498 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.498 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.498 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.498 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.498 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.498 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.498 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.498 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.498 INFO:teuthology.orchestra.run.smithi002.stdout: "predict_interval": { 2024-09-19T04:59:56.498 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "predict_interval", 2024-09-19T04:59:56.498 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.498 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.499 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.499 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "86400", 2024-09-19T04:59:56.499 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.499 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.499 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.499 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.499 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.499 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.499 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.499 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.499 INFO:teuthology.orchestra.run.smithi002.stdout: "predictor_model": { 2024-09-19T04:59:56.499 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "predictor_model", 2024-09-19T04:59:56.499 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.499 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.500 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.500 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "prophetstor", 2024-09-19T04:59:56.500 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.500 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.500 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.500 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.500 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.500 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.500 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.500 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.500 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-19T04:59:56.500 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-19T04:59:56.500 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.501 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.501 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.501 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-19T04:59:56.501 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.501 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.501 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.501 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.501 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.501 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.501 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.501 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.501 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.501 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.501 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.502 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "influx", 2024-09-19T04:59:56.502 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": false, 2024-09-19T04:59:56.502 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "influxdb python module not found", 2024-09-19T04:59:56.502 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:56.502 INFO:teuthology.orchestra.run.smithi002.stdout: "batch_size": { 2024-09-19T04:59:56.502 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "batch_size", 2024-09-19T04:59:56.502 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.502 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.502 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.502 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5000", 2024-09-19T04:59:56.502 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.502 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.502 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.502 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T04:59:56.503 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.503 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.503 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.503 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.503 INFO:teuthology.orchestra.run.smithi002.stdout: "database": { 2024-09-19T04:59:56.503 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "database", 2024-09-19T04:59:56.503 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.503 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.503 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.503 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "ceph", 2024-09-19T04:59:56.503 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.503 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.503 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.504 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T04:59:56.504 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.504 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.504 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.504 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.504 INFO:teuthology.orchestra.run.smithi002.stdout: "hostname": { 2024-09-19T04:59:56.504 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "hostname", 2024-09-19T04:59:56.504 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.504 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.504 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.504 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.504 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.504 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.504 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.505 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB server hostname", 2024-09-19T04:59:56.505 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.505 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.505 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.505 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.505 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-19T04:59:56.505 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-19T04:59:56.505 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:56.505 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.505 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.505 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "30", 2024-09-19T04:59:56.505 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "5", 2024-09-19T04:59:56.505 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.506 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.506 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T04:59:56.506 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.506 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.506 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.506 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.506 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:56.506 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:56.506 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.506 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.506 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.506 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.506 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.507 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.507 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.507 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.507 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.507 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.507 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.507 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.507 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.507 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.507 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.507 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.507 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.507 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.508 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.508 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:56.508 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:56.508 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.508 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.508 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.508 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.508 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.508 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.508 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.508 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.508 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.509 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.509 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.509 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.509 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:56.509 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:56.509 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.509 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.509 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.509 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:56.509 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.509 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.509 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.509 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.509 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.510 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.510 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.510 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.510 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.510 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.510 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.510 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.510 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.510 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.510 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.510 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:56.510 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:56.510 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.511 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.511 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.511 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.511 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.511 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.511 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.511 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.511 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.511 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.511 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.511 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.511 INFO:teuthology.orchestra.run.smithi002.stdout: "password": { 2024-09-19T04:59:56.511 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "password", 2024-09-19T04:59:56.511 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.512 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.512 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.512 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.512 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.512 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.512 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.512 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "password of InfluxDB server user", 2024-09-19T04:59:56.512 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.512 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.512 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.512 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.512 INFO:teuthology.orchestra.run.smithi002.stdout: "port": { 2024-09-19T04:59:56.512 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "port", 2024-09-19T04:59:56.513 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.513 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.513 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.513 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8086", 2024-09-19T04:59:56.513 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.513 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.513 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.513 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB server port", 2024-09-19T04:59:56.513 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.513 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.513 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.513 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.513 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl": { 2024-09-19T04:59:56.513 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl", 2024-09-19T04:59:56.514 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.514 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.514 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.514 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "false", 2024-09-19T04:59:56.514 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.514 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.514 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.514 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T04:59:56.514 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.514 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.514 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.514 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.514 INFO:teuthology.orchestra.run.smithi002.stdout: "threads": { 2024-09-19T04:59:56.515 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "threads", 2024-09-19T04:59:56.515 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.515 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.515 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.515 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-19T04:59:56.515 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-19T04:59:56.515 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "32", 2024-09-19T04:59:56.515 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.515 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T04:59:56.515 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.515 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.515 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.515 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.515 INFO:teuthology.orchestra.run.smithi002.stdout: "username": { 2024-09-19T04:59:56.516 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "username", 2024-09-19T04:59:56.516 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.516 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.516 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.516 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.516 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.516 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.516 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.516 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "username of InfluxDB server user", 2024-09-19T04:59:56.516 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.516 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.516 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.516 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.517 INFO:teuthology.orchestra.run.smithi002.stdout: "verify_ssl": { 2024-09-19T04:59:56.517 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "verify_ssl", 2024-09-19T04:59:56.517 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.517 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.517 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.517 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "true", 2024-09-19T04:59:56.517 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.517 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.517 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.517 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T04:59:56.517 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.517 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.518 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.518 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.518 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.518 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.518 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.518 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "insights", 2024-09-19T04:59:56.518 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:56.518 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:56.518 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:56.518 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:56.518 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:56.518 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.518 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.518 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.519 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.519 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.519 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.519 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.519 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.519 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.519 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.519 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.519 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.519 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.519 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.519 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.519 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.519 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.520 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.520 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.520 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:56.520 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:56.520 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.520 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.520 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.520 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.520 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.520 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.520 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.520 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.520 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.521 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.521 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.521 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.521 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:56.521 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:56.521 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.521 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.521 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.521 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:56.521 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.521 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.521 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.521 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.522 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.522 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.522 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.522 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.522 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.522 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.522 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.522 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.522 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.522 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.522 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.522 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:56.522 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:56.523 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.523 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.523 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.523 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.523 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.523 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.523 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.523 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.523 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.523 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.523 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.523 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.523 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.523 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.524 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.524 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "iostat", 2024-09-19T04:59:56.524 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:56.524 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:56.524 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:56.524 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:56.524 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:56.524 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.524 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.524 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.524 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.524 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.524 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.525 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.525 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.525 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.525 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.525 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.525 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.525 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.525 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.525 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.525 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.525 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.525 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.525 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.525 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:56.526 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:56.526 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.526 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.526 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.526 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.526 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.526 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.526 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.526 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.526 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.526 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.526 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.526 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.527 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:56.527 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:56.527 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.527 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.527 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.527 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:56.527 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.527 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.527 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.527 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.527 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.527 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.527 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.527 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.528 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.528 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.528 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.528 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.528 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.528 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.528 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.528 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:56.528 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:56.528 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.528 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.528 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.529 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.529 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.529 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.529 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.529 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.529 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.529 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.529 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.529 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.529 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.529 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.529 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.529 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "k8sevents", 2024-09-19T04:59:56.529 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:56.530 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:56.530 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:56.530 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_event_retention_days": { 2024-09-19T04:59:56.530 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ceph_event_retention_days", 2024-09-19T04:59:56.530 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.530 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.530 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.530 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "7", 2024-09-19T04:59:56.530 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.530 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.530 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.530 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T04:59:56.530 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.531 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.531 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.531 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.531 INFO:teuthology.orchestra.run.smithi002.stdout: "config_check_secs": { 2024-09-19T04:59:56.531 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_check_secs", 2024-09-19T04:59:56.531 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.531 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.531 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.531 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-19T04:59:56.531 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "10", 2024-09-19T04:59:56.531 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.531 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.531 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T04:59:56.531 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.532 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.532 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.532 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.532 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:56.532 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:56.532 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.532 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.532 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.532 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.532 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.532 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.532 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.532 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.533 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.533 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.533 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.533 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.533 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.533 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.533 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.533 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.533 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.533 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.533 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.533 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:56.533 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:56.534 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.534 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.534 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.534 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.534 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.534 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.534 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.534 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.534 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.534 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.534 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.534 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.534 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:56.534 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:56.535 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.535 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.535 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.535 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:56.535 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.535 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.535 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.535 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.535 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.535 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.535 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.535 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.535 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.536 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.536 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.536 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.536 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.536 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.536 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.536 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:56.536 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:56.536 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.536 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.536 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.536 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.536 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.537 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.537 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.537 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.537 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.537 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.537 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.537 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.537 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.537 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.537 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.537 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "localpool", 2024-09-19T04:59:56.537 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:56.537 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:56.538 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:56.538 INFO:teuthology.orchestra.run.smithi002.stdout: "failure_domain": { 2024-09-19T04:59:56.538 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "failure_domain", 2024-09-19T04:59:56.538 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.538 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.538 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.538 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "host", 2024-09-19T04:59:56.538 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.538 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.538 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.538 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "failure domain for any created local pool", 2024-09-19T04:59:56.538 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T04:59:56.538 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.538 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.539 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.539 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:56.539 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:56.539 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.539 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.539 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.539 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.539 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.539 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.539 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.539 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.539 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.539 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.539 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.540 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.540 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.540 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.540 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.540 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.540 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.540 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.540 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.540 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:56.540 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:56.540 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.540 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.540 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.540 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.541 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.541 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.541 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.541 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.541 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.541 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.541 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.541 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.541 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:56.541 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:56.541 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.541 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.541 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.542 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:56.542 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.542 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.542 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.542 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.542 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.542 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.542 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.542 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.542 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.542 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.542 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.542 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.543 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.543 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.543 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.543 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:56.543 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:56.543 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.543 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.543 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.543 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.543 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.543 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.543 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.543 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.544 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.544 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.544 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.544 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.544 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": { 2024-09-19T04:59:56.544 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "min_size", 2024-09-19T04:59:56.544 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.544 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.544 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.544 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.544 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.544 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.544 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.545 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default min_size for any created local pool", 2024-09-19T04:59:56.545 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T04:59:56.545 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.545 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.545 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.545 INFO:teuthology.orchestra.run.smithi002.stdout: "num_rep": { 2024-09-19T04:59:56.545 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "num_rep", 2024-09-19T04:59:56.545 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.545 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.545 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.545 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3", 2024-09-19T04:59:56.545 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.545 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.546 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.546 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default replica count for any created local pool", 2024-09-19T04:59:56.546 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.546 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.546 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.546 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.546 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": { 2024-09-19T04:59:56.546 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pg_num", 2024-09-19T04:59:56.546 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.546 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.546 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.546 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "128", 2024-09-19T04:59:56.546 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.547 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.547 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.547 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T04:59:56.547 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.547 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.547 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.547 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.547 INFO:teuthology.orchestra.run.smithi002.stdout: "prefix": { 2024-09-19T04:59:56.547 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prefix", 2024-09-19T04:59:56.547 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.547 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.547 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.547 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.548 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.548 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.548 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.548 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "name prefix for any created local pool", 2024-09-19T04:59:56.548 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.548 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.548 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.548 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.548 INFO:teuthology.orchestra.run.smithi002.stdout: "subtree": { 2024-09-19T04:59:56.548 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "subtree", 2024-09-19T04:59:56.548 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.548 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.548 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.549 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "rack", 2024-09-19T04:59:56.549 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.549 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.549 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.549 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T04:59:56.549 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T04:59:56.549 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.549 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.549 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.549 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.549 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.549 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.549 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mds_autoscaler", 2024-09-19T04:59:56.549 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:56.550 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:56.550 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:56.550 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:56.550 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:56.550 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.550 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.550 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.550 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.550 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.550 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.550 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.550 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.550 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.550 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.551 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.551 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.551 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.551 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.551 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.551 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.551 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.551 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.551 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.551 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:56.551 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:56.551 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.551 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.552 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.552 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.552 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.552 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.552 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.552 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.552 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.552 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.552 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.552 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.552 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:56.552 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:56.552 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.553 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.553 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.553 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:56.553 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.553 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.553 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.553 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.553 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.553 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.553 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.553 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.553 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.553 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.554 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.554 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.554 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.554 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.554 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.554 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:56.554 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:56.554 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.554 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.554 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.554 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.554 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.554 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.554 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.555 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.555 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.555 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.555 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.555 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.555 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.555 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.555 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.555 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mirroring", 2024-09-19T04:59:56.555 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:56.555 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:56.555 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:56.555 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:56.556 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:56.556 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.556 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.556 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.556 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.556 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.556 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.556 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.556 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.556 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.556 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.556 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.556 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.557 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.557 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.557 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.557 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.557 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.557 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.557 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.557 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:56.557 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:56.557 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.557 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.557 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.557 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.558 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.558 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.558 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.558 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.558 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.558 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.558 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.558 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.558 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:56.558 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:56.558 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.558 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.558 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.559 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:56.559 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.559 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.559 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.559 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.559 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.559 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.559 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.559 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.559 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.559 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.559 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.559 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.559 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.560 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.560 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.560 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:56.560 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:56.560 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.560 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.560 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.560 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.560 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.560 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.560 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.560 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.560 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.561 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.561 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.561 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.561 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.561 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.561 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.561 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "nfs", 2024-09-19T04:59:56.561 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:56.561 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:56.561 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:56.561 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:56.561 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:56.561 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.562 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.562 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.562 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.562 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.562 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.562 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.562 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.562 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.562 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.562 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.562 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.562 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.562 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.563 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.563 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.563 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.563 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.563 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.563 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:56.563 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:56.563 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.563 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.563 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.563 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.563 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.563 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.563 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.564 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.564 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.564 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.564 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.564 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.564 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:56.564 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:56.564 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.564 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.564 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.564 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:56.564 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.564 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.565 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.565 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.565 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.565 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.565 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.565 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.565 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.565 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.565 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.565 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.565 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.565 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.565 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.566 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:56.566 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:56.566 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.566 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.566 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.566 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.566 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.566 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.566 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.566 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.566 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.566 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.566 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.566 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.567 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.567 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.567 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.567 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "orchestrator", 2024-09-19T04:59:56.567 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:56.567 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:56.567 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:56.567 INFO:teuthology.orchestra.run.smithi002.stdout: "fail_fs": { 2024-09-19T04:59:56.567 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "fail_fs", 2024-09-19T04:59:56.567 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.567 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.567 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.567 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.568 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.568 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.568 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.568 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T04:59:56.568 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.568 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.568 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.568 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.568 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:56.568 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:56.568 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.568 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.568 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.569 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.569 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.569 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.569 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.569 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.569 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.569 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.569 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.569 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.569 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.569 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.569 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.569 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.569 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.570 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.570 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.570 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:56.570 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:56.570 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.570 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.570 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.570 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.570 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.570 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.570 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.570 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.570 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.570 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.571 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.571 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.571 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:56.571 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:56.571 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.571 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.571 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.571 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:56.571 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.571 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.571 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.571 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.571 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.571 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.572 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.572 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.572 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.572 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.572 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.572 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.572 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.572 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.572 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.572 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:56.572 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:56.572 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.572 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.573 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.573 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.573 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.573 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.573 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.573 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.573 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.573 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.573 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.573 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.573 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator": { 2024-09-19T04:59:56.573 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "orchestrator", 2024-09-19T04:59:56.573 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.574 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.574 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.574 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.574 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.574 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.574 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.574 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm", 2024-09-19T04:59:56.574 INFO:teuthology.orchestra.run.smithi002.stdout: "rook", 2024-09-19T04:59:56.574 INFO:teuthology.orchestra.run.smithi002.stdout: "test_orchestrator" 2024-09-19T04:59:56.574 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.574 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Orchestrator backend", 2024-09-19T04:59:56.574 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.574 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.575 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.575 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.575 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.575 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.575 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.575 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "osd_perf_query", 2024-09-19T04:59:56.575 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:56.575 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:56.575 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:56.575 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:56.575 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:56.575 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.575 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.576 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.576 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.576 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.576 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.576 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.576 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.576 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.576 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.576 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.576 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.576 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.576 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.576 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.577 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.577 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.577 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.577 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.577 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:56.577 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:56.577 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.577 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.577 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.577 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.577 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.577 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.577 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.578 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.578 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.578 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.578 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.578 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.578 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:56.578 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:56.578 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.578 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.578 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.578 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:56.578 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.578 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.579 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.579 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.579 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.579 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.579 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.579 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.579 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.579 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.579 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.579 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.579 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.579 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.579 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.579 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:56.580 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:56.580 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.580 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.580 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.580 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.580 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.580 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.580 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.580 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.580 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.580 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.580 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.580 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.581 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.581 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.581 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.581 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "osd_support", 2024-09-19T04:59:56.581 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:56.581 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:56.581 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:56.581 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:56.581 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:56.581 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.581 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.581 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.581 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.581 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.582 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.582 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.582 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.582 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.582 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.582 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.582 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.582 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.582 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.582 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.582 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.582 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.582 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.583 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.583 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:56.583 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:56.583 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.583 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.583 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.583 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.583 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.583 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.583 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.583 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.583 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.583 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.583 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.584 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.584 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:56.584 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:56.584 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.584 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.584 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.584 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:56.584 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.584 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.584 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.584 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.584 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.584 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.585 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.585 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.585 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.585 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.585 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.585 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.585 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.585 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.585 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.585 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:56.585 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:56.585 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.585 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.586 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.586 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.586 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.586 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.586 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.586 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.586 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.586 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.586 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.586 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.586 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.586 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.586 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.586 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pg_autoscaler", 2024-09-19T04:59:56.587 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:56.587 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:56.587 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:56.587 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:56.587 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:56.587 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.587 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.587 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.587 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.587 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.587 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.587 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.587 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.587 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.588 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.588 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.588 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.588 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.588 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.588 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.588 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.588 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.588 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.588 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.588 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:56.588 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:56.588 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.588 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.589 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.589 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.589 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.589 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.589 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.589 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.589 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.589 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.589 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.589 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.589 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:56.589 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:56.589 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.590 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.590 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.590 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:56.590 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.590 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.590 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.590 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.590 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.590 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.590 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.590 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.590 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.590 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.591 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.591 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.591 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.591 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.591 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.591 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:56.591 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:56.591 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.591 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.591 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.591 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.591 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.591 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.592 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.592 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.592 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.592 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.592 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.592 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.592 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-19T04:59:56.592 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-19T04:59:56.592 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:56.592 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.592 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.592 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-19T04:59:56.592 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.593 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.593 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.593 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.593 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.593 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.593 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.593 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.593 INFO:teuthology.orchestra.run.smithi002.stdout: "threshold": { 2024-09-19T04:59:56.593 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "threshold", 2024-09-19T04:59:56.593 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-19T04:59:56.593 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.593 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.593 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3.0", 2024-09-19T04:59:56.594 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1.0", 2024-09-19T04:59:56.594 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.594 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.594 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "scaling threshold", 2024-09-19T04:59:56.594 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T04:59:56.594 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.594 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.594 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.594 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.594 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.594 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.594 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "progress", 2024-09-19T04:59:56.594 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:56.595 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:56.595 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:56.595 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_pg_recovery_event": { 2024-09-19T04:59:56.595 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_pg_recovery_event", 2024-09-19T04:59:56.595 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.595 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.595 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.595 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.595 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.595 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.595 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.595 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T04:59:56.595 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.595 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.596 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.596 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.596 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": { 2024-09-19T04:59:56.596 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enabled", 2024-09-19T04:59:56.596 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.596 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.596 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.596 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.596 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.596 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.596 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.596 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.596 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.597 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.597 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.597 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.597 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:56.597 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:56.597 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.597 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.597 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.597 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.597 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.597 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.597 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.597 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.598 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.598 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.598 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.598 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.598 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.598 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.598 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.598 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.598 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.598 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.598 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.598 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:56.598 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:56.599 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.599 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.599 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.599 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.599 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.599 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.599 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.599 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.599 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.599 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.599 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.599 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.599 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:56.600 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:56.600 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.600 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.600 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.600 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:56.600 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.600 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.600 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.600 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.600 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.600 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.600 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.600 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.601 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.601 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.601 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.601 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.601 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.601 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.601 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.601 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:56.601 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:56.601 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.601 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.601 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.601 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.601 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.602 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.602 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.602 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.602 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.602 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.602 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.602 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.602 INFO:teuthology.orchestra.run.smithi002.stdout: "max_completed_events": { 2024-09-19T04:59:56.602 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_completed_events", 2024-09-19T04:59:56.602 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.602 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.602 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.602 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "50", 2024-09-19T04:59:56.603 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.603 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.603 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.603 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "number of past completed events to remember", 2024-09-19T04:59:56.603 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.603 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.603 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.603 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.603 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-19T04:59:56.603 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-19T04:59:56.603 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:56.603 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.603 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.603 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-19T04:59:56.604 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.604 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.604 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.604 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long the module is going to sleep", 2024-09-19T04:59:56.604 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.604 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.604 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.604 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.604 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.604 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.604 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.604 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prometheus", 2024-09-19T04:59:56.604 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:56.605 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:56.605 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:56.605 INFO:teuthology.orchestra.run.smithi002.stdout: "cache": { 2024-09-19T04:59:56.605 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cache", 2024-09-19T04:59:56.605 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.605 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.605 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.605 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.605 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.605 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.605 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.605 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.605 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.606 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.606 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.606 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.606 INFO:teuthology.orchestra.run.smithi002.stdout: "exclude_perf_counters": { 2024-09-19T04:59:56.606 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "exclude_perf_counters", 2024-09-19T04:59:56.606 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.606 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.606 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.606 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.606 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.606 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.606 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.606 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T04:59:56.607 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T04:59:56.607 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.607 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.607 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.607 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:56.607 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:56.607 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.607 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.607 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.607 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.607 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.607 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.607 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.608 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.608 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.608 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.608 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.608 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.608 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.608 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.608 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.608 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.608 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.608 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.608 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.609 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:56.609 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:56.609 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.609 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.609 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.609 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.609 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.609 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.609 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.609 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.609 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.609 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.609 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.610 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.610 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:56.610 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:56.610 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.610 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.610 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.610 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:56.610 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.610 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.610 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.610 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.610 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.610 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.611 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.611 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.611 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.611 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.611 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.611 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.611 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.611 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.611 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.611 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:56.611 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:56.611 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.611 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.611 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.612 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.612 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.612 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.612 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.612 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.612 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.612 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.612 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.612 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.612 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_stats_pools": { 2024-09-19T04:59:56.612 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_stats_pools", 2024-09-19T04:59:56.612 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.612 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.613 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.613 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.613 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.613 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.613 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.613 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.613 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.613 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.613 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.613 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.613 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T04:59:56.613 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T04:59:56.613 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.614 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.614 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.614 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "300", 2024-09-19T04:59:56.614 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.614 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.614 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.614 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.614 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.614 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.614 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.614 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.614 INFO:teuthology.orchestra.run.smithi002.stdout: "scrape_interval": { 2024-09-19T04:59:56.614 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "scrape_interval", 2024-09-19T04:59:56.614 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-19T04:59:56.615 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.615 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.615 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15.0", 2024-09-19T04:59:56.615 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.615 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.615 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.615 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.615 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.615 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.615 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.615 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.615 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-09-19T04:59:56.615 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-09-19T04:59:56.616 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.616 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.616 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.616 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "::", 2024-09-19T04:59:56.616 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.616 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.616 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.616 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T04:59:56.616 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.616 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.616 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.616 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.616 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-09-19T04:59:56.617 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-09-19T04:59:56.617 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.617 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.617 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.617 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "9283", 2024-09-19T04:59:56.617 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.617 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.617 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.617 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T04:59:56.617 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.617 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.617 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.617 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.617 INFO:teuthology.orchestra.run.smithi002.stdout: "stale_cache_strategy": { 2024-09-19T04:59:56.618 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "stale_cache_strategy", 2024-09-19T04:59:56.618 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.618 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.618 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.618 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "log", 2024-09-19T04:59:56.618 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.618 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.618 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.618 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.618 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.618 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.618 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.618 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.619 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_behaviour": { 2024-09-19T04:59:56.619 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_behaviour", 2024-09-19T04:59:56.619 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.619 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.619 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.619 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "default", 2024-09-19T04:59:56.619 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.619 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.619 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.619 INFO:teuthology.orchestra.run.smithi002.stdout: "default", 2024-09-19T04:59:56.619 INFO:teuthology.orchestra.run.smithi002.stdout: "error" 2024-09-19T04:59:56.619 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.619 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.620 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.620 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.620 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.620 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.620 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_error_status_code": { 2024-09-19T04:59:56.620 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_error_status_code", 2024-09-19T04:59:56.620 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.620 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.620 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.620 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-09-19T04:59:56.620 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "400", 2024-09-19T04:59:56.620 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "599", 2024-09-19T04:59:56.620 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.620 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.621 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.621 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.621 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.621 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.621 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.621 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.621 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.621 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_support", 2024-09-19T04:59:56.621 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:56.621 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:56.621 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:56.621 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:56.621 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:56.622 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.622 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.622 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.622 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.622 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.622 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.622 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.622 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.622 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.622 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.622 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.622 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.622 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.622 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.623 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.623 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.623 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.623 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.623 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.623 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:56.623 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:56.623 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.623 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.623 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.623 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.623 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.623 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.623 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.624 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.624 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.624 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.624 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.624 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.624 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:56.624 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:56.624 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.624 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.624 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.624 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:56.624 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.624 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.624 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.625 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.625 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.625 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.625 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.625 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.625 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.625 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.625 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.625 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.625 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.625 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.625 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.625 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:56.626 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:56.626 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.626 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.626 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.626 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.626 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.626 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.626 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.626 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.626 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.626 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.626 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.626 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.626 INFO:teuthology.orchestra.run.smithi002.stdout: "max_concurrent_snap_create": { 2024-09-19T04:59:56.627 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_concurrent_snap_create", 2024-09-19T04:59:56.627 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.627 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.627 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.627 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-19T04:59:56.627 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.627 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.627 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.627 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.627 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.627 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.627 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.627 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.628 INFO:teuthology.orchestra.run.smithi002.stdout: "mirror_snapshot_schedule": { 2024-09-19T04:59:56.628 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T04:59:56.628 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.628 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.628 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.628 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.628 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.628 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.628 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.628 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.628 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.628 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.628 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.628 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.629 INFO:teuthology.orchestra.run.smithi002.stdout: "trash_purge_schedule": { 2024-09-19T04:59:56.629 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "trash_purge_schedule", 2024-09-19T04:59:56.629 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.629 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.629 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.629 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.629 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.629 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.629 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.629 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.629 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.629 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.629 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.629 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.630 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.630 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.630 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.630 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "restful", 2024-09-19T04:59:56.630 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:56.630 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:56.630 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:56.630 INFO:teuthology.orchestra.run.smithi002.stdout: "enable_auth": { 2024-09-19T04:59:56.630 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enable_auth", 2024-09-19T04:59:56.630 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.630 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.630 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.630 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.631 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.631 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.631 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.631 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.631 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.631 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.631 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.631 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.631 INFO:teuthology.orchestra.run.smithi002.stdout: "key_file": { 2024-09-19T04:59:56.631 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "key_file", 2024-09-19T04:59:56.631 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.631 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.631 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.631 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.632 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.632 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.632 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.632 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.632 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.632 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.632 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.632 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.632 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:56.633 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:56.633 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.633 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.633 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.633 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.633 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.633 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.633 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.633 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.633 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.633 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.633 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.633 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.634 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.634 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.634 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.634 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.634 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.634 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.634 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.634 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:56.634 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:56.634 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.634 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.634 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.634 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.634 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.635 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.635 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.635 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.635 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.635 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.635 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.635 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.635 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:56.635 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:56.635 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.635 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.635 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.635 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:56.635 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.636 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.636 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.636 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.636 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.636 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.636 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.636 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.636 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.636 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.636 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.636 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.636 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.636 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.637 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.637 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:56.637 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:56.637 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.637 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.637 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.637 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.637 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.637 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.637 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.637 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.637 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.637 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.638 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.638 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.638 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-09-19T04:59:56.638 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-09-19T04:59:56.638 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.638 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.638 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.638 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.638 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.638 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.638 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.638 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.638 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.639 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.639 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.639 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.639 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-09-19T04:59:56.639 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-09-19T04:59:56.639 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.639 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.639 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.639 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.639 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.639 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.639 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.639 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.639 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.640 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.640 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.640 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.640 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.640 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.640 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.640 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rgw", 2024-09-19T04:59:56.640 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:56.640 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:56.640 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:56.640 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:56.640 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:56.641 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.641 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.641 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.641 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.641 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.641 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.641 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.641 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.641 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.641 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.641 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.641 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.641 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.642 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.642 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.642 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.642 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.642 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.642 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.642 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:56.642 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:56.642 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.642 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.642 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.642 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.642 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.642 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.643 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.643 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.643 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.643 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.643 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.643 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.643 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:56.643 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:56.643 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.643 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.643 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.643 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:56.643 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.643 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.644 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.644 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.644 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.644 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.644 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.644 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.644 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.644 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.644 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.644 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.644 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.644 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.644 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.645 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:56.645 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:56.645 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.645 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.645 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.645 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.645 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.645 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.645 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.645 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.645 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.645 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.645 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.645 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.646 INFO:teuthology.orchestra.run.smithi002.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T04:59:56.646 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T04:59:56.646 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.646 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.646 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.646 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-19T04:59:56.646 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.646 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.646 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.646 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T04:59:56.646 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.646 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.646 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.647 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.647 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.647 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.647 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.647 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rook", 2024-09-19T04:59:56.647 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:56.647 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:56.647 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:56.647 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:56.647 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:56.647 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.647 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.647 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.648 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.648 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.648 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.648 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.648 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.648 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.648 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.648 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.648 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.648 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.648 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.648 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.649 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.649 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.649 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.649 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.649 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:56.649 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:56.649 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.649 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.649 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.649 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.649 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.649 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.649 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.650 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.650 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.650 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.650 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.650 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.650 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:56.650 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:56.650 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.650 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.650 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.650 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:56.650 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.650 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.651 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.651 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.651 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.651 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.651 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.651 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.651 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.651 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.651 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.651 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.651 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.651 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.651 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.652 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:56.652 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:56.652 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.652 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.652 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.652 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.652 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.652 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.652 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.652 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.652 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.652 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.653 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.653 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.653 INFO:teuthology.orchestra.run.smithi002.stdout: "storage_class": { 2024-09-19T04:59:56.653 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "storage_class", 2024-09-19T04:59:56.653 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.653 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.653 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.653 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "local", 2024-09-19T04:59:56.653 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.653 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.653 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.653 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T04:59:56.653 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.653 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.654 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.654 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.654 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.654 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.654 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.654 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "selftest", 2024-09-19T04:59:56.654 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:56.654 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:56.654 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:56.654 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:56.654 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:56.654 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.655 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.655 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.655 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.655 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.655 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.655 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.655 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.655 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.655 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.655 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.655 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.655 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.655 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.656 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.656 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.656 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.656 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.656 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.656 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:56.656 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:56.656 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.656 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.656 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.656 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.656 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.656 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.656 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.657 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.657 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.657 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.657 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.657 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.657 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:56.657 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:56.657 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.657 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.657 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.657 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:56.657 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.657 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.658 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.658 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.658 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.658 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.658 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.658 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.658 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.658 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.658 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.658 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.658 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.658 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.658 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.658 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:56.659 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:56.659 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.659 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.659 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.659 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.659 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.659 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.659 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.659 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.659 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.659 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.659 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.659 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.659 INFO:teuthology.orchestra.run.smithi002.stdout: "roption1": { 2024-09-19T04:59:56.660 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "roption1", 2024-09-19T04:59:56.660 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.660 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.660 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.660 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.660 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.660 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.660 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.660 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.660 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.660 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.660 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.660 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.660 INFO:teuthology.orchestra.run.smithi002.stdout: "roption2": { 2024-09-19T04:59:56.661 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "roption2", 2024-09-19T04:59:56.661 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.661 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.661 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.661 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "xyz", 2024-09-19T04:59:56.661 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.661 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.661 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.661 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.661 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.661 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.661 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.661 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.661 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption1": { 2024-09-19T04:59:56.662 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption1", 2024-09-19T04:59:56.662 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.662 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.662 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.662 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.662 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.662 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.662 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.662 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.662 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.662 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.662 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.662 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.663 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption2": { 2024-09-19T04:59:56.663 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption2", 2024-09-19T04:59:56.663 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.663 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.663 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.663 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.663 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.663 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.663 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.663 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.663 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.663 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.663 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.664 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.664 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption3": { 2024-09-19T04:59:56.664 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption3", 2024-09-19T04:59:56.664 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-19T04:59:56.664 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.664 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.664 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.664 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.664 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.664 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.664 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.664 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.664 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.664 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.665 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.665 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption4": { 2024-09-19T04:59:56.665 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption4", 2024-09-19T04:59:56.665 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.665 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.665 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.665 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.665 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.665 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.665 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.665 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.665 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.665 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.666 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.666 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.666 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption5": { 2024-09-19T04:59:56.666 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption5", 2024-09-19T04:59:56.666 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.666 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.666 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.666 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.666 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.666 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.666 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.666 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.666 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.666 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.667 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.667 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.667 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption6": { 2024-09-19T04:59:56.667 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption6", 2024-09-19T04:59:56.667 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.667 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.667 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.667 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.667 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.667 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.667 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.667 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.667 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.668 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.668 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.668 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.668 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption7": { 2024-09-19T04:59:56.668 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption7", 2024-09-19T04:59:56.668 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.668 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.668 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.668 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.668 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-19T04:59:56.668 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "42", 2024-09-19T04:59:56.668 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.668 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.669 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.669 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.669 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.669 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.669 INFO:teuthology.orchestra.run.smithi002.stdout: "testkey": { 2024-09-19T04:59:56.669 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testkey", 2024-09-19T04:59:56.669 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.669 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.669 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.669 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.669 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.669 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.669 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.669 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.670 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.670 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.670 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.670 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.670 INFO:teuthology.orchestra.run.smithi002.stdout: "testlkey": { 2024-09-19T04:59:56.670 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testlkey", 2024-09-19T04:59:56.670 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.670 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.670 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.670 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.670 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.670 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.670 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.670 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.671 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.671 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.671 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.671 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.671 INFO:teuthology.orchestra.run.smithi002.stdout: "testnewline": { 2024-09-19T04:59:56.671 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testnewline", 2024-09-19T04:59:56.671 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.671 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.671 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.671 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.671 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.671 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.671 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.671 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.672 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.672 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.672 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.672 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.672 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.672 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.672 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.672 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snap_schedule", 2024-09-19T04:59:56.672 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:56.672 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:56.672 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:56.672 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_m_granularity": { 2024-09-19T04:59:56.672 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_m_granularity", 2024-09-19T04:59:56.673 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.673 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.673 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.673 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.673 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.673 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.673 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.673 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T04:59:56.673 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.673 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.673 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.673 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.673 INFO:teuthology.orchestra.run.smithi002.stdout: "dump_on_update": { 2024-09-19T04:59:56.674 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "dump_on_update", 2024-09-19T04:59:56.674 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.674 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.674 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.674 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.674 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.674 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.674 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.674 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "dump database to debug log on update", 2024-09-19T04:59:56.674 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.674 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.674 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.674 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.674 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:56.675 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:56.675 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.675 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.675 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.675 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.675 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.675 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.675 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.675 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.675 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.675 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.675 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.675 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.676 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.676 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.676 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.676 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.676 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.676 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.676 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.676 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:56.676 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:56.676 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.676 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.676 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.676 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.677 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.677 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.677 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.677 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.677 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.677 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.677 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.677 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.677 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:56.677 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:56.677 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.677 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.677 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.677 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:56.678 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.678 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.678 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.678 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.678 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.678 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.678 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.678 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.678 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.678 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.678 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.678 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.678 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.678 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.679 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.679 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:56.679 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:56.679 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.679 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.679 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.679 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.679 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.679 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.679 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.679 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.679 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.679 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.680 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.680 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.680 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.680 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.680 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.680 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "stats", 2024-09-19T04:59:56.680 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:56.680 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:56.680 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:56.680 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:56.680 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:56.680 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.680 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.681 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.681 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.681 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.681 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.681 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.681 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.681 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.681 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.681 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.681 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.681 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.681 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.681 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.682 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.682 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.682 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.682 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.682 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:56.682 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:56.682 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.682 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.682 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.682 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.682 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.682 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.682 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.682 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.683 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.683 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.683 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.683 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.683 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:56.683 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:56.683 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.683 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.683 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.683 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:56.683 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.683 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.683 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.684 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.684 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.684 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.684 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.684 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.684 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.684 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.684 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.684 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.684 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.684 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.684 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.684 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:56.685 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:56.685 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.685 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.685 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.685 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.685 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.685 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.685 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.685 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.685 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.685 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.685 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.685 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.686 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.686 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.686 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.686 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "status", 2024-09-19T04:59:56.686 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:56.686 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:56.686 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:56.686 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:56.686 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:56.686 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.686 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.686 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.686 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.687 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.687 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.687 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.687 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.687 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.687 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.687 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.687 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.687 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.687 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.687 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.687 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.687 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.687 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.688 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.688 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:56.688 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:56.688 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.688 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.688 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.688 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.688 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.688 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.688 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.688 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.688 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.688 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.689 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.689 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.689 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:56.689 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:56.689 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.689 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.689 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.689 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:56.689 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.689 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.689 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.689 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.689 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.689 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.690 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.690 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.690 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.690 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.690 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.690 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.690 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.690 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.690 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.690 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:56.690 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:56.690 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.690 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.691 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.691 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.691 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.691 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.691 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.691 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.691 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.691 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.691 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.691 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.691 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.691 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.692 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.692 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "telegraf", 2024-09-19T04:59:56.692 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:56.692 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:56.692 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:56.692 INFO:teuthology.orchestra.run.smithi002.stdout: "address": { 2024-09-19T04:59:56.692 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "address", 2024-09-19T04:59:56.692 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.692 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.692 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.692 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T04:59:56.692 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.692 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.693 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.693 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.693 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.693 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.693 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.693 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.693 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-19T04:59:56.693 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-19T04:59:56.693 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:56.693 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.693 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.693 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15", 2024-09-19T04:59:56.693 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.694 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.694 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.694 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.694 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.694 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.694 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.694 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.694 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:56.694 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:56.694 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.694 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.694 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.694 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.694 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.695 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.695 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.695 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.695 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.695 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.695 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.695 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.695 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.695 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.695 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.695 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.695 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.695 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.696 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.696 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:56.696 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:56.696 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.696 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.696 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.696 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.696 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.696 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.696 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.696 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.696 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.696 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.696 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.697 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.697 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:56.697 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:56.697 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.697 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.697 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.697 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:56.697 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.697 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.697 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.697 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.697 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.697 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.698 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.698 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.698 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.698 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.698 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.698 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.698 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.698 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.698 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.698 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:56.698 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:56.698 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.698 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.699 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.699 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.699 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.699 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.699 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.699 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.699 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.699 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.699 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.699 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.699 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.699 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.699 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.699 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "telemetry", 2024-09-19T04:59:56.700 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:56.700 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:56.700 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:56.700 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_basic": { 2024-09-19T04:59:56.700 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_basic", 2024-09-19T04:59:56.700 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.700 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.700 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.700 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.700 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.700 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.700 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.700 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T04:59:56.700 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.701 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.701 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.701 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.701 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_crash": { 2024-09-19T04:59:56.701 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_crash", 2024-09-19T04:59:56.701 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.701 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.701 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.701 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.701 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.701 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.701 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.701 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T04:59:56.701 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.702 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.702 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.702 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.702 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_device": { 2024-09-19T04:59:56.702 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_device", 2024-09-19T04:59:56.702 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.702 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.702 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.702 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.702 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.702 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.702 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.702 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T04:59:56.703 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.703 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.703 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.703 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.703 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_ident": { 2024-09-19T04:59:56.703 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_ident", 2024-09-19T04:59:56.703 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.703 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.703 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.703 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.703 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.703 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.703 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.703 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T04:59:56.703 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.704 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.704 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.704 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.704 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_perf": { 2024-09-19T04:59:56.704 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_perf", 2024-09-19T04:59:56.704 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.704 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.704 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.704 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.704 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.704 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.704 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.704 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T04:59:56.705 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.705 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.705 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.705 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.705 INFO:teuthology.orchestra.run.smithi002.stdout: "contact": { 2024-09-19T04:59:56.705 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "contact", 2024-09-19T04:59:56.705 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.705 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.705 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.705 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.705 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.705 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.705 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.706 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.706 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.706 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.706 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.706 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.706 INFO:teuthology.orchestra.run.smithi002.stdout: "description": { 2024-09-19T04:59:56.706 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "description", 2024-09-19T04:59:56.706 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.706 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.706 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.706 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.706 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.706 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.706 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.707 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.707 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.707 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.707 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.707 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.707 INFO:teuthology.orchestra.run.smithi002.stdout: "device_url": { 2024-09-19T04:59:56.707 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_url", 2024-09-19T04:59:56.707 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.707 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.707 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.707 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T04:59:56.707 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.707 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.708 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.708 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.708 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.708 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.708 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.708 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.708 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": { 2024-09-19T04:59:56.708 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enabled", 2024-09-19T04:59:56.708 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.708 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.708 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.708 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.708 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.709 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.709 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.709 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.709 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.709 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.709 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.709 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.709 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-19T04:59:56.709 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-19T04:59:56.709 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.709 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.709 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.709 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "24", 2024-09-19T04:59:56.710 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "8", 2024-09-19T04:59:56.710 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.710 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.710 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.710 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.710 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.710 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.710 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.710 INFO:teuthology.orchestra.run.smithi002.stdout: "last_opt_revision": { 2024-09-19T04:59:56.710 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "last_opt_revision", 2024-09-19T04:59:56.710 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.710 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.710 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.710 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1", 2024-09-19T04:59:56.711 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.711 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.711 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.711 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.711 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.711 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.711 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.711 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.711 INFO:teuthology.orchestra.run.smithi002.stdout: "leaderboard": { 2024-09-19T04:59:56.711 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "leaderboard", 2024-09-19T04:59:56.711 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.711 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.711 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.712 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.712 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.712 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.712 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.712 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.712 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.712 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.712 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.712 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.712 INFO:teuthology.orchestra.run.smithi002.stdout: "leaderboard_description": { 2024-09-19T04:59:56.712 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "leaderboard_description", 2024-09-19T04:59:56.712 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.712 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.712 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.713 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.713 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.713 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.713 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.713 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.713 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.713 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.713 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.713 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.713 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:56.713 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:56.713 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.713 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.713 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.714 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.714 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.714 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.714 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.714 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.714 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.714 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.714 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.714 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.714 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.714 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.714 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.714 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.715 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.715 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.715 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.715 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:56.715 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:56.715 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.715 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.715 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.715 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.715 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.715 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.715 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.715 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.715 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.716 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.716 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.716 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.716 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:56.716 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:56.716 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.716 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.716 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.716 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:56.716 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.716 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.716 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.716 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.717 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.717 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.717 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.717 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.717 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.717 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.717 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.717 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.717 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.717 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.717 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.717 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:56.717 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:56.717 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.718 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.718 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.718 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.718 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.718 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.718 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.718 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.718 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.718 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.718 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.718 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.718 INFO:teuthology.orchestra.run.smithi002.stdout: "organization": { 2024-09-19T04:59:56.718 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "organization", 2024-09-19T04:59:56.718 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.719 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.719 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.719 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.719 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.719 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.719 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.719 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.719 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.719 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.719 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.719 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.719 INFO:teuthology.orchestra.run.smithi002.stdout: "proxy": { 2024-09-19T04:59:56.719 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "proxy", 2024-09-19T04:59:56.720 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.720 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.720 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.720 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.720 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.720 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.720 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.720 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.720 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.720 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.720 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.720 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.720 INFO:teuthology.orchestra.run.smithi002.stdout: "url": { 2024-09-19T04:59:56.721 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "url", 2024-09-19T04:59:56.721 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.721 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.721 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.721 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T04:59:56.721 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.721 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.721 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.721 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.721 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.721 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.721 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.721 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.721 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.722 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.722 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.722 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "test_orchestrator", 2024-09-19T04:59:56.722 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:56.722 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:56.722 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:56.722 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:56.722 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:56.722 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.722 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.722 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.722 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.722 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.723 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.723 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.723 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.723 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.723 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.723 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.723 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.723 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.723 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.723 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.723 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.723 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.723 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.724 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.724 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:56.724 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:56.724 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.724 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.724 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.724 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.724 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.724 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.724 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.724 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.724 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.724 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.725 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.725 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.725 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:56.725 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:56.725 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.725 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.725 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.725 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:56.725 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.725 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.725 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.725 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.725 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.726 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.726 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.726 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.726 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.726 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.726 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.726 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.726 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.726 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.726 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.726 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:56.726 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:56.726 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.727 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.727 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.727 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.727 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.727 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.727 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.727 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.727 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.727 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.727 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.727 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.727 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.727 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.727 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.728 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "volumes", 2024-09-19T04:59:56.728 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:56.728 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:56.728 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:56.728 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:56.728 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:56.728 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.728 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.728 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.728 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.728 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.728 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.729 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.729 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.729 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.729 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.729 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.729 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.729 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.729 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.729 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.729 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.729 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.729 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.729 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.729 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:56.730 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:56.730 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.730 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.730 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.730 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.730 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.730 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.730 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.730 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.730 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.730 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.730 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.730 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.731 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:56.731 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:56.731 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.731 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.731 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.731 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:56.731 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.731 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.731 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.731 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.731 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.731 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.731 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.731 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.732 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.732 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.732 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.732 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.732 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.732 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.732 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.732 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:56.732 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:56.732 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.732 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.732 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.732 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.733 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.733 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.733 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.733 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.733 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.733 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.733 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.733 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.733 INFO:teuthology.orchestra.run.smithi002.stdout: "max_concurrent_clones": { 2024-09-19T04:59:56.733 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_concurrent_clones", 2024-09-19T04:59:56.733 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.733 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.733 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.733 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "4", 2024-09-19T04:59:56.734 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.734 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.734 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.734 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T04:59:56.734 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.734 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.734 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.734 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.734 INFO:teuthology.orchestra.run.smithi002.stdout: "periodic_async_work": { 2024-09-19T04:59:56.734 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "periodic_async_work", 2024-09-19T04:59:56.734 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.734 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.735 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.735 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.735 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.735 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.735 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.735 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Periodically check for async work", 2024-09-19T04:59:56.735 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.735 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.735 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.735 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.735 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot_clone_delay": { 2024-09-19T04:59:56.735 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snapshot_clone_delay", 2024-09-19T04:59:56.735 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.735 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.736 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.736 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-19T04:59:56.736 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.736 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.736 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.736 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T04:59:56.736 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.736 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.736 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.736 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.736 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot_clone_no_wait": { 2024-09-19T04:59:56.736 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T04:59:56.737 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.737 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.737 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.737 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.737 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.737 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.737 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.737 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T04:59:56.737 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.737 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.737 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.737 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.737 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.737 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.738 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.738 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix", 2024-09-19T04:59:56.738 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:56.738 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:56.738 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:56.738 INFO:teuthology.orchestra.run.smithi002.stdout: "discovery_interval": { 2024-09-19T04:59:56.738 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "discovery_interval", 2024-09-19T04:59:56.738 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-19T04:59:56.738 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.738 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.738 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "100", 2024-09-19T04:59:56.738 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.738 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.739 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.739 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.739 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.739 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.739 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.739 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.739 INFO:teuthology.orchestra.run.smithi002.stdout: "identifier": { 2024-09-19T04:59:56.739 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "identifier", 2024-09-19T04:59:56.739 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.739 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.739 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.739 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.739 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.740 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.740 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.740 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.740 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.740 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.740 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.740 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.740 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-19T04:59:56.740 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-19T04:59:56.740 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:56.740 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.740 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.740 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-19T04:59:56.741 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.741 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.741 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.741 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.741 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.741 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.741 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.741 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.741 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:56.741 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:56.741 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.741 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.741 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.742 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.742 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.742 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.742 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.742 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.742 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.742 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.742 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.742 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.742 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.742 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.742 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.742 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.743 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.743 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.743 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.743 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:56.743 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:56.743 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.743 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.743 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.743 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.743 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.743 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.743 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.743 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.743 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.744 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.744 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.744 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.744 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:56.744 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:56.744 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.744 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.744 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.744 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:56.744 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.744 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.744 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.744 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.745 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.745 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.745 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.745 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.745 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.745 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.745 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.745 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.745 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.745 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.745 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.745 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:56.745 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:56.746 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.746 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.746 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.746 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.746 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.746 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.746 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.746 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.746 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.746 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.746 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.746 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.746 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_host": { 2024-09-19T04:59:56.747 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_host", 2024-09-19T04:59:56.747 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.747 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.747 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.747 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.747 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.747 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.747 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.747 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.747 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.747 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.747 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.747 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.748 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_port": { 2024-09-19T04:59:56.748 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_port", 2024-09-19T04:59:56.748 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.748 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.748 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.748 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10051", 2024-09-19T04:59:56.748 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.748 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.748 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.748 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.748 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.748 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.748 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.749 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.749 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_sender": { 2024-09-19T04:59:56.749 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_sender", 2024-09-19T04:59:56.749 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.749 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.749 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.749 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T04:59:56.749 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.749 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.749 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.749 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.749 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.749 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.750 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.750 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.750 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.750 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.750 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-19T04:59:56.750 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.750 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.750 INFO:teuthology.orchestra.run.smithi002.stdout: "gid": 24790, 2024-09-19T04:59:56.750 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "z", 2024-09-19T04:59:56.750 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_features": 4540701547738038271, 2024-09-19T04:59:56.750 INFO:teuthology.orchestra.run.smithi002.stdout: "available_modules": [ 2024-09-19T04:59:56.750 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.750 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "alerts", 2024-09-19T04:59:56.750 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:56.751 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:56.751 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:56.751 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-19T04:59:56.751 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-19T04:59:56.751 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:56.751 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.751 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.751 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-19T04:59:56.751 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.751 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.751 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.751 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T04:59:56.751 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.752 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.752 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.752 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.752 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:56.752 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:56.752 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.752 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.752 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.752 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.752 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.752 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.752 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.752 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.753 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.753 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.753 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.753 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.753 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.753 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.753 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.753 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.753 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.753 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.753 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.753 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:56.753 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:56.753 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.754 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.754 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.754 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.754 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.754 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.754 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.754 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.754 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.754 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.754 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.754 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.754 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:56.754 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:56.755 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.755 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.755 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.755 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:56.755 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.755 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.755 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.755 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.755 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.755 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.755 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.755 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.755 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.756 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.756 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.756 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.756 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.756 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.756 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.756 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:56.756 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:56.756 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.756 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.756 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.756 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.756 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.757 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.757 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.757 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.757 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.757 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.757 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.757 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.757 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_destination": { 2024-09-19T04:59:56.757 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_destination", 2024-09-19T04:59:56.757 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.757 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.757 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.757 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.758 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.758 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.758 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.758 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Email address to send alerts to", 2024-09-19T04:59:56.758 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.758 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.758 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.758 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.758 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_from_name": { 2024-09-19T04:59:56.758 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_from_name", 2024-09-19T04:59:56.758 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.758 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.758 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.759 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "Ceph", 2024-09-19T04:59:56.759 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.759 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.759 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.759 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Email From: name", 2024-09-19T04:59:56.759 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.759 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.759 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.759 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.759 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_host": { 2024-09-19T04:59:56.759 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_host", 2024-09-19T04:59:56.759 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.759 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.760 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.760 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.760 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.760 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.760 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.760 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP server", 2024-09-19T04:59:56.760 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.760 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.760 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.760 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.760 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_password": { 2024-09-19T04:59:56.760 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_password", 2024-09-19T04:59:56.760 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.760 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.761 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.761 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.761 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.761 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.761 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.761 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Password to authenticate with", 2024-09-19T04:59:56.761 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.761 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.761 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.761 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.761 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_port": { 2024-09-19T04:59:56.761 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_port", 2024-09-19T04:59:56.761 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.761 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.762 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.762 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "465", 2024-09-19T04:59:56.762 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.762 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.762 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.762 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP port", 2024-09-19T04:59:56.762 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.762 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.762 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.762 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.762 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_sender": { 2024-09-19T04:59:56.762 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_sender", 2024-09-19T04:59:56.762 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.763 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.763 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.763 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.763 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.763 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.763 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.763 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP envelope sender", 2024-09-19T04:59:56.763 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.763 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.763 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.763 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.763 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_ssl": { 2024-09-19T04:59:56.763 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_ssl", 2024-09-19T04:59:56.764 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.764 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.764 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.764 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.764 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.764 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.764 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.764 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T04:59:56.764 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.764 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.764 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.764 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.764 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_user": { 2024-09-19T04:59:56.765 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_user", 2024-09-19T04:59:56.765 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.765 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.765 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.765 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.765 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.765 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.765 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.765 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "User to authenticate as", 2024-09-19T04:59:56.765 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.765 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.765 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.765 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.766 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.766 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.766 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.766 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "balancer", 2024-09-19T04:59:56.766 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:56.766 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:56.766 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:56.766 INFO:teuthology.orchestra.run.smithi002.stdout: "active": { 2024-09-19T04:59:56.766 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "active", 2024-09-19T04:59:56.766 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.766 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.766 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.766 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.766 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.767 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.767 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.767 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T04:59:56.767 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.767 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.767 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.767 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.767 INFO:teuthology.orchestra.run.smithi002.stdout: "begin_time": { 2024-09-19T04:59:56.767 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "begin_time", 2024-09-19T04:59:56.767 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.767 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.767 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.767 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0000", 2024-09-19T04:59:56.768 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.768 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.768 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.768 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T04:59:56.768 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T04:59:56.768 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.768 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.768 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.768 INFO:teuthology.orchestra.run.smithi002.stdout: "begin_weekday": { 2024-09-19T04:59:56.768 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "begin_weekday", 2024-09-19T04:59:56.768 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-19T04:59:56.768 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.768 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.769 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-19T04:59:56.769 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0", 2024-09-19T04:59:56.769 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "6", 2024-09-19T04:59:56.769 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.769 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T04:59:56.769 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T04:59:56.769 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.769 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.769 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.769 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_max_iterations": { 2024-09-19T04:59:56.769 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_max_iterations", 2024-09-19T04:59:56.769 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-19T04:59:56.769 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.770 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.770 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "25", 2024-09-19T04:59:56.770 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-19T04:59:56.770 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "250", 2024-09-19T04:59:56.770 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.770 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T04:59:56.770 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.770 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.770 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.770 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.770 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_metrics": { 2024-09-19T04:59:56.770 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_metrics", 2024-09-19T04:59:56.770 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.770 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.771 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.771 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T04:59:56.771 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.771 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.771 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.771 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T04:59:56.771 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T04:59:56.771 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.771 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.771 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.771 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_step": { 2024-09-19T04:59:56.771 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_step", 2024-09-19T04:59:56.771 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-19T04:59:56.772 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.772 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.772 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0.5", 2024-09-19T04:59:56.772 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0.001", 2024-09-19T04:59:56.772 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "0.999", 2024-09-19T04:59:56.772 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.772 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "aggressiveness of optimization", 2024-09-19T04:59:56.772 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T04:59:56.772 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.772 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.772 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.772 INFO:teuthology.orchestra.run.smithi002.stdout: "end_time": { 2024-09-19T04:59:56.772 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "end_time", 2024-09-19T04:59:56.773 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.773 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.773 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.773 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "2359", 2024-09-19T04:59:56.773 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.773 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.773 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.773 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T04:59:56.773 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T04:59:56.773 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.773 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.773 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.773 INFO:teuthology.orchestra.run.smithi002.stdout: "end_weekday": { 2024-09-19T04:59:56.774 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "end_weekday", 2024-09-19T04:59:56.774 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-19T04:59:56.774 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.774 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.774 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-19T04:59:56.774 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0", 2024-09-19T04:59:56.774 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "6", 2024-09-19T04:59:56.774 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.774 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T04:59:56.774 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T04:59:56.774 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.774 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.774 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.774 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:56.775 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:56.775 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.775 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.775 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.775 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.775 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.775 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.775 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.775 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.775 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.775 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.775 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.775 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.775 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.776 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.776 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.776 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.776 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.776 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.776 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.776 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:56.776 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:56.776 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.776 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.776 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.776 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.776 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.777 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.777 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.777 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.777 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.777 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.777 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.777 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.777 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:56.777 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:56.777 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.777 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.777 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.777 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:56.778 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.778 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.778 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.778 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.778 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.778 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.778 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.778 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.778 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.778 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.778 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.778 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.778 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.778 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.779 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.779 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:56.779 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:56.779 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.779 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.779 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.779 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.779 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.779 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.779 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.779 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.779 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.779 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.780 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.780 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.780 INFO:teuthology.orchestra.run.smithi002.stdout: "min_score": { 2024-09-19T04:59:56.780 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "min_score", 2024-09-19T04:59:56.780 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-19T04:59:56.780 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.780 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.780 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-19T04:59:56.780 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.780 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.780 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.780 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T04:59:56.780 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.781 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.781 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.781 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.781 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": { 2024-09-19T04:59:56.781 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mode", 2024-09-19T04:59:56.781 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.781 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.781 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.781 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "upmap", 2024-09-19T04:59:56.781 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.781 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.781 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.781 INFO:teuthology.orchestra.run.smithi002.stdout: "crush-compat", 2024-09-19T04:59:56.782 INFO:teuthology.orchestra.run.smithi002.stdout: "none", 2024-09-19T04:59:56.782 INFO:teuthology.orchestra.run.smithi002.stdout: "read", 2024-09-19T04:59:56.782 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap", 2024-09-19T04:59:56.782 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap-read" 2024-09-19T04:59:56.782 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.782 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Balancer mode", 2024-09-19T04:59:56.782 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.782 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.782 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.782 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.782 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_ids": { 2024-09-19T04:59:56.782 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pool_ids", 2024-09-19T04:59:56.782 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.782 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.783 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.783 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.783 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.783 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.783 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.783 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T04:59:56.783 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.783 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.783 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.783 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.783 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-19T04:59:56.783 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-19T04:59:56.783 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:56.784 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.784 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.784 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-19T04:59:56.784 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.784 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.784 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.784 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T04:59:56.784 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.784 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.784 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.784 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.784 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap_max_deviation": { 2024-09-19T04:59:56.784 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "upmap_max_deviation", 2024-09-19T04:59:56.785 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.785 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.785 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.785 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-19T04:59:56.785 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-19T04:59:56.785 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.785 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.785 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T04:59:56.785 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T04:59:56.785 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.785 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.785 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.785 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap_max_optimizations": { 2024-09-19T04:59:56.786 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "upmap_max_optimizations", 2024-09-19T04:59:56.786 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-19T04:59:56.786 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.786 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.786 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-19T04:59:56.786 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.786 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.786 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.786 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T04:59:56.786 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.786 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.786 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.786 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.786 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.787 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.787 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.787 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephadm", 2024-09-19T04:59:56.787 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:56.787 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:56.787 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:56.787 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_down_multiplier": { 2024-09-19T04:59:56.787 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_down_multiplier", 2024-09-19T04:59:56.787 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-19T04:59:56.787 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.787 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.787 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3.0", 2024-09-19T04:59:56.787 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.788 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.788 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.788 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T04:59:56.788 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.788 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.788 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.788 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.788 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_refresh_rate": { 2024-09-19T04:59:56.788 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_refresh_rate", 2024-09-19T04:59:56.788 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:56.788 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.788 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.788 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "20", 2024-09-19T04:59:56.788 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.788 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.789 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.789 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T04:59:56.789 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.789 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.789 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.789 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.789 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_starting_port": { 2024-09-19T04:59:56.789 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_starting_port", 2024-09-19T04:59:56.789 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.789 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.789 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.789 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "4721", 2024-09-19T04:59:56.789 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.790 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.790 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.790 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T04:59:56.790 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.790 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.790 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.790 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.790 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_ptrace": { 2024-09-19T04:59:56.790 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_ptrace", 2024-09-19T04:59:56.790 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.790 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.790 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.790 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.791 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.791 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.791 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.791 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T04:59:56.791 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T04:59:56.791 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.791 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.791 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.791 INFO:teuthology.orchestra.run.smithi002.stdout: "autotune_interval": { 2024-09-19T04:59:56.791 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "autotune_interval", 2024-09-19T04:59:56.791 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:56.791 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.792 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.792 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-19T04:59:56.792 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.792 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.792 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.792 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T04:59:56.792 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.792 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.792 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.792 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.792 INFO:teuthology.orchestra.run.smithi002.stdout: "autotune_memory_target_ratio": { 2024-09-19T04:59:56.792 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T04:59:56.792 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-19T04:59:56.793 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.793 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.793 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0.7", 2024-09-19T04:59:56.793 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.793 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.793 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.793 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T04:59:56.793 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.793 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.793 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.793 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.793 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm_log_destination": { 2024-09-19T04:59:56.793 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephadm_log_destination", 2024-09-19T04:59:56.794 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.794 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.794 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.794 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.794 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.794 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.794 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.794 INFO:teuthology.orchestra.run.smithi002.stdout: "file", 2024-09-19T04:59:56.794 INFO:teuthology.orchestra.run.smithi002.stdout: "file,syslog", 2024-09-19T04:59:56.794 INFO:teuthology.orchestra.run.smithi002.stdout: "syslog" 2024-09-19T04:59:56.794 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.794 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T04:59:56.794 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.795 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.795 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.795 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.795 INFO:teuthology.orchestra.run.smithi002.stdout: "cgroups_split": { 2024-09-19T04:59:56.795 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cgroups_split", 2024-09-19T04:59:56.795 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.795 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.795 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.795 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.795 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.795 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.795 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.795 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T04:59:56.796 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.796 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.796 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.796 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.796 INFO:teuthology.orchestra.run.smithi002.stdout: "config_checks_enabled": { 2024-09-19T04:59:56.796 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_checks_enabled", 2024-09-19T04:59:56.796 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.796 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.796 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.796 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.796 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.796 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.796 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.797 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T04:59:56.797 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.797 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.797 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.797 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.797 INFO:teuthology.orchestra.run.smithi002.stdout: "config_dashboard": { 2024-09-19T04:59:56.797 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_dashboard", 2024-09-19T04:59:56.797 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.797 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.797 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.797 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.797 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.798 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.798 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.798 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T04:59:56.798 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.798 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.798 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.798 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.798 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_alertmanager": { 2024-09-19T04:59:56.798 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_alertmanager", 2024-09-19T04:59:56.798 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.798 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.798 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.798 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T04:59:56.798 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.799 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.799 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.799 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-19T04:59:56.799 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.799 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.799 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.799 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.799 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_base": { 2024-09-19T04:59:56.799 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_base", 2024-09-19T04:59:56.799 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.799 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.799 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.799 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T04:59:56.800 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.800 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.800 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.800 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Container image name, without the tag", 2024-09-19T04:59:56.800 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.800 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.800 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.800 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.800 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_elasticsearch": { 2024-09-19T04:59:56.800 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_elasticsearch", 2024-09-19T04:59:56.800 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.800 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.800 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.801 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T04:59:56.801 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.801 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.801 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.801 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "elasticsearch container image", 2024-09-19T04:59:56.801 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.801 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.801 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.801 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.801 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_grafana": { 2024-09-19T04:59:56.801 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_grafana", 2024-09-19T04:59:56.801 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.801 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.802 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.802 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T04:59:56.802 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.802 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.802 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.802 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-19T04:59:56.802 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.802 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.802 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.802 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.802 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_haproxy": { 2024-09-19T04:59:56.802 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_haproxy", 2024-09-19T04:59:56.802 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.803 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.803 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.803 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T04:59:56.803 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.803 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.803 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.803 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "HAproxy container image", 2024-09-19T04:59:56.803 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.803 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.803 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.803 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.803 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_agent": { 2024-09-19T04:59:56.803 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_agent", 2024-09-19T04:59:56.803 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.804 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.804 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.804 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T04:59:56.804 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.804 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.804 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.804 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger agent container image", 2024-09-19T04:59:56.804 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.804 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.804 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.804 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.804 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_collector": { 2024-09-19T04:59:56.804 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_collector", 2024-09-19T04:59:56.805 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.805 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.805 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.805 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T04:59:56.805 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.805 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.805 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.805 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger collector container image", 2024-09-19T04:59:56.805 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.805 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.805 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.805 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.805 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_query": { 2024-09-19T04:59:56.806 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_query", 2024-09-19T04:59:56.806 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.806 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.806 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.806 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T04:59:56.806 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.806 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.806 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.806 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger query container image", 2024-09-19T04:59:56.806 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.806 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.806 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.806 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.807 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_keepalived": { 2024-09-19T04:59:56.807 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_keepalived", 2024-09-19T04:59:56.807 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.807 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.807 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.807 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T04:59:56.807 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.807 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.807 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.807 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Keepalived container image", 2024-09-19T04:59:56.807 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.807 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.807 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.808 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.808 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_loki": { 2024-09-19T04:59:56.808 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_loki", 2024-09-19T04:59:56.808 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.808 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.808 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.808 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T04:59:56.808 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.808 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.808 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.808 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Loki container image", 2024-09-19T04:59:56.808 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.808 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.808 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.809 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.809 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_node_exporter": { 2024-09-19T04:59:56.809 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_node_exporter", 2024-09-19T04:59:56.809 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.809 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.809 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.809 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T04:59:56.809 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.809 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.809 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.809 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-19T04:59:56.809 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.809 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.810 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.810 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.810 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_nvmeof": { 2024-09-19T04:59:56.810 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_nvmeof", 2024-09-19T04:59:56.810 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.810 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.810 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.810 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T04:59:56.810 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.810 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.810 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.810 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Nvme-of container image", 2024-09-19T04:59:56.810 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.811 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.811 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.811 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.811 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_prometheus": { 2024-09-19T04:59:56.811 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_prometheus", 2024-09-19T04:59:56.811 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.811 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.811 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.811 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T04:59:56.811 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.811 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.811 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.811 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-19T04:59:56.811 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.812 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.812 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.812 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.812 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_promtail": { 2024-09-19T04:59:56.812 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_promtail", 2024-09-19T04:59:56.812 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.812 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.812 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.812 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T04:59:56.812 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.812 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.812 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.812 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Promtail container image", 2024-09-19T04:59:56.813 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.813 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.813 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.813 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.813 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_samba": { 2024-09-19T04:59:56.813 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_samba", 2024-09-19T04:59:56.813 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.813 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.813 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.813 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T04:59:56.813 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.813 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.813 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.814 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Samba/SMB container image", 2024-09-19T04:59:56.814 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.814 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.814 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.814 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.814 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_snmp_gateway": { 2024-09-19T04:59:56.814 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_snmp_gateway", 2024-09-19T04:59:56.814 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.814 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.814 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.814 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T04:59:56.814 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.814 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.814 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.815 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SNMP Gateway container image", 2024-09-19T04:59:56.815 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.815 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.815 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.815 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.815 INFO:teuthology.orchestra.run.smithi002.stdout: "container_init": { 2024-09-19T04:59:56.815 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_init", 2024-09-19T04:59:56.815 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.815 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.815 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.815 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.815 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.815 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.816 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.816 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T04:59:56.816 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.816 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.816 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.816 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.816 INFO:teuthology.orchestra.run.smithi002.stdout: "daemon_cache_timeout": { 2024-09-19T04:59:56.816 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "daemon_cache_timeout", 2024-09-19T04:59:56.816 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:56.816 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.816 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.816 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-19T04:59:56.817 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.817 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.817 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.817 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T04:59:56.817 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.817 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.817 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.817 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.817 INFO:teuthology.orchestra.run.smithi002.stdout: "default_cephadm_command_timeout": { 2024-09-19T04:59:56.817 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T04:59:56.817 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.817 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.817 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.818 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "900", 2024-09-19T04:59:56.818 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.818 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.818 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.818 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T04:59:56.818 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.818 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.818 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.818 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.818 INFO:teuthology.orchestra.run.smithi002.stdout: "default_registry": { 2024-09-19T04:59:56.818 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "default_registry", 2024-09-19T04:59:56.818 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.818 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.819 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.819 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io", 2024-09-19T04:59:56.819 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.819 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.819 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.819 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T04:59:56.819 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.819 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.819 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.819 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.819 INFO:teuthology.orchestra.run.smithi002.stdout: "device_cache_timeout": { 2024-09-19T04:59:56.819 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_cache_timeout", 2024-09-19T04:59:56.819 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:56.819 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.820 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.820 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1800", 2024-09-19T04:59:56.820 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.820 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.820 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.820 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache device inventory", 2024-09-19T04:59:56.820 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.820 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.820 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.820 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.820 INFO:teuthology.orchestra.run.smithi002.stdout: "device_enhanced_scan": { 2024-09-19T04:59:56.820 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_enhanced_scan", 2024-09-19T04:59:56.821 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.821 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.821 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.821 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.821 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.821 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.821 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.821 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T04:59:56.821 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.821 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.821 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.821 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.821 INFO:teuthology.orchestra.run.smithi002.stdout: "facts_cache_timeout": { 2024-09-19T04:59:56.822 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "facts_cache_timeout", 2024-09-19T04:59:56.822 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:56.822 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.822 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.822 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-19T04:59:56.822 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.822 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.822 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.822 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache host facts data", 2024-09-19T04:59:56.822 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.822 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.822 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.822 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.822 INFO:teuthology.orchestra.run.smithi002.stdout: "grafana_dashboards_path": { 2024-09-19T04:59:56.823 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "grafana_dashboards_path", 2024-09-19T04:59:56.823 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.823 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.823 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.823 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T04:59:56.823 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.823 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.823 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.823 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T04:59:56.823 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.823 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.823 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.823 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.824 INFO:teuthology.orchestra.run.smithi002.stdout: "host_check_interval": { 2024-09-19T04:59:56.824 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "host_check_interval", 2024-09-19T04:59:56.824 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:56.824 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.824 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.824 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-19T04:59:56.824 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.824 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.824 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.824 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to perform a host check", 2024-09-19T04:59:56.824 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.824 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.824 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.824 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.825 INFO:teuthology.orchestra.run.smithi002.stdout: "hw_monitoring": { 2024-09-19T04:59:56.825 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "hw_monitoring", 2024-09-19T04:59:56.825 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.825 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.825 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.825 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.825 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.825 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.825 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.825 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T04:59:56.825 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.825 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.826 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.826 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.826 INFO:teuthology.orchestra.run.smithi002.stdout: "inventory_list_all": { 2024-09-19T04:59:56.826 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "inventory_list_all", 2024-09-19T04:59:56.826 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.826 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.826 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.826 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.826 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.826 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.826 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.826 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T04:59:56.826 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.826 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.827 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.827 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.827 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:56.827 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:56.827 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.827 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.827 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.827 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.827 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.827 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.827 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.827 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.827 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.828 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.828 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.828 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.828 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.828 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.828 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.828 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.828 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.828 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.828 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.828 INFO:teuthology.orchestra.run.smithi002.stdout: "log_refresh_metadata": { 2024-09-19T04:59:56.828 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_refresh_metadata", 2024-09-19T04:59:56.829 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.829 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.829 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.829 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.829 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.829 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.829 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.829 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T04:59:56.829 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.829 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.829 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.829 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.829 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:56.830 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:56.830 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.830 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.830 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.830 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.830 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.830 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.830 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.830 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T04:59:56.830 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.830 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.830 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.830 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.830 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:56.831 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:56.831 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.831 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.831 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.831 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:56.831 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.831 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.831 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.831 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.831 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.831 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.831 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.831 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.832 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.832 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.832 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.832 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.832 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.832 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.832 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.832 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:56.832 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:56.832 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.832 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.832 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.832 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.833 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.833 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.833 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.833 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.833 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.833 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.833 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.833 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.833 INFO:teuthology.orchestra.run.smithi002.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T04:59:56.833 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T04:59:56.833 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.833 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.833 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.834 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.834 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.834 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.834 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.834 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T04:59:56.834 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.834 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.834 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.834 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.834 INFO:teuthology.orchestra.run.smithi002.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T04:59:56.834 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T04:59:56.834 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.834 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.835 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.835 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "*", 2024-09-19T04:59:56.835 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.835 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.835 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.835 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T04:59:56.835 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.835 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.835 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.835 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.835 INFO:teuthology.orchestra.run.smithi002.stdout: "max_count_per_host": { 2024-09-19T04:59:56.835 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_count_per_host", 2024-09-19T04:59:56.835 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.835 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.836 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.836 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-19T04:59:56.836 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.836 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.836 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.836 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "max number of daemons per service per host", 2024-09-19T04:59:56.836 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.836 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.836 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.836 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.836 INFO:teuthology.orchestra.run.smithi002.stdout: "max_osd_draining_count": { 2024-09-19T04:59:56.836 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_osd_draining_count", 2024-09-19T04:59:56.836 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.837 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.837 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.837 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-19T04:59:56.837 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.837 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.837 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.837 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T04:59:56.837 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.837 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.837 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.837 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.837 INFO:teuthology.orchestra.run.smithi002.stdout: "migration_current": { 2024-09-19T04:59:56.837 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "migration_current", 2024-09-19T04:59:56.837 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.838 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.838 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.838 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.838 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.838 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.838 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.838 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "internal - do not modify", 2024-09-19T04:59:56.838 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.838 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.838 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.838 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.838 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": { 2024-09-19T04:59:56.838 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mode", 2024-09-19T04:59:56.838 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.839 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.839 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.839 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "root", 2024-09-19T04:59:56.839 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.839 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.839 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.839 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm-package", 2024-09-19T04:59:56.839 INFO:teuthology.orchestra.run.smithi002.stdout: "root" 2024-09-19T04:59:56.839 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.839 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T04:59:56.839 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.839 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.839 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.840 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.840 INFO:teuthology.orchestra.run.smithi002.stdout: "oob_default_addr": { 2024-09-19T04:59:56.840 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "oob_default_addr", 2024-09-19T04:59:56.840 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.840 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.840 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.840 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "169.254.1.1", 2024-09-19T04:59:56.840 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.840 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.840 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.840 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T04:59:56.840 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.840 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.840 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.841 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.841 INFO:teuthology.orchestra.run.smithi002.stdout: "prometheus_alerts_path": { 2024-09-19T04:59:56.841 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prometheus_alerts_path", 2024-09-19T04:59:56.841 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.841 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.841 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.841 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T04:59:56.841 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.841 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.841 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.841 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T04:59:56.841 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.842 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.842 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.842 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.842 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_insecure": { 2024-09-19T04:59:56.842 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_insecure", 2024-09-19T04:59:56.842 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.842 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.842 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.842 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.842 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.842 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.842 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.842 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T04:59:56.842 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.843 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.843 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.843 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.843 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_password": { 2024-09-19T04:59:56.843 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_password", 2024-09-19T04:59:56.843 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.843 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.843 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.843 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.843 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.843 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.843 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.843 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T04:59:56.843 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.844 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.844 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.844 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.844 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_url": { 2024-09-19T04:59:56.844 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_url", 2024-09-19T04:59:56.844 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.844 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.844 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.844 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.844 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.844 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.844 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.844 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T04:59:56.844 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.845 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.845 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.845 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.845 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_username": { 2024-09-19T04:59:56.845 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_username", 2024-09-19T04:59:56.845 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.845 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.845 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.845 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.845 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.845 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.845 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.845 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T04:59:56.846 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.846 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.846 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.846 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.846 INFO:teuthology.orchestra.run.smithi002.stdout: "secure_monitoring_stack": { 2024-09-19T04:59:56.846 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "secure_monitoring_stack", 2024-09-19T04:59:56.846 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.846 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.846 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.846 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.846 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.846 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.846 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.847 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T04:59:56.847 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.847 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.847 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.847 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.847 INFO:teuthology.orchestra.run.smithi002.stdout: "service_discovery_port": { 2024-09-19T04:59:56.847 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "service_discovery_port", 2024-09-19T04:59:56.847 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.847 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.847 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.847 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8765", 2024-09-19T04:59:56.847 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.847 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.848 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.848 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "cephadm service discovery port", 2024-09-19T04:59:56.848 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.848 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.848 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.848 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.848 INFO:teuthology.orchestra.run.smithi002.stdout: "ssh_config_file": { 2024-09-19T04:59:56.848 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssh_config_file", 2024-09-19T04:59:56.848 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.848 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.848 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.848 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.849 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.849 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.849 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.849 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T04:59:56.849 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.849 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.849 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.849 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.849 INFO:teuthology.orchestra.run.smithi002.stdout: "use_agent": { 2024-09-19T04:59:56.849 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "use_agent", 2024-09-19T04:59:56.849 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.849 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.849 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.850 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.850 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.850 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.850 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.850 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T04:59:56.850 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.850 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.850 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.850 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.850 INFO:teuthology.orchestra.run.smithi002.stdout: "use_repo_digest": { 2024-09-19T04:59:56.850 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "use_repo_digest", 2024-09-19T04:59:56.850 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.850 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.850 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.851 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.851 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.851 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.851 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.851 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T04:59:56.851 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.851 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.851 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.851 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.851 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_failed_host_check": { 2024-09-19T04:59:56.851 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_failed_host_check", 2024-09-19T04:59:56.851 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.851 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.851 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.852 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.852 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.852 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.852 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.852 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T04:59:56.852 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.852 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.852 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.852 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.852 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_stray_daemons": { 2024-09-19T04:59:56.852 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_stray_daemons", 2024-09-19T04:59:56.852 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.852 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.853 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.853 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.853 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.853 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.853 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.853 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T04:59:56.853 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.853 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.853 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.853 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.853 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_stray_hosts": { 2024-09-19T04:59:56.853 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_stray_hosts", 2024-09-19T04:59:56.853 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.853 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.854 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.854 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.854 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.854 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.854 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.854 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T04:59:56.854 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.854 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.854 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.854 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.854 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.854 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.854 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.855 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crash", 2024-09-19T04:59:56.855 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:56.855 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:56.855 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:56.855 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:56.855 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:56.855 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.855 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.855 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.855 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.855 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.855 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.855 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.856 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.856 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.856 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.856 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.856 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.856 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.856 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.856 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.856 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.856 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.856 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.856 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.856 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:56.856 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:56.857 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.857 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.857 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.857 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.857 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.857 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.857 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.857 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.857 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.857 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.857 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.857 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.857 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:56.858 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:56.858 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.858 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.858 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.858 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:56.858 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.858 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.858 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.858 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.858 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.858 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.858 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.858 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.859 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.859 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.859 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.859 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.859 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.859 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.859 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.859 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:56.859 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:56.859 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.859 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.859 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.859 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.859 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.860 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.860 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.860 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.860 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.860 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.860 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.860 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.860 INFO:teuthology.orchestra.run.smithi002.stdout: "retain_interval": { 2024-09-19T04:59:56.860 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "retain_interval", 2024-09-19T04:59:56.860 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:56.860 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.861 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.861 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "31536000", 2024-09-19T04:59:56.861 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.861 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.861 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.861 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T04:59:56.861 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.861 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.861 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.861 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.861 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_recent_interval": { 2024-09-19T04:59:56.861 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_recent_interval", 2024-09-19T04:59:56.861 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:56.862 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.862 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.862 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1209600", 2024-09-19T04:59:56.862 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.862 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.862 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.862 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T04:59:56.862 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.862 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.862 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.862 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.862 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.862 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.862 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.863 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "dashboard", 2024-09-19T04:59:56.863 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:56.863 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:56.863 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:56.863 INFO:teuthology.orchestra.run.smithi002.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T04:59:56.863 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T04:59:56.863 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.863 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.863 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.863 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-19T04:59:56.863 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.863 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.863 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.864 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.864 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.864 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.864 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.864 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.864 INFO:teuthology.orchestra.run.smithi002.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T04:59:56.864 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T04:59:56.864 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.864 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.864 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.864 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.864 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.864 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.865 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.865 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.865 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.865 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.865 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.865 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.865 INFO:teuthology.orchestra.run.smithi002.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T04:59:56.865 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T04:59:56.865 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.865 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.865 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.865 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.865 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.866 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.866 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.866 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.866 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.866 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.866 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.866 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.866 INFO:teuthology.orchestra.run.smithi002.stdout: "AUDIT_API_ENABLED": { 2024-09-19T04:59:56.866 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T04:59:56.866 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.866 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.866 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.866 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.866 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.867 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.867 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.867 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.867 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.867 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.867 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.867 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.867 INFO:teuthology.orchestra.run.smithi002.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T04:59:56.867 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T04:59:56.867 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.867 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.867 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.867 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.868 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.868 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.868 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.868 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.868 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.868 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.868 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.868 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.868 INFO:teuthology.orchestra.run.smithi002.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T04:59:56.868 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T04:59:56.868 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.868 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.868 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.869 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.869 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.869 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.869 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.869 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.869 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.869 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.869 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.869 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.869 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T04:59:56.869 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T04:59:56.869 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.870 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.870 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.870 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.870 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.870 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.870 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.870 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.870 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.870 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.870 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.870 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.870 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T04:59:56.870 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T04:59:56.871 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.871 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.871 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.871 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.871 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.871 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.871 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.871 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.871 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.871 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.871 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.871 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.871 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T04:59:56.871 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T04:59:56.872 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.872 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.872 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.872 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.872 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.872 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.872 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.872 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.872 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.872 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.872 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.872 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.872 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T04:59:56.873 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T04:59:56.873 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.873 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.873 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.873 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.873 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.873 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.873 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.873 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.873 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.873 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.873 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.873 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.874 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T04:59:56.874 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T04:59:56.874 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.874 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.874 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.874 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.874 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.874 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.874 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.874 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.874 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.874 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.874 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.875 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.875 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T04:59:56.875 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T04:59:56.875 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.875 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.875 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.875 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.875 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.875 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.875 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.875 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.875 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.875 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.875 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.876 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.876 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T04:59:56.876 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T04:59:56.876 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.876 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.876 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.876 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.876 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.876 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.876 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.876 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.876 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.876 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.877 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.877 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.877 INFO:teuthology.orchestra.run.smithi002.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T04:59:56.877 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T04:59:56.877 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.877 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.877 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.877 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.877 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.877 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.877 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.877 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.877 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.877 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.878 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.878 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.878 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T04:59:56.878 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T04:59:56.878 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.878 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.878 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.878 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-09-19T04:59:56.878 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.878 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.878 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.878 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.878 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.879 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.879 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.879 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.879 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T04:59:56.879 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T04:59:56.879 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.879 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.879 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.879 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.879 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.879 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.879 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.879 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.879 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.880 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.880 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.880 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.880 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_URL": { 2024-09-19T04:59:56.880 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_URL", 2024-09-19T04:59:56.880 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.880 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.880 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.880 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.880 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.880 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.880 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.880 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.880 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.881 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.881 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.881 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.881 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T04:59:56.881 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T04:59:56.881 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.881 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.881 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.881 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-09-19T04:59:56.881 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.881 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.881 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.881 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.881 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.882 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.882 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.882 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.882 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T04:59:56.882 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T04:59:56.882 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.882 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.882 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.882 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.882 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.882 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.882 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.882 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.882 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.883 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.883 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.883 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.883 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T04:59:56.883 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T04:59:56.883 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.883 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.883 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.883 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.883 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.883 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.883 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.884 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.884 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.884 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.884 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.884 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.884 INFO:teuthology.orchestra.run.smithi002.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T04:59:56.884 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T04:59:56.884 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.884 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.884 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.884 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.884 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.884 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.885 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.885 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.885 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.885 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.885 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.885 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.885 INFO:teuthology.orchestra.run.smithi002.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T04:59:56.885 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T04:59:56.885 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.885 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.885 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.885 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.885 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.885 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.886 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.886 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.886 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.886 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.886 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.886 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.886 INFO:teuthology.orchestra.run.smithi002.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T04:59:56.886 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T04:59:56.886 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.886 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.886 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.886 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.886 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.887 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.887 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.887 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.887 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.887 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.887 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.887 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.887 INFO:teuthology.orchestra.run.smithi002.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T04:59:56.887 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T04:59:56.887 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.887 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.887 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.887 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.887 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.888 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.888 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.888 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.888 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.888 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.888 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.888 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.888 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T04:59:56.888 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T04:59:56.888 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.888 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.888 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.888 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.889 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.889 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.889 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.889 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.889 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.889 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.889 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.889 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.889 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T04:59:56.889 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T04:59:56.889 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.889 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.889 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.889 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.890 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.890 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.890 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.890 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.890 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.890 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.890 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.890 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.890 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T04:59:56.890 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T04:59:56.890 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.890 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.890 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.890 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.891 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.891 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.891 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.891 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.891 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.891 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.891 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.891 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.891 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T04:59:56.891 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T04:59:56.891 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.891 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.892 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.892 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.892 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.892 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.892 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.892 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.892 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.892 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.892 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.892 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.892 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T04:59:56.892 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T04:59:56.892 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.893 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.893 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.893 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.893 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.893 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.893 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.893 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.893 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.893 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.893 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.893 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.893 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T04:59:56.893 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T04:59:56.894 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.894 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.894 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.894 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.894 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.894 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.894 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.894 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.894 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.894 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.894 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.894 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.894 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T04:59:56.895 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T04:59:56.895 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.895 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.895 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.895 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.895 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.895 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.895 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.895 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.895 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.895 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.895 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.895 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.896 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T04:59:56.896 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T04:59:56.896 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.896 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.896 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.896 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.896 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.896 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.896 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.896 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.896 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.896 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.897 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.897 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.897 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T04:59:56.897 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T04:59:56.897 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.897 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.897 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.897 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T04:59:56.897 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.897 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.897 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.897 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.897 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.898 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.898 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.898 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.898 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T04:59:56.898 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T04:59:56.898 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.898 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.898 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.898 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-19T04:59:56.898 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.898 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.898 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.898 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.899 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.899 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.899 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.899 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.899 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T04:59:56.899 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T04:59:56.899 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.899 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.899 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.899 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8", 2024-09-19T04:59:56.900 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.900 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.900 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.900 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.900 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.900 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.900 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.900 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.900 INFO:teuthology.orchestra.run.smithi002.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T04:59:56.900 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T04:59:56.900 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.900 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.901 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.901 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "45", 2024-09-19T04:59:56.901 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.901 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.901 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.901 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.901 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.901 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.901 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.901 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.901 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T04:59:56.901 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T04:59:56.901 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.902 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.902 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.902 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.902 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.902 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.902 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.902 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.902 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.902 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.902 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.902 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.902 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T04:59:56.903 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T04:59:56.903 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.903 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.903 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.903 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-09-19T04:59:56.903 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.903 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.903 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.903 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.903 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.903 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.903 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.903 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.903 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T04:59:56.904 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T04:59:56.904 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.904 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.904 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.904 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.904 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.904 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.904 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.904 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.904 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.904 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.904 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.904 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.905 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T04:59:56.905 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T04:59:56.905 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.905 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.905 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.905 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.905 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.905 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.905 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.905 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.905 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.905 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.905 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.905 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.906 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T04:59:56.906 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T04:59:56.906 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.906 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.906 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.906 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-19T04:59:56.906 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.906 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.906 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.906 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.906 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.906 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.906 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.907 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.907 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T04:59:56.907 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T04:59:56.907 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.907 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.907 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.907 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-19T04:59:56.907 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.907 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.907 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.907 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.907 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.907 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.908 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.908 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.908 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T04:59:56.908 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T04:59:56.908 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.908 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.908 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.908 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-19T04:59:56.908 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.908 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.908 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.908 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.908 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.909 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.909 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.909 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.909 INFO:teuthology.orchestra.run.smithi002.stdout: "cross_origin_url": { 2024-09-19T04:59:56.909 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cross_origin_url", 2024-09-19T04:59:56.909 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.909 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.909 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.909 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.909 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.909 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.909 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.909 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.909 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.910 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.910 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.910 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.910 INFO:teuthology.orchestra.run.smithi002.stdout: "crt_file": { 2024-09-19T04:59:56.910 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crt_file", 2024-09-19T04:59:56.910 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.910 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.910 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.910 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.910 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.910 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.910 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.910 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.910 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.911 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.911 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.911 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.911 INFO:teuthology.orchestra.run.smithi002.stdout: "debug": { 2024-09-19T04:59:56.911 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "debug", 2024-09-19T04:59:56.911 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.911 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.911 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.911 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.911 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.911 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.911 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.911 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable/disable debug options", 2024-09-19T04:59:56.912 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.912 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.912 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.912 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.912 INFO:teuthology.orchestra.run.smithi002.stdout: "jwt_token_ttl": { 2024-09-19T04:59:56.912 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "jwt_token_ttl", 2024-09-19T04:59:56.912 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.912 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.912 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.912 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "28800", 2024-09-19T04:59:56.912 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.912 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.912 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.913 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.913 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.913 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.913 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.913 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.913 INFO:teuthology.orchestra.run.smithi002.stdout: "key_file": { 2024-09-19T04:59:56.913 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "key_file", 2024-09-19T04:59:56.913 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.913 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.913 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.913 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.913 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.913 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.913 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.914 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.914 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.914 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.914 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.914 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.914 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:56.914 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:56.914 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.914 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.914 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.914 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.914 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.914 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.915 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.915 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.915 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.915 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.915 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.915 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.915 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.915 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.915 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.915 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.915 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.915 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.915 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.916 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:56.916 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:56.916 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.916 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.916 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.916 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.916 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.916 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.916 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.916 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.916 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.916 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.916 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.916 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.917 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:56.917 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:56.917 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.917 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.917 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.917 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:56.917 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.917 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.917 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.917 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.917 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.917 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.917 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.918 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.918 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.918 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.918 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.918 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.918 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.918 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.918 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.918 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:56.918 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:56.918 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.918 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.918 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.918 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.918 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.919 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.919 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.919 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.919 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.919 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.919 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.919 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.919 INFO:teuthology.orchestra.run.smithi002.stdout: "motd": { 2024-09-19T04:59:56.919 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "motd", 2024-09-19T04:59:56.919 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.919 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.919 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.919 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.919 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.919 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.920 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.920 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "The message of the day", 2024-09-19T04:59:56.920 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.920 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.920 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.920 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.920 INFO:teuthology.orchestra.run.smithi002.stdout: "redirect_resolve_ip_addr": { 2024-09-19T04:59:56.920 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T04:59:56.920 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.920 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.920 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.920 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.920 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.920 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.921 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.921 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.921 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.921 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.921 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.921 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.921 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-09-19T04:59:56.921 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-09-19T04:59:56.921 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.921 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.921 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.921 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "::", 2024-09-19T04:59:56.921 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.921 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.922 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.922 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.922 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.922 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.922 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.922 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.922 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-09-19T04:59:56.922 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-09-19T04:59:56.922 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.922 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.922 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.922 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8080", 2024-09-19T04:59:56.922 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.922 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.923 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.923 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.923 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.923 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.923 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.923 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.923 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl": { 2024-09-19T04:59:56.923 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl", 2024-09-19T04:59:56.923 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.923 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.923 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.923 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.923 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.923 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.924 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.924 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.924 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.924 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.924 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.924 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.924 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl_server_port": { 2024-09-19T04:59:56.924 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl_server_port", 2024-09-19T04:59:56.924 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.924 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.924 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.924 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8443", 2024-09-19T04:59:56.924 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.924 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.925 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.925 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.925 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.925 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.925 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.925 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.925 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_behaviour": { 2024-09-19T04:59:56.925 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_behaviour", 2024-09-19T04:59:56.925 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.925 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.925 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.925 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "redirect", 2024-09-19T04:59:56.925 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.926 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.926 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.926 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.926 INFO:teuthology.orchestra.run.smithi002.stdout: "redirect" 2024-09-19T04:59:56.926 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.926 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.926 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.926 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.926 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.926 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.926 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_error_status_code": { 2024-09-19T04:59:56.926 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_error_status_code", 2024-09-19T04:59:56.926 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.927 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.927 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.927 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-09-19T04:59:56.927 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "400", 2024-09-19T04:59:56.927 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "599", 2024-09-19T04:59:56.927 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.927 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.927 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.927 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.927 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.927 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.927 INFO:teuthology.orchestra.run.smithi002.stdout: "url_prefix": { 2024-09-19T04:59:56.927 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "url_prefix", 2024-09-19T04:59:56.927 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.928 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.928 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.928 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.928 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.928 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.928 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.928 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.928 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.928 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.928 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.928 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.928 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.928 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.929 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.929 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "devicehealth", 2024-09-19T04:59:56.929 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:56.929 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:56.929 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:56.929 INFO:teuthology.orchestra.run.smithi002.stdout: "enable_monitoring": { 2024-09-19T04:59:56.929 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enable_monitoring", 2024-09-19T04:59:56.929 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.929 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.929 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.929 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.929 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.929 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.929 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.930 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "monitor device health metrics", 2024-09-19T04:59:56.930 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.930 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.930 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.930 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.930 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:56.930 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:56.930 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.930 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.930 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.930 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.930 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.930 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.931 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.931 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.931 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.931 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.931 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.931 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.931 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.931 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.931 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.931 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.931 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.931 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.932 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.932 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:56.932 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:56.932 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.932 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.932 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.932 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.932 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.932 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.932 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.932 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.932 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.932 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.932 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.933 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.933 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:56.933 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:56.933 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.933 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.933 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.933 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:56.933 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.933 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.933 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.933 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.933 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.933 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.934 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.934 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.934 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.934 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.934 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.934 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.934 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.934 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.934 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.934 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:56.934 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:56.934 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.934 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.934 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.935 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.935 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.935 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.935 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.935 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.935 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.935 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.935 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.935 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.935 INFO:teuthology.orchestra.run.smithi002.stdout: "mark_out_threshold": { 2024-09-19T04:59:56.935 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mark_out_threshold", 2024-09-19T04:59:56.935 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:56.936 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.936 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.936 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "2419200", 2024-09-19T04:59:56.936 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.936 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.936 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.936 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T04:59:56.936 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.936 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.936 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.936 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.936 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": { 2024-09-19T04:59:56.936 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pool_name", 2024-09-19T04:59:56.936 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.937 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.937 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.937 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "device_health_metrics", 2024-09-19T04:59:56.937 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.937 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.937 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.937 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T04:59:56.937 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.937 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.937 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.937 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.937 INFO:teuthology.orchestra.run.smithi002.stdout: "retention_period": { 2024-09-19T04:59:56.937 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "retention_period", 2024-09-19T04:59:56.937 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:56.938 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.938 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.938 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15552000", 2024-09-19T04:59:56.938 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.938 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.938 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.938 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long to retain device health metrics", 2024-09-19T04:59:56.938 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.938 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.938 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.938 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.938 INFO:teuthology.orchestra.run.smithi002.stdout: "scrape_frequency": { 2024-09-19T04:59:56.938 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "scrape_frequency", 2024-09-19T04:59:56.938 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:56.939 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.939 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.939 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "86400", 2024-09-19T04:59:56.939 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.939 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.939 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.939 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T04:59:56.939 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.939 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.939 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.939 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.939 INFO:teuthology.orchestra.run.smithi002.stdout: "self_heal": { 2024-09-19T04:59:56.939 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "self_heal", 2024-09-19T04:59:56.940 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.940 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.940 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.940 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:56.940 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.940 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.940 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.940 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T04:59:56.940 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.940 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.940 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.940 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.940 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-19T04:59:56.941 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-19T04:59:56.941 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:56.941 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.941 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.941 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-19T04:59:56.941 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.941 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.941 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.941 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T04:59:56.941 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.941 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.941 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.941 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.942 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_threshold": { 2024-09-19T04:59:56.942 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_threshold", 2024-09-19T04:59:56.942 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:56.942 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.942 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.942 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "7257600", 2024-09-19T04:59:56.942 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.942 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.942 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.942 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T04:59:56.942 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.942 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.942 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.943 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.943 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.943 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.943 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.943 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "diskprediction_local", 2024-09-19T04:59:56.943 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:56.943 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:56.943 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:56.943 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:56.943 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:56.943 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.943 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.943 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.944 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.944 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.944 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.944 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.944 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.944 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.944 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.944 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.944 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.944 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.944 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.944 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.944 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.944 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.945 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.945 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.945 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:56.945 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:56.945 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.945 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.945 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.945 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.945 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.945 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.945 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.945 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.945 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.945 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.946 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.946 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.946 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:56.946 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:56.946 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.946 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.946 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.946 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:56.946 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.946 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.946 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.946 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.946 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.947 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.947 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.947 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.947 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.947 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.947 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.947 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.947 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.947 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.947 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.947 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:56.947 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:56.947 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.948 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.948 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.948 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.948 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.948 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.948 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.948 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.948 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.948 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.948 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.948 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.948 INFO:teuthology.orchestra.run.smithi002.stdout: "predict_interval": { 2024-09-19T04:59:56.948 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "predict_interval", 2024-09-19T04:59:56.949 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.949 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.949 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.949 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "86400", 2024-09-19T04:59:56.949 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.949 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.949 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.949 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.949 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.949 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.949 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.949 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.949 INFO:teuthology.orchestra.run.smithi002.stdout: "predictor_model": { 2024-09-19T04:59:56.949 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "predictor_model", 2024-09-19T04:59:56.950 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.950 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.950 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.950 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "prophetstor", 2024-09-19T04:59:56.950 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.950 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.950 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.950 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.950 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.950 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.950 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.950 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.950 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-19T04:59:56.951 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-19T04:59:56.951 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.951 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.951 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.951 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-19T04:59:56.951 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.951 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.951 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.951 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.951 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.951 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.951 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.951 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.952 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.952 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.952 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.952 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "influx", 2024-09-19T04:59:56.952 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": false, 2024-09-19T04:59:56.952 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "influxdb python module not found", 2024-09-19T04:59:56.952 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:56.952 INFO:teuthology.orchestra.run.smithi002.stdout: "batch_size": { 2024-09-19T04:59:56.952 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "batch_size", 2024-09-19T04:59:56.952 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.952 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.952 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.952 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5000", 2024-09-19T04:59:56.953 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.953 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.953 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.953 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T04:59:56.953 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.953 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.953 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.953 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.953 INFO:teuthology.orchestra.run.smithi002.stdout: "database": { 2024-09-19T04:59:56.953 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "database", 2024-09-19T04:59:56.953 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.953 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.953 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.954 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "ceph", 2024-09-19T04:59:56.954 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.954 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.954 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.954 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T04:59:56.954 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.954 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.954 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.954 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.954 INFO:teuthology.orchestra.run.smithi002.stdout: "hostname": { 2024-09-19T04:59:56.954 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "hostname", 2024-09-19T04:59:56.954 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.954 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.955 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.955 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.955 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.955 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.955 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.955 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB server hostname", 2024-09-19T04:59:56.955 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.955 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.955 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.955 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.955 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-19T04:59:56.955 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-19T04:59:56.955 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:56.956 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.956 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.956 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "30", 2024-09-19T04:59:56.956 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "5", 2024-09-19T04:59:56.956 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.956 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.956 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T04:59:56.956 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.956 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.956 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.956 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.956 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:56.956 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:56.957 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.957 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.957 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.957 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.957 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.957 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.957 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.957 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.957 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.957 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.957 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.957 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.957 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.958 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.958 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.958 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.958 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.958 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.958 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.958 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:56.958 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:56.958 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.958 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.958 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.958 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.958 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.958 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.959 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.959 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.959 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.959 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.959 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.959 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.959 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:56.959 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:56.959 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.959 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.959 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.959 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:56.959 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.959 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.960 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.960 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.960 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.960 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.960 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.960 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.960 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.960 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.960 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.960 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.960 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.960 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.960 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.960 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:56.961 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:56.961 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.961 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.961 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.961 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.961 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.961 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.961 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.961 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.961 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.961 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.961 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.962 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.962 INFO:teuthology.orchestra.run.smithi002.stdout: "password": { 2024-09-19T04:59:56.962 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "password", 2024-09-19T04:59:56.962 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.962 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.962 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.962 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.962 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.962 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.962 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.962 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "password of InfluxDB server user", 2024-09-19T04:59:56.962 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.962 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.962 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.963 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.963 INFO:teuthology.orchestra.run.smithi002.stdout: "port": { 2024-09-19T04:59:56.963 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "port", 2024-09-19T04:59:56.963 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.963 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.963 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.963 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8086", 2024-09-19T04:59:56.963 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.963 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.963 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.963 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB server port", 2024-09-19T04:59:56.963 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.963 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.963 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.964 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.964 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl": { 2024-09-19T04:59:56.964 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl", 2024-09-19T04:59:56.964 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.964 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.964 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.964 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "false", 2024-09-19T04:59:56.964 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.964 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.964 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.964 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T04:59:56.964 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.964 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.965 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.965 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.965 INFO:teuthology.orchestra.run.smithi002.stdout: "threads": { 2024-09-19T04:59:56.965 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "threads", 2024-09-19T04:59:56.965 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.965 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.965 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.965 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-19T04:59:56.965 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-19T04:59:56.965 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "32", 2024-09-19T04:59:56.965 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.965 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T04:59:56.965 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.965 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.965 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.966 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.966 INFO:teuthology.orchestra.run.smithi002.stdout: "username": { 2024-09-19T04:59:56.966 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "username", 2024-09-19T04:59:56.966 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.966 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.966 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.966 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.966 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.966 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.966 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.966 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "username of InfluxDB server user", 2024-09-19T04:59:56.966 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.967 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.967 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.967 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.967 INFO:teuthology.orchestra.run.smithi002.stdout: "verify_ssl": { 2024-09-19T04:59:56.967 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "verify_ssl", 2024-09-19T04:59:56.967 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.967 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.967 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.967 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "true", 2024-09-19T04:59:56.967 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.967 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.967 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.967 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T04:59:56.967 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.968 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.968 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.968 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.968 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.968 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.968 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.968 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "insights", 2024-09-19T04:59:56.968 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:56.968 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:56.968 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:56.968 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:56.968 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:56.968 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.969 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.969 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.969 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.969 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.969 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.969 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.969 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.969 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.969 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.969 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.969 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.969 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.969 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.969 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.970 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.970 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.970 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.970 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.970 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:56.970 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:56.970 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.970 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.970 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.970 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.970 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.970 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.971 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.971 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.971 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.971 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.971 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.971 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.971 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:56.971 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:56.971 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.971 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.971 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.971 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:56.971 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.972 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.972 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.972 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.972 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.972 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.972 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.972 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.972 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.972 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.972 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.972 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.972 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.972 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.973 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.973 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:56.973 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:56.973 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.973 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.973 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.973 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.973 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.973 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.973 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.973 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.973 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.973 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.974 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.974 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.974 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.974 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.974 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.974 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "iostat", 2024-09-19T04:59:56.974 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:56.974 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:56.974 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:56.974 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:56.974 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:56.974 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.974 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.974 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.975 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.975 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.975 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.975 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.975 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.975 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.975 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.975 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.975 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.975 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.975 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.975 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.975 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.976 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.976 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.976 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.976 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:56.976 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:56.976 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.976 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.976 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.976 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.976 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.976 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.976 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.976 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.976 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.977 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.977 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.977 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.977 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:56.977 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:56.977 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.977 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.977 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.977 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:56.977 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.977 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.977 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.977 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.978 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.978 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.978 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.978 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.978 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.978 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.978 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.978 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.978 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.978 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.978 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.978 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:56.978 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:56.979 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.979 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.979 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.979 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.979 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.979 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.979 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.979 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.979 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.979 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.979 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.979 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.979 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.979 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.980 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.980 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "k8sevents", 2024-09-19T04:59:56.980 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:56.980 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:56.980 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:56.980 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_event_retention_days": { 2024-09-19T04:59:56.980 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ceph_event_retention_days", 2024-09-19T04:59:56.980 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.980 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.980 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.980 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "7", 2024-09-19T04:59:56.980 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.980 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.981 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.981 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T04:59:56.981 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.981 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.981 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.981 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.981 INFO:teuthology.orchestra.run.smithi002.stdout: "config_check_secs": { 2024-09-19T04:59:56.981 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_check_secs", 2024-09-19T04:59:56.981 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.981 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.981 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:56.981 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-19T04:59:56.981 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "10", 2024-09-19T04:59:56.981 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.982 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.982 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T04:59:56.982 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.982 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.982 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.982 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.982 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:56.982 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:56.982 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.982 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.982 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.982 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.982 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.983 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.983 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.983 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.983 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.983 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.983 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.983 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.983 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.983 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.983 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.983 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.983 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.983 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.984 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.984 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:56.984 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:56.984 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.984 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.984 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.984 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.984 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.984 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.984 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.984 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.984 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.984 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.985 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.985 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.985 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:56.985 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:56.985 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.985 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.985 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.985 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:56.985 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.985 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.985 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.985 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.985 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.985 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.986 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.986 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.986 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.986 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.986 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.986 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.986 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.986 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.986 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.986 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:56.986 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:56.986 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.986 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.986 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.987 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.987 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.987 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.987 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.987 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.987 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.987 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.987 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.987 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.987 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.987 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.987 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.987 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "localpool", 2024-09-19T04:59:56.988 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:56.988 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:56.988 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:56.988 INFO:teuthology.orchestra.run.smithi002.stdout: "failure_domain": { 2024-09-19T04:59:56.988 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "failure_domain", 2024-09-19T04:59:56.988 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.988 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.988 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.988 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "host", 2024-09-19T04:59:56.988 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.988 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.988 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.988 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "failure domain for any created local pool", 2024-09-19T04:59:56.988 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T04:59:56.989 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.989 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.989 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.989 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:56.989 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:56.989 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.989 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.989 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.989 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.989 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.989 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.989 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.989 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.989 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.990 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.990 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.990 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.990 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.990 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.990 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.990 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.990 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.990 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.990 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.990 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:56.990 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:56.990 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.991 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.991 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.991 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.991 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.991 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.991 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.991 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.991 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.991 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.991 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.991 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.991 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:56.991 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:56.991 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.992 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.992 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.992 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:56.992 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.992 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.992 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:56.992 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:56.992 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:56.992 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:56.992 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:56.992 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:56.992 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:56.992 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:56.993 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.993 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.993 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.993 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.993 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.993 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:56.993 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:56.993 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:56.993 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.993 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.993 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:56.993 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.993 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.993 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.994 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:56.994 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.994 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.994 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.994 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.994 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": { 2024-09-19T04:59:56.994 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "min_size", 2024-09-19T04:59:56.994 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.994 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.994 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.994 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.994 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.994 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.994 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.994 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default min_size for any created local pool", 2024-09-19T04:59:56.995 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T04:59:56.995 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.995 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.995 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.995 INFO:teuthology.orchestra.run.smithi002.stdout: "num_rep": { 2024-09-19T04:59:56.995 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "num_rep", 2024-09-19T04:59:56.995 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.995 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.995 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.995 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3", 2024-09-19T04:59:56.996 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.996 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.996 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.996 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default replica count for any created local pool", 2024-09-19T04:59:56.996 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.996 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.996 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.996 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.996 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": { 2024-09-19T04:59:56.996 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pg_num", 2024-09-19T04:59:56.996 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:56.996 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.996 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.997 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "128", 2024-09-19T04:59:56.997 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.997 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.997 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.997 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T04:59:56.997 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.997 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.997 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.997 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.997 INFO:teuthology.orchestra.run.smithi002.stdout: "prefix": { 2024-09-19T04:59:56.997 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prefix", 2024-09-19T04:59:56.997 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.997 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.997 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.998 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:56.998 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.998 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.998 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.998 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "name prefix for any created local pool", 2024-09-19T04:59:56.998 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:56.998 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.998 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.998 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.998 INFO:teuthology.orchestra.run.smithi002.stdout: "subtree": { 2024-09-19T04:59:56.998 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "subtree", 2024-09-19T04:59:56.998 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:56.998 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:56.999 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:56.999 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "rack", 2024-09-19T04:59:56.999 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:56.999 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:56.999 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:56.999 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T04:59:56.999 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T04:59:56.999 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:56.999 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:56.999 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.999 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:56.999 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:56.999 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:56.999 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mds_autoscaler", 2024-09-19T04:59:57.000 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.000 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.000 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.000 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.000 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.000 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.000 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.000 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.000 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.000 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.000 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.000 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.000 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.001 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.001 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.001 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.001 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.001 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.001 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.001 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.001 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.001 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.001 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.001 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.001 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.001 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.001 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.002 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.002 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.002 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.002 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.002 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.002 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.002 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.002 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.002 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.002 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.002 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.002 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.002 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.003 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.003 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.003 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.003 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.003 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.003 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.003 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.003 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.003 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.003 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.003 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.003 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.003 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.003 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.004 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.004 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.004 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.004 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.004 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.004 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.004 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.004 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.004 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.004 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.004 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.004 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.004 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.005 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.005 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.005 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.005 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.005 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.005 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.005 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.005 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.005 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.005 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mirroring", 2024-09-19T04:59:57.005 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.005 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.005 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.005 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.006 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.006 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.006 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.006 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.006 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.006 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.006 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.006 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.006 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.006 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.006 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.006 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.006 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.006 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.007 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.007 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.007 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.007 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.007 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.007 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.007 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.007 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.007 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.007 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.007 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.007 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.007 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.007 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.008 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.008 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.008 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.008 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.008 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.008 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.008 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.008 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.008 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.008 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.008 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.008 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.008 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.008 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.009 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.009 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.009 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.009 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.009 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.009 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.009 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.009 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.009 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.009 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.009 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.009 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.009 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.009 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.010 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.010 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.010 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.010 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.010 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.010 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.010 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.010 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.010 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.010 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.010 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.010 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.010 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.011 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.011 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.011 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.011 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "nfs", 2024-09-19T04:59:57.011 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.011 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.011 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.011 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.011 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.011 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.011 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.011 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.011 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.011 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.012 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.012 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.012 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.012 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.012 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.012 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.012 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.012 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.012 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.012 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.012 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.012 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.012 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.012 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.013 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.013 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.013 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.013 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.013 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.013 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.013 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.013 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.013 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.013 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.013 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.013 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.013 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.014 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.014 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.014 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.014 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.014 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.014 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.014 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.014 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.014 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.014 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.014 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.014 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.014 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.014 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.015 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.015 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.015 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.015 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.015 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.015 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.015 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.015 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.015 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.015 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.015 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.015 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.015 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.016 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.016 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.016 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.016 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.016 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.016 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.016 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.016 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.016 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.016 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.016 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.016 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.016 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "orchestrator", 2024-09-19T04:59:57.016 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.017 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.017 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.017 INFO:teuthology.orchestra.run.smithi002.stdout: "fail_fs": { 2024-09-19T04:59:57.017 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "fail_fs", 2024-09-19T04:59:57.017 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.017 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.017 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.017 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.017 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.017 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.017 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.017 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T04:59:57.017 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.017 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.018 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.018 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.018 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.018 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.018 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.018 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.018 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.018 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.018 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.018 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.018 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.018 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.018 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.018 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.019 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.019 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.019 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.019 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.019 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.019 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.019 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.019 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.019 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.019 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.019 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.019 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.019 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.019 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.020 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.020 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.020 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.020 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.020 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.020 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.020 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.020 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.020 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.020 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.020 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.020 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.020 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.020 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.021 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.021 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.021 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.021 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.021 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.021 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.021 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.021 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.021 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.021 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.021 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.021 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.021 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.021 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.022 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.022 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.022 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.022 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.022 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.022 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.022 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.022 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.022 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.022 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.022 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.022 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.022 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.022 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.023 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.023 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.023 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator": { 2024-09-19T04:59:57.023 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "orchestrator", 2024-09-19T04:59:57.023 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.023 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.023 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.023 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.023 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.023 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.023 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.023 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm", 2024-09-19T04:59:57.023 INFO:teuthology.orchestra.run.smithi002.stdout: "rook", 2024-09-19T04:59:57.023 INFO:teuthology.orchestra.run.smithi002.stdout: "test_orchestrator" 2024-09-19T04:59:57.024 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.024 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Orchestrator backend", 2024-09-19T04:59:57.024 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.024 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.024 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.024 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.024 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.024 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.024 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.024 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "osd_perf_query", 2024-09-19T04:59:57.024 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.024 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.024 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.025 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.025 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.025 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.025 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.025 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.025 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.025 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.025 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.025 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.025 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.025 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.025 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.025 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.026 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.026 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.026 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.026 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.026 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.026 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.026 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.026 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.026 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.026 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.026 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.026 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.026 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.026 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.027 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.027 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.027 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.027 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.027 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.027 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.027 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.027 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.027 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.027 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.027 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.027 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.027 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.027 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.028 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.028 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.028 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.028 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.028 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.028 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.028 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.028 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.028 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.028 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.028 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.028 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.028 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.029 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.029 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.029 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.029 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.029 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.029 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.029 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.029 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.029 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.029 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.029 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.029 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.029 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.029 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.030 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.030 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.030 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.030 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.030 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.030 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "osd_support", 2024-09-19T04:59:57.030 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.030 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.030 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.030 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.030 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.030 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.030 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.030 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.031 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.031 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.031 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.031 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.031 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.031 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.031 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.031 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.031 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.031 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.031 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.031 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.031 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.031 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.032 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.032 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.032 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.032 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.032 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.032 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.032 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.032 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.032 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.032 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.032 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.032 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.032 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.033 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.033 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.033 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.033 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.033 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.033 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.033 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.033 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.033 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.033 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.033 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.033 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.033 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.033 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.034 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.034 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.034 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.034 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.034 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.034 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.034 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.034 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.034 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.034 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.034 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.034 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.034 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.034 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.035 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.035 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.035 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.035 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.035 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.035 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.035 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.035 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.035 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.035 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.035 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.035 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.035 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.035 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pg_autoscaler", 2024-09-19T04:59:57.036 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.036 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.036 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.036 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.036 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.036 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.036 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.036 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.036 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.036 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.036 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.036 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.036 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.036 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.037 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.037 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.037 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.037 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.037 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.037 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.037 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.037 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.037 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.037 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.037 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.037 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.037 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.037 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.038 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.038 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.038 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.038 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.038 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.038 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.038 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.038 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.038 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.038 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.038 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.038 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.038 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.039 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.039 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.039 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.039 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.039 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.039 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.039 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.039 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.039 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.039 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.039 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.039 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.039 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.039 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.040 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.040 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.040 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.040 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.040 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.040 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.040 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.040 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.040 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.040 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.040 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.040 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.040 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.041 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.041 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.041 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.041 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.041 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.041 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-19T04:59:57.041 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-19T04:59:57.041 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:57.041 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.041 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.041 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-19T04:59:57.043 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.044 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.044 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.044 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.044 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.044 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.044 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.044 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.044 INFO:teuthology.orchestra.run.smithi002.stdout: "threshold": { 2024-09-19T04:59:57.044 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "threshold", 2024-09-19T04:59:57.044 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-19T04:59:57.044 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.044 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.044 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3.0", 2024-09-19T04:59:57.045 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1.0", 2024-09-19T04:59:57.045 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.045 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.045 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "scaling threshold", 2024-09-19T04:59:57.045 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T04:59:57.045 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.045 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.045 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.045 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.045 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.045 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.045 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "progress", 2024-09-19T04:59:57.045 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.045 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.046 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.046 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_pg_recovery_event": { 2024-09-19T04:59:57.046 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_pg_recovery_event", 2024-09-19T04:59:57.046 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.046 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.046 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.046 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.046 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.046 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.046 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.046 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T04:59:57.046 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.046 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.046 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.047 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.047 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": { 2024-09-19T04:59:57.047 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enabled", 2024-09-19T04:59:57.047 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.047 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.047 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.047 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:57.047 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.047 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.047 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.047 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.047 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.047 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.047 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.048 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.048 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.048 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.048 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.048 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.048 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.048 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.048 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.048 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.048 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.048 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.048 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.048 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.049 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.049 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.049 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.049 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.049 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.049 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.049 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.049 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.049 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.049 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.049 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.049 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.049 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.049 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.050 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.050 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.050 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.050 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.050 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.050 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.050 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.050 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.050 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.050 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.050 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.050 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.050 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.050 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.050 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.051 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.051 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.051 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.051 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.051 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.051 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.051 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.051 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.051 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.051 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.051 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.051 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.051 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.052 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.052 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.052 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.052 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.052 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.052 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.052 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.052 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.052 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.052 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.052 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.052 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.052 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.053 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.053 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.053 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.053 INFO:teuthology.orchestra.run.smithi002.stdout: "max_completed_events": { 2024-09-19T04:59:57.053 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_completed_events", 2024-09-19T04:59:57.053 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.053 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.053 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.053 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "50", 2024-09-19T04:59:57.053 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.053 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.053 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.053 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "number of past completed events to remember", 2024-09-19T04:59:57.053 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.053 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.054 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.054 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.054 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-19T04:59:57.054 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-19T04:59:57.054 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:57.054 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.054 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.054 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-19T04:59:57.054 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.054 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.054 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.054 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long the module is going to sleep", 2024-09-19T04:59:57.054 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.055 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.055 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.055 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.055 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.055 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.055 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.055 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prometheus", 2024-09-19T04:59:57.055 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.055 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.055 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.055 INFO:teuthology.orchestra.run.smithi002.stdout: "cache": { 2024-09-19T04:59:57.055 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cache", 2024-09-19T04:59:57.055 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.055 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.056 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.056 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:57.056 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.056 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.056 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.056 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.056 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.056 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.056 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.056 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.056 INFO:teuthology.orchestra.run.smithi002.stdout: "exclude_perf_counters": { 2024-09-19T04:59:57.056 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "exclude_perf_counters", 2024-09-19T04:59:57.056 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.056 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.057 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.057 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:57.057 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.057 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.057 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.057 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T04:59:57.057 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T04:59:57.057 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.057 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.057 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.057 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.057 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.057 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.058 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.058 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.058 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.058 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.058 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.058 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.058 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.058 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.058 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.058 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.058 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.058 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.058 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.058 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.059 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.059 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.059 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.059 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.059 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.059 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.059 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.059 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.059 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.059 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.059 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.059 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.059 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.060 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.060 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.060 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.060 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.060 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.060 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.060 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.060 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.060 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.060 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.060 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.060 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.060 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.060 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.061 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.061 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.061 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.061 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.061 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.061 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.061 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.061 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.061 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.061 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.061 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.061 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.061 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.061 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.062 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.062 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.062 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.062 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.062 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.062 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.062 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.062 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.062 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.062 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.062 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.062 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.062 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_stats_pools": { 2024-09-19T04:59:57.062 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_stats_pools", 2024-09-19T04:59:57.063 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.063 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.063 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.063 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.063 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.063 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.063 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.063 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.063 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.063 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.063 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.063 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.063 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T04:59:57.063 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T04:59:57.064 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.064 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.064 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.064 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "300", 2024-09-19T04:59:57.064 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.064 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.064 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.064 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.064 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.064 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.064 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.064 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.064 INFO:teuthology.orchestra.run.smithi002.stdout: "scrape_interval": { 2024-09-19T04:59:57.064 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "scrape_interval", 2024-09-19T04:59:57.065 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-19T04:59:57.065 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.065 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.065 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15.0", 2024-09-19T04:59:57.065 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.065 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.065 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.065 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.065 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.065 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.065 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.065 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.065 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-09-19T04:59:57.065 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-09-19T04:59:57.066 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.066 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.066 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.066 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "::", 2024-09-19T04:59:57.066 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.066 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.066 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.066 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T04:59:57.066 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.066 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.066 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.066 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.066 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-09-19T04:59:57.066 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-09-19T04:59:57.067 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.067 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.067 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.067 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "9283", 2024-09-19T04:59:57.067 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.067 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.067 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.067 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T04:59:57.067 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.067 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.067 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.067 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.067 INFO:teuthology.orchestra.run.smithi002.stdout: "stale_cache_strategy": { 2024-09-19T04:59:57.068 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "stale_cache_strategy", 2024-09-19T04:59:57.068 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.068 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.068 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.068 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "log", 2024-09-19T04:59:57.068 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.068 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.068 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.068 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.068 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.068 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.068 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.068 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.069 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_behaviour": { 2024-09-19T04:59:57.069 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_behaviour", 2024-09-19T04:59:57.069 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.069 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.069 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.069 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "default", 2024-09-19T04:59:57.069 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.069 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.069 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.069 INFO:teuthology.orchestra.run.smithi002.stdout: "default", 2024-09-19T04:59:57.069 INFO:teuthology.orchestra.run.smithi002.stdout: "error" 2024-09-19T04:59:57.069 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.069 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.069 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.069 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.070 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.070 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.070 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_error_status_code": { 2024-09-19T04:59:57.070 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_error_status_code", 2024-09-19T04:59:57.070 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.070 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.070 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.070 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-09-19T04:59:57.070 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "400", 2024-09-19T04:59:57.070 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "599", 2024-09-19T04:59:57.070 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.070 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.070 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.070 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.071 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.071 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.071 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.071 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.071 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.071 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_support", 2024-09-19T04:59:57.071 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.071 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.071 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.071 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.071 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.071 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.071 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.071 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.072 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.072 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.072 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.072 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.072 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.072 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.072 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.072 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.072 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.072 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.072 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.072 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.072 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.072 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.073 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.073 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.073 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.073 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.073 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.073 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.073 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.073 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.073 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.073 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.073 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.073 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.074 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.074 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.074 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.074 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.074 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.074 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.074 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.074 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.074 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.074 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.074 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.074 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.074 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.074 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.075 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.075 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.075 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.075 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.075 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.075 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.075 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.075 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.075 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.075 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.075 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.075 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.075 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.076 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.076 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.076 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.076 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.076 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.076 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.076 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.076 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.076 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.076 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.076 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.076 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.076 INFO:teuthology.orchestra.run.smithi002.stdout: "max_concurrent_snap_create": { 2024-09-19T04:59:57.076 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_concurrent_snap_create", 2024-09-19T04:59:57.077 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.077 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.077 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.077 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-19T04:59:57.077 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.077 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.077 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.077 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.077 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.077 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.077 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.077 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.077 INFO:teuthology.orchestra.run.smithi002.stdout: "mirror_snapshot_schedule": { 2024-09-19T04:59:57.077 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T04:59:57.078 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.078 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.078 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.078 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.078 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.078 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.078 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.078 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.078 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.078 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.078 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.078 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.078 INFO:teuthology.orchestra.run.smithi002.stdout: "trash_purge_schedule": { 2024-09-19T04:59:57.078 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "trash_purge_schedule", 2024-09-19T04:59:57.079 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.079 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.079 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.079 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.079 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.079 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.079 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.079 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.079 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.079 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.079 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.079 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.079 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.080 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.080 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.080 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "restful", 2024-09-19T04:59:57.080 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.080 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.080 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.080 INFO:teuthology.orchestra.run.smithi002.stdout: "enable_auth": { 2024-09-19T04:59:57.080 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enable_auth", 2024-09-19T04:59:57.080 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.080 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.080 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.080 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:57.080 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.080 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.081 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.081 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.081 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.081 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.081 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.081 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.081 INFO:teuthology.orchestra.run.smithi002.stdout: "key_file": { 2024-09-19T04:59:57.081 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "key_file", 2024-09-19T04:59:57.081 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.081 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.081 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.081 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.081 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.081 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.082 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.082 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.082 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.082 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.082 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.082 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.082 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.082 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.082 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.082 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.082 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.082 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.082 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.083 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.083 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.083 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.083 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.083 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.083 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.083 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.083 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.083 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.083 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.083 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.083 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.083 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.084 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.084 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.084 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.084 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.084 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.084 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.084 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.084 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.084 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.084 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.084 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.084 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.084 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.085 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.085 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.085 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.085 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.085 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.085 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.085 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.085 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.085 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.085 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.085 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.085 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.085 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.085 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.086 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.086 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.086 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.086 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.086 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.086 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.086 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.086 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.086 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.086 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.086 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.086 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.086 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.087 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.087 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.087 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.087 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.087 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.087 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.087 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.087 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.087 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.087 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.087 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-09-19T04:59:57.087 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-09-19T04:59:57.087 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.088 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.088 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.088 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.088 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.088 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.088 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.088 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.088 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.088 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.088 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.088 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.088 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-09-19T04:59:57.088 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-09-19T04:59:57.088 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.089 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.089 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.089 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.089 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.089 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.089 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.089 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.089 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.089 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.089 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.089 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.089 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.089 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.089 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.090 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rgw", 2024-09-19T04:59:57.090 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.090 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.090 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.090 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.090 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.090 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.090 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.090 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.090 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.090 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.090 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.090 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.090 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.091 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.091 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.091 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.091 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.091 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.091 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.091 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.091 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.091 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.091 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.091 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.091 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.091 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.091 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.092 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.092 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.092 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.092 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.092 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.092 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.092 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.092 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.092 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.092 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.092 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.092 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.092 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.093 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.093 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.093 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.093 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.093 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.093 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.093 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.093 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.093 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.093 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.093 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.093 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.093 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.093 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.094 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.094 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.094 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.094 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.094 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.094 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.094 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.094 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.094 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.094 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.094 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.094 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.094 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.094 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.095 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.095 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.095 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.095 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.095 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.095 INFO:teuthology.orchestra.run.smithi002.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T04:59:57.095 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T04:59:57.095 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.095 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.095 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.095 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-19T04:59:57.095 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.095 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.096 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.096 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T04:59:57.096 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.096 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.096 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.096 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.096 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.096 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.096 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.096 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rook", 2024-09-19T04:59:57.096 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.096 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.097 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.097 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.097 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.097 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.097 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.097 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.097 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.097 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.097 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.097 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.097 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.097 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.097 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.097 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.098 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.098 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.098 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.098 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.098 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.098 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.098 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.098 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.098 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.098 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.098 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.098 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.099 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.099 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.099 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.099 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.099 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.099 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.099 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.099 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.099 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.099 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.099 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.099 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.099 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.099 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.100 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.100 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.100 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.100 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.100 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.100 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.100 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.100 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.100 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.100 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.100 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.100 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.100 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.101 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.101 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.101 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.101 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.101 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.101 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.101 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.101 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.101 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.101 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.101 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.101 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.101 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.102 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.102 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.102 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.102 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.102 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.102 INFO:teuthology.orchestra.run.smithi002.stdout: "storage_class": { 2024-09-19T04:59:57.102 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "storage_class", 2024-09-19T04:59:57.102 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.102 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.102 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.102 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "local", 2024-09-19T04:59:57.102 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.102 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.103 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.103 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T04:59:57.103 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.103 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.103 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.103 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.103 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.103 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.103 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.103 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "selftest", 2024-09-19T04:59:57.103 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.103 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.103 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.104 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.104 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.104 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.104 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.104 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.104 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.104 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.104 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.104 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.104 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.104 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.104 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.104 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.104 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.105 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.105 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.105 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.105 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.105 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.105 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.105 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.105 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.105 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.105 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.105 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.105 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.105 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.106 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.106 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.106 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.106 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.106 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.106 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.106 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.106 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.106 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.106 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.106 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.106 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.106 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.106 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.107 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.107 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.107 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.107 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.107 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.107 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.107 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.107 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.107 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.107 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.107 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.107 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.108 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.108 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.108 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.108 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.108 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.108 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.108 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.108 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.108 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.108 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.108 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.108 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.108 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.108 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.109 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.109 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.109 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.109 INFO:teuthology.orchestra.run.smithi002.stdout: "roption1": { 2024-09-19T04:59:57.109 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "roption1", 2024-09-19T04:59:57.109 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.109 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.109 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.109 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.109 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.109 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.109 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.110 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.110 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.110 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.110 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.110 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.110 INFO:teuthology.orchestra.run.smithi002.stdout: "roption2": { 2024-09-19T04:59:57.110 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "roption2", 2024-09-19T04:59:57.110 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.110 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.110 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.110 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "xyz", 2024-09-19T04:59:57.110 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.110 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.110 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.111 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.111 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.111 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.111 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.111 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.111 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption1": { 2024-09-19T04:59:57.111 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption1", 2024-09-19T04:59:57.111 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.111 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.111 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.111 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.111 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.111 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.112 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.112 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.112 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.112 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.112 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.112 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.112 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption2": { 2024-09-19T04:59:57.112 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption2", 2024-09-19T04:59:57.112 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.112 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.112 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.112 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.112 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.113 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.113 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.113 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.113 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.113 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.113 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.113 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.113 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption3": { 2024-09-19T04:59:57.113 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption3", 2024-09-19T04:59:57.113 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-19T04:59:57.113 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.113 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.113 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.114 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.114 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.114 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.114 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.114 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.114 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.114 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.114 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.114 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption4": { 2024-09-19T04:59:57.114 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption4", 2024-09-19T04:59:57.114 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.114 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.114 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.114 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.115 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.115 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.115 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.115 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.115 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.115 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.115 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.115 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.115 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption5": { 2024-09-19T04:59:57.115 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption5", 2024-09-19T04:59:57.115 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.115 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.115 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.116 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.116 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.116 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.116 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.116 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.116 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.116 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.116 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.116 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.116 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption6": { 2024-09-19T04:59:57.116 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption6", 2024-09-19T04:59:57.116 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.116 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.117 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.117 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:57.117 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.117 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.117 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.117 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.117 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.117 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.117 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.117 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.117 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption7": { 2024-09-19T04:59:57.117 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption7", 2024-09-19T04:59:57.117 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.117 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.118 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.118 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.118 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-19T04:59:57.118 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "42", 2024-09-19T04:59:57.118 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.118 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.118 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.118 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.118 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.118 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.118 INFO:teuthology.orchestra.run.smithi002.stdout: "testkey": { 2024-09-19T04:59:57.118 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testkey", 2024-09-19T04:59:57.118 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.118 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.119 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.119 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.119 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.119 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.119 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.119 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.119 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.119 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.119 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.119 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.119 INFO:teuthology.orchestra.run.smithi002.stdout: "testlkey": { 2024-09-19T04:59:57.119 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testlkey", 2024-09-19T04:59:57.119 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.120 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.120 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.120 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.120 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.120 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.120 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.120 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.120 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.120 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.120 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.120 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.120 INFO:teuthology.orchestra.run.smithi002.stdout: "testnewline": { 2024-09-19T04:59:57.120 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testnewline", 2024-09-19T04:59:57.120 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.121 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.121 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.121 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.121 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.121 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.121 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.121 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.121 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.121 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.121 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.121 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.121 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.121 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.121 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.122 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snap_schedule", 2024-09-19T04:59:57.122 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.122 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.122 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.122 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_m_granularity": { 2024-09-19T04:59:57.122 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_m_granularity", 2024-09-19T04:59:57.122 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.122 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.122 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.122 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.122 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.122 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.122 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.122 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T04:59:57.123 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.123 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.123 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.123 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.123 INFO:teuthology.orchestra.run.smithi002.stdout: "dump_on_update": { 2024-09-19T04:59:57.123 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "dump_on_update", 2024-09-19T04:59:57.123 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.123 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.123 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.123 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.123 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.123 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.123 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.123 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "dump database to debug log on update", 2024-09-19T04:59:57.124 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.124 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.124 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.124 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.124 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.124 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.124 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.124 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.124 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.124 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.124 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.124 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.124 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.125 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.125 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.125 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.125 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.125 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.125 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.125 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.125 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.125 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.125 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.125 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.125 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.125 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.126 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.126 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.126 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.126 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.126 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.126 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.126 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.126 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.126 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.126 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.126 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.126 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.126 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.126 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.127 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.127 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.127 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.127 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.127 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.127 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.127 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.127 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.127 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.127 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.127 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.127 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.127 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.127 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.128 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.128 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.128 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.128 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.128 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.128 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.128 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.128 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.128 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.128 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.128 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.128 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.128 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.128 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.129 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.129 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.129 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.129 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.129 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.129 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.129 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.129 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.129 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.129 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "stats", 2024-09-19T04:59:57.129 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.129 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.129 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.130 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.130 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.130 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.130 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.130 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.130 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.130 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.130 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.130 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.130 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.130 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.130 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.130 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.130 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.131 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.131 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.131 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.131 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.131 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.131 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.131 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.131 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.131 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.131 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.131 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.131 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.131 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.131 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.132 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.132 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.132 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.132 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.132 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.132 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.132 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.132 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.132 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.132 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.132 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.132 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.132 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.133 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.133 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.133 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.133 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.133 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.133 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.133 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.133 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.133 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.133 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.133 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.133 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.133 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.133 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.134 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.134 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.134 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.134 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.134 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.134 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.134 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.134 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.134 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.134 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.134 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.134 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.134 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.135 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.135 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.135 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.135 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.135 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.135 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "status", 2024-09-19T04:59:57.135 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.135 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.135 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.135 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.135 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.135 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.135 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.135 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.136 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.136 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.136 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.136 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.136 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.136 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.136 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.136 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.136 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.136 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.136 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.136 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.136 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.136 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.137 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.137 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.137 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.137 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.137 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.137 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.137 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.137 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.137 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.137 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.137 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.137 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.137 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.138 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.138 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.138 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.138 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.138 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.138 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.138 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.138 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.138 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.138 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.138 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.138 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.138 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.138 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.139 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.139 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.139 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.139 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.139 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.139 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.139 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.139 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.139 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.139 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.139 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.139 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.139 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.139 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.140 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.140 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.140 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.140 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.140 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.140 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.140 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.140 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.140 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.140 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.140 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.140 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.140 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.141 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "telegraf", 2024-09-19T04:59:57.141 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.141 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.141 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.141 INFO:teuthology.orchestra.run.smithi002.stdout: "address": { 2024-09-19T04:59:57.141 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "address", 2024-09-19T04:59:57.141 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.141 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.141 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.141 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T04:59:57.141 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.141 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.141 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.141 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.142 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.142 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.142 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.142 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.142 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-19T04:59:57.142 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-19T04:59:57.142 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:57.142 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.142 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.142 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15", 2024-09-19T04:59:57.142 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.142 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.142 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.143 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.143 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.143 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.143 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.143 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.143 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.143 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.143 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.143 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.143 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.143 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.143 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.143 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.144 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.144 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.144 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.144 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.144 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.144 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.144 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.144 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.144 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.144 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.144 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.144 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.144 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.145 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.145 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.145 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.145 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.145 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.145 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.145 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.145 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.145 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.145 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.145 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.145 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.145 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.145 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.146 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.146 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.146 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.146 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.146 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.146 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.146 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.146 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.146 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.146 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.146 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.146 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.146 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.146 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.147 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.147 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.147 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.147 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.147 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.147 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.147 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.147 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.147 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.147 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.147 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.147 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.147 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.147 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.148 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.148 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.148 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.148 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.148 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.148 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.148 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.148 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.148 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.148 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.148 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "telemetry", 2024-09-19T04:59:57.148 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.149 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.149 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.149 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_basic": { 2024-09-19T04:59:57.149 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_basic", 2024-09-19T04:59:57.149 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.149 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.149 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.149 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:57.149 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.149 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.149 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.149 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T04:59:57.149 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.149 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.150 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.150 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.150 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_crash": { 2024-09-19T04:59:57.150 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_crash", 2024-09-19T04:59:57.150 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.150 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.150 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.150 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:57.150 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.150 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.150 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.150 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T04:59:57.150 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.150 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.151 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.151 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.151 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_device": { 2024-09-19T04:59:57.151 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_device", 2024-09-19T04:59:57.151 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.151 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.151 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.151 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:57.151 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.151 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.151 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.151 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T04:59:57.151 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.152 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.152 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.152 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.152 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_ident": { 2024-09-19T04:59:57.152 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_ident", 2024-09-19T04:59:57.152 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.152 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.152 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.153 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.153 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.153 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.153 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.153 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T04:59:57.153 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.153 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.153 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.153 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.153 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_perf": { 2024-09-19T04:59:57.153 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_perf", 2024-09-19T04:59:57.153 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.153 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.154 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.154 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.154 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.154 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.154 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.154 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T04:59:57.154 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.154 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.154 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.154 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.155 INFO:teuthology.orchestra.run.smithi002.stdout: "contact": { 2024-09-19T04:59:57.155 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "contact", 2024-09-19T04:59:57.155 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.155 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.155 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.155 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.155 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.155 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.155 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.155 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.155 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.156 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.156 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.156 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.156 INFO:teuthology.orchestra.run.smithi002.stdout: "description": { 2024-09-19T04:59:57.156 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "description", 2024-09-19T04:59:57.156 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.156 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.156 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.156 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.157 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.157 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.157 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.157 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.157 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.157 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.157 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.157 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.157 INFO:teuthology.orchestra.run.smithi002.stdout: "device_url": { 2024-09-19T04:59:57.157 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_url", 2024-09-19T04:59:57.158 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.158 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.158 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.158 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T04:59:57.158 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.158 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.158 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.158 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.158 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.158 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.158 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.158 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.158 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": { 2024-09-19T04:59:57.158 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enabled", 2024-09-19T04:59:57.159 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.159 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.159 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.159 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.159 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.159 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.159 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.159 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.159 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.159 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.159 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.159 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.159 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-19T04:59:57.159 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-19T04:59:57.160 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.160 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.160 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.160 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "24", 2024-09-19T04:59:57.160 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "8", 2024-09-19T04:59:57.160 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.160 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.160 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.160 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.160 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.160 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.160 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.160 INFO:teuthology.orchestra.run.smithi002.stdout: "last_opt_revision": { 2024-09-19T04:59:57.161 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "last_opt_revision", 2024-09-19T04:59:57.161 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.161 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.161 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.161 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1", 2024-09-19T04:59:57.161 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.161 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.161 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.161 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.161 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.161 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.161 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.161 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.161 INFO:teuthology.orchestra.run.smithi002.stdout: "leaderboard": { 2024-09-19T04:59:57.162 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "leaderboard", 2024-09-19T04:59:57.162 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.162 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.162 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.162 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.162 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.162 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.162 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.162 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.162 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.162 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.162 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.162 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.163 INFO:teuthology.orchestra.run.smithi002.stdout: "leaderboard_description": { 2024-09-19T04:59:57.163 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "leaderboard_description", 2024-09-19T04:59:57.163 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.163 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.163 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.163 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.163 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.163 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.163 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.163 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.163 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.163 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.163 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.163 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.164 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.164 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.164 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.164 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.164 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.164 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.164 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.164 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.164 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.164 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.164 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.164 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.164 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.164 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.165 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.165 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.165 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.165 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.165 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.165 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.165 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.165 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.165 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.165 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.165 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.165 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.165 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.166 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.166 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.166 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.166 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.166 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.166 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.166 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.166 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.166 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.166 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.166 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.166 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.166 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.166 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.167 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.167 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.167 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.167 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.167 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.167 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.167 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.167 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.167 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.167 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.167 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.167 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.167 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.168 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.168 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.168 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.168 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.168 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.168 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.168 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.168 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.168 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.168 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.168 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.168 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.168 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.168 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.169 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.169 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.169 INFO:teuthology.orchestra.run.smithi002.stdout: "organization": { 2024-09-19T04:59:57.169 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "organization", 2024-09-19T04:59:57.169 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.169 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.169 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.169 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.169 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.169 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.169 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.169 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.169 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.170 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.170 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.170 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.170 INFO:teuthology.orchestra.run.smithi002.stdout: "proxy": { 2024-09-19T04:59:57.170 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "proxy", 2024-09-19T04:59:57.170 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.170 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.170 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.170 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.170 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.170 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.170 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.170 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.171 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.171 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.171 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.171 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.171 INFO:teuthology.orchestra.run.smithi002.stdout: "url": { 2024-09-19T04:59:57.171 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "url", 2024-09-19T04:59:57.171 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.171 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.171 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.171 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T04:59:57.171 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.171 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.171 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.171 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.172 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.172 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.172 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.172 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.172 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.172 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.172 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.172 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "test_orchestrator", 2024-09-19T04:59:57.172 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.172 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.172 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.172 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.172 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.172 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.173 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.173 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.173 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.173 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.173 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.173 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.173 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.173 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.173 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.173 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.173 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.173 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.173 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.174 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.174 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.174 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.174 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.174 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.174 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.174 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.174 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.174 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.174 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.174 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.174 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.174 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.174 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.175 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.175 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.175 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.175 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.175 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.175 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.175 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.175 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.175 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.175 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.175 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.175 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.175 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.175 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.176 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.176 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.176 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.176 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.176 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.176 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.176 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.176 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.176 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.176 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.176 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.176 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.176 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.177 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.177 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.177 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.177 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.177 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.177 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.177 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.177 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.177 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.177 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.177 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.177 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.177 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.177 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.178 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.178 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.178 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "volumes", 2024-09-19T04:59:57.178 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.178 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.178 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.178 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.178 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.178 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.178 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.178 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.178 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.178 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.179 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.179 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.179 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.179 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.179 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.179 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.179 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.179 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.179 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.179 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.179 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.179 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.179 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.179 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.180 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.180 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.180 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.180 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.180 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.180 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.180 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.180 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.180 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.180 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.180 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.180 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.180 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.181 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.181 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.181 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.181 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.181 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.181 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.181 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.181 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.181 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.181 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.181 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.181 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.181 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.181 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.182 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.182 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.182 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.182 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.182 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.182 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.182 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.182 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.182 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.182 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.182 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.182 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.182 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.182 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.183 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.183 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.183 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.183 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.183 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.183 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.183 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.183 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.183 INFO:teuthology.orchestra.run.smithi002.stdout: "max_concurrent_clones": { 2024-09-19T04:59:57.183 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_concurrent_clones", 2024-09-19T04:59:57.183 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.183 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.183 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.183 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "4", 2024-09-19T04:59:57.184 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.184 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.184 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.184 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T04:59:57.184 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.184 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.184 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.184 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.184 INFO:teuthology.orchestra.run.smithi002.stdout: "periodic_async_work": { 2024-09-19T04:59:57.184 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "periodic_async_work", 2024-09-19T04:59:57.184 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.184 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.184 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.185 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.185 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.185 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.185 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.185 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Periodically check for async work", 2024-09-19T04:59:57.185 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.185 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.185 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.185 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.185 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot_clone_delay": { 2024-09-19T04:59:57.185 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snapshot_clone_delay", 2024-09-19T04:59:57.185 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.185 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.185 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.186 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-19T04:59:57.186 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.186 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.186 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.186 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T04:59:57.186 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.186 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.186 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.186 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.186 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot_clone_no_wait": { 2024-09-19T04:59:57.186 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T04:59:57.186 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.186 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.187 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.187 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:57.187 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.187 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.187 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.187 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T04:59:57.187 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.187 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.187 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.187 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.187 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.187 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.187 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.187 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix", 2024-09-19T04:59:57.188 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.188 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.188 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.188 INFO:teuthology.orchestra.run.smithi002.stdout: "discovery_interval": { 2024-09-19T04:59:57.188 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "discovery_interval", 2024-09-19T04:59:57.188 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-19T04:59:57.188 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.188 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.188 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "100", 2024-09-19T04:59:57.188 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.188 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.188 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.188 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.189 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.189 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.189 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.189 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.189 INFO:teuthology.orchestra.run.smithi002.stdout: "identifier": { 2024-09-19T04:59:57.189 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "identifier", 2024-09-19T04:59:57.189 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.189 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.189 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.189 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.189 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.189 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.189 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.190 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.190 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.190 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.190 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.190 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.190 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-19T04:59:57.190 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-19T04:59:57.190 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:57.190 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.190 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.190 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-19T04:59:57.190 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.190 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.190 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.191 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.191 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.191 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.191 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.191 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.191 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.191 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.191 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.191 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.191 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.191 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.191 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.191 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.191 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.192 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.192 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.192 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.192 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.192 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.192 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.192 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.192 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.192 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.192 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.192 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.192 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.192 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.193 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.193 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.193 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.193 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.193 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.193 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.193 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.193 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.193 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.193 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.193 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.193 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.193 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.193 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.194 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.194 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.194 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.194 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.194 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.194 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.194 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.194 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.194 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.194 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.194 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.194 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.194 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.194 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.195 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.195 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.195 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.195 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.195 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.195 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.195 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.195 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.195 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.195 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.195 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.195 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.195 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.195 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.196 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.196 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.196 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.196 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.196 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.196 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.196 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_host": { 2024-09-19T04:59:57.196 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_host", 2024-09-19T04:59:57.196 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.196 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.196 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.196 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.196 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.196 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.197 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.197 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.197 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.197 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.197 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.197 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.197 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_port": { 2024-09-19T04:59:57.197 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_port", 2024-09-19T04:59:57.197 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.197 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.197 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.197 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10051", 2024-09-19T04:59:57.197 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.198 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.198 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.198 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.198 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.198 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.198 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.198 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.198 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_sender": { 2024-09-19T04:59:57.198 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_sender", 2024-09-19T04:59:57.198 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.198 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.198 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.198 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T04:59:57.199 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.199 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.199 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.199 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.199 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.199 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.199 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.199 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.199 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.199 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.199 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-19T04:59:57.199 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.199 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.200 INFO:teuthology.orchestra.run.smithi002.stdout: "modules": [ 2024-09-19T04:59:57.200 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm", 2024-09-19T04:59:57.200 INFO:teuthology.orchestra.run.smithi002.stdout: "dashboard", 2024-09-19T04:59:57.200 INFO:teuthology.orchestra.run.smithi002.stdout: "iostat", 2024-09-19T04:59:57.200 INFO:teuthology.orchestra.run.smithi002.stdout: "nfs", 2024-09-19T04:59:57.200 INFO:teuthology.orchestra.run.smithi002.stdout: "restful", 2024-09-19T04:59:57.200 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_schedule" 2024-09-19T04:59:57.200 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.200 INFO:teuthology.orchestra.run.smithi002.stdout: "available_modules": [ 2024-09-19T04:59:57.200 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.200 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "alerts", 2024-09-19T04:59:57.200 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.201 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.201 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.201 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-19T04:59:57.201 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-19T04:59:57.201 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:57.201 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.201 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.201 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-19T04:59:57.201 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.201 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.201 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.201 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T04:59:57.201 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.201 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.202 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.202 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.202 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.202 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.202 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.202 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.202 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.202 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.202 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.202 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.202 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.202 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.202 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.202 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.203 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.203 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.203 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.203 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.203 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.203 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.203 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.203 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.203 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.203 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.203 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.203 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.203 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.204 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.204 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.204 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.204 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.204 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.204 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.204 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.204 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.204 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.204 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.204 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.204 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.204 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.205 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.205 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.205 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.205 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.205 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.205 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.205 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.205 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.205 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.205 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.205 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.205 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.205 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.206 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.206 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.206 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.206 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.206 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.206 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.206 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.206 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.206 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.206 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.206 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.206 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.206 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.207 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.207 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.207 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.207 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.207 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.207 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.207 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_destination": { 2024-09-19T04:59:57.207 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_destination", 2024-09-19T04:59:57.207 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.207 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.207 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.207 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.207 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.207 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.208 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.208 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Email address to send alerts to", 2024-09-19T04:59:57.208 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.208 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.208 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.208 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.208 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_from_name": { 2024-09-19T04:59:57.208 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_from_name", 2024-09-19T04:59:57.208 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.208 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.208 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.208 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "Ceph", 2024-09-19T04:59:57.208 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.209 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.209 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.209 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Email From: name", 2024-09-19T04:59:57.209 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.209 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.209 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.209 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.209 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_host": { 2024-09-19T04:59:57.209 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_host", 2024-09-19T04:59:57.209 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.209 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.209 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.209 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.210 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.210 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.210 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.210 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP server", 2024-09-19T04:59:57.210 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.210 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.210 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.210 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.210 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_password": { 2024-09-19T04:59:57.210 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_password", 2024-09-19T04:59:57.210 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.210 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.210 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.210 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.211 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.211 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.211 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.211 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Password to authenticate with", 2024-09-19T04:59:57.211 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.211 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.211 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.211 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.211 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_port": { 2024-09-19T04:59:57.211 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_port", 2024-09-19T04:59:57.211 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.211 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.211 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.212 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "465", 2024-09-19T04:59:57.212 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.212 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.212 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.212 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP port", 2024-09-19T04:59:57.212 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.212 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.212 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.212 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.212 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_sender": { 2024-09-19T04:59:57.212 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_sender", 2024-09-19T04:59:57.212 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.212 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.213 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.213 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.213 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.213 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.213 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.213 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP envelope sender", 2024-09-19T04:59:57.213 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.213 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.213 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.213 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.213 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_ssl": { 2024-09-19T04:59:57.213 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_ssl", 2024-09-19T04:59:57.213 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.214 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.214 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.214 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:57.214 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.214 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.214 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.214 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T04:59:57.214 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.214 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.214 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.214 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.214 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_user": { 2024-09-19T04:59:57.214 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_user", 2024-09-19T04:59:57.214 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.215 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.215 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.215 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.215 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.215 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.215 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.215 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "User to authenticate as", 2024-09-19T04:59:57.215 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.215 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.215 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.215 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.215 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.215 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.215 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.216 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "balancer", 2024-09-19T04:59:57.216 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.216 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.216 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.216 INFO:teuthology.orchestra.run.smithi002.stdout: "active": { 2024-09-19T04:59:57.216 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "active", 2024-09-19T04:59:57.216 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.216 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.216 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.216 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:57.216 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.216 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.216 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.217 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T04:59:57.217 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.217 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.217 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.217 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.217 INFO:teuthology.orchestra.run.smithi002.stdout: "begin_time": { 2024-09-19T04:59:57.217 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "begin_time", 2024-09-19T04:59:57.217 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.217 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.217 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.217 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0000", 2024-09-19T04:59:57.217 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.217 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.218 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.218 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T04:59:57.218 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T04:59:57.218 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.218 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.218 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.218 INFO:teuthology.orchestra.run.smithi002.stdout: "begin_weekday": { 2024-09-19T04:59:57.218 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "begin_weekday", 2024-09-19T04:59:57.218 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-19T04:59:57.218 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.218 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.218 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-19T04:59:57.218 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0", 2024-09-19T04:59:57.218 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "6", 2024-09-19T04:59:57.219 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.219 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T04:59:57.219 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T04:59:57.219 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.219 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.219 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.219 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_max_iterations": { 2024-09-19T04:59:57.219 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_max_iterations", 2024-09-19T04:59:57.219 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-19T04:59:57.219 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.219 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.219 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "25", 2024-09-19T04:59:57.219 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-19T04:59:57.219 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "250", 2024-09-19T04:59:57.220 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.220 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T04:59:57.220 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.220 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.220 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.220 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.220 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_metrics": { 2024-09-19T04:59:57.220 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_metrics", 2024-09-19T04:59:57.220 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.220 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.220 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.220 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T04:59:57.220 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.221 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.221 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.221 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T04:59:57.221 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T04:59:57.221 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.221 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.221 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.221 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_step": { 2024-09-19T04:59:57.221 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_step", 2024-09-19T04:59:57.221 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-19T04:59:57.221 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.221 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.221 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0.5", 2024-09-19T04:59:57.222 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0.001", 2024-09-19T04:59:57.222 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "0.999", 2024-09-19T04:59:57.222 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.222 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "aggressiveness of optimization", 2024-09-19T04:59:57.222 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T04:59:57.222 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.222 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.222 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.222 INFO:teuthology.orchestra.run.smithi002.stdout: "end_time": { 2024-09-19T04:59:57.222 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "end_time", 2024-09-19T04:59:57.222 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.222 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.222 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.222 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "2359", 2024-09-19T04:59:57.223 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.223 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.223 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.223 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T04:59:57.223 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T04:59:57.223 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.223 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.223 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.223 INFO:teuthology.orchestra.run.smithi002.stdout: "end_weekday": { 2024-09-19T04:59:57.223 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "end_weekday", 2024-09-19T04:59:57.223 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-19T04:59:57.223 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.223 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.223 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-19T04:59:57.224 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0", 2024-09-19T04:59:57.224 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "6", 2024-09-19T04:59:57.224 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.224 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T04:59:57.224 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T04:59:57.224 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.224 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.224 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.224 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.224 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.224 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.224 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.224 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.224 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.225 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.225 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.225 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.225 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.225 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.225 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.225 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.225 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.225 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.225 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.225 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.225 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.225 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.225 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.226 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.226 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.226 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.226 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.226 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.226 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.226 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.226 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.226 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.226 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.226 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.226 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.226 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.226 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.227 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.227 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.227 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.227 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.227 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.227 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.227 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.227 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.227 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.227 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.227 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.227 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.227 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.227 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.228 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.228 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.228 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.228 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.228 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.228 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.228 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.228 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.228 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.228 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.228 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.228 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.228 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.229 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.229 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.229 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.229 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.229 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.229 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.229 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.229 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.229 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.229 INFO:teuthology.orchestra.run.smithi002.stdout: "min_score": { 2024-09-19T04:59:57.229 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "min_score", 2024-09-19T04:59:57.229 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-19T04:59:57.229 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.230 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.230 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-19T04:59:57.230 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.230 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.230 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.230 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T04:59:57.230 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.230 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.230 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.230 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.230 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": { 2024-09-19T04:59:57.230 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mode", 2024-09-19T04:59:57.230 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.230 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.231 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.231 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "upmap", 2024-09-19T04:59:57.231 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.231 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.231 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.231 INFO:teuthology.orchestra.run.smithi002.stdout: "crush-compat", 2024-09-19T04:59:57.231 INFO:teuthology.orchestra.run.smithi002.stdout: "none", 2024-09-19T04:59:57.231 INFO:teuthology.orchestra.run.smithi002.stdout: "read", 2024-09-19T04:59:57.231 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap", 2024-09-19T04:59:57.231 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap-read" 2024-09-19T04:59:57.231 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.231 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Balancer mode", 2024-09-19T04:59:57.231 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.232 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.232 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.232 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.232 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_ids": { 2024-09-19T04:59:57.232 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pool_ids", 2024-09-19T04:59:57.232 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.232 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.232 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.232 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.232 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.232 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.232 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.232 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T04:59:57.232 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.233 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.233 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.233 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.233 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-19T04:59:57.233 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-19T04:59:57.233 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:57.233 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.233 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.233 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-19T04:59:57.233 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.233 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.233 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.233 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T04:59:57.233 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.234 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.234 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.234 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.234 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap_max_deviation": { 2024-09-19T04:59:57.234 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "upmap_max_deviation", 2024-09-19T04:59:57.234 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.234 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.234 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.234 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-19T04:59:57.234 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-19T04:59:57.234 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.234 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.234 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T04:59:57.235 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T04:59:57.235 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.235 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.235 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.235 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap_max_optimizations": { 2024-09-19T04:59:57.235 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "upmap_max_optimizations", 2024-09-19T04:59:57.235 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-19T04:59:57.235 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.235 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.235 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-19T04:59:57.235 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.235 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.235 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.235 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T04:59:57.236 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.236 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.236 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.236 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.236 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.236 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.236 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.236 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephadm", 2024-09-19T04:59:57.236 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.236 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.236 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.236 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_down_multiplier": { 2024-09-19T04:59:57.236 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_down_multiplier", 2024-09-19T04:59:57.237 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-19T04:59:57.237 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.237 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.237 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3.0", 2024-09-19T04:59:57.237 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.237 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.237 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.237 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T04:59:57.237 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.237 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.237 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.237 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.237 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_refresh_rate": { 2024-09-19T04:59:57.237 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_refresh_rate", 2024-09-19T04:59:57.238 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:57.238 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.238 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.238 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "20", 2024-09-19T04:59:57.238 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.238 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.238 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.238 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T04:59:57.238 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.238 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.238 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.238 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.238 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_starting_port": { 2024-09-19T04:59:57.238 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_starting_port", 2024-09-19T04:59:57.239 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.239 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.239 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.239 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "4721", 2024-09-19T04:59:57.239 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.239 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.239 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.239 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T04:59:57.239 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.239 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.239 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.239 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.239 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_ptrace": { 2024-09-19T04:59:57.239 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_ptrace", 2024-09-19T04:59:57.240 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.240 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.240 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.240 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.240 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.240 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.240 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.240 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T04:59:57.240 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T04:59:57.240 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.240 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.240 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.240 INFO:teuthology.orchestra.run.smithi002.stdout: "autotune_interval": { 2024-09-19T04:59:57.240 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "autotune_interval", 2024-09-19T04:59:57.241 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:57.241 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.241 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.241 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-19T04:59:57.241 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.241 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.241 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.241 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T04:59:57.241 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.241 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.241 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.241 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.241 INFO:teuthology.orchestra.run.smithi002.stdout: "autotune_memory_target_ratio": { 2024-09-19T04:59:57.241 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T04:59:57.242 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-19T04:59:57.242 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.242 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.242 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0.7", 2024-09-19T04:59:57.242 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.242 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.242 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.242 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T04:59:57.242 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.242 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.242 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.242 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.242 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm_log_destination": { 2024-09-19T04:59:57.242 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephadm_log_destination", 2024-09-19T04:59:57.243 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.243 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.243 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.243 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.243 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.243 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.243 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.243 INFO:teuthology.orchestra.run.smithi002.stdout: "file", 2024-09-19T04:59:57.243 INFO:teuthology.orchestra.run.smithi002.stdout: "file,syslog", 2024-09-19T04:59:57.243 INFO:teuthology.orchestra.run.smithi002.stdout: "syslog" 2024-09-19T04:59:57.243 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.243 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T04:59:57.243 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.243 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.244 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.244 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.244 INFO:teuthology.orchestra.run.smithi002.stdout: "cgroups_split": { 2024-09-19T04:59:57.244 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cgroups_split", 2024-09-19T04:59:57.244 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.244 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.244 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.244 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:57.244 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.244 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.244 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.244 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T04:59:57.244 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.245 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.245 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.245 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.245 INFO:teuthology.orchestra.run.smithi002.stdout: "config_checks_enabled": { 2024-09-19T04:59:57.245 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_checks_enabled", 2024-09-19T04:59:57.245 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.245 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.245 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.245 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.245 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.245 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.245 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.245 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T04:59:57.245 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.246 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.246 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.246 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.246 INFO:teuthology.orchestra.run.smithi002.stdout: "config_dashboard": { 2024-09-19T04:59:57.246 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_dashboard", 2024-09-19T04:59:57.246 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.246 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.246 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.246 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:57.246 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.246 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.246 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.246 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T04:59:57.246 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.247 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.247 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.247 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.247 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_alertmanager": { 2024-09-19T04:59:57.247 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_alertmanager", 2024-09-19T04:59:57.247 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.247 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.247 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.247 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T04:59:57.247 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.247 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.247 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.247 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-19T04:59:57.247 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.248 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.248 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.248 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.248 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_base": { 2024-09-19T04:59:57.248 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_base", 2024-09-19T04:59:57.248 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.248 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.248 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.248 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T04:59:57.248 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.248 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.248 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.248 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Container image name, without the tag", 2024-09-19T04:59:57.249 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.249 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.249 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.249 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.249 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_elasticsearch": { 2024-09-19T04:59:57.249 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_elasticsearch", 2024-09-19T04:59:57.249 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.249 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.249 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.249 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T04:59:57.249 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.249 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.249 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.249 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "elasticsearch container image", 2024-09-19T04:59:57.250 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.250 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.250 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.250 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.250 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_grafana": { 2024-09-19T04:59:57.250 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_grafana", 2024-09-19T04:59:57.250 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.250 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.250 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.250 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T04:59:57.250 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.250 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.251 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.251 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-19T04:59:57.251 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.251 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.251 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.251 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.251 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_haproxy": { 2024-09-19T04:59:57.251 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_haproxy", 2024-09-19T04:59:57.251 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.251 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.251 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.251 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T04:59:57.251 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.251 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.252 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.252 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "HAproxy container image", 2024-09-19T04:59:57.252 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.252 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.252 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.252 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.252 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_agent": { 2024-09-19T04:59:57.252 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_agent", 2024-09-19T04:59:57.252 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.252 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.252 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.252 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T04:59:57.252 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.252 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.253 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.253 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger agent container image", 2024-09-19T04:59:57.253 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.253 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.253 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.253 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.253 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_collector": { 2024-09-19T04:59:57.253 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_collector", 2024-09-19T04:59:57.253 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.253 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.253 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.253 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T04:59:57.253 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.254 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.254 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.254 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger collector container image", 2024-09-19T04:59:57.254 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.254 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.254 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.254 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.254 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_query": { 2024-09-19T04:59:57.254 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_query", 2024-09-19T04:59:57.254 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.254 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.254 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.254 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T04:59:57.254 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.255 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.255 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.255 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger query container image", 2024-09-19T04:59:57.255 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.255 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.255 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.255 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.255 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_keepalived": { 2024-09-19T04:59:57.255 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_keepalived", 2024-09-19T04:59:57.255 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.255 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.255 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.255 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T04:59:57.255 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.256 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.256 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.256 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Keepalived container image", 2024-09-19T04:59:57.256 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.256 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.256 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.256 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.256 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_loki": { 2024-09-19T04:59:57.256 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_loki", 2024-09-19T04:59:57.256 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.256 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.256 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.256 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T04:59:57.256 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.257 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.257 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.257 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Loki container image", 2024-09-19T04:59:57.257 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.257 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.257 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.257 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.257 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_node_exporter": { 2024-09-19T04:59:57.257 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_node_exporter", 2024-09-19T04:59:57.257 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.257 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.257 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.257 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T04:59:57.257 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.258 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.258 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.258 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-19T04:59:57.258 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.258 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.258 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.258 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.258 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_nvmeof": { 2024-09-19T04:59:57.258 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_nvmeof", 2024-09-19T04:59:57.258 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.258 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.258 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.258 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T04:59:57.258 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.259 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.259 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.259 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Nvme-of container image", 2024-09-19T04:59:57.259 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.259 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.259 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.259 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.259 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_prometheus": { 2024-09-19T04:59:57.259 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_prometheus", 2024-09-19T04:59:57.259 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.259 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.259 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.259 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T04:59:57.260 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.260 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.260 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.260 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-19T04:59:57.260 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.260 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.260 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.260 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.260 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_promtail": { 2024-09-19T04:59:57.260 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_promtail", 2024-09-19T04:59:57.260 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.260 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.260 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.260 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T04:59:57.261 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.261 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.261 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.261 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Promtail container image", 2024-09-19T04:59:57.261 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.261 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.261 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.261 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.261 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_samba": { 2024-09-19T04:59:57.261 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_samba", 2024-09-19T04:59:57.261 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.261 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.261 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.262 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T04:59:57.262 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.262 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.262 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.262 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Samba/SMB container image", 2024-09-19T04:59:57.262 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.262 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.262 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.262 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.262 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_snmp_gateway": { 2024-09-19T04:59:57.262 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_snmp_gateway", 2024-09-19T04:59:57.262 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.262 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.263 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.263 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T04:59:57.263 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.263 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.263 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.263 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SNMP Gateway container image", 2024-09-19T04:59:57.263 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.263 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.263 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.263 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.263 INFO:teuthology.orchestra.run.smithi002.stdout: "container_init": { 2024-09-19T04:59:57.263 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_init", 2024-09-19T04:59:57.263 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.263 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.264 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.264 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:57.264 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.264 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.264 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.264 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T04:59:57.264 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.264 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.264 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.264 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.264 INFO:teuthology.orchestra.run.smithi002.stdout: "daemon_cache_timeout": { 2024-09-19T04:59:57.264 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "daemon_cache_timeout", 2024-09-19T04:59:57.264 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:57.265 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.265 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.265 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-19T04:59:57.265 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.265 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.265 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.265 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T04:59:57.265 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.265 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.265 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.265 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.265 INFO:teuthology.orchestra.run.smithi002.stdout: "default_cephadm_command_timeout": { 2024-09-19T04:59:57.265 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T04:59:57.265 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.266 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.266 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.266 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "900", 2024-09-19T04:59:57.266 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.266 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.266 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.266 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T04:59:57.266 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.266 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.266 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.266 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.266 INFO:teuthology.orchestra.run.smithi002.stdout: "default_registry": { 2024-09-19T04:59:57.266 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "default_registry", 2024-09-19T04:59:57.266 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.267 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.267 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.267 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io", 2024-09-19T04:59:57.267 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.267 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.267 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.267 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T04:59:57.267 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.267 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.267 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.267 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.267 INFO:teuthology.orchestra.run.smithi002.stdout: "device_cache_timeout": { 2024-09-19T04:59:57.267 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_cache_timeout", 2024-09-19T04:59:57.268 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:57.268 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.268 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.268 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1800", 2024-09-19T04:59:57.268 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.268 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.268 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.268 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache device inventory", 2024-09-19T04:59:57.268 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.268 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.268 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.268 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.268 INFO:teuthology.orchestra.run.smithi002.stdout: "device_enhanced_scan": { 2024-09-19T04:59:57.268 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_enhanced_scan", 2024-09-19T04:59:57.269 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.269 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.269 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.269 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.269 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.269 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.269 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.269 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T04:59:57.269 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.269 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.269 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.269 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.269 INFO:teuthology.orchestra.run.smithi002.stdout: "facts_cache_timeout": { 2024-09-19T04:59:57.269 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "facts_cache_timeout", 2024-09-19T04:59:57.270 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:57.270 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.270 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.270 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-19T04:59:57.270 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.270 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.270 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.270 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache host facts data", 2024-09-19T04:59:57.270 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.270 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.270 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.270 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.270 INFO:teuthology.orchestra.run.smithi002.stdout: "grafana_dashboards_path": { 2024-09-19T04:59:57.270 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "grafana_dashboards_path", 2024-09-19T04:59:57.271 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.271 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.271 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.271 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T04:59:57.271 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.271 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.271 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.271 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T04:59:57.271 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.271 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.271 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.271 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.271 INFO:teuthology.orchestra.run.smithi002.stdout: "host_check_interval": { 2024-09-19T04:59:57.271 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "host_check_interval", 2024-09-19T04:59:57.272 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:57.272 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.272 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.272 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-19T04:59:57.272 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.272 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.272 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.272 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to perform a host check", 2024-09-19T04:59:57.272 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.272 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.272 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.272 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.272 INFO:teuthology.orchestra.run.smithi002.stdout: "hw_monitoring": { 2024-09-19T04:59:57.272 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "hw_monitoring", 2024-09-19T04:59:57.273 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.273 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.273 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.273 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.273 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.273 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.273 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.273 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T04:59:57.273 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.273 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.273 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.273 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.273 INFO:teuthology.orchestra.run.smithi002.stdout: "inventory_list_all": { 2024-09-19T04:59:57.274 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "inventory_list_all", 2024-09-19T04:59:57.274 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.274 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.274 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.274 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.274 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.274 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.274 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.274 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T04:59:57.274 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.274 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.274 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.274 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.274 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.275 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.275 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.275 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.275 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.275 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.275 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.275 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.275 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.275 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.275 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.275 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.275 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.275 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.275 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.276 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.276 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.276 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.276 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.276 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.276 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.276 INFO:teuthology.orchestra.run.smithi002.stdout: "log_refresh_metadata": { 2024-09-19T04:59:57.276 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_refresh_metadata", 2024-09-19T04:59:57.276 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.276 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.276 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.276 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.276 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.277 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.277 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.277 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T04:59:57.277 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.277 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.277 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.277 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.277 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.277 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.277 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.277 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.277 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.277 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:57.278 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.278 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.278 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.278 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T04:59:57.278 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.278 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.278 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.278 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.278 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.278 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.278 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.278 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.278 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.278 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.279 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.279 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.279 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.279 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.279 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.279 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.279 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.279 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.279 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.279 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.279 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.279 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.279 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.279 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.280 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.280 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.280 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.280 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.280 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.280 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.280 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.280 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.280 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.280 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.280 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.280 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.280 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.281 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.281 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.281 INFO:teuthology.orchestra.run.smithi002.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T04:59:57.281 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T04:59:57.281 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.281 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.281 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.281 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.281 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.281 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.281 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.281 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T04:59:57.281 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.281 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.282 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.282 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.282 INFO:teuthology.orchestra.run.smithi002.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T04:59:57.282 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T04:59:57.282 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.282 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.283 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.284 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "*", 2024-09-19T04:59:57.284 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.284 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.284 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.284 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T04:59:57.284 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.284 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.284 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.284 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.284 INFO:teuthology.orchestra.run.smithi002.stdout: "max_count_per_host": { 2024-09-19T04:59:57.284 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_count_per_host", 2024-09-19T04:59:57.285 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.285 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.285 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.285 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-19T04:59:57.285 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.285 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.285 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.285 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "max number of daemons per service per host", 2024-09-19T04:59:57.285 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.285 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.285 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.285 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.285 INFO:teuthology.orchestra.run.smithi002.stdout: "max_osd_draining_count": { 2024-09-19T04:59:57.286 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_osd_draining_count", 2024-09-19T04:59:57.286 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.286 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.286 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.286 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-19T04:59:57.286 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.286 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.286 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.286 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T04:59:57.286 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.286 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.286 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.286 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.286 INFO:teuthology.orchestra.run.smithi002.stdout: "migration_current": { 2024-09-19T04:59:57.287 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "migration_current", 2024-09-19T04:59:57.287 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.287 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.287 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.287 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.287 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.287 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.287 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.287 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "internal - do not modify", 2024-09-19T04:59:57.287 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.287 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.287 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.287 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.288 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": { 2024-09-19T04:59:57.288 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mode", 2024-09-19T04:59:57.288 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.288 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.288 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.288 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "root", 2024-09-19T04:59:57.288 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.288 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.288 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.288 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm-package", 2024-09-19T04:59:57.288 INFO:teuthology.orchestra.run.smithi002.stdout: "root" 2024-09-19T04:59:57.288 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.288 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T04:59:57.289 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.289 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.289 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.289 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.289 INFO:teuthology.orchestra.run.smithi002.stdout: "oob_default_addr": { 2024-09-19T04:59:57.289 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "oob_default_addr", 2024-09-19T04:59:57.289 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.289 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.289 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.289 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "169.254.1.1", 2024-09-19T04:59:57.289 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.289 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.289 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.290 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T04:59:57.290 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.290 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.290 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.290 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.290 INFO:teuthology.orchestra.run.smithi002.stdout: "prometheus_alerts_path": { 2024-09-19T04:59:57.290 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prometheus_alerts_path", 2024-09-19T04:59:57.290 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.290 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.290 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.290 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T04:59:57.290 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.290 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.291 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.291 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T04:59:57.291 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.291 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.291 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.291 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.291 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_insecure": { 2024-09-19T04:59:57.291 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_insecure", 2024-09-19T04:59:57.291 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.291 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.291 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.291 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.291 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.291 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.292 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.292 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T04:59:57.292 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.292 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.292 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.292 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.292 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_password": { 2024-09-19T04:59:57.292 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_password", 2024-09-19T04:59:57.292 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.292 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.292 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.292 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.292 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.293 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.293 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.293 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T04:59:57.293 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.293 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.293 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.293 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.293 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_url": { 2024-09-19T04:59:57.293 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_url", 2024-09-19T04:59:57.293 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.293 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.293 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.294 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.294 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.294 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.294 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.294 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T04:59:57.294 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.294 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.294 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.294 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.294 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_username": { 2024-09-19T04:59:57.294 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_username", 2024-09-19T04:59:57.294 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.294 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.295 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.295 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.295 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.295 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.295 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.295 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T04:59:57.295 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.295 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.295 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.295 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.295 INFO:teuthology.orchestra.run.smithi002.stdout: "secure_monitoring_stack": { 2024-09-19T04:59:57.295 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "secure_monitoring_stack", 2024-09-19T04:59:57.295 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.296 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.296 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.296 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.296 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.296 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.296 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.296 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T04:59:57.296 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.296 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.296 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.296 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.296 INFO:teuthology.orchestra.run.smithi002.stdout: "service_discovery_port": { 2024-09-19T04:59:57.296 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "service_discovery_port", 2024-09-19T04:59:57.297 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.297 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.297 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.297 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8765", 2024-09-19T04:59:57.297 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.297 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.297 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.297 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "cephadm service discovery port", 2024-09-19T04:59:57.297 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.297 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.297 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.297 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.297 INFO:teuthology.orchestra.run.smithi002.stdout: "ssh_config_file": { 2024-09-19T04:59:57.297 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssh_config_file", 2024-09-19T04:59:57.298 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.298 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.298 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.298 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.298 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.298 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.298 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.298 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T04:59:57.298 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.298 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.298 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.298 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.299 INFO:teuthology.orchestra.run.smithi002.stdout: "use_agent": { 2024-09-19T04:59:57.299 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "use_agent", 2024-09-19T04:59:57.299 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.299 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.299 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.299 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.299 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.299 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.299 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.299 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T04:59:57.299 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.299 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.299 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.299 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.300 INFO:teuthology.orchestra.run.smithi002.stdout: "use_repo_digest": { 2024-09-19T04:59:57.300 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "use_repo_digest", 2024-09-19T04:59:57.300 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.300 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.300 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.300 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:57.300 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.300 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.300 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.300 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T04:59:57.300 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.301 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.301 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.301 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.301 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_failed_host_check": { 2024-09-19T04:59:57.301 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_failed_host_check", 2024-09-19T04:59:57.301 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.301 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.301 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.301 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:57.301 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.301 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.301 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.301 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T04:59:57.302 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.302 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.302 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.302 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.302 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_stray_daemons": { 2024-09-19T04:59:57.302 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_stray_daemons", 2024-09-19T04:59:57.302 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.302 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.302 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.302 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:57.302 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.302 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.302 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.303 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T04:59:57.303 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.303 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.303 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.303 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.303 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_stray_hosts": { 2024-09-19T04:59:57.303 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_stray_hosts", 2024-09-19T04:59:57.303 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.303 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.303 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.303 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:57.303 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.303 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.303 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.304 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T04:59:57.304 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.304 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.304 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.304 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.304 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.304 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.304 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.304 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crash", 2024-09-19T04:59:57.304 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.304 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.304 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.305 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.305 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.305 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.305 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.305 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.305 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.305 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.305 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.305 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.305 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.305 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.305 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.305 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.306 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.306 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.306 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.306 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.306 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.306 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.306 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.306 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.306 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.306 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.306 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.306 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.306 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.307 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.307 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.307 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.307 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.307 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.307 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.307 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.307 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.307 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.307 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.307 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.307 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.307 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.307 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.308 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.308 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.308 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.308 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.308 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.308 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.308 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.308 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.308 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.308 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.308 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.308 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.308 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.309 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.309 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.309 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.309 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.309 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.309 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.309 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.309 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.309 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.309 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.309 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.309 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.309 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.310 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.310 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.310 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.310 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.310 INFO:teuthology.orchestra.run.smithi002.stdout: "retain_interval": { 2024-09-19T04:59:57.310 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "retain_interval", 2024-09-19T04:59:57.310 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:57.310 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.310 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.310 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "31536000", 2024-09-19T04:59:57.310 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.310 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.310 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.311 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T04:59:57.311 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.311 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.311 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.311 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.311 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_recent_interval": { 2024-09-19T04:59:57.311 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_recent_interval", 2024-09-19T04:59:57.311 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:57.311 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.311 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.311 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1209600", 2024-09-19T04:59:57.311 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.311 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.312 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.312 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T04:59:57.312 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.312 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.312 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.312 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.312 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.312 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.312 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.312 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "dashboard", 2024-09-19T04:59:57.312 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.312 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.312 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.313 INFO:teuthology.orchestra.run.smithi002.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T04:59:57.313 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T04:59:57.313 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.313 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.313 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.313 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-19T04:59:57.313 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.313 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.313 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.313 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.313 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.313 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.313 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.314 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.314 INFO:teuthology.orchestra.run.smithi002.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T04:59:57.314 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T04:59:57.314 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.314 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.314 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.314 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.314 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.314 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.314 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.314 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.314 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.314 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.314 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.315 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.315 INFO:teuthology.orchestra.run.smithi002.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T04:59:57.315 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T04:59:57.315 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.315 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.315 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.315 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:57.315 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.315 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.315 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.315 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.315 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.315 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.316 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.316 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.316 INFO:teuthology.orchestra.run.smithi002.stdout: "AUDIT_API_ENABLED": { 2024-09-19T04:59:57.316 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T04:59:57.316 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.316 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.316 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.316 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.316 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.316 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.316 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.316 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.316 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.316 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.317 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.317 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.317 INFO:teuthology.orchestra.run.smithi002.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T04:59:57.317 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T04:59:57.317 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.317 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.317 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.317 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:57.317 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.317 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.317 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.317 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.317 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.318 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.318 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.318 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.318 INFO:teuthology.orchestra.run.smithi002.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T04:59:57.318 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T04:59:57.318 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.318 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.318 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.318 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:57.318 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.318 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.318 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.318 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.319 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.319 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.319 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.319 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.319 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T04:59:57.319 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T04:59:57.319 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.319 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.319 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.319 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:57.319 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.319 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.319 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.319 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.320 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.320 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.320 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.320 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.320 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T04:59:57.320 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T04:59:57.320 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.320 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.320 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.320 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:57.320 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.320 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.320 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.321 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.321 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.321 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.321 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.321 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.321 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T04:59:57.321 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T04:59:57.321 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.321 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.321 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.321 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:57.321 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.321 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.322 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.322 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.322 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.322 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.322 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.322 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.322 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T04:59:57.322 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T04:59:57.322 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.322 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.322 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.322 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:57.322 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.322 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.323 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.323 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.323 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.323 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.323 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.323 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.323 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T04:59:57.323 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T04:59:57.323 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.323 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.323 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.323 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:57.323 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.323 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.324 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.324 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.324 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.324 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.324 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.324 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.324 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T04:59:57.324 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T04:59:57.324 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.324 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.324 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.324 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:57.324 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.325 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.325 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.325 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.325 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.325 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.325 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.325 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.325 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T04:59:57.325 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T04:59:57.325 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.325 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.325 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.325 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:57.325 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.326 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.326 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.326 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.326 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.326 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.326 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.326 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.326 INFO:teuthology.orchestra.run.smithi002.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T04:59:57.326 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T04:59:57.326 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.326 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.326 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.326 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.326 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.327 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.327 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.327 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.327 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.327 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.327 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.327 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.327 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T04:59:57.327 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T04:59:57.327 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.327 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.327 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.328 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-09-19T04:59:57.328 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.328 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.328 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.328 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.328 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.328 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.328 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.328 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.328 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T04:59:57.328 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T04:59:57.328 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.328 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.329 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.329 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:57.329 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.329 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.329 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.329 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.329 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.329 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.329 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.329 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.329 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_URL": { 2024-09-19T04:59:57.329 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_URL", 2024-09-19T04:59:57.329 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.330 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.330 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.330 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.330 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.330 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.330 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.330 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.330 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.330 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.330 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.330 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.330 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T04:59:57.330 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T04:59:57.331 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.331 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.331 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.331 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-09-19T04:59:57.331 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.331 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.331 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.331 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.331 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.331 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.331 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.331 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.331 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T04:59:57.332 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T04:59:57.332 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.332 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.332 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.332 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.332 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.332 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.332 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.332 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.332 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.332 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.332 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.332 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.333 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T04:59:57.333 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T04:59:57.333 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.333 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.333 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.333 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.333 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.333 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.333 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.333 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.333 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.333 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.333 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.334 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.334 INFO:teuthology.orchestra.run.smithi002.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T04:59:57.334 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T04:59:57.334 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.334 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.334 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.334 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:57.334 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.334 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.334 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.334 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.334 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.334 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.335 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.335 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.335 INFO:teuthology.orchestra.run.smithi002.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T04:59:57.335 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T04:59:57.335 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.335 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.335 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.335 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.335 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.335 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.335 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.335 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.335 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.335 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.336 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.336 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.336 INFO:teuthology.orchestra.run.smithi002.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T04:59:57.336 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T04:59:57.336 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.336 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.336 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.336 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.336 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.336 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.336 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.336 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.336 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.337 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.337 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.337 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.337 INFO:teuthology.orchestra.run.smithi002.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T04:59:57.337 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T04:59:57.337 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.337 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.337 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.337 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:57.337 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.337 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.337 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.337 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.337 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.338 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.338 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.338 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.338 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T04:59:57.338 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T04:59:57.338 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.338 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.338 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.338 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.338 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.338 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.338 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.338 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.338 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.339 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.339 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.339 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.339 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T04:59:57.339 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T04:59:57.339 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.339 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.339 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.339 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.339 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.339 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.339 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.339 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.340 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.340 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.340 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.340 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.340 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T04:59:57.340 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T04:59:57.340 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.340 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.340 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.340 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:57.340 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.340 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.340 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.341 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.341 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.341 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.341 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.341 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.341 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T04:59:57.341 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T04:59:57.341 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.341 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.341 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.341 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:57.341 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.341 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.341 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.342 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.342 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.342 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.342 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.342 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.342 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T04:59:57.342 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T04:59:57.342 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.342 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.342 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.342 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.342 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.342 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.342 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.343 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.343 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.343 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.343 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.343 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.343 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T04:59:57.343 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T04:59:57.343 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.343 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.343 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.343 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.343 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.343 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.344 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.344 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.344 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.344 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.344 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.344 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.344 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T04:59:57.344 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T04:59:57.344 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.344 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.344 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.344 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.344 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.344 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.345 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.345 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.345 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.345 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.345 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.345 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.345 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T04:59:57.345 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T04:59:57.345 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.345 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.345 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.345 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:57.345 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.346 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.346 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.346 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.346 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.346 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.346 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.346 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.346 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T04:59:57.346 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T04:59:57.346 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.346 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.346 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.346 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T04:59:57.347 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.347 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.347 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.347 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.347 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.347 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.347 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.347 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.347 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T04:59:57.347 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T04:59:57.347 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.347 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.347 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.348 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-19T04:59:57.348 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.348 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.348 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.348 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.348 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.348 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.348 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.348 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.348 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T04:59:57.348 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T04:59:57.348 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.348 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.349 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.349 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8", 2024-09-19T04:59:57.349 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.349 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.349 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.349 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.349 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.349 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.349 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.349 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.349 INFO:teuthology.orchestra.run.smithi002.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T04:59:57.349 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T04:59:57.349 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.350 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.350 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.350 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "45", 2024-09-19T04:59:57.350 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.350 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.350 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.350 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.350 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.350 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.350 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.350 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.350 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T04:59:57.351 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T04:59:57.351 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.351 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.351 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.351 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.351 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.351 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.351 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.351 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.351 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.351 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.351 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.351 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.351 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T04:59:57.352 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T04:59:57.352 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.352 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.352 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.352 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-09-19T04:59:57.352 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.352 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.352 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.352 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.352 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.352 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.352 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.352 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.353 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T04:59:57.353 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T04:59:57.353 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.353 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.353 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.353 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.353 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.353 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.353 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.353 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.353 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.353 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.353 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.354 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.354 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T04:59:57.354 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T04:59:57.354 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.354 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.354 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.354 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:57.354 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.354 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.354 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.354 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.354 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.354 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.355 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.355 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.355 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T04:59:57.355 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T04:59:57.355 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.355 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.355 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.355 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-19T04:59:57.355 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.355 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.355 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.355 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.355 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.355 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.356 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.356 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.356 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T04:59:57.356 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T04:59:57.356 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.356 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.356 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.356 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-19T04:59:57.356 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.356 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.356 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.356 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.356 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.357 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.357 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.357 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.357 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T04:59:57.357 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T04:59:57.357 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.357 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.357 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.357 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-19T04:59:57.357 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.357 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.357 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.357 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.358 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.358 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.358 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.358 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.358 INFO:teuthology.orchestra.run.smithi002.stdout: "cross_origin_url": { 2024-09-19T04:59:57.358 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cross_origin_url", 2024-09-19T04:59:57.358 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.358 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.358 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.358 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.358 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.358 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.358 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.359 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.359 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.359 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.359 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.359 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.359 INFO:teuthology.orchestra.run.smithi002.stdout: "crt_file": { 2024-09-19T04:59:57.359 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crt_file", 2024-09-19T04:59:57.359 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.359 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.359 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.359 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.359 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.359 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.359 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.360 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.360 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.360 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.360 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.360 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.360 INFO:teuthology.orchestra.run.smithi002.stdout: "debug": { 2024-09-19T04:59:57.360 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "debug", 2024-09-19T04:59:57.360 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.360 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.360 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.360 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.360 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.361 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.361 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.361 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable/disable debug options", 2024-09-19T04:59:57.361 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.361 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.361 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.361 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.361 INFO:teuthology.orchestra.run.smithi002.stdout: "jwt_token_ttl": { 2024-09-19T04:59:57.361 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "jwt_token_ttl", 2024-09-19T04:59:57.361 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.361 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.361 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.361 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "28800", 2024-09-19T04:59:57.362 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.362 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.362 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.362 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.362 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.362 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.362 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.362 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.362 INFO:teuthology.orchestra.run.smithi002.stdout: "key_file": { 2024-09-19T04:59:57.362 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "key_file", 2024-09-19T04:59:57.362 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.362 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.362 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.362 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.363 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.363 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.363 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.363 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.363 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.363 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.363 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.363 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.363 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.363 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.363 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.363 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.363 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.364 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.364 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.364 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.364 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.364 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.364 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.364 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.364 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.364 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.364 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.364 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.364 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.364 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.365 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.365 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.365 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.365 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.365 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.365 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.365 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.365 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.365 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.365 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.365 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.365 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.365 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.366 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.366 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.366 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.366 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.366 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.366 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.366 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.366 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.366 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.366 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.366 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.366 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.366 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.367 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.367 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.367 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.367 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.367 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.367 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.367 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.367 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.367 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.367 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.367 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.367 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.367 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.367 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.368 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.368 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.368 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.368 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.368 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.368 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.368 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.368 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.368 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.368 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.368 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.368 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.368 INFO:teuthology.orchestra.run.smithi002.stdout: "motd": { 2024-09-19T04:59:57.369 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "motd", 2024-09-19T04:59:57.369 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.369 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.369 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.369 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.369 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.369 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.369 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.369 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "The message of the day", 2024-09-19T04:59:57.369 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.369 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.369 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.369 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.370 INFO:teuthology.orchestra.run.smithi002.stdout: "redirect_resolve_ip_addr": { 2024-09-19T04:59:57.370 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T04:59:57.370 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.370 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.370 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.370 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.370 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.370 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.370 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.370 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.370 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.370 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.370 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.370 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.371 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-09-19T04:59:57.371 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-09-19T04:59:57.371 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.371 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.371 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.371 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "::", 2024-09-19T04:59:57.371 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.371 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.371 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.371 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.371 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.371 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.371 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.371 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.372 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-09-19T04:59:57.372 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-09-19T04:59:57.372 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.372 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.372 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.372 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8080", 2024-09-19T04:59:57.372 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.372 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.372 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.372 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.372 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.372 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.372 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.373 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.373 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl": { 2024-09-19T04:59:57.373 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl", 2024-09-19T04:59:57.373 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.373 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.373 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.373 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:57.373 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.373 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.373 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.373 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.373 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.373 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.374 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.374 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.374 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl_server_port": { 2024-09-19T04:59:57.374 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl_server_port", 2024-09-19T04:59:57.374 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.374 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.374 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.374 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8443", 2024-09-19T04:59:57.374 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.374 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.374 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.374 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.374 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.374 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.374 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.375 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.375 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_behaviour": { 2024-09-19T04:59:57.375 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_behaviour", 2024-09-19T04:59:57.375 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.375 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.375 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.375 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "redirect", 2024-09-19T04:59:57.375 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.375 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.375 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.375 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.375 INFO:teuthology.orchestra.run.smithi002.stdout: "redirect" 2024-09-19T04:59:57.375 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.375 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.376 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.376 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.376 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.376 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.376 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_error_status_code": { 2024-09-19T04:59:57.376 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_error_status_code", 2024-09-19T04:59:57.376 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.376 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.376 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.376 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-09-19T04:59:57.376 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "400", 2024-09-19T04:59:57.376 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "599", 2024-09-19T04:59:57.376 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.377 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.377 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.377 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.377 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.377 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.377 INFO:teuthology.orchestra.run.smithi002.stdout: "url_prefix": { 2024-09-19T04:59:57.377 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "url_prefix", 2024-09-19T04:59:57.377 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.377 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.377 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.377 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.377 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.377 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.377 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.378 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.378 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.378 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.378 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.378 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.378 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.378 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.378 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.378 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "devicehealth", 2024-09-19T04:59:57.378 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.378 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.378 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.378 INFO:teuthology.orchestra.run.smithi002.stdout: "enable_monitoring": { 2024-09-19T04:59:57.379 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enable_monitoring", 2024-09-19T04:59:57.379 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.379 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.379 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.379 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:57.379 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.379 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.379 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.379 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "monitor device health metrics", 2024-09-19T04:59:57.379 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.379 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.379 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.379 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.380 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.380 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.380 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.380 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.380 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.380 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.380 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.380 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.380 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.380 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.380 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.380 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.380 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.380 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.381 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.381 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.381 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.381 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.381 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.381 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.381 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.381 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.381 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.381 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.381 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.381 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.381 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.382 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.382 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.382 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.382 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.382 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.382 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.382 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.382 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.382 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.382 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.382 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.382 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.382 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.382 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.383 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.383 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.383 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.383 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.383 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.383 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.383 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.383 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.383 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.383 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.383 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.383 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.383 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.383 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.384 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.384 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.384 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.384 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.384 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.384 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.384 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.384 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.384 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.384 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.384 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.384 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.384 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.385 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.385 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.385 INFO:teuthology.orchestra.run.smithi002.stdout: "mark_out_threshold": { 2024-09-19T04:59:57.385 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mark_out_threshold", 2024-09-19T04:59:57.385 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:57.385 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.385 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.385 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "2419200", 2024-09-19T04:59:57.385 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.385 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.385 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.385 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T04:59:57.385 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.386 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.386 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.386 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.386 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": { 2024-09-19T04:59:57.386 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pool_name", 2024-09-19T04:59:57.386 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.386 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.386 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.386 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "device_health_metrics", 2024-09-19T04:59:57.386 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.386 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.386 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.386 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T04:59:57.386 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.387 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.387 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.387 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.387 INFO:teuthology.orchestra.run.smithi002.stdout: "retention_period": { 2024-09-19T04:59:57.387 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "retention_period", 2024-09-19T04:59:57.387 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:57.387 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.387 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.387 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15552000", 2024-09-19T04:59:57.387 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.387 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.387 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.387 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long to retain device health metrics", 2024-09-19T04:59:57.387 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.388 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.388 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.388 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.388 INFO:teuthology.orchestra.run.smithi002.stdout: "scrape_frequency": { 2024-09-19T04:59:57.388 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "scrape_frequency", 2024-09-19T04:59:57.388 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:57.388 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.388 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.388 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "86400", 2024-09-19T04:59:57.388 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.388 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.388 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.388 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T04:59:57.388 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.389 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.389 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.389 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.389 INFO:teuthology.orchestra.run.smithi002.stdout: "self_heal": { 2024-09-19T04:59:57.389 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "self_heal", 2024-09-19T04:59:57.389 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.389 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.389 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.389 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:57.389 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.389 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.389 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.389 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T04:59:57.389 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.390 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.390 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.390 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.390 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-19T04:59:57.390 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-19T04:59:57.390 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:57.390 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.390 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.390 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-19T04:59:57.390 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.390 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.390 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.390 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T04:59:57.390 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.391 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.391 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.391 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.391 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_threshold": { 2024-09-19T04:59:57.391 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_threshold", 2024-09-19T04:59:57.391 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:57.391 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.391 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.391 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "7257600", 2024-09-19T04:59:57.391 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.391 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.391 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.391 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T04:59:57.391 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.392 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.392 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.392 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.392 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.392 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.392 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.392 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "diskprediction_local", 2024-09-19T04:59:57.392 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.392 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.392 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.392 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.392 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.392 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.393 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.393 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.393 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.393 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.393 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.393 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.393 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.393 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.393 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.393 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.393 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.393 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.393 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.394 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.394 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.394 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.394 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.394 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.394 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.394 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.394 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.394 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.394 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.394 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.394 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.394 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.394 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.395 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.395 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.395 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.395 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.395 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.395 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.395 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.395 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.395 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.395 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.395 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.396 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.396 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.396 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.396 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.396 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.396 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.396 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.396 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.396 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.396 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.396 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.396 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.396 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.397 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.397 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.397 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.397 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.397 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.397 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.397 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.397 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.397 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.397 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.397 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.397 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.397 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.397 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.398 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.398 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.398 INFO:teuthology.orchestra.run.smithi002.stdout: "predict_interval": { 2024-09-19T04:59:57.398 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "predict_interval", 2024-09-19T04:59:57.398 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.398 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.398 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.398 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "86400", 2024-09-19T04:59:57.398 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.398 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.398 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.398 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.398 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.399 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.399 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.399 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.399 INFO:teuthology.orchestra.run.smithi002.stdout: "predictor_model": { 2024-09-19T04:59:57.399 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "predictor_model", 2024-09-19T04:59:57.399 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.399 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.399 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.399 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "prophetstor", 2024-09-19T04:59:57.399 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.399 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.399 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.399 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.400 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.400 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.400 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.400 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.400 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-19T04:59:57.400 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-19T04:59:57.400 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.400 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.400 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.400 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-19T04:59:57.400 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.400 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.400 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.401 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.401 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.401 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.401 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.401 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.401 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.401 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.401 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.401 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "influx", 2024-09-19T04:59:57.401 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": false, 2024-09-19T04:59:57.401 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "influxdb python module not found", 2024-09-19T04:59:57.401 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.401 INFO:teuthology.orchestra.run.smithi002.stdout: "batch_size": { 2024-09-19T04:59:57.402 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "batch_size", 2024-09-19T04:59:57.402 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.402 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.402 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.402 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5000", 2024-09-19T04:59:57.402 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.402 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.402 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.402 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T04:59:57.402 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.402 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.402 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.402 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.403 INFO:teuthology.orchestra.run.smithi002.stdout: "database": { 2024-09-19T04:59:57.403 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "database", 2024-09-19T04:59:57.403 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.403 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.403 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.403 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "ceph", 2024-09-19T04:59:57.403 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.403 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.403 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.403 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T04:59:57.403 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.403 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.403 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.404 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.404 INFO:teuthology.orchestra.run.smithi002.stdout: "hostname": { 2024-09-19T04:59:57.404 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "hostname", 2024-09-19T04:59:57.404 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.404 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.404 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.404 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.404 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.404 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.404 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.404 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB server hostname", 2024-09-19T04:59:57.404 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.404 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.405 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.405 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.405 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-19T04:59:57.405 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-19T04:59:57.405 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:57.405 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.405 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.405 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "30", 2024-09-19T04:59:57.405 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "5", 2024-09-19T04:59:57.405 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.405 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.405 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T04:59:57.406 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.406 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.406 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.406 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.406 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.406 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.406 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.406 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.406 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.406 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.406 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.406 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.406 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.406 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.407 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.407 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.407 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.407 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.407 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.407 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.407 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.407 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.407 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.407 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.407 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.407 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.407 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.407 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.408 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.408 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.408 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.408 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.408 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.408 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.408 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.408 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.408 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.408 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.408 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.408 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.408 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.409 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.409 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.409 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.409 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.409 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.409 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.409 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.409 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.409 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.409 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.409 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.409 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.409 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.409 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.410 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.410 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.410 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.410 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.410 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.410 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.410 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.410 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.410 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.410 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.410 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.410 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.410 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.411 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.411 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.411 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.411 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.411 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.411 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.411 INFO:teuthology.orchestra.run.smithi002.stdout: "password": { 2024-09-19T04:59:57.411 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "password", 2024-09-19T04:59:57.411 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.411 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.411 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.411 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.411 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.411 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.412 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.412 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "password of InfluxDB server user", 2024-09-19T04:59:57.412 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.412 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.412 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.412 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.412 INFO:teuthology.orchestra.run.smithi002.stdout: "port": { 2024-09-19T04:59:57.412 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "port", 2024-09-19T04:59:57.412 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.412 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.412 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.412 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8086", 2024-09-19T04:59:57.412 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.413 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.413 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.413 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB server port", 2024-09-19T04:59:57.413 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.413 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.413 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.413 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.413 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl": { 2024-09-19T04:59:57.413 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl", 2024-09-19T04:59:57.413 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.413 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.413 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.413 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "false", 2024-09-19T04:59:57.414 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.414 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.414 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.414 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T04:59:57.414 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.414 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.414 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.414 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.414 INFO:teuthology.orchestra.run.smithi002.stdout: "threads": { 2024-09-19T04:59:57.414 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "threads", 2024-09-19T04:59:57.414 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.414 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.414 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.415 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-19T04:59:57.415 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-19T04:59:57.415 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "32", 2024-09-19T04:59:57.415 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.415 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T04:59:57.415 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.415 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.415 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.415 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.415 INFO:teuthology.orchestra.run.smithi002.stdout: "username": { 2024-09-19T04:59:57.415 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "username", 2024-09-19T04:59:57.415 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.416 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.416 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.416 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.416 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.416 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.416 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.416 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "username of InfluxDB server user", 2024-09-19T04:59:57.416 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.416 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.416 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.416 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.416 INFO:teuthology.orchestra.run.smithi002.stdout: "verify_ssl": { 2024-09-19T04:59:57.416 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "verify_ssl", 2024-09-19T04:59:57.416 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.417 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.417 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.417 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "true", 2024-09-19T04:59:57.417 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.417 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.417 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.417 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T04:59:57.417 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.417 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.417 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.417 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.417 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.417 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.418 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.418 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "insights", 2024-09-19T04:59:57.418 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.418 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.418 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.418 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.418 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.418 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.418 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.418 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.418 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.418 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.418 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.418 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.419 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.419 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.419 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.419 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.419 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.419 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.419 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.419 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.419 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.419 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.419 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.419 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.420 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.420 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.420 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.420 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.420 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.420 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.420 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.420 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.420 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.420 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.420 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.420 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.420 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.421 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.421 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.421 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.421 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.421 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.421 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.421 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.421 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.421 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.421 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.421 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.421 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.421 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.421 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.422 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.422 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.422 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.422 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.422 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.422 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.422 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.422 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.422 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.422 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.422 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.422 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.422 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.423 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.423 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.423 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.423 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.423 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.423 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.423 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.423 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.423 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.423 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.423 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.423 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.423 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "iostat", 2024-09-19T04:59:57.424 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.424 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.424 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.424 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.424 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.424 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.424 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.424 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.424 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.424 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.424 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.424 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.424 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.425 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.425 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.425 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.425 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.425 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.425 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.425 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.425 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.425 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.425 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.425 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.425 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.425 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.426 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.426 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.426 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.426 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.426 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.426 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.426 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.426 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.426 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.426 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.426 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.426 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.426 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.426 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.427 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.427 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.427 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.427 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.427 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.427 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.427 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.427 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.427 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.427 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.427 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.427 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.427 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.428 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.428 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.428 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.428 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.428 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.428 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.428 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.428 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.428 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.428 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.428 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.428 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.428 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.429 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.429 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.429 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.429 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.429 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.429 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.429 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.429 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.429 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.429 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.429 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "k8sevents", 2024-09-19T04:59:57.429 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.429 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.430 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.430 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_event_retention_days": { 2024-09-19T04:59:57.430 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ceph_event_retention_days", 2024-09-19T04:59:57.430 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.430 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.430 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.430 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "7", 2024-09-19T04:59:57.430 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.430 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.430 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.430 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T04:59:57.430 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.430 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.430 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.431 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.431 INFO:teuthology.orchestra.run.smithi002.stdout: "config_check_secs": { 2024-09-19T04:59:57.431 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_check_secs", 2024-09-19T04:59:57.431 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.431 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.431 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.431 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-19T04:59:57.431 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "10", 2024-09-19T04:59:57.431 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.431 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.431 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T04:59:57.431 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.431 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.432 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.432 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.432 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.432 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.432 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.432 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.432 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.432 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.432 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.432 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.432 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.432 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.432 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.432 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.433 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.433 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.433 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.433 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.433 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.433 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.433 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.433 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.433 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.433 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.433 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.433 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.433 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.434 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.434 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.434 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.434 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.434 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.434 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.434 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.434 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.434 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.434 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.434 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.434 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.434 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.434 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.435 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.435 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.435 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.435 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.435 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.435 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.435 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.435 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.435 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.435 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.435 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.435 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.435 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.436 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.436 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.436 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.436 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.436 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.436 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.436 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.436 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.436 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.436 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.436 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.436 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.436 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.436 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.437 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.437 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.437 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.437 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.437 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.437 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.437 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.437 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "localpool", 2024-09-19T04:59:57.437 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.437 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.437 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.437 INFO:teuthology.orchestra.run.smithi002.stdout: "failure_domain": { 2024-09-19T04:59:57.438 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "failure_domain", 2024-09-19T04:59:57.438 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.438 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.438 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.438 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "host", 2024-09-19T04:59:57.438 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.438 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.438 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.438 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "failure domain for any created local pool", 2024-09-19T04:59:57.438 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T04:59:57.438 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.438 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.438 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.438 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.439 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.439 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.439 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.439 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.439 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.439 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.439 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.439 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.439 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.439 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.439 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.439 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.439 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.440 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.440 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.440 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.440 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.440 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.440 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.440 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.440 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.440 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.440 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.440 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.440 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.440 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.441 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.441 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.441 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.441 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.441 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.441 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.441 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.441 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.441 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.441 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.441 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.441 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.441 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.442 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.442 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.442 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.442 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.442 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.442 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.442 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.442 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.442 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.442 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.442 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.442 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.442 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.443 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.443 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.443 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.443 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.443 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.443 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.443 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.443 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.443 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.443 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.443 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.443 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.443 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.444 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.444 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.444 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.444 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.444 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": { 2024-09-19T04:59:57.444 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "min_size", 2024-09-19T04:59:57.444 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.444 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.444 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.444 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.444 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.444 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.444 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.445 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default min_size for any created local pool", 2024-09-19T04:59:57.445 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T04:59:57.445 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.445 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.445 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.445 INFO:teuthology.orchestra.run.smithi002.stdout: "num_rep": { 2024-09-19T04:59:57.445 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "num_rep", 2024-09-19T04:59:57.445 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.445 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.445 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.445 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3", 2024-09-19T04:59:57.445 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.445 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.445 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.446 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default replica count for any created local pool", 2024-09-19T04:59:57.446 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.446 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.446 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.446 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.446 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": { 2024-09-19T04:59:57.446 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pg_num", 2024-09-19T04:59:57.446 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.446 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.446 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.446 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "128", 2024-09-19T04:59:57.446 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.446 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.447 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.447 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T04:59:57.447 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.447 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.447 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.447 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.447 INFO:teuthology.orchestra.run.smithi002.stdout: "prefix": { 2024-09-19T04:59:57.447 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prefix", 2024-09-19T04:59:57.447 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.447 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.447 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.447 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.447 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.447 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.448 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.448 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "name prefix for any created local pool", 2024-09-19T04:59:57.448 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.448 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.448 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.448 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.448 INFO:teuthology.orchestra.run.smithi002.stdout: "subtree": { 2024-09-19T04:59:57.448 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "subtree", 2024-09-19T04:59:57.448 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.448 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.448 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.448 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "rack", 2024-09-19T04:59:57.449 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.449 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.449 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.449 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T04:59:57.449 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T04:59:57.449 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.449 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.449 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.449 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.449 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.449 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.449 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mds_autoscaler", 2024-09-19T04:59:57.449 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.449 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.450 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.450 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.450 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.450 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.450 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.450 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.450 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.450 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.452 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.452 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.452 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.452 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.452 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.452 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.452 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.452 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.452 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.452 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.452 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.452 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.452 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.453 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.453 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.453 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.453 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.453 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.453 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.453 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.453 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.453 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.453 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.453 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.453 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.454 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.454 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.454 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.454 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.454 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.454 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.454 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.454 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.454 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.454 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.454 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.454 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.454 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.454 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.455 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.455 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.455 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.455 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.455 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.455 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.455 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.455 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.455 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.455 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.455 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.455 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.455 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.456 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.456 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.456 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.456 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.456 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.456 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.456 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.456 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.456 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.456 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.456 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.456 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.456 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.457 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.457 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mirroring", 2024-09-19T04:59:57.457 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.457 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.457 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.457 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.457 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.457 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.457 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.457 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.457 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.457 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.457 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.458 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.458 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.458 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.458 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.458 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.458 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.458 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.458 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.458 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.458 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.458 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.458 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.458 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.458 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.458 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.459 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.459 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.459 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.459 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.459 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.459 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.459 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.459 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.459 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.459 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.459 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.459 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.459 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.460 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.460 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.460 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.460 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.460 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.460 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.460 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.460 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.460 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.460 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.460 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.460 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.460 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.461 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.461 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.461 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.461 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.461 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.461 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.461 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.461 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.461 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.461 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.461 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.461 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.461 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.461 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.462 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.462 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.462 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.462 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.462 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.462 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.462 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.462 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.462 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.462 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.462 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "nfs", 2024-09-19T04:59:57.462 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.462 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.462 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.463 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.463 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.463 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.463 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.463 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.463 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.463 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.463 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.463 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.463 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.463 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.463 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.463 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.463 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.464 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.464 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.464 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.464 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.464 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.464 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.464 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.464 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.464 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.464 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.464 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.464 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.464 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.465 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.465 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.465 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.465 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.465 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.465 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.465 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.465 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.465 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.465 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.465 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.465 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.465 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.466 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.466 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.466 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.466 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.466 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.466 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.466 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.466 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.466 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.466 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.466 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.466 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.466 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.467 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.467 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.467 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.467 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.467 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.467 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.467 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.467 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.467 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.467 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.467 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.467 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.467 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.467 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.468 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.468 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.468 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.468 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.468 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.468 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.468 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "orchestrator", 2024-09-19T04:59:57.468 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.468 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.468 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.468 INFO:teuthology.orchestra.run.smithi002.stdout: "fail_fs": { 2024-09-19T04:59:57.468 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "fail_fs", 2024-09-19T04:59:57.468 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.469 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.469 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.469 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.469 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.469 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.469 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.469 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T04:59:57.469 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.469 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.469 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.469 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.469 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.469 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.469 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.470 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.470 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.470 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.470 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.470 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.470 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.470 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.470 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.470 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.470 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.470 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.470 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.471 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.471 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.471 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.471 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.471 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.471 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.471 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.471 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.471 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.471 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.471 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.471 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.471 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.471 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.472 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.472 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.472 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.472 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.472 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.472 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.472 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.472 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.472 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.472 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.472 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.472 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.472 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.472 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.473 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.473 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.473 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.473 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.473 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.473 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.473 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.473 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.473 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.473 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.473 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.473 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.473 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.474 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.474 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.474 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.474 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.474 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.474 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.474 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.474 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.474 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.474 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.474 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.474 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.474 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.474 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.475 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator": { 2024-09-19T04:59:57.475 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "orchestrator", 2024-09-19T04:59:57.475 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.475 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.475 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.475 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.475 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.475 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.475 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.475 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm", 2024-09-19T04:59:57.475 INFO:teuthology.orchestra.run.smithi002.stdout: "rook", 2024-09-19T04:59:57.475 INFO:teuthology.orchestra.run.smithi002.stdout: "test_orchestrator" 2024-09-19T04:59:57.475 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.476 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Orchestrator backend", 2024-09-19T04:59:57.476 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.476 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.476 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.476 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.476 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.476 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.476 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.476 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "osd_perf_query", 2024-09-19T04:59:57.476 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.476 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.476 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.476 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.476 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.477 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.477 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.477 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.477 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.477 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.477 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.477 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.477 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.477 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.477 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.477 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.477 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.477 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.478 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.478 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.478 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.478 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.478 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.478 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.478 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.478 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.478 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.478 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.478 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.478 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.478 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.479 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.479 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.479 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.479 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.479 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.479 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.479 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.479 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.479 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.479 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.479 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.479 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.479 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.479 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.480 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.480 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.480 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.480 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.480 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.480 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.480 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.480 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.480 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.480 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.480 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.480 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.480 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.481 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.481 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.481 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.481 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.481 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.481 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.481 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.481 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.481 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.481 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.481 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.481 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.481 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.482 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.482 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.482 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.482 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.482 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.482 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "osd_support", 2024-09-19T04:59:57.482 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.482 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.482 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.482 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.482 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.482 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.482 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.483 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.483 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.483 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.483 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.483 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.483 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.483 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.483 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.483 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.483 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.483 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.483 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.483 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.483 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.484 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.484 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.484 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.484 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.484 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.484 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.484 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.484 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.484 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.484 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.484 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.484 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.484 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.484 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.485 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.485 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.485 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.485 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.485 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.485 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.485 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.485 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.485 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.485 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.485 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.485 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.485 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.486 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.486 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.486 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.486 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.486 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.486 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.486 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.486 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.486 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.486 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.486 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.486 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.486 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.487 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.487 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.487 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.487 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.487 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.487 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.487 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.487 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.487 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.487 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.487 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.487 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.487 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.487 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.488 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.488 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pg_autoscaler", 2024-09-19T04:59:57.488 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.488 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.488 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.488 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.488 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.488 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.488 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.488 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.488 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.488 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.488 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.489 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.489 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.489 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.489 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.489 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.489 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.489 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.489 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.489 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.489 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.489 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.489 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.489 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.490 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.490 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.490 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.490 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.490 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.490 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.490 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.490 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.490 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.490 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.490 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.490 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.490 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.490 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.491 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.491 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.491 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.491 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.491 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.491 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.491 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.491 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.491 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.491 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.491 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.491 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.491 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.491 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.492 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.492 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.492 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.492 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.492 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.492 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.492 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.492 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.492 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.492 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.492 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.492 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.492 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.493 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.493 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.493 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.493 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.493 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.493 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.493 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.493 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.493 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-19T04:59:57.493 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-19T04:59:57.493 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:57.493 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.493 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.494 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-19T04:59:57.494 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.494 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.494 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.494 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.494 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.494 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.494 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.494 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.494 INFO:teuthology.orchestra.run.smithi002.stdout: "threshold": { 2024-09-19T04:59:57.494 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "threshold", 2024-09-19T04:59:57.494 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-19T04:59:57.494 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.494 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.495 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3.0", 2024-09-19T04:59:57.495 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1.0", 2024-09-19T04:59:57.495 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.495 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.495 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "scaling threshold", 2024-09-19T04:59:57.495 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T04:59:57.495 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.495 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.495 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.495 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.495 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.495 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.495 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "progress", 2024-09-19T04:59:57.496 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.496 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.496 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.496 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_pg_recovery_event": { 2024-09-19T04:59:57.496 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_pg_recovery_event", 2024-09-19T04:59:57.496 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.496 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.496 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.496 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.496 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.496 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.496 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.496 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T04:59:57.497 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.497 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.497 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.497 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.497 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": { 2024-09-19T04:59:57.497 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enabled", 2024-09-19T04:59:57.497 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.497 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.497 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.497 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:57.497 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.497 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.497 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.498 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.498 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.498 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.498 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.498 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.498 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.498 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.498 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.498 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.498 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.498 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.498 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.498 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.498 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.499 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.499 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.499 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.499 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.499 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.499 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.499 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.499 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.499 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.499 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.499 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.499 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.499 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.500 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.500 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.500 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.500 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.500 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.500 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.500 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.500 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.500 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.500 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.500 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.500 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.500 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.500 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.501 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.501 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.501 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.501 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.501 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.501 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.501 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.501 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.501 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.501 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.501 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.501 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.501 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.501 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.502 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.502 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.502 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.502 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.502 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.502 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.502 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.502 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.502 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.502 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.502 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.502 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.502 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.503 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.503 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.503 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.503 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.503 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.503 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.503 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.503 INFO:teuthology.orchestra.run.smithi002.stdout: "max_completed_events": { 2024-09-19T04:59:57.503 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_completed_events", 2024-09-19T04:59:57.503 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.503 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.503 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.503 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "50", 2024-09-19T04:59:57.504 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.504 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.504 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.504 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "number of past completed events to remember", 2024-09-19T04:59:57.504 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.504 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.504 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.504 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.504 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-19T04:59:57.504 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-19T04:59:57.504 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:57.504 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.504 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.504 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-19T04:59:57.505 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.505 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.505 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.505 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long the module is going to sleep", 2024-09-19T04:59:57.505 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.505 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.505 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.505 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.505 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.505 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.505 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.505 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prometheus", 2024-09-19T04:59:57.505 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.506 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.506 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.506 INFO:teuthology.orchestra.run.smithi002.stdout: "cache": { 2024-09-19T04:59:57.506 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cache", 2024-09-19T04:59:57.506 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.506 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.506 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.506 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:57.506 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.506 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.506 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.506 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.506 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.506 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.507 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.507 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.507 INFO:teuthology.orchestra.run.smithi002.stdout: "exclude_perf_counters": { 2024-09-19T04:59:57.507 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "exclude_perf_counters", 2024-09-19T04:59:57.507 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.507 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.507 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.507 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:57.507 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.507 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.507 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.507 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T04:59:57.507 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T04:59:57.507 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.508 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.508 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.508 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.508 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.508 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.508 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.508 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.508 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.508 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.508 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.508 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.508 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.509 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.509 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.509 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.509 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.509 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.509 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.509 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.509 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.509 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.509 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.509 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.509 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.509 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.510 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.510 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.510 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.510 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.510 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.510 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.510 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.510 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.510 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.510 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.510 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.510 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.510 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.510 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.511 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.511 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.511 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.511 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.511 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.511 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.511 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.511 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.511 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.511 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.511 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.511 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.511 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.512 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.512 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.512 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.512 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.512 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.512 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.512 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.512 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.512 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.512 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.512 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.512 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.512 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.513 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.513 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.513 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.513 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.513 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.513 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.513 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.513 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_stats_pools": { 2024-09-19T04:59:57.513 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_stats_pools", 2024-09-19T04:59:57.513 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.513 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.513 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.513 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.514 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.514 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.514 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.514 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.514 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.514 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.514 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.514 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.514 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T04:59:57.514 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T04:59:57.514 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.514 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.514 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.515 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "300", 2024-09-19T04:59:57.515 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.515 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.515 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.515 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.515 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.515 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.515 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.515 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.515 INFO:teuthology.orchestra.run.smithi002.stdout: "scrape_interval": { 2024-09-19T04:59:57.515 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "scrape_interval", 2024-09-19T04:59:57.515 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-19T04:59:57.515 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.515 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.516 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15.0", 2024-09-19T04:59:57.516 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.516 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.516 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.516 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.516 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.516 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.516 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.516 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.516 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-09-19T04:59:57.516 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-09-19T04:59:57.516 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.516 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.517 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.517 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "::", 2024-09-19T04:59:57.517 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.517 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.517 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.517 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T04:59:57.517 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.517 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.517 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.517 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.517 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-09-19T04:59:57.517 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-09-19T04:59:57.517 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.517 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.518 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.518 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "9283", 2024-09-19T04:59:57.518 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.518 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.518 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.518 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T04:59:57.518 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.518 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.518 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.518 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.518 INFO:teuthology.orchestra.run.smithi002.stdout: "stale_cache_strategy": { 2024-09-19T04:59:57.518 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "stale_cache_strategy", 2024-09-19T04:59:57.518 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.519 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.519 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.519 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "log", 2024-09-19T04:59:57.519 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.519 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.519 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.519 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.519 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.519 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.519 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.519 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.519 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_behaviour": { 2024-09-19T04:59:57.519 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_behaviour", 2024-09-19T04:59:57.519 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.520 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.520 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.520 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "default", 2024-09-19T04:59:57.520 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.520 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.520 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.520 INFO:teuthology.orchestra.run.smithi002.stdout: "default", 2024-09-19T04:59:57.520 INFO:teuthology.orchestra.run.smithi002.stdout: "error" 2024-09-19T04:59:57.520 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.520 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.520 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.520 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.521 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.521 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.521 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_error_status_code": { 2024-09-19T04:59:57.521 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_error_status_code", 2024-09-19T04:59:57.521 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.521 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.521 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.521 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-09-19T04:59:57.521 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "400", 2024-09-19T04:59:57.521 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "599", 2024-09-19T04:59:57.521 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.521 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.521 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.521 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.522 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.522 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.522 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.522 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.522 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.522 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_support", 2024-09-19T04:59:57.522 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.522 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.522 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.522 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.522 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.522 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.522 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.523 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.523 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.523 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.523 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.523 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.523 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.523 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.523 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.523 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.523 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.523 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.523 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.523 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.524 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.524 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.524 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.524 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.524 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.524 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.524 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.524 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.524 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.524 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.524 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.524 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.524 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.525 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.525 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.525 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.525 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.525 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.525 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.525 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.525 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.525 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.525 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.525 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.525 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.526 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.526 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.526 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.526 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.526 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.526 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.526 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.526 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.526 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.526 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.526 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.526 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.526 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.526 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.527 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.527 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.527 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.527 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.527 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.527 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.527 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.527 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.527 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.527 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.527 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.527 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.527 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.528 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.528 INFO:teuthology.orchestra.run.smithi002.stdout: "max_concurrent_snap_create": { 2024-09-19T04:59:57.528 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_concurrent_snap_create", 2024-09-19T04:59:57.528 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.528 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.528 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.528 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-19T04:59:57.528 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.528 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.528 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.528 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.528 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.528 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.528 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.529 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.529 INFO:teuthology.orchestra.run.smithi002.stdout: "mirror_snapshot_schedule": { 2024-09-19T04:59:57.529 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T04:59:57.529 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.529 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.529 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.529 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.529 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.529 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.529 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.529 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.529 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.529 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.530 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.530 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.530 INFO:teuthology.orchestra.run.smithi002.stdout: "trash_purge_schedule": { 2024-09-19T04:59:57.530 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "trash_purge_schedule", 2024-09-19T04:59:57.530 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.530 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.530 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.530 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.530 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.530 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.530 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.530 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.530 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.531 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.531 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.531 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.531 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.531 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.531 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.531 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "restful", 2024-09-19T04:59:57.531 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.531 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.531 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.531 INFO:teuthology.orchestra.run.smithi002.stdout: "enable_auth": { 2024-09-19T04:59:57.531 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enable_auth", 2024-09-19T04:59:57.531 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.532 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.532 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.532 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:57.532 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.532 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.532 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.532 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.532 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.532 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.532 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.532 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.532 INFO:teuthology.orchestra.run.smithi002.stdout: "key_file": { 2024-09-19T04:59:57.532 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "key_file", 2024-09-19T04:59:57.532 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.533 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.533 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.533 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.533 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.533 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.533 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.533 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.533 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.533 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.533 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.533 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.533 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.533 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.534 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.534 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.534 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.534 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.534 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.534 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.534 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.534 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.534 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.534 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.534 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.534 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.534 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.534 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.535 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.535 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.535 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.535 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.535 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.535 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.535 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.535 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.535 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.535 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.535 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.535 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.535 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.536 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.536 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.536 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.536 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.536 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.536 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.536 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.536 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.536 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.536 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.536 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.536 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.536 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.536 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.537 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.537 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.537 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.537 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.537 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.537 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.537 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.537 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.537 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.537 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.537 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.537 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.537 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.537 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.538 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.538 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.538 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.538 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.538 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.538 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.538 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.538 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.538 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.538 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.538 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.538 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.538 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.539 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-09-19T04:59:57.539 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-09-19T04:59:57.539 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.539 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.539 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.539 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.539 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.539 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.539 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.539 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.539 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.539 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.539 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.540 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.540 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-09-19T04:59:57.540 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-09-19T04:59:57.540 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.540 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.540 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.540 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.540 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.540 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.540 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.540 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.540 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.540 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.541 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.541 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.541 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.541 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.541 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.541 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rgw", 2024-09-19T04:59:57.541 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.541 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.541 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.541 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.541 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.541 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.541 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.542 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.542 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.542 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.542 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.542 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.542 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.542 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.542 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.542 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.542 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.542 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.542 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.542 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.542 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.543 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.543 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.543 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.543 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.543 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.543 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.543 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.543 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.543 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.543 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.543 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.543 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.543 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.544 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.544 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.544 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.544 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.544 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.544 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.544 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.544 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.544 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.544 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.544 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.544 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.544 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.544 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.545 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.545 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.545 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.545 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.545 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.545 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.545 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.545 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.545 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.545 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.545 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.545 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.545 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.546 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.546 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.546 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.546 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.546 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.546 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.546 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.546 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.546 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.546 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.546 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.546 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.546 INFO:teuthology.orchestra.run.smithi002.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T04:59:57.546 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T04:59:57.547 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.547 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.547 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.547 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-19T04:59:57.547 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.547 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.547 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.547 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T04:59:57.547 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.547 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.547 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.547 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.547 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.548 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.548 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.548 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rook", 2024-09-19T04:59:57.548 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.548 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.548 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.548 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.548 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.548 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.548 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.548 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.548 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.548 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.549 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.549 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.549 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.549 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.549 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.549 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.549 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.549 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.549 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.549 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.549 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.549 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.549 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.550 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.550 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.550 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.550 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.550 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.550 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.550 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.550 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.550 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.550 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.550 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.550 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.550 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.551 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.551 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.551 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.551 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.551 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.551 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.551 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.551 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.551 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.551 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.551 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.551 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.551 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.551 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.552 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.552 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.552 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.552 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.552 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.552 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.552 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.552 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.552 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.552 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.552 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.552 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.552 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.553 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.553 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.553 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.553 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.553 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.553 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.553 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.553 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.553 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.553 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.553 INFO:teuthology.orchestra.run.smithi002.stdout: "storage_class": { 2024-09-19T04:59:57.553 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "storage_class", 2024-09-19T04:59:57.553 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.553 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.554 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.554 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "local", 2024-09-19T04:59:57.554 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.554 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.554 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.554 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T04:59:57.554 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.554 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.554 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.554 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.554 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.554 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.554 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.554 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "selftest", 2024-09-19T04:59:57.555 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.555 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.555 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.555 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.555 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.555 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.555 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.555 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.555 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.555 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.555 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.555 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.555 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.556 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.556 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.556 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.556 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.556 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.556 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.556 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.556 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.556 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.556 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.556 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.556 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.556 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.557 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.557 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.557 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.557 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.557 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.557 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.557 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.557 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.557 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.557 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.557 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.557 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.557 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.558 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.558 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.558 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.558 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.558 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.558 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.558 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.558 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.558 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.558 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.558 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.558 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.558 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.558 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.559 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.559 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.559 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.559 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.559 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.559 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.559 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.559 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.559 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.559 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.559 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.559 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.559 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.559 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.560 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.560 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.560 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.560 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.560 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.560 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.560 INFO:teuthology.orchestra.run.smithi002.stdout: "roption1": { 2024-09-19T04:59:57.560 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "roption1", 2024-09-19T04:59:57.560 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.560 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.560 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.560 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.560 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.561 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.561 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.561 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.561 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.561 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.561 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.561 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.561 INFO:teuthology.orchestra.run.smithi002.stdout: "roption2": { 2024-09-19T04:59:57.561 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "roption2", 2024-09-19T04:59:57.561 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.561 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.561 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.562 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "xyz", 2024-09-19T04:59:57.562 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.562 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.562 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.562 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.562 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.562 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.562 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.562 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.562 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption1": { 2024-09-19T04:59:57.562 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption1", 2024-09-19T04:59:57.562 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.562 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.562 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.563 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.563 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.563 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.563 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.563 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.563 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.563 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.563 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.563 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.563 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption2": { 2024-09-19T04:59:57.563 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption2", 2024-09-19T04:59:57.563 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.563 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.564 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.564 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.564 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.564 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.564 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.564 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.564 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.564 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.564 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.564 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.564 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption3": { 2024-09-19T04:59:57.564 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption3", 2024-09-19T04:59:57.564 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-19T04:59:57.565 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.565 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.565 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.565 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.565 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.565 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.565 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.565 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.565 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.565 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.565 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.565 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption4": { 2024-09-19T04:59:57.565 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption4", 2024-09-19T04:59:57.566 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.566 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.566 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.566 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.566 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.566 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.566 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.566 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.566 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.566 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.566 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.566 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.566 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption5": { 2024-09-19T04:59:57.567 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption5", 2024-09-19T04:59:57.567 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.567 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.567 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.567 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.567 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.567 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.567 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.567 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.567 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.567 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.567 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.567 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.568 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption6": { 2024-09-19T04:59:57.568 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption6", 2024-09-19T04:59:57.568 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.568 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.568 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.568 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:57.568 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.568 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.568 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.568 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.568 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.568 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.568 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.568 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.569 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption7": { 2024-09-19T04:59:57.569 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption7", 2024-09-19T04:59:57.569 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.569 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.569 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.569 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.569 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-19T04:59:57.569 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "42", 2024-09-19T04:59:57.569 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.569 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.569 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.569 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.570 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.570 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.570 INFO:teuthology.orchestra.run.smithi002.stdout: "testkey": { 2024-09-19T04:59:57.570 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testkey", 2024-09-19T04:59:57.570 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.570 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.570 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.570 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.570 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.570 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.570 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.570 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.570 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.570 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.571 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.571 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.571 INFO:teuthology.orchestra.run.smithi002.stdout: "testlkey": { 2024-09-19T04:59:57.571 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testlkey", 2024-09-19T04:59:57.571 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.571 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.571 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.571 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.571 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.571 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.571 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.571 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.571 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.572 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.572 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.572 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.572 INFO:teuthology.orchestra.run.smithi002.stdout: "testnewline": { 2024-09-19T04:59:57.572 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testnewline", 2024-09-19T04:59:57.572 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.572 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.572 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.572 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.572 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.572 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.572 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.572 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.572 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.573 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.573 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.573 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.573 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.573 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.573 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.573 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snap_schedule", 2024-09-19T04:59:57.573 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.573 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.573 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.573 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_m_granularity": { 2024-09-19T04:59:57.573 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_m_granularity", 2024-09-19T04:59:57.573 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.574 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.574 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.574 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.574 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.574 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.574 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.574 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T04:59:57.574 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.574 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.574 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.574 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.574 INFO:teuthology.orchestra.run.smithi002.stdout: "dump_on_update": { 2024-09-19T04:59:57.574 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "dump_on_update", 2024-09-19T04:59:57.575 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.575 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.575 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.575 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.575 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.575 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.575 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.575 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "dump database to debug log on update", 2024-09-19T04:59:57.575 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.575 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.575 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.575 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.575 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.575 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.576 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.576 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.576 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.576 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.576 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.576 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.576 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.576 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.576 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.576 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.576 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.576 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.576 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.577 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.577 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.577 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.577 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.577 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.577 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.577 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.577 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.577 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.577 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.577 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.577 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.577 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.578 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.578 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.578 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.578 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.578 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.578 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.578 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.578 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.578 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.578 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.578 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.578 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.578 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.579 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.579 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.579 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.579 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.579 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.579 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.579 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.579 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.579 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.579 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.579 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.579 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.580 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.580 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.580 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.580 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.580 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.580 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.580 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.580 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.580 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.580 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.580 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.580 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.580 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.580 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.581 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.581 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.581 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.581 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.581 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.581 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.581 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "stats", 2024-09-19T04:59:57.581 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.581 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.581 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.581 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.581 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.581 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.582 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.582 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.582 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.582 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.582 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.582 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.582 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.582 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.582 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.582 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.582 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.582 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.582 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.583 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.583 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.583 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.583 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.583 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.583 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.583 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.583 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.583 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.583 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.583 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.583 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.583 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.584 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.584 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.584 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.584 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.584 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.584 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.584 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.584 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.584 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.584 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.584 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.584 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.585 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.585 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.585 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.585 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.585 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.585 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.585 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.585 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.585 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.585 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.585 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.585 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.585 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.585 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.586 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.586 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.586 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.586 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.586 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.586 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.586 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.586 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.586 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.586 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.586 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.586 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.586 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.586 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.587 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.587 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.587 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.587 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.587 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "status", 2024-09-19T04:59:57.587 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.587 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.587 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.587 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.587 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.587 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.587 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.587 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.588 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.588 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.588 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.588 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.588 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.588 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.588 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.588 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.588 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.588 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.588 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.588 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.588 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.589 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.589 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.589 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.589 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.589 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.589 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.589 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.589 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.589 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.589 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.589 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.589 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.589 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.589 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.590 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.590 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.590 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.590 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.590 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.590 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.590 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.590 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.590 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.590 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.590 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.590 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.590 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.590 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.591 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.591 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.591 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.591 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.591 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.591 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.591 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.591 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.591 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.591 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.591 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.591 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.591 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.591 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.592 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.592 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.592 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.592 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.592 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.592 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.592 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.592 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.592 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.592 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.592 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.592 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.592 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.593 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "telegraf", 2024-09-19T04:59:57.593 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.593 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.593 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.593 INFO:teuthology.orchestra.run.smithi002.stdout: "address": { 2024-09-19T04:59:57.593 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "address", 2024-09-19T04:59:57.593 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.593 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.593 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.593 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T04:59:57.593 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.593 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.593 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.594 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.594 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.594 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.594 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.594 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.594 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-19T04:59:57.594 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-19T04:59:57.594 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:57.594 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.594 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.594 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15", 2024-09-19T04:59:57.594 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.594 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.595 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.595 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.595 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.595 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.595 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.595 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.595 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.595 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.595 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.595 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.595 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.595 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.595 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.596 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.596 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.596 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.596 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.596 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.596 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.596 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.596 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.596 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.596 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.596 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.596 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.596 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.597 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.597 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.597 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.597 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.597 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.597 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.597 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.597 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.597 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.597 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.597 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.597 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.597 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.598 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.598 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.598 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.598 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.598 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.598 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.598 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.598 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.598 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.598 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.598 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.598 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.598 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.599 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.599 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.599 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.599 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.599 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.599 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.599 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.599 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.599 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.599 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.599 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.599 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.599 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.599 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.600 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.600 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.600 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.600 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.600 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.600 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.600 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.600 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.600 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.600 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.600 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.600 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.600 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.601 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "telemetry", 2024-09-19T04:59:57.601 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.601 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.601 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.601 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_basic": { 2024-09-19T04:59:57.601 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_basic", 2024-09-19T04:59:57.601 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.601 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.601 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.601 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:57.601 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.601 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.601 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.602 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T04:59:57.602 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.602 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.602 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.602 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.602 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_crash": { 2024-09-19T04:59:57.602 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_crash", 2024-09-19T04:59:57.602 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.602 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.602 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.602 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:57.602 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.603 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.603 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.603 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T04:59:57.603 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.603 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.603 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.603 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.603 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_device": { 2024-09-19T04:59:57.603 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_device", 2024-09-19T04:59:57.603 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.603 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.603 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.603 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:57.603 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.604 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.604 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.604 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T04:59:57.604 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.604 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.604 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.604 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.604 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_ident": { 2024-09-19T04:59:57.604 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_ident", 2024-09-19T04:59:57.604 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.604 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.604 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.604 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.605 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.605 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.605 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.605 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T04:59:57.605 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.605 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.605 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.605 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.605 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_perf": { 2024-09-19T04:59:57.605 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_perf", 2024-09-19T04:59:57.605 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.605 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.605 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.606 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.606 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.606 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.606 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.606 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T04:59:57.606 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.606 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.606 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.606 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.606 INFO:teuthology.orchestra.run.smithi002.stdout: "contact": { 2024-09-19T04:59:57.606 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "contact", 2024-09-19T04:59:57.606 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.606 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.606 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.606 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.607 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.607 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.607 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.607 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.607 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.607 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.607 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.607 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.607 INFO:teuthology.orchestra.run.smithi002.stdout: "description": { 2024-09-19T04:59:57.607 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "description", 2024-09-19T04:59:57.607 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.607 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.607 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.608 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.608 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.608 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.608 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.608 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.608 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.608 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.608 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.608 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.608 INFO:teuthology.orchestra.run.smithi002.stdout: "device_url": { 2024-09-19T04:59:57.608 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_url", 2024-09-19T04:59:57.608 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.608 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.608 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.608 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T04:59:57.609 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.609 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.609 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.609 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.609 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.609 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.609 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.609 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.609 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": { 2024-09-19T04:59:57.609 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enabled", 2024-09-19T04:59:57.609 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.609 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.609 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.610 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.610 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.610 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.610 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.610 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.610 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.610 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.610 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.610 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.610 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-19T04:59:57.610 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-19T04:59:57.610 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.611 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.611 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.611 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "24", 2024-09-19T04:59:57.611 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "8", 2024-09-19T04:59:57.611 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.611 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.611 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.611 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.611 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.611 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.611 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.611 INFO:teuthology.orchestra.run.smithi002.stdout: "last_opt_revision": { 2024-09-19T04:59:57.611 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "last_opt_revision", 2024-09-19T04:59:57.612 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.612 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.612 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.612 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1", 2024-09-19T04:59:57.612 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.612 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.612 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.612 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.612 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.612 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.612 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.612 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.612 INFO:teuthology.orchestra.run.smithi002.stdout: "leaderboard": { 2024-09-19T04:59:57.613 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "leaderboard", 2024-09-19T04:59:57.613 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.613 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.613 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.613 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.613 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.613 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.613 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.613 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.613 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.613 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.613 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.613 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.613 INFO:teuthology.orchestra.run.smithi002.stdout: "leaderboard_description": { 2024-09-19T04:59:57.614 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "leaderboard_description", 2024-09-19T04:59:57.614 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.614 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.614 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.614 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.614 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.614 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.614 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.614 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.614 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.614 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.614 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.614 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.615 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.615 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.615 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.615 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.615 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.615 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.615 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.615 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.615 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.615 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.615 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.615 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.615 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.615 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.616 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.616 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.616 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.616 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.616 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.616 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.616 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.616 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.616 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.616 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.616 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.616 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.616 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.617 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.617 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.617 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.617 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.617 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.617 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.617 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.617 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.617 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.617 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.617 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.617 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.617 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.618 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.618 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.618 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.618 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.618 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.618 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.618 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.618 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.618 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.618 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.618 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.618 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.618 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.618 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.619 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.619 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.619 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.619 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.619 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.619 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.619 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.619 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.619 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.619 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.619 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.619 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.619 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.620 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.620 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.620 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.620 INFO:teuthology.orchestra.run.smithi002.stdout: "organization": { 2024-09-19T04:59:57.620 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "organization", 2024-09-19T04:59:57.620 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.620 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.620 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.620 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.620 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.620 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.620 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.620 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.620 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.621 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.621 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.621 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.621 INFO:teuthology.orchestra.run.smithi002.stdout: "proxy": { 2024-09-19T04:59:57.621 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "proxy", 2024-09-19T04:59:57.621 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.621 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.621 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.621 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.621 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.621 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.621 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.621 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.622 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.622 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.622 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.622 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.622 INFO:teuthology.orchestra.run.smithi002.stdout: "url": { 2024-09-19T04:59:57.622 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "url", 2024-09-19T04:59:57.622 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.622 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.622 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.622 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T04:59:57.622 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.622 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.622 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.622 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.623 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.623 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.623 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.623 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.623 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.623 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.623 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.623 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "test_orchestrator", 2024-09-19T04:59:57.623 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.623 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.623 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.623 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.623 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.623 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.624 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.624 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.624 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.624 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.624 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.624 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.624 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.624 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.624 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.624 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.624 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.624 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.624 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.625 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.625 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.625 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.625 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.625 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.625 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.625 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.625 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.625 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.625 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.625 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.625 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.625 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.625 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.626 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.626 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.626 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.626 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.626 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.626 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.626 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.626 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.626 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.626 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.626 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.626 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.626 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.626 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.627 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.627 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.627 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.627 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.627 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.627 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.627 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.627 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.627 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.627 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.627 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.627 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.627 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.628 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.628 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.628 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.628 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.628 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.628 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.628 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.628 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.628 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.628 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.628 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.628 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.628 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.629 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.629 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.629 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.629 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "volumes", 2024-09-19T04:59:57.629 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.629 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.629 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.629 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.629 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.629 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.629 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.629 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.629 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.629 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.630 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.630 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.630 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.630 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.630 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.630 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.630 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.630 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.630 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.630 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.630 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.630 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.630 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.631 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.631 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.631 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.631 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.631 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.631 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.631 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.631 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.631 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.631 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.631 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.631 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.631 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.632 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.632 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.632 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.632 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.632 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.632 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.632 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.632 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.632 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.632 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.632 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.632 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.632 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.633 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.633 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.633 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.633 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.633 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.633 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.633 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.633 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.633 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.633 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.633 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.633 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.633 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.634 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.634 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.634 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.634 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.634 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.634 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.634 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.634 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.634 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.634 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.634 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.634 INFO:teuthology.orchestra.run.smithi002.stdout: "max_concurrent_clones": { 2024-09-19T04:59:57.634 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_concurrent_clones", 2024-09-19T04:59:57.634 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.635 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.635 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.635 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "4", 2024-09-19T04:59:57.635 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.635 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.635 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.635 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T04:59:57.635 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.635 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.635 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.635 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.635 INFO:teuthology.orchestra.run.smithi002.stdout: "periodic_async_work": { 2024-09-19T04:59:57.635 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "periodic_async_work", 2024-09-19T04:59:57.636 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.636 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.636 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.636 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.636 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.636 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.636 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.636 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Periodically check for async work", 2024-09-19T04:59:57.636 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.636 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.636 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.637 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.637 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot_clone_delay": { 2024-09-19T04:59:57.637 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snapshot_clone_delay", 2024-09-19T04:59:57.637 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.637 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.637 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.637 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-19T04:59:57.637 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.637 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.637 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.637 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T04:59:57.637 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.637 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.638 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.638 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.638 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot_clone_no_wait": { 2024-09-19T04:59:57.638 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T04:59:57.638 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.638 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.638 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.638 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T04:59:57.638 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.638 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.638 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.638 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T04:59:57.638 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.638 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.639 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.639 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.639 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.639 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.639 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.639 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix", 2024-09-19T04:59:57.639 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T04:59:57.639 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T04:59:57.639 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T04:59:57.639 INFO:teuthology.orchestra.run.smithi002.stdout: "discovery_interval": { 2024-09-19T04:59:57.639 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "discovery_interval", 2024-09-19T04:59:57.639 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-19T04:59:57.639 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.640 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.640 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "100", 2024-09-19T04:59:57.640 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.640 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.640 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.640 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.640 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.640 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.640 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.640 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.640 INFO:teuthology.orchestra.run.smithi002.stdout: "identifier": { 2024-09-19T04:59:57.640 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "identifier", 2024-09-19T04:59:57.640 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.640 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.641 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.641 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.641 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.641 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.641 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.641 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.641 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.641 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.641 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.641 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.641 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-19T04:59:57.641 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-19T04:59:57.641 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T04:59:57.642 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.642 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.642 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-19T04:59:57.642 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.642 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.642 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.642 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.642 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.642 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.642 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.642 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.642 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T04:59:57.642 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T04:59:57.642 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.643 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.643 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.643 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.643 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.643 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.643 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.643 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.643 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.643 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.643 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.643 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.643 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.643 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.644 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.644 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.644 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.644 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.644 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.644 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T04:59:57.644 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T04:59:57.644 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.644 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.644 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.644 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.644 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.644 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.644 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.645 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.645 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.645 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.645 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.645 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.645 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T04:59:57.645 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T04:59:57.645 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.645 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.645 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.645 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T04:59:57.645 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.645 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.646 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T04:59:57.646 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T04:59:57.646 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T04:59:57.646 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T04:59:57.646 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T04:59:57.646 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T04:59:57.646 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T04:59:57.646 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.646 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.646 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.646 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.646 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.646 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.647 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T04:59:57.647 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T04:59:57.647 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T04:59:57.647 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.647 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T04:59:57.647 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T04:59:57.647 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.647 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.647 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.647 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.647 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.647 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.647 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.648 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.648 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_host": { 2024-09-19T04:59:57.648 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_host", 2024-09-19T04:59:57.648 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.648 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.648 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.648 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T04:59:57.648 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.648 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.648 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.648 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.648 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.648 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.649 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.649 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.649 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_port": { 2024-09-19T04:59:57.649 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_port", 2024-09-19T04:59:57.649 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T04:59:57.649 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.649 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.649 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10051", 2024-09-19T04:59:57.649 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.649 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.649 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.649 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.649 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.650 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.650 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.650 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.650 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_sender": { 2024-09-19T04:59:57.650 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_sender", 2024-09-19T04:59:57.650 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T04:59:57.650 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T04:59:57.650 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T04:59:57.650 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T04:59:57.650 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T04:59:57.650 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T04:59:57.650 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T04:59:57.650 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T04:59:57.650 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T04:59:57.651 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T04:59:57.651 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T04:59:57.651 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.651 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.651 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.651 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.651 INFO:teuthology.orchestra.run.smithi002.stdout: "services": { 2024-09-19T04:59:57.651 INFO:teuthology.orchestra.run.smithi002.stdout: "dashboard": "https://172.21.15.2:8443/" 2024-09-19T04:59:57.651 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.651 INFO:teuthology.orchestra.run.smithi002.stdout: "always_on_modules": { 2024-09-19T04:59:57.651 INFO:teuthology.orchestra.run.smithi002.stdout: "octopus": [ 2024-09-19T04:59:57.651 INFO:teuthology.orchestra.run.smithi002.stdout: "balancer", 2024-09-19T04:59:57.651 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-09-19T04:59:57.652 INFO:teuthology.orchestra.run.smithi002.stdout: "devicehealth", 2024-09-19T04:59:57.652 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator", 2024-09-19T04:59:57.652 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscaler", 2024-09-19T04:59:57.652 INFO:teuthology.orchestra.run.smithi002.stdout: "progress", 2024-09-19T04:59:57.652 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_support", 2024-09-19T04:59:57.652 INFO:teuthology.orchestra.run.smithi002.stdout: "status", 2024-09-19T04:59:57.652 INFO:teuthology.orchestra.run.smithi002.stdout: "telemetry", 2024-09-19T04:59:57.652 INFO:teuthology.orchestra.run.smithi002.stdout: "volumes" 2024-09-19T04:59:57.652 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.652 INFO:teuthology.orchestra.run.smithi002.stdout: "pacific": [ 2024-09-19T04:59:57.652 INFO:teuthology.orchestra.run.smithi002.stdout: "balancer", 2024-09-19T04:59:57.652 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-09-19T04:59:57.652 INFO:teuthology.orchestra.run.smithi002.stdout: "devicehealth", 2024-09-19T04:59:57.652 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator", 2024-09-19T04:59:57.653 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscaler", 2024-09-19T04:59:57.653 INFO:teuthology.orchestra.run.smithi002.stdout: "progress", 2024-09-19T04:59:57.653 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_support", 2024-09-19T04:59:57.653 INFO:teuthology.orchestra.run.smithi002.stdout: "status", 2024-09-19T04:59:57.653 INFO:teuthology.orchestra.run.smithi002.stdout: "telemetry", 2024-09-19T04:59:57.653 INFO:teuthology.orchestra.run.smithi002.stdout: "volumes" 2024-09-19T04:59:57.653 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.653 INFO:teuthology.orchestra.run.smithi002.stdout: "quincy": [ 2024-09-19T04:59:57.653 INFO:teuthology.orchestra.run.smithi002.stdout: "balancer", 2024-09-19T04:59:57.655 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-09-19T04:59:57.656 INFO:teuthology.orchestra.run.smithi002.stdout: "devicehealth", 2024-09-19T04:59:57.656 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator", 2024-09-19T04:59:57.656 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscaler", 2024-09-19T04:59:57.656 INFO:teuthology.orchestra.run.smithi002.stdout: "progress", 2024-09-19T04:59:57.656 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_support", 2024-09-19T04:59:57.656 INFO:teuthology.orchestra.run.smithi002.stdout: "status", 2024-09-19T04:59:57.656 INFO:teuthology.orchestra.run.smithi002.stdout: "telemetry", 2024-09-19T04:59:57.656 INFO:teuthology.orchestra.run.smithi002.stdout: "volumes" 2024-09-19T04:59:57.656 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.656 INFO:teuthology.orchestra.run.smithi002.stdout: "reef": [ 2024-09-19T04:59:57.656 INFO:teuthology.orchestra.run.smithi002.stdout: "balancer", 2024-09-19T04:59:57.656 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-09-19T04:59:57.656 INFO:teuthology.orchestra.run.smithi002.stdout: "devicehealth", 2024-09-19T04:59:57.657 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator", 2024-09-19T04:59:57.657 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscaler", 2024-09-19T04:59:57.657 INFO:teuthology.orchestra.run.smithi002.stdout: "progress", 2024-09-19T04:59:57.657 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_support", 2024-09-19T04:59:57.657 INFO:teuthology.orchestra.run.smithi002.stdout: "status", 2024-09-19T04:59:57.657 INFO:teuthology.orchestra.run.smithi002.stdout: "telemetry", 2024-09-19T04:59:57.657 INFO:teuthology.orchestra.run.smithi002.stdout: "volumes" 2024-09-19T04:59:57.657 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T04:59:57.657 INFO:teuthology.orchestra.run.smithi002.stdout: "squid": [ 2024-09-19T04:59:57.657 INFO:teuthology.orchestra.run.smithi002.stdout: "balancer", 2024-09-19T04:59:57.657 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-09-19T04:59:57.657 INFO:teuthology.orchestra.run.smithi002.stdout: "devicehealth", 2024-09-19T04:59:57.657 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator", 2024-09-19T04:59:57.657 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscaler", 2024-09-19T04:59:57.658 INFO:teuthology.orchestra.run.smithi002.stdout: "progress", 2024-09-19T04:59:57.658 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_support", 2024-09-19T04:59:57.658 INFO:teuthology.orchestra.run.smithi002.stdout: "status", 2024-09-19T04:59:57.658 INFO:teuthology.orchestra.run.smithi002.stdout: "telemetry", 2024-09-19T04:59:57.658 INFO:teuthology.orchestra.run.smithi002.stdout: "volumes" 2024-09-19T04:59:57.658 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-19T04:59:57.658 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.658 INFO:teuthology.orchestra.run.smithi002.stdout: "last_failure_osd_epoch": 81, 2024-09-19T04:59:57.658 INFO:teuthology.orchestra.run.smithi002.stdout: "active_clients": [ 2024-09-19T04:59:57.658 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.658 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "devicehealth", 2024-09-19T04:59:57.658 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-09-19T04:59:57.658 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.658 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-09-19T04:59:57.659 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-09-19T04:59:57.659 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 1074114537 2024-09-19T04:59:57.659 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.659 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-19T04:59:57.659 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.659 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.659 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "libcephsqlite", 2024-09-19T04:59:57.659 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-09-19T04:59:57.659 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.659 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-09-19T04:59:57.659 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-09-19T04:59:57.659 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 675105642 2024-09-19T04:59:57.659 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.659 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-19T04:59:57.660 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.660 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.660 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_support", 2024-09-19T04:59:57.660 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-09-19T04:59:57.660 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.660 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-09-19T04:59:57.660 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-09-19T04:59:57.660 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 2601362136 2024-09-19T04:59:57.660 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.660 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-19T04:59:57.660 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.660 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.660 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snap_schedule", 2024-09-19T04:59:57.661 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-09-19T04:59:57.661 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.661 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-09-19T04:59:57.661 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-09-19T04:59:57.661 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 3056941657 2024-09-19T04:59:57.661 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.661 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-19T04:59:57.661 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.661 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.661 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snap_schedule", 2024-09-19T04:59:57.661 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-09-19T04:59:57.661 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.661 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-09-19T04:59:57.661 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-09-19T04:59:57.662 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 1946044071 2024-09-19T04:59:57.662 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.662 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-19T04:59:57.662 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:57.662 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.662 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "volumes", 2024-09-19T04:59:57.662 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-09-19T04:59:57.662 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T04:59:57.662 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-09-19T04:59:57.662 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-09-19T04:59:57.662 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 3873492816 2024-09-19T04:59:57.662 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.662 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-19T04:59:57.663 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:57.663 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-19T04:59:57.663 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:59:57.664 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:56 smithi116 ceph-mon[34477]: pgmap v371: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T04:59:57.664 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:56 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/585150721' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T04:59:57.664 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:56 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/3739657896' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T04:59:57.664 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:56 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/3081721521' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T04:59:57.664 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:56 smithi018 ceph-mon[34537]: pgmap v371: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T04:59:57.665 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:56 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/585150721' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T04:59:57.665 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:56 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/3739657896' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T04:59:57.665 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:56 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/3081721521' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T04:59:57.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.290+0000 7f47a773b640 1 -- 172.21.15.2:0/3081721521 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f478c0a3440 msgr2=0x7f478c0a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:57.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.290+0000 7f47a773b640 1 --2- 172.21.15.2:0/3081721521 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f478c0a3440 0x7f478c0a5900 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f479c031440 tx=0x7f479c005a20 comp rx=0 tx=0).stop 2024-09-19T04:59:57.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.290+0000 7f47a773b640 1 -- 172.21.15.2:0/3081721521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47a0199c70 msgr2=0x7f47a01a4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:59:57.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.290+0000 7f47a773b640 1 --2- 172.21.15.2:0/3081721521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47a0199c70 0x7f47a01a4220 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f479800cad0 tx=0x7f479800cf90 comp rx=0 tx=0).stop 2024-09-19T04:59:57.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.290+0000 7f47a773b640 1 -- 172.21.15.2:0/3081721521 shutdown_connections 2024-09-19T04:59:57.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.290+0000 7f47a773b640 1 --2- 172.21.15.2:0/3081721521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47a0199c70 0x7f47a01a4220 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:57.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.290+0000 7f47a773b640 1 --2- 172.21.15.2:0/3081721521 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47a0106f40 0x7f47a01996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:57.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.290+0000 7f47a773b640 1 --2- 172.21.15.2:0/3081721521 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f478c0a3440 0x7f478c0a5900 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:57.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.290+0000 7f47a773b640 1 --2- 172.21.15.2:0/3081721521 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47a0101990 0x7f47a01991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:59:57.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.290+0000 7f47a773b640 1 -- 172.21.15.2:0/3081721521 >> 172.21.15.2:0/3081721521 conn(0x7f47a0075ec0 msgr2=0x7f47a0104af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:59:57.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.291+0000 7f47a773b640 1 -- 172.21.15.2:0/3081721521 shutdown_connections 2024-09-19T04:59:57.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T04:59:56.291+0000 7f47a773b640 1 -- 172.21.15.2:0/3081721521 wait complete. 2024-09-19T04:59:57.723 DEBUG:tasks.check_counter:Getting stats from a 2024-09-19T04:59:57.723 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-19T04:59:57.724 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:56 smithi002 ceph-mon[30975]: pgmap v371: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T04:59:57.724 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:56 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/585150721' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T04:59:57.724 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:56 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/3739657896' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T04:59:57.724 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:56 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/3081721521' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T04:59:57.993 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:59:58.459 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T04:59:58.460 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T04:59:58.460 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 236, 2024-09-19T04:59:58.460 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 224, 2024-09-19T04:59:58.460 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 1454080, 2024-09-19T04:59:58.460 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 136832, 2024-09-19T04:59:58.460 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 4, 2024-09-19T04:59:58.460 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 0, 2024-09-19T04:59:58.460 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.044779098, 2024-09-19T04:59:58.460 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.016326725, 2024-09-19T04:59:58.460 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.038519191, 2024-09-19T04:59:58.460 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T04:59:58.461 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:59:58.461 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 224, 2024-09-19T04:59:58.461 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.015757563, 2024-09-19T04:59:58.461 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000070346 2024-09-19T04:59:58.461 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:58.461 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:59:58.461 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-19T04:59:58.461 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-19T04:59:58.461 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-19T04:59:58.461 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:58.461 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 1454080, 2024-09-19T04:59:58.461 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 136832 2024-09-19T04:59:58.461 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:58.462 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T04:59:58.462 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 2, 2024-09-19T04:59:58.462 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 170, 2024-09-19T04:59:58.462 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 320, 2024-09-19T04:59:58.462 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 186960, 2024-09-19T04:59:58.462 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 5, 2024-09-19T04:59:58.462 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 3, 2024-09-19T04:59:58.462 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.013447784, 2024-09-19T04:59:58.462 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.009131187, 2024-09-19T04:59:58.462 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.002058533, 2024-09-19T04:59:58.462 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T04:59:58.462 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:59:58.463 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 167, 2024-09-19T04:59:58.463 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.014677081, 2024-09-19T04:59:58.463 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000087886 2024-09-19T04:59:58.463 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:58.463 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:59:58.463 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-19T04:59:58.463 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-19T04:59:58.463 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-19T04:59:58.463 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:58.463 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T04:59:58.463 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 186960 2024-09-19T04:59:58.463 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:58.463 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T04:59:58.463 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 0, 2024-09-19T04:59:58.464 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 2, 2024-09-19T04:59:58.464 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 0, 2024-09-19T04:59:58.464 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 0, 2024-09-19T04:59:58.464 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 2, 2024-09-19T04:59:58.464 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 1, 2024-09-19T04:59:58.464 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.000288937, 2024-09-19T04:59:58.464 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T04:59:58.464 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.000201956, 2024-09-19T04:59:58.464 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T04:59:58.464 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:59:58.465 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-19T04:59:58.465 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-19T04:59:58.465 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-19T04:59:58.465 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:58.465 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:59:58.465 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-19T04:59:58.465 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-19T04:59:58.465 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-19T04:59:58.465 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:58.465 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T04:59:58.465 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T04:59:58.465 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:58.465 INFO:teuthology.orchestra.run.smithi002.stdout: "cct": { 2024-09-19T04:59:58.466 INFO:teuthology.orchestra.run.smithi002.stdout: "total_workers": 0, 2024-09-19T04:59:58.466 INFO:teuthology.orchestra.run.smithi002.stdout: "unhealthy_workers": 0 2024-09-19T04:59:58.466 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:58.466 INFO:teuthology.orchestra.run.smithi002.stdout: "mempool": { 2024-09-19T04:59:58.466 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_bytes": 0, 2024-09-19T04:59:58.466 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_items": 0, 2024-09-19T04:59:58.466 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T04:59:58.466 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_items": 0, 2024-09-19T04:59:58.466 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T04:59:58.466 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_items": 0, 2024-09-19T04:59:58.466 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T04:59:58.467 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T04:59:58.467 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T04:59:58.467 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T04:59:58.467 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T04:59:58.467 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_items": 0, 2024-09-19T04:59:58.467 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T04:59:58.467 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T04:59:58.467 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_bytes": 0, 2024-09-19T04:59:58.467 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_items": 0, 2024-09-19T04:59:58.467 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_bytes": 0, 2024-09-19T04:59:58.467 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_items": 0, 2024-09-19T04:59:58.469 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T04:59:58.469 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T04:59:58.469 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T04:59:58.469 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T04:59:58.469 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T04:59:58.469 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_items": 0, 2024-09-19T04:59:58.469 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_bytes": 0, 2024-09-19T04:59:58.469 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_items": 0, 2024-09-19T04:59:58.469 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T04:59:58.469 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T04:59:58.470 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_bytes": 0, 2024-09-19T04:59:58.470 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_items": 0, 2024-09-19T04:59:58.470 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_bytes": 0, 2024-09-19T04:59:58.470 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_items": 0, 2024-09-19T04:59:58.470 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T04:59:58.470 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_items": 0, 2024-09-19T04:59:58.470 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T04:59:58.470 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_items": 0, 2024-09-19T04:59:58.470 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_bytes": 148977, 2024-09-19T04:59:58.470 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_items": 30, 2024-09-19T04:59:58.470 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_bytes": 0, 2024-09-19T04:59:58.470 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_items": 0, 2024-09-19T04:59:58.470 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_bytes": 0, 2024-09-19T04:59:58.470 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_items": 0, 2024-09-19T04:59:58.471 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_bytes": 0, 2024-09-19T04:59:58.471 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_items": 0, 2024-09-19T04:59:58.471 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_bytes": 0, 2024-09-19T04:59:58.471 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_items": 0, 2024-09-19T04:59:58.471 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_bytes": 0, 2024-09-19T04:59:58.471 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_items": 0, 2024-09-19T04:59:58.471 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T04:59:58.471 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_items": 0, 2024-09-19T04:59:58.471 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_bytes": 0, 2024-09-19T04:59:58.471 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_items": 0, 2024-09-19T04:59:58.471 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_bytes": 928, 2024-09-19T04:59:58.471 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_items": 2, 2024-09-19T04:59:58.472 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_bytes": 0, 2024-09-19T04:59:58.472 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_items": 0, 2024-09-19T04:59:58.472 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_bytes": 0, 2024-09-19T04:59:58.472 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_items": 0 2024-09-19T04:59:58.472 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T04:59:58.472 INFO:teuthology.orchestra.run.smithi002.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T04:59:58.472 INFO:teuthology.orchestra.run.smithi002.stdout: "val": 0, 2024-09-19T04:59:58.472 INFO:teuthology.orchestra.run.smithi002.stdout: "max": 104857600, 2024-09-19T04:59:58.472 INFO:teuthology.orchestra.run.smithi002.stdout: "get_started": 0, 2024-09-19T04:59:58.472 INFO:teuthology.orchestra.run.smithi002.stdout: "get": 234, 2024-09-19T04:59:58.472 INFO:teuthology.orchestra.run.smithi002.stdout: "get_sum": 1418393, 2024-09-19T04:59:58.472 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_fail": 0, 2024-09-19T04:59:58.472 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_success": 234, 2024-09-19T04:59:58.473 INFO:teuthology.orchestra.run.smithi002.stdout: "take": 0, 2024-09-19T04:59:58.473 INFO:teuthology.orchestra.run.smithi002.stdout: "take_sum": 0, 2024-09-19T04:59:58.473 INFO:teuthology.orchestra.run.smithi002.stdout: "put": 234, 2024-09-19T04:59:58.473 INFO:teuthology.orchestra.run.smithi002.stdout: "put_sum": 1418393, 2024-09-19T04:59:58.473 INFO:teuthology.orchestra.run.smithi002.stdout: "wait": { 2024-09-19T04:59:58.473 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-19T04:59:58.473 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-19T04:59:58.473 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-19T04:59:58.473 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:58.473 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T04:59:58.473 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T04:59:58.774 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 04:59:58 smithi002 ceph-mon[30975]: pgmap v372: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:59:58.806 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 04:59:58 smithi018 ceph-mon[34537]: pgmap v372: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:59:58.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 04:59:58 smithi116 ceph-mon[34477]: pgmap v372: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T04:59:59.222 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2024-09-19T04:59:59.222 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2024-09-19T04:59:59.222 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2024-09-19T04:59:59.222 DEBUG:tasks.check_counter:Getting stats from d 2024-09-19T04:59:59.222 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-19T04:59:59.483 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:00:00.010 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T05:00:00.011 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T05:00:00.011 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 4, 2024-09-19T05:00:00.011 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 4, 2024-09-19T05:00:00.011 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 2944, 2024-09-19T05:00:00.011 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 448, 2024-09-19T05:00:00.011 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 4, 2024-09-19T05:00:00.011 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 0, 2024-09-19T05:00:00.011 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.003418149, 2024-09-19T05:00:00.011 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.000043254, 2024-09-19T05:00:00.011 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.002429771, 2024-09-19T05:00:00.011 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T05:00:00.011 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:00:00.012 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 3, 2024-09-19T05:00:00.012 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.004370894, 2024-09-19T05:00:00.012 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.001456964 2024-09-19T05:00:00.012 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T05:00:00.012 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:00:00.012 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-19T05:00:00.012 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-19T05:00:00.012 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-19T05:00:00.012 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T05:00:00.012 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-19T05:00:00.012 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T05:00:00.012 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T05:00:00.012 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T05:00:00.013 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 237, 2024-09-19T05:00:00.013 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 227, 2024-09-19T05:00:00.013 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 1452496, 2024-09-19T05:00:00.013 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 139584, 2024-09-19T05:00:00.013 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 2, 2024-09-19T05:00:00.013 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 1, 2024-09-19T05:00:00.013 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.044591055, 2024-09-19T05:00:00.013 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.017011253, 2024-09-19T05:00:00.013 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.039299023, 2024-09-19T05:00:00.013 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T05:00:00.013 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:00:00.013 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 226, 2024-09-19T05:00:00.013 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.014006374, 2024-09-19T05:00:00.014 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000061975 2024-09-19T05:00:00.014 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T05:00:00.014 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:00:00.014 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-19T05:00:00.014 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-19T05:00:00.014 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-19T05:00:00.014 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T05:00:00.014 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 1452496, 2024-09-19T05:00:00.014 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 139584 2024-09-19T05:00:00.014 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T05:00:00.014 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T05:00:00.014 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 2, 2024-09-19T05:00:00.014 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 174, 2024-09-19T05:00:00.014 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 320, 2024-09-19T05:00:00.015 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 187664, 2024-09-19T05:00:00.015 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 5, 2024-09-19T05:00:00.015 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 3, 2024-09-19T05:00:00.015 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.014007931, 2024-09-19T05:00:00.015 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.009824274, 2024-09-19T05:00:00.015 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.001889519, 2024-09-19T05:00:00.015 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T05:00:00.015 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:00:00.015 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 171, 2024-09-19T05:00:00.015 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.018159317, 2024-09-19T05:00:00.015 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000106194 2024-09-19T05:00:00.015 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T05:00:00.015 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:00:00.015 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-19T05:00:00.016 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-19T05:00:00.016 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-19T05:00:00.016 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T05:00:00.016 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T05:00:00.016 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 187664 2024-09-19T05:00:00.016 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T05:00:00.016 INFO:teuthology.orchestra.run.smithi002.stdout: "cct": { 2024-09-19T05:00:00.016 INFO:teuthology.orchestra.run.smithi002.stdout: "total_workers": 0, 2024-09-19T05:00:00.016 INFO:teuthology.orchestra.run.smithi002.stdout: "unhealthy_workers": 0 2024-09-19T05:00:00.016 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T05:00:00.016 INFO:teuthology.orchestra.run.smithi002.stdout: "mempool": { 2024-09-19T05:00:00.016 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_bytes": 0, 2024-09-19T05:00:00.016 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_items": 0, 2024-09-19T05:00:00.017 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T05:00:00.017 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_items": 0, 2024-09-19T05:00:00.017 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T05:00:00.017 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_items": 0, 2024-09-19T05:00:00.017 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T05:00:00.017 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T05:00:00.017 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T05:00:00.017 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T05:00:00.017 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T05:00:00.017 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_items": 0, 2024-09-19T05:00:00.017 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T05:00:00.017 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T05:00:00.017 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_bytes": 0, 2024-09-19T05:00:00.018 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_items": 0, 2024-09-19T05:00:00.018 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_bytes": 0, 2024-09-19T05:00:00.018 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_items": 0, 2024-09-19T05:00:00.018 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T05:00:00.018 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T05:00:00.018 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T05:00:00.018 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T05:00:00.018 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T05:00:00.018 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_items": 0, 2024-09-19T05:00:00.018 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_bytes": 0, 2024-09-19T05:00:00.018 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_items": 0, 2024-09-19T05:00:00.018 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T05:00:00.019 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T05:00:00.019 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_bytes": 0, 2024-09-19T05:00:00.019 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_items": 0, 2024-09-19T05:00:00.019 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_bytes": 0, 2024-09-19T05:00:00.019 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_items": 0, 2024-09-19T05:00:00.019 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T05:00:00.020 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_items": 0, 2024-09-19T05:00:00.020 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T05:00:00.020 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_items": 0, 2024-09-19T05:00:00.020 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_bytes": 149017, 2024-09-19T05:00:00.020 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_items": 31, 2024-09-19T05:00:00.020 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_bytes": 0, 2024-09-19T05:00:00.020 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_items": 0, 2024-09-19T05:00:00.020 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_bytes": 0, 2024-09-19T05:00:00.020 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_items": 0, 2024-09-19T05:00:00.020 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_bytes": 0, 2024-09-19T05:00:00.020 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_items": 0, 2024-09-19T05:00:00.020 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_bytes": 0, 2024-09-19T05:00:00.021 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_items": 0, 2024-09-19T05:00:00.021 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_bytes": 0, 2024-09-19T05:00:00.021 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_items": 0, 2024-09-19T05:00:00.021 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T05:00:00.021 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_items": 0, 2024-09-19T05:00:00.021 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_bytes": 0, 2024-09-19T05:00:00.021 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_items": 0, 2024-09-19T05:00:00.021 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_bytes": 928, 2024-09-19T05:00:00.021 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_items": 2, 2024-09-19T05:00:00.021 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_bytes": 0, 2024-09-19T05:00:00.021 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_items": 0, 2024-09-19T05:00:00.021 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_bytes": 0, 2024-09-19T05:00:00.021 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_items": 0 2024-09-19T05:00:00.022 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T05:00:00.022 INFO:teuthology.orchestra.run.smithi002.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T05:00:00.022 INFO:teuthology.orchestra.run.smithi002.stdout: "val": 0, 2024-09-19T05:00:00.022 INFO:teuthology.orchestra.run.smithi002.stdout: "max": 104857600, 2024-09-19T05:00:00.022 INFO:teuthology.orchestra.run.smithi002.stdout: "get_started": 0, 2024-09-19T05:00:00.022 INFO:teuthology.orchestra.run.smithi002.stdout: "get": 239, 2024-09-19T05:00:00.022 INFO:teuthology.orchestra.run.smithi002.stdout: "get_sum": 1419043, 2024-09-19T05:00:00.022 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_fail": 0, 2024-09-19T05:00:00.022 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_success": 239, 2024-09-19T05:00:00.022 INFO:teuthology.orchestra.run.smithi002.stdout: "take": 0, 2024-09-19T05:00:00.023 INFO:teuthology.orchestra.run.smithi002.stdout: "take_sum": 0, 2024-09-19T05:00:00.023 INFO:teuthology.orchestra.run.smithi002.stdout: "put": 239, 2024-09-19T05:00:00.023 INFO:teuthology.orchestra.run.smithi002.stdout: "put_sum": 1419043, 2024-09-19T05:00:00.023 INFO:teuthology.orchestra.run.smithi002.stdout: "wait": { 2024-09-19T05:00:00.023 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-19T05:00:00.023 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-19T05:00:00.023 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-19T05:00:00.023 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T05:00:00.023 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T05:00:00.023 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T05:00:00.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:00 smithi002 ceph-mon[30975]: pgmap v373: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:00:00.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:00 smithi002 ceph-mon[30975]: overall HEALTH_OK 2024-09-19T05:00:00.803 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-09-19T05:00:00.803 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-09-19T05:00:00.803 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-09-19T05:00:00.804 DEBUG:tasks.check_counter:Getting stats from g 2024-09-19T05:00:00.804 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-19T05:00:00.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:00 smithi018 ceph-mon[34537]: pgmap v373: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:00:00.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:00 smithi018 ceph-mon[34537]: overall HEALTH_OK 2024-09-19T05:00:00.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:00 smithi116 ceph-mon[34477]: pgmap v373: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:00:00.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:00 smithi116 ceph-mon[34477]: overall HEALTH_OK 2024-09-19T05:00:01.061 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:00:01.544 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T05:00:01.544 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T05:00:01.544 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 238, 2024-09-19T05:00:01.544 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 226, 2024-09-19T05:00:01.544 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 1454624, 2024-09-19T05:00:01.544 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 138112, 2024-09-19T05:00:01.544 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 4, 2024-09-19T05:00:01.544 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 0, 2024-09-19T05:00:01.544 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.045481612, 2024-09-19T05:00:01.544 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.016343112, 2024-09-19T05:00:01.545 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.040630922, 2024-09-19T05:00:01.545 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T05:00:01.545 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:00:01.545 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 226, 2024-09-19T05:00:01.545 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.017940762, 2024-09-19T05:00:01.545 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000079383 2024-09-19T05:00:01.545 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T05:00:01.545 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:00:01.545 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-19T05:00:01.545 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-19T05:00:01.545 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-19T05:00:01.545 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T05:00:01.546 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 1454624, 2024-09-19T05:00:01.546 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 138112 2024-09-19T05:00:01.546 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T05:00:01.546 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T05:00:01.546 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 2, 2024-09-19T05:00:01.546 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 172, 2024-09-19T05:00:01.546 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 320, 2024-09-19T05:00:01.546 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 187312, 2024-09-19T05:00:01.546 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 5, 2024-09-19T05:00:01.546 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 3, 2024-09-19T05:00:01.546 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.014054287, 2024-09-19T05:00:01.546 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.009809950, 2024-09-19T05:00:01.546 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.001892796, 2024-09-19T05:00:01.546 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T05:00:01.547 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:00:01.547 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 169, 2024-09-19T05:00:01.547 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.017145402, 2024-09-19T05:00:01.547 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000101452 2024-09-19T05:00:01.547 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T05:00:01.547 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:00:01.547 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-19T05:00:01.547 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-19T05:00:01.547 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-19T05:00:01.547 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T05:00:01.547 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T05:00:01.547 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 187312 2024-09-19T05:00:01.547 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T05:00:01.548 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T05:00:01.548 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 0, 2024-09-19T05:00:01.548 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 2, 2024-09-19T05:00:01.548 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 0, 2024-09-19T05:00:01.548 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 0, 2024-09-19T05:00:01.548 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 2, 2024-09-19T05:00:01.548 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 1, 2024-09-19T05:00:01.548 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.000383314, 2024-09-19T05:00:01.548 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T05:00:01.548 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.000299786, 2024-09-19T05:00:01.548 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T05:00:01.548 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:00:01.548 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-19T05:00:01.549 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-19T05:00:01.549 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-19T05:00:01.549 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T05:00:01.549 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:00:01.549 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-19T05:00:01.549 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-19T05:00:01.549 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-19T05:00:01.549 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T05:00:01.549 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T05:00:01.549 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T05:00:01.549 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T05:00:01.549 INFO:teuthology.orchestra.run.smithi002.stdout: "cct": { 2024-09-19T05:00:01.549 INFO:teuthology.orchestra.run.smithi002.stdout: "total_workers": 0, 2024-09-19T05:00:01.550 INFO:teuthology.orchestra.run.smithi002.stdout: "unhealthy_workers": 0 2024-09-19T05:00:01.550 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T05:00:01.550 INFO:teuthology.orchestra.run.smithi002.stdout: "mempool": { 2024-09-19T05:00:01.550 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_bytes": 0, 2024-09-19T05:00:01.550 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_items": 0, 2024-09-19T05:00:01.550 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T05:00:01.550 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_items": 0, 2024-09-19T05:00:01.550 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T05:00:01.550 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_items": 0, 2024-09-19T05:00:01.550 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T05:00:01.550 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T05:00:01.550 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T05:00:01.550 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T05:00:01.550 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T05:00:01.551 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_items": 0, 2024-09-19T05:00:01.551 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T05:00:01.551 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T05:00:01.551 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_bytes": 0, 2024-09-19T05:00:01.551 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_items": 0, 2024-09-19T05:00:01.551 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_bytes": 0, 2024-09-19T05:00:01.551 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_items": 0, 2024-09-19T05:00:01.551 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T05:00:01.551 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T05:00:01.551 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T05:00:01.551 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T05:00:01.551 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T05:00:01.551 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_items": 0, 2024-09-19T05:00:01.552 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_bytes": 0, 2024-09-19T05:00:01.552 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_items": 0, 2024-09-19T05:00:01.552 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T05:00:01.552 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T05:00:01.552 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_bytes": 0, 2024-09-19T05:00:01.552 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_items": 0, 2024-09-19T05:00:01.552 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_bytes": 0, 2024-09-19T05:00:01.552 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_items": 0, 2024-09-19T05:00:01.552 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T05:00:01.552 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_items": 0, 2024-09-19T05:00:01.552 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T05:00:01.552 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_items": 0, 2024-09-19T05:00:01.553 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_bytes": 149034, 2024-09-19T05:00:01.553 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_items": 32, 2024-09-19T05:00:01.553 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_bytes": 0, 2024-09-19T05:00:01.553 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_items": 0, 2024-09-19T05:00:01.553 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_bytes": 0, 2024-09-19T05:00:01.553 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_items": 0, 2024-09-19T05:00:01.553 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_bytes": 0, 2024-09-19T05:00:01.553 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_items": 0, 2024-09-19T05:00:01.553 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_bytes": 0, 2024-09-19T05:00:01.553 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_items": 0, 2024-09-19T05:00:01.553 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_bytes": 0, 2024-09-19T05:00:01.553 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_items": 0, 2024-09-19T05:00:01.553 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T05:00:01.553 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_items": 0, 2024-09-19T05:00:01.554 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_bytes": 0, 2024-09-19T05:00:01.554 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_items": 0, 2024-09-19T05:00:01.554 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_bytes": 928, 2024-09-19T05:00:01.554 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_items": 2, 2024-09-19T05:00:01.554 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_bytes": 0, 2024-09-19T05:00:01.554 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_items": 0, 2024-09-19T05:00:01.554 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_bytes": 0, 2024-09-19T05:00:01.554 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_items": 0 2024-09-19T05:00:01.554 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T05:00:01.554 INFO:teuthology.orchestra.run.smithi002.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T05:00:01.554 INFO:teuthology.orchestra.run.smithi002.stdout: "val": 0, 2024-09-19T05:00:01.554 INFO:teuthology.orchestra.run.smithi002.stdout: "max": 104857600, 2024-09-19T05:00:01.554 INFO:teuthology.orchestra.run.smithi002.stdout: "get_started": 0, 2024-09-19T05:00:01.554 INFO:teuthology.orchestra.run.smithi002.stdout: "get": 236, 2024-09-19T05:00:01.555 INFO:teuthology.orchestra.run.smithi002.stdout: "get_sum": 1418653, 2024-09-19T05:00:01.555 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_fail": 0, 2024-09-19T05:00:01.555 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_success": 236, 2024-09-19T05:00:01.555 INFO:teuthology.orchestra.run.smithi002.stdout: "take": 0, 2024-09-19T05:00:01.555 INFO:teuthology.orchestra.run.smithi002.stdout: "take_sum": 0, 2024-09-19T05:00:01.555 INFO:teuthology.orchestra.run.smithi002.stdout: "put": 236, 2024-09-19T05:00:01.555 INFO:teuthology.orchestra.run.smithi002.stdout: "put_sum": 1418653, 2024-09-19T05:00:01.555 INFO:teuthology.orchestra.run.smithi002.stdout: "wait": { 2024-09-19T05:00:01.555 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-19T05:00:01.555 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-19T05:00:01.555 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-19T05:00:01.555 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T05:00:01.555 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T05:00:01.555 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T05:00:02.337 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-09-19T05:00:02.337 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-09-19T05:00:02.337 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-09-19T05:00:02.337 DEBUG:tasks.check_counter:Getting stats from j 2024-09-19T05:00:02.337 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-19T05:00:02.600 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:00:02.609 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:02 smithi002 ceph-mon[30975]: pgmap v374: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T05:00:02.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:02 smithi018 ceph-mon[34537]: pgmap v374: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T05:00:02.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:02 smithi116 ceph-mon[34477]: pgmap v374: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T05:00:03.114 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T05:00:03.114 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T05:00:03.114 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 243, 2024-09-19T05:00:03.114 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 231, 2024-09-19T05:00:03.114 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 1455984, 2024-09-19T05:00:03.114 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 141312, 2024-09-19T05:00:03.114 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 4, 2024-09-19T05:00:03.114 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 0, 2024-09-19T05:00:03.114 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.048091322, 2024-09-19T05:00:03.114 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.016684936, 2024-09-19T05:00:03.115 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.042675269, 2024-09-19T05:00:03.115 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T05:00:03.115 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:00:03.115 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 231, 2024-09-19T05:00:03.115 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.017951964, 2024-09-19T05:00:03.115 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000077714 2024-09-19T05:00:03.115 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T05:00:03.115 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:00:03.115 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-19T05:00:03.115 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-19T05:00:03.115 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-19T05:00:03.115 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T05:00:03.116 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 1455984, 2024-09-19T05:00:03.116 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 141312 2024-09-19T05:00:03.116 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T05:00:03.116 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T05:00:03.116 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 2, 2024-09-19T05:00:03.116 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 175, 2024-09-19T05:00:03.116 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 320, 2024-09-19T05:00:03.116 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 187840, 2024-09-19T05:00:03.116 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 5, 2024-09-19T05:00:03.116 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 3, 2024-09-19T05:00:03.116 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.015957877, 2024-09-19T05:00:03.116 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.011012586, 2024-09-19T05:00:03.116 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.002242922, 2024-09-19T05:00:03.117 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T05:00:03.117 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:00:03.117 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 172, 2024-09-19T05:00:03.117 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.017383724, 2024-09-19T05:00:03.117 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000101068 2024-09-19T05:00:03.117 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T05:00:03.117 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:00:03.117 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-19T05:00:03.117 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-19T05:00:03.117 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-19T05:00:03.117 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T05:00:03.117 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T05:00:03.117 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 187840 2024-09-19T05:00:03.118 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T05:00:03.118 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T05:00:03.118 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 0, 2024-09-19T05:00:03.118 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 2, 2024-09-19T05:00:03.118 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 0, 2024-09-19T05:00:03.118 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 0, 2024-09-19T05:00:03.118 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 2, 2024-09-19T05:00:03.118 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 1, 2024-09-19T05:00:03.118 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.000315039, 2024-09-19T05:00:03.118 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T05:00:03.118 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.000234516, 2024-09-19T05:00:03.118 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T05:00:03.119 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:00:03.119 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-19T05:00:03.119 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-19T05:00:03.119 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-19T05:00:03.119 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T05:00:03.119 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:00:03.119 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-19T05:00:03.119 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-19T05:00:03.119 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-19T05:00:03.119 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T05:00:03.119 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T05:00:03.119 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T05:00:03.119 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T05:00:03.120 INFO:teuthology.orchestra.run.smithi002.stdout: "cct": { 2024-09-19T05:00:03.120 INFO:teuthology.orchestra.run.smithi002.stdout: "total_workers": 0, 2024-09-19T05:00:03.120 INFO:teuthology.orchestra.run.smithi002.stdout: "unhealthy_workers": 0 2024-09-19T05:00:03.120 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T05:00:03.120 INFO:teuthology.orchestra.run.smithi002.stdout: "mempool": { 2024-09-19T05:00:03.120 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_bytes": 0, 2024-09-19T05:00:03.120 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_items": 0, 2024-09-19T05:00:03.120 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T05:00:03.120 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_items": 0, 2024-09-19T05:00:03.121 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T05:00:03.121 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_items": 0, 2024-09-19T05:00:03.121 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T05:00:03.121 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T05:00:03.121 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T05:00:03.121 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T05:00:03.121 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T05:00:03.121 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_items": 0, 2024-09-19T05:00:03.121 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T05:00:03.121 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T05:00:03.121 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_bytes": 0, 2024-09-19T05:00:03.121 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_items": 0, 2024-09-19T05:00:03.121 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_bytes": 0, 2024-09-19T05:00:03.121 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_items": 0, 2024-09-19T05:00:03.122 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T05:00:03.122 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T05:00:03.122 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T05:00:03.122 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T05:00:03.122 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T05:00:03.122 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_items": 0, 2024-09-19T05:00:03.122 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_bytes": 0, 2024-09-19T05:00:03.122 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_items": 0, 2024-09-19T05:00:03.122 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T05:00:03.122 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T05:00:03.122 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_bytes": 0, 2024-09-19T05:00:03.122 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_items": 0, 2024-09-19T05:00:03.122 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_bytes": 0, 2024-09-19T05:00:03.122 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_items": 0, 2024-09-19T05:00:03.123 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T05:00:03.123 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_items": 0, 2024-09-19T05:00:03.123 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T05:00:03.123 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_items": 0, 2024-09-19T05:00:03.123 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_bytes": 149034, 2024-09-19T05:00:03.123 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_items": 32, 2024-09-19T05:00:03.123 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_bytes": 0, 2024-09-19T05:00:03.123 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_items": 0, 2024-09-19T05:00:03.123 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_bytes": 0, 2024-09-19T05:00:03.123 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_items": 0, 2024-09-19T05:00:03.123 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_bytes": 0, 2024-09-19T05:00:03.123 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_items": 0, 2024-09-19T05:00:03.123 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_bytes": 0, 2024-09-19T05:00:03.123 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_items": 0, 2024-09-19T05:00:03.124 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_bytes": 0, 2024-09-19T05:00:03.124 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_items": 0, 2024-09-19T05:00:03.124 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T05:00:03.124 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_items": 0, 2024-09-19T05:00:03.124 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_bytes": 0, 2024-09-19T05:00:03.124 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_items": 0, 2024-09-19T05:00:03.124 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_bytes": 928, 2024-09-19T05:00:03.124 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_items": 2, 2024-09-19T05:00:03.124 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_bytes": 0, 2024-09-19T05:00:03.124 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_items": 0, 2024-09-19T05:00:03.124 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_bytes": 0, 2024-09-19T05:00:03.124 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_items": 0 2024-09-19T05:00:03.124 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T05:00:03.124 INFO:teuthology.orchestra.run.smithi002.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T05:00:03.125 INFO:teuthology.orchestra.run.smithi002.stdout: "val": 0, 2024-09-19T05:00:03.125 INFO:teuthology.orchestra.run.smithi002.stdout: "max": 104857600, 2024-09-19T05:00:03.125 INFO:teuthology.orchestra.run.smithi002.stdout: "get_started": 0, 2024-09-19T05:00:03.125 INFO:teuthology.orchestra.run.smithi002.stdout: "get": 241, 2024-09-19T05:00:03.125 INFO:teuthology.orchestra.run.smithi002.stdout: "get_sum": 1419303, 2024-09-19T05:00:03.125 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_fail": 0, 2024-09-19T05:00:03.125 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_success": 241, 2024-09-19T05:00:03.125 INFO:teuthology.orchestra.run.smithi002.stdout: "take": 0, 2024-09-19T05:00:03.125 INFO:teuthology.orchestra.run.smithi002.stdout: "take_sum": 0, 2024-09-19T05:00:03.125 INFO:teuthology.orchestra.run.smithi002.stdout: "put": 241, 2024-09-19T05:00:03.125 INFO:teuthology.orchestra.run.smithi002.stdout: "put_sum": 1419303, 2024-09-19T05:00:03.125 INFO:teuthology.orchestra.run.smithi002.stdout: "wait": { 2024-09-19T05:00:03.125 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-19T05:00:03.126 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-19T05:00:03.126 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-19T05:00:03.126 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T05:00:03.126 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T05:00:03.126 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T05:00:03.764 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-09-19T05:00:03.764 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-09-19T05:00:03.764 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-09-19T05:00:03.764 DEBUG:tasks.check_counter:Getting stats from b 2024-09-19T05:00:03.764 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-19T05:00:04.036 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T05:00:04.581 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T05:00:04.581 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T05:00:04.582 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 1590, 2024-09-19T05:00:04.582 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 1592, 2024-09-19T05:00:04.582 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 8860329, 2024-09-19T05:00:04.582 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 505630, 2024-09-19T05:00:04.582 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 6, 2024-09-19T05:00:04.582 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 2, 2024-09-19T05:00:04.582 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.155233702, 2024-09-19T05:00:04.582 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.057812949, 2024-09-19T05:00:04.582 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.040685802, 2024-09-19T05:00:04.583 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.041485274, 2024-09-19T05:00:04.583 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:00:04.583 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 1590, 2024-09-19T05:00:04.583 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.066226929, 2024-09-19T05:00:04.583 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000041652 2024-09-19T05:00:04.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.583 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:00:04.583 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:04.583 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:04.583 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:04.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.584 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T05:00:04.584 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T05:00:04.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.584 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T05:00:04.584 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 680, 2024-09-19T05:00:04.585 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 848, 2024-09-19T05:00:04.585 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 8559556, 2024-09-19T05:00:04.585 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 681366, 2024-09-19T05:00:04.585 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 7, 2024-09-19T05:00:04.585 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 5, 2024-09-19T05:00:04.585 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.075982581, 2024-09-19T05:00:04.585 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.021444593, 2024-09-19T05:00:04.585 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.027629252, 2024-09-19T05:00:04.585 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.020380927, 2024-09-19T05:00:04.586 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:00:04.586 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 845, 2024-09-19T05:00:04.586 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.035789714, 2024-09-19T05:00:04.586 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000042354 2024-09-19T05:00:04.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.586 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:00:04.586 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:04.586 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:04.586 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:04.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.587 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T05:00:04.587 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 465696 2024-09-19T05:00:04.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.587 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T05:00:04.587 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 1050, 2024-09-19T05:00:04.587 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 1037, 2024-09-19T05:00:04.587 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 8693471, 2024-09-19T05:00:04.587 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 392927, 2024-09-19T05:00:04.587 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 4, 2024-09-19T05:00:04.587 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 3, 2024-09-19T05:00:04.587 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.121502023, 2024-09-19T05:00:04.587 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.035351405, 2024-09-19T05:00:04.588 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.070590684, 2024-09-19T05:00:04.588 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.023927124, 2024-09-19T05:00:04.588 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:00:04.588 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 1037, 2024-09-19T05:00:04.588 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.042491203, 2024-09-19T05:00:04.588 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000040975 2024-09-19T05:00:04.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.588 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:00:04.588 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:04.588 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:04.588 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:04.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.589 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 1475456, 2024-09-19T05:00:04.589 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 140752 2024-09-19T05:00:04.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.589 INFO:teuthology.orchestra.run.smithi018.stdout: "cct": { 2024-09-19T05:00:04.589 INFO:teuthology.orchestra.run.smithi018.stdout: "total_workers": 1, 2024-09-19T05:00:04.589 INFO:teuthology.orchestra.run.smithi018.stdout: "unhealthy_workers": 0 2024-09-19T05:00:04.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.589 INFO:teuthology.orchestra.run.smithi018.stdout: "finisher-MDSRank": { 2024-09-19T05:00:04.589 INFO:teuthology.orchestra.run.smithi018.stdout: "queue_len": 0, 2024-09-19T05:00:04.589 INFO:teuthology.orchestra.run.smithi018.stdout: "complete_latency": { 2024-09-19T05:00:04.589 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 5269, 2024-09-19T05:00:04.589 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.123483119, 2024-09-19T05:00:04.590 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000023435 2024-09-19T05:00:04.590 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T05:00:04.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.590 INFO:teuthology.orchestra.run.smithi018.stdout: "finisher-PurgeQueue": { 2024-09-19T05:00:04.590 INFO:teuthology.orchestra.run.smithi018.stdout: "queue_len": 0, 2024-09-19T05:00:04.590 INFO:teuthology.orchestra.run.smithi018.stdout: "complete_latency": { 2024-09-19T05:00:04.590 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:04.590 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:04.590 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:04.590 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T05:00:04.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.590 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": { 2024-09-19T05:00:04.590 INFO:teuthology.orchestra.run.smithi018.stdout: "request": 0, 2024-09-19T05:00:04.591 INFO:teuthology.orchestra.run.smithi018.stdout: "reply": 0, 2024-09-19T05:00:04.591 INFO:teuthology.orchestra.run.smithi018.stdout: "reply_latency": { 2024-09-19T05:00:04.591 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:04.591 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:04.591 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:04.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.591 INFO:teuthology.orchestra.run.smithi018.stdout: "slow_reply": 0, 2024-09-19T05:00:04.591 INFO:teuthology.orchestra.run.smithi018.stdout: "forward": 0, 2024-09-19T05:00:04.591 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_fetch_complete": 0, 2024-09-19T05:00:04.591 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_fetch_keys": 0, 2024-09-19T05:00:04.591 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_commit": 0, 2024-09-19T05:00:04.592 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_split": 0, 2024-09-19T05:00:04.592 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_merge": 0, 2024-09-19T05:00:04.592 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes": 31, 2024-09-19T05:00:04.592 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_top": 0, 2024-09-19T05:00:04.592 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_bottom": 31, 2024-09-19T05:00:04.592 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_pin_tail": 0, 2024-09-19T05:00:04.592 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_pinned": 31, 2024-09-19T05:00:04.592 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_expired": 0, 2024-09-19T05:00:04.592 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_with_caps": 0, 2024-09-19T05:00:04.592 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": 0, 2024-09-19T05:00:04.592 INFO:teuthology.orchestra.run.smithi018.stdout: "subtrees": 2, 2024-09-19T05:00:04.592 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse": 0, 2024-09-19T05:00:04.592 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_hit": 0, 2024-09-19T05:00:04.593 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_forward": 0, 2024-09-19T05:00:04.593 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_discover": 0, 2024-09-19T05:00:04.593 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_dir_fetch": 0, 2024-09-19T05:00:04.593 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_remote_ino": 0, 2024-09-19T05:00:04.593 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_lock": 0, 2024-09-19T05:00:04.593 INFO:teuthology.orchestra.run.smithi018.stdout: "load_cent": 0, 2024-09-19T05:00:04.593 INFO:teuthology.orchestra.run.smithi018.stdout: "q": 0, 2024-09-19T05:00:04.593 INFO:teuthology.orchestra.run.smithi018.stdout: "exported": 0, 2024-09-19T05:00:04.593 INFO:teuthology.orchestra.run.smithi018.stdout: "exported_inodes": 0, 2024-09-19T05:00:04.593 INFO:teuthology.orchestra.run.smithi018.stdout: "imported": 0, 2024-09-19T05:00:04.593 INFO:teuthology.orchestra.run.smithi018.stdout: "imported_inodes": 0, 2024-09-19T05:00:04.593 INFO:teuthology.orchestra.run.smithi018.stdout: "openino_dir_fetch": 0, 2024-09-19T05:00:04.593 INFO:teuthology.orchestra.run.smithi018.stdout: "openino_backtrace_fetch": 0, 2024-09-19T05:00:04.594 INFO:teuthology.orchestra.run.smithi018.stdout: "openino_peer_discover": 0, 2024-09-19T05:00:04.594 INFO:teuthology.orchestra.run.smithi018.stdout: "root_rfiles": 4, 2024-09-19T05:00:04.594 INFO:teuthology.orchestra.run.smithi018.stdout: "root_rbytes": 234, 2024-09-19T05:00:04.594 INFO:teuthology.orchestra.run.smithi018.stdout: "root_rsnaps": 6, 2024-09-19T05:00:04.594 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T05:00:04.594 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_set_tag": 0, 2024-09-19T05:00:04.594 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T05:00:04.594 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_inotable_repaired": 0, 2024-09-19T05:00:04.594 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_dir_inodes": 0, 2024-09-19T05:00:04.594 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T05:00:04.594 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T05:00:04.594 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_file_inodes": 0, 2024-09-19T05:00:04.594 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_inode_file_caps": 0, 2024-09-19T05:00:04.594 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T05:00:04.595 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_grant": 0, 2024-09-19T05:00:04.595 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T05:00:04.595 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T05:00:04.595 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T05:00:04.595 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_caps": 0, 2024-09-19T05:00:04.595 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_caps_dirty": 0, 2024-09-19T05:00:04.595 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_cap_release": 0, 2024-09-19T05:00:04.595 INFO:teuthology.orchestra.run.smithi018.stdout: "process_request_cap_release": 0 2024-09-19T05:00:04.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.595 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_cache": { 2024-09-19T05:00:04.595 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_update": 0, 2024-09-19T05:00:04.595 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_update_receipt": 0, 2024-09-19T05:00:04.595 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_try_discover": 0, 2024-09-19T05:00:04.595 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_send_discover": 0, 2024-09-19T05:00:04.596 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_handle_discover": 0, 2024-09-19T05:00:04.596 INFO:teuthology.orchestra.run.smithi018.stdout: "num_strays": 0, 2024-09-19T05:00:04.596 INFO:teuthology.orchestra.run.smithi018.stdout: "num_strays_delayed": 0, 2024-09-19T05:00:04.596 INFO:teuthology.orchestra.run.smithi018.stdout: "num_strays_enqueuing": 0, 2024-09-19T05:00:04.596 INFO:teuthology.orchestra.run.smithi018.stdout: "strays_created": 0, 2024-09-19T05:00:04.596 INFO:teuthology.orchestra.run.smithi018.stdout: "strays_enqueued": 0, 2024-09-19T05:00:04.596 INFO:teuthology.orchestra.run.smithi018.stdout: "strays_reintegrated": 0, 2024-09-19T05:00:04.596 INFO:teuthology.orchestra.run.smithi018.stdout: "strays_migrated": 0, 2024-09-19T05:00:04.596 INFO:teuthology.orchestra.run.smithi018.stdout: "num_recovering_processing": 0, 2024-09-19T05:00:04.596 INFO:teuthology.orchestra.run.smithi018.stdout: "num_recovering_enqueued": 0, 2024-09-19T05:00:04.596 INFO:teuthology.orchestra.run.smithi018.stdout: "num_recovering_prioritized": 0, 2024-09-19T05:00:04.596 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_started": 0, 2024-09-19T05:00:04.596 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_completed": 0, 2024-09-19T05:00:04.597 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_quiesce_path": 0, 2024-09-19T05:00:04.597 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_quiesce_inode": 0, 2024-09-19T05:00:04.597 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T05:00:04.597 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_exportdir": 0, 2024-09-19T05:00:04.597 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_flush": 0, 2024-09-19T05:00:04.597 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_fragmentdir": 0, 2024-09-19T05:00:04.597 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_fragstats": 0, 2024-09-19T05:00:04.597 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_inodestats": 0 2024-09-19T05:00:04.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.597 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_log": { 2024-09-19T05:00:04.597 INFO:teuthology.orchestra.run.smithi018.stdout: "evlrg": 0, 2024-09-19T05:00:04.597 INFO:teuthology.orchestra.run.smithi018.stdout: "evadd": 0, 2024-09-19T05:00:04.598 INFO:teuthology.orchestra.run.smithi018.stdout: "evex": 0, 2024-09-19T05:00:04.598 INFO:teuthology.orchestra.run.smithi018.stdout: "evtrm": 0, 2024-09-19T05:00:04.598 INFO:teuthology.orchestra.run.smithi018.stdout: "ev": 2326, 2024-09-19T05:00:04.598 INFO:teuthology.orchestra.run.smithi018.stdout: "evexg": 0, 2024-09-19T05:00:04.598 INFO:teuthology.orchestra.run.smithi018.stdout: "evexd": 0, 2024-09-19T05:00:04.598 INFO:teuthology.orchestra.run.smithi018.stdout: "segadd": 0, 2024-09-19T05:00:04.598 INFO:teuthology.orchestra.run.smithi018.stdout: "segex": 0, 2024-09-19T05:00:04.598 INFO:teuthology.orchestra.run.smithi018.stdout: "segtrm": 0, 2024-09-19T05:00:04.598 INFO:teuthology.orchestra.run.smithi018.stdout: "seg": 7, 2024-09-19T05:00:04.598 INFO:teuthology.orchestra.run.smithi018.stdout: "segmjr": 2, 2024-09-19T05:00:04.598 INFO:teuthology.orchestra.run.smithi018.stdout: "segexg": 0, 2024-09-19T05:00:04.598 INFO:teuthology.orchestra.run.smithi018.stdout: "segexd": 0, 2024-09-19T05:00:04.598 INFO:teuthology.orchestra.run.smithi018.stdout: "expos": 4194304, 2024-09-19T05:00:04.598 INFO:teuthology.orchestra.run.smithi018.stdout: "wrpos": 27990914, 2024-09-19T05:00:04.599 INFO:teuthology.orchestra.run.smithi018.stdout: "rdpos": 27986751, 2024-09-19T05:00:04.599 INFO:teuthology.orchestra.run.smithi018.stdout: "jlat": { 2024-09-19T05:00:04.599 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:04.599 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:04.599 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:04.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.599 INFO:teuthology.orchestra.run.smithi018.stdout: "replayed": 2326 2024-09-19T05:00:04.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.599 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_mem": { 2024-09-19T05:00:04.599 INFO:teuthology.orchestra.run.smithi018.stdout: "ino": 26, 2024-09-19T05:00:04.599 INFO:teuthology.orchestra.run.smithi018.stdout: "ino+": 27, 2024-09-19T05:00:04.599 INFO:teuthology.orchestra.run.smithi018.stdout: "ino-": 1, 2024-09-19T05:00:04.599 INFO:teuthology.orchestra.run.smithi018.stdout: "dir": 11, 2024-09-19T05:00:04.599 INFO:teuthology.orchestra.run.smithi018.stdout: "dir+": 11, 2024-09-19T05:00:04.599 INFO:teuthology.orchestra.run.smithi018.stdout: "dir-": 0, 2024-09-19T05:00:04.600 INFO:teuthology.orchestra.run.smithi018.stdout: "dn": 31, 2024-09-19T05:00:04.600 INFO:teuthology.orchestra.run.smithi018.stdout: "dn+": 31, 2024-09-19T05:00:04.600 INFO:teuthology.orchestra.run.smithi018.stdout: "dn-": 0, 2024-09-19T05:00:04.600 INFO:teuthology.orchestra.run.smithi018.stdout: "cap": 0, 2024-09-19T05:00:04.600 INFO:teuthology.orchestra.run.smithi018.stdout: "cap+": 0, 2024-09-19T05:00:04.600 INFO:teuthology.orchestra.run.smithi018.stdout: "cap-": 0, 2024-09-19T05:00:04.600 INFO:teuthology.orchestra.run.smithi018.stdout: "rss": 52456, 2024-09-19T05:00:04.600 INFO:teuthology.orchestra.run.smithi018.stdout: "heap": 215328 2024-09-19T05:00:04.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.600 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_server": { 2024-09-19T05:00:04.600 INFO:teuthology.orchestra.run.smithi018.stdout: "dispatch_client_request": 0, 2024-09-19T05:00:04.601 INFO:teuthology.orchestra.run.smithi018.stdout: "dispatch_server_request": 0, 2024-09-19T05:00:04.601 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_request": 0, 2024-09-19T05:00:04.601 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_session": 0, 2024-09-19T05:00:04.601 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_peer_request": 0, 2024-09-19T05:00:04.601 INFO:teuthology.orchestra.run.smithi018.stdout: "req_create_latency": { 2024-09-19T05:00:04.601 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:04.601 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:04.601 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:04.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.601 INFO:teuthology.orchestra.run.smithi018.stdout: "req_getattr_latency": { 2024-09-19T05:00:04.601 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:04.601 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:04.601 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:04.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.602 INFO:teuthology.orchestra.run.smithi018.stdout: "req_getfilelock_latency": { 2024-09-19T05:00:04.602 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:04.602 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:04.602 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:04.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.602 INFO:teuthology.orchestra.run.smithi018.stdout: "req_link_latency": { 2024-09-19T05:00:04.602 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:04.602 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:04.602 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:04.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.602 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookup_latency": { 2024-09-19T05:00:04.602 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:04.602 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:04.603 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:04.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.603 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookuphash_latency": { 2024-09-19T05:00:04.603 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:04.603 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:04.603 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:04.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.603 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookupino_latency": { 2024-09-19T05:00:04.603 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:04.603 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:04.603 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:04.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.603 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookupname_latency": { 2024-09-19T05:00:04.603 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:04.604 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:04.604 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:04.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.604 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookupparent_latency": { 2024-09-19T05:00:04.604 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:04.604 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:04.604 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:04.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.604 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookupsnap_latency": { 2024-09-19T05:00:04.604 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:04.604 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:04.604 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:04.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.605 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lssnap_latency": { 2024-09-19T05:00:04.605 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:04.605 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:04.605 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:04.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.608 INFO:teuthology.orchestra.run.smithi018.stdout: "req_mkdir_latency": { 2024-09-19T05:00:04.609 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:04.609 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:04.609 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:04.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.609 INFO:teuthology.orchestra.run.smithi018.stdout: "req_mknod_latency": { 2024-09-19T05:00:04.609 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:04.609 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:04.610 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:04.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.610 INFO:teuthology.orchestra.run.smithi018.stdout: "req_mksnap_latency": { 2024-09-19T05:00:04.610 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:04.610 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:04.610 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:04.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.610 INFO:teuthology.orchestra.run.smithi018.stdout: "req_open_latency": { 2024-09-19T05:00:04.610 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:04.610 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:04.611 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:04.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.611 INFO:teuthology.orchestra.run.smithi018.stdout: "req_readdir_latency": { 2024-09-19T05:00:04.611 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:04.611 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:04.611 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:04.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.611 INFO:teuthology.orchestra.run.smithi018.stdout: "req_rename_latency": { 2024-09-19T05:00:04.611 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:04.611 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:04.611 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:04.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.612 INFO:teuthology.orchestra.run.smithi018.stdout: "req_renamesnap_latency": { 2024-09-19T05:00:04.612 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:04.612 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:04.612 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:04.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.612 INFO:teuthology.orchestra.run.smithi018.stdout: "req_snapdiff_latency": { 2024-09-19T05:00:04.612 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:04.612 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:04.612 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:04.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.613 INFO:teuthology.orchestra.run.smithi018.stdout: "req_rmdir_latency": { 2024-09-19T05:00:04.613 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:04.613 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:04.613 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:04.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.613 INFO:teuthology.orchestra.run.smithi018.stdout: "req_rmsnap_latency": { 2024-09-19T05:00:04.613 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:04.613 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:04.613 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:04.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.613 INFO:teuthology.orchestra.run.smithi018.stdout: "req_rmxattr_latency": { 2024-09-19T05:00:04.614 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:04.614 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:04.614 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:04.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.614 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setattr_latency": { 2024-09-19T05:00:04.614 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:04.614 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:04.614 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:04.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.614 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setdirlayout_latency": { 2024-09-19T05:00:04.614 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:04.615 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:04.615 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:04.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.615 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setfilelock_latency": { 2024-09-19T05:00:04.615 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:04.615 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:04.615 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:04.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.615 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setlayout_latency": { 2024-09-19T05:00:04.615 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:04.615 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:04.615 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:04.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.616 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setxattr_latency": { 2024-09-19T05:00:04.616 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:04.616 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:04.616 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:04.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.616 INFO:teuthology.orchestra.run.smithi018.stdout: "req_symlink_latency": { 2024-09-19T05:00:04.616 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:04.616 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:04.616 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:04.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.617 INFO:teuthology.orchestra.run.smithi018.stdout: "req_unlink_latency": { 2024-09-19T05:00:04.617 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:04.617 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:04.617 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:04.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.617 INFO:teuthology.orchestra.run.smithi018.stdout: "cap_revoke_eviction": 0, 2024-09-19T05:00:04.617 INFO:teuthology.orchestra.run.smithi018.stdout: "cap_acquisition_throttle": 0, 2024-09-19T05:00:04.617 INFO:teuthology.orchestra.run.smithi018.stdout: "req_getvxattr_latency": { 2024-09-19T05:00:04.617 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:04.617 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:04.617 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:04.618 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T05:00:04.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.618 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_sessions": { 2024-09-19T05:00:04.618 INFO:teuthology.orchestra.run.smithi018.stdout: "session_count": 2, 2024-09-19T05:00:04.618 INFO:teuthology.orchestra.run.smithi018.stdout: "session_add": 5, 2024-09-19T05:00:04.618 INFO:teuthology.orchestra.run.smithi018.stdout: "session_remove": 3, 2024-09-19T05:00:04.618 INFO:teuthology.orchestra.run.smithi018.stdout: "sessions_open": 4, 2024-09-19T05:00:04.618 INFO:teuthology.orchestra.run.smithi018.stdout: "sessions_stale": 0, 2024-09-19T05:00:04.618 INFO:teuthology.orchestra.run.smithi018.stdout: "total_load": 0, 2024-09-19T05:00:04.618 INFO:teuthology.orchestra.run.smithi018.stdout: "average_load": 0, 2024-09-19T05:00:04.618 INFO:teuthology.orchestra.run.smithi018.stdout: "avg_session_uptime": 4656, 2024-09-19T05:00:04.619 INFO:teuthology.orchestra.run.smithi018.stdout: "mdthresh_evicted": 0 2024-09-19T05:00:04.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.619 INFO:teuthology.orchestra.run.smithi018.stdout: "mempool": { 2024-09-19T05:00:04.619 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_bytes": 0, 2024-09-19T05:00:04.619 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_items": 0, 2024-09-19T05:00:04.619 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T05:00:04.619 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_items": 0, 2024-09-19T05:00:04.619 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T05:00:04.619 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_items": 0, 2024-09-19T05:00:04.619 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T05:00:04.620 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T05:00:04.620 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T05:00:04.620 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T05:00:04.620 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T05:00:04.620 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_items": 0, 2024-09-19T05:00:04.620 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T05:00:04.620 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T05:00:04.620 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_bytes": 0, 2024-09-19T05:00:04.620 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_items": 0, 2024-09-19T05:00:04.620 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_bytes": 0, 2024-09-19T05:00:04.620 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_items": 0, 2024-09-19T05:00:04.620 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T05:00:04.621 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T05:00:04.621 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T05:00:04.621 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T05:00:04.621 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T05:00:04.621 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_items": 0, 2024-09-19T05:00:04.621 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_bytes": 0, 2024-09-19T05:00:04.621 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_items": 0, 2024-09-19T05:00:04.621 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T05:00:04.621 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T05:00:04.621 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_bytes": 0, 2024-09-19T05:00:04.621 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_items": 0, 2024-09-19T05:00:04.622 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_bytes": 0, 2024-09-19T05:00:04.622 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_items": 0, 2024-09-19T05:00:04.622 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T05:00:04.622 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_items": 0, 2024-09-19T05:00:04.622 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T05:00:04.622 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_items": 0, 2024-09-19T05:00:04.622 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_bytes": 198257, 2024-09-19T05:00:04.622 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_items": 57, 2024-09-19T05:00:04.622 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_bytes": 0, 2024-09-19T05:00:04.622 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_items": 0, 2024-09-19T05:00:04.622 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_bytes": 0, 2024-09-19T05:00:04.623 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_items": 0, 2024-09-19T05:00:04.623 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_bytes": 0, 2024-09-19T05:00:04.623 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_items": 0, 2024-09-19T05:00:04.623 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_bytes": 0, 2024-09-19T05:00:04.623 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_items": 0, 2024-09-19T05:00:04.623 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_bytes": 8096, 2024-09-19T05:00:04.623 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_items": 178, 2024-09-19T05:00:04.623 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T05:00:04.623 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_items": 0, 2024-09-19T05:00:04.623 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_bytes": 0, 2024-09-19T05:00:04.623 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_items": 0, 2024-09-19T05:00:04.624 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_bytes": 150900, 2024-09-19T05:00:04.624 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_items": 583, 2024-09-19T05:00:04.624 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_bytes": 0, 2024-09-19T05:00:04.624 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_items": 0, 2024-09-19T05:00:04.624 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_bytes": 0, 2024-09-19T05:00:04.624 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_items": 0 2024-09-19T05:00:04.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.624 INFO:teuthology.orchestra.run.smithi018.stdout: "objecter": { 2024-09-19T05:00:04.624 INFO:teuthology.orchestra.run.smithi018.stdout: "op_active": 0, 2024-09-19T05:00:04.624 INFO:teuthology.orchestra.run.smithi018.stdout: "op_laggy": 0, 2024-09-19T05:00:04.624 INFO:teuthology.orchestra.run.smithi018.stdout: "op_send": 3061, 2024-09-19T05:00:04.624 INFO:teuthology.orchestra.run.smithi018.stdout: "op_send_bytes": 26, 2024-09-19T05:00:04.625 INFO:teuthology.orchestra.run.smithi018.stdout: "op_resend": 4, 2024-09-19T05:00:04.625 INFO:teuthology.orchestra.run.smithi018.stdout: "op_reply": 3061, 2024-09-19T05:00:04.625 INFO:teuthology.orchestra.run.smithi018.stdout: "op_latency": { 2024-09-19T05:00:04.625 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 3061, 2024-09-19T05:00:04.625 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 1.412983800, 2024-09-19T05:00:04.625 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000461608 2024-09-19T05:00:04.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.625 INFO:teuthology.orchestra.run.smithi018.stdout: "op_inflight": 0, 2024-09-19T05:00:04.625 INFO:teuthology.orchestra.run.smithi018.stdout: "oplen_avg": { 2024-09-19T05:00:04.625 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 3061, 2024-09-19T05:00:04.625 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 3062 2024-09-19T05:00:04.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.626 INFO:teuthology.orchestra.run.smithi018.stdout: "op": 3061, 2024-09-19T05:00:04.626 INFO:teuthology.orchestra.run.smithi018.stdout: "op_r": 3061, 2024-09-19T05:00:04.626 INFO:teuthology.orchestra.run.smithi018.stdout: "op_w": 0, 2024-09-19T05:00:04.626 INFO:teuthology.orchestra.run.smithi018.stdout: "op_rmw": 0, 2024-09-19T05:00:04.626 INFO:teuthology.orchestra.run.smithi018.stdout: "op_pg": 0, 2024-09-19T05:00:04.626 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_stat": 1615, 2024-09-19T05:00:04.626 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_create": 0, 2024-09-19T05:00:04.626 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_read": 1443, 2024-09-19T05:00:04.626 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_write": 0, 2024-09-19T05:00:04.626 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_writefull": 0, 2024-09-19T05:00:04.627 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_writesame": 0, 2024-09-19T05:00:04.627 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_append": 0, 2024-09-19T05:00:04.627 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_zero": 0, 2024-09-19T05:00:04.627 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_truncate": 0, 2024-09-19T05:00:04.627 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_delete": 0, 2024-09-19T05:00:04.627 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_mapext": 0, 2024-09-19T05:00:04.627 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_sparse_read": 0, 2024-09-19T05:00:04.627 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_clonerange": 0, 2024-09-19T05:00:04.627 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_getxattr": 2, 2024-09-19T05:00:04.627 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_setxattr": 0, 2024-09-19T05:00:04.627 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_cmpxattr": 0, 2024-09-19T05:00:04.627 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_rmxattr": 0, 2024-09-19T05:00:04.628 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_resetxattrs": 0, 2024-09-19T05:00:04.628 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_call": 0, 2024-09-19T05:00:04.628 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_watch": 0, 2024-09-19T05:00:04.628 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_notify": 0, 2024-09-19T05:00:04.628 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T05:00:04.628 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_pgls": 0, 2024-09-19T05:00:04.628 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_pgls_filter": 0, 2024-09-19T05:00:04.628 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_other": 0, 2024-09-19T05:00:04.628 INFO:teuthology.orchestra.run.smithi018.stdout: "linger_active": 0, 2024-09-19T05:00:04.628 INFO:teuthology.orchestra.run.smithi018.stdout: "linger_send": 0, 2024-09-19T05:00:04.628 INFO:teuthology.orchestra.run.smithi018.stdout: "linger_resend": 0, 2024-09-19T05:00:04.629 INFO:teuthology.orchestra.run.smithi018.stdout: "linger_ping": 0, 2024-09-19T05:00:04.629 INFO:teuthology.orchestra.run.smithi018.stdout: "poolop_active": 0, 2024-09-19T05:00:04.629 INFO:teuthology.orchestra.run.smithi018.stdout: "poolop_send": 0, 2024-09-19T05:00:04.629 INFO:teuthology.orchestra.run.smithi018.stdout: "poolop_resend": 0, 2024-09-19T05:00:04.629 INFO:teuthology.orchestra.run.smithi018.stdout: "poolstat_active": 0, 2024-09-19T05:00:04.629 INFO:teuthology.orchestra.run.smithi018.stdout: "poolstat_send": 0, 2024-09-19T05:00:04.629 INFO:teuthology.orchestra.run.smithi018.stdout: "poolstat_resend": 0, 2024-09-19T05:00:04.629 INFO:teuthology.orchestra.run.smithi018.stdout: "statfs_active": 0, 2024-09-19T05:00:04.629 INFO:teuthology.orchestra.run.smithi018.stdout: "statfs_send": 0, 2024-09-19T05:00:04.629 INFO:teuthology.orchestra.run.smithi018.stdout: "statfs_resend": 0, 2024-09-19T05:00:04.629 INFO:teuthology.orchestra.run.smithi018.stdout: "command_active": 0, 2024-09-19T05:00:04.629 INFO:teuthology.orchestra.run.smithi018.stdout: "command_send": 0, 2024-09-19T05:00:04.630 INFO:teuthology.orchestra.run.smithi018.stdout: "command_resend": 0, 2024-09-19T05:00:04.630 INFO:teuthology.orchestra.run.smithi018.stdout: "map_epoch": 91, 2024-09-19T05:00:04.630 INFO:teuthology.orchestra.run.smithi018.stdout: "map_full": 0, 2024-09-19T05:00:04.630 INFO:teuthology.orchestra.run.smithi018.stdout: "map_inc": 13, 2024-09-19T05:00:04.630 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_sessions": 6, 2024-09-19T05:00:04.630 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_session_open": 6, 2024-09-19T05:00:04.630 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_session_close": 0, 2024-09-19T05:00:04.630 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_laggy": 0, 2024-09-19T05:00:04.630 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_wr": 0, 2024-09-19T05:00:04.630 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_rd": 2, 2024-09-19T05:00:04.630 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_del": 0 2024-09-19T05:00:04.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.631 INFO:teuthology.orchestra.run.smithi018.stdout: "oft": { 2024-09-19T05:00:04.631 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_total_objs": 0, 2024-09-19T05:00:04.631 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_total_kv_pairs": 0, 2024-09-19T05:00:04.631 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_total_updates": 0, 2024-09-19T05:00:04.631 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_total_removes": 0 2024-09-19T05:00:04.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.631 INFO:teuthology.orchestra.run.smithi018.stdout: "osd-slow-ops": { 2024-09-19T05:00:04.631 INFO:teuthology.orchestra.run.smithi018.stdout: "slow_ops_count": 0 2024-09-19T05:00:04.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.631 INFO:teuthology.orchestra.run.smithi018.stdout: "purge_queue": { 2024-09-19T05:00:04.631 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executing_ops": 0, 2024-09-19T05:00:04.632 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T05:00:04.632 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executing": 0, 2024-09-19T05:00:04.632 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executing_high_water": 0, 2024-09-19T05:00:04.632 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executed_ops": 0, 2024-09-19T05:00:04.632 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executed": 0, 2024-09-19T05:00:04.632 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_item_in_journal": 0 2024-09-19T05:00:04.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.632 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T05:00:04.632 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-19T05:00:04.632 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 104857600, 2024-09-19T05:00:04.632 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-19T05:00:04.632 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 3316, 2024-09-19T05:00:04.633 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 25799013, 2024-09-19T05:00:04.633 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-19T05:00:04.633 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 3316, 2024-09-19T05:00:04.633 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-09-19T05:00:04.633 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-09-19T05:00:04.633 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 3316, 2024-09-19T05:00:04.633 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 25799013, 2024-09-19T05:00:04.633 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-19T05:00:04.633 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:04.633 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:04.633 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:04.633 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T05:00:04.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.634 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-objecter_bytes": { 2024-09-19T05:00:04.634 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-19T05:00:04.634 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 104857600, 2024-09-19T05:00:04.634 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-19T05:00:04.634 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 0, 2024-09-19T05:00:04.634 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 0, 2024-09-19T05:00:04.634 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-19T05:00:04.634 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 0, 2024-09-19T05:00:04.634 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 3061, 2024-09-19T05:00:04.634 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 23796620, 2024-09-19T05:00:04.635 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 3061, 2024-09-19T05:00:04.635 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 23796620, 2024-09-19T05:00:04.635 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-19T05:00:04.635 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:04.635 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:04.635 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:04.635 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T05:00:04.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.635 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-objecter_ops": { 2024-09-19T05:00:04.635 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-19T05:00:04.635 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 1024, 2024-09-19T05:00:04.636 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-19T05:00:04.636 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 0, 2024-09-19T05:00:04.636 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 0, 2024-09-19T05:00:04.636 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-19T05:00:04.636 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 0, 2024-09-19T05:00:04.636 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 3061, 2024-09-19T05:00:04.636 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 3061, 2024-09-19T05:00:04.636 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 3061, 2024-09-19T05:00:04.636 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 3061, 2024-09-19T05:00:04.636 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-19T05:00:04.636 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:04.636 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:04.637 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:04.637 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T05:00:04.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.637 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-write_buf_throttle": { 2024-09-19T05:00:04.638 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-19T05:00:04.638 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 3758096384, 2024-09-19T05:00:04.638 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-19T05:00:04.638 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 0, 2024-09-19T05:00:04.638 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 0, 2024-09-19T05:00:04.638 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-19T05:00:04.638 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 0, 2024-09-19T05:00:04.638 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-09-19T05:00:04.638 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-09-19T05:00:04.638 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 0, 2024-09-19T05:00:04.638 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 0, 2024-09-19T05:00:04.638 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-19T05:00:04.639 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:04.639 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:04.639 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:04.639 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T05:00:04.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:04.639 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-write_buf_throttle-0x55709317c6e0": { 2024-09-19T05:00:04.639 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-19T05:00:04.639 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 3758096384, 2024-09-19T05:00:04.639 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-19T05:00:04.639 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 0, 2024-09-19T05:00:04.639 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 0, 2024-09-19T05:00:04.639 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-19T05:00:04.640 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 0, 2024-09-19T05:00:04.640 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-09-19T05:00:04.640 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-09-19T05:00:04.640 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 0, 2024-09-19T05:00:04.640 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 0, 2024-09-19T05:00:04.640 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-19T05:00:04.640 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:04.640 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:04.640 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:04.640 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T05:00:04.640 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T05:00:04.641 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T05:00:04.757 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:04 smithi018 ceph-mon[34537]: pgmap v375: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:00:04.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:04 smithi002 ceph-mon[30975]: pgmap v375: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:00:04.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:04 smithi116 ceph-mon[34477]: pgmap v375: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:00:05.531 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-09-19T05:00:05.531 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=0 2024-09-19T05:00:05.531 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T05:00:05.531 DEBUG:tasks.check_counter:Getting stats from e 2024-09-19T05:00:05.531 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-19T05:00:05.792 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T05:00:06.411 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T05:00:06.411 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T05:00:06.412 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 0, 2024-09-19T05:00:06.412 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 2, 2024-09-19T05:00:06.412 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 0, 2024-09-19T05:00:06.412 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 0, 2024-09-19T05:00:06.412 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 4, 2024-09-19T05:00:06.412 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 0, 2024-09-19T05:00:06.412 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.001252621, 2024-09-19T05:00:06.412 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T05:00:06.412 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.000242096, 2024-09-19T05:00:06.412 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T05:00:06.412 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:00:06.412 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:06.412 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:06.413 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:06.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:06.413 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:00:06.413 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:06.413 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:06.413 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:06.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:06.413 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T05:00:06.413 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T05:00:06.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:06.413 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T05:00:06.413 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 6, 2024-09-19T05:00:06.413 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 177, 2024-09-19T05:00:06.414 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 3264, 2024-09-19T05:00:06.414 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 188288, 2024-09-19T05:00:06.414 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 5, 2024-09-19T05:00:06.414 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 3, 2024-09-19T05:00:06.414 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.014338508, 2024-09-19T05:00:06.414 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.008247115, 2024-09-19T05:00:06.414 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.003764225, 2024-09-19T05:00:06.414 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T05:00:06.414 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:00:06.414 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 175, 2024-09-19T05:00:06.414 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.022447435, 2024-09-19T05:00:06.414 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000128271 2024-09-19T05:00:06.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:06.415 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:00:06.415 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:06.415 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:06.415 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:06.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:06.415 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 3264, 2024-09-19T05:00:06.415 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 188288 2024-09-19T05:00:06.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:06.415 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T05:00:06.415 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 238, 2024-09-19T05:00:06.415 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 228, 2024-09-19T05:00:06.415 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 1452768, 2024-09-19T05:00:06.415 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 140224, 2024-09-19T05:00:06.416 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 2, 2024-09-19T05:00:06.416 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 1, 2024-09-19T05:00:06.416 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.047508512, 2024-09-19T05:00:06.416 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.016777161, 2024-09-19T05:00:06.416 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.044551519, 2024-09-19T05:00:06.416 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T05:00:06.416 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:00:06.416 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 227, 2024-09-19T05:00:06.416 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.015592443, 2024-09-19T05:00:06.416 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000068689 2024-09-19T05:00:06.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:06.416 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:00:06.416 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:06.417 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:06.417 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:06.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:06.417 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 1452768, 2024-09-19T05:00:06.417 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 140224 2024-09-19T05:00:06.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:06.417 INFO:teuthology.orchestra.run.smithi018.stdout: "cct": { 2024-09-19T05:00:06.417 INFO:teuthology.orchestra.run.smithi018.stdout: "total_workers": 0, 2024-09-19T05:00:06.417 INFO:teuthology.orchestra.run.smithi018.stdout: "unhealthy_workers": 0 2024-09-19T05:00:06.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:06.417 INFO:teuthology.orchestra.run.smithi018.stdout: "mempool": { 2024-09-19T05:00:06.417 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_bytes": 0, 2024-09-19T05:00:06.417 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_items": 0, 2024-09-19T05:00:06.418 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T05:00:06.418 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_items": 0, 2024-09-19T05:00:06.418 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T05:00:06.418 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_items": 0, 2024-09-19T05:00:06.418 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T05:00:06.418 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T05:00:06.418 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T05:00:06.418 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T05:00:06.418 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T05:00:06.418 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_items": 0, 2024-09-19T05:00:06.418 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T05:00:06.418 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T05:00:06.418 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_bytes": 0, 2024-09-19T05:00:06.419 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_items": 0, 2024-09-19T05:00:06.419 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_bytes": 0, 2024-09-19T05:00:06.419 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_items": 0, 2024-09-19T05:00:06.419 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T05:00:06.419 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T05:00:06.419 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T05:00:06.419 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T05:00:06.419 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T05:00:06.419 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_items": 0, 2024-09-19T05:00:06.419 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_bytes": 0, 2024-09-19T05:00:06.419 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_items": 0, 2024-09-19T05:00:06.419 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T05:00:06.419 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T05:00:06.419 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_bytes": 0, 2024-09-19T05:00:06.420 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_items": 0, 2024-09-19T05:00:06.420 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_bytes": 0, 2024-09-19T05:00:06.420 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_items": 0, 2024-09-19T05:00:06.420 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T05:00:06.420 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_items": 0, 2024-09-19T05:00:06.420 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T05:00:06.420 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_items": 0, 2024-09-19T05:00:06.420 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_bytes": 148977, 2024-09-19T05:00:06.420 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_items": 30, 2024-09-19T05:00:06.420 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_bytes": 0, 2024-09-19T05:00:06.420 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_items": 0, 2024-09-19T05:00:06.420 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_bytes": 0, 2024-09-19T05:00:06.420 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_items": 0, 2024-09-19T05:00:06.421 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_bytes": 0, 2024-09-19T05:00:06.421 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_items": 0, 2024-09-19T05:00:06.421 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_bytes": 0, 2024-09-19T05:00:06.421 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_items": 0, 2024-09-19T05:00:06.421 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_bytes": 0, 2024-09-19T05:00:06.421 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_items": 0, 2024-09-19T05:00:06.421 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T05:00:06.421 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_items": 0, 2024-09-19T05:00:06.421 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_bytes": 0, 2024-09-19T05:00:06.421 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_items": 0, 2024-09-19T05:00:06.421 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_bytes": 928, 2024-09-19T05:00:06.421 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_items": 2, 2024-09-19T05:00:06.421 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_bytes": 0, 2024-09-19T05:00:06.421 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_items": 0, 2024-09-19T05:00:06.422 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_bytes": 0, 2024-09-19T05:00:06.422 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_items": 0 2024-09-19T05:00:06.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:06.422 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T05:00:06.422 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-19T05:00:06.422 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 104857600, 2024-09-19T05:00:06.422 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-19T05:00:06.422 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 240, 2024-09-19T05:00:06.422 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 1419173, 2024-09-19T05:00:06.422 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-19T05:00:06.422 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 240, 2024-09-19T05:00:06.422 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-09-19T05:00:06.422 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-09-19T05:00:06.423 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 240, 2024-09-19T05:00:06.423 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 1419173, 2024-09-19T05:00:06.423 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-19T05:00:06.423 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:06.423 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:06.423 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:06.423 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T05:00:06.423 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T05:00:06.423 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T05:00:06.557 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:06 smithi018 ceph-mon[34537]: pgmap v376: 97 pgs: 97 active+clean; 24 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-19T05:00:06.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:06 smithi002 ceph-mon[30975]: pgmap v376: 97 pgs: 97 active+clean; 24 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-19T05:00:06.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:06 smithi116 ceph-mon[34477]: pgmap v376: 97 pgs: 97 active+clean; 24 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-19T05:00:07.123 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.e 2024-09-19T05:00:07.123 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.e 2024-09-19T05:00:07.123 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.e 2024-09-19T05:00:07.123 DEBUG:tasks.check_counter:Getting stats from h 2024-09-19T05:00:07.123 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-19T05:00:07.385 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T05:00:07.889 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T05:00:07.890 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T05:00:07.890 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 237, 2024-09-19T05:00:07.890 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 227, 2024-09-19T05:00:07.890 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 1452496, 2024-09-19T05:00:07.890 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 139584, 2024-09-19T05:00:07.890 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 4, 2024-09-19T05:00:07.890 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 0, 2024-09-19T05:00:07.890 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.045650121, 2024-09-19T05:00:07.890 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.016785085, 2024-09-19T05:00:07.890 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.041510202, 2024-09-19T05:00:07.890 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T05:00:07.890 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:00:07.891 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 226, 2024-09-19T05:00:07.891 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.013682369, 2024-09-19T05:00:07.891 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000060541 2024-09-19T05:00:07.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:07.891 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:00:07.891 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:07.891 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:07.891 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:07.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:07.891 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 1452496, 2024-09-19T05:00:07.891 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 139584 2024-09-19T05:00:07.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:07.891 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T05:00:07.892 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 2, 2024-09-19T05:00:07.892 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 174, 2024-09-19T05:00:07.892 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 320, 2024-09-19T05:00:07.892 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 187664, 2024-09-19T05:00:07.892 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 5, 2024-09-19T05:00:07.892 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 3, 2024-09-19T05:00:07.892 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.011987497, 2024-09-19T05:00:07.892 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.007900054, 2024-09-19T05:00:07.892 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.001857181, 2024-09-19T05:00:07.892 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T05:00:07.892 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:00:07.892 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 171, 2024-09-19T05:00:07.892 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.016361704, 2024-09-19T05:00:07.893 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000095682 2024-09-19T05:00:07.893 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:07.893 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:00:07.893 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:07.893 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:07.893 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:07.893 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:07.893 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T05:00:07.893 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 187664 2024-09-19T05:00:07.893 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:07.893 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T05:00:07.893 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 4, 2024-09-19T05:00:07.893 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 4, 2024-09-19T05:00:07.894 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 2944, 2024-09-19T05:00:07.894 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 448, 2024-09-19T05:00:07.894 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 2, 2024-09-19T05:00:07.894 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 1, 2024-09-19T05:00:07.894 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.002512570, 2024-09-19T05:00:07.894 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.000044950, 2024-09-19T05:00:07.894 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.002472146, 2024-09-19T05:00:07.894 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T05:00:07.894 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:00:07.894 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 3, 2024-09-19T05:00:07.895 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.004377884, 2024-09-19T05:00:07.895 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.001459294 2024-09-19T05:00:07.895 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:07.895 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:00:07.895 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:07.895 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:07.895 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:07.895 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:07.895 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-19T05:00:07.895 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T05:00:07.895 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:07.895 INFO:teuthology.orchestra.run.smithi018.stdout: "cct": { 2024-09-19T05:00:07.895 INFO:teuthology.orchestra.run.smithi018.stdout: "total_workers": 0, 2024-09-19T05:00:07.895 INFO:teuthology.orchestra.run.smithi018.stdout: "unhealthy_workers": 0 2024-09-19T05:00:07.896 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:07.896 INFO:teuthology.orchestra.run.smithi018.stdout: "mempool": { 2024-09-19T05:00:07.896 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_bytes": 0, 2024-09-19T05:00:07.896 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_items": 0, 2024-09-19T05:00:07.896 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T05:00:07.896 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_items": 0, 2024-09-19T05:00:07.896 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T05:00:07.896 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_items": 0, 2024-09-19T05:00:07.896 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T05:00:07.897 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T05:00:07.897 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T05:00:07.897 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T05:00:07.897 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T05:00:07.897 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_items": 0, 2024-09-19T05:00:07.897 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T05:00:07.897 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T05:00:07.897 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_bytes": 0, 2024-09-19T05:00:07.897 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_items": 0, 2024-09-19T05:00:07.897 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_bytes": 0, 2024-09-19T05:00:07.897 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_items": 0, 2024-09-19T05:00:07.897 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T05:00:07.898 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T05:00:07.898 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T05:00:07.898 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T05:00:07.898 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T05:00:07.898 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_items": 0, 2024-09-19T05:00:07.898 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_bytes": 0, 2024-09-19T05:00:07.898 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_items": 0, 2024-09-19T05:00:07.898 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T05:00:07.898 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T05:00:07.898 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_bytes": 0, 2024-09-19T05:00:07.898 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_items": 0, 2024-09-19T05:00:07.898 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_bytes": 0, 2024-09-19T05:00:07.898 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_items": 0, 2024-09-19T05:00:07.899 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T05:00:07.899 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_items": 0, 2024-09-19T05:00:07.899 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T05:00:07.899 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_items": 0, 2024-09-19T05:00:07.899 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_bytes": 148977, 2024-09-19T05:00:07.899 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_items": 30, 2024-09-19T05:00:07.899 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_bytes": 0, 2024-09-19T05:00:07.899 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_items": 0, 2024-09-19T05:00:07.899 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_bytes": 0, 2024-09-19T05:00:07.899 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_items": 0, 2024-09-19T05:00:07.900 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_bytes": 0, 2024-09-19T05:00:07.900 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_items": 0, 2024-09-19T05:00:07.900 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_bytes": 0, 2024-09-19T05:00:07.900 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_items": 0, 2024-09-19T05:00:07.900 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_bytes": 0, 2024-09-19T05:00:07.900 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_items": 0, 2024-09-19T05:00:07.900 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T05:00:07.900 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_items": 0, 2024-09-19T05:00:07.900 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_bytes": 0, 2024-09-19T05:00:07.900 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_items": 0, 2024-09-19T05:00:07.900 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_bytes": 928, 2024-09-19T05:00:07.900 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_items": 2, 2024-09-19T05:00:07.901 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_bytes": 0, 2024-09-19T05:00:07.901 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_items": 0, 2024-09-19T05:00:07.901 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_bytes": 0, 2024-09-19T05:00:07.901 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_items": 0 2024-09-19T05:00:07.901 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:07.901 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T05:00:07.901 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-19T05:00:07.901 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 104857600, 2024-09-19T05:00:07.901 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-19T05:00:07.901 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 239, 2024-09-19T05:00:07.902 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 1419043, 2024-09-19T05:00:07.902 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-19T05:00:07.902 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 239, 2024-09-19T05:00:07.902 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-09-19T05:00:07.902 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-09-19T05:00:07.902 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 239, 2024-09-19T05:00:07.902 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 1419043, 2024-09-19T05:00:07.902 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-19T05:00:07.902 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:07.902 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:07.902 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:07.902 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T05:00:07.903 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T05:00:07.903 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T05:00:08.478 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.h 2024-09-19T05:00:08.478 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.h 2024-09-19T05:00:08.478 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.h 2024-09-19T05:00:08.478 DEBUG:tasks.check_counter:Getting stats from k 2024-09-19T05:00:08.478 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-19T05:00:08.736 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T05:00:08.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:08 smithi018 ceph-mon[34537]: pgmap v377: 97 pgs: 97 active+clean; 24 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-09-19T05:00:08.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:08 smithi002 ceph-mon[30975]: pgmap v377: 97 pgs: 97 active+clean; 24 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-09-19T05:00:08.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:08 smithi116 ceph-mon[34477]: pgmap v377: 97 pgs: 97 active+clean; 24 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-09-19T05:00:09.190 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T05:00:09.190 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T05:00:09.190 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 4, 2024-09-19T05:00:09.190 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 4, 2024-09-19T05:00:09.191 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 2944, 2024-09-19T05:00:09.191 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 448, 2024-09-19T05:00:09.191 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 4, 2024-09-19T05:00:09.191 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 0, 2024-09-19T05:00:09.191 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.004587968, 2024-09-19T05:00:09.191 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.000042511, 2024-09-19T05:00:09.191 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.003519929, 2024-09-19T05:00:09.191 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T05:00:09.191 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:00:09.191 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 3, 2024-09-19T05:00:09.191 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.006384657, 2024-09-19T05:00:09.191 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.002128219 2024-09-19T05:00:09.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:09.192 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:00:09.192 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:09.192 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:09.192 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:09.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:09.192 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-19T05:00:09.192 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T05:00:09.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:09.192 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T05:00:09.192 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 2, 2024-09-19T05:00:09.192 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 177, 2024-09-19T05:00:09.192 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 320, 2024-09-19T05:00:09.192 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 188192, 2024-09-19T05:00:09.193 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 5, 2024-09-19T05:00:09.193 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 3, 2024-09-19T05:00:09.193 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.013797231, 2024-09-19T05:00:09.193 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.009357718, 2024-09-19T05:00:09.193 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.001670171, 2024-09-19T05:00:09.193 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T05:00:09.193 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:00:09.193 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 174, 2024-09-19T05:00:09.193 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.014704130, 2024-09-19T05:00:09.193 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000084506 2024-09-19T05:00:09.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:09.193 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:00:09.193 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:09.193 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:09.194 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:09.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:09.194 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T05:00:09.194 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 188192 2024-09-19T05:00:09.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:09.194 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T05:00:09.194 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 241, 2024-09-19T05:00:09.194 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 231, 2024-09-19T05:00:09.194 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 1453584, 2024-09-19T05:00:09.194 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 142144, 2024-09-19T05:00:09.194 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 2, 2024-09-19T05:00:09.194 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 1, 2024-09-19T05:00:09.194 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.047587522, 2024-09-19T05:00:09.194 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.016791968, 2024-09-19T05:00:09.195 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.044091022, 2024-09-19T05:00:09.195 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T05:00:09.195 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:00:09.195 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 230, 2024-09-19T05:00:09.195 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.015698373, 2024-09-19T05:00:09.195 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000068253 2024-09-19T05:00:09.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:09.195 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:00:09.195 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:09.195 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:09.195 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:09.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:09.195 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 1453584, 2024-09-19T05:00:09.195 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 142144 2024-09-19T05:00:09.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:09.196 INFO:teuthology.orchestra.run.smithi018.stdout: "cct": { 2024-09-19T05:00:09.196 INFO:teuthology.orchestra.run.smithi018.stdout: "total_workers": 0, 2024-09-19T05:00:09.196 INFO:teuthology.orchestra.run.smithi018.stdout: "unhealthy_workers": 0 2024-09-19T05:00:09.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:09.196 INFO:teuthology.orchestra.run.smithi018.stdout: "mempool": { 2024-09-19T05:00:09.196 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_bytes": 0, 2024-09-19T05:00:09.196 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_items": 0, 2024-09-19T05:00:09.196 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T05:00:09.196 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_items": 0, 2024-09-19T05:00:09.196 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T05:00:09.196 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_items": 0, 2024-09-19T05:00:09.196 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T05:00:09.197 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T05:00:09.197 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T05:00:09.197 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T05:00:09.197 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T05:00:09.197 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_items": 0, 2024-09-19T05:00:09.197 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T05:00:09.197 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T05:00:09.197 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_bytes": 0, 2024-09-19T05:00:09.197 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_items": 0, 2024-09-19T05:00:09.197 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_bytes": 0, 2024-09-19T05:00:09.197 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_items": 0, 2024-09-19T05:00:09.197 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T05:00:09.197 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T05:00:09.197 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T05:00:09.198 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T05:00:09.198 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T05:00:09.198 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_items": 0, 2024-09-19T05:00:09.198 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_bytes": 0, 2024-09-19T05:00:09.198 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_items": 0, 2024-09-19T05:00:09.198 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T05:00:09.198 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T05:00:09.198 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_bytes": 0, 2024-09-19T05:00:09.198 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_items": 0, 2024-09-19T05:00:09.198 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_bytes": 0, 2024-09-19T05:00:09.198 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_items": 0, 2024-09-19T05:00:09.198 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T05:00:09.198 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_items": 0, 2024-09-19T05:00:09.198 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T05:00:09.199 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_items": 0, 2024-09-19T05:00:09.199 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_bytes": 150008, 2024-09-19T05:00:09.199 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_items": 31, 2024-09-19T05:00:09.199 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_bytes": 0, 2024-09-19T05:00:09.199 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_items": 0, 2024-09-19T05:00:09.199 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_bytes": 0, 2024-09-19T05:00:09.199 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_items": 0, 2024-09-19T05:00:09.199 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_bytes": 0, 2024-09-19T05:00:09.199 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_items": 0, 2024-09-19T05:00:09.199 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_bytes": 0, 2024-09-19T05:00:09.199 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_items": 0, 2024-09-19T05:00:09.199 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_bytes": 0, 2024-09-19T05:00:09.199 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_items": 0, 2024-09-19T05:00:09.199 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T05:00:09.200 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_items": 0, 2024-09-19T05:00:09.200 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_bytes": 0, 2024-09-19T05:00:09.200 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_items": 0, 2024-09-19T05:00:09.200 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_bytes": 928, 2024-09-19T05:00:09.200 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_items": 2, 2024-09-19T05:00:09.200 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_bytes": 0, 2024-09-19T05:00:09.200 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_items": 0, 2024-09-19T05:00:09.200 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_bytes": 0, 2024-09-19T05:00:09.200 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_items": 0 2024-09-19T05:00:09.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T05:00:09.201 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T05:00:09.201 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-19T05:00:09.201 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 104857600, 2024-09-19T05:00:09.201 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-19T05:00:09.201 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 243, 2024-09-19T05:00:09.201 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 1419563, 2024-09-19T05:00:09.201 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-19T05:00:09.201 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 243, 2024-09-19T05:00:09.201 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-09-19T05:00:09.201 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-09-19T05:00:09.201 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 243, 2024-09-19T05:00:09.201 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 1419563, 2024-09-19T05:00:09.201 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-19T05:00:09.202 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-19T05:00:09.202 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-19T05:00:09.202 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-19T05:00:09.202 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T05:00:09.202 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T05:00:09.202 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T05:00:09.893 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2024-09-19T05:00:09.893 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2024-09-19T05:00:09.893 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2024-09-19T05:00:09.893 DEBUG:tasks.check_counter:Getting stats from c 2024-09-19T05:00:09.893 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-19T05:00:10.150 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T05:00:10.601 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:10 smithi116 ceph-mon[34477]: pgmap v378: 97 pgs: 97 active+clean; 24 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-09-19T05:00:10.619 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-19T05:00:10.619 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T05:00:10.619 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 0, 2024-09-19T05:00:10.619 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 2, 2024-09-19T05:00:10.619 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 0, 2024-09-19T05:00:10.619 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 0, 2024-09-19T05:00:10.620 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 4, 2024-09-19T05:00:10.620 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 0, 2024-09-19T05:00:10.620 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.001204949, 2024-09-19T05:00:10.620 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T05:00:10.620 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.000307914, 2024-09-19T05:00:10.620 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T05:00:10.620 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:00:10.620 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-19T05:00:10.620 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-19T05:00:10.620 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-19T05:00:10.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:10.620 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:00:10.620 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-19T05:00:10.621 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-19T05:00:10.621 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-19T05:00:10.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:10.621 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T05:00:10.621 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T05:00:10.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:10.621 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T05:00:10.621 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 6, 2024-09-19T05:00:10.621 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 177, 2024-09-19T05:00:10.621 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 3264, 2024-09-19T05:00:10.621 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 188288, 2024-09-19T05:00:10.621 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 5, 2024-09-19T05:00:10.622 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 3, 2024-09-19T05:00:10.622 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.014814786, 2024-09-19T05:00:10.622 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.008309044, 2024-09-19T05:00:10.622 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.003833263, 2024-09-19T05:00:10.622 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T05:00:10.622 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:00:10.622 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 175, 2024-09-19T05:00:10.622 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.025892270, 2024-09-19T05:00:10.622 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000147955 2024-09-19T05:00:10.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:10.622 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:00:10.622 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-19T05:00:10.622 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-19T05:00:10.622 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-19T05:00:10.623 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:10.623 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 3264, 2024-09-19T05:00:10.623 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 188288 2024-09-19T05:00:10.623 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:10.623 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T05:00:10.623 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 238, 2024-09-19T05:00:10.623 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 228, 2024-09-19T05:00:10.623 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 1452768, 2024-09-19T05:00:10.623 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 140224, 2024-09-19T05:00:10.623 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 2, 2024-09-19T05:00:10.623 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 1, 2024-09-19T05:00:10.623 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.042867030, 2024-09-19T05:00:10.623 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.016225367, 2024-09-19T05:00:10.624 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.039995142, 2024-09-19T05:00:10.624 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T05:00:10.624 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:00:10.624 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 227, 2024-09-19T05:00:10.624 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.015651996, 2024-09-19T05:00:10.624 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000068951 2024-09-19T05:00:10.624 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:10.624 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:00:10.624 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-19T05:00:10.624 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-19T05:00:10.624 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-19T05:00:10.624 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:10.625 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 1452768, 2024-09-19T05:00:10.625 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 140224 2024-09-19T05:00:10.625 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:10.625 INFO:teuthology.orchestra.run.smithi116.stdout: "cct": { 2024-09-19T05:00:10.625 INFO:teuthology.orchestra.run.smithi116.stdout: "total_workers": 0, 2024-09-19T05:00:10.625 INFO:teuthology.orchestra.run.smithi116.stdout: "unhealthy_workers": 0 2024-09-19T05:00:10.625 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:10.625 INFO:teuthology.orchestra.run.smithi116.stdout: "mempool": { 2024-09-19T05:00:10.625 INFO:teuthology.orchestra.run.smithi116.stdout: "bloom_filter_bytes": 0, 2024-09-19T05:00:10.625 INFO:teuthology.orchestra.run.smithi116.stdout: "bloom_filter_items": 0, 2024-09-19T05:00:10.625 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T05:00:10.625 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_alloc_items": 0, 2024-09-19T05:00:10.625 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T05:00:10.625 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_data_items": 0, 2024-09-19T05:00:10.626 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T05:00:10.626 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T05:00:10.626 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T05:00:10.626 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T05:00:10.626 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T05:00:10.626 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_other_items": 0, 2024-09-19T05:00:10.626 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T05:00:10.626 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T05:00:10.626 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_extent_bytes": 0, 2024-09-19T05:00:10.626 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_extent_items": 0, 2024-09-19T05:00:10.626 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_blob_bytes": 0, 2024-09-19T05:00:10.626 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_blob_items": 0, 2024-09-19T05:00:10.626 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T05:00:10.627 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T05:00:10.627 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T05:00:10.627 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T05:00:10.627 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T05:00:10.627 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_items": 0, 2024-09-19T05:00:10.627 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_txc_bytes": 0, 2024-09-19T05:00:10.627 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_txc_items": 0, 2024-09-19T05:00:10.627 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T05:00:10.627 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T05:00:10.627 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_bytes": 0, 2024-09-19T05:00:10.627 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_items": 0, 2024-09-19T05:00:10.627 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_bytes": 0, 2024-09-19T05:00:10.627 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_items": 0, 2024-09-19T05:00:10.627 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T05:00:10.628 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_reader_items": 0, 2024-09-19T05:00:10.628 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T05:00:10.628 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_writer_items": 0, 2024-09-19T05:00:10.628 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_anon_bytes": 148994, 2024-09-19T05:00:10.628 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_anon_items": 31, 2024-09-19T05:00:10.628 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_meta_bytes": 0, 2024-09-19T05:00:10.628 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_meta_items": 0, 2024-09-19T05:00:10.628 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_bytes": 0, 2024-09-19T05:00:10.628 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_items": 0, 2024-09-19T05:00:10.628 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mapbl_bytes": 0, 2024-09-19T05:00:10.628 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mapbl_items": 0, 2024-09-19T05:00:10.628 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pglog_bytes": 0, 2024-09-19T05:00:10.628 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pglog_items": 0, 2024-09-19T05:00:10.629 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_bytes": 0, 2024-09-19T05:00:10.629 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_items": 0, 2024-09-19T05:00:10.629 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T05:00:10.629 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_mapping_items": 0, 2024-09-19T05:00:10.629 INFO:teuthology.orchestra.run.smithi116.stdout: "pgmap_bytes": 0, 2024-09-19T05:00:10.629 INFO:teuthology.orchestra.run.smithi116.stdout: "pgmap_items": 0, 2024-09-19T05:00:10.629 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_co_bytes": 928, 2024-09-19T05:00:10.629 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_co_items": 2, 2024-09-19T05:00:10.629 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_1_bytes": 0, 2024-09-19T05:00:10.629 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_1_items": 0, 2024-09-19T05:00:10.629 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_2_bytes": 0, 2024-09-19T05:00:10.629 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_2_items": 0 2024-09-19T05:00:10.629 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:10.629 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T05:00:10.630 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-09-19T05:00:10.630 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 104857600, 2024-09-19T05:00:10.630 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-09-19T05:00:10.630 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 240, 2024-09-19T05:00:10.630 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 1419173, 2024-09-19T05:00:10.630 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-09-19T05:00:10.630 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 240, 2024-09-19T05:00:10.630 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2024-09-19T05:00:10.630 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2024-09-19T05:00:10.630 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 240, 2024-09-19T05:00:10.630 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 1419173, 2024-09-19T05:00:10.630 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-09-19T05:00:10.630 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-19T05:00:10.630 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-19T05:00:10.630 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-19T05:00:10.631 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-19T05:00:10.631 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-19T05:00:10.631 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-19T05:00:10.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:10 smithi018 ceph-mon[34537]: pgmap v378: 97 pgs: 97 active+clean; 24 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-09-19T05:00:10.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:10 smithi002 ceph-mon[30975]: pgmap v378: 97 pgs: 97 active+clean; 24 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-09-19T05:00:11.374 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.c 2024-09-19T05:00:11.374 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.c 2024-09-19T05:00:11.374 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.c 2024-09-19T05:00:11.374 DEBUG:tasks.check_counter:Getting stats from f 2024-09-19T05:00:11.374 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-19T05:00:11.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:11 smithi116 ceph-mon[34477]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T05:00:11.631 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T05:00:11.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:11 smithi018 ceph-mon[34537]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T05:00:11.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:11 smithi002 ceph-mon[30975]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T05:00:12.128 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-19T05:00:12.128 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T05:00:12.128 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 239, 2024-09-19T05:00:12.128 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 229, 2024-09-19T05:00:12.128 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 1453040, 2024-09-19T05:00:12.129 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 140864, 2024-09-19T05:00:12.129 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 4, 2024-09-19T05:00:12.129 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 0, 2024-09-19T05:00:12.129 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.045116455, 2024-09-19T05:00:12.129 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.016671436, 2024-09-19T05:00:12.129 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.040391632, 2024-09-19T05:00:12.129 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T05:00:12.129 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:00:12.129 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 228, 2024-09-19T05:00:12.129 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.014701565, 2024-09-19T05:00:12.129 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000064480 2024-09-19T05:00:12.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:12.130 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:00:12.130 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-19T05:00:12.130 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-19T05:00:12.130 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-19T05:00:12.130 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:12.130 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 1453040, 2024-09-19T05:00:12.130 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 140864 2024-09-19T05:00:12.130 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:12.130 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T05:00:12.130 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 2, 2024-09-19T05:00:12.130 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 175, 2024-09-19T05:00:12.130 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 320, 2024-09-19T05:00:12.130 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 187840, 2024-09-19T05:00:12.130 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 5, 2024-09-19T05:00:12.131 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 3, 2024-09-19T05:00:12.131 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.011887324, 2024-09-19T05:00:12.131 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.008070656, 2024-09-19T05:00:12.131 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.001546783, 2024-09-19T05:00:12.131 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T05:00:12.131 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:00:12.131 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 172, 2024-09-19T05:00:12.131 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.018768157, 2024-09-19T05:00:12.131 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000109117 2024-09-19T05:00:12.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:12.131 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:00:12.131 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-19T05:00:12.131 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-19T05:00:12.132 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-19T05:00:12.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:12.132 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T05:00:12.132 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 187840 2024-09-19T05:00:12.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:12.132 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T05:00:12.132 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 4, 2024-09-19T05:00:12.132 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 4, 2024-09-19T05:00:12.132 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 2944, 2024-09-19T05:00:12.132 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 448, 2024-09-19T05:00:12.132 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 2, 2024-09-19T05:00:12.132 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 1, 2024-09-19T05:00:12.132 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.002208951, 2024-09-19T05:00:12.133 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.000042366, 2024-09-19T05:00:12.133 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.002145012, 2024-09-19T05:00:12.133 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T05:00:12.133 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:00:12.133 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 3, 2024-09-19T05:00:12.133 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.003929814, 2024-09-19T05:00:12.133 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.001309938 2024-09-19T05:00:12.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:12.133 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:00:12.133 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-19T05:00:12.133 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-19T05:00:12.133 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-19T05:00:12.134 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:12.134 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-19T05:00:12.134 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T05:00:12.134 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:12.134 INFO:teuthology.orchestra.run.smithi116.stdout: "cct": { 2024-09-19T05:00:12.134 INFO:teuthology.orchestra.run.smithi116.stdout: "total_workers": 0, 2024-09-19T05:00:12.134 INFO:teuthology.orchestra.run.smithi116.stdout: "unhealthy_workers": 0 2024-09-19T05:00:12.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:12.135 INFO:teuthology.orchestra.run.smithi116.stdout: "mempool": { 2024-09-19T05:00:12.135 INFO:teuthology.orchestra.run.smithi116.stdout: "bloom_filter_bytes": 0, 2024-09-19T05:00:12.135 INFO:teuthology.orchestra.run.smithi116.stdout: "bloom_filter_items": 0, 2024-09-19T05:00:12.135 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T05:00:12.135 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_alloc_items": 0, 2024-09-19T05:00:12.135 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T05:00:12.135 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_data_items": 0, 2024-09-19T05:00:12.135 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T05:00:12.135 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T05:00:12.135 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T05:00:12.135 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T05:00:12.135 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T05:00:12.135 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_other_items": 0, 2024-09-19T05:00:12.136 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T05:00:12.136 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T05:00:12.136 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_extent_bytes": 0, 2024-09-19T05:00:12.136 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_extent_items": 0, 2024-09-19T05:00:12.136 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_blob_bytes": 0, 2024-09-19T05:00:12.136 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_blob_items": 0, 2024-09-19T05:00:12.137 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T05:00:12.137 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T05:00:12.137 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T05:00:12.137 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T05:00:12.137 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T05:00:12.137 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_items": 0, 2024-09-19T05:00:12.137 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_txc_bytes": 0, 2024-09-19T05:00:12.137 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_txc_items": 0, 2024-09-19T05:00:12.137 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T05:00:12.137 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T05:00:12.138 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_bytes": 0, 2024-09-19T05:00:12.138 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_items": 0, 2024-09-19T05:00:12.138 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_bytes": 0, 2024-09-19T05:00:12.138 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_items": 0, 2024-09-19T05:00:12.138 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T05:00:12.138 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_reader_items": 0, 2024-09-19T05:00:12.138 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T05:00:12.138 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_writer_items": 0, 2024-09-19T05:00:12.138 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_anon_bytes": 149017, 2024-09-19T05:00:12.138 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_anon_items": 31, 2024-09-19T05:00:12.138 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_meta_bytes": 0, 2024-09-19T05:00:12.138 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_meta_items": 0, 2024-09-19T05:00:12.138 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_bytes": 0, 2024-09-19T05:00:12.138 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_items": 0, 2024-09-19T05:00:12.139 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mapbl_bytes": 0, 2024-09-19T05:00:12.139 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mapbl_items": 0, 2024-09-19T05:00:12.139 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pglog_bytes": 0, 2024-09-19T05:00:12.139 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pglog_items": 0, 2024-09-19T05:00:12.139 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_bytes": 0, 2024-09-19T05:00:12.139 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_items": 0, 2024-09-19T05:00:12.139 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T05:00:12.139 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_mapping_items": 0, 2024-09-19T05:00:12.139 INFO:teuthology.orchestra.run.smithi116.stdout: "pgmap_bytes": 0, 2024-09-19T05:00:12.139 INFO:teuthology.orchestra.run.smithi116.stdout: "pgmap_items": 0, 2024-09-19T05:00:12.139 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_co_bytes": 928, 2024-09-19T05:00:12.139 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_co_items": 2, 2024-09-19T05:00:12.139 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_1_bytes": 0, 2024-09-19T05:00:12.140 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_1_items": 0, 2024-09-19T05:00:12.140 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_2_bytes": 0, 2024-09-19T05:00:12.140 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_2_items": 0 2024-09-19T05:00:12.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:12.140 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T05:00:12.140 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-09-19T05:00:12.140 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 104857600, 2024-09-19T05:00:12.140 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-09-19T05:00:12.140 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 241, 2024-09-19T05:00:12.140 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 1419303, 2024-09-19T05:00:12.140 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-09-19T05:00:12.140 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 241, 2024-09-19T05:00:12.140 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2024-09-19T05:00:12.141 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2024-09-19T05:00:12.141 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 241, 2024-09-19T05:00:12.141 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 1419303, 2024-09-19T05:00:12.141 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-09-19T05:00:12.141 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-19T05:00:12.141 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-19T05:00:12.141 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-19T05:00:12.141 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-19T05:00:12.141 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-19T05:00:12.141 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-19T05:00:12.780 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:12 smithi116 ceph-mon[34477]: pgmap v380: 97 pgs: 97 active+clean; 24 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-19T05:00:12.807 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.f 2024-09-19T05:00:12.807 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.f 2024-09-19T05:00:12.807 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.f 2024-09-19T05:00:12.807 DEBUG:tasks.check_counter:Getting stats from i 2024-09-19T05:00:12.807 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-19T05:00:12.808 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:12 smithi018 ceph-mon[34537]: pgmap v380: 97 pgs: 97 active+clean; 24 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-19T05:00:12.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:12 smithi002 ceph-mon[30975]: pgmap v380: 97 pgs: 97 active+clean; 24 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-19T05:00:13.052 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T05:00:13.541 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-19T05:00:13.542 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T05:00:13.542 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 5242, 2024-09-19T05:00:13.542 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 6911, 2024-09-19T05:00:13.542 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 1684501, 2024-09-19T05:00:13.542 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 15226536, 2024-09-19T05:00:13.542 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 26, 2024-09-19T05:00:13.542 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 5, 2024-09-19T05:00:13.542 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.575778748, 2024-09-19T05:00:13.542 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.193253616, 2024-09-19T05:00:13.542 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.217846240, 2024-09-19T05:00:13.542 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.140365846, 2024-09-19T05:00:13.542 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:00:13.543 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 6910, 2024-09-19T05:00:13.543 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.341981664, 2024-09-19T05:00:13.543 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000049490 2024-09-19T05:00:13.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.543 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:00:13.543 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 6676, 2024-09-19T05:00:13.543 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.001529638, 2024-09-19T05:00:13.543 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000229 2024-09-19T05:00:13.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.543 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 360224, 2024-09-19T05:00:13.543 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 111216 2024-09-19T05:00:13.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.543 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T05:00:13.544 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 1224, 2024-09-19T05:00:13.544 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 1215, 2024-09-19T05:00:13.544 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 1712383, 2024-09-19T05:00:13.544 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 7578189, 2024-09-19T05:00:13.544 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 15, 2024-09-19T05:00:13.544 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 6, 2024-09-19T05:00:13.544 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.119814978, 2024-09-19T05:00:13.544 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.047186040, 2024-09-19T05:00:13.544 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.063082909, 2024-09-19T05:00:13.544 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.020027693, 2024-09-19T05:00:13.544 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:00:13.544 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 1214, 2024-09-19T05:00:13.544 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.359388629, 2024-09-19T05:00:13.545 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000296036 2024-09-19T05:00:13.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.545 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:00:13.545 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 8, 2024-09-19T05:00:13.545 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000673, 2024-09-19T05:00:13.545 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000084 2024-09-19T05:00:13.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.545 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 1493120, 2024-09-19T05:00:13.545 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 176688 2024-09-19T05:00:13.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.545 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T05:00:13.545 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 1034, 2024-09-19T05:00:13.546 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 967, 2024-09-19T05:00:13.546 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 303937, 2024-09-19T05:00:13.546 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 6751863, 2024-09-19T05:00:13.546 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 163, 2024-09-19T05:00:13.546 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 6, 2024-09-19T05:00:13.546 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.141357335, 2024-09-19T05:00:13.546 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.033619567, 2024-09-19T05:00:13.546 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.070889415, 2024-09-19T05:00:13.546 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.027415131, 2024-09-19T05:00:13.546 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:00:13.546 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 963, 2024-09-19T05:00:13.546 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.151768069, 2024-09-19T05:00:13.546 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000157599 2024-09-19T05:00:13.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.547 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:00:13.547 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 544, 2024-09-19T05:00:13.547 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000073752, 2024-09-19T05:00:13.547 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000135 2024-09-19T05:00:13.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.547 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 139392, 2024-09-19T05:00:13.547 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 512240 2024-09-19T05:00:13.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.547 INFO:teuthology.orchestra.run.smithi116.stdout: "cct": { 2024-09-19T05:00:13.547 INFO:teuthology.orchestra.run.smithi116.stdout: "total_workers": 1, 2024-09-19T05:00:13.547 INFO:teuthology.orchestra.run.smithi116.stdout: "unhealthy_workers": 0 2024-09-19T05:00:13.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.547 INFO:teuthology.orchestra.run.smithi116.stdout: "finisher-MDSRank": { 2024-09-19T05:00:13.548 INFO:teuthology.orchestra.run.smithi116.stdout: "queue_len": 0, 2024-09-19T05:00:13.548 INFO:teuthology.orchestra.run.smithi116.stdout: "complete_latency": { 2024-09-19T05:00:13.548 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 5361, 2024-09-19T05:00:13.548 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 1.493432574, 2024-09-19T05:00:13.548 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000278573 2024-09-19T05:00:13.548 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-19T05:00:13.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.548 INFO:teuthology.orchestra.run.smithi116.stdout: "finisher-PurgeQueue": { 2024-09-19T05:00:13.548 INFO:teuthology.orchestra.run.smithi116.stdout: "queue_len": 0, 2024-09-19T05:00:13.548 INFO:teuthology.orchestra.run.smithi116.stdout: "complete_latency": { 2024-09-19T05:00:13.548 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 16, 2024-09-19T05:00:13.548 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000286998, 2024-09-19T05:00:13.549 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000017937 2024-09-19T05:00:13.549 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-19T05:00:13.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.549 INFO:teuthology.orchestra.run.smithi116.stdout: "mds": { 2024-09-19T05:00:13.549 INFO:teuthology.orchestra.run.smithi116.stdout: "request": 790, 2024-09-19T05:00:13.549 INFO:teuthology.orchestra.run.smithi116.stdout: "reply": 790, 2024-09-19T05:00:13.549 INFO:teuthology.orchestra.run.smithi116.stdout: "reply_latency": { 2024-09-19T05:00:13.549 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 790, 2024-09-19T05:00:13.549 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 4.876425315, 2024-09-19T05:00:13.549 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.006172690 2024-09-19T05:00:13.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.549 INFO:teuthology.orchestra.run.smithi116.stdout: "slow_reply": 0, 2024-09-19T05:00:13.549 INFO:teuthology.orchestra.run.smithi116.stdout: "forward": 0, 2024-09-19T05:00:13.550 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_fetch_complete": 0, 2024-09-19T05:00:13.550 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_fetch_keys": 0, 2024-09-19T05:00:13.550 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_commit": 12, 2024-09-19T05:00:13.550 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_split": 0, 2024-09-19T05:00:13.550 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_merge": 0, 2024-09-19T05:00:13.550 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes": 41, 2024-09-19T05:00:13.550 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_top": 1, 2024-09-19T05:00:13.550 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_bottom": 40, 2024-09-19T05:00:13.550 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_pin_tail": 0, 2024-09-19T05:00:13.550 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_pinned": 39, 2024-09-19T05:00:13.550 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_expired": 0, 2024-09-19T05:00:13.550 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_with_caps": 5, 2024-09-19T05:00:13.550 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": 6, 2024-09-19T05:00:13.551 INFO:teuthology.orchestra.run.smithi116.stdout: "subtrees": 2, 2024-09-19T05:00:13.551 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse": 860, 2024-09-19T05:00:13.551 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_hit": 852, 2024-09-19T05:00:13.551 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_forward": 0, 2024-09-19T05:00:13.551 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_discover": 0, 2024-09-19T05:00:13.551 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_dir_fetch": 0, 2024-09-19T05:00:13.551 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_remote_ino": 0, 2024-09-19T05:00:13.551 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_lock": 0, 2024-09-19T05:00:13.551 INFO:teuthology.orchestra.run.smithi116.stdout: "load_cent": 0, 2024-09-19T05:00:13.551 INFO:teuthology.orchestra.run.smithi116.stdout: "q": 0, 2024-09-19T05:00:13.551 INFO:teuthology.orchestra.run.smithi116.stdout: "exported": 0, 2024-09-19T05:00:13.551 INFO:teuthology.orchestra.run.smithi116.stdout: "exported_inodes": 0, 2024-09-19T05:00:13.551 INFO:teuthology.orchestra.run.smithi116.stdout: "imported": 0, 2024-09-19T05:00:13.552 INFO:teuthology.orchestra.run.smithi116.stdout: "imported_inodes": 0, 2024-09-19T05:00:13.552 INFO:teuthology.orchestra.run.smithi116.stdout: "openino_dir_fetch": 0, 2024-09-19T05:00:13.552 INFO:teuthology.orchestra.run.smithi116.stdout: "openino_backtrace_fetch": 315, 2024-09-19T05:00:13.552 INFO:teuthology.orchestra.run.smithi116.stdout: "openino_peer_discover": 0, 2024-09-19T05:00:13.552 INFO:teuthology.orchestra.run.smithi116.stdout: "root_rfiles": 4, 2024-09-19T05:00:13.552 INFO:teuthology.orchestra.run.smithi116.stdout: "root_rbytes": 234, 2024-09-19T05:00:13.552 INFO:teuthology.orchestra.run.smithi116.stdout: "root_rsnaps": 6, 2024-09-19T05:00:13.552 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_backtrace_fetch": 315, 2024-09-19T05:00:13.552 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_set_tag": 0, 2024-09-19T05:00:13.552 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T05:00:13.552 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_inotable_repaired": 0, 2024-09-19T05:00:13.552 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_dir_inodes": 203, 2024-09-19T05:00:13.552 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_dir_base_inodes": 23, 2024-09-19T05:00:13.552 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_dirfrag_rstats": 180, 2024-09-19T05:00:13.553 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_file_inodes": 112, 2024-09-19T05:00:13.553 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_inode_file_caps": 0, 2024-09-19T05:00:13.553 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_revoke": 621, 2024-09-19T05:00:13.553 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_grant": 1207, 2024-09-19T05:00:13.553 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_trunc": 599, 2024-09-19T05:00:13.553 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T05:00:13.553 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T05:00:13.553 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_caps": 637, 2024-09-19T05:00:13.553 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_caps_dirty": 613, 2024-09-19T05:00:13.553 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_cap_release": 2, 2024-09-19T05:00:13.553 INFO:teuthology.orchestra.run.smithi116.stdout: "process_request_cap_release": 26 2024-09-19T05:00:13.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.553 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_cache": { 2024-09-19T05:00:13.553 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_update": 0, 2024-09-19T05:00:13.554 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_update_receipt": 0, 2024-09-19T05:00:13.554 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_try_discover": 0, 2024-09-19T05:00:13.554 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_send_discover": 0, 2024-09-19T05:00:13.554 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_handle_discover": 0, 2024-09-19T05:00:13.554 INFO:teuthology.orchestra.run.smithi116.stdout: "num_strays": 2, 2024-09-19T05:00:13.554 INFO:teuthology.orchestra.run.smithi116.stdout: "num_strays_delayed": 0, 2024-09-19T05:00:13.554 INFO:teuthology.orchestra.run.smithi116.stdout: "num_strays_enqueuing": 0, 2024-09-19T05:00:13.554 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_created": 3, 2024-09-19T05:00:13.554 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_enqueued": 1, 2024-09-19T05:00:13.554 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_reintegrated": 0, 2024-09-19T05:00:13.554 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_migrated": 0, 2024-09-19T05:00:13.554 INFO:teuthology.orchestra.run.smithi116.stdout: "num_recovering_processing": 0, 2024-09-19T05:00:13.554 INFO:teuthology.orchestra.run.smithi116.stdout: "num_recovering_enqueued": 0, 2024-09-19T05:00:13.554 INFO:teuthology.orchestra.run.smithi116.stdout: "num_recovering_prioritized": 0, 2024-09-19T05:00:13.555 INFO:teuthology.orchestra.run.smithi116.stdout: "recovery_started": 0, 2024-09-19T05:00:13.555 INFO:teuthology.orchestra.run.smithi116.stdout: "recovery_completed": 0, 2024-09-19T05:00:13.555 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_quiesce_path": 0, 2024-09-19T05:00:13.555 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_quiesce_inode": 0, 2024-09-19T05:00:13.555 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_enqueue_scrub": 23, 2024-09-19T05:00:13.555 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_exportdir": 0, 2024-09-19T05:00:13.555 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_flush": 0, 2024-09-19T05:00:13.555 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_fragmentdir": 0, 2024-09-19T05:00:13.555 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_fragstats": 0, 2024-09-19T05:00:13.555 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_inodestats": 0 2024-09-19T05:00:13.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.555 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_log": { 2024-09-19T05:00:13.555 INFO:teuthology.orchestra.run.smithi116.stdout: "evlrg": 0, 2024-09-19T05:00:13.555 INFO:teuthology.orchestra.run.smithi116.stdout: "evadd": 2329, 2024-09-19T05:00:13.556 INFO:teuthology.orchestra.run.smithi116.stdout: "evex": 0, 2024-09-19T05:00:13.556 INFO:teuthology.orchestra.run.smithi116.stdout: "evtrm": 0, 2024-09-19T05:00:13.556 INFO:teuthology.orchestra.run.smithi116.stdout: "ev": 2329, 2024-09-19T05:00:13.556 INFO:teuthology.orchestra.run.smithi116.stdout: "evexg": 0, 2024-09-19T05:00:13.556 INFO:teuthology.orchestra.run.smithi116.stdout: "evexd": 0, 2024-09-19T05:00:13.556 INFO:teuthology.orchestra.run.smithi116.stdout: "segadd": 7, 2024-09-19T05:00:13.556 INFO:teuthology.orchestra.run.smithi116.stdout: "segex": 0, 2024-09-19T05:00:13.556 INFO:teuthology.orchestra.run.smithi116.stdout: "segtrm": 0, 2024-09-19T05:00:13.556 INFO:teuthology.orchestra.run.smithi116.stdout: "seg": 7, 2024-09-19T05:00:13.556 INFO:teuthology.orchestra.run.smithi116.stdout: "segmjr": 2, 2024-09-19T05:00:13.556 INFO:teuthology.orchestra.run.smithi116.stdout: "segexg": 0, 2024-09-19T05:00:13.556 INFO:teuthology.orchestra.run.smithi116.stdout: "segexd": 0, 2024-09-19T05:00:13.556 INFO:teuthology.orchestra.run.smithi116.stdout: "expos": 4194304, 2024-09-19T05:00:13.557 INFO:teuthology.orchestra.run.smithi116.stdout: "wrpos": 27991170, 2024-09-19T05:00:13.557 INFO:teuthology.orchestra.run.smithi116.stdout: "rdpos": 0, 2024-09-19T05:00:13.557 INFO:teuthology.orchestra.run.smithi116.stdout: "jlat": { 2024-09-19T05:00:13.557 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 2271, 2024-09-19T05:00:13.557 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 4.368794531, 2024-09-19T05:00:13.557 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.001923731 2024-09-19T05:00:13.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.557 INFO:teuthology.orchestra.run.smithi116.stdout: "replayed": 0 2024-09-19T05:00:13.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.557 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_mem": { 2024-09-19T05:00:13.557 INFO:teuthology.orchestra.run.smithi116.stdout: "ino": 35, 2024-09-19T05:00:13.557 INFO:teuthology.orchestra.run.smithi116.stdout: "ino+": 59, 2024-09-19T05:00:13.557 INFO:teuthology.orchestra.run.smithi116.stdout: "ino-": 24, 2024-09-19T05:00:13.557 INFO:teuthology.orchestra.run.smithi116.stdout: "dir": 20, 2024-09-19T05:00:13.558 INFO:teuthology.orchestra.run.smithi116.stdout: "dir+": 20, 2024-09-19T05:00:13.558 INFO:teuthology.orchestra.run.smithi116.stdout: "dir-": 0, 2024-09-19T05:00:13.558 INFO:teuthology.orchestra.run.smithi116.stdout: "dn": 41, 2024-09-19T05:00:13.558 INFO:teuthology.orchestra.run.smithi116.stdout: "dn+": 42, 2024-09-19T05:00:13.558 INFO:teuthology.orchestra.run.smithi116.stdout: "dn-": 1, 2024-09-19T05:00:13.558 INFO:teuthology.orchestra.run.smithi116.stdout: "cap": 6, 2024-09-19T05:00:13.558 INFO:teuthology.orchestra.run.smithi116.stdout: "cap+": 24, 2024-09-19T05:00:13.558 INFO:teuthology.orchestra.run.smithi116.stdout: "cap-": 18, 2024-09-19T05:00:13.558 INFO:teuthology.orchestra.run.smithi116.stdout: "rss": 55328, 2024-09-19T05:00:13.558 INFO:teuthology.orchestra.run.smithi116.stdout: "heap": 231712 2024-09-19T05:00:13.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.558 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_server": { 2024-09-19T05:00:13.559 INFO:teuthology.orchestra.run.smithi116.stdout: "dispatch_client_request": 2023, 2024-09-19T05:00:13.559 INFO:teuthology.orchestra.run.smithi116.stdout: "dispatch_server_request": 0, 2024-09-19T05:00:13.559 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_request": 790, 2024-09-19T05:00:13.559 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_session": 32, 2024-09-19T05:00:13.559 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_peer_request": 0, 2024-09-19T05:00:13.559 INFO:teuthology.orchestra.run.smithi116.stdout: "req_create_latency": { 2024-09-19T05:00:13.559 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 5, 2024-09-19T05:00:13.559 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.003668724, 2024-09-19T05:00:13.559 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000733744 2024-09-19T05:00:13.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.559 INFO:teuthology.orchestra.run.smithi116.stdout: "req_getattr_latency": { 2024-09-19T05:00:13.559 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 129, 2024-09-19T05:00:13.559 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 1.711899948, 2024-09-19T05:00:13.559 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.013270542 2024-09-19T05:00:13.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.560 INFO:teuthology.orchestra.run.smithi116.stdout: "req_getfilelock_latency": { 2024-09-19T05:00:13.560 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-19T05:00:13.560 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-19T05:00:13.560 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-19T05:00:13.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.560 INFO:teuthology.orchestra.run.smithi116.stdout: "req_link_latency": { 2024-09-19T05:00:13.560 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-19T05:00:13.560 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-19T05:00:13.560 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-19T05:00:13.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.560 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookup_latency": { 2024-09-19T05:00:13.560 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 4, 2024-09-19T05:00:13.561 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000796456, 2024-09-19T05:00:13.561 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000199114 2024-09-19T05:00:13.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.561 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookuphash_latency": { 2024-09-19T05:00:13.561 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-19T05:00:13.561 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-19T05:00:13.561 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-19T05:00:13.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.561 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupino_latency": { 2024-09-19T05:00:13.561 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-19T05:00:13.561 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-19T05:00:13.561 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-19T05:00:13.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.562 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupname_latency": { 2024-09-19T05:00:13.562 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-19T05:00:13.562 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-19T05:00:13.562 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-19T05:00:13.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.562 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupparent_latency": { 2024-09-19T05:00:13.562 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-19T05:00:13.562 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-19T05:00:13.562 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-19T05:00:13.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.562 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupsnap_latency": { 2024-09-19T05:00:13.562 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-19T05:00:13.563 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-19T05:00:13.563 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-19T05:00:13.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.563 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lssnap_latency": { 2024-09-19T05:00:13.563 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 12, 2024-09-19T05:00:13.563 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.001692037, 2024-09-19T05:00:13.563 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000141003 2024-09-19T05:00:13.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.563 INFO:teuthology.orchestra.run.smithi116.stdout: "req_mkdir_latency": { 2024-09-19T05:00:13.563 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 8, 2024-09-19T05:00:13.563 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.011995484, 2024-09-19T05:00:13.563 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.001499435 2024-09-19T05:00:13.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.564 INFO:teuthology.orchestra.run.smithi116.stdout: "req_mknod_latency": { 2024-09-19T05:00:13.564 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-19T05:00:13.564 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-19T05:00:13.564 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-19T05:00:13.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.564 INFO:teuthology.orchestra.run.smithi116.stdout: "req_mksnap_latency": { 2024-09-19T05:00:13.564 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 12, 2024-09-19T05:00:13.564 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.047192748, 2024-09-19T05:00:13.564 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.003932729 2024-09-19T05:00:13.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.564 INFO:teuthology.orchestra.run.smithi116.stdout: "req_open_latency": { 2024-09-19T05:00:13.564 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 599, 2024-09-19T05:00:13.564 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 3.040346449, 2024-09-19T05:00:13.565 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.005075703 2024-09-19T05:00:13.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.565 INFO:teuthology.orchestra.run.smithi116.stdout: "req_readdir_latency": { 2024-09-19T05:00:13.565 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 2, 2024-09-19T05:00:13.565 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.003214100, 2024-09-19T05:00:13.565 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.001607050 2024-09-19T05:00:13.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.565 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rename_latency": { 2024-09-19T05:00:13.565 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 2, 2024-09-19T05:00:13.565 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.001966465, 2024-09-19T05:00:13.565 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000983232 2024-09-19T05:00:13.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.565 INFO:teuthology.orchestra.run.smithi116.stdout: "req_renamesnap_latency": { 2024-09-19T05:00:13.565 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-19T05:00:13.566 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-19T05:00:13.566 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-19T05:00:13.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.566 INFO:teuthology.orchestra.run.smithi116.stdout: "req_snapdiff_latency": { 2024-09-19T05:00:13.566 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-19T05:00:13.566 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-19T05:00:13.566 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-19T05:00:13.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.566 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rmdir_latency": { 2024-09-19T05:00:13.566 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 2, 2024-09-19T05:00:13.566 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.008207861, 2024-09-19T05:00:13.566 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.004103930 2024-09-19T05:00:13.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.567 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rmsnap_latency": { 2024-09-19T05:00:13.567 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 6, 2024-09-19T05:00:13.567 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.022350424, 2024-09-19T05:00:13.567 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.003725070 2024-09-19T05:00:13.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.567 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rmxattr_latency": { 2024-09-19T05:00:13.567 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-19T05:00:13.567 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-19T05:00:13.567 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-19T05:00:13.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.567 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setattr_latency": { 2024-09-19T05:00:13.567 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 1, 2024-09-19T05:00:13.567 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.001203194, 2024-09-19T05:00:13.567 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.001203194 2024-09-19T05:00:13.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.568 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setdirlayout_latency": { 2024-09-19T05:00:13.568 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-19T05:00:13.568 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-19T05:00:13.568 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-19T05:00:13.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.568 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setfilelock_latency": { 2024-09-19T05:00:13.568 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-19T05:00:13.568 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-19T05:00:13.568 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-19T05:00:13.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.568 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setlayout_latency": { 2024-09-19T05:00:13.568 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-19T05:00:13.569 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-19T05:00:13.569 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-19T05:00:13.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.569 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setxattr_latency": { 2024-09-19T05:00:13.569 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 7, 2024-09-19T05:00:13.569 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.019834109, 2024-09-19T05:00:13.569 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.002833444 2024-09-19T05:00:13.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.569 INFO:teuthology.orchestra.run.smithi116.stdout: "req_symlink_latency": { 2024-09-19T05:00:13.569 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-19T05:00:13.569 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-19T05:00:13.569 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-19T05:00:13.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.570 INFO:teuthology.orchestra.run.smithi116.stdout: "req_unlink_latency": { 2024-09-19T05:00:13.570 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 1, 2024-09-19T05:00:13.570 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.002057316, 2024-09-19T05:00:13.570 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.002057316 2024-09-19T05:00:13.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.570 INFO:teuthology.orchestra.run.smithi116.stdout: "cap_revoke_eviction": 0, 2024-09-19T05:00:13.570 INFO:teuthology.orchestra.run.smithi116.stdout: "cap_acquisition_throttle": 0, 2024-09-19T05:00:13.570 INFO:teuthology.orchestra.run.smithi116.stdout: "req_getvxattr_latency": { 2024-09-19T05:00:13.570 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-19T05:00:13.570 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-19T05:00:13.570 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-19T05:00:13.570 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-19T05:00:13.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.570 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_sessions": { 2024-09-19T05:00:13.571 INFO:teuthology.orchestra.run.smithi116.stdout: "session_count": 2, 2024-09-19T05:00:13.571 INFO:teuthology.orchestra.run.smithi116.stdout: "session_add": 5, 2024-09-19T05:00:13.571 INFO:teuthology.orchestra.run.smithi116.stdout: "session_remove": 3, 2024-09-19T05:00:13.571 INFO:teuthology.orchestra.run.smithi116.stdout: "sessions_open": 2, 2024-09-19T05:00:13.571 INFO:teuthology.orchestra.run.smithi116.stdout: "sessions_stale": 0, 2024-09-19T05:00:13.571 INFO:teuthology.orchestra.run.smithi116.stdout: "total_load": 85, 2024-09-19T05:00:13.571 INFO:teuthology.orchestra.run.smithi116.stdout: "average_load": 42, 2024-09-19T05:00:13.571 INFO:teuthology.orchestra.run.smithi116.stdout: "avg_session_uptime": 701, 2024-09-19T05:00:13.571 INFO:teuthology.orchestra.run.smithi116.stdout: "mdthresh_evicted": 0 2024-09-19T05:00:13.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.571 INFO:teuthology.orchestra.run.smithi116.stdout: "mempool": { 2024-09-19T05:00:13.571 INFO:teuthology.orchestra.run.smithi116.stdout: "bloom_filter_bytes": 0, 2024-09-19T05:00:13.571 INFO:teuthology.orchestra.run.smithi116.stdout: "bloom_filter_items": 0, 2024-09-19T05:00:13.572 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T05:00:13.572 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_alloc_items": 0, 2024-09-19T05:00:13.572 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T05:00:13.572 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_data_items": 0, 2024-09-19T05:00:13.572 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T05:00:13.572 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T05:00:13.572 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T05:00:13.572 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T05:00:13.572 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T05:00:13.572 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_other_items": 0, 2024-09-19T05:00:13.572 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T05:00:13.572 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T05:00:13.572 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_extent_bytes": 0, 2024-09-19T05:00:13.573 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_extent_items": 0, 2024-09-19T05:00:13.573 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_blob_bytes": 0, 2024-09-19T05:00:13.573 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_blob_items": 0, 2024-09-19T05:00:13.573 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T05:00:13.573 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T05:00:13.573 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T05:00:13.573 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T05:00:13.573 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T05:00:13.573 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_items": 0, 2024-09-19T05:00:13.573 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_txc_bytes": 0, 2024-09-19T05:00:13.573 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_txc_items": 0, 2024-09-19T05:00:13.573 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T05:00:13.573 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T05:00:13.574 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_bytes": 0, 2024-09-19T05:00:13.574 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_items": 0, 2024-09-19T05:00:13.574 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_bytes": 0, 2024-09-19T05:00:13.574 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_items": 0, 2024-09-19T05:00:13.574 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T05:00:13.574 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_reader_items": 0, 2024-09-19T05:00:13.574 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T05:00:13.574 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_writer_items": 0, 2024-09-19T05:00:13.574 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_anon_bytes": 322834, 2024-09-19T05:00:13.574 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_anon_items": 124, 2024-09-19T05:00:13.574 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_meta_bytes": 0, 2024-09-19T05:00:13.574 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_meta_items": 0, 2024-09-19T05:00:13.574 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_bytes": 0, 2024-09-19T05:00:13.575 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_items": 0, 2024-09-19T05:00:13.575 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mapbl_bytes": 0, 2024-09-19T05:00:13.575 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mapbl_items": 0, 2024-09-19T05:00:13.575 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pglog_bytes": 0, 2024-09-19T05:00:13.575 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pglog_items": 0, 2024-09-19T05:00:13.575 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_bytes": 8096, 2024-09-19T05:00:13.575 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_items": 178, 2024-09-19T05:00:13.575 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T05:00:13.575 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_mapping_items": 0, 2024-09-19T05:00:13.575 INFO:teuthology.orchestra.run.smithi116.stdout: "pgmap_bytes": 0, 2024-09-19T05:00:13.575 INFO:teuthology.orchestra.run.smithi116.stdout: "pgmap_items": 0, 2024-09-19T05:00:13.575 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_co_bytes": 187020, 2024-09-19T05:00:13.575 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_co_items": 1007, 2024-09-19T05:00:13.576 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_1_bytes": 0, 2024-09-19T05:00:13.576 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_1_items": 0, 2024-09-19T05:00:13.576 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_2_bytes": 0, 2024-09-19T05:00:13.576 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_2_items": 0 2024-09-19T05:00:13.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.576 INFO:teuthology.orchestra.run.smithi116.stdout: "objecter": { 2024-09-19T05:00:13.576 INFO:teuthology.orchestra.run.smithi116.stdout: "op_active": 0, 2024-09-19T05:00:13.576 INFO:teuthology.orchestra.run.smithi116.stdout: "op_laggy": 0, 2024-09-19T05:00:13.576 INFO:teuthology.orchestra.run.smithi116.stdout: "op_send": 3851, 2024-09-19T05:00:13.576 INFO:teuthology.orchestra.run.smithi116.stdout: "op_send_bytes": 23817276, 2024-09-19T05:00:13.576 INFO:teuthology.orchestra.run.smithi116.stdout: "op_resend": 37, 2024-09-19T05:00:13.576 INFO:teuthology.orchestra.run.smithi116.stdout: "op_reply": 3851, 2024-09-19T05:00:13.576 INFO:teuthology.orchestra.run.smithi116.stdout: "op_latency": { 2024-09-19T05:00:13.576 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 3851, 2024-09-19T05:00:13.577 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 25.162578361, 2024-09-19T05:00:13.577 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.006534037 2024-09-19T05:00:13.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.577 INFO:teuthology.orchestra.run.smithi116.stdout: "op_inflight": 0, 2024-09-19T05:00:13.577 INFO:teuthology.orchestra.run.smithi116.stdout: "oplen_avg": { 2024-09-19T05:00:13.577 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 3851, 2024-09-19T05:00:13.577 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 3894 2024-09-19T05:00:13.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.577 INFO:teuthology.orchestra.run.smithi116.stdout: "op": 3851, 2024-09-19T05:00:13.577 INFO:teuthology.orchestra.run.smithi116.stdout: "op_r": 362, 2024-09-19T05:00:13.577 INFO:teuthology.orchestra.run.smithi116.stdout: "op_w": 3489, 2024-09-19T05:00:13.577 INFO:teuthology.orchestra.run.smithi116.stdout: "op_rmw": 0, 2024-09-19T05:00:13.577 INFO:teuthology.orchestra.run.smithi116.stdout: "op_pg": 0, 2024-09-19T05:00:13.578 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_stat": 0, 2024-09-19T05:00:13.578 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_create": 11, 2024-09-19T05:00:13.578 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_read": 24, 2024-09-19T05:00:13.578 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_write": 2272, 2024-09-19T05:00:13.578 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_writefull": 55, 2024-09-19T05:00:13.578 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_writesame": 0, 2024-09-19T05:00:13.578 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_append": 0, 2024-09-19T05:00:13.578 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_zero": 0, 2024-09-19T05:00:13.578 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_truncate": 0, 2024-09-19T05:00:13.578 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_delete": 518, 2024-09-19T05:00:13.578 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_mapext": 0, 2024-09-19T05:00:13.578 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_sparse_read": 0, 2024-09-19T05:00:13.578 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_clonerange": 0, 2024-09-19T05:00:13.579 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_getxattr": 338, 2024-09-19T05:00:13.579 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_setxattr": 22, 2024-09-19T05:00:13.579 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_cmpxattr": 0, 2024-09-19T05:00:13.579 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_rmxattr": 0, 2024-09-19T05:00:13.579 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_resetxattrs": 0, 2024-09-19T05:00:13.579 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_call": 0, 2024-09-19T05:00:13.579 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_watch": 0, 2024-09-19T05:00:13.579 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_notify": 0, 2024-09-19T05:00:13.579 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T05:00:13.579 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_pgls": 0, 2024-09-19T05:00:13.579 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_pgls_filter": 0, 2024-09-19T05:00:13.579 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_other": 599, 2024-09-19T05:00:13.579 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_active": 0, 2024-09-19T05:00:13.579 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_send": 0, 2024-09-19T05:00:13.580 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_resend": 0, 2024-09-19T05:00:13.580 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_ping": 0, 2024-09-19T05:00:13.580 INFO:teuthology.orchestra.run.smithi116.stdout: "poolop_active": 0, 2024-09-19T05:00:13.580 INFO:teuthology.orchestra.run.smithi116.stdout: "poolop_send": 0, 2024-09-19T05:00:13.580 INFO:teuthology.orchestra.run.smithi116.stdout: "poolop_resend": 0, 2024-09-19T05:00:13.580 INFO:teuthology.orchestra.run.smithi116.stdout: "poolstat_active": 0, 2024-09-19T05:00:13.580 INFO:teuthology.orchestra.run.smithi116.stdout: "poolstat_send": 0, 2024-09-19T05:00:13.580 INFO:teuthology.orchestra.run.smithi116.stdout: "poolstat_resend": 0, 2024-09-19T05:00:13.580 INFO:teuthology.orchestra.run.smithi116.stdout: "statfs_active": 0, 2024-09-19T05:00:13.580 INFO:teuthology.orchestra.run.smithi116.stdout: "statfs_send": 0, 2024-09-19T05:00:13.580 INFO:teuthology.orchestra.run.smithi116.stdout: "statfs_resend": 0, 2024-09-19T05:00:13.580 INFO:teuthology.orchestra.run.smithi116.stdout: "command_active": 0, 2024-09-19T05:00:13.580 INFO:teuthology.orchestra.run.smithi116.stdout: "command_send": 0, 2024-09-19T05:00:13.581 INFO:teuthology.orchestra.run.smithi116.stdout: "command_resend": 0, 2024-09-19T05:00:13.581 INFO:teuthology.orchestra.run.smithi116.stdout: "map_epoch": 92, 2024-09-19T05:00:13.581 INFO:teuthology.orchestra.run.smithi116.stdout: "map_full": 0, 2024-09-19T05:00:13.581 INFO:teuthology.orchestra.run.smithi116.stdout: "map_inc": 14, 2024-09-19T05:00:13.581 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_sessions": 12, 2024-09-19T05:00:13.581 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_session_open": 12, 2024-09-19T05:00:13.581 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_session_close": 0, 2024-09-19T05:00:13.581 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_laggy": 0, 2024-09-19T05:00:13.581 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_wr": 45, 2024-09-19T05:00:13.581 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_rd": 0, 2024-09-19T05:00:13.581 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_del": 10 2024-09-19T05:00:13.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.581 INFO:teuthology.orchestra.run.smithi116.stdout: "oft": { 2024-09-19T05:00:13.582 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_objs": 1, 2024-09-19T05:00:13.582 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_kv_pairs": 0, 2024-09-19T05:00:13.582 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_updates": 0, 2024-09-19T05:00:13.582 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_removes": 0 2024-09-19T05:00:13.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.582 INFO:teuthology.orchestra.run.smithi116.stdout: "osd-slow-ops": { 2024-09-19T05:00:13.582 INFO:teuthology.orchestra.run.smithi116.stdout: "slow_ops_count": 0 2024-09-19T05:00:13.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.582 INFO:teuthology.orchestra.run.smithi116.stdout: "purge_queue": { 2024-09-19T05:00:13.582 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing_ops": 0, 2024-09-19T05:00:13.582 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing_ops_high_water": 1, 2024-09-19T05:00:13.582 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing": 0, 2024-09-19T05:00:13.582 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing_high_water": 1, 2024-09-19T05:00:13.582 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executed_ops": 1, 2024-09-19T05:00:13.583 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executed": 1, 2024-09-19T05:00:13.583 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_item_in_journal": 0 2024-09-19T05:00:13.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.583 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T05:00:13.583 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-09-19T05:00:13.583 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 104857600, 2024-09-19T05:00:13.583 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-09-19T05:00:13.583 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 7496, 2024-09-19T05:00:13.583 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 2954150, 2024-09-19T05:00:13.583 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-09-19T05:00:13.583 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 7496, 2024-09-19T05:00:13.583 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2024-09-19T05:00:13.583 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2024-09-19T05:00:13.583 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 7496, 2024-09-19T05:00:13.584 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 2954150, 2024-09-19T05:00:13.584 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-09-19T05:00:13.584 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-19T05:00:13.584 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-19T05:00:13.584 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-19T05:00:13.584 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-19T05:00:13.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.584 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-objecter_bytes": { 2024-09-19T05:00:13.584 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-09-19T05:00:13.584 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 104857600, 2024-09-19T05:00:13.584 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-09-19T05:00:13.584 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 0, 2024-09-19T05:00:13.584 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 0, 2024-09-19T05:00:13.585 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-09-19T05:00:13.585 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 0, 2024-09-19T05:00:13.585 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 3851, 2024-09-19T05:00:13.585 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 23817425, 2024-09-19T05:00:13.585 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 3851, 2024-09-19T05:00:13.585 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 23817425, 2024-09-19T05:00:13.585 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-09-19T05:00:13.585 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-19T05:00:13.585 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-19T05:00:13.585 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-19T05:00:13.585 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-19T05:00:13.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.585 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-objecter_ops": { 2024-09-19T05:00:13.585 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-09-19T05:00:13.586 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 1024, 2024-09-19T05:00:13.586 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-09-19T05:00:13.586 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 0, 2024-09-19T05:00:13.586 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 0, 2024-09-19T05:00:13.586 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-09-19T05:00:13.586 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 0, 2024-09-19T05:00:13.586 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 3851, 2024-09-19T05:00:13.586 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 3851, 2024-09-19T05:00:13.586 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 3851, 2024-09-19T05:00:13.586 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 3851, 2024-09-19T05:00:13.586 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-09-19T05:00:13.586 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-19T05:00:13.586 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-19T05:00:13.587 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-19T05:00:13.587 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-19T05:00:13.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.587 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-write_buf_throttle": { 2024-09-19T05:00:13.587 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-09-19T05:00:13.587 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 3758096384, 2024-09-19T05:00:13.587 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-09-19T05:00:13.587 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 1, 2024-09-19T05:00:13.587 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 149, 2024-09-19T05:00:13.587 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-09-19T05:00:13.587 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 1, 2024-09-19T05:00:13.587 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2024-09-19T05:00:13.587 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2024-09-19T05:00:13.587 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 1, 2024-09-19T05:00:13.588 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 149, 2024-09-19T05:00:13.588 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-09-19T05:00:13.588 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-19T05:00:13.588 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-19T05:00:13.588 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-19T05:00:13.588 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-19T05:00:13.588 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:13.588 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-write_buf_throttle-0x5588a3e7c500": { 2024-09-19T05:00:13.588 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 112, 2024-09-19T05:00:13.588 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 3758096384, 2024-09-19T05:00:13.588 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-09-19T05:00:13.588 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 2329, 2024-09-19T05:00:13.588 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 23796866, 2024-09-19T05:00:13.589 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-09-19T05:00:13.589 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 2329, 2024-09-19T05:00:13.589 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2024-09-19T05:00:13.589 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2024-09-19T05:00:13.589 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 2271, 2024-09-19T05:00:13.589 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 23796754, 2024-09-19T05:00:13.589 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-09-19T05:00:13.589 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-19T05:00:13.589 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-19T05:00:13.589 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-19T05:00:13.589 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-19T05:00:13.589 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-19T05:00:13.589 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-19T05:00:14.217 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-09-19T05:00:14.217 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=12 2024-09-19T05:00:14.217 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=6 2024-09-19T05:00:14.217 DEBUG:tasks.check_counter:Getting stats from l 2024-09-19T05:00:14.218 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-19T05:00:14.462 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T05:00:14.761 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:14 smithi116 ceph-mon[34477]: pgmap v381: 97 pgs: 97 active+clean; 24 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-19T05:00:14.806 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:14 smithi018 ceph-mon[34537]: pgmap v381: 97 pgs: 97 active+clean; 24 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-19T05:00:14.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:14 smithi002 ceph-mon[30975]: pgmap v381: 97 pgs: 97 active+clean; 24 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-19T05:00:14.978 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-19T05:00:14.978 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T05:00:14.978 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 243, 2024-09-19T05:00:14.978 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 233, 2024-09-19T05:00:14.978 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 1454128, 2024-09-19T05:00:14.978 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 143424, 2024-09-19T05:00:14.978 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 4, 2024-09-19T05:00:14.979 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 0, 2024-09-19T05:00:14.979 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.048013435, 2024-09-19T05:00:14.979 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.018049500, 2024-09-19T05:00:14.979 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.042679453, 2024-09-19T05:00:14.979 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T05:00:14.979 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:00:14.979 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 232, 2024-09-19T05:00:14.979 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.014416057, 2024-09-19T05:00:14.979 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000062138 2024-09-19T05:00:14.979 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:14.979 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:00:14.979 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-19T05:00:14.979 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-19T05:00:14.980 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-19T05:00:14.980 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:14.980 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 1454128, 2024-09-19T05:00:14.980 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 143424 2024-09-19T05:00:14.980 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:14.980 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T05:00:14.980 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 6, 2024-09-19T05:00:14.980 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 181, 2024-09-19T05:00:14.980 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 3264, 2024-09-19T05:00:14.980 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 188992, 2024-09-19T05:00:14.980 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 5, 2024-09-19T05:00:14.980 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 3, 2024-09-19T05:00:14.980 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.014434915, 2024-09-19T05:00:14.981 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.008628853, 2024-09-19T05:00:14.981 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.003645959, 2024-09-19T05:00:14.981 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T05:00:14.981 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:00:14.981 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 179, 2024-09-19T05:00:14.981 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.022268388, 2024-09-19T05:00:14.981 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000124404 2024-09-19T05:00:14.981 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:14.981 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:00:14.981 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-19T05:00:14.981 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-19T05:00:14.981 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-19T05:00:14.982 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:14.982 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 3264, 2024-09-19T05:00:14.982 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 188992 2024-09-19T05:00:14.982 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:14.982 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T05:00:14.982 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 0, 2024-09-19T05:00:14.982 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 2, 2024-09-19T05:00:14.982 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 0, 2024-09-19T05:00:14.982 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 0, 2024-09-19T05:00:14.982 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 2, 2024-09-19T05:00:14.982 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 1, 2024-09-19T05:00:14.982 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.000404391, 2024-09-19T05:00:14.983 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T05:00:14.983 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.000337692, 2024-09-19T05:00:14.983 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T05:00:14.983 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:00:14.983 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-19T05:00:14.983 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-19T05:00:14.983 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-19T05:00:14.983 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:14.983 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:00:14.983 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-19T05:00:14.983 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-19T05:00:14.983 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-19T05:00:14.983 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:14.984 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T05:00:14.984 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T05:00:14.984 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:14.984 INFO:teuthology.orchestra.run.smithi116.stdout: "cct": { 2024-09-19T05:00:14.984 INFO:teuthology.orchestra.run.smithi116.stdout: "total_workers": 0, 2024-09-19T05:00:14.984 INFO:teuthology.orchestra.run.smithi116.stdout: "unhealthy_workers": 0 2024-09-19T05:00:14.984 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:14.984 INFO:teuthology.orchestra.run.smithi116.stdout: "mempool": { 2024-09-19T05:00:14.984 INFO:teuthology.orchestra.run.smithi116.stdout: "bloom_filter_bytes": 0, 2024-09-19T05:00:14.984 INFO:teuthology.orchestra.run.smithi116.stdout: "bloom_filter_items": 0, 2024-09-19T05:00:14.984 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T05:00:14.984 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_alloc_items": 0, 2024-09-19T05:00:14.984 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T05:00:14.984 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_data_items": 0, 2024-09-19T05:00:14.985 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T05:00:14.985 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T05:00:14.985 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T05:00:14.985 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T05:00:14.985 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T05:00:14.985 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_other_items": 0, 2024-09-19T05:00:14.985 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T05:00:14.985 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T05:00:14.985 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_extent_bytes": 0, 2024-09-19T05:00:14.985 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_extent_items": 0, 2024-09-19T05:00:14.985 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_blob_bytes": 0, 2024-09-19T05:00:14.985 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_blob_items": 0, 2024-09-19T05:00:14.985 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T05:00:14.985 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T05:00:14.986 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T05:00:14.986 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T05:00:14.986 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T05:00:14.986 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_items": 0, 2024-09-19T05:00:14.986 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_txc_bytes": 0, 2024-09-19T05:00:14.986 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_txc_items": 0, 2024-09-19T05:00:14.986 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T05:00:14.986 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T05:00:14.986 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_bytes": 0, 2024-09-19T05:00:14.986 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_items": 0, 2024-09-19T05:00:14.986 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_bytes": 0, 2024-09-19T05:00:14.986 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_items": 0, 2024-09-19T05:00:14.986 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T05:00:14.986 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_reader_items": 0, 2024-09-19T05:00:14.986 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T05:00:14.987 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_writer_items": 0, 2024-09-19T05:00:14.987 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_anon_bytes": 148994, 2024-09-19T05:00:14.987 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_anon_items": 31, 2024-09-19T05:00:14.987 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_meta_bytes": 0, 2024-09-19T05:00:14.987 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_meta_items": 0, 2024-09-19T05:00:14.987 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_bytes": 0, 2024-09-19T05:00:14.987 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_items": 0, 2024-09-19T05:00:14.987 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mapbl_bytes": 0, 2024-09-19T05:00:14.987 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mapbl_items": 0, 2024-09-19T05:00:14.987 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pglog_bytes": 0, 2024-09-19T05:00:14.987 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pglog_items": 0, 2024-09-19T05:00:14.987 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_bytes": 0, 2024-09-19T05:00:14.987 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_items": 0, 2024-09-19T05:00:14.988 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T05:00:14.988 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_mapping_items": 0, 2024-09-19T05:00:14.988 INFO:teuthology.orchestra.run.smithi116.stdout: "pgmap_bytes": 0, 2024-09-19T05:00:14.988 INFO:teuthology.orchestra.run.smithi116.stdout: "pgmap_items": 0, 2024-09-19T05:00:14.988 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_co_bytes": 928, 2024-09-19T05:00:14.988 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_co_items": 2, 2024-09-19T05:00:14.988 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_1_bytes": 0, 2024-09-19T05:00:14.988 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_1_items": 0, 2024-09-19T05:00:14.988 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_2_bytes": 0, 2024-09-19T05:00:14.988 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_2_items": 0 2024-09-19T05:00:14.988 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-19T05:00:14.988 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T05:00:14.988 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-09-19T05:00:14.988 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 104857600, 2024-09-19T05:00:14.989 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-09-19T05:00:14.989 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 245, 2024-09-19T05:00:14.989 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 1419823, 2024-09-19T05:00:14.989 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-09-19T05:00:14.989 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 245, 2024-09-19T05:00:14.989 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2024-09-19T05:00:14.989 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2024-09-19T05:00:14.989 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 245, 2024-09-19T05:00:14.989 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 1419823, 2024-09-19T05:00:14.989 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-09-19T05:00:14.989 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-19T05:00:14.989 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-19T05:00:14.989 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-19T05:00:14.989 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-19T05:00:14.990 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-19T05:00:14.990 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-19T05:00:15.642 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2024-09-19T05:00:15.642 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2024-09-19T05:00:15.642 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2024-09-19T05:00:15.642 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-19T05:00:15.653 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-19T05:00:15.653 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-19T05:00:15.653 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:00:15.676 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-19T05:00:15.676 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:00:15.736 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T05:00:16.050 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:00:16.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.537+0000 7f85525fb640 1 -- 172.21.15.2:0/395938613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f854c103660 msgr2=0x7f854c10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:00:16.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.537+0000 7f85525fb640 1 --2- 172.21.15.2:0/395938613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f854c103660 0x7f854c10bb50 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f8540009900 tx=0x7f854002a480 comp rx=0 tx=0).stop 2024-09-19T05:00:16.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.537+0000 7f85525fb640 1 -- 172.21.15.2:0/395938613 shutdown_connections 2024-09-19T05:00:16.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.537+0000 7f85525fb640 1 --2- 172.21.15.2:0/395938613 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f854c10c170 0x7f854c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:16.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.537+0000 7f85525fb640 1 --2- 172.21.15.2:0/395938613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f854c103660 0x7f854c10bb50 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:16.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.537+0000 7f85525fb640 1 --2- 172.21.15.2:0/395938613 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f854c102d40 0x7f854c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:16.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.537+0000 7f85525fb640 1 -- 172.21.15.2:0/395938613 >> 172.21.15.2:0/395938613 conn(0x7f854c0fc7a0 msgr2=0x7f854c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:00:16.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.537+0000 7f85525fb640 1 -- 172.21.15.2:0/395938613 shutdown_connections 2024-09-19T05:00:16.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.537+0000 7f85525fb640 1 -- 172.21.15.2:0/395938613 wait complete. 2024-09-19T05:00:16.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.538+0000 7f85525fb640 1 Processor -- start 2024-09-19T05:00:16.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.538+0000 7f85525fb640 1 -- start start 2024-09-19T05:00:16.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.538+0000 7f85525fb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f854c102d40 0x7f854c1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:00:16.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.538+0000 7f85525fb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f854c103660 0x7f854c100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:00:16.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.538+0000 7f85525fb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f854c10c170 0x7f854c101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:00:16.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.538+0000 7f85525fb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f854c111e20 con 0x7f854c103660 2024-09-19T05:00:16.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.538+0000 7f85525fb640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f854c111ca0 con 0x7f854c102d40 2024-09-19T05:00:16.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.538+0000 7f85525fb640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f854c111fa0 con 0x7f854c10c170 2024-09-19T05:00:16.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.538+0000 7f854b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f854c103660 0x7f854c100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:00:16.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.538+0000 7f854b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f854c103660 0x7f854c100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51704/0 (socket says 172.21.15.2:51704) 2024-09-19T05:00:16.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.538+0000 7f854b7fe640 1 -- 172.21.15.2:0/933112320 learned_addr learned my addr 172.21.15.2:0/933112320 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T05:00:16.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.538+0000 7f8550b98640 1 --2- 172.21.15.2:0/933112320 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f854c10c170 0x7f854c101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:00:16.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.539+0000 7f854bfff640 1 --2- 172.21.15.2:0/933112320 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f854c102d40 0x7f854c1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:00:16.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.539+0000 7f854b7fe640 1 -- 172.21.15.2:0/933112320 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f854c10c170 msgr2=0x7f854c101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:00:16.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.539+0000 7f854b7fe640 1 --2- 172.21.15.2:0/933112320 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f854c10c170 0x7f854c101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:16.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.539+0000 7f854b7fe640 1 -- 172.21.15.2:0/933112320 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f854c102d40 msgr2=0x7f854c1009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:00:16.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.539+0000 7f854b7fe640 1 --2- 172.21.15.2:0/933112320 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f854c102d40 0x7f854c1009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:16.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.539+0000 7f854b7fe640 1 -- 172.21.15.2:0/933112320 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f854c1a6890 con 0x7f854c103660 2024-09-19T05:00:16.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.539+0000 7f854b7fe640 1 --2- 172.21.15.2:0/933112320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f854c103660 0x7f854c100ee0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f8540006010 tx=0x7f85400042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:00:16.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.539+0000 7f85497fa640 1 -- 172.21.15.2:0/933112320 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f854003f030 con 0x7f854c103660 2024-09-19T05:00:16.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.539+0000 7f85525fb640 1 -- 172.21.15.2:0/933112320 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f854c1a6b20 con 0x7f854c103660 2024-09-19T05:00:16.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.539+0000 7f85497fa640 1 -- 172.21.15.2:0/933112320 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8540003800 con 0x7f854c103660 2024-09-19T05:00:16.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.539+0000 7f85497fa640 1 -- 172.21.15.2:0/933112320 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8540035070 con 0x7f854c103660 2024-09-19T05:00:16.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.539+0000 7f85525fb640 1 -- 172.21.15.2:0/933112320 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f854c1a7000 con 0x7f854c103660 2024-09-19T05:00:16.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.540+0000 7f85525fb640 1 -- 172.21.15.2:0/933112320 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f854c103120 con 0x7f854c103660 2024-09-19T05:00:16.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.541+0000 7f85497fa640 1 -- 172.21.15.2:0/933112320 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f8540031af0 con 0x7f854c103660 2024-09-19T05:00:16.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.542+0000 7f85497fa640 1 --2- 172.21.15.2:0/933112320 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f85340a33b0 0x7f85340a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:00:16.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.542+0000 7f85497fa640 1 -- 172.21.15.2:0/933112320 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8571+0+0 (secure 0 0 0) 0x7f85400f05f0 con 0x7f854c103660 2024-09-19T05:00:16.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.542+0000 7f854bfff640 1 --2- 172.21.15.2:0/933112320 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f85340a33b0 0x7f85340a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:00:16.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.542+0000 7f854bfff640 1 --2- 172.21.15.2:0/933112320 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f85340a33b0 0x7f85340a5870 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f853c005fd0 tx=0x7f853c005e20 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:00:16.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.546+0000 7f85497fa640 1 -- 172.21.15.2:0/933112320 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f85400bcfa0 con 0x7f854c103660 2024-09-19T05:00:16.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.732+0000 7f85525fb640 1 -- 172.21.15.2:0/933112320 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f854c1071e0 con 0x7f854c103660 2024-09-19T05:00:16.735 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:16 smithi002 ceph-mon[30975]: pgmap v382: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-19T05:00:16.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.733+0000 7f85497fa640 1 -- 172.21.15.2:0/933112320 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 17 entries v92) ==== 81+0+985 (secure 0 0 0) 0x7f85400bc8a0 con 0x7f854c103660 2024-09-19T05:00:16.735 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3848778984 2024-09-20T04:47:59.140869+0000 2024-09-19T05:00:16.736 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2044166064 2024-09-20T04:47:59.140869+0000 2024-09-19T05:00:16.736 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/1092443021 2024-09-20T04:47:59.140869+0000 2024-09-19T05:00:16.736 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2432243496 2024-09-20T04:39:11.086431+0000 2024-09-19T05:00:16.736 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/3782987318 2024-09-20T04:39:35.461329+0000 2024-09-19T05:00:16.736 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/1825825090 2024-09-20T04:39:11.086431+0000 2024-09-19T05:00:16.736 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/1825825090 2024-09-20T04:39:11.086431+0000 2024-09-19T05:00:16.736 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/3171525177 2024-09-20T04:47:59.140869+0000 2024-09-19T05:00:16.736 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3064319092 2024-09-20T04:39:11.086431+0000 2024-09-19T05:00:16.736 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/3782987318 2024-09-20T04:39:35.461329+0000 2024-09-19T05:00:16.736 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/256825166 2024-09-20T04:39:35.461329+0000 2024-09-19T05:00:16.736 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/1528097642 2024-09-20T04:39:11.086431+0000 2024-09-19T05:00:16.736 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2801870985 2024-09-20T04:39:35.461329+0000 2024-09-19T05:00:16.737 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/3171525177 2024-09-20T04:47:59.140869+0000 2024-09-19T05:00:16.737 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/4263572944 2024-09-20T04:47:59.140869+0000 2024-09-19T05:00:16.737 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/870383845 2024-09-20T04:39:35.461329+0000 2024-09-19T05:00:16.737 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3466359926 2024-09-20T04:47:59.140869+0000 2024-09-19T05:00:16.737 INFO:teuthology.orchestra.run.smithi002.stderr:listed 17 entries 2024-09-19T05:00:16.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.735+0000 7f85525fb640 1 -- 172.21.15.2:0/933112320 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f85340a33b0 msgr2=0x7f85340a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:00:16.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.735+0000 7f85525fb640 1 --2- 172.21.15.2:0/933112320 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f85340a33b0 0x7f85340a5870 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f853c005fd0 tx=0x7f853c005e20 comp rx=0 tx=0).stop 2024-09-19T05:00:16.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.735+0000 7f85525fb640 1 -- 172.21.15.2:0/933112320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f854c103660 msgr2=0x7f854c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:00:16.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.735+0000 7f85525fb640 1 --2- 172.21.15.2:0/933112320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f854c103660 0x7f854c100ee0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f8540006010 tx=0x7f85400042f0 comp rx=0 tx=0).stop 2024-09-19T05:00:16.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.735+0000 7f85525fb640 1 -- 172.21.15.2:0/933112320 shutdown_connections 2024-09-19T05:00:16.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.735+0000 7f85525fb640 1 --2- 172.21.15.2:0/933112320 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f85340a33b0 0x7f85340a5870 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:16.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.735+0000 7f85525fb640 1 --2- 172.21.15.2:0/933112320 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f854c10c170 0x7f854c101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:16.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.735+0000 7f85525fb640 1 --2- 172.21.15.2:0/933112320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f854c103660 0x7f854c100ee0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:16.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.735+0000 7f85525fb640 1 --2- 172.21.15.2:0/933112320 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f854c102d40 0x7f854c1009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:16.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.735+0000 7f85525fb640 1 -- 172.21.15.2:0/933112320 >> 172.21.15.2:0/933112320 conn(0x7f854c0fc7a0 msgr2=0x7f854c0fd580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:00:16.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.735+0000 7f85525fb640 1 -- 172.21.15.2:0/933112320 shutdown_connections 2024-09-19T05:00:16.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:16.735+0000 7f85525fb640 1 -- 172.21.15.2:0/933112320 wait complete. 2024-09-19T05:00:16.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:16 smithi018 ceph-mon[34537]: pgmap v382: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-19T05:00:16.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:16 smithi116 ceph-mon[34477]: pgmap v382: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-19T05:00:17.368 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-19T05:00:17.368 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:00:17.385 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T05:00:17.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:17 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/933112320' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T05:00:17.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:17 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:00:17.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:17 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T05:00:17.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:17 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T05:00:17.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:17 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T05:00:17.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:17 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T05:00:17.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:17 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T05:00:17.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:17 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T05:00:17.697 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:00:17.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:17 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/933112320' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T05:00:17.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:17 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:00:17.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:17 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T05:00:17.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:17 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T05:00:17.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:17 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T05:00:17.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:17 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T05:00:17.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:17 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T05:00:17.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:17 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T05:00:17.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:17 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/933112320' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T05:00:17.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:17 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:00:17.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:17 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T05:00:17.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:17 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T05:00:17.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:17 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T05:00:17.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:17 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T05:00:17.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:17 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T05:00:17.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:17 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T05:00:18.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.179+0000 7f9bb52fe640 1 -- 172.21.15.2:0/1231192859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bb0106a80 msgr2=0x7f9bb0106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:00:18.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.179+0000 7f9bb52fe640 1 --2- 172.21.15.2:0/1231192859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bb0106a80 0x7f9bb0106e60 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f9ba0009930 tx=0x7f9ba002a420 comp rx=0 tx=0).stop 2024-09-19T05:00:18.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.179+0000 7f9bb52fe640 1 -- 172.21.15.2:0/1231192859 shutdown_connections 2024-09-19T05:00:18.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.179+0000 7f9bb52fe640 1 --2- 172.21.15.2:0/1231192859 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9bb0101420 0x7f9bb010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:18.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.179+0000 7f9bb52fe640 1 --2- 172.21.15.2:0/1231192859 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9bb0100a80 0x7f9bb0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:18.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.179+0000 7f9bb52fe640 1 --2- 172.21.15.2:0/1231192859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bb0106a80 0x7f9bb0106e60 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:18.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.179+0000 7f9bb52fe640 1 -- 172.21.15.2:0/1231192859 >> 172.21.15.2:0/1231192859 conn(0x7f9bb00fc7a0 msgr2=0x7f9bb00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:00:18.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.179+0000 7f9bb52fe640 1 -- 172.21.15.2:0/1231192859 shutdown_connections 2024-09-19T05:00:18.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.179+0000 7f9bb52fe640 1 -- 172.21.15.2:0/1231192859 wait complete. 2024-09-19T05:00:18.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.180+0000 7f9bb52fe640 1 Processor -- start 2024-09-19T05:00:18.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.180+0000 7f9bb52fe640 1 -- start start 2024-09-19T05:00:18.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.180+0000 7f9bb52fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bb0100a80 0x7f9bb0198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:00:18.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.180+0000 7f9bb52fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9bb0101420 0x7f9bb01988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:00:18.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.180+0000 7f9bb52fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9bb0106a80 0x7f9bb019cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:00:18.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.180+0000 7f9bb52fe640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb0110cf0 con 0x7f9bb0100a80 2024-09-19T05:00:18.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.180+0000 7f9bb52fe640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb0110b70 con 0x7f9bb0101420 2024-09-19T05:00:18.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.180+0000 7f9bb52fe640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb0110e70 con 0x7f9bb0106a80 2024-09-19T05:00:18.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.180+0000 7f9baeffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bb0100a80 0x7f9bb0198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:00:18.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.180+0000 7f9baeffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bb0100a80 0x7f9bb0198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51714/0 (socket says 172.21.15.2:51714) 2024-09-19T05:00:18.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.180+0000 7f9baeffd640 1 -- 172.21.15.2:0/3001556091 learned_addr learned my addr 172.21.15.2:0/3001556091 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T05:00:18.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.180+0000 7f9ba67fc640 1 --2- 172.21.15.2:0/3001556091 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9bb0101420 0x7f9bb01988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:00:18.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.180+0000 7f9baf7fe640 1 --2- 172.21.15.2:0/3001556091 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9bb0106a80 0x7f9bb019cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:00:18.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.181+0000 7f9baeffd640 1 -- 172.21.15.2:0/3001556091 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9bb0106a80 msgr2=0x7f9bb019cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:00:18.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.181+0000 7f9baeffd640 1 --2- 172.21.15.2:0/3001556091 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9bb0106a80 0x7f9bb019cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:18.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.181+0000 7f9baeffd640 1 -- 172.21.15.2:0/3001556091 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9bb0101420 msgr2=0x7f9bb01988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:00:18.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.181+0000 7f9baeffd640 1 --2- 172.21.15.2:0/3001556091 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9bb0101420 0x7f9bb01988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:18.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.181+0000 7f9baeffd640 1 -- 172.21.15.2:0/3001556091 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bb019d330 con 0x7f9bb0100a80 2024-09-19T05:00:18.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.181+0000 7f9baeffd640 1 --2- 172.21.15.2:0/3001556091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bb0100a80 0x7f9bb0198380 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f9ba0005940 tx=0x7f9ba00040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:00:18.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.181+0000 7f9bacff9640 1 -- 172.21.15.2:0/3001556091 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ba003f030 con 0x7f9bb0100a80 2024-09-19T05:00:18.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.181+0000 7f9bacff9640 1 -- 172.21.15.2:0/3001556091 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9ba00044c0 con 0x7f9bb0100a80 2024-09-19T05:00:18.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.181+0000 7f9bb52fe640 1 -- 172.21.15.2:0/3001556091 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bb019d5c0 con 0x7f9bb0100a80 2024-09-19T05:00:18.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.181+0000 7f9bacff9640 1 -- 172.21.15.2:0/3001556091 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ba0035070 con 0x7f9bb0100a80 2024-09-19T05:00:18.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.181+0000 7f9bb52fe640 1 -- 172.21.15.2:0/3001556091 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bb01a4f00 con 0x7f9bb0100a80 2024-09-19T05:00:18.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.182+0000 7f9bb52fe640 1 -- 172.21.15.2:0/3001556091 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bb01021c0 con 0x7f9bb0100a80 2024-09-19T05:00:18.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.183+0000 7f9bacff9640 1 -- 172.21.15.2:0/3001556091 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f9ba0042030 con 0x7f9bb0100a80 2024-09-19T05:00:18.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.184+0000 7f9bacff9640 1 --2- 172.21.15.2:0/3001556091 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f9b9c0a3430 0x7f9b9c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:00:18.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.184+0000 7f9ba67fc640 1 --2- 172.21.15.2:0/3001556091 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f9b9c0a3430 0x7f9b9c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:00:18.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.184+0000 7f9bacff9640 1 -- 172.21.15.2:0/3001556091 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8571+0+0 (secure 0 0 0) 0x7f9ba00effc0 con 0x7f9bb0100a80 2024-09-19T05:00:18.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.185+0000 7f9ba67fc640 1 --2- 172.21.15.2:0/3001556091 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f9b9c0a3430 0x7f9b9c0a58f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9bb01052f0 tx=0x7f9b98005f90 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:00:18.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.188+0000 7f9bacff9640 1 -- 172.21.15.2:0/3001556091 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9ba00bc320 con 0x7f9bb0100a80 2024-09-19T05:00:18.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.377+0000 7f9bb52fe640 1 -- 172.21.15.2:0/3001556091 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9bb0100ee0 con 0x7f9bb0100a80 2024-09-19T05:00:18.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.377+0000 7f9bacff9640 1 -- 172.21.15.2:0/3001556091 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 17 entries v92) ==== 81+0+985 (secure 0 0 0) 0x7f9ba00c0620 con 0x7f9bb0100a80 2024-09-19T05:00:18.379 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3848778984 2024-09-20T04:47:59.140869+0000 2024-09-19T05:00:18.379 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2044166064 2024-09-20T04:47:59.140869+0000 2024-09-19T05:00:18.379 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/1092443021 2024-09-20T04:47:59.140869+0000 2024-09-19T05:00:18.379 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2432243496 2024-09-20T04:39:11.086431+0000 2024-09-19T05:00:18.379 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/3782987318 2024-09-20T04:39:35.461329+0000 2024-09-19T05:00:18.379 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/1825825090 2024-09-20T04:39:11.086431+0000 2024-09-19T05:00:18.379 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/1825825090 2024-09-20T04:39:11.086431+0000 2024-09-19T05:00:18.379 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/3171525177 2024-09-20T04:47:59.140869+0000 2024-09-19T05:00:18.379 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3064319092 2024-09-20T04:39:11.086431+0000 2024-09-19T05:00:18.379 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/3782987318 2024-09-20T04:39:35.461329+0000 2024-09-19T05:00:18.380 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/256825166 2024-09-20T04:39:35.461329+0000 2024-09-19T05:00:18.380 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/1528097642 2024-09-20T04:39:11.086431+0000 2024-09-19T05:00:18.380 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2801870985 2024-09-20T04:39:35.461329+0000 2024-09-19T05:00:18.380 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/3171525177 2024-09-20T04:47:59.140869+0000 2024-09-19T05:00:18.380 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/4263572944 2024-09-20T04:47:59.140869+0000 2024-09-19T05:00:18.380 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/870383845 2024-09-20T04:39:35.461329+0000 2024-09-19T05:00:18.380 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3466359926 2024-09-20T04:47:59.140869+0000 2024-09-19T05:00:18.381 INFO:teuthology.orchestra.run.smithi002.stderr:listed 17 entries 2024-09-19T05:00:18.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.379+0000 7f9bb52fe640 1 -- 172.21.15.2:0/3001556091 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f9b9c0a3430 msgr2=0x7f9b9c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:00:18.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.379+0000 7f9bb52fe640 1 --2- 172.21.15.2:0/3001556091 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f9b9c0a3430 0x7f9b9c0a58f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9bb01052f0 tx=0x7f9b98005f90 comp rx=0 tx=0).stop 2024-09-19T05:00:18.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.379+0000 7f9bb52fe640 1 -- 172.21.15.2:0/3001556091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bb0100a80 msgr2=0x7f9bb0198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:00:18.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.379+0000 7f9bb52fe640 1 --2- 172.21.15.2:0/3001556091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bb0100a80 0x7f9bb0198380 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f9ba0005940 tx=0x7f9ba00040c0 comp rx=0 tx=0).stop 2024-09-19T05:00:18.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.379+0000 7f9bb52fe640 1 -- 172.21.15.2:0/3001556091 shutdown_connections 2024-09-19T05:00:18.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.379+0000 7f9bb52fe640 1 --2- 172.21.15.2:0/3001556091 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f9b9c0a3430 0x7f9b9c0a58f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:18.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.379+0000 7f9bb52fe640 1 --2- 172.21.15.2:0/3001556091 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9bb0106a80 0x7f9bb019cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:18.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.379+0000 7f9bb52fe640 1 --2- 172.21.15.2:0/3001556091 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9bb0101420 0x7f9bb01988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:18.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.379+0000 7f9bb52fe640 1 --2- 172.21.15.2:0/3001556091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bb0100a80 0x7f9bb0198380 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:18.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.379+0000 7f9bb52fe640 1 -- 172.21.15.2:0/3001556091 >> 172.21.15.2:0/3001556091 conn(0x7f9bb00fc7a0 msgr2=0x7f9bb006abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:00:18.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.379+0000 7f9bb52fe640 1 -- 172.21.15.2:0/3001556091 shutdown_connections 2024-09-19T05:00:18.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:18.379+0000 7f9bb52fe640 1 -- 172.21.15.2:0/3001556091 wait complete. 2024-09-19T05:00:18.750 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:18 smithi002 ceph-mon[30975]: pgmap v383: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-19T05:00:18.750 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:18 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:00:18.750 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:18 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:00:18.750 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:18 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T05:00:18.750 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:18 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/3001556091' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T05:00:18.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:18 smithi018 ceph-mon[34537]: pgmap v383: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-19T05:00:18.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:18 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:00:18.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:18 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:00:18.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:18 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T05:00:18.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:18 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/3001556091' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T05:00:18.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:18 smithi116 ceph-mon[34477]: pgmap v383: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-19T05:00:18.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:18 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:00:18.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:18 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:00:18.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:18 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' 2024-09-19T05:00:18.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:18 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/3001556091' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T05:00:19.066 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi002.front.sepia.ceph.com... 2024-09-19T05:00:19.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:00:19.066 DEBUG:teuthology.orchestra.run.smithi002:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-19T05:00:19.094 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:ceph-fuse[81449]: fuse finished with error 0 and tester_r 0 2024-09-19T05:00:19.096 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:00:20.806 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:20 smithi018 ceph-mon[34537]: pgmap v384: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-19T05:00:20.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:20 smithi018 ceph-mon[34537]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T05:00:20.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:20 smithi002 ceph-mon[30975]: pgmap v384: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-19T05:00:20.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:20 smithi002 ceph-mon[30975]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T05:00:20.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:20 smithi116 ceph-mon[34477]: pgmap v384: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-19T05:00:20.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:20 smithi116 ceph-mon[34477]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T05:00:22.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:22 smithi018 ceph-mon[34537]: pgmap v386: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-19T05:00:22.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:22 smithi002 ceph-mon[30975]: pgmap v386: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-19T05:00:22.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:22 smithi116 ceph-mon[34477]: pgmap v386: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-19T05:00:24.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:24 smithi018 ceph-mon[34537]: pgmap v387: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-19T05:00:24.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:24 smithi002 ceph-mon[30975]: pgmap v387: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-19T05:00:24.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:24 smithi116 ceph-mon[34477]: pgmap v387: 97 pgs: 97 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-19T05:00:25.198 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2024-09-19T05:00:25.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:00:25.198 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T05:00:25.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:00:25.233 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-09-19T05:00:25.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T05:00:25.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:00:25.293 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:00:25.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:00:25.364 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link delete ceph-brx 2024-09-19T05:00:25.476 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-19T05:00:25.488 INFO:tasks.cephadm:Teardown begin 2024-09-19T05:00:25.488 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T05:00:25.488 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:00:25.749 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:00:26.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.231+0000 7f41783bf640 1 -- 172.21.15.2:0/133145368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41701002f0 msgr2=0x7f41701006d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:00:26.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.231+0000 7f41783bf640 1 --2- 172.21.15.2:0/133145368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41701002f0 0x7f41701006d0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f416c009930 tx=0x7f416c02a420 comp rx=0 tx=0).stop 2024-09-19T05:00:26.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.231+0000 7f41783bf640 1 -- 172.21.15.2:0/133145368 shutdown_connections 2024-09-19T05:00:26.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.231+0000 7f41783bf640 1 --2- 172.21.15.2:0/133145368 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4170106f50 0x7f417010eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:26.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.231+0000 7f41783bf640 1 --2- 172.21.15.2:0/133145368 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4170100ca0 0x7f4170106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:26.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.231+0000 7f41783bf640 1 --2- 172.21.15.2:0/133145368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41701002f0 0x7f41701006d0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:26.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.231+0000 7f41783bf640 1 -- 172.21.15.2:0/133145368 >> 172.21.15.2:0/133145368 conn(0x7f4170077210 msgr2=0x7f41700fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:00:26.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.231+0000 7f41783bf640 1 -- 172.21.15.2:0/133145368 shutdown_connections 2024-09-19T05:00:26.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.231+0000 7f41783bf640 1 -- 172.21.15.2:0/133145368 wait complete. 2024-09-19T05:00:26.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.232+0000 7f41783bf640 1 Processor -- start 2024-09-19T05:00:26.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.232+0000 7f41783bf640 1 -- start start 2024-09-19T05:00:26.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.232+0000 7f41783bf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41701002f0 0x7f4170198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:00:26.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.232+0000 7f41783bf640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4170100ca0 0x7f4170198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:00:26.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.232+0000 7f41783bf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4170106f50 0x7f417019ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:00:26.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.232+0000 7f41783bf640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4170111f30 con 0x7f4170106f50 2024-09-19T05:00:26.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.232+0000 7f41783bf640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4170111db0 con 0x7f41701002f0 2024-09-19T05:00:26.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.232+0000 7f41783bf640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f41701120b0 con 0x7f4170100ca0 2024-09-19T05:00:26.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.232+0000 7f417695c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4170106f50 0x7f417019ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:00:26.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.232+0000 7f417695c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4170106f50 0x7f417019ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53484/0 (socket says 172.21.15.2:53484) 2024-09-19T05:00:26.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.232+0000 7f417695c640 1 -- 172.21.15.2:0/1950751934 learned_addr learned my addr 172.21.15.2:0/1950751934 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T05:00:26.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.233+0000 7f417595a640 1 --2- 172.21.15.2:0/1950751934 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4170100ca0 0x7f4170198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:00:26.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.233+0000 7f417615b640 1 --2- 172.21.15.2:0/1950751934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41701002f0 0x7f4170198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:00:26.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.233+0000 7f417695c640 1 -- 172.21.15.2:0/1950751934 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4170100ca0 msgr2=0x7f4170198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:00:26.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.233+0000 7f417695c640 1 --2- 172.21.15.2:0/1950751934 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4170100ca0 0x7f4170198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:26.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.233+0000 7f417695c640 1 -- 172.21.15.2:0/1950751934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41701002f0 msgr2=0x7f4170198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:00:26.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.233+0000 7f417695c640 1 --2- 172.21.15.2:0/1950751934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41701002f0 0x7f4170198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:26.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.233+0000 7f417695c640 1 -- 172.21.15.2:0/1950751934 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f417019d500 con 0x7f4170106f50 2024-09-19T05:00:26.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.233+0000 7f417595a640 1 --2- 172.21.15.2:0/1950751934 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4170100ca0 0x7f4170198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:00:26.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.233+0000 7f417695c640 1 --2- 172.21.15.2:0/1950751934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4170106f50 0x7f417019ce20 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f416800b970 tx=0x7f416800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:00:26.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.233+0000 7f41637fe640 1 -- 172.21.15.2:0/1950751934 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4168019070 con 0x7f4170106f50 2024-09-19T05:00:26.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.233+0000 7f41637fe640 1 -- 172.21.15.2:0/1950751934 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4168014440 con 0x7f4170106f50 2024-09-19T05:00:26.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.233+0000 7f41783bf640 1 -- 172.21.15.2:0/1950751934 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f417019d7f0 con 0x7f4170106f50 2024-09-19T05:00:26.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.233+0000 7f41637fe640 1 -- 172.21.15.2:0/1950751934 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41680075d0 con 0x7f4170106f50 2024-09-19T05:00:26.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.233+0000 7f41783bf640 1 -- 172.21.15.2:0/1950751934 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41701a50d0 con 0x7f4170106f50 2024-09-19T05:00:26.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.234+0000 7f41783bf640 1 -- 172.21.15.2:0/1950751934 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4170100750 con 0x7f4170106f50 2024-09-19T05:00:26.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.235+0000 7f41637fe640 1 -- 172.21.15.2:0/1950751934 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f416801c070 con 0x7f4170106f50 2024-09-19T05:00:26.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.236+0000 7f41637fe640 1 --2- 172.21.15.2:0/1950751934 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f415c0a33b0 0x7f415c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:00:26.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.236+0000 7f41637fe640 1 -- 172.21.15.2:0/1950751934 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8527+0+0 (secure 0 0 0) 0x7f41680cf2f0 con 0x7f4170106f50 2024-09-19T05:00:26.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.236+0000 7f417615b640 1 --2- 172.21.15.2:0/1950751934 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f415c0a33b0 0x7f415c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:00:26.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.237+0000 7f417615b640 1 --2- 172.21.15.2:0/1950751934 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f415c0a33b0 0x7f415c0a5870 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f416c000c00 tx=0x7f416c031400 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:00:26.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.240+0000 7f41637fe640 1 -- 172.21.15.2:0/1950751934 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f416809bd80 con 0x7f4170106f50 2024-09-19T05:00:26.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.455+0000 7f41783bf640 1 -- 172.21.15.2:0/1950751934 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f417002d7c0 con 0x7f4170106f50 2024-09-19T05:00:26.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.456+0000 7f41637fe640 1 -- 172.21.15.2:0/1950751934 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11840 (secure 0 0 0) 0x7f416809b680 con 0x7f4170106f50 2024-09-19T05:00:26.458 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T05:00:26.458 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":19,"btime":"2024-09-19T04:46:33:537239+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2467365137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2467365137},{"type":"v1","addr":"172.21.15.2:6835","nonce":2467365137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3162441888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3162441888},{"type":"v1","addr":"172.21.15.2:6837","nonce":3162441888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14631,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2740862966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2740862966},{"type":"v1","addr":"172.21.15.2:6839","nonce":2740862966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/2394435504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2394435504},{"type":"v1","addr":"172.21.15.2:6841","nonce":2394435504}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1630480244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1630480244},{"type":"v1","addr":"172.21.15.18:6833","nonce":1630480244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1553897465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1553897465},{"type":"v1","addr":"172.21.15.116:6833","nonce":1553897465}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3035664608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3035664608},{"type":"v1","addr":"172.21.15.18:6835","nonce":3035664608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1096622392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1096622392},{"type":"v1","addr":"172.21.15.18:6837","nonce":1096622392}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3761157675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3761157675},{"type":"v1","addr":"172.21.15.116:6835","nonce":3761157675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/1120131594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1120131594},{"type":"v1","addr":"172.21.15.116:6837","nonce":1120131594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:46:24.050115+0000","modified":"2024-09-19T04:46:33.112369+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/4207677139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":4207677139},{"type":"v1","addr":"172.21.15.18:6839","nonce":4207677139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/2346874880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":2346874880},{"type":"v1","addr":"172.21.15.116:6839","nonce":2346874880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496]},"id":1}]} 2024-09-19T05:00:26.458 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 19 2024-09-19T05:00:26.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.458+0000 7f41783bf640 1 -- 172.21.15.2:0/1950751934 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f415c0a33b0 msgr2=0x7f415c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:00:26.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.458+0000 7f41783bf640 1 --2- 172.21.15.2:0/1950751934 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f415c0a33b0 0x7f415c0a5870 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f416c000c00 tx=0x7f416c031400 comp rx=0 tx=0).stop 2024-09-19T05:00:26.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.458+0000 7f41783bf640 1 -- 172.21.15.2:0/1950751934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4170106f50 msgr2=0x7f417019ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:00:26.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.458+0000 7f41783bf640 1 --2- 172.21.15.2:0/1950751934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4170106f50 0x7f417019ce20 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f416800b970 tx=0x7f416800be30 comp rx=0 tx=0).stop 2024-09-19T05:00:26.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.459+0000 7f41783bf640 1 -- 172.21.15.2:0/1950751934 shutdown_connections 2024-09-19T05:00:26.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.459+0000 7f41783bf640 1 --2- 172.21.15.2:0/1950751934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4170106f50 0x7f417019ce20 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:26.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.459+0000 7f41783bf640 1 --2- 172.21.15.2:0/1950751934 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f415c0a33b0 0x7f415c0a5870 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:26.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.459+0000 7f41783bf640 1 --2- 172.21.15.2:0/1950751934 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4170100ca0 0x7f4170198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:26.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.459+0000 7f41783bf640 1 --2- 172.21.15.2:0/1950751934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41701002f0 0x7f4170198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:26.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.459+0000 7f41783bf640 1 -- 172.21.15.2:0/1950751934 >> 172.21.15.2:0/1950751934 conn(0x7f4170077210 msgr2=0x7f4170105420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:00:26.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.459+0000 7f41783bf640 1 -- 172.21.15.2:0/1950751934 shutdown_connections 2024-09-19T05:00:26.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:26.459+0000 7f41783bf640 1 -- 172.21.15.2:0/1950751934 wait complete. 2024-09-19T05:00:26.776 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:26 smithi002 ceph-mon[30975]: pgmap v388: 97 pgs: 97 active+clean; 24 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 409 B/s wr, 2 op/s 2024-09-19T05:00:26.776 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:26 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/1950751934' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:00:26.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:26 smithi018 ceph-mon[34537]: pgmap v388: 97 pgs: 97 active+clean; 24 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 409 B/s wr, 2 op/s 2024-09-19T05:00:26.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:26 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/1950751934' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:00:26.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:26 smithi116 ceph-mon[34477]: pgmap v388: 97 pgs: 97 active+clean; 24 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 409 B/s wr, 2 op/s 2024-09-19T05:00:26.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:26 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/1950751934' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:00:27.084 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:00:27.349 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:00:27.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:27.831+0000 7fc6a458c640 1 -- 172.21.15.2:0/614751910 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc69c100e20 msgr2=0x7fc69c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:00:27.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:27.831+0000 7fc6a458c640 1 --2- 172.21.15.2:0/614751910 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc69c100e20 0x7fc69c101200 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fc698009900 tx=0x7fc69802a480 comp rx=0 tx=0).stop 2024-09-19T05:00:27.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:27.832+0000 7fc6a458c640 1 -- 172.21.15.2:0/614751910 shutdown_connections 2024-09-19T05:00:27.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:27.832+0000 7fc6a458c640 1 --2- 172.21.15.2:0/614751910 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc69c102ef0 0x7fc69c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:27.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:27.832+0000 7fc6a458c640 1 --2- 172.21.15.2:0/614751910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc69c102570 0x7fc69c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:27.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:27.832+0000 7fc6a458c640 1 --2- 172.21.15.2:0/614751910 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc69c100e20 0x7fc69c101200 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:27.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:27.832+0000 7fc6a458c640 1 -- 172.21.15.2:0/614751910 >> 172.21.15.2:0/614751910 conn(0x7fc69c0fc7d0 msgr2=0x7fc69c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:00:27.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:27.832+0000 7fc6a458c640 1 -- 172.21.15.2:0/614751910 shutdown_connections 2024-09-19T05:00:27.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:27.832+0000 7fc6a458c640 1 -- 172.21.15.2:0/614751910 wait complete. 2024-09-19T05:00:27.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:27.832+0000 7fc6a458c640 1 Processor -- start 2024-09-19T05:00:27.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:27.832+0000 7fc6a458c640 1 -- start start 2024-09-19T05:00:27.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:27.833+0000 7fc6a458c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc69c100e20 0x7fc69c198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:00:27.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:27.833+0000 7fc6a458c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc69c102570 0x7fc69c198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:00:27.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:27.833+0000 7fc6a458c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc69c102ef0 0x7fc69c19cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:00:27.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:27.833+0000 7fc6a458c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc69c110e00 con 0x7fc69c102570 2024-09-19T05:00:27.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:27.833+0000 7fc6a458c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc69c110c80 con 0x7fc69c100e20 2024-09-19T05:00:27.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:27.833+0000 7fc6a458c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fc69c110f80 con 0x7fc69c102ef0 2024-09-19T05:00:27.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:27.833+0000 7fc6a1b27640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc69c102570 0x7fc69c198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:00:27.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:27.833+0000 7fc6a1b27640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc69c102570 0x7fc69c198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53506/0 (socket says 172.21.15.2:53506) 2024-09-19T05:00:27.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:27.833+0000 7fc6a1b27640 1 -- 172.21.15.2:0/2727211356 learned_addr learned my addr 172.21.15.2:0/2727211356 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T05:00:27.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:27.833+0000 7fc6a2328640 1 --2- 172.21.15.2:0/2727211356 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc69c100e20 0x7fc69c198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:00:27.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:27.833+0000 7fc6a2b29640 1 --2- 172.21.15.2:0/2727211356 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc69c102ef0 0x7fc69c19cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:00:27.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:27.833+0000 7fc6a1b27640 1 -- 172.21.15.2:0/2727211356 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc69c102ef0 msgr2=0x7fc69c19cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:00:27.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:27.833+0000 7fc6a1b27640 1 --2- 172.21.15.2:0/2727211356 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc69c102ef0 0x7fc69c19cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:27.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:27.833+0000 7fc6a1b27640 1 -- 172.21.15.2:0/2727211356 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc69c100e20 msgr2=0x7fc69c198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:00:27.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:27.833+0000 7fc6a1b27640 1 --2- 172.21.15.2:0/2727211356 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc69c100e20 0x7fc69c198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:27.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:27.833+0000 7fc6a1b27640 1 -- 172.21.15.2:0/2727211356 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc69c19d3c0 con 0x7fc69c102570 2024-09-19T05:00:27.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:27.833+0000 7fc6a2b29640 1 --2- 172.21.15.2:0/2727211356 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc69c102ef0 0x7fc69c19cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:00:27.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:27.833+0000 7fc6a1b27640 1 --2- 172.21.15.2:0/2727211356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc69c102570 0x7fc69c198950 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fc68c00c920 tx=0x7fc68c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:00:27.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:27.834+0000 7fc6937fe640 1 -- 172.21.15.2:0/2727211356 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68c007c70 con 0x7fc69c102570 2024-09-19T05:00:27.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:27.834+0000 7fc6a458c640 1 -- 172.21.15.2:0/2727211356 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc69c19d6b0 con 0x7fc69c102570 2024-09-19T05:00:27.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:27.834+0000 7fc6937fe640 1 -- 172.21.15.2:0/2727211356 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc68c007e10 con 0x7fc69c102570 2024-09-19T05:00:27.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:27.834+0000 7fc6937fe640 1 -- 172.21.15.2:0/2727211356 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68c018820 con 0x7fc69c102570 2024-09-19T05:00:27.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:27.834+0000 7fc6a458c640 1 -- 172.21.15.2:0/2727211356 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc69c1a4f90 con 0x7fc69c102570 2024-09-19T05:00:27.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:27.835+0000 7fc6a458c640 1 -- 172.21.15.2:0/2727211356 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc69c101200 con 0x7fc69c102570 2024-09-19T05:00:27.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:27.836+0000 7fc6937fe640 1 -- 172.21.15.2:0/2727211356 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fc68c0189c0 con 0x7fc69c102570 2024-09-19T05:00:27.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:27.837+0000 7fc6937fe640 1 --2- 172.21.15.2:0/2727211356 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fc6880a33b0 0x7fc6880a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:00:27.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:27.837+0000 7fc6937fe640 1 -- 172.21.15.2:0/2727211356 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8527+0+0 (secure 0 0 0) 0x7fc68c0cfeb0 con 0x7fc69c102570 2024-09-19T05:00:27.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:27.837+0000 7fc6a2328640 1 --2- 172.21.15.2:0/2727211356 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fc6880a33b0 0x7fc6880a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:00:27.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:27.838+0000 7fc6a2328640 1 --2- 172.21.15.2:0/2727211356 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fc6880a33b0 0x7fc6880a5870 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc698009230 tx=0x7fc6980058d0 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:00:27.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:27.841+0000 7fc6937fe640 1 -- 172.21.15.2:0/2727211356 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc68c014030 con 0x7fc69c102570 2024-09-19T05:00:28.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:28.083+0000 7fc6a458c640 1 -- 172.21.15.2:0/2727211356 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc69c10a0a0 con 0x7fc69c102570 2024-09-19T05:00:28.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:28.084+0000 7fc6937fe640 1 -- 172.21.15.2:0/2727211356 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11840 (secure 0 0 0) 0x7fc68c09c830 con 0x7fc69c102570 2024-09-19T05:00:28.085 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T05:00:28.086 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 19 2024-09-19T05:00:28.086 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":19,"btime":"2024-09-19T04:46:33:537239+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14565,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2467365137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2467365137},{"type":"v1","addr":"172.21.15.2:6835","nonce":2467365137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14577,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3162441888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3162441888},{"type":"v1","addr":"172.21.15.2:6837","nonce":3162441888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14631,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/2740862966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":2740862966},{"type":"v1","addr":"172.21.15.2:6839","nonce":2740862966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/2394435504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":2394435504},{"type":"v1","addr":"172.21.15.2:6841","nonce":2394435504}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24413,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1630480244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1630480244},{"type":"v1","addr":"172.21.15.18:6833","nonce":1630480244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1553897465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1553897465},{"type":"v1","addr":"172.21.15.116:6833","nonce":1553897465}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3035664608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3035664608},{"type":"v1","addr":"172.21.15.18:6835","nonce":3035664608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1096622392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1096622392},{"type":"v1","addr":"172.21.15.18:6837","nonce":1096622392}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3761157675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3761157675},{"type":"v1","addr":"172.21.15.116:6835","nonce":3761157675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/1120131594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1120131594},{"type":"v1","addr":"172.21.15.116:6837","nonce":1120131594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:46:24.050115+0000","modified":"2024-09-19T04:46:33.112369+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6839/4207677139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":4207677139},{"type":"v1","addr":"172.21.15.18:6839","nonce":4207677139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/2346874880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":2346874880},{"type":"v1","addr":"172.21.15.116:6839","nonce":2346874880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496]},"id":1}]} 2024-09-19T05:00:28.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:28.086+0000 7fc6a458c640 1 -- 172.21.15.2:0/2727211356 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fc6880a33b0 msgr2=0x7fc6880a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:00:28.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:28.086+0000 7fc6a458c640 1 --2- 172.21.15.2:0/2727211356 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fc6880a33b0 0x7fc6880a5870 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc698009230 tx=0x7fc6980058d0 comp rx=0 tx=0).stop 2024-09-19T05:00:28.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:28.086+0000 7fc6a458c640 1 -- 172.21.15.2:0/2727211356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc69c102570 msgr2=0x7fc69c198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:00:28.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:28.086+0000 7fc6a458c640 1 --2- 172.21.15.2:0/2727211356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc69c102570 0x7fc69c198950 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fc68c00c920 tx=0x7fc68c00cde0 comp rx=0 tx=0).stop 2024-09-19T05:00:28.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:28.086+0000 7fc6a458c640 1 -- 172.21.15.2:0/2727211356 shutdown_connections 2024-09-19T05:00:28.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:28.086+0000 7fc6a458c640 1 --2- 172.21.15.2:0/2727211356 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fc6880a33b0 0x7fc6880a5870 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:28.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:28.086+0000 7fc6a458c640 1 --2- 172.21.15.2:0/2727211356 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc69c102ef0 0x7fc69c19cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:28.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:28.086+0000 7fc6a458c640 1 --2- 172.21.15.2:0/2727211356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc69c102570 0x7fc69c198950 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:28.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:28.086+0000 7fc6a458c640 1 --2- 172.21.15.2:0/2727211356 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc69c100e20 0x7fc69c198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:28.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:28.086+0000 7fc6a458c640 1 -- 172.21.15.2:0/2727211356 >> 172.21.15.2:0/2727211356 conn(0x7fc69c0fc7d0 msgr2=0x7fc69c06a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:00:28.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:28.086+0000 7fc6a458c640 1 -- 172.21.15.2:0/2727211356 shutdown_connections 2024-09-19T05:00:28.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:28.086+0000 7fc6a458c640 1 -- 172.21.15.2:0/2727211356 wait complete. 2024-09-19T05:00:28.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:28 smithi002 ceph-mon[30975]: pgmap v389: 97 pgs: 97 active+clean; 24 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 409 B/s wr, 2 op/s 2024-09-19T05:00:28.744 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:28 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/2727211356' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:00:28.774 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T05:00:28.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:28 smithi018 ceph-mon[34537]: pgmap v389: 97 pgs: 97 active+clean; 24 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 409 B/s wr, 2 op/s 2024-09-19T05:00:28.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:28 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/2727211356' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:00:28.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:28 smithi116 ceph-mon[34477]: pgmap v389: 97 pgs: 97 active+clean; 24 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 409 B/s wr, 2 op/s 2024-09-19T05:00:28.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:28 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/2727211356' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:00:29.032 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:00:29.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.530+0000 7f1027fe9640 1 -- 172.21.15.2:0/3618081983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1020102790 msgr2=0x7f10201067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:00:29.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.530+0000 7f1027fe9640 1 --2- 172.21.15.2:0/3618081983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1020102790 0x7f10201067e0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f1010009900 tx=0x7f101002a410 comp rx=0 tx=0).stop 2024-09-19T05:00:29.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.530+0000 7f1027fe9640 1 -- 172.21.15.2:0/3618081983 shutdown_connections 2024-09-19T05:00:29.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.530+0000 7f1027fe9640 1 --2- 172.21.15.2:0/3618081983 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1020106f10 0x7f102010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:29.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.530+0000 7f1027fe9640 1 --2- 172.21.15.2:0/3618081983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1020102790 0x7f10201067e0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:29.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.530+0000 7f1027fe9640 1 --2- 172.21.15.2:0/3618081983 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1020101de0 0x7f10201021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:29.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.530+0000 7f1027fe9640 1 -- 172.21.15.2:0/3618081983 >> 172.21.15.2:0/3618081983 conn(0x7f10200fd8c0 msgr2=0x7f10200ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:00:29.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.530+0000 7f1027fe9640 1 -- 172.21.15.2:0/3618081983 shutdown_connections 2024-09-19T05:00:29.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.530+0000 7f1027fe9640 1 -- 172.21.15.2:0/3618081983 wait complete. 2024-09-19T05:00:29.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.531+0000 7f1027fe9640 1 Processor -- start 2024-09-19T05:00:29.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.531+0000 7f1027fe9640 1 -- start start 2024-09-19T05:00:29.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.531+0000 7f1027fe9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1020101de0 0x7f10200744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:00:29.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.531+0000 7f1027fe9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1020102790 0x7f1020074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:00:29.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.531+0000 7f1027fe9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1020106f10 0x7f1020074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:00:29.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.531+0000 7f1027fe9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1020111ec0 con 0x7f1020106f10 2024-09-19T05:00:29.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.531+0000 7f1027fe9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1020111d40 con 0x7f1020102790 2024-09-19T05:00:29.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.531+0000 7f1027fe9640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f1020112040 con 0x7f1020101de0 2024-09-19T05:00:29.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.531+0000 7f1026586640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1020106f10 0x7f1020074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:00:29.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.531+0000 7f1026586640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1020106f10 0x7f1020074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53526/0 (socket says 172.21.15.2:53526) 2024-09-19T05:00:29.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.531+0000 7f1026586640 1 -- 172.21.15.2:0/1010044127 learned_addr learned my addr 172.21.15.2:0/1010044127 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T05:00:29.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.531+0000 7f1025d85640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1020101de0 0x7f10200744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:00:29.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.531+0000 7f1025584640 1 --2- 172.21.15.2:0/1010044127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1020102790 0x7f1020074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:00:29.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.531+0000 7f1026586640 1 -- 172.21.15.2:0/1010044127 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1020101de0 msgr2=0x7f10200744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:00:29.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.531+0000 7f1026586640 1 --2- 172.21.15.2:0/1010044127 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1020101de0 0x7f10200744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:29.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.531+0000 7f1026586640 1 -- 172.21.15.2:0/1010044127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1020102790 msgr2=0x7f1020074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:00:29.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.531+0000 7f1026586640 1 --2- 172.21.15.2:0/1010044127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1020102790 0x7f1020074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:29.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.531+0000 7f1026586640 1 -- 172.21.15.2:0/1010044127 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10201a69e0 con 0x7f1020106f10 2024-09-19T05:00:29.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.531+0000 7f1025d85640 1 --2- 172.21.15.2:0/1010044127 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1020101de0 0x7f10200744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:00:29.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.532+0000 7f1026586640 1 --2- 172.21.15.2:0/1010044127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1020106f10 0x7f1020074f70 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f101800b970 tx=0x7f101800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:00:29.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.532+0000 7f1016ffd640 1 -- 172.21.15.2:0/1010044127 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1018019070 con 0x7f1020106f10 2024-09-19T05:00:29.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.532+0000 7f1016ffd640 1 -- 172.21.15.2:0/1010044127 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1018014440 con 0x7f1020106f10 2024-09-19T05:00:29.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.532+0000 7f1027fe9640 1 -- 172.21.15.2:0/1010044127 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10201a6cd0 con 0x7f1020106f10 2024-09-19T05:00:29.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.532+0000 7f1016ffd640 1 -- 172.21.15.2:0/1010044127 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10180075d0 con 0x7f1020106f10 2024-09-19T05:00:29.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.532+0000 7f1027fe9640 1 -- 172.21.15.2:0/1010044127 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10201a7190 con 0x7f1020106f10 2024-09-19T05:00:29.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.533+0000 7f1027fe9640 1 -- 172.21.15.2:0/1010044127 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10201032c0 con 0x7f1020106f10 2024-09-19T05:00:29.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.534+0000 7f1016ffd640 1 -- 172.21.15.2:0/1010044127 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f101801c070 con 0x7f1020106f10 2024-09-19T05:00:29.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.535+0000 7f1016ffd640 1 --2- 172.21.15.2:0/1010044127 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f100c0a33b0 0x7f100c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:00:29.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.535+0000 7f1016ffd640 1 -- 172.21.15.2:0/1010044127 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8527+0+0 (secure 0 0 0) 0x7f10180cf160 con 0x7f1020106f10 2024-09-19T05:00:29.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.535+0000 7f1025d85640 1 --2- 172.21.15.2:0/1010044127 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f100c0a33b0 0x7f100c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:00:29.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.536+0000 7f1025d85640 1 --2- 172.21.15.2:0/1010044127 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f100c0a33b0 0x7f100c0a5870 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f101c009d60 tx=0x7f101c009110 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:00:29.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.539+0000 7f1016ffd640 1 -- 172.21.15.2:0/1010044127 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f101809b5a0 con 0x7f1020106f10 2024-09-19T05:00:29.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.716+0000 7f1027fe9640 1 -- 172.21.15.2:0/1010044127 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f102002d7c0 con 0x7f1020106f10 2024-09-19T05:00:29.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.718+0000 7f1016ffd640 1 -- 172.21.15.2:0/1010044127 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+23013 (secure 0 0 0) 0x7f101809f8a0 con 0x7f1020106f10 2024-09-19T05:00:29.720 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T05:00:29.720 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":93,"fsid":"d46630c4-7640-11ef-bceb-c7b262605968","created":"2024-09-19T04:38:39.698488+0000","modified":"2024-09-19T05:00:20.243178+0000","last_up_change":"2024-09-19T04:45:33.839647+0000","last_in_change":"2024-09-19T04:45:09.816808+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T04:41:51.960734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T04:46:20.031485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T04:46:22.484767+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":19,"snap_epoch":92,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7a7dc9b9-8d5d-4dd3-93a3-0d5efced07d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":611702745},{"type":"v1","addr":"172.21.15.2:6803","nonce":611702745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":611702745},{"type":"v1","addr":"172.21.15.2:6805","nonce":611702745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":611702745},{"type":"v1","addr":"172.21.15.2:6809","nonce":611702745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":611702745},{"type":"v1","addr":"172.21.15.2:6807","nonce":611702745}]},"public_addr":"172.21.15.2:6803/611702745","cluster_addr":"172.21.15.2:6805/611702745","heartbeat_back_addr":"172.21.15.2:6809/611702745","heartbeat_front_addr":"172.21.15.2:6807/611702745","state":["exists","up"]},{"osd":1,"uuid":"bea40dec-7d9c-497f-bf16-4bf6d3b839f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":58390709},{"type":"v1","addr":"172.21.15.18:6801","nonce":58390709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":58390709},{"type":"v1","addr":"172.21.15.18:6803","nonce":58390709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":58390709},{"type":"v1","addr":"172.21.15.18:6807","nonce":58390709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":58390709},{"type":"v1","addr":"172.21.15.18:6805","nonce":58390709}]},"public_addr":"172.21.15.18:6801/58390709","cluster_addr":"172.21.15.18:6803/58390709","heartbeat_back_addr":"172.21.15.18:6807/58390709","heartbeat_front_addr":"172.21.15.18:6805/58390709","state":["exists","up"]},{"osd":2,"uuid":"97716304-a31e-48c9-83de-84eed10a7a4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":627735759},{"type":"v1","addr":"172.21.15.116:6801","nonce":627735759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":627735759},{"type":"v1","addr":"172.21.15.116:6803","nonce":627735759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":627735759},{"type":"v1","addr":"172.21.15.116:6807","nonce":627735759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":627735759},{"type":"v1","addr":"172.21.15.116:6805","nonce":627735759}]},"public_addr":"172.21.15.116:6801/627735759","cluster_addr":"172.21.15.116:6803/627735759","heartbeat_back_addr":"172.21.15.116:6807/627735759","heartbeat_front_addr":"172.21.15.116:6805/627735759","state":["exists","up"]},{"osd":3,"uuid":"8d79514e-16cf-4bd0-a2eb-e9148b91183d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1936071687},{"type":"v1","addr":"172.21.15.2:6811","nonce":1936071687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1936071687},{"type":"v1","addr":"172.21.15.2:6813","nonce":1936071687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1936071687},{"type":"v1","addr":"172.21.15.2:6817","nonce":1936071687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1936071687},{"type":"v1","addr":"172.21.15.2:6815","nonce":1936071687}]},"public_addr":"172.21.15.2:6811/1936071687","cluster_addr":"172.21.15.2:6813/1936071687","heartbeat_back_addr":"172.21.15.2:6817/1936071687","heartbeat_front_addr":"172.21.15.2:6815/1936071687","state":["exists","up"]},{"osd":4,"uuid":"5136f03c-94a3-42a0-9bfc-020397836037","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1333533784},{"type":"v1","addr":"172.21.15.18:6809","nonce":1333533784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1333533784},{"type":"v1","addr":"172.21.15.18:6811","nonce":1333533784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1333533784},{"type":"v1","addr":"172.21.15.18:6815","nonce":1333533784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1333533784},{"type":"v1","addr":"172.21.15.18:6813","nonce":1333533784}]},"public_addr":"172.21.15.18:6809/1333533784","cluster_addr":"172.21.15.18:6811/1333533784","heartbeat_back_addr":"172.21.15.18:6815/1333533784","heartbeat_front_addr":"172.21.15.18:6813/1333533784","state":["exists","up"]},{"osd":5,"uuid":"9d3384b0-f87d-4513-b151-4cca21c339b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":316360741},{"type":"v1","addr":"172.21.15.116:6809","nonce":316360741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":316360741},{"type":"v1","addr":"172.21.15.116:6811","nonce":316360741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":316360741},{"type":"v1","addr":"172.21.15.116:6815","nonce":316360741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":316360741},{"type":"v1","addr":"172.21.15.116:6813","nonce":316360741}]},"public_addr":"172.21.15.116:6809/316360741","cluster_addr":"172.21.15.116:6811/316360741","heartbeat_back_addr":"172.21.15.116:6815/316360741","heartbeat_front_addr":"172.21.15.116:6813/316360741","state":["exists","up"]},{"osd":6,"uuid":"e54f44b5-a693-4b31-83b2-2bcf10ab9a75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1185564560},{"type":"v1","addr":"172.21.15.2:6819","nonce":1185564560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1185564560},{"type":"v1","addr":"172.21.15.2:6821","nonce":1185564560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1185564560},{"type":"v1","addr":"172.21.15.2:6825","nonce":1185564560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":1185564560},{"type":"v1","addr":"172.21.15.2:6823","nonce":1185564560}]},"public_addr":"172.21.15.2:6819/1185564560","cluster_addr":"172.21.15.2:6821/1185564560","heartbeat_back_addr":"172.21.15.2:6825/1185564560","heartbeat_front_addr":"172.21.15.2:6823/1185564560","state":["exists","up"]},{"osd":7,"uuid":"96a444c3-429a-48b6-9823-95c9e171341a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3691801363},{"type":"v1","addr":"172.21.15.18:6817","nonce":3691801363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3691801363},{"type":"v1","addr":"172.21.15.18:6819","nonce":3691801363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3691801363},{"type":"v1","addr":"172.21.15.18:6823","nonce":3691801363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3691801363},{"type":"v1","addr":"172.21.15.18:6821","nonce":3691801363}]},"public_addr":"172.21.15.18:6817/3691801363","cluster_addr":"172.21.15.18:6819/3691801363","heartbeat_back_addr":"172.21.15.18:6823/3691801363","heartbeat_front_addr":"172.21.15.18:6821/3691801363","state":["exists","up"]},{"osd":8,"uuid":"c3f696aa-be7d-4f67-9147-3751406e394d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":3709586119},{"type":"v1","addr":"172.21.15.116:6817","nonce":3709586119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":3709586119},{"type":"v1","addr":"172.21.15.116:6819","nonce":3709586119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":3709586119},{"type":"v1","addr":"172.21.15.116:6823","nonce":3709586119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":3709586119},{"type":"v1","addr":"172.21.15.116:6821","nonce":3709586119}]},"public_addr":"172.21.15.116:6817/3709586119","cluster_addr":"172.21.15.116:6819/3709586119","heartbeat_back_addr":"172.21.15.116:6823/3709586119","heartbeat_front_addr":"172.21.15.116:6821/3709586119","state":["exists","up"]},{"osd":9,"uuid":"4892549d-f050-48c5-b695-5924b612a581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1054791011},{"type":"v1","addr":"172.21.15.2:6827","nonce":1054791011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1054791011},{"type":"v1","addr":"172.21.15.2:6829","nonce":1054791011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1054791011},{"type":"v1","addr":"172.21.15.2:6833","nonce":1054791011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":1054791011},{"type":"v1","addr":"172.21.15.2:6831","nonce":1054791011}]},"public_addr":"172.21.15.2:6827/1054791011","cluster_addr":"172.21.15.2:6829/1054791011","heartbeat_back_addr":"172.21.15.2:6833/1054791011","heartbeat_front_addr":"172.21.15.2:6831/1054791011","state":["exists","up"]},{"osd":10,"uuid":"12b60238-6a35-4d48-bacd-ee5ddd8fdb0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1958683776},{"type":"v1","addr":"172.21.15.18:6825","nonce":1958683776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":1958683776},{"type":"v1","addr":"172.21.15.18:6827","nonce":1958683776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":1958683776},{"type":"v1","addr":"172.21.15.18:6831","nonce":1958683776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":1958683776},{"type":"v1","addr":"172.21.15.18:6829","nonce":1958683776}]},"public_addr":"172.21.15.18:6825/1958683776","cluster_addr":"172.21.15.18:6827/1958683776","heartbeat_back_addr":"172.21.15.18:6831/1958683776","heartbeat_front_addr":"172.21.15.18:6829/1958683776","state":["exists","up"]},{"osd":11,"uuid":"99b3e553-b42c-4b2f-817f-3900ad8bd223","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3456789654},{"type":"v1","addr":"172.21.15.116:6825","nonce":3456789654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3456789654},{"type":"v1","addr":"172.21.15.116:6827","nonce":3456789654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3456789654},{"type":"v1","addr":"172.21.15.116:6831","nonce":3456789654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3456789654},{"type":"v1","addr":"172.21.15.116:6829","nonce":3456789654}]},"public_addr":"172.21.15.116:6825/3456789654","cluster_addr":"172.21.15.116:6827/3456789654","heartbeat_back_addr":"172.21.15.116:6831/3456789654","heartbeat_front_addr":"172.21.15.116:6829/3456789654","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:40:58.216702+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:41:22.852350+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:41:47.265084+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:42:12.785128+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:42:38.475008+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:43:02.924009+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:43:28.050646+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:43:52.715369+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:44:16.905066+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:44:42.071128+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:45:06.434525+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:45:31.569086+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":1}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/3848778984":"2024-09-20T04:47:59.140869+0000","172.21.15.2:0/2044166064":"2024-09-20T04:47:59.140869+0000","172.21.15.2:0/1092443021":"2024-09-20T04:47:59.140869+0000","172.21.15.2:0/2432243496":"2024-09-20T04:39:11.086431+0000","172.21.15.2:6800/3782987318":"2024-09-20T04:39:35.461329+0000","172.21.15.2:6801/1825825090":"2024-09-20T04:39:11.086431+0000","172.21.15.2:6800/1825825090":"2024-09-20T04:39:11.086431+0000","172.21.15.2:6800/3171525177":"2024-09-20T04:47:59.140869+0000","172.21.15.2:0/3064319092":"2024-09-20T04:39:11.086431+0000","172.21.15.2:6801/3782987318":"2024-09-20T04:39:35.461329+0000","172.21.15.2:0/256825166":"2024-09-20T04:39:35.461329+0000","172.21.15.2:0/1528097642":"2024-09-20T04:39:11.086431+0000","172.21.15.2:0/2801870985":"2024-09-20T04:39:35.461329+0000","172.21.15.2:6801/3171525177":"2024-09-20T04:47:59.140869+0000","172.21.15.2:0/4263572944":"2024-09-20T04:47:59.140869+0000","172.21.15.2:0/870383845":"2024-09-20T04:39:35.461329+0000","172.21.15.2:0/3466359926":"2024-09-20T04:47:59.140869+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":7,"length":1},{"begin":19,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:00:29.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.721+0000 7f1027fe9640 1 -- 172.21.15.2:0/1010044127 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f100c0a33b0 msgr2=0x7f100c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:00:29.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.721+0000 7f1027fe9640 1 --2- 172.21.15.2:0/1010044127 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f100c0a33b0 0x7f100c0a5870 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f101c009d60 tx=0x7f101c009110 comp rx=0 tx=0).stop 2024-09-19T05:00:29.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.721+0000 7f1027fe9640 1 -- 172.21.15.2:0/1010044127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1020106f10 msgr2=0x7f1020074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:00:29.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.721+0000 7f1027fe9640 1 --2- 172.21.15.2:0/1010044127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1020106f10 0x7f1020074f70 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f101800b970 tx=0x7f101800bd70 comp rx=0 tx=0).stop 2024-09-19T05:00:29.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.721+0000 7f1027fe9640 1 -- 172.21.15.2:0/1010044127 shutdown_connections 2024-09-19T05:00:29.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.721+0000 7f1027fe9640 1 --2- 172.21.15.2:0/1010044127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1020106f10 0x7f1020074f70 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:29.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.721+0000 7f1027fe9640 1 --2- 172.21.15.2:0/1010044127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1020102790 0x7f1020074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:29.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.721+0000 7f1027fe9640 1 --2- 172.21.15.2:0/1010044127 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f100c0a33b0 0x7f100c0a5870 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:29.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.721+0000 7f1027fe9640 1 --2- 172.21.15.2:0/1010044127 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1020101de0 0x7f10200744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:29.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.721+0000 7f1027fe9640 1 -- 172.21.15.2:0/1010044127 >> 172.21.15.2:0/1010044127 conn(0x7f10200fd8c0 msgr2=0x7f10200fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:00:29.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.721+0000 7f1027fe9640 1 -- 172.21.15.2:0/1010044127 shutdown_connections 2024-09-19T05:00:29.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:29.721+0000 7f1027fe9640 1 -- 172.21.15.2:0/1010044127 wait complete. 2024-09-19T05:00:30.410 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs fail cephfs 2024-09-19T05:00:30.670 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:00:30.792 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:30 smithi002 ceph-mon[30975]: pgmap v390: 97 pgs: 97 active+clean; 24 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 409 B/s wr, 2 op/s 2024-09-19T05:00:30.792 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:30 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/1010044127' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:00:30.806 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:30 smithi018 ceph-mon[34537]: pgmap v390: 97 pgs: 97 active+clean; 24 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 409 B/s wr, 2 op/s 2024-09-19T05:00:30.806 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:30 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/1010044127' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:00:30.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:30 smithi116 ceph-mon[34477]: pgmap v390: 97 pgs: 97 active+clean; 24 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 409 B/s wr, 2 op/s 2024-09-19T05:00:30.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:30 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/1010044127' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:00:31.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.214+0000 7f0ee943c640 1 -- 172.21.15.2:0/625966309 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ee4101de0 msgr2=0x7f0ee41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:00:31.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.214+0000 7f0ee943c640 1 --2- 172.21.15.2:0/625966309 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ee4101de0 0x7f0ee41021c0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4009900 tx=0x7f0ed402a410 comp rx=0 tx=0).stop 2024-09-19T05:00:31.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.214+0000 7f0ee943c640 1 -- 172.21.15.2:0/625966309 shutdown_connections 2024-09-19T05:00:31.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.214+0000 7f0ee943c640 1 --2- 172.21.15.2:0/625966309 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ee4106f10 0x7f0ee410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:31.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.214+0000 7f0ee943c640 1 --2- 172.21.15.2:0/625966309 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ee4102790 0x7f0ee41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:31.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.214+0000 7f0ee943c640 1 --2- 172.21.15.2:0/625966309 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ee4101de0 0x7f0ee41021c0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:31.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.214+0000 7f0ee943c640 1 -- 172.21.15.2:0/625966309 >> 172.21.15.2:0/625966309 conn(0x7f0ee40fd8c0 msgr2=0x7f0ee40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:00:31.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.214+0000 7f0ee943c640 1 -- 172.21.15.2:0/625966309 shutdown_connections 2024-09-19T05:00:31.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.214+0000 7f0ee943c640 1 -- 172.21.15.2:0/625966309 wait complete. 2024-09-19T05:00:31.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.215+0000 7f0ee943c640 1 Processor -- start 2024-09-19T05:00:31.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.215+0000 7f0ee943c640 1 -- start start 2024-09-19T05:00:31.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.215+0000 7f0ee943c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ee4101de0 0x7f0ee40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:00:31.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.215+0000 7f0ee943c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ee4102790 0x7f0ee4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:00:31.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.215+0000 7f0ee943c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ee4106f10 0x7f0ee4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:00:31.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.215+0000 7f0ee943c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee4111e20 con 0x7f0ee4106f10 2024-09-19T05:00:31.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.215+0000 7f0ee943c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee4111ca0 con 0x7f0ee4101de0 2024-09-19T05:00:31.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.215+0000 7f0ee943c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee4111fa0 con 0x7f0ee4102790 2024-09-19T05:00:31.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.216+0000 7f0ee37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ee4106f10 0x7f0ee4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:00:31.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.216+0000 7f0ee37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ee4106f10 0x7f0ee4074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53536/0 (socket says 172.21.15.2:53536) 2024-09-19T05:00:31.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.216+0000 7f0ee37fe640 1 -- 172.21.15.2:0/657008604 learned_addr learned my addr 172.21.15.2:0/657008604 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T05:00:31.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.216+0000 7f0ee2ffd640 1 --2- 172.21.15.2:0/657008604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ee4101de0 0x7f0ee40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:00:31.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.216+0000 7f0edbfff640 1 --2- 172.21.15.2:0/657008604 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ee4102790 0x7f0ee4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:00:31.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.216+0000 7f0ee37fe640 1 -- 172.21.15.2:0/657008604 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ee4102790 msgr2=0x7f0ee4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:00:31.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.216+0000 7f0ee37fe640 1 --2- 172.21.15.2:0/657008604 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ee4102790 0x7f0ee4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:31.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.216+0000 7f0ee37fe640 1 -- 172.21.15.2:0/657008604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ee4101de0 msgr2=0x7f0ee40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:00:31.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.216+0000 7f0ee37fe640 1 --2- 172.21.15.2:0/657008604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ee4101de0 0x7f0ee40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:31.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.216+0000 7f0ee37fe640 1 -- 172.21.15.2:0/657008604 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ee41a6840 con 0x7f0ee4106f10 2024-09-19T05:00:31.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.216+0000 7f0ee37fe640 1 --2- 172.21.15.2:0/657008604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ee4106f10 0x7f0ee4074f70 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f0edc00eaa0 tx=0x7f0edc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:00:31.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.216+0000 7f0ee0ff9640 1 -- 172.21.15.2:0/657008604 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0edc00cdb0 con 0x7f0ee4106f10 2024-09-19T05:00:31.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.216+0000 7f0ee0ff9640 1 -- 172.21.15.2:0/657008604 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0edc005020 con 0x7f0ee4106f10 2024-09-19T05:00:31.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.216+0000 7f0ee0ff9640 1 -- 172.21.15.2:0/657008604 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0edc0116d0 con 0x7f0ee4106f10 2024-09-19T05:00:31.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.216+0000 7f0ee943c640 1 -- 172.21.15.2:0/657008604 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ee41a6b30 con 0x7f0ee4106f10 2024-09-19T05:00:31.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.216+0000 7f0ee943c640 1 -- 172.21.15.2:0/657008604 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ee41a7070 con 0x7f0ee4106f10 2024-09-19T05:00:31.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.218+0000 7f0ee943c640 1 -- 172.21.15.2:0/657008604 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ee41021c0 con 0x7f0ee4106f10 2024-09-19T05:00:31.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.219+0000 7f0ee0ff9640 1 -- 172.21.15.2:0/657008604 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f0edc0051d0 con 0x7f0ee4106f10 2024-09-19T05:00:31.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.219+0000 7f0ee0ff9640 1 --2- 172.21.15.2:0/657008604 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f0ed00a3430 0x7f0ed00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:00:31.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.220+0000 7f0ee2ffd640 1 --2- 172.21.15.2:0/657008604 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f0ed00a3430 0x7f0ed00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:00:31.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.220+0000 7f0ee0ff9640 1 -- 172.21.15.2:0/657008604 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8527+0+0 (secure 0 0 0) 0x7f0edc0cfe10 con 0x7f0ee4106f10 2024-09-19T05:00:31.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.220+0000 7f0ee2ffd640 1 --2- 172.21.15.2:0/657008604 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f0ed00a3430 0x7f0ed00a58f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4031440 tx=0x7f0ed4005b50 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:00:31.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.224+0000 7f0ee0ff9640 1 -- 172.21.15.2:0/657008604 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0edc016030 con 0x7f0ee4106f10 2024-09-19T05:00:31.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.436+0000 7f0ee943c640 1 -- 172.21.15.2:0/657008604 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f0ee410a0f0 con 0x7f0ee4106f10 2024-09-19T05:00:31.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.439+0000 7f0ee0ff9640 1 -- 172.21.15.2:0/657008604 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v20) ==== 161+0+0 (secure 0 0 0) 0x7f0edc09c7f0 con 0x7f0ee4106f10 2024-09-19T05:00:31.441 INFO:teuthology.orchestra.run.smithi002.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T05:00:31.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.442+0000 7f0ee943c640 1 -- 172.21.15.2:0/657008604 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f0ed00a3430 msgr2=0x7f0ed00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:00:31.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.442+0000 7f0ee943c640 1 --2- 172.21.15.2:0/657008604 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f0ed00a3430 0x7f0ed00a58f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4031440 tx=0x7f0ed4005b50 comp rx=0 tx=0).stop 2024-09-19T05:00:31.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.442+0000 7f0ee943c640 1 -- 172.21.15.2:0/657008604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ee4106f10 msgr2=0x7f0ee4074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:00:31.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.442+0000 7f0ee943c640 1 --2- 172.21.15.2:0/657008604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ee4106f10 0x7f0ee4074f70 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f0edc00eaa0 tx=0x7f0edc00ef60 comp rx=0 tx=0).stop 2024-09-19T05:00:31.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.442+0000 7f0ee943c640 1 -- 172.21.15.2:0/657008604 shutdown_connections 2024-09-19T05:00:31.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.442+0000 7f0ee943c640 1 --2- 172.21.15.2:0/657008604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ee4106f10 0x7f0ee4074f70 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:31.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.442+0000 7f0ee943c640 1 --2- 172.21.15.2:0/657008604 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7f0ed00a3430 0x7f0ed00a58f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:31.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.442+0000 7f0ee943c640 1 --2- 172.21.15.2:0/657008604 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ee4102790 0x7f0ee4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:31.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.442+0000 7f0ee943c640 1 --2- 172.21.15.2:0/657008604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ee4101de0 0x7f0ee40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:31.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.442+0000 7f0ee943c640 1 -- 172.21.15.2:0/657008604 >> 172.21.15.2:0/657008604 conn(0x7f0ee40fd8c0 msgr2=0x7f0ee40fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:00:31.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.442+0000 7f0ee943c640 1 -- 172.21.15.2:0/657008604 shutdown_connections 2024-09-19T05:00:31.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:31.442+0000 7f0ee943c640 1 -- 172.21.15.2:0/657008604 wait complete. 2024-09-19T05:00:31.787 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:31 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mon-a[30971]: 2024-09-19T05:00:31.437+0000 7f5c9757d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T05:00:31.787 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:31 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/657008604' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T05:00:31.787 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:31 smithi002 ceph-mon[30975]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T05:00:31.788 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:31 smithi002 ceph-mon[30975]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T05:00:31.788 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:31 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/657008604' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T05:00:31.788 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:31 smithi002 ceph-mon[30975]: osdmap e94: 12 total, 12 up, 12 in 2024-09-19T05:00:31.788 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:31 smithi002 ceph-mon[30975]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-19T05:00:31.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:31 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/657008604' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T05:00:31.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:31 smithi018 ceph-mon[34537]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T05:00:31.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:31 smithi018 ceph-mon[34537]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T05:00:31.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:31 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/657008604' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T05:00:31.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:31 smithi018 ceph-mon[34537]: osdmap e94: 12 total, 12 up, 12 in 2024-09-19T05:00:31.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:31 smithi018 ceph-mon[34537]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-19T05:00:31.807 INFO:journalctl@ceph.mds.b.smithi018.stdout:Sep 19 05:00:31 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-b[64546]: ignoring --setuser ceph since I am not root 2024-09-19T05:00:31.807 INFO:journalctl@ceph.mds.b.smithi018.stdout:Sep 19 05:00:31 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-b[64546]: ignoring --setgroup ceph since I am not root 2024-09-19T05:00:31.808 INFO:journalctl@ceph.mds.b.smithi018.stdout:Sep 19 05:00:31 smithi018 ceph-mds[64550]: -- 172.21.15.18:0/1025207683 <== mon.2 v2:172.21.15.18:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5611262f5860 con 0x5611262d3400 2024-09-19T05:00:31.808 INFO:journalctl@ceph.mds.b.smithi018.stdout:Sep 19 05:00:31 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-b[64546]: starting mds.b at 2024-09-19T05:00:31.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:31 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/657008604' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T05:00:31.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:31 smithi116 ceph-mon[34477]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T05:00:31.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:31 smithi116 ceph-mon[34477]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T05:00:31.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:31 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/657008604' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T05:00:31.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:31 smithi116 ceph-mon[34477]: osdmap e94: 12 total, 12 up, 12 in 2024-09-19T05:00:31.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:31 smithi116 ceph-mon[34477]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-19T05:00:31.861 INFO:journalctl@ceph.mds.i.smithi116.stdout:Sep 19 05:00:31 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-i[64913]: ignoring --setuser ceph since I am not root 2024-09-19T05:00:31.861 INFO:journalctl@ceph.mds.i.smithi116.stdout:Sep 19 05:00:31 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-i[64913]: ignoring --setgroup ceph since I am not root 2024-09-19T05:00:31.861 INFO:journalctl@ceph.mds.i.smithi116.stdout:Sep 19 05:00:31 smithi116 ceph-mds[64917]: -- 172.21.15.116:0/2694346719 <== mon.1 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561758a8d860 con 0x561758a6b000 2024-09-19T05:00:31.861 INFO:journalctl@ceph.mds.i.smithi116.stdout:Sep 19 05:00:31 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-i[64913]: starting mds.i at 2024-09-19T05:00:32.115 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T05:00:32.370 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:00:32.756 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:32 smithi002 ceph-mon[30975]: pgmap v391: 97 pgs: 97 active+clean; 24 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 1011 B/s rd, 0 B/s wr, 2 op/s 2024-09-19T05:00:32.756 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:32 smithi002 ceph-mon[30975]: mds.? [v2:172.21.15.116:6838/914588382,v1:172.21.15.116:6839/914588382] up:boot 2024-09-19T05:00:32.756 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:32 smithi002 ceph-mon[30975]: mds.? [v2:172.21.15.18:6838/2927498088,v1:172.21.15.18:6839/2927498088] up:boot 2024-09-19T05:00:32.756 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:32 smithi002 ceph-mon[30975]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-19T05:00:32.756 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:32 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T05:00:32.756 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:32 smithi002 ceph-mon[30975]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T05:00:32.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:32 smithi018 ceph-mon[34537]: pgmap v391: 97 pgs: 97 active+clean; 24 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 1011 B/s rd, 0 B/s wr, 2 op/s 2024-09-19T05:00:32.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:32 smithi018 ceph-mon[34537]: mds.? [v2:172.21.15.116:6838/914588382,v1:172.21.15.116:6839/914588382] up:boot 2024-09-19T05:00:32.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:32 smithi018 ceph-mon[34537]: mds.? [v2:172.21.15.18:6838/2927498088,v1:172.21.15.18:6839/2927498088] up:boot 2024-09-19T05:00:32.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:32 smithi018 ceph-mon[34537]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-19T05:00:32.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:32 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T05:00:32.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:32 smithi018 ceph-mon[34537]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T05:00:32.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:32.838+0000 7fa048fc5640 1 -- 172.21.15.2:0/2837214496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa04410c170 msgr2=0x7fa04410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:00:32.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:32.838+0000 7fa048fc5640 1 --2- 172.21.15.2:0/2837214496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa04410c170 0x7fa04410e610 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fa03c009ca0 tx=0x7fa03c02a950 comp rx=0 tx=0).stop 2024-09-19T05:00:32.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:32.838+0000 7fa048fc5640 1 -- 172.21.15.2:0/2837214496 shutdown_connections 2024-09-19T05:00:32.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:32.838+0000 7fa048fc5640 1 --2- 172.21.15.2:0/2837214496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa04410c170 0x7fa04410e610 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:32.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:32.838+0000 7fa048fc5640 1 --2- 172.21.15.2:0/2837214496 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa044103660 0x7fa04410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:32.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:32.838+0000 7fa048fc5640 1 --2- 172.21.15.2:0/2837214496 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa044102d40 0x7fa044103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:32.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:32.838+0000 7fa048fc5640 1 -- 172.21.15.2:0/2837214496 >> 172.21.15.2:0/2837214496 conn(0x7fa0440fc7a0 msgr2=0x7fa0440febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:00:32.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:32.838+0000 7fa048fc5640 1 -- 172.21.15.2:0/2837214496 shutdown_connections 2024-09-19T05:00:32.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:32.838+0000 7fa048fc5640 1 -- 172.21.15.2:0/2837214496 wait complete. 2024-09-19T05:00:32.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:32.839+0000 7fa048fc5640 1 Processor -- start 2024-09-19T05:00:32.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:32.839+0000 7fa048fc5640 1 -- start start 2024-09-19T05:00:32.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:32.839+0000 7fa048fc5640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa044102d40 0x7fa0441983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:00:32.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:32.839+0000 7fa048fc5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa044103660 0x7fa044198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:00:32.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:32.839+0000 7fa048fc5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa04410c170 0x7fa04419cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:00:32.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:32.839+0000 7fa048fc5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa044111de0 con 0x7fa04410c170 2024-09-19T05:00:32.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:32.839+0000 7fa048fc5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa044111c60 con 0x7fa044103660 2024-09-19T05:00:32.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:32.839+0000 7fa048fc5640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa044111f60 con 0x7fa044102d40 2024-09-19T05:00:32.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:32.839+0000 7fa042d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa04410c170 0x7fa04419cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:00:32.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:32.839+0000 7fa042d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa04410c170 0x7fa04419cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56458/0 (socket says 172.21.15.2:56458) 2024-09-19T05:00:32.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:32.839+0000 7fa042d9d640 1 -- 172.21.15.2:0/2929334180 learned_addr learned my addr 172.21.15.2:0/2929334180 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T05:00:32.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:32.840+0000 7fa04259c640 1 --2- 172.21.15.2:0/2929334180 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa044102d40 0x7fa0441983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:00:32.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:32.840+0000 7fa039d9b640 1 --2- 172.21.15.2:0/2929334180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa044103660 0x7fa044198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:00:32.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:32.840+0000 7fa042d9d640 1 -- 172.21.15.2:0/2929334180 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa044102d40 msgr2=0x7fa0441983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:00:32.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:32.840+0000 7fa042d9d640 1 --2- 172.21.15.2:0/2929334180 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa044102d40 0x7fa0441983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:32.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:32.840+0000 7fa042d9d640 1 -- 172.21.15.2:0/2929334180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa044103660 msgr2=0x7fa044198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:00:32.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:32.840+0000 7fa042d9d640 1 --2- 172.21.15.2:0/2929334180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa044103660 0x7fa044198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:32.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:32.840+0000 7fa042d9d640 1 -- 172.21.15.2:0/2929334180 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa04419d370 con 0x7fa04410c170 2024-09-19T05:00:32.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:32.840+0000 7fa039d9b640 1 --2- 172.21.15.2:0/2929334180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa044103660 0x7fa044198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:00:32.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:32.840+0000 7fa042d9d640 1 --2- 172.21.15.2:0/2929334180 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa04410c170 0x7fa04419cc90 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fa03c02ae70 tx=0x7fa03c02f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:00:32.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:32.840+0000 7fa03bfff640 1 -- 172.21.15.2:0/2929334180 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa03c034040 con 0x7fa04410c170 2024-09-19T05:00:32.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:32.840+0000 7fa03bfff640 1 -- 172.21.15.2:0/2929334180 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa03c0308f0 con 0x7fa04410c170 2024-09-19T05:00:32.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:32.840+0000 7fa048fc5640 1 -- 172.21.15.2:0/2929334180 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa04419d600 con 0x7fa04410c170 2024-09-19T05:00:32.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:32.840+0000 7fa03bfff640 1 -- 172.21.15.2:0/2929334180 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa03c0047f0 con 0x7fa04410c170 2024-09-19T05:00:32.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:32.840+0000 7fa048fc5640 1 -- 172.21.15.2:0/2929334180 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0441a4f40 con 0x7fa04410c170 2024-09-19T05:00:32.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:32.841+0000 7fa048fc5640 1 -- 172.21.15.2:0/2929334180 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa044103120 con 0x7fa04410c170 2024-09-19T05:00:32.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:32.842+0000 7fa03bfff640 1 -- 172.21.15.2:0/2929334180 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fa03c037020 con 0x7fa04410c170 2024-09-19T05:00:32.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:32.843+0000 7fa03bfff640 1 --2- 172.21.15.2:0/2929334180 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fa0300a33b0 0x7fa0300a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:00:32.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:32.843+0000 7fa03bfff640 1 -- 172.21.15.2:0/2929334180 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8569+0+0 (secure 0 0 0) 0x7fa03c0f0c90 con 0x7fa04410c170 2024-09-19T05:00:32.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:32.843+0000 7fa04259c640 1 --2- 172.21.15.2:0/2929334180 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fa0300a33b0 0x7fa0300a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:00:32.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:32.844+0000 7fa04259c640 1 --2- 172.21.15.2:0/2929334180 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fa0300a33b0 0x7fa0300a5870 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa034005d00 tx=0x7fa03400b410 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:00:32.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:32.847+0000 7fa03bfff640 1 -- 172.21.15.2:0/2929334180 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa03c0bd6f0 con 0x7fa04410c170 2024-09-19T05:00:32.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:32 smithi116 ceph-mon[34477]: pgmap v391: 97 pgs: 97 active+clean; 24 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 1011 B/s rd, 0 B/s wr, 2 op/s 2024-09-19T05:00:32.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:32 smithi116 ceph-mon[34477]: mds.? [v2:172.21.15.116:6838/914588382,v1:172.21.15.116:6839/914588382] up:boot 2024-09-19T05:00:32.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:32 smithi116 ceph-mon[34477]: mds.? [v2:172.21.15.18:6838/2927498088,v1:172.21.15.18:6839/2927498088] up:boot 2024-09-19T05:00:32.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:32 smithi116 ceph-mon[34477]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-19T05:00:32.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:32 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T05:00:32.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:32 smithi116 ceph-mon[34477]: from='mgr.15096 172.21.15.2:0/4126678298' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T05:00:33.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:33.060+0000 7fa048fc5640 1 -- 172.21.15.2:0/2929334180 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fa044107210 con 0x7fa04410c170 2024-09-19T05:00:33.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:33.531+0000 7fa03bfff640 1 -- 172.21.15.2:0/2929334180 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v22) ==== 104+0+0 (secure 0 0 0) 0x7fa03c0bcff0 con 0x7fa04410c170 2024-09-19T05:00:33.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:33.534+0000 7fa048fc5640 1 -- 172.21.15.2:0/2929334180 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fa0300a33b0 msgr2=0x7fa0300a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:00:33.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:33.534+0000 7fa048fc5640 1 --2- 172.21.15.2:0/2929334180 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fa0300a33b0 0x7fa0300a5870 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa034005d00 tx=0x7fa03400b410 comp rx=0 tx=0).stop 2024-09-19T05:00:33.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:33.534+0000 7fa048fc5640 1 -- 172.21.15.2:0/2929334180 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa04410c170 msgr2=0x7fa04419cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:00:33.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:33.534+0000 7fa048fc5640 1 --2- 172.21.15.2:0/2929334180 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa04410c170 0x7fa04419cc90 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fa03c02ae70 tx=0x7fa03c02f5d0 comp rx=0 tx=0).stop 2024-09-19T05:00:33.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:33.534+0000 7fa048fc5640 1 -- 172.21.15.2:0/2929334180 shutdown_connections 2024-09-19T05:00:33.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:33.534+0000 7fa048fc5640 1 --2- 172.21.15.2:0/2929334180 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa04410c170 0x7fa04419cc90 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:33.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:33.534+0000 7fa048fc5640 1 --2- 172.21.15.2:0/2929334180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa044103660 0x7fa044198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:33.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:33.534+0000 7fa048fc5640 1 --2- 172.21.15.2:0/2929334180 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7fa0300a33b0 0x7fa0300a5870 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:33.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:33.534+0000 7fa048fc5640 1 --2- 172.21.15.2:0/2929334180 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa044102d40 0x7fa0441983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:33.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:33.534+0000 7fa048fc5640 1 -- 172.21.15.2:0/2929334180 >> 172.21.15.2:0/2929334180 conn(0x7fa0440fc7a0 msgr2=0x7fa0440fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:00:33.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:33.534+0000 7fa048fc5640 1 -- 172.21.15.2:0/2929334180 shutdown_connections 2024-09-19T05:00:33.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:33.534+0000 7fa048fc5640 1 -- 172.21.15.2:0/2929334180 wait complete. 2024-09-19T05:00:33.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:33 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/2929334180' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T05:00:33.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:33 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/2929334180' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T05:00:33.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:33 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/2929334180' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T05:00:34.314 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T05:00:34.578 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:00:34.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:34 smithi018 ceph-mon[34537]: pgmap v393: 97 pgs: 97 active+clean; 24 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-19T05:00:34.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:34 smithi018 ceph-mon[34537]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T05:00:34.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:34 smithi018 ceph-mon[34537]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T05:00:34.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:34 smithi018 ceph-mon[34537]: Cluster is now healthy 2024-09-19T05:00:34.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:34 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/2929334180' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T05:00:34.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:34 smithi018 ceph-mon[34537]: fsmap 12 up:standby 2024-09-19T05:00:34.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:34 smithi002 ceph-mon[30975]: pgmap v393: 97 pgs: 97 active+clean; 24 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-19T05:00:34.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:34 smithi002 ceph-mon[30975]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T05:00:34.810 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:34 smithi002 ceph-mon[30975]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T05:00:34.810 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:34 smithi002 ceph-mon[30975]: Cluster is now healthy 2024-09-19T05:00:34.810 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:34 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/2929334180' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T05:00:34.810 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:34 smithi002 ceph-mon[30975]: fsmap 12 up:standby 2024-09-19T05:00:34.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:34 smithi116 ceph-mon[34477]: pgmap v393: 97 pgs: 97 active+clean; 24 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-19T05:00:34.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:34 smithi116 ceph-mon[34477]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T05:00:34.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:34 smithi116 ceph-mon[34477]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T05:00:34.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:34 smithi116 ceph-mon[34477]: Cluster is now healthy 2024-09-19T05:00:34.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:34 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/2929334180' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T05:00:34.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:34 smithi116 ceph-mon[34477]: fsmap 12 up:standby 2024-09-19T05:00:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.025+0000 7ff83dd17640 1 -- 172.21.15.2:0/1968160880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8381082a0 msgr2=0x7ff83810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:00:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.025+0000 7ff83dd17640 1 --2- 172.21.15.2:0/1968160880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8381082a0 0x7ff83810ec40 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7ff830009cd0 tx=0x7ff83002a910 comp rx=0 tx=0).stop 2024-09-19T05:00:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.025+0000 7ff83dd17640 1 -- 172.21.15.2:0/1968160880 shutdown_connections 2024-09-19T05:00:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.025+0000 7ff83dd17640 1 --2- 172.21.15.2:0/1968160880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8381082a0 0x7ff83810ec40 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.025+0000 7ff83dd17640 1 --2- 172.21.15.2:0/1968160880 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8381036e0 0x7ff838107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.025+0000 7ff83dd17640 1 --2- 172.21.15.2:0/1968160880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff838102d30 0x7ff838103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.025+0000 7ff83dd17640 1 -- 172.21.15.2:0/1968160880 >> 172.21.15.2:0/1968160880 conn(0x7ff8380fc7d0 msgr2=0x7ff8380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:00:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.025+0000 7ff83dd17640 1 -- 172.21.15.2:0/1968160880 shutdown_connections 2024-09-19T05:00:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.025+0000 7ff83dd17640 1 -- 172.21.15.2:0/1968160880 wait complete. 2024-09-19T05:00:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.025+0000 7ff83dd17640 1 Processor -- start 2024-09-19T05:00:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.025+0000 7ff83dd17640 1 -- start start 2024-09-19T05:00:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.025+0000 7ff83dd17640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff838102d30 0x7ff838100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:00:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.025+0000 7ff83dd17640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8381036e0 0x7ff838100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:00:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.026+0000 7ff83dd17640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8381082a0 0x7ff838101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:00:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.026+0000 7ff83dd17640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff838111f90 con 0x7ff8381036e0 2024-09-19T05:00:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.026+0000 7ff83dd17640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff838111e10 con 0x7ff8381082a0 2024-09-19T05:00:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.026+0000 7ff83dd17640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7ff838112110 con 0x7ff838102d30 2024-09-19T05:00:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.026+0000 7ff82ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8381036e0 0x7ff838100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:00:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.026+0000 7ff82ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8381036e0 0x7ff838100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56478/0 (socket says 172.21.15.2:56478) 2024-09-19T05:00:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.026+0000 7ff82ffff640 1 -- 172.21.15.2:0/1352389533 learned_addr learned my addr 172.21.15.2:0/1352389533 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T05:00:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.026+0000 7ff837fff640 1 --2- 172.21.15.2:0/1352389533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8381082a0 0x7ff838101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:00:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.026+0000 7ff8377fe640 1 --2- 172.21.15.2:0/1352389533 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff838102d30 0x7ff838100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:00:35.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.026+0000 7ff82ffff640 1 -- 172.21.15.2:0/1352389533 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff838102d30 msgr2=0x7ff838100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:00:35.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.026+0000 7ff82ffff640 1 --2- 172.21.15.2:0/1352389533 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff838102d30 0x7ff838100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:35.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.026+0000 7ff82ffff640 1 -- 172.21.15.2:0/1352389533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8381082a0 msgr2=0x7ff838101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:00:35.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.026+0000 7ff82ffff640 1 --2- 172.21.15.2:0/1352389533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8381082a0 0x7ff838101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:35.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.026+0000 7ff82ffff640 1 -- 172.21.15.2:0/1352389533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8381a69d0 con 0x7ff8381036e0 2024-09-19T05:00:35.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.026+0000 7ff82ffff640 1 --2- 172.21.15.2:0/1352389533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8381036e0 0x7ff838100ed0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7ff820006fd0 tx=0x7ff82000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:00:35.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.026+0000 7ff8357fa640 1 -- 172.21.15.2:0/1352389533 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff820011830 con 0x7ff8381036e0 2024-09-19T05:00:35.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.026+0000 7ff8357fa640 1 -- 172.21.15.2:0/1352389533 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff820016070 con 0x7ff8381036e0 2024-09-19T05:00:35.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.026+0000 7ff8357fa640 1 -- 172.21.15.2:0/1352389533 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff820010df0 con 0x7ff8381036e0 2024-09-19T05:00:35.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.027+0000 7ff83dd17640 1 -- 172.21.15.2:0/1352389533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8381a6cc0 con 0x7ff8381036e0 2024-09-19T05:00:35.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.027+0000 7ff83dd17640 1 -- 172.21.15.2:0/1352389533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8381a71b0 con 0x7ff8381036e0 2024-09-19T05:00:35.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.028+0000 7ff83dd17640 1 -- 172.21.15.2:0/1352389533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff838103110 con 0x7ff8381036e0 2024-09-19T05:00:35.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.029+0000 7ff8357fa640 1 -- 172.21.15.2:0/1352389533 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7ff8200119d0 con 0x7ff8381036e0 2024-09-19T05:00:35.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.029+0000 7ff8357fa640 1 --2- 172.21.15.2:0/1352389533 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7ff8240a3430 0x7ff8240a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:00:35.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.030+0000 7ff8377fe640 1 --2- 172.21.15.2:0/1352389533 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7ff8240a3430 0x7ff8240a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:00:35.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.030+0000 7ff8357fa640 1 -- 172.21.15.2:0/1352389533 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8569+0+0 (secure 0 0 0) 0x7ff8200cf210 con 0x7ff8381036e0 2024-09-19T05:00:35.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.030+0000 7ff8377fe640 1 --2- 172.21.15.2:0/1352389533 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7ff8240a3430 0x7ff8240a58f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff828005fd0 tx=0x7ff828005850 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:00:35.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.034+0000 7ff8357fa640 1 -- 172.21.15.2:0/1352389533 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff82009bcd0 con 0x7ff8381036e0 2024-09-19T05:00:35.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.213+0000 7ff83dd17640 1 -- 172.21.15.2:0/1352389533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff83810a2e0 con 0x7ff8381036e0 2024-09-19T05:00:35.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.534+0000 7ff8357fa640 1 -- 172.21.15.2:0/1352389533 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v95) ==== 181+0+0 (secure 0 0 0) 0x7ff82009b5d0 con 0x7ff8381036e0 2024-09-19T05:00:35.536 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' removed 2024-09-19T05:00:35.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.537+0000 7ff83dd17640 1 -- 172.21.15.2:0/1352389533 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7ff8240a3430 msgr2=0x7ff8240a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:00:35.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.537+0000 7ff83dd17640 1 --2- 172.21.15.2:0/1352389533 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7ff8240a3430 0x7ff8240a58f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff828005fd0 tx=0x7ff828005850 comp rx=0 tx=0).stop 2024-09-19T05:00:35.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.537+0000 7ff83dd17640 1 -- 172.21.15.2:0/1352389533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8381036e0 msgr2=0x7ff838100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:00:35.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.537+0000 7ff83dd17640 1 --2- 172.21.15.2:0/1352389533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8381036e0 0x7ff838100ed0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7ff820006fd0 tx=0x7ff82000b8e0 comp rx=0 tx=0).stop 2024-09-19T05:00:35.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.538+0000 7ff83dd17640 1 -- 172.21.15.2:0/1352389533 shutdown_connections 2024-09-19T05:00:35.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.538+0000 7ff83dd17640 1 --2- 172.21.15.2:0/1352389533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8381082a0 0x7ff838101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:35.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.538+0000 7ff83dd17640 1 --2- 172.21.15.2:0/1352389533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8381036e0 0x7ff838100ed0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:35.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.538+0000 7ff83dd17640 1 --2- 172.21.15.2:0/1352389533 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7ff8240a3430 0x7ff8240a58f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:35.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.538+0000 7ff83dd17640 1 --2- 172.21.15.2:0/1352389533 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff838102d30 0x7ff838100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:35.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.538+0000 7ff83dd17640 1 -- 172.21.15.2:0/1352389533 >> 172.21.15.2:0/1352389533 conn(0x7ff8380fc7d0 msgr2=0x7ff838105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:00:35.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.538+0000 7ff83dd17640 1 -- 172.21.15.2:0/1352389533 shutdown_connections 2024-09-19T05:00:35.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:35.538+0000 7ff83dd17640 1 -- 172.21.15.2:0/1352389533 wait complete. 2024-09-19T05:00:35.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:35 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/1352389533' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T05:00:35.843 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:35 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/1352389533' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T05:00:35.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:35 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/1352389533' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T05:00:36.234 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid d46630c4-7640-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T05:00:36.496 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:00:36.806 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:36 smithi018 ceph-mon[34537]: pgmap v394: 97 pgs: 97 active+clean; 24 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 614 B/s rd, 1 op/s 2024-09-19T05:00:36.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:36 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/1352389533' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T05:00:36.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:36 smithi018 ceph-mon[34537]: osdmap e95: 12 total, 12 up, 12 in 2024-09-19T05:00:36.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:36 smithi002 ceph-mon[30975]: pgmap v394: 97 pgs: 97 active+clean; 24 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 614 B/s rd, 1 op/s 2024-09-19T05:00:36.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:36 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/1352389533' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T05:00:36.860 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:36 smithi002 ceph-mon[30975]: osdmap e95: 12 total, 12 up, 12 in 2024-09-19T05:00:36.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:36 smithi116 ceph-mon[34477]: pgmap v394: 97 pgs: 97 active+clean; 24 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 614 B/s rd, 1 op/s 2024-09-19T05:00:36.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:36 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/1352389533' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T05:00:36.861 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:36 smithi116 ceph-mon[34477]: osdmap e95: 12 total, 12 up, 12 in 2024-09-19T05:00:36.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:36.955+0000 7faa871cc640 1 -- 172.21.15.2:0/165729399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa80106a80 msgr2=0x7faa80106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:00:36.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:36.955+0000 7faa871cc640 1 --2- 172.21.15.2:0/165729399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa80106a80 0x7faa80106e60 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7faa70009930 tx=0x7faa7002a420 comp rx=0 tx=0).stop 2024-09-19T05:00:36.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:36.955+0000 7faa871cc640 1 -- 172.21.15.2:0/165729399 shutdown_connections 2024-09-19T05:00:36.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:36.955+0000 7faa871cc640 1 --2- 172.21.15.2:0/165729399 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa80101420 0x7faa8010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:36.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:36.956+0000 7faa871cc640 1 --2- 172.21.15.2:0/165729399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa80100a80 0x7faa80100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:36.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:36.956+0000 7faa871cc640 1 --2- 172.21.15.2:0/165729399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa80106a80 0x7faa80106e60 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:36.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:36.956+0000 7faa871cc640 1 -- 172.21.15.2:0/165729399 >> 172.21.15.2:0/165729399 conn(0x7faa800fc7a0 msgr2=0x7faa800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:00:36.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:36.956+0000 7faa871cc640 1 -- 172.21.15.2:0/165729399 shutdown_connections 2024-09-19T05:00:36.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:36.956+0000 7faa871cc640 1 -- 172.21.15.2:0/165729399 wait complete. 2024-09-19T05:00:36.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:36.956+0000 7faa871cc640 1 Processor -- start 2024-09-19T05:00:36.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:36.956+0000 7faa871cc640 1 -- start start 2024-09-19T05:00:36.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:36.957+0000 7faa871cc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa80100a80 0x7faa801972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:00:36.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:36.957+0000 7faa871cc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa80101420 0x7faa80197800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:00:36.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:36.957+0000 7faa871cc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa80106a80 0x7faa8019bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:00:36.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:36.957+0000 7faa871cc640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faa80110d80 con 0x7faa80101420 2024-09-19T05:00:36.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:36.957+0000 7faa871cc640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7faa80110c00 con 0x7faa80106a80 2024-09-19T05:00:36.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:36.957+0000 7faa871cc640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7faa80110f00 con 0x7faa80100a80 2024-09-19T05:00:36.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:36.957+0000 7faa7ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa80101420 0x7faa80197800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:00:36.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:36.957+0000 7faa7ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa80101420 0x7faa80197800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56506/0 (socket says 172.21.15.2:56506) 2024-09-19T05:00:36.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:36.957+0000 7faa7ffff640 1 -- 172.21.15.2:0/3424172095 learned_addr learned my addr 172.21.15.2:0/3424172095 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T05:00:36.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:36.957+0000 7faa85769640 1 --2- 172.21.15.2:0/3424172095 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa80106a80 0x7faa8019bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:00:36.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:36.957+0000 7faa84f68640 1 --2- 172.21.15.2:0/3424172095 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa80100a80 0x7faa801972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:00:36.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:36.957+0000 7faa7ffff640 1 -- 172.21.15.2:0/3424172095 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa80100a80 msgr2=0x7faa801972c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:00:36.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:36.957+0000 7faa7ffff640 1 --2- 172.21.15.2:0/3424172095 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa80100a80 0x7faa801972c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:36.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:36.957+0000 7faa7ffff640 1 -- 172.21.15.2:0/3424172095 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa80106a80 msgr2=0x7faa8019bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:00:36.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:36.957+0000 7faa7ffff640 1 --2- 172.21.15.2:0/3424172095 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa80106a80 0x7faa8019bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:36.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:36.957+0000 7faa7ffff640 1 -- 172.21.15.2:0/3424172095 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa8019c270 con 0x7faa80101420 2024-09-19T05:00:36.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:36.957+0000 7faa7ffff640 1 --2- 172.21.15.2:0/3424172095 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa80101420 0x7faa80197800 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7faa74009970 tx=0x7faa74009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:00:36.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:36.958+0000 7faa7dffb640 1 -- 172.21.15.2:0/3424172095 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa7400d020 con 0x7faa80101420 2024-09-19T05:00:36.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:36.958+0000 7faa871cc640 1 -- 172.21.15.2:0/3424172095 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa8019c560 con 0x7faa80101420 2024-09-19T05:00:36.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:36.958+0000 7faa7dffb640 1 -- 172.21.15.2:0/3424172095 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7faa7400d1c0 con 0x7faa80101420 2024-09-19T05:00:36.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:36.958+0000 7faa7dffb640 1 -- 172.21.15.2:0/3424172095 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa7400cc50 con 0x7faa80101420 2024-09-19T05:00:36.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:36.958+0000 7faa871cc640 1 -- 172.21.15.2:0/3424172095 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa8006a790 con 0x7faa80101420 2024-09-19T05:00:36.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:36.959+0000 7faa871cc640 1 -- 172.21.15.2:0/3424172095 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa80100ee0 con 0x7faa80101420 2024-09-19T05:00:36.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:36.960+0000 7faa7dffb640 1 -- 172.21.15.2:0/3424172095 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7faa7400c460 con 0x7faa80101420 2024-09-19T05:00:36.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:36.961+0000 7faa7dffb640 1 --2- 172.21.15.2:0/3424172095 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7faa680a33b0 0x7faa680a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:00:36.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:36.961+0000 7faa7dffb640 1 -- 172.21.15.2:0/3424172095 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8044+0+0 (secure 0 0 0) 0x7faa740d0ef0 con 0x7faa80101420 2024-09-19T05:00:36.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:36.961+0000 7faa84f68640 1 --2- 172.21.15.2:0/3424172095 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7faa680a33b0 0x7faa680a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:00:36.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:36.961+0000 7faa84f68640 1 --2- 172.21.15.2:0/3424172095 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7faa680a33b0 0x7faa680a5870 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7faa70006010 tx=0x7faa70000bc0 comp rx=0 tx=0).ready entity=mgr.15096 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:00:36.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:36.965+0000 7faa7dffb640 1 -- 172.21.15.2:0/3424172095 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7faa7409db00 con 0x7faa80101420 2024-09-19T05:00:37.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:37.141+0000 7faa871cc640 1 -- 172.21.15.2:0/3424172095 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7faa8006b240 con 0x7faa80101420 2024-09-19T05:00:37.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:37.540+0000 7faa7dffb640 1 -- 172.21.15.2:0/3424172095 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v96) ==== 169+0+0 (secure 0 0 0) 0x7faa7409d400 con 0x7faa80101420 2024-09-19T05:00:37.542 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' removed 2024-09-19T05:00:37.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:37.544+0000 7faa871cc640 1 -- 172.21.15.2:0/3424172095 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7faa680a33b0 msgr2=0x7faa680a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:00:37.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:37.544+0000 7faa871cc640 1 --2- 172.21.15.2:0/3424172095 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7faa680a33b0 0x7faa680a5870 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7faa70006010 tx=0x7faa70000bc0 comp rx=0 tx=0).stop 2024-09-19T05:00:37.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:37.544+0000 7faa871cc640 1 -- 172.21.15.2:0/3424172095 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa80101420 msgr2=0x7faa80197800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:00:37.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:37.544+0000 7faa871cc640 1 --2- 172.21.15.2:0/3424172095 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa80101420 0x7faa80197800 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7faa74009970 tx=0x7faa74009e30 comp rx=0 tx=0).stop 2024-09-19T05:00:37.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:37.544+0000 7faa871cc640 1 -- 172.21.15.2:0/3424172095 shutdown_connections 2024-09-19T05:00:37.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:37.544+0000 7faa871cc640 1 --2- 172.21.15.2:0/3424172095 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa80106a80 0x7faa8019bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:37.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:37.544+0000 7faa871cc640 1 --2- 172.21.15.2:0/3424172095 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa80101420 0x7faa80197800 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:37.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:37.544+0000 7faa871cc640 1 --2- 172.21.15.2:0/3424172095 >> [v2:172.21.15.2:6800/852329670,v1:172.21.15.2:6801/852329670] conn(0x7faa680a33b0 0x7faa680a5870 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:37.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:37.544+0000 7faa871cc640 1 --2- 172.21.15.2:0/3424172095 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa80100a80 0x7faa801972c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:00:37.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:37.544+0000 7faa871cc640 1 -- 172.21.15.2:0/3424172095 >> 172.21.15.2:0/3424172095 conn(0x7faa800fc7a0 msgr2=0x7faa800fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:00:37.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:37.545+0000 7faa871cc640 1 -- 172.21.15.2:0/3424172095 shutdown_connections 2024-09-19T05:00:37.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T05:00:37.545+0000 7faa871cc640 1 -- 172.21.15.2:0/3424172095 wait complete. 2024-09-19T05:00:37.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:37 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/3424172095' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T05:00:37.844 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:37 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/3424172095' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T05:00:37.860 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:37 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/3424172095' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T05:00:38.262 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T05:00:38.292 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T05:00:38.328 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T05:00:38.360 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-19T05:00:38.361 DEBUG:teuthology.orchestra.run.smithi002:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T05:00:38.378 DEBUG:teuthology.orchestra.run.smithi018:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T05:00:38.395 DEBUG:teuthology.orchestra.run.smithi116:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T05:00:38.419 INFO:tasks.cephadm:Stopping all daemons... 2024-09-19T05:00:38.419 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-19T05:00:38.419 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-d46630c4-7640-11ef-bceb-c7b262605968@mon.a 2024-09-19T05:00:38.610 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:38 smithi116 ceph-mon[34477]: pgmap v396: 65 pgs: 65 active+clean; 577 KiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:00:38.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:38 smithi116 ceph-mon[34477]: from='client.? 172.21.15.2:0/3424172095' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T05:00:38.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:38 smithi116 ceph-mon[34477]: osdmap e96: 12 total, 12 up, 12 in 2024-09-19T05:00:38.724 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:38 smithi002 systemd[1]: Stopping Ceph mon.a for d46630c4-7640-11ef-bceb-c7b262605968... 2024-09-19T05:00:38.724 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:38 smithi002 ceph-mon[30975]: pgmap v396: 65 pgs: 65 active+clean; 577 KiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:00:38.724 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:38 smithi002 ceph-mon[30975]: from='client.? 172.21.15.2:0/3424172095' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T05:00:38.724 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:38 smithi002 ceph-mon[30975]: osdmap e96: 12 total, 12 up, 12 in 2024-09-19T05:00:38.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:38 smithi018 ceph-mon[34537]: pgmap v396: 65 pgs: 65 active+clean; 577 KiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:00:38.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:38 smithi018 ceph-mon[34537]: from='client.? 172.21.15.2:0/3424172095' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T05:00:38.807 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:38 smithi018 ceph-mon[34537]: osdmap e96: 12 total, 12 up, 12 in 2024-09-19T05:00:39.075 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:38 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mon-a[30971]: 2024-09-19T05:00:38.722+0000 7f5c9cd88640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:00:39.075 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:38 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mon-a[30971]: 2024-09-19T05:00:38.722+0000 7f5c9cd88640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-19T05:00:39.075 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:38 smithi002 podman[103462]: 2024-09-19 05:00:38.784140555 +0000 UTC m=+0.161402321 container died 7720d0275239e8c2d1aa5e29f5ed99628f65acf75f8726a29944539afd7dc971 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mon-a, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0) 2024-09-19T05:00:39.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:39 smithi002 podman[103462]: 2024-09-19 05:00:39.247985805 +0000 UTC m=+0.625247560 container cleanup 7720d0275239e8c2d1aa5e29f5ed99628f65acf75f8726a29944539afd7dc971 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mon-a, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-2f599a4) 2024-09-19T05:00:39.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 05:00:39 smithi002 bash[103462]: ceph-d46630c4-7640-11ef-bceb-c7b262605968-mon-a 2024-09-19T05:00:39.683 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@mon.a.service' 2024-09-19T05:00:39.739 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:00:39.739 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-19T05:00:39.739 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-19T05:00:39.740 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-d46630c4-7640-11ef-bceb-c7b262605968@mon.b 2024-09-19T05:00:40.057 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:39 smithi018 systemd[1]: Stopping Ceph mon.b for d46630c4-7640-11ef-bceb-c7b262605968... 2024-09-19T05:00:40.434 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:40 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mon-b[34533]: 2024-09-19T05:00:40.083+0000 7f8fba9cd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:00:40.434 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:40 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mon-b[34533]: 2024-09-19T05:00:40.083+0000 7f8fba9cd640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-19T05:00:40.434 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:40 smithi018 podman[70627]: 2024-09-19 05:00:40.155574203 +0000 UTC m=+0.201207699 container died 55d975b2834d9b34fc002617891f73a61cbe48c9aabb452e730539da73498132 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mon-b, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T05:00:40.783 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:40 smithi018 podman[70627]: 2024-09-19 05:00:40.556571088 +0000 UTC m=+0.602204574 container cleanup 55d975b2834d9b34fc002617891f73a61cbe48c9aabb452e730539da73498132 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mon-b, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T05:00:40.783 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 19 05:00:40 smithi018 bash[70627]: ceph-d46630c4-7640-11ef-bceb-c7b262605968-mon-b 2024-09-19T05:00:40.921 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@mon.b.service' 2024-09-19T05:00:40.964 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:00:40.964 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-19T05:00:40.964 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-19T05:00:40.964 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-d46630c4-7640-11ef-bceb-c7b262605968@mon.c 2024-09-19T05:00:41.267 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:41 smithi116 systemd[1]: Stopping Ceph mon.c for d46630c4-7640-11ef-bceb-c7b262605968... 2024-09-19T05:00:41.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:41 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mon-c[34473]: 2024-09-19T05:00:41.266+0000 7f14c6def640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:00:41.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:41 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mon-c[34473]: 2024-09-19T05:00:41.266+0000 7f14c6def640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-19T05:00:41.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:41 smithi116 podman[70449]: 2024-09-19 05:00:41.511716858 +0000 UTC m=+0.347121377 container died cbe5b534edd459d03f0a525bcfb708adc1de949a7bd789e92b0b38ca556526d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mon-c, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-19T05:00:42.052 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:41 smithi116 podman[70449]: 2024-09-19 05:00:41.842107013 +0000 UTC m=+0.677511532 container cleanup cbe5b534edd459d03f0a525bcfb708adc1de949a7bd789e92b0b38ca556526d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mon-c, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-19T05:00:42.052 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 19 05:00:41 smithi116 bash[70449]: ceph-d46630c4-7640-11ef-bceb-c7b262605968-mon-c 2024-09-19T05:00:42.265 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@mon.c.service' 2024-09-19T05:00:42.311 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:00:42.311 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-19T05:00:42.311 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-19T05:00:42.311 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-d46630c4-7640-11ef-bceb-c7b262605968@mgr.x 2024-09-19T05:00:42.610 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 05:00:42 smithi002 systemd[1]: Stopping Ceph mgr.x for d46630c4-7640-11ef-bceb-c7b262605968... 2024-09-19T05:00:43.005 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 05:00:42 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T05:00:42.653+0000 7f5647922640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:00:43.005 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 05:00:42 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T05:00:42.653+0000 7f5647922640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-19T05:00:43.005 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 05:00:42 smithi002 podman[103595]: 2024-09-19 05:00:42.684152858 +0000 UTC m=+0.166590688 container died 61e24d87eda4c5273e70266ed42280a8667b3be3be8faa49d6fb200745ae8f9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True) 2024-09-19T05:00:43.360 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 05:00:43 smithi002 podman[103595]: 2024-09-19 05:00:43.170466066 +0000 UTC m=+0.652903887 container cleanup 61e24d87eda4c5273e70266ed42280a8667b3be3be8faa49d6fb200745ae8f9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:00:43.360 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 05:00:43 smithi002 bash[103595]: ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-x 2024-09-19T05:00:43.538 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@mgr.x.service' 2024-09-19T05:00:43.576 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:00:43.577 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-19T05:00:43.577 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-19T05:00:43.577 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-d46630c4-7640-11ef-bceb-c7b262605968@mgr.y 2024-09-19T05:00:43.898 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 05:00:43 smithi018 systemd[1]: Stopping Ceph mgr.y for d46630c4-7640-11ef-bceb-c7b262605968... 2024-09-19T05:00:44.161 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 05:00:43 smithi018 podman[70749]: 2024-09-19 05:00:43.898052283 +0000 UTC m=+0.124685722 container died 993e387f95a99b0ed5717f617c77d7a09ff64ef560f3f05021938d5dff4f6555 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-19T05:00:44.420 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 05:00:44 smithi018 podman[70749]: 2024-09-19 05:00:44.243400489 +0000 UTC m=+0.470033927 container cleanup 993e387f95a99b0ed5717f617c77d7a09ff64ef560f3f05021938d5dff4f6555 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS) 2024-09-19T05:00:44.420 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 05:00:44 smithi018 bash[70749]: ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y 2024-09-19T05:00:44.670 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@mgr.y.service' 2024-09-19T05:00:44.693 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 05:00:44 smithi018 podman[70763]: 2024-09-19 05:00:44.419678213 +0000 UTC m=+0.516109927 container remove 993e387f95a99b0ed5717f617c77d7a09ff64ef560f3f05021938d5dff4f6555 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-y, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T05:00:44.693 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 05:00:44 smithi018 systemd[1]: ceph-d46630c4-7640-11ef-bceb-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-09-19T05:00:44.693 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 05:00:44 smithi018 systemd[1]: ceph-d46630c4-7640-11ef-bceb-c7b262605968@mgr.y.service: Failed with result 'exit-code'. 2024-09-19T05:00:44.694 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 05:00:44 smithi018 systemd[1]: Stopped Ceph mgr.y for d46630c4-7640-11ef-bceb-c7b262605968. 2024-09-19T05:00:44.694 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 19 05:00:44 smithi018 systemd[1]: ceph-d46630c4-7640-11ef-bceb-c7b262605968@mgr.y.service: Consumed 12.076s CPU time. 2024-09-19T05:00:44.707 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:00:44.707 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-19T05:00:44.707 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-19T05:00:44.707 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-d46630c4-7640-11ef-bceb-c7b262605968@mgr.z 2024-09-19T05:00:45.036 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 05:00:44 smithi116 systemd[1]: Stopping Ceph mgr.z for d46630c4-7640-11ef-bceb-c7b262605968... 2024-09-19T05:00:45.315 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 05:00:45 smithi116 podman[70573]: 2024-09-19 05:00:45.036000202 +0000 UTC m=+0.138322509 container died 65b2ae446ca7300c723bca1abee1c5d823d47174c445328a41159cd771e55f99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-19T05:00:45.611 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 05:00:45 smithi116 podman[70573]: 2024-09-19 05:00:45.397011234 +0000 UTC m=+0.499333527 container cleanup 65b2ae446ca7300c723bca1abee1c5d823d47174c445328a41159cd771e55f99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-19T05:00:45.611 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 19 05:00:45 smithi116 bash[70573]: ceph-d46630c4-7640-11ef-bceb-c7b262605968-mgr-z 2024-09-19T05:00:45.822 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@mgr.z.service' 2024-09-19T05:00:45.857 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:00:45.858 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-19T05:00:45.858 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-19T05:00:45.858 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-d46630c4-7640-11ef-bceb-c7b262605968@osd.0 2024-09-19T05:00:46.209 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 05:00:45 smithi002 systemd[1]: Stopping Ceph osd.0 for d46630c4-7640-11ef-bceb-c7b262605968... 2024-09-19T05:00:46.610 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 05:00:46 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-0[44697]: 2024-09-19T05:00:46.207+0000 7ff33be44640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:00:46.610 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 05:00:46 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-0[44697]: 2024-09-19T05:00:46.207+0000 7ff33be44640 -1 osd.0 96 *** Got signal Terminated *** 2024-09-19T05:00:46.610 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 05:00:46 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-0[44697]: 2024-09-19T05:00:46.207+0000 7ff33be44640 -1 osd.0 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T05:00:51.944 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 05:00:51 smithi002 podman[103719]: 2024-09-19 05:00:51.659294216 +0000 UTC m=+5.591042043 container died 4ef3f458db9e8e64b10d317ca7ca48515f2f62882984de6dbb02d80585d017af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-19T05:00:52.344 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 05:00:52 smithi002 podman[103719]: 2024-09-19 05:00:52.108993328 +0000 UTC m=+6.040741183 container cleanup 4ef3f458db9e8e64b10d317ca7ca48515f2f62882984de6dbb02d80585d017af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-0, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T05:00:52.344 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 05:00:52 smithi002 bash[103719]: ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-0 2024-09-19T05:00:52.610 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 05:00:52 smithi002 podman[103736]: 2024-09-19 05:00:52.343707242 +0000 UTC m=+0.682001240 container remove 4ef3f458db9e8e64b10d317ca7ca48515f2f62882984de6dbb02d80585d017af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-19T05:00:52.948 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 05:00:52 smithi002 podman[103824]: 2024-09-19 05:00:52.585390306 +0000 UTC m=+0.016586511 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:00:52.948 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 05:00:52 smithi002 podman[103824]: 2024-09-19 05:00:52.702985983 +0000 UTC m=+0.134182188 container create 5b2f5e0cc637f65150066caaebd1bfe55615d617b33e4598dcd47a27efdd757a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-2f599a4) 2024-09-19T05:00:53.360 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 05:00:52 smithi002 podman[103824]: 2024-09-19 05:00:52.947304241 +0000 UTC m=+0.378500449 container init 5b2f5e0cc637f65150066caaebd1bfe55615d617b33e4598dcd47a27efdd757a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:00:53.360 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 05:00:52 smithi002 podman[103824]: 2024-09-19 05:00:52.951573724 +0000 UTC m=+0.382769931 container start 5b2f5e0cc637f65150066caaebd1bfe55615d617b33e4598dcd47a27efdd757a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-19T05:00:53.360 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 05:00:53 smithi002 podman[103824]: 2024-09-19 05:00:53.030379183 +0000 UTC m=+0.461575408 container attach 5b2f5e0cc637f65150066caaebd1bfe55615d617b33e4598dcd47a27efdd757a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-0-deactivate, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-19T05:00:53.360 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 05:00:53 smithi002 podman[103824]: 2024-09-19 05:00:53.147705359 +0000 UTC m=+0.578901566 container died 5b2f5e0cc637f65150066caaebd1bfe55615d617b33e4598dcd47a27efdd757a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-19T05:00:53.769 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@osd.0.service' 2024-09-19T05:00:53.817 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:00:53.817 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-19T05:00:53.817 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-19T05:00:53.817 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-d46630c4-7640-11ef-bceb-c7b262605968@osd.1 2024-09-19T05:00:54.124 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 19 05:00:53 smithi018 systemd[1]: Stopping Ceph osd.1 for d46630c4-7640-11ef-bceb-c7b262605968... 2024-09-19T05:00:54.557 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 19 05:00:54 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-1[39031]: 2024-09-19T05:00:54.246+0000 7ff07ea23640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:00:54.557 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 19 05:00:54 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-1[39031]: 2024-09-19T05:00:54.246+0000 7ff07ea23640 -1 osd.1 96 *** Got signal Terminated *** 2024-09-19T05:00:54.557 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 19 05:00:54 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-1[39031]: 2024-09-19T05:00:54.246+0000 7ff07ea23640 -1 osd.1 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T05:01:00.057 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 19 05:00:59 smithi018 podman[70872]: 2024-09-19 05:00:59.655240267 +0000 UTC m=+5.644172057 container died c01fd417e77e5429ab1b1fb2129eff631bd1a3409dedd3bc61c0f28ea3812ebc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-1, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4) 2024-09-19T05:01:00.381 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 19 05:01:00 smithi018 podman[70872]: 2024-09-19 05:01:00.154963007 +0000 UTC m=+6.143894797 container cleanup c01fd417e77e5429ab1b1fb2129eff631bd1a3409dedd3bc61c0f28ea3812ebc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-1, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2) 2024-09-19T05:01:00.382 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 19 05:01:00 smithi018 bash[70872]: ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-1 2024-09-19T05:01:00.719 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 19 05:01:00 smithi018 podman[70899]: 2024-09-19 05:01:00.381148497 +0000 UTC m=+0.721482480 container remove c01fd417e77e5429ab1b1fb2129eff631bd1a3409dedd3bc61c0f28ea3812ebc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-1, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-19T05:01:01.012 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 19 05:01:00 smithi018 podman[70990]: 2024-09-19 05:01:00.621611039 +0000 UTC m=+0.016508086 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:01:01.012 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 19 05:01:00 smithi018 podman[70990]: 2024-09-19 05:01:00.740222371 +0000 UTC m=+0.135119454 container create 8351bb3aabd5d9eaa498b9631d5382d1b70ac12ce186fa8aaf0dc1e6f6884612 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-19T05:01:01.307 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 19 05:01:01 smithi018 podman[70990]: 2024-09-19 05:01:01.011342348 +0000 UTC m=+0.406239395 container init 8351bb3aabd5d9eaa498b9631d5382d1b70ac12ce186fa8aaf0dc1e6f6884612 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-19T05:01:01.307 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 19 05:01:01 smithi018 podman[70990]: 2024-09-19 05:01:01.015348157 +0000 UTC m=+0.410245201 container start 8351bb3aabd5d9eaa498b9631d5382d1b70ac12ce186fa8aaf0dc1e6f6884612 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-19T05:01:01.307 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 19 05:01:01 smithi018 podman[70990]: 2024-09-19 05:01:01.125992873 +0000 UTC m=+0.520889932 container attach 8351bb3aabd5d9eaa498b9631d5382d1b70ac12ce186fa8aaf0dc1e6f6884612 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T05:01:01.307 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 19 05:01:01 smithi018 podman[70990]: 2024-09-19 05:01:01.207407448 +0000 UTC m=+0.602304486 container died 8351bb3aabd5d9eaa498b9631d5382d1b70ac12ce186fa8aaf0dc1e6f6884612 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-19T05:01:01.991 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@osd.1.service' 2024-09-19T05:01:02.035 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:01:02.035 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-19T05:01:02.035 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-19T05:01:02.036 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-d46630c4-7640-11ef-bceb-c7b262605968@osd.2 2024-09-19T05:01:02.328 INFO:journalctl@ceph.osd.2.smithi116.stdout:Sep 19 05:01:02 smithi116 systemd[1]: Stopping Ceph osd.2 for d46630c4-7640-11ef-bceb-c7b262605968... 2024-09-19T05:01:02.610 INFO:journalctl@ceph.osd.2.smithi116.stdout:Sep 19 05:01:02 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-2[39479]: 2024-09-19T05:01:02.325+0000 7f756dd14640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:01:02.610 INFO:journalctl@ceph.osd.2.smithi116.stdout:Sep 19 05:01:02 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-2[39479]: 2024-09-19T05:01:02.325+0000 7f756dd14640 -1 osd.2 96 *** Got signal Terminated *** 2024-09-19T05:01:02.611 INFO:journalctl@ceph.osd.2.smithi116.stdout:Sep 19 05:01:02 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-2[39479]: 2024-09-19T05:01:02.325+0000 7f756dd14640 -1 osd.2 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T05:01:07.960 INFO:journalctl@ceph.osd.2.smithi116.stdout:Sep 19 05:01:07 smithi116 podman[70725]: 2024-09-19 05:01:07.657342992 +0000 UTC m=+5.431695214 container died 1cafa9c8cd93599d99e82564c3f0c5f0378300e51388506974320dec723e6b63 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-19T05:01:08.361 INFO:journalctl@ceph.osd.2.smithi116.stdout:Sep 19 05:01:07 smithi116 podman[70725]: 2024-09-19 05:01:07.959475026 +0000 UTC m=+5.733827287 container cleanup 1cafa9c8cd93599d99e82564c3f0c5f0378300e51388506974320dec723e6b63 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-2, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T05:01:08.361 INFO:journalctl@ceph.osd.2.smithi116.stdout:Sep 19 05:01:07 smithi116 bash[70725]: ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-2 2024-09-19T05:01:08.361 INFO:journalctl@ceph.osd.2.smithi116.stdout:Sep 19 05:01:08 smithi116 podman[70741]: 2024-09-19 05:01:08.177393232 +0000 UTC m=+0.521520745 container remove 1cafa9c8cd93599d99e82564c3f0c5f0378300e51388506974320dec723e6b63 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-19T05:01:08.740 INFO:journalctl@ceph.osd.2.smithi116.stdout:Sep 19 05:01:08 smithi116 podman[70831]: 2024-09-19 05:01:08.486574543 +0000 UTC m=+0.102390285 container create bb1a4ef0132cf6de8478735e52e1cae66270250fc62e6415d0fede1dde7f99f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, RELEASE=squid-2f599a4, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:01:08.740 INFO:journalctl@ceph.osd.2.smithi116.stdout:Sep 19 05:01:08 smithi116 podman[70831]: 2024-09-19 05:01:08.399701648 +0000 UTC m=+0.015517363 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:01:08.740 INFO:journalctl@ceph.osd.2.smithi116.stdout:Sep 19 05:01:08 smithi116 podman[70831]: 2024-09-19 05:01:08.680914743 +0000 UTC m=+0.296730439 container init bb1a4ef0132cf6de8478735e52e1cae66270250fc62e6415d0fede1dde7f99f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T05:01:08.740 INFO:journalctl@ceph.osd.2.smithi116.stdout:Sep 19 05:01:08 smithi116 podman[70831]: 2024-09-19 05:01:08.684261732 +0000 UTC m=+0.300077436 container start bb1a4ef0132cf6de8478735e52e1cae66270250fc62e6415d0fede1dde7f99f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:01:08.740 INFO:journalctl@ceph.osd.2.smithi116.stdout:Sep 19 05:01:08 smithi116 podman[70831]: 2024-09-19 05:01:08.739123976 +0000 UTC m=+0.354939679 container attach bb1a4ef0132cf6de8478735e52e1cae66270250fc62e6415d0fede1dde7f99f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-19T05:01:09.110 INFO:journalctl@ceph.osd.2.smithi116.stdout:Sep 19 05:01:08 smithi116 podman[70831]: 2024-09-19 05:01:08.87257194 +0000 UTC m=+0.488387636 container died bb1a4ef0132cf6de8478735e52e1cae66270250fc62e6415d0fede1dde7f99f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-19T05:01:09.500 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@osd.2.service' 2024-09-19T05:01:09.541 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:01:09.542 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-19T05:01:09.542 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-19T05:01:09.542 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-d46630c4-7640-11ef-bceb-c7b262605968@osd.3 2024-09-19T05:01:09.846 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 19 05:01:09 smithi002 systemd[1]: Stopping Ceph osd.3 for d46630c4-7640-11ef-bceb-c7b262605968... 2024-09-19T05:01:10.110 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 19 05:01:09 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-3[51640]: 2024-09-19T05:01:09.844+0000 7f6eaf2f2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:01:10.110 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 19 05:01:09 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-3[51640]: 2024-09-19T05:01:09.844+0000 7f6eaf2f2640 -1 osd.3 96 *** Got signal Terminated *** 2024-09-19T05:01:10.110 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 19 05:01:09 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-3[51640]: 2024-09-19T05:01:09.844+0000 7f6eaf2f2640 -1 osd.3 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T05:01:12.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:12 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:12.580+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:01:13.610 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 19 05:01:13 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-5[45954]: 2024-09-19T05:01:13.311+0000 7f4f165a6640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.076216+0000 front 2024-09-19T05:00:48.076323+0000 (oldest deadline 2024-09-19T05:01:12.775938+0000) 2024-09-19T05:01:14.110 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:13 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:13.619+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:01:14.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:14 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:14.233+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:01:14.611 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 19 05:01:14 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-5[45954]: 2024-09-19T05:01:14.354+0000 7f4f165a6640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.076216+0000 front 2024-09-19T05:00:48.076323+0000 (oldest deadline 2024-09-19T05:01:12.775938+0000) 2024-09-19T05:01:14.611 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 19 05:01:14 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-3[51640]: 2024-09-19T05:01:14.271+0000 7f6eab8f7640 -1 osd.3 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.592083+0000 front 2024-09-19T05:00:47.592310+0000 (oldest deadline 2024-09-19T05:01:13.492184+0000) 2024-09-19T05:01:14.611 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:14 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:14.134+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.231030+0000 front 2024-09-19T05:00:48.230802+0000 (oldest deadline 2024-09-19T05:01:14.131054+0000) 2024-09-19T05:01:15.111 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:14 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:14.657+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:01:15.512 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:15 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:15.137+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.231030+0000 front 2024-09-19T05:00:48.230802+0000 (oldest deadline 2024-09-19T05:01:14.131054+0000) 2024-09-19T05:01:15.513 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 19 05:01:15 smithi002 podman[103945]: 2024-09-19 05:01:15.221949325 +0000 UTC m=+5.476483784 container died 1a12b72f66cf49ec61af74cfba3e3f8d1134731f513b3688d1bdf815e13d9f60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-3, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-19T05:01:15.513 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:15 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:15.272+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.951676+0000 front 2024-09-19T05:00:50.951605+0000 (oldest deadline 2024-09-19T05:01:15.051789+0000) 2024-09-19T05:01:15.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:15 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:15.246+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:01:15.665 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 19 05:01:15 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-5[45954]: 2024-09-19T05:01:15.380+0000 7f4f165a6640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.076216+0000 front 2024-09-19T05:00:48.076323+0000 (oldest deadline 2024-09-19T05:01:12.775938+0000) 2024-09-19T05:01:15.857 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 19 05:01:15 smithi002 podman[103945]: 2024-09-19 05:01:15.577944479 +0000 UTC m=+5.832478929 container cleanup 1a12b72f66cf49ec61af74cfba3e3f8d1134731f513b3688d1bdf815e13d9f60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-3, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-19T05:01:15.857 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 19 05:01:15 smithi002 bash[103945]: ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-3 2024-09-19T05:01:16.110 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 19 05:01:15 smithi002 podman[103974]: 2024-09-19 05:01:15.856249418 +0000 UTC m=+0.623789382 container remove 1a12b72f66cf49ec61af74cfba3e3f8d1134731f513b3688d1bdf815e13d9f60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-3, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-19T05:01:16.110 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:15 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:15.664+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:01:16.394 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:16 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:16.241+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.951676+0000 front 2024-09-19T05:00:50.951605+0000 (oldest deadline 2024-09-19T05:01:15.051789+0000) 2024-09-19T05:01:16.394 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:16 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:16.132+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.231030+0000 front 2024-09-19T05:00:48.230802+0000 (oldest deadline 2024-09-19T05:01:14.131054+0000) 2024-09-19T05:01:16.395 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 19 05:01:16 smithi002 podman[104064]: 2024-09-19 05:01:16.119581723 +0000 UTC m=+0.016956662 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:01:16.395 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 19 05:01:16 smithi002 podman[104064]: 2024-09-19 05:01:16.232423115 +0000 UTC m=+0.129798087 container create 0c292c57c9ddc1501bfdaa720c8a45ac2f5698ba609a0d277b99bff644d0fde7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-19T05:01:16.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:16 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:16.246+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:01:16.699 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 19 05:01:16 smithi002 podman[104064]: 2024-09-19 05:01:16.5016126 +0000 UTC m=+0.398987534 container init 0c292c57c9ddc1501bfdaa720c8a45ac2f5698ba609a0d277b99bff644d0fde7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux ) 2024-09-19T05:01:16.699 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 19 05:01:16 smithi002 podman[104064]: 2024-09-19 05:01:16.504989323 +0000 UTC m=+0.402364255 container start 0c292c57c9ddc1501bfdaa720c8a45ac2f5698ba609a0d277b99bff644d0fde7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-3-deactivate, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:01:16.699 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 19 05:01:16 smithi002 podman[104064]: 2024-09-19 05:01:16.584981157 +0000 UTC m=+0.482356087 container attach 0c292c57c9ddc1501bfdaa720c8a45ac2f5698ba609a0d277b99bff644d0fde7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-19T05:01:16.700 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 19 05:01:16 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-5[45954]: 2024-09-19T05:01:16.403+0000 7f4f165a6640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.076216+0000 front 2024-09-19T05:00:48.076323+0000 (oldest deadline 2024-09-19T05:01:12.775938+0000) 2024-09-19T05:01:17.056 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 19 05:01:16 smithi002 podman[104064]: 2024-09-19 05:01:16.698720135 +0000 UTC m=+0.596095064 container died 0c292c57c9ddc1501bfdaa720c8a45ac2f5698ba609a0d277b99bff644d0fde7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-19T05:01:17.110 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:16 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:16.700+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:01:17.356 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:17 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:17.222+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.951676+0000 front 2024-09-19T05:00:50.951605+0000 (oldest deadline 2024-09-19T05:01:15.051789+0000) 2024-09-19T05:01:17.356 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:17 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:17.154+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.231030+0000 front 2024-09-19T05:00:48.230802+0000 (oldest deadline 2024-09-19T05:01:14.131054+0000) 2024-09-19T05:01:17.378 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@osd.3.service' 2024-09-19T05:01:17.420 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:01:17.421 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-19T05:01:17.421 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-19T05:01:17.421 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-d46630c4-7640-11ef-bceb-c7b262605968@osd.4 2024-09-19T05:01:17.557 INFO:journalctl@ceph.osd.4.smithi018.stdout:Sep 19 05:01:17 smithi018 systemd[1]: Stopping Ceph osd.4 for d46630c4-7640-11ef-bceb-c7b262605968... 2024-09-19T05:01:17.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:17 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:17.226+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:01:17.860 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 19 05:01:17 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-5[45954]: 2024-09-19T05:01:17.415+0000 7f4f165a6640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.076216+0000 front 2024-09-19T05:00:48.076323+0000 (oldest deadline 2024-09-19T05:01:12.775938+0000) 2024-09-19T05:01:17.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:17 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:17.655+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:01:18.057 INFO:journalctl@ceph.osd.4.smithi018.stdout:Sep 19 05:01:17 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-4[45488]: 2024-09-19T05:01:17.730+0000 7f664cc8c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:01:18.057 INFO:journalctl@ceph.osd.4.smithi018.stdout:Sep 19 05:01:17 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-4[45488]: 2024-09-19T05:01:17.730+0000 7f664cc8c640 -1 osd.4 96 *** Got signal Terminated *** 2024-09-19T05:01:18.057 INFO:journalctl@ceph.osd.4.smithi018.stdout:Sep 19 05:01:17 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-4[45488]: 2024-09-19T05:01:17.730+0000 7f664cc8c640 -1 osd.4 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T05:01:18.360 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:18 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:18.205+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.951676+0000 front 2024-09-19T05:00:50.951605+0000 (oldest deadline 2024-09-19T05:01:15.051789+0000) 2024-09-19T05:01:18.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:18 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:18.106+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.231030+0000 front 2024-09-19T05:00:48.230802+0000 (oldest deadline 2024-09-19T05:01:14.131054+0000) 2024-09-19T05:01:18.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:18 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:18.259+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:01:18.865 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 19 05:01:18 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-5[45954]: 2024-09-19T05:01:18.458+0000 7f4f165a6640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.076216+0000 front 2024-09-19T05:00:48.076323+0000 (oldest deadline 2024-09-19T05:01:12.775938+0000) 2024-09-19T05:01:18.865 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:18 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:18.606+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:01:19.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:19 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:19.248+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:01:19.610 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:19 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:19.238+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.951676+0000 front 2024-09-19T05:00:50.951605+0000 (oldest deadline 2024-09-19T05:01:15.051789+0000) 2024-09-19T05:01:19.610 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:19 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:19.113+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.231030+0000 front 2024-09-19T05:00:48.230802+0000 (oldest deadline 2024-09-19T05:01:14.131054+0000) 2024-09-19T05:01:19.860 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 19 05:01:19 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-5[45954]: 2024-09-19T05:01:19.421+0000 7f4f165a6640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.076216+0000 front 2024-09-19T05:00:48.076323+0000 (oldest deadline 2024-09-19T05:01:12.775938+0000) 2024-09-19T05:01:19.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:19 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:19.589+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:01:20.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:20 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:20.092+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.231030+0000 front 2024-09-19T05:00:48.230802+0000 (oldest deadline 2024-09-19T05:01:14.131054+0000) 2024-09-19T05:01:20.360 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:20 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:20.278+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.951676+0000 front 2024-09-19T05:00:50.951605+0000 (oldest deadline 2024-09-19T05:01:15.051789+0000) 2024-09-19T05:01:20.360 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:20 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:20.278+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:55.052267+0000 front 2024-09-19T05:00:55.052308+0000 (oldest deadline 2024-09-19T05:01:19.752480+0000) 2024-09-19T05:01:20.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:20 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:20.239+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:01:20.860 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 19 05:01:20 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-5[45954]: 2024-09-19T05:01:20.389+0000 7f4f165a6640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.076216+0000 front 2024-09-19T05:00:48.076323+0000 (oldest deadline 2024-09-19T05:01:12.775938+0000) 2024-09-19T05:01:20.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:20 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:20.597+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:01:21.057 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:20 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:20.632+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.774268+0000 front 2024-09-19T05:00:56.774285+0000 (oldest deadline 2024-09-19T05:01:19.674420+0000) 2024-09-19T05:01:21.360 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:21 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:21.264+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.951676+0000 front 2024-09-19T05:00:50.951605+0000 (oldest deadline 2024-09-19T05:01:15.051789+0000) 2024-09-19T05:01:21.360 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:21 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:21.264+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:55.052267+0000 front 2024-09-19T05:00:55.052308+0000 (oldest deadline 2024-09-19T05:01:19.752480+0000) 2024-09-19T05:01:21.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:21 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:21.099+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.231030+0000 front 2024-09-19T05:00:48.230802+0000 (oldest deadline 2024-09-19T05:01:14.131054+0000) 2024-09-19T05:01:21.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:21 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:21.285+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:01:21.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:21 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:21.285+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.465788+0000 front 2024-09-19T05:00:56.465813+0000 (oldest deadline 2024-09-19T05:01:21.166043+0000) 2024-09-19T05:01:21.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:21 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:21.552+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:01:21.861 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 19 05:01:21 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-5[45954]: 2024-09-19T05:01:21.380+0000 7f4f165a6640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.076216+0000 front 2024-09-19T05:00:48.076323+0000 (oldest deadline 2024-09-19T05:01:12.775938+0000) 2024-09-19T05:01:21.861 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 19 05:01:21 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-5[45954]: 2024-09-19T05:01:21.380+0000 7f4f165a6640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.676988+0000 front 2024-09-19T05:00:58.676858+0000 (oldest deadline 2024-09-19T05:01:20.976959+0000) 2024-09-19T05:01:22.057 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:21 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:21.653+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.774268+0000 front 2024-09-19T05:00:56.774285+0000 (oldest deadline 2024-09-19T05:01:19.674420+0000) 2024-09-19T05:01:22.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:22 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:22.078+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.231030+0000 front 2024-09-19T05:00:48.230802+0000 (oldest deadline 2024-09-19T05:01:14.131054+0000) 2024-09-19T05:01:22.360 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:22 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:22.229+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.951676+0000 front 2024-09-19T05:00:50.951605+0000 (oldest deadline 2024-09-19T05:01:15.051789+0000) 2024-09-19T05:01:22.360 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:22 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:22.229+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:55.052267+0000 front 2024-09-19T05:00:55.052308+0000 (oldest deadline 2024-09-19T05:01:19.752480+0000) 2024-09-19T05:01:22.360 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:21 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:21.940+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.056022+0000 front 2024-09-19T05:00:57.056114+0000 (oldest deadline 2024-09-19T05:01:21.756148+0000) 2024-09-19T05:01:22.557 INFO:journalctl@ceph.osd.4.smithi018.stdout:Sep 19 05:01:22 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-4[45488]: 2024-09-19T05:01:22.094+0000 7f6645289640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.345214+0000 front 2024-09-19T05:00:58.345244+0000 (oldest deadline 2024-09-19T05:01:21.245417+0000) 2024-09-19T05:01:22.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:22 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:22.316+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:01:22.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:22 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:22.316+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.465788+0000 front 2024-09-19T05:00:56.465813+0000 (oldest deadline 2024-09-19T05:01:21.166043+0000) 2024-09-19T05:01:22.861 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 19 05:01:22 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-5[45954]: 2024-09-19T05:01:22.391+0000 7f4f165a6640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.076216+0000 front 2024-09-19T05:00:48.076323+0000 (oldest deadline 2024-09-19T05:01:12.775938+0000) 2024-09-19T05:01:22.861 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 19 05:01:22 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-5[45954]: 2024-09-19T05:01:22.391+0000 7f4f165a6640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.676988+0000 front 2024-09-19T05:00:58.676858+0000 (oldest deadline 2024-09-19T05:01:20.976959+0000) 2024-09-19T05:01:22.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:22 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:22.533+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:01:22.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:22 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:22.533+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:01:23.057 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:22 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:22.689+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.774268+0000 front 2024-09-19T05:00:56.774285+0000 (oldest deadline 2024-09-19T05:01:19.674420+0000) 2024-09-19T05:01:23.349 INFO:journalctl@ceph.osd.4.smithi018.stdout:Sep 19 05:01:23 smithi018 podman[71105]: 2024-09-19 05:01:23.210291272 +0000 UTC m=+5.587852691 container died 6d8bb99338c02194c7691fabde79348fc529a78ff7292b3a80e486bae3f624b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T05:01:23.360 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:23 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:23.243+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.951676+0000 front 2024-09-19T05:00:50.951605+0000 (oldest deadline 2024-09-19T05:01:15.051789+0000) 2024-09-19T05:01:23.360 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:23 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:23.243+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:55.052267+0000 front 2024-09-19T05:00:55.052308+0000 (oldest deadline 2024-09-19T05:01:19.752480+0000) 2024-09-19T05:01:23.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:23 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:23.084+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.231030+0000 front 2024-09-19T05:00:48.230802+0000 (oldest deadline 2024-09-19T05:01:14.131054+0000) 2024-09-19T05:01:23.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:23 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:23.084+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.232023+0000 front 2024-09-19T05:00:58.232160+0000 (oldest deadline 2024-09-19T05:01:22.332135+0000) 2024-09-19T05:01:23.360 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:22 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:22.898+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.056022+0000 front 2024-09-19T05:00:57.056114+0000 (oldest deadline 2024-09-19T05:01:21.756148+0000) 2024-09-19T05:01:23.653 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:23 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:23.348+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:01:23.653 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:23 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:23.348+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.465788+0000 front 2024-09-19T05:00:56.465813+0000 (oldest deadline 2024-09-19T05:01:21.166043+0000) 2024-09-19T05:01:23.653 INFO:journalctl@ceph.osd.4.smithi018.stdout:Sep 19 05:01:23 smithi018 podman[71105]: 2024-09-19 05:01:23.580722982 +0000 UTC m=+5.958284400 container cleanup 6d8bb99338c02194c7691fabde79348fc529a78ff7292b3a80e486bae3f624b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-4, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-19T05:01:23.654 INFO:journalctl@ceph.osd.4.smithi018.stdout:Sep 19 05:01:23 smithi018 bash[71105]: ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-4 2024-09-19T05:01:23.860 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 19 05:01:23 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-5[45954]: 2024-09-19T05:01:23.368+0000 7f4f165a6640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.076216+0000 front 2024-09-19T05:00:48.076323+0000 (oldest deadline 2024-09-19T05:01:12.775938+0000) 2024-09-19T05:01:23.861 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 19 05:01:23 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-5[45954]: 2024-09-19T05:01:23.368+0000 7f4f165a6640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.676988+0000 front 2024-09-19T05:00:58.676858+0000 (oldest deadline 2024-09-19T05:01:20.976959+0000) 2024-09-19T05:01:23.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:23 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:23.514+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:01:23.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:23 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:23.514+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:01:24.057 INFO:journalctl@ceph.osd.4.smithi018.stdout:Sep 19 05:01:23 smithi018 podman[71122]: 2024-09-19 05:01:23.831934422 +0000 UTC m=+0.620889586 container remove 6d8bb99338c02194c7691fabde79348fc529a78ff7292b3a80e486bae3f624b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-4, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-19T05:01:24.057 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:23 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:23.650+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.774268+0000 front 2024-09-19T05:00:56.774285+0000 (oldest deadline 2024-09-19T05:01:19.674420+0000) 2024-09-19T05:01:24.360 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:24 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:24.200+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.951676+0000 front 2024-09-19T05:00:50.951605+0000 (oldest deadline 2024-09-19T05:01:15.051789+0000) 2024-09-19T05:01:24.360 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:24 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:24.200+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:55.052267+0000 front 2024-09-19T05:00:55.052308+0000 (oldest deadline 2024-09-19T05:01:19.752480+0000) 2024-09-19T05:01:24.361 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:24 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:24.056+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.231030+0000 front 2024-09-19T05:00:48.230802+0000 (oldest deadline 2024-09-19T05:01:14.131054+0000) 2024-09-19T05:01:24.361 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:24 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:24.056+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.232023+0000 front 2024-09-19T05:00:58.232160+0000 (oldest deadline 2024-09-19T05:01:22.332135+0000) 2024-09-19T05:01:24.361 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:23 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:23.907+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.056022+0000 front 2024-09-19T05:00:57.056114+0000 (oldest deadline 2024-09-19T05:01:21.756148+0000) 2024-09-19T05:01:24.502 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:24 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:24.362+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:01:24.502 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:24 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:24.362+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.465788+0000 front 2024-09-19T05:00:56.465813+0000 (oldest deadline 2024-09-19T05:01:21.166043+0000) 2024-09-19T05:01:24.502 INFO:journalctl@ceph.osd.4.smithi018.stdout:Sep 19 05:01:24 smithi018 podman[71221]: 2024-09-19 05:01:24.101412222 +0000 UTC m=+0.016689184 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:01:24.503 INFO:journalctl@ceph.osd.4.smithi018.stdout:Sep 19 05:01:24 smithi018 podman[71221]: 2024-09-19 05:01:24.199564991 +0000 UTC m=+0.114841938 container create 68d721c9fe2f4054aedcebddf56af1ee923034ca81d3eef999cd2f8f252fbbb3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:01:24.503 INFO:journalctl@ceph.osd.4.smithi018.stdout:Sep 19 05:01:24 smithi018 podman[71221]: 2024-09-19 05:01:24.418697023 +0000 UTC m=+0.333973971 container init 68d721c9fe2f4054aedcebddf56af1ee923034ca81d3eef999cd2f8f252fbbb3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-19T05:01:24.503 INFO:journalctl@ceph.osd.4.smithi018.stdout:Sep 19 05:01:24 smithi018 podman[71221]: 2024-09-19 05:01:24.422271087 +0000 UTC m=+0.337548035 container start 68d721c9fe2f4054aedcebddf56af1ee923034ca81d3eef999cd2f8f252fbbb3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-2f599a4, ceph=True) 2024-09-19T05:01:24.503 INFO:journalctl@ceph.osd.4.smithi018.stdout:Sep 19 05:01:24 smithi018 podman[71221]: 2024-09-19 05:01:24.501665765 +0000 UTC m=+0.416942721 container attach 68d721c9fe2f4054aedcebddf56af1ee923034ca81d3eef999cd2f8f252fbbb3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4) 2024-09-19T05:01:24.807 INFO:journalctl@ceph.osd.4.smithi018.stdout:Sep 19 05:01:24 smithi018 podman[71221]: 2024-09-19 05:01:24.62031205 +0000 UTC m=+0.535589006 container died 68d721c9fe2f4054aedcebddf56af1ee923034ca81d3eef999cd2f8f252fbbb3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-19T05:01:24.807 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:24 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:24.678+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.774268+0000 front 2024-09-19T05:00:56.774285+0000 (oldest deadline 2024-09-19T05:01:19.674420+0000) 2024-09-19T05:01:24.861 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 19 05:01:24 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-5[45954]: 2024-09-19T05:01:24.415+0000 7f4f165a6640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.076216+0000 front 2024-09-19T05:00:48.076323+0000 (oldest deadline 2024-09-19T05:01:12.775938+0000) 2024-09-19T05:01:24.865 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 19 05:01:24 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-5[45954]: 2024-09-19T05:01:24.415+0000 7f4f165a6640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.676988+0000 front 2024-09-19T05:00:58.676858+0000 (oldest deadline 2024-09-19T05:01:20.976959+0000) 2024-09-19T05:01:24.865 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:24 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:24.563+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:01:24.865 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:24 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:24.563+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:01:25.249 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@osd.4.service' 2024-09-19T05:01:25.292 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:01:25.293 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-19T05:01:25.293 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-19T05:01:25.293 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-d46630c4-7640-11ef-bceb-c7b262605968@osd.5 2024-09-19T05:01:25.320 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:24 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:24.894+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.056022+0000 front 2024-09-19T05:00:57.056114+0000 (oldest deadline 2024-09-19T05:01:21.756148+0000) 2024-09-19T05:01:25.360 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:25 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:25.245+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.951676+0000 front 2024-09-19T05:00:50.951605+0000 (oldest deadline 2024-09-19T05:01:15.051789+0000) 2024-09-19T05:01:25.360 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:25 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:25.245+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:55.052267+0000 front 2024-09-19T05:00:55.052308+0000 (oldest deadline 2024-09-19T05:01:19.752480+0000) 2024-09-19T05:01:25.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:25 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:25.097+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.231030+0000 front 2024-09-19T05:00:48.230802+0000 (oldest deadline 2024-09-19T05:01:14.131054+0000) 2024-09-19T05:01:25.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:25 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:25.097+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.232023+0000 front 2024-09-19T05:00:58.232160+0000 (oldest deadline 2024-09-19T05:01:22.332135+0000) 2024-09-19T05:01:25.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:25 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:25.359+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:01:25.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:25 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:25.359+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.465788+0000 front 2024-09-19T05:00:56.465813+0000 (oldest deadline 2024-09-19T05:01:21.166043+0000) 2024-09-19T05:01:25.597 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:25 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:25.537+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:01:25.597 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:25 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:25.537+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:01:25.597 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 19 05:01:25 smithi116 systemd[1]: Stopping Ceph osd.5 for d46630c4-7640-11ef-bceb-c7b262605968... 2024-09-19T05:01:25.597 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 19 05:01:25 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-5[45954]: 2024-09-19T05:01:25.459+0000 7f4f165a6640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.076216+0000 front 2024-09-19T05:00:48.076323+0000 (oldest deadline 2024-09-19T05:01:12.775938+0000) 2024-09-19T05:01:25.597 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 19 05:01:25 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-5[45954]: 2024-09-19T05:01:25.459+0000 7f4f165a6640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.676988+0000 front 2024-09-19T05:00:58.676858+0000 (oldest deadline 2024-09-19T05:01:20.976959+0000) 2024-09-19T05:01:25.598 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 19 05:01:25 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-5[45954]: 2024-09-19T05:01:25.596+0000 7f4f19fa1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:01:25.598 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 19 05:01:25 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-5[45954]: 2024-09-19T05:01:25.596+0000 7f4f19fa1640 -1 osd.5 96 *** Got signal Terminated *** 2024-09-19T05:01:25.598 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 19 05:01:25 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-5[45954]: 2024-09-19T05:01:25.596+0000 7f4f19fa1640 -1 osd.5 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T05:01:26.057 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:25 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:25.630+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.774268+0000 front 2024-09-19T05:00:56.774285+0000 (oldest deadline 2024-09-19T05:01:19.674420+0000) 2024-09-19T05:01:26.360 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:26 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:26.199+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.951676+0000 front 2024-09-19T05:00:50.951605+0000 (oldest deadline 2024-09-19T05:01:15.051789+0000) 2024-09-19T05:01:26.360 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:26 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:26.199+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:55.052267+0000 front 2024-09-19T05:00:55.052308+0000 (oldest deadline 2024-09-19T05:01:19.752480+0000) 2024-09-19T05:01:26.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:26 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:26.053+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.231030+0000 front 2024-09-19T05:00:48.230802+0000 (oldest deadline 2024-09-19T05:01:14.131054+0000) 2024-09-19T05:01:26.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:26 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:26.053+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.232023+0000 front 2024-09-19T05:00:58.232160+0000 (oldest deadline 2024-09-19T05:01:22.332135+0000) 2024-09-19T05:01:26.361 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:25 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:25.923+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.056022+0000 front 2024-09-19T05:00:57.056114+0000 (oldest deadline 2024-09-19T05:01:21.756148+0000) 2024-09-19T05:01:26.603 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:26 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:26.326+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:01:26.603 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:26 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:26.326+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.465788+0000 front 2024-09-19T05:00:56.465813+0000 (oldest deadline 2024-09-19T05:01:21.166043+0000) 2024-09-19T05:01:26.760 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 19 05:01:26 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-5[45954]: 2024-09-19T05:01:26.444+0000 7f4f165a6640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.076216+0000 front 2024-09-19T05:00:48.076323+0000 (oldest deadline 2024-09-19T05:01:12.775938+0000) 2024-09-19T05:01:26.760 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 19 05:01:26 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-5[45954]: 2024-09-19T05:01:26.444+0000 7f4f165a6640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.676988+0000 front 2024-09-19T05:00:58.676858+0000 (oldest deadline 2024-09-19T05:01:20.976959+0000) 2024-09-19T05:01:26.760 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:26 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:26.495+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:01:26.760 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:26 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:26.495+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:01:27.057 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:26 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:26.601+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.774268+0000 front 2024-09-19T05:00:56.774285+0000 (oldest deadline 2024-09-19T05:01:19.674420+0000) 2024-09-19T05:01:27.110 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:26 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:26.920+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.056022+0000 front 2024-09-19T05:00:57.056114+0000 (oldest deadline 2024-09-19T05:01:21.756148+0000) 2024-09-19T05:01:27.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:27 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:27.070+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.231030+0000 front 2024-09-19T05:00:48.230802+0000 (oldest deadline 2024-09-19T05:01:14.131054+0000) 2024-09-19T05:01:27.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:27 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:27.070+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.232023+0000 front 2024-09-19T05:00:58.232160+0000 (oldest deadline 2024-09-19T05:01:22.332135+0000) 2024-09-19T05:01:27.360 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:27 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:27.221+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.951676+0000 front 2024-09-19T05:00:50.951605+0000 (oldest deadline 2024-09-19T05:01:15.051789+0000) 2024-09-19T05:01:27.360 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:27 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:27.221+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:55.052267+0000 front 2024-09-19T05:00:55.052308+0000 (oldest deadline 2024-09-19T05:01:19.752480+0000) 2024-09-19T05:01:27.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:27 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:27.283+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:01:27.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:27 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:27.283+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.465788+0000 front 2024-09-19T05:00:56.465813+0000 (oldest deadline 2024-09-19T05:01:21.166043+0000) 2024-09-19T05:01:27.860 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 19 05:01:27 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-5[45954]: 2024-09-19T05:01:27.440+0000 7f4f165a6640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.076216+0000 front 2024-09-19T05:00:48.076323+0000 (oldest deadline 2024-09-19T05:01:12.775938+0000) 2024-09-19T05:01:27.861 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 19 05:01:27 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-5[45954]: 2024-09-19T05:01:27.440+0000 7f4f165a6640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.676988+0000 front 2024-09-19T05:00:58.676858+0000 (oldest deadline 2024-09-19T05:01:20.976959+0000) 2024-09-19T05:01:27.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:27 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:27.501+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:01:27.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:27 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:27.501+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:01:28.057 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:27 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:27.618+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.774268+0000 front 2024-09-19T05:00:56.774285+0000 (oldest deadline 2024-09-19T05:01:19.674420+0000) 2024-09-19T05:01:28.360 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:28 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:28.265+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.951676+0000 front 2024-09-19T05:00:50.951605+0000 (oldest deadline 2024-09-19T05:01:15.051789+0000) 2024-09-19T05:01:28.360 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:28 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:28.265+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:55.052267+0000 front 2024-09-19T05:00:55.052308+0000 (oldest deadline 2024-09-19T05:01:19.752480+0000) 2024-09-19T05:01:28.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:28 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:28.079+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.231030+0000 front 2024-09-19T05:00:48.230802+0000 (oldest deadline 2024-09-19T05:01:14.131054+0000) 2024-09-19T05:01:28.361 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:28 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:28.079+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.232023+0000 front 2024-09-19T05:00:58.232160+0000 (oldest deadline 2024-09-19T05:01:22.332135+0000) 2024-09-19T05:01:28.361 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:27 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:27.895+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.056022+0000 front 2024-09-19T05:00:57.056114+0000 (oldest deadline 2024-09-19T05:01:21.756148+0000) 2024-09-19T05:01:28.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:28 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:28.289+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:01:28.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:28 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:28.289+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.465788+0000 front 2024-09-19T05:00:56.465813+0000 (oldest deadline 2024-09-19T05:01:21.166043+0000) 2024-09-19T05:01:28.852 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 19 05:01:28 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-5[45954]: 2024-09-19T05:01:28.416+0000 7f4f165a6640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.076216+0000 front 2024-09-19T05:00:48.076323+0000 (oldest deadline 2024-09-19T05:01:12.775938+0000) 2024-09-19T05:01:28.852 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 19 05:01:28 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-5[45954]: 2024-09-19T05:01:28.416+0000 7f4f165a6640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.676988+0000 front 2024-09-19T05:00:58.676858+0000 (oldest deadline 2024-09-19T05:01:20.976959+0000) 2024-09-19T05:01:28.852 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:28 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:28.487+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:01:28.852 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:28 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:28.487+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:01:29.057 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:28 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:28.624+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.774268+0000 front 2024-09-19T05:00:56.774285+0000 (oldest deadline 2024-09-19T05:01:19.674420+0000) 2024-09-19T05:01:29.110 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:28 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:28.851+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.056022+0000 front 2024-09-19T05:00:57.056114+0000 (oldest deadline 2024-09-19T05:01:21.756148+0000) 2024-09-19T05:01:29.360 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:29 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:29.311+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.951676+0000 front 2024-09-19T05:00:50.951605+0000 (oldest deadline 2024-09-19T05:01:15.051789+0000) 2024-09-19T05:01:29.360 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:29 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:29.311+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:55.052267+0000 front 2024-09-19T05:00:55.052308+0000 (oldest deadline 2024-09-19T05:01:19.752480+0000) 2024-09-19T05:01:29.360 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:29 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:29.311+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:05.653623+0000 front 2024-09-19T05:01:05.653692+0000 (oldest deadline 2024-09-19T05:01:28.553581+0000) 2024-09-19T05:01:29.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:29 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:29.079+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.231030+0000 front 2024-09-19T05:00:48.230802+0000 (oldest deadline 2024-09-19T05:01:14.131054+0000) 2024-09-19T05:01:29.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:29 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:29.079+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.232023+0000 front 2024-09-19T05:00:58.232160+0000 (oldest deadline 2024-09-19T05:01:22.332135+0000) 2024-09-19T05:01:29.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:29 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:29.079+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:02.332945+0000 front 2024-09-19T05:01:02.332803+0000 (oldest deadline 2024-09-19T05:01:28.733073+0000) 2024-09-19T05:01:29.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:29 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:29.269+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:01:29.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:29 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:29.269+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.465788+0000 front 2024-09-19T05:00:56.465813+0000 (oldest deadline 2024-09-19T05:01:21.166043+0000) 2024-09-19T05:01:29.860 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 19 05:01:29 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-5[45954]: 2024-09-19T05:01:29.417+0000 7f4f165a6640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.076216+0000 front 2024-09-19T05:00:48.076323+0000 (oldest deadline 2024-09-19T05:01:12.775938+0000) 2024-09-19T05:01:29.861 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 19 05:01:29 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-5[45954]: 2024-09-19T05:01:29.417+0000 7f4f165a6640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.676988+0000 front 2024-09-19T05:00:58.676858+0000 (oldest deadline 2024-09-19T05:01:20.976959+0000) 2024-09-19T05:01:29.861 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 19 05:01:29 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-5[45954]: 2024-09-19T05:01:29.417+0000 7f4f165a6640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:06.778511+0000 front 2024-09-19T05:01:06.778560+0000 (oldest deadline 2024-09-19T05:01:29.078770+0000) 2024-09-19T05:01:29.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:29 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:29.514+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:01:29.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:29 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:29.514+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:01:29.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:29 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:29.514+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.009788+0000 front 2024-09-19T05:01:04.009844+0000 (oldest deadline 2024-09-19T05:01:28.709792+0000) 2024-09-19T05:01:30.057 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:29 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:29.634+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.774268+0000 front 2024-09-19T05:00:56.774285+0000 (oldest deadline 2024-09-19T05:01:19.674420+0000) 2024-09-19T05:01:30.057 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:29 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:29.634+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:06.076024+0000 front 2024-09-19T05:01:06.075998+0000 (oldest deadline 2024-09-19T05:01:28.975895+0000) 2024-09-19T05:01:30.360 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:30 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:30.314+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.951676+0000 front 2024-09-19T05:00:50.951605+0000 (oldest deadline 2024-09-19T05:01:15.051789+0000) 2024-09-19T05:01:30.360 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:30 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:30.314+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:55.052267+0000 front 2024-09-19T05:00:55.052308+0000 (oldest deadline 2024-09-19T05:01:19.752480+0000) 2024-09-19T05:01:30.360 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:30 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:30.314+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:05.653623+0000 front 2024-09-19T05:01:05.653692+0000 (oldest deadline 2024-09-19T05:01:28.553581+0000) 2024-09-19T05:01:30.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:30 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:30.073+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.231030+0000 front 2024-09-19T05:00:48.230802+0000 (oldest deadline 2024-09-19T05:01:14.131054+0000) 2024-09-19T05:01:30.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:30 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:30.073+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.232023+0000 front 2024-09-19T05:00:58.232160+0000 (oldest deadline 2024-09-19T05:01:22.332135+0000) 2024-09-19T05:01:30.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:30 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:30.073+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:02.332945+0000 front 2024-09-19T05:01:02.332803+0000 (oldest deadline 2024-09-19T05:01:28.733073+0000) 2024-09-19T05:01:30.361 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:29 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:29.892+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.056022+0000 front 2024-09-19T05:00:57.056114+0000 (oldest deadline 2024-09-19T05:01:21.756148+0000) 2024-09-19T05:01:30.361 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:29 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:29.892+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.657044+0000 front 2024-09-19T05:01:04.657069+0000 (oldest deadline 2024-09-19T05:01:29.357253+0000) 2024-09-19T05:01:30.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:30 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:30.273+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:01:30.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:30 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:30.273+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.465788+0000 front 2024-09-19T05:00:56.465813+0000 (oldest deadline 2024-09-19T05:01:21.166043+0000) 2024-09-19T05:01:30.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:30 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:30.478+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:01:30.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:30 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:30.478+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:01:30.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:30 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:30.478+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.009788+0000 front 2024-09-19T05:01:04.009844+0000 (oldest deadline 2024-09-19T05:01:28.709792+0000) 2024-09-19T05:01:30.861 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 19 05:01:30 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-5[45954]: 2024-09-19T05:01:30.416+0000 7f4f165a6640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.076216+0000 front 2024-09-19T05:00:48.076323+0000 (oldest deadline 2024-09-19T05:01:12.775938+0000) 2024-09-19T05:01:30.861 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 19 05:01:30 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-5[45954]: 2024-09-19T05:01:30.416+0000 7f4f165a6640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.676988+0000 front 2024-09-19T05:00:58.676858+0000 (oldest deadline 2024-09-19T05:01:20.976959+0000) 2024-09-19T05:01:30.861 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 19 05:01:30 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-5[45954]: 2024-09-19T05:01:30.416+0000 7f4f165a6640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:06.778511+0000 front 2024-09-19T05:01:06.778560+0000 (oldest deadline 2024-09-19T05:01:29.078770+0000) 2024-09-19T05:01:31.057 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:30 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:30.595+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.774268+0000 front 2024-09-19T05:00:56.774285+0000 (oldest deadline 2024-09-19T05:01:19.674420+0000) 2024-09-19T05:01:31.057 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:30 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:30.595+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:06.076024+0000 front 2024-09-19T05:01:06.075998+0000 (oldest deadline 2024-09-19T05:01:28.975895+0000) 2024-09-19T05:01:31.239 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 19 05:01:30 smithi116 podman[70946]: 2024-09-19 05:01:30.993769724 +0000 UTC m=+5.509728938 container died dde79e36a871a7412137cd784e6bd792def2f739f8ac2c149e8b28cd197893d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-5, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-19T05:01:31.239 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:30 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:30.881+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.056022+0000 front 2024-09-19T05:00:57.056114+0000 (oldest deadline 2024-09-19T05:01:21.756148+0000) 2024-09-19T05:01:31.239 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:30 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:30.881+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.657044+0000 front 2024-09-19T05:01:04.657069+0000 (oldest deadline 2024-09-19T05:01:29.357253+0000) 2024-09-19T05:01:31.360 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:31 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:31.272+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.951676+0000 front 2024-09-19T05:00:50.951605+0000 (oldest deadline 2024-09-19T05:01:15.051789+0000) 2024-09-19T05:01:31.442 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:31 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:31.272+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:55.052267+0000 front 2024-09-19T05:00:55.052308+0000 (oldest deadline 2024-09-19T05:01:19.752480+0000) 2024-09-19T05:01:31.442 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:31 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:31.272+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:05.653623+0000 front 2024-09-19T05:01:05.653692+0000 (oldest deadline 2024-09-19T05:01:28.553581+0000) 2024-09-19T05:01:31.443 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:31 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:31.082+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.231030+0000 front 2024-09-19T05:00:48.230802+0000 (oldest deadline 2024-09-19T05:01:14.131054+0000) 2024-09-19T05:01:31.443 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:31 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:31.082+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.232023+0000 front 2024-09-19T05:00:58.232160+0000 (oldest deadline 2024-09-19T05:01:22.332135+0000) 2024-09-19T05:01:31.443 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:31 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:31.082+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:02.332945+0000 front 2024-09-19T05:01:02.332803+0000 (oldest deadline 2024-09-19T05:01:28.733073+0000) 2024-09-19T05:01:31.554 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:31 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:31.293+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:01:31.554 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:31 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:31.293+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.465788+0000 front 2024-09-19T05:00:56.465813+0000 (oldest deadline 2024-09-19T05:01:21.166043+0000) 2024-09-19T05:01:31.555 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:31 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:31.293+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:05.768290+0000 front 2024-09-19T05:01:05.768030+0000 (oldest deadline 2024-09-19T05:01:31.067908+0000) 2024-09-19T05:01:31.605 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 19 05:01:31 smithi116 podman[70946]: 2024-09-19 05:01:31.346589888 +0000 UTC m=+5.862549096 container cleanup dde79e36a871a7412137cd784e6bd792def2f739f8ac2c149e8b28cd197893d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0) 2024-09-19T05:01:31.606 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 19 05:01:31 smithi116 bash[70946]: ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-5 2024-09-19T05:01:31.606 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:31 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:31.441+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:01:31.606 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:31 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:31.441+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:01:31.606 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:31 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:31.441+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.009788+0000 front 2024-09-19T05:01:04.009844+0000 (oldest deadline 2024-09-19T05:01:28.709792+0000) 2024-09-19T05:01:31.807 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:31 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:31.551+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.774268+0000 front 2024-09-19T05:00:56.774285+0000 (oldest deadline 2024-09-19T05:01:19.674420+0000) 2024-09-19T05:01:31.807 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:31 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:31.551+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:06.076024+0000 front 2024-09-19T05:01:06.075998+0000 (oldest deadline 2024-09-19T05:01:28.975895+0000) 2024-09-19T05:01:31.861 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 19 05:01:31 smithi116 podman[70966]: 2024-09-19 05:01:31.597066654 +0000 UTC m=+0.599809572 container remove dde79e36a871a7412137cd784e6bd792def2f739f8ac2c149e8b28cd197893d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-5, RELEASE=squid-2f599a4, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True) 2024-09-19T05:01:32.159 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 19 05:01:31 smithi116 podman[71053]: 2024-09-19 05:01:31.814262711 +0000 UTC m=+0.015892308 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:01:32.159 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 19 05:01:31 smithi116 podman[71053]: 2024-09-19 05:01:31.923149635 +0000 UTC m=+0.124779265 container create 5915bf24ae27132e4ef82a9a4268c7f586e7602b1a8bd8643931274ffed3292d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-2f599a4) 2024-09-19T05:01:32.159 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:31 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:31.889+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.056022+0000 front 2024-09-19T05:00:57.056114+0000 (oldest deadline 2024-09-19T05:01:21.756148+0000) 2024-09-19T05:01:32.159 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:31 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:31.889+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.657044+0000 front 2024-09-19T05:01:04.657069+0000 (oldest deadline 2024-09-19T05:01:29.357253+0000) 2024-09-19T05:01:32.360 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:32 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:32.319+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.951676+0000 front 2024-09-19T05:00:50.951605+0000 (oldest deadline 2024-09-19T05:01:15.051789+0000) 2024-09-19T05:01:32.360 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:32 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:32.319+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:55.052267+0000 front 2024-09-19T05:00:55.052308+0000 (oldest deadline 2024-09-19T05:01:19.752480+0000) 2024-09-19T05:01:32.360 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:32 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:32.319+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:05.653623+0000 front 2024-09-19T05:01:05.653692+0000 (oldest deadline 2024-09-19T05:01:28.553581+0000) 2024-09-19T05:01:32.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:32 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:32.093+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.231030+0000 front 2024-09-19T05:00:48.230802+0000 (oldest deadline 2024-09-19T05:01:14.131054+0000) 2024-09-19T05:01:32.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:32 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:32.093+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.232023+0000 front 2024-09-19T05:00:58.232160+0000 (oldest deadline 2024-09-19T05:01:22.332135+0000) 2024-09-19T05:01:32.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:32 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:32.093+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:02.332945+0000 front 2024-09-19T05:01:02.332803+0000 (oldest deadline 2024-09-19T05:01:28.733073+0000) 2024-09-19T05:01:32.444 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 19 05:01:32 smithi116 podman[71053]: 2024-09-19 05:01:32.158823981 +0000 UTC m=+0.360453578 container init 5915bf24ae27132e4ef82a9a4268c7f586e7602b1a8bd8643931274ffed3292d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-5-deactivate, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-2f599a4) 2024-09-19T05:01:32.445 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 19 05:01:32 smithi116 podman[71053]: 2024-09-19 05:01:32.162182265 +0000 UTC m=+0.363811867 container start 5915bf24ae27132e4ef82a9a4268c7f586e7602b1a8bd8643931274ffed3292d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-19T05:01:32.445 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 19 05:01:32 smithi116 podman[71053]: 2024-09-19 05:01:32.242402679 +0000 UTC m=+0.444032277 container attach 5915bf24ae27132e4ef82a9a4268c7f586e7602b1a8bd8643931274ffed3292d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:01:32.445 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 19 05:01:32 smithi116 podman[71053]: 2024-09-19 05:01:32.349028119 +0000 UTC m=+0.550657718 container died 5915bf24ae27132e4ef82a9a4268c7f586e7602b1a8bd8643931274ffed3292d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-19T05:01:32.557 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:32 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:32.530+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.774268+0000 front 2024-09-19T05:00:56.774285+0000 (oldest deadline 2024-09-19T05:01:19.674420+0000) 2024-09-19T05:01:32.557 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:32 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:32.530+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:06.076024+0000 front 2024-09-19T05:01:06.075998+0000 (oldest deadline 2024-09-19T05:01:28.975895+0000) 2024-09-19T05:01:32.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:32 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:32.302+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:01:32.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:32 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:32.302+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.465788+0000 front 2024-09-19T05:00:56.465813+0000 (oldest deadline 2024-09-19T05:01:21.166043+0000) 2024-09-19T05:01:32.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:32 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:32.302+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:05.768290+0000 front 2024-09-19T05:01:05.768030+0000 (oldest deadline 2024-09-19T05:01:31.067908+0000) 2024-09-19T05:01:32.846 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:32 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:32.443+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:01:32.847 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:32 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:32.443+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:01:32.847 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:32 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:32.443+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.009788+0000 front 2024-09-19T05:01:04.009844+0000 (oldest deadline 2024-09-19T05:01:28.709792+0000) 2024-09-19T05:01:32.871 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@osd.5.service' 2024-09-19T05:01:32.952 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:01:32.952 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-19T05:01:32.952 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-19T05:01:32.952 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-d46630c4-7640-11ef-bceb-c7b262605968@osd.6 2024-09-19T05:01:33.110 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:32 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:32.866+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.056022+0000 front 2024-09-19T05:00:57.056114+0000 (oldest deadline 2024-09-19T05:01:21.756148+0000) 2024-09-19T05:01:33.111 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:32 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:32.866+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.657044+0000 front 2024-09-19T05:01:04.657069+0000 (oldest deadline 2024-09-19T05:01:29.357253+0000) 2024-09-19T05:01:33.284 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:33 smithi002 systemd[1]: Stopping Ceph osd.6 for d46630c4-7640-11ef-bceb-c7b262605968... 2024-09-19T05:01:33.284 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:33 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:33.048+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.231030+0000 front 2024-09-19T05:00:48.230802+0000 (oldest deadline 2024-09-19T05:01:14.131054+0000) 2024-09-19T05:01:33.284 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:33 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:33.048+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.232023+0000 front 2024-09-19T05:00:58.232160+0000 (oldest deadline 2024-09-19T05:01:22.332135+0000) 2024-09-19T05:01:33.284 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:33 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:33.048+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:02.332945+0000 front 2024-09-19T05:01:02.332803+0000 (oldest deadline 2024-09-19T05:01:28.733073+0000) 2024-09-19T05:01:33.557 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:33 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:33.506+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.774268+0000 front 2024-09-19T05:00:56.774285+0000 (oldest deadline 2024-09-19T05:01:19.674420+0000) 2024-09-19T05:01:33.557 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:33 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:33.506+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:06.076024+0000 front 2024-09-19T05:01:06.075998+0000 (oldest deadline 2024-09-19T05:01:28.975895+0000) 2024-09-19T05:01:33.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:33 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:33.259+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:01:33.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:33 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:33.259+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.465788+0000 front 2024-09-19T05:00:56.465813+0000 (oldest deadline 2024-09-19T05:01:21.166043+0000) 2024-09-19T05:01:33.558 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:33 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:33.259+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:05.768290+0000 front 2024-09-19T05:01:05.768030+0000 (oldest deadline 2024-09-19T05:01:31.067908+0000) 2024-09-19T05:01:33.610 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:33 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:33.282+0000 7fa36f71b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:01:33.610 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:33 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:33.282+0000 7fa36f71b640 -1 osd.6 96 *** Got signal Terminated *** 2024-09-19T05:01:33.610 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:33 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:33.282+0000 7fa36f71b640 -1 osd.6 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T05:01:33.610 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:33 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:33.285+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.951676+0000 front 2024-09-19T05:00:50.951605+0000 (oldest deadline 2024-09-19T05:01:15.051789+0000) 2024-09-19T05:01:33.610 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:33 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:33.285+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:55.052267+0000 front 2024-09-19T05:00:55.052308+0000 (oldest deadline 2024-09-19T05:01:19.752480+0000) 2024-09-19T05:01:33.610 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:33 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:33.285+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:05.653623+0000 front 2024-09-19T05:01:05.653692+0000 (oldest deadline 2024-09-19T05:01:28.553581+0000) 2024-09-19T05:01:33.860 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:33 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:33.446+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:01:33.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:33 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:33.446+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:01:33.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:33 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:33.446+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.009788+0000 front 2024-09-19T05:01:04.009844+0000 (oldest deadline 2024-09-19T05:01:28.709792+0000) 2024-09-19T05:01:34.334 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:34 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:34.008+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.231030+0000 front 2024-09-19T05:00:48.230802+0000 (oldest deadline 2024-09-19T05:01:14.131054+0000) 2024-09-19T05:01:34.334 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:34 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:34.008+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.232023+0000 front 2024-09-19T05:00:58.232160+0000 (oldest deadline 2024-09-19T05:01:22.332135+0000) 2024-09-19T05:01:34.335 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:34 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:34.008+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:02.332945+0000 front 2024-09-19T05:01:02.332803+0000 (oldest deadline 2024-09-19T05:01:28.733073+0000) 2024-09-19T05:01:34.361 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:33 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:33.906+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.056022+0000 front 2024-09-19T05:00:57.056114+0000 (oldest deadline 2024-09-19T05:01:21.756148+0000) 2024-09-19T05:01:34.361 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:33 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:33.906+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.657044+0000 front 2024-09-19T05:01:04.657069+0000 (oldest deadline 2024-09-19T05:01:29.357253+0000) 2024-09-19T05:01:34.535 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:34 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:34.229+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:01:34.535 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:34 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:34.229+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.465788+0000 front 2024-09-19T05:00:56.465813+0000 (oldest deadline 2024-09-19T05:01:21.166043+0000) 2024-09-19T05:01:34.536 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:34 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:34.229+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:05.768290+0000 front 2024-09-19T05:01:05.768030+0000 (oldest deadline 2024-09-19T05:01:31.067908+0000) 2024-09-19T05:01:34.610 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:34 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:34.333+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.951676+0000 front 2024-09-19T05:00:50.951605+0000 (oldest deadline 2024-09-19T05:01:15.051789+0000) 2024-09-19T05:01:34.610 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:34 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:34.333+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:55.052267+0000 front 2024-09-19T05:00:55.052308+0000 (oldest deadline 2024-09-19T05:01:19.752480+0000) 2024-09-19T05:01:34.610 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:34 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:34.333+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:05.653623+0000 front 2024-09-19T05:01:05.653692+0000 (oldest deadline 2024-09-19T05:01:28.553581+0000) 2024-09-19T05:01:34.807 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:34 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:34.534+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.774268+0000 front 2024-09-19T05:00:56.774285+0000 (oldest deadline 2024-09-19T05:01:19.674420+0000) 2024-09-19T05:01:34.807 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:34 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:34.534+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:06.076024+0000 front 2024-09-19T05:01:06.075998+0000 (oldest deadline 2024-09-19T05:01:28.975895+0000) 2024-09-19T05:01:34.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:34 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:34.432+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:01:34.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:34 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:34.432+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:01:34.862 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:34 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:34.432+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.009788+0000 front 2024-09-19T05:01:04.009844+0000 (oldest deadline 2024-09-19T05:01:28.709792+0000) 2024-09-19T05:01:35.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:35 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:35.001+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.231030+0000 front 2024-09-19T05:00:48.230802+0000 (oldest deadline 2024-09-19T05:01:14.131054+0000) 2024-09-19T05:01:35.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:35 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:35.001+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.232023+0000 front 2024-09-19T05:00:58.232160+0000 (oldest deadline 2024-09-19T05:01:22.332135+0000) 2024-09-19T05:01:35.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:35 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:35.001+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:02.332945+0000 front 2024-09-19T05:01:02.332803+0000 (oldest deadline 2024-09-19T05:01:28.733073+0000) 2024-09-19T05:01:35.361 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:34 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:34.867+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.056022+0000 front 2024-09-19T05:00:57.056114+0000 (oldest deadline 2024-09-19T05:01:21.756148+0000) 2024-09-19T05:01:35.361 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:34 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:34.867+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.657044+0000 front 2024-09-19T05:01:04.657069+0000 (oldest deadline 2024-09-19T05:01:29.357253+0000) 2024-09-19T05:01:35.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:35 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:35.229+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:01:35.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:35 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:35.229+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.465788+0000 front 2024-09-19T05:00:56.465813+0000 (oldest deadline 2024-09-19T05:01:21.166043+0000) 2024-09-19T05:01:35.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:35 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:35.229+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:05.768290+0000 front 2024-09-19T05:01:05.768030+0000 (oldest deadline 2024-09-19T05:01:31.067908+0000) 2024-09-19T05:01:35.860 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:35 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:35.368+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.951676+0000 front 2024-09-19T05:00:50.951605+0000 (oldest deadline 2024-09-19T05:01:15.051789+0000) 2024-09-19T05:01:35.860 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:35 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:35.368+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:55.052267+0000 front 2024-09-19T05:00:55.052308+0000 (oldest deadline 2024-09-19T05:01:19.752480+0000) 2024-09-19T05:01:35.860 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:35 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:35.368+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:05.653623+0000 front 2024-09-19T05:01:05.653692+0000 (oldest deadline 2024-09-19T05:01:28.553581+0000) 2024-09-19T05:01:35.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:35 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:35.477+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:01:35.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:35 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:35.477+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:01:35.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:35 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:35.477+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.009788+0000 front 2024-09-19T05:01:04.009844+0000 (oldest deadline 2024-09-19T05:01:28.709792+0000) 2024-09-19T05:01:36.057 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:35 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:35.564+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.774268+0000 front 2024-09-19T05:00:56.774285+0000 (oldest deadline 2024-09-19T05:01:19.674420+0000) 2024-09-19T05:01:36.057 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:35 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:35.564+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:06.076024+0000 front 2024-09-19T05:01:06.075998+0000 (oldest deadline 2024-09-19T05:01:28.975895+0000) 2024-09-19T05:01:36.354 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:35 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:35.990+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.231030+0000 front 2024-09-19T05:00:48.230802+0000 (oldest deadline 2024-09-19T05:01:14.131054+0000) 2024-09-19T05:01:36.354 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:35 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:35.990+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.232023+0000 front 2024-09-19T05:00:58.232160+0000 (oldest deadline 2024-09-19T05:01:22.332135+0000) 2024-09-19T05:01:36.355 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:35 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:35.990+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:02.332945+0000 front 2024-09-19T05:01:02.332803+0000 (oldest deadline 2024-09-19T05:01:28.733073+0000) 2024-09-19T05:01:36.360 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:35 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:35.912+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.056022+0000 front 2024-09-19T05:00:57.056114+0000 (oldest deadline 2024-09-19T05:01:21.756148+0000) 2024-09-19T05:01:36.360 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:35 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:35.912+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.657044+0000 front 2024-09-19T05:01:04.657069+0000 (oldest deadline 2024-09-19T05:01:29.357253+0000) 2024-09-19T05:01:36.519 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:36 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:36.225+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:01:36.519 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:36 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:36.225+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.465788+0000 front 2024-09-19T05:00:56.465813+0000 (oldest deadline 2024-09-19T05:01:21.166043+0000) 2024-09-19T05:01:36.519 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:36 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:36.225+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:05.768290+0000 front 2024-09-19T05:01:05.768030+0000 (oldest deadline 2024-09-19T05:01:31.067908+0000) 2024-09-19T05:01:36.610 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:36 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:36.353+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.951676+0000 front 2024-09-19T05:00:50.951605+0000 (oldest deadline 2024-09-19T05:01:15.051789+0000) 2024-09-19T05:01:36.610 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:36 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:36.353+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:55.052267+0000 front 2024-09-19T05:00:55.052308+0000 (oldest deadline 2024-09-19T05:01:19.752480+0000) 2024-09-19T05:01:36.610 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:36 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:36.353+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:05.653623+0000 front 2024-09-19T05:01:05.653692+0000 (oldest deadline 2024-09-19T05:01:28.553581+0000) 2024-09-19T05:01:36.807 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:36 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:36.517+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.774268+0000 front 2024-09-19T05:00:56.774285+0000 (oldest deadline 2024-09-19T05:01:19.674420+0000) 2024-09-19T05:01:36.807 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:36 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:36.517+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:06.076024+0000 front 2024-09-19T05:01:06.075998+0000 (oldest deadline 2024-09-19T05:01:28.975895+0000) 2024-09-19T05:01:36.860 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:36 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:36.467+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:01:36.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:36 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:36.467+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:01:36.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:36 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:36.467+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.009788+0000 front 2024-09-19T05:01:04.009844+0000 (oldest deadline 2024-09-19T05:01:28.709792+0000) 2024-09-19T05:01:37.330 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:37 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:37.035+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.231030+0000 front 2024-09-19T05:00:48.230802+0000 (oldest deadline 2024-09-19T05:01:14.131054+0000) 2024-09-19T05:01:37.330 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:37 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:37.035+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.232023+0000 front 2024-09-19T05:00:58.232160+0000 (oldest deadline 2024-09-19T05:01:22.332135+0000) 2024-09-19T05:01:37.330 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:37 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:37.035+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:02.332945+0000 front 2024-09-19T05:01:02.332803+0000 (oldest deadline 2024-09-19T05:01:28.733073+0000) 2024-09-19T05:01:37.330 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:37 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:37.035+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:13.934098+0000 front 2024-09-19T05:01:13.934134+0000 (oldest deadline 2024-09-19T05:01:36.834314+0000) 2024-09-19T05:01:37.360 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:36 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:36.942+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.056022+0000 front 2024-09-19T05:00:57.056114+0000 (oldest deadline 2024-09-19T05:01:21.756148+0000) 2024-09-19T05:01:37.361 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:36 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:36.942+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.657044+0000 front 2024-09-19T05:01:04.657069+0000 (oldest deadline 2024-09-19T05:01:29.357253+0000) 2024-09-19T05:01:37.550 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:37 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:37.257+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:01:37.550 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:37 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:37.257+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.465788+0000 front 2024-09-19T05:00:56.465813+0000 (oldest deadline 2024-09-19T05:01:21.166043+0000) 2024-09-19T05:01:37.550 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:37 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:37.257+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:05.768290+0000 front 2024-09-19T05:01:05.768030+0000 (oldest deadline 2024-09-19T05:01:31.067908+0000) 2024-09-19T05:01:37.550 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:37 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:37.257+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.768950+0000 front 2024-09-19T05:01:12.769033+0000 (oldest deadline 2024-09-19T05:01:36.268756+0000) 2024-09-19T05:01:37.610 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:37 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:37.329+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.951676+0000 front 2024-09-19T05:00:50.951605+0000 (oldest deadline 2024-09-19T05:01:15.051789+0000) 2024-09-19T05:01:37.610 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:37 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:37.329+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:55.052267+0000 front 2024-09-19T05:00:55.052308+0000 (oldest deadline 2024-09-19T05:01:19.752480+0000) 2024-09-19T05:01:37.610 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:37 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:37.329+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:05.653623+0000 front 2024-09-19T05:01:05.653692+0000 (oldest deadline 2024-09-19T05:01:28.553581+0000) 2024-09-19T05:01:37.610 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:37 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6[58152]: 2024-09-19T05:01:37.329+0000 7fa367d18640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.555026+0000 front 2024-09-19T05:01:12.555112+0000 (oldest deadline 2024-09-19T05:01:37.255014+0000) 2024-09-19T05:01:37.807 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:37 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:37.549+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.774268+0000 front 2024-09-19T05:00:56.774285+0000 (oldest deadline 2024-09-19T05:01:19.674420+0000) 2024-09-19T05:01:37.807 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:37 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:37.549+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:06.076024+0000 front 2024-09-19T05:01:06.075998+0000 (oldest deadline 2024-09-19T05:01:28.975895+0000) 2024-09-19T05:01:37.860 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:37 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:37.452+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:01:37.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:37 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:37.452+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:01:37.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:37 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:37.452+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.009788+0000 front 2024-09-19T05:01:04.009844+0000 (oldest deadline 2024-09-19T05:01:28.709792+0000) 2024-09-19T05:01:38.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:38 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:38.062+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.231030+0000 front 2024-09-19T05:00:48.230802+0000 (oldest deadline 2024-09-19T05:01:14.131054+0000) 2024-09-19T05:01:38.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:38 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:38.062+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.232023+0000 front 2024-09-19T05:00:58.232160+0000 (oldest deadline 2024-09-19T05:01:22.332135+0000) 2024-09-19T05:01:38.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:38 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:38.062+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:02.332945+0000 front 2024-09-19T05:01:02.332803+0000 (oldest deadline 2024-09-19T05:01:28.733073+0000) 2024-09-19T05:01:38.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:38 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:38.062+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:13.934098+0000 front 2024-09-19T05:01:13.934134+0000 (oldest deadline 2024-09-19T05:01:36.834314+0000) 2024-09-19T05:01:38.361 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:37 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:37.971+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.056022+0000 front 2024-09-19T05:00:57.056114+0000 (oldest deadline 2024-09-19T05:01:21.756148+0000) 2024-09-19T05:01:38.361 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:37 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:37.971+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.657044+0000 front 2024-09-19T05:01:04.657069+0000 (oldest deadline 2024-09-19T05:01:29.357253+0000) 2024-09-19T05:01:38.361 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:37 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:37.971+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.758896+0000 front 2024-09-19T05:01:12.758940+0000 (oldest deadline 2024-09-19T05:01:37.458850+0000) 2024-09-19T05:01:38.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:38 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:38.220+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:01:38.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:38 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:38.220+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.465788+0000 front 2024-09-19T05:00:56.465813+0000 (oldest deadline 2024-09-19T05:01:21.166043+0000) 2024-09-19T05:01:38.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:38 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:38.220+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:05.768290+0000 front 2024-09-19T05:01:05.768030+0000 (oldest deadline 2024-09-19T05:01:31.067908+0000) 2024-09-19T05:01:38.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:38 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:38.220+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.768950+0000 front 2024-09-19T05:01:12.769033+0000 (oldest deadline 2024-09-19T05:01:36.268756+0000) 2024-09-19T05:01:38.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:38 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:38.452+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:01:38.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:38 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:38.452+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:01:38.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:38 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:38.452+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.009788+0000 front 2024-09-19T05:01:04.009844+0000 (oldest deadline 2024-09-19T05:01:28.709792+0000) 2024-09-19T05:01:38.976 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:38 smithi002 podman[104166]: 2024-09-19 05:01:38.692917988 +0000 UTC m=+5.534258727 container died 2845620210acb803e904d90f3a53745b423fb047e20e8fae0800d34090b0e489 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-19T05:01:39.057 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:38 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:38.572+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.774268+0000 front 2024-09-19T05:00:56.774285+0000 (oldest deadline 2024-09-19T05:01:19.674420+0000) 2024-09-19T05:01:39.057 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:38 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:38.572+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:06.076024+0000 front 2024-09-19T05:01:06.075998+0000 (oldest deadline 2024-09-19T05:01:28.975895+0000) 2024-09-19T05:01:39.360 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:39 smithi002 podman[104166]: 2024-09-19 05:01:39.157817427 +0000 UTC m=+5.999158160 container cleanup 2845620210acb803e904d90f3a53745b423fb047e20e8fae0800d34090b0e489 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-19T05:01:39.360 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:39 smithi002 bash[104166]: ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6 2024-09-19T05:01:39.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:39 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:39.069+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.231030+0000 front 2024-09-19T05:00:48.230802+0000 (oldest deadline 2024-09-19T05:01:14.131054+0000) 2024-09-19T05:01:39.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:39 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:39.069+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.232023+0000 front 2024-09-19T05:00:58.232160+0000 (oldest deadline 2024-09-19T05:01:22.332135+0000) 2024-09-19T05:01:39.361 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:39 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:39.069+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:02.332945+0000 front 2024-09-19T05:01:02.332803+0000 (oldest deadline 2024-09-19T05:01:28.733073+0000) 2024-09-19T05:01:39.361 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:39 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:39.069+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:13.934098+0000 front 2024-09-19T05:01:13.934134+0000 (oldest deadline 2024-09-19T05:01:36.834314+0000) 2024-09-19T05:01:39.361 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:38 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:38.923+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.056022+0000 front 2024-09-19T05:00:57.056114+0000 (oldest deadline 2024-09-19T05:01:21.756148+0000) 2024-09-19T05:01:39.361 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:38 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:38.923+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.657044+0000 front 2024-09-19T05:01:04.657069+0000 (oldest deadline 2024-09-19T05:01:29.357253+0000) 2024-09-19T05:01:39.361 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:38 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:38.923+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.758896+0000 front 2024-09-19T05:01:12.758940+0000 (oldest deadline 2024-09-19T05:01:37.458850+0000) 2024-09-19T05:01:39.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:39 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:39.254+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:01:39.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:39 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:39.254+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.465788+0000 front 2024-09-19T05:00:56.465813+0000 (oldest deadline 2024-09-19T05:01:21.166043+0000) 2024-09-19T05:01:39.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:39 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:39.254+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:05.768290+0000 front 2024-09-19T05:01:05.768030+0000 (oldest deadline 2024-09-19T05:01:31.067908+0000) 2024-09-19T05:01:39.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:39 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:39.254+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.768950+0000 front 2024-09-19T05:01:12.769033+0000 (oldest deadline 2024-09-19T05:01:36.268756+0000) 2024-09-19T05:01:39.836 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:39 smithi002 podman[104181]: 2024-09-19 05:01:39.467784449 +0000 UTC m=+0.772156677 container remove 2845620210acb803e904d90f3a53745b423fb047e20e8fae0800d34090b0e489 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4) 2024-09-19T05:01:39.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:39 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:39.475+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:01:39.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:39 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:39.475+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:01:39.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:39 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:39.475+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.009788+0000 front 2024-09-19T05:01:04.009844+0000 (oldest deadline 2024-09-19T05:01:28.709792+0000) 2024-09-19T05:01:39.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:39 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:39.475+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:14.010849+0000 front 2024-09-19T05:01:14.010831+0000 (oldest deadline 2024-09-19T05:01:38.710587+0000) 2024-09-19T05:01:40.057 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:39 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:39.598+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.774268+0000 front 2024-09-19T05:00:56.774285+0000 (oldest deadline 2024-09-19T05:01:19.674420+0000) 2024-09-19T05:01:40.057 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:39 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:39.598+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:06.076024+0000 front 2024-09-19T05:01:06.075998+0000 (oldest deadline 2024-09-19T05:01:28.975895+0000) 2024-09-19T05:01:40.057 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:39 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:39.598+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:14.276988+0000 front 2024-09-19T05:01:14.277014+0000 (oldest deadline 2024-09-19T05:01:39.576671+0000) 2024-09-19T05:01:40.110 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:40 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:40.045+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.231030+0000 front 2024-09-19T05:00:48.230802+0000 (oldest deadline 2024-09-19T05:01:14.131054+0000) 2024-09-19T05:01:40.110 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:40 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:40.045+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.232023+0000 front 2024-09-19T05:00:58.232160+0000 (oldest deadline 2024-09-19T05:01:22.332135+0000) 2024-09-19T05:01:40.110 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:40 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:40.045+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:02.332945+0000 front 2024-09-19T05:01:02.332803+0000 (oldest deadline 2024-09-19T05:01:28.733073+0000) 2024-09-19T05:01:40.110 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:40 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:40.045+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:13.934098+0000 front 2024-09-19T05:01:13.934134+0000 (oldest deadline 2024-09-19T05:01:36.834314+0000) 2024-09-19T05:01:40.110 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:39 smithi002 podman[104266]: 2024-09-19 05:01:39.835313805 +0000 UTC m=+0.109267239 container create dbddbf571ae1c3e2b613cb734c033c374340c36b81e68cf4b88300ce7c660e31 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6-deactivate, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4) 2024-09-19T05:01:40.111 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:39 smithi002 podman[104266]: 2024-09-19 05:01:39.74276001 +0000 UTC m=+0.016713422 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:01:40.111 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:40 smithi002 podman[104266]: 2024-09-19 05:01:40.054515204 +0000 UTC m=+0.328468616 container init dbddbf571ae1c3e2b613cb734c033c374340c36b81e68cf4b88300ce7c660e31 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0) 2024-09-19T05:01:40.111 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:40 smithi002 podman[104266]: 2024-09-19 05:01:40.058018038 +0000 UTC m=+0.331971436 container start dbddbf571ae1c3e2b613cb734c033c374340c36b81e68cf4b88300ce7c660e31 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-19T05:01:40.361 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:39 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:39.894+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.056022+0000 front 2024-09-19T05:00:57.056114+0000 (oldest deadline 2024-09-19T05:01:21.756148+0000) 2024-09-19T05:01:40.361 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:39 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:39.894+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.657044+0000 front 2024-09-19T05:01:04.657069+0000 (oldest deadline 2024-09-19T05:01:29.357253+0000) 2024-09-19T05:01:40.361 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:39 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:39.894+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.758896+0000 front 2024-09-19T05:01:12.758940+0000 (oldest deadline 2024-09-19T05:01:37.458850+0000) 2024-09-19T05:01:40.529 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:40 smithi002 podman[104266]: 2024-09-19 05:01:40.1295152 +0000 UTC m=+0.403468606 container attach dbddbf571ae1c3e2b613cb734c033c374340c36b81e68cf4b88300ce7c660e31 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:01:40.529 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 05:01:40 smithi002 podman[104266]: 2024-09-19 05:01:40.248898562 +0000 UTC m=+0.522851963 container died dbddbf571ae1c3e2b613cb734c033c374340c36b81e68cf4b88300ce7c660e31 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-6-deactivate, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-19T05:01:40.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:40 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:40.304+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:01:40.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:40 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:40.304+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.465788+0000 front 2024-09-19T05:00:56.465813+0000 (oldest deadline 2024-09-19T05:01:21.166043+0000) 2024-09-19T05:01:40.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:40 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:40.304+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:05.768290+0000 front 2024-09-19T05:01:05.768030+0000 (oldest deadline 2024-09-19T05:01:31.067908+0000) 2024-09-19T05:01:40.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:40 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:40.304+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.768950+0000 front 2024-09-19T05:01:12.769033+0000 (oldest deadline 2024-09-19T05:01:36.268756+0000) 2024-09-19T05:01:40.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:40 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:40.468+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:01:40.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:40 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:40.468+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:01:40.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:40 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:40.468+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.009788+0000 front 2024-09-19T05:01:04.009844+0000 (oldest deadline 2024-09-19T05:01:28.709792+0000) 2024-09-19T05:01:40.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:40 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:40.468+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:14.010849+0000 front 2024-09-19T05:01:14.010831+0000 (oldest deadline 2024-09-19T05:01:38.710587+0000) 2024-09-19T05:01:40.897 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@osd.6.service' 2024-09-19T05:01:40.937 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:01:40.937 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-19T05:01:40.938 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-19T05:01:40.938 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-d46630c4-7640-11ef-bceb-c7b262605968@osd.7 2024-09-19T05:01:40.965 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:40 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:40.587+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.774268+0000 front 2024-09-19T05:00:56.774285+0000 (oldest deadline 2024-09-19T05:01:19.674420+0000) 2024-09-19T05:01:40.966 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:40 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:40.587+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:06.076024+0000 front 2024-09-19T05:01:06.075998+0000 (oldest deadline 2024-09-19T05:01:28.975895+0000) 2024-09-19T05:01:40.966 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:40 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:40.587+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:14.276988+0000 front 2024-09-19T05:01:14.277014+0000 (oldest deadline 2024-09-19T05:01:39.576671+0000) 2024-09-19T05:01:41.241 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:40 smithi018 systemd[1]: Stopping Ceph osd.7 for d46630c4-7640-11ef-bceb-c7b262605968... 2024-09-19T05:01:41.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:41 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:41.073+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.231030+0000 front 2024-09-19T05:00:48.230802+0000 (oldest deadline 2024-09-19T05:01:14.131054+0000) 2024-09-19T05:01:41.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:41 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:41.073+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.232023+0000 front 2024-09-19T05:00:58.232160+0000 (oldest deadline 2024-09-19T05:01:22.332135+0000) 2024-09-19T05:01:41.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:41 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:41.073+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:02.332945+0000 front 2024-09-19T05:01:02.332803+0000 (oldest deadline 2024-09-19T05:01:28.733073+0000) 2024-09-19T05:01:41.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:41 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:41.073+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:13.934098+0000 front 2024-09-19T05:01:13.934134+0000 (oldest deadline 2024-09-19T05:01:36.834314+0000) 2024-09-19T05:01:41.361 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:40 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:40.875+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.056022+0000 front 2024-09-19T05:00:57.056114+0000 (oldest deadline 2024-09-19T05:01:21.756148+0000) 2024-09-19T05:01:41.361 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:40 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:40.875+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.657044+0000 front 2024-09-19T05:01:04.657069+0000 (oldest deadline 2024-09-19T05:01:29.357253+0000) 2024-09-19T05:01:41.361 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:40 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:40.875+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.758896+0000 front 2024-09-19T05:01:12.758940+0000 (oldest deadline 2024-09-19T05:01:37.458850+0000) 2024-09-19T05:01:41.543 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:41 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:41.239+0000 7f16e9fa1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:01:41.543 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:41 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:41.239+0000 7f16e9fa1640 -1 osd.7 96 *** Got signal Terminated *** 2024-09-19T05:01:41.543 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:41 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:41.239+0000 7f16e9fa1640 -1 osd.7 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T05:01:41.543 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:41 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:41.542+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.774268+0000 front 2024-09-19T05:00:56.774285+0000 (oldest deadline 2024-09-19T05:01:19.674420+0000) 2024-09-19T05:01:41.543 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:41 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:41.542+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:06.076024+0000 front 2024-09-19T05:01:06.075998+0000 (oldest deadline 2024-09-19T05:01:28.975895+0000) 2024-09-19T05:01:41.544 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:41 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:41.353+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:01:41.544 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:41 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:41.353+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.465788+0000 front 2024-09-19T05:00:56.465813+0000 (oldest deadline 2024-09-19T05:01:21.166043+0000) 2024-09-19T05:01:41.544 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:41 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:41.353+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:05.768290+0000 front 2024-09-19T05:01:05.768030+0000 (oldest deadline 2024-09-19T05:01:31.067908+0000) 2024-09-19T05:01:41.544 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:41 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:41.353+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.768950+0000 front 2024-09-19T05:01:12.769033+0000 (oldest deadline 2024-09-19T05:01:36.268756+0000) 2024-09-19T05:01:41.807 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:41 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:41.542+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:14.276988+0000 front 2024-09-19T05:01:14.277014+0000 (oldest deadline 2024-09-19T05:01:39.576671+0000) 2024-09-19T05:01:41.827 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:41 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:41.495+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:01:41.827 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:41 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:41.495+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:01:41.828 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:41 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:41.495+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.009788+0000 front 2024-09-19T05:01:04.009844+0000 (oldest deadline 2024-09-19T05:01:28.709792+0000) 2024-09-19T05:01:41.828 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:41 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:41.495+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:14.010849+0000 front 2024-09-19T05:01:14.010831+0000 (oldest deadline 2024-09-19T05:01:38.710587+0000) 2024-09-19T05:01:42.110 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:41 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:41.826+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.056022+0000 front 2024-09-19T05:00:57.056114+0000 (oldest deadline 2024-09-19T05:01:21.756148+0000) 2024-09-19T05:01:42.110 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:41 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:41.826+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.657044+0000 front 2024-09-19T05:01:04.657069+0000 (oldest deadline 2024-09-19T05:01:29.357253+0000) 2024-09-19T05:01:42.111 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:41 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:41.826+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.758896+0000 front 2024-09-19T05:01:12.758940+0000 (oldest deadline 2024-09-19T05:01:37.458850+0000) 2024-09-19T05:01:42.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:42 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:42.106+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.231030+0000 front 2024-09-19T05:00:48.230802+0000 (oldest deadline 2024-09-19T05:01:14.131054+0000) 2024-09-19T05:01:42.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:42 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:42.106+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.232023+0000 front 2024-09-19T05:00:58.232160+0000 (oldest deadline 2024-09-19T05:01:22.332135+0000) 2024-09-19T05:01:42.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:42 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:42.106+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:02.332945+0000 front 2024-09-19T05:01:02.332803+0000 (oldest deadline 2024-09-19T05:01:28.733073+0000) 2024-09-19T05:01:42.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:42 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:42.106+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:13.934098+0000 front 2024-09-19T05:01:13.934134+0000 (oldest deadline 2024-09-19T05:01:36.834314+0000) 2024-09-19T05:01:42.581 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:42 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:42.314+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:01:42.582 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:42 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:42.314+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.465788+0000 front 2024-09-19T05:00:56.465813+0000 (oldest deadline 2024-09-19T05:01:21.166043+0000) 2024-09-19T05:01:42.582 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:42 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:42.314+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:05.768290+0000 front 2024-09-19T05:01:05.768030+0000 (oldest deadline 2024-09-19T05:01:31.067908+0000) 2024-09-19T05:01:42.582 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:42 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:42.314+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.768950+0000 front 2024-09-19T05:01:12.769033+0000 (oldest deadline 2024-09-19T05:01:36.268756+0000) 2024-09-19T05:01:42.843 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:42 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:42.467+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:01:42.844 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:42 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:42.467+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:01:42.844 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:42 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:42.467+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.009788+0000 front 2024-09-19T05:01:04.009844+0000 (oldest deadline 2024-09-19T05:01:28.709792+0000) 2024-09-19T05:01:42.844 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:42 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:42.467+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:14.010849+0000 front 2024-09-19T05:01:14.010831+0000 (oldest deadline 2024-09-19T05:01:38.710587+0000) 2024-09-19T05:01:43.057 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:42 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:42.580+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.774268+0000 front 2024-09-19T05:00:56.774285+0000 (oldest deadline 2024-09-19T05:01:19.674420+0000) 2024-09-19T05:01:43.057 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:42 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:42.580+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:06.076024+0000 front 2024-09-19T05:01:06.075998+0000 (oldest deadline 2024-09-19T05:01:28.975895+0000) 2024-09-19T05:01:43.057 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:42 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:42.580+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:14.276988+0000 front 2024-09-19T05:01:14.277014+0000 (oldest deadline 2024-09-19T05:01:39.576671+0000) 2024-09-19T05:01:43.110 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:42 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:42.842+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.056022+0000 front 2024-09-19T05:00:57.056114+0000 (oldest deadline 2024-09-19T05:01:21.756148+0000) 2024-09-19T05:01:43.111 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:42 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:42.842+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.657044+0000 front 2024-09-19T05:01:04.657069+0000 (oldest deadline 2024-09-19T05:01:29.357253+0000) 2024-09-19T05:01:43.111 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:42 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:42.842+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.758896+0000 front 2024-09-19T05:01:12.758940+0000 (oldest deadline 2024-09-19T05:01:37.458850+0000) 2024-09-19T05:01:43.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:43 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:43.073+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.231030+0000 front 2024-09-19T05:00:48.230802+0000 (oldest deadline 2024-09-19T05:01:14.131054+0000) 2024-09-19T05:01:43.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:43 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:43.073+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.232023+0000 front 2024-09-19T05:00:58.232160+0000 (oldest deadline 2024-09-19T05:01:22.332135+0000) 2024-09-19T05:01:43.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:43 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:43.073+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:02.332945+0000 front 2024-09-19T05:01:02.332803+0000 (oldest deadline 2024-09-19T05:01:28.733073+0000) 2024-09-19T05:01:43.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:43 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:43.073+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:13.934098+0000 front 2024-09-19T05:01:13.934134+0000 (oldest deadline 2024-09-19T05:01:36.834314+0000) 2024-09-19T05:01:43.629 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:43 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:43.361+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:01:43.629 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:43 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:43.361+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.465788+0000 front 2024-09-19T05:00:56.465813+0000 (oldest deadline 2024-09-19T05:01:21.166043+0000) 2024-09-19T05:01:43.629 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:43 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:43.361+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:05.768290+0000 front 2024-09-19T05:01:05.768030+0000 (oldest deadline 2024-09-19T05:01:31.067908+0000) 2024-09-19T05:01:43.629 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:43 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:43.361+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.768950+0000 front 2024-09-19T05:01:12.769033+0000 (oldest deadline 2024-09-19T05:01:36.268756+0000) 2024-09-19T05:01:43.860 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:43 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:43.468+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:01:43.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:43 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:43.468+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:01:43.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:43 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:43.468+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.009788+0000 front 2024-09-19T05:01:04.009844+0000 (oldest deadline 2024-09-19T05:01:28.709792+0000) 2024-09-19T05:01:43.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:43 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:43.468+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:14.010849+0000 front 2024-09-19T05:01:14.010831+0000 (oldest deadline 2024-09-19T05:01:38.710587+0000) 2024-09-19T05:01:44.057 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:43 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:43.627+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.774268+0000 front 2024-09-19T05:00:56.774285+0000 (oldest deadline 2024-09-19T05:01:19.674420+0000) 2024-09-19T05:01:44.057 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:43 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:43.627+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:06.076024+0000 front 2024-09-19T05:01:06.075998+0000 (oldest deadline 2024-09-19T05:01:28.975895+0000) 2024-09-19T05:01:44.057 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:43 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:43.627+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:14.276988+0000 front 2024-09-19T05:01:14.277014+0000 (oldest deadline 2024-09-19T05:01:39.576671+0000) 2024-09-19T05:01:44.057 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:43 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:43.627+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:20.677395+0000 front 2024-09-19T05:01:20.677384+0000 (oldest deadline 2024-09-19T05:01:43.577505+0000) 2024-09-19T05:01:44.361 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:43 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:43.873+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.056022+0000 front 2024-09-19T05:00:57.056114+0000 (oldest deadline 2024-09-19T05:01:21.756148+0000) 2024-09-19T05:01:44.361 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:43 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:43.873+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.657044+0000 front 2024-09-19T05:01:04.657069+0000 (oldest deadline 2024-09-19T05:01:29.357253+0000) 2024-09-19T05:01:44.361 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:43 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:43.873+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.758896+0000 front 2024-09-19T05:01:12.758940+0000 (oldest deadline 2024-09-19T05:01:37.458850+0000) 2024-09-19T05:01:44.610 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:44 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:44.109+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.231030+0000 front 2024-09-19T05:00:48.230802+0000 (oldest deadline 2024-09-19T05:01:14.131054+0000) 2024-09-19T05:01:44.610 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:44 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:44.109+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.232023+0000 front 2024-09-19T05:00:58.232160+0000 (oldest deadline 2024-09-19T05:01:22.332135+0000) 2024-09-19T05:01:44.610 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:44 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:44.109+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:02.332945+0000 front 2024-09-19T05:01:02.332803+0000 (oldest deadline 2024-09-19T05:01:28.733073+0000) 2024-09-19T05:01:44.610 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:44 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:44.109+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:13.934098+0000 front 2024-09-19T05:01:13.934134+0000 (oldest deadline 2024-09-19T05:01:36.834314+0000) 2024-09-19T05:01:44.662 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:44 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:44.386+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:01:44.662 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:44 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:44.386+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.465788+0000 front 2024-09-19T05:00:56.465813+0000 (oldest deadline 2024-09-19T05:01:21.166043+0000) 2024-09-19T05:01:44.663 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:44 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:44.386+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:05.768290+0000 front 2024-09-19T05:01:05.768030+0000 (oldest deadline 2024-09-19T05:01:31.067908+0000) 2024-09-19T05:01:44.663 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:44 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:44.386+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.768950+0000 front 2024-09-19T05:01:12.769033+0000 (oldest deadline 2024-09-19T05:01:36.268756+0000) 2024-09-19T05:01:44.834 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:44 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:44.447+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:01:44.835 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:44 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:44.447+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:01:44.835 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:44 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:44.447+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.009788+0000 front 2024-09-19T05:01:04.009844+0000 (oldest deadline 2024-09-19T05:01:28.709792+0000) 2024-09-19T05:01:44.835 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:44 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:44.447+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:14.010849+0000 front 2024-09-19T05:01:14.010831+0000 (oldest deadline 2024-09-19T05:01:38.710587+0000) 2024-09-19T05:01:45.057 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:44 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:44.660+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.774268+0000 front 2024-09-19T05:00:56.774285+0000 (oldest deadline 2024-09-19T05:01:19.674420+0000) 2024-09-19T05:01:45.057 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:44 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:44.660+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:06.076024+0000 front 2024-09-19T05:01:06.075998+0000 (oldest deadline 2024-09-19T05:01:28.975895+0000) 2024-09-19T05:01:45.057 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:44 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:44.660+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:14.276988+0000 front 2024-09-19T05:01:14.277014+0000 (oldest deadline 2024-09-19T05:01:39.576671+0000) 2024-09-19T05:01:45.057 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:44 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:44.660+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:20.677395+0000 front 2024-09-19T05:01:20.677384+0000 (oldest deadline 2024-09-19T05:01:43.577505+0000) 2024-09-19T05:01:45.111 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:44 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:44.833+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.056022+0000 front 2024-09-19T05:00:57.056114+0000 (oldest deadline 2024-09-19T05:01:21.756148+0000) 2024-09-19T05:01:45.111 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:44 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:44.833+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.657044+0000 front 2024-09-19T05:01:04.657069+0000 (oldest deadline 2024-09-19T05:01:29.357253+0000) 2024-09-19T05:01:45.111 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:44 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:44.833+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.758896+0000 front 2024-09-19T05:01:12.758940+0000 (oldest deadline 2024-09-19T05:01:37.458850+0000) 2024-09-19T05:01:45.610 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:45 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:45.139+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.231030+0000 front 2024-09-19T05:00:48.230802+0000 (oldest deadline 2024-09-19T05:01:14.131054+0000) 2024-09-19T05:01:45.610 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:45 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:45.139+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.232023+0000 front 2024-09-19T05:00:58.232160+0000 (oldest deadline 2024-09-19T05:01:22.332135+0000) 2024-09-19T05:01:45.610 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:45 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:45.139+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:02.332945+0000 front 2024-09-19T05:01:02.332803+0000 (oldest deadline 2024-09-19T05:01:28.733073+0000) 2024-09-19T05:01:45.610 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:45 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:45.139+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:13.934098+0000 front 2024-09-19T05:01:13.934134+0000 (oldest deadline 2024-09-19T05:01:36.834314+0000) 2024-09-19T05:01:45.610 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:45 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:45.139+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:20.235949+0000 front 2024-09-19T05:01:20.235978+0000 (oldest deadline 2024-09-19T05:01:44.935783+0000) 2024-09-19T05:01:45.804 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:45 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:45.452+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:01:45.804 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:45 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:45.452+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:01:45.804 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:45 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:45.452+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.009788+0000 front 2024-09-19T05:01:04.009844+0000 (oldest deadline 2024-09-19T05:01:28.709792+0000) 2024-09-19T05:01:45.805 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:45 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:45.452+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:14.010849+0000 front 2024-09-19T05:01:14.010831+0000 (oldest deadline 2024-09-19T05:01:38.710587+0000) 2024-09-19T05:01:45.805 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:45 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:45.452+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:18.711264+0000 front 2024-09-19T05:01:18.711209+0000 (oldest deadline 2024-09-19T05:01:44.611168+0000) 2024-09-19T05:01:45.806 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:45 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:45.411+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:01:45.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:45 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:45.411+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.465788+0000 front 2024-09-19T05:00:56.465813+0000 (oldest deadline 2024-09-19T05:01:21.166043+0000) 2024-09-19T05:01:45.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:45 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:45.411+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:05.768290+0000 front 2024-09-19T05:01:05.768030+0000 (oldest deadline 2024-09-19T05:01:31.067908+0000) 2024-09-19T05:01:45.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:45 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:45.411+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.768950+0000 front 2024-09-19T05:01:12.769033+0000 (oldest deadline 2024-09-19T05:01:36.268756+0000) 2024-09-19T05:01:45.807 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:45 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:45.625+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.774268+0000 front 2024-09-19T05:00:56.774285+0000 (oldest deadline 2024-09-19T05:01:19.674420+0000) 2024-09-19T05:01:45.807 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:45 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:45.625+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:06.076024+0000 front 2024-09-19T05:01:06.075998+0000 (oldest deadline 2024-09-19T05:01:28.975895+0000) 2024-09-19T05:01:45.807 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:45 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:45.625+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:14.276988+0000 front 2024-09-19T05:01:14.277014+0000 (oldest deadline 2024-09-19T05:01:39.576671+0000) 2024-09-19T05:01:45.807 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:45 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7[52456]: 2024-09-19T05:01:45.625+0000 7f16e65a6640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:20.677395+0000 front 2024-09-19T05:01:20.677384+0000 (oldest deadline 2024-09-19T05:01:43.577505+0000) 2024-09-19T05:01:46.110 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:45 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:45.802+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.056022+0000 front 2024-09-19T05:00:57.056114+0000 (oldest deadline 2024-09-19T05:01:21.756148+0000) 2024-09-19T05:01:46.111 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:45 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:45.802+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.657044+0000 front 2024-09-19T05:01:04.657069+0000 (oldest deadline 2024-09-19T05:01:29.357253+0000) 2024-09-19T05:01:46.111 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:45 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:45.802+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.758896+0000 front 2024-09-19T05:01:12.758940+0000 (oldest deadline 2024-09-19T05:01:37.458850+0000) 2024-09-19T05:01:46.466 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:46 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:46.462+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:01:46.466 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:46 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:46.462+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:01:46.466 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:46 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:46.462+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.009788+0000 front 2024-09-19T05:01:04.009844+0000 (oldest deadline 2024-09-19T05:01:28.709792+0000) 2024-09-19T05:01:46.466 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:46 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:46.462+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:14.010849+0000 front 2024-09-19T05:01:14.010831+0000 (oldest deadline 2024-09-19T05:01:38.710587+0000) 2024-09-19T05:01:46.466 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:46 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:46.462+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:18.711264+0000 front 2024-09-19T05:01:18.711209+0000 (oldest deadline 2024-09-19T05:01:44.611168+0000) 2024-09-19T05:01:46.610 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:46 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:46.188+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.231030+0000 front 2024-09-19T05:00:48.230802+0000 (oldest deadline 2024-09-19T05:01:14.131054+0000) 2024-09-19T05:01:46.610 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:46 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:46.188+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.232023+0000 front 2024-09-19T05:00:58.232160+0000 (oldest deadline 2024-09-19T05:01:22.332135+0000) 2024-09-19T05:01:46.610 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:46 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:46.188+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:02.332945+0000 front 2024-09-19T05:01:02.332803+0000 (oldest deadline 2024-09-19T05:01:28.733073+0000) 2024-09-19T05:01:46.610 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:46 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:46.188+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:13.934098+0000 front 2024-09-19T05:01:13.934134+0000 (oldest deadline 2024-09-19T05:01:36.834314+0000) 2024-09-19T05:01:46.610 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:46 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:46.188+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:20.235949+0000 front 2024-09-19T05:01:20.235978+0000 (oldest deadline 2024-09-19T05:01:44.935783+0000) 2024-09-19T05:01:46.772 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:46 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:46.416+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:01:46.772 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:46 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:46.416+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.465788+0000 front 2024-09-19T05:00:56.465813+0000 (oldest deadline 2024-09-19T05:01:21.166043+0000) 2024-09-19T05:01:46.772 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:46 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:46.416+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:05.768290+0000 front 2024-09-19T05:01:05.768030+0000 (oldest deadline 2024-09-19T05:01:31.067908+0000) 2024-09-19T05:01:46.772 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:46 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:46.416+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.768950+0000 front 2024-09-19T05:01:12.769033+0000 (oldest deadline 2024-09-19T05:01:36.268756+0000) 2024-09-19T05:01:47.058 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:46 smithi018 podman[71324]: 2024-09-19 05:01:46.771126701 +0000 UTC m=+5.635427942 container died 2a48e878b0371d42f19392fdc6bca91035560a82344b4c6579340ee28013c82c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-19T05:01:47.111 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:46 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:46.810+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.056022+0000 front 2024-09-19T05:00:57.056114+0000 (oldest deadline 2024-09-19T05:01:21.756148+0000) 2024-09-19T05:01:47.111 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:46 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:46.810+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.657044+0000 front 2024-09-19T05:01:04.657069+0000 (oldest deadline 2024-09-19T05:01:29.357253+0000) 2024-09-19T05:01:47.111 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:46 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:46.810+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.758896+0000 front 2024-09-19T05:01:12.758940+0000 (oldest deadline 2024-09-19T05:01:37.458850+0000) 2024-09-19T05:01:47.499 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:47 smithi018 podman[71324]: 2024-09-19 05:01:47.272618779 +0000 UTC m=+6.136920001 container cleanup 2a48e878b0371d42f19392fdc6bca91035560a82344b4c6579340ee28013c82c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-19T05:01:47.499 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:47 smithi018 bash[71324]: ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7 2024-09-19T05:01:47.499 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:47 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:47.396+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:01:47.499 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:47 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:47.396+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.465788+0000 front 2024-09-19T05:00:56.465813+0000 (oldest deadline 2024-09-19T05:01:21.166043+0000) 2024-09-19T05:01:47.499 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:47 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:47.396+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:05.768290+0000 front 2024-09-19T05:01:05.768030+0000 (oldest deadline 2024-09-19T05:01:31.067908+0000) 2024-09-19T05:01:47.500 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:47 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:47.396+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.768950+0000 front 2024-09-19T05:01:12.769033+0000 (oldest deadline 2024-09-19T05:01:36.268756+0000) 2024-09-19T05:01:47.500 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:47 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:47.396+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:20.869854+0000 front 2024-09-19T05:01:20.869872+0000 (oldest deadline 2024-09-19T05:01:46.769918+0000) 2024-09-19T05:01:47.610 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:47 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:47.198+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.231030+0000 front 2024-09-19T05:00:48.230802+0000 (oldest deadline 2024-09-19T05:01:14.131054+0000) 2024-09-19T05:01:47.610 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:47 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:47.198+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.232023+0000 front 2024-09-19T05:00:58.232160+0000 (oldest deadline 2024-09-19T05:01:22.332135+0000) 2024-09-19T05:01:47.610 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:47 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:47.198+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:02.332945+0000 front 2024-09-19T05:01:02.332803+0000 (oldest deadline 2024-09-19T05:01:28.733073+0000) 2024-09-19T05:01:47.610 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:47 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:47.198+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:13.934098+0000 front 2024-09-19T05:01:13.934134+0000 (oldest deadline 2024-09-19T05:01:36.834314+0000) 2024-09-19T05:01:47.610 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:47 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:47.198+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:20.235949+0000 front 2024-09-19T05:01:20.235978+0000 (oldest deadline 2024-09-19T05:01:44.935783+0000) 2024-09-19T05:01:47.707 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:47 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:47.451+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:01:47.708 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:47 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:47.451+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:01:47.708 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:47 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:47.451+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.009788+0000 front 2024-09-19T05:01:04.009844+0000 (oldest deadline 2024-09-19T05:01:28.709792+0000) 2024-09-19T05:01:47.708 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:47 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:47.451+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:14.010849+0000 front 2024-09-19T05:01:14.010831+0000 (oldest deadline 2024-09-19T05:01:38.710587+0000) 2024-09-19T05:01:47.708 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:47 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:47.451+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:18.711264+0000 front 2024-09-19T05:01:18.711209+0000 (oldest deadline 2024-09-19T05:01:44.611168+0000) 2024-09-19T05:01:47.807 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:47 smithi018 podman[71340]: 2024-09-19 05:01:47.498494539 +0000 UTC m=+0.727852778 container remove 2a48e878b0371d42f19392fdc6bca91035560a82344b4c6579340ee28013c82c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-19T05:01:48.110 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:47 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:47.777+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.056022+0000 front 2024-09-19T05:00:57.056114+0000 (oldest deadline 2024-09-19T05:01:21.756148+0000) 2024-09-19T05:01:48.110 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:47 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:47.777+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.657044+0000 front 2024-09-19T05:01:04.657069+0000 (oldest deadline 2024-09-19T05:01:29.357253+0000) 2024-09-19T05:01:48.111 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:47 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:47.777+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.758896+0000 front 2024-09-19T05:01:12.758940+0000 (oldest deadline 2024-09-19T05:01:37.458850+0000) 2024-09-19T05:01:48.111 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:47 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:47.777+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:21.360782+0000 front 2024-09-19T05:01:21.360829+0000 (oldest deadline 2024-09-19T05:01:47.260602+0000) 2024-09-19T05:01:48.144 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:47 smithi018 podman[71431]: 2024-09-19 05:01:47.720845117 +0000 UTC m=+0.016795953 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:01:48.144 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:47 smithi018 podman[71431]: 2024-09-19 05:01:47.832759237 +0000 UTC m=+0.128710099 container create 9cd3a11f970adee1f098c08ffc6adbcc614a6395bf9278e85a37ed2533b00ac1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2) 2024-09-19T05:01:48.144 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:48 smithi018 podman[71431]: 2024-09-19 05:01:48.059921595 +0000 UTC m=+0.355872435 container init 9cd3a11f970adee1f098c08ffc6adbcc614a6395bf9278e85a37ed2533b00ac1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-19T05:01:48.144 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:48 smithi018 podman[71431]: 2024-09-19 05:01:48.063250563 +0000 UTC m=+0.359201387 container start 9cd3a11f970adee1f098c08ffc6adbcc614a6395bf9278e85a37ed2533b00ac1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7-deactivate, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-19T05:01:48.144 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:48 smithi018 podman[71431]: 2024-09-19 05:01:48.142989714 +0000 UTC m=+0.438940543 container attach 9cd3a11f970adee1f098c08ffc6adbcc614a6395bf9278e85a37ed2533b00ac1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7-deactivate, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-19T05:01:48.440 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 19 05:01:48 smithi018 podman[71431]: 2024-09-19 05:01:48.258250381 +0000 UTC m=+0.554201210 container died 9cd3a11f970adee1f098c08ffc6adbcc614a6395bf9278e85a37ed2533b00ac1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-19T05:01:48.610 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:48 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:48.174+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.231030+0000 front 2024-09-19T05:00:48.230802+0000 (oldest deadline 2024-09-19T05:01:14.131054+0000) 2024-09-19T05:01:48.610 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:48 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:48.174+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.232023+0000 front 2024-09-19T05:00:58.232160+0000 (oldest deadline 2024-09-19T05:01:22.332135+0000) 2024-09-19T05:01:48.610 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:48 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:48.174+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:02.332945+0000 front 2024-09-19T05:01:02.332803+0000 (oldest deadline 2024-09-19T05:01:28.733073+0000) 2024-09-19T05:01:48.610 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:48 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:48.174+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:13.934098+0000 front 2024-09-19T05:01:13.934134+0000 (oldest deadline 2024-09-19T05:01:36.834314+0000) 2024-09-19T05:01:48.610 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:48 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:48.174+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:20.235949+0000 front 2024-09-19T05:01:20.235978+0000 (oldest deadline 2024-09-19T05:01:44.935783+0000) 2024-09-19T05:01:48.741 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:48 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:48.449+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:01:48.741 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:48 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:48.449+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:01:48.741 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:48 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:48.449+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.009788+0000 front 2024-09-19T05:01:04.009844+0000 (oldest deadline 2024-09-19T05:01:28.709792+0000) 2024-09-19T05:01:48.741 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:48 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:48.449+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:14.010849+0000 front 2024-09-19T05:01:14.010831+0000 (oldest deadline 2024-09-19T05:01:38.710587+0000) 2024-09-19T05:01:48.741 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:48 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:48.449+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:18.711264+0000 front 2024-09-19T05:01:18.711209+0000 (oldest deadline 2024-09-19T05:01:44.611168+0000) 2024-09-19T05:01:48.805 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:48 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:48.438+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:01:48.805 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:48 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:48.438+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.465788+0000 front 2024-09-19T05:00:56.465813+0000 (oldest deadline 2024-09-19T05:01:21.166043+0000) 2024-09-19T05:01:48.805 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:48 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:48.438+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:05.768290+0000 front 2024-09-19T05:01:05.768030+0000 (oldest deadline 2024-09-19T05:01:31.067908+0000) 2024-09-19T05:01:48.806 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:48 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:48.438+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.768950+0000 front 2024-09-19T05:01:12.769033+0000 (oldest deadline 2024-09-19T05:01:36.268756+0000) 2024-09-19T05:01:48.806 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:48 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:48.438+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:20.869854+0000 front 2024-09-19T05:01:20.869872+0000 (oldest deadline 2024-09-19T05:01:46.769918+0000) 2024-09-19T05:01:48.830 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@osd.7.service' 2024-09-19T05:01:48.915 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:01:48.916 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-19T05:01:48.916 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-19T05:01:48.916 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-d46630c4-7640-11ef-bceb-c7b262605968@osd.8 2024-09-19T05:01:49.110 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:48 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:48.739+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.056022+0000 front 2024-09-19T05:00:57.056114+0000 (oldest deadline 2024-09-19T05:01:21.756148+0000) 2024-09-19T05:01:49.111 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:48 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:48.739+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.657044+0000 front 2024-09-19T05:01:04.657069+0000 (oldest deadline 2024-09-19T05:01:29.357253+0000) 2024-09-19T05:01:49.111 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:48 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:48.739+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.758896+0000 front 2024-09-19T05:01:12.758940+0000 (oldest deadline 2024-09-19T05:01:37.458850+0000) 2024-09-19T05:01:49.111 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:48 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:48.739+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:21.360782+0000 front 2024-09-19T05:01:21.360829+0000 (oldest deadline 2024-09-19T05:01:47.260602+0000) 2024-09-19T05:01:49.111 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:48 smithi116 systemd[1]: Stopping Ceph osd.8 for d46630c4-7640-11ef-bceb-c7b262605968... 2024-09-19T05:01:49.610 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:49 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:49.133+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.231030+0000 front 2024-09-19T05:00:48.230802+0000 (oldest deadline 2024-09-19T05:01:14.131054+0000) 2024-09-19T05:01:49.610 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:49 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:49.133+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.232023+0000 front 2024-09-19T05:00:58.232160+0000 (oldest deadline 2024-09-19T05:01:22.332135+0000) 2024-09-19T05:01:49.610 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:49 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:49.133+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:02.332945+0000 front 2024-09-19T05:01:02.332803+0000 (oldest deadline 2024-09-19T05:01:28.733073+0000) 2024-09-19T05:01:49.610 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:49 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:49.133+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:13.934098+0000 front 2024-09-19T05:01:13.934134+0000 (oldest deadline 2024-09-19T05:01:36.834314+0000) 2024-09-19T05:01:49.610 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:49 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:49.133+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:20.235949+0000 front 2024-09-19T05:01:20.235978+0000 (oldest deadline 2024-09-19T05:01:44.935783+0000) 2024-09-19T05:01:49.611 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:49 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:49.214+0000 7f460c915640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:01:49.611 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:49 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:49.214+0000 7f460c915640 -1 osd.8 96 *** Got signal Terminated *** 2024-09-19T05:01:49.611 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:49 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:49.214+0000 7f460c915640 -1 osd.8 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T05:01:49.611 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:49 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:49.449+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:01:49.611 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:49 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:49.449+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:01:49.611 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:49 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:49.449+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.009788+0000 front 2024-09-19T05:01:04.009844+0000 (oldest deadline 2024-09-19T05:01:28.709792+0000) 2024-09-19T05:01:49.611 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:49 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:49.449+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:14.010849+0000 front 2024-09-19T05:01:14.010831+0000 (oldest deadline 2024-09-19T05:01:38.710587+0000) 2024-09-19T05:01:49.611 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:49 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:49.449+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:18.711264+0000 front 2024-09-19T05:01:18.711209+0000 (oldest deadline 2024-09-19T05:01:44.611168+0000) 2024-09-19T05:01:49.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:49 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:49.426+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:01:49.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:49 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:49.426+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.465788+0000 front 2024-09-19T05:00:56.465813+0000 (oldest deadline 2024-09-19T05:01:21.166043+0000) 2024-09-19T05:01:49.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:49 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:49.426+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:05.768290+0000 front 2024-09-19T05:01:05.768030+0000 (oldest deadline 2024-09-19T05:01:31.067908+0000) 2024-09-19T05:01:49.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:49 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:49.426+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.768950+0000 front 2024-09-19T05:01:12.769033+0000 (oldest deadline 2024-09-19T05:01:36.268756+0000) 2024-09-19T05:01:49.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:49 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:49.426+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:20.869854+0000 front 2024-09-19T05:01:20.869872+0000 (oldest deadline 2024-09-19T05:01:46.769918+0000) 2024-09-19T05:01:50.110 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:49 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:49.704+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.056022+0000 front 2024-09-19T05:00:57.056114+0000 (oldest deadline 2024-09-19T05:01:21.756148+0000) 2024-09-19T05:01:50.111 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:49 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:49.704+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.657044+0000 front 2024-09-19T05:01:04.657069+0000 (oldest deadline 2024-09-19T05:01:29.357253+0000) 2024-09-19T05:01:50.111 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:49 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:49.704+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.758896+0000 front 2024-09-19T05:01:12.758940+0000 (oldest deadline 2024-09-19T05:01:37.458850+0000) 2024-09-19T05:01:50.111 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:49 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:49.704+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:21.360782+0000 front 2024-09-19T05:01:21.360829+0000 (oldest deadline 2024-09-19T05:01:47.260602+0000) 2024-09-19T05:01:50.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:50 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:50.100+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.231030+0000 front 2024-09-19T05:00:48.230802+0000 (oldest deadline 2024-09-19T05:01:14.131054+0000) 2024-09-19T05:01:50.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:50 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:50.100+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.232023+0000 front 2024-09-19T05:00:58.232160+0000 (oldest deadline 2024-09-19T05:01:22.332135+0000) 2024-09-19T05:01:50.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:50 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:50.100+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:02.332945+0000 front 2024-09-19T05:01:02.332803+0000 (oldest deadline 2024-09-19T05:01:28.733073+0000) 2024-09-19T05:01:50.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:50 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:50.100+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:13.934098+0000 front 2024-09-19T05:01:13.934134+0000 (oldest deadline 2024-09-19T05:01:36.834314+0000) 2024-09-19T05:01:50.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:50 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:50.100+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:20.235949+0000 front 2024-09-19T05:01:20.235978+0000 (oldest deadline 2024-09-19T05:01:44.935783+0000) 2024-09-19T05:01:50.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:50 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:50.434+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:01:50.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:50 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:50.434+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.465788+0000 front 2024-09-19T05:00:56.465813+0000 (oldest deadline 2024-09-19T05:01:21.166043+0000) 2024-09-19T05:01:50.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:50 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:50.434+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:05.768290+0000 front 2024-09-19T05:01:05.768030+0000 (oldest deadline 2024-09-19T05:01:31.067908+0000) 2024-09-19T05:01:50.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:50 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:50.434+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.768950+0000 front 2024-09-19T05:01:12.769033+0000 (oldest deadline 2024-09-19T05:01:36.268756+0000) 2024-09-19T05:01:50.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:50 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:50.434+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:20.869854+0000 front 2024-09-19T05:01:20.869872+0000 (oldest deadline 2024-09-19T05:01:46.769918+0000) 2024-09-19T05:01:50.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:50 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:50.478+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:01:50.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:50 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:50.478+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:01:50.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:50 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:50.478+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.009788+0000 front 2024-09-19T05:01:04.009844+0000 (oldest deadline 2024-09-19T05:01:28.709792+0000) 2024-09-19T05:01:50.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:50 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:50.478+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:14.010849+0000 front 2024-09-19T05:01:14.010831+0000 (oldest deadline 2024-09-19T05:01:38.710587+0000) 2024-09-19T05:01:50.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:50 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:50.478+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:18.711264+0000 front 2024-09-19T05:01:18.711209+0000 (oldest deadline 2024-09-19T05:01:44.611168+0000) 2024-09-19T05:01:50.861 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:50 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:50.692+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.056022+0000 front 2024-09-19T05:00:57.056114+0000 (oldest deadline 2024-09-19T05:01:21.756148+0000) 2024-09-19T05:01:50.861 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:50 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:50.692+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.657044+0000 front 2024-09-19T05:01:04.657069+0000 (oldest deadline 2024-09-19T05:01:29.357253+0000) 2024-09-19T05:01:50.861 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:50 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:50.692+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.758896+0000 front 2024-09-19T05:01:12.758940+0000 (oldest deadline 2024-09-19T05:01:37.458850+0000) 2024-09-19T05:01:50.861 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:50 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:50.692+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:21.360782+0000 front 2024-09-19T05:01:21.360829+0000 (oldest deadline 2024-09-19T05:01:47.260602+0000) 2024-09-19T05:01:51.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:51 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:51.080+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.231030+0000 front 2024-09-19T05:00:48.230802+0000 (oldest deadline 2024-09-19T05:01:14.131054+0000) 2024-09-19T05:01:51.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:51 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:51.080+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.232023+0000 front 2024-09-19T05:00:58.232160+0000 (oldest deadline 2024-09-19T05:01:22.332135+0000) 2024-09-19T05:01:51.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:51 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:51.080+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:02.332945+0000 front 2024-09-19T05:01:02.332803+0000 (oldest deadline 2024-09-19T05:01:28.733073+0000) 2024-09-19T05:01:51.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:51 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:51.080+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:13.934098+0000 front 2024-09-19T05:01:13.934134+0000 (oldest deadline 2024-09-19T05:01:36.834314+0000) 2024-09-19T05:01:51.361 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:51 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:51.080+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:20.235949+0000 front 2024-09-19T05:01:20.235978+0000 (oldest deadline 2024-09-19T05:01:44.935783+0000) 2024-09-19T05:01:51.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:51 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:51.384+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:01:51.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:51 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:51.384+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.465788+0000 front 2024-09-19T05:00:56.465813+0000 (oldest deadline 2024-09-19T05:01:21.166043+0000) 2024-09-19T05:01:51.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:51 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:51.384+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:05.768290+0000 front 2024-09-19T05:01:05.768030+0000 (oldest deadline 2024-09-19T05:01:31.067908+0000) 2024-09-19T05:01:51.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:51 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:51.384+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.768950+0000 front 2024-09-19T05:01:12.769033+0000 (oldest deadline 2024-09-19T05:01:36.268756+0000) 2024-09-19T05:01:51.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:51 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:51.384+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:20.869854+0000 front 2024-09-19T05:01:20.869872+0000 (oldest deadline 2024-09-19T05:01:46.769918+0000) 2024-09-19T05:01:51.722 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:51 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:51.429+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:01:51.722 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:51 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:51.429+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:01:51.722 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:51 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:51.429+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.009788+0000 front 2024-09-19T05:01:04.009844+0000 (oldest deadline 2024-09-19T05:01:28.709792+0000) 2024-09-19T05:01:51.722 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:51 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:51.429+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:14.010849+0000 front 2024-09-19T05:01:14.010831+0000 (oldest deadline 2024-09-19T05:01:38.710587+0000) 2024-09-19T05:01:51.722 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:51 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:51.429+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:18.711264+0000 front 2024-09-19T05:01:18.711209+0000 (oldest deadline 2024-09-19T05:01:44.611168+0000) 2024-09-19T05:01:52.110 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:51 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:51.720+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.056022+0000 front 2024-09-19T05:00:57.056114+0000 (oldest deadline 2024-09-19T05:01:21.756148+0000) 2024-09-19T05:01:52.111 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:51 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:51.720+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.657044+0000 front 2024-09-19T05:01:04.657069+0000 (oldest deadline 2024-09-19T05:01:29.357253+0000) 2024-09-19T05:01:52.111 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:51 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:51.720+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.758896+0000 front 2024-09-19T05:01:12.758940+0000 (oldest deadline 2024-09-19T05:01:37.458850+0000) 2024-09-19T05:01:52.111 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:51 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:51.720+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:21.360782+0000 front 2024-09-19T05:01:21.360829+0000 (oldest deadline 2024-09-19T05:01:47.260602+0000) 2024-09-19T05:01:52.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:52 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:52.065+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.231030+0000 front 2024-09-19T05:00:48.230802+0000 (oldest deadline 2024-09-19T05:01:14.131054+0000) 2024-09-19T05:01:52.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:52 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:52.065+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.232023+0000 front 2024-09-19T05:00:58.232160+0000 (oldest deadline 2024-09-19T05:01:22.332135+0000) 2024-09-19T05:01:52.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:52 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:52.065+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:02.332945+0000 front 2024-09-19T05:01:02.332803+0000 (oldest deadline 2024-09-19T05:01:28.733073+0000) 2024-09-19T05:01:52.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:52 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:52.065+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:13.934098+0000 front 2024-09-19T05:01:13.934134+0000 (oldest deadline 2024-09-19T05:01:36.834314+0000) 2024-09-19T05:01:52.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:52 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:52.065+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:20.235949+0000 front 2024-09-19T05:01:20.235978+0000 (oldest deadline 2024-09-19T05:01:44.935783+0000) 2024-09-19T05:01:52.361 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:52 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:52.065+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-19T05:01:29.036869+0000 front 2024-09-19T05:01:29.036995+0000 (oldest deadline 2024-09-19T05:01:51.237203+0000) 2024-09-19T05:01:52.734 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:52 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:52.464+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:01:52.734 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:52 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:52.464+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:01:52.734 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:52 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:52.464+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.009788+0000 front 2024-09-19T05:01:04.009844+0000 (oldest deadline 2024-09-19T05:01:28.709792+0000) 2024-09-19T05:01:52.734 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:52 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:52.464+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:14.010849+0000 front 2024-09-19T05:01:14.010831+0000 (oldest deadline 2024-09-19T05:01:38.710587+0000) 2024-09-19T05:01:52.734 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:52 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:52.464+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:18.711264+0000 front 2024-09-19T05:01:18.711209+0000 (oldest deadline 2024-09-19T05:01:44.611168+0000) 2024-09-19T05:01:52.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:52 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:52.427+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:01:52.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:52 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:52.427+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.465788+0000 front 2024-09-19T05:00:56.465813+0000 (oldest deadline 2024-09-19T05:01:21.166043+0000) 2024-09-19T05:01:52.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:52 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:52.427+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:05.768290+0000 front 2024-09-19T05:01:05.768030+0000 (oldest deadline 2024-09-19T05:01:31.067908+0000) 2024-09-19T05:01:52.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:52 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:52.427+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.768950+0000 front 2024-09-19T05:01:12.769033+0000 (oldest deadline 2024-09-19T05:01:36.268756+0000) 2024-09-19T05:01:52.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:52 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:52.427+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:20.869854+0000 front 2024-09-19T05:01:20.869872+0000 (oldest deadline 2024-09-19T05:01:46.769918+0000) 2024-09-19T05:01:53.111 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:52 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:52.732+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.056022+0000 front 2024-09-19T05:00:57.056114+0000 (oldest deadline 2024-09-19T05:01:21.756148+0000) 2024-09-19T05:01:53.111 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:52 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:52.732+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.657044+0000 front 2024-09-19T05:01:04.657069+0000 (oldest deadline 2024-09-19T05:01:29.357253+0000) 2024-09-19T05:01:53.111 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:52 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:52.732+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.758896+0000 front 2024-09-19T05:01:12.758940+0000 (oldest deadline 2024-09-19T05:01:37.458850+0000) 2024-09-19T05:01:53.111 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:52 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:52.732+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:21.360782+0000 front 2024-09-19T05:01:21.360829+0000 (oldest deadline 2024-09-19T05:01:47.260602+0000) 2024-09-19T05:01:53.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:53 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:53.032+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.231030+0000 front 2024-09-19T05:00:48.230802+0000 (oldest deadline 2024-09-19T05:01:14.131054+0000) 2024-09-19T05:01:53.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:53 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:53.032+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.232023+0000 front 2024-09-19T05:00:58.232160+0000 (oldest deadline 2024-09-19T05:01:22.332135+0000) 2024-09-19T05:01:53.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:53 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:53.032+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:02.332945+0000 front 2024-09-19T05:01:02.332803+0000 (oldest deadline 2024-09-19T05:01:28.733073+0000) 2024-09-19T05:01:53.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:53 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:53.032+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:13.934098+0000 front 2024-09-19T05:01:13.934134+0000 (oldest deadline 2024-09-19T05:01:36.834314+0000) 2024-09-19T05:01:53.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:53 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:53.032+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:20.235949+0000 front 2024-09-19T05:01:20.235978+0000 (oldest deadline 2024-09-19T05:01:44.935783+0000) 2024-09-19T05:01:53.361 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:53 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:53.032+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-19T05:01:29.036869+0000 front 2024-09-19T05:01:29.036995+0000 (oldest deadline 2024-09-19T05:01:51.237203+0000) 2024-09-19T05:01:53.708 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:53 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:53.408+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:01:53.709 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:53 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:53.408+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.465788+0000 front 2024-09-19T05:00:56.465813+0000 (oldest deadline 2024-09-19T05:01:21.166043+0000) 2024-09-19T05:01:53.709 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:53 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:53.408+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:05.768290+0000 front 2024-09-19T05:01:05.768030+0000 (oldest deadline 2024-09-19T05:01:31.067908+0000) 2024-09-19T05:01:53.709 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:53 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:53.408+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.768950+0000 front 2024-09-19T05:01:12.769033+0000 (oldest deadline 2024-09-19T05:01:36.268756+0000) 2024-09-19T05:01:53.709 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:53 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:53.408+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:20.869854+0000 front 2024-09-19T05:01:20.869872+0000 (oldest deadline 2024-09-19T05:01:46.769918+0000) 2024-09-19T05:01:53.742 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:53 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:53.474+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:01:53.742 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:53 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:53.474+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:01:53.743 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:53 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:53.474+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.009788+0000 front 2024-09-19T05:01:04.009844+0000 (oldest deadline 2024-09-19T05:01:28.709792+0000) 2024-09-19T05:01:53.743 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:53 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:53.474+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:14.010849+0000 front 2024-09-19T05:01:14.010831+0000 (oldest deadline 2024-09-19T05:01:38.710587+0000) 2024-09-19T05:01:53.743 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:53 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:53.474+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:18.711264+0000 front 2024-09-19T05:01:18.711209+0000 (oldest deadline 2024-09-19T05:01:44.611168+0000) 2024-09-19T05:01:54.111 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:53 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:53.740+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.056022+0000 front 2024-09-19T05:00:57.056114+0000 (oldest deadline 2024-09-19T05:01:21.756148+0000) 2024-09-19T05:01:54.111 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:53 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:53.740+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.657044+0000 front 2024-09-19T05:01:04.657069+0000 (oldest deadline 2024-09-19T05:01:29.357253+0000) 2024-09-19T05:01:54.111 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:53 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:53.740+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.758896+0000 front 2024-09-19T05:01:12.758940+0000 (oldest deadline 2024-09-19T05:01:37.458850+0000) 2024-09-19T05:01:54.111 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:53 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:53.740+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:21.360782+0000 front 2024-09-19T05:01:21.360829+0000 (oldest deadline 2024-09-19T05:01:47.260602+0000) 2024-09-19T05:01:54.111 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:53 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8[52603]: 2024-09-19T05:01:53.740+0000 7f4608f1a640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-19T05:01:28.361272+0000 front 2024-09-19T05:01:28.361314+0000 (oldest deadline 2024-09-19T05:01:53.661587+0000) 2024-09-19T05:01:54.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:54 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:54.031+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.231030+0000 front 2024-09-19T05:00:48.230802+0000 (oldest deadline 2024-09-19T05:01:14.131054+0000) 2024-09-19T05:01:54.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:54 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:54.031+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.232023+0000 front 2024-09-19T05:00:58.232160+0000 (oldest deadline 2024-09-19T05:01:22.332135+0000) 2024-09-19T05:01:54.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:54 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:54.031+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:02.332945+0000 front 2024-09-19T05:01:02.332803+0000 (oldest deadline 2024-09-19T05:01:28.733073+0000) 2024-09-19T05:01:54.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:54 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:54.031+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:13.934098+0000 front 2024-09-19T05:01:13.934134+0000 (oldest deadline 2024-09-19T05:01:36.834314+0000) 2024-09-19T05:01:54.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:54 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:54.031+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:20.235949+0000 front 2024-09-19T05:01:20.235978+0000 (oldest deadline 2024-09-19T05:01:44.935783+0000) 2024-09-19T05:01:54.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:54 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:54.031+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-19T05:01:29.036869+0000 front 2024-09-19T05:01:29.036995+0000 (oldest deadline 2024-09-19T05:01:51.237203+0000) 2024-09-19T05:01:54.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:54 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:54.408+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:01:54.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:54 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:54.408+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.465788+0000 front 2024-09-19T05:00:56.465813+0000 (oldest deadline 2024-09-19T05:01:21.166043+0000) 2024-09-19T05:01:54.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:54 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:54.408+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:05.768290+0000 front 2024-09-19T05:01:05.768030+0000 (oldest deadline 2024-09-19T05:01:31.067908+0000) 2024-09-19T05:01:54.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:54 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:54.408+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.768950+0000 front 2024-09-19T05:01:12.769033+0000 (oldest deadline 2024-09-19T05:01:36.268756+0000) 2024-09-19T05:01:54.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:54 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:54.408+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:20.869854+0000 front 2024-09-19T05:01:20.869872+0000 (oldest deadline 2024-09-19T05:01:46.769918+0000) 2024-09-19T05:01:54.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:54 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:54.408+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-19T05:01:29.670871+0000 front 2024-09-19T05:01:29.670805+0000 (oldest deadline 2024-09-19T05:01:54.370738+0000) 2024-09-19T05:01:54.808 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:54 smithi116 podman[71166]: 2024-09-19 05:01:54.528540646 +0000 UTC m=+5.416994051 container died b14e24c2fe1aaaa87a291c855525b9caa3dea6c90bd20113ba983eeb65dce53e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2) 2024-09-19T05:01:54.809 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:54 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:54.495+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:01:54.809 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:54 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:54.495+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:01:54.809 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:54 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:54.495+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.009788+0000 front 2024-09-19T05:01:04.009844+0000 (oldest deadline 2024-09-19T05:01:28.709792+0000) 2024-09-19T05:01:54.809 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:54 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:54.495+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:14.010849+0000 front 2024-09-19T05:01:14.010831+0000 (oldest deadline 2024-09-19T05:01:38.710587+0000) 2024-09-19T05:01:54.809 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:54 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:54.495+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:18.711264+0000 front 2024-09-19T05:01:18.711209+0000 (oldest deadline 2024-09-19T05:01:44.611168+0000) 2024-09-19T05:01:55.110 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:54 smithi116 podman[71166]: 2024-09-19 05:01:54.898477146 +0000 UTC m=+5.786930547 container cleanup b14e24c2fe1aaaa87a291c855525b9caa3dea6c90bd20113ba983eeb65dce53e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-19T05:01:55.110 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:54 smithi116 bash[71166]: ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8 2024-09-19T05:01:55.361 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:55 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:55.023+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.231030+0000 front 2024-09-19T05:00:48.230802+0000 (oldest deadline 2024-09-19T05:01:14.131054+0000) 2024-09-19T05:01:55.474 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:55 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:55.023+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.232023+0000 front 2024-09-19T05:00:58.232160+0000 (oldest deadline 2024-09-19T05:01:22.332135+0000) 2024-09-19T05:01:55.474 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:55 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:55.023+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:02.332945+0000 front 2024-09-19T05:01:02.332803+0000 (oldest deadline 2024-09-19T05:01:28.733073+0000) 2024-09-19T05:01:55.475 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:55 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:55.023+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:13.934098+0000 front 2024-09-19T05:01:13.934134+0000 (oldest deadline 2024-09-19T05:01:36.834314+0000) 2024-09-19T05:01:55.475 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:55 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:55.023+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:20.235949+0000 front 2024-09-19T05:01:20.235978+0000 (oldest deadline 2024-09-19T05:01:44.935783+0000) 2024-09-19T05:01:55.475 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:55 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:55.023+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-19T05:01:29.036869+0000 front 2024-09-19T05:01:29.036995+0000 (oldest deadline 2024-09-19T05:01:51.237203+0000) 2024-09-19T05:01:55.475 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:55 smithi116 podman[71181]: 2024-09-19 05:01:55.149704946 +0000 UTC m=+0.613130071 container remove b14e24c2fe1aaaa87a291c855525b9caa3dea6c90bd20113ba983eeb65dce53e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-19T05:01:55.762 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:55 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:55.451+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:01:55.762 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:55 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:55.451+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:01:55.762 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:55 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:55.451+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.009788+0000 front 2024-09-19T05:01:04.009844+0000 (oldest deadline 2024-09-19T05:01:28.709792+0000) 2024-09-19T05:01:55.762 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:55 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:55.451+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:14.010849+0000 front 2024-09-19T05:01:14.010831+0000 (oldest deadline 2024-09-19T05:01:38.710587+0000) 2024-09-19T05:01:55.762 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:55 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:55.451+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:18.711264+0000 front 2024-09-19T05:01:18.711209+0000 (oldest deadline 2024-09-19T05:01:44.611168+0000) 2024-09-19T05:01:55.762 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:55 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:55.451+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-19T05:01:29.812666+0000 front 2024-09-19T05:01:29.812627+0000 (oldest deadline 2024-09-19T05:01:54.512727+0000) 2024-09-19T05:01:55.763 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:55 smithi116 podman[71273]: 2024-09-19 05:01:55.458749726 +0000 UTC m=+0.111993502 container create 2a0d0e4d562ea28365b48add832b5213a7b869cadfc9281f28144283ba4ed6f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8-deactivate, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-19T05:01:55.763 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:55 smithi116 podman[71273]: 2024-09-19 05:01:55.362688915 +0000 UTC m=+0.015932700 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:01:55.763 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:55 smithi116 podman[71273]: 2024-09-19 05:01:55.6779049 +0000 UTC m=+0.331148679 container init 2a0d0e4d562ea28365b48add832b5213a7b869cadfc9281f28144283ba4ed6f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T05:01:55.763 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:55 smithi116 podman[71273]: 2024-09-19 05:01:55.681292917 +0000 UTC m=+0.334536698 container start 2a0d0e4d562ea28365b48add832b5213a7b869cadfc9281f28144283ba4ed6f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-19T05:01:55.763 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:55 smithi116 podman[71273]: 2024-09-19 05:01:55.761095196 +0000 UTC m=+0.414338986 container attach 2a0d0e4d562ea28365b48add832b5213a7b869cadfc9281f28144283ba4ed6f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD) 2024-09-19T05:01:55.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:55 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:55.457+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:01:55.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:55 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:55.457+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.465788+0000 front 2024-09-19T05:00:56.465813+0000 (oldest deadline 2024-09-19T05:01:21.166043+0000) 2024-09-19T05:01:55.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:55 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:55.457+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:05.768290+0000 front 2024-09-19T05:01:05.768030+0000 (oldest deadline 2024-09-19T05:01:31.067908+0000) 2024-09-19T05:01:55.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:55 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:55.457+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.768950+0000 front 2024-09-19T05:01:12.769033+0000 (oldest deadline 2024-09-19T05:01:36.268756+0000) 2024-09-19T05:01:55.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:55 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:55.457+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:20.869854+0000 front 2024-09-19T05:01:20.869872+0000 (oldest deadline 2024-09-19T05:01:46.769918+0000) 2024-09-19T05:01:55.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:55 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:55.457+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-19T05:01:29.670871+0000 front 2024-09-19T05:01:29.670805+0000 (oldest deadline 2024-09-19T05:01:54.370738+0000) 2024-09-19T05:01:56.110 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:55 smithi116 podman[71273]: 2024-09-19 05:01:55.86547227 +0000 UTC m=+0.518716046 container died 2a0d0e4d562ea28365b48add832b5213a7b869cadfc9281f28144283ba4ed6f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS) 2024-09-19T05:01:56.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:56 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:56.015+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.231030+0000 front 2024-09-19T05:00:48.230802+0000 (oldest deadline 2024-09-19T05:01:14.131054+0000) 2024-09-19T05:01:56.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:56 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:56.015+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.232023+0000 front 2024-09-19T05:00:58.232160+0000 (oldest deadline 2024-09-19T05:01:22.332135+0000) 2024-09-19T05:01:56.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:56 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:56.015+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:02.332945+0000 front 2024-09-19T05:01:02.332803+0000 (oldest deadline 2024-09-19T05:01:28.733073+0000) 2024-09-19T05:01:56.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:56 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:56.015+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:13.934098+0000 front 2024-09-19T05:01:13.934134+0000 (oldest deadline 2024-09-19T05:01:36.834314+0000) 2024-09-19T05:01:56.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:56 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:56.015+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:20.235949+0000 front 2024-09-19T05:01:20.235978+0000 (oldest deadline 2024-09-19T05:01:44.935783+0000) 2024-09-19T05:01:56.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:56 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:56.015+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-19T05:01:29.036869+0000 front 2024-09-19T05:01:29.036995+0000 (oldest deadline 2024-09-19T05:01:51.237203+0000) 2024-09-19T05:01:56.409 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@osd.8.service' 2024-09-19T05:01:56.416 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:56 smithi116 podman[71296]: 2024-09-19 05:01:56.381252026 +0000 UTC m=+0.505147296 container remove 2a0d0e4d562ea28365b48add832b5213a7b869cadfc9281f28144283ba4ed6f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True) 2024-09-19T05:01:56.416 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:56 smithi116 systemd[1]: ceph-d46630c4-7640-11ef-bceb-c7b262605968@osd.8.service: Deactivated successfully. 2024-09-19T05:01:56.416 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:56 smithi116 systemd[1]: Stopped Ceph osd.8 for d46630c4-7640-11ef-bceb-c7b262605968. 2024-09-19T05:01:56.416 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 19 05:01:56 smithi116 systemd[1]: ceph-d46630c4-7640-11ef-bceb-c7b262605968@osd.8.service: Consumed 9.778s CPU time. 2024-09-19T05:01:56.449 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:01:56.450 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-19T05:01:56.450 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-19T05:01:56.450 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-d46630c4-7640-11ef-bceb-c7b262605968@osd.9 2024-09-19T05:01:56.761 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:56 smithi002 systemd[1]: Stopping Ceph osd.9 for d46630c4-7640-11ef-bceb-c7b262605968... 2024-09-19T05:01:56.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:56 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:56.448+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:01:56.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:56 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:56.448+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.465788+0000 front 2024-09-19T05:00:56.465813+0000 (oldest deadline 2024-09-19T05:01:21.166043+0000) 2024-09-19T05:01:56.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:56 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:56.448+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:05.768290+0000 front 2024-09-19T05:01:05.768030+0000 (oldest deadline 2024-09-19T05:01:31.067908+0000) 2024-09-19T05:01:56.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:56 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:56.448+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.768950+0000 front 2024-09-19T05:01:12.769033+0000 (oldest deadline 2024-09-19T05:01:36.268756+0000) 2024-09-19T05:01:56.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:56 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:56.448+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:20.869854+0000 front 2024-09-19T05:01:20.869872+0000 (oldest deadline 2024-09-19T05:01:46.769918+0000) 2024-09-19T05:01:56.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:56 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:56.448+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-19T05:01:29.670871+0000 front 2024-09-19T05:01:29.670805+0000 (oldest deadline 2024-09-19T05:01:54.370738+0000) 2024-09-19T05:01:56.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:56 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:56.459+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:01:56.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:56 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:56.459+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:01:56.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:56 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:56.459+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.009788+0000 front 2024-09-19T05:01:04.009844+0000 (oldest deadline 2024-09-19T05:01:28.709792+0000) 2024-09-19T05:01:56.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:56 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:56.459+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:14.010849+0000 front 2024-09-19T05:01:14.010831+0000 (oldest deadline 2024-09-19T05:01:38.710587+0000) 2024-09-19T05:01:56.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:56 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:56.459+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:18.711264+0000 front 2024-09-19T05:01:18.711209+0000 (oldest deadline 2024-09-19T05:01:44.611168+0000) 2024-09-19T05:01:56.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:56 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:56.459+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-19T05:01:29.812666+0000 front 2024-09-19T05:01:29.812627+0000 (oldest deadline 2024-09-19T05:01:54.512727+0000) 2024-09-19T05:01:57.039 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:56 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:56.760+0000 7f57fa64a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:01:57.039 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:56 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:56.760+0000 7f57fa64a640 -1 osd.9 96 *** Got signal Terminated *** 2024-09-19T05:01:57.039 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:56 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:56.760+0000 7f57fa64a640 -1 osd.9 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T05:01:57.040 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:57 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:57.037+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.231030+0000 front 2024-09-19T05:00:48.230802+0000 (oldest deadline 2024-09-19T05:01:14.131054+0000) 2024-09-19T05:01:57.040 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:57 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:57.037+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.232023+0000 front 2024-09-19T05:00:58.232160+0000 (oldest deadline 2024-09-19T05:01:22.332135+0000) 2024-09-19T05:01:57.040 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:57 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:57.037+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:02.332945+0000 front 2024-09-19T05:01:02.332803+0000 (oldest deadline 2024-09-19T05:01:28.733073+0000) 2024-09-19T05:01:57.040 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:57 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:57.037+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:13.934098+0000 front 2024-09-19T05:01:13.934134+0000 (oldest deadline 2024-09-19T05:01:36.834314+0000) 2024-09-19T05:01:57.040 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:57 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:57.037+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:20.235949+0000 front 2024-09-19T05:01:20.235978+0000 (oldest deadline 2024-09-19T05:01:44.935783+0000) 2024-09-19T05:01:57.040 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:57 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:57.037+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-19T05:01:29.036869+0000 front 2024-09-19T05:01:29.036995+0000 (oldest deadline 2024-09-19T05:01:51.237203+0000) 2024-09-19T05:01:57.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:57 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:57.474+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:01:57.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:57 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:57.474+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.465788+0000 front 2024-09-19T05:00:56.465813+0000 (oldest deadline 2024-09-19T05:01:21.166043+0000) 2024-09-19T05:01:57.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:57 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:57.474+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:05.768290+0000 front 2024-09-19T05:01:05.768030+0000 (oldest deadline 2024-09-19T05:01:31.067908+0000) 2024-09-19T05:01:57.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:57 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:57.474+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.768950+0000 front 2024-09-19T05:01:12.769033+0000 (oldest deadline 2024-09-19T05:01:36.268756+0000) 2024-09-19T05:01:57.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:57 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:57.474+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:20.869854+0000 front 2024-09-19T05:01:20.869872+0000 (oldest deadline 2024-09-19T05:01:46.769918+0000) 2024-09-19T05:01:57.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:57 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:57.474+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-19T05:01:29.670871+0000 front 2024-09-19T05:01:29.670805+0000 (oldest deadline 2024-09-19T05:01:54.370738+0000) 2024-09-19T05:01:57.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:57 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:57.473+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:01:57.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:57 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:57.473+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:01:57.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:57 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:57.473+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.009788+0000 front 2024-09-19T05:01:04.009844+0000 (oldest deadline 2024-09-19T05:01:28.709792+0000) 2024-09-19T05:01:57.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:57 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:57.473+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:14.010849+0000 front 2024-09-19T05:01:14.010831+0000 (oldest deadline 2024-09-19T05:01:38.710587+0000) 2024-09-19T05:01:57.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:57 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:57.473+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:18.711264+0000 front 2024-09-19T05:01:18.711209+0000 (oldest deadline 2024-09-19T05:01:44.611168+0000) 2024-09-19T05:01:57.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:57 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:57.473+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-19T05:01:29.812666+0000 front 2024-09-19T05:01:29.812627+0000 (oldest deadline 2024-09-19T05:01:54.512727+0000) 2024-09-19T05:01:58.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:58 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:58.061+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.231030+0000 front 2024-09-19T05:00:48.230802+0000 (oldest deadline 2024-09-19T05:01:14.131054+0000) 2024-09-19T05:01:58.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:58 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:58.061+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.232023+0000 front 2024-09-19T05:00:58.232160+0000 (oldest deadline 2024-09-19T05:01:22.332135+0000) 2024-09-19T05:01:58.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:58 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:58.061+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:02.332945+0000 front 2024-09-19T05:01:02.332803+0000 (oldest deadline 2024-09-19T05:01:28.733073+0000) 2024-09-19T05:01:58.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:58 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:58.061+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:13.934098+0000 front 2024-09-19T05:01:13.934134+0000 (oldest deadline 2024-09-19T05:01:36.834314+0000) 2024-09-19T05:01:58.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:58 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:58.061+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:20.235949+0000 front 2024-09-19T05:01:20.235978+0000 (oldest deadline 2024-09-19T05:01:44.935783+0000) 2024-09-19T05:01:58.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:58 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:58.061+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-19T05:01:29.036869+0000 front 2024-09-19T05:01:29.036995+0000 (oldest deadline 2024-09-19T05:01:51.237203+0000) 2024-09-19T05:01:58.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:58 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:58.484+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:01:58.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:58 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:58.484+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.465788+0000 front 2024-09-19T05:00:56.465813+0000 (oldest deadline 2024-09-19T05:01:21.166043+0000) 2024-09-19T05:01:58.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:58 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:58.484+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:05.768290+0000 front 2024-09-19T05:01:05.768030+0000 (oldest deadline 2024-09-19T05:01:31.067908+0000) 2024-09-19T05:01:58.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:58 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:58.484+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.768950+0000 front 2024-09-19T05:01:12.769033+0000 (oldest deadline 2024-09-19T05:01:36.268756+0000) 2024-09-19T05:01:58.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:58 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:58.484+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:20.869854+0000 front 2024-09-19T05:01:20.869872+0000 (oldest deadline 2024-09-19T05:01:46.769918+0000) 2024-09-19T05:01:58.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:58 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:58.484+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-19T05:01:29.670871+0000 front 2024-09-19T05:01:29.670805+0000 (oldest deadline 2024-09-19T05:01:54.370738+0000) 2024-09-19T05:01:58.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:58 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:58.479+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:01:58.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:58 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:58.479+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:01:58.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:58 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:58.479+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.009788+0000 front 2024-09-19T05:01:04.009844+0000 (oldest deadline 2024-09-19T05:01:28.709792+0000) 2024-09-19T05:01:58.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:58 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:58.479+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:14.010849+0000 front 2024-09-19T05:01:14.010831+0000 (oldest deadline 2024-09-19T05:01:38.710587+0000) 2024-09-19T05:01:58.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:58 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:58.479+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:18.711264+0000 front 2024-09-19T05:01:18.711209+0000 (oldest deadline 2024-09-19T05:01:44.611168+0000) 2024-09-19T05:01:58.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:58 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:58.479+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-19T05:01:29.812666+0000 front 2024-09-19T05:01:29.812627+0000 (oldest deadline 2024-09-19T05:01:54.512727+0000) 2024-09-19T05:01:59.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:59 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:59.021+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.231030+0000 front 2024-09-19T05:00:48.230802+0000 (oldest deadline 2024-09-19T05:01:14.131054+0000) 2024-09-19T05:01:59.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:59 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:59.021+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.232023+0000 front 2024-09-19T05:00:58.232160+0000 (oldest deadline 2024-09-19T05:01:22.332135+0000) 2024-09-19T05:01:59.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:59 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:59.021+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:02.332945+0000 front 2024-09-19T05:01:02.332803+0000 (oldest deadline 2024-09-19T05:01:28.733073+0000) 2024-09-19T05:01:59.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:59 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:59.021+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:13.934098+0000 front 2024-09-19T05:01:13.934134+0000 (oldest deadline 2024-09-19T05:01:36.834314+0000) 2024-09-19T05:01:59.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:59 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:59.021+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:20.235949+0000 front 2024-09-19T05:01:20.235978+0000 (oldest deadline 2024-09-19T05:01:44.935783+0000) 2024-09-19T05:01:59.361 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:59 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:59.021+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-19T05:01:29.036869+0000 front 2024-09-19T05:01:29.036995+0000 (oldest deadline 2024-09-19T05:01:51.237203+0000) 2024-09-19T05:01:59.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:59 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:59.513+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:01:59.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:59 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:59.513+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.465788+0000 front 2024-09-19T05:00:56.465813+0000 (oldest deadline 2024-09-19T05:01:21.166043+0000) 2024-09-19T05:01:59.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:59 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:59.513+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:05.768290+0000 front 2024-09-19T05:01:05.768030+0000 (oldest deadline 2024-09-19T05:01:31.067908+0000) 2024-09-19T05:01:59.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:59 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:59.513+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.768950+0000 front 2024-09-19T05:01:12.769033+0000 (oldest deadline 2024-09-19T05:01:36.268756+0000) 2024-09-19T05:01:59.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:59 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:59.513+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:20.869854+0000 front 2024-09-19T05:01:20.869872+0000 (oldest deadline 2024-09-19T05:01:46.769918+0000) 2024-09-19T05:01:59.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:01:59 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:01:59.513+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-19T05:01:29.670871+0000 front 2024-09-19T05:01:29.670805+0000 (oldest deadline 2024-09-19T05:01:54.370738+0000) 2024-09-19T05:01:59.860 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:59 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:59.432+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:01:59.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:59 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:59.432+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:01:59.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:59 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:59.432+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.009788+0000 front 2024-09-19T05:01:04.009844+0000 (oldest deadline 2024-09-19T05:01:28.709792+0000) 2024-09-19T05:01:59.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:59 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:59.432+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:14.010849+0000 front 2024-09-19T05:01:14.010831+0000 (oldest deadline 2024-09-19T05:01:38.710587+0000) 2024-09-19T05:01:59.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:59 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:59.432+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:18.711264+0000 front 2024-09-19T05:01:18.711209+0000 (oldest deadline 2024-09-19T05:01:44.611168+0000) 2024-09-19T05:01:59.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:01:59 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:01:59.432+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-19T05:01:29.812666+0000 front 2024-09-19T05:01:29.812627+0000 (oldest deadline 2024-09-19T05:01:54.512727+0000) 2024-09-19T05:02:00.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:59 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:59.981+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.231030+0000 front 2024-09-19T05:00:48.230802+0000 (oldest deadline 2024-09-19T05:01:14.131054+0000) 2024-09-19T05:02:00.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:59 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:59.981+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.232023+0000 front 2024-09-19T05:00:58.232160+0000 (oldest deadline 2024-09-19T05:01:22.332135+0000) 2024-09-19T05:02:00.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:59 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:59.981+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:02.332945+0000 front 2024-09-19T05:01:02.332803+0000 (oldest deadline 2024-09-19T05:01:28.733073+0000) 2024-09-19T05:02:00.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:59 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:59.981+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:13.934098+0000 front 2024-09-19T05:01:13.934134+0000 (oldest deadline 2024-09-19T05:01:36.834314+0000) 2024-09-19T05:02:00.361 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:59 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:59.981+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:20.235949+0000 front 2024-09-19T05:01:20.235978+0000 (oldest deadline 2024-09-19T05:01:44.935783+0000) 2024-09-19T05:02:00.361 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:01:59 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:01:59.981+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-19T05:01:29.036869+0000 front 2024-09-19T05:01:29.036995+0000 (oldest deadline 2024-09-19T05:01:51.237203+0000) 2024-09-19T05:02:00.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:00 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:00.524+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:02:00.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:00 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:00.524+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.465788+0000 front 2024-09-19T05:00:56.465813+0000 (oldest deadline 2024-09-19T05:01:21.166043+0000) 2024-09-19T05:02:00.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:00 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:00.524+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:05.768290+0000 front 2024-09-19T05:01:05.768030+0000 (oldest deadline 2024-09-19T05:01:31.067908+0000) 2024-09-19T05:02:00.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:00 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:00.524+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.768950+0000 front 2024-09-19T05:01:12.769033+0000 (oldest deadline 2024-09-19T05:01:36.268756+0000) 2024-09-19T05:02:00.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:00 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:00.524+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:20.869854+0000 front 2024-09-19T05:01:20.869872+0000 (oldest deadline 2024-09-19T05:01:46.769918+0000) 2024-09-19T05:02:00.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:00 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:00.524+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-19T05:01:29.670871+0000 front 2024-09-19T05:01:29.670805+0000 (oldest deadline 2024-09-19T05:01:54.370738+0000) 2024-09-19T05:02:00.860 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:00 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:00.397+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:02:00.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:00 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:00.397+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:02:00.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:00 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:00.397+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.009788+0000 front 2024-09-19T05:01:04.009844+0000 (oldest deadline 2024-09-19T05:01:28.709792+0000) 2024-09-19T05:02:00.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:00 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:00.397+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:14.010849+0000 front 2024-09-19T05:01:14.010831+0000 (oldest deadline 2024-09-19T05:01:38.710587+0000) 2024-09-19T05:02:00.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:00 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:00.397+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:18.711264+0000 front 2024-09-19T05:01:18.711209+0000 (oldest deadline 2024-09-19T05:01:44.611168+0000) 2024-09-19T05:02:00.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:00 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:00.397+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-19T05:01:29.812666+0000 front 2024-09-19T05:01:29.812627+0000 (oldest deadline 2024-09-19T05:01:54.512727+0000) 2024-09-19T05:02:01.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:02:00 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:02:00.980+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:48.231030+0000 front 2024-09-19T05:00:48.230802+0000 (oldest deadline 2024-09-19T05:01:14.131054+0000) 2024-09-19T05:02:01.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:02:00 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:02:00.980+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:58.232023+0000 front 2024-09-19T05:00:58.232160+0000 (oldest deadline 2024-09-19T05:01:22.332135+0000) 2024-09-19T05:02:01.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:02:00 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:02:00.980+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:02.332945+0000 front 2024-09-19T05:01:02.332803+0000 (oldest deadline 2024-09-19T05:01:28.733073+0000) 2024-09-19T05:02:01.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:02:00 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:02:00.980+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:13.934098+0000 front 2024-09-19T05:01:13.934134+0000 (oldest deadline 2024-09-19T05:01:36.834314+0000) 2024-09-19T05:02:01.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:02:00 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:02:00.980+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:20.235949+0000 front 2024-09-19T05:01:20.235978+0000 (oldest deadline 2024-09-19T05:01:44.935783+0000) 2024-09-19T05:02:01.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:02:00 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:02:00.980+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-19T05:01:29.036869+0000 front 2024-09-19T05:01:29.036995+0000 (oldest deadline 2024-09-19T05:01:51.237203+0000) 2024-09-19T05:02:01.361 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:02:00 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9[65159]: 2024-09-19T05:02:00.980+0000 7f57f2c47640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-19T05:01:35.738797+0000 front 2024-09-19T05:01:35.738778+0000 (oldest deadline 2024-09-19T05:02:00.339247+0000) 2024-09-19T05:02:01.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:01 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:01.554+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:02:01.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:01 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:01.554+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.465788+0000 front 2024-09-19T05:00:56.465813+0000 (oldest deadline 2024-09-19T05:01:21.166043+0000) 2024-09-19T05:02:01.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:01 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:01.554+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:05.768290+0000 front 2024-09-19T05:01:05.768030+0000 (oldest deadline 2024-09-19T05:01:31.067908+0000) 2024-09-19T05:02:01.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:01 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:01.554+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.768950+0000 front 2024-09-19T05:01:12.769033+0000 (oldest deadline 2024-09-19T05:01:36.268756+0000) 2024-09-19T05:02:01.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:01 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:01.554+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:20.869854+0000 front 2024-09-19T05:01:20.869872+0000 (oldest deadline 2024-09-19T05:01:46.769918+0000) 2024-09-19T05:02:01.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:01 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:01.554+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-19T05:01:29.670871+0000 front 2024-09-19T05:01:29.670805+0000 (oldest deadline 2024-09-19T05:01:54.370738+0000) 2024-09-19T05:02:01.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:01 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:01.397+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:02:01.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:01 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:01.397+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:02:01.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:01 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:01.397+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.009788+0000 front 2024-09-19T05:01:04.009844+0000 (oldest deadline 2024-09-19T05:01:28.709792+0000) 2024-09-19T05:02:01.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:01 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:01.397+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:14.010849+0000 front 2024-09-19T05:01:14.010831+0000 (oldest deadline 2024-09-19T05:01:38.710587+0000) 2024-09-19T05:02:01.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:01 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:01.397+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:18.711264+0000 front 2024-09-19T05:01:18.711209+0000 (oldest deadline 2024-09-19T05:01:44.611168+0000) 2024-09-19T05:02:01.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:01 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:01.397+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-19T05:01:29.812666+0000 front 2024-09-19T05:01:29.812627+0000 (oldest deadline 2024-09-19T05:01:54.512727+0000) 2024-09-19T05:02:02.360 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:02:02 smithi002 podman[104380]: 2024-09-19 05:02:02.095550092 +0000 UTC m=+5.437310886 container died 748e1fc259f6c677f8d50a910a28dc18dc3466a7403bc6028ce8c563456657ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T05:02:02.712 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:02:02 smithi002 podman[104380]: 2024-09-19 05:02:02.460194771 +0000 UTC m=+5.801955562 container cleanup 748e1fc259f6c677f8d50a910a28dc18dc3466a7403bc6028ce8c563456657ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T05:02:02.712 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:02:02 smithi002 bash[104380]: ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9 2024-09-19T05:02:02.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:02 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:02.517+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:02:02.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:02 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:02.517+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.465788+0000 front 2024-09-19T05:00:56.465813+0000 (oldest deadline 2024-09-19T05:01:21.166043+0000) 2024-09-19T05:02:02.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:02 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:02.517+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:05.768290+0000 front 2024-09-19T05:01:05.768030+0000 (oldest deadline 2024-09-19T05:01:31.067908+0000) 2024-09-19T05:02:02.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:02 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:02.517+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.768950+0000 front 2024-09-19T05:01:12.769033+0000 (oldest deadline 2024-09-19T05:01:36.268756+0000) 2024-09-19T05:02:02.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:02 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:02.517+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:20.869854+0000 front 2024-09-19T05:01:20.869872+0000 (oldest deadline 2024-09-19T05:01:46.769918+0000) 2024-09-19T05:02:02.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:02 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:02.517+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-19T05:01:29.670871+0000 front 2024-09-19T05:01:29.670805+0000 (oldest deadline 2024-09-19T05:01:54.370738+0000) 2024-09-19T05:02:02.807 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:02 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:02.517+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-19T05:01:36.572493+0000 front 2024-09-19T05:01:36.572519+0000 (oldest deadline 2024-09-19T05:02:02.472259+0000) 2024-09-19T05:02:02.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:02 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:02.363+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:02:02.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:02 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:02.363+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:02:02.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:02 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:02.363+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.009788+0000 front 2024-09-19T05:01:04.009844+0000 (oldest deadline 2024-09-19T05:01:28.709792+0000) 2024-09-19T05:02:02.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:02 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:02.363+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:14.010849+0000 front 2024-09-19T05:01:14.010831+0000 (oldest deadline 2024-09-19T05:01:38.710587+0000) 2024-09-19T05:02:02.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:02 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:02.363+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:18.711264+0000 front 2024-09-19T05:01:18.711209+0000 (oldest deadline 2024-09-19T05:01:44.611168+0000) 2024-09-19T05:02:02.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:02 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:02.363+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-19T05:01:29.812666+0000 front 2024-09-19T05:01:29.812627+0000 (oldest deadline 2024-09-19T05:01:54.512727+0000) 2024-09-19T05:02:03.029 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:02:02 smithi002 podman[104397]: 2024-09-19 05:02:02.71154649 +0000 UTC m=+0.616617937 container remove 748e1fc259f6c677f8d50a910a28dc18dc3466a7403bc6028ce8c563456657ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-19T05:02:03.357 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:02:03 smithi002 podman[104485]: 2024-09-19 05:02:03.02904886 +0000 UTC m=+0.103450261 container create ea6579fb451707ee899dfb2a26178b460881cfc8be3087b8061ec4db2b69ec32 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T05:02:03.357 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:02:03 smithi002 podman[104485]: 2024-09-19 05:02:02.942121561 +0000 UTC m=+0.016522920 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:02:03.357 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:02:03 smithi002 podman[104485]: 2024-09-19 05:02:03.273482346 +0000 UTC m=+0.347883713 container init ea6579fb451707ee899dfb2a26178b460881cfc8be3087b8061ec4db2b69ec32 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-19T05:02:03.357 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:02:03 smithi002 podman[104485]: 2024-09-19 05:02:03.277055444 +0000 UTC m=+0.351456808 container start ea6579fb451707ee899dfb2a26178b460881cfc8be3087b8061ec4db2b69ec32 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:02:03.357 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:02:03 smithi002 podman[104485]: 2024-09-19 05:02:03.356318068 +0000 UTC m=+0.430719441 container attach ea6579fb451707ee899dfb2a26178b460881cfc8be3087b8061ec4db2b69ec32 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9-deactivate, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-19T05:02:03.610 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 05:02:03 smithi002 podman[104485]: 2024-09-19 05:02:03.469277399 +0000 UTC m=+0.543678765 container died ea6579fb451707ee899dfb2a26178b460881cfc8be3087b8061ec4db2b69ec32 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-9-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-19T05:02:03.610 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:03 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:03.339+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:02:03.611 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:03 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:03.339+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:02:03.611 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:03 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:03.339+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.009788+0000 front 2024-09-19T05:01:04.009844+0000 (oldest deadline 2024-09-19T05:01:28.709792+0000) 2024-09-19T05:02:03.611 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:03 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:03.339+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:14.010849+0000 front 2024-09-19T05:01:14.010831+0000 (oldest deadline 2024-09-19T05:01:38.710587+0000) 2024-09-19T05:02:03.611 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:03 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:03.339+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:18.711264+0000 front 2024-09-19T05:01:18.711209+0000 (oldest deadline 2024-09-19T05:01:44.611168+0000) 2024-09-19T05:02:03.611 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:03 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:03.339+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-19T05:01:29.812666+0000 front 2024-09-19T05:01:29.812627+0000 (oldest deadline 2024-09-19T05:01:54.512727+0000) 2024-09-19T05:02:04.057 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:03 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:03.562+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:02:04.057 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:03 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:03.562+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.465788+0000 front 2024-09-19T05:00:56.465813+0000 (oldest deadline 2024-09-19T05:01:21.166043+0000) 2024-09-19T05:02:04.057 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:03 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:03.562+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:05.768290+0000 front 2024-09-19T05:01:05.768030+0000 (oldest deadline 2024-09-19T05:01:31.067908+0000) 2024-09-19T05:02:04.057 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:03 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:03.562+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.768950+0000 front 2024-09-19T05:01:12.769033+0000 (oldest deadline 2024-09-19T05:01:36.268756+0000) 2024-09-19T05:02:04.057 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:03 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:03.562+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:20.869854+0000 front 2024-09-19T05:01:20.869872+0000 (oldest deadline 2024-09-19T05:01:46.769918+0000) 2024-09-19T05:02:04.058 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:03 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:03.562+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-19T05:01:29.670871+0000 front 2024-09-19T05:01:29.670805+0000 (oldest deadline 2024-09-19T05:01:54.370738+0000) 2024-09-19T05:02:04.058 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:03 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:03.562+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-19T05:01:36.572493+0000 front 2024-09-19T05:01:36.572519+0000 (oldest deadline 2024-09-19T05:02:02.472259+0000) 2024-09-19T05:02:04.261 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@osd.9.service' 2024-09-19T05:02:04.304 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:02:04.304 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-19T05:02:04.304 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-19T05:02:04.304 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-d46630c4-7640-11ef-bceb-c7b262605968@osd.10 2024-09-19T05:02:04.604 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:04 smithi018 systemd[1]: Stopping Ceph osd.10 for d46630c4-7640-11ef-bceb-c7b262605968... 2024-09-19T05:02:04.610 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:04 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:04.357+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:02:04.610 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:04 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:04.357+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:02:04.611 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:04 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:04.357+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.009788+0000 front 2024-09-19T05:01:04.009844+0000 (oldest deadline 2024-09-19T05:01:28.709792+0000) 2024-09-19T05:02:04.611 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:04 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:04.357+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:14.010849+0000 front 2024-09-19T05:01:14.010831+0000 (oldest deadline 2024-09-19T05:01:38.710587+0000) 2024-09-19T05:02:04.611 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:04 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:04.357+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:18.711264+0000 front 2024-09-19T05:01:18.711209+0000 (oldest deadline 2024-09-19T05:01:44.611168+0000) 2024-09-19T05:02:04.611 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:04 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:04.357+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-19T05:01:29.812666+0000 front 2024-09-19T05:01:29.812627+0000 (oldest deadline 2024-09-19T05:01:54.512727+0000) 2024-09-19T05:02:05.057 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:04 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:04.602+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:02:05.057 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:04 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:04.602+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.465788+0000 front 2024-09-19T05:00:56.465813+0000 (oldest deadline 2024-09-19T05:01:21.166043+0000) 2024-09-19T05:02:05.058 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:04 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:04.602+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:05.768290+0000 front 2024-09-19T05:01:05.768030+0000 (oldest deadline 2024-09-19T05:01:31.067908+0000) 2024-09-19T05:02:05.058 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:04 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:04.602+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.768950+0000 front 2024-09-19T05:01:12.769033+0000 (oldest deadline 2024-09-19T05:01:36.268756+0000) 2024-09-19T05:02:05.058 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:04 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:04.602+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:20.869854+0000 front 2024-09-19T05:01:20.869872+0000 (oldest deadline 2024-09-19T05:01:46.769918+0000) 2024-09-19T05:02:05.058 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:04 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:04.602+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-19T05:01:29.670871+0000 front 2024-09-19T05:01:29.670805+0000 (oldest deadline 2024-09-19T05:01:54.370738+0000) 2024-09-19T05:02:05.058 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:04 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:04.602+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-19T05:01:36.572493+0000 front 2024-09-19T05:01:36.572519+0000 (oldest deadline 2024-09-19T05:02:02.472259+0000) 2024-09-19T05:02:05.058 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:04 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:04.614+0000 7fd45a398640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:02:05.058 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:04 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:04.614+0000 7fd45a398640 -1 osd.10 96 *** Got signal Terminated *** 2024-09-19T05:02:05.058 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:04 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:04.614+0000 7fd45a398640 -1 osd.10 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T05:02:05.610 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:05 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:05.350+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:02:05.611 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:05 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:05.350+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:02:05.611 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:05 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:05.350+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.009788+0000 front 2024-09-19T05:01:04.009844+0000 (oldest deadline 2024-09-19T05:01:28.709792+0000) 2024-09-19T05:02:05.611 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:05 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:05.350+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:14.010849+0000 front 2024-09-19T05:01:14.010831+0000 (oldest deadline 2024-09-19T05:01:38.710587+0000) 2024-09-19T05:02:05.611 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:05 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:05.350+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:18.711264+0000 front 2024-09-19T05:01:18.711209+0000 (oldest deadline 2024-09-19T05:01:44.611168+0000) 2024-09-19T05:02:05.611 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:05 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:05.350+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-19T05:01:29.812666+0000 front 2024-09-19T05:01:29.812627+0000 (oldest deadline 2024-09-19T05:01:54.512727+0000) 2024-09-19T05:02:06.057 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:05 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:05.637+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:02:06.057 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:05 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:05.637+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.465788+0000 front 2024-09-19T05:00:56.465813+0000 (oldest deadline 2024-09-19T05:01:21.166043+0000) 2024-09-19T05:02:06.057 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:05 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:05.637+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:05.768290+0000 front 2024-09-19T05:01:05.768030+0000 (oldest deadline 2024-09-19T05:01:31.067908+0000) 2024-09-19T05:02:06.057 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:05 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:05.637+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.768950+0000 front 2024-09-19T05:01:12.769033+0000 (oldest deadline 2024-09-19T05:01:36.268756+0000) 2024-09-19T05:02:06.057 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:05 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:05.637+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:20.869854+0000 front 2024-09-19T05:01:20.869872+0000 (oldest deadline 2024-09-19T05:01:46.769918+0000) 2024-09-19T05:02:06.057 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:05 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:05.637+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-19T05:01:29.670871+0000 front 2024-09-19T05:01:29.670805+0000 (oldest deadline 2024-09-19T05:01:54.370738+0000) 2024-09-19T05:02:06.058 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:05 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:05.637+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-19T05:01:36.572493+0000 front 2024-09-19T05:01:36.572519+0000 (oldest deadline 2024-09-19T05:02:02.472259+0000) 2024-09-19T05:02:06.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:06 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:06.376+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:02:06.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:06 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:06.376+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:02:06.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:06 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:06.376+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.009788+0000 front 2024-09-19T05:01:04.009844+0000 (oldest deadline 2024-09-19T05:01:28.709792+0000) 2024-09-19T05:02:06.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:06 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:06.376+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:14.010849+0000 front 2024-09-19T05:01:14.010831+0000 (oldest deadline 2024-09-19T05:01:38.710587+0000) 2024-09-19T05:02:06.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:06 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:06.376+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:18.711264+0000 front 2024-09-19T05:01:18.711209+0000 (oldest deadline 2024-09-19T05:01:44.611168+0000) 2024-09-19T05:02:06.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:06 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:06.376+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-19T05:01:29.812666+0000 front 2024-09-19T05:01:29.812627+0000 (oldest deadline 2024-09-19T05:01:54.512727+0000) 2024-09-19T05:02:07.057 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:06 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:06.596+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:02:07.057 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:06 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:06.596+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.465788+0000 front 2024-09-19T05:00:56.465813+0000 (oldest deadline 2024-09-19T05:01:21.166043+0000) 2024-09-19T05:02:07.057 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:06 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:06.596+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:05.768290+0000 front 2024-09-19T05:01:05.768030+0000 (oldest deadline 2024-09-19T05:01:31.067908+0000) 2024-09-19T05:02:07.057 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:06 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:06.596+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.768950+0000 front 2024-09-19T05:01:12.769033+0000 (oldest deadline 2024-09-19T05:01:36.268756+0000) 2024-09-19T05:02:07.057 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:06 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:06.596+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:20.869854+0000 front 2024-09-19T05:01:20.869872+0000 (oldest deadline 2024-09-19T05:01:46.769918+0000) 2024-09-19T05:02:07.057 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:06 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:06.596+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-19T05:01:29.670871+0000 front 2024-09-19T05:01:29.670805+0000 (oldest deadline 2024-09-19T05:01:54.370738+0000) 2024-09-19T05:02:07.057 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:06 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:06.596+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-19T05:01:36.572493+0000 front 2024-09-19T05:01:36.572519+0000 (oldest deadline 2024-09-19T05:02:02.472259+0000) 2024-09-19T05:02:07.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:07 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:07.411+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:02:07.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:07 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:07.411+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:02:07.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:07 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:07.411+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.009788+0000 front 2024-09-19T05:01:04.009844+0000 (oldest deadline 2024-09-19T05:01:28.709792+0000) 2024-09-19T05:02:07.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:07 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:07.411+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:14.010849+0000 front 2024-09-19T05:01:14.010831+0000 (oldest deadline 2024-09-19T05:01:38.710587+0000) 2024-09-19T05:02:07.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:07 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:07.411+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:18.711264+0000 front 2024-09-19T05:01:18.711209+0000 (oldest deadline 2024-09-19T05:01:44.611168+0000) 2024-09-19T05:02:07.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:07 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:07.411+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-19T05:01:29.812666+0000 front 2024-09-19T05:01:29.812627+0000 (oldest deadline 2024-09-19T05:01:54.512727+0000) 2024-09-19T05:02:08.057 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:07 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:07.614+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:02:08.057 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:07 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:07.614+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.465788+0000 front 2024-09-19T05:00:56.465813+0000 (oldest deadline 2024-09-19T05:01:21.166043+0000) 2024-09-19T05:02:08.057 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:07 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:07.614+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:05.768290+0000 front 2024-09-19T05:01:05.768030+0000 (oldest deadline 2024-09-19T05:01:31.067908+0000) 2024-09-19T05:02:08.057 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:07 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:07.614+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.768950+0000 front 2024-09-19T05:01:12.769033+0000 (oldest deadline 2024-09-19T05:01:36.268756+0000) 2024-09-19T05:02:08.057 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:07 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:07.614+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:20.869854+0000 front 2024-09-19T05:01:20.869872+0000 (oldest deadline 2024-09-19T05:01:46.769918+0000) 2024-09-19T05:02:08.057 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:07 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:07.614+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-19T05:01:29.670871+0000 front 2024-09-19T05:01:29.670805+0000 (oldest deadline 2024-09-19T05:01:54.370738+0000) 2024-09-19T05:02:08.058 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:07 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:07.614+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-19T05:01:36.572493+0000 front 2024-09-19T05:01:36.572519+0000 (oldest deadline 2024-09-19T05:02:02.472259+0000) 2024-09-19T05:02:08.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:08 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:08.428+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:02:08.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:08 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:08.428+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:02:08.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:08 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:08.428+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.009788+0000 front 2024-09-19T05:01:04.009844+0000 (oldest deadline 2024-09-19T05:01:28.709792+0000) 2024-09-19T05:02:08.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:08 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:08.428+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:14.010849+0000 front 2024-09-19T05:01:14.010831+0000 (oldest deadline 2024-09-19T05:01:38.710587+0000) 2024-09-19T05:02:08.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:08 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:08.428+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:18.711264+0000 front 2024-09-19T05:01:18.711209+0000 (oldest deadline 2024-09-19T05:01:44.611168+0000) 2024-09-19T05:02:08.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:08 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:08.428+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-19T05:01:29.812666+0000 front 2024-09-19T05:01:29.812627+0000 (oldest deadline 2024-09-19T05:01:54.512727+0000) 2024-09-19T05:02:08.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:08 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:08.428+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6820 osd.7 since back 2024-09-19T05:01:43.814991+0000 front 2024-09-19T05:01:43.815063+0000 (oldest deadline 2024-09-19T05:02:07.914909+0000) 2024-09-19T05:02:09.057 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:08 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:08.646+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:50.164146+0000 front 2024-09-19T05:00:50.164119+0000 (oldest deadline 2024-09-19T05:01:13.564804+0000) 2024-09-19T05:02:09.057 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:08 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:08.646+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:56.465788+0000 front 2024-09-19T05:00:56.465813+0000 (oldest deadline 2024-09-19T05:01:21.166043+0000) 2024-09-19T05:02:09.057 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:08 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:08.646+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:05.768290+0000 front 2024-09-19T05:01:05.768030+0000 (oldest deadline 2024-09-19T05:01:31.067908+0000) 2024-09-19T05:02:09.058 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:08 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:08.646+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:12.768950+0000 front 2024-09-19T05:01:12.769033+0000 (oldest deadline 2024-09-19T05:01:36.268756+0000) 2024-09-19T05:02:09.058 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:08 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:08.646+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:20.869854+0000 front 2024-09-19T05:01:20.869872+0000 (oldest deadline 2024-09-19T05:01:46.769918+0000) 2024-09-19T05:02:09.058 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:08 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:08.646+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-19T05:01:29.670871+0000 front 2024-09-19T05:01:29.670805+0000 (oldest deadline 2024-09-19T05:01:54.370738+0000) 2024-09-19T05:02:09.058 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:08 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10[59341]: 2024-09-19T05:02:08.646+0000 7fd452995640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-19T05:01:36.572493+0000 front 2024-09-19T05:01:36.572519+0000 (oldest deadline 2024-09-19T05:02:02.472259+0000) 2024-09-19T05:02:09.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:09 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:09.386+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:02:09.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:09 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:09.386+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:02:09.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:09 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:09.386+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.009788+0000 front 2024-09-19T05:01:04.009844+0000 (oldest deadline 2024-09-19T05:01:28.709792+0000) 2024-09-19T05:02:09.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:09 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:09.386+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:14.010849+0000 front 2024-09-19T05:01:14.010831+0000 (oldest deadline 2024-09-19T05:01:38.710587+0000) 2024-09-19T05:02:09.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:09 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:09.386+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:18.711264+0000 front 2024-09-19T05:01:18.711209+0000 (oldest deadline 2024-09-19T05:01:44.611168+0000) 2024-09-19T05:02:09.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:09 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:09.386+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-19T05:01:29.812666+0000 front 2024-09-19T05:01:29.812627+0000 (oldest deadline 2024-09-19T05:01:54.512727+0000) 2024-09-19T05:02:09.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:09 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:09.386+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6820 osd.7 since back 2024-09-19T05:01:43.814991+0000 front 2024-09-19T05:01:43.815063+0000 (oldest deadline 2024-09-19T05:02:07.914909+0000) 2024-09-19T05:02:10.282 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:09 smithi018 podman[71546]: 2024-09-19 05:02:09.986495803 +0000 UTC m=+5.474937247 container died 55aa501e5af666dda151bb4db1b2d5d25ca6ed112e31854d86b261b32ea41915 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731) 2024-09-19T05:02:10.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:10 smithi018 podman[71546]: 2024-09-19 05:02:10.380435556 +0000 UTC m=+5.868876994 container cleanup 55aa501e5af666dda151bb4db1b2d5d25ca6ed112e31854d86b261b32ea41915 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True) 2024-09-19T05:02:10.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:10 smithi018 bash[71546]: ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10 2024-09-19T05:02:10.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:10 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:10.371+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:02:10.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:10 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:10.371+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:02:10.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:10 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:10.371+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.009788+0000 front 2024-09-19T05:01:04.009844+0000 (oldest deadline 2024-09-19T05:01:28.709792+0000) 2024-09-19T05:02:10.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:10 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:10.371+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:14.010849+0000 front 2024-09-19T05:01:14.010831+0000 (oldest deadline 2024-09-19T05:01:38.710587+0000) 2024-09-19T05:02:10.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:10 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:10.371+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:18.711264+0000 front 2024-09-19T05:01:18.711209+0000 (oldest deadline 2024-09-19T05:01:44.611168+0000) 2024-09-19T05:02:10.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:10 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:10.371+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-19T05:01:29.812666+0000 front 2024-09-19T05:01:29.812627+0000 (oldest deadline 2024-09-19T05:01:54.512727+0000) 2024-09-19T05:02:10.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:10 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:10.371+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6820 osd.7 since back 2024-09-19T05:01:43.814991+0000 front 2024-09-19T05:01:43.815063+0000 (oldest deadline 2024-09-19T05:02:07.914909+0000) 2024-09-19T05:02:10.958 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:10 smithi018 podman[71562]: 2024-09-19 05:02:10.623003534 +0000 UTC m=+0.630212469 container remove 55aa501e5af666dda151bb4db1b2d5d25ca6ed112e31854d86b261b32ea41915 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-19T05:02:11.211 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:10 smithi018 podman[71649]: 2024-09-19 05:02:10.860575369 +0000 UTC m=+0.016412144 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:02:11.211 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:10 smithi018 podman[71649]: 2024-09-19 05:02:10.965448312 +0000 UTC m=+0.121285119 container create e03fe61f84e2c89be392f9cabb73d2e0958e8547a87a2707f1098df643fe6285 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-19T05:02:11.211 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:11 smithi018 podman[71649]: 2024-09-19 05:02:11.209955002 +0000 UTC m=+0.365791776 container init e03fe61f84e2c89be392f9cabb73d2e0958e8547a87a2707f1098df643fe6285 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4) 2024-09-19T05:02:11.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:11 smithi018 podman[71649]: 2024-09-19 05:02:11.213378034 +0000 UTC m=+0.369214799 container start e03fe61f84e2c89be392f9cabb73d2e0958e8547a87a2707f1098df643fe6285 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-19T05:02:11.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:11 smithi018 podman[71649]: 2024-09-19 05:02:11.301356855 +0000 UTC m=+0.457193634 container attach e03fe61f84e2c89be392f9cabb73d2e0958e8547a87a2707f1098df643fe6285 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-19T05:02:11.557 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:11 smithi018 podman[71649]: 2024-09-19 05:02:11.407733169 +0000 UTC m=+0.563569934 container died e03fe61f84e2c89be392f9cabb73d2e0958e8547a87a2707f1098df643fe6285 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:02:11.860 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:11 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:11.417+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:02:11.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:11 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:11.417+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:02:11.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:11 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:11.417+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.009788+0000 front 2024-09-19T05:01:04.009844+0000 (oldest deadline 2024-09-19T05:01:28.709792+0000) 2024-09-19T05:02:11.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:11 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:11.417+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:14.010849+0000 front 2024-09-19T05:01:14.010831+0000 (oldest deadline 2024-09-19T05:01:38.710587+0000) 2024-09-19T05:02:11.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:11 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:11.417+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:18.711264+0000 front 2024-09-19T05:01:18.711209+0000 (oldest deadline 2024-09-19T05:01:44.611168+0000) 2024-09-19T05:02:11.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:11 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:11.417+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-19T05:01:29.812666+0000 front 2024-09-19T05:01:29.812627+0000 (oldest deadline 2024-09-19T05:01:54.512727+0000) 2024-09-19T05:02:11.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:11 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:11.417+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6820 osd.7 since back 2024-09-19T05:01:43.814991+0000 front 2024-09-19T05:01:43.815063+0000 (oldest deadline 2024-09-19T05:02:07.914909+0000) 2024-09-19T05:02:11.912 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@osd.10.service' 2024-09-19T05:02:11.937 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:11 smithi018 podman[71672]: 2024-09-19 05:02:11.895910057 +0000 UTC m=+0.482183936 container remove e03fe61f84e2c89be392f9cabb73d2e0958e8547a87a2707f1098df643fe6285 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731) 2024-09-19T05:02:11.937 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:11 smithi018 systemd[1]: ceph-d46630c4-7640-11ef-bceb-c7b262605968@osd.10.service: Deactivated successfully. 2024-09-19T05:02:11.937 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:11 smithi018 systemd[1]: Stopped Ceph osd.10 for d46630c4-7640-11ef-bceb-c7b262605968. 2024-09-19T05:02:11.937 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 19 05:02:11 smithi018 systemd[1]: ceph-d46630c4-7640-11ef-bceb-c7b262605968@osd.10.service: Consumed 13.111s CPU time. 2024-09-19T05:02:11.953 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:02:11.953 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-19T05:02:11.953 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-19T05:02:11.954 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-d46630c4-7640-11ef-bceb-c7b262605968@osd.11 2024-09-19T05:02:12.276 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:12 smithi116 systemd[1]: Stopping Ceph osd.11 for d46630c4-7640-11ef-bceb-c7b262605968... 2024-09-19T05:02:12.611 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:12 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:12.274+0000 7f3039ae9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:02:12.611 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:12 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:12.274+0000 7f3039ae9640 -1 osd.11 96 *** Got signal Terminated *** 2024-09-19T05:02:12.611 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:12 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:12.274+0000 7f3039ae9640 -1 osd.11 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T05:02:12.611 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:12 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:12.410+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:02:12.611 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:12 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:12.410+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:02:12.611 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:12 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:12.410+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.009788+0000 front 2024-09-19T05:01:04.009844+0000 (oldest deadline 2024-09-19T05:01:28.709792+0000) 2024-09-19T05:02:12.611 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:12 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:12.410+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:14.010849+0000 front 2024-09-19T05:01:14.010831+0000 (oldest deadline 2024-09-19T05:01:38.710587+0000) 2024-09-19T05:02:12.611 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:12 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:12.410+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:18.711264+0000 front 2024-09-19T05:01:18.711209+0000 (oldest deadline 2024-09-19T05:01:44.611168+0000) 2024-09-19T05:02:12.611 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:12 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:12.410+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-19T05:01:29.812666+0000 front 2024-09-19T05:01:29.812627+0000 (oldest deadline 2024-09-19T05:01:54.512727+0000) 2024-09-19T05:02:12.611 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:12 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:12.410+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6820 osd.7 since back 2024-09-19T05:01:43.814991+0000 front 2024-09-19T05:01:43.815063+0000 (oldest deadline 2024-09-19T05:02:07.914909+0000) 2024-09-19T05:02:13.860 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:13 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:13.454+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:02:13.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:13 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:13.454+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:02:13.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:13 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:13.454+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.009788+0000 front 2024-09-19T05:01:04.009844+0000 (oldest deadline 2024-09-19T05:01:28.709792+0000) 2024-09-19T05:02:13.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:13 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:13.454+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:14.010849+0000 front 2024-09-19T05:01:14.010831+0000 (oldest deadline 2024-09-19T05:01:38.710587+0000) 2024-09-19T05:02:13.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:13 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:13.454+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:18.711264+0000 front 2024-09-19T05:01:18.711209+0000 (oldest deadline 2024-09-19T05:01:44.611168+0000) 2024-09-19T05:02:13.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:13 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:13.454+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-19T05:01:29.812666+0000 front 2024-09-19T05:01:29.812627+0000 (oldest deadline 2024-09-19T05:01:54.512727+0000) 2024-09-19T05:02:13.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:13 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:13.454+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6820 osd.7 since back 2024-09-19T05:01:43.814991+0000 front 2024-09-19T05:01:43.815063+0000 (oldest deadline 2024-09-19T05:02:07.914909+0000) 2024-09-19T05:02:14.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:14 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:14.444+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:02:14.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:14 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:14.444+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:02:14.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:14 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:14.444+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.009788+0000 front 2024-09-19T05:01:04.009844+0000 (oldest deadline 2024-09-19T05:01:28.709792+0000) 2024-09-19T05:02:14.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:14 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:14.444+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:14.010849+0000 front 2024-09-19T05:01:14.010831+0000 (oldest deadline 2024-09-19T05:01:38.710587+0000) 2024-09-19T05:02:14.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:14 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:14.444+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:18.711264+0000 front 2024-09-19T05:01:18.711209+0000 (oldest deadline 2024-09-19T05:01:44.611168+0000) 2024-09-19T05:02:14.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:14 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:14.444+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-19T05:01:29.812666+0000 front 2024-09-19T05:01:29.812627+0000 (oldest deadline 2024-09-19T05:01:54.512727+0000) 2024-09-19T05:02:14.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:14 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:14.444+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6820 osd.7 since back 2024-09-19T05:01:43.814991+0000 front 2024-09-19T05:01:43.815063+0000 (oldest deadline 2024-09-19T05:02:07.914909+0000) 2024-09-19T05:02:15.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:15 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:15.491+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:02:15.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:15 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:15.491+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:02:15.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:15 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:15.491+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.009788+0000 front 2024-09-19T05:01:04.009844+0000 (oldest deadline 2024-09-19T05:01:28.709792+0000) 2024-09-19T05:02:15.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:15 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:15.491+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:14.010849+0000 front 2024-09-19T05:01:14.010831+0000 (oldest deadline 2024-09-19T05:01:38.710587+0000) 2024-09-19T05:02:15.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:15 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:15.491+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:18.711264+0000 front 2024-09-19T05:01:18.711209+0000 (oldest deadline 2024-09-19T05:01:44.611168+0000) 2024-09-19T05:02:15.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:15 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:15.491+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-19T05:01:29.812666+0000 front 2024-09-19T05:01:29.812627+0000 (oldest deadline 2024-09-19T05:01:54.512727+0000) 2024-09-19T05:02:15.861 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:15 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:15.491+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6820 osd.7 since back 2024-09-19T05:01:43.814991+0000 front 2024-09-19T05:01:43.815063+0000 (oldest deadline 2024-09-19T05:02:07.914909+0000) 2024-09-19T05:02:16.762 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:16 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:16.480+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T05:00:47.206329+0000 front 2024-09-19T05:00:47.206370+0000 (oldest deadline 2024-09-19T05:01:11.906449+0000) 2024-09-19T05:02:16.762 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:16 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:16.480+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-19T05:00:57.008848+0000 front 2024-09-19T05:00:57.008815+0000 (oldest deadline 2024-09-19T05:01:21.708895+0000) 2024-09-19T05:02:16.762 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:16 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:16.480+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-19T05:01:04.009788+0000 front 2024-09-19T05:01:04.009844+0000 (oldest deadline 2024-09-19T05:01:28.709792+0000) 2024-09-19T05:02:16.762 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:16 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:16.480+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T05:01:14.010849+0000 front 2024-09-19T05:01:14.010831+0000 (oldest deadline 2024-09-19T05:01:38.710587+0000) 2024-09-19T05:02:16.763 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:16 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:16.480+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-19T05:01:18.711264+0000 front 2024-09-19T05:01:18.711209+0000 (oldest deadline 2024-09-19T05:01:44.611168+0000) 2024-09-19T05:02:16.763 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:16 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:16.480+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-19T05:01:29.812666+0000 front 2024-09-19T05:01:29.812627+0000 (oldest deadline 2024-09-19T05:01:54.512727+0000) 2024-09-19T05:02:16.763 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:16 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11[59327]: 2024-09-19T05:02:16.480+0000 7f30320e6640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.18:6820 osd.7 since back 2024-09-19T05:01:43.814991+0000 front 2024-09-19T05:01:43.815063+0000 (oldest deadline 2024-09-19T05:02:07.914909+0000) 2024-09-19T05:02:17.959 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:17 smithi116 podman[71375]: 2024-09-19 05:02:17.69815473 +0000 UTC m=+5.553576959 container died 225f52ce53b71d41286091675aa98098031e6350bb071187c63e21355cd200cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True) 2024-09-19T05:02:18.326 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:18 smithi116 podman[71375]: 2024-09-19 05:02:18.058078013 +0000 UTC m=+5.913500279 container cleanup 225f52ce53b71d41286091675aa98098031e6350bb071187c63e21355cd200cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4) 2024-09-19T05:02:18.326 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:18 smithi116 bash[71375]: ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11 2024-09-19T05:02:18.610 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:18 smithi116 podman[71390]: 2024-09-19 05:02:18.325864242 +0000 UTC m=+0.625440693 container remove 225f52ce53b71d41286091675aa98098031e6350bb071187c63e21355cd200cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD) 2024-09-19T05:02:18.955 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:18 smithi116 podman[71481]: 2024-09-19 05:02:18.576288314 +0000 UTC m=+0.015460562 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:02:18.955 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:18 smithi116 podman[71481]: 2024-09-19 05:02:18.693403248 +0000 UTC m=+0.132575541 container create d686715c7b8de01c0a761c90be48dc48bc91f0e0c709752459142612af98ae8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux ) 2024-09-19T05:02:18.955 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:18 smithi116 podman[71481]: 2024-09-19 05:02:18.879286537 +0000 UTC m=+0.318458784 container init d686715c7b8de01c0a761c90be48dc48bc91f0e0c709752459142612af98ae8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS) 2024-09-19T05:02:18.955 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:18 smithi116 podman[71481]: 2024-09-19 05:02:18.882439506 +0000 UTC m=+0.321611763 container start d686715c7b8de01c0a761c90be48dc48bc91f0e0c709752459142612af98ae8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-19T05:02:19.349 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:18 smithi116 podman[71481]: 2024-09-19 05:02:18.954117038 +0000 UTC m=+0.393289294 container attach d686715c7b8de01c0a761c90be48dc48bc91f0e0c709752459142612af98ae8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-19T05:02:19.349 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:19 smithi116 podman[71481]: 2024-09-19 05:02:19.067384183 +0000 UTC m=+0.506556430 container died d686715c7b8de01c0a761c90be48dc48bc91f0e0c709752459142612af98ae8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-19T05:02:19.610 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 19 05:02:19 smithi116 podman[71504]: 2024-09-19 05:02:19.590740775 +0000 UTC m=+0.513784594 container remove d686715c7b8de01c0a761c90be48dc48bc91f0e0c709752459142612af98ae8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-19T05:02:19.615 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@osd.11.service' 2024-09-19T05:02:19.658 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:02:19.658 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-19T05:02:19.658 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-19T05:02:19.658 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-d46630c4-7640-11ef-bceb-c7b262605968@mds.a 2024-09-19T05:02:19.963 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 19 05:02:19 smithi002 systemd[1]: Stopping Ceph mds.a for d46630c4-7640-11ef-bceb-c7b262605968... 2024-09-19T05:02:20.360 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 19 05:02:19 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-a[71944]: 2024-09-19T05:02:19.961+0000 7f4284c62640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:02:20.360 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 19 05:02:19 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-a[71944]: 2024-09-19T05:02:19.962+0000 7f4284c62640 -1 mds.a *** got signal Terminated *** 2024-09-19T05:02:23.360 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 19 05:02:23 smithi002 podman[104601]: 2024-09-19 05:02:23.0557234 +0000 UTC m=+3.195715493 container died 04ce962f102fa1bde7d7f05eff0ab08baf218078b296c364227f5f56b1515195 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-19T05:02:23.780 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 19 05:02:23 smithi002 podman[104601]: 2024-09-19 05:02:23.54508298 +0000 UTC m=+3.685075077 container cleanup 04ce962f102fa1bde7d7f05eff0ab08baf218078b296c364227f5f56b1515195 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-a, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-19T05:02:23.781 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 19 05:02:23 smithi002 bash[104601]: ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-a 2024-09-19T05:02:23.924 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@mds.a.service' 2024-09-19T05:02:23.960 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:02:23.960 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-19T05:02:23.961 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-19T05:02:23.961 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-d46630c4-7640-11ef-bceb-c7b262605968@mds.d 2024-09-19T05:02:24.360 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 19 05:02:24 smithi002 systemd[1]: Stopping Ceph mds.d for d46630c4-7640-11ef-bceb-c7b262605968... 2024-09-19T05:02:24.360 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 19 05:02:24 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-d[70848]: 2024-09-19T05:02:24.282+0000 7f6c737c9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:02:24.360 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 19 05:02:24 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-d[70848]: 2024-09-19T05:02:24.282+0000 7f6c737c9640 -1 mds.d *** got signal Terminated *** 2024-09-19T05:02:28.610 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 19 05:02:28 smithi002 podman[104721]: 2024-09-19 05:02:28.291730234 +0000 UTC m=+4.106160001 container died 51951dea2f187f04b7d431c46ec029654fa200da426389807dbb001f2297c8aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-d, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True) 2024-09-19T05:02:28.992 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 19 05:02:28 smithi002 podman[104721]: 2024-09-19 05:02:28.757039841 +0000 UTC m=+4.571469607 container cleanup 51951dea2f187f04b7d431c46ec029654fa200da426389807dbb001f2297c8aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-d, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD) 2024-09-19T05:02:28.992 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 19 05:02:28 smithi002 bash[104721]: ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-d 2024-09-19T05:02:29.155 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@mds.d.service' 2024-09-19T05:02:29.190 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:02:29.190 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-19T05:02:29.190 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-19T05:02:29.190 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-d46630c4-7640-11ef-bceb-c7b262605968@mds.g 2024-09-19T05:02:29.529 INFO:journalctl@ceph.mds.g.smithi002.stdout:Sep 19 05:02:29 smithi002 systemd[1]: Stopping Ceph mds.g for d46630c4-7640-11ef-bceb-c7b262605968... 2024-09-19T05:02:29.860 INFO:journalctl@ceph.mds.g.smithi002.stdout:Sep 19 05:02:29 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-g[71609]: 2024-09-19T05:02:29.526+0000 7f8cbc9e2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:02:29.860 INFO:journalctl@ceph.mds.g.smithi002.stdout:Sep 19 05:02:29 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-g[71609]: 2024-09-19T05:02:29.526+0000 7f8cbc9e2640 -1 mds.g *** got signal Terminated *** 2024-09-19T05:02:32.820 INFO:journalctl@ceph.mds.g.smithi002.stdout:Sep 19 05:02:32 smithi002 podman[104841]: 2024-09-19 05:02:32.534312633 +0000 UTC m=+3.113523139 container died c4282b95ee0d76c830d0487cefe10a633d7c5c541aecc7a76105c88080e8a790 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-g, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-19T05:02:33.110 INFO:journalctl@ceph.mds.g.smithi002.stdout:Sep 19 05:02:32 smithi002 podman[104841]: 2024-09-19 05:02:32.902587482 +0000 UTC m=+3.481797979 container cleanup c4282b95ee0d76c830d0487cefe10a633d7c5c541aecc7a76105c88080e8a790 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-g, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731) 2024-09-19T05:02:33.110 INFO:journalctl@ceph.mds.g.smithi002.stdout:Sep 19 05:02:32 smithi002 bash[104841]: ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-g 2024-09-19T05:02:33.337 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@mds.g.service' 2024-09-19T05:02:33.370 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:02:33.370 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-19T05:02:33.370 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-19T05:02:33.371 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-d46630c4-7640-11ef-bceb-c7b262605968@mds.j 2024-09-19T05:02:33.757 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 19 05:02:33 smithi002 systemd[1]: Stopping Ceph mds.j for d46630c4-7640-11ef-bceb-c7b262605968... 2024-09-19T05:02:34.110 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 19 05:02:33 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-j[70453]: 2024-09-19T05:02:33.756+0000 7f01b4241640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:02:34.110 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 19 05:02:33 smithi002 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-j[70453]: 2024-09-19T05:02:33.756+0000 7f01b4241640 -1 mds.j *** got signal Terminated *** 2024-09-19T05:02:38.031 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 19 05:02:37 smithi002 podman[104961]: 2024-09-19 05:02:37.766884029 +0000 UTC m=+4.173218108 container died 56a3b4f35edd3d46cbe8dfb1b4ac6bcc0018fcc12471d605f163756e3e6d478b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-j, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:02:38.032 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 19 05:02:38 smithi002 podman[104961]: 2024-09-19 05:02:38.030943163 +0000 UTC m=+4.437277232 container cleanup 56a3b4f35edd3d46cbe8dfb1b4ac6bcc0018fcc12471d605f163756e3e6d478b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-j, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , ceph=True) 2024-09-19T05:02:38.360 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 19 05:02:38 smithi002 bash[104961]: ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-j 2024-09-19T05:02:38.617 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@mds.j.service' 2024-09-19T05:02:38.650 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:02:38.650 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-19T05:02:38.650 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-19T05:02:38.650 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-d46630c4-7640-11ef-bceb-c7b262605968@mds.b 2024-09-19T05:02:38.955 INFO:journalctl@ceph.mds.b.smithi018.stdout:Sep 19 05:02:38 smithi018 systemd[1]: Stopping Ceph mds.b for d46630c4-7640-11ef-bceb-c7b262605968... 2024-09-19T05:02:39.307 INFO:journalctl@ceph.mds.b.smithi018.stdout:Sep 19 05:02:38 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-b[64546]: 2024-09-19T05:02:38.953+0000 7f4df97ac640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:02:39.307 INFO:journalctl@ceph.mds.b.smithi018.stdout:Sep 19 05:02:38 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-b[64546]: 2024-09-19T05:02:38.953+0000 7f4df97ac640 -1 mds.b *** got signal Terminated *** 2024-09-19T05:02:43.308 INFO:journalctl@ceph.mds.b.smithi018.stdout:Sep 19 05:02:42 smithi018 podman[71753]: 2024-09-19 05:02:42.96681591 +0000 UTC m=+4.119864178 container died 06e4de8bb5a95762b22e13cda31b95ea2811e3f3bb5358e3b86286b1bb863320 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-b, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-19T05:02:43.604 INFO:journalctl@ceph.mds.b.smithi018.stdout:Sep 19 05:02:43 smithi018 podman[71753]: 2024-09-19 05:02:43.410957107 +0000 UTC m=+4.564005364 container cleanup 06e4de8bb5a95762b22e13cda31b95ea2811e3f3bb5358e3b86286b1bb863320 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-19T05:02:43.605 INFO:journalctl@ceph.mds.b.smithi018.stdout:Sep 19 05:02:43 smithi018 bash[71753]: ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-b 2024-09-19T05:02:43.822 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@mds.b.service' 2024-09-19T05:02:43.859 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:02:43.859 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-19T05:02:43.859 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-19T05:02:43.859 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-d46630c4-7640-11ef-bceb-c7b262605968@mds.e 2024-09-19T05:02:44.208 INFO:journalctl@ceph.mds.e.smithi018.stdout:Sep 19 05:02:43 smithi018 systemd[1]: Stopping Ceph mds.e for d46630c4-7640-11ef-bceb-c7b262605968... 2024-09-19T05:02:44.557 INFO:journalctl@ceph.mds.e.smithi018.stdout:Sep 19 05:02:44 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-e[63941]: 2024-09-19T05:02:44.205+0000 7f990e9e0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:02:44.557 INFO:journalctl@ceph.mds.e.smithi018.stdout:Sep 19 05:02:44 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-e[63941]: 2024-09-19T05:02:44.205+0000 7f990e9e0640 -1 mds.e *** got signal Terminated *** 2024-09-19T05:02:48.057 INFO:journalctl@ceph.mds.e.smithi018.stdout:Sep 19 05:02:47 smithi018 podman[71887]: 2024-09-19 05:02:47.778631406 +0000 UTC m=+3.700590939 container died a3d5df36f065648eaee3bee35efdd4fd26ac47d5e9afacadafa6cef3a85dfc67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-e, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-19T05:02:48.437 INFO:journalctl@ceph.mds.e.smithi018.stdout:Sep 19 05:02:48 smithi018 podman[71887]: 2024-09-19 05:02:48.089217663 +0000 UTC m=+4.011177191 container cleanup a3d5df36f065648eaee3bee35efdd4fd26ac47d5e9afacadafa6cef3a85dfc67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-e, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-19T05:02:48.437 INFO:journalctl@ceph.mds.e.smithi018.stdout:Sep 19 05:02:48 smithi018 bash[71887]: ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-e 2024-09-19T05:02:48.437 INFO:journalctl@ceph.mds.e.smithi018.stdout:Sep 19 05:02:48 smithi018 podman[71899]: 2024-09-19 05:02:48.315480234 +0000 UTC m=+0.525854694 container remove a3d5df36f065648eaee3bee35efdd4fd26ac47d5e9afacadafa6cef3a85dfc67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-e, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-19T05:02:48.452 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@mds.e.service' 2024-09-19T05:02:48.487 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:02:48.487 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-19T05:02:48.487 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-19T05:02:48.487 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-d46630c4-7640-11ef-bceb-c7b262605968@mds.h 2024-09-19T05:02:48.807 INFO:journalctl@ceph.mds.h.smithi018.stdout:Sep 19 05:02:48 smithi018 systemd[1]: Stopping Ceph mds.h for d46630c4-7640-11ef-bceb-c7b262605968... 2024-09-19T05:02:49.307 INFO:journalctl@ceph.mds.h.smithi018.stdout:Sep 19 05:02:48 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-h[64244]: 2024-09-19T05:02:48.808+0000 7ff8d5559640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:02:49.307 INFO:journalctl@ceph.mds.h.smithi018.stdout:Sep 19 05:02:48 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-h[64244]: 2024-09-19T05:02:48.808+0000 7ff8d5559640 -1 mds.h *** got signal Terminated *** 2024-09-19T05:02:51.427 INFO:journalctl@ceph.mds.h.smithi018.stdout:Sep 19 05:02:51 smithi018 podman[72008]: 2024-09-19 05:02:51.127725717 +0000 UTC m=+2.419253428 container died 1573d33f076b52a8ff5b04d1b3227ed609abb4cc6a2e941e3193265af9bd4f38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-h, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-19T05:02:51.760 INFO:journalctl@ceph.mds.h.smithi018.stdout:Sep 19 05:02:51 smithi018 podman[72008]: 2024-09-19 05:02:51.526017251 +0000 UTC m=+2.817544936 container cleanup 1573d33f076b52a8ff5b04d1b3227ed609abb4cc6a2e941e3193265af9bd4f38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-h, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-19T05:02:51.761 INFO:journalctl@ceph.mds.h.smithi018.stdout:Sep 19 05:02:51 smithi018 bash[72008]: ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-h 2024-09-19T05:02:51.916 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@mds.h.service' 2024-09-19T05:02:51.950 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:02:51.950 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-19T05:02:51.950 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-19T05:02:51.950 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-d46630c4-7640-11ef-bceb-c7b262605968@mds.k 2024-09-19T05:02:52.280 INFO:journalctl@ceph.mds.k.smithi018.stdout:Sep 19 05:02:52 smithi018 systemd[1]: Stopping Ceph mds.k for d46630c4-7640-11ef-bceb-c7b262605968... 2024-09-19T05:02:52.556 INFO:journalctl@ceph.mds.k.smithi018.stdout:Sep 19 05:02:52 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-k[63622]: 2024-09-19T05:02:52.278+0000 7fb048e6e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:02:52.557 INFO:journalctl@ceph.mds.k.smithi018.stdout:Sep 19 05:02:52 smithi018 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-k[63622]: 2024-09-19T05:02:52.278+0000 7fb048e6e640 -1 mds.k *** got signal Terminated *** 2024-09-19T05:02:54.905 INFO:journalctl@ceph.mds.k.smithi018.stdout:Sep 19 05:02:54 smithi018 podman[72130]: 2024-09-19 05:02:54.640152208 +0000 UTC m=+2.461350507 container died 629dab1921dc80c1b913725850c652351e59b2aa226b4e30654d0da9b794ef39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-k, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T05:02:55.264 INFO:journalctl@ceph.mds.k.smithi018.stdout:Sep 19 05:02:54 smithi018 podman[72130]: 2024-09-19 05:02:54.987365716 +0000 UTC m=+2.808564004 container cleanup 629dab1921dc80c1b913725850c652351e59b2aa226b4e30654d0da9b794ef39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-k, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4) 2024-09-19T05:02:55.264 INFO:journalctl@ceph.mds.k.smithi018.stdout:Sep 19 05:02:54 smithi018 bash[72130]: ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-k 2024-09-19T05:02:55.418 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@mds.k.service' 2024-09-19T05:02:55.451 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:02:55.451 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-19T05:02:55.451 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-19T05:02:55.452 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-d46630c4-7640-11ef-bceb-c7b262605968@mds.c 2024-09-19T05:02:55.749 INFO:journalctl@ceph.mds.c.smithi116.stdout:Sep 19 05:02:55 smithi116 systemd[1]: Stopping Ceph mds.c for d46630c4-7640-11ef-bceb-c7b262605968... 2024-09-19T05:02:56.004 INFO:journalctl@ceph.mds.c.smithi116.stdout:Sep 19 05:02:55 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-c[64612]: 2024-09-19T05:02:55.747+0000 7ff12d235640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:02:56.005 INFO:journalctl@ceph.mds.c.smithi116.stdout:Sep 19 05:02:55 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-c[64612]: 2024-09-19T05:02:55.747+0000 7ff12d235640 -1 mds.c *** got signal Terminated *** 2024-09-19T05:03:00.107 INFO:journalctl@ceph.mds.c.smithi116.stdout:Sep 19 05:02:59 smithi116 podman[71582]: 2024-09-19 05:02:59.756828504 +0000 UTC m=+4.109515459 container died be4217314e29ec4a5e1e764b60eefc5c853fc35f36068f9af4cdcb9501a6a274 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-c, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-19T05:03:00.361 INFO:journalctl@ceph.mds.c.smithi116.stdout:Sep 19 05:03:00 smithi116 podman[71582]: 2024-09-19 05:03:00.181263202 +0000 UTC m=+4.533950156 container cleanup be4217314e29ec4a5e1e764b60eefc5c853fc35f36068f9af4cdcb9501a6a274 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-c, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-19T05:03:00.361 INFO:journalctl@ceph.mds.c.smithi116.stdout:Sep 19 05:03:00 smithi116 bash[71582]: ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-c 2024-09-19T05:03:00.614 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@mds.c.service' 2024-09-19T05:03:00.636 INFO:journalctl@ceph.mds.c.smithi116.stdout:Sep 19 05:03:00 smithi116 podman[71608]: 2024-09-19 05:03:00.374053604 +0000 UTC m=+0.612282872 container remove be4217314e29ec4a5e1e764b60eefc5c853fc35f36068f9af4cdcb9501a6a274 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-c, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-19T05:03:00.636 INFO:journalctl@ceph.mds.c.smithi116.stdout:Sep 19 05:03:00 smithi116 systemd[1]: ceph-d46630c4-7640-11ef-bceb-c7b262605968@mds.c.service: Deactivated successfully. 2024-09-19T05:03:00.636 INFO:journalctl@ceph.mds.c.smithi116.stdout:Sep 19 05:03:00 smithi116 systemd[1]: Stopped Ceph mds.c for d46630c4-7640-11ef-bceb-c7b262605968. 2024-09-19T05:03:00.636 INFO:journalctl@ceph.mds.c.smithi116.stdout:Sep 19 05:03:00 smithi116 systemd[1]: ceph-d46630c4-7640-11ef-bceb-c7b262605968@mds.c.service: Consumed 1.080s CPU time. 2024-09-19T05:03:00.649 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:03:00.650 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-19T05:03:00.650 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-19T05:03:00.650 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-d46630c4-7640-11ef-bceb-c7b262605968@mds.f 2024-09-19T05:03:00.995 INFO:journalctl@ceph.mds.f.smithi116.stdout:Sep 19 05:03:00 smithi116 systemd[1]: Stopping Ceph mds.f for d46630c4-7640-11ef-bceb-c7b262605968... 2024-09-19T05:03:01.360 INFO:journalctl@ceph.mds.f.smithi116.stdout:Sep 19 05:03:00 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-f[64309]: 2024-09-19T05:03:00.993+0000 7fc1f93a5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:03:01.361 INFO:journalctl@ceph.mds.f.smithi116.stdout:Sep 19 05:03:00 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-f[64309]: 2024-09-19T05:03:00.993+0000 7fc1f93a5640 -1 mds.f *** got signal Terminated *** 2024-09-19T05:03:02.445 INFO:journalctl@ceph.mds.f.smithi116.stdout:Sep 19 05:03:02 smithi116 podman[71713]: 2024-09-19 05:03:02.180277408 +0000 UTC m=+1.314951374 container died 95553dfaf8def1c0fd5da5f7e1767022d3be9552873f6979bc5d28596e33fb64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-f, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T05:03:02.779 INFO:journalctl@ceph.mds.f.smithi116.stdout:Sep 19 05:03:02 smithi116 podman[71713]: 2024-09-19 05:03:02.551731177 +0000 UTC m=+1.686405149 container cleanup 95553dfaf8def1c0fd5da5f7e1767022d3be9552873f6979bc5d28596e33fb64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-f, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True) 2024-09-19T05:03:02.779 INFO:journalctl@ceph.mds.f.smithi116.stdout:Sep 19 05:03:02 smithi116 bash[71713]: ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-f 2024-09-19T05:03:02.928 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@mds.f.service' 2024-09-19T05:03:02.961 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:03:02.961 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-19T05:03:02.961 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-19T05:03:02.961 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-d46630c4-7640-11ef-bceb-c7b262605968@mds.i 2024-09-19T05:03:03.360 INFO:journalctl@ceph.mds.i.smithi116.stdout:Sep 19 05:03:03 smithi116 systemd[1]: Stopping Ceph mds.i for d46630c4-7640-11ef-bceb-c7b262605968... 2024-09-19T05:03:03.361 INFO:journalctl@ceph.mds.i.smithi116.stdout:Sep 19 05:03:03 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-i[64913]: 2024-09-19T05:03:03.263+0000 7f6fdc6bd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:03:03.361 INFO:journalctl@ceph.mds.i.smithi116.stdout:Sep 19 05:03:03 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-i[64913]: 2024-09-19T05:03:03.263+0000 7f6fdc6bd640 -1 mds.i *** got signal Terminated *** 2024-09-19T05:03:07.361 INFO:journalctl@ceph.mds.i.smithi116.stdout:Sep 19 05:03:07 smithi116 podman[71834]: 2024-09-19 05:03:07.27464018 +0000 UTC m=+4.102221160 container died 4d19e7a3094d77fd465a8f74a3498447e62fa1f5d80d098ce14a4ce0d73a42d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-i, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=) 2024-09-19T05:03:07.791 INFO:journalctl@ceph.mds.i.smithi116.stdout:Sep 19 05:03:07 smithi116 podman[71834]: 2024-09-19 05:03:07.622277389 +0000 UTC m=+4.449858368 container cleanup 4d19e7a3094d77fd465a8f74a3498447e62fa1f5d80d098ce14a4ce0d73a42d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-i, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:03:07.791 INFO:journalctl@ceph.mds.i.smithi116.stdout:Sep 19 05:03:07 smithi116 bash[71834]: ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-i 2024-09-19T05:03:07.996 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@mds.i.service' 2024-09-19T05:03:08.029 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:03:08.029 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-19T05:03:08.029 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-19T05:03:08.029 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-d46630c4-7640-11ef-bceb-c7b262605968@mds.l 2024-09-19T05:03:08.360 INFO:journalctl@ceph.mds.l.smithi116.stdout:Sep 19 05:03:08 smithi116 systemd[1]: Stopping Ceph mds.l for d46630c4-7640-11ef-bceb-c7b262605968... 2024-09-19T05:03:08.861 INFO:journalctl@ceph.mds.l.smithi116.stdout:Sep 19 05:03:08 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-l[64005]: 2024-09-19T05:03:08.375+0000 7f8bfbfae640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:03:08.861 INFO:journalctl@ceph.mds.l.smithi116.stdout:Sep 19 05:03:08 smithi116 ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-l[64005]: 2024-09-19T05:03:08.375+0000 7f8bfbfae640 -1 mds.l *** got signal Terminated *** 2024-09-19T05:03:12.277 INFO:journalctl@ceph.mds.l.smithi116.stdout:Sep 19 05:03:11 smithi116 podman[71953]: 2024-09-19 05:03:11.944075237 +0000 UTC m=+3.696238309 container died f8bd7b31c4c702be2bbc60ac58470c00df99099de8be4cd2911dc8a59732ff09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-l, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-19T05:03:12.552 INFO:journalctl@ceph.mds.l.smithi116.stdout:Sep 19 05:03:12 smithi116 podman[71953]: 2024-09-19 05:03:12.367145763 +0000 UTC m=+4.119308882 container cleanup f8bd7b31c4c702be2bbc60ac58470c00df99099de8be4cd2911dc8a59732ff09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-l, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-19T05:03:12.552 INFO:journalctl@ceph.mds.l.smithi116.stdout:Sep 19 05:03:12 smithi116 bash[71953]: ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-l 2024-09-19T05:03:12.787 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d46630c4-7640-11ef-bceb-c7b262605968@mds.l.service' 2024-09-19T05:03:12.807 INFO:journalctl@ceph.mds.l.smithi116.stdout:Sep 19 05:03:12 smithi116 podman[71965]: 2024-09-19 05:03:12.551278715 +0000 UTC m=+0.598524018 container remove f8bd7b31c4c702be2bbc60ac58470c00df99099de8be4cd2911dc8a59732ff09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-d46630c4-7640-11ef-bceb-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T05:03:12.807 INFO:journalctl@ceph.mds.l.smithi116.stdout:Sep 19 05:03:12 smithi116 systemd[1]: ceph-d46630c4-7640-11ef-bceb-c7b262605968@mds.l.service: Deactivated successfully. 2024-09-19T05:03:12.807 INFO:journalctl@ceph.mds.l.smithi116.stdout:Sep 19 05:03:12 smithi116 systemd[1]: Stopped Ceph mds.l for d46630c4-7640-11ef-bceb-c7b262605968. 2024-09-19T05:03:12.807 INFO:journalctl@ceph.mds.l.smithi116.stdout:Sep 19 05:03:12 smithi116 systemd[1]: ceph-d46630c4-7640-11ef-bceb-c7b262605968@mds.l.service: Consumed 1.088s CPU time. 2024-09-19T05:03:12.818 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:03:12.818 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-19T05:03:12.818 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d46630c4-7640-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T05:03:13.030 INFO:teuthology.orchestra.run.smithi002.stdout:Deleting cluster with fsid: d46630c4-7640-11ef-bceb-c7b262605968 2024-09-19T05:03:15.613 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d46630c4-7640-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T05:03:15.825 INFO:teuthology.orchestra.run.smithi018.stdout:Deleting cluster with fsid: d46630c4-7640-11ef-bceb-c7b262605968 2024-09-19T05:03:18.369 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d46630c4-7640-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T05:03:18.568 INFO:teuthology.orchestra.run.smithi116.stdout:Deleting cluster with fsid: d46630c4-7640-11ef-bceb-c7b262605968 2024-09-19T05:03:20.867 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T05:03:20.902 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T05:03:20.935 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T05:03:20.962 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-19T05:03:20.965 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911642/remote/smithi002/crash 2024-09-19T05:03:20.965 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/crash -- . 2024-09-19T05:03:21.008 INFO:teuthology.orchestra.run.smithi002.stderr:tar: /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T05:03:21.009 INFO:teuthology.orchestra.run.smithi002.stderr:tar: Error is not recoverable: exiting now 2024-09-19T05:03:21.011 DEBUG:teuthology.misc:Transferring archived files from smithi018:/var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911642/remote/smithi018/crash 2024-09-19T05:03:21.011 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/crash -- . 2024-09-19T05:03:21.053 INFO:teuthology.orchestra.run.smithi018.stderr:tar: /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T05:03:21.054 INFO:teuthology.orchestra.run.smithi018.stderr:tar: Error is not recoverable: exiting now 2024-09-19T05:03:21.056 DEBUG:teuthology.misc:Transferring archived files from smithi116:/var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911642/remote/smithi116/crash 2024-09-19T05:03:21.057 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/crash -- . 2024-09-19T05:03:21.092 INFO:teuthology.orchestra.run.smithi116.stderr:tar: /var/lib/ceph/d46630c4-7640-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T05:03:21.092 INFO:teuthology.orchestra.run.smithi116.stderr:tar: Error is not recoverable: exiting now 2024-09-19T05:03:21.093 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-19T05:03:21.094 DEBUG:teuthology.orchestra.run.smithi002:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-19T05:03:21.131 INFO:tasks.cephadm:Compressing logs... 2024-09-19T05:03:21.131 DEBUG:teuthology.orchestra.run.smithi002:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T05:03:21.174 DEBUG:teuthology.orchestra.run.smithi018:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T05:03:21.176 DEBUG:teuthology.orchestra.run.smithi116:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T05:03:21.200 INFO:teuthology.orchestra.run.smithi002.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-19T05:03:21.201 INFO:teuthology.orchestra.run.smithi002.stderr:: No such file or directory 2024-09-19T05:03:21.201 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-osd.9.log 2024-09-19T05:03:21.201 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T05:03:21.201 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T05:03:21.201 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mds.a.log 2024-09-19T05:03:21.201 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T05:03:21.203 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mon.a.log 2024-09-19T05:03:21.204 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mds.g.log 2024-09-19T05:03:21.210 INFO:teuthology.orchestra.run.smithi116.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T05:03:21.210 INFO:teuthology.orchestra.run.smithi116.stderr:: No such file or directory 2024-09-19T05:03:21.210 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T05:03:21.211 INFO:teuthology.orchestra.run.smithi116.stderr:gzip/var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-volume.log: -5 --verbose -- /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mds.i.log 2024-09-19T05:03:21.211 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mon.c.log 2024-09-19T05:03:21.211 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T05:03:21.211 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-osd.11.log 2024-09-19T05:03:21.211 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mon.c.log: /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-19T05:03:21.211 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-osd.11.log: gzip 81.9% -5 --verbose -- /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-19T05:03:21.211 INFO:teuthology.orchestra.run.smithi116.stderr: -- replaced with /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T05:03:21.211 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph.log 2024-09-19T05:03:21.211 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mds.l.log 2024-09-19T05:03:21.211 INFO:teuthology.orchestra.run.smithi116.stderr: 90.5% -- replaced with /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T05:03:21.212 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph.log: 87.5% -- replaced with /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T05:03:21.212 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-osd.8.log 2024-09-19T05:03:21.212 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mgr.z.log 2024-09-19T05:03:21.217 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-osd.8.log: 94.6% -- replaced with /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mds.l.log.gz 2024-09-19T05:03:21.217 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mds.c.log 2024-09-19T05:03:21.217 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mgr.z.log: 91.0% -- replaced with /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T05:03:21.218 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mon.a.log: 84.5% -- replaced with /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T05:03:21.219 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-osd.6.log 2024-09-19T05:03:21.219 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph.log 2024-09-19T05:03:21.219 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mds.g.log: /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-osd.6.log: 90.3% -- replaced with /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T05:03:21.219 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mds.d.log 2024-09-19T05:03:21.219 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph.log: 94.6% -- replaced with /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mds.a.log.gz 2024-09-19T05:03:21.219 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mgr.x.log 2024-09-19T05:03:21.219 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mds.d.log: 87.5% -- replaced with /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T05:03:21.219 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mds.j.log 2024-09-19T05:03:21.219 INFO:teuthology.orchestra.run.smithi002.stderr: 94.6% -- replaced with /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mds.g.log.gz 2024-09-19T05:03:21.219 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mgr.x.log: 94.6% -- replaced with /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mds.d.log.gz 2024-09-19T05:03:21.220 INFO:teuthology.orchestra.run.smithi002.stderr: 90.9% -- replaced with /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T05:03:21.220 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-19T05:03:21.220 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-09-19T05:03:21.220 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T05:03:21.222 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.log: 94.7% -- replaced with /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mds.j.log.gz 2024-09-19T05:03:21.225 INFO:teuthology.orchestra.run.smithi018.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-osd.10.log 2024-09-19T05:03:21.225 INFO:teuthology.orchestra.run.smithi018.stderr:: No such file or directory 2024-09-19T05:03:21.225 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-19T05:03:21.225 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-osd.7.log 2024-09-19T05:03:21.225 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T05:03:21.225 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-osd.1.log: /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mds.b.log 2024-09-19T05:03:21.225 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mds.k.log 2024-09-19T05:03:21.225 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-19T05:03:21.226 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T05:03:21.226 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T05:03:21.226 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph.audit.log: 90.4% -- replaced with /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T05:03:21.226 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mgr.y.log 2024-09-19T05:03:21.226 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph.cephadm.log: 94.5% -- replaced with /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mds.k.log.gz 2024-09-19T05:03:21.226 INFO:teuthology.orchestra.run.smithi018.stderr: 82.0% -- replaced with /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T05:03:21.226 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph.log 2024-09-19T05:03:21.226 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mds.h.log 2024-09-19T05:03:21.226 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph.log: 87.5% -- replaced with /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T05:03:21.226 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mon.b.log 2024-09-19T05:03:21.226 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mds.h.log: 90.8% -- replaced with /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T05:03:21.226 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mds.e.log 2024-09-19T05:03:21.226 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mon.b.log: 94.6% -- replaced with /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mds.h.log.gz 2024-09-19T05:03:21.227 INFO:teuthology.orchestra.run.smithi018.stderr: 91.9% -- replaced with /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mgr.y.log.gz 2024-09-19T05:03:21.227 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T05:03:21.228 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T05:03:21.229 INFO:teuthology.orchestra.run.smithi116.stderr: 92.0% -- replaced with /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mgr.z.log.gz 2024-09-19T05:03:21.229 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mds.f.log 2024-09-19T05:03:21.229 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T05:03:21.229 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mds.f.log: 94.6% -- replaced with /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mds.c.log.gz 2024-09-19T05:03:21.229 INFO:teuthology.orchestra.run.smithi116.stderr: 94.6% -- replaced with /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mds.f.log.gz 2024-09-19T05:03:21.229 INFO:teuthology.orchestra.run.smithi018.stderr: 94.5% -- replaced with /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mds.e.log.gz 2024-09-19T05:03:21.230 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T05:03:21.233 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/cephadm.log: 94.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T05:03:21.400 INFO:teuthology.orchestra.run.smithi018.stderr: 94.6% -- replaced with /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mds.b.log.gz 2024-09-19T05:03:21.474 INFO:teuthology.orchestra.run.smithi116.stderr: 91.8% -- replaced with /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mon.c.log.gz 2024-09-19T05:03:21.493 INFO:teuthology.orchestra.run.smithi018.stderr: 91.8% -- replaced with /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mon.b.log.gz 2024-09-19T05:03:21.578 INFO:teuthology.orchestra.run.smithi116.stderr: 93.1% -- replaced with /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-osd.11.log.gz 2024-09-19T05:03:21.591 INFO:teuthology.orchestra.run.smithi002.stderr: 90.2% -- replaced with /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mgr.x.log.gz 2024-09-19T05:03:21.643 INFO:teuthology.orchestra.run.smithi002.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-09-19T05:03:21.759 INFO:teuthology.orchestra.run.smithi002.stderr: 92.9% -- replaced with /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-osd.6.log.gz 2024-09-19T05:03:21.805 INFO:teuthology.orchestra.run.smithi002.stderr: 93.0% -- replaced with /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-19T05:03:21.821 INFO:teuthology.orchestra.run.smithi018.stderr: 92.7% -- replaced with /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-19T05:03:21.841 INFO:teuthology.orchestra.run.smithi116.stderr: 92.8% -- replaced with /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-19T05:03:21.852 INFO:teuthology.orchestra.run.smithi018.stderr: 93.0% -- replaced with /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-osd.7.log.gz 2024-09-19T05:03:21.914 INFO:teuthology.orchestra.run.smithi116.stderr: 93.0% -- replaced with /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-osd.8.log.gz 2024-09-19T05:03:21.930 INFO:teuthology.orchestra.run.smithi018.stderr: 92.9% -- replaced with /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-19T05:03:21.975 INFO:teuthology.orchestra.run.smithi002.stderr: 93.1% -- replaced with /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-19T05:03:22.030 INFO:teuthology.orchestra.run.smithi002.stderr: 93.1% -- replaced with /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-osd.9.log.gz 2024-09-19T05:03:22.059 INFO:teuthology.orchestra.run.smithi002.stderr: 90.3% -- replaced with /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mon.a.log.gz 2024-09-19T05:03:22.061 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-19T05:03:22.061 INFO:teuthology.orchestra.run.smithi002.stderr:real 0m0.873s 2024-09-19T05:03:22.061 INFO:teuthology.orchestra.run.smithi002.stderr:user 0m4.325s 2024-09-19T05:03:22.061 INFO:teuthology.orchestra.run.smithi002.stderr:sys 0m0.171s 2024-09-19T05:03:22.159 INFO:teuthology.orchestra.run.smithi018.stderr: 93.3% -- replaced with /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-osd.10.log.gz 2024-09-19T05:03:22.161 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-19T05:03:22.161 INFO:teuthology.orchestra.run.smithi018.stderr:real 0m0.969s 2024-09-19T05:03:22.162 INFO:teuthology.orchestra.run.smithi018.stderr:user 0m3.358s 2024-09-19T05:03:22.162 INFO:teuthology.orchestra.run.smithi018.stderr:sys 0m0.129s 2024-09-19T05:03:22.346 INFO:teuthology.orchestra.run.smithi116.stderr: 93.1% -- replaced with /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-19T05:03:23.005 INFO:teuthology.orchestra.run.smithi116.stderr: 93.1% -- replaced with /var/log/ceph/d46630c4-7640-11ef-bceb-c7b262605968/ceph-mds.i.log.gz 2024-09-19T05:03:23.007 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-09-19T05:03:23.007 INFO:teuthology.orchestra.run.smithi116.stderr:real 0m1.816s 2024-09-19T05:03:23.007 INFO:teuthology.orchestra.run.smithi116.stderr:user 0m4.822s 2024-09-19T05:03:23.007 INFO:teuthology.orchestra.run.smithi116.stderr:sys 0m0.183s 2024-09-19T05:03:23.008 INFO:tasks.cephadm:Archiving logs... 2024-09-19T05:03:23.008 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911642/remote/smithi002/log 2024-09-19T05:03:23.009 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T05:03:23.653 DEBUG:teuthology.misc:Transferring archived files from smithi018:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911642/remote/smithi018/log 2024-09-19T05:03:23.654 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T05:03:24.143 DEBUG:teuthology.misc:Transferring archived files from smithi116:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911642/remote/smithi116/log 2024-09-19T05:03:24.144 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T05:03:24.866 INFO:tasks.cephadm:Removing cluster... 2024-09-19T05:03:24.867 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d46630c4-7640-11ef-bceb-c7b262605968 --force 2024-09-19T05:03:25.071 INFO:teuthology.orchestra.run.smithi002.stdout:Deleting cluster with fsid: d46630c4-7640-11ef-bceb-c7b262605968 2024-09-19T05:03:25.341 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d46630c4-7640-11ef-bceb-c7b262605968 --force 2024-09-19T05:03:25.554 INFO:teuthology.orchestra.run.smithi018.stdout:Deleting cluster with fsid: d46630c4-7640-11ef-bceb-c7b262605968 2024-09-19T05:03:25.825 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d46630c4-7640-11ef-bceb-c7b262605968 --force 2024-09-19T05:03:26.018 INFO:teuthology.orchestra.run.smithi116.stdout:Deleting cluster with fsid: d46630c4-7640-11ef-bceb-c7b262605968 2024-09-19T05:03:26.281 INFO:tasks.cephadm:Removing cephadm ... 2024-09-19T05:03:26.281 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T05:03:26.301 DEBUG:teuthology.orchestra.run.smithi018:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T05:03:26.319 DEBUG:teuthology.orchestra.run.smithi116:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T05:03:26.334 INFO:tasks.cephadm:Teardown complete 2024-09-19T05:03:26.334 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-19T05:03:26.345 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-19T05:03:26.345 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T05:03:26.348 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T05:03:26.361 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T05:03:26.475 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-19T05:03:26.487 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-19T05:03:26.488 DEBUG:teuthology.orchestra.run.smithi002:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T05:03:26.491 DEBUG:teuthology.orchestra.run.smithi018:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T05:03:26.493 DEBUG:teuthology.orchestra.run.smithi116:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T05:03:26.506 INFO:teuthology.orchestra.run.smithi002.stderr:bash: line 1: ntpq: command not found 2024-09-19T05:03:26.506 INFO:teuthology.orchestra.run.smithi018.stderr:bash: line 1: ntpq: command not found 2024-09-19T05:03:26.507 INFO:teuthology.orchestra.run.smithi116.stderr:bash: line 1: ntpq: command not found 2024-09-19T05:03:26.512 INFO:teuthology.orchestra.run.smithi116.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T05:03:26.512 INFO:teuthology.orchestra.run.smithi116.stdout:=============================================================================== 2024-09-19T05:03:26.513 INFO:teuthology.orchestra.run.smithi116.stdout:^* hv01.front.sepia.ceph.com 3 6 377 5 -53us[ -55us] +/- 65ms 2024-09-19T05:03:26.513 INFO:teuthology.orchestra.run.smithi116.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 8 +214us[ +212us] +/- 63ms 2024-09-19T05:03:26.513 INFO:teuthology.orchestra.run.smithi116.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 6 -197us[ -200us] +/- 72ms 2024-09-19T05:03:26.513 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:03:26.516 INFO:teuthology.orchestra.run.smithi002.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T05:03:26.516 INFO:teuthology.orchestra.run.smithi002.stdout:=============================================================================== 2024-09-19T05:03:26.516 INFO:teuthology.orchestra.run.smithi002.stdout:^* hv01.front.sepia.ceph.com 3 6 377 7 -50us[ -52us] +/- 65ms 2024-09-19T05:03:26.516 INFO:teuthology.orchestra.run.smithi002.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 7 +232us[ +231us] +/- 63ms 2024-09-19T05:03:26.517 INFO:teuthology.orchestra.run.smithi002.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 7 -206us[ -207us] +/- 72ms 2024-09-19T05:03:26.517 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:03:26.517 INFO:teuthology.orchestra.run.smithi018.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T05:03:26.517 INFO:teuthology.orchestra.run.smithi018.stdout:=============================================================================== 2024-09-19T05:03:26.517 INFO:teuthology.orchestra.run.smithi018.stdout:^* hv01.front.sepia.ceph.com 3 6 377 7 -41us[ -44us] +/- 65ms 2024-09-19T05:03:26.518 INFO:teuthology.orchestra.run.smithi018.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 9 +211us[ +209us] +/- 63ms 2024-09-19T05:03:26.518 INFO:teuthology.orchestra.run.smithi018.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 6 -201us[ -201us] +/- 72ms 2024-09-19T05:03:26.518 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:03:26.518 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-19T05:03:26.530 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-19T05:03:26.530 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-19T05:03:26.540 DEBUG:teuthology.orchestra.run.smithi002:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T05:03:26.644 DEBUG:teuthology.orchestra.run.smithi018:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T05:03:26.718 DEBUG:teuthology.orchestra.run.smithi116:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T05:03:26.786 DEBUG:teuthology.orchestra.run.smithi002:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T05:03:26.818 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:03:26.819 DEBUG:teuthology.orchestra.run.smithi018:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T05:03:26.848 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:03:26.849 DEBUG:teuthology.orchestra.run.smithi116:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T05:03:26.877 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:03:26.878 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-19T05:03:26.889 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-19T05:03:26.899 INFO:teuthology.task.internal:Duration was 1922.511228 seconds 2024-09-19T05:03:26.899 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-19T05:03:26.910 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-19T05:03:26.911 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T05:03:26.914 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T05:03:26.916 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T05:03:26.954 INFO:teuthology.orchestra.run.smithi002.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T05:03:26.956 INFO:teuthology.orchestra.run.smithi116.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T05:03:26.956 INFO:teuthology.orchestra.run.smithi018.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T05:03:27.345 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-19T05:03:27.345 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi002.front.sepia.ceph.com 2024-09-19T05:03:27.345 DEBUG:teuthology.orchestra.run.smithi002:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T05:03:27.367 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi018.front.sepia.ceph.com 2024-09-19T05:03:27.367 DEBUG:teuthology.orchestra.run.smithi018:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T05:03:27.411 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi116.front.sepia.ceph.com 2024-09-19T05:03:27.412 DEBUG:teuthology.orchestra.run.smithi116:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T05:03:27.441 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-19T05:03:27.441 DEBUG:teuthology.orchestra.run.smithi002:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T05:03:27.443 DEBUG:teuthology.orchestra.run.smithi018:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T05:03:27.455 DEBUG:teuthology.orchestra.run.smithi116:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T05:03:27.508 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-19T05:03:27.508 DEBUG:teuthology.orchestra.run.smithi002:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T05:03:27.512 DEBUG:teuthology.orchestra.run.smithi018:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T05:03:27.522 DEBUG:teuthology.orchestra.run.smithi116:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T05:03:28.477 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-19T05:03:28.488 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-19T05:03:28.488 DEBUG:teuthology.orchestra.run.smithi002:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T05:03:28.514 DEBUG:teuthology.orchestra.run.smithi018:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T05:03:28.545 DEBUG:teuthology.orchestra.run.smithi116:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T05:03:28.573 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-19T05:03:28.584 DEBUG:teuthology.orchestra.run.smithi002:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T05:03:28.586 DEBUG:teuthology.orchestra.run.smithi018:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T05:03:28.589 DEBUG:teuthology.orchestra.run.smithi116:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T05:03:28.608 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern = core 2024-09-19T05:03:28.615 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern = core 2024-09-19T05:03:28.638 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern = core 2024-09-19T05:03:28.773 DEBUG:teuthology.orchestra.run.smithi002:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T05:03:28.788 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:03:28.789 DEBUG:teuthology.orchestra.run.smithi018:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T05:03:28.805 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:03:28.806 DEBUG:teuthology.orchestra.run.smithi116:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T05:03:28.829 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:03:28.830 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-19T05:03:28.841 INFO:teuthology.task.internal:Transferring archived files... 2024-09-19T05:03:28.842 DEBUG:teuthology.misc:Transferring archived files from smithi002:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911642/remote/smithi002 2024-09-19T05:03:28.842 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T05:03:28.900 DEBUG:teuthology.misc:Transferring archived files from smithi018:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911642/remote/smithi018 2024-09-19T05:03:28.900 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T05:03:28.942 DEBUG:teuthology.misc:Transferring archived files from smithi116:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911642/remote/smithi116 2024-09-19T05:03:28.942 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T05:03:28.980 INFO:teuthology.task.internal:Removing archive directory... 2024-09-19T05:03:28.980 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T05:03:28.983 DEBUG:teuthology.orchestra.run.smithi018:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T05:03:28.985 DEBUG:teuthology.orchestra.run.smithi116:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T05:03:29.031 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-19T05:03:29.043 INFO:teuthology.task.internal:Not uploading archives. 2024-09-19T05:03:29.043 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-19T05:03:29.054 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-19T05:03:29.054 DEBUG:teuthology.orchestra.run.smithi002:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T05:03:29.056 DEBUG:teuthology.orchestra.run.smithi018:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T05:03:29.059 DEBUG:teuthology.orchestra.run.smithi116:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T05:03:29.070 INFO:teuthology.orchestra.run.smithi002.stdout: 265558 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 05:03 /home/ubuntu/cephtest 2024-09-19T05:03:29.074 INFO:teuthology.orchestra.run.smithi018.stdout: 266055 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 05:03 /home/ubuntu/cephtest 2024-09-19T05:03:29.086 INFO:teuthology.orchestra.run.smithi116.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 05:03 /home/ubuntu/cephtest 2024-09-19T05:03:29.088 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-19T05:03:29.099 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-19T05:03:29.123 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/fs/test_o_trunc}} duration: 1922.5112280845642 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-19T05:03:29.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T05:03:29.220 INFO:teuthology.run:pass